2023-07-25T14:20:47.566 INFO:root:teuthology version: 0.0.1.dev160+g407880c 2023-07-25T14:20:47.567 DEBUG:teuthology.run:Teuthology command: teuthology --archive /home/teuthworker/archive/vshankar-2023-07-25_11:29:34-fs-wip-vshankar-testing-20230725.043804-testing-default-smithi/7350676 --name vshankar-2023-07-25_11:29:34-fs-wip-vshankar-testing-20230725.043804-testing-default-smithi --owner scheduled_vshankar@teuthology --description fs/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug} tasks/multifs-auth} --verbose -- /home/teuthworker/archive/vshankar-2023-07-25_11:29:34-fs-wip-vshankar-testing-20230725.043804-testing-default-smithi/7350676/orig.config.yaml 2023-07-25T14:20:47.621 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-25T14:20:47.711 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/vshankar-2023-07-25_11:29:34-fs-wip-vshankar-testing-20230725.043804-testing-default-smithi/7350676 branch: wip-vshankar-testing-20230725.043804 description: fs/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug} tasks/multifs-auth} email: vshankar@redhat.com first_in_suite: false job_id: '7350676' kernel: client: sha1: distro flavor: default kdb: true sha1: bbae19e0824be3daf9282aaf5330af10cdf81109 ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: vshankar-2023-07-25_11:29:34-fs-wip-vshankar-testing-20230725.043804-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: rhel os_version: '8.6' overrides: admin_socket: branch: wip-vshankar-testing-20230725.043804 ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: a5d48e8c688c2543997a98b8acbae2ce9635578c ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 install: ceph: flavor: default sha1: a5d48e8c688c2543997a98b8acbae2ce9635578c kclient: syntax: v1 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-vshankar-testing-20230725.043804 sha1: a5d48e8c688c2543997a98b8acbae2ce9635578c owner: scheduled_vshankar@teuthology priority: 150 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 seed: 9167 sha1: a5d48e8c688c2543997a98b8acbae2ce9635578c sleep_before_teardown: 0 subset: 269/1024 suite: fs suite_branch: wip-vshankar-testing-20230725.043804 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_a5d48e8c688c2543997a98b8acbae2ce9635578c/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: a5d48e8c688c2543997a98b8acbae2ce9635578c syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi072.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac= smithi092.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: null - kclient: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.test_multifs_auth teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 407880c6d3fb77318fff01c863715090f9c2de69 timestamp: 2023-07-25_11:29:34 tube: smithi user: vshankar verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.23459 2023-07-25T14:20:47.712 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_a5d48e8c688c2543997a98b8acbae2ce9635578c/qa; will attempt to use it 2023-07-25T14:20:47.712 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_a5d48e8c688c2543997a98b8acbae2ce9635578c/qa/tasks 2023-07-25T14:20:47.713 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-07-25T14:20:47.714 INFO:teuthology.task.internal:Checking packages... 2023-07-25T14:20:47.742 INFO:teuthology.task.internal:Checking packages for os_type 'rhel', flavor 'default' and ceph hash 'a5d48e8c688c2543997a98b8acbae2ce9635578c' 2023-07-25T14:20:47.742 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-07-25T14:20:47.742 INFO:teuthology.packaging:ref: None 2023-07-25T14:20:47.743 INFO:teuthology.packaging:tag: None 2023-07-25T14:20:47.743 INFO:teuthology.packaging:branch: wip-vshankar-testing-20230725.043804 2023-07-25T14:20:47.743 INFO:teuthology.packaging:sha1: a5d48e8c688c2543997a98b8acbae2ce9635578c 2023-07-25T14:20:47.743 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-vshankar-testing-20230725.043804 2023-07-25T14:20:48.150 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-5128.ga5d48e8c 2023-07-25T14:20:48.150 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-07-25T14:20:48.157 INFO:teuthology.task.internal:no buildpackages task found 2023-07-25T14:20:48.157 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-07-25T14:20:48.177 INFO:teuthology.task.internal:Saving configuration 2023-07-25T14:20:48.192 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-07-25T14:20:48.197 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-25T14:20:48.224 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi072.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-07-25_11:29:34-fs-wip-vshankar-testing-20230725.043804-testing-default-smithi/7350676', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-25 14:13:54.102741', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-07-25T14:20:48.251 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi092.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-07-25_11:29:34-fs-wip-vshankar-testing-20230725.043804-testing-default-smithi/7350676', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-25 14:13:54.101086', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-07-25T14:20:48.251 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-07-25T14:20:48.257 INFO:teuthology.task.internal:roles: ubuntu@smithi072.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2023-07-25T14:20:48.258 INFO:teuthology.task.internal:roles: ubuntu@smithi092.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1'] 2023-07-25T14:20:48.258 INFO:teuthology.run_tasks:Running task console_log... 2023-07-25T14:20:48.346 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f3c9817ce50>, signals=[15]) 2023-07-25T14:20:48.347 INFO:teuthology.run_tasks:Running task internal.connect... 2023-07-25T14:20:48.353 INFO:teuthology.task.internal:Opening connections... 2023-07-25T14:20:48.353 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi072.front.sepia.ceph.com 2023-07-25T14:20:48.355 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-25T14:20:48.423 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi092.front.sepia.ceph.com 2023-07-25T14:20:48.424 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-25T14:20:48.491 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-07-25T14:20:48.498 DEBUG:teuthology.orchestra.run.smithi072:> uname -m 2023-07-25T14:20:48.519 INFO:teuthology.orchestra.run.smithi072.stdout:x86_64 2023-07-25T14:20:48.519 DEBUG:teuthology.orchestra.run.smithi072:> cat /etc/os-release 2023-07-25T14:20:48.577 INFO:teuthology.orchestra.run.smithi072.stdout:NAME="Red Hat Enterprise Linux" 2023-07-25T14:20:48.578 INFO:teuthology.orchestra.run.smithi072.stdout:VERSION="8.6 (Ootpa)" 2023-07-25T14:20:48.578 INFO:teuthology.orchestra.run.smithi072.stdout:ID="rhel" 2023-07-25T14:20:48.578 INFO:teuthology.orchestra.run.smithi072.stdout:ID_LIKE="fedora" 2023-07-25T14:20:48.579 INFO:teuthology.orchestra.run.smithi072.stdout:VERSION_ID="8.6" 2023-07-25T14:20:48.579 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM_ID="platform:el8" 2023-07-25T14:20:48.579 INFO:teuthology.orchestra.run.smithi072.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-25T14:20:48.579 INFO:teuthology.orchestra.run.smithi072.stdout:ANSI_COLOR="0;31" 2023-07-25T14:20:48.579 INFO:teuthology.orchestra.run.smithi072.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-25T14:20:48.580 INFO:teuthology.orchestra.run.smithi072.stdout:HOME_URL="https://www.redhat.com/" 2023-07-25T14:20:48.580 INFO:teuthology.orchestra.run.smithi072.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-25T14:20:48.580 INFO:teuthology.orchestra.run.smithi072.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-25T14:20:48.580 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-25T14:20:48.581 INFO:teuthology.orchestra.run.smithi072.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-25T14:20:48.581 INFO:teuthology.orchestra.run.smithi072.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-25T14:20:48.581 INFO:teuthology.orchestra.run.smithi072.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-25T14:20:48.581 INFO:teuthology.orchestra.run.smithi072.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-25T14:20:48.582 INFO:teuthology.lock.ops:Updating smithi072.front.sepia.ceph.com on lock server 2023-07-25T14:20:48.611 DEBUG:teuthology.orchestra.run.smithi092:> uname -m 2023-07-25T14:20:48.632 INFO:teuthology.orchestra.run.smithi092.stdout:x86_64 2023-07-25T14:20:48.632 DEBUG:teuthology.orchestra.run.smithi092:> cat /etc/os-release 2023-07-25T14:20:48.691 INFO:teuthology.orchestra.run.smithi092.stdout:NAME="Red Hat Enterprise Linux" 2023-07-25T14:20:48.691 INFO:teuthology.orchestra.run.smithi092.stdout:VERSION="8.6 (Ootpa)" 2023-07-25T14:20:48.691 INFO:teuthology.orchestra.run.smithi092.stdout:ID="rhel" 2023-07-25T14:20:48.691 INFO:teuthology.orchestra.run.smithi092.stdout:ID_LIKE="fedora" 2023-07-25T14:20:48.692 INFO:teuthology.orchestra.run.smithi092.stdout:VERSION_ID="8.6" 2023-07-25T14:20:48.692 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM_ID="platform:el8" 2023-07-25T14:20:48.692 INFO:teuthology.orchestra.run.smithi092.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-25T14:20:48.692 INFO:teuthology.orchestra.run.smithi092.stdout:ANSI_COLOR="0;31" 2023-07-25T14:20:48.692 INFO:teuthology.orchestra.run.smithi092.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-25T14:20:48.692 INFO:teuthology.orchestra.run.smithi092.stdout:HOME_URL="https://www.redhat.com/" 2023-07-25T14:20:48.692 INFO:teuthology.orchestra.run.smithi092.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-25T14:20:48.693 INFO:teuthology.orchestra.run.smithi092.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-25T14:20:48.693 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-07-25T14:20:48.693 INFO:teuthology.orchestra.run.smithi092.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-25T14:20:48.693 INFO:teuthology.orchestra.run.smithi092.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-25T14:20:48.693 INFO:teuthology.orchestra.run.smithi092.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-25T14:20:48.693 INFO:teuthology.orchestra.run.smithi092.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-25T14:20:48.694 INFO:teuthology.lock.ops:Updating smithi092.front.sepia.ceph.com on lock server 2023-07-25T14:20:48.719 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-07-25T14:20:48.728 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-07-25T14:20:48.733 INFO:teuthology.task.internal:Checking for old test directory... 2023-07-25T14:20:48.733 DEBUG:teuthology.orchestra.run.smithi072:> test '!' -e /home/ubuntu/cephtest 2023-07-25T14:20:48.736 DEBUG:teuthology.orchestra.run.smithi092:> test '!' -e /home/ubuntu/cephtest 2023-07-25T14:20:48.754 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-07-25T14:20:48.759 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-07-25T14:20:48.760 DEBUG:teuthology.orchestra.run.smithi072:> test -z $(ls -A /var/lib/ceph) 2023-07-25T14:20:48.794 DEBUG:teuthology.orchestra.run.smithi092:> test -z $(ls -A /var/lib/ceph) 2023-07-25T14:20:48.823 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-07-25T14:20:48.885 INFO:teuthology.run_tasks:Running task kernel... 2023-07-25T14:20:48.901 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'flavor': 'default', 'kdb': True, 'sha1': 'bbae19e0824be3daf9282aaf5330af10cdf81109'} 2023-07-25T14:20:48.903 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}} 2023-07-25T14:20:48.903 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}}, timeout 300 2023-07-25T14:20:48.904 DEBUG:teuthology.orchestra.run.smithi072:> test -f /run/.containerenv -o -f /.dockerenv 2023-07-25T14:20:48.905 DEBUG:teuthology.orchestra.run.smithi092:> test -f /run/.containerenv -o -f /.dockerenv 2023-07-25T14:20:48.923 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-25T14:20:48.924 DEBUG:teuthology.orchestra.run.smithi092:> uname -r 2023-07-25T14:20:48.925 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-25T14:20:48.926 DEBUG:teuthology.orchestra.run.smithi072:> uname -r 2023-07-25T14:20:48.983 INFO:teuthology.orchestra.run.smithi092.stdout:4.18.0-372.9.1.el8.x86_64 2023-07-25T14:20:48.984 INFO:teuthology.task.kernel:Running kernel on smithi092: 4.18.0-372.9.1.el8.x86_64 2023-07-25T14:20:48.984 DEBUG:teuthology.orchestra.run.smithi092:> sudo yum install -y kernel 2023-07-25T14:20:48.986 INFO:teuthology.orchestra.run.smithi072.stdout:4.18.0-372.9.1.el8.x86_64 2023-07-25T14:20:48.987 INFO:teuthology.task.kernel:Running kernel on smithi072: 4.18.0-372.9.1.el8.x86_64 2023-07-25T14:20:48.987 DEBUG:teuthology.orchestra.run.smithi072:> sudo yum install -y kernel 2023-07-25T14:20:50.179 INFO:teuthology.orchestra.run.smithi092.stdout:Updating Subscription Management repositories. 2023-07-25T14:20:50.180 INFO:teuthology.orchestra.run.smithi092.stdout:Unable to read consumer identity 2023-07-25T14:20:50.446 INFO:teuthology.orchestra.run.smithi072.stdout:Updating Subscription Management repositories. 2023-07-25T14:20:50.446 INFO:teuthology.orchestra.run.smithi072.stdout:Unable to read consumer identity 2023-07-25T14:20:51.839 INFO:teuthology.orchestra.run.smithi092.stdout:Copr repo for python3-asyncssh owned by ceph 8.3 kB/s | 3.5 kB 00:00 2023-07-25T14:20:53.266 INFO:teuthology.orchestra.run.smithi072.stdout:Copr repo for python3-asyncssh owned by ceph 8.3 kB/s | 3.5 kB 00:00 2023-07-25T14:20:53.765 INFO:teuthology.orchestra.run.smithi092.stdout:Extra Packages for Enterprise Linux 8.2 MB/s | 16 MB 00:01 2023-07-25T14:20:57.214 INFO:teuthology.orchestra.run.smithi092.stdout:lab-extras 561 kB/s | 24 kB 00:00 2023-07-25T14:20:57.267 INFO:teuthology.orchestra.run.smithi072.stdout:Extra Packages for Enterprise Linux 3.9 MB/s | 16 MB 00:03 2023-07-25T14:20:57.891 INFO:teuthology.orchestra.run.smithi092.stdout:Package kernel-4.18.0-372.9.1.el8.x86_64 is already installed. 2023-07-25T14:20:57.950 INFO:teuthology.orchestra.run.smithi092.stdout:Dependencies resolved. 2023-07-25T14:20:57.951 INFO:teuthology.orchestra.run.smithi092.stdout:Nothing to do. 2023-07-25T14:20:57.951 INFO:teuthology.orchestra.run.smithi092.stdout:Complete! 2023-07-25T14:20:58.064 DEBUG:teuthology.orchestra.run.smithi092:> echo no | sudo yum reinstall kernel || true 2023-07-25T14:20:58.434 INFO:teuthology.orchestra.run.smithi092.stdout:Updating Subscription Management repositories. 2023-07-25T14:20:58.434 INFO:teuthology.orchestra.run.smithi092.stdout:Unable to read consumer identity 2023-07-25T14:20:58.696 INFO:teuthology.orchestra.run.smithi092.stdout:Last metadata expiration check: 0:00:01 ago on Tue 25 Jul 2023 02:20:57 PM UTC. 2023-07-25T14:20:58.740 INFO:teuthology.orchestra.run.smithi092.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-07-25T14:20:58.774 INFO:teuthology.orchestra.run.smithi092.stderr:Error: No packages marked for reinstall. 2023-07-25T14:20:58.820 DEBUG:teuthology.orchestra.run.smithi092:> sudo yum reinstall -y kernel || true 2023-07-25T14:20:59.147 INFO:teuthology.orchestra.run.smithi092.stdout:Updating Subscription Management repositories. 2023-07-25T14:20:59.147 INFO:teuthology.orchestra.run.smithi092.stdout:Unable to read consumer identity 2023-07-25T14:20:59.397 INFO:teuthology.orchestra.run.smithi092.stdout:Last metadata expiration check: 0:00:02 ago on Tue 25 Jul 2023 02:20:57 PM UTC. 2023-07-25T14:20:59.436 INFO:teuthology.orchestra.run.smithi092.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-07-25T14:20:59.458 INFO:teuthology.orchestra.run.smithi092.stderr:Error: No packages marked for reinstall. 2023-07-25T14:20:59.507 DEBUG:teuthology.orchestra.run.smithi092:> rpm -q kernel | sort -rV | head -n 1 2023-07-25T14:20:59.588 INFO:teuthology.orchestra.run.smithi092.stdout:kernel-4.18.0-372.9.1.el8.x86_64 2023-07-25T14:20:59.588 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-372.9.1.el8.x86_64 2023-07-25T14:20:59.589 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2023-07-25T14:20:59.589 DEBUG:teuthology.parallel:result is None 2023-07-25T14:21:00.668 INFO:teuthology.orchestra.run.smithi072.stdout:lab-extras 434 kB/s | 24 kB 00:00 2023-07-25T14:21:01.407 INFO:teuthology.orchestra.run.smithi072.stdout:Package kernel-4.18.0-372.9.1.el8.x86_64 is already installed. 2023-07-25T14:21:01.492 INFO:teuthology.orchestra.run.smithi072.stdout:Dependencies resolved. 2023-07-25T14:21:01.493 INFO:teuthology.orchestra.run.smithi072.stdout:Nothing to do. 2023-07-25T14:21:01.493 INFO:teuthology.orchestra.run.smithi072.stdout:Complete! 2023-07-25T14:21:01.616 DEBUG:teuthology.orchestra.run.smithi072:> echo no | sudo yum reinstall kernel || true 2023-07-25T14:21:01.950 INFO:teuthology.orchestra.run.smithi072.stdout:Updating Subscription Management repositories. 2023-07-25T14:21:01.950 INFO:teuthology.orchestra.run.smithi072.stdout:Unable to read consumer identity 2023-07-25T14:21:02.209 INFO:teuthology.orchestra.run.smithi072.stdout:Last metadata expiration check: 0:00:02 ago on Tue 25 Jul 2023 02:21:00 PM UTC. 2023-07-25T14:21:02.258 INFO:teuthology.orchestra.run.smithi072.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-07-25T14:21:02.313 INFO:teuthology.orchestra.run.smithi072.stderr:Error: No packages marked for reinstall. 2023-07-25T14:21:02.358 DEBUG:teuthology.orchestra.run.smithi072:> sudo yum reinstall -y kernel || true 2023-07-25T14:21:02.686 INFO:teuthology.orchestra.run.smithi072.stdout:Updating Subscription Management repositories. 2023-07-25T14:21:02.687 INFO:teuthology.orchestra.run.smithi072.stdout:Unable to read consumer identity 2023-07-25T14:21:02.940 INFO:teuthology.orchestra.run.smithi072.stdout:Last metadata expiration check: 0:00:03 ago on Tue 25 Jul 2023 02:21:00 PM UTC. 2023-07-25T14:21:02.979 INFO:teuthology.orchestra.run.smithi072.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-07-25T14:21:03.010 INFO:teuthology.orchestra.run.smithi072.stderr:Error: No packages marked for reinstall. 2023-07-25T14:21:03.060 DEBUG:teuthology.orchestra.run.smithi072:> rpm -q kernel | sort -rV | head -n 1 2023-07-25T14:21:03.140 INFO:teuthology.orchestra.run.smithi072.stdout:kernel-4.18.0-372.9.1.el8.x86_64 2023-07-25T14:21:03.141 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-372.9.1.el8.x86_64 2023-07-25T14:21:03.141 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2023-07-25T14:21:03.142 DEBUG:teuthology.parallel:result is None 2023-07-25T14:21:03.142 INFO:teuthology.run_tasks:Running task internal.base... 2023-07-25T14:21:03.152 INFO:teuthology.task.internal:Creating test directory... 2023-07-25T14:21:03.152 DEBUG:teuthology.orchestra.run.smithi072:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-07-25T14:21:03.155 DEBUG:teuthology.orchestra.run.smithi092:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-07-25T14:21:03.176 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-07-25T14:21:03.182 INFO:teuthology.run_tasks:Running task internal.archive... 2023-07-25T14:21:03.188 INFO:teuthology.task.internal:Creating archive directory... 2023-07-25T14:21:03.189 DEBUG:teuthology.orchestra.run.smithi072:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-07-25T14:21:03.211 DEBUG:teuthology.orchestra.run.smithi092:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-07-25T14:21:03.241 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-07-25T14:21:03.247 INFO:teuthology.task.internal:Enabling coredump saving... 2023-07-25T14:21:03.247 DEBUG:teuthology.orchestra.run.smithi072:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-07-25T14:21:03.268 DEBUG:teuthology.orchestra.run.smithi092:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-07-25T14:21:03.299 INFO:teuthology.orchestra.run.smithi072.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-07-25T14:21:03.312 INFO:teuthology.orchestra.run.smithi072.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-07-25T14:21:03.320 INFO:teuthology.orchestra.run.smithi092.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-07-25T14:21:03.333 INFO:teuthology.orchestra.run.smithi092.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-07-25T14:21:03.335 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-07-25T14:21:03.343 INFO:teuthology.task.internal:Configuring sudo... 2023-07-25T14:21:03.343 DEBUG:teuthology.orchestra.run.smithi072:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-07-25T14:21:03.355 DEBUG:teuthology.orchestra.run.smithi092:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-07-25T14:21:03.387 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-07-25T14:21:03.396 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-07-25T14:21:03.396 DEBUG:teuthology.orchestra.run.smithi072:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-07-25T14:21:03.421 DEBUG:teuthology.orchestra.run.smithi092:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-07-25T14:21:03.447 DEBUG:teuthology.orchestra.run.smithi072:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-07-25T14:21:08.525 DEBUG:teuthology.orchestra.run.smithi072:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-07-25T14:21:08.589 DEBUG:teuthology.orchestra.run.smithi072:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-07-25T14:21:13.643 DEBUG:teuthology.orchestra.run.smithi072:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-07-25T14:21:13.675 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-07-25T14:21:13.676 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-07-25T14:21:13.755 DEBUG:teuthology.orchestra.run.smithi092:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-07-25T14:21:26.056 DEBUG:teuthology.orchestra.run.smithi092:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-07-25T14:21:26.094 DEBUG:teuthology.orchestra.run.smithi092:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-07-25T14:21:26.175 DEBUG:teuthology.orchestra.run.smithi092:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-07-25T14:21:26.229 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-07-25T14:21:26.229 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-07-25T14:21:26.301 DEBUG:teuthology.orchestra.run.smithi072:> sudo service rsyslog restart 2023-07-25T14:21:26.304 DEBUG:teuthology.orchestra.run.smithi092:> sudo service rsyslog restart 2023-07-25T14:21:26.384 INFO:teuthology.orchestra.run.smithi072.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-07-25T14:21:26.404 INFO:teuthology.orchestra.run.smithi092.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-07-25T14:21:26.836 INFO:teuthology.run_tasks:Running task internal.timer... 2023-07-25T14:21:26.844 INFO:teuthology.task.internal:Starting timer... 2023-07-25T14:21:26.844 INFO:teuthology.run_tasks:Running task pcp... 2023-07-25T14:21:26.854 INFO:teuthology.run_tasks:Running task selinux... 2023-07-25T14:21:26.862 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:logrotate_t:s0']} 2023-07-25T14:21:26.863 DEBUG:teuthology.orchestra.run.smithi072:> sudo service auditd rotate 2023-07-25T14:21:26.931 INFO:teuthology.orchestra.run.smithi072.stdout:Rotating logs: 2023-07-25T14:21:26.933 DEBUG:teuthology.orchestra.run.smithi092:> sudo service auditd rotate 2023-07-25T14:21:26.999 INFO:teuthology.orchestra.run.smithi092.stdout:Rotating logs: 2023-07-25T14:21:27.001 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-07-25T14:21:27.001 DEBUG:teuthology.orchestra.run.smithi072:> /usr/sbin/getenforce 2023-07-25T14:21:27.026 INFO:teuthology.orchestra.run.smithi072.stdout:Permissive 2023-07-25T14:21:27.026 DEBUG:teuthology.orchestra.run.smithi092:> /usr/sbin/getenforce 2023-07-25T14:21:27.046 INFO:teuthology.orchestra.run.smithi092.stdout:Permissive 2023-07-25T14:21:27.046 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi072.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi092.front.sepia.ceph.com': 'permissive'} 2023-07-25T14:21:27.046 DEBUG:teuthology.orchestra.run.smithi072:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-07-25T14:21:27.093 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-25T14:21:27.093 DEBUG:teuthology.orchestra.run.smithi092:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-07-25T14:21:27.120 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-25T14:21:27.120 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-07-25T14:21:27.121 DEBUG:teuthology.orchestra.run.smithi072:> sudo /usr/sbin/setenforce permissive 2023-07-25T14:21:27.160 DEBUG:teuthology.orchestra.run.smithi092:> sudo /usr/sbin/setenforce permissive 2023-07-25T14:21:27.187 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-07-25T14:21:27.196 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2023-07-25T14:21:27.225 INFO:teuthology.repo_utils:Fetching main from origin 2023-07-25T14:21:27.384 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-07-25T14:21:27.409 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-07-25T14:21:27.410 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi072.front.sepia.ceph.com,smithi092.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-07-25T14:30:40.551 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi072.front.sepia.ceph.com'), Remote(name='ubuntu@smithi092.front.sepia.ceph.com')] 2023-07-25T14:30:40.553 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi072.front.sepia.ceph.com' 2023-07-25T14:30:40.554 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-25T14:30:45.625 DEBUG:teuthology.orchestra.run.smithi072:> true 2023-07-25T14:30:45.656 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi072.front.sepia.ceph.com' 2023-07-25T14:30:45.656 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi092.front.sepia.ceph.com' 2023-07-25T14:30:45.657 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-25T14:30:50.728 DEBUG:teuthology.orchestra.run.smithi092:> true 2023-07-25T14:30:50.801 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi092.front.sepia.ceph.com' 2023-07-25T14:30:50.802 INFO:teuthology.run_tasks:Running task clock... 2023-07-25T14:30:50.812 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-07-25T14:30:50.812 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-07-25T14:30:50.813 DEBUG:teuthology.orchestra.run.smithi072:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-07-25T14:30:50.815 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-07-25T14:30:50.816 DEBUG:teuthology.orchestra.run.smithi092:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-07-25T14:30:50.849 INFO:teuthology.orchestra.run.smithi072.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-07-25T14:30:50.865 INFO:teuthology.orchestra.run.smithi072.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-07-25T14:30:50.879 INFO:teuthology.orchestra.run.smithi092.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-07-25T14:30:50.896 INFO:teuthology.orchestra.run.smithi092.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-07-25T14:30:50.931 INFO:teuthology.orchestra.run.smithi072.stderr:sudo: ntpd: command not found 2023-07-25T14:30:50.943 INFO:teuthology.orchestra.run.smithi072.stdout:506 Cannot talk to daemon 2023-07-25T14:30:50.958 INFO:teuthology.orchestra.run.smithi072.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-07-25T14:30:50.972 INFO:teuthology.orchestra.run.smithi072.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-07-25T14:30:50.976 INFO:teuthology.orchestra.run.smithi092.stderr:sudo: ntpd: command not found 2023-07-25T14:30:50.991 INFO:teuthology.orchestra.run.smithi092.stdout:506 Cannot talk to daemon 2023-07-25T14:30:51.009 INFO:teuthology.orchestra.run.smithi092.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-07-25T14:30:51.026 INFO:teuthology.orchestra.run.smithi092.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-07-25T14:30:51.041 INFO:teuthology.orchestra.run.smithi072.stderr:bash: ntpq: command not found 2023-07-25T14:30:51.045 INFO:teuthology.orchestra.run.smithi072.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-07-25T14:30:51.045 INFO:teuthology.orchestra.run.smithi072.stdout:=============================================================================== 2023-07-25T14:30:51.045 INFO:teuthology.orchestra.run.smithi072.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-25T14:30:51.046 INFO:teuthology.orchestra.run.smithi072.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-25T14:30:51.046 INFO:teuthology.orchestra.run.smithi072.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-25T14:30:51.046 INFO:teuthology.orchestra.run.smithi072.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-25T14:30:51.104 INFO:teuthology.orchestra.run.smithi092.stderr:bash: ntpq: command not found 2023-07-25T14:30:51.108 INFO:teuthology.orchestra.run.smithi092.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-07-25T14:30:51.108 INFO:teuthology.orchestra.run.smithi092.stdout:=============================================================================== 2023-07-25T14:30:51.109 INFO:teuthology.orchestra.run.smithi092.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-25T14:30:51.109 INFO:teuthology.orchestra.run.smithi092.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-25T14:30:51.109 INFO:teuthology.orchestra.run.smithi092.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-25T14:30:51.109 INFO:teuthology.orchestra.run.smithi092.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-25T14:30:51.110 INFO:teuthology.run_tasks:Running task install... 2023-07-25T14:30:51.118 DEBUG:teuthology.task.install:project ceph 2023-07-25T14:30:51.119 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'a5d48e8c688c2543997a98b8acbae2ce9635578c'}} 2023-07-25T14:30:51.119 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'a5d48e8c688c2543997a98b8acbae2ce9635578c'} 2023-07-25T14:30:51.119 INFO:teuthology.task.install:Using flavor: default 2023-07-25T14:30:51.129 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-07-25T14:30:51.129 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-07-25T14:30:51.130 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'a5d48e8c688c2543997a98b8acbae2ce9635578c', 'tag': None, 'wait_for_package': False} 2023-07-25T14:30:51.131 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=a5d48e8c688c2543997a98b8acbae2ce9635578c 2023-07-25T14:30:51.134 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'a5d48e8c688c2543997a98b8acbae2ce9635578c', 'tag': None, 'wait_for_package': False} 2023-07-25T14:30:51.134 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=a5d48e8c688c2543997a98b8acbae2ce9635578c 2023-07-25T14:30:51.523 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230725.043804/a5d48e8c688c2543997a98b8acbae2ce9635578c/centos/8/flavors/default/ 2023-07-25T14:30:51.524 INFO:teuthology.task.install.rpm:Package version is 18.0.0-5128.ga5d48e8c 2023-07-25T14:30:51.831 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230725.043804/a5d48e8c688c2543997a98b8acbae2ce9635578c/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230725.043804/a5d48e8c688c2543997a98b8acbae2ce9635578c/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230725.043804/a5d48e8c688c2543997a98b8acbae2ce9635578c/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-07-25T14:30:51.831 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-07-25T14:30:51.832 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-07-25T14:30:51.865 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-07-25T14:30:51.865 DEBUG:teuthology.orchestra.run.smithi092:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/a5d48e8c688c2543997a98b8acbae2ce9635578c/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-07-25T14:30:51.938 DEBUG:teuthology.orchestra.run.smithi092:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-07-25T14:30:52.022 DEBUG:teuthology.orchestra.run.smithi092:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-07-25T14:30:52.094 INFO:teuthology.orchestra.run.smithi092.stdout:check_obsoletes = 1 2023-07-25T14:30:52.095 DEBUG:teuthology.orchestra.run.smithi092:> sudo yum clean all 2023-07-25T14:30:52.483 INFO:teuthology.orchestra.run.smithi092.stdout:Updating Subscription Management repositories. 2023-07-25T14:30:52.629 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230725.043804/a5d48e8c688c2543997a98b8acbae2ce9635578c/centos/8/flavors/default/ 2023-07-25T14:30:52.629 INFO:teuthology.task.install.rpm:Package version is 18.0.0-5128.ga5d48e8c 2023-07-25T14:30:52.764 INFO:teuthology.orchestra.run.smithi092.stdout:44 files removed 2023-07-25T14:30:52.810 DEBUG:teuthology.orchestra.run.smithi092:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-07-25T14:30:52.862 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230725.043804/a5d48e8c688c2543997a98b8acbae2ce9635578c/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230725.043804/a5d48e8c688c2543997a98b8acbae2ce9635578c/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230725.043804/a5d48e8c688c2543997a98b8acbae2ce9635578c/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-07-25T14:30:52.862 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-07-25T14:30:52.863 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-07-25T14:30:52.895 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-07-25T14:30:52.896 DEBUG:teuthology.orchestra.run.smithi072:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/a5d48e8c688c2543997a98b8acbae2ce9635578c/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-07-25T14:30:52.967 DEBUG:teuthology.orchestra.run.smithi072:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-07-25T14:30:53.048 DEBUG:teuthology.orchestra.run.smithi072:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-07-25T14:30:53.116 INFO:teuthology.orchestra.run.smithi072.stdout:check_obsoletes = 1 2023-07-25T14:30:53.117 DEBUG:teuthology.orchestra.run.smithi072:> sudo yum clean all 2023-07-25T14:30:53.140 INFO:teuthology.orchestra.run.smithi092.stdout:Updating Subscription Management repositories. 2023-07-25T14:30:53.490 INFO:teuthology.orchestra.run.smithi072.stdout:Updating Subscription Management repositories. 2023-07-25T14:30:53.756 INFO:teuthology.orchestra.run.smithi072.stdout:44 files removed 2023-07-25T14:30:53.802 DEBUG:teuthology.orchestra.run.smithi072:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-07-25T14:30:54.112 INFO:teuthology.orchestra.run.smithi092.stdout:ceph packages for x86_64 144 kB/s | 81 kB 00:00 2023-07-25T14:30:54.132 INFO:teuthology.orchestra.run.smithi072.stdout:Updating Subscription Management repositories. 2023-07-25T14:30:54.629 INFO:teuthology.orchestra.run.smithi092.stdout:ceph noarch packages 19 kB/s | 9.4 kB 00:00 2023-07-25T14:30:55.025 INFO:teuthology.orchestra.run.smithi072.stdout:ceph packages for x86_64 157 kB/s | 81 kB 00:00 2023-07-25T14:30:55.105 INFO:teuthology.orchestra.run.smithi092.stdout:ceph source packages 3.3 kB/s | 1.5 kB 00:00 2023-07-25T14:30:55.414 INFO:teuthology.orchestra.run.smithi092.stdout:Copr repo for python3-asyncssh owned by ceph 12 kB/s | 3.5 kB 00:00 2023-07-25T14:30:55.526 INFO:teuthology.orchestra.run.smithi072.stdout:ceph noarch packages 20 kB/s | 9.4 kB 00:00 2023-07-25T14:30:56.002 INFO:teuthology.orchestra.run.smithi072.stdout:ceph source packages 3.3 kB/s | 1.5 kB 00:00 2023-07-25T14:30:56.437 INFO:teuthology.orchestra.run.smithi072.stdout:Copr repo for python3-asyncssh owned by ceph 8.4 kB/s | 3.5 kB 00:00 2023-07-25T14:30:56.706 INFO:teuthology.orchestra.run.smithi092.stdout:Extra Packages for Enterprise Linux 12 MB/s | 16 MB 00:01 2023-07-25T14:31:00.189 INFO:teuthology.orchestra.run.smithi092.stdout:lab-extras 406 kB/s | 24 kB 00:00 2023-07-25T14:31:01.074 INFO:teuthology.orchestra.run.smithi092.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 65 MB/s | 53 MB 00:00 2023-07-25T14:31:02.093 INFO:teuthology.orchestra.run.smithi072.stdout:Extra Packages for Enterprise Linux 2.8 MB/s | 16 MB 00:05 2023-07-25T14:31:05.583 INFO:teuthology.orchestra.run.smithi072.stdout:lab-extras 403 kB/s | 24 kB 00:00 2023-07-25T14:31:06.827 INFO:teuthology.orchestra.run.smithi072.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 45 MB/s | 53 MB 00:01 2023-07-25T14:31:09.233 INFO:teuthology.orchestra.run.smithi092.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 59 MB/s | 47 MB 00:00 2023-07-25T14:31:15.132 INFO:teuthology.orchestra.run.smithi072.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 44 MB/s | 47 MB 00:01 2023-07-25T14:31:20.128 INFO:teuthology.orchestra.run.smithi092.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-07-25T14:31:20.129 INFO:teuthology.orchestra.run.smithi092.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-07-25T14:31:20.143 INFO:teuthology.orchestra.run.smithi092.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2023-07-25T14:31:20.144 INFO:teuthology.orchestra.run.smithi092.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2023-07-25T14:31:20.145 INFO:teuthology.orchestra.run.smithi092.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2023-07-25T14:31:20.146 INFO:teuthology.orchestra.run.smithi092.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-07-25T14:31:20.149 INFO:teuthology.orchestra.run.smithi092.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-07-25T14:31:20.152 INFO:teuthology.orchestra.run.smithi092.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-07-25T14:31:20.153 INFO:teuthology.orchestra.run.smithi092.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-07-25T14:31:20.282 INFO:teuthology.orchestra.run.smithi092.stdout:Dependencies resolved. 2023-07-25T14:31:20.294 INFO:teuthology.orchestra.run.smithi092.stdout:=========================================================================================================================== 2023-07-25T14:31:20.294 INFO:teuthology.orchestra.run.smithi092.stdout: Package Arch Version Repository Size 2023-07-25T14:31:20.295 INFO:teuthology.orchestra.run.smithi092.stdout:=========================================================================================================================== 2023-07-25T14:31:20.295 INFO:teuthology.orchestra.run.smithi092.stdout:Installing: 2023-07-25T14:31:20.295 INFO:teuthology.orchestra.run.smithi092.stdout: NetworkManager-initscripts-updown noarch 1:1.36.0-9.el8_6 rhel-8-for-x86_64-baseos-rpms 138 k 2023-07-25T14:31:20.295 INFO:teuthology.orchestra.run.smithi092.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-07-25T14:31:20.295 INFO:teuthology.orchestra.run.smithi092.stdout: ceph x86_64 2:18.0.0-5128.ga5d48e8c.el8 ceph 6.4 k 2023-07-25T14:31:20.295 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-base x86_64 2:18.0.0-5128.ga5d48e8c.el8 ceph 5.4 M 2023-07-25T14:31:20.295 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-fuse x86_64 2:18.0.0-5128.ga5d48e8c.el8 ceph 859 k 2023-07-25T14:31:20.296 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-5128.ga5d48e8c.el8 ceph 167 k 2023-07-25T14:31:20.296 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr x86_64 2:18.0.0-5128.ga5d48e8c.el8 ceph 1.6 M 2023-07-25T14:31:20.296 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-cephadm noarch 2:18.0.0-5128.ga5d48e8c.el8 ceph-noarch 129 k 2023-07-25T14:31:20.296 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-dashboard noarch 2:18.0.0-5128.ga5d48e8c.el8 ceph-noarch 1.7 M 2023-07-25T14:31:20.296 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-5128.ga5d48e8c.el8 ceph-noarch 7.4 M 2023-07-25T14:31:20.296 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-rook noarch 2:18.0.0-5128.ga5d48e8c.el8 ceph-noarch 47 k 2023-07-25T14:31:20.297 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-radosgw x86_64 2:18.0.0-5128.ga5d48e8c.el8 ceph 14 M 2023-07-25T14:31:20.297 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-test x86_64 2:18.0.0-5128.ga5d48e8c.el8 ceph 48 M 2023-07-25T14:31:20.297 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-volume noarch 2:18.0.0-5128.ga5d48e8c.el8 ceph-noarch 258 k 2023-07-25T14:31:20.297 INFO:teuthology.orchestra.run.smithi092.stdout: cephadm noarch 2:18.0.0-5128.ga5d48e8c.el8 ceph-noarch 165 k 2023-07-25T14:31:20.297 INFO:teuthology.orchestra.run.smithi092.stdout: cephfs-mirror x86_64 2:18.0.0-5128.ga5d48e8c.el8 ceph 260 k 2023-07-25T14:31:20.297 INFO:teuthology.orchestra.run.smithi092.stdout: cephfs-top noarch 2:18.0.0-5128.ga5d48e8c.el8 ceph-noarch 18 k 2023-07-25T14:31:20.297 INFO:teuthology.orchestra.run.smithi092.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-07-25T14:31:20.298 INFO:teuthology.orchestra.run.smithi092.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-07-25T14:31:20.298 INFO:teuthology.orchestra.run.smithi092.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-07-25T14:31:20.298 INFO:teuthology.orchestra.run.smithi092.stdout: libcephfs-devel x86_64 2:18.0.0-5128.ga5d48e8c.el8 ceph 31 k 2023-07-25T14:31:20.298 INFO:teuthology.orchestra.run.smithi092.stdout: libcephfs2 x86_64 2:18.0.0-5128.ga5d48e8c.el8 ceph 783 k 2023-07-25T14:31:20.298 INFO:teuthology.orchestra.run.smithi092.stdout: librados-devel x86_64 2:18.0.0-5128.ga5d48e8c.el8 ceph 139 k 2023-07-25T14:31:20.298 INFO:teuthology.orchestra.run.smithi092.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-07-25T14:31:20.298 INFO:teuthology.orchestra.run.smithi092.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-07-25T14:31:20.299 INFO:teuthology.orchestra.run.smithi092.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-07-25T14:31:20.299 INFO:teuthology.orchestra.run.smithi092.stdout: postgresql x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 1.5 M 2023-07-25T14:31:20.299 INFO:teuthology.orchestra.run.smithi092.stdout: postgresql-contrib x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 808 k 2023-07-25T14:31:20.299 INFO:teuthology.orchestra.run.smithi092.stdout: postgresql-server x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 5.1 M 2023-07-25T14:31:20.299 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cephfs x86_64 2:18.0.0-5128.ga5d48e8c.el8 ceph 197 k 2023-07-25T14:31:20.299 INFO:teuthology.orchestra.run.smithi092.stdout: python3-rados x86_64 2:18.0.0-5128.ga5d48e8c.el8 ceph 371 k 2023-07-25T14:31:20.300 INFO:teuthology.orchestra.run.smithi092.stdout: python3-rbd x86_64 2:18.0.0-5128.ga5d48e8c.el8 ceph 364 k 2023-07-25T14:31:20.300 INFO:teuthology.orchestra.run.smithi092.stdout: python3-rgw x86_64 2:18.0.0-5128.ga5d48e8c.el8 ceph 107 k 2023-07-25T14:31:20.300 INFO:teuthology.orchestra.run.smithi092.stdout: rbd-fuse x86_64 2:18.0.0-5128.ga5d48e8c.el8 ceph 94 k 2023-07-25T14:31:20.300 INFO:teuthology.orchestra.run.smithi092.stdout: rbd-mirror x86_64 2:18.0.0-5128.ga5d48e8c.el8 ceph 3.5 M 2023-07-25T14:31:20.300 INFO:teuthology.orchestra.run.smithi092.stdout: rbd-nbd x86_64 2:18.0.0-5128.ga5d48e8c.el8 ceph 179 k 2023-07-25T14:31:20.301 INFO:teuthology.orchestra.run.smithi092.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-07-25T14:31:20.301 INFO:teuthology.orchestra.run.smithi092.stdout:Upgrading: 2023-07-25T14:31:20.301 INFO:teuthology.orchestra.run.smithi092.stdout: iproute x86_64 5.15.0-4.el8_6.1 rhel-8-for-x86_64-baseos-rpms 798 k 2023-07-25T14:31:20.301 INFO:teuthology.orchestra.run.smithi092.stdout: librados2 x86_64 2:18.0.0-5128.ga5d48e8c.el8 ceph 3.7 M 2023-07-25T14:31:20.301 INFO:teuthology.orchestra.run.smithi092.stdout: librbd1 x86_64 2:18.0.0-5128.ga5d48e8c.el8 ceph 3.6 M 2023-07-25T14:31:20.301 INFO:teuthology.orchestra.run.smithi092.stdout:Installing dependencies: 2023-07-25T14:31:20.301 INFO:teuthology.orchestra.run.smithi092.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-07-25T14:31:20.302 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-common x86_64 2:18.0.0-5128.ga5d48e8c.el8 ceph 22 M 2023-07-25T14:31:20.302 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-grafana-dashboards noarch 2:18.0.0-5128.ga5d48e8c.el8 ceph-noarch 23 k 2023-07-25T14:31:20.302 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mds x86_64 2:18.0.0-5128.ga5d48e8c.el8 ceph 2.3 M 2023-07-25T14:31:20.302 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-modules-core noarch 2:18.0.0-5128.ga5d48e8c.el8 ceph-noarch 241 k 2023-07-25T14:31:20.302 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mon x86_64 2:18.0.0-5128.ga5d48e8c.el8 ceph 4.6 M 2023-07-25T14:31:20.302 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-osd x86_64 2:18.0.0-5128.ga5d48e8c.el8 ceph 18 M 2023-07-25T14:31:20.302 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-prometheus-alerts noarch 2:18.0.0-5128.ga5d48e8c.el8 ceph-noarch 14 k 2023-07-25T14:31:20.303 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-selinux x86_64 2:18.0.0-5128.ga5d48e8c.el8 ceph 24 k 2023-07-25T14:31:20.303 INFO:teuthology.orchestra.run.smithi092.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-07-25T14:31:20.303 INFO:teuthology.orchestra.run.smithi092.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-07-25T14:31:20.303 INFO:teuthology.orchestra.run.smithi092.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-07-25T14:31:20.303 INFO:teuthology.orchestra.run.smithi092.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-07-25T14:31:20.303 INFO:teuthology.orchestra.run.smithi092.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-07-25T14:31:20.303 INFO:teuthology.orchestra.run.smithi092.stdout: libcephsqlite x86_64 2:18.0.0-5128.ga5d48e8c.el8 ceph 139 k 2023-07-25T14:31:20.304 INFO:teuthology.orchestra.run.smithi092.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-07-25T14:31:20.304 INFO:teuthology.orchestra.run.smithi092.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-07-25T14:31:20.305 INFO:teuthology.orchestra.run.smithi092.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-07-25T14:31:20.305 INFO:teuthology.orchestra.run.smithi092.stdout: libpq x86_64 13.5-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2023-07-25T14:31:20.305 INFO:teuthology.orchestra.run.smithi092.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-07-25T14:31:20.305 INFO:teuthology.orchestra.run.smithi092.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-07-25T14:31:20.305 INFO:teuthology.orchestra.run.smithi092.stdout: libradosstriper1 x86_64 2:18.0.0-5128.ga5d48e8c.el8 ceph 473 k 2023-07-25T14:31:20.305 INFO:teuthology.orchestra.run.smithi092.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-07-25T14:31:20.305 INFO:teuthology.orchestra.run.smithi092.stdout: librgw2 x86_64 2:18.0.0-5128.ga5d48e8c.el8 ceph 6.8 M 2023-07-25T14:31:20.306 INFO:teuthology.orchestra.run.smithi092.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-07-25T14:31:20.306 INFO:teuthology.orchestra.run.smithi092.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-07-25T14:31:20.306 INFO:teuthology.orchestra.run.smithi092.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-07-25T14:31:20.306 INFO:teuthology.orchestra.run.smithi092.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-07-25T14:31:20.306 INFO:teuthology.orchestra.run.smithi092.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-07-25T14:31:20.306 INFO:teuthology.orchestra.run.smithi092.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-07-25T14:31:20.307 INFO:teuthology.orchestra.run.smithi092.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-07-25T14:31:20.307 INFO:teuthology.orchestra.run.smithi092.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-07-25T14:31:20.307 INFO:teuthology.orchestra.run.smithi092.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-07-25T14:31:20.307 INFO:teuthology.orchestra.run.smithi092.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-07-25T14:31:20.308 INFO:teuthology.orchestra.run.smithi092.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-07-25T14:31:20.308 INFO:teuthology.orchestra.run.smithi092.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-07-25T14:31:20.308 INFO:teuthology.orchestra.run.smithi092.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-07-25T14:31:20.309 INFO:teuthology.orchestra.run.smithi092.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-07-25T14:31:20.309 INFO:teuthology.orchestra.run.smithi092.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-07-25T14:31:20.309 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-07-25T14:31:20.309 INFO:teuthology.orchestra.run.smithi092.stdout: python3-ceph-argparse x86_64 2:18.0.0-5128.ga5d48e8c.el8 ceph 45 k 2023-07-25T14:31:20.310 INFO:teuthology.orchestra.run.smithi092.stdout: python3-ceph-common x86_64 2:18.0.0-5128.ga5d48e8c.el8 ceph 122 k 2023-07-25T14:31:20.310 INFO:teuthology.orchestra.run.smithi092.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-07-25T14:31:20.310 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-07-25T14:31:20.310 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-07-25T14:31:20.311 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-07-25T14:31:20.311 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-07-25T14:31:20.311 INFO:teuthology.orchestra.run.smithi092.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-07-25T14:31:20.312 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-07-25T14:31:20.312 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-07-25T14:31:20.312 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-07-25T14:31:20.313 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-07-25T14:31:20.313 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-07-25T14:31:20.313 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-07-25T14:31:20.314 INFO:teuthology.orchestra.run.smithi092.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-07-25T14:31:20.314 INFO:teuthology.orchestra.run.smithi092.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-07-25T14:31:20.314 INFO:teuthology.orchestra.run.smithi092.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-07-25T14:31:20.314 INFO:teuthology.orchestra.run.smithi092.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-07-25T14:31:20.314 INFO:teuthology.orchestra.run.smithi092.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-07-25T14:31:20.314 INFO:teuthology.orchestra.run.smithi092.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-07-25T14:31:20.314 INFO:teuthology.orchestra.run.smithi092.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-07-25T14:31:20.315 INFO:teuthology.orchestra.run.smithi092.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-07-25T14:31:20.315 INFO:teuthology.orchestra.run.smithi092.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-07-25T14:31:20.315 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-07-25T14:31:20.315 INFO:teuthology.orchestra.run.smithi092.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-07-25T14:31:20.315 INFO:teuthology.orchestra.run.smithi092.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-07-25T14:31:20.315 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-07-25T14:31:20.315 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-07-25T14:31:20.316 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-07-25T14:31:20.316 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-07-25T14:31:20.316 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-07-25T14:31:20.316 INFO:teuthology.orchestra.run.smithi092.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-07-25T14:31:20.316 INFO:teuthology.orchestra.run.smithi092.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-07-25T14:31:20.317 INFO:teuthology.orchestra.run.smithi092.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-07-25T14:31:20.317 INFO:teuthology.orchestra.run.smithi092.stdout: python3-rsa noarch 4.8-1.el8 epel 61 k 2023-07-25T14:31:20.317 INFO:teuthology.orchestra.run.smithi092.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-07-25T14:31:20.317 INFO:teuthology.orchestra.run.smithi092.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-07-25T14:31:20.317 INFO:teuthology.orchestra.run.smithi092.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-07-25T14:31:20.317 INFO:teuthology.orchestra.run.smithi092.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-07-25T14:31:20.317 INFO:teuthology.orchestra.run.smithi092.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-07-25T14:31:20.318 INFO:teuthology.orchestra.run.smithi092.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-07-25T14:31:20.318 INFO:teuthology.orchestra.run.smithi092.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-07-25T14:31:20.318 INFO:teuthology.orchestra.run.smithi092.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-07-25T14:31:20.318 INFO:teuthology.orchestra.run.smithi092.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-07-25T14:31:20.318 INFO:teuthology.orchestra.run.smithi092.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-07-25T14:31:20.318 INFO:teuthology.orchestra.run.smithi092.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-07-25T14:31:20.318 INFO:teuthology.orchestra.run.smithi092.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-07-25T14:31:20.318 INFO:teuthology.orchestra.run.smithi092.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-07-25T14:31:20.319 INFO:teuthology.orchestra.run.smithi092.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2023-07-25T14:31:20.319 INFO:teuthology.orchestra.run.smithi092.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-07-25T14:31:20.319 INFO:teuthology.orchestra.run.smithi092.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-07-25T14:31:20.319 INFO:teuthology.orchestra.run.smithi092.stdout:Enabling module streams: 2023-07-25T14:31:20.319 INFO:teuthology.orchestra.run.smithi092.stdout: postgresql 10 2023-07-25T14:31:20.319 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-07-25T14:31:20.319 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction Summary 2023-07-25T14:31:20.320 INFO:teuthology.orchestra.run.smithi092.stdout:=========================================================================================================================== 2023-07-25T14:31:20.320 INFO:teuthology.orchestra.run.smithi092.stdout:Install 128 Packages 2023-07-25T14:31:20.320 INFO:teuthology.orchestra.run.smithi092.stdout:Upgrade 3 Packages 2023-07-25T14:31:20.320 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-07-25T14:31:20.321 INFO:teuthology.orchestra.run.smithi092.stdout:Total download size: 206 M 2023-07-25T14:31:20.321 INFO:teuthology.orchestra.run.smithi092.stdout:Downloading Packages: 2023-07-25T14:31:20.648 INFO:teuthology.orchestra.run.smithi092.stdout:(1/131): ceph-18.0.0-5128.ga5d48e8c.el8.x86_64. 26 kB/s | 6.4 kB 00:00 2023-07-25T14:31:22.281 INFO:teuthology.orchestra.run.smithi092.stdout:(2/131): ceph-fuse-18.0.0-5128.ga5d48e8c.el8.x8 526 kB/s | 859 kB 00:01 2023-07-25T14:31:22.632 INFO:teuthology.orchestra.run.smithi092.stdout:(3/131): ceph-immutable-object-cache-18.0.0-512 477 kB/s | 167 kB 00:00 2023-07-25T14:31:26.072 INFO:teuthology.orchestra.run.smithi072.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-07-25T14:31:26.073 INFO:teuthology.orchestra.run.smithi072.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-07-25T14:31:26.088 INFO:teuthology.orchestra.run.smithi072.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2023-07-25T14:31:26.089 INFO:teuthology.orchestra.run.smithi072.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2023-07-25T14:31:26.090 INFO:teuthology.orchestra.run.smithi072.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2023-07-25T14:31:26.091 INFO:teuthology.orchestra.run.smithi072.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-07-25T14:31:26.093 INFO:teuthology.orchestra.run.smithi072.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-07-25T14:31:26.097 INFO:teuthology.orchestra.run.smithi072.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-07-25T14:31:26.098 INFO:teuthology.orchestra.run.smithi072.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-07-25T14:31:26.232 INFO:teuthology.orchestra.run.smithi072.stdout:Dependencies resolved. 2023-07-25T14:31:26.244 INFO:teuthology.orchestra.run.smithi072.stdout:=========================================================================================================================== 2023-07-25T14:31:26.244 INFO:teuthology.orchestra.run.smithi072.stdout: Package Arch Version Repository Size 2023-07-25T14:31:26.245 INFO:teuthology.orchestra.run.smithi072.stdout:=========================================================================================================================== 2023-07-25T14:31:26.245 INFO:teuthology.orchestra.run.smithi072.stdout:Installing: 2023-07-25T14:31:26.245 INFO:teuthology.orchestra.run.smithi072.stdout: NetworkManager-initscripts-updown noarch 1:1.36.0-9.el8_6 rhel-8-for-x86_64-baseos-rpms 138 k 2023-07-25T14:31:26.245 INFO:teuthology.orchestra.run.smithi072.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-07-25T14:31:26.245 INFO:teuthology.orchestra.run.smithi072.stdout: ceph x86_64 2:18.0.0-5128.ga5d48e8c.el8 ceph 6.4 k 2023-07-25T14:31:26.245 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-base x86_64 2:18.0.0-5128.ga5d48e8c.el8 ceph 5.4 M 2023-07-25T14:31:26.246 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-fuse x86_64 2:18.0.0-5128.ga5d48e8c.el8 ceph 859 k 2023-07-25T14:31:26.246 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-5128.ga5d48e8c.el8 ceph 167 k 2023-07-25T14:31:26.246 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr x86_64 2:18.0.0-5128.ga5d48e8c.el8 ceph 1.6 M 2023-07-25T14:31:26.246 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-cephadm noarch 2:18.0.0-5128.ga5d48e8c.el8 ceph-noarch 129 k 2023-07-25T14:31:26.246 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-dashboard noarch 2:18.0.0-5128.ga5d48e8c.el8 ceph-noarch 1.7 M 2023-07-25T14:31:26.246 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-5128.ga5d48e8c.el8 ceph-noarch 7.4 M 2023-07-25T14:31:26.246 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-rook noarch 2:18.0.0-5128.ga5d48e8c.el8 ceph-noarch 47 k 2023-07-25T14:31:26.246 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-radosgw x86_64 2:18.0.0-5128.ga5d48e8c.el8 ceph 14 M 2023-07-25T14:31:26.247 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-test x86_64 2:18.0.0-5128.ga5d48e8c.el8 ceph 48 M 2023-07-25T14:31:26.247 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-volume noarch 2:18.0.0-5128.ga5d48e8c.el8 ceph-noarch 258 k 2023-07-25T14:31:26.247 INFO:teuthology.orchestra.run.smithi072.stdout: cephadm noarch 2:18.0.0-5128.ga5d48e8c.el8 ceph-noarch 165 k 2023-07-25T14:31:26.247 INFO:teuthology.orchestra.run.smithi072.stdout: cephfs-mirror x86_64 2:18.0.0-5128.ga5d48e8c.el8 ceph 260 k 2023-07-25T14:31:26.247 INFO:teuthology.orchestra.run.smithi072.stdout: cephfs-top noarch 2:18.0.0-5128.ga5d48e8c.el8 ceph-noarch 18 k 2023-07-25T14:31:26.247 INFO:teuthology.orchestra.run.smithi072.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-07-25T14:31:26.247 INFO:teuthology.orchestra.run.smithi072.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-07-25T14:31:26.248 INFO:teuthology.orchestra.run.smithi072.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-07-25T14:31:26.248 INFO:teuthology.orchestra.run.smithi072.stdout: libcephfs-devel x86_64 2:18.0.0-5128.ga5d48e8c.el8 ceph 31 k 2023-07-25T14:31:26.248 INFO:teuthology.orchestra.run.smithi072.stdout: libcephfs2 x86_64 2:18.0.0-5128.ga5d48e8c.el8 ceph 783 k 2023-07-25T14:31:26.248 INFO:teuthology.orchestra.run.smithi072.stdout: librados-devel x86_64 2:18.0.0-5128.ga5d48e8c.el8 ceph 139 k 2023-07-25T14:31:26.248 INFO:teuthology.orchestra.run.smithi072.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-07-25T14:31:26.248 INFO:teuthology.orchestra.run.smithi072.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-07-25T14:31:26.248 INFO:teuthology.orchestra.run.smithi072.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-07-25T14:31:26.249 INFO:teuthology.orchestra.run.smithi072.stdout: postgresql x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 1.5 M 2023-07-25T14:31:26.249 INFO:teuthology.orchestra.run.smithi072.stdout: postgresql-contrib x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 808 k 2023-07-25T14:31:26.249 INFO:teuthology.orchestra.run.smithi072.stdout: postgresql-server x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 5.1 M 2023-07-25T14:31:26.249 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cephfs x86_64 2:18.0.0-5128.ga5d48e8c.el8 ceph 197 k 2023-07-25T14:31:26.249 INFO:teuthology.orchestra.run.smithi072.stdout: python3-rados x86_64 2:18.0.0-5128.ga5d48e8c.el8 ceph 371 k 2023-07-25T14:31:26.249 INFO:teuthology.orchestra.run.smithi072.stdout: python3-rbd x86_64 2:18.0.0-5128.ga5d48e8c.el8 ceph 364 k 2023-07-25T14:31:26.249 INFO:teuthology.orchestra.run.smithi072.stdout: python3-rgw x86_64 2:18.0.0-5128.ga5d48e8c.el8 ceph 107 k 2023-07-25T14:31:26.249 INFO:teuthology.orchestra.run.smithi072.stdout: rbd-fuse x86_64 2:18.0.0-5128.ga5d48e8c.el8 ceph 94 k 2023-07-25T14:31:26.250 INFO:teuthology.orchestra.run.smithi072.stdout: rbd-mirror x86_64 2:18.0.0-5128.ga5d48e8c.el8 ceph 3.5 M 2023-07-25T14:31:26.250 INFO:teuthology.orchestra.run.smithi072.stdout: rbd-nbd x86_64 2:18.0.0-5128.ga5d48e8c.el8 ceph 179 k 2023-07-25T14:31:26.250 INFO:teuthology.orchestra.run.smithi072.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-07-25T14:31:26.250 INFO:teuthology.orchestra.run.smithi072.stdout:Upgrading: 2023-07-25T14:31:26.250 INFO:teuthology.orchestra.run.smithi072.stdout: iproute x86_64 5.15.0-4.el8_6.1 rhel-8-for-x86_64-baseos-rpms 798 k 2023-07-25T14:31:26.250 INFO:teuthology.orchestra.run.smithi072.stdout: librados2 x86_64 2:18.0.0-5128.ga5d48e8c.el8 ceph 3.7 M 2023-07-25T14:31:26.250 INFO:teuthology.orchestra.run.smithi072.stdout: librbd1 x86_64 2:18.0.0-5128.ga5d48e8c.el8 ceph 3.6 M 2023-07-25T14:31:26.250 INFO:teuthology.orchestra.run.smithi072.stdout:Installing dependencies: 2023-07-25T14:31:26.251 INFO:teuthology.orchestra.run.smithi072.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-07-25T14:31:26.251 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-common x86_64 2:18.0.0-5128.ga5d48e8c.el8 ceph 22 M 2023-07-25T14:31:26.251 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-grafana-dashboards noarch 2:18.0.0-5128.ga5d48e8c.el8 ceph-noarch 23 k 2023-07-25T14:31:26.251 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mds x86_64 2:18.0.0-5128.ga5d48e8c.el8 ceph 2.3 M 2023-07-25T14:31:26.251 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-modules-core noarch 2:18.0.0-5128.ga5d48e8c.el8 ceph-noarch 241 k 2023-07-25T14:31:26.251 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mon x86_64 2:18.0.0-5128.ga5d48e8c.el8 ceph 4.6 M 2023-07-25T14:31:26.251 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-osd x86_64 2:18.0.0-5128.ga5d48e8c.el8 ceph 18 M 2023-07-25T14:31:26.252 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-prometheus-alerts noarch 2:18.0.0-5128.ga5d48e8c.el8 ceph-noarch 14 k 2023-07-25T14:31:26.252 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-selinux x86_64 2:18.0.0-5128.ga5d48e8c.el8 ceph 24 k 2023-07-25T14:31:26.252 INFO:teuthology.orchestra.run.smithi072.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-07-25T14:31:26.252 INFO:teuthology.orchestra.run.smithi072.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-07-25T14:31:26.252 INFO:teuthology.orchestra.run.smithi072.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-07-25T14:31:26.252 INFO:teuthology.orchestra.run.smithi072.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-07-25T14:31:26.252 INFO:teuthology.orchestra.run.smithi072.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-07-25T14:31:26.253 INFO:teuthology.orchestra.run.smithi072.stdout: libcephsqlite x86_64 2:18.0.0-5128.ga5d48e8c.el8 ceph 139 k 2023-07-25T14:31:26.253 INFO:teuthology.orchestra.run.smithi072.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-07-25T14:31:26.253 INFO:teuthology.orchestra.run.smithi072.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-07-25T14:31:26.253 INFO:teuthology.orchestra.run.smithi072.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-07-25T14:31:26.253 INFO:teuthology.orchestra.run.smithi072.stdout: libpq x86_64 13.5-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2023-07-25T14:31:26.253 INFO:teuthology.orchestra.run.smithi072.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-07-25T14:31:26.253 INFO:teuthology.orchestra.run.smithi072.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-07-25T14:31:26.253 INFO:teuthology.orchestra.run.smithi072.stdout: libradosstriper1 x86_64 2:18.0.0-5128.ga5d48e8c.el8 ceph 473 k 2023-07-25T14:31:26.254 INFO:teuthology.orchestra.run.smithi072.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-07-25T14:31:26.254 INFO:teuthology.orchestra.run.smithi072.stdout: librgw2 x86_64 2:18.0.0-5128.ga5d48e8c.el8 ceph 6.8 M 2023-07-25T14:31:26.254 INFO:teuthology.orchestra.run.smithi072.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-07-25T14:31:26.254 INFO:teuthology.orchestra.run.smithi072.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-07-25T14:31:26.254 INFO:teuthology.orchestra.run.smithi072.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-07-25T14:31:26.254 INFO:teuthology.orchestra.run.smithi072.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-07-25T14:31:26.254 INFO:teuthology.orchestra.run.smithi072.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-07-25T14:31:26.255 INFO:teuthology.orchestra.run.smithi072.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-07-25T14:31:26.255 INFO:teuthology.orchestra.run.smithi072.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-07-25T14:31:26.255 INFO:teuthology.orchestra.run.smithi072.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-07-25T14:31:26.255 INFO:teuthology.orchestra.run.smithi072.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-07-25T14:31:26.255 INFO:teuthology.orchestra.run.smithi072.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-07-25T14:31:26.255 INFO:teuthology.orchestra.run.smithi072.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-07-25T14:31:26.255 INFO:teuthology.orchestra.run.smithi072.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-07-25T14:31:26.255 INFO:teuthology.orchestra.run.smithi072.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-07-25T14:31:26.256 INFO:teuthology.orchestra.run.smithi072.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-07-25T14:31:26.256 INFO:teuthology.orchestra.run.smithi072.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-07-25T14:31:26.256 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-07-25T14:31:26.256 INFO:teuthology.orchestra.run.smithi072.stdout: python3-ceph-argparse x86_64 2:18.0.0-5128.ga5d48e8c.el8 ceph 45 k 2023-07-25T14:31:26.256 INFO:teuthology.orchestra.run.smithi072.stdout: python3-ceph-common x86_64 2:18.0.0-5128.ga5d48e8c.el8 ceph 122 k 2023-07-25T14:31:26.256 INFO:teuthology.orchestra.run.smithi072.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-07-25T14:31:26.256 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-07-25T14:31:26.256 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-07-25T14:31:26.257 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-07-25T14:31:26.257 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-07-25T14:31:26.257 INFO:teuthology.orchestra.run.smithi072.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-07-25T14:31:26.257 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-07-25T14:31:26.257 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-07-25T14:31:26.257 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-07-25T14:31:26.257 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-07-25T14:31:26.258 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-07-25T14:31:26.258 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-07-25T14:31:26.258 INFO:teuthology.orchestra.run.smithi072.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-07-25T14:31:26.258 INFO:teuthology.orchestra.run.smithi072.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-07-25T14:31:26.258 INFO:teuthology.orchestra.run.smithi072.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-07-25T14:31:26.258 INFO:teuthology.orchestra.run.smithi072.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-07-25T14:31:26.258 INFO:teuthology.orchestra.run.smithi072.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-07-25T14:31:26.258 INFO:teuthology.orchestra.run.smithi072.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-07-25T14:31:26.259 INFO:teuthology.orchestra.run.smithi072.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-07-25T14:31:26.259 INFO:teuthology.orchestra.run.smithi072.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-07-25T14:31:26.259 INFO:teuthology.orchestra.run.smithi072.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-07-25T14:31:26.259 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-07-25T14:31:26.259 INFO:teuthology.orchestra.run.smithi072.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-07-25T14:31:26.259 INFO:teuthology.orchestra.run.smithi072.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-07-25T14:31:26.259 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-07-25T14:31:26.259 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-07-25T14:31:26.260 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-07-25T14:31:26.260 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-07-25T14:31:26.260 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-07-25T14:31:26.260 INFO:teuthology.orchestra.run.smithi072.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-07-25T14:31:26.260 INFO:teuthology.orchestra.run.smithi072.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-07-25T14:31:26.260 INFO:teuthology.orchestra.run.smithi072.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-07-25T14:31:26.260 INFO:teuthology.orchestra.run.smithi072.stdout: python3-rsa noarch 4.8-1.el8 epel 61 k 2023-07-25T14:31:26.260 INFO:teuthology.orchestra.run.smithi072.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-07-25T14:31:26.261 INFO:teuthology.orchestra.run.smithi072.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-07-25T14:31:26.261 INFO:teuthology.orchestra.run.smithi072.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-07-25T14:31:26.261 INFO:teuthology.orchestra.run.smithi072.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-07-25T14:31:26.261 INFO:teuthology.orchestra.run.smithi072.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-07-25T14:31:26.261 INFO:teuthology.orchestra.run.smithi072.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-07-25T14:31:26.261 INFO:teuthology.orchestra.run.smithi072.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-07-25T14:31:26.261 INFO:teuthology.orchestra.run.smithi072.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-07-25T14:31:26.262 INFO:teuthology.orchestra.run.smithi072.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-07-25T14:31:26.262 INFO:teuthology.orchestra.run.smithi072.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-07-25T14:31:26.262 INFO:teuthology.orchestra.run.smithi072.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-07-25T14:31:26.262 INFO:teuthology.orchestra.run.smithi072.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-07-25T14:31:26.262 INFO:teuthology.orchestra.run.smithi072.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-07-25T14:31:26.263 INFO:teuthology.orchestra.run.smithi072.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2023-07-25T14:31:26.263 INFO:teuthology.orchestra.run.smithi072.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-07-25T14:31:26.263 INFO:teuthology.orchestra.run.smithi072.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-07-25T14:31:26.263 INFO:teuthology.orchestra.run.smithi072.stdout:Enabling module streams: 2023-07-25T14:31:26.263 INFO:teuthology.orchestra.run.smithi072.stdout: postgresql 10 2023-07-25T14:31:26.264 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-25T14:31:26.264 INFO:teuthology.orchestra.run.smithi072.stdout:Transaction Summary 2023-07-25T14:31:26.264 INFO:teuthology.orchestra.run.smithi072.stdout:=========================================================================================================================== 2023-07-25T14:31:26.264 INFO:teuthology.orchestra.run.smithi072.stdout:Install 128 Packages 2023-07-25T14:31:26.264 INFO:teuthology.orchestra.run.smithi072.stdout:Upgrade 3 Packages 2023-07-25T14:31:26.264 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-25T14:31:26.265 INFO:teuthology.orchestra.run.smithi072.stdout:Total download size: 206 M 2023-07-25T14:31:26.265 INFO:teuthology.orchestra.run.smithi072.stdout:Downloading Packages: 2023-07-25T14:31:26.598 INFO:teuthology.orchestra.run.smithi092.stdout:(4/131): ceph-mds-18.0.0-5128.ga5d48e8c.el8.x86 591 kB/s | 2.3 MB 00:03 2023-07-25T14:31:26.867 INFO:teuthology.orchestra.run.smithi072.stdout:(1/131): ceph-18.0.0-5128.ga5d48e8c.el8.x86_64. 19 kB/s | 6.4 kB 00:00 2023-07-25T14:31:27.826 INFO:teuthology.orchestra.run.smithi072.stdout:(2/131): ceph-fuse-18.0.0-5128.ga5d48e8c.el8.x8 896 kB/s | 859 kB 00:00 2023-07-25T14:31:28.035 INFO:teuthology.orchestra.run.smithi072.stdout:(3/131): ceph-immutable-object-cache-18.0.0-512 801 kB/s | 167 kB 00:00 2023-07-25T14:31:28.814 INFO:teuthology.orchestra.run.smithi092.stdout:(5/131): ceph-base-18.0.0-5128.ga5d48e8c.el8.x8 655 kB/s | 5.4 MB 00:08 2023-07-25T14:31:29.081 INFO:teuthology.orchestra.run.smithi092.stdout:(6/131): ceph-mgr-18.0.0-5128.ga5d48e8c.el8.x86 644 kB/s | 1.6 MB 00:02 2023-07-25T14:31:29.495 INFO:teuthology.orchestra.run.smithi072.stdout:(4/131): ceph-base-18.0.0-5128.ga5d48e8c.el8.x8 1.8 MB/s | 5.4 MB 00:02 2023-07-25T14:31:29.554 INFO:teuthology.orchestra.run.smithi072.stdout:(5/131): ceph-mds-18.0.0-5128.ga5d48e8c.el8.x86 1.5 MB/s | 2.3 MB 00:01 2023-07-25T14:31:30.271 INFO:teuthology.orchestra.run.smithi072.stdout:(6/131): ceph-mgr-18.0.0-5128.ga5d48e8c.el8.x86 2.0 MB/s | 1.6 MB 00:00 2023-07-25T14:31:32.380 INFO:teuthology.orchestra.run.smithi072.stdout:(7/131): ceph-mon-18.0.0-5128.ga5d48e8c.el8.x86 1.6 MB/s | 4.6 MB 00:02 2023-07-25T14:31:32.806 INFO:teuthology.orchestra.run.smithi092.stdout:(7/131): ceph-mon-18.0.0-5128.ga5d48e8c.el8.x86 1.2 MB/s | 4.6 MB 00:03 2023-07-25T14:31:37.561 INFO:teuthology.orchestra.run.smithi092.stdout:(8/131): ceph-common-18.0.0-5128.ga5d48e8c.el8. 1.3 MB/s | 22 MB 00:17 2023-07-25T14:31:37.697 INFO:teuthology.orchestra.run.smithi092.stdout:(9/131): ceph-selinux-18.0.0-5128.ga5d48e8c.el8 180 kB/s | 24 kB 00:00 2023-07-25T14:31:50.396 INFO:teuthology.orchestra.run.smithi072.stdout:(8/131): ceph-common-18.0.0-5128.ga5d48e8c.el8. 951 kB/s | 22 MB 00:23 2023-07-25T14:31:50.597 INFO:teuthology.orchestra.run.smithi072.stdout:(9/131): ceph-selinux-18.0.0-5128.ga5d48e8c.el8 121 kB/s | 24 kB 00:00 2023-07-25T14:31:53.197 INFO:teuthology.orchestra.run.smithi072.stdout:(10/131): ceph-radosgw-18.0.0-5128.ga5d48e8c.el 666 kB/s | 14 MB 00:20 2023-07-25T14:31:54.268 INFO:teuthology.orchestra.run.smithi072.stdout:(11/131): cephfs-mirror-18.0.0-5128.ga5d48e8c.e 243 kB/s | 260 kB 00:01 2023-07-25T14:31:54.415 INFO:teuthology.orchestra.run.smithi072.stdout:(12/131): libcephfs-devel-18.0.0-5128.ga5d48e8c 213 kB/s | 31 kB 00:00 2023-07-25T14:31:54.536 INFO:teuthology.orchestra.run.smithi092.stdout:(10/131): ceph-osd-18.0.0-5128.ga5d48e8c.el8.x8 715 kB/s | 18 MB 00:25 2023-07-25T14:31:54.815 INFO:teuthology.orchestra.run.smithi072.stdout:(13/131): ceph-osd-18.0.0-5128.ga5d48e8c.el8.x8 741 kB/s | 18 MB 00:24 2023-07-25T14:31:54.853 INFO:teuthology.orchestra.run.smithi092.stdout:(11/131): cephfs-mirror-18.0.0-5128.ga5d48e8c.e 821 kB/s | 260 kB 00:00 2023-07-25T14:31:54.944 INFO:teuthology.orchestra.run.smithi092.stdout:(12/131): libcephfs-devel-18.0.0-5128.ga5d48e8c 339 kB/s | 31 kB 00:00 2023-07-25T14:31:55.174 INFO:teuthology.orchestra.run.smithi072.stdout:(14/131): libcephsqlite-18.0.0-5128.ga5d48e8c.e 388 kB/s | 139 kB 00:00 2023-07-25T14:31:55.460 INFO:teuthology.orchestra.run.smithi072.stdout:(15/131): librados-devel-18.0.0-5128.ga5d48e8c. 487 kB/s | 139 kB 00:00 2023-07-25T14:31:56.035 INFO:teuthology.orchestra.run.smithi072.stdout:(16/131): libcephfs2-18.0.0-5128.ga5d48e8c.el8. 483 kB/s | 783 kB 00:01 2023-07-25T14:31:56.177 INFO:teuthology.orchestra.run.smithi072.stdout:(17/131): libradosstriper1-18.0.0-5128.ga5d48e8 660 kB/s | 473 kB 00:00 2023-07-25T14:31:56.303 INFO:teuthology.orchestra.run.smithi072.stdout:(18/131): python3-ceph-argparse-18.0.0-5128.ga5 357 kB/s | 45 kB 00:00 2023-07-25T14:31:56.345 INFO:teuthology.orchestra.run.smithi092.stdout:(13/131): libcephfs2-18.0.0-5128.ga5d48e8c.el8. 559 kB/s | 783 kB 00:01 2023-07-25T14:31:56.537 INFO:teuthology.orchestra.run.smithi072.stdout:(19/131): python3-ceph-common-18.0.0-5128.ga5d4 525 kB/s | 122 kB 00:00 2023-07-25T14:31:56.611 INFO:teuthology.orchestra.run.smithi092.stdout:(14/131): libcephsqlite-18.0.0-5128.ga5d48e8c.e 521 kB/s | 139 kB 00:00 2023-07-25T14:31:56.787 INFO:teuthology.orchestra.run.smithi072.stdout:(20/131): python3-cephfs-18.0.0-5128.ga5d48e8c. 786 kB/s | 197 kB 00:00 2023-07-25T14:31:56.812 INFO:teuthology.orchestra.run.smithi092.stdout:(15/131): librados-devel-18.0.0-5128.ga5d48e8c. 695 kB/s | 139 kB 00:00 2023-07-25T14:31:57.279 INFO:teuthology.orchestra.run.smithi072.stdout:(21/131): python3-rados-18.0.0-5128.ga5d48e8c.e 755 kB/s | 371 kB 00:00 2023-07-25T14:31:57.520 INFO:teuthology.orchestra.run.smithi092.stdout:(16/131): libradosstriper1-18.0.0-5128.ga5d48e8 668 kB/s | 473 kB 00:00 2023-07-25T14:31:57.747 INFO:teuthology.orchestra.run.smithi072.stdout:(22/131): python3-rbd-18.0.0-5128.ga5d48e8c.el8 779 kB/s | 364 kB 00:00 2023-07-25T14:31:57.889 INFO:teuthology.orchestra.run.smithi072.stdout:(23/131): python3-rgw-18.0.0-5128.ga5d48e8c.el8 752 kB/s | 107 kB 00:00 2023-07-25T14:31:58.139 INFO:teuthology.orchestra.run.smithi072.stdout:(24/131): rbd-fuse-18.0.0-5128.ga5d48e8c.el8.x8 374 kB/s | 94 kB 00:00 2023-07-25T14:32:01.670 INFO:teuthology.orchestra.run.smithi092.stdout:(17/131): ceph-radosgw-18.0.0-5128.ga5d48e8c.el 481 kB/s | 14 MB 00:28 2023-07-25T14:32:01.707 INFO:teuthology.orchestra.run.smithi072.stdout:(25/131): rbd-mirror-18.0.0-5128.ga5d48e8c.el8. 1.0 MB/s | 3.5 MB 00:03 2023-07-25T14:32:01.745 INFO:teuthology.orchestra.run.smithi092.stdout:(18/131): python3-ceph-argparse-18.0.0-5128.ga5 600 kB/s | 45 kB 00:00 2023-07-25T14:32:01.899 INFO:teuthology.orchestra.run.smithi072.stdout:(26/131): rbd-nbd-18.0.0-5128.ga5d48e8c.el8.x86 934 kB/s | 179 kB 00:00 2023-07-25T14:32:01.937 INFO:teuthology.orchestra.run.smithi092.stdout:(19/131): python3-ceph-common-18.0.0-5128.ga5d4 639 kB/s | 122 kB 00:00 2023-07-25T14:32:01.974 INFO:teuthology.orchestra.run.smithi072.stdout:(27/131): ceph-grafana-dashboards-18.0.0-5128.g 305 kB/s | 23 kB 00:00 2023-07-25T14:32:02.125 INFO:teuthology.orchestra.run.smithi072.stdout:(28/131): ceph-mgr-cephadm-18.0.0-5128.ga5d48e8 860 kB/s | 129 kB 00:00 2023-07-25T14:32:02.212 INFO:teuthology.orchestra.run.smithi092.stdout:(20/131): python3-cephfs-18.0.0-5128.ga5d48e8c. 715 kB/s | 197 kB 00:00 2023-07-25T14:32:02.929 INFO:teuthology.orchestra.run.smithi092.stdout:(21/131): python3-rados-18.0.0-5128.ga5d48e8c.e 518 kB/s | 371 kB 00:00 2023-07-25T14:32:03.729 INFO:teuthology.orchestra.run.smithi092.stdout:(22/131): python3-rbd-18.0.0-5128.ga5d48e8c.el8 455 kB/s | 364 kB 00:00 2023-07-25T14:32:03.969 INFO:teuthology.orchestra.run.smithi072.stdout:(29/131): ceph-mgr-dashboard-18.0.0-5128.ga5d48 953 kB/s | 1.7 MB 00:01 2023-07-25T14:32:03.971 INFO:teuthology.orchestra.run.smithi092.stdout:(23/131): python3-rgw-18.0.0-5128.ga5d48e8c.el8 442 kB/s | 107 kB 00:00 2023-07-25T14:32:04.280 INFO:teuthology.orchestra.run.smithi092.stdout:(24/131): rbd-fuse-18.0.0-5128.ga5d48e8c.el8.x8 304 kB/s | 94 kB 00:00 2023-07-25T14:32:04.361 INFO:teuthology.orchestra.run.smithi072.stdout:(30/131): librgw2-18.0.0-5128.ga5d48e8c.el8.x86 834 kB/s | 6.8 MB 00:08 2023-07-25T14:32:04.711 INFO:teuthology.orchestra.run.smithi072.stdout:(31/131): ceph-mgr-modules-core-18.0.0-5128.ga5 688 kB/s | 241 kB 00:00 2023-07-25T14:32:04.795 INFO:teuthology.orchestra.run.smithi072.stdout:(32/131): ceph-mgr-rook-18.0.0-5128.ga5d48e8c.e 567 kB/s | 47 kB 00:00 2023-07-25T14:32:04.879 INFO:teuthology.orchestra.run.smithi072.stdout:(33/131): ceph-prometheus-alerts-18.0.0-5128.ga 174 kB/s | 14 kB 00:00 2023-07-25T14:32:05.188 INFO:teuthology.orchestra.run.smithi072.stdout:(34/131): ceph-volume-18.0.0-5128.ga5d48e8c.el8 837 kB/s | 258 kB 00:00 2023-07-25T14:32:05.413 INFO:teuthology.orchestra.run.smithi072.stdout:(35/131): cephadm-18.0.0-5128.ga5d48e8c.el8.noa 734 kB/s | 165 kB 00:00 2023-07-25T14:32:05.522 INFO:teuthology.orchestra.run.smithi072.stdout:(36/131): cephfs-top-18.0.0-5128.ga5d48e8c.el8. 165 kB/s | 18 kB 00:00 2023-07-25T14:32:05.855 INFO:teuthology.orchestra.run.smithi092.stdout:(25/131): librgw2-18.0.0-5128.ga5d48e8c.el8.x86 833 kB/s | 6.8 MB 00:08 2023-07-25T14:32:06.113 INFO:teuthology.orchestra.run.smithi092.stdout:(26/131): rbd-nbd-18.0.0-5128.ga5d48e8c.el8.x86 693 kB/s | 179 kB 00:00 2023-07-25T14:32:06.205 INFO:teuthology.orchestra.run.smithi092.stdout:(27/131): ceph-grafana-dashboards-18.0.0-5128.g 251 kB/s | 23 kB 00:00 2023-07-25T14:32:06.422 INFO:teuthology.orchestra.run.smithi092.stdout:(28/131): ceph-mgr-cephadm-18.0.0-5128.ga5d48e8 596 kB/s | 129 kB 00:00 2023-07-25T14:32:06.748 INFO:teuthology.orchestra.run.smithi072.stdout:(37/131): gperftools-libs-2.7-9.el8.x86_64.rpm 250 kB/s | 306 kB 00:01 2023-07-25T14:32:07.098 INFO:teuthology.orchestra.run.smithi072.stdout:(38/131): liboath-2.6.2-3.el8.x86_64.rpm 168 kB/s | 59 kB 00:00 2023-07-25T14:32:07.423 INFO:teuthology.orchestra.run.smithi072.stdout:(39/131): libunwind-1.3.1-3.el8.x86_64.rpm 231 kB/s | 75 kB 00:00 2023-07-25T14:32:08.813 INFO:teuthology.orchestra.run.smithi092.stdout:(29/131): ceph-mgr-dashboard-18.0.0-5128.ga5d48 735 kB/s | 1.7 MB 00:02 2023-07-25T14:32:08.866 INFO:teuthology.orchestra.run.smithi072.stdout:(40/131): python3-asyncssh-2.7.0-2.el8.noarch.r 330 kB/s | 476 kB 00:01 2023-07-25T14:32:09.041 INFO:teuthology.orchestra.run.smithi072.stdout:(41/131): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 249 kB/s | 44 kB 00:00 2023-07-25T14:32:09.633 INFO:teuthology.orchestra.run.smithi072.stdout:(42/131): python3-beautifulsoup4-4.6.3-2.el8.1. 313 kB/s | 185 kB 00:00 2023-07-25T14:32:09.810 INFO:teuthology.orchestra.run.smithi072.stdout:(43/131): python3-cachetools-3.1.1-4.el8.noarch 187 kB/s | 33 kB 00:00 2023-07-25T14:32:09.911 INFO:teuthology.orchestra.run.smithi072.stdout:(44/131): python3-certifi-2018.10.15-7.el8.noar 163 kB/s | 16 kB 00:00 2023-07-25T14:32:10.172 INFO:teuthology.orchestra.run.smithi092.stdout:(30/131): rbd-mirror-18.0.0-5128.ga5d48e8c.el8. 613 kB/s | 3.5 MB 00:05 2023-07-25T14:32:10.345 INFO:teuthology.orchestra.run.smithi072.stdout:(45/131): python3-cheroot-8.5.2-1.el8.noarch.rp 398 kB/s | 173 kB 00:00 2023-07-25T14:32:10.630 INFO:teuthology.orchestra.run.smithi092.stdout:(31/131): ceph-mgr-modules-core-18.0.0-5128.ga5 526 kB/s | 241 kB 00:00 2023-07-25T14:32:10.772 INFO:teuthology.orchestra.run.smithi092.stdout:(32/131): ceph-mgr-rook-18.0.0-5128.ga5d48e8c.e 335 kB/s | 47 kB 00:00 2023-07-25T14:32:10.839 INFO:teuthology.orchestra.run.smithi092.stdout:(33/131): ceph-prometheus-alerts-18.0.0-5128.ga 218 kB/s | 14 kB 00:00 2023-07-25T14:32:11.071 INFO:teuthology.orchestra.run.smithi072.stdout:(46/131): python3-cherrypy-18.4.0-1.el8.noarch. 530 kB/s | 384 kB 00:00 2023-07-25T14:32:11.206 INFO:teuthology.orchestra.run.smithi092.stdout:(34/131): ceph-volume-18.0.0-5128.ga5d48e8c.el8 704 kB/s | 258 kB 00:00 2023-07-25T14:32:11.230 INFO:teuthology.orchestra.run.smithi072.stdout:(47/131): python3-google-auth-1.1.1-10.el8.noar 513 kB/s | 81 kB 00:00 2023-07-25T14:32:11.313 INFO:teuthology.orchestra.run.smithi072.stdout:(48/131): python3-jaraco-6.2-6.el8.noarch.rpm 133 kB/s | 11 kB 00:00 2023-07-25T14:32:11.397 INFO:teuthology.orchestra.run.smithi072.stdout:(49/131): python3-jaraco-functools-2.0-4.el8.no 210 kB/s | 18 kB 00:00 2023-07-25T14:32:11.439 INFO:teuthology.orchestra.run.smithi092.stdout:(35/131): cephadm-18.0.0-5128.ga5d48e8c.el8.noa 708 kB/s | 165 kB 00:00 2023-07-25T14:32:11.515 INFO:teuthology.orchestra.run.smithi092.stdout:(36/131): cephfs-top-18.0.0-5128.ga5d48e8c.el8. 239 kB/s | 18 kB 00:00 2023-07-25T14:32:11.956 INFO:teuthology.orchestra.run.smithi092.stdout:(37/131): gperftools-libs-2.7-9.el8.x86_64.rpm 694 kB/s | 306 kB 00:00 2023-07-25T14:32:12.049 INFO:teuthology.orchestra.run.smithi092.stdout:(38/131): liboath-2.6.2-3.el8.x86_64.rpm 639 kB/s | 59 kB 00:00 2023-07-25T14:32:12.132 INFO:teuthology.orchestra.run.smithi092.stdout:(39/131): libunwind-1.3.1-3.el8.x86_64.rpm 902 kB/s | 75 kB 00:00 2023-07-25T14:32:12.323 INFO:teuthology.orchestra.run.smithi072.stdout:(50/131): python3-kubernetes-11.0.0-6.el8.noarc 1.3 MB/s | 1.2 MB 00:00 2023-07-25T14:32:12.448 INFO:teuthology.orchestra.run.smithi072.stdout:(51/131): python3-logutils-0.3.5-11.el8.noarch. 389 kB/s | 49 kB 00:00 2023-07-25T14:32:12.449 INFO:teuthology.orchestra.run.smithi092.stdout:(40/131): python3-asyncssh-2.7.0-2.el8.noarch.r 1.5 MB/s | 476 kB 00:00 2023-07-25T14:32:12.525 INFO:teuthology.orchestra.run.smithi092.stdout:(41/131): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 582 kB/s | 44 kB 00:00 2023-07-25T14:32:12.566 INFO:teuthology.orchestra.run.smithi072.stdout:(52/131): python3-more-itertools-7.2.0-3.el8.no 502 kB/s | 59 kB 00:00 2023-07-25T14:32:12.642 INFO:teuthology.orchestra.run.smithi092.stdout:(42/131): python3-beautifulsoup4-4.6.3-2.el8.1. 1.6 MB/s | 185 kB 00:00 2023-07-25T14:32:12.675 INFO:teuthology.orchestra.run.smithi072.stdout:(53/131): python3-natsort-7.1.1-2.el8.noarch.rp 555 kB/s | 60 kB 00:00 2023-07-25T14:32:12.733 INFO:teuthology.orchestra.run.smithi092.stdout:(43/131): python3-cachetools-3.1.1-4.el8.noarch 361 kB/s | 33 kB 00:00 2023-07-25T14:32:12.809 INFO:teuthology.orchestra.run.smithi092.stdout:(44/131): python3-certifi-2018.10.15-7.el8.noar 217 kB/s | 16 kB 00:00 2023-07-25T14:32:12.967 INFO:teuthology.orchestra.run.smithi072.stdout:(54/131): python3-pecan-1.3.2-9.el8.noarch.rpm 969 kB/s | 283 kB 00:00 2023-07-25T14:32:12.967 INFO:teuthology.orchestra.run.smithi092.stdout:(45/131): python3-cheroot-8.5.2-1.el8.noarch.rp 1.1 MB/s | 173 kB 00:00 2023-07-25T14:32:13.067 INFO:teuthology.orchestra.run.smithi072.stdout:(55/131): python3-portend-2.6-1.el8.noarch.rpm 155 kB/s | 16 kB 00:00 2023-07-25T14:32:13.201 INFO:teuthology.orchestra.run.smithi072.stdout:(56/131): python3-repoze-lru-0.7-6.el8.noarch.r 252 kB/s | 34 kB 00:00 2023-07-25T14:32:13.343 INFO:teuthology.orchestra.run.smithi092.stdout:(46/131): python3-cherrypy-18.4.0-1.el8.noarch. 1.0 MB/s | 384 kB 00:00 2023-07-25T14:32:13.451 INFO:teuthology.orchestra.run.smithi092.stdout:(47/131): python3-google-auth-1.1.1-10.el8.noar 751 kB/s | 81 kB 00:00 2023-07-25T14:32:13.478 INFO:teuthology.orchestra.run.smithi072.stdout:(57/131): python3-routes-2.4.1-12.el8.noarch.rp 710 kB/s | 196 kB 00:00 2023-07-25T14:32:13.551 INFO:teuthology.orchestra.run.smithi092.stdout:(48/131): python3-jaraco-6.2-6.el8.noarch.rpm 111 kB/s | 11 kB 00:00 2023-07-25T14:32:13.629 INFO:teuthology.orchestra.run.smithi072.stdout:(58/131): python3-rsa-4.8-1.el8.noarch.rpm 409 kB/s | 61 kB 00:00 2023-07-25T14:32:13.652 INFO:teuthology.orchestra.run.smithi092.stdout:(49/131): python3-jaraco-functools-2.0-4.el8.no 176 kB/s | 18 kB 00:00 2023-07-25T14:32:13.763 INFO:teuthology.orchestra.run.smithi072.stdout:(59/131): ceph-mgr-diskprediction-local-18.0.0- 774 kB/s | 7.4 MB 00:09 2023-07-25T14:32:13.797 INFO:teuthology.orchestra.run.smithi072.stdout:(60/131): python3-simplegeneric-0.8.1-17.el8.no 112 kB/s | 19 kB 00:00 2023-07-25T14:32:13.931 INFO:teuthology.orchestra.run.smithi072.stdout:(61/131): python3-tempora-1.14.1-5.el8.noarch.r 219 kB/s | 29 kB 00:00 2023-07-25T14:32:14.048 INFO:teuthology.orchestra.run.smithi072.stdout:(62/131): python3-trustme-0.6.0-4.el8.noarch.rp 235 kB/s | 27 kB 00:00 2023-07-25T14:32:14.148 INFO:teuthology.orchestra.run.smithi072.stdout:(63/131): python3-singledispatch-3.4.0.3-18.el8 62 kB/s | 24 kB 00:00 2023-07-25T14:32:14.524 INFO:teuthology.orchestra.run.smithi072.stdout:(64/131): python3-waitress-1.4.3-1.el8.noarch.r 536 kB/s | 255 kB 00:00 2023-07-25T14:32:14.642 INFO:teuthology.orchestra.run.smithi072.stdout:(65/131): python3-websocket-client-0.56.0-5.el8 523 kB/s | 61 kB 00:00 2023-07-25T14:32:14.825 INFO:teuthology.orchestra.run.smithi072.stdout:(66/131): python3-webtest-2.0.33-1.el8.noarch.r 465 kB/s | 85 kB 00:00 2023-07-25T14:32:14.851 INFO:teuthology.orchestra.run.smithi072.stdout:(67/131): python3-webob-1.8.5-1.el8.1.noarch.rp 358 kB/s | 251 kB 00:00 2023-07-25T14:32:14.926 INFO:teuthology.orchestra.run.smithi072.stdout:(68/131): python3-zc-lockfile-2.0-2.el8.noarch. 228 kB/s | 23 kB 00:00 2023-07-25T14:32:14.960 INFO:teuthology.orchestra.run.smithi072.stdout:(69/131): xmlstarlet-1.6.1-20.el8.x86_64.rpm 2.0 MB/s | 70 kB 00:00 2023-07-25T14:32:15.019 INFO:teuthology.orchestra.run.smithi072.stdout:(70/131): librabbitmq-0.9.0-3.el8.x86_64.rpm 799 kB/s | 47 kB 00:00 2023-07-25T14:32:15.063 INFO:teuthology.orchestra.run.smithi072.stdout:(71/131): libselinux-devel-2.9-5.el8.x86_64.rpm 4.5 MB/s | 200 kB 00:00 2023-07-25T14:32:15.105 INFO:teuthology.orchestra.run.smithi072.stdout:(72/131): python3-jwt-1.6.1-2.el8.noarch.rpm 1.0 MB/s | 43 kB 00:00 2023-07-25T14:32:15.147 INFO:teuthology.orchestra.run.smithi072.stdout:(73/131): pcre2-utf32-10.32-2.el8.x86_64.rpm 5.1 MB/s | 220 kB 00:00 2023-07-25T14:32:15.168 INFO:teuthology.orchestra.run.smithi092.stdout:(50/131): python3-kubernetes-11.0.0-6.el8.noarc 787 kB/s | 1.2 MB 00:01 2023-07-25T14:32:15.189 INFO:teuthology.orchestra.run.smithi072.stdout:(74/131): keyutils-libs-devel-1.5.10-9.el8.x86_ 1.1 MB/s | 48 kB 00:00 2023-07-25T14:32:15.232 INFO:teuthology.orchestra.run.smithi072.stdout:(75/131): libsepol-devel-2.9-3.el8.x86_64.rpm 2.0 MB/s | 87 kB 00:00 2023-07-25T14:32:15.274 INFO:teuthology.orchestra.run.smithi072.stdout:(76/131): python3-requests-oauthlib-1.0.0-1.el8 1.0 MB/s | 43 kB 00:00 2023-07-25T14:32:15.294 INFO:teuthology.orchestra.run.smithi092.stdout:(51/131): python3-logutils-0.3.5-11.el8.noarch. 390 kB/s | 49 kB 00:00 2023-07-25T14:32:15.308 INFO:teuthology.orchestra.run.smithi072.stdout:(77/131): python3-pycparser-2.14-14.el8.noarch. 3.2 MB/s | 109 kB 00:00 2023-07-25T14:32:15.350 INFO:teuthology.orchestra.run.smithi072.stdout:(78/131): pcre2-utf16-10.32-2.el8.x86_64.rpm 5.4 MB/s | 229 kB 00:00 2023-07-25T14:32:15.400 INFO:teuthology.orchestra.run.smithi072.stdout:(79/131): krb5-devel-1.18.2-14.el8.x86_64.rpm 11 MB/s | 560 kB 00:00 2023-07-25T14:32:15.434 INFO:teuthology.orchestra.run.smithi072.stdout:(80/131): libaio-devel-0.3.112-1.el8.x86_64.rpm 557 kB/s | 19 kB 00:00 2023-07-25T14:32:15.469 INFO:teuthology.orchestra.run.smithi092.stdout:(52/131): python3-more-itertools-7.2.0-3.el8.no 335 kB/s | 59 kB 00:00 2023-07-25T14:32:15.476 INFO:teuthology.orchestra.run.smithi072.stdout:(81/131): python3-oauthlib-2.1.0-1.el8.noarch.r 3.6 MB/s | 155 kB 00:00 2023-07-25T14:32:15.527 INFO:teuthology.orchestra.run.smithi072.stdout:(82/131): python3-cryptography-3.2.1-5.el8.x86_ 11 MB/s | 559 kB 00:00 2023-07-25T14:32:15.561 INFO:teuthology.orchestra.run.smithi072.stdout:(83/131): libverto-devel-0.3.0-5.el8.x86_64.rpm 533 kB/s | 18 kB 00:00 2023-07-25T14:32:15.612 INFO:teuthology.orchestra.run.smithi072.stdout:(84/131): pcre2-devel-10.32-2.el8.x86_64.rpm 12 MB/s | 605 kB 00:00 2023-07-25T14:32:15.654 INFO:teuthology.orchestra.run.smithi072.stdout:(85/131): python3-cffi-1.11.5-5.el8.x86_64.rpm 5.6 MB/s | 238 kB 00:00 2023-07-25T14:32:15.661 INFO:teuthology.orchestra.run.smithi092.stdout:(53/131): python3-natsort-7.1.1-2.el8.noarch.rp 314 kB/s | 60 kB 00:00 2023-07-25T14:32:15.756 INFO:teuthology.orchestra.run.smithi072.stdout:(86/131): openssl-devel-1.1.1k-7.el8_6.x86_64.r 23 MB/s | 2.3 MB 00:00 2023-07-25T14:32:15.798 INFO:teuthology.orchestra.run.smithi072.stdout:(87/131): xfsprogs-devel-5.0.0-10.el8.x86_64.rp 1.7 MB/s | 72 kB 00:00 2023-07-25T14:32:15.840 INFO:teuthology.orchestra.run.smithi072.stdout:(88/131): fuse-2.9.7-15.el8.x86_64.rpm 1.9 MB/s | 83 kB 00:00 2023-07-25T14:32:15.883 INFO:teuthology.orchestra.run.smithi072.stdout:(89/131): elfutils-libelf-devel-0.186-1.el8.x86 1.4 MB/s | 60 kB 00:00 2023-07-25T14:32:15.925 INFO:teuthology.orchestra.run.smithi072.stdout:(90/131): libuuid-devel-2.32.1-35.el8.x86_64.rp 2.3 MB/s | 98 kB 00:00 2023-07-25T14:32:15.976 INFO:teuthology.orchestra.run.smithi072.stdout:(91/131): zlib-devel-1.2.11-18.el8_5.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2023-07-25T14:32:16.009 INFO:teuthology.orchestra.run.smithi072.stdout:(92/131): libcom_err-devel-1.45.6-4.el8.x86_64. 1.1 MB/s | 39 kB 00:00 2023-07-25T14:32:16.068 INFO:teuthology.orchestra.run.smithi072.stdout:(93/131): libgfortran-8.5.0-10.1.el8_6.x86_64.r 11 MB/s | 644 kB 00:00 2023-07-25T14:32:16.111 INFO:teuthology.orchestra.run.smithi072.stdout:(94/131): libquadmath-8.5.0-10.1.el8_6.x86_64.r 4.0 MB/s | 171 kB 00:00 2023-07-25T14:32:16.153 INFO:teuthology.orchestra.run.smithi072.stdout:(95/131): NetworkManager-initscripts-updown-1.3 3.2 MB/s | 138 kB 00:00 2023-07-25T14:32:16.553 INFO:teuthology.orchestra.run.smithi072.stdout:(96/131): python3-scipy-1.0.0-21.module+el8.5.0 34 MB/s | 14 MB 00:00 2023-07-25T14:32:16.587 INFO:teuthology.orchestra.run.smithi072.stdout:(97/131): python3-pyasn1-modules-0.3.7-6.el8.no 3.2 MB/s | 110 kB 00:00 2023-07-25T14:32:16.628 INFO:teuthology.orchestra.run.smithi092.stdout:(54/131): python3-pecan-1.3.2-9.el8.noarch.rpm 293 kB/s | 283 kB 00:00 2023-07-25T14:32:16.629 INFO:teuthology.orchestra.run.smithi072.stdout:(98/131): python3-pytz-2017.2-9.el8.noarch.rpm 1.3 MB/s | 54 kB 00:00 2023-07-25T14:32:16.672 INFO:teuthology.orchestra.run.smithi072.stdout:(99/131): lttng-ust-2.8.1-11.el8.x86_64.rpm 6.0 MB/s | 259 kB 00:00 2023-07-25T14:32:16.716 INFO:teuthology.orchestra.run.smithi072.stdout:(100/131): socat-1.7.4.1-1.el8.x86_64.rpm 7.3 MB/s | 323 kB 00:00 2023-07-25T14:32:16.749 INFO:teuthology.orchestra.run.smithi072.stdout:(101/131): python3-markupsafe-0.23-19.el8.x86_6 1.1 MB/s | 39 kB 00:00 2023-07-25T14:32:16.800 INFO:teuthology.orchestra.run.smithi072.stdout:(102/131): bison-3.0.4-10.el8.x86_64.rpm 13 MB/s | 688 kB 00:00 2023-07-25T14:32:16.850 INFO:teuthology.orchestra.run.smithi072.stdout:(103/131): python3-jinja2-2.10.1-3.el8.noarch.r 10 MB/s | 538 kB 00:00 2023-07-25T14:32:16.853 INFO:teuthology.orchestra.run.smithi092.stdout:(55/131): python3-portend-2.6-1.el8.noarch.rpm 69 kB/s | 16 kB 00:00 2023-07-25T14:32:16.893 INFO:teuthology.orchestra.run.smithi072.stdout:(104/131): python3-mako-1.0.6-13.el8.noarch.rpm 3.7 MB/s | 157 kB 00:00 2023-07-25T14:32:16.927 INFO:teuthology.orchestra.run.smithi072.stdout:(105/131): oniguruma-6.8.2-2.el8.x86_64.rpm 5.4 MB/s | 187 kB 00:00 2023-07-25T14:32:16.978 INFO:teuthology.orchestra.run.smithi092.stdout:(56/131): python3-repoze-lru-0.7-6.el8.noarch.r 269 kB/s | 34 kB 00:00 2023-07-25T14:32:16.985 INFO:teuthology.orchestra.run.smithi072.stdout:(106/131): automake-1.16.1-7.el8.noarch.rpm 12 MB/s | 713 kB 00:00 2023-07-25T14:32:17.136 INFO:teuthology.orchestra.run.smithi072.stdout:(107/131): python3-babel-2.5.1-7.el8.noarch.rpm 32 MB/s | 4.8 MB 00:00 2023-07-25T14:32:17.170 INFO:teuthology.orchestra.run.smithi072.stdout:(108/131): python3-jsonpatch-1.21-2.el8.noarch. 796 kB/s | 27 kB 00:00 2023-07-25T14:32:17.212 INFO:teuthology.orchestra.run.smithi072.stdout:(109/131): flex-2.6.1-9.el8.x86_64.rpm 7.5 MB/s | 320 kB 00:00 2023-07-25T14:32:17.246 INFO:teuthology.orchestra.run.smithi072.stdout:(110/131): python3-prettytable-0.7.2-14.el8.noa 1.3 MB/s | 44 kB 00:00 2023-07-25T14:32:17.380 INFO:teuthology.orchestra.run.smithi072.stdout:(111/131): python3-numpy-1.14.3-10.el8.x86_64.r 28 MB/s | 3.7 MB 00:00 2023-07-25T14:32:17.431 INFO:teuthology.orchestra.run.smithi072.stdout:(112/131): python3-werkzeug-0.12.2-4.el8.noarch 8.9 MB/s | 457 kB 00:00 2023-07-25T14:32:17.473 INFO:teuthology.orchestra.run.smithi072.stdout:(113/131): python3-numpy-f2py-1.14.3-10.el8.x86 5.2 MB/s | 225 kB 00:00 2023-07-25T14:32:17.487 INFO:teuthology.orchestra.run.smithi092.stdout:(57/131): python3-routes-2.4.1-12.el8.noarch.rp 386 kB/s | 196 kB 00:00 2023-07-25T14:32:17.515 INFO:teuthology.orchestra.run.smithi072.stdout:(114/131): uuid-1.6.2-43.el8.x86_64.rpm 1.5 MB/s | 64 kB 00:00 2023-07-25T14:32:17.559 INFO:teuthology.orchestra.run.smithi072.stdout:(115/131): python3-pyasn1-0.3.7-6.el8.noarch.rp 2.8 MB/s | 126 kB 00:00 2023-07-25T14:32:17.593 INFO:teuthology.orchestra.run.smithi072.stdout:(116/131): python3-jsonpointer-1.10-11.el8.noar 597 kB/s | 20 kB 00:00 2023-07-25T14:32:17.635 INFO:teuthology.orchestra.run.smithi072.stdout:(117/131): python3-pyOpenSSL-19.0.0-1.el8.noarc 2.4 MB/s | 103 kB 00:00 2023-07-25T14:32:17.694 INFO:teuthology.orchestra.run.smithi072.stdout:(118/131): libtool-2.4.6-25.el8.x86_64.rpm 12 MB/s | 709 kB 00:00 2023-07-25T14:32:17.804 INFO:teuthology.orchestra.run.smithi092.stdout:(58/131): python3-rsa-4.8-1.el8.noarch.rpm 194 kB/s | 61 kB 00:00 2023-07-25T14:32:17.853 INFO:teuthology.orchestra.run.smithi072.stdout:(119/131): openblas-threads-0.3.15-3.el8.x86_64 31 MB/s | 4.9 MB 00:00 2023-07-25T14:32:17.895 INFO:teuthology.orchestra.run.smithi072.stdout:(120/131): libpq-13.5-1.el8.x86_64.rpm 4.6 MB/s | 198 kB 00:00 2023-07-25T14:32:17.946 INFO:teuthology.orchestra.run.smithi092.stdout:(59/131): python3-simplegeneric-0.8.1-17.el8.no 132 kB/s | 19 kB 00:00 2023-07-25T14:32:18.054 INFO:teuthology.orchestra.run.smithi072.stdout:(121/131): openblas-0.3.15-3.el8.x86_64.rpm 30 MB/s | 4.7 MB 00:00 2023-07-25T14:32:18.104 INFO:teuthology.orchestra.run.smithi092.stdout:(60/131): python3-singledispatch-3.4.0.3-18.el8 151 kB/s | 24 kB 00:00 2023-07-25T14:32:18.105 INFO:teuthology.orchestra.run.smithi072.stdout:(122/131): thrift-0.13.0-2.el8.x86_64.rpm 546 kB/s | 1.7 MB 00:03 2023-07-25T14:32:18.139 INFO:teuthology.orchestra.run.smithi072.stdout:(123/131): jq-1.6-3.el8.x86_64.rpm 2.3 MB/s | 202 kB 00:00 2023-07-25T14:32:18.189 INFO:teuthology.orchestra.run.smithi072.stdout:(124/131): librdkafka-0.11.4-3.el8.x86_64.rpm 4.1 MB/s | 354 kB 00:00 2023-07-25T14:32:18.248 INFO:teuthology.orchestra.run.smithi072.stdout:(125/131): postgresql-contrib-10.21-2.module+el 13 MB/s | 808 kB 00:00 2023-07-25T14:32:18.280 INFO:teuthology.orchestra.run.smithi092.stdout:(61/131): python3-tempora-1.14.1-5.el8.noarch.r 167 kB/s | 29 kB 00:00 2023-07-25T14:32:18.382 INFO:teuthology.orchestra.run.smithi072.stdout:(126/131): postgresql-server-10.21-2.module+el8 21 MB/s | 5.1 MB 00:00 2023-07-25T14:32:18.405 INFO:teuthology.orchestra.run.smithi092.stdout:(62/131): python3-trustme-0.6.0-4.el8.noarch.rp 220 kB/s | 27 kB 00:00 2023-07-25T14:32:18.432 INFO:teuthology.orchestra.run.smithi072.stdout:(127/131): postgresql-10.21-2.module+el8.6.0+15 8.2 MB/s | 1.5 MB 00:00 2023-07-25T14:32:19.205 INFO:teuthology.orchestra.run.smithi092.stdout:(63/131): python3-waitress-1.4.3-1.el8.noarch.r 319 kB/s | 255 kB 00:00 2023-07-25T14:32:19.705 INFO:teuthology.orchestra.run.smithi092.stdout:(64/131): ceph-mgr-diskprediction-local-18.0.0- 696 kB/s | 7.4 MB 00:10 2023-07-25T14:32:19.981 INFO:teuthology.orchestra.run.smithi092.stdout:(65/131): python3-webob-1.8.5-1.el8.1.noarch.rp 324 kB/s | 251 kB 00:00 2023-07-25T14:32:20.231 INFO:teuthology.orchestra.run.smithi092.stdout:(66/131): python3-webtest-2.0.33-1.el8.noarch.r 341 kB/s | 85 kB 00:00 2023-07-25T14:32:20.323 INFO:teuthology.orchestra.run.smithi092.stdout:(67/131): python3-zc-lockfile-2.0-2.el8.noarch. 250 kB/s | 23 kB 00:00 2023-07-25T14:32:21.223 INFO:teuthology.orchestra.run.smithi092.stdout:(68/131): python3-websocket-client-0.56.0-5.el8 40 kB/s | 61 kB 00:01 2023-07-25T14:32:21.248 INFO:teuthology.orchestra.run.smithi092.stdout:(69/131): xmlstarlet-1.6.1-20.el8.x86_64.rpm 2.7 MB/s | 70 kB 00:00 2023-07-25T14:32:21.298 INFO:teuthology.orchestra.run.smithi092.stdout:(70/131): librabbitmq-0.9.0-3.el8.x86_64.rpm 941 kB/s | 47 kB 00:00 2023-07-25T14:32:21.340 INFO:teuthology.orchestra.run.smithi092.stdout:(71/131): libselinux-devel-2.9-5.el8.x86_64.rpm 4.7 MB/s | 200 kB 00:00 2023-07-25T14:32:21.382 INFO:teuthology.orchestra.run.smithi092.stdout:(72/131): python3-jwt-1.6.1-2.el8.noarch.rpm 1.0 MB/s | 43 kB 00:00 2023-07-25T14:32:21.424 INFO:teuthology.orchestra.run.smithi092.stdout:(73/131): pcre2-utf32-10.32-2.el8.x86_64.rpm 5.2 MB/s | 220 kB 00:00 2023-07-25T14:32:21.466 INFO:teuthology.orchestra.run.smithi092.stdout:(74/131): keyutils-libs-devel-1.5.10-9.el8.x86_ 1.1 MB/s | 48 kB 00:00 2023-07-25T14:32:21.508 INFO:teuthology.orchestra.run.smithi092.stdout:(75/131): libsepol-devel-2.9-3.el8.x86_64.rpm 2.0 MB/s | 87 kB 00:00 2023-07-25T14:32:21.550 INFO:teuthology.orchestra.run.smithi092.stdout:(76/131): python3-requests-oauthlib-1.0.0-1.el8 1.0 MB/s | 43 kB 00:00 2023-07-25T14:32:21.592 INFO:teuthology.orchestra.run.smithi092.stdout:(77/131): python3-pycparser-2.14-14.el8.noarch. 2.6 MB/s | 109 kB 00:00 2023-07-25T14:32:21.634 INFO:teuthology.orchestra.run.smithi092.stdout:(78/131): pcre2-utf16-10.32-2.el8.x86_64.rpm 5.4 MB/s | 229 kB 00:00 2023-07-25T14:32:21.676 INFO:teuthology.orchestra.run.smithi092.stdout:(79/131): krb5-devel-1.18.2-14.el8.x86_64.rpm 13 MB/s | 560 kB 00:00 2023-07-25T14:32:21.709 INFO:teuthology.orchestra.run.smithi092.stdout:(80/131): libaio-devel-0.3.112-1.el8.x86_64.rpm 560 kB/s | 19 kB 00:00 2023-07-25T14:32:21.751 INFO:teuthology.orchestra.run.smithi092.stdout:(81/131): python3-oauthlib-2.1.0-1.el8.noarch.r 3.6 MB/s | 155 kB 00:00 2023-07-25T14:32:21.793 INFO:teuthology.orchestra.run.smithi092.stdout:(82/131): python3-cryptography-3.2.1-5.el8.x86_ 13 MB/s | 559 kB 00:00 2023-07-25T14:32:21.835 INFO:teuthology.orchestra.run.smithi092.stdout:(83/131): libverto-devel-0.3.0-5.el8.x86_64.rpm 430 kB/s | 18 kB 00:00 2023-07-25T14:32:21.902 INFO:teuthology.orchestra.run.smithi092.stdout:(84/131): pcre2-devel-10.32-2.el8.x86_64.rpm 8.9 MB/s | 605 kB 00:00 2023-07-25T14:32:21.944 INFO:teuthology.orchestra.run.smithi092.stdout:(85/131): python3-cffi-1.11.5-5.el8.x86_64.rpm 5.6 MB/s | 238 kB 00:00 2023-07-25T14:32:22.036 INFO:teuthology.orchestra.run.smithi092.stdout:(86/131): openssl-devel-1.1.1k-7.el8_6.x86_64.r 25 MB/s | 2.3 MB 00:00 2023-07-25T14:32:22.070 INFO:teuthology.orchestra.run.smithi092.stdout:(87/131): xfsprogs-devel-5.0.0-10.el8.x86_64.rp 2.1 MB/s | 72 kB 00:00 2023-07-25T14:32:22.112 INFO:teuthology.orchestra.run.smithi092.stdout:(88/131): fuse-2.9.7-15.el8.x86_64.rpm 1.9 MB/s | 83 kB 00:00 2023-07-25T14:32:22.154 INFO:teuthology.orchestra.run.smithi092.stdout:(89/131): elfutils-libelf-devel-0.186-1.el8.x86 1.4 MB/s | 60 kB 00:00 2023-07-25T14:32:22.187 INFO:teuthology.orchestra.run.smithi092.stdout:(90/131): libuuid-devel-2.32.1-35.el8.x86_64.rp 2.9 MB/s | 98 kB 00:00 2023-07-25T14:32:22.229 INFO:teuthology.orchestra.run.smithi092.stdout:(91/131): zlib-devel-1.2.11-18.el8_5.x86_64.rpm 1.4 MB/s | 58 kB 00:00 2023-07-25T14:32:22.271 INFO:teuthology.orchestra.run.smithi092.stdout:(92/131): libcom_err-devel-1.45.6-4.el8.x86_64. 932 kB/s | 39 kB 00:00 2023-07-25T14:32:22.338 INFO:teuthology.orchestra.run.smithi092.stdout:(93/131): libgfortran-8.5.0-10.1.el8_6.x86_64.r 9.4 MB/s | 644 kB 00:00 2023-07-25T14:32:22.388 INFO:teuthology.orchestra.run.smithi092.stdout:(94/131): libquadmath-8.5.0-10.1.el8_6.x86_64.r 3.3 MB/s | 171 kB 00:00 2023-07-25T14:32:22.431 INFO:teuthology.orchestra.run.smithi092.stdout:(95/131): NetworkManager-initscripts-updown-1.3 3.2 MB/s | 138 kB 00:00 2023-07-25T14:32:22.706 INFO:teuthology.orchestra.run.smithi092.stdout:(96/131): python3-scipy-1.0.0-21.module+el8.5.0 50 MB/s | 14 MB 00:00 2023-07-25T14:32:22.748 INFO:teuthology.orchestra.run.smithi092.stdout:(97/131): python3-pyasn1-modules-0.3.7-6.el8.no 2.6 MB/s | 110 kB 00:00 2023-07-25T14:32:22.782 INFO:teuthology.orchestra.run.smithi092.stdout:(98/131): python3-pytz-2017.2-9.el8.noarch.rpm 1.6 MB/s | 54 kB 00:00 2023-07-25T14:32:22.823 INFO:teuthology.orchestra.run.smithi092.stdout:(99/131): lttng-ust-2.8.1-11.el8.x86_64.rpm 6.1 MB/s | 259 kB 00:00 2023-07-25T14:32:22.865 INFO:teuthology.orchestra.run.smithi092.stdout:(100/131): socat-1.7.4.1-1.el8.x86_64.rpm 7.6 MB/s | 323 kB 00:00 2023-07-25T14:32:22.899 INFO:teuthology.orchestra.run.smithi092.stdout:(101/131): python3-markupsafe-0.23-19.el8.x86_6 1.1 MB/s | 39 kB 00:00 2023-07-25T14:32:22.949 INFO:teuthology.orchestra.run.smithi092.stdout:(102/131): bison-3.0.4-10.el8.x86_64.rpm 13 MB/s | 688 kB 00:00 2023-07-25T14:32:22.999 INFO:teuthology.orchestra.run.smithi092.stdout:(103/131): python3-jinja2-2.10.1-3.el8.noarch.r 11 MB/s | 538 kB 00:00 2023-07-25T14:32:23.041 INFO:teuthology.orchestra.run.smithi092.stdout:(104/131): python3-mako-1.0.6-13.el8.noarch.rpm 3.7 MB/s | 157 kB 00:00 2023-07-25T14:32:23.083 INFO:teuthology.orchestra.run.smithi092.stdout:(105/131): oniguruma-6.8.2-2.el8.x86_64.rpm 4.4 MB/s | 187 kB 00:00 2023-07-25T14:32:23.142 INFO:teuthology.orchestra.run.smithi092.stdout:(106/131): automake-1.16.1-7.el8.noarch.rpm 12 MB/s | 713 kB 00:00 2023-07-25T14:32:23.287 INFO:teuthology.orchestra.run.smithi092.stdout:(107/131): python3-babel-2.5.1-7.el8.noarch.rpm 33 MB/s | 4.8 MB 00:00 2023-07-25T14:32:23.335 INFO:teuthology.orchestra.run.smithi092.stdout:(108/131): python3-jsonpatch-1.21-2.el8.noarch. 569 kB/s | 27 kB 00:00 2023-07-25T14:32:23.376 INFO:teuthology.orchestra.run.smithi092.stdout:(109/131): flex-2.6.1-9.el8.x86_64.rpm 7.5 MB/s | 320 kB 00:00 2023-07-25T14:32:23.427 INFO:teuthology.orchestra.run.smithi092.stdout:(110/131): python3-prettytable-0.7.2-14.el8.noa 880 kB/s | 44 kB 00:00 2023-07-25T14:32:23.543 INFO:teuthology.orchestra.run.smithi092.stdout:(111/131): python3-numpy-1.14.3-10.el8.x86_64.r 32 MB/s | 3.7 MB 00:00 2023-07-25T14:32:23.594 INFO:teuthology.orchestra.run.smithi092.stdout:(112/131): python3-werkzeug-0.12.2-4.el8.noarch 9.0 MB/s | 457 kB 00:00 2023-07-25T14:32:23.636 INFO:teuthology.orchestra.run.smithi092.stdout:(113/131): python3-numpy-f2py-1.14.3-10.el8.x86 5.3 MB/s | 225 kB 00:00 2023-07-25T14:32:23.677 INFO:teuthology.orchestra.run.smithi092.stdout:(114/131): uuid-1.6.2-43.el8.x86_64.rpm 1.5 MB/s | 64 kB 00:00 2023-07-25T14:32:23.719 INFO:teuthology.orchestra.run.smithi092.stdout:(115/131): python3-pyasn1-0.3.7-6.el8.noarch.rp 3.0 MB/s | 126 kB 00:00 2023-07-25T14:32:23.761 INFO:teuthology.orchestra.run.smithi092.stdout:(116/131): python3-jsonpointer-1.10-11.el8.noar 480 kB/s | 20 kB 00:00 2023-07-25T14:32:23.803 INFO:teuthology.orchestra.run.smithi092.stdout:(117/131): python3-pyOpenSSL-19.0.0-1.el8.noarc 2.4 MB/s | 103 kB 00:00 2023-07-25T14:32:23.854 INFO:teuthology.orchestra.run.smithi092.stdout:(118/131): libtool-2.4.6-25.el8.x86_64.rpm 14 MB/s | 709 kB 00:00 2023-07-25T14:32:23.998 INFO:teuthology.orchestra.run.smithi092.stdout:(119/131): openblas-threads-0.3.15-3.el8.x86_64 34 MB/s | 4.9 MB 00:00 2023-07-25T14:32:24.046 INFO:teuthology.orchestra.run.smithi092.stdout:(120/131): libpq-13.5-1.el8.x86_64.rpm 4.0 MB/s | 198 kB 00:00 2023-07-25T14:32:24.163 INFO:teuthology.orchestra.run.smithi092.stdout:(121/131): openblas-0.3.15-3.el8.x86_64.rpm 40 MB/s | 4.7 MB 00:00 2023-07-25T14:32:24.205 INFO:teuthology.orchestra.run.smithi092.stdout:(122/131): jq-1.6-3.el8.x86_64.rpm 4.8 MB/s | 202 kB 00:00 2023-07-25T14:32:24.247 INFO:teuthology.orchestra.run.smithi092.stdout:(123/131): librdkafka-0.11.4-3.el8.x86_64.rpm 8.3 MB/s | 354 kB 00:00 2023-07-25T14:32:24.364 INFO:teuthology.orchestra.run.smithi092.stdout:(124/131): postgresql-server-10.21-2.module+el8 43 MB/s | 5.1 MB 00:00 2023-07-25T14:32:24.414 INFO:teuthology.orchestra.run.smithi092.stdout:(125/131): postgresql-contrib-10.21-2.module+el 16 MB/s | 808 kB 00:00 2023-07-25T14:32:24.481 INFO:teuthology.orchestra.run.smithi092.stdout:(126/131): postgresql-10.21-2.module+el8.6.0+15 23 MB/s | 1.5 MB 00:00 2023-07-25T14:32:26.292 INFO:teuthology.orchestra.run.smithi072.stdout:(128/131): librados2-18.0.0-5128.ga5d48e8c.el8. 477 kB/s | 3.7 MB 00:07 2023-07-25T14:32:26.351 INFO:teuthology.orchestra.run.smithi072.stdout:(129/131): iproute-5.15.0-4.el8_6.1.x86_64.rpm 13 MB/s | 798 kB 00:00 2023-07-25T14:32:26.453 INFO:teuthology.orchestra.run.smithi072.stdout:(130/131): librbd1-18.0.0-5128.ga5d48e8c.el8.x8 464 kB/s | 3.6 MB 00:08 2023-07-25T14:32:27.406 INFO:teuthology.orchestra.run.smithi092.stdout:(127/131): thrift-0.13.0-2.el8.x86_64.rpm 251 kB/s | 1.7 MB 00:07 2023-07-25T14:32:30.364 INFO:teuthology.orchestra.run.smithi092.stdout:(128/131): librados2-18.0.0-5128.ga5d48e8c.el8. 641 kB/s | 3.7 MB 00:05 2023-07-25T14:32:30.423 INFO:teuthology.orchestra.run.smithi092.stdout:(129/131): iproute-5.15.0-4.el8_6.1.x86_64.rpm 13 MB/s | 798 kB 00:00 2023-07-25T14:32:31.239 INFO:teuthology.orchestra.run.smithi092.stdout:(130/131): librbd1-18.0.0-5128.ga5d48e8c.el8.x8 970 kB/s | 3.6 MB 00:03 2023-07-25T14:32:52.760 INFO:teuthology.orchestra.run.smithi092.stdout:(131/131): ceph-test-18.0.0-5128.ga5d48e8c.el8. 655 kB/s | 48 MB 01:15 2023-07-25T14:32:52.763 INFO:teuthology.orchestra.run.smithi092.stdout:-------------------------------------------------------------------------------- 2023-07-25T14:32:52.764 INFO:teuthology.orchestra.run.smithi092.stdout:Total 2.2 MB/s | 206 MB 01:32 2023-07-25T14:32:53.585 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction check 2023-07-25T14:32:53.624 INFO:teuthology.orchestra.run.smithi072.stdout:(131/131): ceph-test-18.0.0-5128.ga5d48e8c.el8. 780 kB/s | 48 MB 01:03 2023-07-25T14:32:53.627 INFO:teuthology.orchestra.run.smithi072.stdout:-------------------------------------------------------------------------------- 2023-07-25T14:32:53.627 INFO:teuthology.orchestra.run.smithi072.stdout:Total 2.4 MB/s | 206 MB 01:27 2023-07-25T14:32:53.704 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction check succeeded. 2023-07-25T14:32:53.704 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction test 2023-07-25T14:32:54.448 INFO:teuthology.orchestra.run.smithi072.stdout:Running transaction check 2023-07-25T14:32:54.567 INFO:teuthology.orchestra.run.smithi072.stdout:Transaction check succeeded. 2023-07-25T14:32:54.568 INFO:teuthology.orchestra.run.smithi072.stdout:Running transaction test 2023-07-25T14:32:54.800 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction test succeeded. 2023-07-25T14:32:54.804 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction 2023-07-25T14:32:55.661 INFO:teuthology.orchestra.run.smithi072.stdout:Transaction test succeeded. 2023-07-25T14:32:55.665 INFO:teuthology.orchestra.run.smithi072.stdout:Running transaction 2023-07-25T14:32:59.746 INFO:teuthology.orchestra.run.smithi092.stdout: Preparing : 1/1 2023-07-25T14:32:59.948 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/134 2023-07-25T14:33:00.131 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/134 2023-07-25T14:33:00.284 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 3/134 2023-07-25T14:33:00.404 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 3/134 2023-07-25T14:33:00.481 INFO:teuthology.orchestra.run.smithi072.stdout: Preparing : 1/1 2023-07-25T14:33:00.634 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 4/134 2023-07-25T14:33:00.677 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/134 2023-07-25T14:33:00.877 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/134 2023-07-25T14:33:01.046 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 3/134 2023-07-25T14:33:01.058 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 4/134 2023-07-25T14:33:01.212 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 3/134 2023-07-25T14:33:01.308 INFO:teuthology.orchestra.run.smithi092.stdout: Upgrading : librados2-2:18.0.0-5128.ga5d48e8c.el8.x86_64 5/134 2023-07-25T14:33:01.438 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 4/134 2023-07-25T14:33:01.695 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: librados2-2:18.0.0-5128.ga5d48e8c.el8.x86_64 5/134 2023-07-25T14:33:01.839 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 4/134 2023-07-25T14:33:01.883 INFO:teuthology.orchestra.run.smithi092.stdout: Upgrading : librbd1-2:18.0.0-5128.ga5d48e8c.el8.x86_64 6/134 2023-07-25T14:33:02.000 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: librbd1-2:18.0.0-5128.ga5d48e8c.el8.x86_64 6/134 2023-07-25T14:33:02.063 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : librados2-2:18.0.0-5128.ga5d48e8c.el8.x86_64 5/134 2023-07-25T14:33:02.183 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libcephfs2-2:18.0.0-5128.ga5d48e8c.el8.x86_64 7/134 2023-07-25T14:33:02.279 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: libcephfs2-2:18.0.0-5128.ga5d48e8c.el8.x86_64 7/134 2023-07-25T14:33:02.438 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-rados-2:18.0.0-5128.ga5d48e8c.el8.x86_64 8/134 2023-07-25T14:33:02.476 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: librados2-2:18.0.0-5128.ga5d48e8c.el8.x86_64 5/134 2023-07-25T14:33:02.609 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 9/134 2023-07-25T14:33:02.679 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : librbd1-2:18.0.0-5128.ga5d48e8c.el8.x86_64 6/134 2023-07-25T14:33:02.811 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: librbd1-2:18.0.0-5128.ga5d48e8c.el8.x86_64 6/134 2023-07-25T14:33:02.870 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libpq-13.5-1.el8.x86_64 10/134 2023-07-25T14:33:03.004 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libcephfs2-2:18.0.0-5128.ga5d48e8c.el8.x86_64 7/134 2023-07-25T14:33:03.086 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/134 2023-07-25T14:33:03.098 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: libcephfs2-2:18.0.0-5128.ga5d48e8c.el8.x86_64 7/134 2023-07-25T14:33:03.295 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-rados-2:18.0.0-5128.ga5d48e8c.el8.x86_64 8/134 2023-07-25T14:33:03.493 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/134 2023-07-25T14:33:03.542 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 9/134 2023-07-25T14:33:03.745 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : postgresql-10.21-2.module+el8.6.0+15342+53518fac 13/134 2023-07-25T14:33:03.812 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libpq-13.5-1.el8.x86_64 10/134 2023-07-25T14:33:03.933 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libcephsqlite-2:18.0.0-5128.ga5d48e8c.el8.x86_64 14/134 2023-07-25T14:33:03.998 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/134 2023-07-25T14:33:04.037 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: libcephsqlite-2:18.0.0-5128.ga5d48e8c.el8.x86_64 14/134 2023-07-25T14:33:04.242 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libradosstriper1-2:18.0.0-5128.ga5d48e8c.el8.x86 15/134 2023-07-25T14:33:04.386 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: libradosstriper1-2:18.0.0-5128.ga5d48e8c.el8.x86 15/134 2023-07-25T14:33:04.428 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/134 2023-07-25T14:33:04.561 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 16/134 2023-07-25T14:33:04.665 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : postgresql-10.21-2.module+el8.6.0+15342+53518fac 13/134 2023-07-25T14:33:04.730 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 17/134 2023-07-25T14:33:04.837 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libcephsqlite-2:18.0.0-5128.ga5d48e8c.el8.x86_64 14/134 2023-07-25T14:33:04.928 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 18/134 2023-07-25T14:33:04.941 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: libcephsqlite-2:18.0.0-5128.ga5d48e8c.el8.x86_64 14/134 2023-07-25T14:33:05.057 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 19/134 2023-07-25T14:33:05.129 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libradosstriper1-2:18.0.0-5128.ga5d48e8c.el8.x86 15/134 2023-07-25T14:33:05.206 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 19/134 2023-07-25T14:33:05.276 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: libradosstriper1-2:18.0.0-5128.ga5d48e8c.el8.x86 15/134 2023-07-25T14:33:05.366 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 20/134 2023-07-25T14:33:05.466 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 16/134 2023-07-25T14:33:05.651 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 17/134 2023-07-25T14:33:05.863 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 18/134 2023-07-25T14:33:05.977 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 20/134 2023-07-25T14:33:05.995 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 19/134 2023-07-25T14:33:06.134 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 19/134 2023-07-25T14:33:06.158 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 21/134 2023-07-25T14:33:06.287 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 20/134 2023-07-25T14:33:06.776 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 21/134 2023-07-25T14:33:06.904 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 20/134 2023-07-25T14:33:06.990 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : openblas-0.3.15-3.el8.x86_64 22/134 2023-07-25T14:33:07.087 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 21/134 2023-07-25T14:33:07.681 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 22/134 2023-07-25T14:33:07.682 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 21/134 2023-07-25T14:33:07.886 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : openblas-0.3.15-3.el8.x86_64 22/134 2023-07-25T14:33:07.963 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 23/134 2023-07-25T14:33:08.154 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 24/134 2023-07-25T14:33:08.399 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/134 2023-07-25T14:33:08.596 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-ceph-common-2:18.0.0-5128.ga5d48e8c.el8. 26/134 2023-07-25T14:33:08.653 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 22/134 2023-07-25T14:33:08.717 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-ceph-argparse-2:18.0.0-5128.ga5d48e8c.el 27/134 2023-07-25T14:33:08.946 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 23/134 2023-07-25T14:33:08.952 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-cephfs-2:18.0.0-5128.ga5d48e8c.el8.x86_6 28/134 2023-07-25T14:33:09.142 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 24/134 2023-07-25T14:33:09.183 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/134 2023-07-25T14:33:09.364 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/134 2023-07-25T14:33:09.526 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-ceph-common-2:18.0.0-5128.ga5d48e8c.el8. 26/134 2023-07-25T14:33:09.638 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-ceph-argparse-2:18.0.0-5128.ga5d48e8c.el 27/134 2023-07-25T14:33:09.882 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-cephfs-2:18.0.0-5128.ga5d48e8c.el8.x86_6 28/134 2023-07-25T14:33:10.069 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/134 2023-07-25T14:33:10.941 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/134 2023-07-25T14:33:11.850 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/134 2023-07-25T14:33:11.964 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 30/134 2023-07-25T14:33:12.294 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 31/134 2023-07-25T14:33:12.573 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 32/134 2023-07-25T14:33:12.781 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 33/134 2023-07-25T14:33:12.890 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 30/134 2023-07-25T14:33:12.991 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-rsa-4.8-1.el8.noarch 34/134 2023-07-25T14:33:13.182 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 35/134 2023-07-25T14:33:13.218 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 31/134 2023-07-25T14:33:13.395 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-rbd-2:18.0.0-5128.ga5d48e8c.el8.x86_64 36/134 2023-07-25T14:33:13.479 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 32/134 2023-07-25T14:33:13.554 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : librados-devel-2:18.0.0-5128.ga5d48e8c.el8.x86_6 37/134 2023-07-25T14:33:13.691 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 33/134 2023-07-25T14:33:13.696 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 38/134 2023-07-25T14:33:13.849 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 39/134 2023-07-25T14:33:13.889 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-rsa-4.8-1.el8.noarch 34/134 2023-07-25T14:33:14.030 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : uuid-1.6.2-43.el8.x86_64 40/134 2023-07-25T14:33:14.086 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 40/134 2023-07-25T14:33:14.105 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 35/134 2023-07-25T14:33:14.289 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 41/134 2023-07-25T14:33:14.307 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-rbd-2:18.0.0-5128.ga5d48e8c.el8.x86_64 36/134 2023-07-25T14:33:14.475 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : librados-devel-2:18.0.0-5128.ga5d48e8c.el8.x86_6 37/134 2023-07-25T14:33:14.500 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : automake-1.16.1-7.el8.noarch 42/134 2023-07-25T14:33:14.643 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 38/134 2023-07-25T14:33:14.664 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 43/134 2023-07-25T14:33:14.748 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 43/134 2023-07-25T14:33:14.845 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 39/134 2023-07-25T14:33:14.959 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : jq-1.6-3.el8.x86_64 44/134 2023-07-25T14:33:15.019 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : uuid-1.6.2-43.el8.x86_64 40/134 2023-07-25T14:33:15.084 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 40/134 2023-07-25T14:33:15.126 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 45/134 2023-07-25T14:33:15.274 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 46/134 2023-07-25T14:33:15.295 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 41/134 2023-07-25T14:33:15.456 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 47/134 2023-07-25T14:33:15.499 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : automake-1.16.1-7.el8.noarch 42/134 2023-07-25T14:33:15.607 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : fuse-2.9.7-15.el8.x86_64 48/134 2023-07-25T14:33:15.677 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 43/134 2023-07-25T14:33:15.759 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 49/134 2023-07-25T14:33:15.759 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 43/134 2023-07-25T14:33:15.937 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 50/134 2023-07-25T14:33:15.990 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : jq-1.6-3.el8.x86_64 44/134 2023-07-25T14:33:16.151 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 51/134 2023-07-25T14:33:16.164 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 45/134 2023-07-25T14:33:16.344 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 46/134 2023-07-25T14:33:16.502 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 52/134 2023-07-25T14:33:16.536 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 47/134 2023-07-25T14:33:16.721 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : fuse-2.9.7-15.el8.x86_64 48/134 2023-07-25T14:33:16.814 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 53/134 2023-07-25T14:33:16.863 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 49/134 2023-07-25T14:33:17.041 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 54/134 2023-07-25T14:33:17.091 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 50/134 2023-07-25T14:33:17.285 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 55/134 2023-07-25T14:33:17.297 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 51/134 2023-07-25T14:33:17.526 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 56/134 2023-07-25T14:33:17.643 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 52/134 2023-07-25T14:33:17.829 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 57/134 2023-07-25T14:33:17.928 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 53/134 2023-07-25T14:33:18.037 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 58/134 2023-07-25T14:33:18.137 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 54/134 2023-07-25T14:33:18.238 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 59/134 2023-07-25T14:33:18.395 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 55/134 2023-07-25T14:33:18.441 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 60/134 2023-07-25T14:33:18.622 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 56/134 2023-07-25T14:33:18.645 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 61/134 2023-07-25T14:33:18.808 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 62/134 2023-07-25T14:33:18.941 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 57/134 2023-07-25T14:33:19.145 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 63/134 2023-07-25T14:33:19.184 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 58/134 2023-07-25T14:33:19.398 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 59/134 2023-07-25T14:33:19.416 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 64/134 2023-07-25T14:33:19.621 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 60/134 2023-07-25T14:33:19.683 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 65/134 2023-07-25T14:33:19.800 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 61/134 2023-07-25T14:33:19.889 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 66/134 2023-07-25T14:33:19.990 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 62/134 2023-07-25T14:33:20.045 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 67/134 2023-07-25T14:33:20.215 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 68/134 2023-07-25T14:33:20.296 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 63/134 2023-07-25T14:33:20.515 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 69/134 2023-07-25T14:33:20.555 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 64/134 2023-07-25T14:33:20.736 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 70/134 2023-07-25T14:33:20.780 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 65/134 2023-07-25T14:33:20.892 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 71/134 2023-07-25T14:33:20.994 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 66/134 2023-07-25T14:33:21.081 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 72/134 2023-07-25T14:33:21.150 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 67/134 2023-07-25T14:33:21.279 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 73/134 2023-07-25T14:33:21.329 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 68/134 2023-07-25T14:33:21.499 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 74/134 2023-07-25T14:33:21.635 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 69/134 2023-07-25T14:33:21.726 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 75/134 2023-07-25T14:33:21.850 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 70/134 2023-07-25T14:33:21.890 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 76/134 2023-07-25T14:33:22.022 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 71/134 2023-07-25T14:33:22.026 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 77/134 2023-07-25T14:33:22.178 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 72/134 2023-07-25T14:33:22.231 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 78/134 2023-07-25T14:33:22.376 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 73/134 2023-07-25T14:33:22.482 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 79/134 2023-07-25T14:33:22.570 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 74/134 2023-07-25T14:33:22.684 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 80/134 2023-07-25T14:33:22.753 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 75/134 2023-07-25T14:33:22.912 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 76/134 2023-07-25T14:33:22.931 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-portend-2.6-1.el8.noarch 81/134 2023-07-25T14:33:23.048 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 77/134 2023-07-25T14:33:23.202 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 82/134 2023-07-25T14:33:23.286 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 78/134 2023-07-25T14:33:23.377 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 83/134 2023-07-25T14:33:23.487 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 79/134 2023-07-25T14:33:23.593 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 84/134 2023-07-25T14:33:23.706 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 80/134 2023-07-25T14:33:23.965 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-portend-2.6-1.el8.noarch 81/134 2023-07-25T14:33:24.200 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 82/134 2023-07-25T14:33:24.384 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 83/134 2023-07-25T14:33:24.601 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 84/134 2023-07-25T14:33:24.659 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 85/134 2023-07-25T14:33:24.916 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 86/134 2023-07-25T14:33:25.169 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 87/134 2023-07-25T14:33:25.486 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 88/134 2023-07-25T14:33:25.673 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 85/134 2023-07-25T14:33:25.740 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 89/134 2023-07-25T14:33:25.918 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 90/134 2023-07-25T14:33:25.946 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 86/134 2023-07-25T14:33:26.192 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 87/134 2023-07-25T14:33:26.542 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 88/134 2023-07-25T14:33:26.722 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 91/134 2023-07-25T14:33:26.826 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 89/134 2023-07-25T14:33:26.885 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : librgw2-2:18.0.0-5128.ga5d48e8c.el8.x86_64 92/134 2023-07-25T14:33:26.960 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: librgw2-2:18.0.0-5128.ga5d48e8c.el8.x86_64 92/134 2023-07-25T14:33:27.042 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 90/134 2023-07-25T14:33:27.128 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-rgw-2:18.0.0-5128.ga5d48e8c.el8.x86_64 93/134 2023-07-25T14:33:27.866 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 91/134 2023-07-25T14:33:28.050 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : librgw2-2:18.0.0-5128.ga5d48e8c.el8.x86_64 92/134 2023-07-25T14:33:28.153 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: librgw2-2:18.0.0-5128.ga5d48e8c.el8.x86_64 92/134 2023-07-25T14:33:28.318 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-rgw-2:18.0.0-5128.ga5d48e8c.el8.x86_64 93/134 2023-07-25T14:33:30.702 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-common-2:18.0.0-5128.ga5d48e8c.el8.x86_64 94/134 2023-07-25T14:33:30.943 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-common-2:18.0.0-5128.ga5d48e8c.el8.x86_64 94/134 2023-07-25T14:33:31.532 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-common-2:18.0.0-5128.ga5d48e8c.el8.x86_64 94/134 2023-07-25T14:33:31.960 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-common-2:18.0.0-5128.ga5d48e8c.el8.x86_64 94/134 2023-07-25T14:33:32.175 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-common-2:18.0.0-5128.ga5d48e8c.el8.x86_64 94/134 2023-07-25T14:33:32.426 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-base-2:18.0.0-5128.ga5d48e8c.el8.x86_64 95/134 2023-07-25T14:33:32.522 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-base-2:18.0.0-5128.ga5d48e8c.el8.x86_64 95/134 2023-07-25T14:33:32.651 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-selinux-2:18.0.0-5128.ga5d48e8c.el8.x86_64 96/134 2023-07-25T14:33:32.786 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-common-2:18.0.0-5128.ga5d48e8c.el8.x86_64 94/134 2023-07-25T14:33:33.079 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-base-2:18.0.0-5128.ga5d48e8c.el8.x86_64 95/134 2023-07-25T14:33:33.158 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-base-2:18.0.0-5128.ga5d48e8c.el8.x86_64 95/134 2023-07-25T14:33:33.341 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-selinux-2:18.0.0-5128.ga5d48e8c.el8.x86_64 96/134 2023-07-25T14:33:51.774 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-selinux-2:18.0.0-5128.ga5d48e8c.el8.x86_64 96/134 2023-07-25T14:33:51.775 INFO:teuthology.orchestra.run.smithi092.stdout:skipping the directory /sys 2023-07-25T14:33:51.775 INFO:teuthology.orchestra.run.smithi092.stdout:skipping the directory /proc 2023-07-25T14:33:51.775 INFO:teuthology.orchestra.run.smithi092.stdout:skipping the directory /dev 2023-07-25T14:33:51.775 INFO:teuthology.orchestra.run.smithi092.stdout:skipping the directory /run 2023-07-25T14:33:51.775 INFO:teuthology.orchestra.run.smithi092.stdout:skipping the directory /mnt 2023-07-25T14:33:51.776 INFO:teuthology.orchestra.run.smithi092.stdout:skipping the directory /var/tmp 2023-07-25T14:33:51.776 INFO:teuthology.orchestra.run.smithi092.stdout:skipping the directory /home 2023-07-25T14:33:51.776 INFO:teuthology.orchestra.run.smithi092.stdout:skipping the directory /tmp 2023-07-25T14:33:51.776 INFO:teuthology.orchestra.run.smithi092.stdout:skipping the directory /dev 2023-07-25T14:33:51.776 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-07-25T14:33:52.105 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-volume-2:18.0.0-5128.ga5d48e8c.el8.noarch 97/134 2023-07-25T14:33:53.695 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-volume-2:18.0.0-5128.ga5d48e8c.el8.noarch 97/134 2023-07-25T14:33:53.895 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-osd-2:18.0.0-5128.ga5d48e8c.el8.x86_64 98/134 2023-07-25T14:33:53.909 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-selinux-2:18.0.0-5128.ga5d48e8c.el8.x86_64 96/134 2023-07-25T14:33:53.909 INFO:teuthology.orchestra.run.smithi072.stdout:skipping the directory /sys 2023-07-25T14:33:53.910 INFO:teuthology.orchestra.run.smithi072.stdout:skipping the directory /proc 2023-07-25T14:33:53.910 INFO:teuthology.orchestra.run.smithi072.stdout:skipping the directory /dev 2023-07-25T14:33:53.910 INFO:teuthology.orchestra.run.smithi072.stdout:skipping the directory /run 2023-07-25T14:33:53.910 INFO:teuthology.orchestra.run.smithi072.stdout:skipping the directory /mnt 2023-07-25T14:33:53.910 INFO:teuthology.orchestra.run.smithi072.stdout:skipping the directory /var/tmp 2023-07-25T14:33:53.910 INFO:teuthology.orchestra.run.smithi072.stdout:skipping the directory /home 2023-07-25T14:33:53.910 INFO:teuthology.orchestra.run.smithi072.stdout:skipping the directory /tmp 2023-07-25T14:33:53.911 INFO:teuthology.orchestra.run.smithi072.stdout:skipping the directory /dev 2023-07-25T14:33:53.911 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-25T14:33:54.113 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-osd-2:18.0.0-5128.ga5d48e8c.el8.x86_64 98/134 2023-07-25T14:33:54.239 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-volume-2:18.0.0-5128.ga5d48e8c.el8.noarch 97/134 2023-07-25T14:33:54.254 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-mds-2:18.0.0-5128.ga5d48e8c.el8.x86_64 99/134 2023-07-25T14:33:54.708 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-mds-2:18.0.0-5128.ga5d48e8c.el8.x86_64 99/134 2023-07-25T14:33:54.896 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-mon-2:18.0.0-5128.ga5d48e8c.el8.x86_64 100/134 2023-07-25T14:33:54.913 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-mon-2:18.0.0-5128.ga5d48e8c.el8.x86_64 100/134 2023-07-25T14:33:55.830 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-volume-2:18.0.0-5128.ga5d48e8c.el8.noarch 97/134 2023-07-25T14:33:56.009 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-osd-2:18.0.0-5128.ga5d48e8c.el8.x86_64 98/134 2023-07-25T14:33:56.226 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-osd-2:18.0.0-5128.ga5d48e8c.el8.x86_64 98/134 2023-07-25T14:33:56.380 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-mds-2:18.0.0-5128.ga5d48e8c.el8.x86_64 99/134 2023-07-25T14:33:56.524 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: cephadm-2:18.0.0-5128.ga5d48e8c.el8.noarch 101/134 2023-07-25T14:33:56.739 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : cephadm-2:18.0.0-5128.ga5d48e8c.el8.noarch 101/134 2023-07-25T14:33:56.831 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-mds-2:18.0.0-5128.ga5d48e8c.el8.x86_64 99/134 2023-07-25T14:33:56.851 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-5128.ga5d48e8c.e 102/134 2023-07-25T14:33:57.030 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-mon-2:18.0.0-5128.ga5d48e8c.el8.x86_64 100/134 2023-07-25T14:33:57.046 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-mon-2:18.0.0-5128.ga5d48e8c.el8.x86_64 100/134 2023-07-25T14:33:57.051 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-5128.ga5d48e8c. 103/134 2023-07-25T14:33:57.228 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-5128.ga5d48e8c.el8.noa 104/134 2023-07-25T14:33:57.442 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-5128.ga5d48e8c.el8.noa 104/134 2023-07-25T14:33:57.761 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-5128.ga5d48e8c.el8.n 105/134 2023-07-25T14:33:58.717 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: cephadm-2:18.0.0-5128.ga5d48e8c.el8.noarch 101/134 2023-07-25T14:33:58.722 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-5128.ga5d48e8c.el8.n 105/134 2023-07-25T14:33:58.919 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : cephadm-2:18.0.0-5128.ga5d48e8c.el8.noarch 101/134 2023-07-25T14:33:58.920 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-5128.ga5d 106/134 2023-07-25T14:33:59.009 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-5128.ga5d 106/134 2023-07-25T14:33:59.044 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-5128.ga5d48e8c.e 102/134 2023-07-25T14:33:59.243 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-5128.ga5d48e8c. 103/134 2023-07-25T14:33:59.381 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-5128.ga5d48e8c.el 107/134 2023-07-25T14:33:59.429 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-5128.ga5d48e8c.el8.noa 104/134 2023-07-25T14:33:59.602 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-mgr-2:18.0.0-5128.ga5d48e8c.el8.x86_64 108/134 2023-07-25T14:33:59.637 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-mgr-2:18.0.0-5128.ga5d48e8c.el8.x86_64 108/134 2023-07-25T14:33:59.641 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-5128.ga5d48e8c.el8.noa 104/134 2023-07-25T14:33:59.811 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-mgr-rook-2:18.0.0-5128.ga5d48e8c.el8.noarch 109/134 2023-07-25T14:33:59.822 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-5128.ga5d48e8c.el8.noarch 109/134 2023-07-25T14:33:59.983 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-5128.ga5d48e8c.el8.n 105/134 2023-07-25T14:34:00.941 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-5128.ga5d48e8c.el8.n 105/134 2023-07-25T14:34:01.104 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-5128.ga5d 106/134 2023-07-25T14:34:01.118 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-2:18.0.0-5128.ga5d48e8c.el8.x86_64 110/134 2023-07-25T14:34:01.193 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-5128.ga5d 106/134 2023-07-25T14:34:01.336 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-radosgw-2:18.0.0-5128.ga5d48e8c.el8.x86_64 111/134 2023-07-25T14:34:01.370 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-5128.ga5d48e8c.el8.x86_64 111/134 2023-07-25T14:34:01.528 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-5128.ga5d48 112/134 2023-07-25T14:34:01.553 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-5128.ga5d48e8c.el 107/134 2023-07-25T14:34:01.570 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-5128.ga5d48 112/134 2023-07-25T14:34:01.727 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : cephfs-mirror-2:18.0.0-5128.ga5d48e8c.el8.x86_64 113/134 2023-07-25T14:34:01.741 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-mgr-2:18.0.0-5128.ga5d48e8c.el8.x86_64 108/134 2023-07-25T14:34:01.777 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-mgr-2:18.0.0-5128.ga5d48e8c.el8.x86_64 108/134 2023-07-25T14:34:01.945 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-mgr-rook-2:18.0.0-5128.ga5d48e8c.el8.noarch 109/134 2023-07-25T14:34:01.956 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-5128.ga5d48e8c.el8.noarch 109/134 2023-07-25T14:34:02.081 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-5128.ga5d48e8c.el8.x86_64 113/134 2023-07-25T14:34:02.236 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : rbd-mirror-2:18.0.0-5128.ga5d48e8c.el8.x86_64 114/134 2023-07-25T14:34:03.246 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-2:18.0.0-5128.ga5d48e8c.el8.x86_64 110/134 2023-07-25T14:34:03.459 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-radosgw-2:18.0.0-5128.ga5d48e8c.el8.x86_64 111/134 2023-07-25T14:34:03.492 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-5128.ga5d48e8c.el8.x86_64 111/134 2023-07-25T14:34:03.645 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-5128.ga5d48 112/134 2023-07-25T14:34:03.687 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-5128.ga5d48 112/134 2023-07-25T14:34:03.829 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : cephfs-mirror-2:18.0.0-5128.ga5d48e8c.el8.x86_64 113/134 2023-07-25T14:34:04.188 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-5128.ga5d48e8c.el8.x86_64 113/134 2023-07-25T14:34:04.346 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : rbd-mirror-2:18.0.0-5128.ga5d48e8c.el8.x86_64 114/134 2023-07-25T14:34:06.777 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: rbd-mirror-2:18.0.0-5128.ga5d48e8c.el8.x86_64 114/134 2023-07-25T14:34:07.655 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-test-2:18.0.0-5128.ga5d48e8c.el8.x86_64 115/134 2023-07-25T14:34:07.985 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 116/134 2023-07-25T14:34:08.182 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-fuse-2:18.0.0-5128.ga5d48e8c.el8.x86_64 117/134 2023-07-25T14:34:08.435 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 118/134 2023-07-25T14:34:08.575 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libtool-2.4.6-25.el8.x86_64 119/134 2023-07-25T14:34:08.781 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 119/134 2023-07-25T14:34:08.915 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: rbd-mirror-2:18.0.0-5128.ga5d48e8c.el8.x86_64 114/134 2023-07-25T14:34:09.013 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 120/134 2023-07-25T14:34:09.205 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libcephfs-devel-2:18.0.0-5128.ga5d48e8c.el8.x86_ 121/134 2023-07-25T14:34:09.385 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-07-25T14:34:09.769 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-test-2:18.0.0-5128.ga5d48e8c.el8.x86_64 115/134 2023-07-25T14:34:10.093 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 116/134 2023-07-25T14:34:10.291 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-fuse-2:18.0.0-5128.ga5d48e8c.el8.x86_64 117/134 2023-07-25T14:34:10.526 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 118/134 2023-07-25T14:34:10.711 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libtool-2.4.6-25.el8.x86_64 119/134 2023-07-25T14:34:10.928 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 119/134 2023-07-25T14:34:11.198 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 120/134 2023-07-25T14:34:11.365 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libcephfs-devel-2:18.0.0-5128.ga5d48e8c.el8.x86_ 121/134 2023-07-25T14:34:11.504 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-07-25T14:34:11.551 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-07-25T14:34:11.808 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-07-25T14:34:11.825 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-07-25T14:34:12.008 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : cephfs-top-2:18.0.0-5128.ga5d48e8c.el8.noarch 124/134 2023-07-25T14:34:12.299 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : rbd-fuse-2:18.0.0-5128.ga5d48e8c.el8.x86_64 125/134 2023-07-25T14:34:12.576 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : rbd-nbd-2:18.0.0-5128.ga5d48e8c.el8.x86_64 126/134 2023-07-25T14:34:12.945 INFO:teuthology.orchestra.run.smithi092.stdout: Upgrading : iproute-5.15.0-4.el8_6.1.x86_64 127/134 2023-07-25T14:34:13.099 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : flex-2.6.1-9.el8.x86_64 128/134 2023-07-25T14:34:13.181 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 128/134 2023-07-25T14:34:13.391 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : bison-3.0.4-10.el8.x86_64 129/134 2023-07-25T14:34:13.404 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 129/134 2023-07-25T14:34:13.600 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : NetworkManager-initscripts-updown-1:1.36.0-9.el8 130/134 2023-07-25T14:34:13.608 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.36.0-9.el8 130/134 2023-07-25T14:34:13.662 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-07-25T14:34:13.751 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 131/134 2023-07-25T14:34:13.752 INFO:teuthology.orchestra.run.smithi092.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-07-25T14:34:13.911 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-07-25T14:34:13.928 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-07-25T14:34:13.952 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-07-25T14:34:13.953 INFO:teuthology.orchestra.run.smithi092.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 133/134 2023-07-25T14:34:14.122 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : cephfs-top-2:18.0.0-5128.ga5d48e8c.el8.noarch 124/134 2023-07-25T14:34:14.171 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 133/134 2023-07-25T14:34:14.373 INFO:teuthology.orchestra.run.smithi092.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 134/134 2023-07-25T14:34:14.377 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : rbd-fuse-2:18.0.0-5128.ga5d48e8c.el8.x86_64 125/134 2023-07-25T14:34:14.678 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : rbd-nbd-2:18.0.0-5128.ga5d48e8c.el8.x86_64 126/134 2023-07-25T14:34:14.876 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: iproute-5.15.0-4.el8.x86_64 134/134 2023-07-25T14:34:14.877 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-2:18.0.0-5128.ga5d48e8c.el8.x86_64 1/134 2023-07-25T14:34:14.877 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-base-2:18.0.0-5128.ga5d48e8c.el8.x86_64 2/134 2023-07-25T14:34:14.877 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-common-2:18.0.0-5128.ga5d48e8c.el8.x86_64 3/134 2023-07-25T14:34:14.877 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-fuse-2:18.0.0-5128.ga5d48e8c.el8.x86_64 4/134 2023-07-25T14:34:14.877 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-5128.ga5d48 5/134 2023-07-25T14:34:14.877 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-mds-2:18.0.0-5128.ga5d48e8c.el8.x86_64 6/134 2023-07-25T14:34:14.878 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-mgr-2:18.0.0-5128.ga5d48e8c.el8.x86_64 7/134 2023-07-25T14:34:14.878 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-mon-2:18.0.0-5128.ga5d48e8c.el8.x86_64 8/134 2023-07-25T14:34:14.878 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-osd-2:18.0.0-5128.ga5d48e8c.el8.x86_64 9/134 2023-07-25T14:34:14.878 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-radosgw-2:18.0.0-5128.ga5d48e8c.el8.x86_64 10/134 2023-07-25T14:34:14.878 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-selinux-2:18.0.0-5128.ga5d48e8c.el8.x86_64 11/134 2023-07-25T14:34:14.878 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-test-2:18.0.0-5128.ga5d48e8c.el8.x86_64 12/134 2023-07-25T14:34:14.878 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : cephfs-mirror-2:18.0.0-5128.ga5d48e8c.el8.x86_64 13/134 2023-07-25T14:34:14.878 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libcephfs-devel-2:18.0.0-5128.ga5d48e8c.el8.x86_ 14/134 2023-07-25T14:34:14.879 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libcephfs2-2:18.0.0-5128.ga5d48e8c.el8.x86_64 15/134 2023-07-25T14:34:14.879 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libcephsqlite-2:18.0.0-5128.ga5d48e8c.el8.x86_64 16/134 2023-07-25T14:34:14.879 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : librados-devel-2:18.0.0-5128.ga5d48e8c.el8.x86_6 17/134 2023-07-25T14:34:14.879 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libradosstriper1-2:18.0.0-5128.ga5d48e8c.el8.x86 18/134 2023-07-25T14:34:14.879 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : librgw2-2:18.0.0-5128.ga5d48e8c.el8.x86_64 19/134 2023-07-25T14:34:14.879 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-ceph-argparse-2:18.0.0-5128.ga5d48e8c.el 20/134 2023-07-25T14:34:14.879 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-ceph-common-2:18.0.0-5128.ga5d48e8c.el8. 21/134 2023-07-25T14:34:14.879 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-cephfs-2:18.0.0-5128.ga5d48e8c.el8.x86_6 22/134 2023-07-25T14:34:14.880 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-rados-2:18.0.0-5128.ga5d48e8c.el8.x86_64 23/134 2023-07-25T14:34:14.880 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-rbd-2:18.0.0-5128.ga5d48e8c.el8.x86_64 24/134 2023-07-25T14:34:14.880 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-rgw-2:18.0.0-5128.ga5d48e8c.el8.x86_64 25/134 2023-07-25T14:34:14.880 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : rbd-fuse-2:18.0.0-5128.ga5d48e8c.el8.x86_64 26/134 2023-07-25T14:34:14.880 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : rbd-mirror-2:18.0.0-5128.ga5d48e8c.el8.x86_64 27/134 2023-07-25T14:34:14.880 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : rbd-nbd-2:18.0.0-5128.ga5d48e8c.el8.x86_64 28/134 2023-07-25T14:34:14.880 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-5128.ga5d48e8c. 29/134 2023-07-25T14:34:14.881 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-5128.ga5d48e8c.el8.noa 30/134 2023-07-25T14:34:14.881 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-5128.ga5d48e8c.el8.n 31/134 2023-07-25T14:34:14.881 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-5128.ga5d 32/134 2023-07-25T14:34:14.881 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-5128.ga5d48e8c.el 33/134 2023-07-25T14:34:14.881 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-mgr-rook-2:18.0.0-5128.ga5d48e8c.el8.noarch 34/134 2023-07-25T14:34:14.881 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-5128.ga5d48e8c.e 35/134 2023-07-25T14:34:14.881 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-volume-2:18.0.0-5128.ga5d48e8c.el8.noarch 36/134 2023-07-25T14:34:14.881 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : cephadm-2:18.0.0-5128.ga5d48e8c.el8.noarch 37/134 2023-07-25T14:34:14.882 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : cephfs-top-2:18.0.0-5128.ga5d48e8c.el8.noarch 38/134 2023-07-25T14:34:14.882 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/134 2023-07-25T14:34:14.882 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/134 2023-07-25T14:34:14.882 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/134 2023-07-25T14:34:14.882 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/134 2023-07-25T14:34:14.882 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/134 2023-07-25T14:34:14.882 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/134 2023-07-25T14:34:14.882 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/134 2023-07-25T14:34:14.883 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/134 2023-07-25T14:34:14.883 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/134 2023-07-25T14:34:14.883 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/134 2023-07-25T14:34:14.883 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/134 2023-07-25T14:34:14.883 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/134 2023-07-25T14:34:14.883 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/134 2023-07-25T14:34:14.883 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/134 2023-07-25T14:34:14.883 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/134 2023-07-25T14:34:14.884 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/134 2023-07-25T14:34:14.884 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/134 2023-07-25T14:34:14.884 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/134 2023-07-25T14:34:14.884 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/134 2023-07-25T14:34:14.884 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/134 2023-07-25T14:34:14.884 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/134 2023-07-25T14:34:14.884 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-rsa-4.8-1.el8.noarch 60/134 2023-07-25T14:34:14.884 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/134 2023-07-25T14:34:14.885 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/134 2023-07-25T14:34:14.885 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/134 2023-07-25T14:34:14.885 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/134 2023-07-25T14:34:14.885 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/134 2023-07-25T14:34:14.885 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/134 2023-07-25T14:34:14.885 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/134 2023-07-25T14:34:14.885 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/134 2023-07-25T14:34:14.886 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/134 2023-07-25T14:34:14.886 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/134 2023-07-25T14:34:14.886 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/134 2023-07-25T14:34:14.886 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 72/134 2023-07-25T14:34:14.886 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 73/134 2023-07-25T14:34:14.886 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 74/134 2023-07-25T14:34:14.886 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 75/134 2023-07-25T14:34:14.886 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 76/134 2023-07-25T14:34:14.887 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 77/134 2023-07-25T14:34:14.887 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 78/134 2023-07-25T14:34:14.887 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 79/134 2023-07-25T14:34:14.887 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 80/134 2023-07-25T14:34:14.887 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 81/134 2023-07-25T14:34:14.887 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 82/134 2023-07-25T14:34:14.887 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 83/134 2023-07-25T14:34:14.887 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 84/134 2023-07-25T14:34:14.888 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 85/134 2023-07-25T14:34:14.888 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 86/134 2023-07-25T14:34:14.888 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 87/134 2023-07-25T14:34:14.888 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 88/134 2023-07-25T14:34:14.888 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 89/134 2023-07-25T14:34:14.888 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 90/134 2023-07-25T14:34:14.888 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 91/134 2023-07-25T14:34:14.888 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 92/134 2023-07-25T14:34:14.889 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 93/134 2023-07-25T14:34:14.889 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 94/134 2023-07-25T14:34:14.889 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 95/134 2023-07-25T14:34:14.889 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 96/134 2023-07-25T14:34:14.889 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : NetworkManager-initscripts-updown-1:1.36.0-9.el8 97/134 2023-07-25T14:34:14.889 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 98/134 2023-07-25T14:34:14.889 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 99/134 2023-07-25T14:34:14.890 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 100/134 2023-07-25T14:34:14.890 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 101/134 2023-07-25T14:34:14.890 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 102/134 2023-07-25T14:34:14.890 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 103/134 2023-07-25T14:34:14.890 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : bison-3.0.4-10.el8.x86_64 104/134 2023-07-25T14:34:14.890 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 105/134 2023-07-25T14:34:14.890 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 106/134 2023-07-25T14:34:14.890 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 107/134 2023-07-25T14:34:14.891 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : automake-1.16.1-7.el8.noarch 108/134 2023-07-25T14:34:14.891 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 109/134 2023-07-25T14:34:14.891 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 110/134 2023-07-25T14:34:14.891 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : flex-2.6.1-9.el8.x86_64 111/134 2023-07-25T14:34:14.891 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 112/134 2023-07-25T14:34:14.891 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 113/134 2023-07-25T14:34:14.891 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 114/134 2023-07-25T14:34:14.891 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 115/134 2023-07-25T14:34:14.892 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 116/134 2023-07-25T14:34:14.892 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 117/134 2023-07-25T14:34:14.892 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 118/134 2023-07-25T14:34:14.892 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 119/134 2023-07-25T14:34:14.892 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 120/134 2023-07-25T14:34:14.892 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 121/134 2023-07-25T14:34:14.892 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libpq-13.5-1.el8.x86_64 122/134 2023-07-25T14:34:14.892 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 123/134 2023-07-25T14:34:14.893 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : jq-1.6-3.el8.x86_64 124/134 2023-07-25T14:34:14.893 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 125/134 2023-07-25T14:34:14.893 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : postgresql-server-10.21-2.module+el8.6.0+15342+5 126/134 2023-07-25T14:34:14.893 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 127/134 2023-07-25T14:34:14.893 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : postgresql-10.21-2.module+el8.6.0+15342+53518fac 128/134 2023-07-25T14:34:14.893 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : librados2-2:18.0.0-5128.ga5d48e8c.el8.x86_64 129/134 2023-07-25T14:34:14.893 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/134 2023-07-25T14:34:14.894 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : librbd1-2:18.0.0-5128.ga5d48e8c.el8.x86_64 131/134 2023-07-25T14:34:14.894 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-07-25T14:34:14.894 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : iproute-5.15.0-4.el8_6.1.x86_64 133/134 2023-07-25T14:34:15.047 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : iproute-5.15.0-4.el8_6.1.x86_64 127/134 2023-07-25T14:34:15.260 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : flex-2.6.1-9.el8.x86_64 128/134 2023-07-25T14:34:15.341 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 128/134 2023-07-25T14:34:15.553 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : bison-3.0.4-10.el8.x86_64 129/134 2023-07-25T14:34:15.565 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 129/134 2023-07-25T14:34:15.761 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : NetworkManager-initscripts-updown-1:1.36.0-9.el8 130/134 2023-07-25T14:34:15.768 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.36.0-9.el8 130/134 2023-07-25T14:34:15.913 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 131/134 2023-07-25T14:34:15.913 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-07-25T14:34:16.114 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-07-25T14:34:16.114 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 133/134 2023-07-25T14:34:16.361 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 133/134 2023-07-25T14:34:16.559 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 134/134 2023-07-25T14:34:17.075 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: iproute-5.15.0-4.el8.x86_64 134/134 2023-07-25T14:34:17.075 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-2:18.0.0-5128.ga5d48e8c.el8.x86_64 1/134 2023-07-25T14:34:17.075 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-base-2:18.0.0-5128.ga5d48e8c.el8.x86_64 2/134 2023-07-25T14:34:17.075 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-common-2:18.0.0-5128.ga5d48e8c.el8.x86_64 3/134 2023-07-25T14:34:17.076 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-fuse-2:18.0.0-5128.ga5d48e8c.el8.x86_64 4/134 2023-07-25T14:34:17.076 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-5128.ga5d48 5/134 2023-07-25T14:34:17.076 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-mds-2:18.0.0-5128.ga5d48e8c.el8.x86_64 6/134 2023-07-25T14:34:17.076 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-mgr-2:18.0.0-5128.ga5d48e8c.el8.x86_64 7/134 2023-07-25T14:34:17.076 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-mon-2:18.0.0-5128.ga5d48e8c.el8.x86_64 8/134 2023-07-25T14:34:17.076 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-osd-2:18.0.0-5128.ga5d48e8c.el8.x86_64 9/134 2023-07-25T14:34:17.076 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-radosgw-2:18.0.0-5128.ga5d48e8c.el8.x86_64 10/134 2023-07-25T14:34:17.077 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-selinux-2:18.0.0-5128.ga5d48e8c.el8.x86_64 11/134 2023-07-25T14:34:17.077 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-test-2:18.0.0-5128.ga5d48e8c.el8.x86_64 12/134 2023-07-25T14:34:17.077 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : cephfs-mirror-2:18.0.0-5128.ga5d48e8c.el8.x86_64 13/134 2023-07-25T14:34:17.077 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libcephfs-devel-2:18.0.0-5128.ga5d48e8c.el8.x86_ 14/134 2023-07-25T14:34:17.077 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libcephfs2-2:18.0.0-5128.ga5d48e8c.el8.x86_64 15/134 2023-07-25T14:34:17.077 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libcephsqlite-2:18.0.0-5128.ga5d48e8c.el8.x86_64 16/134 2023-07-25T14:34:17.077 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : librados-devel-2:18.0.0-5128.ga5d48e8c.el8.x86_6 17/134 2023-07-25T14:34:17.077 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libradosstriper1-2:18.0.0-5128.ga5d48e8c.el8.x86 18/134 2023-07-25T14:34:17.078 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : librgw2-2:18.0.0-5128.ga5d48e8c.el8.x86_64 19/134 2023-07-25T14:34:17.078 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-ceph-argparse-2:18.0.0-5128.ga5d48e8c.el 20/134 2023-07-25T14:34:17.078 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-ceph-common-2:18.0.0-5128.ga5d48e8c.el8. 21/134 2023-07-25T14:34:17.078 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-cephfs-2:18.0.0-5128.ga5d48e8c.el8.x86_6 22/134 2023-07-25T14:34:17.078 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-rados-2:18.0.0-5128.ga5d48e8c.el8.x86_64 23/134 2023-07-25T14:34:17.078 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-rbd-2:18.0.0-5128.ga5d48e8c.el8.x86_64 24/134 2023-07-25T14:34:17.078 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-rgw-2:18.0.0-5128.ga5d48e8c.el8.x86_64 25/134 2023-07-25T14:34:17.079 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : rbd-fuse-2:18.0.0-5128.ga5d48e8c.el8.x86_64 26/134 2023-07-25T14:34:17.079 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : rbd-mirror-2:18.0.0-5128.ga5d48e8c.el8.x86_64 27/134 2023-07-25T14:34:17.079 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : rbd-nbd-2:18.0.0-5128.ga5d48e8c.el8.x86_64 28/134 2023-07-25T14:34:17.079 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-5128.ga5d48e8c. 29/134 2023-07-25T14:34:17.085 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-5128.ga5d48e8c.el8.noa 30/134 2023-07-25T14:34:17.086 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-5128.ga5d48e8c.el8.n 31/134 2023-07-25T14:34:17.086 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-5128.ga5d 32/134 2023-07-25T14:34:17.086 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-5128.ga5d48e8c.el 33/134 2023-07-25T14:34:17.086 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-mgr-rook-2:18.0.0-5128.ga5d48e8c.el8.noarch 34/134 2023-07-25T14:34:17.086 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-5128.ga5d48e8c.e 35/134 2023-07-25T14:34:17.086 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-volume-2:18.0.0-5128.ga5d48e8c.el8.noarch 36/134 2023-07-25T14:34:17.087 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : cephadm-2:18.0.0-5128.ga5d48e8c.el8.noarch 37/134 2023-07-25T14:34:17.087 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : cephfs-top-2:18.0.0-5128.ga5d48e8c.el8.noarch 38/134 2023-07-25T14:34:17.087 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/134 2023-07-25T14:34:17.087 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/134 2023-07-25T14:34:17.087 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/134 2023-07-25T14:34:17.087 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/134 2023-07-25T14:34:17.087 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/134 2023-07-25T14:34:17.088 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/134 2023-07-25T14:34:17.088 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/134 2023-07-25T14:34:17.088 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/134 2023-07-25T14:34:17.088 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/134 2023-07-25T14:34:17.088 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/134 2023-07-25T14:34:17.088 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/134 2023-07-25T14:34:17.088 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/134 2023-07-25T14:34:17.089 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/134 2023-07-25T14:34:17.089 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/134 2023-07-25T14:34:17.089 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/134 2023-07-25T14:34:17.089 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/134 2023-07-25T14:34:17.089 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/134 2023-07-25T14:34:17.089 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/134 2023-07-25T14:34:17.089 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/134 2023-07-25T14:34:17.089 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/134 2023-07-25T14:34:17.090 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/134 2023-07-25T14:34:17.090 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-rsa-4.8-1.el8.noarch 60/134 2023-07-25T14:34:17.090 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/134 2023-07-25T14:34:17.090 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/134 2023-07-25T14:34:17.090 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/134 2023-07-25T14:34:17.090 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/134 2023-07-25T14:34:17.090 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/134 2023-07-25T14:34:17.091 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/134 2023-07-25T14:34:17.091 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/134 2023-07-25T14:34:17.091 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/134 2023-07-25T14:34:17.091 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/134 2023-07-25T14:34:17.091 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/134 2023-07-25T14:34:17.091 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/134 2023-07-25T14:34:17.091 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 72/134 2023-07-25T14:34:17.091 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 73/134 2023-07-25T14:34:17.092 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 74/134 2023-07-25T14:34:17.092 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 75/134 2023-07-25T14:34:17.092 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 76/134 2023-07-25T14:34:17.092 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 77/134 2023-07-25T14:34:17.092 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 78/134 2023-07-25T14:34:17.093 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 79/134 2023-07-25T14:34:17.093 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 80/134 2023-07-25T14:34:17.093 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 81/134 2023-07-25T14:34:17.093 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 82/134 2023-07-25T14:34:17.093 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 83/134 2023-07-25T14:34:17.093 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 84/134 2023-07-25T14:34:17.093 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 85/134 2023-07-25T14:34:17.093 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 86/134 2023-07-25T14:34:17.094 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 87/134 2023-07-25T14:34:17.094 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 88/134 2023-07-25T14:34:17.094 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 89/134 2023-07-25T14:34:17.094 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 90/134 2023-07-25T14:34:17.094 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 91/134 2023-07-25T14:34:17.094 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 92/134 2023-07-25T14:34:17.094 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 93/134 2023-07-25T14:34:17.095 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 94/134 2023-07-25T14:34:17.095 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 95/134 2023-07-25T14:34:17.095 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 96/134 2023-07-25T14:34:17.095 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : NetworkManager-initscripts-updown-1:1.36.0-9.el8 97/134 2023-07-25T14:34:17.095 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 98/134 2023-07-25T14:34:17.095 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 99/134 2023-07-25T14:34:17.095 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 100/134 2023-07-25T14:34:17.095 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 101/134 2023-07-25T14:34:17.096 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 102/134 2023-07-25T14:34:17.096 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 103/134 2023-07-25T14:34:17.096 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : bison-3.0.4-10.el8.x86_64 104/134 2023-07-25T14:34:17.096 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 105/134 2023-07-25T14:34:17.096 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 106/134 2023-07-25T14:34:17.096 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 107/134 2023-07-25T14:34:17.096 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : automake-1.16.1-7.el8.noarch 108/134 2023-07-25T14:34:17.097 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 109/134 2023-07-25T14:34:17.097 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 110/134 2023-07-25T14:34:17.097 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : flex-2.6.1-9.el8.x86_64 111/134 2023-07-25T14:34:17.097 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 112/134 2023-07-25T14:34:17.097 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 113/134 2023-07-25T14:34:17.097 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 114/134 2023-07-25T14:34:17.097 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 115/134 2023-07-25T14:34:17.097 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 116/134 2023-07-25T14:34:17.098 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 117/134 2023-07-25T14:34:17.098 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 118/134 2023-07-25T14:34:17.098 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 119/134 2023-07-25T14:34:17.098 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 120/134 2023-07-25T14:34:17.098 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 121/134 2023-07-25T14:34:17.098 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libpq-13.5-1.el8.x86_64 122/134 2023-07-25T14:34:17.098 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 123/134 2023-07-25T14:34:17.098 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : jq-1.6-3.el8.x86_64 124/134 2023-07-25T14:34:17.099 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 125/134 2023-07-25T14:34:17.099 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : postgresql-server-10.21-2.module+el8.6.0+15342+5 126/134 2023-07-25T14:34:17.099 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 127/134 2023-07-25T14:34:17.099 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : postgresql-10.21-2.module+el8.6.0+15342+53518fac 128/134 2023-07-25T14:34:17.099 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : librados2-2:18.0.0-5128.ga5d48e8c.el8.x86_64 129/134 2023-07-25T14:34:17.099 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/134 2023-07-25T14:34:17.099 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : librbd1-2:18.0.0-5128.ga5d48e8c.el8.x86_64 131/134 2023-07-25T14:34:17.099 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-07-25T14:34:17.100 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : iproute-5.15.0-4.el8_6.1.x86_64 133/134 2023-07-25T14:34:17.560 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 134/134 2023-07-25T14:34:17.561 INFO:teuthology.orchestra.run.smithi092.stdout:Last metadata expiration check: 0:03:09 ago on Tue 25 Jul 2023 02:31:08 PM UTC. 2023-07-25T14:34:19.781 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 134/134 2023-07-25T14:34:19.782 INFO:teuthology.orchestra.run.smithi072.stdout:Last metadata expiration check: 0:03:05 ago on Tue 25 Jul 2023 02:31:14 PM UTC. 2023-07-25T14:34:20.128 INFO:teuthology.orchestra.run.smithi092.stdout:Installed products updated. 2023-07-25T14:34:20.345 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-07-25T14:34:20.346 INFO:teuthology.orchestra.run.smithi092.stdout:Upgraded: 2023-07-25T14:34:20.346 INFO:teuthology.orchestra.run.smithi092.stdout: iproute-5.15.0-4.el8_6.1.x86_64 2023-07-25T14:34:20.346 INFO:teuthology.orchestra.run.smithi092.stdout: librados2-2:18.0.0-5128.ga5d48e8c.el8.x86_64 2023-07-25T14:34:20.346 INFO:teuthology.orchestra.run.smithi092.stdout: librbd1-2:18.0.0-5128.ga5d48e8c.el8.x86_64 2023-07-25T14:34:20.346 INFO:teuthology.orchestra.run.smithi092.stdout:Installed: 2023-07-25T14:34:20.347 INFO:teuthology.orchestra.run.smithi092.stdout: NetworkManager-initscripts-updown-1:1.36.0-9.el8_6.noarch 2023-07-25T14:34:20.347 INFO:teuthology.orchestra.run.smithi092.stdout: automake-1.16.1-7.el8.noarch 2023-07-25T14:34:20.347 INFO:teuthology.orchestra.run.smithi092.stdout: bison-3.0.4-10.el8.x86_64 2023-07-25T14:34:20.347 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-2:18.0.0-5128.ga5d48e8c.el8.x86_64 2023-07-25T14:34:20.347 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-base-2:18.0.0-5128.ga5d48e8c.el8.x86_64 2023-07-25T14:34:20.347 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-common-2:18.0.0-5128.ga5d48e8c.el8.x86_64 2023-07-25T14:34:20.347 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-fuse-2:18.0.0-5128.ga5d48e8c.el8.x86_64 2023-07-25T14:34:20.347 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-grafana-dashboards-2:18.0.0-5128.ga5d48e8c.el8.noarch 2023-07-25T14:34:20.348 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-immutable-object-cache-2:18.0.0-5128.ga5d48e8c.el8.x86_64 2023-07-25T14:34:20.348 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mds-2:18.0.0-5128.ga5d48e8c.el8.x86_64 2023-07-25T14:34:20.348 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-2:18.0.0-5128.ga5d48e8c.el8.x86_64 2023-07-25T14:34:20.348 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-cephadm-2:18.0.0-5128.ga5d48e8c.el8.noarch 2023-07-25T14:34:20.348 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-dashboard-2:18.0.0-5128.ga5d48e8c.el8.noarch 2023-07-25T14:34:20.348 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-diskprediction-local-2:18.0.0-5128.ga5d48e8c.el8.noarch 2023-07-25T14:34:20.349 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-modules-core-2:18.0.0-5128.ga5d48e8c.el8.noarch 2023-07-25T14:34:20.349 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-rook-2:18.0.0-5128.ga5d48e8c.el8.noarch 2023-07-25T14:34:20.349 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mon-2:18.0.0-5128.ga5d48e8c.el8.x86_64 2023-07-25T14:34:20.349 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-osd-2:18.0.0-5128.ga5d48e8c.el8.x86_64 2023-07-25T14:34:20.349 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-prometheus-alerts-2:18.0.0-5128.ga5d48e8c.el8.noarch 2023-07-25T14:34:20.349 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-radosgw-2:18.0.0-5128.ga5d48e8c.el8.x86_64 2023-07-25T14:34:20.349 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-selinux-2:18.0.0-5128.ga5d48e8c.el8.x86_64 2023-07-25T14:34:20.350 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-test-2:18.0.0-5128.ga5d48e8c.el8.x86_64 2023-07-25T14:34:20.350 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-volume-2:18.0.0-5128.ga5d48e8c.el8.noarch 2023-07-25T14:34:20.350 INFO:teuthology.orchestra.run.smithi092.stdout: cephadm-2:18.0.0-5128.ga5d48e8c.el8.noarch 2023-07-25T14:34:20.350 INFO:teuthology.orchestra.run.smithi092.stdout: cephfs-mirror-2:18.0.0-5128.ga5d48e8c.el8.x86_64 2023-07-25T14:34:20.350 INFO:teuthology.orchestra.run.smithi092.stdout: cephfs-top-2:18.0.0-5128.ga5d48e8c.el8.noarch 2023-07-25T14:34:20.350 INFO:teuthology.orchestra.run.smithi092.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-07-25T14:34:20.350 INFO:teuthology.orchestra.run.smithi092.stdout: flex-2.6.1-9.el8.x86_64 2023-07-25T14:34:20.350 INFO:teuthology.orchestra.run.smithi092.stdout: fuse-2.9.7-15.el8.x86_64 2023-07-25T14:34:20.351 INFO:teuthology.orchestra.run.smithi092.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-07-25T14:34:20.351 INFO:teuthology.orchestra.run.smithi092.stdout: jq-1.6-3.el8.x86_64 2023-07-25T14:34:20.351 INFO:teuthology.orchestra.run.smithi092.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-07-25T14:34:20.351 INFO:teuthology.orchestra.run.smithi092.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-07-25T14:34:20.352 INFO:teuthology.orchestra.run.smithi092.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-07-25T14:34:20.352 INFO:teuthology.orchestra.run.smithi092.stdout: libcephfs-devel-2:18.0.0-5128.ga5d48e8c.el8.x86_64 2023-07-25T14:34:20.352 INFO:teuthology.orchestra.run.smithi092.stdout: libcephfs2-2:18.0.0-5128.ga5d48e8c.el8.x86_64 2023-07-25T14:34:20.352 INFO:teuthology.orchestra.run.smithi092.stdout: libcephsqlite-2:18.0.0-5128.ga5d48e8c.el8.x86_64 2023-07-25T14:34:20.352 INFO:teuthology.orchestra.run.smithi092.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-07-25T14:34:20.352 INFO:teuthology.orchestra.run.smithi092.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-07-25T14:34:20.352 INFO:teuthology.orchestra.run.smithi092.stdout: liboath-2.6.2-3.el8.x86_64 2023-07-25T14:34:20.352 INFO:teuthology.orchestra.run.smithi092.stdout: libpq-13.5-1.el8.x86_64 2023-07-25T14:34:20.353 INFO:teuthology.orchestra.run.smithi092.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-07-25T14:34:20.353 INFO:teuthology.orchestra.run.smithi092.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-07-25T14:34:20.353 INFO:teuthology.orchestra.run.smithi092.stdout: librados-devel-2:18.0.0-5128.ga5d48e8c.el8.x86_64 2023-07-25T14:34:20.353 INFO:teuthology.orchestra.run.smithi092.stdout: libradosstriper1-2:18.0.0-5128.ga5d48e8c.el8.x86_64 2023-07-25T14:34:20.353 INFO:teuthology.orchestra.run.smithi092.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-07-25T14:34:20.353 INFO:teuthology.orchestra.run.smithi092.stdout: librgw2-2:18.0.0-5128.ga5d48e8c.el8.x86_64 2023-07-25T14:34:20.353 INFO:teuthology.orchestra.run.smithi092.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-07-25T14:34:20.354 INFO:teuthology.orchestra.run.smithi092.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-07-25T14:34:20.354 INFO:teuthology.orchestra.run.smithi092.stdout: libtool-2.4.6-25.el8.x86_64 2023-07-25T14:34:20.354 INFO:teuthology.orchestra.run.smithi092.stdout: libunwind-1.3.1-3.el8.x86_64 2023-07-25T14:34:20.354 INFO:teuthology.orchestra.run.smithi092.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-07-25T14:34:20.354 INFO:teuthology.orchestra.run.smithi092.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-07-25T14:34:20.354 INFO:teuthology.orchestra.run.smithi092.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-07-25T14:34:20.354 INFO:teuthology.orchestra.run.smithi092.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-07-25T14:34:20.355 INFO:teuthology.orchestra.run.smithi092.stdout: openblas-0.3.15-3.el8.x86_64 2023-07-25T14:34:20.355 INFO:teuthology.orchestra.run.smithi092.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-07-25T14:34:20.355 INFO:teuthology.orchestra.run.smithi092.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-07-25T14:34:20.355 INFO:teuthology.orchestra.run.smithi092.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-07-25T14:34:20.355 INFO:teuthology.orchestra.run.smithi092.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-07-25T14:34:20.355 INFO:teuthology.orchestra.run.smithi092.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-07-25T14:34:20.355 INFO:teuthology.orchestra.run.smithi092.stdout: postgresql-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-07-25T14:34:20.355 INFO:teuthology.orchestra.run.smithi092.stdout: postgresql-contrib-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-07-25T14:34:20.356 INFO:teuthology.orchestra.run.smithi092.stdout: postgresql-server-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-07-25T14:34:20.356 INFO:teuthology.orchestra.run.smithi092.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-07-25T14:34:20.356 INFO:teuthology.orchestra.run.smithi092.stdout: python3-babel-2.5.1-7.el8.noarch 2023-07-25T14:34:20.356 INFO:teuthology.orchestra.run.smithi092.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-07-25T14:34:20.356 INFO:teuthology.orchestra.run.smithi092.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-07-25T14:34:20.356 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-07-25T14:34:20.357 INFO:teuthology.orchestra.run.smithi092.stdout: python3-ceph-argparse-2:18.0.0-5128.ga5d48e8c.el8.x86_64 2023-07-25T14:34:20.357 INFO:teuthology.orchestra.run.smithi092.stdout: python3-ceph-common-2:18.0.0-5128.ga5d48e8c.el8.x86_64 2023-07-25T14:34:20.357 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cephfs-2:18.0.0-5128.ga5d48e8c.el8.x86_64 2023-07-25T14:34:20.357 INFO:teuthology.orchestra.run.smithi092.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-07-25T14:34:20.357 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-07-25T14:34:20.357 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-07-25T14:34:20.357 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-07-25T14:34:20.358 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-07-25T14:34:20.358 INFO:teuthology.orchestra.run.smithi092.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-07-25T14:34:20.358 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jaraco-6.2-6.el8.noarch 2023-07-25T14:34:20.358 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-07-25T14:34:20.358 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-07-25T14:34:20.358 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-07-25T14:34:20.358 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-07-25T14:34:20.358 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-07-25T14:34:20.359 INFO:teuthology.orchestra.run.smithi092.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-07-25T14:34:20.359 INFO:teuthology.orchestra.run.smithi092.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-07-25T14:34:20.359 INFO:teuthology.orchestra.run.smithi092.stdout: python3-mako-1.0.6-13.el8.noarch 2023-07-25T14:34:20.359 INFO:teuthology.orchestra.run.smithi092.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-07-25T14:34:20.359 INFO:teuthology.orchestra.run.smithi092.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-07-25T14:34:20.359 INFO:teuthology.orchestra.run.smithi092.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-07-25T14:34:20.359 INFO:teuthology.orchestra.run.smithi092.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-07-25T14:34:20.359 INFO:teuthology.orchestra.run.smithi092.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-07-25T14:34:20.360 INFO:teuthology.orchestra.run.smithi092.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-07-25T14:34:20.360 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-07-25T14:34:20.360 INFO:teuthology.orchestra.run.smithi092.stdout: python3-portend-2.6-1.el8.noarch 2023-07-25T14:34:20.360 INFO:teuthology.orchestra.run.smithi092.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-07-25T14:34:20.360 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-07-25T14:34:20.360 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-07-25T14:34:20.360 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-07-25T14:34:20.361 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pycparser-2.14-14.el8.noarch 2023-07-25T14:34:20.361 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pytz-2017.2-9.el8.noarch 2023-07-25T14:34:20.361 INFO:teuthology.orchestra.run.smithi092.stdout: python3-rados-2:18.0.0-5128.ga5d48e8c.el8.x86_64 2023-07-25T14:34:20.361 INFO:teuthology.orchestra.run.smithi092.stdout: python3-rbd-2:18.0.0-5128.ga5d48e8c.el8.x86_64 2023-07-25T14:34:20.361 INFO:teuthology.orchestra.run.smithi092.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-07-25T14:34:20.361 INFO:teuthology.orchestra.run.smithi092.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-07-25T14:34:20.361 INFO:teuthology.orchestra.run.smithi092.stdout: python3-rgw-2:18.0.0-5128.ga5d48e8c.el8.x86_64 2023-07-25T14:34:20.361 INFO:teuthology.orchestra.run.smithi092.stdout: python3-routes-2.4.1-12.el8.noarch 2023-07-25T14:34:20.362 INFO:teuthology.orchestra.run.smithi092.stdout: python3-rsa-4.8-1.el8.noarch 2023-07-25T14:34:20.362 INFO:teuthology.orchestra.run.smithi092.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-07-25T14:34:20.362 INFO:teuthology.orchestra.run.smithi092.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-07-25T14:34:20.362 INFO:teuthology.orchestra.run.smithi092.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-07-25T14:34:20.362 INFO:teuthology.orchestra.run.smithi092.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-07-25T14:34:20.362 INFO:teuthology.orchestra.run.smithi092.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-07-25T14:34:20.362 INFO:teuthology.orchestra.run.smithi092.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-07-25T14:34:20.363 INFO:teuthology.orchestra.run.smithi092.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-07-25T14:34:20.363 INFO:teuthology.orchestra.run.smithi092.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-07-25T14:34:20.363 INFO:teuthology.orchestra.run.smithi092.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-07-25T14:34:20.363 INFO:teuthology.orchestra.run.smithi092.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-07-25T14:34:20.363 INFO:teuthology.orchestra.run.smithi092.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-07-25T14:34:20.364 INFO:teuthology.orchestra.run.smithi092.stdout: rbd-fuse-2:18.0.0-5128.ga5d48e8c.el8.x86_64 2023-07-25T14:34:20.364 INFO:teuthology.orchestra.run.smithi092.stdout: rbd-mirror-2:18.0.0-5128.ga5d48e8c.el8.x86_64 2023-07-25T14:34:20.364 INFO:teuthology.orchestra.run.smithi092.stdout: rbd-nbd-2:18.0.0-5128.ga5d48e8c.el8.x86_64 2023-07-25T14:34:20.364 INFO:teuthology.orchestra.run.smithi092.stdout: socat-1.7.4.1-1.el8.x86_64 2023-07-25T14:34:20.364 INFO:teuthology.orchestra.run.smithi092.stdout: thrift-0.13.0-2.el8.x86_64 2023-07-25T14:34:20.364 INFO:teuthology.orchestra.run.smithi092.stdout: uuid-1.6.2-43.el8.x86_64 2023-07-25T14:34:20.364 INFO:teuthology.orchestra.run.smithi092.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-07-25T14:34:20.365 INFO:teuthology.orchestra.run.smithi092.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-07-25T14:34:20.365 INFO:teuthology.orchestra.run.smithi092.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-07-25T14:34:20.365 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-07-25T14:34:20.365 INFO:teuthology.orchestra.run.smithi092.stdout:Complete! 2023-07-25T14:34:20.649 DEBUG:teuthology.parallel:result is None 2023-07-25T14:34:22.357 INFO:teuthology.orchestra.run.smithi072.stdout:Installed products updated. 2023-07-25T14:34:22.588 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-25T14:34:22.588 INFO:teuthology.orchestra.run.smithi072.stdout:Upgraded: 2023-07-25T14:34:22.589 INFO:teuthology.orchestra.run.smithi072.stdout: iproute-5.15.0-4.el8_6.1.x86_64 2023-07-25T14:34:22.589 INFO:teuthology.orchestra.run.smithi072.stdout: librados2-2:18.0.0-5128.ga5d48e8c.el8.x86_64 2023-07-25T14:34:22.590 INFO:teuthology.orchestra.run.smithi072.stdout: librbd1-2:18.0.0-5128.ga5d48e8c.el8.x86_64 2023-07-25T14:34:22.590 INFO:teuthology.orchestra.run.smithi072.stdout:Installed: 2023-07-25T14:34:22.590 INFO:teuthology.orchestra.run.smithi072.stdout: NetworkManager-initscripts-updown-1:1.36.0-9.el8_6.noarch 2023-07-25T14:34:22.590 INFO:teuthology.orchestra.run.smithi072.stdout: automake-1.16.1-7.el8.noarch 2023-07-25T14:34:22.591 INFO:teuthology.orchestra.run.smithi072.stdout: bison-3.0.4-10.el8.x86_64 2023-07-25T14:34:22.591 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-2:18.0.0-5128.ga5d48e8c.el8.x86_64 2023-07-25T14:34:22.591 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-base-2:18.0.0-5128.ga5d48e8c.el8.x86_64 2023-07-25T14:34:22.591 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-common-2:18.0.0-5128.ga5d48e8c.el8.x86_64 2023-07-25T14:34:22.591 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-fuse-2:18.0.0-5128.ga5d48e8c.el8.x86_64 2023-07-25T14:34:22.591 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-grafana-dashboards-2:18.0.0-5128.ga5d48e8c.el8.noarch 2023-07-25T14:34:22.591 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-immutable-object-cache-2:18.0.0-5128.ga5d48e8c.el8.x86_64 2023-07-25T14:34:22.591 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mds-2:18.0.0-5128.ga5d48e8c.el8.x86_64 2023-07-25T14:34:22.592 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-2:18.0.0-5128.ga5d48e8c.el8.x86_64 2023-07-25T14:34:22.592 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-cephadm-2:18.0.0-5128.ga5d48e8c.el8.noarch 2023-07-25T14:34:22.592 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-dashboard-2:18.0.0-5128.ga5d48e8c.el8.noarch 2023-07-25T14:34:22.592 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-diskprediction-local-2:18.0.0-5128.ga5d48e8c.el8.noarch 2023-07-25T14:34:22.592 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-modules-core-2:18.0.0-5128.ga5d48e8c.el8.noarch 2023-07-25T14:34:22.592 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-rook-2:18.0.0-5128.ga5d48e8c.el8.noarch 2023-07-25T14:34:22.593 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mon-2:18.0.0-5128.ga5d48e8c.el8.x86_64 2023-07-25T14:34:22.593 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-osd-2:18.0.0-5128.ga5d48e8c.el8.x86_64 2023-07-25T14:34:22.593 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-prometheus-alerts-2:18.0.0-5128.ga5d48e8c.el8.noarch 2023-07-25T14:34:22.593 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-radosgw-2:18.0.0-5128.ga5d48e8c.el8.x86_64 2023-07-25T14:34:22.593 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-selinux-2:18.0.0-5128.ga5d48e8c.el8.x86_64 2023-07-25T14:34:22.593 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-test-2:18.0.0-5128.ga5d48e8c.el8.x86_64 2023-07-25T14:34:22.593 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-volume-2:18.0.0-5128.ga5d48e8c.el8.noarch 2023-07-25T14:34:22.594 INFO:teuthology.orchestra.run.smithi072.stdout: cephadm-2:18.0.0-5128.ga5d48e8c.el8.noarch 2023-07-25T14:34:22.594 INFO:teuthology.orchestra.run.smithi072.stdout: cephfs-mirror-2:18.0.0-5128.ga5d48e8c.el8.x86_64 2023-07-25T14:34:22.594 INFO:teuthology.orchestra.run.smithi072.stdout: cephfs-top-2:18.0.0-5128.ga5d48e8c.el8.noarch 2023-07-25T14:34:22.594 INFO:teuthology.orchestra.run.smithi072.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-07-25T14:34:22.594 INFO:teuthology.orchestra.run.smithi072.stdout: flex-2.6.1-9.el8.x86_64 2023-07-25T14:34:22.595 INFO:teuthology.orchestra.run.smithi072.stdout: fuse-2.9.7-15.el8.x86_64 2023-07-25T14:34:22.595 INFO:teuthology.orchestra.run.smithi072.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-07-25T14:34:22.595 INFO:teuthology.orchestra.run.smithi072.stdout: jq-1.6-3.el8.x86_64 2023-07-25T14:34:22.595 INFO:teuthology.orchestra.run.smithi072.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-07-25T14:34:22.595 INFO:teuthology.orchestra.run.smithi072.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-07-25T14:34:22.595 INFO:teuthology.orchestra.run.smithi072.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-07-25T14:34:22.595 INFO:teuthology.orchestra.run.smithi072.stdout: libcephfs-devel-2:18.0.0-5128.ga5d48e8c.el8.x86_64 2023-07-25T14:34:22.596 INFO:teuthology.orchestra.run.smithi072.stdout: libcephfs2-2:18.0.0-5128.ga5d48e8c.el8.x86_64 2023-07-25T14:34:22.596 INFO:teuthology.orchestra.run.smithi072.stdout: libcephsqlite-2:18.0.0-5128.ga5d48e8c.el8.x86_64 2023-07-25T14:34:22.596 INFO:teuthology.orchestra.run.smithi072.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-07-25T14:34:22.596 INFO:teuthology.orchestra.run.smithi072.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-07-25T14:34:22.596 INFO:teuthology.orchestra.run.smithi072.stdout: liboath-2.6.2-3.el8.x86_64 2023-07-25T14:34:22.596 INFO:teuthology.orchestra.run.smithi072.stdout: libpq-13.5-1.el8.x86_64 2023-07-25T14:34:22.596 INFO:teuthology.orchestra.run.smithi072.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-07-25T14:34:22.597 INFO:teuthology.orchestra.run.smithi072.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-07-25T14:34:22.597 INFO:teuthology.orchestra.run.smithi072.stdout: librados-devel-2:18.0.0-5128.ga5d48e8c.el8.x86_64 2023-07-25T14:34:22.598 INFO:teuthology.orchestra.run.smithi072.stdout: libradosstriper1-2:18.0.0-5128.ga5d48e8c.el8.x86_64 2023-07-25T14:34:22.598 INFO:teuthology.orchestra.run.smithi072.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-07-25T14:34:22.598 INFO:teuthology.orchestra.run.smithi072.stdout: librgw2-2:18.0.0-5128.ga5d48e8c.el8.x86_64 2023-07-25T14:34:22.599 INFO:teuthology.orchestra.run.smithi072.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-07-25T14:34:22.599 INFO:teuthology.orchestra.run.smithi072.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-07-25T14:34:22.599 INFO:teuthology.orchestra.run.smithi072.stdout: libtool-2.4.6-25.el8.x86_64 2023-07-25T14:34:22.599 INFO:teuthology.orchestra.run.smithi072.stdout: libunwind-1.3.1-3.el8.x86_64 2023-07-25T14:34:22.600 INFO:teuthology.orchestra.run.smithi072.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-07-25T14:34:22.600 INFO:teuthology.orchestra.run.smithi072.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-07-25T14:34:22.600 INFO:teuthology.orchestra.run.smithi072.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-07-25T14:34:22.601 INFO:teuthology.orchestra.run.smithi072.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-07-25T14:34:22.601 INFO:teuthology.orchestra.run.smithi072.stdout: openblas-0.3.15-3.el8.x86_64 2023-07-25T14:34:22.601 INFO:teuthology.orchestra.run.smithi072.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-07-25T14:34:22.602 INFO:teuthology.orchestra.run.smithi072.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-07-25T14:34:22.602 INFO:teuthology.orchestra.run.smithi072.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-07-25T14:34:22.602 INFO:teuthology.orchestra.run.smithi072.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-07-25T14:34:22.603 INFO:teuthology.orchestra.run.smithi072.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-07-25T14:34:22.603 INFO:teuthology.orchestra.run.smithi072.stdout: postgresql-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-07-25T14:34:22.603 INFO:teuthology.orchestra.run.smithi072.stdout: postgresql-contrib-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-07-25T14:34:22.603 INFO:teuthology.orchestra.run.smithi072.stdout: postgresql-server-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-07-25T14:34:22.604 INFO:teuthology.orchestra.run.smithi072.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-07-25T14:34:22.604 INFO:teuthology.orchestra.run.smithi072.stdout: python3-babel-2.5.1-7.el8.noarch 2023-07-25T14:34:22.604 INFO:teuthology.orchestra.run.smithi072.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-07-25T14:34:22.605 INFO:teuthology.orchestra.run.smithi072.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-07-25T14:34:22.605 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-07-25T14:34:22.605 INFO:teuthology.orchestra.run.smithi072.stdout: python3-ceph-argparse-2:18.0.0-5128.ga5d48e8c.el8.x86_64 2023-07-25T14:34:22.605 INFO:teuthology.orchestra.run.smithi072.stdout: python3-ceph-common-2:18.0.0-5128.ga5d48e8c.el8.x86_64 2023-07-25T14:34:22.606 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cephfs-2:18.0.0-5128.ga5d48e8c.el8.x86_64 2023-07-25T14:34:22.606 INFO:teuthology.orchestra.run.smithi072.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-07-25T14:34:22.606 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-07-25T14:34:22.606 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-07-25T14:34:22.607 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-07-25T14:34:22.607 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-07-25T14:34:22.607 INFO:teuthology.orchestra.run.smithi072.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-07-25T14:34:22.607 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jaraco-6.2-6.el8.noarch 2023-07-25T14:34:22.608 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-07-25T14:34:22.608 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-07-25T14:34:22.609 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-07-25T14:34:22.609 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-07-25T14:34:22.609 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-07-25T14:34:22.609 INFO:teuthology.orchestra.run.smithi072.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-07-25T14:34:22.610 INFO:teuthology.orchestra.run.smithi072.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-07-25T14:34:22.610 INFO:teuthology.orchestra.run.smithi072.stdout: python3-mako-1.0.6-13.el8.noarch 2023-07-25T14:34:22.610 INFO:teuthology.orchestra.run.smithi072.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-07-25T14:34:22.610 INFO:teuthology.orchestra.run.smithi072.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-07-25T14:34:22.611 INFO:teuthology.orchestra.run.smithi072.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-07-25T14:34:22.611 INFO:teuthology.orchestra.run.smithi072.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-07-25T14:34:22.611 INFO:teuthology.orchestra.run.smithi072.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-07-25T14:34:22.611 INFO:teuthology.orchestra.run.smithi072.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-07-25T14:34:22.611 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-07-25T14:34:22.612 INFO:teuthology.orchestra.run.smithi072.stdout: python3-portend-2.6-1.el8.noarch 2023-07-25T14:34:22.612 INFO:teuthology.orchestra.run.smithi072.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-07-25T14:34:22.612 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-07-25T14:34:22.612 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-07-25T14:34:22.612 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-07-25T14:34:22.612 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pycparser-2.14-14.el8.noarch 2023-07-25T14:34:22.613 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pytz-2017.2-9.el8.noarch 2023-07-25T14:34:22.613 INFO:teuthology.orchestra.run.smithi072.stdout: python3-rados-2:18.0.0-5128.ga5d48e8c.el8.x86_64 2023-07-25T14:34:22.613 INFO:teuthology.orchestra.run.smithi072.stdout: python3-rbd-2:18.0.0-5128.ga5d48e8c.el8.x86_64 2023-07-25T14:34:22.613 INFO:teuthology.orchestra.run.smithi072.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-07-25T14:34:22.613 INFO:teuthology.orchestra.run.smithi072.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-07-25T14:34:22.613 INFO:teuthology.orchestra.run.smithi072.stdout: python3-rgw-2:18.0.0-5128.ga5d48e8c.el8.x86_64 2023-07-25T14:34:22.613 INFO:teuthology.orchestra.run.smithi072.stdout: python3-routes-2.4.1-12.el8.noarch 2023-07-25T14:34:22.613 INFO:teuthology.orchestra.run.smithi072.stdout: python3-rsa-4.8-1.el8.noarch 2023-07-25T14:34:22.614 INFO:teuthology.orchestra.run.smithi072.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-07-25T14:34:22.614 INFO:teuthology.orchestra.run.smithi072.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-07-25T14:34:22.614 INFO:teuthology.orchestra.run.smithi072.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-07-25T14:34:22.614 INFO:teuthology.orchestra.run.smithi072.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-07-25T14:34:22.614 INFO:teuthology.orchestra.run.smithi072.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-07-25T14:34:22.614 INFO:teuthology.orchestra.run.smithi072.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-07-25T14:34:22.614 INFO:teuthology.orchestra.run.smithi072.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-07-25T14:34:22.615 INFO:teuthology.orchestra.run.smithi072.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-07-25T14:34:22.615 INFO:teuthology.orchestra.run.smithi072.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-07-25T14:34:22.615 INFO:teuthology.orchestra.run.smithi072.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-07-25T14:34:22.615 INFO:teuthology.orchestra.run.smithi072.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-07-25T14:34:22.615 INFO:teuthology.orchestra.run.smithi072.stdout: rbd-fuse-2:18.0.0-5128.ga5d48e8c.el8.x86_64 2023-07-25T14:34:22.615 INFO:teuthology.orchestra.run.smithi072.stdout: rbd-mirror-2:18.0.0-5128.ga5d48e8c.el8.x86_64 2023-07-25T14:34:22.615 INFO:teuthology.orchestra.run.smithi072.stdout: rbd-nbd-2:18.0.0-5128.ga5d48e8c.el8.x86_64 2023-07-25T14:34:22.615 INFO:teuthology.orchestra.run.smithi072.stdout: socat-1.7.4.1-1.el8.x86_64 2023-07-25T14:34:22.616 INFO:teuthology.orchestra.run.smithi072.stdout: thrift-0.13.0-2.el8.x86_64 2023-07-25T14:34:22.616 INFO:teuthology.orchestra.run.smithi072.stdout: uuid-1.6.2-43.el8.x86_64 2023-07-25T14:34:22.616 INFO:teuthology.orchestra.run.smithi072.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-07-25T14:34:22.616 INFO:teuthology.orchestra.run.smithi072.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-07-25T14:34:22.616 INFO:teuthology.orchestra.run.smithi072.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-07-25T14:34:22.617 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-25T14:34:22.617 INFO:teuthology.orchestra.run.smithi072.stdout:Complete! 2023-07-25T14:34:22.860 DEBUG:teuthology.parallel:result is None 2023-07-25T14:34:22.861 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=a5d48e8c688c2543997a98b8acbae2ce9635578c 2023-07-25T14:34:28.354 DEBUG:teuthology.orchestra.run.smithi072:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-07-25T14:34:28.382 INFO:teuthology.orchestra.run.smithi072.stdout:18.0.0-5128.ga5d48e8c.el8 2023-07-25T14:34:28.383 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-5128.ga5d48e8c.el8 2023-07-25T14:34:28.383 INFO:teuthology.task.install:The correct ceph version 18.0.0-5128.ga5d48e8c is installed. 2023-07-25T14:34:28.384 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=a5d48e8c688c2543997a98b8acbae2ce9635578c 2023-07-25T14:34:33.955 DEBUG:teuthology.orchestra.run.smithi092:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-07-25T14:34:33.984 INFO:teuthology.orchestra.run.smithi092.stdout:18.0.0-5128.ga5d48e8c.el8 2023-07-25T14:34:33.985 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-5128.ga5d48e8c.el8 2023-07-25T14:34:33.985 INFO:teuthology.task.install:The correct ceph version 18.0.0-5128.ga5d48e8c is installed. 2023-07-25T14:34:33.986 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-07-25T14:34:33.987 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-07-25T14:34:33.987 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-07-25T14:34:34.037 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-07-25T14:34:34.037 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-07-25T14:34:34.087 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-07-25T14:34:34.087 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-07-25T14:34:34.087 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd of=/usr/bin/daemon-helper 2023-07-25T14:34:34.117 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-07-25T14:34:34.186 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-07-25T14:34:34.187 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd of=/usr/bin/daemon-helper 2023-07-25T14:34:34.220 DEBUG:teuthology.orchestra.run.smithi092:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-07-25T14:34:34.291 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-07-25T14:34:34.292 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-07-25T14:34:34.292 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd of=/usr/bin/adjust-ulimits 2023-07-25T14:34:34.320 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-07-25T14:34:34.388 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-07-25T14:34:34.389 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd of=/usr/bin/adjust-ulimits 2023-07-25T14:34:34.420 DEBUG:teuthology.orchestra.run.smithi092:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-07-25T14:34:34.492 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-07-25T14:34:34.493 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-07-25T14:34:34.493 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd of=/usr/bin/stdin-killer 2023-07-25T14:34:34.521 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-07-25T14:34:34.588 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-07-25T14:34:34.589 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd of=/usr/bin/stdin-killer 2023-07-25T14:34:34.621 DEBUG:teuthology.orchestra.run.smithi092:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-07-25T14:34:34.693 INFO:teuthology.run_tasks:Running task ceph... 2023-07-25T14:34:34.770 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-07-25T14:34:34.771 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod 777 /var/log/ceph 2023-07-25T14:34:34.774 DEBUG:teuthology.orchestra.run.smithi092:> sudo chmod 777 /var/log/ceph 2023-07-25T14:34:34.804 INFO:tasks.ceph:Disabling ceph logrotate... 2023-07-25T14:34:34.805 DEBUG:teuthology.orchestra.run.smithi072:> sudo rm -f -- /etc/logrotate.d/ceph 2023-07-25T14:34:34.841 DEBUG:teuthology.orchestra.run.smithi092:> sudo rm -f -- /etc/logrotate.d/ceph 2023-07-25T14:34:34.877 INFO:tasks.ceph:Creating extra log directories... 2023-07-25T14:34:34.877 DEBUG:teuthology.orchestra.run.smithi072:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-07-25T14:34:34.907 DEBUG:teuthology.orchestra.run.smithi092:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-07-25T14:34:34.954 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-07-25T14:34:34.954 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-07-25T14:34:34.954 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-07-25T14:34:34.955 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-07-25T14:34:34.955 DEBUG:teuthology.orchestra.run.smithi072:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-07-25T14:34:34.988 DEBUG:teuthology.orchestra.run.smithi072:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-07-25T14:34:40.149 DEBUG:teuthology.orchestra.run.smithi072:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-07-25T14:34:40.238 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-07-25T14:34:40.239 DEBUG:teuthology.orchestra.run.smithi092:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-07-25T14:34:40.258 DEBUG:teuthology.orchestra.run.smithi092:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-07-25T14:34:45.479 DEBUG:teuthology.orchestra.run.smithi092:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-07-25T14:34:45.520 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-07-25T14:34:45.521 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-07-25T14:34:45.521 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/vshankar-2023-07-25_11:29:34-fs-wip-vshankar-testing-20230725.043804-testing-default-smithi/7350676', 'branch': 'wip-vshankar-testing-20230725.043804', 'description': 'fs/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug} tasks/multifs-auth}', 'email': 'vshankar@redhat.com', 'first_in_suite': False, 'job_id': '7350676', 'kernel': {'client': {'sha1': 'distro'}, 'flavor': 'default', 'kdb': True, 'sha1': 'bbae19e0824be3daf9282aaf5330af10cdf81109'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'vshankar-2023-07-25_11:29:34-fs-wip-vshankar-testing-20230725.043804-testing-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'rhel', 'os_version': '8.6', 'overrides': {'admin_socket': {'branch': 'wip-vshankar-testing-20230725.043804'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': 'a5d48e8c688c2543997a98b8acbae2ce9635578c'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}}}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'a5d48e8c688c2543997a98b8acbae2ce9635578c'}}, 'kclient': {'syntax': 'v1'}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-vshankar-testing-20230725.043804', 'sha1': 'a5d48e8c688c2543997a98b8acbae2ce9635578c'}}, 'owner': 'scheduled_vshankar@teuthology', 'priority': 150, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1']], 'seed': 9167, 'sha1': 'a5d48e8c688c2543997a98b8acbae2ce9635578c', 'sleep_before_teardown': 0, 'subset': '269/1024', 'suite': 'fs', 'suite_branch': 'wip-vshankar-testing-20230725.043804', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_a5d48e8c688c2543997a98b8acbae2ce9635578c/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': 'a5d48e8c688c2543997a98b8acbae2ce9635578c', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi072.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac=', 'smithi092.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'sha1': 'distro'}, 'flavor': 'default', 'kdb': True, 'sha1': 'bbae19e0824be3daf9282aaf5330af10cdf81109'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'a5d48e8c688c2543997a98b8acbae2ce9635578c'}}, {'ceph': None}, {'kclient': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.test_multifs_auth']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '407880c6d3fb77318fff01c863715090f9c2de69', 'timestamp': '2023-07-25_11:29:34', 'tube': 'smithi', 'user': 'vshankar', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.23459'} 2023-07-25T14:34:45.522 DEBUG:teuthology.orchestra.run.smithi072:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-07-25T14:34:45.525 DEBUG:teuthology.orchestra.run.smithi092:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-07-25T14:34:45.575 DEBUG:teuthology.orchestra.run.smithi072:> sudo install -d -m0777 -- /var/run/ceph 2023-07-25T14:34:45.585 DEBUG:teuthology.orchestra.run.smithi092:> sudo install -d -m0777 -- /var/run/ceph 2023-07-25T14:34:45.647 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-07-25T14:34:45.647 DEBUG:teuthology.orchestra.run.smithi072:> dd if=/scratch_devs of=/dev/stdout 2023-07-25T14:34:45.672 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-07-25T14:34:45.673 DEBUG:teuthology.orchestra.run.smithi072:> stat /dev/vg_nvme/lv_1 2023-07-25T14:34:45.730 INFO:teuthology.orchestra.run.smithi072.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-07-25T14:34:45.731 INFO:teuthology.orchestra.run.smithi072.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-25T14:34:45.731 INFO:teuthology.orchestra.run.smithi072.stdout:Device: 6h/6d Inode: 370662 Links: 1 2023-07-25T14:34:45.731 INFO:teuthology.orchestra.run.smithi072.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-25T14:34:45.731 INFO:teuthology.orchestra.run.smithi072.stdout:Context: system_u:object_r:device_t:s0 2023-07-25T14:34:45.731 INFO:teuthology.orchestra.run.smithi072.stdout:Access: 2023-07-25 14:34:16.764002694 +0000 2023-07-25T14:34:45.731 INFO:teuthology.orchestra.run.smithi072.stdout:Modify: 2023-07-25 14:29:55.172296727 +0000 2023-07-25T14:34:45.731 INFO:teuthology.orchestra.run.smithi072.stdout:Change: 2023-07-25 14:29:55.172296727 +0000 2023-07-25T14:34:45.732 INFO:teuthology.orchestra.run.smithi072.stdout: Birth: - 2023-07-25T14:34:45.732 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-07-25T14:34:45.797 INFO:teuthology.orchestra.run.smithi072.stderr:1+0 records in 2023-07-25T14:34:45.798 INFO:teuthology.orchestra.run.smithi072.stderr:1+0 records out 2023-07-25T14:34:45.798 INFO:teuthology.orchestra.run.smithi072.stderr:512 bytes copied, 0.000260656 s, 2.0 MB/s 2023-07-25T14:34:45.799 DEBUG:teuthology.orchestra.run.smithi072:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-07-25T14:34:45.858 DEBUG:teuthology.orchestra.run.smithi072:> stat /dev/vg_nvme/lv_2 2023-07-25T14:34:45.917 INFO:teuthology.orchestra.run.smithi072.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-07-25T14:34:45.917 INFO:teuthology.orchestra.run.smithi072.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-25T14:34:45.918 INFO:teuthology.orchestra.run.smithi072.stdout:Device: 6h/6d Inode: 380995 Links: 1 2023-07-25T14:34:45.918 INFO:teuthology.orchestra.run.smithi072.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-25T14:34:45.918 INFO:teuthology.orchestra.run.smithi072.stdout:Context: system_u:object_r:device_t:s0 2023-07-25T14:34:45.918 INFO:teuthology.orchestra.run.smithi072.stdout:Access: 2023-07-25 14:34:16.765002673 +0000 2023-07-25T14:34:45.918 INFO:teuthology.orchestra.run.smithi072.stdout:Modify: 2023-07-25 14:29:55.690286063 +0000 2023-07-25T14:34:45.919 INFO:teuthology.orchestra.run.smithi072.stdout:Change: 2023-07-25 14:29:55.690286063 +0000 2023-07-25T14:34:45.919 INFO:teuthology.orchestra.run.smithi072.stdout: Birth: - 2023-07-25T14:34:45.919 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-07-25T14:34:45.983 INFO:teuthology.orchestra.run.smithi072.stderr:1+0 records in 2023-07-25T14:34:45.984 INFO:teuthology.orchestra.run.smithi072.stderr:1+0 records out 2023-07-25T14:34:45.984 INFO:teuthology.orchestra.run.smithi072.stderr:512 bytes copied, 0.000230385 s, 2.2 MB/s 2023-07-25T14:34:45.985 DEBUG:teuthology.orchestra.run.smithi072:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-07-25T14:34:46.043 DEBUG:teuthology.orchestra.run.smithi072:> stat /dev/vg_nvme/lv_3 2023-07-25T14:34:46.100 INFO:teuthology.orchestra.run.smithi072.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-07-25T14:34:46.101 INFO:teuthology.orchestra.run.smithi072.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-25T14:34:46.101 INFO:teuthology.orchestra.run.smithi072.stdout:Device: 6h/6d Inode: 383056 Links: 1 2023-07-25T14:34:46.101 INFO:teuthology.orchestra.run.smithi072.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-25T14:34:46.101 INFO:teuthology.orchestra.run.smithi072.stdout:Context: system_u:object_r:device_t:s0 2023-07-25T14:34:46.102 INFO:teuthology.orchestra.run.smithi072.stdout:Access: 2023-07-25 14:34:16.765002673 +0000 2023-07-25T14:34:46.102 INFO:teuthology.orchestra.run.smithi072.stdout:Modify: 2023-07-25 14:29:56.193275709 +0000 2023-07-25T14:34:46.102 INFO:teuthology.orchestra.run.smithi072.stdout:Change: 2023-07-25 14:29:56.193275709 +0000 2023-07-25T14:34:46.102 INFO:teuthology.orchestra.run.smithi072.stdout: Birth: - 2023-07-25T14:34:46.102 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-07-25T14:34:46.166 INFO:teuthology.orchestra.run.smithi072.stderr:1+0 records in 2023-07-25T14:34:46.166 INFO:teuthology.orchestra.run.smithi072.stderr:1+0 records out 2023-07-25T14:34:46.166 INFO:teuthology.orchestra.run.smithi072.stderr:512 bytes copied, 0.000231891 s, 2.2 MB/s 2023-07-25T14:34:46.170 DEBUG:teuthology.orchestra.run.smithi072:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-07-25T14:34:46.228 DEBUG:teuthology.orchestra.run.smithi072:> stat /dev/vg_nvme/lv_4 2023-07-25T14:34:46.286 INFO:teuthology.orchestra.run.smithi072.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-07-25T14:34:46.286 INFO:teuthology.orchestra.run.smithi072.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-25T14:34:46.286 INFO:teuthology.orchestra.run.smithi072.stdout:Device: 6h/6d Inode: 380738 Links: 1 2023-07-25T14:34:46.287 INFO:teuthology.orchestra.run.smithi072.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-25T14:34:46.287 INFO:teuthology.orchestra.run.smithi072.stdout:Context: system_u:object_r:device_t:s0 2023-07-25T14:34:46.287 INFO:teuthology.orchestra.run.smithi072.stdout:Access: 2023-07-25 14:34:16.765002673 +0000 2023-07-25T14:34:46.287 INFO:teuthology.orchestra.run.smithi072.stdout:Modify: 2023-07-25 14:29:56.690265477 +0000 2023-07-25T14:34:46.287 INFO:teuthology.orchestra.run.smithi072.stdout:Change: 2023-07-25 14:29:56.690265477 +0000 2023-07-25T14:34:46.288 INFO:teuthology.orchestra.run.smithi072.stdout: Birth: - 2023-07-25T14:34:46.288 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-07-25T14:34:46.351 INFO:teuthology.orchestra.run.smithi072.stderr:1+0 records in 2023-07-25T14:34:46.352 INFO:teuthology.orchestra.run.smithi072.stderr:1+0 records out 2023-07-25T14:34:46.352 INFO:teuthology.orchestra.run.smithi072.stderr:512 bytes copied, 0.0001963 s, 2.6 MB/s 2023-07-25T14:34:46.353 DEBUG:teuthology.orchestra.run.smithi072:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-07-25T14:34:46.411 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-07-25T14:34:46.411 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-07-25T14:34:46.412 DEBUG:teuthology.orchestra.run.smithi092:> dd if=/scratch_devs of=/dev/stdout 2023-07-25T14:34:46.433 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-07-25T14:34:46.433 DEBUG:teuthology.orchestra.run.smithi092:> stat /dev/vg_nvme/lv_1 2023-07-25T14:34:46.493 INFO:teuthology.orchestra.run.smithi092.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-07-25T14:34:46.493 INFO:teuthology.orchestra.run.smithi092.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-25T14:34:46.493 INFO:teuthology.orchestra.run.smithi092.stdout:Device: 6h/6d Inode: 377458 Links: 1 2023-07-25T14:34:46.493 INFO:teuthology.orchestra.run.smithi092.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-25T14:34:46.494 INFO:teuthology.orchestra.run.smithi092.stdout:Context: system_u:object_r:device_t:s0 2023-07-25T14:34:46.494 INFO:teuthology.orchestra.run.smithi092.stdout:Access: 2023-07-25 14:34:14.565936952 +0000 2023-07-25T14:34:46.494 INFO:teuthology.orchestra.run.smithi092.stdout:Modify: 2023-07-25 14:30:12.422694738 +0000 2023-07-25T14:34:46.494 INFO:teuthology.orchestra.run.smithi092.stdout:Change: 2023-07-25 14:30:12.422694738 +0000 2023-07-25T14:34:46.494 INFO:teuthology.orchestra.run.smithi092.stdout: Birth: - 2023-07-25T14:34:46.495 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-07-25T14:34:46.563 INFO:teuthology.orchestra.run.smithi092.stderr:1+0 records in 2023-07-25T14:34:46.563 INFO:teuthology.orchestra.run.smithi092.stderr:1+0 records out 2023-07-25T14:34:46.563 INFO:teuthology.orchestra.run.smithi092.stderr:512 bytes copied, 0.000251408 s, 2.0 MB/s 2023-07-25T14:34:46.564 DEBUG:teuthology.orchestra.run.smithi092:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-07-25T14:34:46.625 DEBUG:teuthology.orchestra.run.smithi092:> stat /dev/vg_nvme/lv_2 2023-07-25T14:34:46.685 INFO:teuthology.orchestra.run.smithi092.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-07-25T14:34:46.685 INFO:teuthology.orchestra.run.smithi092.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-25T14:34:46.686 INFO:teuthology.orchestra.run.smithi092.stdout:Device: 6h/6d Inode: 371583 Links: 1 2023-07-25T14:34:46.686 INFO:teuthology.orchestra.run.smithi092.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-25T14:34:46.686 INFO:teuthology.orchestra.run.smithi092.stdout:Context: system_u:object_r:device_t:s0 2023-07-25T14:34:46.686 INFO:teuthology.orchestra.run.smithi092.stdout:Access: 2023-07-25 14:34:14.565936952 +0000 2023-07-25T14:34:46.686 INFO:teuthology.orchestra.run.smithi092.stdout:Modify: 2023-07-25 14:30:12.951679581 +0000 2023-07-25T14:34:46.686 INFO:teuthology.orchestra.run.smithi092.stdout:Change: 2023-07-25 14:30:12.951679581 +0000 2023-07-25T14:34:46.686 INFO:teuthology.orchestra.run.smithi092.stdout: Birth: - 2023-07-25T14:34:46.687 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-07-25T14:34:46.756 INFO:teuthology.orchestra.run.smithi092.stderr:1+0 records in 2023-07-25T14:34:46.756 INFO:teuthology.orchestra.run.smithi092.stderr:1+0 records out 2023-07-25T14:34:46.756 INFO:teuthology.orchestra.run.smithi092.stderr:512 bytes copied, 0.000212162 s, 2.4 MB/s 2023-07-25T14:34:46.757 DEBUG:teuthology.orchestra.run.smithi092:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-07-25T14:34:46.818 DEBUG:teuthology.orchestra.run.smithi092:> stat /dev/vg_nvme/lv_3 2023-07-25T14:34:46.879 INFO:teuthology.orchestra.run.smithi092.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-07-25T14:34:46.880 INFO:teuthology.orchestra.run.smithi092.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-25T14:34:46.880 INFO:teuthology.orchestra.run.smithi092.stdout:Device: 6h/6d Inode: 373592 Links: 1 2023-07-25T14:34:46.880 INFO:teuthology.orchestra.run.smithi092.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-25T14:34:46.880 INFO:teuthology.orchestra.run.smithi092.stdout:Context: system_u:object_r:device_t:s0 2023-07-25T14:34:46.880 INFO:teuthology.orchestra.run.smithi092.stdout:Access: 2023-07-25 14:34:14.565936952 +0000 2023-07-25T14:34:46.880 INFO:teuthology.orchestra.run.smithi092.stdout:Modify: 2023-07-25 14:30:13.452665226 +0000 2023-07-25T14:34:46.880 INFO:teuthology.orchestra.run.smithi092.stdout:Change: 2023-07-25 14:30:13.452665226 +0000 2023-07-25T14:34:46.881 INFO:teuthology.orchestra.run.smithi092.stdout: Birth: - 2023-07-25T14:34:46.881 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-07-25T14:34:46.950 INFO:teuthology.orchestra.run.smithi092.stderr:1+0 records in 2023-07-25T14:34:46.950 INFO:teuthology.orchestra.run.smithi092.stderr:1+0 records out 2023-07-25T14:34:46.950 INFO:teuthology.orchestra.run.smithi092.stderr:512 bytes copied, 0.000239223 s, 2.1 MB/s 2023-07-25T14:34:46.951 DEBUG:teuthology.orchestra.run.smithi092:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-07-25T14:34:47.012 DEBUG:teuthology.orchestra.run.smithi092:> stat /dev/vg_nvme/lv_4 2023-07-25T14:34:47.073 INFO:teuthology.orchestra.run.smithi092.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-07-25T14:34:47.073 INFO:teuthology.orchestra.run.smithi092.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-25T14:34:47.073 INFO:teuthology.orchestra.run.smithi092.stdout:Device: 6h/6d Inode: 377730 Links: 1 2023-07-25T14:34:47.074 INFO:teuthology.orchestra.run.smithi092.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-25T14:34:47.074 INFO:teuthology.orchestra.run.smithi092.stdout:Context: system_u:object_r:device_t:s0 2023-07-25T14:34:47.074 INFO:teuthology.orchestra.run.smithi092.stdout:Access: 2023-07-25 14:34:14.565936952 +0000 2023-07-25T14:34:47.074 INFO:teuthology.orchestra.run.smithi092.stdout:Modify: 2023-07-25 14:30:13.994649697 +0000 2023-07-25T14:34:47.074 INFO:teuthology.orchestra.run.smithi092.stdout:Change: 2023-07-25 14:30:13.994649697 +0000 2023-07-25T14:34:47.074 INFO:teuthology.orchestra.run.smithi092.stdout: Birth: - 2023-07-25T14:34:47.075 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-07-25T14:34:47.143 INFO:teuthology.orchestra.run.smithi092.stderr:1+0 records in 2023-07-25T14:34:47.143 INFO:teuthology.orchestra.run.smithi092.stderr:1+0 records out 2023-07-25T14:34:47.143 INFO:teuthology.orchestra.run.smithi092.stderr:512 bytes copied, 0.000204208 s, 2.5 MB/s 2023-07-25T14:34:47.144 DEBUG:teuthology.orchestra.run.smithi092:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-07-25T14:34:47.205 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-07-25T14:34:47.205 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi072.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi092.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-07-25T14:34:47.206 INFO:tasks.ceph:Generating config... 2023-07-25T14:34:47.207 INFO:tasks.ceph:[client] client mount timeout = 600 2023-07-25T14:34:47.207 INFO:tasks.ceph:[client] debug client = 20 2023-07-25T14:34:47.207 INFO:tasks.ceph:[client] debug ms = 1 2023-07-25T14:34:47.208 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-07-25T14:34:47.208 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-07-25T14:34:47.208 INFO:tasks.ceph:[global] ms die on skipped message = False 2023-07-25T14:34:47.208 INFO:tasks.ceph:[mds] debug mds = 20 2023-07-25T14:34:47.208 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-07-25T14:34:47.209 INFO:tasks.ceph:[mds] debug ms = 1 2023-07-25T14:34:47.209 INFO:tasks.ceph:[mds] mds debug frag = True 2023-07-25T14:34:47.209 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-07-25T14:34:47.209 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-07-25T14:34:47.209 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-07-25T14:34:47.210 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-07-25T14:34:47.210 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-07-25T14:34:47.210 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-07-25T14:34:47.210 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-07-25T14:34:47.210 INFO:tasks.ceph:[mgr] debug ms = 1 2023-07-25T14:34:47.211 INFO:tasks.ceph:[mon] debug mon = 20 2023-07-25T14:34:47.211 INFO:tasks.ceph:[mon] debug ms = 1 2023-07-25T14:34:47.211 INFO:tasks.ceph:[mon] debug paxos = 20 2023-07-25T14:34:47.211 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-07-25T14:34:47.211 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-07-25T14:34:47.211 INFO:tasks.ceph:[osd] bluestore compression mode = aggressive 2023-07-25T14:34:47.212 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-07-25T14:34:47.212 INFO:tasks.ceph:[osd] debug bluefs = 20 2023-07-25T14:34:47.212 INFO:tasks.ceph:[osd] debug bluestore = 20 2023-07-25T14:34:47.212 INFO:tasks.ceph:[osd] debug ms = 1 2023-07-25T14:34:47.212 INFO:tasks.ceph:[osd] debug osd = 20 2023-07-25T14:34:47.213 INFO:tasks.ceph:[osd] debug rocksdb = 10 2023-07-25T14:34:47.213 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-07-25T14:34:47.213 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-07-25T14:34:47.213 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-07-25T14:34:47.213 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-07-25T14:34:47.214 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-07-25T14:34:47.214 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-07-25T14:34:47.214 INFO:tasks.ceph:Setting up mon.a... 2023-07-25T14:34:47.214 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-07-25T14:34:47.290 INFO:teuthology.orchestra.run.smithi072.stdout:creating /etc/ceph/ceph.keyring 2023-07-25T14:34:47.293 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-07-25T14:34:47.348 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-07-25T14:34:47.376 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.72'), ('mon.b', '172.21.15.92'), ('mon.c', '[v2:172.21.15.92:3301,v1:172.21.15.92:6790]')] 2023-07-25T14:34:47.377 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.72,172.21.15.92,[v2:172.21.15.92:3301,v1:172.21.15.92:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-07-25T14:34:47.378 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-07-25T14:34:47.378 DEBUG:teuthology.orchestra.run.smithi072:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-07-25T14:34:47.434 DEBUG:teuthology.orchestra.run.smithi072:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.72 --add b 172.21.15.92 --addv c '[v2:172.21.15.92:3301,v1:172.21.15.92:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-07-25T14:34:47.524 INFO:teuthology.orchestra.run.smithi072.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-07-25T14:34:47.524 INFO:teuthology.orchestra.run.smithi072.stdout:monmaptool: generated fsid 9170db48-9170-43e8-8ccb-9813e6240906 2023-07-25T14:34:47.525 INFO:teuthology.orchestra.run.smithi072.stdout:setting min_mon_release = pacific 2023-07-25T14:34:47.525 INFO:teuthology.orchestra.run.smithi072.stdout:epoch 0 2023-07-25T14:34:47.525 INFO:teuthology.orchestra.run.smithi072.stdout:fsid 9170db48-9170-43e8-8ccb-9813e6240906 2023-07-25T14:34:47.526 INFO:teuthology.orchestra.run.smithi072.stdout:last_changed 2023-07-25T14:34:47.511796+0000 2023-07-25T14:34:47.526 INFO:teuthology.orchestra.run.smithi072.stdout:created 2023-07-25T14:34:47.511796+0000 2023-07-25T14:34:47.526 INFO:teuthology.orchestra.run.smithi072.stdout:min_mon_release 16 (pacific) 2023-07-25T14:34:47.526 INFO:teuthology.orchestra.run.smithi072.stdout:election_strategy: 1 2023-07-25T14:34:47.527 INFO:teuthology.orchestra.run.smithi072.stdout:0: [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] mon.a 2023-07-25T14:34:47.527 INFO:teuthology.orchestra.run.smithi072.stdout:1: [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] mon.b 2023-07-25T14:34:47.527 INFO:teuthology.orchestra.run.smithi072.stdout:2: [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] mon.c 2023-07-25T14:34:47.527 INFO:teuthology.orchestra.run.smithi072.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-07-25T14:34:47.529 DEBUG:teuthology.orchestra.run.smithi072:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-07-25T14:34:47.547 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 9170db48-9170-43e8-8ccb-9813e6240906... 2023-07-25T14:34:47.550 DEBUG:teuthology.orchestra.run.smithi072:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-07-25T14:34:47.591 DEBUG:teuthology.orchestra.run.smithi092:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-07-25T14:34:47.633 INFO:teuthology.orchestra.run.smithi072.stdout:[global] 2023-07-25T14:34:47.633 INFO:teuthology.orchestra.run.smithi072.stdout: chdir = "" 2023-07-25T14:34:47.633 INFO:teuthology.orchestra.run.smithi072.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-07-25T14:34:47.634 INFO:teuthology.orchestra.run.smithi072.stdout: auth supported = cephx 2023-07-25T14:34:47.634 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-25T14:34:47.634 INFO:teuthology.orchestra.run.smithi072.stdout: filestore xattr use omap = true 2023-07-25T14:34:47.635 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-25T14:34:47.635 INFO:teuthology.orchestra.run.smithi072.stdout: mon clock drift allowed = 1.000 2023-07-25T14:34:47.635 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-25T14:34:47.636 INFO:teuthology.orchestra.run.smithi072.stdout: osd crush chooseleaf type = 0 2023-07-25T14:34:47.637 INFO:teuthology.orchestra.run.smithi072.stdout: auth debug = true 2023-07-25T14:34:47.637 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-25T14:34:47.637 INFO:teuthology.orchestra.run.smithi072.stdout: ms die on old message = true 2023-07-25T14:34:47.638 INFO:teuthology.orchestra.run.smithi072.stdout: ms die on bug = true 2023-07-25T14:34:47.638 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-25T14:34:47.638 INFO:teuthology.orchestra.run.smithi072.stdout: mon max pg per osd = 10000 # >= luminous 2023-07-25T14:34:47.638 INFO:teuthology.orchestra.run.smithi072.stdout: mon pg warn max object skew = 0 2023-07-25T14:34:47.639 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-25T14:34:47.639 INFO:teuthology.orchestra.run.smithi072.stdout: # disable pg_autoscaler by default for new pools 2023-07-25T14:34:47.639 INFO:teuthology.orchestra.run.smithi072.stdout: osd_pool_default_pg_autoscale_mode = off 2023-07-25T14:34:47.639 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-25T14:34:47.640 INFO:teuthology.orchestra.run.smithi072.stdout: osd pool default size = 2 2023-07-25T14:34:47.640 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-25T14:34:47.640 INFO:teuthology.orchestra.run.smithi072.stdout: mon osd allow primary affinity = true 2023-07-25T14:34:47.641 INFO:teuthology.orchestra.run.smithi072.stdout: mon osd allow pg remap = true 2023-07-25T14:34:47.641 INFO:teuthology.orchestra.run.smithi072.stdout: mon warn on legacy crush tunables = false 2023-07-25T14:34:47.641 INFO:teuthology.orchestra.run.smithi072.stdout: mon warn on crush straw calc version zero = false 2023-07-25T14:34:47.642 INFO:teuthology.orchestra.run.smithi072.stdout: mon warn on no sortbitwise = false 2023-07-25T14:34:47.642 INFO:teuthology.orchestra.run.smithi072.stdout: mon warn on osd down out interval zero = false 2023-07-25T14:34:47.642 INFO:teuthology.orchestra.run.smithi072.stdout: mon warn on too few osds = false 2023-07-25T14:34:47.642 INFO:teuthology.orchestra.run.smithi072.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-07-25T14:34:47.643 INFO:teuthology.orchestra.run.smithi072.stdout: mon_warn_on_pool_no_redundancy = false 2023-07-25T14:34:47.643 INFO:teuthology.orchestra.run.smithi072.stdout: mon_allow_pool_size_one = true 2023-07-25T14:34:47.644 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-25T14:34:47.644 INFO:teuthology.orchestra.run.smithi072.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-07-25T14:34:47.644 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-25T14:34:47.644 INFO:teuthology.orchestra.run.smithi072.stdout: osd default data pool replay window = 5 2023-07-25T14:34:47.645 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-25T14:34:47.645 INFO:teuthology.orchestra.run.smithi072.stdout: mon allow pool delete = true 2023-07-25T14:34:47.645 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-25T14:34:47.645 INFO:teuthology.orchestra.run.smithi072.stdout: mon cluster log file level = debug 2023-07-25T14:34:47.646 INFO:teuthology.orchestra.run.smithi072.stdout: debug asserts on shutdown = true 2023-07-25T14:34:47.646 INFO:teuthology.orchestra.run.smithi072.stdout: mon health detail to clog = false 2023-07-25T14:34:47.646 INFO:teuthology.orchestra.run.smithi072.stdout: mon host = "172.21.15.72,172.21.15.92,[v2:172.21.15.92:3301,v1:172.21.15.92:6790]" 2023-07-25T14:34:47.646 INFO:teuthology.orchestra.run.smithi072.stdout: ms die on skipped message = False 2023-07-25T14:34:47.647 INFO:teuthology.orchestra.run.smithi072.stdout: fsid = 9170db48-9170-43e8-8ccb-9813e6240906 2023-07-25T14:34:47.647 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-25T14:34:47.647 INFO:teuthology.orchestra.run.smithi072.stdout:[osd] 2023-07-25T14:34:47.647 INFO:teuthology.orchestra.run.smithi072.stdout: osd journal size = 100 2023-07-25T14:34:47.648 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-25T14:34:47.648 INFO:teuthology.orchestra.run.smithi072.stdout: osd scrub load threshold = 5.0 2023-07-25T14:34:47.648 INFO:teuthology.orchestra.run.smithi072.stdout: osd scrub max interval = 600 2023-07-25T14:34:47.648 INFO:teuthology.orchestra.run.smithi072.stdout: osd mclock profile = high_recovery_ops 2023-07-25T14:34:47.649 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-25T14:34:47.649 INFO:teuthology.orchestra.run.smithi072.stdout: osd recover clone overlap = true 2023-07-25T14:34:47.649 INFO:teuthology.orchestra.run.smithi072.stdout: osd recovery max chunk = 1048576 2023-07-25T14:34:47.650 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-25T14:34:47.650 INFO:teuthology.orchestra.run.smithi072.stdout: osd debug shutdown = true 2023-07-25T14:34:47.650 INFO:teuthology.orchestra.run.smithi072.stdout: osd debug op order = true 2023-07-25T14:34:47.650 INFO:teuthology.orchestra.run.smithi072.stdout: osd debug verify stray on activate = true 2023-07-25T14:34:47.651 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-25T14:34:47.651 INFO:teuthology.orchestra.run.smithi072.stdout: osd open classes on start = true 2023-07-25T14:34:47.651 INFO:teuthology.orchestra.run.smithi072.stdout: osd debug pg log writeout = true 2023-07-25T14:34:47.651 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-25T14:34:47.652 INFO:teuthology.orchestra.run.smithi072.stdout: osd deep scrub update digest min age = 30 2023-07-25T14:34:47.652 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-25T14:34:47.652 INFO:teuthology.orchestra.run.smithi072.stdout: osd map max advance = 10 2023-07-25T14:34:47.652 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-25T14:34:47.653 INFO:teuthology.orchestra.run.smithi072.stdout: journal zero on create = true 2023-07-25T14:34:47.653 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-25T14:34:47.653 INFO:teuthology.orchestra.run.smithi072.stdout: filestore ondisk finisher threads = 3 2023-07-25T14:34:47.653 INFO:teuthology.orchestra.run.smithi072.stdout: filestore apply finisher threads = 3 2023-07-25T14:34:47.654 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-25T14:34:47.654 INFO:teuthology.orchestra.run.smithi072.stdout: bdev debug aio = true 2023-07-25T14:34:47.654 INFO:teuthology.orchestra.run.smithi072.stdout: osd debug misdirected ops = true 2023-07-25T14:34:47.655 INFO:teuthology.orchestra.run.smithi072.stdout: bluestore block size = 96636764160 2023-07-25T14:34:47.655 INFO:teuthology.orchestra.run.smithi072.stdout: bluestore compression mode = aggressive 2023-07-25T14:34:47.655 INFO:teuthology.orchestra.run.smithi072.stdout: bluestore fsck on mount = True 2023-07-25T14:34:47.655 INFO:teuthology.orchestra.run.smithi072.stdout: debug bluefs = 20 2023-07-25T14:34:47.656 INFO:teuthology.orchestra.run.smithi072.stdout: debug bluestore = 20 2023-07-25T14:34:47.656 INFO:teuthology.orchestra.run.smithi072.stdout: debug ms = 1 2023-07-25T14:34:47.656 INFO:teuthology.orchestra.run.smithi072.stdout: debug osd = 20 2023-07-25T14:34:47.656 INFO:teuthology.orchestra.run.smithi072.stdout: debug rocksdb = 10 2023-07-25T14:34:47.657 INFO:teuthology.orchestra.run.smithi072.stdout: mon osd backfillfull_ratio = 0.85 2023-07-25T14:34:47.657 INFO:teuthology.orchestra.run.smithi072.stdout: mon osd full ratio = 0.9 2023-07-25T14:34:47.657 INFO:teuthology.orchestra.run.smithi072.stdout: mon osd nearfull ratio = 0.8 2023-07-25T14:34:47.658 INFO:teuthology.orchestra.run.smithi072.stdout: osd failsafe full ratio = 0.95 2023-07-25T14:34:47.658 INFO:teuthology.orchestra.run.smithi072.stdout: osd objectstore = bluestore 2023-07-25T14:34:47.658 INFO:teuthology.orchestra.run.smithi072.stdout: osd op complaint time = 180 2023-07-25T14:34:47.658 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-25T14:34:47.658 INFO:teuthology.orchestra.run.smithi072.stdout:[mgr] 2023-07-25T14:34:47.659 INFO:teuthology.orchestra.run.smithi072.stdout: debug ms = 1 2023-07-25T14:34:47.659 INFO:teuthology.orchestra.run.smithi072.stdout: debug mgr = 20 2023-07-25T14:34:47.659 INFO:teuthology.orchestra.run.smithi072.stdout: debug mon = 20 2023-07-25T14:34:47.659 INFO:teuthology.orchestra.run.smithi072.stdout: debug auth = 20 2023-07-25T14:34:47.660 INFO:teuthology.orchestra.run.smithi072.stdout: mon reweight min pgs per osd = 4 2023-07-25T14:34:47.660 INFO:teuthology.orchestra.run.smithi072.stdout: mon reweight min bytes per osd = 10 2023-07-25T14:34:47.660 INFO:teuthology.orchestra.run.smithi072.stdout: mgr/telemetry/nag = false 2023-07-25T14:34:47.661 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-25T14:34:47.661 INFO:teuthology.orchestra.run.smithi072.stdout:[mon] 2023-07-25T14:34:47.661 INFO:teuthology.orchestra.run.smithi072.stdout: debug ms = 1 2023-07-25T14:34:47.661 INFO:teuthology.orchestra.run.smithi072.stdout: debug mon = 20 2023-07-25T14:34:47.662 INFO:teuthology.orchestra.run.smithi072.stdout: debug paxos = 20 2023-07-25T14:34:47.662 INFO:teuthology.orchestra.run.smithi072.stdout: debug auth = 20 2023-07-25T14:34:47.662 INFO:teuthology.orchestra.run.smithi072.stdout: mon data avail warn = 5 2023-07-25T14:34:47.662 INFO:teuthology.orchestra.run.smithi072.stdout: mon mgr mkfs grace = 240 2023-07-25T14:34:47.663 INFO:teuthology.orchestra.run.smithi072.stdout: mon reweight min pgs per osd = 4 2023-07-25T14:34:47.663 INFO:teuthology.orchestra.run.smithi072.stdout: mon osd reporter subtree level = osd 2023-07-25T14:34:47.663 INFO:teuthology.orchestra.run.smithi072.stdout: mon osd prime pg temp = true 2023-07-25T14:34:47.663 INFO:teuthology.orchestra.run.smithi072.stdout: mon reweight min bytes per osd = 10 2023-07-25T14:34:47.664 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-25T14:34:47.664 INFO:teuthology.orchestra.run.smithi072.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-07-25T14:34:47.664 INFO:teuthology.orchestra.run.smithi072.stdout: auth mon ticket ttl = 660 # 11m 2023-07-25T14:34:47.665 INFO:teuthology.orchestra.run.smithi072.stdout: auth service ticket ttl = 240 # 4m 2023-07-25T14:34:47.665 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-25T14:34:47.665 INFO:teuthology.orchestra.run.smithi072.stdout: # don't complain about insecure global_id in the test suite 2023-07-25T14:34:47.665 INFO:teuthology.orchestra.run.smithi072.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-07-25T14:34:47.666 INFO:teuthology.orchestra.run.smithi072.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-07-25T14:34:47.666 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-25T14:34:47.666 INFO:teuthology.orchestra.run.smithi072.stdout: # 1m isn't quite enough 2023-07-25T14:34:47.666 INFO:teuthology.orchestra.run.smithi072.stdout: mon_down_mkfs_grace = 2m 2023-07-25T14:34:47.666 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-25T14:34:47.667 INFO:teuthology.orchestra.run.smithi072.stdout: mon_warn_on_filestore_osds = false 2023-07-25T14:34:47.667 INFO:teuthology.orchestra.run.smithi072.stdout: mon op complaint time = 120 2023-07-25T14:34:47.667 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-25T14:34:47.667 INFO:teuthology.orchestra.run.smithi072.stdout:[client] 2023-07-25T14:34:47.667 INFO:teuthology.orchestra.run.smithi072.stdout: rgw cache enabled = true 2023-07-25T14:34:47.667 INFO:teuthology.orchestra.run.smithi072.stdout: rgw enable ops log = true 2023-07-25T14:34:47.667 INFO:teuthology.orchestra.run.smithi072.stdout: rgw enable usage log = true 2023-07-25T14:34:47.668 INFO:teuthology.orchestra.run.smithi072.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-07-25T14:34:47.668 INFO:teuthology.orchestra.run.smithi072.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-07-25T14:34:47.668 INFO:teuthology.orchestra.run.smithi072.stdout: client mount timeout = 600 2023-07-25T14:34:47.668 INFO:teuthology.orchestra.run.smithi072.stdout: debug client = 20 2023-07-25T14:34:47.668 INFO:teuthology.orchestra.run.smithi072.stdout: debug ms = 1 2023-07-25T14:34:47.668 INFO:teuthology.orchestra.run.smithi072.stdout: rados mon op timeout = 900 2023-07-25T14:34:47.668 INFO:teuthology.orchestra.run.smithi072.stdout: rados osd op timeout = 900 2023-07-25T14:34:47.668 INFO:teuthology.orchestra.run.smithi072.stdout:[mon.a] 2023-07-25T14:34:47.669 INFO:teuthology.orchestra.run.smithi072.stdout:[mon.b] 2023-07-25T14:34:47.669 INFO:teuthology.orchestra.run.smithi072.stdout:[mon.c] 2023-07-25T14:34:47.669 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.a] 2023-07-25T14:34:47.669 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.c] 2023-07-25T14:34:47.669 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.b] 2023-07-25T14:34:47.669 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.d] 2023-07-25T14:34:47.669 INFO:teuthology.orchestra.run.smithi072.stdout:[mds] 2023-07-25T14:34:47.670 INFO:teuthology.orchestra.run.smithi072.stdout: debug mds = 20 2023-07-25T14:34:47.670 INFO:teuthology.orchestra.run.smithi072.stdout: debug mds balancer = 20 2023-07-25T14:34:47.670 INFO:teuthology.orchestra.run.smithi072.stdout: debug ms = 1 2023-07-25T14:34:47.670 INFO:teuthology.orchestra.run.smithi072.stdout: mds debug frag = True 2023-07-25T14:34:47.670 INFO:teuthology.orchestra.run.smithi072.stdout: mds debug scatterstat = True 2023-07-25T14:34:47.670 INFO:teuthology.orchestra.run.smithi072.stdout: mds op complaint time = 180 2023-07-25T14:34:47.670 INFO:teuthology.orchestra.run.smithi072.stdout: mds verify scatter = True 2023-07-25T14:34:47.670 INFO:teuthology.orchestra.run.smithi072.stdout: osd op complaint time = 180 2023-07-25T14:34:47.671 INFO:teuthology.orchestra.run.smithi072.stdout: rados mon op timeout = 900 2023-07-25T14:34:47.671 INFO:teuthology.orchestra.run.smithi072.stdout: rados osd op timeout = 900 2023-07-25T14:34:47.672 INFO:teuthology.orchestra.run.smithi092.stdout:[global] 2023-07-25T14:34:47.672 INFO:teuthology.orchestra.run.smithi092.stdout: chdir = "" 2023-07-25T14:34:47.672 INFO:teuthology.orchestra.run.smithi092.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-07-25T14:34:47.673 INFO:teuthology.orchestra.run.smithi092.stdout: auth supported = cephx 2023-07-25T14:34:47.673 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-07-25T14:34:47.673 INFO:teuthology.orchestra.run.smithi092.stdout: filestore xattr use omap = true 2023-07-25T14:34:47.673 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-07-25T14:34:47.673 INFO:teuthology.orchestra.run.smithi092.stdout: mon clock drift allowed = 1.000 2023-07-25T14:34:47.673 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-07-25T14:34:47.673 INFO:teuthology.orchestra.run.smithi092.stdout: osd crush chooseleaf type = 0 2023-07-25T14:34:47.673 INFO:teuthology.orchestra.run.smithi092.stdout: auth debug = true 2023-07-25T14:34:47.674 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-07-25T14:34:47.674 INFO:teuthology.orchestra.run.smithi092.stdout: ms die on old message = true 2023-07-25T14:34:47.674 INFO:teuthology.orchestra.run.smithi092.stdout: ms die on bug = true 2023-07-25T14:34:47.674 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-07-25T14:34:47.674 INFO:teuthology.orchestra.run.smithi092.stdout: mon max pg per osd = 10000 # >= luminous 2023-07-25T14:34:47.674 INFO:teuthology.orchestra.run.smithi092.stdout: mon pg warn max object skew = 0 2023-07-25T14:34:47.674 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-07-25T14:34:47.674 INFO:teuthology.orchestra.run.smithi092.stdout: # disable pg_autoscaler by default for new pools 2023-07-25T14:34:47.675 INFO:teuthology.orchestra.run.smithi092.stdout: osd_pool_default_pg_autoscale_mode = off 2023-07-25T14:34:47.675 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-07-25T14:34:47.675 INFO:teuthology.orchestra.run.smithi092.stdout: osd pool default size = 2 2023-07-25T14:34:47.675 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-07-25T14:34:47.675 INFO:teuthology.orchestra.run.smithi092.stdout: mon osd allow primary affinity = true 2023-07-25T14:34:47.675 INFO:teuthology.orchestra.run.smithi092.stdout: mon osd allow pg remap = true 2023-07-25T14:34:47.675 INFO:teuthology.orchestra.run.smithi092.stdout: mon warn on legacy crush tunables = false 2023-07-25T14:34:47.675 INFO:teuthology.orchestra.run.smithi092.stdout: mon warn on crush straw calc version zero = false 2023-07-25T14:34:47.676 INFO:teuthology.orchestra.run.smithi092.stdout: mon warn on no sortbitwise = false 2023-07-25T14:34:47.676 INFO:teuthology.orchestra.run.smithi092.stdout: mon warn on osd down out interval zero = false 2023-07-25T14:34:47.676 INFO:teuthology.orchestra.run.smithi092.stdout: mon warn on too few osds = false 2023-07-25T14:34:47.676 INFO:teuthology.orchestra.run.smithi092.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-07-25T14:34:47.676 INFO:teuthology.orchestra.run.smithi092.stdout: mon_warn_on_pool_no_redundancy = false 2023-07-25T14:34:47.676 INFO:teuthology.orchestra.run.smithi092.stdout: mon_allow_pool_size_one = true 2023-07-25T14:34:47.676 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-07-25T14:34:47.677 INFO:teuthology.orchestra.run.smithi092.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-07-25T14:34:47.677 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-07-25T14:34:47.677 INFO:teuthology.orchestra.run.smithi092.stdout: osd default data pool replay window = 5 2023-07-25T14:34:47.677 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-07-25T14:34:47.677 INFO:teuthology.orchestra.run.smithi092.stdout: mon allow pool delete = true 2023-07-25T14:34:47.677 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-07-25T14:34:47.677 INFO:teuthology.orchestra.run.smithi092.stdout: mon cluster log file level = debug 2023-07-25T14:34:47.677 INFO:teuthology.orchestra.run.smithi092.stdout: debug asserts on shutdown = true 2023-07-25T14:34:47.678 INFO:teuthology.orchestra.run.smithi092.stdout: mon health detail to clog = false 2023-07-25T14:34:47.678 INFO:teuthology.orchestra.run.smithi092.stdout: mon host = "172.21.15.72,172.21.15.92,[v2:172.21.15.92:3301,v1:172.21.15.92:6790]" 2023-07-25T14:34:47.678 INFO:teuthology.orchestra.run.smithi092.stdout: ms die on skipped message = False 2023-07-25T14:34:47.678 INFO:teuthology.orchestra.run.smithi092.stdout: fsid = 9170db48-9170-43e8-8ccb-9813e6240906 2023-07-25T14:34:47.678 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-07-25T14:34:47.678 INFO:teuthology.orchestra.run.smithi092.stdout:[osd] 2023-07-25T14:34:47.678 INFO:teuthology.orchestra.run.smithi092.stdout: osd journal size = 100 2023-07-25T14:34:47.678 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-07-25T14:34:47.679 INFO:teuthology.orchestra.run.smithi092.stdout: osd scrub load threshold = 5.0 2023-07-25T14:34:47.679 INFO:teuthology.orchestra.run.smithi092.stdout: osd scrub max interval = 600 2023-07-25T14:34:47.679 INFO:teuthology.orchestra.run.smithi092.stdout: osd mclock profile = high_recovery_ops 2023-07-25T14:34:47.679 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-07-25T14:34:47.679 INFO:teuthology.orchestra.run.smithi092.stdout: osd recover clone overlap = true 2023-07-25T14:34:47.679 INFO:teuthology.orchestra.run.smithi092.stdout: osd recovery max chunk = 1048576 2023-07-25T14:34:47.679 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-07-25T14:34:47.679 INFO:teuthology.orchestra.run.smithi092.stdout: osd debug shutdown = true 2023-07-25T14:34:47.680 INFO:teuthology.orchestra.run.smithi092.stdout: osd debug op order = true 2023-07-25T14:34:47.680 INFO:teuthology.orchestra.run.smithi092.stdout: osd debug verify stray on activate = true 2023-07-25T14:34:47.680 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-07-25T14:34:47.680 INFO:teuthology.orchestra.run.smithi092.stdout: osd open classes on start = true 2023-07-25T14:34:47.680 INFO:teuthology.orchestra.run.smithi092.stdout: osd debug pg log writeout = true 2023-07-25T14:34:47.680 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-07-25T14:34:47.680 INFO:teuthology.orchestra.run.smithi092.stdout: osd deep scrub update digest min age = 30 2023-07-25T14:34:47.681 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-07-25T14:34:47.681 INFO:teuthology.orchestra.run.smithi092.stdout: osd map max advance = 10 2023-07-25T14:34:47.681 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-07-25T14:34:47.681 INFO:teuthology.orchestra.run.smithi092.stdout: journal zero on create = true 2023-07-25T14:34:47.681 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-07-25T14:34:47.681 INFO:teuthology.orchestra.run.smithi092.stdout: filestore ondisk finisher threads = 3 2023-07-25T14:34:47.681 INFO:teuthology.orchestra.run.smithi092.stdout: filestore apply finisher threads = 3 2023-07-25T14:34:47.681 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-07-25T14:34:47.682 INFO:teuthology.orchestra.run.smithi092.stdout: bdev debug aio = true 2023-07-25T14:34:47.682 INFO:teuthology.orchestra.run.smithi092.stdout: osd debug misdirected ops = true 2023-07-25T14:34:47.682 INFO:teuthology.orchestra.run.smithi092.stdout: bluestore block size = 96636764160 2023-07-25T14:34:47.682 INFO:teuthology.orchestra.run.smithi092.stdout: bluestore compression mode = aggressive 2023-07-25T14:34:47.682 INFO:teuthology.orchestra.run.smithi092.stdout: bluestore fsck on mount = True 2023-07-25T14:34:47.682 INFO:teuthology.orchestra.run.smithi092.stdout: debug bluefs = 20 2023-07-25T14:34:47.682 INFO:teuthology.orchestra.run.smithi092.stdout: debug bluestore = 20 2023-07-25T14:34:47.682 INFO:teuthology.orchestra.run.smithi092.stdout: debug ms = 1 2023-07-25T14:34:47.683 INFO:teuthology.orchestra.run.smithi092.stdout: debug osd = 20 2023-07-25T14:34:47.683 INFO:teuthology.orchestra.run.smithi092.stdout: debug rocksdb = 10 2023-07-25T14:34:47.683 INFO:teuthology.orchestra.run.smithi092.stdout: mon osd backfillfull_ratio = 0.85 2023-07-25T14:34:47.683 INFO:teuthology.orchestra.run.smithi092.stdout: mon osd full ratio = 0.9 2023-07-25T14:34:47.683 INFO:teuthology.orchestra.run.smithi092.stdout: mon osd nearfull ratio = 0.8 2023-07-25T14:34:47.683 INFO:teuthology.orchestra.run.smithi092.stdout: osd failsafe full ratio = 0.95 2023-07-25T14:34:47.683 INFO:teuthology.orchestra.run.smithi092.stdout: osd objectstore = bluestore 2023-07-25T14:34:47.683 INFO:teuthology.orchestra.run.smithi092.stdout: osd op complaint time = 180 2023-07-25T14:34:47.684 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-07-25T14:34:47.684 INFO:teuthology.orchestra.run.smithi092.stdout:[mgr] 2023-07-25T14:34:47.684 INFO:teuthology.orchestra.run.smithi092.stdout: debug ms = 1 2023-07-25T14:34:47.684 INFO:teuthology.orchestra.run.smithi092.stdout: debug mgr = 20 2023-07-25T14:34:47.684 INFO:teuthology.orchestra.run.smithi092.stdout: debug mon = 20 2023-07-25T14:34:47.684 INFO:teuthology.orchestra.run.smithi092.stdout: debug auth = 20 2023-07-25T14:34:47.684 INFO:teuthology.orchestra.run.smithi092.stdout: mon reweight min pgs per osd = 4 2023-07-25T14:34:47.684 INFO:teuthology.orchestra.run.smithi092.stdout: mon reweight min bytes per osd = 10 2023-07-25T14:34:47.685 INFO:teuthology.orchestra.run.smithi092.stdout: mgr/telemetry/nag = false 2023-07-25T14:34:47.685 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-07-25T14:34:47.685 INFO:teuthology.orchestra.run.smithi092.stdout:[mon] 2023-07-25T14:34:47.685 INFO:teuthology.orchestra.run.smithi092.stdout: debug ms = 1 2023-07-25T14:34:47.685 INFO:teuthology.orchestra.run.smithi092.stdout: debug mon = 20 2023-07-25T14:34:47.685 INFO:teuthology.orchestra.run.smithi092.stdout: debug paxos = 20 2023-07-25T14:34:47.685 INFO:teuthology.orchestra.run.smithi092.stdout: debug auth = 20 2023-07-25T14:34:47.685 INFO:teuthology.orchestra.run.smithi092.stdout: mon data avail warn = 5 2023-07-25T14:34:47.686 INFO:teuthology.orchestra.run.smithi092.stdout: mon mgr mkfs grace = 240 2023-07-25T14:34:47.686 INFO:teuthology.orchestra.run.smithi092.stdout: mon reweight min pgs per osd = 4 2023-07-25T14:34:47.686 INFO:teuthology.orchestra.run.smithi092.stdout: mon osd reporter subtree level = osd 2023-07-25T14:34:47.686 INFO:teuthology.orchestra.run.smithi092.stdout: mon osd prime pg temp = true 2023-07-25T14:34:47.686 INFO:teuthology.orchestra.run.smithi092.stdout: mon reweight min bytes per osd = 10 2023-07-25T14:34:47.686 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-07-25T14:34:47.686 INFO:teuthology.orchestra.run.smithi092.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-07-25T14:34:47.686 INFO:teuthology.orchestra.run.smithi092.stdout: auth mon ticket ttl = 660 # 11m 2023-07-25T14:34:47.687 INFO:teuthology.orchestra.run.smithi092.stdout: auth service ticket ttl = 240 # 4m 2023-07-25T14:34:47.687 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-07-25T14:34:47.687 INFO:teuthology.orchestra.run.smithi092.stdout: # don't complain about insecure global_id in the test suite 2023-07-25T14:34:47.687 INFO:teuthology.orchestra.run.smithi092.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-07-25T14:34:47.687 INFO:teuthology.orchestra.run.smithi092.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-07-25T14:34:47.687 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-07-25T14:34:47.687 INFO:teuthology.orchestra.run.smithi092.stdout: # 1m isn't quite enough 2023-07-25T14:34:47.688 INFO:teuthology.orchestra.run.smithi092.stdout: mon_down_mkfs_grace = 2m 2023-07-25T14:34:47.688 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-07-25T14:34:47.688 INFO:teuthology.orchestra.run.smithi092.stdout: mon_warn_on_filestore_osds = false 2023-07-25T14:34:47.688 INFO:teuthology.orchestra.run.smithi092.stdout: mon op complaint time = 120 2023-07-25T14:34:47.688 INFO:teuthology.orchestra.run.smithi092.stdout: 2023-07-25T14:34:47.688 INFO:teuthology.orchestra.run.smithi092.stdout:[client] 2023-07-25T14:34:47.688 INFO:teuthology.orchestra.run.smithi092.stdout: rgw cache enabled = true 2023-07-25T14:34:47.688 INFO:teuthology.orchestra.run.smithi092.stdout: rgw enable ops log = true 2023-07-25T14:34:47.689 INFO:teuthology.orchestra.run.smithi092.stdout: rgw enable usage log = true 2023-07-25T14:34:47.689 INFO:teuthology.orchestra.run.smithi092.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-07-25T14:34:47.689 INFO:teuthology.orchestra.run.smithi092.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-07-25T14:34:47.689 INFO:teuthology.orchestra.run.smithi092.stdout: client mount timeout = 600 2023-07-25T14:34:47.689 INFO:teuthology.orchestra.run.smithi092.stdout: debug client = 20 2023-07-25T14:34:47.689 INFO:teuthology.orchestra.run.smithi092.stdout: debug ms = 1 2023-07-25T14:34:47.689 INFO:teuthology.orchestra.run.smithi092.stdout: rados mon op timeout = 900 2023-07-25T14:34:47.689 INFO:teuthology.orchestra.run.smithi092.stdout: rados osd op timeout = 900 2023-07-25T14:34:47.690 INFO:teuthology.orchestra.run.smithi092.stdout:[mon.a] 2023-07-25T14:34:47.690 INFO:teuthology.orchestra.run.smithi092.stdout:[mon.b] 2023-07-25T14:34:47.690 INFO:teuthology.orchestra.run.smithi092.stdout:[mon.c] 2023-07-25T14:34:47.690 INFO:teuthology.orchestra.run.smithi092.stdout:[mds.a] 2023-07-25T14:34:47.690 INFO:teuthology.orchestra.run.smithi092.stdout:[mds.c] 2023-07-25T14:34:47.690 INFO:teuthology.orchestra.run.smithi092.stdout:[mds.b] 2023-07-25T14:34:47.690 INFO:teuthology.orchestra.run.smithi092.stdout:[mds.d] 2023-07-25T14:34:47.690 INFO:teuthology.orchestra.run.smithi092.stdout:[mds] 2023-07-25T14:34:47.691 INFO:teuthology.orchestra.run.smithi092.stdout: debug mds = 20 2023-07-25T14:34:47.691 INFO:teuthology.orchestra.run.smithi092.stdout: debug mds balancer = 20 2023-07-25T14:34:47.691 INFO:teuthology.orchestra.run.smithi092.stdout: debug ms = 1 2023-07-25T14:34:47.691 INFO:teuthology.orchestra.run.smithi092.stdout: mds debug frag = True 2023-07-25T14:34:47.691 INFO:teuthology.orchestra.run.smithi092.stdout: mds debug scatterstat = True 2023-07-25T14:34:47.691 INFO:teuthology.orchestra.run.smithi092.stdout: mds op complaint time = 180 2023-07-25T14:34:47.691 INFO:teuthology.orchestra.run.smithi092.stdout: mds verify scatter = True 2023-07-25T14:34:47.691 INFO:teuthology.orchestra.run.smithi092.stdout: osd op complaint time = 180 2023-07-25T14:34:47.692 INFO:teuthology.orchestra.run.smithi092.stdout: rados mon op timeout = 900 2023-07-25T14:34:47.692 INFO:teuthology.orchestra.run.smithi092.stdout: rados osd op timeout = 900 2023-07-25T14:34:47.692 INFO:tasks.ceph:Creating admin key on mon.a... 2023-07-25T14:34:47.692 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-07-25T14:34:47.769 INFO:tasks.ceph:Copying monmap to all nodes... 2023-07-25T14:34:47.769 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-07-25T14:34:47.770 DEBUG:teuthology.orchestra.run.smithi072:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-07-25T14:34:47.786 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-07-25T14:34:47.786 DEBUG:teuthology.orchestra.run.smithi072:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-07-25T14:34:47.845 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi072.front.sepia.ceph.com 2023-07-25T14:34:47.845 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-07-25T14:34:47.846 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd of=/etc/ceph/ceph.keyring 2023-07-25T14:34:47.847 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-07-25T14:34:47.922 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-07-25T14:34:47.922 DEBUG:teuthology.orchestra.run.smithi072:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-07-25T14:34:47.978 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi092.front.sepia.ceph.com 2023-07-25T14:34:47.979 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-07-25T14:34:47.979 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd of=/etc/ceph/ceph.keyring 2023-07-25T14:34:47.979 DEBUG:teuthology.orchestra.run.smithi092:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-07-25T14:34:48.023 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-07-25T14:34:48.024 DEBUG:teuthology.orchestra.run.smithi092:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-07-25T14:34:48.084 INFO:tasks.ceph:Setting up mon nodes... 2023-07-25T14:34:48.084 INFO:tasks.ceph:Setting up mgr nodes... 2023-07-25T14:34:48.085 DEBUG:teuthology.orchestra.run.smithi072:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-07-25T14:34:48.138 INFO:teuthology.orchestra.run.smithi072.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-07-25T14:34:48.140 DEBUG:teuthology.orchestra.run.smithi092:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-07-25T14:34:48.224 INFO:teuthology.orchestra.run.smithi092.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-07-25T14:34:48.227 INFO:tasks.ceph:Setting up mds nodes... 2023-07-25T14:34:48.227 DEBUG:teuthology.orchestra.run.smithi072:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-07-25T14:34:48.280 INFO:teuthology.orchestra.run.smithi072.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-07-25T14:34:48.283 DEBUG:teuthology.orchestra.run.smithi072:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-07-25T14:34:48.308 DEBUG:teuthology.orchestra.run.smithi072:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-07-25T14:34:48.401 INFO:teuthology.orchestra.run.smithi072.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-07-25T14:34:48.403 DEBUG:teuthology.orchestra.run.smithi072:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-07-25T14:34:48.429 DEBUG:teuthology.orchestra.run.smithi092:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-07-25T14:34:48.486 INFO:teuthology.orchestra.run.smithi092.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-07-25T14:34:48.489 DEBUG:teuthology.orchestra.run.smithi092:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-07-25T14:34:48.516 DEBUG:teuthology.orchestra.run.smithi092:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-07-25T14:34:48.610 INFO:teuthology.orchestra.run.smithi092.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-07-25T14:34:48.612 DEBUG:teuthology.orchestra.run.smithi092:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-07-25T14:34:48.638 INFO:tasks.ceph_client:Setting up client nodes... 2023-07-25T14:34:48.638 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-07-25T14:34:48.681 INFO:teuthology.orchestra.run.smithi072.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-07-25T14:34:48.694 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-07-25T14:34:48.736 INFO:teuthology.orchestra.run.smithi092.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-07-25T14:34:48.749 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-07-25T14:34:48.749 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi072.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi092.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-07-25T14:34:48.749 DEBUG:teuthology.orchestra.run.smithi072:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-07-25T14:34:48.775 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-07-25T14:34:48.776 INFO:tasks.ceph:role: osd.0 2023-07-25T14:34:48.776 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi072.front.sepia.ceph.com 2023-07-25T14:34:48.776 DEBUG:teuthology.orchestra.run.smithi072:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-07-25T14:34:48.848 INFO:teuthology.orchestra.run.smithi072.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-07-25T14:34:48.848 INFO:teuthology.orchestra.run.smithi072.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-25T14:34:48.849 INFO:teuthology.orchestra.run.smithi072.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-25T14:34:48.849 INFO:teuthology.orchestra.run.smithi072.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-25T14:34:48.849 INFO:teuthology.orchestra.run.smithi072.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-25T14:34:48.849 INFO:teuthology.orchestra.run.smithi072.stdout: = sunit=0 swidth=0 blks 2023-07-25T14:34:48.849 INFO:teuthology.orchestra.run.smithi072.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-25T14:34:48.849 INFO:teuthology.orchestra.run.smithi072.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-25T14:34:48.849 INFO:teuthology.orchestra.run.smithi072.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-25T14:34:48.850 INFO:teuthology.orchestra.run.smithi072.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-25T14:34:49.285 INFO:teuthology.orchestra.run.smithi072.stdout:Discarding blocks...Done. 2023-07-25T14:34:49.287 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi072.front.sepia.ceph.com -o noatime 2023-07-25T14:34:49.287 DEBUG:teuthology.orchestra.run.smithi072:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-07-25T14:34:49.464 DEBUG:teuthology.orchestra.run.smithi072:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-07-25T14:34:49.500 DEBUG:teuthology.orchestra.run.smithi072:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-07-25T14:34:49.567 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-07-25T14:34:49.567 INFO:tasks.ceph:role: osd.1 2023-07-25T14:34:49.568 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi072.front.sepia.ceph.com 2023-07-25T14:34:49.568 DEBUG:teuthology.orchestra.run.smithi072:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-07-25T14:34:49.640 INFO:teuthology.orchestra.run.smithi072.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-07-25T14:34:49.641 INFO:teuthology.orchestra.run.smithi072.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-25T14:34:49.641 INFO:teuthology.orchestra.run.smithi072.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-25T14:34:49.641 INFO:teuthology.orchestra.run.smithi072.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-25T14:34:49.641 INFO:teuthology.orchestra.run.smithi072.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-25T14:34:49.641 INFO:teuthology.orchestra.run.smithi072.stdout: = sunit=0 swidth=0 blks 2023-07-25T14:34:49.641 INFO:teuthology.orchestra.run.smithi072.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-25T14:34:49.642 INFO:teuthology.orchestra.run.smithi072.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-25T14:34:49.642 INFO:teuthology.orchestra.run.smithi072.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-25T14:34:49.642 INFO:teuthology.orchestra.run.smithi072.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-25T14:34:50.067 INFO:teuthology.orchestra.run.smithi072.stdout:Discarding blocks...Done. 2023-07-25T14:34:50.068 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi072.front.sepia.ceph.com -o noatime 2023-07-25T14:34:50.069 DEBUG:teuthology.orchestra.run.smithi072:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-07-25T14:34:50.178 DEBUG:teuthology.orchestra.run.smithi072:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-07-25T14:34:50.207 DEBUG:teuthology.orchestra.run.smithi072:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-07-25T14:34:50.273 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-07-25T14:34:50.274 INFO:tasks.ceph:role: osd.2 2023-07-25T14:34:50.274 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi072.front.sepia.ceph.com 2023-07-25T14:34:50.274 DEBUG:teuthology.orchestra.run.smithi072:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-07-25T14:34:50.353 INFO:teuthology.orchestra.run.smithi072.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-07-25T14:34:50.354 INFO:teuthology.orchestra.run.smithi072.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-25T14:34:50.354 INFO:teuthology.orchestra.run.smithi072.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-25T14:34:50.354 INFO:teuthology.orchestra.run.smithi072.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-25T14:34:50.354 INFO:teuthology.orchestra.run.smithi072.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-25T14:34:50.354 INFO:teuthology.orchestra.run.smithi072.stdout: = sunit=0 swidth=0 blks 2023-07-25T14:34:50.354 INFO:teuthology.orchestra.run.smithi072.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-25T14:34:50.354 INFO:teuthology.orchestra.run.smithi072.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-25T14:34:50.355 INFO:teuthology.orchestra.run.smithi072.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-25T14:34:50.355 INFO:teuthology.orchestra.run.smithi072.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-25T14:34:50.791 INFO:teuthology.orchestra.run.smithi072.stdout:Discarding blocks...Done. 2023-07-25T14:34:50.792 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi072.front.sepia.ceph.com -o noatime 2023-07-25T14:34:50.793 DEBUG:teuthology.orchestra.run.smithi072:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-07-25T14:34:50.961 DEBUG:teuthology.orchestra.run.smithi072:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-07-25T14:34:50.994 DEBUG:teuthology.orchestra.run.smithi072:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-07-25T14:34:51.063 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-07-25T14:34:51.064 INFO:tasks.ceph:role: osd.3 2023-07-25T14:34:51.064 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi072.front.sepia.ceph.com 2023-07-25T14:34:51.065 DEBUG:teuthology.orchestra.run.smithi072:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-07-25T14:34:51.138 INFO:teuthology.orchestra.run.smithi072.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-07-25T14:34:51.138 INFO:teuthology.orchestra.run.smithi072.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-25T14:34:51.138 INFO:teuthology.orchestra.run.smithi072.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-25T14:34:51.138 INFO:teuthology.orchestra.run.smithi072.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-25T14:34:51.138 INFO:teuthology.orchestra.run.smithi072.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-25T14:34:51.139 INFO:teuthology.orchestra.run.smithi072.stdout: = sunit=0 swidth=0 blks 2023-07-25T14:34:51.139 INFO:teuthology.orchestra.run.smithi072.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-25T14:34:51.139 INFO:teuthology.orchestra.run.smithi072.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-25T14:34:51.139 INFO:teuthology.orchestra.run.smithi072.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-25T14:34:51.139 INFO:teuthology.orchestra.run.smithi072.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-25T14:34:51.583 INFO:teuthology.orchestra.run.smithi072.stdout:Discarding blocks...Done. 2023-07-25T14:34:51.584 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi072.front.sepia.ceph.com -o noatime 2023-07-25T14:34:51.585 DEBUG:teuthology.orchestra.run.smithi072:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-07-25T14:34:51.772 DEBUG:teuthology.orchestra.run.smithi072:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-07-25T14:34:51.810 DEBUG:teuthology.orchestra.run.smithi072:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-25T14:34:51.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:34:51.916+0000 7fb5c8433640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-07-25T14:34:51.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:34:51.917+0000 7fb5c8433640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-07-25T14:34:51.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:34:51.917+0000 7fb5c8433640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-07-25T14:34:51.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:34:51.917+0000 7fb5c8433640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-07-25T14:34:51.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:34:51.917+0000 7fb5c8433640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-07-25T14:34:51.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:34:51.917+0000 7fb5c8433640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-07-25T14:34:54.789 DEBUG:teuthology.orchestra.run.smithi072:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-07-25T14:34:54.820 DEBUG:teuthology.orchestra.run.smithi072:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-25T14:34:54.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:34:54.899+0000 7fef6164b640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-07-25T14:34:54.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:34:54.900+0000 7fef6164b640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-07-25T14:34:54.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:34:54.900+0000 7fef6164b640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-07-25T14:34:54.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:34:54.900+0000 7fef6164b640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-07-25T14:34:54.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:34:54.900+0000 7fef6164b640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-07-25T14:34:54.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:34:54.900+0000 7fef6164b640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-07-25T14:34:57.780 DEBUG:teuthology.orchestra.run.smithi072:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-07-25T14:34:57.810 DEBUG:teuthology.orchestra.run.smithi072:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-25T14:34:57.902 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:34:57.889+0000 7ffab229a640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-07-25T14:34:57.902 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:34:57.889+0000 7ffab229a640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-07-25T14:34:57.902 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:34:57.890+0000 7ffab229a640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-07-25T14:34:57.902 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:34:57.890+0000 7ffab229a640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-07-25T14:34:57.902 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:34:57.890+0000 7ffab229a640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-07-25T14:34:57.903 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:34:57.890+0000 7ffab229a640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-07-25T14:35:00.766 DEBUG:teuthology.orchestra.run.smithi072:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-07-25T14:35:00.797 DEBUG:teuthology.orchestra.run.smithi072:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-25T14:35:00.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:00.877+0000 7fd89cf0e640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-07-25T14:35:00.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:00.877+0000 7fd89cf0e640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-07-25T14:35:00.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:00.877+0000 7fd89cf0e640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-07-25T14:35:00.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:00.877+0000 7fd89cf0e640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-07-25T14:35:00.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:00.877+0000 7fd89cf0e640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-07-25T14:35:00.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:00.877+0000 7fd89cf0e640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-07-25T14:35:03.745 DEBUG:teuthology.orchestra.run.smithi072:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-07-25T14:35:03.776 DEBUG:teuthology.orchestra.run.smithi092:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-07-25T14:35:03.809 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-07-25T14:35:03.809 INFO:tasks.ceph:role: osd.4 2023-07-25T14:35:03.809 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi092.front.sepia.ceph.com 2023-07-25T14:35:03.810 DEBUG:teuthology.orchestra.run.smithi092:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-07-25T14:35:03.888 INFO:teuthology.orchestra.run.smithi092.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-07-25T14:35:03.888 INFO:teuthology.orchestra.run.smithi092.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-25T14:35:03.889 INFO:teuthology.orchestra.run.smithi092.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-25T14:35:03.889 INFO:teuthology.orchestra.run.smithi092.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-25T14:35:03.889 INFO:teuthology.orchestra.run.smithi092.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-25T14:35:03.889 INFO:teuthology.orchestra.run.smithi092.stdout: = sunit=0 swidth=0 blks 2023-07-25T14:35:03.889 INFO:teuthology.orchestra.run.smithi092.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-25T14:35:03.889 INFO:teuthology.orchestra.run.smithi092.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-25T14:35:03.889 INFO:teuthology.orchestra.run.smithi092.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-25T14:35:03.889 INFO:teuthology.orchestra.run.smithi092.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-25T14:35:04.320 INFO:teuthology.orchestra.run.smithi092.stdout:Discarding blocks...Done. 2023-07-25T14:35:04.321 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi092.front.sepia.ceph.com -o noatime 2023-07-25T14:35:04.322 DEBUG:teuthology.orchestra.run.smithi092:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-07-25T14:35:04.476 DEBUG:teuthology.orchestra.run.smithi092:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-07-25T14:35:04.514 DEBUG:teuthology.orchestra.run.smithi092:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-07-25T14:35:04.587 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-07-25T14:35:04.588 INFO:tasks.ceph:role: osd.5 2023-07-25T14:35:04.588 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi092.front.sepia.ceph.com 2023-07-25T14:35:04.588 DEBUG:teuthology.orchestra.run.smithi092:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-07-25T14:35:04.667 INFO:teuthology.orchestra.run.smithi092.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-07-25T14:35:04.667 INFO:teuthology.orchestra.run.smithi092.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-25T14:35:04.667 INFO:teuthology.orchestra.run.smithi092.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-25T14:35:04.668 INFO:teuthology.orchestra.run.smithi092.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-25T14:35:04.668 INFO:teuthology.orchestra.run.smithi092.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-25T14:35:04.668 INFO:teuthology.orchestra.run.smithi092.stdout: = sunit=0 swidth=0 blks 2023-07-25T14:35:04.668 INFO:teuthology.orchestra.run.smithi092.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-25T14:35:04.668 INFO:teuthology.orchestra.run.smithi092.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-25T14:35:04.668 INFO:teuthology.orchestra.run.smithi092.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-25T14:35:04.668 INFO:teuthology.orchestra.run.smithi092.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-25T14:35:05.088 INFO:teuthology.orchestra.run.smithi092.stdout:Discarding blocks...Done. 2023-07-25T14:35:05.089 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi092.front.sepia.ceph.com -o noatime 2023-07-25T14:35:05.090 DEBUG:teuthology.orchestra.run.smithi092:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-07-25T14:35:05.199 DEBUG:teuthology.orchestra.run.smithi092:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-07-25T14:35:05.236 DEBUG:teuthology.orchestra.run.smithi092:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-07-25T14:35:05.307 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-07-25T14:35:05.308 INFO:tasks.ceph:role: osd.6 2023-07-25T14:35:05.308 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi092.front.sepia.ceph.com 2023-07-25T14:35:05.308 DEBUG:teuthology.orchestra.run.smithi092:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-07-25T14:35:05.387 INFO:teuthology.orchestra.run.smithi092.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-07-25T14:35:05.387 INFO:teuthology.orchestra.run.smithi092.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-25T14:35:05.387 INFO:teuthology.orchestra.run.smithi092.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-25T14:35:05.388 INFO:teuthology.orchestra.run.smithi092.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-25T14:35:05.388 INFO:teuthology.orchestra.run.smithi092.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-25T14:35:05.388 INFO:teuthology.orchestra.run.smithi092.stdout: = sunit=0 swidth=0 blks 2023-07-25T14:35:05.388 INFO:teuthology.orchestra.run.smithi092.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-25T14:35:05.388 INFO:teuthology.orchestra.run.smithi092.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-25T14:35:05.388 INFO:teuthology.orchestra.run.smithi092.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-25T14:35:05.388 INFO:teuthology.orchestra.run.smithi092.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-25T14:35:05.850 INFO:teuthology.orchestra.run.smithi092.stdout:Discarding blocks...Done. 2023-07-25T14:35:05.852 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi092.front.sepia.ceph.com -o noatime 2023-07-25T14:35:05.853 DEBUG:teuthology.orchestra.run.smithi092:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-07-25T14:35:06.010 DEBUG:teuthology.orchestra.run.smithi092:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-07-25T14:35:06.047 DEBUG:teuthology.orchestra.run.smithi092:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-07-25T14:35:06.119 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-07-25T14:35:06.120 INFO:tasks.ceph:role: osd.7 2023-07-25T14:35:06.120 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi092.front.sepia.ceph.com 2023-07-25T14:35:06.120 DEBUG:teuthology.orchestra.run.smithi092:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-07-25T14:35:06.199 INFO:teuthology.orchestra.run.smithi092.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-07-25T14:35:06.199 INFO:teuthology.orchestra.run.smithi092.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-25T14:35:06.199 INFO:teuthology.orchestra.run.smithi092.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-25T14:35:06.199 INFO:teuthology.orchestra.run.smithi092.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-25T14:35:06.199 INFO:teuthology.orchestra.run.smithi092.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-25T14:35:06.199 INFO:teuthology.orchestra.run.smithi092.stdout: = sunit=0 swidth=0 blks 2023-07-25T14:35:06.200 INFO:teuthology.orchestra.run.smithi092.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-25T14:35:06.200 INFO:teuthology.orchestra.run.smithi092.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-25T14:35:06.200 INFO:teuthology.orchestra.run.smithi092.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-25T14:35:06.201 INFO:teuthology.orchestra.run.smithi092.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-25T14:35:06.630 INFO:teuthology.orchestra.run.smithi092.stdout:Discarding blocks...Done. 2023-07-25T14:35:06.632 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi092.front.sepia.ceph.com -o noatime 2023-07-25T14:35:06.632 DEBUG:teuthology.orchestra.run.smithi092:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-07-25T14:35:06.818 DEBUG:teuthology.orchestra.run.smithi092:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-07-25T14:35:06.857 DEBUG:teuthology.orchestra.run.smithi092:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-25T14:35:06.972 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:06.959+0000 7f31b0be6640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-07-25T14:35:06.973 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:06.960+0000 7f31b0be6640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-07-25T14:35:06.973 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:06.960+0000 7f31b0be6640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-07-25T14:35:06.973 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:06.960+0000 7f31b0be6640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-07-25T14:35:06.973 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:06.960+0000 7f31b0be6640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-07-25T14:35:06.973 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:06.960+0000 7f31b0be6640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-07-25T14:35:09.842 DEBUG:teuthology.orchestra.run.smithi092:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-07-25T14:35:09.875 DEBUG:teuthology.orchestra.run.smithi092:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-25T14:35:09.968 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:09.955+0000 7f9e6f1a0640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-07-25T14:35:09.968 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:09.955+0000 7f9e6f1a0640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-07-25T14:35:09.968 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:09.955+0000 7f9e6f1a0640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-07-25T14:35:09.969 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:09.955+0000 7f9e6f1a0640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-07-25T14:35:09.969 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:09.955+0000 7f9e6f1a0640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-07-25T14:35:09.969 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:09.956+0000 7f9e6f1a0640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-07-25T14:35:12.825 DEBUG:teuthology.orchestra.run.smithi092:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-07-25T14:35:12.857 DEBUG:teuthology.orchestra.run.smithi092:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-25T14:35:12.952 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:12.939+0000 7f193a3e9640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-07-25T14:35:12.953 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:12.940+0000 7f193a3e9640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-07-25T14:35:12.953 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:12.940+0000 7f193a3e9640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-07-25T14:35:12.953 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:12.940+0000 7f193a3e9640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-07-25T14:35:12.953 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:12.940+0000 7f193a3e9640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-07-25T14:35:12.954 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:12.940+0000 7f193a3e9640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-07-25T14:35:15.524 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T14:35:15.527 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T14:35:15.827 DEBUG:teuthology.orchestra.run.smithi092:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-07-25T14:35:15.856 DEBUG:teuthology.orchestra.run.smithi092:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-25T14:35:15.944 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:15.931+0000 7fa233e76640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-07-25T14:35:15.945 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:15.931+0000 7fa233e76640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-07-25T14:35:15.945 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:15.931+0000 7fa233e76640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-07-25T14:35:15.945 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:15.932+0000 7fa233e76640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-07-25T14:35:15.945 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:15.932+0000 7fa233e76640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-07-25T14:35:15.946 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:15.932+0000 7fa233e76640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-07-25T14:35:18.806 DEBUG:teuthology.orchestra.run.smithi092:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-07-25T14:35:18.838 INFO:tasks.ceph:Reading keys from all nodes... 2023-07-25T14:35:18.839 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-07-25T14:35:18.839 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-07-25T14:35:18.872 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-07-25T14:35:18.872 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-07-25T14:35:18.942 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-07-25T14:35:18.942 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-07-25T14:35:19.011 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-07-25T14:35:19.011 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-07-25T14:35:19.078 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-07-25T14:35:19.079 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-07-25T14:35:19.146 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-07-25T14:35:19.146 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-07-25T14:35:19.212 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-07-25T14:35:19.213 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-07-25T14:35:19.279 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-07-25T14:35:19.279 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-07-25T14:35:19.311 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-07-25T14:35:19.311 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-07-25T14:35:19.383 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-07-25T14:35:19.383 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-07-25T14:35:19.455 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-07-25T14:35:19.455 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-07-25T14:35:19.527 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-07-25T14:35:19.528 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-07-25T14:35:19.599 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-07-25T14:35:19.599 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-07-25T14:35:19.671 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-07-25T14:35:19.671 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-07-25T14:35:19.743 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-07-25T14:35:19.743 DEBUG:teuthology.orchestra.run.smithi072:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-07-25T14:35:19.762 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-07-25T14:35:19.762 DEBUG:teuthology.orchestra.run.smithi092:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-07-25T14:35:19.804 INFO:tasks.ceph:Adding keys to all mons... 2023-07-25T14:35:19.805 DEBUG:teuthology.orchestra.run.smithi072:> sudo tee -a /etc/ceph/ceph.keyring 2023-07-25T14:35:19.808 DEBUG:teuthology.orchestra.run.smithi092:> sudo tee -a /etc/ceph/ceph.keyring 2023-07-25T14:35:19.848 INFO:teuthology.orchestra.run.smithi072.stdout:[mgr.y] 2023-07-25T14:35:19.849 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQCI3b9k5aWABxAAzNuS36Orii6Hxg/6h9cx8Q== 2023-07-25T14:35:19.849 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.a] 2023-07-25T14:35:19.849 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQCI3b9kxN0HEBAAnEgyrSmMgSmqg52QCBBAXg== 2023-07-25T14:35:19.849 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.c] 2023-07-25T14:35:19.849 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQCI3b9kKrguFxAAIA8EagIfMcMVROAL3rEetg== 2023-07-25T14:35:19.850 INFO:teuthology.orchestra.run.smithi072.stdout:[osd.0] 2023-07-25T14:35:19.850 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQCL3b9kt8KrNhAATMANux0x8pqETvHcwfe+jA== 2023-07-25T14:35:19.850 INFO:teuthology.orchestra.run.smithi072.stdout:[osd.1] 2023-07-25T14:35:19.850 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQCO3b9kKZqoNRAAPhEAV8i8LjCRlsHUWWzgGg== 2023-07-25T14:35:19.851 INFO:teuthology.orchestra.run.smithi072.stdout:[osd.2] 2023-07-25T14:35:19.851 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQCR3b9kOgUONRAA05jvcIlbYBtNnlMryBUsEw== 2023-07-25T14:35:19.852 INFO:teuthology.orchestra.run.smithi072.stdout:[osd.3] 2023-07-25T14:35:19.852 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQCU3b9kiCNMNBAAIGnnWPs/tzjDMMViNWOgpg== 2023-07-25T14:35:19.853 INFO:teuthology.orchestra.run.smithi072.stdout:[mgr.x] 2023-07-25T14:35:19.853 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQCI3b9kGgynDBAA7I0mBcwS0zmXAN9uxn4LCQ== 2023-07-25T14:35:19.853 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.b] 2023-07-25T14:35:19.853 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQCI3b9k9E1QHBAAtQ3+KQ2iWS4MWp8ydNmXwg== 2023-07-25T14:35:19.854 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.d] 2023-07-25T14:35:19.854 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQCI3b9k0n2mIxAA+ga0Z55EygoBenB3JZfndQ== 2023-07-25T14:35:19.854 INFO:teuthology.orchestra.run.smithi072.stdout:[osd.4] 2023-07-25T14:35:19.855 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQCa3b9kOuNDORAAhqs3jZIKDxp08d/R0MbnrQ== 2023-07-25T14:35:19.855 INFO:teuthology.orchestra.run.smithi072.stdout:[osd.5] 2023-07-25T14:35:19.855 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQCd3b9kMvn/OBAAj8R00HLAH23ld0/0A6e5XA== 2023-07-25T14:35:19.855 INFO:teuthology.orchestra.run.smithi072.stdout:[osd.6] 2023-07-25T14:35:19.856 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQCg3b9kXWwUOBAAKyB6jtX1TMOe4daeeVH67A== 2023-07-25T14:35:19.856 INFO:teuthology.orchestra.run.smithi072.stdout:[osd.7] 2023-07-25T14:35:19.856 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQCj3b9kp0GXNxAAMZEzI57maI7h3DJpHtlGyg== 2023-07-25T14:35:19.856 INFO:teuthology.orchestra.run.smithi072.stdout:[client.0] 2023-07-25T14:35:19.856 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQCI3b9k9P3nJxAAF+MNeILdw3WF8ZQhKpISew== 2023-07-25T14:35:19.857 INFO:teuthology.orchestra.run.smithi072.stdout:[client.1] 2023-07-25T14:35:19.857 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQCI3b9kRPMxKxAAACbj386PGidKwcHoe2J57A== 2023-07-25T14:35:19.873 INFO:teuthology.orchestra.run.smithi092.stdout:[mgr.y] 2023-07-25T14:35:19.873 INFO:teuthology.orchestra.run.smithi092.stdout: key = AQCI3b9k5aWABxAAzNuS36Orii6Hxg/6h9cx8Q== 2023-07-25T14:35:19.874 INFO:teuthology.orchestra.run.smithi092.stdout:[mds.a] 2023-07-25T14:35:19.874 INFO:teuthology.orchestra.run.smithi092.stdout: key = AQCI3b9kxN0HEBAAnEgyrSmMgSmqg52QCBBAXg== 2023-07-25T14:35:19.874 INFO:teuthology.orchestra.run.smithi092.stdout:[mds.c] 2023-07-25T14:35:19.874 INFO:teuthology.orchestra.run.smithi092.stdout: key = AQCI3b9kKrguFxAAIA8EagIfMcMVROAL3rEetg== 2023-07-25T14:35:19.875 INFO:teuthology.orchestra.run.smithi092.stdout:[osd.0] 2023-07-25T14:35:19.875 INFO:teuthology.orchestra.run.smithi092.stdout: key = AQCL3b9kt8KrNhAATMANux0x8pqETvHcwfe+jA== 2023-07-25T14:35:19.875 INFO:teuthology.orchestra.run.smithi092.stdout:[osd.1] 2023-07-25T14:35:19.875 INFO:teuthology.orchestra.run.smithi092.stdout: key = AQCO3b9kKZqoNRAAPhEAV8i8LjCRlsHUWWzgGg== 2023-07-25T14:35:19.875 INFO:teuthology.orchestra.run.smithi092.stdout:[osd.2] 2023-07-25T14:35:19.875 INFO:teuthology.orchestra.run.smithi092.stdout: key = AQCR3b9kOgUONRAA05jvcIlbYBtNnlMryBUsEw== 2023-07-25T14:35:19.875 INFO:teuthology.orchestra.run.smithi092.stdout:[osd.3] 2023-07-25T14:35:19.876 INFO:teuthology.orchestra.run.smithi092.stdout: key = AQCU3b9kiCNMNBAAIGnnWPs/tzjDMMViNWOgpg== 2023-07-25T14:35:19.876 INFO:teuthology.orchestra.run.smithi092.stdout:[mgr.x] 2023-07-25T14:35:19.876 INFO:teuthology.orchestra.run.smithi092.stdout: key = AQCI3b9kGgynDBAA7I0mBcwS0zmXAN9uxn4LCQ== 2023-07-25T14:35:19.877 INFO:teuthology.orchestra.run.smithi092.stdout:[mds.b] 2023-07-25T14:35:19.877 INFO:teuthology.orchestra.run.smithi092.stdout: key = AQCI3b9k9E1QHBAAtQ3+KQ2iWS4MWp8ydNmXwg== 2023-07-25T14:35:19.877 INFO:teuthology.orchestra.run.smithi092.stdout:[mds.d] 2023-07-25T14:35:19.877 INFO:teuthology.orchestra.run.smithi092.stdout: key = AQCI3b9k0n2mIxAA+ga0Z55EygoBenB3JZfndQ== 2023-07-25T14:35:19.877 INFO:teuthology.orchestra.run.smithi092.stdout:[osd.4] 2023-07-25T14:35:19.877 INFO:teuthology.orchestra.run.smithi092.stdout: key = AQCa3b9kOuNDORAAhqs3jZIKDxp08d/R0MbnrQ== 2023-07-25T14:35:19.877 INFO:teuthology.orchestra.run.smithi092.stdout:[osd.5] 2023-07-25T14:35:19.878 INFO:teuthology.orchestra.run.smithi092.stdout: key = AQCd3b9kMvn/OBAAj8R00HLAH23ld0/0A6e5XA== 2023-07-25T14:35:19.878 INFO:teuthology.orchestra.run.smithi092.stdout:[osd.6] 2023-07-25T14:35:19.878 INFO:teuthology.orchestra.run.smithi092.stdout: key = AQCg3b9kXWwUOBAAKyB6jtX1TMOe4daeeVH67A== 2023-07-25T14:35:19.878 INFO:teuthology.orchestra.run.smithi092.stdout:[osd.7] 2023-07-25T14:35:19.878 INFO:teuthology.orchestra.run.smithi092.stdout: key = AQCj3b9kp0GXNxAAMZEzI57maI7h3DJpHtlGyg== 2023-07-25T14:35:19.878 INFO:teuthology.orchestra.run.smithi092.stdout:[client.0] 2023-07-25T14:35:19.878 INFO:teuthology.orchestra.run.smithi092.stdout: key = AQCI3b9k9P3nJxAAF+MNeILdw3WF8ZQhKpISew== 2023-07-25T14:35:19.879 INFO:teuthology.orchestra.run.smithi092.stdout:[client.1] 2023-07-25T14:35:19.879 INFO:teuthology.orchestra.run.smithi092.stdout: key = AQCI3b9kRPMxKxAAACbj386PGidKwcHoe2J57A== 2023-07-25T14:35:19.880 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-07-25T14:35:19.901 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-07-25T14:35:19.978 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-25T14:35:19.981 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-25T14:35:20.038 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-25T14:35:20.040 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-25T14:35:20.096 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-25T14:35:20.099 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-25T14:35:20.151 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-25T14:35:20.155 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-25T14:35:20.208 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-25T14:35:20.211 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-25T14:35:20.263 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-25T14:35:20.265 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-25T14:35:20.318 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-07-25T14:35:20.322 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-07-25T14:35:20.374 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-25T14:35:20.377 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-25T14:35:20.433 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-25T14:35:20.436 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-25T14:35:20.492 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-25T14:35:20.494 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-25T14:35:20.548 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-25T14:35:20.550 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-25T14:35:20.603 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-25T14:35:20.606 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-25T14:35:20.659 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-25T14:35:20.661 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-25T14:35:20.713 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-07-25T14:35:20.715 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-07-25T14:35:20.770 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-07-25T14:35:20.772 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-07-25T14:35:20.827 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-07-25T14:35:20.828 DEBUG:teuthology.orchestra.run.smithi072:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-07-25T14:35:20.854 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-07-25T14:35:20.950 DEBUG:teuthology.orchestra.run.smithi072:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-07-25T14:35:20.977 DEBUG:teuthology.orchestra.run.smithi092:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-07-25T14:35:21.005 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-07-25T14:35:21.104 DEBUG:teuthology.orchestra.run.smithi092:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-07-25T14:35:21.130 DEBUG:teuthology.orchestra.run.smithi092:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-07-25T14:35:21.196 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-07-25T14:35:21.294 DEBUG:teuthology.orchestra.run.smithi092:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-07-25T14:35:21.319 DEBUG:teuthology.orchestra.run.smithi072:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-07-25T14:35:21.322 DEBUG:teuthology.orchestra.run.smithi092:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-07-25T14:35:21.375 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-07-25T14:35:21.376 INFO:tasks.ceph.mon.a:Restarting daemon 2023-07-25T14:35:21.376 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-07-25T14:35:21.379 INFO:tasks.ceph.mon.a:Started 2023-07-25T14:35:21.379 INFO:tasks.ceph.mon.b:Restarting daemon 2023-07-25T14:35:21.379 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-07-25T14:35:21.418 INFO:tasks.ceph.mon.b:Started 2023-07-25T14:35:21.418 INFO:tasks.ceph.mon.c:Restarting daemon 2023-07-25T14:35:21.418 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-07-25T14:35:21.420 INFO:tasks.ceph.mon.c:Started 2023-07-25T14:35:21.420 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-07-25T14:35:21.421 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-07-25T14:35:21.421 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-07-25T14:35:21.423 INFO:tasks.ceph.mgr.y:Started 2023-07-25T14:35:21.423 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-07-25T14:35:21.423 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-07-25T14:35:21.425 INFO:tasks.ceph.mgr.x:Started 2023-07-25T14:35:21.425 INFO:tasks.ceph:Setting crush tunables to default 2023-07-25T14:35:21.426 DEBUG:teuthology.orchestra.run.smithi072:> sudo ceph --cluster ceph osd crush tunables default 2023-07-25T14:35:21.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:21.534+0000 7fa8125e9700 1 Processor -- start 2023-07-25T14:35:21.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:21.534+0000 7fa8125e9700 1 -- start start 2023-07-25T14:35:21.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:21.535+0000 7fa8125e9700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa80c0c5f40 0x7fa80c154640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:21.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:21.535+0000 7fa8125e9700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa80c0c54f0 con 0x7fa80c0ba0e0 2023-07-25T14:35:21.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:21.535+0000 7fa8125e9700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa80c0c6670 con 0x7fa80c151ba0 2023-07-25T14:35:21.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:21.535+0000 7fa8125e9700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa80c0c5740 con 0x7fa80c0c5f40 2023-07-25T14:35:21.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:21.535+0000 7fa80b7fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa80c0c5f40 0x7fa80c154640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:21.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:21.535+0000 7fa810b86700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fa80c0ba0e0 0x7fa80c15b970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:57728/0 (socket says 172.21.15.72:57728) 2023-07-25T14:35:21.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:21.535+0000 7fa80b7fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa80c0c5f40 0x7fa80c154640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:38758/0 (socket says 172.21.15.72:38758) 2023-07-25T14:35:21.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:21.535+0000 7fa810b86700 1 -- 172.21.15.72:0/1517914546 learned_addr learned my addr 172.21.15.72:0/1517914546 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:35:21.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:21.535+0000 7fa80b7fe700 1 -- 172.21.15.72:0/1517914546 >> v2:172.21.15.72:3300/0 conn(0x7fa80c0c5f40 msgr2=0x7fa80c154640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-07-25T14:35:21.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:21.535+0000 7fa80b7fe700 1 -- 172.21.15.72:0/1517914546 >> v2:172.21.15.72:3300/0 conn(0x7fa80c0c5f40 msgr2=0x7fa80c154640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-07-25T14:35:21.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:21.535+0000 7fa80b7fe700 1 --2- 172.21.15.72:0/1517914546 >> v2:172.21.15.72:3300/0 conn(0x7fa80c0c5f40 0x7fa80c154640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-07-25T14:35:21.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:21.535+0000 7fa80b7fe700 1 --2- 172.21.15.72:0/1517914546 >> v2:172.21.15.72:3300/0 conn(0x7fa80c0c5f40 0x7fa80c154640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-25T14:35:21.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:21.736+0000 7fa80b7fe700 1 --2- 172.21.15.72:0/1517914546 >> v2:172.21.15.72:3300/0 conn(0x7fa80c0c5f40 0x7fa80c154640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:21.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:21.736+0000 7fa80b7fe700 1 -- 172.21.15.72:0/1517914546 >> v2:172.21.15.72:3300/0 conn(0x7fa80c0c5f40 msgr2=0x7fa80c154640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-07-25T14:35:21.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:21.736+0000 7fa80b7fe700 1 -- 172.21.15.72:0/1517914546 >> v2:172.21.15.72:3300/0 conn(0x7fa80c0c5f40 msgr2=0x7fa80c154640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-07-25T14:35:21.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:21.736+0000 7fa80b7fe700 1 --2- 172.21.15.72:0/1517914546 >> v2:172.21.15.72:3300/0 conn(0x7fa80c0c5f40 0x7fa80c154640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-07-25T14:35:21.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:21.736+0000 7fa80b7fe700 1 --2- 172.21.15.72:0/1517914546 >> v2:172.21.15.72:3300/0 conn(0x7fa80c0c5f40 0x7fa80c154640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-07-25T14:35:21.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:21.757+0000 7fa80affd700 1 -- 172.21.15.72:0/1517914546 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 293276901 0 0) 0x7fa80c0c54f0 con 0x7fa80c0ba0e0 2023-07-25T14:35:21.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:21.757+0000 7fa80affd700 1 -- 172.21.15.72:0/1517914546 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa7f40035b0 con 0x7fa80c0ba0e0 2023-07-25T14:35:21.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:21.757+0000 7fa80affd700 1 -- 172.21.15.72:0/1517914546 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1118411655 0 0) 0x7fa7f40035b0 con 0x7fa80c0ba0e0 2023-07-25T14:35:21.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:21.757+0000 7fa80affd700 1 -- 172.21.15.72:0/1517914546 >> v2:172.21.15.72:3300/0 conn(0x7fa80c0c5f40 msgr2=0x7fa80c154640 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-25T14:35:21.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:21.757+0000 7fa80affd700 1 --2- 172.21.15.72:0/1517914546 >> v2:172.21.15.72:3300/0 conn(0x7fa80c0c5f40 0x7fa80c154640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:21.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:21.757+0000 7fa80affd700 1 -- 172.21.15.72:0/1517914546 >> v1:172.21.15.92:6789/0 conn(0x7fa80c151ba0 legacy=0x7fa80c0c2230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:21.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:21.757+0000 7fa80affd700 1 -- 172.21.15.72:0/1517914546 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa80c0c5a20 con 0x7fa80c0ba0e0 2023-07-25T14:35:21.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:21.757+0000 7fa80affd700 1 -- 172.21.15.72:0/1517914546 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2559588315 0 0) 0x7fa8040019f0 con 0x7fa80c0ba0e0 2023-07-25T14:35:21.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:21.758+0000 7fa80affd700 1 -- 172.21.15.72:0/1517914546 >> v1:172.21.15.72:6789/0 conn(0x7fa80c0ba0e0 legacy=0x7fa80c15b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:21.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:21.758+0000 7fa80affd700 1 --2- 172.21.15.72:0/1517914546 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa7f4003a00 0x7fa7f4003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:21.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:21.758+0000 7fa80affd700 1 --2- 172.21.15.72:0/1517914546 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa7f4004850 0x7fa7f4004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:21.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:21.758+0000 7fa80affd700 1 --2- 172.21.15.72:0/1517914546 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa7f4005410 0x7fa7f400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:21.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:21.758+0000 7fa80affd700 1 -- 172.21.15.72:0/1517914546 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa80c0c5740 con 0x7fa7f4003a00 2023-07-25T14:35:21.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:21.758+0000 7fa80affd700 1 -- 172.21.15.72:0/1517914546 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7f400c2a0 con 0x7fa7f4004850 2023-07-25T14:35:21.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:21.758+0000 7fa80affd700 1 -- 172.21.15.72:0/1517914546 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7f400c460 con 0x7fa7f4005410 2023-07-25T14:35:21.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:21.758+0000 7fa80bfff700 1 --2- 172.21.15.72:0/1517914546 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa7f4003a00 0x7fa7f4003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:21.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:21.758+0000 7fa810b86700 1 --2- 172.21.15.72:0/1517914546 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa7f4005410 0x7fa7f400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:21.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:21.758+0000 7fa80b7fe700 1 --2- 172.21.15.72:0/1517914546 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa7f4004850 0x7fa7f4004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:21.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:21.758+0000 7fa80bfff700 1 -- 172.21.15.72:0/1517914546 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa7f4005410 msgr2=0x7fa7f400ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:35:21.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:21.758+0000 7fa80bfff700 1 --2- 172.21.15.72:0/1517914546 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa7f4005410 0x7fa7f400ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:21.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:21.758+0000 7fa80bfff700 1 -- 172.21.15.72:0/1517914546 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa7f4004850 msgr2=0x7fa7f4004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:35:21.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:21.758+0000 7fa80bfff700 1 --2- 172.21.15.72:0/1517914546 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa7f4004850 0x7fa7f4004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:21.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:21.758+0000 7fa80bfff700 1 -- 172.21.15.72:0/1517914546 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7f40035b0 con 0x7fa7f4003a00 2023-07-25T14:35:21.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:21.758+0000 7fa810b86700 1 --2- 172.21.15.72:0/1517914546 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa7f4005410 0x7fa7f400ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-25T14:35:21.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:21.758+0000 7fa80b7fe700 1 --2- 172.21.15.72:0/1517914546 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa7f4004850 0x7fa7f4004cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-25T14:35:21.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:21.758+0000 7fa810b86700 1 -- 172.21.15.72:0/1517914546 reap_dead start 2023-07-25T14:35:21.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:21.758+0000 7fa80bfff700 1 --2- 172.21.15.72:0/1517914546 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa7f4003a00 0x7fa7f4003e20 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fa800001800 tx=0x7fa7f4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fca01b66f47414a server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:35:21.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:21.758+0000 7fa80affd700 1 -- 172.21.15.72:0/1517914546 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8000012f0 con 0x7fa7f4003a00 2023-07-25T14:35:21.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:21.758+0000 7fa80affd700 1 -- 172.21.15.72:0/1517914546 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa800005310 con 0x7fa7f4003a00 2023-07-25T14:35:21.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:21.758+0000 7fa80affd700 1 -- 172.21.15.72:0/1517914546 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa800006860 con 0x7fa7f4003a00 2023-07-25T14:35:21.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:21.759+0000 7fa8125e9700 1 -- 172.21.15.72:0/1517914546 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa7f4003a00 msgr2=0x7fa7f4003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:21.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:21.759+0000 7fa8125e9700 1 --2- 172.21.15.72:0/1517914546 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa7f4003a00 0x7fa7f4003e20 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fa800001800 tx=0x7fa7f4005880 comp rx=0 tx=0).stop 2023-07-25T14:35:21.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:21.759+0000 7fa8125e9700 1 -- 172.21.15.72:0/1517914546 shutdown_connections 2023-07-25T14:35:21.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:21.759+0000 7fa8125e9700 1 --2- 172.21.15.72:0/1517914546 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa7f4003a00 0x7fa7f4003e20 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:21.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:21.759+0000 7fa8125e9700 1 -- 172.21.15.72:0/1517914546 >> 172.21.15.72:0/1517914546 conn(0x7fa80c0a87e0 msgr2=0x7fa80c0a8bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:35:21.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:21.759+0000 7fa8125e9700 1 -- 172.21.15.72:0/1517914546 shutdown_connections 2023-07-25T14:35:21.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:21.759+0000 7fa8125e9700 1 -- 172.21.15.72:0/1517914546 wait complete. 2023-07-25T14:35:21.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:21.760+0000 7fa8125e9700 1 Processor -- start 2023-07-25T14:35:21.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:21.761+0000 7fa8125e9700 1 -- start start 2023-07-25T14:35:21.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:21.762+0000 7fa8125e9700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa7f4003a00 0x7fa80c14ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:21.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:21.762+0000 7fa8125e9700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa80c149e40 0x7fa80c14a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:21.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:21.762+0000 7fa8125e9700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa80c148c40 0x7fa80c1490d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:21.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:21.762+0000 7fa8125e9700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa80c149610 con 0x7fa7f4003a00 2023-07-25T14:35:21.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:21.762+0000 7fa8125e9700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa80c154bc0 con 0x7fa80c149e40 2023-07-25T14:35:21.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:21.762+0000 7fa8125e9700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa80c14e540 con 0x7fa80c148c40 2023-07-25T14:35:21.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:21.762+0000 7fa80bfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa7f4003a00 0x7fa80c14ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:21.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:21.762+0000 7fa810b86700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa80c148c40 0x7fa80c1490d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:21.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:21.762+0000 7fa80b7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa80c149e40 0x7fa80c14a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:21.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:21.762+0000 7fa80bfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa7f4003a00 0x7fa80c14ae00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:38790/0 (socket says 172.21.15.72:38790) 2023-07-25T14:35:21.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:21.762+0000 7fa80bfff700 1 -- 172.21.15.72:0/2803798321 learned_addr learned my addr 172.21.15.72:0/2803798321 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:35:21.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:21.762+0000 7fa810b86700 1 -- 172.21.15.72:0/2803798321 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa80c149e40 msgr2=0x7fa80c14a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:21.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:21.762+0000 7fa810b86700 1 --2- 172.21.15.72:0/2803798321 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa80c149e40 0x7fa80c14a2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:21.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:21.762+0000 7fa810b86700 1 -- 172.21.15.72:0/2803798321 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa7f4003a00 msgr2=0x7fa80c14ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:21.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:21.762+0000 7fa810b86700 1 --2- 172.21.15.72:0/2803798321 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa7f4003a00 0x7fa80c14ae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:21.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:21.762+0000 7fa810b86700 1 -- 172.21.15.72:0/2803798321 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa80c148440 con 0x7fa80c148c40 2023-07-25T14:35:21.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:21.762+0000 7fa80b7fe700 1 --2- 172.21.15.72:0/2803798321 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa80c149e40 0x7fa80c14a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-25T14:35:21.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:21.762+0000 7fa810b86700 1 --2- 172.21.15.72:0/2803798321 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa80c148c40 0x7fa80c1490d0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fa80c072950 tx=0x7fa80400e440 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:35:21.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:21.762+0000 7fa808ff9700 1 -- 172.21.15.72:0/2803798321 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa80400ec80 con 0x7fa80c148c40 2023-07-25T14:35:21.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:21.762+0000 7fa808ff9700 1 -- 172.21.15.72:0/2803798321 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa80400ee00 con 0x7fa80c148c40 2023-07-25T14:35:21.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:21.763+0000 7fa8125e9700 1 -- 172.21.15.72:0/2803798321 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa80c148720 con 0x7fa80c148c40 2023-07-25T14:35:21.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:21.763+0000 7fa808ff9700 1 -- 172.21.15.72:0/2803798321 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa804013660 con 0x7fa80c148c40 2023-07-25T14:35:21.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:21.763+0000 7fa8125e9700 1 -- 172.21.15.72:0/2803798321 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa80c0c3920 con 0x7fa80c148c40 2023-07-25T14:35:21.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:21.763+0000 7fa808ff9700 1 -- 172.21.15.72:0/2803798321 <== mon.2 v2:172.21.15.92:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fa8040137c0 con 0x7fa80c148c40 2023-07-25T14:35:21.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:21.763+0000 7fa808ff9700 1 -- 172.21.15.72:0/2803798321 <== mon.2 v2:172.21.15.92:3301/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fa80401d7c0 con 0x7fa80c148c40 2023-07-25T14:35:21.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:21.763+0000 7fa8125e9700 1 -- 172.21.15.72:0/2803798321 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa80c148910 con 0x7fa80c148c40 2023-07-25T14:35:21.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:21.767+0000 7fa808ff9700 1 -- 172.21.15.72:0/2803798321 <== mon.2 v2:172.21.15.92:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7fa804013c00 con 0x7fa80c148c40 2023-07-25T14:35:21.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:21.845+0000 7fa8125e9700 1 -- 172.21.15.72:0/2803798321 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7fa80c04e470 con 0x7fa80c148c40 2023-07-25T14:35:21.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:21.853+0000 7fa808ff9700 1 -- 172.21.15.72:0/2803798321 <== mon.2 v2:172.21.15.92:3301/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7fa80401d980 con 0x7fa80c148c40 2023-07-25T14:35:21.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:21.854+0000 7fa8125e9700 1 -- 172.21.15.72:0/2803798321 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa80c148c40 msgr2=0x7fa80c1490d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:21.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:21.854+0000 7fa8125e9700 1 --2- 172.21.15.72:0/2803798321 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa80c148c40 0x7fa80c1490d0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fa80c072950 tx=0x7fa80400e440 comp rx=0 tx=0).stop 2023-07-25T14:35:21.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:21.854+0000 7fa8125e9700 1 -- 172.21.15.72:0/2803798321 shutdown_connections 2023-07-25T14:35:21.868 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:21.854+0000 7fa8125e9700 1 --2- 172.21.15.72:0/2803798321 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa80c148c40 0x7fa80c1490d0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:21.868 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:21.854+0000 7fa8125e9700 1 --2- 172.21.15.72:0/2803798321 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa7f4003a00 0x7fa80c14ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:21.868 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:21.854+0000 7fa8125e9700 1 --2- 172.21.15.72:0/2803798321 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa80c149e40 0x7fa80c14a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:21.868 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:21.854+0000 7fa8125e9700 1 -- 172.21.15.72:0/2803798321 >> 172.21.15.72:0/2803798321 conn(0x7fa80c0a87e0 msgr2=0x7fa80c06f400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:35:21.868 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:21.854+0000 7fa8125e9700 1 -- 172.21.15.72:0/2803798321 shutdown_connections 2023-07-25T14:35:21.868 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:21.854+0000 7fa8125e9700 1 -- 172.21.15.72:0/2803798321 wait complete. 2023-07-25T14:35:21.869 INFO:teuthology.orchestra.run.smithi072.stderr:adjusted tunables profile to default 2023-07-25T14:35:21.879 INFO:tasks.ceph:check_enable_crimson: False 2023-07-25T14:35:21.879 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-07-25T14:35:21.879 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-07-25T14:35:21.880 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-07-25T14:35:21.889 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-07-25T14:35:21.877+0000 7f1c41ed8200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-25T14:35:21.898 INFO:tasks.ceph.mgr.x.smithi092.stderr:2023-07-25T14:35:21.885+0000 7f95aaba9200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-25T14:35:21.905 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-07-25T14:35:21.906 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-07-25T14:35:21.959 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-07-25T14:35:21.946+0000 7f1c41ed8200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-25T14:35:21.963 INFO:tasks.ceph.mgr.x.smithi092.stderr:2023-07-25T14:35:21.950+0000 7f95aaba9200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-25T14:35:21.971 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-07-25T14:35:21.972 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-07-25T14:35:22.038 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-07-25T14:35:22.039 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-07-25T14:35:22.040 INFO:tasks.ceph.mgr.x.smithi092.stderr:2023-07-25T14:35:22.026+0000 7f95aaba9200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-25T14:35:22.040 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-07-25T14:35:22.026+0000 7f1c41ed8200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-25T14:35:22.065 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-07-25T14:35:22.066 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-07-25T14:35:22.091 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-07-25T14:35:22.092 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-07-25T14:35:22.119 INFO:tasks.ceph.mgr.x.smithi092.stderr:2023-07-25T14:35:22.106+0000 7f95aaba9200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-25T14:35:22.123 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-07-25T14:35:22.110+0000 7f1c41ed8200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-25T14:35:22.144 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-07-25T14:35:22.145 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-07-25T14:35:22.211 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-07-25T14:35:22.211 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-07-25T14:35:22.266 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-07-25T14:35:22.253+0000 7f1c41ed8200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-25T14:35:22.268 INFO:tasks.ceph.mgr.x.smithi092.stderr:2023-07-25T14:35:22.256+0000 7f95aaba9200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-25T14:35:22.282 DEBUG:teuthology.orchestra.run.smithi092:> sudo ceph --cluster ceph osd new d517fdad-0bfe-49f0-89f2-9421c3761839 0 2023-07-25T14:35:22.443 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.430+0000 7fb248f19700 1 Processor -- start 2023-07-25T14:35:22.443 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.430+0000 7fb248f19700 1 -- start start 2023-07-25T14:35:22.445 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.431+0000 7fb248f19700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb2440724c0 0x7fb2440c34c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:22.445 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.431+0000 7fb248f19700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb2440c4930 0x7fb2440c3a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:22.445 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.431+0000 7fb248f19700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2440c2fe0 con 0x7fb244151950 2023-07-25T14:35:22.445 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.431+0000 7fb248f19700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb244071a60 con 0x7fb2440c4930 2023-07-25T14:35:22.446 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.431+0000 7fb248f19700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2440c2a70 con 0x7fb2440724c0 2023-07-25T14:35:22.446 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.431+0000 7fb241d9b700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb2440724c0 0x7fb2440c34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:22.446 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.431+0000 7fb241d9b700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb2440724c0 0x7fb2440c34c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3301/0 says I am v2:172.21.15.92:46732/0 (socket says 172.21.15.92:46732) 2023-07-25T14:35:22.446 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.431+0000 7fb241d9b700 1 -- 172.21.15.92:0/3761287722 learned_addr learned my addr 172.21.15.92:0/3761287722 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-07-25T14:35:22.446 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.431+0000 7fb242d9d700 1 --2- 172.21.15.92:0/3761287722 >> v2:172.21.15.72:3300/0 conn(0x7fb2440c4930 0x7fb2440c3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:22.446 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.431+0000 7fb241d9b700 1 -- 172.21.15.92:0/3761287722 >> v2:172.21.15.72:3300/0 conn(0x7fb2440c4930 msgr2=0x7fb2440c3a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:35:22.446 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.431+0000 7fb241d9b700 1 --2- 172.21.15.92:0/3761287722 >> v2:172.21.15.72:3300/0 conn(0x7fb2440c4930 0x7fb2440c3a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:22.446 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.431+0000 7fb241d9b700 1 -- 172.21.15.92:0/3761287722 >> v1:172.21.15.72:6789/0 conn(0x7fb244151950 legacy=0x7fb24406a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:22.447 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.431+0000 7fb241d9b700 1 -- 172.21.15.92:0/3761287722 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb244155070 con 0x7fb2440724c0 2023-07-25T14:35:22.447 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.432+0000 7fb241d9b700 1 --2- 172.21.15.92:0/3761287722 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb2440724c0 0x7fb2440c34c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fb2380098f0 tx=0x7fb238009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f3b67b4453d77b6d server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:35:22.447 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.432+0000 7fb24159a700 1 -- 172.21.15.92:0/3761287722 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb238011830 con 0x7fb2440724c0 2023-07-25T14:35:22.447 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.432+0000 7fb24159a700 1 -- 172.21.15.92:0/3761287722 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb238011990 con 0x7fb2440724c0 2023-07-25T14:35:22.447 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.432+0000 7fb24159a700 1 -- 172.21.15.92:0/3761287722 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb238011d20 con 0x7fb2440724c0 2023-07-25T14:35:22.447 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.432+0000 7fb248f19700 1 -- 172.21.15.92:0/3761287722 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb2440724c0 msgr2=0x7fb2440c34c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:22.447 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.432+0000 7fb248f19700 1 --2- 172.21.15.92:0/3761287722 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb2440724c0 0x7fb2440c34c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fb2380098f0 tx=0x7fb238009c00 comp rx=0 tx=0).stop 2023-07-25T14:35:22.448 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.432+0000 7fb248f19700 1 -- 172.21.15.92:0/3761287722 shutdown_connections 2023-07-25T14:35:22.448 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.432+0000 7fb248f19700 1 --2- 172.21.15.92:0/3761287722 >> v2:172.21.15.72:3300/0 conn(0x7fb2440c4930 0x7fb2440c3a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:22.448 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.432+0000 7fb248f19700 1 --2- 172.21.15.92:0/3761287722 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb2440724c0 0x7fb2440c34c0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:22.448 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.432+0000 7fb248f19700 1 -- 172.21.15.92:0/3761287722 >> 172.21.15.92:0/3761287722 conn(0x7fb2440a87e0 msgr2=0x7fb2440a8bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:35:22.449 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.432+0000 7fb248f19700 1 -- 172.21.15.92:0/3761287722 shutdown_connections 2023-07-25T14:35:22.449 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.432+0000 7fb248f19700 1 -- 172.21.15.92:0/3761287722 wait complete. 2023-07-25T14:35:22.453 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.434+0000 7fb248f19700 1 Processor -- start 2023-07-25T14:35:22.453 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.434+0000 7fb248f19700 1 -- start start 2023-07-25T14:35:22.453 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.434+0000 7fb248f19700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb2440724c0 0x7fb2440c0380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:22.453 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.434+0000 7fb248f19700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb2440c4930 0x7fb2440ac440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:22.454 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.434+0000 7fb248f19700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb244151950 0x7fb2440bec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:22.454 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.434+0000 7fb248f19700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2440bdba0 con 0x7fb244151950 2023-07-25T14:35:22.454 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.434+0000 7fb248f19700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2440bde80 con 0x7fb2440724c0 2023-07-25T14:35:22.454 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.434+0000 7fb248f19700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2440be160 con 0x7fb2440c4930 2023-07-25T14:35:22.455 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.434+0000 7fb241d9b700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb2440c4930 0x7fb2440ac440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:22.455 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.435+0000 7fb241d9b700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb2440c4930 0x7fb2440ac440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3301/0 says I am v2:172.21.15.92:46738/0 (socket says 172.21.15.92:46738) 2023-07-25T14:35:22.455 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.435+0000 7fb241d9b700 1 -- 172.21.15.92:0/3304594917 learned_addr learned my addr 172.21.15.92:0/3304594917 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-07-25T14:35:22.456 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.435+0000 7fb24259c700 1 --2- 172.21.15.92:0/3304594917 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb2440724c0 0x7fb2440c0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:22.456 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.435+0000 7fb242d9d700 1 --2- 172.21.15.92:0/3304594917 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb244151950 0x7fb2440bec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:22.456 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.435+0000 7fb241d9b700 1 -- 172.21.15.92:0/3304594917 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb2440724c0 msgr2=0x7fb2440c0380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:22.456 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.435+0000 7fb241d9b700 1 --2- 172.21.15.92:0/3304594917 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb2440724c0 0x7fb2440c0380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:22.457 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.435+0000 7fb241d9b700 1 -- 172.21.15.92:0/3304594917 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb244151950 msgr2=0x7fb2440bec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:22.457 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.435+0000 7fb241d9b700 1 --2- 172.21.15.92:0/3304594917 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb244151950 0x7fb2440bec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:22.457 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.435+0000 7fb241d9b700 1 -- 172.21.15.92:0/3304594917 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb238009550 con 0x7fb2440c4930 2023-07-25T14:35:22.457 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.435+0000 7fb241d9b700 1 --2- 172.21.15.92:0/3304594917 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb2440c4930 0x7fb2440ac440 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fb238000c00 tx=0x7fb238004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:35:22.458 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.435+0000 7fb232ffd700 1 -- 172.21.15.92:0/3304594917 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb238004400 con 0x7fb2440c4930 2023-07-25T14:35:22.458 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.435+0000 7fb232ffd700 1 -- 172.21.15.92:0/3304594917 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb23801f070 con 0x7fb2440c4930 2023-07-25T14:35:22.458 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.435+0000 7fb248f19700 1 -- 172.21.15.92:0/3304594917 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2440be440 con 0x7fb2440c4930 2023-07-25T14:35:22.458 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.435+0000 7fb232ffd700 1 -- 172.21.15.92:0/3304594917 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2380038e0 con 0x7fb2440c4930 2023-07-25T14:35:22.459 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.435+0000 7fb248f19700 1 -- 172.21.15.92:0/3304594917 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2440a5c70 con 0x7fb2440c4930 2023-07-25T14:35:22.459 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.435+0000 7fb232ffd700 1 -- 172.21.15.92:0/3304594917 <== mon.2 v2:172.21.15.92:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fb238021030 con 0x7fb2440c4930 2023-07-25T14:35:22.459 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.435+0000 7fb232ffd700 1 -- 172.21.15.92:0/3304594917 <== mon.2 v2:172.21.15.92:3301/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7fb23801a900 con 0x7fb2440c4930 2023-07-25T14:35:22.460 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.436+0000 7fb248f19700 1 -- 172.21.15.92:0/3304594917 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2440be960 con 0x7fb2440c4930 2023-07-25T14:35:22.460 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.438+0000 7fb232ffd700 1 -- 172.21.15.92:0/3304594917 <== mon.2 v2:172.21.15.92:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7fb2440be960 con 0x7fb2440c4930 2023-07-25T14:35:22.535 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.522+0000 7fb248f19700 1 -- 172.21.15.92:0/3304594917 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_command({"prefix": "osd new", "uuid": "d517fdad-0bfe-49f0-89f2-9421c3761839", "id": 0} v 0) v1 -- 0x7fb24404e470 con 0x7fb2440c4930 2023-07-25T14:35:22.539 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.527+0000 7fb232ffd700 1 -- 172.21.15.92:0/3304594917 <== mon.2 v2:172.21.15.92:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d517fdad-0bfe-49f0-89f2-9421c3761839", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7fb238015020 con 0x7fb2440c4930 2023-07-25T14:35:22.540 INFO:teuthology.orchestra.run.smithi092.stdout:0 2023-07-25T14:35:22.541 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.528+0000 7fb248f19700 1 -- 172.21.15.92:0/3304594917 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb2440c4930 msgr2=0x7fb2440ac440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:22.541 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.528+0000 7fb248f19700 1 --2- 172.21.15.92:0/3304594917 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb2440c4930 0x7fb2440ac440 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fb238000c00 tx=0x7fb238004750 comp rx=0 tx=0).stop 2023-07-25T14:35:22.541 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.528+0000 7fb248f19700 1 -- 172.21.15.92:0/3304594917 shutdown_connections 2023-07-25T14:35:22.541 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.528+0000 7fb248f19700 1 --2- 172.21.15.92:0/3304594917 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb244151950 0x7fb2440bec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:22.541 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.528+0000 7fb248f19700 1 --2- 172.21.15.92:0/3304594917 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb2440724c0 0x7fb2440c0380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:22.542 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.528+0000 7fb248f19700 1 --2- 172.21.15.92:0/3304594917 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb2440c4930 0x7fb2440ac440 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:22.542 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.528+0000 7fb248f19700 1 -- 172.21.15.92:0/3304594917 >> 172.21.15.92:0/3304594917 conn(0x7fb2440a87e0 msgr2=0x7fb24406ef80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:35:22.542 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.528+0000 7fb248f19700 1 -- 172.21.15.92:0/3304594917 shutdown_connections 2023-07-25T14:35:22.542 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.528+0000 7fb248f19700 1 -- 172.21.15.92:0/3304594917 wait complete. 2023-07-25T14:35:22.552 DEBUG:teuthology.orchestra.run.smithi092:> sudo ceph --cluster ceph osd new e1564be3-f209-47e5-a8d0-32fc618a474f 1 2023-07-25T14:35:22.595 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-07-25T14:35:22.582+0000 7f1c41ed8200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-25T14:35:22.615 INFO:tasks.ceph.mgr.x.smithi092.stderr:2023-07-25T14:35:22.602+0000 7f95aaba9200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-25T14:35:22.670 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-07-25T14:35:22.657+0000 7f1c41ed8200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-25T14:35:22.673 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.660+0000 7f3108c4c700 1 Processor -- start 2023-07-25T14:35:22.673 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.660+0000 7f3108c4c700 1 -- start start 2023-07-25T14:35:22.675 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.661+0000 7f3108c4c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f3104151950 0x7f310406a190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:22.676 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.661+0000 7f3108c4c700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f31040724c0 0x7f31040c34c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:22.676 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.661+0000 7f3108c4c700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31040c2fe0 con 0x7f310406a6d0 2023-07-25T14:35:22.676 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.661+0000 7f3108c4c700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3104071a60 con 0x7f3104151950 2023-07-25T14:35:22.676 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.661+0000 7f3108c4c700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31040c2a70 con 0x7f31040724c0 2023-07-25T14:35:22.677 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.661+0000 7f3101d9b700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f31040724c0 0x7f31040c34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:22.677 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.661+0000 7f3101d9b700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f31040724c0 0x7f31040c34c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3301/0 says I am v2:172.21.15.92:46744/0 (socket says 172.21.15.92:46744) 2023-07-25T14:35:22.677 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.661+0000 7f3101d9b700 1 -- 172.21.15.92:0/391975282 learned_addr learned my addr 172.21.15.92:0/391975282 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-07-25T14:35:22.677 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.661+0000 7f310259c700 1 --2- 172.21.15.92:0/391975282 >> v2:172.21.15.72:3300/0 conn(0x7f3104151950 0x7f310406a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:22.677 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.662+0000 7f3101d9b700 1 -- 172.21.15.92:0/391975282 >> v2:172.21.15.72:3300/0 conn(0x7f3104151950 msgr2=0x7f310406a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:35:22.677 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.662+0000 7f3101d9b700 1 --2- 172.21.15.92:0/391975282 >> v2:172.21.15.72:3300/0 conn(0x7f3104151950 0x7f310406a190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:22.678 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.662+0000 7f3101d9b700 1 -- 172.21.15.92:0/391975282 >> v1:172.21.15.72:6789/0 conn(0x7f310406a6d0 legacy=0x7f31040c3a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:22.678 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.662+0000 7f3101d9b700 1 -- 172.21.15.92:0/391975282 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3104155070 con 0x7f31040724c0 2023-07-25T14:35:22.678 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.662+0000 7f3101d9b700 1 --2- 172.21.15.92:0/391975282 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f31040724c0 0x7f31040c34c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f30f80098f0 tx=0x7f30f8009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=93faf1d9304e98b5 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:35:22.678 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.662+0000 7f310159a700 1 -- 172.21.15.92:0/391975282 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30f8011830 con 0x7f31040724c0 2023-07-25T14:35:22.678 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.662+0000 7f310159a700 1 -- 172.21.15.92:0/391975282 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30f8011990 con 0x7f31040724c0 2023-07-25T14:35:22.678 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.662+0000 7f310159a700 1 -- 172.21.15.92:0/391975282 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30f8011d20 con 0x7f31040724c0 2023-07-25T14:35:22.678 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.663+0000 7f3108c4c700 1 -- 172.21.15.92:0/391975282 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f31040724c0 msgr2=0x7f31040c34c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:22.678 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.663+0000 7f3108c4c700 1 --2- 172.21.15.92:0/391975282 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f31040724c0 0x7f31040c34c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f30f80098f0 tx=0x7f30f8009c00 comp rx=0 tx=0).stop 2023-07-25T14:35:22.679 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.663+0000 7f3108c4c700 1 -- 172.21.15.92:0/391975282 shutdown_connections 2023-07-25T14:35:22.679 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.663+0000 7f3108c4c700 1 --2- 172.21.15.92:0/391975282 >> v2:172.21.15.72:3300/0 conn(0x7f3104151950 0x7f310406a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:22.679 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.663+0000 7f3108c4c700 1 --2- 172.21.15.92:0/391975282 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f31040724c0 0x7f31040c34c0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:22.679 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.663+0000 7f3108c4c700 1 -- 172.21.15.92:0/391975282 >> 172.21.15.92:0/391975282 conn(0x7f31040a87e0 msgr2=0x7f31040a8bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:35:22.679 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.663+0000 7f3108c4c700 1 -- 172.21.15.92:0/391975282 shutdown_connections 2023-07-25T14:35:22.679 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.663+0000 7f3108c4c700 1 -- 172.21.15.92:0/391975282 wait complete. 2023-07-25T14:35:22.681 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.664+0000 7f3108c4c700 1 Processor -- start 2023-07-25T14:35:22.682 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.664+0000 7f3108c4c700 1 -- start start 2023-07-25T14:35:22.682 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.665+0000 7f3108c4c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f310406a6d0 0x7f310406f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:22.682 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.665+0000 7f3108c4c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f31040724c0 0x7f31040bfa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:22.682 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.665+0000 7f3108c4c700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3104151950 0x7f31040bff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:22.682 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.665+0000 7f3108c4c700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31041ed5b0 con 0x7f310406a6d0 2023-07-25T14:35:22.682 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.665+0000 7f3108c4c700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31040bf630 con 0x7f31040724c0 2023-07-25T14:35:22.682 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.665+0000 7f3108c4c700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31040aa8c0 con 0x7f3104151950 2023-07-25T14:35:22.682 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.665+0000 7f3101d9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f31040724c0 0x7f31040bfa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:22.683 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.665+0000 7f3102d9d700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3104151950 0x7f31040bff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:22.683 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.665+0000 7f3101d9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f31040724c0 0x7f31040bfa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:39518/0 (socket says 172.21.15.92:39518) 2023-07-25T14:35:22.683 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.665+0000 7f3101d9b700 1 -- 172.21.15.92:0/1057622142 learned_addr learned my addr 172.21.15.92:0/1057622142 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-07-25T14:35:22.683 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.665+0000 7f310259c700 1 --2- 172.21.15.92:0/1057622142 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f310406a6d0 0x7f310406f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:22.683 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.665+0000 7f310259c700 1 -- 172.21.15.92:0/1057622142 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3104151950 msgr2=0x7f31040bff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:22.683 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.665+0000 7f310259c700 1 --2- 172.21.15.92:0/1057622142 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3104151950 0x7f31040bff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:22.683 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.665+0000 7f310259c700 1 -- 172.21.15.92:0/1057622142 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f31040724c0 msgr2=0x7f31040bfa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:22.684 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.665+0000 7f310259c700 1 --2- 172.21.15.92:0/1057622142 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f31040724c0 0x7f31040bfa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:22.684 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.665+0000 7f310259c700 1 -- 172.21.15.92:0/1057622142 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30f8009550 con 0x7f310406a6d0 2023-07-25T14:35:22.684 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.665+0000 7f3101d9b700 1 --2- 172.21.15.92:0/1057622142 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f31040724c0 0x7f31040bfa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-25T14:35:22.684 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.665+0000 7f3102d9d700 1 --2- 172.21.15.92:0/1057622142 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3104151950 0x7f31040bff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-25T14:35:22.684 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.665+0000 7f310259c700 1 --2- 172.21.15.92:0/1057622142 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f310406a6d0 0x7f310406f2c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f30f400e870 tx=0x7f30f400eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:35:22.684 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.666+0000 7f30f2ffd700 1 -- 172.21.15.92:0/1057622142 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30f4013680 con 0x7f310406a6d0 2023-07-25T14:35:22.685 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.666+0000 7f30f2ffd700 1 -- 172.21.15.92:0/1057622142 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30f40137e0 con 0x7f310406a6d0 2023-07-25T14:35:22.685 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.666+0000 7f3108c4c700 1 -- 172.21.15.92:0/1057622142 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31040a8380 con 0x7f310406a6d0 2023-07-25T14:35:22.685 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.666+0000 7f30f2ffd700 1 -- 172.21.15.92:0/1057622142 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30f4013b90 con 0x7f310406a6d0 2023-07-25T14:35:22.685 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.666+0000 7f3108c4c700 1 -- 172.21.15.92:0/1057622142 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31041ecef0 con 0x7f310406a6d0 2023-07-25T14:35:22.685 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.666+0000 7f30f2ffd700 1 -- 172.21.15.92:0/1057622142 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f30f4005a20 con 0x7f310406a6d0 2023-07-25T14:35:22.685 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.666+0000 7f30f2ffd700 1 -- 172.21.15.92:0/1057622142 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f30f401c800 con 0x7f310406a6d0 2023-07-25T14:35:22.686 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.666+0000 7f3108c4c700 1 -- 172.21.15.92:0/1057622142 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31041ed820 con 0x7f310406a6d0 2023-07-25T14:35:22.686 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.669+0000 7f30f2ffd700 1 -- 172.21.15.92:0/1057622142 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f30f4021060 con 0x7f310406a6d0 2023-07-25T14:35:22.694 INFO:tasks.ceph.mgr.x.smithi092.stderr:2023-07-25T14:35:22.682+0000 7f95aaba9200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-25T14:35:22.766 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.753+0000 7f3108c4c700 1 -- 172.21.15.92:0/1057622142 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd new", "uuid": "e1564be3-f209-47e5-a8d0-32fc618a474f", "id": 1} v 0) v1 -- 0x7f310404e470 con 0x7f310406a6d0 2023-07-25T14:35:22.774 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.762+0000 7f30f2ffd700 1 -- 172.21.15.92:0/1057622142 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e1564be3-f209-47e5-a8d0-32fc618a474f", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f30f4017070 con 0x7f310406a6d0 2023-07-25T14:35:22.774 INFO:teuthology.orchestra.run.smithi092.stdout:1 2023-07-25T14:35:22.775 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.763+0000 7f3108c4c700 1 -- 172.21.15.92:0/1057622142 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f310406a6d0 msgr2=0x7f310406f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:22.775 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.763+0000 7f3108c4c700 1 --2- 172.21.15.92:0/1057622142 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f310406a6d0 0x7f310406f2c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f30f400e870 tx=0x7f30f400eb80 comp rx=0 tx=0).stop 2023-07-25T14:35:22.776 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.763+0000 7f3108c4c700 1 -- 172.21.15.92:0/1057622142 shutdown_connections 2023-07-25T14:35:22.776 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.763+0000 7f3108c4c700 1 --2- 172.21.15.92:0/1057622142 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3104151950 0x7f31040bff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:22.776 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.763+0000 7f3108c4c700 1 --2- 172.21.15.92:0/1057622142 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f310406a6d0 0x7f310406f2c0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:22.776 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.763+0000 7f3108c4c700 1 --2- 172.21.15.92:0/1057622142 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f31040724c0 0x7f31040bfa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:22.776 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.763+0000 7f3108c4c700 1 -- 172.21.15.92:0/1057622142 >> 172.21.15.92:0/1057622142 conn(0x7f31040a87e0 msgr2=0x7f310414fca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:35:22.777 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.763+0000 7f3108c4c700 1 -- 172.21.15.92:0/1057622142 shutdown_connections 2023-07-25T14:35:22.777 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.763+0000 7f3108c4c700 1 -- 172.21.15.92:0/1057622142 wait complete. 2023-07-25T14:35:22.787 DEBUG:teuthology.orchestra.run.smithi092:> sudo ceph --cluster ceph osd new c4647d30-ffa6-417a-9026-ef530c75910e 2 2023-07-25T14:35:22.791 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-07-25T14:35:22.779+0000 7f1c41ed8200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-25T14:35:22.834 INFO:tasks.ceph.mgr.x.smithi092.stderr:2023-07-25T14:35:22.821+0000 7f95aaba9200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-25T14:35:22.872 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-07-25T14:35:22.859+0000 7f1c41ed8200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-25T14:35:22.907 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.894+0000 7f5d22de4700 1 Processor -- start 2023-07-25T14:35:22.907 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.894+0000 7f5d22de4700 1 -- start start 2023-07-25T14:35:22.909 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.895+0000 7f5d22de4700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5d1c151950 0x7f5d1c06a190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:22.910 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.895+0000 7f5d22de4700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f5d1c06a6d0 0x7f5d1c0c3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:22.910 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.895+0000 7f5d22de4700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d1c0c2fe0 con 0x7f5d1c0724c0 2023-07-25T14:35:22.910 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.895+0000 7f5d22de4700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d1c071a60 con 0x7f5d1c06a6d0 2023-07-25T14:35:22.910 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.895+0000 7f5d22de4700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d1c0c2a70 con 0x7f5d1c151950 2023-07-25T14:35:22.910 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.895+0000 7f5d20b80700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5d1c151950 0x7f5d1c06a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:22.910 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.895+0000 7f5d1bfff700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f5d1c0724c0 0x7f5d1c0c34c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:51378/0 (socket says 172.21.15.92:51378) 2023-07-25T14:35:22.910 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.895+0000 7f5d20b80700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5d1c151950 0x7f5d1c06a190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3301/0 says I am v2:172.21.15.92:46754/0 (socket says 172.21.15.92:46754) 2023-07-25T14:35:22.911 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.895+0000 7f5d1bfff700 1 -- 172.21.15.92:0/889809958 learned_addr learned my addr 172.21.15.92:0/889809958 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-07-25T14:35:22.911 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.895+0000 7f5d21381700 1 --2- 172.21.15.92:0/889809958 >> v2:172.21.15.92:3300/0 conn(0x7f5d1c06a6d0 0x7f5d1c0c3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:22.911 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.895+0000 7f5d1b7fe700 1 -- 172.21.15.92:0/889809958 <== mon.1 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3600955044 0 0) 0x7f5d1c0c2fe0 con 0x7f5d1c0724c0 2023-07-25T14:35:22.911 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.895+0000 7f5d20b80700 1 -- 172.21.15.92:0/889809958 >> v2:172.21.15.92:3300/0 conn(0x7f5d1c06a6d0 msgr2=0x7f5d1c0c3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:35:22.911 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.895+0000 7f5d20b80700 1 --2- 172.21.15.92:0/889809958 >> v2:172.21.15.92:3300/0 conn(0x7f5d1c06a6d0 0x7f5d1c0c3bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:22.911 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.895+0000 7f5d20b80700 1 -- 172.21.15.92:0/889809958 >> v1:172.21.15.92:6789/0 conn(0x7f5d1c0724c0 legacy=0x7f5d1c0c34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:22.911 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.895+0000 7f5d20b80700 1 -- 172.21.15.92:0/889809958 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d1c155070 con 0x7f5d1c151950 2023-07-25T14:35:22.912 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.895+0000 7f5d20b80700 1 --2- 172.21.15.92:0/889809958 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5d1c151950 0x7f5d1c06a190 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f5d10009840 tx=0x7f5d10009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4568e2b6bc563a0c server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:35:22.912 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.895+0000 7f5d1b7fe700 1 -- 172.21.15.92:0/889809958 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d10011830 con 0x7f5d1c151950 2023-07-25T14:35:22.912 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.895+0000 7f5d1b7fe700 1 -- 172.21.15.92:0/889809958 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d10011990 con 0x7f5d1c151950 2023-07-25T14:35:22.912 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.895+0000 7f5d1b7fe700 1 -- 172.21.15.92:0/889809958 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d10011d20 con 0x7f5d1c151950 2023-07-25T14:35:22.912 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.896+0000 7f5d22de4700 1 -- 172.21.15.92:0/889809958 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5d1c151950 msgr2=0x7f5d1c06a190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:22.912 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.896+0000 7f5d22de4700 1 --2- 172.21.15.92:0/889809958 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5d1c151950 0x7f5d1c06a190 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f5d10009840 tx=0x7f5d10009b50 comp rx=0 tx=0).stop 2023-07-25T14:35:22.913 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.896+0000 7f5d22de4700 1 -- 172.21.15.92:0/889809958 shutdown_connections 2023-07-25T14:35:22.913 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.896+0000 7f5d22de4700 1 --2- 172.21.15.92:0/889809958 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5d1c151950 0x7f5d1c06a190 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:22.913 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.896+0000 7f5d22de4700 1 --2- 172.21.15.92:0/889809958 >> v2:172.21.15.92:3300/0 conn(0x7f5d1c06a6d0 0x7f5d1c0c3bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:22.913 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.896+0000 7f5d22de4700 1 -- 172.21.15.92:0/889809958 >> 172.21.15.92:0/889809958 conn(0x7f5d1c0a87e0 msgr2=0x7f5d1c0a8bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:35:22.913 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.896+0000 7f5d22de4700 1 -- 172.21.15.92:0/889809958 shutdown_connections 2023-07-25T14:35:22.913 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.896+0000 7f5d22de4700 1 -- 172.21.15.92:0/889809958 wait complete. 2023-07-25T14:35:22.913 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.897+0000 7f5d22de4700 1 Processor -- start 2023-07-25T14:35:22.914 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.897+0000 7f5d22de4700 1 -- start start 2023-07-25T14:35:22.916 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.898+0000 7f5d22de4700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5d1c06a6d0 0x7f5d1c1534e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:22.916 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.898+0000 7f5d22de4700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5d1c0724c0 0x7f5d1c1eacc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:22.916 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.898+0000 7f5d22de4700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5d1c151950 0x7f5d1c1eb200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:22.916 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.898+0000 7f5d22de4700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d1c0bf4c0 con 0x7f5d1c151950 2023-07-25T14:35:22.917 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.898+0000 7f5d22de4700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d1c0ac9d0 con 0x7f5d1c0724c0 2023-07-25T14:35:22.917 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.898+0000 7f5d22de4700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d1c1eb740 con 0x7f5d1c06a6d0 2023-07-25T14:35:22.917 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.898+0000 7f5d1bfff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5d1c0724c0 0x7f5d1c1eacc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:22.917 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.898+0000 7f5d1bfff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5d1c0724c0 0x7f5d1c1eacc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:39528/0 (socket says 172.21.15.92:39528) 2023-07-25T14:35:22.917 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.898+0000 7f5d1bfff700 1 -- 172.21.15.92:0/3115753455 learned_addr learned my addr 172.21.15.92:0/3115753455 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-07-25T14:35:22.917 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.898+0000 7f5d20b80700 1 --2- 172.21.15.92:0/3115753455 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5d1c06a6d0 0x7f5d1c1534e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:22.917 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.898+0000 7f5d21381700 1 --2- 172.21.15.92:0/3115753455 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5d1c151950 0x7f5d1c1eb200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:22.917 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.898+0000 7f5d1bfff700 1 -- 172.21.15.92:0/3115753455 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5d1c06a6d0 msgr2=0x7f5d1c1534e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:22.918 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.898+0000 7f5d1bfff700 1 --2- 172.21.15.92:0/3115753455 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5d1c06a6d0 0x7f5d1c1534e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:22.918 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.898+0000 7f5d1bfff700 1 -- 172.21.15.92:0/3115753455 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5d1c151950 msgr2=0x7f5d1c1eb200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:22.918 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.898+0000 7f5d1bfff700 1 --2- 172.21.15.92:0/3115753455 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5d1c151950 0x7f5d1c1eb200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:22.918 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.898+0000 7f5d1bfff700 1 -- 172.21.15.92:0/3115753455 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d100094a0 con 0x7f5d1c0724c0 2023-07-25T14:35:22.918 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.898+0000 7f5d21381700 1 --2- 172.21.15.92:0/3115753455 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5d1c151950 0x7f5d1c1eb200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-25T14:35:22.919 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.899+0000 7f5d1bfff700 1 --2- 172.21.15.92:0/3115753455 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5d1c0724c0 0x7f5d1c1eacc0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f5d0800c540 tx=0x7f5d0800c850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:35:22.919 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.899+0000 7f5d197fa700 1 -- 172.21.15.92:0/3115753455 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d08004c80 con 0x7f5d1c0724c0 2023-07-25T14:35:22.919 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.899+0000 7f5d197fa700 1 -- 172.21.15.92:0/3115753455 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d08004de0 con 0x7f5d1c0724c0 2023-07-25T14:35:22.919 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.899+0000 7f5d197fa700 1 -- 172.21.15.92:0/3115753455 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d08007310 con 0x7f5d1c0724c0 2023-07-25T14:35:22.919 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.899+0000 7f5d22de4700 1 -- 172.21.15.92:0/3115753455 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d1c0bf950 con 0x7f5d1c0724c0 2023-07-25T14:35:22.919 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.899+0000 7f5d22de4700 1 -- 172.21.15.92:0/3115753455 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d1c0beb90 con 0x7f5d1c0724c0 2023-07-25T14:35:22.920 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.899+0000 7f5d197fa700 1 -- 172.21.15.92:0/3115753455 <== mon.1 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f5d0801d3f0 con 0x7f5d1c0724c0 2023-07-25T14:35:22.920 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.899+0000 7f5d197fa700 1 -- 172.21.15.92:0/3115753455 <== mon.1 v2:172.21.15.92:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7f5d080137e0 con 0x7f5d1c0724c0 2023-07-25T14:35:22.920 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.900+0000 7f5d22de4700 1 -- 172.21.15.92:0/3115753455 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d1c0bf630 con 0x7f5d1c0724c0 2023-07-25T14:35:22.920 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.902+0000 7f5d197fa700 1 -- 172.21.15.92:0/3115753455 <== mon.1 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f5d08013470 con 0x7f5d1c0724c0 2023-07-25T14:35:22.921 INFO:tasks.ceph.mgr.x.smithi092.stderr:2023-07-25T14:35:22.906+0000 7f95aaba9200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-25T14:35:22.998 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.985+0000 7f5d22de4700 1 -- 172.21.15.92:0/3115753455 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd new", "uuid": "c4647d30-ffa6-417a-9026-ef530c75910e", "id": 2} v 0) v1 -- 0x7f5d1c04e470 con 0x7f5d1c0724c0 2023-07-25T14:35:23.006 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.993+0000 7f5d197fa700 1 -- 172.21.15.92:0/3115753455 <== mon.1 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c4647d30-ffa6-417a-9026-ef530c75910e", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f5d08013a40 con 0x7f5d1c0724c0 2023-07-25T14:35:23.006 INFO:teuthology.orchestra.run.smithi092.stdout:2 2023-07-25T14:35:23.007 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.994+0000 7f5d22de4700 1 -- 172.21.15.92:0/3115753455 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5d1c0724c0 msgr2=0x7f5d1c1eacc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:23.007 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.994+0000 7f5d22de4700 1 --2- 172.21.15.92:0/3115753455 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5d1c0724c0 0x7f5d1c1eacc0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f5d0800c540 tx=0x7f5d0800c850 comp rx=0 tx=0).stop 2023-07-25T14:35:23.007 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.994+0000 7f5d22de4700 1 -- 172.21.15.92:0/3115753455 shutdown_connections 2023-07-25T14:35:23.007 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.994+0000 7f5d22de4700 1 --2- 172.21.15.92:0/3115753455 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5d1c06a6d0 0x7f5d1c1534e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:23.007 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.994+0000 7f5d22de4700 1 --2- 172.21.15.92:0/3115753455 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5d1c151950 0x7f5d1c1eb200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:23.008 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.994+0000 7f5d22de4700 1 --2- 172.21.15.92:0/3115753455 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5d1c0724c0 0x7f5d1c1eacc0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:23.008 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.994+0000 7f5d22de4700 1 -- 172.21.15.92:0/3115753455 >> 172.21.15.92:0/3115753455 conn(0x7f5d1c0a87e0 msgr2=0x7f5d1c0c36a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:35:23.008 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.994+0000 7f5d22de4700 1 -- 172.21.15.92:0/3115753455 shutdown_connections 2023-07-25T14:35:23.008 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:22.994+0000 7f5d22de4700 1 -- 172.21.15.92:0/3115753455 wait complete. 2023-07-25T14:35:23.018 DEBUG:teuthology.orchestra.run.smithi092:> sudo ceph --cluster ceph osd new 76c9d9a7-c2e2-4612-a58b-d6882dd76b58 3 2023-07-25T14:35:23.140 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.127+0000 7fdd8735d700 1 Processor -- start 2023-07-25T14:35:23.140 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.127+0000 7fdd8735d700 1 -- start start 2023-07-25T14:35:23.142 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.128+0000 7fdd8735d700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fdd801518c0 0x7fdd8006b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:23.142 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.128+0000 7fdd8735d700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fdd800c4370 0x7fdd800c47a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:23.142 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.128+0000 7fdd8735d700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd80157cd0 con 0x7fdd80154df0 2023-07-25T14:35:23.142 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.128+0000 7fdd8735d700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd800c2310 con 0x7fdd800c4370 2023-07-25T14:35:23.143 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.128+0000 7fdd8735d700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd80158870 con 0x7fdd801518c0 2023-07-25T14:35:23.143 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.128+0000 7fdd858fa700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fdd800c4370 0x7fdd800c47a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:23.143 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.128+0000 7fdd850f9700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fdd801518c0 0x7fdd8006b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:23.143 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.128+0000 7fdd858fa700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fdd800c4370 0x7fdd800c47a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:39536/0 (socket says 172.21.15.92:39536) 2023-07-25T14:35:23.143 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.128+0000 7fdd858fa700 1 -- 172.21.15.92:0/1047426101 learned_addr learned my addr 172.21.15.92:0/1047426101 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-07-25T14:35:23.143 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.128+0000 7fdd850f9700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fdd801518c0 0x7fdd8006b2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3301/0 says I am v2:172.21.15.92:46764/0 (socket says 172.21.15.92:46764) 2023-07-25T14:35:23.144 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.128+0000 7fdd848f8700 1 --1- 172.21.15.92:0/1047426101 >> v1:172.21.15.92:6789/0 conn(0x7fdd80154df0 0x7fdd80158160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:51388/0 (socket says 172.21.15.92:51388) 2023-07-25T14:35:23.144 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.129+0000 7fdd858fa700 1 -- 172.21.15.92:0/1047426101 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fdd801518c0 msgr2=0x7fdd8006b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:35:23.144 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.129+0000 7fdd858fa700 1 --2- 172.21.15.92:0/1047426101 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fdd801518c0 0x7fdd8006b2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:23.144 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.129+0000 7fdd858fa700 1 -- 172.21.15.92:0/1047426101 >> v1:172.21.15.92:6789/0 conn(0x7fdd80154df0 legacy=0x7fdd80158160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:23.144 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.129+0000 7fdd858fa700 1 -- 172.21.15.92:0/1047426101 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd801552a0 con 0x7fdd800c4370 2023-07-25T14:35:23.144 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.129+0000 7fdd850f9700 1 --2- 172.21.15.92:0/1047426101 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fdd801518c0 0x7fdd8006b2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-25T14:35:23.145 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.129+0000 7fdd858fa700 1 --2- 172.21.15.92:0/1047426101 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdd800c4370 0x7fdd800c47a0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fdd78009e50 tx=0x7fdd7800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5d0e8a26d6e74a53 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:35:23.145 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.129+0000 7fdd77fff700 1 -- 172.21.15.92:0/1047426101 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd7800e070 con 0x7fdd800c4370 2023-07-25T14:35:23.145 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.129+0000 7fdd77fff700 1 -- 172.21.15.92:0/1047426101 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd7800b910 con 0x7fdd800c4370 2023-07-25T14:35:23.145 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.129+0000 7fdd77fff700 1 -- 172.21.15.92:0/1047426101 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd7800bcc0 con 0x7fdd800c4370 2023-07-25T14:35:23.145 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.129+0000 7fdd8735d700 1 -- 172.21.15.92:0/1047426101 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdd800c4370 msgr2=0x7fdd800c47a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:23.145 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.129+0000 7fdd8735d700 1 --2- 172.21.15.92:0/1047426101 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdd800c4370 0x7fdd800c47a0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fdd78009e50 tx=0x7fdd7800b330 comp rx=0 tx=0).stop 2023-07-25T14:35:23.145 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.130+0000 7fdd8735d700 1 -- 172.21.15.92:0/1047426101 shutdown_connections 2023-07-25T14:35:23.145 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.130+0000 7fdd8735d700 1 --2- 172.21.15.92:0/1047426101 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fdd801518c0 0x7fdd8006b2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:23.146 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.130+0000 7fdd8735d700 1 --2- 172.21.15.92:0/1047426101 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdd800c4370 0x7fdd800c47a0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:23.146 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.130+0000 7fdd8735d700 1 -- 172.21.15.92:0/1047426101 >> 172.21.15.92:0/1047426101 conn(0x7fdd8006a8d0 msgr2=0x7fdd800a94e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:35:23.146 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.130+0000 7fdd8735d700 1 -- 172.21.15.92:0/1047426101 shutdown_connections 2023-07-25T14:35:23.146 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.130+0000 7fdd8735d700 1 -- 172.21.15.92:0/1047426101 wait complete. 2023-07-25T14:35:23.148 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.131+0000 7fdd8735d700 1 Processor -- start 2023-07-25T14:35:23.148 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.131+0000 7fdd8735d700 1 -- start start 2023-07-25T14:35:23.148 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.131+0000 7fdd8735d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdd800c4370 0x7fdd80153a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:23.148 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.131+0000 7fdd8735d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdd801518c0 0x7fdd800c69d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:23.148 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.131+0000 7fdd8735d700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fdd80154df0 0x7fdd800c6f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:23.149 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.131+0000 7fdd8735d700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd8014bd90 con 0x7fdd801518c0 2023-07-25T14:35:23.149 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.131+0000 7fdd8735d700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd800a8f20 con 0x7fdd800c4370 2023-07-25T14:35:23.149 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.131+0000 7fdd8735d700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd800aaee0 con 0x7fdd80154df0 2023-07-25T14:35:23.149 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.132+0000 7fdd850f9700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdd800c4370 0x7fdd80153a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:23.149 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.132+0000 7fdd850f9700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdd800c4370 0x7fdd80153a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:39538/0 (socket says 172.21.15.92:39538) 2023-07-25T14:35:23.149 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.132+0000 7fdd858fa700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fdd80154df0 0x7fdd800c6f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:23.149 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.132+0000 7fdd850f9700 1 -- 172.21.15.92:0/1548646067 learned_addr learned my addr 172.21.15.92:0/1548646067 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-07-25T14:35:23.150 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.132+0000 7fdd848f8700 1 --2- 172.21.15.92:0/1548646067 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdd801518c0 0x7fdd800c69d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:23.150 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.132+0000 7fdd858fa700 1 -- 172.21.15.92:0/1548646067 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdd800c4370 msgr2=0x7fdd80153a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:23.150 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.132+0000 7fdd858fa700 1 --2- 172.21.15.92:0/1548646067 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdd800c4370 0x7fdd80153a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:23.150 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.132+0000 7fdd858fa700 1 -- 172.21.15.92:0/1548646067 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdd801518c0 msgr2=0x7fdd800c69d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:23.150 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.132+0000 7fdd858fa700 1 --2- 172.21.15.92:0/1548646067 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdd801518c0 0x7fdd800c69d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:23.150 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.132+0000 7fdd858fa700 1 -- 172.21.15.92:0/1548646067 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd7c0094a0 con 0x7fdd80154df0 2023-07-25T14:35:23.150 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.132+0000 7fdd850f9700 1 --2- 172.21.15.92:0/1548646067 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdd800c4370 0x7fdd80153a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-25T14:35:23.150 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.132+0000 7fdd858fa700 1 --2- 172.21.15.92:0/1548646067 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fdd80154df0 0x7fdd800c6f10 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fdd800c4f30 tx=0x7fdd78004b20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:35:23.151 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.132+0000 7fdd75ffb700 1 -- 172.21.15.92:0/1548646067 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd78004800 con 0x7fdd80154df0 2023-07-25T14:35:23.151 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.132+0000 7fdd75ffb700 1 -- 172.21.15.92:0/1548646067 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd780092e0 con 0x7fdd80154df0 2023-07-25T14:35:23.151 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.132+0000 7fdd8735d700 1 -- 172.21.15.92:0/1548646067 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd78009b30 con 0x7fdd80154df0 2023-07-25T14:35:23.151 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.132+0000 7fdd75ffb700 1 -- 172.21.15.92:0/1548646067 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd7801c680 con 0x7fdd80154df0 2023-07-25T14:35:23.151 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.132+0000 7fdd8735d700 1 -- 172.21.15.92:0/1548646067 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd800c7450 con 0x7fdd80154df0 2023-07-25T14:35:23.151 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.133+0000 7fdd75ffb700 1 -- 172.21.15.92:0/1548646067 <== mon.2 v2:172.21.15.92:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fdd7801cae0 con 0x7fdd80154df0 2023-07-25T14:35:23.151 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.133+0000 7fdd75ffb700 1 -- 172.21.15.92:0/1548646067 <== mon.2 v2:172.21.15.92:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7fdd78025d90 con 0x7fdd80154df0 2023-07-25T14:35:23.152 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.133+0000 7fdd8735d700 1 -- 172.21.15.92:0/1548646067 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd800a8d90 con 0x7fdd80154df0 2023-07-25T14:35:23.152 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.137+0000 7fdd75ffb700 1 -- 172.21.15.92:0/1548646067 <== mon.2 v2:172.21.15.92:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7fdd78043b00 con 0x7fdd80154df0 2023-07-25T14:35:23.232 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.219+0000 7fdd8735d700 1 -- 172.21.15.92:0/1548646067 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_command({"prefix": "osd new", "uuid": "76c9d9a7-c2e2-4612-a58b-d6882dd76b58", "id": 3} v 0) v1 -- 0x7fdd8004e470 con 0x7fdd80154df0 2023-07-25T14:35:23.239 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.227+0000 7fdd75ffb700 1 -- 172.21.15.92:0/1548646067 <== mon.2 v2:172.21.15.92:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "76c9d9a7-c2e2-4612-a58b-d6882dd76b58", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7fdd78032030 con 0x7fdd80154df0 2023-07-25T14:35:23.240 INFO:teuthology.orchestra.run.smithi092.stdout:3 2023-07-25T14:35:23.241 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.228+0000 7fdd8735d700 1 -- 172.21.15.92:0/1548646067 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fdd80154df0 msgr2=0x7fdd800c6f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:23.241 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.228+0000 7fdd8735d700 1 --2- 172.21.15.92:0/1548646067 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fdd80154df0 0x7fdd800c6f10 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fdd800c4f30 tx=0x7fdd78004b20 comp rx=0 tx=0).stop 2023-07-25T14:35:23.241 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.228+0000 7fdd8735d700 1 -- 172.21.15.92:0/1548646067 shutdown_connections 2023-07-25T14:35:23.241 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.228+0000 7fdd8735d700 1 --2- 172.21.15.92:0/1548646067 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fdd80154df0 0x7fdd800c6f10 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:23.241 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.228+0000 7fdd8735d700 1 --2- 172.21.15.92:0/1548646067 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdd800c4370 0x7fdd80153a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:23.242 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.228+0000 7fdd8735d700 1 --2- 172.21.15.92:0/1548646067 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdd801518c0 0x7fdd800c69d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:23.242 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.228+0000 7fdd8735d700 1 -- 172.21.15.92:0/1548646067 >> 172.21.15.92:0/1548646067 conn(0x7fdd8006a8d0 msgr2=0x7fdd8006b890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:35:23.242 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.228+0000 7fdd8735d700 1 -- 172.21.15.92:0/1548646067 shutdown_connections 2023-07-25T14:35:23.242 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.228+0000 7fdd8735d700 1 -- 172.21.15.92:0/1548646067 wait complete. 2023-07-25T14:35:23.252 DEBUG:teuthology.orchestra.run.smithi092:> sudo ceph --cluster ceph osd new 7f8920dc-0ad4-4a73-ab40-65408f83eadd 4 2023-07-25T14:35:23.323 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-07-25T14:35:23.310+0000 7f1c41ed8200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-25T14:35:23.366 INFO:tasks.ceph.mgr.x.smithi092.stderr:2023-07-25T14:35:23.352+0000 7f95aaba9200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-25T14:35:23.372 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.358+0000 7f9ff7e8e700 1 Processor -- start 2023-07-25T14:35:23.372 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.359+0000 7f9ff7e8e700 1 -- start start 2023-07-25T14:35:23.374 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.359+0000 7f9ff7e8e700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9ff0151950 0x7f9ff006a190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:23.374 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.359+0000 7f9ff7e8e700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f9ff00724c0 0x7f9ff00c34c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:23.375 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.359+0000 7f9ff7e8e700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ff00c2fe0 con 0x7f9ff006a6d0 2023-07-25T14:35:23.375 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.359+0000 7f9ff7e8e700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ff0071a60 con 0x7f9ff00724c0 2023-07-25T14:35:23.375 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.359+0000 7f9ff7e8e700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ff00c2a70 con 0x7f9ff0151950 2023-07-25T14:35:23.375 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.360+0000 7f9ff5429700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f9ff00724c0 0x7f9ff00c34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:23.376 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.360+0000 7f9ff5c2a700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9ff0151950 0x7f9ff006a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:23.376 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.360+0000 7f9ff642b700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f9ff006a6d0 0x7f9ff00c3a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:51402/0 (socket says 172.21.15.92:51402) 2023-07-25T14:35:23.376 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.360+0000 7f9ff642b700 1 -- 172.21.15.92:0/3712026443 learned_addr learned my addr 172.21.15.92:0/3712026443 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-07-25T14:35:23.376 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.360+0000 7f9ff5c2a700 1 -- 172.21.15.92:0/3712026443 >> v2:172.21.15.92:3300/0 conn(0x7f9ff00724c0 msgr2=0x7f9ff00c34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:35:23.376 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.360+0000 7f9ff5c2a700 1 --2- 172.21.15.92:0/3712026443 >> v2:172.21.15.92:3300/0 conn(0x7f9ff00724c0 0x7f9ff00c34c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:23.376 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.360+0000 7f9ff5c2a700 1 -- 172.21.15.92:0/3712026443 >> v1:172.21.15.92:6789/0 conn(0x7f9ff006a6d0 legacy=0x7f9ff00c3a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:23.376 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.360+0000 7f9ff5c2a700 1 -- 172.21.15.92:0/3712026443 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ff0155070 con 0x7f9ff0151950 2023-07-25T14:35:23.377 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.360+0000 7f9ff4c28700 1 -- 172.21.15.92:0/3712026443 <== mon.1 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1194330397 0 0) 0x7f9ff00c2fe0 con 0x7f9ff006a6d0 2023-07-25T14:35:23.377 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.360+0000 7f9ff5429700 1 --2- 172.21.15.92:0/3712026443 >> v2:172.21.15.92:3300/0 conn(0x7f9ff00724c0 0x7f9ff00c34c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-25T14:35:23.377 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.360+0000 7f9ff5c2a700 1 --2- 172.21.15.92:0/3712026443 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9ff0151950 0x7f9ff006a190 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f9fec009840 tx=0x7f9fec009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=22ec0bfb625d8eac server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:35:23.377 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.360+0000 7f9ff4c28700 1 -- 172.21.15.92:0/3712026443 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fec011830 con 0x7f9ff0151950 2023-07-25T14:35:23.377 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.360+0000 7f9ff4c28700 1 -- 172.21.15.92:0/3712026443 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fec011990 con 0x7f9ff0151950 2023-07-25T14:35:23.377 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.360+0000 7f9ff4c28700 1 -- 172.21.15.92:0/3712026443 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fec011d20 con 0x7f9ff0151950 2023-07-25T14:35:23.378 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.361+0000 7f9ff7e8e700 1 -- 172.21.15.92:0/3712026443 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9ff0151950 msgr2=0x7f9ff006a190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:23.378 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.361+0000 7f9ff7e8e700 1 --2- 172.21.15.92:0/3712026443 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9ff0151950 0x7f9ff006a190 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f9fec009840 tx=0x7f9fec009b50 comp rx=0 tx=0).stop 2023-07-25T14:35:23.378 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.361+0000 7f9ff7e8e700 1 -- 172.21.15.92:0/3712026443 shutdown_connections 2023-07-25T14:35:23.378 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.361+0000 7f9ff7e8e700 1 --2- 172.21.15.92:0/3712026443 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9ff0151950 0x7f9ff006a190 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:23.378 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.361+0000 7f9ff7e8e700 1 --2- 172.21.15.92:0/3712026443 >> v2:172.21.15.92:3300/0 conn(0x7f9ff00724c0 0x7f9ff00c34c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:23.378 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.361+0000 7f9ff7e8e700 1 -- 172.21.15.92:0/3712026443 >> 172.21.15.92:0/3712026443 conn(0x7f9ff00a87e0 msgr2=0x7f9ff00a8bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:35:23.378 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.361+0000 7f9ff7e8e700 1 -- 172.21.15.92:0/3712026443 shutdown_connections 2023-07-25T14:35:23.379 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.361+0000 7f9ff7e8e700 1 -- 172.21.15.92:0/3712026443 wait complete. 2023-07-25T14:35:23.380 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.362+0000 7f9ff7e8e700 1 Processor -- start 2023-07-25T14:35:23.381 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.362+0000 7f9ff7e8e700 1 -- start start 2023-07-25T14:35:23.381 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.363+0000 7f9ff7e8e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9ff006a6d0 0x7f9ff01ed2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:23.381 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.363+0000 7f9ff7e8e700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9ff00724c0 0x7f9ff014cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:23.381 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.363+0000 7f9ff7e8e700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9ff0151950 0x7f9ff00ac3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:23.381 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.363+0000 7f9ff7e8e700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ff0157d60 con 0x7f9ff006a6d0 2023-07-25T14:35:23.381 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.363+0000 7f9ff7e8e700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ff014d5a0 con 0x7f9ff00724c0 2023-07-25T14:35:23.381 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.363+0000 7f9ff7e8e700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ff01e92c0 con 0x7f9ff0151950 2023-07-25T14:35:23.382 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.363+0000 7f9ff642b700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9ff0151950 0x7f9ff00ac3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:23.382 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.363+0000 7f9ff5429700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9ff00724c0 0x7f9ff014cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:23.382 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.363+0000 7f9ff642b700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9ff0151950 0x7f9ff00ac3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3301/0 says I am v2:172.21.15.92:46784/0 (socket says 172.21.15.92:46784) 2023-07-25T14:35:23.382 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.363+0000 7f9ff642b700 1 -- 172.21.15.92:0/938615411 learned_addr learned my addr 172.21.15.92:0/938615411 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-07-25T14:35:23.382 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.363+0000 7f9ff5429700 1 --2- 172.21.15.92:0/938615411 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9ff00724c0 0x7f9ff014cb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:39550/0 (socket says 172.21.15.92:39550) 2023-07-25T14:35:23.382 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.363+0000 7f9ff5c2a700 1 --2- 172.21.15.92:0/938615411 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9ff006a6d0 0x7f9ff01ed2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:23.382 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.363+0000 7f9ff642b700 1 -- 172.21.15.92:0/938615411 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9ff00724c0 msgr2=0x7f9ff014cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:23.383 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.363+0000 7f9ff642b700 1 --2- 172.21.15.92:0/938615411 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9ff00724c0 0x7f9ff014cb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:23.383 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.363+0000 7f9ff642b700 1 -- 172.21.15.92:0/938615411 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9ff006a6d0 msgr2=0x7f9ff01ed2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:23.383 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.363+0000 7f9ff642b700 1 --2- 172.21.15.92:0/938615411 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9ff006a6d0 0x7f9ff01ed2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:23.383 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.363+0000 7f9ff642b700 1 -- 172.21.15.92:0/938615411 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fe00094a0 con 0x7f9ff0151950 2023-07-25T14:35:23.383 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.363+0000 7f9ff5429700 1 --2- 172.21.15.92:0/938615411 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9ff00724c0 0x7f9ff014cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-25T14:35:23.383 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.363+0000 7f9ff5c2a700 1 --2- 172.21.15.92:0/938615411 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9ff006a6d0 0x7f9ff01ed2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-25T14:35:23.383 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.364+0000 7f9ff642b700 1 --2- 172.21.15.92:0/938615411 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9ff0151950 0x7f9ff00ac3d0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f9fe8002230 tx=0x7f9fe800cf50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:35:23.383 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.364+0000 7f9fe67fc700 1 -- 172.21.15.92:0/938615411 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fe800ab70 con 0x7f9ff0151950 2023-07-25T14:35:23.384 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.364+0000 7f9fe67fc700 1 -- 172.21.15.92:0/938615411 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fe800acf0 con 0x7f9ff0151950 2023-07-25T14:35:23.384 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.364+0000 7f9ff7e8e700 1 -- 172.21.15.92:0/938615411 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fec0094a0 con 0x7f9ff0151950 2023-07-25T14:35:23.384 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.364+0000 7f9fe67fc700 1 -- 172.21.15.92:0/938615411 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fe8007310 con 0x7f9ff0151950 2023-07-25T14:35:23.384 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.364+0000 7f9ff7e8e700 1 -- 172.21.15.92:0/938615411 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ff014d090 con 0x7f9ff0151950 2023-07-25T14:35:23.384 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.364+0000 7f9fe67fc700 1 -- 172.21.15.92:0/938615411 <== mon.2 v2:172.21.15.92:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f9fe8007770 con 0x7f9ff0151950 2023-07-25T14:35:23.384 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.364+0000 7f9fe67fc700 1 -- 172.21.15.92:0/938615411 <== mon.2 v2:172.21.15.92:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7f9fe8007a20 con 0x7f9ff0151950 2023-07-25T14:35:23.385 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.365+0000 7f9ff7e8e700 1 -- 172.21.15.92:0/938615411 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ff004e470 con 0x7f9ff0151950 2023-07-25T14:35:23.385 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.368+0000 7f9fe67fc700 1 -- 172.21.15.92:0/938615411 <== mon.2 v2:172.21.15.92:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f9fe8018070 con 0x7f9ff0151950 2023-07-25T14:35:23.463 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.450+0000 7f9ff7e8e700 1 -- 172.21.15.92:0/938615411 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_command({"prefix": "osd new", "uuid": "7f8920dc-0ad4-4a73-ab40-65408f83eadd", "id": 4} v 0) v1 -- 0x7f9ff014dfd0 con 0x7f9ff0151950 2023-07-25T14:35:23.471 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.458+0000 7f9fe67fc700 1 -- 172.21.15.92:0/938615411 <== mon.2 v2:172.21.15.92:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7f8920dc-0ad4-4a73-ab40-65408f83eadd", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f9fe801d440 con 0x7f9ff0151950 2023-07-25T14:35:23.472 INFO:teuthology.orchestra.run.smithi092.stdout:4 2023-07-25T14:35:23.473 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.459+0000 7f9ff7e8e700 1 -- 172.21.15.92:0/938615411 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9ff0151950 msgr2=0x7f9ff00ac3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:23.473 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.459+0000 7f9ff7e8e700 1 --2- 172.21.15.92:0/938615411 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9ff0151950 0x7f9ff00ac3d0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f9fe8002230 tx=0x7f9fe800cf50 comp rx=0 tx=0).stop 2023-07-25T14:35:23.473 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.459+0000 7f9ff7e8e700 1 -- 172.21.15.92:0/938615411 shutdown_connections 2023-07-25T14:35:23.473 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.459+0000 7f9ff7e8e700 1 --2- 172.21.15.92:0/938615411 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9ff0151950 0x7f9ff00ac3d0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:23.473 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.459+0000 7f9ff7e8e700 1 --2- 172.21.15.92:0/938615411 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9ff006a6d0 0x7f9ff01ed2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:23.473 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.459+0000 7f9ff7e8e700 1 --2- 172.21.15.92:0/938615411 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9ff00724c0 0x7f9ff014cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:23.474 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.459+0000 7f9ff7e8e700 1 -- 172.21.15.92:0/938615411 >> 172.21.15.92:0/938615411 conn(0x7f9ff00a87e0 msgr2=0x7f9ff00c34c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:35:23.474 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.459+0000 7f9ff7e8e700 1 -- 172.21.15.92:0/938615411 shutdown_connections 2023-07-25T14:35:23.474 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.459+0000 7f9ff7e8e700 1 -- 172.21.15.92:0/938615411 wait complete. 2023-07-25T14:35:23.484 DEBUG:teuthology.orchestra.run.smithi092:> sudo ceph --cluster ceph osd new 56257e7c-31eb-44c5-9ec7-1318a4e0bb35 5 2023-07-25T14:35:23.607 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.593+0000 7fd0869f6700 1 Processor -- start 2023-07-25T14:35:23.607 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.593+0000 7fd0869f6700 1 -- start start 2023-07-25T14:35:23.611 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.594+0000 7fd0869f6700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd0800bb0b0 0x7fd080152cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:23.612 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.594+0000 7fd0869f6700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0800c5890 con 0x7fd08014f810 2023-07-25T14:35:23.612 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.594+0000 7fd0869f6700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd080152150 con 0x7fd0800a9cc0 2023-07-25T14:35:23.612 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.594+0000 7fd0869f6700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd08014fbf0 con 0x7fd0800bb0b0 2023-07-25T14:35:23.613 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.594+0000 7fd07f7fe700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7fd0800a9cc0 0x7fd0801525e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:51412/0 (socket says 172.21.15.92:51412) 2023-07-25T14:35:23.613 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.594+0000 7fd07f7fe700 1 -- 172.21.15.92:0/2307615745 learned_addr learned my addr 172.21.15.92:0/2307615745 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-07-25T14:35:23.613 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.594+0000 7fd084f93700 1 --2- 172.21.15.92:0/2307615745 >> v2:172.21.15.72:3300/0 conn(0x7fd0800bb0b0 0x7fd080152cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:23.613 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.595+0000 7fd07effd700 1 -- 172.21.15.92:0/2307615745 <== mon.1 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2054761043 0 0) 0x7fd080152150 con 0x7fd0800a9cc0 2023-07-25T14:35:23.614 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.595+0000 7fd07effd700 1 -- 172.21.15.92:0/2307615745 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd0680035b0 con 0x7fd0800a9cc0 2023-07-25T14:35:23.614 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.595+0000 7fd07effd700 1 -- 172.21.15.92:0/2307615745 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 409778314 0 0) 0x7fd0800c5890 con 0x7fd08014f810 2023-07-25T14:35:23.614 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.595+0000 7fd07effd700 1 -- 172.21.15.92:0/2307615745 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd080152150 con 0x7fd08014f810 2023-07-25T14:35:23.615 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.595+0000 7fd084f93700 1 -- 172.21.15.92:0/2307615745 >> v1:172.21.15.92:6789/0 conn(0x7fd0800a9cc0 legacy=0x7fd0801525e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:23.615 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.595+0000 7fd084f93700 1 -- 172.21.15.92:0/2307615745 >> v1:172.21.15.72:6789/0 conn(0x7fd08014f810 legacy=0x7fd0800c4370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:23.615 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.595+0000 7fd084f93700 1 -- 172.21.15.92:0/2307615745 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0801566a0 con 0x7fd0800bb0b0 2023-07-25T14:35:23.615 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.595+0000 7fd084f93700 1 --2- 172.21.15.92:0/2307615745 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd0800bb0b0 0x7fd080152cf0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fd078009d90 tx=0x7fd07800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cc06d4f078fc773 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:35:23.616 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.595+0000 7fd07effd700 1 -- 172.21.15.92:0/2307615745 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd07800e070 con 0x7fd0800bb0b0 2023-07-25T14:35:23.616 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.595+0000 7fd07effd700 1 -- 172.21.15.92:0/2307615745 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd07800bb20 con 0x7fd0800bb0b0 2023-07-25T14:35:23.616 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.595+0000 7fd07effd700 1 -- 172.21.15.92:0/2307615745 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd078012430 con 0x7fd0800bb0b0 2023-07-25T14:35:23.616 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.596+0000 7fd0869f6700 1 -- 172.21.15.92:0/2307615745 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd0800bb0b0 msgr2=0x7fd080152cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:23.616 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.596+0000 7fd0869f6700 1 --2- 172.21.15.92:0/2307615745 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd0800bb0b0 0x7fd080152cf0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fd078009d90 tx=0x7fd07800b330 comp rx=0 tx=0).stop 2023-07-25T14:35:23.617 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.596+0000 7fd0869f6700 1 -- 172.21.15.92:0/2307615745 shutdown_connections 2023-07-25T14:35:23.617 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.596+0000 7fd0869f6700 1 --2- 172.21.15.92:0/2307615745 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd0800bb0b0 0x7fd080152cf0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:23.617 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.596+0000 7fd0869f6700 1 -- 172.21.15.92:0/2307615745 >> 172.21.15.92:0/2307615745 conn(0x7fd08006a8d0 msgr2=0x7fd0800a94e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:35:23.617 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.596+0000 7fd0869f6700 1 -- 172.21.15.92:0/2307615745 shutdown_connections 2023-07-25T14:35:23.618 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.596+0000 7fd0869f6700 1 -- 172.21.15.92:0/2307615745 wait complete. 2023-07-25T14:35:23.618 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.597+0000 7fd0869f6700 1 Processor -- start 2023-07-25T14:35:23.618 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.597+0000 7fd0869f6700 1 -- start start 2023-07-25T14:35:23.620 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.598+0000 7fd0869f6700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd0800a9cc0 0x7fd0800acf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:23.621 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.598+0000 7fd0869f6700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd0800bb0b0 0x7fd0800be080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:23.621 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.598+0000 7fd0869f6700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd08014f810 0x7fd0801e7c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:23.621 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.598+0000 7fd0869f6700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0800bd020 con 0x7fd0800a9cc0 2023-07-25T14:35:23.621 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.598+0000 7fd0869f6700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0800ac800 con 0x7fd08014f810 2023-07-25T14:35:23.621 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.598+0000 7fd0869f6700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0800acae0 con 0x7fd0800bb0b0 2023-07-25T14:35:23.621 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.598+0000 7fd07f7fe700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd0800bb0b0 0x7fd0800be080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:23.621 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.598+0000 7fd084f93700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd08014f810 0x7fd0801e7c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:23.622 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.598+0000 7fd07f7fe700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd0800bb0b0 0x7fd0800be080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3301/0 says I am v2:172.21.15.92:46794/0 (socket says 172.21.15.92:46794) 2023-07-25T14:35:23.622 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.598+0000 7fd084f93700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd08014f810 0x7fd0801e7c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:39564/0 (socket says 172.21.15.92:39564) 2023-07-25T14:35:23.622 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.598+0000 7fd07f7fe700 1 -- 172.21.15.92:0/1985524996 learned_addr learned my addr 172.21.15.92:0/1985524996 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-07-25T14:35:23.622 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.599+0000 7fd07ffff700 1 --2- 172.21.15.92:0/1985524996 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd0800a9cc0 0x7fd0800acf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:23.622 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.599+0000 7fd084f93700 1 -- 172.21.15.92:0/1985524996 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd0800bb0b0 msgr2=0x7fd0800be080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:23.622 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.599+0000 7fd084f93700 1 --2- 172.21.15.92:0/1985524996 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd0800bb0b0 0x7fd0800be080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:23.622 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.599+0000 7fd084f93700 1 -- 172.21.15.92:0/1985524996 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd0800a9cc0 msgr2=0x7fd0800acf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:23.622 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.599+0000 7fd084f93700 1 --2- 172.21.15.92:0/1985524996 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd0800a9cc0 0x7fd0800acf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:23.623 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.599+0000 7fd084f93700 1 -- 172.21.15.92:0/1985524996 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd078009a70 con 0x7fd08014f810 2023-07-25T14:35:23.623 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.599+0000 7fd07f7fe700 1 --2- 172.21.15.92:0/1985524996 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd0800bb0b0 0x7fd0800be080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-25T14:35:23.623 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.599+0000 7fd084f93700 1 --2- 172.21.15.92:0/1985524996 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd08014f810 0x7fd0801e7c70 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fd078016000 tx=0x7fd078004b20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:35:23.623 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.599+0000 7fd07cff9700 1 -- 172.21.15.92:0/1985524996 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd078012430 con 0x7fd08014f810 2023-07-25T14:35:23.623 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.599+0000 7fd07cff9700 1 -- 172.21.15.92:0/1985524996 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd078020070 con 0x7fd08014f810 2023-07-25T14:35:23.623 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.599+0000 7fd0869f6700 1 -- 172.21.15.92:0/1985524996 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0800abc70 con 0x7fd08014f810 2023-07-25T14:35:23.623 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.599+0000 7fd07cff9700 1 -- 172.21.15.92:0/1985524996 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd07801ba50 con 0x7fd08014f810 2023-07-25T14:35:23.623 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.599+0000 7fd0869f6700 1 -- 172.21.15.92:0/1985524996 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0800ac230 con 0x7fd08014f810 2023-07-25T14:35:23.624 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.599+0000 7fd07cff9700 1 -- 172.21.15.92:0/1985524996 <== mon.1 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fd078027480 con 0x7fd08014f810 2023-07-25T14:35:23.624 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.599+0000 7fd07cff9700 1 -- 172.21.15.92:0/1985524996 <== mon.1 v2:172.21.15.92:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7fd078022070 con 0x7fd08014f810 2023-07-25T14:35:23.624 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.600+0000 7fd0869f6700 1 -- 172.21.15.92:0/1985524996 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd08004e470 con 0x7fd08014f810 2023-07-25T14:35:23.624 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.602+0000 7fd07cff9700 1 -- 172.21.15.92:0/1985524996 <== mon.1 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7fd078027890 con 0x7fd08014f810 2023-07-25T14:35:23.699 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.686+0000 7fd0869f6700 1 -- 172.21.15.92:0/1985524996 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd new", "uuid": "56257e7c-31eb-44c5-9ec7-1318a4e0bb35", "id": 5} v 0) v1 -- 0x7fd0800acc20 con 0x7fd08014f810 2023-07-25T14:35:23.707 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.694+0000 7fd07cff9700 1 -- 172.21.15.92:0/1985524996 <== mon.1 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "56257e7c-31eb-44c5-9ec7-1318a4e0bb35", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7fd078027b60 con 0x7fd08014f810 2023-07-25T14:35:23.707 INFO:teuthology.orchestra.run.smithi092.stdout:5 2023-07-25T14:35:23.708 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.695+0000 7fd0869f6700 1 -- 172.21.15.92:0/1985524996 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd08014f810 msgr2=0x7fd0801e7c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:23.709 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.695+0000 7fd0869f6700 1 --2- 172.21.15.92:0/1985524996 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd08014f810 0x7fd0801e7c70 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fd078016000 tx=0x7fd078004b20 comp rx=0 tx=0).stop 2023-07-25T14:35:23.709 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.695+0000 7fd0869f6700 1 -- 172.21.15.92:0/1985524996 shutdown_connections 2023-07-25T14:35:23.709 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.695+0000 7fd0869f6700 1 --2- 172.21.15.92:0/1985524996 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd08014f810 0x7fd0801e7c70 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:23.709 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.695+0000 7fd0869f6700 1 --2- 172.21.15.92:0/1985524996 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd0800a9cc0 0x7fd0800acf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:23.709 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.695+0000 7fd0869f6700 1 --2- 172.21.15.92:0/1985524996 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd0800bb0b0 0x7fd0800be080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:23.710 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.695+0000 7fd0869f6700 1 -- 172.21.15.92:0/1985524996 >> 172.21.15.92:0/1985524996 conn(0x7fd08006a8d0 msgr2=0x7fd0801524e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:35:23.710 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.695+0000 7fd0869f6700 1 -- 172.21.15.92:0/1985524996 shutdown_connections 2023-07-25T14:35:23.710 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.695+0000 7fd0869f6700 1 -- 172.21.15.92:0/1985524996 wait complete. 2023-07-25T14:35:23.719 DEBUG:teuthology.orchestra.run.smithi092:> sudo ceph --cluster ceph osd new a150d3d8-a0c9-4955-968a-8d98eff4ffb7 6 2023-07-25T14:35:23.868 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.854+0000 7f024c93f700 1 Processor -- start 2023-07-25T14:35:23.868 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.854+0000 7f024c93f700 1 -- start start 2023-07-25T14:35:23.870 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.855+0000 7f024c93f700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f02480724c0 0x7f02480c34c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:23.870 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.855+0000 7f024c93f700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f02480c4930 0x7f02480c3a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:23.870 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.855+0000 7f024c93f700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02480c2fe0 con 0x7f0248151950 2023-07-25T14:35:23.871 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.855+0000 7f024c93f700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0248071a60 con 0x7f02480c4930 2023-07-25T14:35:23.871 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.855+0000 7f024c93f700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02480c2a70 con 0x7f02480724c0 2023-07-25T14:35:23.871 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.855+0000 7f0246d9d700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f02480c4930 0x7f02480c3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:23.871 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.855+0000 7f0245d9b700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f02480724c0 0x7f02480c34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:23.871 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.855+0000 7f024659c700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f0248151950 0x7f024806a190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.92:51422/0 (socket says 172.21.15.92:51422) 2023-07-25T14:35:23.871 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.855+0000 7f024659c700 1 -- 172.21.15.92:0/1587366465 learned_addr learned my addr 172.21.15.92:0/1587366465 (peer_addr_for_me v1:172.21.15.92:0/0) 2023-07-25T14:35:23.871 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.856+0000 7f0246d9d700 1 -- 172.21.15.92:0/1587366465 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f02480724c0 msgr2=0x7f02480c34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:35:23.872 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.856+0000 7f0246d9d700 1 --2- 172.21.15.92:0/1587366465 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f02480724c0 0x7f02480c34c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:23.872 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.856+0000 7f0246d9d700 1 -- 172.21.15.92:0/1587366465 >> v1:172.21.15.92:6789/0 conn(0x7f0248151950 legacy=0x7f024806a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:23.872 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.856+0000 7f0246d9d700 1 -- 172.21.15.92:0/1587366465 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0248155070 con 0x7f02480c4930 2023-07-25T14:35:23.872 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.856+0000 7f024559a700 1 -- 172.21.15.92:0/1587366465 <== mon.1 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3557195382 0 0) 0x7f02480c2fe0 con 0x7f0248151950 2023-07-25T14:35:23.872 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.856+0000 7f0245d9b700 1 --2- 172.21.15.92:0/1587366465 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f02480724c0 0x7f02480c34c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-25T14:35:23.872 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.856+0000 7f0246d9d700 1 --2- 172.21.15.92:0/1587366465 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f02480c4930 0x7f02480c3a00 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f0240009d90 tx=0x7f024000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b157dd37b99c1ba4 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:35:23.872 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.856+0000 7f024559a700 1 -- 172.21.15.92:0/1587366465 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f024000e070 con 0x7f02480c4930 2023-07-25T14:35:23.873 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.856+0000 7f024559a700 1 -- 172.21.15.92:0/1587366465 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f024000bb20 con 0x7f02480c4930 2023-07-25T14:35:23.873 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.856+0000 7f024559a700 1 -- 172.21.15.92:0/1587366465 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0240012430 con 0x7f02480c4930 2023-07-25T14:35:23.873 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.856+0000 7f024c93f700 1 -- 172.21.15.92:0/1587366465 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f02480c4930 msgr2=0x7f02480c3a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:23.873 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.856+0000 7f024c93f700 1 --2- 172.21.15.92:0/1587366465 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f02480c4930 0x7f02480c3a00 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f0240009d90 tx=0x7f024000b330 comp rx=0 tx=0).stop 2023-07-25T14:35:23.873 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.857+0000 7f024c93f700 1 -- 172.21.15.92:0/1587366465 shutdown_connections 2023-07-25T14:35:23.873 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.857+0000 7f024c93f700 1 --2- 172.21.15.92:0/1587366465 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f02480c4930 0x7f02480c3a00 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:23.873 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.857+0000 7f024c93f700 1 --2- 172.21.15.92:0/1587366465 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f02480724c0 0x7f02480c34c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:23.874 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.857+0000 7f024c93f700 1 -- 172.21.15.92:0/1587366465 >> 172.21.15.92:0/1587366465 conn(0x7f02480a87e0 msgr2=0x7f02480a8bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:35:23.874 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.857+0000 7f024c93f700 1 -- 172.21.15.92:0/1587366465 shutdown_connections 2023-07-25T14:35:23.874 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.857+0000 7f024c93f700 1 -- 172.21.15.92:0/1587366465 wait complete. 2023-07-25T14:35:23.876 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.858+0000 7f024c93f700 1 Processor -- start 2023-07-25T14:35:23.876 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.858+0000 7f024c93f700 1 -- start start 2023-07-25T14:35:23.876 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.859+0000 7f024c93f700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f02480724c0 0x7f02481557b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:23.876 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.859+0000 7f024c93f700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f02480c4930 0x7f0248156dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:23.876 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.859+0000 7f024c93f700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0248151950 0x7f0248157300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:23.877 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.859+0000 7f024c93f700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0248156930 con 0x7f02480c4930 2023-07-25T14:35:23.877 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.859+0000 7f024c93f700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02480c03b0 con 0x7f0248151950 2023-07-25T14:35:23.877 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.859+0000 7f024c93f700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02480bfb10 con 0x7f02480724c0 2023-07-25T14:35:23.877 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.859+0000 7f024659c700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f02480724c0 0x7f02481557b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:23.877 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.859+0000 7f0246d9d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0248151950 0x7f0248157300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:23.877 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.859+0000 7f0246d9d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0248151950 0x7f0248157300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:39576/0 (socket says 172.21.15.92:39576) 2023-07-25T14:35:23.877 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.859+0000 7f0246d9d700 1 -- 172.21.15.92:0/4163280767 learned_addr learned my addr 172.21.15.92:0/4163280767 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-07-25T14:35:23.878 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.859+0000 7f0245d9b700 1 --2- 172.21.15.92:0/4163280767 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f02480c4930 0x7f0248156dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:23.878 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.859+0000 7f0246d9d700 1 -- 172.21.15.92:0/4163280767 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f02480724c0 msgr2=0x7f02481557b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:23.878 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.859+0000 7f0246d9d700 1 --2- 172.21.15.92:0/4163280767 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f02480724c0 0x7f02481557b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:23.878 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.859+0000 7f0246d9d700 1 -- 172.21.15.92:0/4163280767 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f02480c4930 msgr2=0x7f0248156dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:23.878 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.859+0000 7f0246d9d700 1 --2- 172.21.15.92:0/4163280767 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f02480c4930 0x7f0248156dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:23.878 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.859+0000 7f0246d9d700 1 -- 172.21.15.92:0/4163280767 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f023c0094a0 con 0x7f0248151950 2023-07-25T14:35:23.878 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.859+0000 7f024659c700 1 --2- 172.21.15.92:0/4163280767 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f02480724c0 0x7f02481557b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-25T14:35:23.879 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.859+0000 7f0246d9d700 1 --2- 172.21.15.92:0/4163280767 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0248151950 0x7f0248157300 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f024806aec0 tx=0x7f0240004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:35:23.879 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.859+0000 7f0236ffd700 1 -- 172.21.15.92:0/4163280767 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0240012430 con 0x7f0248151950 2023-07-25T14:35:23.879 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.859+0000 7f0236ffd700 1 -- 172.21.15.92:0/4163280767 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0240020070 con 0x7f0248151950 2023-07-25T14:35:23.879 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.859+0000 7f024c93f700 1 -- 172.21.15.92:0/4163280767 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0240009a70 con 0x7f0248151950 2023-07-25T14:35:23.879 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.859+0000 7f0236ffd700 1 -- 172.21.15.92:0/4163280767 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0240004280 con 0x7f0248151950 2023-07-25T14:35:23.879 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.859+0000 7f024c93f700 1 -- 172.21.15.92:0/4163280767 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02480c00d0 con 0x7f0248151950 2023-07-25T14:35:23.879 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.860+0000 7f0236ffd700 1 -- 172.21.15.92:0/4163280767 <== mon.1 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f02400046e0 con 0x7f0248151950 2023-07-25T14:35:23.880 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.860+0000 7f0236ffd700 1 -- 172.21.15.92:0/4163280767 <== mon.1 v2:172.21.15.92:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7f0240022070 con 0x7f0248151950 2023-07-25T14:35:23.880 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.860+0000 7f0234ff9700 1 -- 172.21.15.92:0/4163280767 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02200052f0 con 0x7f0248151950 2023-07-25T14:35:23.880 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.862+0000 7f0236ffd700 1 -- 172.21.15.92:0/4163280767 <== mon.1 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f024002c060 con 0x7f0248151950 2023-07-25T14:35:23.896 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-07-25T14:35:23.881+0000 7f1c41ed8200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-07-25T14:35:23.958 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.944+0000 7f0234ff9700 1 -- 172.21.15.92:0/4163280767 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd new", "uuid": "a150d3d8-a0c9-4955-968a-8d98eff4ffb7", "id": 6} v 0) v1 -- 0x7f0220005640 con 0x7f0248151950 2023-07-25T14:35:23.966 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.953+0000 7f0236ffd700 1 -- 172.21.15.92:0/4163280767 <== mon.1 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a150d3d8-a0c9-4955-968a-8d98eff4ffb7", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f02400350b0 con 0x7f0248151950 2023-07-25T14:35:23.967 INFO:teuthology.orchestra.run.smithi092.stdout:6 2023-07-25T14:35:23.968 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.954+0000 7f0234ff9700 1 -- 172.21.15.92:0/4163280767 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0248151950 msgr2=0x7f0248157300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:23.969 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.954+0000 7f0234ff9700 1 --2- 172.21.15.92:0/4163280767 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0248151950 0x7f0248157300 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f024806aec0 tx=0x7f0240004ad0 comp rx=0 tx=0).stop 2023-07-25T14:35:23.969 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.954+0000 7f0234ff9700 1 -- 172.21.15.92:0/4163280767 shutdown_connections 2023-07-25T14:35:23.969 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.954+0000 7f0234ff9700 1 --2- 172.21.15.92:0/4163280767 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f02480724c0 0x7f02481557b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:23.969 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.954+0000 7f0234ff9700 1 --2- 172.21.15.92:0/4163280767 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0248151950 0x7f0248157300 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:23.970 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.954+0000 7f0234ff9700 1 --2- 172.21.15.92:0/4163280767 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f02480c4930 0x7f0248156dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:23.970 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.954+0000 7f0234ff9700 1 -- 172.21.15.92:0/4163280767 >> 172.21.15.92:0/4163280767 conn(0x7f02480a87e0 msgr2=0x7f0248150610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:35:23.970 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.954+0000 7f0234ff9700 1 -- 172.21.15.92:0/4163280767 shutdown_connections 2023-07-25T14:35:23.970 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:23.954+0000 7f0234ff9700 1 -- 172.21.15.92:0/4163280767 wait complete. 2023-07-25T14:35:23.971 INFO:tasks.ceph.mgr.x.smithi092.stderr:2023-07-25T14:35:23.956+0000 7f95aaba9200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-07-25T14:35:23.979 DEBUG:teuthology.orchestra.run.smithi092:> sudo ceph --cluster ceph osd new 07799c27-54ee-4591-a42d-a978d6b32065 7 2023-07-25T14:35:24.049 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-07-25T14:35:24.036+0000 7f1c41ed8200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-25T14:35:24.100 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:24.087+0000 7ff78f146700 1 Processor -- start 2023-07-25T14:35:24.101 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:24.087+0000 7ff78f146700 1 -- start start 2023-07-25T14:35:24.102 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:24.088+0000 7ff78f146700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff78814f810 0x7ff7880c4370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:24.103 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:24.088+0000 7ff78f146700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7ff7880a9cc0 0x7ff7881525e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:24.103 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:24.088+0000 7ff78f146700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7880c5890 con 0x7ff7880bb0b0 2023-07-25T14:35:24.103 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:24.088+0000 7ff78f146700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff788152150 con 0x7ff78814f810 2023-07-25T14:35:24.103 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:24.088+0000 7ff78f146700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff78814fbf0 con 0x7ff7880a9cc0 2023-07-25T14:35:24.103 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:24.088+0000 7ff787fff700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7ff7880a9cc0 0x7ff7881525e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:24.103 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:24.088+0000 7ff787fff700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7ff7880a9cc0 0x7ff7881525e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:39578/0 (socket says 172.21.15.92:39578) 2023-07-25T14:35:24.103 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:24.088+0000 7ff787fff700 1 -- 172.21.15.92:0/2927222851 learned_addr learned my addr 172.21.15.92:0/2927222851 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-07-25T14:35:24.104 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:24.088+0000 7ff78cee2700 1 --2- 172.21.15.92:0/2927222851 >> v2:172.21.15.72:3300/0 conn(0x7ff78814f810 0x7ff7880c4370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:24.104 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:24.088+0000 7ff787fff700 1 -- 172.21.15.92:0/2927222851 >> v2:172.21.15.72:3300/0 conn(0x7ff78814f810 msgr2=0x7ff7880c4370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:35:24.104 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:24.088+0000 7ff787fff700 1 --2- 172.21.15.92:0/2927222851 >> v2:172.21.15.72:3300/0 conn(0x7ff78814f810 0x7ff7880c4370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:24.104 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:24.088+0000 7ff787fff700 1 -- 172.21.15.92:0/2927222851 >> v1:172.21.15.72:6789/0 conn(0x7ff7880bb0b0 legacy=0x7ff788152b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:24.104 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:24.088+0000 7ff787fff700 1 -- 172.21.15.92:0/2927222851 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7881566a0 con 0x7ff7880a9cc0 2023-07-25T14:35:24.104 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:24.088+0000 7ff787fff700 1 --2- 172.21.15.92:0/2927222851 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff7880a9cc0 0x7ff7881525e0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7ff7880c1f90 tx=0x7ff774009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f61d9a07ca646ce7 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:35:24.104 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:24.088+0000 7ff7877fe700 1 -- 172.21.15.92:0/2927222851 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff774011830 con 0x7ff7880a9cc0 2023-07-25T14:35:24.105 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:24.089+0000 7ff7877fe700 1 -- 172.21.15.92:0/2927222851 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff774011990 con 0x7ff7880a9cc0 2023-07-25T14:35:24.105 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:24.089+0000 7ff7877fe700 1 -- 172.21.15.92:0/2927222851 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff774011d20 con 0x7ff7880a9cc0 2023-07-25T14:35:24.105 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:24.089+0000 7ff78f146700 1 -- 172.21.15.92:0/2927222851 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff7880a9cc0 msgr2=0x7ff7881525e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:24.105 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:24.089+0000 7ff78f146700 1 --2- 172.21.15.92:0/2927222851 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff7880a9cc0 0x7ff7881525e0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7ff7880c1f90 tx=0x7ff774009bd0 comp rx=0 tx=0).stop 2023-07-25T14:35:24.105 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:24.089+0000 7ff78f146700 1 -- 172.21.15.92:0/2927222851 shutdown_connections 2023-07-25T14:35:24.105 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:24.089+0000 7ff78f146700 1 --2- 172.21.15.92:0/2927222851 >> v2:172.21.15.72:3300/0 conn(0x7ff78814f810 0x7ff7880c4370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:24.105 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:24.089+0000 7ff78f146700 1 --2- 172.21.15.92:0/2927222851 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff7880a9cc0 0x7ff7881525e0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:24.106 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:24.089+0000 7ff78f146700 1 -- 172.21.15.92:0/2927222851 >> 172.21.15.92:0/2927222851 conn(0x7ff78806a8d0 msgr2=0x7ff7880a94e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:35:24.106 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:24.089+0000 7ff78f146700 1 -- 172.21.15.92:0/2927222851 shutdown_connections 2023-07-25T14:35:24.106 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:24.089+0000 7ff78f146700 1 -- 172.21.15.92:0/2927222851 wait complete. 2023-07-25T14:35:24.108 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:24.090+0000 7ff78f146700 1 Processor -- start 2023-07-25T14:35:24.108 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:24.090+0000 7ff78f146700 1 -- start start 2023-07-25T14:35:24.108 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:24.091+0000 7ff78f146700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff7880a9cc0 0x7ff7880ab550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:24.108 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:24.091+0000 7ff78f146700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff7880bb0b0 0x7ff7881e9970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:24.109 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:24.091+0000 7ff78f146700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff78814f810 0x7ff7881e9eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:24.109 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:24.091+0000 7ff78f146700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7880aad30 con 0x7ff7880a9cc0 2023-07-25T14:35:24.109 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:24.091+0000 7ff78f146700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff78814c790 con 0x7ff7880bb0b0 2023-07-25T14:35:24.109 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:24.091+0000 7ff78f146700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7880ad790 con 0x7ff78814f810 2023-07-25T14:35:24.109 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:24.091+0000 7ff787fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff7880bb0b0 0x7ff7881e9970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:24.109 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:24.091+0000 7ff787fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff7880bb0b0 0x7ff7881e9970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:39586/0 (socket says 172.21.15.92:39586) 2023-07-25T14:35:24.109 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:24.091+0000 7ff787fff700 1 -- 172.21.15.92:0/4054544121 learned_addr learned my addr 172.21.15.92:0/4054544121 (peer_addr_for_me v2:172.21.15.92:0/0) 2023-07-25T14:35:24.110 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:24.091+0000 7ff78cee2700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff7880a9cc0 0x7ff7880ab550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:24.110 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:24.091+0000 7ff78d6e3700 1 --2- 172.21.15.92:0/4054544121 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff78814f810 0x7ff7881e9eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:24.110 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:24.092+0000 7ff787fff700 1 -- 172.21.15.92:0/4054544121 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff78814f810 msgr2=0x7ff7881e9eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:24.110 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:24.092+0000 7ff787fff700 1 --2- 172.21.15.92:0/4054544121 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff78814f810 0x7ff7881e9eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:24.110 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:24.092+0000 7ff787fff700 1 -- 172.21.15.92:0/4054544121 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff7880a9cc0 msgr2=0x7ff7880ab550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:24.111 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:24.092+0000 7ff787fff700 1 --2- 172.21.15.92:0/4054544121 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff7880a9cc0 0x7ff7880ab550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:24.111 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:24.092+0000 7ff787fff700 1 -- 172.21.15.92:0/4054544121 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff774009550 con 0x7ff7880bb0b0 2023-07-25T14:35:24.111 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:24.092+0000 7ff78cee2700 1 --2- 172.21.15.92:0/4054544121 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff7880a9cc0 0x7ff7880ab550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-25T14:35:24.111 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:24.092+0000 7ff78d6e3700 1 --2- 172.21.15.92:0/4054544121 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff78814f810 0x7ff7881e9eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-25T14:35:24.111 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:24.092+0000 7ff787fff700 1 --2- 172.21.15.92:0/4054544121 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff7880bb0b0 0x7ff7881e9970 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7ff774009c10 tx=0x7ff774004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:35:24.111 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:24.092+0000 7ff7857fa700 1 -- 172.21.15.92:0/4054544121 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff774004510 con 0x7ff7880bb0b0 2023-07-25T14:35:24.112 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:24.092+0000 7ff7857fa700 1 -- 172.21.15.92:0/4054544121 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff77401e070 con 0x7ff7880bb0b0 2023-07-25T14:35:24.113 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:24.092+0000 7ff7857fa700 1 -- 172.21.15.92:0/4054544121 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7740038e0 con 0x7ff7880bb0b0 2023-07-25T14:35:24.113 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:24.092+0000 7ff78f146700 1 -- 172.21.15.92:0/4054544121 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7880ad4b0 con 0x7ff7880bb0b0 2023-07-25T14:35:24.113 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:24.092+0000 7ff78f146700 1 -- 172.21.15.92:0/4054544121 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7880aa9c0 con 0x7ff7880bb0b0 2023-07-25T14:35:24.113 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:24.092+0000 7ff7857fa700 1 -- 172.21.15.92:0/4054544121 <== mon.1 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7ff774003d40 con 0x7ff7880bb0b0 2023-07-25T14:35:24.113 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:24.092+0000 7ff7857fa700 1 -- 172.21.15.92:0/4054544121 <== mon.1 v2:172.21.15.92:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7ff77401aa80 con 0x7ff7880bb0b0 2023-07-25T14:35:24.113 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:24.093+0000 7ff78f146700 1 -- 172.21.15.92:0/4054544121 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff78804e470 con 0x7ff7880bb0b0 2023-07-25T14:35:24.114 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:24.096+0000 7ff7857fa700 1 -- 172.21.15.92:0/4054544121 <== mon.1 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7ff774020070 con 0x7ff7880bb0b0 2023-07-25T14:35:24.143 INFO:tasks.ceph.mgr.x.smithi092.stderr:2023-07-25T14:35:24.130+0000 7f95aaba9200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-25T14:35:24.206 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:24.193+0000 7ff78f146700 1 -- 172.21.15.92:0/4054544121 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd new", "uuid": "07799c27-54ee-4591-a42d-a978d6b32065", "id": 7} v 0) v1 -- 0x7ff7881e9620 con 0x7ff7880bb0b0 2023-07-25T14:35:24.216 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:24.203+0000 7ff7857fa700 1 -- 172.21.15.92:0/4054544121 <== mon.1 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "07799c27-54ee-4591-a42d-a978d6b32065", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7ff774015020 con 0x7ff7880bb0b0 2023-07-25T14:35:24.217 INFO:teuthology.orchestra.run.smithi092.stdout:7 2023-07-25T14:35:24.218 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:24.204+0000 7ff78f146700 1 -- 172.21.15.92:0/4054544121 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff7880bb0b0 msgr2=0x7ff7881e9970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:24.218 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:24.204+0000 7ff78f146700 1 --2- 172.21.15.92:0/4054544121 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff7880bb0b0 0x7ff7881e9970 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7ff774009c10 tx=0x7ff774004750 comp rx=0 tx=0).stop 2023-07-25T14:35:24.218 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:24.204+0000 7ff78f146700 1 -- 172.21.15.92:0/4054544121 shutdown_connections 2023-07-25T14:35:24.218 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:24.204+0000 7ff78f146700 1 --2- 172.21.15.92:0/4054544121 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff78814f810 0x7ff7881e9eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:24.218 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:24.204+0000 7ff78f146700 1 --2- 172.21.15.92:0/4054544121 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff7880a9cc0 0x7ff7880ab550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:24.218 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:24.204+0000 7ff78f146700 1 --2- 172.21.15.92:0/4054544121 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff7880bb0b0 0x7ff7881e9970 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:24.219 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:24.204+0000 7ff78f146700 1 -- 172.21.15.92:0/4054544121 >> 172.21.15.92:0/4054544121 conn(0x7ff78806a8d0 msgr2=0x7ff7881558c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:35:24.219 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:24.204+0000 7ff78f146700 1 -- 172.21.15.92:0/4054544121 shutdown_connections 2023-07-25T14:35:24.219 INFO:teuthology.orchestra.run.smithi092.stderr:2023-07-25T14:35:24.204+0000 7ff78f146700 1 -- 172.21.15.92:0/4054544121 wait complete. 2023-07-25T14:35:24.229 INFO:tasks.ceph.osd.0:Restarting daemon 2023-07-25T14:35:24.229 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-07-25T14:35:24.231 INFO:tasks.ceph.osd.0:Started 2023-07-25T14:35:24.232 INFO:tasks.ceph.osd.1:Restarting daemon 2023-07-25T14:35:24.232 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-07-25T14:35:24.234 INFO:tasks.ceph.osd.1:Started 2023-07-25T14:35:24.234 INFO:tasks.ceph.osd.2:Restarting daemon 2023-07-25T14:35:24.234 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-07-25T14:35:24.236 INFO:tasks.ceph.osd.2:Started 2023-07-25T14:35:24.236 INFO:tasks.ceph.osd.3:Restarting daemon 2023-07-25T14:35:24.236 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-07-25T14:35:24.238 INFO:tasks.ceph.osd.3:Started 2023-07-25T14:35:24.238 INFO:tasks.ceph.osd.4:Restarting daemon 2023-07-25T14:35:24.239 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-07-25T14:35:24.241 INFO:tasks.ceph.osd.4:Started 2023-07-25T14:35:24.241 INFO:tasks.ceph.osd.5:Restarting daemon 2023-07-25T14:35:24.242 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-07-25T14:35:24.243 INFO:tasks.ceph.osd.5:Started 2023-07-25T14:35:24.243 INFO:tasks.ceph.osd.6:Restarting daemon 2023-07-25T14:35:24.244 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-07-25T14:35:24.245 INFO:tasks.ceph.osd.6:Started 2023-07-25T14:35:24.246 INFO:tasks.ceph.osd.7:Restarting daemon 2023-07-25T14:35:24.246 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-07-25T14:35:24.248 INFO:tasks.ceph.osd.7:Started 2023-07-25T14:35:24.248 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-25T14:35:24.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:24.391+0000 7f8a5d957700 1 Processor -- start 2023-07-25T14:35:24.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:24.391+0000 7f8a5d957700 1 -- start start 2023-07-25T14:35:24.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:24.392+0000 7f8a5d957700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8a5806f280 0x7f8a580a8170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:24.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:24.392+0000 7f8a5d957700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f8a580c11f0 0x7f8a580a86b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:24.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:24.392+0000 7f8a5d957700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a580ba1c0 con 0x7f8a5814e6f0 2023-07-25T14:35:24.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:24.392+0000 7f8a5d957700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a580a7920 con 0x7f8a5806f280 2023-07-25T14:35:24.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:24.392+0000 7f8a5d957700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a58154640 con 0x7f8a580c11f0 2023-07-25T14:35:24.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:24.392+0000 7f8a567fc700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8a5806f280 0x7f8a580a8170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:24.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:24.392+0000 7f8a567fc700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8a5806f280 0x7f8a580a8170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:38820/0 (socket says 172.21.15.72:38820) 2023-07-25T14:35:24.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:24.392+0000 7f8a567fc700 1 -- 172.21.15.72:0/2416916619 learned_addr learned my addr 172.21.15.72:0/2416916619 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:35:24.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:24.392+0000 7f8a577fe700 1 --2- 172.21.15.72:0/2416916619 >> v2:172.21.15.92:3300/0 conn(0x7f8a580c11f0 0x7f8a580a86b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:24.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:24.392+0000 7f8a567fc700 1 -- 172.21.15.72:0/2416916619 >> v2:172.21.15.92:3300/0 conn(0x7f8a580c11f0 msgr2=0x7f8a580a86b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:35:24.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:24.392+0000 7f8a567fc700 1 --2- 172.21.15.72:0/2416916619 >> v2:172.21.15.92:3300/0 conn(0x7f8a580c11f0 0x7f8a580a86b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:24.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:24.392+0000 7f8a567fc700 1 -- 172.21.15.72:0/2416916619 >> v1:172.21.15.92:6789/0 conn(0x7f8a5814e6f0 legacy=0x7f8a580c67d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:24.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:24.392+0000 7f8a567fc700 1 -- 172.21.15.72:0/2416916619 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a58154900 con 0x7f8a5806f280 2023-07-25T14:35:24.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:24.392+0000 7f8a567fc700 1 --2- 172.21.15.72:0/2416916619 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8a5806f280 0x7f8a580a8170 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f8a580c7880 tx=0x7f8a4c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aeff41c0b47143d6 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:35:24.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:24.393+0000 7f8a55ffb700 1 -- 172.21.15.72:0/2416916619 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a4c00f8a0 con 0x7f8a5806f280 2023-07-25T14:35:24.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:24.393+0000 7f8a55ffb700 1 -- 172.21.15.72:0/2416916619 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a4c00fa00 con 0x7f8a5806f280 2023-07-25T14:35:24.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:24.393+0000 7f8a55ffb700 1 -- 172.21.15.72:0/2416916619 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a4c00fd90 con 0x7f8a5806f280 2023-07-25T14:35:24.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:24.393+0000 7f8a5d957700 1 -- 172.21.15.72:0/2416916619 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8a5806f280 msgr2=0x7f8a580a8170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:24.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:24.393+0000 7f8a5d957700 1 --2- 172.21.15.72:0/2416916619 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8a5806f280 0x7f8a580a8170 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f8a580c7880 tx=0x7f8a4c009bd0 comp rx=0 tx=0).stop 2023-07-25T14:35:24.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:24.393+0000 7f8a5d957700 1 -- 172.21.15.72:0/2416916619 shutdown_connections 2023-07-25T14:35:24.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:24.393+0000 7f8a5d957700 1 --2- 172.21.15.72:0/2416916619 >> v2:172.21.15.92:3300/0 conn(0x7f8a580c11f0 0x7f8a580a86b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:24.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:24.393+0000 7f8a5d957700 1 --2- 172.21.15.72:0/2416916619 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8a5806f280 0x7f8a580a8170 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:24.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:24.393+0000 7f8a5d957700 1 -- 172.21.15.72:0/2416916619 >> 172.21.15.72:0/2416916619 conn(0x7f8a580714f0 msgr2=0x7f8a58071900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:35:24.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:24.393+0000 7f8a5d957700 1 -- 172.21.15.72:0/2416916619 shutdown_connections 2023-07-25T14:35:24.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:24.393+0000 7f8a5d957700 1 -- 172.21.15.72:0/2416916619 wait complete. 2023-07-25T14:35:24.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:24.394+0000 7f8a5d957700 1 Processor -- start 2023-07-25T14:35:24.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:24.395+0000 7f8a5d957700 1 -- start start 2023-07-25T14:35:24.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:24.395+0000 7f8a5d957700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8a5806f280 0x7f8a580c5930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:24.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:24.395+0000 7f8a5d957700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8a580c11f0 0x7f8a580bfc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:24.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:24.395+0000 7f8a5d957700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8a5814e6f0 0x7f8a580c0150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:24.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:24.395+0000 7f8a5d957700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a580bee00 con 0x7f8a5814e6f0 2023-07-25T14:35:24.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:24.395+0000 7f8a5d957700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a581e65c0 con 0x7f8a5806f280 2023-07-25T14:35:24.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:24.395+0000 7f8a5d957700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a580bd530 con 0x7f8a580c11f0 2023-07-25T14:35:24.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:24.396+0000 7f8a577fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8a5814e6f0 0x7f8a580c0150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:24.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:24.396+0000 7f8a577fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8a5814e6f0 0x7f8a580c0150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:38830/0 (socket says 172.21.15.72:38830) 2023-07-25T14:35:24.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:24.396+0000 7f8a577fe700 1 -- 172.21.15.72:0/754216455 learned_addr learned my addr 172.21.15.72:0/754216455 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:35:24.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:24.396+0000 7f8a567fc700 1 --2- 172.21.15.72:0/754216455 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8a580c11f0 0x7f8a580bfc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:24.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:24.396+0000 7f8a56ffd700 1 --2- 172.21.15.72:0/754216455 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8a5806f280 0x7f8a580c5930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:24.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:24.396+0000 7f8a577fe700 1 -- 172.21.15.72:0/754216455 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8a580c11f0 msgr2=0x7f8a580bfc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:24.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:24.396+0000 7f8a577fe700 1 --2- 172.21.15.72:0/754216455 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8a580c11f0 0x7f8a580bfc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:24.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:24.396+0000 7f8a577fe700 1 -- 172.21.15.72:0/754216455 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8a5806f280 msgr2=0x7f8a580c5930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:24.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:24.396+0000 7f8a577fe700 1 --2- 172.21.15.72:0/754216455 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8a5806f280 0x7f8a580c5930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:24.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:24.396+0000 7f8a577fe700 1 -- 172.21.15.72:0/754216455 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a4c009550 con 0x7f8a5814e6f0 2023-07-25T14:35:24.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:24.396+0000 7f8a577fe700 1 --2- 172.21.15.72:0/754216455 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8a5814e6f0 0x7f8a580c0150 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f8a5000efc0 tx=0x7f8a5000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:35:24.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:24.396+0000 7f8a3ffff700 1 -- 172.21.15.72:0/754216455 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a50009ea0 con 0x7f8a5814e6f0 2023-07-25T14:35:24.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:24.396+0000 7f8a3ffff700 1 -- 172.21.15.72:0/754216455 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a5000f040 con 0x7f8a5814e6f0 2023-07-25T14:35:24.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:24.396+0000 7f8a5d957700 1 -- 172.21.15.72:0/754216455 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a580bca20 con 0x7f8a5814e6f0 2023-07-25T14:35:24.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:24.396+0000 7f8a3ffff700 1 -- 172.21.15.72:0/754216455 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a5000ced0 con 0x7f8a5814e6f0 2023-07-25T14:35:24.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:24.396+0000 7f8a5d957700 1 -- 172.21.15.72:0/754216455 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a581e5c90 con 0x7f8a5814e6f0 2023-07-25T14:35:24.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:24.397+0000 7f8a3ffff700 1 -- 172.21.15.72:0/754216455 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f8a50014780 con 0x7f8a5814e6f0 2023-07-25T14:35:24.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:24.397+0000 7f8a5d957700 1 -- 172.21.15.72:0/754216455 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a581e6750 con 0x7f8a5814e6f0 2023-07-25T14:35:24.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:24.397+0000 7f8a3ffff700 1 -- 172.21.15.72:0/754216455 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f8a5001d400 con 0x7f8a5814e6f0 2023-07-25T14:35:24.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:24.401+0000 7f8a3ffff700 1 -- 172.21.15.72:0/754216455 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f8a50018020 con 0x7f8a5814e6f0 2023-07-25T14:35:24.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:24.470+0000 7f8a5d957700 1 -- 172.21.15.72:0/754216455 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8a58154410 con 0x7f8a5814e6f0 2023-07-25T14:35:24.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:24.470+0000 7f8a3ffff700 1 -- 172.21.15.72:0/754216455 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f8a50014a70 con 0x7f8a5814e6f0 2023-07-25T14:35:24.483 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-25T14:35:24.484 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":10,"fsid":"9170db48-9170-43e8-8ccb-9813e6240906","created":"2023-07-25T14:35:21.733262+0000","modified":"2023-07-25T14:35:24.195785+0000","last_up_change":"0.000000","last_in_change":"2023-07-25T14:35:24.195785+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"d517fdad-0bfe-49f0-89f2-9421c3761839","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"e1564be3-f209-47e5-a8d0-32fc618a474f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"c4647d30-ffa6-417a-9026-ef530c75910e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"76c9d9a7-c2e2-4612-a58b-d6882dd76b58","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"7f8920dc-0ad4-4a73-ab40-65408f83eadd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"56257e7c-31eb-44c5-9ec7-1318a4e0bb35","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"a150d3d8-a0c9-4955-968a-8d98eff4ffb7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"07799c27-54ee-4591-a42d-a978d6b32065","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-25T14:35:24.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:24.471+0000 7f8a5d957700 1 -- 172.21.15.72:0/754216455 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8a5814e6f0 msgr2=0x7f8a580c0150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:24.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:24.471+0000 7f8a5d957700 1 --2- 172.21.15.72:0/754216455 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8a5814e6f0 0x7f8a580c0150 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f8a5000efc0 tx=0x7f8a5000c3a0 comp rx=0 tx=0).stop 2023-07-25T14:35:24.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:24.471+0000 7f8a5d957700 1 -- 172.21.15.72:0/754216455 shutdown_connections 2023-07-25T14:35:24.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:24.471+0000 7f8a5d957700 1 --2- 172.21.15.72:0/754216455 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8a5814e6f0 0x7f8a580c0150 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:24.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:24.471+0000 7f8a5d957700 1 --2- 172.21.15.72:0/754216455 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8a5806f280 0x7f8a580c5930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:24.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:24.471+0000 7f8a5d957700 1 --2- 172.21.15.72:0/754216455 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8a580c11f0 0x7f8a580bfc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:24.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:24.471+0000 7f8a5d957700 1 -- 172.21.15.72:0/754216455 >> 172.21.15.72:0/754216455 conn(0x7f8a580714f0 msgr2=0x7f8a58153930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:35:24.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:24.472+0000 7f8a5d957700 1 -- 172.21.15.72:0/754216455 shutdown_connections 2023-07-25T14:35:24.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:24.472+0000 7f8a5d957700 1 -- 172.21.15.72:0/754216455 wait complete. 2023-07-25T14:35:24.497 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-07-25T14:35:24.497 INFO:tasks.ceph:Waiting for OSDs to come up 2023-07-25T14:35:24.772 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-07-25T14:35:24.759+0000 7f1c41ed8200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-25T14:35:24.851 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-07-25T14:35:24.838+0000 7f1c41ed8200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-25T14:35:24.856 INFO:tasks.ceph.osd.5.smithi092.stderr:2023-07-25T14:35:24.842+0000 7f3630d8e640 -1 Falling back to public interface 2023-07-25T14:35:24.857 INFO:tasks.ceph.osd.6.smithi092.stderr:2023-07-25T14:35:24.844+0000 7fd1fc9f1640 -1 Falling back to public interface 2023-07-25T14:35:24.861 INFO:tasks.ceph.osd.0.smithi072.stderr:2023-07-25T14:35:24.848+0000 7fce4ff19640 -1 Falling back to public interface 2023-07-25T14:35:24.864 INFO:tasks.ceph.osd.4.smithi092.stderr:2023-07-25T14:35:24.851+0000 7f89b2425640 -1 Falling back to public interface 2023-07-25T14:35:24.866 INFO:tasks.ceph.osd.7.smithi092.stderr:2023-07-25T14:35:24.853+0000 7ffa709e6640 -1 Falling back to public interface 2023-07-25T14:35:24.869 INFO:tasks.ceph.mgr.x.smithi092.stderr:2023-07-25T14:35:24.856+0000 7f95aaba9200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-25T14:35:24.873 INFO:tasks.ceph.osd.2.smithi072.stderr:2023-07-25T14:35:24.860+0000 7f86beffc640 -1 Falling back to public interface 2023-07-25T14:35:24.878 INFO:tasks.ceph.osd.3.smithi072.stderr:2023-07-25T14:35:24.865+0000 7f166357d640 -1 Falling back to public interface 2023-07-25T14:35:24.880 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-07-25T14:35:24.867+0000 7f2a477b4640 -1 Falling back to public interface 2023-07-25T14:35:24.948 INFO:tasks.ceph.mgr.x.smithi092.stderr:2023-07-25T14:35:24.935+0000 7f95aaba9200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-25T14:35:24.995 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-07-25T14:35:24.982+0000 7f1c41ed8200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-25T14:35:25.088 INFO:tasks.ceph.mgr.x.smithi092.stderr:2023-07-25T14:35:25.074+0000 7f95aaba9200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-25T14:35:25.229 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-07-25T14:35:25.216+0000 7f1c41ed8200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-07-25T14:35:25.303 DEBUG:teuthology.orchestra.run.smithi072:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-07-25T14:35:25.304 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-07-25T14:35:25.291+0000 7f1c41ed8200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-25T14:35:25.323 INFO:tasks.ceph.mgr.x.smithi092.stderr:2023-07-25T14:35:25.310+0000 7f95aaba9200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-07-25T14:35:25.397 INFO:tasks.ceph.mgr.x.smithi092.stderr:2023-07-25T14:35:25.384+0000 7f95aaba9200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-25T14:35:25.419 INFO:teuthology.misc.health.smithi072.stderr:2023-07-25T14:35:25.406+0000 7ff053393700 1 Processor -- start 2023-07-25T14:35:25.419 INFO:teuthology.misc.health.smithi072.stderr:2023-07-25T14:35:25.406+0000 7ff053393700 1 -- start start 2023-07-25T14:35:25.421 INFO:teuthology.misc.health.smithi072.stderr:2023-07-25T14:35:25.407+0000 7ff053393700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff04c150ec0 0x7ff04c0c1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:25.421 INFO:teuthology.misc.health.smithi072.stderr:2023-07-25T14:35:25.407+0000 7ff053393700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff04c1514a0 con 0x7ff04c14ae70 2023-07-25T14:35:25.421 INFO:teuthology.misc.health.smithi072.stderr:2023-07-25T14:35:25.407+0000 7ff053393700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff04c151780 con 0x7ff04c0c1670 2023-07-25T14:35:25.421 INFO:teuthology.misc.health.smithi072.stderr:2023-07-25T14:35:25.407+0000 7ff053393700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff04c151a60 con 0x7ff04c150ec0 2023-07-25T14:35:25.421 INFO:teuthology.misc.health.smithi072.stderr:2023-07-25T14:35:25.407+0000 7ff05092e700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff04c150ec0 0x7ff04c0c1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:25.422 INFO:teuthology.misc.health.smithi072.stderr:2023-07-25T14:35:25.407+0000 7ff05092e700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff04c150ec0 0x7ff04c0c1130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:38834/0 (socket says 172.21.15.72:38834) 2023-07-25T14:35:25.422 INFO:teuthology.misc.health.smithi072.stderr:2023-07-25T14:35:25.407+0000 7ff05092e700 1 -- 172.21.15.72:0/3515156648 learned_addr learned my addr 172.21.15.72:0/3515156648 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:35:25.422 INFO:teuthology.misc.health.smithi072.stderr:2023-07-25T14:35:25.408+0000 7ff05092e700 1 -- 172.21.15.72:0/3515156648 >> v1:172.21.15.92:6789/0 conn(0x7ff04c0c1670 legacy=0x7ff04c154990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:25.422 INFO:teuthology.misc.health.smithi072.stderr:2023-07-25T14:35:25.408+0000 7ff05092e700 1 -- 172.21.15.72:0/3515156648 >> v1:172.21.15.72:6789/0 conn(0x7ff04c14ae70 legacy=0x7ff04c072180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:25.422 INFO:teuthology.misc.health.smithi072.stderr:2023-07-25T14:35:25.408+0000 7ff043fff700 1 -- 172.21.15.72:0/3515156648 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3722909624 0 0) 0x7ff04c1514a0 con 0x7ff04c14ae70 2023-07-25T14:35:25.422 INFO:teuthology.misc.health.smithi072.stderr:2023-07-25T14:35:25.408+0000 7ff05092e700 1 -- 172.21.15.72:0/3515156648 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff04c151d40 con 0x7ff04c150ec0 2023-07-25T14:35:25.422 INFO:teuthology.misc.health.smithi072.stderr:2023-07-25T14:35:25.408+0000 7ff05092e700 1 --2- 172.21.15.72:0/3515156648 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff04c150ec0 0x7ff04c0c1130 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7ff03c0098f0 tx=0x7ff03c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=642e8826c520bda2 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:35:25.422 INFO:teuthology.misc.health.smithi072.stderr:2023-07-25T14:35:25.408+0000 7ff043fff700 1 -- 172.21.15.72:0/3515156648 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff03c00b8a0 con 0x7ff04c150ec0 2023-07-25T14:35:25.423 INFO:teuthology.misc.health.smithi072.stderr:2023-07-25T14:35:25.408+0000 7ff043fff700 1 -- 172.21.15.72:0/3515156648 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff03c00ba00 con 0x7ff04c150ec0 2023-07-25T14:35:25.423 INFO:teuthology.misc.health.smithi072.stderr:2023-07-25T14:35:25.408+0000 7ff043fff700 1 -- 172.21.15.72:0/3515156648 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff03c00bd90 con 0x7ff04c150ec0 2023-07-25T14:35:25.425 INFO:teuthology.misc.health.smithi072.stderr:2023-07-25T14:35:25.409+0000 7ff053393700 1 -- 172.21.15.72:0/3515156648 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff04c150ec0 msgr2=0x7ff04c0c1130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:25.425 INFO:teuthology.misc.health.smithi072.stderr:2023-07-25T14:35:25.409+0000 7ff053393700 1 --2- 172.21.15.72:0/3515156648 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff04c150ec0 0x7ff04c0c1130 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7ff03c0098f0 tx=0x7ff03c009c00 comp rx=0 tx=0).stop 2023-07-25T14:35:25.425 INFO:teuthology.misc.health.smithi072.stderr:2023-07-25T14:35:25.409+0000 7ff053393700 1 -- 172.21.15.72:0/3515156648 shutdown_connections 2023-07-25T14:35:25.425 INFO:teuthology.misc.health.smithi072.stderr:2023-07-25T14:35:25.409+0000 7ff053393700 1 --2- 172.21.15.72:0/3515156648 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff04c150ec0 0x7ff04c0c1130 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:25.425 INFO:teuthology.misc.health.smithi072.stderr:2023-07-25T14:35:25.409+0000 7ff053393700 1 -- 172.21.15.72:0/3515156648 >> 172.21.15.72:0/3515156648 conn(0x7ff04c06b240 msgr2=0x7ff04c06b620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:35:25.426 INFO:teuthology.misc.health.smithi072.stderr:2023-07-25T14:35:25.409+0000 7ff053393700 1 -- 172.21.15.72:0/3515156648 shutdown_connections 2023-07-25T14:35:25.426 INFO:teuthology.misc.health.smithi072.stderr:2023-07-25T14:35:25.409+0000 7ff053393700 1 -- 172.21.15.72:0/3515156648 wait complete. 2023-07-25T14:35:25.426 INFO:teuthology.misc.health.smithi072.stderr:2023-07-25T14:35:25.410+0000 7ff053393700 1 Processor -- start 2023-07-25T14:35:25.426 INFO:teuthology.misc.health.smithi072.stderr:2023-07-25T14:35:25.410+0000 7ff053393700 1 -- start start 2023-07-25T14:35:25.426 INFO:teuthology.misc.health.smithi072.stderr:2023-07-25T14:35:25.411+0000 7ff053393700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff04c0c1670 0x7ff04c1470b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:25.426 INFO:teuthology.misc.health.smithi072.stderr:2023-07-25T14:35:25.411+0000 7ff053393700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff04c14ae70 0x7ff04c1dd000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:25.426 INFO:teuthology.misc.health.smithi072.stderr:2023-07-25T14:35:25.411+0000 7ff053393700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff04c150ec0 0x7ff04c1eac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:25.426 INFO:teuthology.misc.health.smithi072.stderr:2023-07-25T14:35:25.411+0000 7ff053393700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff04c1542c0 con 0x7ff04c150ec0 2023-07-25T14:35:25.427 INFO:teuthology.misc.health.smithi072.stderr:2023-07-25T14:35:25.411+0000 7ff053393700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff04c153fe0 con 0x7ff04c14ae70 2023-07-25T14:35:25.427 INFO:teuthology.misc.health.smithi072.stderr:2023-07-25T14:35:25.411+0000 7ff053393700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff04c1ddec0 con 0x7ff04c0c1670 2023-07-25T14:35:25.427 INFO:teuthology.misc.health.smithi072.stderr:2023-07-25T14:35:25.411+0000 7ff051930700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff04c150ec0 0x7ff04c1eac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:25.427 INFO:teuthology.misc.health.smithi072.stderr:2023-07-25T14:35:25.411+0000 7ff05112f700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff04c0c1670 0x7ff04c1470b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:25.427 INFO:teuthology.misc.health.smithi072.stderr:2023-07-25T14:35:25.411+0000 7ff051930700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff04c150ec0 0x7ff04c1eac60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:38842/0 (socket says 172.21.15.72:38842) 2023-07-25T14:35:25.427 INFO:teuthology.misc.health.smithi072.stderr:2023-07-25T14:35:25.411+0000 7ff05112f700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff04c0c1670 0x7ff04c1470b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3301/0 says I am v2:172.21.15.72:44066/0 (socket says 172.21.15.72:44066) 2023-07-25T14:35:25.427 INFO:teuthology.misc.health.smithi072.stderr:2023-07-25T14:35:25.411+0000 7ff051930700 1 -- 172.21.15.72:0/1096911315 learned_addr learned my addr 172.21.15.72:0/1096911315 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:35:25.428 INFO:teuthology.misc.health.smithi072.stderr:2023-07-25T14:35:25.411+0000 7ff05092e700 1 --2- 172.21.15.72:0/1096911315 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff04c14ae70 0x7ff04c1dd000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:25.428 INFO:teuthology.misc.health.smithi072.stderr:2023-07-25T14:35:25.411+0000 7ff051930700 1 -- 172.21.15.72:0/1096911315 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff04c0c1670 msgr2=0x7ff04c1470b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:25.428 INFO:teuthology.misc.health.smithi072.stderr:2023-07-25T14:35:25.411+0000 7ff051930700 1 --2- 172.21.15.72:0/1096911315 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff04c0c1670 0x7ff04c1470b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:25.428 INFO:teuthology.misc.health.smithi072.stderr:2023-07-25T14:35:25.411+0000 7ff051930700 1 -- 172.21.15.72:0/1096911315 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff04c14ae70 msgr2=0x7ff04c1dd000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:25.428 INFO:teuthology.misc.health.smithi072.stderr:2023-07-25T14:35:25.411+0000 7ff051930700 1 --2- 172.21.15.72:0/1096911315 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff04c14ae70 0x7ff04c1dd000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:25.428 INFO:teuthology.misc.health.smithi072.stderr:2023-07-25T14:35:25.411+0000 7ff051930700 1 -- 172.21.15.72:0/1096911315 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff03c009550 con 0x7ff04c150ec0 2023-07-25T14:35:25.429 INFO:teuthology.misc.health.smithi072.stderr:2023-07-25T14:35:25.411+0000 7ff051930700 1 --2- 172.21.15.72:0/1096911315 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff04c150ec0 0x7ff04c1eac60 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7ff04400cb50 tx=0x7ff04400ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:35:25.429 INFO:teuthology.misc.health.smithi072.stderr:2023-07-25T14:35:25.411+0000 7ff041ffb700 1 -- 172.21.15.72:0/1096911315 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff044003c00 con 0x7ff04c150ec0 2023-07-25T14:35:25.429 INFO:teuthology.misc.health.smithi072.stderr:2023-07-25T14:35:25.412+0000 7ff041ffb700 1 -- 172.21.15.72:0/1096911315 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff044003d60 con 0x7ff04c150ec0 2023-07-25T14:35:25.429 INFO:teuthology.misc.health.smithi072.stderr:2023-07-25T14:35:25.412+0000 7ff041ffb700 1 -- 172.21.15.72:0/1096911315 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff04400aa20 con 0x7ff04c150ec0 2023-07-25T14:35:25.429 INFO:teuthology.misc.health.smithi072.stderr:2023-07-25T14:35:25.412+0000 7ff053393700 1 -- 172.21.15.72:0/1096911315 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff04c1de1a0 con 0x7ff04c150ec0 2023-07-25T14:35:25.429 INFO:teuthology.misc.health.smithi072.stderr:2023-07-25T14:35:25.412+0000 7ff041ffb700 1 -- 172.21.15.72:0/1096911315 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7ff0440050d0 con 0x7ff04c150ec0 2023-07-25T14:35:25.429 INFO:teuthology.misc.health.smithi072.stderr:2023-07-25T14:35:25.412+0000 7ff053393700 1 -- 172.21.15.72:0/1096911315 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff04c06ec60 con 0x7ff04c150ec0 2023-07-25T14:35:25.429 INFO:teuthology.misc.health.smithi072.stderr:2023-07-25T14:35:25.412+0000 7ff041ffb700 1 -- 172.21.15.72:0/1096911315 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7ff044012d20 con 0x7ff04c150ec0 2023-07-25T14:35:25.430 INFO:teuthology.misc.health.smithi072.stderr:2023-07-25T14:35:25.413+0000 7ff053393700 1 -- 172.21.15.72:0/1096911315 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff04c152620 con 0x7ff04c150ec0 2023-07-25T14:35:25.430 INFO:teuthology.misc.health.smithi072.stderr:2023-07-25T14:35:25.417+0000 7ff041ffb700 1 -- 172.21.15.72:0/1096911315 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7ff044005510 con 0x7ff04c150ec0 2023-07-25T14:35:25.499 INFO:teuthology.misc.health.smithi072.stderr:2023-07-25T14:35:25.486+0000 7ff053393700 1 -- 172.21.15.72:0/1096911315 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff04c0742d0 con 0x7ff04c150ec0 2023-07-25T14:35:25.500 INFO:teuthology.misc.health.smithi072.stderr:2023-07-25T14:35:25.487+0000 7ff041ffb700 1 -- 172.21.15.72:0/1096911315 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7ff0440056b0 con 0x7ff04c150ec0 2023-07-25T14:35:25.500 INFO:teuthology.misc.health.smithi072.stdout: 2023-07-25T14:35:25.500 INFO:teuthology.misc.health.smithi072.stdout:{"epoch":10,"fsid":"9170db48-9170-43e8-8ccb-9813e6240906","created":"2023-07-25T14:35:21.733262+0000","modified":"2023-07-25T14:35:24.195785+0000","last_up_change":"0.000000","last_in_change":"2023-07-25T14:35:24.195785+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"d517fdad-0bfe-49f0-89f2-9421c3761839","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"e1564be3-f209-47e5-a8d0-32fc618a474f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"c4647d30-ffa6-417a-9026-ef530c75910e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"76c9d9a7-c2e2-4612-a58b-d6882dd76b58","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"7f8920dc-0ad4-4a73-ab40-65408f83eadd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"56257e7c-31eb-44c5-9ec7-1318a4e0bb35","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"a150d3d8-a0c9-4955-968a-8d98eff4ffb7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"07799c27-54ee-4591-a42d-a978d6b32065","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-25T14:35:25.501 INFO:teuthology.misc.health.smithi072.stderr:2023-07-25T14:35:25.488+0000 7ff053393700 1 -- 172.21.15.72:0/1096911315 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff04c150ec0 msgr2=0x7ff04c1eac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:25.501 INFO:teuthology.misc.health.smithi072.stderr:2023-07-25T14:35:25.488+0000 7ff053393700 1 --2- 172.21.15.72:0/1096911315 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff04c150ec0 0x7ff04c1eac60 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7ff04400cb50 tx=0x7ff04400ce60 comp rx=0 tx=0).stop 2023-07-25T14:35:25.502 INFO:teuthology.misc.health.smithi072.stderr:2023-07-25T14:35:25.488+0000 7ff053393700 1 -- 172.21.15.72:0/1096911315 shutdown_connections 2023-07-25T14:35:25.502 INFO:teuthology.misc.health.smithi072.stderr:2023-07-25T14:35:25.488+0000 7ff053393700 1 --2- 172.21.15.72:0/1096911315 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff04c0c1670 0x7ff04c1470b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:25.502 INFO:teuthology.misc.health.smithi072.stderr:2023-07-25T14:35:25.488+0000 7ff053393700 1 --2- 172.21.15.72:0/1096911315 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff04c150ec0 0x7ff04c1eac60 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:25.502 INFO:teuthology.misc.health.smithi072.stderr:2023-07-25T14:35:25.488+0000 7ff053393700 1 --2- 172.21.15.72:0/1096911315 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff04c14ae70 0x7ff04c1dd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:25.502 INFO:teuthology.misc.health.smithi072.stderr:2023-07-25T14:35:25.488+0000 7ff053393700 1 -- 172.21.15.72:0/1096911315 >> 172.21.15.72:0/1096911315 conn(0x7ff04c06b240 msgr2=0x7ff04c0bc1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:35:25.502 INFO:teuthology.misc.health.smithi072.stderr:2023-07-25T14:35:25.488+0000 7ff053393700 1 -- 172.21.15.72:0/1096911315 shutdown_connections 2023-07-25T14:35:25.502 INFO:teuthology.misc.health.smithi072.stderr:2023-07-25T14:35:25.488+0000 7ff053393700 1 -- 172.21.15.72:0/1096911315 wait complete. 2023-07-25T14:35:25.512 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-07-25T14:35:25.584 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-07-25T14:35:25.571+0000 7f1c41ed8200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-25T14:35:25.670 INFO:tasks.ceph.mgr.x.smithi092.stderr:2023-07-25T14:35:25.657+0000 7f95aaba9200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-25T14:35:25.803 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-07-25T14:35:25.790+0000 7f1c41ed8200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-25T14:35:25.890 INFO:tasks.ceph.mgr.x.smithi092.stderr:2023-07-25T14:35:25.877+0000 7f95aaba9200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-25T14:35:25.957 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-07-25T14:35:25.944+0000 7f1c41ed8200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-25T14:35:26.046 INFO:tasks.ceph.mgr.x.smithi092.stderr:2023-07-25T14:35:26.032+0000 7f95aaba9200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-25T14:35:26.075 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-07-25T14:35:26.062+0000 7f1c41ed8200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-25T14:35:26.161 INFO:tasks.ceph.mgr.x.smithi092.stderr:2023-07-25T14:35:26.147+0000 7f95aaba9200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-25T14:35:26.401 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-07-25T14:35:26.388+0000 7f1c41ed8200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-25T14:35:26.483 INFO:tasks.ceph.mgr.x.smithi092.stderr:2023-07-25T14:35:26.471+0000 7f95aaba9200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-25T14:35:26.500 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-07-25T14:35:26.488+0000 7f1c41ed8200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-25T14:35:26.584 INFO:tasks.ceph.mgr.x.smithi092.stderr:2023-07-25T14:35:26.571+0000 7f95aaba9200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-25T14:35:26.685 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-07-25T14:35:26.673+0000 7f1c41ed8200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-25T14:35:26.766 INFO:tasks.ceph.mgr.x.smithi092.stderr:2023-07-25T14:35:26.754+0000 7f95aaba9200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-25T14:35:27.276 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-07-25T14:35:27.263+0000 7f1c41ed8200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-25T14:35:27.357 INFO:tasks.ceph.mgr.x.smithi092.stderr:2023-07-25T14:35:27.345+0000 7f95aaba9200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-25T14:35:28.143 INFO:tasks.ceph.osd.2.smithi072.stderr:2023-07-25T14:35:28.130+0000 7f86beffc640 -1 osd.2 0 log_to_monitors true 2023-07-25T14:35:28.300 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-07-25T14:35:28.287+0000 7f1bfa0d7700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-07-25T14:35:28.301 INFO:tasks.ceph.mgr.y.smithi072.stderr:2023-07-25T14:35:28.288+0000 7f1bfa0d7700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-07-25T14:35:28.360 INFO:tasks.ceph.osd.0.smithi072.stderr:2023-07-25T14:35:28.348+0000 7fce4ff19640 -1 osd.0 0 log_to_monitors true 2023-07-25T14:35:28.396 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-07-25T14:35:28.383+0000 7f2a477b4640 -1 osd.1 0 log_to_monitors true 2023-07-25T14:35:28.418 INFO:tasks.ceph.osd.3.smithi072.stderr:2023-07-25T14:35:28.405+0000 7f166357d640 -1 osd.3 0 log_to_monitors true 2023-07-25T14:35:28.437 INFO:tasks.ceph.osd.5.smithi092.stderr:2023-07-25T14:35:28.425+0000 7f3630d8e640 -1 osd.5 0 log_to_monitors true 2023-07-25T14:35:28.438 INFO:tasks.ceph.osd.6.smithi092.stderr:2023-07-25T14:35:28.426+0000 7fd1fc9f1640 -1 osd.6 0 log_to_monitors true 2023-07-25T14:35:28.446 INFO:tasks.ceph.osd.4.smithi092.stderr:2023-07-25T14:35:28.433+0000 7f89b2425640 -1 osd.4 0 log_to_monitors true 2023-07-25T14:35:28.454 INFO:tasks.ceph.osd.7.smithi092.stderr:2023-07-25T14:35:28.442+0000 7ffa709e6640 -1 osd.7 0 log_to_monitors true 2023-07-25T14:35:30.358 INFO:tasks.ceph.osd.7.smithi092.stderr:2023-07-25T14:35:30.345+0000 7ffa64d9e700 -1 osd.7 0 waiting for initial osdmap 2023-07-25T14:35:30.372 INFO:tasks.ceph.osd.7.smithi092.stderr:2023-07-25T14:35:30.360+0000 7ffa5c978700 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-25T14:35:30.388 INFO:tasks.ceph.osd.2.smithi072.stderr:2023-07-25T14:35:30.375+0000 7f86b33b4700 -1 osd.2 0 waiting for initial osdmap 2023-07-25T14:35:30.394 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-07-25T14:35:30.382+0000 7f2a3bb6c700 -1 osd.1 0 waiting for initial osdmap 2023-07-25T14:35:30.397 INFO:tasks.ceph.osd.2.smithi072.stderr:2023-07-25T14:35:30.385+0000 7f86aaf8e700 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-25T14:35:30.403 INFO:tasks.ceph.osd.3.smithi072.stderr:2023-07-25T14:35:30.391+0000 7f1657935700 -1 osd.3 0 waiting for initial osdmap 2023-07-25T14:35:30.405 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-07-25T14:35:30.393+0000 7f2a33746700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-25T14:35:30.409 INFO:tasks.ceph.osd.4.smithi092.stderr:2023-07-25T14:35:30.397+0000 7f89a67dd700 -1 osd.4 0 waiting for initial osdmap 2023-07-25T14:35:30.416 INFO:tasks.ceph.osd.3.smithi072.stderr:2023-07-25T14:35:30.404+0000 7f164f50f700 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-25T14:35:30.427 INFO:tasks.ceph.osd.4.smithi092.stderr:2023-07-25T14:35:30.415+0000 7f899e3b7700 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-25T14:35:30.432 INFO:tasks.ceph.osd.6.smithi092.stderr:2023-07-25T14:35:30.419+0000 7fd1f0da9700 -1 osd.6 0 waiting for initial osdmap 2023-07-25T14:35:30.440 INFO:tasks.ceph.osd.0.smithi072.stderr:2023-07-25T14:35:30.427+0000 7fce442d1700 -1 osd.0 0 waiting for initial osdmap 2023-07-25T14:35:30.448 INFO:tasks.ceph.osd.6.smithi092.stderr:2023-07-25T14:35:30.436+0000 7fd1e8983700 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-25T14:35:30.452 INFO:tasks.ceph.osd.5.smithi092.stderr:2023-07-25T14:35:30.440+0000 7f3625146700 -1 osd.5 0 waiting for initial osdmap 2023-07-25T14:35:30.454 INFO:tasks.ceph.osd.0.smithi072.stderr:2023-07-25T14:35:30.442+0000 7fce3beab700 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-25T14:35:30.472 INFO:tasks.ceph.osd.5.smithi092.stderr:2023-07-25T14:35:30.457+0000 7f361cd20700 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-25T14:35:32.318 DEBUG:teuthology.orchestra.run.smithi072:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-07-25T14:35:32.442 INFO:teuthology.misc.health.smithi072.stderr:2023-07-25T14:35:32.429+0000 7f98cf371700 1 Processor -- start 2023-07-25T14:35:32.442 INFO:teuthology.misc.health.smithi072.stderr:2023-07-25T14:35:32.430+0000 7f98cf371700 1 -- start start 2023-07-25T14:35:32.443 INFO:teuthology.misc.health.smithi072.stderr:2023-07-25T14:35:32.430+0000 7f98cf371700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f98c806d7f0 0x7f98c806dc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:32.444 INFO:teuthology.misc.health.smithi072.stderr:2023-07-25T14:35:32.430+0000 7f98cf371700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98c80a9140 con 0x7f98c80c0290 2023-07-25T14:35:32.444 INFO:teuthology.misc.health.smithi072.stderr:2023-07-25T14:35:32.430+0000 7f98cf371700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98c80a93e0 con 0x7f98c8072290 2023-07-25T14:35:32.444 INFO:teuthology.misc.health.smithi072.stderr:2023-07-25T14:35:32.430+0000 7f98cf371700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98c81511c0 con 0x7f98c806d7f0 2023-07-25T14:35:32.444 INFO:teuthology.misc.health.smithi072.stderr:2023-07-25T14:35:32.430+0000 7f98cd90e700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f98c806d7f0 0x7f98c806dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:32.444 INFO:teuthology.misc.health.smithi072.stderr:2023-07-25T14:35:32.430+0000 7f98cd90e700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f98c806d7f0 0x7f98c806dc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:39082/0 (socket says 172.21.15.72:39082) 2023-07-25T14:35:32.444 INFO:teuthology.misc.health.smithi072.stderr:2023-07-25T14:35:32.430+0000 7f98cd10d700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f98c80c0290 0x7f98c80c0670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:58046/0 (socket says 172.21.15.72:58046) 2023-07-25T14:35:32.445 INFO:teuthology.misc.health.smithi072.stderr:2023-07-25T14:35:32.430+0000 7f98cd90e700 1 -- 172.21.15.72:0/2664295482 learned_addr learned my addr 172.21.15.72:0/2664295482 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:35:32.445 INFO:teuthology.misc.health.smithi072.stderr:2023-07-25T14:35:32.431+0000 7f98cd90e700 1 -- 172.21.15.72:0/2664295482 >> v1:172.21.15.92:6789/0 conn(0x7f98c8072290 legacy=0x7f98c814db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:35:32.445 INFO:teuthology.misc.health.smithi072.stderr:2023-07-25T14:35:32.431+0000 7f98cd90e700 1 -- 172.21.15.72:0/2664295482 >> v1:172.21.15.72:6789/0 conn(0x7f98c80c0290 legacy=0x7f98c80c0670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:32.445 INFO:teuthology.misc.health.smithi072.stderr:2023-07-25T14:35:32.431+0000 7f98cd90e700 1 -- 172.21.15.72:0/2664295482 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98c81514a0 con 0x7f98c806d7f0 2023-07-25T14:35:32.445 INFO:teuthology.misc.health.smithi072.stderr:2023-07-25T14:35:32.431+0000 7f98bffff700 1 -- 172.21.15.72:0/2664295482 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2819385387 0 0) 0x7f98c80a9140 con 0x7f98c80c0290 2023-07-25T14:35:32.445 INFO:teuthology.misc.health.smithi072.stderr:2023-07-25T14:35:32.431+0000 7f98cd90e700 1 --2- 172.21.15.72:0/2664295482 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f98c806d7f0 0x7f98c806dc60 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f98c0009e50 tx=0x7f98c000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edc6879752c97e54 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:35:32.445 INFO:teuthology.misc.health.smithi072.stderr:2023-07-25T14:35:32.431+0000 7f98bffff700 1 -- 172.21.15.72:0/2664295482 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98c0003a70 con 0x7f98c806d7f0 2023-07-25T14:35:32.445 INFO:teuthology.misc.health.smithi072.stderr:2023-07-25T14:35:32.431+0000 7f98bffff700 1 -- 172.21.15.72:0/2664295482 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98c0003bd0 con 0x7f98c806d7f0 2023-07-25T14:35:32.446 INFO:teuthology.misc.health.smithi072.stderr:2023-07-25T14:35:32.431+0000 7f98bffff700 1 -- 172.21.15.72:0/2664295482 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98c000b980 con 0x7f98c806d7f0 2023-07-25T14:35:32.448 INFO:teuthology.misc.health.smithi072.stderr:2023-07-25T14:35:32.432+0000 7f98cf371700 1 -- 172.21.15.72:0/2664295482 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f98c806d7f0 msgr2=0x7f98c806dc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:32.448 INFO:teuthology.misc.health.smithi072.stderr:2023-07-25T14:35:32.432+0000 7f98cf371700 1 --2- 172.21.15.72:0/2664295482 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f98c806d7f0 0x7f98c806dc60 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f98c0009e50 tx=0x7f98c000b330 comp rx=0 tx=0).stop 2023-07-25T14:35:32.448 INFO:teuthology.misc.health.smithi072.stderr:2023-07-25T14:35:32.432+0000 7f98cf371700 1 -- 172.21.15.72:0/2664295482 shutdown_connections 2023-07-25T14:35:32.448 INFO:teuthology.misc.health.smithi072.stderr:2023-07-25T14:35:32.432+0000 7f98cf371700 1 --2- 172.21.15.72:0/2664295482 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f98c806d7f0 0x7f98c806dc60 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:32.448 INFO:teuthology.misc.health.smithi072.stderr:2023-07-25T14:35:32.432+0000 7f98cf371700 1 -- 172.21.15.72:0/2664295482 >> 172.21.15.72:0/2664295482 conn(0x7f98c80a7670 msgr2=0x7f98c80a7a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:35:32.448 INFO:teuthology.misc.health.smithi072.stderr:2023-07-25T14:35:32.432+0000 7f98cf371700 1 -- 172.21.15.72:0/2664295482 shutdown_connections 2023-07-25T14:35:32.449 INFO:teuthology.misc.health.smithi072.stderr:2023-07-25T14:35:32.432+0000 7f98cf371700 1 -- 172.21.15.72:0/2664295482 wait complete. 2023-07-25T14:35:32.449 INFO:teuthology.misc.health.smithi072.stderr:2023-07-25T14:35:32.433+0000 7f98cf371700 1 Processor -- start 2023-07-25T14:35:32.449 INFO:teuthology.misc.health.smithi072.stderr:2023-07-25T14:35:32.433+0000 7f98cf371700 1 -- start start 2023-07-25T14:35:32.449 INFO:teuthology.misc.health.smithi072.stderr:2023-07-25T14:35:32.434+0000 7f98cf371700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f98c806d7f0 0x7f98c814b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:32.449 INFO:teuthology.misc.health.smithi072.stderr:2023-07-25T14:35:32.434+0000 7f98cf371700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f98c8072290 0x7f98c81dcba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:32.449 INFO:teuthology.misc.health.smithi072.stderr:2023-07-25T14:35:32.434+0000 7f98cf371700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f98c80c0290 0x7f98c8147ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:32.449 INFO:teuthology.misc.health.smithi072.stderr:2023-07-25T14:35:32.434+0000 7f98cf371700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98c80c4a40 con 0x7f98c806d7f0 2023-07-25T14:35:32.449 INFO:teuthology.misc.health.smithi072.stderr:2023-07-25T14:35:32.434+0000 7f98cf371700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98c8149080 con 0x7f98c8072290 2023-07-25T14:35:32.450 INFO:teuthology.misc.health.smithi072.stderr:2023-07-25T14:35:32.434+0000 7f98cf371700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98c80c41a0 con 0x7f98c80c0290 2023-07-25T14:35:32.450 INFO:teuthology.misc.health.smithi072.stderr:2023-07-25T14:35:32.434+0000 7f98cd10d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f98c806d7f0 0x7f98c814b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:32.450 INFO:teuthology.misc.health.smithi072.stderr:2023-07-25T14:35:32.434+0000 7f98cd10d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f98c806d7f0 0x7f98c814b4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:39084/0 (socket says 172.21.15.72:39084) 2023-07-25T14:35:32.450 INFO:teuthology.misc.health.smithi072.stderr:2023-07-25T14:35:32.434+0000 7f98cd10d700 1 -- 172.21.15.72:0/221978988 learned_addr learned my addr 172.21.15.72:0/221978988 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:35:32.450 INFO:teuthology.misc.health.smithi072.stderr:2023-07-25T14:35:32.434+0000 7f98cc90c700 1 --2- 172.21.15.72:0/221978988 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f98c8072290 0x7f98c81dcba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:32.450 INFO:teuthology.misc.health.smithi072.stderr:2023-07-25T14:35:32.434+0000 7f98cd10d700 1 -- 172.21.15.72:0/221978988 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f98c80c0290 msgr2=0x7f98c8147ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:32.450 INFO:teuthology.misc.health.smithi072.stderr:2023-07-25T14:35:32.434+0000 7f98cd90e700 1 --2- 172.21.15.72:0/221978988 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f98c80c0290 0x7f98c8147ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:32.450 INFO:teuthology.misc.health.smithi072.stderr:2023-07-25T14:35:32.434+0000 7f98cd10d700 1 --2- 172.21.15.72:0/221978988 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f98c80c0290 0x7f98c8147ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:32.451 INFO:teuthology.misc.health.smithi072.stderr:2023-07-25T14:35:32.434+0000 7f98cd10d700 1 -- 172.21.15.72:0/221978988 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f98c8072290 msgr2=0x7f98c81dcba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:32.451 INFO:teuthology.misc.health.smithi072.stderr:2023-07-25T14:35:32.434+0000 7f98cd10d700 1 --2- 172.21.15.72:0/221978988 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f98c8072290 0x7f98c81dcba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:32.451 INFO:teuthology.misc.health.smithi072.stderr:2023-07-25T14:35:32.434+0000 7f98cd10d700 1 -- 172.21.15.72:0/221978988 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98c0009b30 con 0x7f98c806d7f0 2023-07-25T14:35:32.451 INFO:teuthology.misc.health.smithi072.stderr:2023-07-25T14:35:32.434+0000 7f98cc90c700 1 --2- 172.21.15.72:0/221978988 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f98c8072290 0x7f98c81dcba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-25T14:35:32.451 INFO:teuthology.misc.health.smithi072.stderr:2023-07-25T14:35:32.434+0000 7f98cd10d700 1 --2- 172.21.15.72:0/221978988 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f98c806d7f0 0x7f98c814b4a0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f98b800c520 tx=0x7f98b800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:35:32.451 INFO:teuthology.misc.health.smithi072.stderr:2023-07-25T14:35:32.434+0000 7f98bdffb700 1 -- 172.21.15.72:0/221978988 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98b8004c80 con 0x7f98c806d7f0 2023-07-25T14:35:32.451 INFO:teuthology.misc.health.smithi072.stderr:2023-07-25T14:35:32.434+0000 7f98bdffb700 1 -- 172.21.15.72:0/221978988 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98b8004e20 con 0x7f98c806d7f0 2023-07-25T14:35:32.452 INFO:teuthology.misc.health.smithi072.stderr:2023-07-25T14:35:32.434+0000 7f98cf371700 1 -- 172.21.15.72:0/221978988 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98c80c4480 con 0x7f98c806d7f0 2023-07-25T14:35:32.452 INFO:teuthology.misc.health.smithi072.stderr:2023-07-25T14:35:32.434+0000 7f98bdffb700 1 -- 172.21.15.72:0/221978988 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98b8007310 con 0x7f98c806d7f0 2023-07-25T14:35:32.452 INFO:teuthology.misc.health.smithi072.stderr:2023-07-25T14:35:32.435+0000 7f98cf371700 1 -- 172.21.15.72:0/221978988 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98c8148d10 con 0x7f98c806d7f0 2023-07-25T14:35:32.452 INFO:teuthology.misc.health.smithi072.stderr:2023-07-25T14:35:32.436+0000 7f98cf371700 1 -- 172.21.15.72:0/221978988 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98c8149360 con 0x7f98c806d7f0 2023-07-25T14:35:32.453 INFO:teuthology.misc.health.smithi072.stderr:2023-07-25T14:35:32.436+0000 7f98bdffb700 1 -- 172.21.15.72:0/221978988 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 88981+0+0 (secure 0 0 0) 0x7f98b8007470 con 0x7f98c806d7f0 2023-07-25T14:35:32.453 INFO:teuthology.misc.health.smithi072.stderr:2023-07-25T14:35:32.436+0000 7f98bdffb700 1 --2- 172.21.15.72:0/221978988 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f98ac06ac50 0x7f98ac06d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:32.453 INFO:teuthology.misc.health.smithi072.stderr:2023-07-25T14:35:32.436+0000 7f98bdffb700 1 -- 172.21.15.72:0/221978988 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 4471+0+0 (secure 0 0 0) 0x7f98b80889d0 con 0x7f98c806d7f0 2023-07-25T14:35:32.453 INFO:teuthology.misc.health.smithi072.stderr:2023-07-25T14:35:32.436+0000 7f98cc90c700 1 --2- 172.21.15.72:0/221978988 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f98ac06ac50 0x7f98ac06d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:32.453 INFO:teuthology.misc.health.smithi072.stderr:2023-07-25T14:35:32.437+0000 7f98cc90c700 1 --2- 172.21.15.72:0/221978988 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f98ac06ac50 0x7f98ac06d110 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f98c80c3cd0 tx=0x7f98c4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:35:32.454 INFO:teuthology.misc.health.smithi072.stderr:2023-07-25T14:35:32.441+0000 7f98bdffb700 1 -- 172.21.15.72:0/221978988 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f98b8054190 con 0x7f98c806d7f0 2023-07-25T14:35:32.643 INFO:teuthology.misc.health.smithi072.stderr:2023-07-25T14:35:32.630+0000 7f98cf371700 1 -- 172.21.15.72:0/221978988 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f98c8148b70 con 0x7f98c806d7f0 2023-07-25T14:35:32.644 INFO:teuthology.misc.health.smithi072.stderr:2023-07-25T14:35:32.631+0000 7f98bdffb700 1 -- 172.21.15.72:0/221978988 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) v1 ==== 74+0+10998 (secure 0 0 0) 0x7f98c8148b70 con 0x7f98c806d7f0 2023-07-25T14:35:32.644 INFO:teuthology.misc.health.smithi072.stdout: 2023-07-25T14:35:32.644 INFO:teuthology.misc.health.smithi072.stdout:{"epoch":14,"fsid":"9170db48-9170-43e8-8ccb-9813e6240906","created":"2023-07-25T14:35:21.733262+0000","modified":"2023-07-25T14:35:32.356966+0000","last_up_change":"2023-07-25T14:35:31.355010+0000","last_in_change":"2023-07-25T14:35:24.195785+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"d517fdad-0bfe-49f0-89f2-9421c3761839","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6801","nonce":2475407414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6803","nonce":2475407414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6807","nonce":2475407414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6805","nonce":2475407414}]},"public_addr":"172.21.15.72:6801/2475407414","cluster_addr":"172.21.15.72:6803/2475407414","heartbeat_back_addr":"172.21.15.72:6807/2475407414","heartbeat_front_addr":"172.21.15.72:6805/2475407414","state":["exists","up"]},{"osd":1,"uuid":"e1564be3-f209-47e5-a8d0-32fc618a474f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6822","nonce":870954016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6825","nonce":870954016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6831","nonce":870954016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6827","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6829","nonce":870954016}]},"public_addr":"172.21.15.72:6822/870954016","cluster_addr":"172.21.15.72:6825/870954016","heartbeat_back_addr":"172.21.15.72:6831/870954016","heartbeat_front_addr":"172.21.15.72:6829/870954016","state":["exists","up"]},{"osd":2,"uuid":"c4647d30-ffa6-417a-9026-ef530c75910e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6809","nonce":2143129442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6811","nonce":2143129442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6815","nonce":2143129442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6813","nonce":2143129442}]},"public_addr":"172.21.15.72:6809/2143129442","cluster_addr":"172.21.15.72:6811/2143129442","heartbeat_back_addr":"172.21.15.72:6815/2143129442","heartbeat_front_addr":"172.21.15.72:6813/2143129442","state":["exists","up"]},{"osd":3,"uuid":"76c9d9a7-c2e2-4612-a58b-d6882dd76b58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6817","nonce":3404066311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6819","nonce":3404066311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6828","nonce":3404066311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6821","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6823","nonce":3404066311}]},"public_addr":"172.21.15.72:6817/3404066311","cluster_addr":"172.21.15.72:6819/3404066311","heartbeat_back_addr":"172.21.15.72:6828/3404066311","heartbeat_front_addr":"172.21.15.72:6823/3404066311","state":["exists","up"]},{"osd":4,"uuid":"7f8920dc-0ad4-4a73-ab40-65408f83eadd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6817","nonce":2381008739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6819","nonce":2381008739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6825","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6827","nonce":2381008739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6822","nonce":2381008739}]},"public_addr":"172.21.15.92:6817/2381008739","cluster_addr":"172.21.15.92:6819/2381008739","heartbeat_back_addr":"172.21.15.92:6827/2381008739","heartbeat_front_addr":"172.21.15.92:6822/2381008739","state":["exists","up"]},{"osd":5,"uuid":"56257e7c-31eb-44c5-9ec7-1318a4e0bb35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6801","nonce":2161935604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6803","nonce":2161935604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6807","nonce":2161935604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6805","nonce":2161935604}]},"public_addr":"172.21.15.92:6801/2161935604","cluster_addr":"172.21.15.92:6803/2161935604","heartbeat_back_addr":"172.21.15.92:6807/2161935604","heartbeat_front_addr":"172.21.15.92:6805/2161935604","state":["exists","up"]},{"osd":6,"uuid":"a150d3d8-a0c9-4955-968a-8d98eff4ffb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6809","nonce":3770163493}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6811","nonce":3770163493}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6815","nonce":3770163493}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6813","nonce":3770163493}]},"public_addr":"172.21.15.92:6809/3770163493","cluster_addr":"172.21.15.92:6811/3770163493","heartbeat_back_addr":"172.21.15.92:6815/3770163493","heartbeat_front_addr":"172.21.15.92:6813/3770163493","state":["exists","up"]},{"osd":7,"uuid":"07799c27-54ee-4591-a42d-a978d6b32065","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6821","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6823","nonce":2135777609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6826","nonce":2135777609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6831","nonce":2135777609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6829","nonce":2135777609}]},"public_addr":"172.21.15.92:6823/2135777609","cluster_addr":"172.21.15.92:6826/2135777609","heartbeat_back_addr":"172.21.15.92:6831/2135777609","heartbeat_front_addr":"172.21.15.92:6829/2135777609","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.146566+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.372172+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:30.398421+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.385632+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.465611+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.443583+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-25T14:35:32.646 INFO:teuthology.misc.health.smithi072.stderr:2023-07-25T14:35:32.633+0000 7f98cf371700 1 -- 172.21.15.72:0/221978988 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f98ac06ac50 msgr2=0x7f98ac06d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:32.646 INFO:teuthology.misc.health.smithi072.stderr:2023-07-25T14:35:32.633+0000 7f98cf371700 1 --2- 172.21.15.72:0/221978988 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f98ac06ac50 0x7f98ac06d110 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f98c80c3cd0 tx=0x7f98c4009040 comp rx=0 tx=0).stop 2023-07-25T14:35:32.646 INFO:teuthology.misc.health.smithi072.stderr:2023-07-25T14:35:32.633+0000 7f98cf371700 1 -- 172.21.15.72:0/221978988 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f98c806d7f0 msgr2=0x7f98c814b4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:32.646 INFO:teuthology.misc.health.smithi072.stderr:2023-07-25T14:35:32.633+0000 7f98cf371700 1 --2- 172.21.15.72:0/221978988 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f98c806d7f0 0x7f98c814b4a0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f98b800c520 tx=0x7f98b800c8e0 comp rx=0 tx=0).stop 2023-07-25T14:35:32.646 INFO:teuthology.misc.health.smithi072.stderr:2023-07-25T14:35:32.633+0000 7f98cf371700 1 -- 172.21.15.72:0/221978988 shutdown_connections 2023-07-25T14:35:32.647 INFO:teuthology.misc.health.smithi072.stderr:2023-07-25T14:35:32.633+0000 7f98cf371700 1 --2- 172.21.15.72:0/221978988 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f98ac06ac50 0x7f98ac06d110 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:32.647 INFO:teuthology.misc.health.smithi072.stderr:2023-07-25T14:35:32.633+0000 7f98cf371700 1 --2- 172.21.15.72:0/221978988 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f98c80c0290 0x7f98c8147ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:32.647 INFO:teuthology.misc.health.smithi072.stderr:2023-07-25T14:35:32.633+0000 7f98cf371700 1 --2- 172.21.15.72:0/221978988 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f98c806d7f0 0x7f98c814b4a0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:32.647 INFO:teuthology.misc.health.smithi072.stderr:2023-07-25T14:35:32.633+0000 7f98cf371700 1 --2- 172.21.15.72:0/221978988 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f98c8072290 0x7f98c81dcba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:32.647 INFO:teuthology.misc.health.smithi072.stderr:2023-07-25T14:35:32.633+0000 7f98cf371700 1 -- 172.21.15.72:0/221978988 >> 172.21.15.72:0/221978988 conn(0x7f98c80a7670 msgr2=0x7f98c80c0670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:35:32.647 INFO:teuthology.misc.health.smithi072.stderr:2023-07-25T14:35:32.633+0000 7f98cf371700 1 -- 172.21.15.72:0/221978988 shutdown_connections 2023-07-25T14:35:32.647 INFO:teuthology.misc.health.smithi072.stderr:2023-07-25T14:35:32.633+0000 7f98cf371700 1 -- 172.21.15.72:0/221978988 wait complete. 2023-07-25T14:35:32.656 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-07-25T14:35:32.657 INFO:tasks.ceph:Creating RBD pool 2023-07-25T14:35:32.657 DEBUG:teuthology.orchestra.run.smithi072:> sudo ceph --cluster ceph osd pool create rbd 8 2023-07-25T14:35:32.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:32.764+0000 7fb70c3d2700 1 Processor -- start 2023-07-25T14:35:32.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:32.764+0000 7fb70c3d2700 1 -- start start 2023-07-25T14:35:32.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:32.765+0000 7fb70c3d2700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb7040bb0b0 0x7fb704152cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:32.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:32.765+0000 7fb70c3d2700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7040c5890 con 0x7fb70414f810 2023-07-25T14:35:32.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:32.765+0000 7fb70c3d2700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb704152150 con 0x7fb7040a9cc0 2023-07-25T14:35:32.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:32.765+0000 7fb70c3d2700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb70414fbf0 con 0x7fb7040bb0b0 2023-07-25T14:35:32.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:32.765+0000 7fb70a16e700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fb70414f810 0x7fb7040c4370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:58074/0 (socket says 172.21.15.72:58074) 2023-07-25T14:35:32.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:32.766+0000 7fb70a16e700 1 -- 172.21.15.72:0/956803676 learned_addr learned my addr 172.21.15.72:0/956803676 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:35:32.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:32.766+0000 7fb70916c700 1 -- 172.21.15.72:0/956803676 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1598068032 0 0) 0x7fb7040c5890 con 0x7fb70414f810 2023-07-25T14:35:32.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:32.766+0000 7fb70916c700 1 -- 172.21.15.72:0/956803676 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb6f00035b0 con 0x7fb70414f810 2023-07-25T14:35:32.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:32.766+0000 7fb70a96f700 1 --2- 172.21.15.72:0/956803676 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb7040bb0b0 0x7fb704152cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:32.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:32.766+0000 7fb70916c700 1 -- 172.21.15.72:0/956803676 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3290007 0 0) 0x7fb6f00035b0 con 0x7fb70414f810 2023-07-25T14:35:32.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:32.766+0000 7fb70916c700 1 -- 172.21.15.72:0/956803676 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb7040bb0b0 msgr2=0x7fb704152cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:35:32.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:32.766+0000 7fb70916c700 1 --2- 172.21.15.72:0/956803676 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb7040bb0b0 0x7fb704152cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:32.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:32.766+0000 7fb70916c700 1 -- 172.21.15.72:0/956803676 >> v1:172.21.15.92:6789/0 conn(0x7fb7040a9cc0 legacy=0x7fb7041525e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:32.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:32.766+0000 7fb70916c700 1 -- 172.21.15.72:0/956803676 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7041566a0 con 0x7fb70414f810 2023-07-25T14:35:32.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:32.766+0000 7fb70916c700 1 -- 172.21.15.72:0/956803676 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2559588315 0 0) 0x7fb6f4001670 con 0x7fb70414f810 2023-07-25T14:35:32.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:32.766+0000 7fb70916c700 1 -- 172.21.15.72:0/956803676 >> v1:172.21.15.72:6789/0 conn(0x7fb70414f810 legacy=0x7fb7040c4370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:32.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:32.766+0000 7fb70916c700 1 --2- 172.21.15.72:0/956803676 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb6f0003a30 0x7fb6f0003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:32.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:32.766+0000 7fb70916c700 1 --2- 172.21.15.72:0/956803676 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb7040bb0b0 0x7fb6f0004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:32.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:32.766+0000 7fb70916c700 1 --2- 172.21.15.72:0/956803676 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb6f0004d90 0x7fb6f0005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:32.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:32.766+0000 7fb70916c700 1 -- 172.21.15.72:0/956803676 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb70414fbf0 con 0x7fb6f0003a30 2023-07-25T14:35:32.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:32.766+0000 7fb70916c700 1 -- 172.21.15.72:0/956803676 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6f000bb40 con 0x7fb6f0004d90 2023-07-25T14:35:32.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:32.766+0000 7fb70916c700 1 -- 172.21.15.72:0/956803676 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6f000bd00 con 0x7fb7040bb0b0 2023-07-25T14:35:32.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:32.766+0000 7fb70a16e700 1 --2- 172.21.15.72:0/956803676 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb6f0003a30 0x7fb6f0003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:32.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:32.766+0000 7fb70996d700 1 --2- 172.21.15.72:0/956803676 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb7040bb0b0 0x7fb6f0004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:32.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:32.766+0000 7fb70a96f700 1 --2- 172.21.15.72:0/956803676 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb6f0004d90 0x7fb6f0005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:32.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:32.766+0000 7fb70a16e700 1 -- 172.21.15.72:0/956803676 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb7040bb0b0 msgr2=0x7fb6f0004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:35:32.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:32.766+0000 7fb70a16e700 1 --2- 172.21.15.72:0/956803676 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb7040bb0b0 0x7fb6f0004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:32.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:32.766+0000 7fb70a16e700 1 -- 172.21.15.72:0/956803676 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb6f0004d90 msgr2=0x7fb6f0005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:35:32.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:32.766+0000 7fb70a16e700 1 --2- 172.21.15.72:0/956803676 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb6f0004d90 0x7fb6f0005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:32.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:32.766+0000 7fb70a16e700 1 -- 172.21.15.72:0/956803676 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6f00035b0 con 0x7fb6f0003a30 2023-07-25T14:35:32.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:32.767+0000 7fb70a16e700 1 --2- 172.21.15.72:0/956803676 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb6f0003a30 0x7fb6f0003e50 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fb6f400c210 tx=0x7fb6f0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84f60bd2d72e7646 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:35:32.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:32.767+0000 7fb70916c700 1 -- 172.21.15.72:0/956803676 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6f4007c10 con 0x7fb6f0003a30 2023-07-25T14:35:32.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:32.767+0000 7fb70916c700 1 -- 172.21.15.72:0/956803676 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6f400ccf0 con 0x7fb6f0003a30 2023-07-25T14:35:32.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:32.767+0000 7fb70916c700 1 -- 172.21.15.72:0/956803676 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6f4005ba0 con 0x7fb6f0003a30 2023-07-25T14:35:32.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:32.767+0000 7fb70c3d2700 1 -- 172.21.15.72:0/956803676 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb6f0003a30 msgr2=0x7fb6f0003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:32.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:32.767+0000 7fb70c3d2700 1 --2- 172.21.15.72:0/956803676 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb6f0003a30 0x7fb6f0003e50 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fb6f400c210 tx=0x7fb6f0005880 comp rx=0 tx=0).stop 2023-07-25T14:35:32.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:32.767+0000 7fb70a96f700 1 -- 172.21.15.72:0/956803676 reap_dead start 2023-07-25T14:35:32.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:32.767+0000 7fb70c3d2700 1 -- 172.21.15.72:0/956803676 shutdown_connections 2023-07-25T14:35:32.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:32.767+0000 7fb70c3d2700 1 -- 172.21.15.72:0/956803676 >> 172.21.15.72:0/956803676 conn(0x7fb70406a8d0 msgr2=0x7fb7040a94e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:35:32.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:32.767+0000 7fb70c3d2700 1 -- 172.21.15.72:0/956803676 shutdown_connections 2023-07-25T14:35:32.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:32.767+0000 7fb70c3d2700 1 -- 172.21.15.72:0/956803676 wait complete. 2023-07-25T14:35:32.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:32.769+0000 7fb70c3d2700 1 Processor -- start 2023-07-25T14:35:32.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:32.769+0000 7fb70c3d2700 1 -- start start 2023-07-25T14:35:32.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:32.770+0000 7fb70c3d2700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb6f0003a30 0x7fb7040a8e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:32.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:32.770+0000 7fb70c3d2700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb7040c1070 0x7fb7040aac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:32.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:32.770+0000 7fb70c3d2700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb7040bea60 0x7fb7040ab1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:32.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:32.770+0000 7fb70c3d2700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7040ac410 con 0x7fb6f0003a30 2023-07-25T14:35:32.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:32.770+0000 7fb70c3d2700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7040ad140 con 0x7fb7040bea60 2023-07-25T14:35:32.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:32.770+0000 7fb70c3d2700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7040a6ea0 con 0x7fb7040c1070 2023-07-25T14:35:32.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:32.770+0000 7fb70a16e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb6f0003a30 0x7fb7040a8e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:32.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:32.770+0000 7fb70a16e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb6f0003a30 0x7fb7040a8e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:39118/0 (socket says 172.21.15.72:39118) 2023-07-25T14:35:32.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:32.770+0000 7fb70a16e700 1 -- 172.21.15.72:0/1223450719 learned_addr learned my addr 172.21.15.72:0/1223450719 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:35:32.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:32.770+0000 7fb70a16e700 1 -- 172.21.15.72:0/1223450719 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb7040c1070 msgr2=0x7fb7040aac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:32.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:32.770+0000 7fb70996d700 1 --2- 172.21.15.72:0/1223450719 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb7040c1070 0x7fb7040aac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:32.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:32.770+0000 7fb70a96f700 1 --2- 172.21.15.72:0/1223450719 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb7040bea60 0x7fb7040ab1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:32.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:32.770+0000 7fb70a16e700 1 --2- 172.21.15.72:0/1223450719 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb7040c1070 0x7fb7040aac70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:32.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:32.770+0000 7fb70a16e700 1 -- 172.21.15.72:0/1223450719 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb7040bea60 msgr2=0x7fb7040ab1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:32.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:32.770+0000 7fb70a16e700 1 --2- 172.21.15.72:0/1223450719 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb7040bea60 0x7fb7040ab1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:32.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:32.770+0000 7fb70a16e700 1 -- 172.21.15.72:0/1223450719 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7040ac130 con 0x7fb6f0003a30 2023-07-25T14:35:32.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:32.770+0000 7fb70a96f700 1 --2- 172.21.15.72:0/1223450719 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb7040bea60 0x7fb7040ab1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-25T14:35:32.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:32.770+0000 7fb70a16e700 1 --2- 172.21.15.72:0/1223450719 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb6f0003a30 0x7fb7040a8e30 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fb6f4001930 tx=0x7fb7040c2310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:35:32.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:32.770+0000 7fb6faffd700 1 -- 172.21.15.72:0/1223450719 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6f400ce60 con 0x7fb6f0003a30 2023-07-25T14:35:32.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:32.770+0000 7fb6faffd700 1 -- 172.21.15.72:0/1223450719 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6f4005e10 con 0x7fb6f0003a30 2023-07-25T14:35:32.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:32.770+0000 7fb6faffd700 1 -- 172.21.15.72:0/1223450719 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6f4007520 con 0x7fb6f0003a30 2023-07-25T14:35:32.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:32.770+0000 7fb70c3d2700 1 -- 172.21.15.72:0/1223450719 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7040aa750 con 0x7fb6f0003a30 2023-07-25T14:35:32.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:32.770+0000 7fb70c3d2700 1 -- 172.21.15.72:0/1223450719 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7040be730 con 0x7fb6f0003a30 2023-07-25T14:35:32.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:32.771+0000 7fb70c3d2700 1 -- 172.21.15.72:0/1223450719 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7040aaac0 con 0x7fb6f0003a30 2023-07-25T14:35:32.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:32.772+0000 7fb6faffd700 1 -- 172.21.15.72:0/1223450719 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 88981+0+0 (secure 0 0 0) 0x7fb6f4019030 con 0x7fb6f0003a30 2023-07-25T14:35:32.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:32.772+0000 7fb6faffd700 1 --2- 172.21.15.72:0/1223450719 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fb6e806ac50 0x7fb6e806d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:32.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:32.772+0000 7fb6faffd700 1 -- 172.21.15.72:0/1223450719 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 4471+0+0 (secure 0 0 0) 0x7fb6f4089d00 con 0x7fb6f0003a30 2023-07-25T14:35:32.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:32.772+0000 7fb70996d700 1 --2- 172.21.15.72:0/1223450719 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fb6e806ac50 0x7fb6e806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:32.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:32.772+0000 7fb70996d700 1 --2- 172.21.15.72:0/1223450719 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fb6e806ac50 0x7fb6e806d110 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fb7040a9740 tx=0x7fb700009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:35:32.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:32.776+0000 7fb6faffd700 1 -- 172.21.15.72:0/1223450719 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fb6f4055550 con 0x7fb6f0003a30 2023-07-25T14:35:32.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:32.965+0000 7fb70c3d2700 1 -- 172.21.15.72:0/1223450719 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7fb7040aa5b0 con 0x7fb6f0003a30 2023-07-25T14:35:33.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:33.360+0000 7fb6faffd700 1 -- 172.21.15.72:0/1223450719 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v15) v1 ==== 109+0+0 (secure 0 0 0) 0x7fb7040aa5b0 con 0x7fb6f0003a30 2023-07-25T14:35:33.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:33.363+0000 7fb70c3d2700 1 -- 172.21.15.72:0/1223450719 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fb6e806ac50 msgr2=0x7fb6e806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:33.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:33.363+0000 7fb70c3d2700 1 --2- 172.21.15.72:0/1223450719 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fb6e806ac50 0x7fb6e806d110 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fb7040a9740 tx=0x7fb700009040 comp rx=0 tx=0).stop 2023-07-25T14:35:33.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:33.363+0000 7fb70c3d2700 1 -- 172.21.15.72:0/1223450719 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb6f0003a30 msgr2=0x7fb7040a8e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:33.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:33.363+0000 7fb70c3d2700 1 --2- 172.21.15.72:0/1223450719 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb6f0003a30 0x7fb7040a8e30 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fb6f4001930 tx=0x7fb7040c2310 comp rx=0 tx=0).stop 2023-07-25T14:35:33.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:33.363+0000 7fb70c3d2700 1 -- 172.21.15.72:0/1223450719 shutdown_connections 2023-07-25T14:35:33.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:33.363+0000 7fb70c3d2700 1 --2- 172.21.15.72:0/1223450719 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fb6e806ac50 0x7fb6e806d110 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:33.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:33.363+0000 7fb70c3d2700 1 --2- 172.21.15.72:0/1223450719 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb7040bea60 0x7fb7040ab1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:33.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:33.363+0000 7fb70c3d2700 1 --2- 172.21.15.72:0/1223450719 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb6f0003a30 0x7fb7040a8e30 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:33.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:33.363+0000 7fb70c3d2700 1 --2- 172.21.15.72:0/1223450719 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb7040c1070 0x7fb7040aac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:33.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:33.363+0000 7fb70c3d2700 1 -- 172.21.15.72:0/1223450719 >> 172.21.15.72:0/1223450719 conn(0x7fb70406a8d0 msgr2=0x7fb704151750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:35:33.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:33.363+0000 7fb70c3d2700 1 -- 172.21.15.72:0/1223450719 shutdown_connections 2023-07-25T14:35:33.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:33.363+0000 7fb70c3d2700 1 -- 172.21.15.72:0/1223450719 wait complete. 2023-07-25T14:35:33.378 INFO:teuthology.orchestra.run.smithi072.stderr:pool 'rbd' created 2023-07-25T14:35:33.388 DEBUG:teuthology.orchestra.run.smithi072:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2023-07-25T14:35:33.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:33.498+0000 7f16b1bbe700 1 Processor -- start 2023-07-25T14:35:33.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:33.498+0000 7f16b1bbe700 1 -- start start 2023-07-25T14:35:33.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:33.499+0000 7f16b1bbe700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f16ac14af40 0x7f16ac0ab3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:33.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:33.499+0000 7f16b1bbe700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f16ac0c1b10 0x7f16ac06b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:33.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:33.499+0000 7f16b1bbe700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16ac151940 con 0x7f16ac06b6e0 2023-07-25T14:35:33.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:33.499+0000 7f16b1bbe700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16ac0a81a0 con 0x7f16ac0c1b10 2023-07-25T14:35:33.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:33.499+0000 7f16b1bbe700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16ac071da0 con 0x7f16ac14af40 2023-07-25T14:35:33.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:33.499+0000 7f16ab7fe700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f16ac14af40 0x7f16ac0ab3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:33.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:33.499+0000 7f16aaffd700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f16ac0c1b10 0x7f16ac06b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:33.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:33.499+0000 7f16aaffd700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f16ac0c1b10 0x7f16ac06b1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.72:34710/0 (socket says 172.21.15.72:34710) 2023-07-25T14:35:33.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:33.499+0000 7f16ab7fe700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f16ac14af40 0x7f16ac0ab3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3301/0 says I am v2:172.21.15.72:44366/0 (socket says 172.21.15.72:44366) 2023-07-25T14:35:33.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:33.499+0000 7f16aaffd700 1 -- 172.21.15.72:0/2730573055 learned_addr learned my addr 172.21.15.72:0/2730573055 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:35:33.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:33.500+0000 7f16aaffd700 1 -- 172.21.15.72:0/2730573055 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f16ac14af40 msgr2=0x7f16ac0ab3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:35:33.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:33.500+0000 7f16aaffd700 1 --2- 172.21.15.72:0/2730573055 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f16ac14af40 0x7f16ac0ab3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:33.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:33.500+0000 7f16aaffd700 1 -- 172.21.15.72:0/2730573055 >> v1:172.21.15.92:6789/0 conn(0x7f16ac06b6e0 legacy=0x7f16ac0a9290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:33.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:33.500+0000 7f16aaffd700 1 -- 172.21.15.72:0/2730573055 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16ac0ab9d0 con 0x7f16ac0c1b10 2023-07-25T14:35:33.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:33.500+0000 7f16ab7fe700 1 --2- 172.21.15.72:0/2730573055 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f16ac14af40 0x7f16ac0ab3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-25T14:35:33.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:33.500+0000 7f16aaffd700 1 --2- 172.21.15.72:0/2730573055 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f16ac0c1b10 0x7f16ac06b1a0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f16a00098f0 tx=0x7f16a0009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=773b575fd4df244c server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:35:33.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:33.501+0000 7f16aa7fc700 1 -- 172.21.15.72:0/2730573055 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16a0011830 con 0x7f16ac0c1b10 2023-07-25T14:35:33.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:33.501+0000 7f16aa7fc700 1 -- 172.21.15.72:0/2730573055 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16a0011990 con 0x7f16ac0c1b10 2023-07-25T14:35:33.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:33.501+0000 7f16aa7fc700 1 -- 172.21.15.72:0/2730573055 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16a0011d20 con 0x7f16ac0c1b10 2023-07-25T14:35:33.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:33.502+0000 7f16b1bbe700 1 -- 172.21.15.72:0/2730573055 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f16ac0c1b10 msgr2=0x7f16ac06b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:33.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:33.502+0000 7f16b1bbe700 1 --2- 172.21.15.72:0/2730573055 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f16ac0c1b10 0x7f16ac06b1a0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f16a00098f0 tx=0x7f16a0009c00 comp rx=0 tx=0).stop 2023-07-25T14:35:33.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:33.502+0000 7f16b1bbe700 1 -- 172.21.15.72:0/2730573055 shutdown_connections 2023-07-25T14:35:33.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:33.502+0000 7f16b1bbe700 1 --2- 172.21.15.72:0/2730573055 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f16ac14af40 0x7f16ac0ab3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:33.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:33.502+0000 7f16b1bbe700 1 --2- 172.21.15.72:0/2730573055 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f16ac0c1b10 0x7f16ac06b1a0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:33.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:33.502+0000 7f16b1bbe700 1 -- 172.21.15.72:0/2730573055 >> 172.21.15.72:0/2730573055 conn(0x7f16ac070c90 msgr2=0x7f16ac0710a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:35:33.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:33.502+0000 7f16b1bbe700 1 -- 172.21.15.72:0/2730573055 shutdown_connections 2023-07-25T14:35:33.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:33.502+0000 7f16b1bbe700 1 -- 172.21.15.72:0/2730573055 wait complete. 2023-07-25T14:35:33.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:33.503+0000 7f16b1bbe700 1 Processor -- start 2023-07-25T14:35:33.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:33.503+0000 7f16b1bbe700 1 -- start start 2023-07-25T14:35:33.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:33.504+0000 7f16b1bbe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f16ac06b6e0 0x7f16ac153270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:33.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:33.504+0000 7f16b1bbe700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f16ac0c1b10 0x7f16ac0c1190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:33.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:33.504+0000 7f16b1bbe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f16ac14af40 0x7f16ac1eb390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:33.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:33.504+0000 7f16b1bbe700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16ac1eaf00 con 0x7f16ac14af40 2023-07-25T14:35:33.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:33.504+0000 7f16b1bbe700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16ac14d040 con 0x7f16ac06b6e0 2023-07-25T14:35:33.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:33.504+0000 7f16b1bbe700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16ac14b320 con 0x7f16ac0c1b10 2023-07-25T14:35:33.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:33.504+0000 7f16abfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f16ac14af40 0x7f16ac1eb390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:33.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:33.504+0000 7f16abfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f16ac14af40 0x7f16ac1eb390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:39146/0 (socket says 172.21.15.72:39146) 2023-07-25T14:35:33.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:33.504+0000 7f16abfff700 1 -- 172.21.15.72:0/4103124058 learned_addr learned my addr 172.21.15.72:0/4103124058 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:35:33.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:33.504+0000 7f16aaffd700 1 --2- 172.21.15.72:0/4103124058 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f16ac0c1b10 0x7f16ac0c1190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:33.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:33.504+0000 7f16ab7fe700 1 --2- 172.21.15.72:0/4103124058 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f16ac06b6e0 0x7f16ac153270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:33.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:33.504+0000 7f16abfff700 1 -- 172.21.15.72:0/4103124058 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f16ac0c1b10 msgr2=0x7f16ac0c1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:33.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:33.504+0000 7f16abfff700 1 --2- 172.21.15.72:0/4103124058 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f16ac0c1b10 0x7f16ac0c1190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:33.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:33.504+0000 7f16abfff700 1 -- 172.21.15.72:0/4103124058 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f16ac06b6e0 msgr2=0x7f16ac153270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:33.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:33.504+0000 7f16abfff700 1 --2- 172.21.15.72:0/4103124058 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f16ac06b6e0 0x7f16ac153270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:33.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:33.505+0000 7f16abfff700 1 -- 172.21.15.72:0/4103124058 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f169c0094a0 con 0x7f16ac14af40 2023-07-25T14:35:33.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:33.505+0000 7f16abfff700 1 --2- 172.21.15.72:0/4103124058 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f16ac14af40 0x7f16ac1eb390 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f16a400cc80 tx=0x7f16a400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:35:33.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:33.505+0000 7f1693fff700 1 -- 172.21.15.72:0/4103124058 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16a4003c00 con 0x7f16ac14af40 2023-07-25T14:35:33.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:33.505+0000 7f1693fff700 1 -- 172.21.15.72:0/4103124058 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16a4003d60 con 0x7f16ac14af40 2023-07-25T14:35:33.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:33.505+0000 7f16b1bbe700 1 -- 172.21.15.72:0/4103124058 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16a0009550 con 0x7f16ac14af40 2023-07-25T14:35:33.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:33.505+0000 7f1693fff700 1 -- 172.21.15.72:0/4103124058 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16a400aaa0 con 0x7f16ac14af40 2023-07-25T14:35:33.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:33.505+0000 7f16b1bbe700 1 -- 172.21.15.72:0/4103124058 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16ac14b8e0 con 0x7f16ac14af40 2023-07-25T14:35:33.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:33.506+0000 7f16b1bbe700 1 -- 172.21.15.72:0/4103124058 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16ac1eb0b0 con 0x7f16ac14af40 2023-07-25T14:35:33.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:33.506+0000 7f1693fff700 1 -- 172.21.15.72:0/4103124058 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 88981+0+0 (secure 0 0 0) 0x7f16a400ac00 con 0x7f16ac14af40 2023-07-25T14:35:33.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:33.507+0000 7f1693fff700 1 --2- 172.21.15.72:0/4103124058 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f169806ac50 0x7f169806d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:33.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:33.507+0000 7f1693fff700 1 -- 172.21.15.72:0/4103124058 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 5188+0+0 (secure 0 0 0) 0x7f16a4089020 con 0x7f16ac14af40 2023-07-25T14:35:33.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:33.507+0000 7f16ab7fe700 1 --2- 172.21.15.72:0/4103124058 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f169806ac50 0x7f169806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:33.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:33.507+0000 7f16ab7fe700 1 --2- 172.21.15.72:0/4103124058 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f169806ac50 0x7f169806d110 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f169c009cd0 tx=0x7f169c009210 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:35:33.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:33.511+0000 7f1693fff700 1 -- 172.21.15.72:0/4103124058 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f16ac1eb0b0 con 0x7f16ac14af40 2023-07-25T14:35:33.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:33.700+0000 7f16b1bbe700 1 -- 172.21.15.72:0/4103124058 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f16ac1eb0b0 con 0x7f16ac14af40 2023-07-25T14:35:34.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:34.365+0000 7f1693fff700 1 -- 172.21.15.72:0/4103124058 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v16) v1 ==== 173+0+0 (secure 0 0 0) 0x7f16ac1eb0b0 con 0x7f16ac14af40 2023-07-25T14:35:34.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:34.369+0000 7f16b1bbe700 1 -- 172.21.15.72:0/4103124058 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f169806ac50 msgr2=0x7f169806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:34.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:34.369+0000 7f16b1bbe700 1 --2- 172.21.15.72:0/4103124058 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f169806ac50 0x7f169806d110 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f169c009cd0 tx=0x7f169c009210 comp rx=0 tx=0).stop 2023-07-25T14:35:34.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:34.369+0000 7f16b1bbe700 1 -- 172.21.15.72:0/4103124058 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f16ac14af40 msgr2=0x7f16ac1eb390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:34.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:34.369+0000 7f16b1bbe700 1 --2- 172.21.15.72:0/4103124058 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f16ac14af40 0x7f16ac1eb390 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f16a400cc80 tx=0x7f16a400cf90 comp rx=0 tx=0).stop 2023-07-25T14:35:34.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:34.369+0000 7f16b1bbe700 1 -- 172.21.15.72:0/4103124058 shutdown_connections 2023-07-25T14:35:34.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:34.369+0000 7f16b1bbe700 1 --2- 172.21.15.72:0/4103124058 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f169806ac50 0x7f169806d110 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:34.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:34.369+0000 7f16b1bbe700 1 --2- 172.21.15.72:0/4103124058 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f16ac14af40 0x7f16ac1eb390 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:34.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:34.369+0000 7f16b1bbe700 1 --2- 172.21.15.72:0/4103124058 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f16ac06b6e0 0x7f16ac153270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:34.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:34.369+0000 7f16b1bbe700 1 --2- 172.21.15.72:0/4103124058 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f16ac0c1b10 0x7f16ac0c1190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:34.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:34.369+0000 7f16b1bbe700 1 -- 172.21.15.72:0/4103124058 >> 172.21.15.72:0/4103124058 conn(0x7f16ac070c90 msgr2=0x7f16ac0ab170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:35:34.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:34.369+0000 7f16b1bbe700 1 -- 172.21.15.72:0/4103124058 shutdown_connections 2023-07-25T14:35:34.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:34.370+0000 7f16b1bbe700 1 -- 172.21.15.72:0/4103124058 wait complete. 2023-07-25T14:35:34.384 INFO:teuthology.orchestra.run.smithi072.stderr:enabled application 'rbd' on pool 'rbd' 2023-07-25T14:35:34.398 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-07-25T14:35:34.399 INFO:tasks.ceph.mds.a:Restarting daemon 2023-07-25T14:35:34.399 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-07-25T14:35:34.401 INFO:tasks.ceph.mds.a:Started 2023-07-25T14:35:34.401 INFO:tasks.ceph.mds.c:Restarting daemon 2023-07-25T14:35:34.401 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-07-25T14:35:34.403 INFO:tasks.ceph.mds.c:Started 2023-07-25T14:35:34.403 INFO:tasks.ceph.mds.b:Restarting daemon 2023-07-25T14:35:34.404 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-07-25T14:35:34.406 INFO:tasks.ceph.mds.b:Started 2023-07-25T14:35:34.406 INFO:tasks.ceph.mds.d:Restarting daemon 2023-07-25T14:35:34.407 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-07-25T14:35:34.409 INFO:tasks.ceph.mds.d:Started 2023-07-25T14:35:34.409 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-07-25T14:35:34.409 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-25T14:35:34.496 INFO:tasks.ceph.mds.c.smithi072.stdout:starting mds.c at 2023-07-25T14:35:34.497 INFO:tasks.ceph.mds.a.smithi072.stdout:starting mds.a at 2023-07-25T14:35:34.505 INFO:tasks.ceph.mds.b.smithi092.stdout:starting mds.b at 2023-07-25T14:35:34.506 INFO:tasks.ceph.mds.d.smithi092.stdout:starting mds.d at 2023-07-25T14:35:34.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:34.542+0000 7f14453fa700 1 Processor -- start 2023-07-25T14:35:34.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:34.542+0000 7f14453fa700 1 -- start start 2023-07-25T14:35:34.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:34.543+0000 7f14453fa700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f14400c5480 0x7f14400c2300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:34.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:34.543+0000 7f14453fa700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f14400c3820 0x7f14400c02a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:34.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:34.543+0000 7f14453fa700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f144006cd90 con 0x7f14400c2840 2023-07-25T14:35:34.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:34.543+0000 7f14453fa700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14400c15c0 con 0x7f14400c3820 2023-07-25T14:35:34.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:34.543+0000 7f14453fa700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1440162120 con 0x7f14400c5480 2023-07-25T14:35:34.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:34.543+0000 7f143e7fc700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f14400c2840 0x7f144006d220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:58170/0 (socket says 172.21.15.72:58170) 2023-07-25T14:35:34.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:34.543+0000 7f143e7fc700 1 -- 172.21.15.72:0/3408867453 learned_addr learned my addr 172.21.15.72:0/3408867453 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:35:34.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:34.543+0000 7f143dffb700 1 -- 172.21.15.72:0/3408867453 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3306305620 0 0) 0x7f144006cd90 con 0x7f14400c2840 2023-07-25T14:35:34.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:34.543+0000 7f143f7fe700 1 --2- 172.21.15.72:0/3408867453 >> v2:172.21.15.92:3300/0 conn(0x7f14400c3820 0x7f14400c02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:34.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:34.543+0000 7f143effd700 1 --2- 172.21.15.72:0/3408867453 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f14400c5480 0x7f14400c2300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:34.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:34.544+0000 7f143dffb700 1 -- 172.21.15.72:0/3408867453 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f142c0057c0 con 0x7f14400c2840 2023-07-25T14:35:34.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:34.544+0000 7f143dffb700 1 -- 172.21.15.72:0/3408867453 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1301846134 0 0) 0x7f142c0057c0 con 0x7f14400c2840 2023-07-25T14:35:34.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:34.544+0000 7f143dffb700 1 -- 172.21.15.72:0/3408867453 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f14400c5480 msgr2=0x7f14400c2300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:35:34.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:34.544+0000 7f143dffb700 1 --2- 172.21.15.72:0/3408867453 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f14400c5480 0x7f14400c2300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:34.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:34.544+0000 7f143dffb700 1 -- 172.21.15.72:0/3408867453 >> v2:172.21.15.92:3300/0 conn(0x7f14400c3820 msgr2=0x7f14400c02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:35:34.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:34.544+0000 7f143dffb700 1 --2- 172.21.15.72:0/3408867453 >> v2:172.21.15.92:3300/0 conn(0x7f14400c3820 0x7f14400c02a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:34.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:34.544+0000 7f143dffb700 1 -- 172.21.15.72:0/3408867453 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14400727c0 con 0x7f14400c2840 2023-07-25T14:35:34.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:34.544+0000 7f143dffb700 1 -- 172.21.15.72:0/3408867453 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2559588315 0 0) 0x7f14280017f0 con 0x7f14400c2840 2023-07-25T14:35:34.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:34.545+0000 7f143dffb700 1 -- 172.21.15.72:0/3408867453 >> v1:172.21.15.72:6789/0 conn(0x7f14400c2840 legacy=0x7f144006d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:34.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:34.545+0000 7f143dffb700 1 --2- 172.21.15.72:0/3408867453 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f142c005c40 0x7f142c006060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:34.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:34.545+0000 7f143dffb700 1 --2- 172.21.15.72:0/3408867453 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f14400c5480 0x7f142c006a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:34.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:34.545+0000 7f143dffb700 1 --2- 172.21.15.72:0/3408867453 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f142c0065a0 0x7f142c006fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:34.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:34.545+0000 7f143dffb700 1 -- 172.21.15.72:0/3408867453 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f142c0077f0 con 0x7f142c0065a0 2023-07-25T14:35:34.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:34.545+0000 7f143dffb700 1 -- 172.21.15.72:0/3408867453 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f142c00bc10 con 0x7f142c005c40 2023-07-25T14:35:34.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:34.545+0000 7f143dffb700 1 -- 172.21.15.72:0/3408867453 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f142c00bd50 con 0x7f14400c5480 2023-07-25T14:35:34.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:34.545+0000 7f143f7fe700 1 --2- 172.21.15.72:0/3408867453 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f142c0065a0 0x7f142c006fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:34.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:34.545+0000 7f143e7fc700 1 --2- 172.21.15.72:0/3408867453 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f14400c5480 0x7f142c006a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:34.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:34.545+0000 7f143effd700 1 --2- 172.21.15.72:0/3408867453 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f142c005c40 0x7f142c006060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:34.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:34.545+0000 7f143f7fe700 1 -- 172.21.15.72:0/3408867453 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f14400c5480 msgr2=0x7f142c006a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:35:34.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:34.545+0000 7f143f7fe700 1 --2- 172.21.15.72:0/3408867453 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f14400c5480 0x7f142c006a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:34.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:34.545+0000 7f143f7fe700 1 -- 172.21.15.72:0/3408867453 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f142c005c40 msgr2=0x7f142c006060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:35:34.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:34.545+0000 7f143f7fe700 1 --2- 172.21.15.72:0/3408867453 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f142c005c40 0x7f142c006060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:34.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:34.545+0000 7f143f7fe700 1 -- 172.21.15.72:0/3408867453 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f142c0057c0 con 0x7f142c0065a0 2023-07-25T14:35:34.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:34.545+0000 7f143e7fc700 1 --2- 172.21.15.72:0/3408867453 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f14400c5480 0x7f142c006a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-25T14:35:34.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:34.545+0000 7f143f7fe700 1 --2- 172.21.15.72:0/3408867453 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f142c0065a0 0x7f142c006fa0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f1438007dc0 tx=0x7f142c007a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=984c910b345dbaf server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:35:34.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:34.545+0000 7f143dffb700 1 -- 172.21.15.72:0/3408867453 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1438013050 con 0x7f142c0065a0 2023-07-25T14:35:34.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:34.545+0000 7f143dffb700 1 -- 172.21.15.72:0/3408867453 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1438014040 con 0x7f142c0065a0 2023-07-25T14:35:34.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:34.545+0000 7f143dffb700 1 -- 172.21.15.72:0/3408867453 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f143800ee40 con 0x7f142c0065a0 2023-07-25T14:35:34.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:34.546+0000 7f14453fa700 1 -- 172.21.15.72:0/3408867453 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f142c0065a0 msgr2=0x7f142c006fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:34.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:34.546+0000 7f14453fa700 1 --2- 172.21.15.72:0/3408867453 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f142c0065a0 0x7f142c006fa0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f1438007dc0 tx=0x7f142c007a90 comp rx=0 tx=0).stop 2023-07-25T14:35:34.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:34.546+0000 7f143f7fe700 1 -- 172.21.15.72:0/3408867453 reap_dead start 2023-07-25T14:35:34.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:34.546+0000 7f14453fa700 1 -- 172.21.15.72:0/3408867453 shutdown_connections 2023-07-25T14:35:34.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:34.546+0000 7f14453fa700 1 -- 172.21.15.72:0/3408867453 >> 172.21.15.72:0/3408867453 conn(0x7f14400a7510 msgr2=0x7f14400a7920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:35:34.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:34.546+0000 7f14453fa700 1 -- 172.21.15.72:0/3408867453 shutdown_connections 2023-07-25T14:35:34.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:34.546+0000 7f14453fa700 1 -- 172.21.15.72:0/3408867453 wait complete. 2023-07-25T14:35:34.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:34.547+0000 7f14453fa700 1 Processor -- start 2023-07-25T14:35:34.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:34.547+0000 7f14453fa700 1 -- start start 2023-07-25T14:35:34.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:34.548+0000 7f14453fa700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f142c0065a0 0x7f14400b9cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:34.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:34.548+0000 7f14453fa700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f14400aa760 0x7f14400ab070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:34.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:34.548+0000 7f14453fa700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f14400aa210 0x7f14401f9750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:34.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:34.548+0000 7f14453fa700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14400ba230 con 0x7f14400aa210 2023-07-25T14:35:34.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:34.548+0000 7f14453fa700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14400a9970 con 0x7f142c0065a0 2023-07-25T14:35:34.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:34.548+0000 7f14453fa700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14400a9c50 con 0x7f14400aa760 2023-07-25T14:35:34.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:34.548+0000 7f143f7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f14400aa210 0x7f14401f9750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:34.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:34.548+0000 7f143f7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f14400aa210 0x7f14401f9750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:39216/0 (socket says 172.21.15.72:39216) 2023-07-25T14:35:34.574 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:34.548+0000 7f143f7fe700 1 -- 172.21.15.72:0/3538106106 learned_addr learned my addr 172.21.15.72:0/3538106106 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:35:34.574 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:34.548+0000 7f143e7fc700 1 --2- 172.21.15.72:0/3538106106 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f14400aa760 0x7f14400ab070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:34.574 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:34.548+0000 7f143effd700 1 --2- 172.21.15.72:0/3538106106 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f142c0065a0 0x7f14400b9cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:34.574 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:34.548+0000 7f143f7fe700 1 -- 172.21.15.72:0/3538106106 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f14400aa760 msgr2=0x7f14400ab070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:34.575 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:34.548+0000 7f143f7fe700 1 --2- 172.21.15.72:0/3538106106 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f14400aa760 0x7f14400ab070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:34.575 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:34.548+0000 7f143f7fe700 1 -- 172.21.15.72:0/3538106106 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f142c0065a0 msgr2=0x7f14400b9cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:34.575 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:34.548+0000 7f143f7fe700 1 --2- 172.21.15.72:0/3538106106 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f142c0065a0 0x7f14400b9cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:34.575 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:34.548+0000 7f143f7fe700 1 -- 172.21.15.72:0/3538106106 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14400a9f30 con 0x7f14400aa210 2023-07-25T14:35:34.575 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:34.548+0000 7f143e7fc700 1 --2- 172.21.15.72:0/3538106106 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f14400aa760 0x7f14400ab070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-25T14:35:34.575 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:34.548+0000 7f143f7fe700 1 --2- 172.21.15.72:0/3538106106 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f14400aa210 0x7f14401f9750 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f1438019000 tx=0x7f14380064f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:35:34.575 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:34.548+0000 7f14377fe700 1 -- 172.21.15.72:0/3538106106 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1438013070 con 0x7f14400aa210 2023-07-25T14:35:34.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:34.548+0000 7f14377fe700 1 -- 172.21.15.72:0/3538106106 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f143800e300 con 0x7f14400aa210 2023-07-25T14:35:34.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:34.548+0000 7f14453fa700 1 -- 172.21.15.72:0/3538106106 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14400b94f0 con 0x7f14400aa210 2023-07-25T14:35:34.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:34.548+0000 7f14377fe700 1 -- 172.21.15.72:0/3538106106 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1438004470 con 0x7f14400aa210 2023-07-25T14:35:34.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:34.549+0000 7f14453fa700 1 -- 172.21.15.72:0/3538106106 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14400ab5b0 con 0x7f14400aa210 2023-07-25T14:35:34.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:34.549+0000 7f14453fa700 1 -- 172.21.15.72:0/3538106106 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f144004e470 con 0x7f14400aa210 2023-07-25T14:35:34.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:34.550+0000 7f14377fe700 1 -- 172.21.15.72:0/3538106106 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 88981+0+0 (secure 0 0 0) 0x7f1438028070 con 0x7f14400aa210 2023-07-25T14:35:34.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:34.550+0000 7f14377fe700 1 --2- 172.21.15.72:0/3538106106 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f142006ac50 0x7f142006d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:34.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:34.550+0000 7f14377fe700 1 -- 172.21.15.72:0/3538106106 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f143808e530 con 0x7f14400aa210 2023-07-25T14:35:34.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:34.550+0000 7f143effd700 1 --2- 172.21.15.72:0/3538106106 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f142006ac50 0x7f142006d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:34.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:34.551+0000 7f143effd700 1 --2- 172.21.15.72:0/3538106106 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f142006ac50 0x7f142006d110 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f1430005fc0 tx=0x7f1430009180 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:35:34.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:34.554+0000 7f14377fe700 1 -- 172.21.15.72:0/3538106106 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f1438059bc0 con 0x7f14400aa210 2023-07-25T14:35:34.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:34.758+0000 7f14453fa700 1 -- 172.21.15.72:0/3538106106 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f14400a68f0 con 0x7f14400aa210 2023-07-25T14:35:34.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:34.759+0000 7f14377fe700 1 -- 172.21.15.72:0/3538106106 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+14557 (secure 0 0 0) 0x7f143805d1e0 con 0x7f14400aa210 2023-07-25T14:35:34.772 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-25T14:35:34.772 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":16,"fsid":"9170db48-9170-43e8-8ccb-9813e6240906","created":"2023-07-25T14:35:21.733262+0000","modified":"2023-07-25T14:35:34.359916+0000","last_up_change":"2023-07-25T14:35:31.355010+0000","last_in_change":"2023-07-25T14:35:24.195785+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-25T14:35:32.983457+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-25T14:35:33.326342+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d517fdad-0bfe-49f0-89f2-9421c3761839","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6801","nonce":2475407414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6803","nonce":2475407414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6807","nonce":2475407414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6805","nonce":2475407414}]},"public_addr":"172.21.15.72:6801/2475407414","cluster_addr":"172.21.15.72:6803/2475407414","heartbeat_back_addr":"172.21.15.72:6807/2475407414","heartbeat_front_addr":"172.21.15.72:6805/2475407414","state":["exists","up"]},{"osd":1,"uuid":"e1564be3-f209-47e5-a8d0-32fc618a474f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6822","nonce":870954016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6825","nonce":870954016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6831","nonce":870954016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6827","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6829","nonce":870954016}]},"public_addr":"172.21.15.72:6822/870954016","cluster_addr":"172.21.15.72:6825/870954016","heartbeat_back_addr":"172.21.15.72:6831/870954016","heartbeat_front_addr":"172.21.15.72:6829/870954016","state":["exists","up"]},{"osd":2,"uuid":"c4647d30-ffa6-417a-9026-ef530c75910e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6809","nonce":2143129442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6811","nonce":2143129442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6815","nonce":2143129442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6813","nonce":2143129442}]},"public_addr":"172.21.15.72:6809/2143129442","cluster_addr":"172.21.15.72:6811/2143129442","heartbeat_back_addr":"172.21.15.72:6815/2143129442","heartbeat_front_addr":"172.21.15.72:6813/2143129442","state":["exists","up"]},{"osd":3,"uuid":"76c9d9a7-c2e2-4612-a58b-d6882dd76b58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6817","nonce":3404066311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6819","nonce":3404066311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6828","nonce":3404066311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6821","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6823","nonce":3404066311}]},"public_addr":"172.21.15.72:6817/3404066311","cluster_addr":"172.21.15.72:6819/3404066311","heartbeat_back_addr":"172.21.15.72:6828/3404066311","heartbeat_front_addr":"172.21.15.72:6823/3404066311","state":["exists","up"]},{"osd":4,"uuid":"7f8920dc-0ad4-4a73-ab40-65408f83eadd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6817","nonce":2381008739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6819","nonce":2381008739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6825","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6827","nonce":2381008739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6822","nonce":2381008739}]},"public_addr":"172.21.15.92:6817/2381008739","cluster_addr":"172.21.15.92:6819/2381008739","heartbeat_back_addr":"172.21.15.92:6827/2381008739","heartbeat_front_addr":"172.21.15.92:6822/2381008739","state":["exists","up"]},{"osd":5,"uuid":"56257e7c-31eb-44c5-9ec7-1318a4e0bb35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6801","nonce":2161935604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6803","nonce":2161935604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6807","nonce":2161935604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6805","nonce":2161935604}]},"public_addr":"172.21.15.92:6801/2161935604","cluster_addr":"172.21.15.92:6803/2161935604","heartbeat_back_addr":"172.21.15.92:6807/2161935604","heartbeat_front_addr":"172.21.15.92:6805/2161935604","state":["exists","up"]},{"osd":6,"uuid":"a150d3d8-a0c9-4955-968a-8d98eff4ffb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6809","nonce":3770163493}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6811","nonce":3770163493}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6815","nonce":3770163493}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6813","nonce":3770163493}]},"public_addr":"172.21.15.92:6809/3770163493","cluster_addr":"172.21.15.92:6811/3770163493","heartbeat_back_addr":"172.21.15.92:6815/3770163493","heartbeat_front_addr":"172.21.15.92:6813/3770163493","state":["exists","up"]},{"osd":7,"uuid":"07799c27-54ee-4591-a42d-a978d6b32065","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6821","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6823","nonce":2135777609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6826","nonce":2135777609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6831","nonce":2135777609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6829","nonce":2135777609}]},"public_addr":"172.21.15.92:6823/2135777609","cluster_addr":"172.21.15.92:6826/2135777609","heartbeat_back_addr":"172.21.15.92:6831/2135777609","heartbeat_front_addr":"172.21.15.92:6829/2135777609","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.345365+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.378150+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.146566+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.372172+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:30.398421+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.385632+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.465611+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.443583+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-25T14:35:34.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:34.761+0000 7f14453fa700 1 -- 172.21.15.72:0/3538106106 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f142006ac50 msgr2=0x7f142006d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:34.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:34.761+0000 7f14453fa700 1 --2- 172.21.15.72:0/3538106106 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f142006ac50 0x7f142006d110 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f1430005fc0 tx=0x7f1430009180 comp rx=0 tx=0).stop 2023-07-25T14:35:34.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:34.761+0000 7f14453fa700 1 -- 172.21.15.72:0/3538106106 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f14400aa210 msgr2=0x7f14401f9750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:34.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:34.761+0000 7f14453fa700 1 --2- 172.21.15.72:0/3538106106 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f14400aa210 0x7f14401f9750 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f1438019000 tx=0x7f14380064f0 comp rx=0 tx=0).stop 2023-07-25T14:35:34.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:34.761+0000 7f14453fa700 1 -- 172.21.15.72:0/3538106106 shutdown_connections 2023-07-25T14:35:34.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:34.761+0000 7f14453fa700 1 --2- 172.21.15.72:0/3538106106 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f142006ac50 0x7f142006d110 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:34.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:34.761+0000 7f14453fa700 1 --2- 172.21.15.72:0/3538106106 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f14400aa210 0x7f14401f9750 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:34.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:34.761+0000 7f14453fa700 1 --2- 172.21.15.72:0/3538106106 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f142c0065a0 0x7f14400b9cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:34.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:34.761+0000 7f14453fa700 1 --2- 172.21.15.72:0/3538106106 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f14400aa760 0x7f14400ab070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:34.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:34.761+0000 7f14453fa700 1 -- 172.21.15.72:0/3538106106 >> 172.21.15.72:0/3538106106 conn(0x7f14400a7510 msgr2=0x7f1440070530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:35:34.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:34.762+0000 7f14453fa700 1 -- 172.21.15.72:0/3538106106 shutdown_connections 2023-07-25T14:35:34.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:34.762+0000 7f14453fa700 1 -- 172.21.15.72:0/3538106106 wait complete. 2023-07-25T14:35:34.787 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-07-25T14:35:32.983457+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-07-25T14:35:33.326342+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-25T14:35:34.787 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-25T14:35:34.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:34.902+0000 7fa108e62700 1 Processor -- start 2023-07-25T14:35:34.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:34.902+0000 7fa108e62700 1 -- start start 2023-07-25T14:35:34.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:34.903+0000 7fa108e62700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fa1040724c0 0x7fa1040c34c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:34.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:34.903+0000 7fa108e62700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa1040c4930 0x7fa1040c3a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:34.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:34.903+0000 7fa108e62700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1040c2fe0 con 0x7fa104151950 2023-07-25T14:35:34.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:34.903+0000 7fa108e62700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa104071a60 con 0x7fa1040724c0 2023-07-25T14:35:34.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:34.903+0000 7fa108e62700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1040c2a70 con 0x7fa1040c4930 2023-07-25T14:35:34.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:34.903+0000 7fa102d9d700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa1040c4930 0x7fa1040c3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:34.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:34.903+0000 7fa101d9b700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fa1040724c0 0x7fa1040c34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:34.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:34.903+0000 7fa102d9d700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa1040c4930 0x7fa1040c3a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3301/0 says I am v2:172.21.15.72:44460/0 (socket says 172.21.15.72:44460) 2023-07-25T14:35:34.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:34.903+0000 7fa101d9b700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fa1040724c0 0x7fa1040c34c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.72:34802/0 (socket says 172.21.15.72:34802) 2023-07-25T14:35:34.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:34.903+0000 7fa102d9d700 1 -- 172.21.15.72:0/4286213465 learned_addr learned my addr 172.21.15.72:0/4286213465 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:35:34.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:34.903+0000 7fa10259c700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7fa104151950 0x7fa10406a190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.72:53538/0 (socket says 172.21.15.72:53538) 2023-07-25T14:35:34.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:34.904+0000 7fa10159a700 1 -- 172.21.15.72:0/4286213465 <== mon.1 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2605082195 0 0) 0x7fa1040c2fe0 con 0x7fa104151950 2023-07-25T14:35:34.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:34.904+0000 7fa10159a700 1 -- 172.21.15.72:0/4286213465 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa0ec0035b0 con 0x7fa104151950 2023-07-25T14:35:34.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:34.904+0000 7fa102d9d700 1 -- 172.21.15.72:0/4286213465 >> v2:172.21.15.92:3300/0 conn(0x7fa1040724c0 msgr2=0x7fa1040c34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:35:34.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:34.904+0000 7fa102d9d700 1 --2- 172.21.15.72:0/4286213465 >> v2:172.21.15.92:3300/0 conn(0x7fa1040724c0 0x7fa1040c34c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:34.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:34.904+0000 7fa102d9d700 1 -- 172.21.15.72:0/4286213465 >> v1:172.21.15.92:6789/0 conn(0x7fa104151950 legacy=0x7fa10406a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:34.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:34.904+0000 7fa102d9d700 1 -- 172.21.15.72:0/4286213465 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa104155070 con 0x7fa1040c4930 2023-07-25T14:35:34.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:34.904+0000 7fa101d9b700 1 --2- 172.21.15.72:0/4286213465 >> v2:172.21.15.92:3300/0 conn(0x7fa1040724c0 0x7fa1040c34c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-25T14:35:34.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:34.904+0000 7fa102d9d700 1 --2- 172.21.15.72:0/4286213465 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa1040c4930 0x7fa1040c3a00 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fa0fc009e50 tx=0x7fa0fc00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ab01ac5e49b2a9c5 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:35:34.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:34.904+0000 7fa10159a700 1 -- 172.21.15.72:0/4286213465 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0fc00e070 con 0x7fa1040c4930 2023-07-25T14:35:34.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:34.904+0000 7fa10159a700 1 -- 172.21.15.72:0/4286213465 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0fc00b910 con 0x7fa1040c4930 2023-07-25T14:35:34.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:34.904+0000 7fa10159a700 1 -- 172.21.15.72:0/4286213465 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0fc00bcc0 con 0x7fa1040c4930 2023-07-25T14:35:34.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:34.905+0000 7fa108e62700 1 -- 172.21.15.72:0/4286213465 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa1040c4930 msgr2=0x7fa1040c3a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:34.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:34.905+0000 7fa108e62700 1 --2- 172.21.15.72:0/4286213465 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa1040c4930 0x7fa1040c3a00 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fa0fc009e50 tx=0x7fa0fc00b330 comp rx=0 tx=0).stop 2023-07-25T14:35:34.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:34.905+0000 7fa108e62700 1 -- 172.21.15.72:0/4286213465 shutdown_connections 2023-07-25T14:35:34.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:34.905+0000 7fa108e62700 1 --2- 172.21.15.72:0/4286213465 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa1040c4930 0x7fa1040c3a00 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:34.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:34.905+0000 7fa108e62700 1 --2- 172.21.15.72:0/4286213465 >> v2:172.21.15.92:3300/0 conn(0x7fa1040724c0 0x7fa1040c34c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:34.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:34.905+0000 7fa108e62700 1 -- 172.21.15.72:0/4286213465 >> 172.21.15.72:0/4286213465 conn(0x7fa1040a87e0 msgr2=0x7fa1040a8bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:35:34.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:34.905+0000 7fa108e62700 1 -- 172.21.15.72:0/4286213465 shutdown_connections 2023-07-25T14:35:34.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:34.905+0000 7fa108e62700 1 -- 172.21.15.72:0/4286213465 wait complete. 2023-07-25T14:35:34.928 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:34.906+0000 7fa108e62700 1 Processor -- start 2023-07-25T14:35:34.928 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:34.906+0000 7fa108e62700 1 -- start start 2023-07-25T14:35:34.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:34.907+0000 7fa108e62700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa1040724c0 0x7fa1041558e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:34.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:34.907+0000 7fa108e62700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa1040c4930 0x7fa104157cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:34.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:34.907+0000 7fa108e62700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa104151950 0x7fa104158230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:34.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:34.907+0000 7fa108e62700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa104156400 con 0x7fa104151950 2023-07-25T14:35:34.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:34.907+0000 7fa108e62700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1040be900 con 0x7fa1040c4930 2023-07-25T14:35:34.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:34.907+0000 7fa108e62700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa104158770 con 0x7fa1040724c0 2023-07-25T14:35:34.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:34.907+0000 7fa102d9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa104151950 0x7fa104158230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:34.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:34.907+0000 7fa102d9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa104151950 0x7fa104158230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:39238/0 (socket says 172.21.15.72:39238) 2023-07-25T14:35:34.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:34.907+0000 7fa102d9d700 1 -- 172.21.15.72:0/2042683887 learned_addr learned my addr 172.21.15.72:0/2042683887 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:35:34.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:34.907+0000 7fa101d9b700 1 --2- 172.21.15.72:0/2042683887 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa1040c4930 0x7fa104157cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:34.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:34.907+0000 7fa10259c700 1 --2- 172.21.15.72:0/2042683887 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa1040724c0 0x7fa1041558e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:34.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:34.907+0000 7fa102d9d700 1 -- 172.21.15.72:0/2042683887 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa1040724c0 msgr2=0x7fa1041558e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:34.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:34.907+0000 7fa102d9d700 1 --2- 172.21.15.72:0/2042683887 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa1040724c0 0x7fa1041558e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:34.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:34.907+0000 7fa102d9d700 1 -- 172.21.15.72:0/2042683887 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa1040c4930 msgr2=0x7fa104157cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:34.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:34.907+0000 7fa102d9d700 1 --2- 172.21.15.72:0/2042683887 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa1040c4930 0x7fa104157cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:34.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:34.907+0000 7fa102d9d700 1 -- 172.21.15.72:0/2042683887 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0f40094a0 con 0x7fa104151950 2023-07-25T14:35:34.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:34.907+0000 7fa102d9d700 1 --2- 172.21.15.72:0/2042683887 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa104151950 0x7fa104158230 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fa1040728c0 tx=0x7fa0fc004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:35:34.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:34.907+0000 7fa0f2ffd700 1 -- 172.21.15.72:0/2042683887 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0fc004800 con 0x7fa104151950 2023-07-25T14:35:34.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:34.907+0000 7fa0f2ffd700 1 -- 172.21.15.72:0/2042683887 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0fc004960 con 0x7fa104151950 2023-07-25T14:35:34.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:34.907+0000 7fa108e62700 1 -- 172.21.15.72:0/2042683887 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0fc009b30 con 0x7fa104151950 2023-07-25T14:35:34.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:34.907+0000 7fa0f2ffd700 1 -- 172.21.15.72:0/2042683887 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0fc01c680 con 0x7fa104151950 2023-07-25T14:35:34.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:34.907+0000 7fa108e62700 1 -- 172.21.15.72:0/2042683887 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1041561d0 con 0x7fa104151950 2023-07-25T14:35:34.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:34.908+0000 7fa108e62700 1 -- 172.21.15.72:0/2042683887 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa10404e470 con 0x7fa104151950 2023-07-25T14:35:34.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:34.909+0000 7fa0f2ffd700 1 -- 172.21.15.72:0/2042683887 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 88981+0+0 (secure 0 0 0) 0x7fa0fc01c7e0 con 0x7fa104151950 2023-07-25T14:35:34.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:34.909+0000 7fa0f2ffd700 1 --2- 172.21.15.72:0/2042683887 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fa0e406ac50 0x7fa0e406d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:34.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:34.909+0000 7fa0f2ffd700 1 -- 172.21.15.72:0/2042683887 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fa0fc08aa60 con 0x7fa104151950 2023-07-25T14:35:34.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:34.913+0000 7fa0f2ffd700 1 -- 172.21.15.72:0/2042683887 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fa0fc055fd0 con 0x7fa104151950 2023-07-25T14:35:34.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:34.924+0000 7fa10259c700 1 --2- 172.21.15.72:0/2042683887 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fa0e406ac50 0x7fa0e406d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:34.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:34.924+0000 7fa10259c700 1 --2- 172.21.15.72:0/2042683887 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fa0e406ac50 0x7fa0e406d110 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fa0f8007fd0 tx=0x7fa0f8007dc0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:35:35.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.103+0000 7fa108e62700 1 -- 172.21.15.72:0/2042683887 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fa104071e50 con 0x7fa104151950 2023-07-25T14:35:35.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.103+0000 7fa0f2ffd700 1 -- 172.21.15.72:0/2042683887 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v16) v1 ==== 92+0+10 (secure 0 0 0) 0x7fa0fc0595f0 con 0x7fa104151950 2023-07-25T14:35:35.117 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 8 2023-07-25T14:35:35.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.105+0000 7fa108e62700 1 -- 172.21.15.72:0/2042683887 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fa0e406ac50 msgr2=0x7fa0e406d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:35.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.105+0000 7fa108e62700 1 --2- 172.21.15.72:0/2042683887 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fa0e406ac50 0x7fa0e406d110 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fa0f8007fd0 tx=0x7fa0f8007dc0 comp rx=0 tx=0).stop 2023-07-25T14:35:35.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.105+0000 7fa108e62700 1 -- 172.21.15.72:0/2042683887 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa104151950 msgr2=0x7fa104158230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:35.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.105+0000 7fa108e62700 1 --2- 172.21.15.72:0/2042683887 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa104151950 0x7fa104158230 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fa1040728c0 tx=0x7fa0fc004ad0 comp rx=0 tx=0).stop 2023-07-25T14:35:35.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.106+0000 7fa108e62700 1 -- 172.21.15.72:0/2042683887 shutdown_connections 2023-07-25T14:35:35.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.106+0000 7fa108e62700 1 --2- 172.21.15.72:0/2042683887 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fa0e406ac50 0x7fa0e406d110 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:35.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.106+0000 7fa108e62700 1 --2- 172.21.15.72:0/2042683887 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa1040724c0 0x7fa1041558e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:35.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.106+0000 7fa108e62700 1 --2- 172.21.15.72:0/2042683887 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa104151950 0x7fa104158230 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:35.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.106+0000 7fa108e62700 1 --2- 172.21.15.72:0/2042683887 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa1040c4930 0x7fa104157cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:35.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.106+0000 7fa108e62700 1 -- 172.21.15.72:0/2042683887 >> 172.21.15.72:0/2042683887 conn(0x7fa1040a87e0 msgr2=0x7fa10406ece0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:35:35.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.106+0000 7fa108e62700 1 -- 172.21.15.72:0/2042683887 shutdown_connections 2023-07-25T14:35:35.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.106+0000 7fa108e62700 1 -- 172.21.15.72:0/2042683887 wait complete. 2023-07-25T14:35:35.131 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-25T14:35:35.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.243+0000 7f08e782f700 1 Processor -- start 2023-07-25T14:35:35.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.243+0000 7f08e782f700 1 -- start start 2023-07-25T14:35:35.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.244+0000 7f08e782f700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f08e0151950 0x7f08e006a190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:35.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.244+0000 7f08e782f700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08e00c2fe0 con 0x7f08e00724c0 2023-07-25T14:35:35.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.244+0000 7f08e782f700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08e0155070 con 0x7f08e006a6d0 2023-07-25T14:35:35.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.244+0000 7f08e782f700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08e0071a60 con 0x7f08e0151950 2023-07-25T14:35:35.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.244+0000 7f08e4dca700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f08e00724c0 0x7f08e00c34c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:58218/0 (socket says 172.21.15.72:58218) 2023-07-25T14:35:35.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.244+0000 7f08e4dca700 1 -- 172.21.15.72:0/41563506 learned_addr learned my addr 172.21.15.72:0/41563506 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:35:35.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.244+0000 7f08e55cb700 1 --2- 172.21.15.72:0/41563506 >> v2:172.21.15.92:3300/0 conn(0x7f08e0151950 0x7f08e006a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:35.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.244+0000 7f08d7fff700 1 -- 172.21.15.72:0/41563506 <== mon.1 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1993097489 0 0) 0x7f08e0155070 con 0x7f08e006a6d0 2023-07-25T14:35:35.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.244+0000 7f08d7fff700 1 -- 172.21.15.72:0/41563506 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f08cc0035b0 con 0x7f08e006a6d0 2023-07-25T14:35:35.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.244+0000 7f08e55cb700 1 -- 172.21.15.72:0/41563506 >> v1:172.21.15.92:6789/0 conn(0x7f08e006a6d0 legacy=0x7f08e00c3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:35.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.244+0000 7f08e55cb700 1 -- 172.21.15.72:0/41563506 >> v1:172.21.15.72:6789/0 conn(0x7f08e00724c0 legacy=0x7f08e00c34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:35.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.244+0000 7f08e55cb700 1 -- 172.21.15.72:0/41563506 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08e00c15c0 con 0x7f08e0151950 2023-07-25T14:35:35.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.244+0000 7f08e55cb700 1 --2- 172.21.15.72:0/41563506 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f08e0151950 0x7f08e006a190 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f08dc009840 tx=0x7f08dc009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=97608568262d7087 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:35:35.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.245+0000 7f08d7fff700 1 -- 172.21.15.72:0/41563506 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08dc011830 con 0x7f08e0151950 2023-07-25T14:35:35.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.245+0000 7f08d7fff700 1 -- 172.21.15.72:0/41563506 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08dc011990 con 0x7f08e0151950 2023-07-25T14:35:35.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.245+0000 7f08d7fff700 1 -- 172.21.15.72:0/41563506 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08dc011d20 con 0x7f08e0151950 2023-07-25T14:35:35.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.245+0000 7f08e782f700 1 -- 172.21.15.72:0/41563506 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f08e0151950 msgr2=0x7f08e006a190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:35.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.245+0000 7f08e782f700 1 --2- 172.21.15.72:0/41563506 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f08e0151950 0x7f08e006a190 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f08dc009840 tx=0x7f08dc009b50 comp rx=0 tx=0).stop 2023-07-25T14:35:35.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.245+0000 7f08e782f700 1 -- 172.21.15.72:0/41563506 shutdown_connections 2023-07-25T14:35:35.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.245+0000 7f08e782f700 1 --2- 172.21.15.72:0/41563506 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f08e0151950 0x7f08e006a190 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:35.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.245+0000 7f08e782f700 1 -- 172.21.15.72:0/41563506 >> 172.21.15.72:0/41563506 conn(0x7f08e00a87e0 msgr2=0x7f08e00a8bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:35:35.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.245+0000 7f08e782f700 1 -- 172.21.15.72:0/41563506 shutdown_connections 2023-07-25T14:35:35.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.245+0000 7f08e782f700 1 -- 172.21.15.72:0/41563506 wait complete. 2023-07-25T14:35:35.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.246+0000 7f08e782f700 1 Processor -- start 2023-07-25T14:35:35.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.247+0000 7f08e782f700 1 -- start start 2023-07-25T14:35:35.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.247+0000 7f08e782f700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f08e006a6d0 0x7f08e014ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:35.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.247+0000 7f08e782f700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f08e00724c0 0x7f08e00a7310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:35.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.247+0000 7f08e782f700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f08e0151950 0x7f08e00c53e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:35.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.247+0000 7f08e782f700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08e014dfa0 con 0x7f08e006a6d0 2023-07-25T14:35:35.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.247+0000 7f08e782f700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08e01ea7e0 con 0x7f08e00724c0 2023-07-25T14:35:35.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.247+0000 7f08e782f700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08e014e1b0 con 0x7f08e0151950 2023-07-25T14:35:35.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.247+0000 7f08e4dca700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f08e00724c0 0x7f08e00a7310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:35.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.247+0000 7f08e4dca700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f08e00724c0 0x7f08e00a7310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.72:34830/0 (socket says 172.21.15.72:34830) 2023-07-25T14:35:35.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.247+0000 7f08e4dca700 1 -- 172.21.15.72:0/1689279304 learned_addr learned my addr 172.21.15.72:0/1689279304 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:35:35.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.247+0000 7f08e55cb700 1 --2- 172.21.15.72:0/1689279304 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f08e006a6d0 0x7f08e014ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:35.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.247+0000 7f08e5dcc700 1 --2- 172.21.15.72:0/1689279304 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f08e0151950 0x7f08e00c53e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:35.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.248+0000 7f08e4dca700 1 -- 172.21.15.72:0/1689279304 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f08e0151950 msgr2=0x7f08e00c53e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:35.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.248+0000 7f08e4dca700 1 --2- 172.21.15.72:0/1689279304 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f08e0151950 0x7f08e00c53e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:35.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.248+0000 7f08e4dca700 1 -- 172.21.15.72:0/1689279304 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f08e006a6d0 msgr2=0x7f08e014ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:35.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.248+0000 7f08e4dca700 1 --2- 172.21.15.72:0/1689279304 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f08e006a6d0 0x7f08e014ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:35.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.248+0000 7f08e4dca700 1 -- 172.21.15.72:0/1689279304 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08dc0094a0 con 0x7f08e00724c0 2023-07-25T14:35:35.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.248+0000 7f08e5dcc700 1 --2- 172.21.15.72:0/1689279304 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f08e0151950 0x7f08e00c53e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-25T14:35:35.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.248+0000 7f08e4dca700 1 --2- 172.21.15.72:0/1689279304 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f08e00724c0 0x7f08e00a7310 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f08d000c520 tx=0x7f08d000c830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:35:35.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.248+0000 7f08d5ffb700 1 -- 172.21.15.72:0/1689279304 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08d0005d70 con 0x7f08e00724c0 2023-07-25T14:35:35.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.248+0000 7f08d5ffb700 1 -- 172.21.15.72:0/1689279304 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08d00070d0 con 0x7f08e00724c0 2023-07-25T14:35:35.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.248+0000 7f08e782f700 1 -- 172.21.15.72:0/1689279304 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08e014e490 con 0x7f08e00724c0 2023-07-25T14:35:35.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.248+0000 7f08d5ffb700 1 -- 172.21.15.72:0/1689279304 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08d0007440 con 0x7f08e00724c0 2023-07-25T14:35:35.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.248+0000 7f08e782f700 1 -- 172.21.15.72:0/1689279304 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08e01ea490 con 0x7f08e00724c0 2023-07-25T14:35:35.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.249+0000 7f08e782f700 1 -- 172.21.15.72:0/1689279304 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08e014e9b0 con 0x7f08e00724c0 2023-07-25T14:35:35.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.249+0000 7f08d5ffb700 1 -- 172.21.15.72:0/1689279304 <== mon.1 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 4) v1 ==== 88981+0+0 (secure 0 0 0) 0x7f08d00075a0 con 0x7f08e00724c0 2023-07-25T14:35:35.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.250+0000 7f08d5ffb700 1 --2- 172.21.15.72:0/1689279304 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f08c406ac50 0x7f08c406d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:35.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.250+0000 7f08d5ffb700 1 -- 172.21.15.72:0/1689279304 <== mon.1 v2:172.21.15.92:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f08d0088240 con 0x7f08e00724c0 2023-07-25T14:35:35.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.250+0000 7f08e55cb700 1 --2- 172.21.15.72:0/1689279304 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f08c406ac50 0x7f08c406d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:35.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.250+0000 7f08e55cb700 1 --2- 172.21.15.72:0/1689279304 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f08c406ac50 0x7f08c406d110 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f08dc0090b0 tx=0x7f08dc01c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:35:35.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.254+0000 7f08d5ffb700 1 -- 172.21.15.72:0/1689279304 <== mon.1 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f08e014e9b0 con 0x7f08e00724c0 2023-07-25T14:35:35.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.450+0000 7f08e782f700 1 -- 172.21.15.72:0/1689279304 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f08e014e9b0 con 0x7f08e00724c0 2023-07-25T14:35:35.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.451+0000 7f08d5ffb700 1 -- 172.21.15.72:0/1689279304 <== mon.1 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) v1 ==== 93+0+10 (secure 0 0 0) 0x7f08e014e9b0 con 0x7f08e00724c0 2023-07-25T14:35:35.464 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 1 2023-07-25T14:35:35.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.453+0000 7f08e782f700 1 -- 172.21.15.72:0/1689279304 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f08c406ac50 msgr2=0x7f08c406d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:35.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.453+0000 7f08e782f700 1 --2- 172.21.15.72:0/1689279304 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f08c406ac50 0x7f08c406d110 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f08dc0090b0 tx=0x7f08dc01c040 comp rx=0 tx=0).stop 2023-07-25T14:35:35.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.453+0000 7f08e782f700 1 -- 172.21.15.72:0/1689279304 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f08e00724c0 msgr2=0x7f08e00a7310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:35.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.453+0000 7f08e782f700 1 --2- 172.21.15.72:0/1689279304 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f08e00724c0 0x7f08e00a7310 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f08d000c520 tx=0x7f08d000c830 comp rx=0 tx=0).stop 2023-07-25T14:35:35.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.453+0000 7f08e782f700 1 -- 172.21.15.72:0/1689279304 shutdown_connections 2023-07-25T14:35:35.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.453+0000 7f08e782f700 1 --2- 172.21.15.72:0/1689279304 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f08c406ac50 0x7f08c406d110 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:35.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.453+0000 7f08e782f700 1 --2- 172.21.15.72:0/1689279304 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f08e0151950 0x7f08e00c53e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:35.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.453+0000 7f08e782f700 1 --2- 172.21.15.72:0/1689279304 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f08e006a6d0 0x7f08e014ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:35.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.453+0000 7f08e782f700 1 --2- 172.21.15.72:0/1689279304 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f08e00724c0 0x7f08e00a7310 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:35.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.453+0000 7f08e782f700 1 -- 172.21.15.72:0/1689279304 >> 172.21.15.72:0/1689279304 conn(0x7f08e00a87e0 msgr2=0x7f08e006e8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:35:35.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.453+0000 7f08e782f700 1 -- 172.21.15.72:0/1689279304 shutdown_connections 2023-07-25T14:35:35.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.453+0000 7f08e782f700 1 -- 172.21.15.72:0/1689279304 wait complete. 2023-07-25T14:35:35.477 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-25T14:35:35.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.586+0000 7f68e7a32700 1 Processor -- start 2023-07-25T14:35:35.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.586+0000 7f68e7a32700 1 -- start start 2023-07-25T14:35:35.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.587+0000 7f68e7a32700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f68e0151950 0x7f68e006a190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:35.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.587+0000 7f68e7a32700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68e00c2fe0 con 0x7f68e006a6d0 2023-07-25T14:35:35.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.587+0000 7f68e7a32700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68e0155070 con 0x7f68e00724c0 2023-07-25T14:35:35.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.587+0000 7f68e7a32700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68e0071a60 con 0x7f68e0151950 2023-07-25T14:35:35.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.587+0000 7f68e57ce700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f68e0151950 0x7f68e006a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:35.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.587+0000 7f68e5fcf700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f68e006a6d0 0x7f68e00c3bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:58242/0 (socket says 172.21.15.72:58242) 2023-07-25T14:35:35.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.587+0000 7f68e5fcf700 1 -- 172.21.15.72:0/2529700222 learned_addr learned my addr 172.21.15.72:0/2529700222 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:35:35.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.587+0000 7f68e57ce700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f68e0151950 0x7f68e006a190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:39270/0 (socket says 172.21.15.72:39270) 2023-07-25T14:35:35.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.588+0000 7f68e57ce700 1 -- 172.21.15.72:0/2529700222 >> v1:172.21.15.92:6789/0 conn(0x7f68e00724c0 legacy=0x7f68e00c34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:35.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.588+0000 7f68e57ce700 1 -- 172.21.15.72:0/2529700222 >> v1:172.21.15.72:6789/0 conn(0x7f68e006a6d0 legacy=0x7f68e00c3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:35.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.588+0000 7f68e57ce700 1 -- 172.21.15.72:0/2529700222 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68e00c15c0 con 0x7f68e0151950 2023-07-25T14:35:35.602 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.588+0000 7f68d7fff700 1 -- 172.21.15.72:0/2529700222 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3837039051 0 0) 0x7f68e00c2fe0 con 0x7f68e006a6d0 2023-07-25T14:35:35.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.588+0000 7f68e57ce700 1 --2- 172.21.15.72:0/2529700222 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f68e0151950 0x7f68e006a190 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f68d0009840 tx=0x7f68d0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79ca33c8acf49846 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:35:35.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.588+0000 7f68d7fff700 1 -- 172.21.15.72:0/2529700222 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68d0011830 con 0x7f68e0151950 2023-07-25T14:35:35.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.588+0000 7f68d7fff700 1 -- 172.21.15.72:0/2529700222 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68d0011990 con 0x7f68e0151950 2023-07-25T14:35:35.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.588+0000 7f68d7fff700 1 -- 172.21.15.72:0/2529700222 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68d0011d20 con 0x7f68e0151950 2023-07-25T14:35:35.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.588+0000 7f68e7a32700 1 -- 172.21.15.72:0/2529700222 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f68e0151950 msgr2=0x7f68e006a190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:35.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.588+0000 7f68e7a32700 1 --2- 172.21.15.72:0/2529700222 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f68e0151950 0x7f68e006a190 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f68d0009840 tx=0x7f68d0009b50 comp rx=0 tx=0).stop 2023-07-25T14:35:35.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.588+0000 7f68e7a32700 1 -- 172.21.15.72:0/2529700222 shutdown_connections 2023-07-25T14:35:35.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.588+0000 7f68e7a32700 1 --2- 172.21.15.72:0/2529700222 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f68e0151950 0x7f68e006a190 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:35.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.588+0000 7f68e7a32700 1 -- 172.21.15.72:0/2529700222 >> 172.21.15.72:0/2529700222 conn(0x7f68e00a87e0 msgr2=0x7f68e00a8bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:35:35.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.588+0000 7f68e7a32700 1 -- 172.21.15.72:0/2529700222 shutdown_connections 2023-07-25T14:35:35.605 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.589+0000 7f68e7a32700 1 -- 172.21.15.72:0/2529700222 wait complete. 2023-07-25T14:35:35.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.590+0000 7f68e7a32700 1 Processor -- start 2023-07-25T14:35:35.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.590+0000 7f68e7a32700 1 -- start start 2023-07-25T14:35:35.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.590+0000 7f68e7a32700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f68e006a6d0 0x7f68e01edac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:35.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.590+0000 7f68e7a32700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f68e00724c0 0x7f68e01eb020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:35.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.590+0000 7f68e7a32700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f68e0151950 0x7f68e006ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:35.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.590+0000 7f68e7a32700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68e014ec60 con 0x7f68e00724c0 2023-07-25T14:35:35.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.590+0000 7f68e7a32700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68e01ee000 con 0x7f68e006a6d0 2023-07-25T14:35:35.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.590+0000 7f68e7a32700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68e01ed070 con 0x7f68e0151950 2023-07-25T14:35:35.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.590+0000 7f68e4fcd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f68e00724c0 0x7f68e01eb020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:35.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.590+0000 7f68e57ce700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f68e006a6d0 0x7f68e01edac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:35.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.590+0000 7f68e57ce700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f68e006a6d0 0x7f68e01edac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.72:34848/0 (socket says 172.21.15.72:34848) 2023-07-25T14:35:35.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.590+0000 7f68e57ce700 1 -- 172.21.15.72:0/2076782585 learned_addr learned my addr 172.21.15.72:0/2076782585 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:35:35.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.590+0000 7f68e5fcf700 1 --2- 172.21.15.72:0/2076782585 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f68e0151950 0x7f68e006ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:35.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.591+0000 7f68e4fcd700 1 -- 172.21.15.72:0/2076782585 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f68e0151950 msgr2=0x7f68e006ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:35.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.591+0000 7f68e4fcd700 1 --2- 172.21.15.72:0/2076782585 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f68e0151950 0x7f68e006ef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:35.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.591+0000 7f68e4fcd700 1 -- 172.21.15.72:0/2076782585 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f68e006a6d0 msgr2=0x7f68e01edac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:35.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.591+0000 7f68e4fcd700 1 --2- 172.21.15.72:0/2076782585 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f68e006a6d0 0x7f68e01edac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:35.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.591+0000 7f68e4fcd700 1 -- 172.21.15.72:0/2076782585 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68d00094a0 con 0x7f68e00724c0 2023-07-25T14:35:35.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.591+0000 7f68e4fcd700 1 --2- 172.21.15.72:0/2076782585 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f68e00724c0 0x7f68e01eb020 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f68dc000f60 tx=0x7f68dc00c730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:35:35.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.591+0000 7f68d5ffb700 1 -- 172.21.15.72:0/2076782585 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68dc0052d0 con 0x7f68e00724c0 2023-07-25T14:35:35.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.591+0000 7f68d5ffb700 1 -- 172.21.15.72:0/2076782585 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68dc005430 con 0x7f68e00724c0 2023-07-25T14:35:35.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.591+0000 7f68e7a32700 1 -- 172.21.15.72:0/2076782585 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68e01ed630 con 0x7f68e00724c0 2023-07-25T14:35:35.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.591+0000 7f68d5ffb700 1 -- 172.21.15.72:0/2076782585 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68dc0038a0 con 0x7f68e00724c0 2023-07-25T14:35:35.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.591+0000 7f68e7a32700 1 -- 172.21.15.72:0/2076782585 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68e01ed2c0 con 0x7f68e00724c0 2023-07-25T14:35:35.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.592+0000 7f68e7a32700 1 -- 172.21.15.72:0/2076782585 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68e01ed7c0 con 0x7f68e00724c0 2023-07-25T14:35:35.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.593+0000 7f68d5ffb700 1 -- 172.21.15.72:0/2076782585 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 88981+0+0 (secure 0 0 0) 0x7f68dc003a00 con 0x7f68e00724c0 2023-07-25T14:35:35.617 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.593+0000 7f68d5ffb700 1 --2- 172.21.15.72:0/2076782585 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f68c406ac50 0x7f68c406d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:35.617 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.593+0000 7f68d5ffb700 1 -- 172.21.15.72:0/2076782585 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f68dc088250 con 0x7f68e00724c0 2023-07-25T14:35:35.617 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.593+0000 7f68e57ce700 1 --2- 172.21.15.72:0/2076782585 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f68c406ac50 0x7f68c406d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:35.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.593+0000 7f68e57ce700 1 --2- 172.21.15.72:0/2076782585 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f68c406ac50 0x7f68c406d110 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f68d0009b90 tx=0x7f68d001c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:35:35.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.598+0000 7f68d5ffb700 1 -- 172.21.15.72:0/2076782585 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f68dc0537c0 con 0x7f68e00724c0 2023-07-25T14:35:35.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.827+0000 7f68e7a32700 1 -- 172.21.15.72:0/2076782585 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f68e006ca00 con 0x7f68e00724c0 2023-07-25T14:35:35.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.827+0000 7f68d5ffb700 1 -- 172.21.15.72:0/2076782585 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3521 (secure 0 0 0) 0x7f68dc017de0 con 0x7f68e00724c0 2023-07-25T14:35:35.844 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-25T14:35:35.844 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4220,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6836/4293785067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":4293785067},{"type":"v1","addr":"172.21.15.72:6836","nonce":4293785067}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4229,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6834/681290755","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":681290755},{"type":"v1","addr":"172.21.15.92:6834","nonce":681290755}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6837/3376375642","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6835","nonce":3376375642},{"type":"v1","addr":"172.21.15.72:6837","nonce":3376375642}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4285,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/2045555979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6833","nonce":2045555979},{"type":"v1","addr":"172.21.15.92:6835","nonce":2045555979}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2023-07-25T14:35:35.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.829+0000 7f68e7a32700 1 -- 172.21.15.72:0/2076782585 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f68c406ac50 msgr2=0x7f68c406d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:35.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.829+0000 7f68e7a32700 1 --2- 172.21.15.72:0/2076782585 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f68c406ac50 0x7f68c406d110 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f68d0009b90 tx=0x7f68d001c040 comp rx=0 tx=0).stop 2023-07-25T14:35:35.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.829+0000 7f68e7a32700 1 -- 172.21.15.72:0/2076782585 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f68e00724c0 msgr2=0x7f68e01eb020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:35.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.829+0000 7f68e7a32700 1 --2- 172.21.15.72:0/2076782585 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f68e00724c0 0x7f68e01eb020 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f68dc000f60 tx=0x7f68dc00c730 comp rx=0 tx=0).stop 2023-07-25T14:35:35.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.829+0000 7f68e7a32700 1 -- 172.21.15.72:0/2076782585 shutdown_connections 2023-07-25T14:35:35.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.829+0000 7f68e7a32700 1 --2- 172.21.15.72:0/2076782585 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f68c406ac50 0x7f68c406d110 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:35.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.829+0000 7f68e7a32700 1 --2- 172.21.15.72:0/2076782585 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f68e0151950 0x7f68e006ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:35.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.829+0000 7f68e7a32700 1 --2- 172.21.15.72:0/2076782585 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f68e006a6d0 0x7f68e01edac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:35.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.829+0000 7f68e7a32700 1 --2- 172.21.15.72:0/2076782585 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f68e00724c0 0x7f68e01eb020 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:35.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.829+0000 7f68e7a32700 1 -- 172.21.15.72:0/2076782585 >> 172.21.15.72:0/2076782585 conn(0x7f68e00a87e0 msgr2=0x7f68e0150aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:35:35.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.830+0000 7f68e7a32700 1 -- 172.21.15.72:0/2076782585 shutdown_connections 2023-07-25T14:35:35.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.830+0000 7f68e7a32700 1 -- 172.21.15.72:0/2076782585 wait complete. 2023-07-25T14:35:35.847 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 3 2023-07-25T14:35:35.854 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-25T14:35:35.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.962+0000 7fa7f2827700 1 Processor -- start 2023-07-25T14:35:35.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.962+0000 7fa7f2827700 1 -- start start 2023-07-25T14:35:35.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.962+0000 7fa7f2827700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa7ec0a9cc0 0x7fa7ec1525e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:35.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.963+0000 7fa7f2827700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7ec0c5890 con 0x7fa7ec14f810 2023-07-25T14:35:35.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.963+0000 7fa7f2827700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7ec152150 con 0x7fa7ec0bb0b0 2023-07-25T14:35:35.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.963+0000 7fa7f2827700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7ec14fbf0 con 0x7fa7ec0a9cc0 2023-07-25T14:35:35.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.963+0000 7fa7ebfff700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fa7ec14f810 0x7fa7ec0c4370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:58252/0 (socket says 172.21.15.72:58252) 2023-07-25T14:35:35.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.963+0000 7fa7ebfff700 1 -- 172.21.15.72:0/2092649 learned_addr learned my addr 172.21.15.72:0/2092649 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:35:35.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.963+0000 7fa7eb7fe700 1 --2- 172.21.15.72:0/2092649 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa7ec0a9cc0 0x7fa7ec1525e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:35.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.963+0000 7fa7eaffd700 1 -- 172.21.15.72:0/2092649 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3913675685 0 0) 0x7fa7ec0c5890 con 0x7fa7ec14f810 2023-07-25T14:35:35.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.963+0000 7fa7eaffd700 1 -- 172.21.15.72:0/2092649 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa7d40035b0 con 0x7fa7ec14f810 2023-07-25T14:35:35.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.963+0000 7fa7eaffd700 1 -- 172.21.15.72:0/2092649 <== mon.1 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1761894134 0 0) 0x7fa7ec152150 con 0x7fa7ec0bb0b0 2023-07-25T14:35:35.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.963+0000 7fa7eaffd700 1 -- 172.21.15.72:0/2092649 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa7ec0c5890 con 0x7fa7ec0bb0b0 2023-07-25T14:35:35.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.963+0000 7fa7eb7fe700 1 -- 172.21.15.72:0/2092649 >> v1:172.21.15.92:6789/0 conn(0x7fa7ec0bb0b0 legacy=0x7fa7ec152b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:35.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.963+0000 7fa7eb7fe700 1 -- 172.21.15.72:0/2092649 >> v1:172.21.15.72:6789/0 conn(0x7fa7ec14f810 legacy=0x7fa7ec0c4370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:35.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.963+0000 7fa7eb7fe700 1 -- 172.21.15.72:0/2092649 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7ec1566a0 con 0x7fa7ec0a9cc0 2023-07-25T14:35:35.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.963+0000 7fa7eb7fe700 1 --2- 172.21.15.72:0/2092649 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa7ec0a9cc0 0x7fa7ec1525e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fa7e0009870 tx=0x7fa7e0009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c04537fdffac7f22 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:35:35.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.963+0000 7fa7eaffd700 1 -- 172.21.15.72:0/2092649 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7e0011830 con 0x7fa7ec0a9cc0 2023-07-25T14:35:35.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.963+0000 7fa7eaffd700 1 -- 172.21.15.72:0/2092649 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7e0011990 con 0x7fa7ec0a9cc0 2023-07-25T14:35:35.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.963+0000 7fa7eaffd700 1 -- 172.21.15.72:0/2092649 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7e0011d20 con 0x7fa7ec0a9cc0 2023-07-25T14:35:35.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.964+0000 7fa7f2827700 1 -- 172.21.15.72:0/2092649 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa7ec0a9cc0 msgr2=0x7fa7ec1525e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:35.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.964+0000 7fa7f2827700 1 --2- 172.21.15.72:0/2092649 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa7ec0a9cc0 0x7fa7ec1525e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fa7e0009870 tx=0x7fa7e0009b80 comp rx=0 tx=0).stop 2023-07-25T14:35:35.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.964+0000 7fa7f2827700 1 -- 172.21.15.72:0/2092649 shutdown_connections 2023-07-25T14:35:35.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.964+0000 7fa7f2827700 1 --2- 172.21.15.72:0/2092649 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa7ec0a9cc0 0x7fa7ec1525e0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:35.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.964+0000 7fa7f2827700 1 -- 172.21.15.72:0/2092649 >> 172.21.15.72:0/2092649 conn(0x7fa7ec06a8d0 msgr2=0x7fa7ec0a94e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:35:35.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.964+0000 7fa7f2827700 1 -- 172.21.15.72:0/2092649 shutdown_connections 2023-07-25T14:35:35.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.964+0000 7fa7f2827700 1 -- 172.21.15.72:0/2092649 wait complete. 2023-07-25T14:35:35.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.965+0000 7fa7f2827700 1 Processor -- start 2023-07-25T14:35:35.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.965+0000 7fa7f2827700 1 -- start start 2023-07-25T14:35:35.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.966+0000 7fa7f2827700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa7ec0a9cc0 0x7fa7ec0a8ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:35.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.966+0000 7fa7f2827700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa7ec0bb0b0 0x7fa7ec0a5fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:35.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.966+0000 7fa7f2827700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa7ec14f810 0x7fa7ec0a6520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:35.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.966+0000 7fa7f2827700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7ec0acf90 con 0x7fa7ec14f810 2023-07-25T14:35:35.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.966+0000 7fa7f2827700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7ec0a6f40 con 0x7fa7ec0a9cc0 2023-07-25T14:35:35.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.966+0000 7fa7f2827700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7ec1e8990 con 0x7fa7ec0bb0b0 2023-07-25T14:35:35.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.966+0000 7fa7f0dc4700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa7ec14f810 0x7fa7ec0a6520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:35.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.966+0000 7fa7f0dc4700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa7ec14f810 0x7fa7ec0a6520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:39294/0 (socket says 172.21.15.72:39294) 2023-07-25T14:35:35.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.966+0000 7fa7f0dc4700 1 -- 172.21.15.72:0/2937461311 learned_addr learned my addr 172.21.15.72:0/2937461311 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:35:35.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.966+0000 7fa7eb7fe700 1 --2- 172.21.15.72:0/2937461311 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa7ec0bb0b0 0x7fa7ec0a5fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:35.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.966+0000 7fa7ebfff700 1 --2- 172.21.15.72:0/2937461311 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa7ec0a9cc0 0x7fa7ec0a8ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:35.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.966+0000 7fa7f0dc4700 1 -- 172.21.15.72:0/2937461311 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa7ec0bb0b0 msgr2=0x7fa7ec0a5fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:35.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.966+0000 7fa7f0dc4700 1 --2- 172.21.15.72:0/2937461311 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa7ec0bb0b0 0x7fa7ec0a5fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:35.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.966+0000 7fa7f0dc4700 1 -- 172.21.15.72:0/2937461311 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa7ec0a9cc0 msgr2=0x7fa7ec0a8ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:35.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.966+0000 7fa7f0dc4700 1 --2- 172.21.15.72:0/2937461311 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa7ec0a9cc0 0x7fa7ec0a8ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:35.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.966+0000 7fa7f0dc4700 1 -- 172.21.15.72:0/2937461311 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7e00094a0 con 0x7fa7ec14f810 2023-07-25T14:35:35.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.967+0000 7fa7f0dc4700 1 --2- 172.21.15.72:0/2937461311 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa7ec14f810 0x7fa7ec0a6520 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa7e400cbc0 tx=0x7fa7e400ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:35:35.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.967+0000 7fa7e8ff9700 1 -- 172.21.15.72:0/2937461311 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7e4003c50 con 0x7fa7ec14f810 2023-07-25T14:35:35.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.967+0000 7fa7e8ff9700 1 -- 172.21.15.72:0/2937461311 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7e4003db0 con 0x7fa7ec14f810 2023-07-25T14:35:35.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.967+0000 7fa7f2827700 1 -- 172.21.15.72:0/2937461311 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7ec1e8c70 con 0x7fa7ec14f810 2023-07-25T14:35:35.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.967+0000 7fa7e8ff9700 1 -- 172.21.15.72:0/2937461311 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7e400aae0 con 0x7fa7ec14f810 2023-07-25T14:35:35.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.967+0000 7fa7f2827700 1 -- 172.21.15.72:0/2937461311 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7ec0aa930 con 0x7fa7ec14f810 2023-07-25T14:35:35.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.968+0000 7fa7f2827700 1 -- 172.21.15.72:0/2937461311 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7ec0aab50 con 0x7fa7ec14f810 2023-07-25T14:35:35.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.968+0000 7fa7e8ff9700 1 -- 172.21.15.72:0/2937461311 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 4) v1 ==== 88981+0+0 (secure 0 0 0) 0x7fa7e400ac40 con 0x7fa7ec14f810 2023-07-25T14:35:35.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.969+0000 7fa7e8ff9700 1 --2- 172.21.15.72:0/2937461311 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fa7d806ac50 0x7fa7d806d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:35.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.969+0000 7fa7e8ff9700 1 -- 172.21.15.72:0/2937461311 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fa7e4088fb0 con 0x7fa7ec14f810 2023-07-25T14:35:35.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.969+0000 7fa7ebfff700 1 --2- 172.21.15.72:0/2937461311 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fa7d806ac50 0x7fa7d806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:35.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.969+0000 7fa7ebfff700 1 --2- 172.21.15.72:0/2937461311 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fa7d806ac50 0x7fa7d806d110 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fa7dc007fd0 tx=0x7fa7dc007dc0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:35:35.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.973+0000 7fa7e8ff9700 1 -- 172.21.15.72:0/2937461311 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fa7e40bb310 con 0x7fa7ec14f810 2023-07-25T14:35:36.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:35.991+0000 7fa7e8ff9700 1 -- 172.21.15.72:0/2937461311 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa7e40548f0 con 0x7fa7ec14f810 2023-07-25T14:35:36.178 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.166+0000 7fa7f2827700 1 -- 172.21.15.72:0/2937461311 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa7ec04e470 con 0x7fa7ec14f810 2023-07-25T14:35:36.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.167+0000 7fa7e8ff9700 1 -- 172.21.15.72:0/2937461311 <== mon.0 v2:172.21.15.72:3300/0 8 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+14531 (secure 0 0 0) 0x7fa7e40755d0 con 0x7fa7ec14f810 2023-07-25T14:35:36.179 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-25T14:35:36.180 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":17,"fsid":"9170db48-9170-43e8-8ccb-9813e6240906","created":"2023-07-25T14:35:21.733262+0000","modified":"2023-07-25T14:35:35.361374+0000","last_up_change":"2023-07-25T14:35:31.355010+0000","last_in_change":"2023-07-25T14:35:24.195785+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-25T14:35:32.983457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-25T14:35:33.326342+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d517fdad-0bfe-49f0-89f2-9421c3761839","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6801","nonce":2475407414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6803","nonce":2475407414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6807","nonce":2475407414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6805","nonce":2475407414}]},"public_addr":"172.21.15.72:6801/2475407414","cluster_addr":"172.21.15.72:6803/2475407414","heartbeat_back_addr":"172.21.15.72:6807/2475407414","heartbeat_front_addr":"172.21.15.72:6805/2475407414","state":["exists","up"]},{"osd":1,"uuid":"e1564be3-f209-47e5-a8d0-32fc618a474f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6822","nonce":870954016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6825","nonce":870954016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6831","nonce":870954016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6827","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6829","nonce":870954016}]},"public_addr":"172.21.15.72:6822/870954016","cluster_addr":"172.21.15.72:6825/870954016","heartbeat_back_addr":"172.21.15.72:6831/870954016","heartbeat_front_addr":"172.21.15.72:6829/870954016","state":["exists","up"]},{"osd":2,"uuid":"c4647d30-ffa6-417a-9026-ef530c75910e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6809","nonce":2143129442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6811","nonce":2143129442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6815","nonce":2143129442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6813","nonce":2143129442}]},"public_addr":"172.21.15.72:6809/2143129442","cluster_addr":"172.21.15.72:6811/2143129442","heartbeat_back_addr":"172.21.15.72:6815/2143129442","heartbeat_front_addr":"172.21.15.72:6813/2143129442","state":["exists","up"]},{"osd":3,"uuid":"76c9d9a7-c2e2-4612-a58b-d6882dd76b58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6817","nonce":3404066311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6819","nonce":3404066311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6828","nonce":3404066311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6821","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6823","nonce":3404066311}]},"public_addr":"172.21.15.72:6817/3404066311","cluster_addr":"172.21.15.72:6819/3404066311","heartbeat_back_addr":"172.21.15.72:6828/3404066311","heartbeat_front_addr":"172.21.15.72:6823/3404066311","state":["exists","up"]},{"osd":4,"uuid":"7f8920dc-0ad4-4a73-ab40-65408f83eadd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6817","nonce":2381008739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6819","nonce":2381008739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6825","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6827","nonce":2381008739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6822","nonce":2381008739}]},"public_addr":"172.21.15.92:6817/2381008739","cluster_addr":"172.21.15.92:6819/2381008739","heartbeat_back_addr":"172.21.15.92:6827/2381008739","heartbeat_front_addr":"172.21.15.92:6822/2381008739","state":["exists","up"]},{"osd":5,"uuid":"56257e7c-31eb-44c5-9ec7-1318a4e0bb35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6801","nonce":2161935604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6803","nonce":2161935604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6807","nonce":2161935604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6805","nonce":2161935604}]},"public_addr":"172.21.15.92:6801/2161935604","cluster_addr":"172.21.15.92:6803/2161935604","heartbeat_back_addr":"172.21.15.92:6807/2161935604","heartbeat_front_addr":"172.21.15.92:6805/2161935604","state":["exists","up"]},{"osd":6,"uuid":"a150d3d8-a0c9-4955-968a-8d98eff4ffb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6809","nonce":3770163493}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6811","nonce":3770163493}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6815","nonce":3770163493}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6813","nonce":3770163493}]},"public_addr":"172.21.15.92:6809/3770163493","cluster_addr":"172.21.15.92:6811/3770163493","heartbeat_back_addr":"172.21.15.92:6815/3770163493","heartbeat_front_addr":"172.21.15.92:6813/3770163493","state":["exists","up"]},{"osd":7,"uuid":"07799c27-54ee-4591-a42d-a978d6b32065","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6821","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6823","nonce":2135777609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6826","nonce":2135777609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6831","nonce":2135777609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6829","nonce":2135777609}]},"public_addr":"172.21.15.92:6823/2135777609","cluster_addr":"172.21.15.92:6826/2135777609","heartbeat_back_addr":"172.21.15.92:6831/2135777609","heartbeat_front_addr":"172.21.15.92:6829/2135777609","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.345365+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.378150+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.146566+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.372172+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:30.398421+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.385632+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.465611+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.443583+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-25T14:35:36.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.169+0000 7fa7f2827700 1 -- 172.21.15.72:0/2937461311 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fa7d806ac50 msgr2=0x7fa7d806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:36.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.169+0000 7fa7f2827700 1 --2- 172.21.15.72:0/2937461311 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fa7d806ac50 0x7fa7d806d110 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fa7dc007fd0 tx=0x7fa7dc007dc0 comp rx=0 tx=0).stop 2023-07-25T14:35:36.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.169+0000 7fa7f2827700 1 -- 172.21.15.72:0/2937461311 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa7ec14f810 msgr2=0x7fa7ec0a6520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:36.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.169+0000 7fa7f2827700 1 --2- 172.21.15.72:0/2937461311 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa7ec14f810 0x7fa7ec0a6520 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa7e400cbc0 tx=0x7fa7e400ced0 comp rx=0 tx=0).stop 2023-07-25T14:35:36.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.169+0000 7fa7f2827700 1 -- 172.21.15.72:0/2937461311 shutdown_connections 2023-07-25T14:35:36.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.169+0000 7fa7f2827700 1 --2- 172.21.15.72:0/2937461311 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fa7d806ac50 0x7fa7d806d110 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:36.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.169+0000 7fa7f2827700 1 --2- 172.21.15.72:0/2937461311 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa7ec14f810 0x7fa7ec0a6520 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:36.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.169+0000 7fa7f2827700 1 --2- 172.21.15.72:0/2937461311 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa7ec0a9cc0 0x7fa7ec0a8ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:36.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.169+0000 7fa7f2827700 1 --2- 172.21.15.72:0/2937461311 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa7ec0bb0b0 0x7fa7ec0a5fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:36.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.169+0000 7fa7f2827700 1 -- 172.21.15.72:0/2937461311 >> 172.21.15.72:0/2937461311 conn(0x7fa7ec06a8d0 msgr2=0x7fa7ec1525e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:35:36.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.169+0000 7fa7f2827700 1 -- 172.21.15.72:0/2937461311 shutdown_connections 2023-07-25T14:35:36.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.169+0000 7fa7f2827700 1 -- 172.21.15.72:0/2937461311 wait complete. 2023-07-25T14:35:36.196 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-07-25T14:35:32.983457+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-07-25T14:35:33.326342+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-25T14:35:36.197 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-25T14:35:36.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.306+0000 7ff404691700 1 Processor -- start 2023-07-25T14:35:36.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.306+0000 7ff404691700 1 -- start start 2023-07-25T14:35:36.326 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.307+0000 7ff404691700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7ff3fc151950 0x7ff3fc06a190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:36.327 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.307+0000 7ff404691700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff3fc0724c0 0x7ff3fc0c34c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:36.327 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.307+0000 7ff404691700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff3fc06a6d0 0x7ff3fc0c3a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:36.327 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.307+0000 7ff404691700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3fc071a60 con 0x7ff3fc0724c0 2023-07-25T14:35:36.327 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.307+0000 7ff404691700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3fc0c2a70 con 0x7ff3fc151950 2023-07-25T14:35:36.328 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.307+0000 7ff404691700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3fc151d30 con 0x7ff3fc06a6d0 2023-07-25T14:35:36.328 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.307+0000 7ff401c2c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff3fc0724c0 0x7ff3fc0c34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:36.328 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.307+0000 7ff401c2c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff3fc0724c0 0x7ff3fc0c34c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:39298/0 (socket says 172.21.15.72:39298) 2023-07-25T14:35:36.328 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.307+0000 7ff401c2c700 1 -- 172.21.15.72:0/2485627428 learned_addr learned my addr 172.21.15.72:0/2485627428 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:35:36.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.308+0000 7ff402c2e700 1 --2- 172.21.15.72:0/2485627428 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff3fc06a6d0 0x7ff3fc0c3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:36.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.308+0000 7ff40242d700 1 --2- 172.21.15.72:0/2485627428 >> v2:172.21.15.92:3300/0 conn(0x7ff3fc151950 0x7ff3fc06a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:36.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.308+0000 7ff401c2c700 1 -- 172.21.15.72:0/2485627428 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff3fc06a6d0 msgr2=0x7ff3fc0c3a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:35:36.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.308+0000 7ff401c2c700 1 --2- 172.21.15.72:0/2485627428 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff3fc06a6d0 0x7ff3fc0c3a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:36.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.308+0000 7ff401c2c700 1 -- 172.21.15.72:0/2485627428 >> v2:172.21.15.92:3300/0 conn(0x7ff3fc151950 msgr2=0x7ff3fc06a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:35:36.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.308+0000 7ff401c2c700 1 --2- 172.21.15.72:0/2485627428 >> v2:172.21.15.92:3300/0 conn(0x7ff3fc151950 0x7ff3fc06a190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:36.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.308+0000 7ff401c2c700 1 -- 172.21.15.72:0/2485627428 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3fc0c2fe0 con 0x7ff3fc0724c0 2023-07-25T14:35:36.331 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.308+0000 7ff40242d700 1 --2- 172.21.15.72:0/2485627428 >> v2:172.21.15.92:3300/0 conn(0x7ff3fc151950 0x7ff3fc06a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-25T14:35:36.331 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.308+0000 7ff401c2c700 1 --2- 172.21.15.72:0/2485627428 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff3fc0724c0 0x7ff3fc0c34c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff3fc06ad50 tx=0x7ff3f8009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f3d954dab3484a8 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:35:36.331 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.308+0000 7ff40142b700 1 -- 172.21.15.72:0/2485627428 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3f800b870 con 0x7ff3fc0724c0 2023-07-25T14:35:36.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.308+0000 7ff40142b700 1 -- 172.21.15.72:0/2485627428 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3f800b9d0 con 0x7ff3fc0724c0 2023-07-25T14:35:36.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.308+0000 7ff40142b700 1 -- 172.21.15.72:0/2485627428 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3f800bd60 con 0x7ff3fc0724c0 2023-07-25T14:35:36.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.309+0000 7ff404691700 1 -- 172.21.15.72:0/2485627428 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff3fc0724c0 msgr2=0x7ff3fc0c34c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:36.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.309+0000 7ff404691700 1 --2- 172.21.15.72:0/2485627428 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff3fc0724c0 0x7ff3fc0c34c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff3fc06ad50 tx=0x7ff3f8009bd0 comp rx=0 tx=0).stop 2023-07-25T14:35:36.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.309+0000 7ff404691700 1 -- 172.21.15.72:0/2485627428 shutdown_connections 2023-07-25T14:35:36.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.309+0000 7ff404691700 1 --2- 172.21.15.72:0/2485627428 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff3fc06a6d0 0x7ff3fc0c3a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:36.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.309+0000 7ff404691700 1 --2- 172.21.15.72:0/2485627428 >> v2:172.21.15.92:3300/0 conn(0x7ff3fc151950 0x7ff3fc06a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:36.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.309+0000 7ff404691700 1 --2- 172.21.15.72:0/2485627428 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff3fc0724c0 0x7ff3fc0c34c0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:36.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.309+0000 7ff404691700 1 -- 172.21.15.72:0/2485627428 >> 172.21.15.72:0/2485627428 conn(0x7ff3fc0a87e0 msgr2=0x7ff3fc0a8bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:35:36.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.309+0000 7ff404691700 1 -- 172.21.15.72:0/2485627428 shutdown_connections 2023-07-25T14:35:36.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.309+0000 7ff404691700 1 -- 172.21.15.72:0/2485627428 wait complete. 2023-07-25T14:35:36.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.310+0000 7ff404691700 1 Processor -- start 2023-07-25T14:35:36.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.310+0000 7ff404691700 1 -- start start 2023-07-25T14:35:36.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.310+0000 7ff404691700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff3fc06a6d0 0x7ff3fc0ab900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:36.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.310+0000 7ff404691700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff3fc0724c0 0x7ff3fc0abe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:36.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.310+0000 7ff404691700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff3fc151950 0x7ff3fc0bdc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:36.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.310+0000 7ff404691700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3fc0aafa0 con 0x7ff3fc151950 2023-07-25T14:35:36.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.311+0000 7ff404691700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3fc0aa0d0 con 0x7ff3fc06a6d0 2023-07-25T14:35:36.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.311+0000 7ff404691700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3fc0aa320 con 0x7ff3fc0724c0 2023-07-25T14:35:36.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.311+0000 7ff402c2e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff3fc151950 0x7ff3fc0bdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:36.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.311+0000 7ff402c2e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff3fc151950 0x7ff3fc0bdc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:39306/0 (socket says 172.21.15.72:39306) 2023-07-25T14:35:36.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.311+0000 7ff402c2e700 1 -- 172.21.15.72:0/647497463 learned_addr learned my addr 172.21.15.72:0/647497463 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:35:36.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.311+0000 7ff40242d700 1 --2- 172.21.15.72:0/647497463 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff3fc06a6d0 0x7ff3fc0ab900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:36.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.311+0000 7ff401c2c700 1 --2- 172.21.15.72:0/647497463 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff3fc0724c0 0x7ff3fc0abe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:36.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.311+0000 7ff402c2e700 1 -- 172.21.15.72:0/647497463 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff3fc0724c0 msgr2=0x7ff3fc0abe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:36.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.311+0000 7ff402c2e700 1 --2- 172.21.15.72:0/647497463 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff3fc0724c0 0x7ff3fc0abe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:36.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.311+0000 7ff402c2e700 1 -- 172.21.15.72:0/647497463 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff3fc06a6d0 msgr2=0x7ff3fc0ab900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:36.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.311+0000 7ff402c2e700 1 --2- 172.21.15.72:0/647497463 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff3fc06a6d0 0x7ff3fc0ab900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:36.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.311+0000 7ff402c2e700 1 -- 172.21.15.72:0/647497463 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3f8009550 con 0x7ff3fc151950 2023-07-25T14:35:36.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.311+0000 7ff402c2e700 1 --2- 172.21.15.72:0/647497463 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff3fc151950 0x7ff3fc0bdc00 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff3f4007e60 tx=0x7ff3f400e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:35:36.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.311+0000 7ff3f2ffd700 1 -- 172.21.15.72:0/647497463 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3f400ed30 con 0x7ff3fc151950 2023-07-25T14:35:36.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.311+0000 7ff3f2ffd700 1 -- 172.21.15.72:0/647497463 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3f4014420 con 0x7ff3fc151950 2023-07-25T14:35:36.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.311+0000 7ff404691700 1 -- 172.21.15.72:0/647497463 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3fc0aa600 con 0x7ff3fc151950 2023-07-25T14:35:36.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.311+0000 7ff3f2ffd700 1 -- 172.21.15.72:0/647497463 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3f40147d0 con 0x7ff3fc151950 2023-07-25T14:35:36.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.311+0000 7ff404691700 1 -- 172.21.15.72:0/647497463 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3fc0aabc0 con 0x7ff3fc151950 2023-07-25T14:35:36.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.312+0000 7ff404691700 1 -- 172.21.15.72:0/647497463 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3fc04e470 con 0x7ff3fc151950 2023-07-25T14:35:36.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.313+0000 7ff3f2ffd700 1 -- 172.21.15.72:0/647497463 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff3f4014930 con 0x7ff3fc151950 2023-07-25T14:35:36.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.313+0000 7ff3f2ffd700 1 --2- 172.21.15.72:0/647497463 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7ff3e006ad10 0x7ff3e006d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:36.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.313+0000 7ff3f2ffd700 1 -- 172.21.15.72:0/647497463 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5210+0+0 (secure 0 0 0) 0x7ff3f4089600 con 0x7ff3fc151950 2023-07-25T14:35:36.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.313+0000 7ff40242d700 1 --2- 172.21.15.72:0/647497463 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7ff3e006ad10 0x7ff3e006d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:36.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.313+0000 7ff40242d700 1 --2- 172.21.15.72:0/647497463 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7ff3e006ad10 0x7ff3e006d1d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7ff3fc14f670 tx=0x7ff3ec008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:35:36.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.317+0000 7ff3f2ffd700 1 -- 172.21.15.72:0/647497463 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7ff3f4054a90 con 0x7ff3fc151950 2023-07-25T14:35:36.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.505+0000 7ff404691700 1 -- 172.21.15.72:0/647497463 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7ff3fc0722a0 con 0x7ff3fc151950 2023-07-25T14:35:36.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.505+0000 7ff3f2ffd700 1 -- 172.21.15.72:0/647497463 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v17) v1 ==== 92+0+10 (secure 0 0 0) 0x7ff3f40580b0 con 0x7ff3fc151950 2023-07-25T14:35:36.518 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 8 2023-07-25T14:35:36.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.507+0000 7ff404691700 1 -- 172.21.15.72:0/647497463 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7ff3e006ad10 msgr2=0x7ff3e006d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:36.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.507+0000 7ff404691700 1 --2- 172.21.15.72:0/647497463 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7ff3e006ad10 0x7ff3e006d1d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7ff3fc14f670 tx=0x7ff3ec008040 comp rx=0 tx=0).stop 2023-07-25T14:35:36.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.507+0000 7ff404691700 1 -- 172.21.15.72:0/647497463 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff3fc151950 msgr2=0x7ff3fc0bdc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:36.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.507+0000 7ff404691700 1 --2- 172.21.15.72:0/647497463 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff3fc151950 0x7ff3fc0bdc00 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff3f4007e60 tx=0x7ff3f400e3c0 comp rx=0 tx=0).stop 2023-07-25T14:35:36.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.507+0000 7ff404691700 1 -- 172.21.15.72:0/647497463 shutdown_connections 2023-07-25T14:35:36.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.507+0000 7ff404691700 1 --2- 172.21.15.72:0/647497463 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7ff3e006ad10 0x7ff3e006d1d0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:36.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.507+0000 7ff404691700 1 --2- 172.21.15.72:0/647497463 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff3fc151950 0x7ff3fc0bdc00 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:36.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.507+0000 7ff404691700 1 --2- 172.21.15.72:0/647497463 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff3fc06a6d0 0x7ff3fc0ab900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:36.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.507+0000 7ff404691700 1 --2- 172.21.15.72:0/647497463 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff3fc0724c0 0x7ff3fc0abe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:36.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.507+0000 7ff404691700 1 -- 172.21.15.72:0/647497463 >> 172.21.15.72:0/647497463 conn(0x7ff3fc0a87e0 msgr2=0x7ff3fc0c54e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:35:36.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.507+0000 7ff404691700 1 -- 172.21.15.72:0/647497463 shutdown_connections 2023-07-25T14:35:36.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.507+0000 7ff404691700 1 -- 172.21.15.72:0/647497463 wait complete. 2023-07-25T14:35:36.532 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-25T14:35:36.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.644+0000 7fcf06ddf700 1 Processor -- start 2023-07-25T14:35:36.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.644+0000 7fcf06ddf700 1 -- start start 2023-07-25T14:35:36.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.645+0000 7fcf06ddf700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fcf00072300 0x7fcf0006a190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:36.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.645+0000 7fcf06ddf700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fcf00151200 0x7fcf0014dea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:36.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.645+0000 7fcf06ddf700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fcf00065e30 0x7fcf000a86c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:36.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.645+0000 7fcf06ddf700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf000c18d0 con 0x7fcf00065e30 2023-07-25T14:35:36.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.645+0000 7fcf06ddf700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf0006ea10 con 0x7fcf00151200 2023-07-25T14:35:36.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.645+0000 7fcf06ddf700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf000a8230 con 0x7fcf00072300 2023-07-25T14:35:36.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.645+0000 7fcf0537c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fcf00065e30 0x7fcf000a86c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:36.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.645+0000 7fcf0537c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fcf00065e30 0x7fcf000a86c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:39316/0 (socket says 172.21.15.72:39316) 2023-07-25T14:35:36.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.645+0000 7fcf0537c700 1 -- 172.21.15.72:0/1113783497 learned_addr learned my addr 172.21.15.72:0/1113783497 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:35:36.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.645+0000 7fcf04b7b700 1 --2- 172.21.15.72:0/1113783497 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fcf00072300 0x7fcf0006a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:36.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.645+0000 7fcefffff700 1 --2- 172.21.15.72:0/1113783497 >> v2:172.21.15.92:3300/0 conn(0x7fcf00151200 0x7fcf0014dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:36.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.645+0000 7fcf0537c700 1 -- 172.21.15.72:0/1113783497 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fcf00072300 msgr2=0x7fcf0006a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:35:36.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.645+0000 7fcf0537c700 1 --2- 172.21.15.72:0/1113783497 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fcf00072300 0x7fcf0006a190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:36.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.645+0000 7fcf0537c700 1 -- 172.21.15.72:0/1113783497 >> v2:172.21.15.92:3300/0 conn(0x7fcf00151200 msgr2=0x7fcf0014dea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:35:36.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.645+0000 7fcf0537c700 1 --2- 172.21.15.72:0/1113783497 >> v2:172.21.15.92:3300/0 conn(0x7fcf00151200 0x7fcf0014dea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:36.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.645+0000 7fcf0537c700 1 -- 172.21.15.72:0/1113783497 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf000a7c20 con 0x7fcf00065e30 2023-07-25T14:35:36.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.645+0000 7fcf04b7b700 1 --2- 172.21.15.72:0/1113783497 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fcf00072300 0x7fcf0006a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-25T14:35:36.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.645+0000 7fcefffff700 1 --2- 172.21.15.72:0/1113783497 >> v2:172.21.15.92:3300/0 conn(0x7fcf00151200 0x7fcf0014dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-25T14:35:36.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.646+0000 7fcf0537c700 1 --2- 172.21.15.72:0/1113783497 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcf00065e30 0x7fcf000a86c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fcf0006f160 tx=0x7fcef800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df842bc93ea0ff8 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:35:36.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.646+0000 7fceff7fe700 1 -- 172.21.15.72:0/1113783497 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcef800e070 con 0x7fcf00065e30 2023-07-25T14:35:36.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.646+0000 7fceff7fe700 1 -- 172.21.15.72:0/1113783497 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcef800b9c0 con 0x7fcf00065e30 2023-07-25T14:35:36.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.646+0000 7fceff7fe700 1 -- 172.21.15.72:0/1113783497 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcef800bd70 con 0x7fcf00065e30 2023-07-25T14:35:36.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.646+0000 7fcf06ddf700 1 -- 172.21.15.72:0/1113783497 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcf00065e30 msgr2=0x7fcf000a86c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:36.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.646+0000 7fcf06ddf700 1 --2- 172.21.15.72:0/1113783497 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcf00065e30 0x7fcf000a86c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fcf0006f160 tx=0x7fcef800b330 comp rx=0 tx=0).stop 2023-07-25T14:35:36.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.646+0000 7fcf06ddf700 1 -- 172.21.15.72:0/1113783497 shutdown_connections 2023-07-25T14:35:36.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.646+0000 7fcf06ddf700 1 --2- 172.21.15.72:0/1113783497 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcf00065e30 0x7fcf000a86c0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:36.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.646+0000 7fcf06ddf700 1 --2- 172.21.15.72:0/1113783497 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fcf00072300 0x7fcf0006a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:36.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.646+0000 7fcf06ddf700 1 --2- 172.21.15.72:0/1113783497 >> v2:172.21.15.92:3300/0 conn(0x7fcf00151200 0x7fcf0014dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:36.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.646+0000 7fcf06ddf700 1 -- 172.21.15.72:0/1113783497 >> 172.21.15.72:0/1113783497 conn(0x7fcf0006def0 msgr2=0x7fcf0006e300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:35:36.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.646+0000 7fcf06ddf700 1 -- 172.21.15.72:0/1113783497 shutdown_connections 2023-07-25T14:35:36.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.646+0000 7fcf06ddf700 1 -- 172.21.15.72:0/1113783497 wait complete. 2023-07-25T14:35:36.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.648+0000 7fcf06ddf700 1 Processor -- start 2023-07-25T14:35:36.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.648+0000 7fcf06ddf700 1 -- start start 2023-07-25T14:35:36.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.649+0000 7fcf06ddf700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fcf00065e30 0x7fcf000c40d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:36.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.649+0000 7fcf06ddf700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcf00072300 0x7fcf001e9b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:36.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.649+0000 7fcf06ddf700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcf00151200 0x7fcf001ea090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:36.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.649+0000 7fcf06ddf700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf00143390 con 0x7fcf00151200 2023-07-25T14:35:36.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.649+0000 7fcf06ddf700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf000c5960 con 0x7fcf00072300 2023-07-25T14:35:36.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.649+0000 7fcf06ddf700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf001ea6d0 con 0x7fcf00065e30 2023-07-25T14:35:36.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.649+0000 7fcf0537c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcf00151200 0x7fcf001ea090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:36.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.649+0000 7fcf0537c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcf00151200 0x7fcf001ea090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:39322/0 (socket says 172.21.15.72:39322) 2023-07-25T14:35:36.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.649+0000 7fcf0537c700 1 -- 172.21.15.72:0/3280756551 learned_addr learned my addr 172.21.15.72:0/3280756551 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:35:36.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.649+0000 7fcf0537c700 1 -- 172.21.15.72:0/3280756551 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fcf00065e30 msgr2=0x7fcf000c40d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:36.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.649+0000 7fcefffff700 1 --2- 172.21.15.72:0/3280756551 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcf00072300 0x7fcf001e9b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:36.679 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.649+0000 7fcf04b7b700 1 --2- 172.21.15.72:0/3280756551 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fcf00065e30 0x7fcf000c40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:36.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.649+0000 7fcf0537c700 1 --2- 172.21.15.72:0/3280756551 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fcf00065e30 0x7fcf000c40d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:36.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.649+0000 7fcf0537c700 1 -- 172.21.15.72:0/3280756551 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcf00072300 msgr2=0x7fcf001e9b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:36.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.649+0000 7fcf0537c700 1 --2- 172.21.15.72:0/3280756551 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcf00072300 0x7fcf001e9b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:36.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.649+0000 7fcf0537c700 1 -- 172.21.15.72:0/3280756551 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcef8009b30 con 0x7fcf00151200 2023-07-25T14:35:36.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.649+0000 7fcefffff700 1 --2- 172.21.15.72:0/3280756551 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcf00072300 0x7fcf001e9b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-25T14:35:36.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.649+0000 7fcf0537c700 1 --2- 172.21.15.72:0/3280756551 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcf00151200 0x7fcf001ea090 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fcef800b370 tx=0x7fcef8004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:35:36.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.649+0000 7fcefd7fa700 1 -- 172.21.15.72:0/3280756551 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcef8014ad0 con 0x7fcf00151200 2023-07-25T14:35:36.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.650+0000 7fcefd7fa700 1 -- 172.21.15.72:0/3280756551 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcef8014c30 con 0x7fcf00151200 2023-07-25T14:35:36.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.650+0000 7fcf06ddf700 1 -- 172.21.15.72:0/3280756551 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf000c5c20 con 0x7fcf00151200 2023-07-25T14:35:36.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.650+0000 7fcefd7fa700 1 -- 172.21.15.72:0/3280756551 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcef8004040 con 0x7fcf00151200 2023-07-25T14:35:36.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.650+0000 7fcf06ddf700 1 -- 172.21.15.72:0/3280756551 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf001428c0 con 0x7fcf00151200 2023-07-25T14:35:36.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.650+0000 7fcf06ddf700 1 -- 172.21.15.72:0/3280756551 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf00143540 con 0x7fcf00151200 2023-07-25T14:35:36.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.651+0000 7fcefd7fa700 1 -- 172.21.15.72:0/3280756551 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fcef80041a0 con 0x7fcf00151200 2023-07-25T14:35:36.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.651+0000 7fcefd7fa700 1 --2- 172.21.15.72:0/3280756551 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fcee406ace0 0x7fcee406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:36.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.651+0000 7fcefd7fa700 1 -- 172.21.15.72:0/3280756551 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fcef808cee0 con 0x7fcf00151200 2023-07-25T14:35:36.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.651+0000 7fcf04b7b700 1 --2- 172.21.15.72:0/3280756551 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fcee406ace0 0x7fcee406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:36.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.652+0000 7fcf04b7b700 1 --2- 172.21.15.72:0/3280756551 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fcee406ace0 0x7fcee406d1a0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fcef4008870 tx=0x7fcef4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:35:36.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.656+0000 7fcefd7fa700 1 -- 172.21.15.72:0/3280756551 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fcef8058370 con 0x7fcf00151200 2023-07-25T14:35:36.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.840+0000 7fcf06ddf700 1 -- 172.21.15.72:0/3280756551 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fcf00074270 con 0x7fcf00151200 2023-07-25T14:35:36.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.841+0000 7fcefd7fa700 1 -- 172.21.15.72:0/3280756551 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) v1 ==== 93+0+10 (secure 0 0 0) 0x7fcef8020020 con 0x7fcf00151200 2023-07-25T14:35:36.854 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 1 2023-07-25T14:35:36.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.843+0000 7fcf06ddf700 1 -- 172.21.15.72:0/3280756551 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fcee406ace0 msgr2=0x7fcee406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:36.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.843+0000 7fcf06ddf700 1 --2- 172.21.15.72:0/3280756551 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fcee406ace0 0x7fcee406d1a0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fcef4008870 tx=0x7fcef4008040 comp rx=0 tx=0).stop 2023-07-25T14:35:36.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.843+0000 7fcf06ddf700 1 -- 172.21.15.72:0/3280756551 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcf00151200 msgr2=0x7fcf001ea090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:36.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.843+0000 7fcf06ddf700 1 --2- 172.21.15.72:0/3280756551 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcf00151200 0x7fcf001ea090 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fcef800b370 tx=0x7fcef8004ad0 comp rx=0 tx=0).stop 2023-07-25T14:35:36.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.843+0000 7fcf06ddf700 1 -- 172.21.15.72:0/3280756551 shutdown_connections 2023-07-25T14:35:36.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.843+0000 7fcf06ddf700 1 --2- 172.21.15.72:0/3280756551 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fcee406ace0 0x7fcee406d1a0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:36.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.843+0000 7fcf06ddf700 1 --2- 172.21.15.72:0/3280756551 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fcf00065e30 0x7fcf000c40d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:36.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.843+0000 7fcf06ddf700 1 --2- 172.21.15.72:0/3280756551 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcf00151200 0x7fcf001ea090 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:36.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.843+0000 7fcf06ddf700 1 --2- 172.21.15.72:0/3280756551 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcf00072300 0x7fcf001e9b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:36.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.843+0000 7fcf06ddf700 1 -- 172.21.15.72:0/3280756551 >> 172.21.15.72:0/3280756551 conn(0x7fcf0006def0 msgr2=0x7fcf0006e2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:35:36.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.843+0000 7fcf06ddf700 1 -- 172.21.15.72:0/3280756551 shutdown_connections 2023-07-25T14:35:36.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.843+0000 7fcf06ddf700 1 -- 172.21.15.72:0/3280756551 wait complete. 2023-07-25T14:35:36.869 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-07-25T14:35:36.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.976+0000 7f0deb833700 1 Processor -- start 2023-07-25T14:35:36.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.976+0000 7f0deb833700 1 -- start start 2023-07-25T14:35:36.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.977+0000 7f0deb833700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0de4151ba0 0x7f0de40c2230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:36.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.977+0000 7f0deb833700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0de40c5f40 0x7f0de4154640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:36.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.977+0000 7f0deb833700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0de40c54f0 con 0x7f0de40ba0e0 2023-07-25T14:35:36.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.977+0000 7f0deb833700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0de40c6670 con 0x7f0de40c5f40 2023-07-25T14:35:36.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.977+0000 7f0deb833700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0de40c5740 con 0x7f0de4151ba0 2023-07-25T14:35:36.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.977+0000 7f0de8dce700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0de40c5f40 0x7f0de4154640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:36.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.977+0000 7f0de8dce700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0de40c5f40 0x7f0de4154640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:39326/0 (socket says 172.21.15.72:39326) 2023-07-25T14:35:36.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.977+0000 7f0de8dce700 1 -- 172.21.15.72:0/4288651949 learned_addr learned my addr 172.21.15.72:0/4288651949 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:35:36.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.977+0000 7f0de95cf700 1 --2- 172.21.15.72:0/4288651949 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0de4151ba0 0x7f0de40c2230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:36.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.977+0000 7f0de8dce700 1 -- 172.21.15.72:0/4288651949 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0de4151ba0 msgr2=0x7f0de40c2230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:35:36.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.977+0000 7f0de8dce700 1 --2- 172.21.15.72:0/4288651949 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0de4151ba0 0x7f0de40c2230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:36.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.977+0000 7f0de8dce700 1 -- 172.21.15.72:0/4288651949 >> v1:172.21.15.92:6789/0 conn(0x7f0de40ba0e0 legacy=0x7f0de4071740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:35:36.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.977+0000 7f0de8dce700 1 -- 172.21.15.72:0/4288651949 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0de40c5a20 con 0x7f0de40c5f40 2023-07-25T14:35:36.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.977+0000 7f0de8dce700 1 --2- 172.21.15.72:0/4288651949 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0de40c5f40 0x7f0de4154640 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f0de00098f0 tx=0x7f0de0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b6d1ae1824cf088 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:35:36.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.978+0000 7f0ddbfff700 1 -- 172.21.15.72:0/4288651949 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0de000b8a0 con 0x7f0de40c5f40 2023-07-25T14:35:36.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.978+0000 7f0ddbfff700 1 -- 172.21.15.72:0/4288651949 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0de000ba00 con 0x7f0de40c5f40 2023-07-25T14:35:36.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.978+0000 7f0ddbfff700 1 -- 172.21.15.72:0/4288651949 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0de000bd90 con 0x7f0de40c5f40 2023-07-25T14:35:36.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.978+0000 7f0deb833700 1 -- 172.21.15.72:0/4288651949 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0de40c5f40 msgr2=0x7f0de4154640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:36.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.978+0000 7f0deb833700 1 --2- 172.21.15.72:0/4288651949 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0de40c5f40 0x7f0de4154640 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f0de00098f0 tx=0x7f0de0009c00 comp rx=0 tx=0).stop 2023-07-25T14:35:36.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.978+0000 7f0deb833700 1 -- 172.21.15.72:0/4288651949 shutdown_connections 2023-07-25T14:35:36.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.978+0000 7f0deb833700 1 --2- 172.21.15.72:0/4288651949 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0de4151ba0 0x7f0de40c2230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:36.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.978+0000 7f0deb833700 1 --2- 172.21.15.72:0/4288651949 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0de40c5f40 0x7f0de4154640 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:36.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.978+0000 7f0deb833700 1 -- 172.21.15.72:0/4288651949 >> 172.21.15.72:0/4288651949 conn(0x7f0de40a87e0 msgr2=0x7f0de40a8bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:35:36.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.978+0000 7f0deb833700 1 -- 172.21.15.72:0/4288651949 shutdown_connections 2023-07-25T14:35:36.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.978+0000 7f0deb833700 1 -- 172.21.15.72:0/4288651949 wait complete. 2023-07-25T14:35:36.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.979+0000 7f0deb833700 1 Processor -- start 2023-07-25T14:35:36.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.979+0000 7f0deb833700 1 -- start start 2023-07-25T14:35:36.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.980+0000 7f0deb833700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0de40ba0e0 0x7f0de40ac0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:36.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.980+0000 7f0deb833700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0de40c5f40 0x7f0de40ac620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:36.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.980+0000 7f0deb833700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0de4151ba0 0x7f0de414bc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:36.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.980+0000 7f0deb833700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0de41e8830 con 0x7f0de40ba0e0 2023-07-25T14:35:36.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.980+0000 7f0deb833700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0de41e8a80 con 0x7f0de40c5f40 2023-07-25T14:35:36.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.980+0000 7f0deb833700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0de41e8d60 con 0x7f0de4151ba0 2023-07-25T14:35:36.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.980+0000 7f0de95cf700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0de40ba0e0 0x7f0de40ac0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:36.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.980+0000 7f0de95cf700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0de40ba0e0 0x7f0de40ac0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:39332/0 (socket says 172.21.15.72:39332) 2023-07-25T14:35:36.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.980+0000 7f0de95cf700 1 -- 172.21.15.72:0/3091702663 learned_addr learned my addr 172.21.15.72:0/3091702663 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:35:36.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.980+0000 7f0de9dd0700 1 --2- 172.21.15.72:0/3091702663 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0de4151ba0 0x7f0de414bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:36.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.980+0000 7f0de8dce700 1 --2- 172.21.15.72:0/3091702663 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0de40c5f40 0x7f0de40ac620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:36.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.980+0000 7f0de95cf700 1 -- 172.21.15.72:0/3091702663 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0de4151ba0 msgr2=0x7f0de414bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:36.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.980+0000 7f0de95cf700 1 --2- 172.21.15.72:0/3091702663 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0de4151ba0 0x7f0de414bc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:36.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.980+0000 7f0de95cf700 1 -- 172.21.15.72:0/3091702663 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0de40c5f40 msgr2=0x7f0de40ac620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:36.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.980+0000 7f0de95cf700 1 --2- 172.21.15.72:0/3091702663 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0de40c5f40 0x7f0de40ac620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:36.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.980+0000 7f0de95cf700 1 -- 172.21.15.72:0/3091702663 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0de0009550 con 0x7f0de40ba0e0 2023-07-25T14:35:36.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.981+0000 7f0de95cf700 1 --2- 172.21.15.72:0/3091702663 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0de40ba0e0 0x7f0de40ac0e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f0dd400d800 tx=0x7f0dd400db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:35:36.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.981+0000 7f0dd9ffb700 1 -- 172.21.15.72:0/3091702663 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dd40125f0 con 0x7f0de40ba0e0 2023-07-25T14:35:36.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.981+0000 7f0dd9ffb700 1 -- 172.21.15.72:0/3091702663 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dd4012750 con 0x7f0de40ba0e0 2023-07-25T14:35:36.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.981+0000 7f0deb833700 1 -- 172.21.15.72:0/3091702663 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0de41e9040 con 0x7f0de40ba0e0 2023-07-25T14:35:36.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.981+0000 7f0dd9ffb700 1 -- 172.21.15.72:0/3091702663 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dd4012b00 con 0x7f0de40ba0e0 2023-07-25T14:35:37.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.981+0000 7f0deb833700 1 -- 172.21.15.72:0/3091702663 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0de40ab6e0 con 0x7f0de40ba0e0 2023-07-25T14:35:37.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.982+0000 7f0deb833700 1 -- 172.21.15.72:0/3091702663 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0de41e9560 con 0x7f0de40ba0e0 2023-07-25T14:35:37.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.982+0000 7f0dd9ffb700 1 -- 172.21.15.72:0/3091702663 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0dd4012c60 con 0x7f0de40ba0e0 2023-07-25T14:35:37.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.982+0000 7f0dd9ffb700 1 --2- 172.21.15.72:0/3091702663 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f0dc806ad10 0x7f0dc806d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:37.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.982+0000 7f0de8dce700 1 --2- 172.21.15.72:0/3091702663 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f0dc806ad10 0x7f0dc806d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:37.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.982+0000 7f0dd9ffb700 1 -- 172.21.15.72:0/3091702663 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f0dd4089170 con 0x7f0de40ba0e0 2023-07-25T14:35:37.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.983+0000 7f0de8dce700 1 --2- 172.21.15.72:0/3091702663 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f0dc806ad10 0x7f0dc806d1d0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f0de40c6320 tx=0x7f0de0008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:35:37.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:36.987+0000 7f0dd9ffb700 1 -- 172.21.15.72:0/3091702663 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f0de41e9560 con 0x7f0de40ba0e0 2023-07-25T14:35:37.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:37.174+0000 7f0deb833700 1 -- 172.21.15.72:0/3091702663 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f0de41e9560 con 0x7f0de40ba0e0 2023-07-25T14:35:37.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:37.175+0000 7f0dd9ffb700 1 -- 172.21.15.72:0/3091702663 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v17) v1 ==== 84+0+126 (secure 0 0 0) 0x7f0de41e9560 con 0x7f0de40ba0e0 2023-07-25T14:35:37.188 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-25T14:35:37.188 INFO:teuthology.orchestra.run.smithi072.stdout:[ 2023-07-25T14:35:37.188 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-07-25T14:35:37.189 INFO:teuthology.orchestra.run.smithi072.stdout: "poolnum": 1, 2023-07-25T14:35:37.189 INFO:teuthology.orchestra.run.smithi072.stdout: "poolname": "rbd" 2023-07-25T14:35:37.189 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-07-25T14:35:37.189 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-07-25T14:35:37.189 INFO:teuthology.orchestra.run.smithi072.stdout: "poolnum": 2, 2023-07-25T14:35:37.189 INFO:teuthology.orchestra.run.smithi072.stdout: "poolname": ".mgr" 2023-07-25T14:35:37.189 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-07-25T14:35:37.189 INFO:teuthology.orchestra.run.smithi072.stdout:] 2023-07-25T14:35:37.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:37.177+0000 7f0deb833700 1 -- 172.21.15.72:0/3091702663 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f0dc806ad10 msgr2=0x7f0dc806d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:37.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:37.177+0000 7f0deb833700 1 --2- 172.21.15.72:0/3091702663 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f0dc806ad10 0x7f0dc806d1d0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f0de40c6320 tx=0x7f0de0008030 comp rx=0 tx=0).stop 2023-07-25T14:35:37.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:37.177+0000 7f0deb833700 1 -- 172.21.15.72:0/3091702663 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0de40ba0e0 msgr2=0x7f0de40ac0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:37.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:37.177+0000 7f0deb833700 1 --2- 172.21.15.72:0/3091702663 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0de40ba0e0 0x7f0de40ac0e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f0dd400d800 tx=0x7f0dd400db10 comp rx=0 tx=0).stop 2023-07-25T14:35:37.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:37.177+0000 7f0deb833700 1 -- 172.21.15.72:0/3091702663 shutdown_connections 2023-07-25T14:35:37.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:37.177+0000 7f0deb833700 1 --2- 172.21.15.72:0/3091702663 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f0dc806ad10 0x7f0dc806d1d0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:37.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:37.177+0000 7f0deb833700 1 --2- 172.21.15.72:0/3091702663 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0de4151ba0 0x7f0de414bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:37.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:37.177+0000 7f0deb833700 1 --2- 172.21.15.72:0/3091702663 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0de40ba0e0 0x7f0de40ac0e0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:37.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:37.177+0000 7f0deb833700 1 --2- 172.21.15.72:0/3091702663 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0de40c5f40 0x7f0de40ac620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:37.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:37.177+0000 7f0deb833700 1 -- 172.21.15.72:0/3091702663 >> 172.21.15.72:0/3091702663 conn(0x7f0de40a87e0 msgr2=0x7f0de406a190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:35:37.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:37.177+0000 7f0deb833700 1 -- 172.21.15.72:0/3091702663 shutdown_connections 2023-07-25T14:35:37.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:37.177+0000 7f0deb833700 1 -- 172.21.15.72:0/3091702663 wait complete. 2023-07-25T14:35:37.202 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-07-25T14:35:37.202 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-07-25T14:35:37.326 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:37.314+0000 7f9462b26700 1 Processor -- start 2023-07-25T14:35:37.327 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:37.314+0000 7f9462b26700 1 -- start start 2023-07-25T14:35:37.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:37.315+0000 7f9462b26700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f945c0c5b90 0x7f945c0c6d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:37.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:37.315+0000 7f9462b26700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f945c0c5f70 0x7f945c154c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:37.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:37.315+0000 7f9462b26700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f945c0c5250 con 0x7f945c0c49d0 2023-07-25T14:35:37.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:37.315+0000 7f9462b26700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f945c0c5530 con 0x7f945c0c5f70 2023-07-25T14:35:37.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:37.315+0000 7f9462b26700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f945c0c6520 con 0x7f945c0c5b90 2023-07-25T14:35:37.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:37.315+0000 7f945bfff700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f945c0c49d0 0x7f945c06db00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:58306/0 (socket says 172.21.15.72:58306) 2023-07-25T14:35:37.331 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:37.315+0000 7f945bfff700 1 -- 172.21.15.72:0/2593986418 learned_addr learned my addr 172.21.15.72:0/2593986418 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:35:37.331 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:37.315+0000 7f945b7fe700 1 -- 172.21.15.72:0/2593986418 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3391242910 0 0) 0x7f945c0c5250 con 0x7f945c0c49d0 2023-07-25T14:35:37.331 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:37.315+0000 7f94610c3700 1 --2- 172.21.15.72:0/2593986418 >> v2:172.21.15.92:3300/0 conn(0x7f945c0c5f70 0x7f945c154c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:37.331 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:37.315+0000 7f94608c2700 1 --2- 172.21.15.72:0/2593986418 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f945c0c5b90 0x7f945c0c6d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:37.331 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:37.315+0000 7f945b7fe700 1 -- 172.21.15.72:0/2593986418 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f94480035b0 con 0x7f945c0c49d0 2023-07-25T14:35:37.331 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:37.316+0000 7f945b7fe700 1 -- 172.21.15.72:0/2593986418 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1274490379 0 0) 0x7f94480035b0 con 0x7f945c0c49d0 2023-07-25T14:35:37.331 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:37.316+0000 7f945b7fe700 1 -- 172.21.15.72:0/2593986418 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f945c0c5b90 msgr2=0x7f945c0c6d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:35:37.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:37.316+0000 7f945b7fe700 1 --2- 172.21.15.72:0/2593986418 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f945c0c5b90 0x7f945c0c6d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:37.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:37.316+0000 7f945b7fe700 1 -- 172.21.15.72:0/2593986418 >> v2:172.21.15.92:3300/0 conn(0x7f945c0c5f70 msgr2=0x7f945c154c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:35:37.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:37.316+0000 7f945b7fe700 1 --2- 172.21.15.72:0/2593986418 >> v2:172.21.15.92:3300/0 conn(0x7f945c0c5f70 0x7f945c154c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:37.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:37.316+0000 7f945b7fe700 1 -- 172.21.15.72:0/2593986418 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f945c0c6800 con 0x7f945c0c49d0 2023-07-25T14:35:37.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:37.316+0000 7f945b7fe700 1 -- 172.21.15.72:0/2593986418 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2559588315 0 0) 0x7f9444001670 con 0x7f945c0c49d0 2023-07-25T14:35:37.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:37.316+0000 7f945b7fe700 1 -- 172.21.15.72:0/2593986418 >> v1:172.21.15.72:6789/0 conn(0x7f945c0c49d0 legacy=0x7f945c06db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:37.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:37.316+0000 7f945b7fe700 1 --2- 172.21.15.72:0/2593986418 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9448003a00 0x7f9448003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:37.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:37.316+0000 7f945b7fe700 1 --2- 172.21.15.72:0/2593986418 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f945c0c5b90 0x7f9448004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:37.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:37.316+0000 7f945b7fe700 1 --2- 172.21.15.72:0/2593986418 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9448004d90 0x7f9448005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:37.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:37.316+0000 7f945b7fe700 1 -- 172.21.15.72:0/2593986418 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f945c0c5530 con 0x7f9448003a00 2023-07-25T14:35:37.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:37.316+0000 7f945b7fe700 1 -- 172.21.15.72:0/2593986418 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f945c0c6520 con 0x7f9448004d90 2023-07-25T14:35:37.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:37.316+0000 7f945b7fe700 1 -- 172.21.15.72:0/2593986418 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94480046b0 con 0x7f945c0c5b90 2023-07-25T14:35:37.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:37.316+0000 7f94608c2700 1 --2- 172.21.15.72:0/2593986418 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9448003a00 0x7f9448003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:37.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:37.316+0000 7f945bfff700 1 --2- 172.21.15.72:0/2593986418 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f945c0c5b90 0x7f9448004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:37.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:37.316+0000 7f94610c3700 1 --2- 172.21.15.72:0/2593986418 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9448004d90 0x7f9448005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:37.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:37.316+0000 7f94608c2700 1 -- 172.21.15.72:0/2593986418 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f945c0c5b90 msgr2=0x7f9448004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:35:37.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:37.316+0000 7f94608c2700 1 --2- 172.21.15.72:0/2593986418 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f945c0c5b90 0x7f9448004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:37.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:37.316+0000 7f94608c2700 1 -- 172.21.15.72:0/2593986418 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9448004d90 msgr2=0x7f9448005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:35:37.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:37.316+0000 7f94608c2700 1 --2- 172.21.15.72:0/2593986418 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9448004d90 0x7f9448005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:37.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:37.316+0000 7f94608c2700 1 -- 172.21.15.72:0/2593986418 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94480035b0 con 0x7f9448003a00 2023-07-25T14:35:37.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:37.316+0000 7f945bfff700 1 --2- 172.21.15.72:0/2593986418 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f945c0c5b90 0x7f9448004850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-25T14:35:37.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:37.316+0000 7f94608c2700 1 --2- 172.21.15.72:0/2593986418 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9448003a00 0x7f9448003de0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f9454009fc0 tx=0x7f9448005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba9561d360404e37 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:35:37.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:37.316+0000 7f945b7fe700 1 -- 172.21.15.72:0/2593986418 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f945400ec30 con 0x7f9448003a00 2023-07-25T14:35:37.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:37.316+0000 7f945b7fe700 1 -- 172.21.15.72:0/2593986418 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f945400f040 con 0x7f9448003a00 2023-07-25T14:35:37.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:37.316+0000 7f945b7fe700 1 -- 172.21.15.72:0/2593986418 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9454014480 con 0x7f9448003a00 2023-07-25T14:35:37.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:37.317+0000 7f9462b26700 1 -- 172.21.15.72:0/2593986418 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9448003a00 msgr2=0x7f9448003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:37.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:37.317+0000 7f9462b26700 1 --2- 172.21.15.72:0/2593986418 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9448003a00 0x7f9448003de0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f9454009fc0 tx=0x7f9448005880 comp rx=0 tx=0).stop 2023-07-25T14:35:37.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:37.317+0000 7f94610c3700 1 -- 172.21.15.72:0/2593986418 reap_dead start 2023-07-25T14:35:37.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:37.317+0000 7f9462b26700 1 -- 172.21.15.72:0/2593986418 shutdown_connections 2023-07-25T14:35:37.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:37.317+0000 7f9462b26700 1 -- 172.21.15.72:0/2593986418 >> 172.21.15.72:0/2593986418 conn(0x7f945c06bbc0 msgr2=0x7f945c0a8590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:35:37.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:37.317+0000 7f9462b26700 1 -- 172.21.15.72:0/2593986418 shutdown_connections 2023-07-25T14:35:37.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:37.317+0000 7f9462b26700 1 -- 172.21.15.72:0/2593986418 wait complete. 2023-07-25T14:35:37.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:37.318+0000 7f9462b26700 1 Processor -- start 2023-07-25T14:35:37.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:37.318+0000 7f9462b26700 1 -- start start 2023-07-25T14:35:37.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:37.319+0000 7f9462b26700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9448003a00 0x7f945c06e600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:37.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:37.319+0000 7f9462b26700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f945c14d4c0 0x7f945c0bfc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:37.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:37.319+0000 7f9462b26700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f945c0c0160 0x7f945c1e7ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:37.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:37.319+0000 7f9462b26700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f945c1eafd0 con 0x7f945c14d4c0 2023-07-25T14:35:37.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:37.319+0000 7f9462b26700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f945c1eb2b0 con 0x7f945c0c0160 2023-07-25T14:35:37.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:37.319+0000 7f9462b26700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f945c1eb590 con 0x7f9448003a00 2023-07-25T14:35:37.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:37.319+0000 7f945bfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f945c14d4c0 0x7f945c0bfc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:37.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:37.319+0000 7f945bfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f945c14d4c0 0x7f945c0bfc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:39352/0 (socket says 172.21.15.72:39352) 2023-07-25T14:35:37.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:37.319+0000 7f945bfff700 1 -- 172.21.15.72:0/113269002 learned_addr learned my addr 172.21.15.72:0/113269002 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:35:37.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:37.319+0000 7f94608c2700 1 --2- 172.21.15.72:0/113269002 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9448003a00 0x7f945c06e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:37.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:37.319+0000 7f94610c3700 1 --2- 172.21.15.72:0/113269002 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f945c0c0160 0x7f945c1e7ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:37.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:37.319+0000 7f945bfff700 1 -- 172.21.15.72:0/113269002 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9448003a00 msgr2=0x7f945c06e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:37.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:37.320+0000 7f945bfff700 1 --2- 172.21.15.72:0/113269002 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9448003a00 0x7f945c06e600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:37.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:37.320+0000 7f945bfff700 1 -- 172.21.15.72:0/113269002 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f945c0c0160 msgr2=0x7f945c1e7ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:37.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:37.320+0000 7f945bfff700 1 --2- 172.21.15.72:0/113269002 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f945c0c0160 0x7f945c1e7ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:37.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:37.320+0000 7f945bfff700 1 -- 172.21.15.72:0/113269002 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f945c1eb870 con 0x7f945c14d4c0 2023-07-25T14:35:37.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:37.320+0000 7f945bfff700 1 --2- 172.21.15.72:0/113269002 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f945c14d4c0 0x7f945c0bfc20 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f9444008310 tx=0x7f9444008620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:35:37.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:37.320+0000 7f94597fa700 1 -- 172.21.15.72:0/113269002 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f944400e840 con 0x7f945c14d4c0 2023-07-25T14:35:37.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:37.320+0000 7f94597fa700 1 -- 172.21.15.72:0/113269002 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f944400e9a0 con 0x7f945c14d4c0 2023-07-25T14:35:37.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:37.320+0000 7f9462b26700 1 -- 172.21.15.72:0/113269002 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f945c1ebb50 con 0x7f945c14d4c0 2023-07-25T14:35:37.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:37.320+0000 7f94597fa700 1 -- 172.21.15.72:0/113269002 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f944400ed10 con 0x7f945c14d4c0 2023-07-25T14:35:37.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:37.320+0000 7f9462b26700 1 -- 172.21.15.72:0/113269002 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f945c0bc110 con 0x7f945c14d4c0 2023-07-25T14:35:37.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:37.321+0000 7f9462b26700 1 -- 172.21.15.72:0/113269002 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f945c0abe00 con 0x7f945c14d4c0 2023-07-25T14:35:37.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:37.321+0000 7f94597fa700 1 -- 172.21.15.72:0/113269002 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f944401d460 con 0x7f945c14d4c0 2023-07-25T14:35:37.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:37.322+0000 7f94597fa700 1 --2- 172.21.15.72:0/113269002 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f943c06ace0 0x7f943c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:37.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:37.322+0000 7f94608c2700 1 --2- 172.21.15.72:0/113269002 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f943c06ace0 0x7f943c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:37.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:37.322+0000 7f94597fa700 1 -- 172.21.15.72:0/113269002 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f94440890e0 con 0x7f945c14d4c0 2023-07-25T14:35:37.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:37.322+0000 7f94608c2700 1 --2- 172.21.15.72:0/113269002 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f943c06ace0 0x7f943c06d1a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f9454000f80 tx=0x7f9454013000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:35:37.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:37.326+0000 7f94597fa700 1 -- 172.21.15.72:0/113269002 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f9444054570 con 0x7f945c14d4c0 2023-07-25T14:35:37.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:37.514+0000 7f9462b26700 1 -- 172.21.15.72:0/113269002 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f945c0c4ea0 con 0x7f945c14d4c0 2023-07-25T14:35:38.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:38.518+0000 7f94597fa700 1 -- 172.21.15.72:0/113269002 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v18) v1 ==== 138+0+0 (secure 0 0 0) 0x7f9444005e60 con 0x7f945c14d4c0 2023-07-25T14:35:38.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:38.525+0000 7f9462b26700 1 -- 172.21.15.72:0/113269002 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f943c06ace0 msgr2=0x7f943c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:38.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:38.525+0000 7f9462b26700 1 --2- 172.21.15.72:0/113269002 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f943c06ace0 0x7f943c06d1a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f9454000f80 tx=0x7f9454013000 comp rx=0 tx=0).stop 2023-07-25T14:35:38.538 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:38.525+0000 7f9462b26700 1 -- 172.21.15.72:0/113269002 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f945c14d4c0 msgr2=0x7f945c0bfc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:38.538 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:38.525+0000 7f9462b26700 1 --2- 172.21.15.72:0/113269002 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f945c14d4c0 0x7f945c0bfc20 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f9444008310 tx=0x7f9444008620 comp rx=0 tx=0).stop 2023-07-25T14:35:38.538 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:38.525+0000 7f9462b26700 1 -- 172.21.15.72:0/113269002 shutdown_connections 2023-07-25T14:35:38.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:38.525+0000 7f9462b26700 1 --2- 172.21.15.72:0/113269002 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f943c06ace0 0x7f943c06d1a0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:38.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:38.525+0000 7f9462b26700 1 --2- 172.21.15.72:0/113269002 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9448003a00 0x7f945c06e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:38.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:38.525+0000 7f9462b26700 1 --2- 172.21.15.72:0/113269002 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f945c0c0160 0x7f945c1e7ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:38.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:38.525+0000 7f9462b26700 1 --2- 172.21.15.72:0/113269002 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f945c14d4c0 0x7f945c0bfc20 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:38.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:38.525+0000 7f9462b26700 1 -- 172.21.15.72:0/113269002 >> 172.21.15.72:0/113269002 conn(0x7f945c06bbc0 msgr2=0x7f945c1540d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:35:38.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:38.525+0000 7f9462b26700 1 -- 172.21.15.72:0/113269002 shutdown_connections 2023-07-25T14:35:38.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:38.525+0000 7f9462b26700 1 -- 172.21.15.72:0/113269002 wait complete. 2023-07-25T14:35:38.540 INFO:teuthology.orchestra.run.smithi072.stderr:pool 'cephfs_metadata' created 2023-07-25T14:35:38.553 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2023-07-25T14:35:38.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:38.672+0000 7f8139674700 1 Processor -- start 2023-07-25T14:35:38.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:38.672+0000 7f8139674700 1 -- start start 2023-07-25T14:35:38.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:38.672+0000 7f8139674700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f81340c44d0 0x7f81340c4900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:38.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:38.672+0000 7f8139674700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81340bfeb0 con 0x7f81340bead0 2023-07-25T14:35:38.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:38.672+0000 7f8139674700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81340bf2e0 con 0x7f8134151a90 2023-07-25T14:35:38.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:38.672+0000 7f8139674700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81340c10b0 con 0x7f81340c44d0 2023-07-25T14:35:38.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:38.673+0000 7f81327fc700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f81340bead0 0x7f81340c0350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:58328/0 (socket says 172.21.15.72:58328) 2023-07-25T14:35:38.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:38.673+0000 7f81327fc700 1 -- 172.21.15.72:0/3387762205 learned_addr learned my addr 172.21.15.72:0/3387762205 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:35:38.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:38.673+0000 7f81337fe700 1 --2- 172.21.15.72:0/3387762205 >> v2:172.21.15.72:3300/0 conn(0x7f81340c44d0 0x7f81340c4900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:38.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:38.673+0000 7f81337fe700 1 -- 172.21.15.72:0/3387762205 >> v1:172.21.15.92:6789/0 conn(0x7f8134151a90 legacy=0x7f8134154d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:35:38.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:38.673+0000 7f81337fe700 1 -- 172.21.15.72:0/3387762205 >> v1:172.21.15.72:6789/0 conn(0x7f81340bead0 legacy=0x7f81340c0350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:38.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:38.673+0000 7f81337fe700 1 -- 172.21.15.72:0/3387762205 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81340bf580 con 0x7f81340c44d0 2023-07-25T14:35:38.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:38.673+0000 7f8131ffb700 1 -- 172.21.15.72:0/3387762205 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 215815610 0 0) 0x7f81340bfeb0 con 0x7f81340bead0 2023-07-25T14:35:38.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:38.673+0000 7f81337fe700 1 --2- 172.21.15.72:0/3387762205 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f81340c44d0 0x7f81340c4900 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f812c009d90 tx=0x7f812c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5b17695f4fe64a2 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:35:38.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:38.673+0000 7f8131ffb700 1 -- 172.21.15.72:0/3387762205 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f812c00e070 con 0x7f81340c44d0 2023-07-25T14:35:38.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:38.673+0000 7f8131ffb700 1 -- 172.21.15.72:0/3387762205 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f812c00bb90 con 0x7f81340c44d0 2023-07-25T14:35:38.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:38.673+0000 7f8131ffb700 1 -- 172.21.15.72:0/3387762205 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f812c003a20 con 0x7f81340c44d0 2023-07-25T14:35:38.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:38.674+0000 7f8139674700 1 -- 172.21.15.72:0/3387762205 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f81340c44d0 msgr2=0x7f81340c4900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:38.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:38.674+0000 7f8139674700 1 --2- 172.21.15.72:0/3387762205 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f81340c44d0 0x7f81340c4900 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f812c009d90 tx=0x7f812c00b330 comp rx=0 tx=0).stop 2023-07-25T14:35:38.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:38.674+0000 7f8139674700 1 -- 172.21.15.72:0/3387762205 shutdown_connections 2023-07-25T14:35:38.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:38.674+0000 7f8139674700 1 --2- 172.21.15.72:0/3387762205 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f81340c44d0 0x7f81340c4900 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:38.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:38.674+0000 7f8139674700 1 -- 172.21.15.72:0/3387762205 >> 172.21.15.72:0/3387762205 conn(0x7f813406c3a0 msgr2=0x7f813406c780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:35:38.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:38.674+0000 7f8139674700 1 -- 172.21.15.72:0/3387762205 shutdown_connections 2023-07-25T14:35:38.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:38.674+0000 7f8139674700 1 -- 172.21.15.72:0/3387762205 wait complete. 2023-07-25T14:35:38.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:38.675+0000 7f8139674700 1 Processor -- start 2023-07-25T14:35:38.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:38.675+0000 7f8139674700 1 -- start start 2023-07-25T14:35:38.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:38.676+0000 7f8139674700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f81340bead0 0x7f81341ed560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:38.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:38.676+0000 7f8139674700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f81340c44d0 0x7f8134149570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:38.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:38.676+0000 7f8139674700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8134151a90 0x7f81340c9750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:38.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:38.676+0000 7f8139674700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8134151160 con 0x7f81340bead0 2023-07-25T14:35:38.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:38.676+0000 7f8139674700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f813414a260 con 0x7f81340c44d0 2023-07-25T14:35:38.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:38.676+0000 7f8139674700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81340ca960 con 0x7f8134151a90 2023-07-25T14:35:38.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:38.676+0000 7f8132ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f81340bead0 0x7f81341ed560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:38.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:38.676+0000 7f8132ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f81340bead0 0x7f81341ed560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:39364/0 (socket says 172.21.15.72:39364) 2023-07-25T14:35:38.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:38.676+0000 7f8132ffd700 1 -- 172.21.15.72:0/252378004 learned_addr learned my addr 172.21.15.72:0/252378004 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:35:38.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:38.676+0000 7f8132ffd700 1 -- 172.21.15.72:0/252378004 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8134151a90 msgr2=0x7f81340c9750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:38.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:38.676+0000 7f81337fe700 1 --2- 172.21.15.72:0/252378004 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8134151a90 0x7f81340c9750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:38.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:38.676+0000 7f81327fc700 1 --2- 172.21.15.72:0/252378004 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f81340c44d0 0x7f8134149570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:38.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:38.676+0000 7f8132ffd700 1 --2- 172.21.15.72:0/252378004 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8134151a90 0x7f81340c9750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:38.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:38.676+0000 7f8132ffd700 1 -- 172.21.15.72:0/252378004 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f81340c44d0 msgr2=0x7f8134149570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:38.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:38.676+0000 7f8132ffd700 1 --2- 172.21.15.72:0/252378004 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f81340c44d0 0x7f8134149570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:38.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:38.676+0000 7f8132ffd700 1 -- 172.21.15.72:0/252378004 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f812c009a70 con 0x7f81340bead0 2023-07-25T14:35:38.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:38.676+0000 7f81327fc700 1 --2- 172.21.15.72:0/252378004 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f81340c44d0 0x7f8134149570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-25T14:35:38.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:38.676+0000 7f8132ffd700 1 --2- 172.21.15.72:0/252378004 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f81340bead0 0x7f81341ed560 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f812400b4a0 tx=0x7f812400b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:35:38.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:38.676+0000 7f811b7fe700 1 -- 172.21.15.72:0/252378004 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8124011830 con 0x7f81340bead0 2023-07-25T14:35:38.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:38.676+0000 7f811b7fe700 1 -- 172.21.15.72:0/252378004 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8124011990 con 0x7f81340bead0 2023-07-25T14:35:38.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:38.676+0000 7f8139674700 1 -- 172.21.15.72:0/252378004 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8134150c10 con 0x7f81340bead0 2023-07-25T14:35:38.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:38.676+0000 7f811b7fe700 1 -- 172.21.15.72:0/252378004 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8124011d40 con 0x7f81340bead0 2023-07-25T14:35:38.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:38.676+0000 7f8139674700 1 -- 172.21.15.72:0/252378004 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8134150e80 con 0x7f81340bead0 2023-07-25T14:35:38.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:38.677+0000 7f8139674700 1 -- 172.21.15.72:0/252378004 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f813404e470 con 0x7f81340bead0 2023-07-25T14:35:38.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:38.678+0000 7f811b7fe700 1 -- 172.21.15.72:0/252378004 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f812401a400 con 0x7f81340bead0 2023-07-25T14:35:38.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:38.678+0000 7f811b7fe700 1 --2- 172.21.15.72:0/252378004 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f812006ace0 0x7f812006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:38.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:38.678+0000 7f811b7fe700 1 -- 172.21.15.72:0/252378004 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5580+0+0 (secure 0 0 0) 0x7f8124088f70 con 0x7f81340bead0 2023-07-25T14:35:38.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:38.678+0000 7f81327fc700 1 --2- 172.21.15.72:0/252378004 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f812006ace0 0x7f812006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:38.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:38.679+0000 7f81327fc700 1 --2- 172.21.15.72:0/252378004 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f812006ace0 0x7f812006d1a0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f81341e73c0 tx=0x7f8128009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:35:38.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:38.683+0000 7f811b7fe700 1 -- 172.21.15.72:0/252378004 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f81240bb310 con 0x7f81340bead0 2023-07-25T14:35:38.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:38.872+0000 7f8139674700 1 -- 172.21.15.72:0/252378004 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) v1 -- 0x7f81340c5aa0 con 0x7f81340bead0 2023-07-25T14:35:39.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:39.521+0000 7f811b7fe700 1 -- 172.21.15.72:0/252378004 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v19) v1 ==== 171+0+0 (secure 0 0 0) 0x7f81240150d0 con 0x7f81340bead0 2023-07-25T14:35:39.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:39.526+0000 7f8139674700 1 -- 172.21.15.72:0/252378004 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f812006ace0 msgr2=0x7f812006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:39.540 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:39.526+0000 7f8139674700 1 --2- 172.21.15.72:0/252378004 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f812006ace0 0x7f812006d1a0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f81341e73c0 tx=0x7f8128009040 comp rx=0 tx=0).stop 2023-07-25T14:35:39.540 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:39.526+0000 7f8139674700 1 -- 172.21.15.72:0/252378004 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f81340bead0 msgr2=0x7f81341ed560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:39.540 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:39.526+0000 7f8139674700 1 --2- 172.21.15.72:0/252378004 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f81340bead0 0x7f81341ed560 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f812400b4a0 tx=0x7f812400b860 comp rx=0 tx=0).stop 2023-07-25T14:35:39.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:39.530+0000 7f8139674700 1 -- 172.21.15.72:0/252378004 shutdown_connections 2023-07-25T14:35:39.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:39.530+0000 7f8139674700 1 --2- 172.21.15.72:0/252378004 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f812006ace0 0x7f812006d1a0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:39.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:39.530+0000 7f8139674700 1 --2- 172.21.15.72:0/252378004 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8134151a90 0x7f81340c9750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:39.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:39.530+0000 7f8139674700 1 --2- 172.21.15.72:0/252378004 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f81340bead0 0x7f81341ed560 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:39.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:39.530+0000 7f8139674700 1 --2- 172.21.15.72:0/252378004 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f81340c44d0 0x7f8134149570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:39.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:39.530+0000 7f8139674700 1 -- 172.21.15.72:0/252378004 >> 172.21.15.72:0/252378004 conn(0x7f813406c3a0 msgr2=0x7f81340c1400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:35:39.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:39.532+0000 7f8139674700 1 -- 172.21.15.72:0/252378004 shutdown_connections 2023-07-25T14:35:39.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:39.533+0000 7f8139674700 1 -- 172.21.15.72:0/252378004 wait complete. 2023-07-25T14:35:39.552 INFO:teuthology.orchestra.run.smithi072.stderr:pool 'cephfs_data' created 2023-07-25T14:35:39.568 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-07-25T14:35:39.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:39.682+0000 7f0634949700 1 Processor -- start 2023-07-25T14:35:39.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:39.682+0000 7f0634949700 1 -- start start 2023-07-25T14:35:39.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:39.683+0000 7f0634949700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f06300c25a0 0x7f063015c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:39.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:39.683+0000 7f0634949700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0630071570 con 0x7f06300c51d0 2023-07-25T14:35:39.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:39.683+0000 7f0634949700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06300720d0 con 0x7f06300c21c0 2023-07-25T14:35:39.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:39.683+0000 7f0634949700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06300a5140 con 0x7f06300c25a0 2023-07-25T14:35:39.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:39.683+0000 7f062dd9b700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f06300c51d0 0x7f0630154d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:58342/0 (socket says 172.21.15.72:58342) 2023-07-25T14:35:39.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:39.683+0000 7f062dd9b700 1 -- 172.21.15.72:0/4249593562 learned_addr learned my addr 172.21.15.72:0/4249593562 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:35:39.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:39.684+0000 7f062ed9d700 1 --2- 172.21.15.72:0/4249593562 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f06300c25a0 0x7f063015c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:39.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:39.684+0000 7f062d59a700 1 -- 172.21.15.72:0/4249593562 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 507236421 0 0) 0x7f0630071570 con 0x7f06300c51d0 2023-07-25T14:35:39.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:39.684+0000 7f062d59a700 1 -- 172.21.15.72:0/4249593562 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f06180035b0 con 0x7f06300c51d0 2023-07-25T14:35:39.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:39.684+0000 7f062d59a700 1 -- 172.21.15.72:0/4249593562 <== mon.1 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2088078809 0 0) 0x7f06300720d0 con 0x7f06300c21c0 2023-07-25T14:35:39.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:39.684+0000 7f062d59a700 1 -- 172.21.15.72:0/4249593562 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0630071570 con 0x7f06300c21c0 2023-07-25T14:35:39.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:39.684+0000 7f062d59a700 1 -- 172.21.15.72:0/4249593562 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3794613732 0 0) 0x7f06180035b0 con 0x7f06300c51d0 2023-07-25T14:35:39.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:39.684+0000 7f062d59a700 1 -- 172.21.15.72:0/4249593562 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f06300c25a0 msgr2=0x7f063015c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:35:39.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:39.684+0000 7f062d59a700 1 --2- 172.21.15.72:0/4249593562 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f06300c25a0 0x7f063015c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:39.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:39.684+0000 7f062d59a700 1 -- 172.21.15.72:0/4249593562 >> v1:172.21.15.92:6789/0 conn(0x7f06300c21c0 legacy=0x7f0630154680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:39.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:39.684+0000 7f062d59a700 1 -- 172.21.15.72:0/4249593562 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06300717a0 con 0x7f06300c51d0 2023-07-25T14:35:39.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:39.684+0000 7f062d59a700 1 -- 172.21.15.72:0/4249593562 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2559588315 0 0) 0x7f0620001670 con 0x7f06300c51d0 2023-07-25T14:35:39.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:39.684+0000 7f062d59a700 1 -- 172.21.15.72:0/4249593562 >> v1:172.21.15.72:6789/0 conn(0x7f06300c51d0 legacy=0x7f0630154d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:39.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:39.684+0000 7f062d59a700 1 --2- 172.21.15.72:0/4249593562 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0618003bc0 0x7f0618003fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:39.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:39.684+0000 7f062d59a700 1 --2- 172.21.15.72:0/4249593562 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0618004850 0x7f0618004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:39.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:39.684+0000 7f062d59a700 1 --2- 172.21.15.72:0/4249593562 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f06300c25a0 0x7f0618005270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:39.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:39.684+0000 7f062d59a700 1 -- 172.21.15.72:0/4249593562 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06300a5140 con 0x7f0618004850 2023-07-25T14:35:39.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:39.684+0000 7f062d59a700 1 -- 172.21.15.72:0/4249593562 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f061800bba0 con 0x7f0618003bc0 2023-07-25T14:35:39.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:39.684+0000 7f062d59a700 1 -- 172.21.15.72:0/4249593562 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f061800bd30 con 0x7f06300c25a0 2023-07-25T14:35:39.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:39.684+0000 7f062dd9b700 1 --2- 172.21.15.72:0/4249593562 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0618004850 0x7f0618004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:39.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:39.684+0000 7f062e59c700 1 --2- 172.21.15.72:0/4249593562 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0618003bc0 0x7f0618003fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:39.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:39.684+0000 7f062ed9d700 1 --2- 172.21.15.72:0/4249593562 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f06300c25a0 0x7f0618005270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:39.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:39.684+0000 7f062dd9b700 1 -- 172.21.15.72:0/4249593562 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f06300c25a0 msgr2=0x7f0618005270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:35:39.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:39.684+0000 7f062dd9b700 1 --2- 172.21.15.72:0/4249593562 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f06300c25a0 0x7f0618005270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:39.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:39.684+0000 7f062dd9b700 1 -- 172.21.15.72:0/4249593562 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0618003bc0 msgr2=0x7f0618003fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:35:39.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:39.684+0000 7f062dd9b700 1 --2- 172.21.15.72:0/4249593562 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0618003bc0 0x7f0618003fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:39.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:39.684+0000 7f062dd9b700 1 -- 172.21.15.72:0/4249593562 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06180035b0 con 0x7f0618004850 2023-07-25T14:35:39.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:39.685+0000 7f062dd9b700 1 --2- 172.21.15.72:0/4249593562 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0618004850 0x7f0618004cd0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f062000c110 tx=0x7f0618005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b53ecb01860b3a09 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:35:39.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:39.685+0000 7f062d59a700 1 -- 172.21.15.72:0/4249593562 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f062000cc70 con 0x7f0618004850 2023-07-25T14:35:39.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:39.685+0000 7f062d59a700 1 -- 172.21.15.72:0/4249593562 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f062000cdd0 con 0x7f0618004850 2023-07-25T14:35:39.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:39.685+0000 7f062d59a700 1 -- 172.21.15.72:0/4249593562 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0620005ba0 con 0x7f0618004850 2023-07-25T14:35:39.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:39.685+0000 7f0634949700 1 -- 172.21.15.72:0/4249593562 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0618004850 msgr2=0x7f0618004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:39.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:39.685+0000 7f0634949700 1 --2- 172.21.15.72:0/4249593562 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0618004850 0x7f0618004cd0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f062000c110 tx=0x7f0618005880 comp rx=0 tx=0).stop 2023-07-25T14:35:39.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:39.685+0000 7f062ed9d700 1 -- 172.21.15.72:0/4249593562 reap_dead start 2023-07-25T14:35:39.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:39.685+0000 7f0634949700 1 -- 172.21.15.72:0/4249593562 shutdown_connections 2023-07-25T14:35:39.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:39.685+0000 7f0634949700 1 -- 172.21.15.72:0/4249593562 >> 172.21.15.72:0/4249593562 conn(0x7f06300a7510 msgr2=0x7f06300a78f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:35:39.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:39.685+0000 7f0634949700 1 -- 172.21.15.72:0/4249593562 shutdown_connections 2023-07-25T14:35:39.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:39.685+0000 7f0634949700 1 -- 172.21.15.72:0/4249593562 wait complete. 2023-07-25T14:35:39.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:39.687+0000 7f0634949700 1 Processor -- start 2023-07-25T14:35:39.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:39.687+0000 7f0634949700 1 -- start start 2023-07-25T14:35:39.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:39.687+0000 7f0634949700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0618004850 0x7f06300badb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:39.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:39.687+0000 7f0634949700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f063014d8a0 0x7f06301ebc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:39.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:39.687+0000 7f0634949700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f06301e8530 0x7f06300c01a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:39.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:39.687+0000 7f0634949700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0630099d80 con 0x7f06301e8530 2023-07-25T14:35:39.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:39.687+0000 7f0634949700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06301ec1c0 con 0x7f063014d8a0 2023-07-25T14:35:39.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:39.687+0000 7f0634949700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f063014dd20 con 0x7f0618004850 2023-07-25T14:35:39.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:39.687+0000 7f062ed9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f06301e8530 0x7f06300c01a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:39.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:39.687+0000 7f062ed9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f06301e8530 0x7f06300c01a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:39388/0 (socket says 172.21.15.72:39388) 2023-07-25T14:35:39.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:39.687+0000 7f062ed9d700 1 -- 172.21.15.72:0/3634698832 learned_addr learned my addr 172.21.15.72:0/3634698832 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:35:39.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:39.687+0000 7f062e59c700 1 --2- 172.21.15.72:0/3634698832 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0618004850 0x7f06300badb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:39.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:39.687+0000 7f062dd9b700 1 --2- 172.21.15.72:0/3634698832 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f063014d8a0 0x7f06301ebc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:39.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:39.688+0000 7f062ed9d700 1 -- 172.21.15.72:0/3634698832 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0618004850 msgr2=0x7f06300badb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:39.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:39.688+0000 7f062ed9d700 1 --2- 172.21.15.72:0/3634698832 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0618004850 0x7f06300badb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:39.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:39.688+0000 7f062ed9d700 1 -- 172.21.15.72:0/3634698832 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f063014d8a0 msgr2=0x7f06301ebc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:39.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:39.688+0000 7f062ed9d700 1 --2- 172.21.15.72:0/3634698832 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f063014d8a0 0x7f06301ebc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:39.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:39.688+0000 7f062ed9d700 1 -- 172.21.15.72:0/3634698832 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06300994e0 con 0x7f06301e8530 2023-07-25T14:35:39.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:39.688+0000 7f062ed9d700 1 --2- 172.21.15.72:0/3634698832 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f06301e8530 0x7f06300c01a0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f06300a8320 tx=0x7f0628011f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:35:39.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:39.688+0000 7f061effd700 1 -- 172.21.15.72:0/3634698832 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f062800e040 con 0x7f06301e8530 2023-07-25T14:35:39.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:39.688+0000 7f061effd700 1 -- 172.21.15.72:0/3634698832 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f062800f040 con 0x7f06301e8530 2023-07-25T14:35:39.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:39.688+0000 7f0634949700 1 -- 172.21.15.72:0/3634698832 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06300997c0 con 0x7f06301e8530 2023-07-25T14:35:39.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:39.688+0000 7f061effd700 1 -- 172.21.15.72:0/3634698832 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f062800fe40 con 0x7f06301e8530 2023-07-25T14:35:39.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:39.688+0000 7f0634949700 1 -- 172.21.15.72:0/3634698832 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06301e8010 con 0x7f06301e8530 2023-07-25T14:35:39.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:39.689+0000 7f0634949700 1 -- 172.21.15.72:0/3634698832 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0630099240 con 0x7f06301e8530 2023-07-25T14:35:39.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:39.689+0000 7f061effd700 1 -- 172.21.15.72:0/3634698832 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0628015430 con 0x7f06301e8530 2023-07-25T14:35:39.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:39.690+0000 7f061effd700 1 --2- 172.21.15.72:0/3634698832 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f061006ace0 0x7f061006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:39.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:39.690+0000 7f062e59c700 1 --2- 172.21.15.72:0/3634698832 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f061006ace0 0x7f061006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:39.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:39.690+0000 7f061effd700 1 -- 172.21.15.72:0/3634698832 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5962+0+0 (secure 0 0 0) 0x7f0628089b10 con 0x7f06301e8530 2023-07-25T14:35:39.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:39.690+0000 7f062e59c700 1 --2- 172.21.15.72:0/3634698832 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f061006ace0 0x7f061006d1a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f06300c0d50 tx=0x7f0624009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:35:39.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:39.695+0000 7f061effd700 1 -- 172.21.15.72:0/3634698832 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f0628058740 con 0x7f06301e8530 2023-07-25T14:35:39.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:39.937+0000 7f0634949700 1 -- 172.21.15.72:0/3634698832 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f063004e470 con 0x7f06301e8530 2023-07-25T14:35:40.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:40.553+0000 7f061effd700 1 -- 172.21.15.72:0/3634698832 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 3 and data pool 4 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f06280582d0 con 0x7f06301e8530 2023-07-25T14:35:40.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:40.557+0000 7f0634949700 1 -- 172.21.15.72:0/3634698832 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f061006ace0 msgr2=0x7f061006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:40.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:40.557+0000 7f0634949700 1 --2- 172.21.15.72:0/3634698832 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f061006ace0 0x7f061006d1a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f06300c0d50 tx=0x7f0624009040 comp rx=0 tx=0).stop 2023-07-25T14:35:40.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:40.557+0000 7f0634949700 1 -- 172.21.15.72:0/3634698832 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f06301e8530 msgr2=0x7f06300c01a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:40.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:40.557+0000 7f0634949700 1 --2- 172.21.15.72:0/3634698832 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f06301e8530 0x7f06300c01a0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f06300a8320 tx=0x7f0628011f60 comp rx=0 tx=0).stop 2023-07-25T14:35:40.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:40.559+0000 7f0634949700 1 -- 172.21.15.72:0/3634698832 shutdown_connections 2023-07-25T14:35:40.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:40.559+0000 7f0634949700 1 --2- 172.21.15.72:0/3634698832 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f061006ace0 0x7f061006d1a0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:40.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:40.559+0000 7f0634949700 1 --2- 172.21.15.72:0/3634698832 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0618004850 0x7f06300badb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:40.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:40.559+0000 7f0634949700 1 --2- 172.21.15.72:0/3634698832 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f06301e8530 0x7f06300c01a0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:40.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:40.559+0000 7f0634949700 1 --2- 172.21.15.72:0/3634698832 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f063014d8a0 0x7f06301ebc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:40.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:40.559+0000 7f0634949700 1 -- 172.21.15.72:0/3634698832 >> 172.21.15.72:0/3634698832 conn(0x7f06300a7510 msgr2=0x7f0630153b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:35:40.574 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:40.561+0000 7f0634949700 1 -- 172.21.15.72:0/3634698832 shutdown_connections 2023-07-25T14:35:40.574 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:40.562+0000 7f0634949700 1 -- 172.21.15.72:0/3634698832 wait complete. 2023-07-25T14:35:40.584 INFO:teuthology.orchestra.run.smithi072.stderr:new fs with metadata pool 3 and data pool 4 2023-07-25T14:35:40.601 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2023-07-25T14:35:40.602 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2023-07-25T14:35:40.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:40.719+0000 7f48896e1700 1 Processor -- start 2023-07-25T14:35:40.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:40.719+0000 7f48896e1700 1 -- start start 2023-07-25T14:35:40.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:40.720+0000 7f48896e1700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f48840c0490 0x7f48840c0910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:40.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:40.720+0000 7f48896e1700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f4884154440 0x7f4884154870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:40.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:40.720+0000 7f48896e1700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4884158670 con 0x7f48841517b0 2023-07-25T14:35:40.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:40.720+0000 7f48896e1700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48841577c0 con 0x7f4884154440 2023-07-25T14:35:40.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:40.720+0000 7f48896e1700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4884157a60 con 0x7f48840c0490 2023-07-25T14:35:40.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:40.720+0000 7f48837fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f4884154440 0x7f4884154870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:40.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:40.720+0000 7f48837fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f4884154440 0x7f4884154870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:39396/0 (socket says 172.21.15.72:39396) 2023-07-25T14:35:40.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:40.720+0000 7f48837fe700 1 -- 172.21.15.72:0/497116458 learned_addr learned my addr 172.21.15.72:0/497116458 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:35:40.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:40.720+0000 7f48837fe700 1 -- 172.21.15.72:0/497116458 >> v2:172.21.15.92:3300/0 conn(0x7f48840c0490 msgr2=0x7f48840c0910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:35:40.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:40.720+0000 7f48827fc700 1 --2- 172.21.15.72:0/497116458 >> v2:172.21.15.92:3300/0 conn(0x7f48840c0490 0x7f48840c0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:40.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:40.720+0000 7f48837fe700 1 --2- 172.21.15.72:0/497116458 >> v2:172.21.15.92:3300/0 conn(0x7f48840c0490 0x7f48840c0910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:40.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:40.720+0000 7f48837fe700 1 -- 172.21.15.72:0/497116458 >> v1:172.21.15.92:6789/0 conn(0x7f48841517b0 legacy=0x7f48840c5b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:35:40.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:40.720+0000 7f48837fe700 1 -- 172.21.15.72:0/497116458 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4884157d40 con 0x7f4884154440 2023-07-25T14:35:40.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:40.720+0000 7f48837fe700 1 --2- 172.21.15.72:0/497116458 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4884154440 0x7f4884154870 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f48840afe20 tx=0x7f487c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76ed1c3035f8b9c1 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:35:40.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:40.720+0000 7f4881ffb700 1 -- 172.21.15.72:0/497116458 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f487c00e070 con 0x7f4884154440 2023-07-25T14:35:40.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:40.721+0000 7f4881ffb700 1 -- 172.21.15.72:0/497116458 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f487c003a20 con 0x7f4884154440 2023-07-25T14:35:40.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:40.721+0000 7f4881ffb700 1 -- 172.21.15.72:0/497116458 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f487c003dd0 con 0x7f4884154440 2023-07-25T14:35:40.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:40.721+0000 7f48896e1700 1 -- 172.21.15.72:0/497116458 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4884154440 msgr2=0x7f4884154870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:40.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:40.721+0000 7f48896e1700 1 --2- 172.21.15.72:0/497116458 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4884154440 0x7f4884154870 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f48840afe20 tx=0x7f487c00b330 comp rx=0 tx=0).stop 2023-07-25T14:35:40.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:40.721+0000 7f48896e1700 1 -- 172.21.15.72:0/497116458 shutdown_connections 2023-07-25T14:35:40.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:40.721+0000 7f48896e1700 1 --2- 172.21.15.72:0/497116458 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4884154440 0x7f4884154870 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:40.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:40.721+0000 7f48896e1700 1 --2- 172.21.15.72:0/497116458 >> v2:172.21.15.92:3300/0 conn(0x7f48840c0490 0x7f48840c0910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:40.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:40.721+0000 7f48896e1700 1 -- 172.21.15.72:0/497116458 >> 172.21.15.72:0/497116458 conn(0x7f48840c9b30 msgr2=0x7f48840c9f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:35:40.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:40.721+0000 7f48896e1700 1 -- 172.21.15.72:0/497116458 shutdown_connections 2023-07-25T14:35:40.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:40.721+0000 7f48896e1700 1 -- 172.21.15.72:0/497116458 wait complete. 2023-07-25T14:35:40.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:40.722+0000 7f48896e1700 1 Processor -- start 2023-07-25T14:35:40.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:40.722+0000 7f48896e1700 1 -- start start 2023-07-25T14:35:40.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:40.723+0000 7f48896e1700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f48840c0490 0x7f488414c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:40.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:40.723+0000 7f48896e1700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f48841517b0 0x7f4884152050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:40.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:40.723+0000 7f48896e1700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4884154440 0x7f488413f100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:40.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:40.723+0000 7f48896e1700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4884152cb0 con 0x7f4884154440 2023-07-25T14:35:40.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:40.723+0000 7f48896e1700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4884150b20 con 0x7f48840c0490 2023-07-25T14:35:40.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:40.723+0000 7f48896e1700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48841431a0 con 0x7f48841517b0 2023-07-25T14:35:40.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:40.723+0000 7f48837fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4884154440 0x7f488413f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:40.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:40.723+0000 7f48837fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4884154440 0x7f488413f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:39402/0 (socket says 172.21.15.72:39402) 2023-07-25T14:35:40.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:40.723+0000 7f48837fe700 1 -- 172.21.15.72:0/223091682 learned_addr learned my addr 172.21.15.72:0/223091682 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:35:40.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:40.723+0000 7f4882ffd700 1 --2- 172.21.15.72:0/223091682 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f48840c0490 0x7f488414c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:40.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:40.723+0000 7f48827fc700 1 --2- 172.21.15.72:0/223091682 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f48841517b0 0x7f4884152050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:40.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:40.723+0000 7f48837fe700 1 -- 172.21.15.72:0/223091682 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f48841517b0 msgr2=0x7f4884152050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:40.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:40.723+0000 7f48837fe700 1 --2- 172.21.15.72:0/223091682 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f48841517b0 0x7f4884152050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:40.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:40.723+0000 7f48837fe700 1 -- 172.21.15.72:0/223091682 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f48840c0490 msgr2=0x7f488414c240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:40.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:40.723+0000 7f48837fe700 1 --2- 172.21.15.72:0/223091682 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f48840c0490 0x7f488414c240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:40.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:40.723+0000 7f48837fe700 1 -- 172.21.15.72:0/223091682 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f487c009b30 con 0x7f4884154440 2023-07-25T14:35:40.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:40.723+0000 7f48837fe700 1 --2- 172.21.15.72:0/223091682 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4884154440 0x7f488413f100 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f487c015040 tx=0x7f487c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:35:40.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:40.724+0000 7f486b7fe700 1 -- 172.21.15.72:0/223091682 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f487c004440 con 0x7f4884154440 2023-07-25T14:35:40.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:40.724+0000 7f486b7fe700 1 -- 172.21.15.72:0/223091682 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f487c0045c0 con 0x7f4884154440 2023-07-25T14:35:40.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:40.724+0000 7f48896e1700 1 -- 172.21.15.72:0/223091682 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4884150e50 con 0x7f4884154440 2023-07-25T14:35:40.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:40.724+0000 7f486b7fe700 1 -- 172.21.15.72:0/223091682 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f487c004970 con 0x7f4884154440 2023-07-25T14:35:40.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:40.724+0000 7f48896e1700 1 -- 172.21.15.72:0/223091682 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f488414cc20 con 0x7f4884154440 2023-07-25T14:35:40.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:40.724+0000 7f48896e1700 1 -- 172.21.15.72:0/223091682 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48840c4150 con 0x7f4884154440 2023-07-25T14:35:40.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:40.725+0000 7f486b7fe700 1 -- 172.21.15.72:0/223091682 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f487c012430 con 0x7f4884154440 2023-07-25T14:35:40.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:40.725+0000 7f486b7fe700 1 --2- 172.21.15.72:0/223091682 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f487006ace0 0x7f487006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:40.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:40.725+0000 7f4882ffd700 1 --2- 172.21.15.72:0/223091682 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f487006ace0 0x7f487006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:40.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:40.725+0000 7f486b7fe700 1 -- 172.21.15.72:0/223091682 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f487c08a710 con 0x7f4884154440 2023-07-25T14:35:40.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:40.726+0000 7f4882ffd700 1 --2- 172.21.15.72:0/223091682 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f487006ace0 0x7f487006d1a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f4878007fd0 tx=0x7f4878007ec0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:35:40.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:40.730+0000 7f486b7fe700 1 -- 172.21.15.72:0/223091682 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f487c055850 con 0x7f4884154440 2023-07-25T14:35:40.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:40.928+0000 7f48896e1700 1 -- 172.21.15.72:0/223091682 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) v1 -- 0x7f488404e470 con 0x7f4884154440 2023-07-25T14:35:41.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:41.565+0000 7f486b7fe700 1 -- 172.21.15.72:0/223091682 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v21) v1 ==== 157+0+0 (secure 0 0 0) 0x7f487c007310 con 0x7f4884154440 2023-07-25T14:35:41.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:41.568+0000 7f48896e1700 1 -- 172.21.15.72:0/223091682 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f487006ace0 msgr2=0x7f487006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:41.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:41.568+0000 7f48896e1700 1 --2- 172.21.15.72:0/223091682 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f487006ace0 0x7f487006d1a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f4878007fd0 tx=0x7f4878007ec0 comp rx=0 tx=0).stop 2023-07-25T14:35:41.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:41.568+0000 7f48896e1700 1 -- 172.21.15.72:0/223091682 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4884154440 msgr2=0x7f488413f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:41.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:41.568+0000 7f48896e1700 1 --2- 172.21.15.72:0/223091682 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4884154440 0x7f488413f100 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f487c015040 tx=0x7f487c004ad0 comp rx=0 tx=0).stop 2023-07-25T14:35:41.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:41.568+0000 7f48896e1700 1 -- 172.21.15.72:0/223091682 shutdown_connections 2023-07-25T14:35:41.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:41.568+0000 7f48896e1700 1 --2- 172.21.15.72:0/223091682 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f487006ace0 0x7f487006d1a0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:41.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:41.568+0000 7f48896e1700 1 --2- 172.21.15.72:0/223091682 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4884154440 0x7f488413f100 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:41.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:41.568+0000 7f48896e1700 1 --2- 172.21.15.72:0/223091682 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f48840c0490 0x7f488414c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:41.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:41.568+0000 7f48896e1700 1 --2- 172.21.15.72:0/223091682 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f48841517b0 0x7f4884152050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:41.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:41.568+0000 7f48896e1700 1 -- 172.21.15.72:0/223091682 >> 172.21.15.72:0/223091682 conn(0x7f48840c9b30 msgr2=0x7f48840bf8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:35:41.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:41.568+0000 7f48896e1700 1 -- 172.21.15.72:0/223091682 shutdown_connections 2023-07-25T14:35:41.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:41.568+0000 7f48896e1700 1 -- 172.21.15.72:0/223091682 wait complete. 2023-07-25T14:35:41.593 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2023-07-25T14:35:41.722 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:41.711+0000 7fc1ff2cd700 1 Processor -- start 2023-07-25T14:35:41.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:41.711+0000 7fc1ff2cd700 1 -- start start 2023-07-25T14:35:41.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:41.712+0000 7fc1ff2cd700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fc1f81518d0 0x7fc1f806a190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:41.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:41.712+0000 7fc1ff2cd700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1f8151cb0 con 0x7fc1f806e420 2023-07-25T14:35:41.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:41.712+0000 7fc1ff2cd700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1f80718a0 con 0x7fc1f8154fd0 2023-07-25T14:35:41.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:41.712+0000 7fc1ff2cd700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1f81544a0 con 0x7fc1f81518d0 2023-07-25T14:35:41.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:41.712+0000 7fc1fc868700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fc1f806e420 0x7fc1f81548c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:58374/0 (socket says 172.21.15.72:58374) 2023-07-25T14:35:41.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:41.712+0000 7fc1fc868700 1 -- 172.21.15.72:0/2049456813 learned_addr learned my addr 172.21.15.72:0/2049456813 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:35:41.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:41.712+0000 7fc1effff700 1 -- 172.21.15.72:0/2049456813 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 575753706 0 0) 0x7fc1f8151cb0 con 0x7fc1f806e420 2023-07-25T14:35:41.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:41.712+0000 7fc1effff700 1 -- 172.21.15.72:0/2049456813 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc1e40035b0 con 0x7fc1f806e420 2023-07-25T14:35:41.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:41.712+0000 7fc1fd069700 1 --2- 172.21.15.72:0/2049456813 >> v2:172.21.15.92:3300/0 conn(0x7fc1f81518d0 0x7fc1f806a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:41.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:41.712+0000 7fc1effff700 1 -- 172.21.15.72:0/2049456813 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 385779624 0 0) 0x7fc1e40035b0 con 0x7fc1f806e420 2023-07-25T14:35:41.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:41.712+0000 7fc1effff700 1 -- 172.21.15.72:0/2049456813 >> v2:172.21.15.92:3300/0 conn(0x7fc1f81518d0 msgr2=0x7fc1f806a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:35:41.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:41.712+0000 7fc1effff700 1 --2- 172.21.15.72:0/2049456813 >> v2:172.21.15.92:3300/0 conn(0x7fc1f81518d0 0x7fc1f806a190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:41.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:41.712+0000 7fc1effff700 1 -- 172.21.15.72:0/2049456813 >> v1:172.21.15.92:6789/0 conn(0x7fc1f8154fd0 legacy=0x7fc1f815ec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:41.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:41.712+0000 7fc1effff700 1 -- 172.21.15.72:0/2049456813 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1f8071b80 con 0x7fc1f806e420 2023-07-25T14:35:41.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:41.712+0000 7fc1effff700 1 -- 172.21.15.72:0/2049456813 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2559588315 0 0) 0x7fc1e8001670 con 0x7fc1f806e420 2023-07-25T14:35:41.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:41.712+0000 7fc1effff700 1 -- 172.21.15.72:0/2049456813 >> v1:172.21.15.72:6789/0 conn(0x7fc1f806e420 legacy=0x7fc1f81548c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:41.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:41.712+0000 7fc1effff700 1 --2- 172.21.15.72:0/2049456813 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc1e4003a70 0x7fc1e4003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:41.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:41.712+0000 7fc1effff700 1 --2- 172.21.15.72:0/2049456813 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc1e4004850 0x7fc1e4004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:41.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:41.712+0000 7fc1effff700 1 --2- 172.21.15.72:0/2049456813 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc1e4005280 0x7fc1e400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:41.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:41.712+0000 7fc1effff700 1 -- 172.21.15.72:0/2049456813 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1f81544a0 con 0x7fc1e4005280 2023-07-25T14:35:41.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:41.712+0000 7fc1effff700 1 -- 172.21.15.72:0/2049456813 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1e400c1e0 con 0x7fc1e4003a70 2023-07-25T14:35:41.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:41.712+0000 7fc1effff700 1 -- 172.21.15.72:0/2049456813 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1e400c3a0 con 0x7fc1e4004850 2023-07-25T14:35:41.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:41.713+0000 7fc1fd86a700 1 --2- 172.21.15.72:0/2049456813 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc1e4005280 0x7fc1e400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:41.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:41.713+0000 7fc1fd069700 1 --2- 172.21.15.72:0/2049456813 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc1e4003a70 0x7fc1e4003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:41.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:41.713+0000 7fc1fc868700 1 --2- 172.21.15.72:0/2049456813 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc1e4004850 0x7fc1e4004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:41.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:41.713+0000 7fc1fd86a700 1 -- 172.21.15.72:0/2049456813 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc1e4004850 msgr2=0x7fc1e4004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:35:41.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:41.713+0000 7fc1fd86a700 1 --2- 172.21.15.72:0/2049456813 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc1e4004850 0x7fc1e4004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:41.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:41.713+0000 7fc1fd86a700 1 -- 172.21.15.72:0/2049456813 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc1e4003a70 msgr2=0x7fc1e4003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:35:41.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:41.713+0000 7fc1fd86a700 1 --2- 172.21.15.72:0/2049456813 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc1e4003a70 0x7fc1e4003e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:41.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:41.713+0000 7fc1fd86a700 1 -- 172.21.15.72:0/2049456813 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1e40035b0 con 0x7fc1e4005280 2023-07-25T14:35:41.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:41.713+0000 7fc1fd86a700 1 -- 172.21.15.72:0/2049456813 reap_dead start 2023-07-25T14:35:41.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:41.713+0000 7fc1fd86a700 1 --2- 172.21.15.72:0/2049456813 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc1e4005280 0x7fc1e400ba10 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fc1f000c260 tx=0x7fc1e4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a251a47932c629aa server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:35:41.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:41.713+0000 7fc1effff700 1 -- 172.21.15.72:0/2049456813 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1f0016070 con 0x7fc1e4005280 2023-07-25T14:35:41.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:41.713+0000 7fc1effff700 1 -- 172.21.15.72:0/2049456813 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1f000cc00 con 0x7fc1e4005280 2023-07-25T14:35:41.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:41.713+0000 7fc1effff700 1 -- 172.21.15.72:0/2049456813 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1f0001e70 con 0x7fc1e4005280 2023-07-25T14:35:41.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:41.713+0000 7fc1ff2cd700 1 -- 172.21.15.72:0/2049456813 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc1e4005280 msgr2=0x7fc1e400ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:41.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:41.713+0000 7fc1ff2cd700 1 --2- 172.21.15.72:0/2049456813 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc1e4005280 0x7fc1e400ba10 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fc1f000c260 tx=0x7fc1e4005880 comp rx=0 tx=0).stop 2023-07-25T14:35:41.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:41.714+0000 7fc1ff2cd700 1 -- 172.21.15.72:0/2049456813 shutdown_connections 2023-07-25T14:35:41.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:41.714+0000 7fc1ff2cd700 1 --2- 172.21.15.72:0/2049456813 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc1e4005280 0x7fc1e400ba10 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:41.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:41.714+0000 7fc1ff2cd700 1 -- 172.21.15.72:0/2049456813 >> 172.21.15.72:0/2049456813 conn(0x7fc1f806b2a0 msgr2=0x7fc1f806b680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:35:41.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:41.714+0000 7fc1ff2cd700 1 -- 172.21.15.72:0/2049456813 shutdown_connections 2023-07-25T14:35:41.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:41.714+0000 7fc1ff2cd700 1 -- 172.21.15.72:0/2049456813 wait complete. 2023-07-25T14:35:41.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:41.715+0000 7fc1ff2cd700 1 Processor -- start 2023-07-25T14:35:41.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:41.715+0000 7fc1ff2cd700 1 -- start start 2023-07-25T14:35:41.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:41.715+0000 7fc1ff2cd700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc1e4005280 0x7fc1f81ea190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:41.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:41.715+0000 7fc1ff2cd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc1f80ac800 0x7fc1f806a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:41.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:41.715+0000 7fc1ff2cd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc1f81ecb20 0x7fc1f81de970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:41.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:41.715+0000 7fc1ff2cd700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1f8151f30 con 0x7fc1f81ecb20 2023-07-25T14:35:41.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:41.715+0000 7fc1ff2cd700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1f80be320 con 0x7fc1f80ac800 2023-07-25T14:35:41.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:41.715+0000 7fc1ff2cd700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1f8152460 con 0x7fc1e4005280 2023-07-25T14:35:41.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:41.715+0000 7fc1fd86a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc1f81ecb20 0x7fc1f81de970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:41.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:41.715+0000 7fc1fd86a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc1f81ecb20 0x7fc1f81de970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:39422/0 (socket says 172.21.15.72:39422) 2023-07-25T14:35:41.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:41.716+0000 7fc1fd86a700 1 -- 172.21.15.72:0/988527 learned_addr learned my addr 172.21.15.72:0/988527 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:35:41.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:41.716+0000 7fc1fc868700 1 --2- 172.21.15.72:0/988527 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc1f80ac800 0x7fc1f806a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:41.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:41.716+0000 7fc1fd069700 1 --2- 172.21.15.72:0/988527 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc1e4005280 0x7fc1f81ea190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:41.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:41.716+0000 7fc1fd86a700 1 -- 172.21.15.72:0/988527 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc1e4005280 msgr2=0x7fc1f81ea190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:41.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:41.716+0000 7fc1fd86a700 1 --2- 172.21.15.72:0/988527 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc1e4005280 0x7fc1f81ea190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:41.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:41.716+0000 7fc1fd86a700 1 -- 172.21.15.72:0/988527 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc1f80ac800 msgr2=0x7fc1f806a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:41.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:41.716+0000 7fc1fd86a700 1 --2- 172.21.15.72:0/988527 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc1f80ac800 0x7fc1f806a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:41.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:41.716+0000 7fc1fd86a700 1 -- 172.21.15.72:0/988527 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1f80722c0 con 0x7fc1f81ecb20 2023-07-25T14:35:41.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:41.716+0000 7fc1fc868700 1 --2- 172.21.15.72:0/988527 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc1f80ac800 0x7fc1f806a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-25T14:35:41.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:41.716+0000 7fc1fd86a700 1 --2- 172.21.15.72:0/988527 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc1f81ecb20 0x7fc1f81de970 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc1f8072940 tx=0x7fc1f00015b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:35:41.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:41.716+0000 7fc1edffb700 1 -- 172.21.15.72:0/988527 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1f0016040 con 0x7fc1f81ecb20 2023-07-25T14:35:41.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:41.716+0000 7fc1edffb700 1 -- 172.21.15.72:0/988527 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1f0005070 con 0x7fc1f81ecb20 2023-07-25T14:35:41.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:41.716+0000 7fc1ff2cd700 1 -- 172.21.15.72:0/988527 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1f80c5910 con 0x7fc1f81ecb20 2023-07-25T14:35:41.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:41.716+0000 7fc1edffb700 1 -- 172.21.15.72:0/988527 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1f00053e0 con 0x7fc1f81ecb20 2023-07-25T14:35:41.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:41.716+0000 7fc1ff2cd700 1 -- 172.21.15.72:0/988527 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1f8152180 con 0x7fc1f81ecb20 2023-07-25T14:35:41.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:41.717+0000 7fc1ff2cd700 1 -- 172.21.15.72:0/988527 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1f81e9550 con 0x7fc1f81ecb20 2023-07-25T14:35:41.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:41.718+0000 7fc1edffb700 1 -- 172.21.15.72:0/988527 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc1f0005540 con 0x7fc1f81ecb20 2023-07-25T14:35:41.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:41.718+0000 7fc1edffb700 1 --2- 172.21.15.72:0/988527 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fc1dc06ace0 0x7fc1dc06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:41.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:41.718+0000 7fc1fd069700 1 --2- 172.21.15.72:0/988527 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fc1dc06ace0 0x7fc1dc06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:41.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:41.718+0000 7fc1edffb700 1 -- 172.21.15.72:0/988527 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6288+0+0 (secure 0 0 0) 0x7fc1f008a590 con 0x7fc1f81ecb20 2023-07-25T14:35:41.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:41.718+0000 7fc1fd069700 1 --2- 172.21.15.72:0/988527 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fc1dc06ace0 0x7fc1dc06d1a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fc1f8154340 tx=0x7fc1f4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:35:41.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:41.723+0000 7fc1edffb700 1 -- 172.21.15.72:0/988527 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fc1f81e9550 con 0x7fc1f81ecb20 2023-07-25T14:35:41.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:41.907+0000 7fc1ff2cd700 1 -- 172.21.15.72:0/988527 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fc1f81e9550 con 0x7fc1f81ecb20 2023-07-25T14:35:43.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:43.584+0000 7fc1edffb700 1 -- 172.21.15.72:0/988527 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v23) v1 ==== 228+0+0 (secure 0 0 0) 0x7fc1f81e9550 con 0x7fc1f81ecb20 2023-07-25T14:35:43.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:43.589+0000 7fc1ff2cd700 1 -- 172.21.15.72:0/988527 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fc1dc06ace0 msgr2=0x7fc1dc06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:43.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:43.589+0000 7fc1ff2cd700 1 --2- 172.21.15.72:0/988527 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fc1dc06ace0 0x7fc1dc06d1a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fc1f8154340 tx=0x7fc1f4008040 comp rx=0 tx=0).stop 2023-07-25T14:35:43.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:43.589+0000 7fc1ff2cd700 1 -- 172.21.15.72:0/988527 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc1f81ecb20 msgr2=0x7fc1f81de970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:43.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:43.589+0000 7fc1ff2cd700 1 --2- 172.21.15.72:0/988527 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc1f81ecb20 0x7fc1f81de970 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc1f8072940 tx=0x7fc1f00015b0 comp rx=0 tx=0).stop 2023-07-25T14:35:43.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:43.589+0000 7fc1ff2cd700 1 -- 172.21.15.72:0/988527 shutdown_connections 2023-07-25T14:35:43.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:43.589+0000 7fc1ff2cd700 1 --2- 172.21.15.72:0/988527 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fc1dc06ace0 0x7fc1dc06d1a0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:43.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:43.589+0000 7fc1ff2cd700 1 --2- 172.21.15.72:0/988527 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc1e4005280 0x7fc1f81ea190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:43.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:43.589+0000 7fc1ff2cd700 1 --2- 172.21.15.72:0/988527 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc1f81ecb20 0x7fc1f81de970 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:43.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:43.589+0000 7fc1ff2cd700 1 --2- 172.21.15.72:0/988527 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc1f80ac800 0x7fc1f806a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:43.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:43.589+0000 7fc1ff2cd700 1 -- 172.21.15.72:0/988527 >> 172.21.15.72:0/988527 conn(0x7fc1f806b2a0 msgr2=0x7fc1f814f8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:35:43.604 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:43.593+0000 7fc1ff2cd700 1 -- 172.21.15.72:0/988527 shutdown_connections 2023-07-25T14:35:43.605 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:43.593+0000 7fc1ff2cd700 1 -- 172.21.15.72:0/988527 wait complete. 2023-07-25T14:35:43.609 INFO:teuthology.orchestra.run.smithi072.stderr:pool 'cephfs_data_ec' created 2023-07-25T14:35:43.622 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2023-07-25T14:35:43.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:43.739+0000 7f1f32706700 1 Processor -- start 2023-07-25T14:35:43.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:43.739+0000 7f1f32706700 1 -- start start 2023-07-25T14:35:43.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:43.740+0000 7f1f32706700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1f2c0c5b90 0x7f1f2c0c6d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:43.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:43.740+0000 7f1f32706700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f1f2c0c49d0 0x7f1f2c06db00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:43.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:43.740+0000 7f1f32706700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1f2c06e040 0x7f1f2c154c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:43.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:43.740+0000 7f1f32706700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f2c0c5250 con 0x7f1f2c06e040 2023-07-25T14:35:43.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:43.740+0000 7f1f32706700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f2c0c5530 con 0x7f1f2c0c49d0 2023-07-25T14:35:43.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:43.740+0000 7f1f32706700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f2c0c6520 con 0x7f1f2c0c5b90 2023-07-25T14:35:43.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:43.740+0000 7f1f30ca3700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1f2c06e040 0x7f1f2c154c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:43.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:43.740+0000 7f1f30ca3700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1f2c06e040 0x7f1f2c154c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:39430/0 (socket says 172.21.15.72:39430) 2023-07-25T14:35:43.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:43.740+0000 7f1f30ca3700 1 -- 172.21.15.72:0/2513821772 learned_addr learned my addr 172.21.15.72:0/2513821772 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:35:43.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:43.740+0000 7f1f2b7fe700 1 --2- 172.21.15.72:0/2513821772 >> v2:172.21.15.92:3300/0 conn(0x7f1f2c0c49d0 0x7f1f2c06db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:43.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:43.740+0000 7f1f2bfff700 1 --2- 172.21.15.72:0/2513821772 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1f2c0c5b90 0x7f1f2c0c6d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:43.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:43.740+0000 7f1f30ca3700 1 -- 172.21.15.72:0/2513821772 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1f2c0c5b90 msgr2=0x7f1f2c0c6d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:35:43.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:43.740+0000 7f1f30ca3700 1 --2- 172.21.15.72:0/2513821772 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1f2c0c5b90 0x7f1f2c0c6d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:43.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:43.740+0000 7f1f30ca3700 1 -- 172.21.15.72:0/2513821772 >> v2:172.21.15.92:3300/0 conn(0x7f1f2c0c49d0 msgr2=0x7f1f2c06db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:35:43.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:43.740+0000 7f1f30ca3700 1 --2- 172.21.15.72:0/2513821772 >> v2:172.21.15.92:3300/0 conn(0x7f1f2c0c49d0 0x7f1f2c06db00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:43.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:43.740+0000 7f1f30ca3700 1 -- 172.21.15.72:0/2513821772 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f2c0c6800 con 0x7f1f2c06e040 2023-07-25T14:35:43.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:43.740+0000 7f1f30ca3700 1 --2- 172.21.15.72:0/2513821772 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1f2c06e040 0x7f1f2c154c70 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f1f2c0a9650 tx=0x7f1f2400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9d0e16f19c00486 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:35:43.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:43.741+0000 7f1f2affd700 1 -- 172.21.15.72:0/2513821772 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f2400bbc0 con 0x7f1f2c06e040 2023-07-25T14:35:43.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:43.741+0000 7f1f2affd700 1 -- 172.21.15.72:0/2513821772 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f2400bd20 con 0x7f1f2c06e040 2023-07-25T14:35:43.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:43.741+0000 7f1f2affd700 1 -- 172.21.15.72:0/2513821772 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f240116a0 con 0x7f1f2c06e040 2023-07-25T14:35:43.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:43.741+0000 7f1f32706700 1 -- 172.21.15.72:0/2513821772 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1f2c06e040 msgr2=0x7f1f2c154c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:43.756 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:43.741+0000 7f1f32706700 1 --2- 172.21.15.72:0/2513821772 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1f2c06e040 0x7f1f2c154c70 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f1f2c0a9650 tx=0x7f1f2400b330 comp rx=0 tx=0).stop 2023-07-25T14:35:43.756 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:43.741+0000 7f1f32706700 1 -- 172.21.15.72:0/2513821772 shutdown_connections 2023-07-25T14:35:43.756 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:43.741+0000 7f1f32706700 1 --2- 172.21.15.72:0/2513821772 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1f2c06e040 0x7f1f2c154c70 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:43.756 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:43.741+0000 7f1f32706700 1 --2- 172.21.15.72:0/2513821772 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1f2c0c5b90 0x7f1f2c0c6d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:43.756 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:43.741+0000 7f1f32706700 1 --2- 172.21.15.72:0/2513821772 >> v2:172.21.15.92:3300/0 conn(0x7f1f2c0c49d0 0x7f1f2c06db00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:43.756 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:43.741+0000 7f1f32706700 1 -- 172.21.15.72:0/2513821772 >> 172.21.15.72:0/2513821772 conn(0x7f1f2c06bbc0 msgr2=0x7f1f2c0a8590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:35:43.756 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:43.741+0000 7f1f32706700 1 -- 172.21.15.72:0/2513821772 shutdown_connections 2023-07-25T14:35:43.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:43.741+0000 7f1f32706700 1 -- 172.21.15.72:0/2513821772 wait complete. 2023-07-25T14:35:43.759 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:43.743+0000 7f1f32706700 1 Processor -- start 2023-07-25T14:35:43.759 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:43.743+0000 7f1f32706700 1 -- start start 2023-07-25T14:35:43.759 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:43.744+0000 7f1f32706700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1f2c06e040 0x7f1f2c152f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:43.759 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:43.744+0000 7f1f32706700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1f2c0c49d0 0x7f1f2c14d840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:43.759 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:43.744+0000 7f1f32706700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1f2c0c5b90 0x7f1f2c1db600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:43.759 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:43.744+0000 7f1f32706700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f2c14e340 con 0x7f1f2c0c5b90 2023-07-25T14:35:43.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:43.744+0000 7f1f32706700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f2c0bc1b0 con 0x7f1f2c0c49d0 2023-07-25T14:35:43.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:43.744+0000 7f1f32706700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f2c0a87f0 con 0x7f1f2c06e040 2023-07-25T14:35:43.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:43.744+0000 7f1f30ca3700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1f2c0c5b90 0x7f1f2c1db600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:43.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:43.744+0000 7f1f30ca3700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1f2c0c5b90 0x7f1f2c1db600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:39436/0 (socket says 172.21.15.72:39436) 2023-07-25T14:35:43.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:43.744+0000 7f1f30ca3700 1 -- 172.21.15.72:0/3615744219 learned_addr learned my addr 172.21.15.72:0/3615744219 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:35:43.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:43.744+0000 7f1f2b7fe700 1 --2- 172.21.15.72:0/3615744219 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1f2c0c49d0 0x7f1f2c14d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:43.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:43.744+0000 7f1f2bfff700 1 --2- 172.21.15.72:0/3615744219 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1f2c06e040 0x7f1f2c152f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:43.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:43.744+0000 7f1f30ca3700 1 -- 172.21.15.72:0/3615744219 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1f2c06e040 msgr2=0x7f1f2c152f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:43.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:43.744+0000 7f1f30ca3700 1 --2- 172.21.15.72:0/3615744219 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1f2c06e040 0x7f1f2c152f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:43.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:43.744+0000 7f1f30ca3700 1 -- 172.21.15.72:0/3615744219 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1f2c0c49d0 msgr2=0x7f1f2c14d840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:43.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:43.744+0000 7f1f30ca3700 1 --2- 172.21.15.72:0/3615744219 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1f2c0c49d0 0x7f1f2c14d840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:43.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:43.744+0000 7f1f30ca3700 1 -- 172.21.15.72:0/3615744219 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f24009b30 con 0x7f1f2c0c5b90 2023-07-25T14:35:43.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:43.744+0000 7f1f2bfff700 1 --2- 172.21.15.72:0/3615744219 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1f2c06e040 0x7f1f2c152f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-25T14:35:43.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:43.744+0000 7f1f30ca3700 1 --2- 172.21.15.72:0/3615744219 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1f2c0c5b90 0x7f1f2c1db600 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f1f24014000 tx=0x7f1f24004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:35:43.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:43.744+0000 7f1f28ff9700 1 -- 172.21.15.72:0/3615744219 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f24020070 con 0x7f1f2c0c5b90 2023-07-25T14:35:43.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:43.744+0000 7f1f28ff9700 1 -- 172.21.15.72:0/3615744219 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f240092e0 con 0x7f1f2c0c5b90 2023-07-25T14:35:43.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:43.744+0000 7f1f32706700 1 -- 172.21.15.72:0/3615744219 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f2c1e99c0 con 0x7f1f2c0c5b90 2023-07-25T14:35:43.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:43.744+0000 7f1f28ff9700 1 -- 172.21.15.72:0/3615744219 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f24004450 con 0x7f1f2c0c5b90 2023-07-25T14:35:43.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:43.744+0000 7f1f32706700 1 -- 172.21.15.72:0/3615744219 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f2c0a77c0 con 0x7f1f2c0c5b90 2023-07-25T14:35:43.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:43.745+0000 7f1f32706700 1 -- 172.21.15.72:0/3615744219 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f2c0abe00 con 0x7f1f2c0c5b90 2023-07-25T14:35:43.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:43.746+0000 7f1f28ff9700 1 -- 172.21.15.72:0/3615744219 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1f240045b0 con 0x7f1f2c0c5b90 2023-07-25T14:35:43.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:43.746+0000 7f1f28ff9700 1 --2- 172.21.15.72:0/3615744219 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f1f1806ace0 0x7f1f1806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:43.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:43.746+0000 7f1f28ff9700 1 -- 172.21.15.72:0/3615744219 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6781+0+0 (secure 0 0 0) 0x7f1f2408cca0 con 0x7f1f2c0c5b90 2023-07-25T14:35:43.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:43.746+0000 7f1f2bfff700 1 --2- 172.21.15.72:0/3615744219 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f1f1806ace0 0x7f1f1806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:43.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:43.746+0000 7f1f2bfff700 1 --2- 172.21.15.72:0/3615744219 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f1f1806ace0 0x7f1f1806d1a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f1f2c0c4550 tx=0x7f1f20008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:35:43.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:43.751+0000 7f1f28ff9700 1 -- 172.21.15.72:0/3615744219 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f1f24057c30 con 0x7f1f2c0c5b90 2023-07-25T14:35:43.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:43.937+0000 7f1f32706700 1 -- 172.21.15.72:0/3615744219 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) v1 -- 0x7f1f2c1dc310 con 0x7f1f2c0c5b90 2023-07-25T14:35:44.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:44.588+0000 7f1f28ff9700 1 -- 172.21.15.72:0/3615744219 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 5 allow_ec_overwrites to true v24) v1 ==== 169+0+0 (secure 0 0 0) 0x7f1f2c1dc310 con 0x7f1f2c0c5b90 2023-07-25T14:35:44.605 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:44.592+0000 7f1f32706700 1 -- 172.21.15.72:0/3615744219 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f1f1806ace0 msgr2=0x7f1f1806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:44.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:44.592+0000 7f1f32706700 1 --2- 172.21.15.72:0/3615744219 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f1f1806ace0 0x7f1f1806d1a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f1f2c0c4550 tx=0x7f1f20008040 comp rx=0 tx=0).stop 2023-07-25T14:35:44.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:44.592+0000 7f1f32706700 1 -- 172.21.15.72:0/3615744219 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1f2c0c5b90 msgr2=0x7f1f2c1db600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:44.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:44.592+0000 7f1f32706700 1 --2- 172.21.15.72:0/3615744219 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1f2c0c5b90 0x7f1f2c1db600 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f1f24014000 tx=0x7f1f24004ad0 comp rx=0 tx=0).stop 2023-07-25T14:35:44.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:44.593+0000 7f1f32706700 1 -- 172.21.15.72:0/3615744219 shutdown_connections 2023-07-25T14:35:44.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:44.593+0000 7f1f32706700 1 --2- 172.21.15.72:0/3615744219 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f1f1806ace0 0x7f1f1806d1a0 secure :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f1f2c0c4550 tx=0x7f1f20008040 comp rx=0 tx=0).stop 2023-07-25T14:35:44.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:44.594+0000 7f1f32706700 1 --2- 172.21.15.72:0/3615744219 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1f2c06e040 0x7f1f2c152f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:44.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:44.594+0000 7f1f32706700 1 --2- 172.21.15.72:0/3615744219 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1f2c0c5b90 0x7f1f2c1db600 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:44.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:44.594+0000 7f1f32706700 1 --2- 172.21.15.72:0/3615744219 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1f2c0c49d0 0x7f1f2c14d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:44.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:44.594+0000 7f1f32706700 1 -- 172.21.15.72:0/3615744219 >> 172.21.15.72:0/3615744219 conn(0x7f1f2c06bbc0 msgr2=0x7f1f2c0c3c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:35:44.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:44.597+0000 7f1f32706700 1 -- 172.21.15.72:0/3615744219 shutdown_connections 2023-07-25T14:35:44.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:44.597+0000 7f1f32706700 1 -- 172.21.15.72:0/3615744219 wait complete. 2023-07-25T14:35:44.619 INFO:teuthology.orchestra.run.smithi072.stderr:set pool 5 allow_ec_overwrites to true 2023-07-25T14:35:44.637 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2023-07-25T14:35:44.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:44.750+0000 7f942258b700 1 Processor -- start 2023-07-25T14:35:44.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:44.750+0000 7f942258b700 1 -- start start 2023-07-25T14:35:44.764 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:44.751+0000 7f942258b700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f941c151950 0x7f941c06a190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:44.764 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:44.751+0000 7f942258b700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f941c0724c0 0x7f941c0c34c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:44.764 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:44.751+0000 7f942258b700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f941c0c2fe0 con 0x7f941c06a6d0 2023-07-25T14:35:44.764 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:44.751+0000 7f942258b700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f941c071a60 con 0x7f941c0724c0 2023-07-25T14:35:44.764 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:44.751+0000 7f942258b700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f941c0c2a70 con 0x7f941c151950 2023-07-25T14:35:44.765 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:44.751+0000 7f941b7fe700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f941c0724c0 0x7f941c0c34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:44.765 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:44.751+0000 7f941bfff700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f941c151950 0x7f941c06a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:44.765 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:44.751+0000 7f9420b28700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f941c06a6d0 0x7f941c0c3a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.72:53754/0 (socket says 172.21.15.72:53754) 2023-07-25T14:35:44.765 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:44.751+0000 7f9420b28700 1 -- 172.21.15.72:0/3655219565 learned_addr learned my addr 172.21.15.72:0/3655219565 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:35:44.765 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:44.751+0000 7f941b7fe700 1 -- 172.21.15.72:0/3655219565 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f941c151950 msgr2=0x7f941c06a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:35:44.765 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:44.751+0000 7f941b7fe700 1 --2- 172.21.15.72:0/3655219565 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f941c151950 0x7f941c06a190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:44.765 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:44.751+0000 7f941b7fe700 1 -- 172.21.15.72:0/3655219565 >> v1:172.21.15.92:6789/0 conn(0x7f941c06a6d0 legacy=0x7f941c0c3a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:44.765 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:44.751+0000 7f941b7fe700 1 -- 172.21.15.72:0/3655219565 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f941c155070 con 0x7f941c0724c0 2023-07-25T14:35:44.766 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:44.751+0000 7f941bfff700 1 --2- 172.21.15.72:0/3655219565 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f941c151950 0x7f941c06a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-25T14:35:44.766 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:44.752+0000 7f941b7fe700 1 --2- 172.21.15.72:0/3655219565 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f941c0724c0 0x7f941c0c34c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f940c009840 tx=0x7f940c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=39a41735214fd464 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:35:44.766 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:44.752+0000 7f941affd700 1 -- 172.21.15.72:0/3655219565 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f940c011830 con 0x7f941c0724c0 2023-07-25T14:35:44.766 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:44.752+0000 7f941affd700 1 -- 172.21.15.72:0/3655219565 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f940c011990 con 0x7f941c0724c0 2023-07-25T14:35:44.766 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:44.752+0000 7f941affd700 1 -- 172.21.15.72:0/3655219565 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f940c011d20 con 0x7f941c0724c0 2023-07-25T14:35:44.766 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:44.752+0000 7f942258b700 1 -- 172.21.15.72:0/3655219565 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f941c0724c0 msgr2=0x7f941c0c34c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:44.766 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:44.752+0000 7f942258b700 1 --2- 172.21.15.72:0/3655219565 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f941c0724c0 0x7f941c0c34c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f940c009840 tx=0x7f940c009b50 comp rx=0 tx=0).stop 2023-07-25T14:35:44.766 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:44.752+0000 7f942258b700 1 -- 172.21.15.72:0/3655219565 shutdown_connections 2023-07-25T14:35:44.767 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:44.752+0000 7f942258b700 1 --2- 172.21.15.72:0/3655219565 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f941c151950 0x7f941c06a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:44.767 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:44.752+0000 7f942258b700 1 --2- 172.21.15.72:0/3655219565 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f941c0724c0 0x7f941c0c34c0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:44.767 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:44.752+0000 7f942258b700 1 -- 172.21.15.72:0/3655219565 >> 172.21.15.72:0/3655219565 conn(0x7f941c0a87e0 msgr2=0x7f941c0a8bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:35:44.767 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:44.752+0000 7f942258b700 1 -- 172.21.15.72:0/3655219565 shutdown_connections 2023-07-25T14:35:44.767 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:44.752+0000 7f942258b700 1 -- 172.21.15.72:0/3655219565 wait complete. 2023-07-25T14:35:44.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:44.753+0000 7f942258b700 1 Processor -- start 2023-07-25T14:35:44.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:44.754+0000 7f942258b700 1 -- start start 2023-07-25T14:35:44.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:44.754+0000 7f942258b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f941c06a6d0 0x7f941c14da50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:44.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:44.754+0000 7f942258b700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f941c0724c0 0x7f941c14d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:44.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:44.754+0000 7f942258b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f941c151950 0x7f941c1ed110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:44.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:44.754+0000 7f942258b700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f941c14e0c0 con 0x7f941c151950 2023-07-25T14:35:44.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:44.754+0000 7f942258b700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f941c0ac710 con 0x7f941c06a6d0 2023-07-25T14:35:44.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:44.754+0000 7f942258b700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f941c0ac9f0 con 0x7f941c0724c0 2023-07-25T14:35:44.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:44.754+0000 7f9420b28700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f941c151950 0x7f941c1ed110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:44.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:44.754+0000 7f9420b28700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f941c151950 0x7f941c1ed110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:39450/0 (socket says 172.21.15.72:39450) 2023-07-25T14:35:44.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:44.754+0000 7f9420b28700 1 -- 172.21.15.72:0/33777872 learned_addr learned my addr 172.21.15.72:0/33777872 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:35:44.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:44.755+0000 7f941b7fe700 1 --2- 172.21.15.72:0/33777872 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f941c0724c0 0x7f941c14d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:44.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:44.755+0000 7f941bfff700 1 --2- 172.21.15.72:0/33777872 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f941c06a6d0 0x7f941c14da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:44.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:44.755+0000 7f9420b28700 1 -- 172.21.15.72:0/33777872 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f941c0724c0 msgr2=0x7f941c14d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:44.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:44.755+0000 7f9420b28700 1 --2- 172.21.15.72:0/33777872 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f941c0724c0 0x7f941c14d1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:44.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:44.755+0000 7f9420b28700 1 -- 172.21.15.72:0/33777872 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f941c06a6d0 msgr2=0x7f941c14da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:44.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:44.755+0000 7f9420b28700 1 --2- 172.21.15.72:0/33777872 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f941c06a6d0 0x7f941c14da50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:44.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:44.755+0000 7f9420b28700 1 -- 172.21.15.72:0/33777872 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94100094a0 con 0x7f941c151950 2023-07-25T14:35:44.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:44.755+0000 7f941bfff700 1 --2- 172.21.15.72:0/33777872 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f941c06a6d0 0x7f941c14da50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-25T14:35:44.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:44.755+0000 7f9420b28700 1 --2- 172.21.15.72:0/33777872 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f941c151950 0x7f941c1ed110 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f941400cbc0 tx=0x7f941400ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:35:44.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:44.755+0000 7f9418ff9700 1 -- 172.21.15.72:0/33777872 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f941400aaa0 con 0x7f941c151950 2023-07-25T14:35:44.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:44.755+0000 7f9418ff9700 1 -- 172.21.15.72:0/33777872 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f941400ac00 con 0x7f941c151950 2023-07-25T14:35:44.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:44.755+0000 7f942258b700 1 -- 172.21.15.72:0/33777872 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f940c0094a0 con 0x7f941c151950 2023-07-25T14:35:44.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:44.755+0000 7f9418ff9700 1 -- 172.21.15.72:0/33777872 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9414012400 con 0x7f941c151950 2023-07-25T14:35:44.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:44.755+0000 7f942258b700 1 -- 172.21.15.72:0/33777872 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f941c158530 con 0x7f941c151950 2023-07-25T14:35:44.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:44.756+0000 7f942258b700 1 -- 172.21.15.72:0/33777872 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f941c0ac850 con 0x7f941c151950 2023-07-25T14:35:44.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:44.757+0000 7f9418ff9700 1 -- 172.21.15.72:0/33777872 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f941401b3b0 con 0x7f941c151950 2023-07-25T14:35:44.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:44.757+0000 7f9418ff9700 1 --2- 172.21.15.72:0/33777872 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f940806ace0 0x7f940806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:44.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:44.757+0000 7f9418ff9700 1 -- 172.21.15.72:0/33777872 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6781+0+0 (secure 0 0 0) 0x7f9414089260 con 0x7f941c151950 2023-07-25T14:35:44.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:44.757+0000 7f941bfff700 1 --2- 172.21.15.72:0/33777872 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f940806ace0 0x7f940806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:44.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:44.757+0000 7f941bfff700 1 --2- 172.21.15.72:0/33777872 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f940806ace0 0x7f940806d1a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f9410009d20 tx=0x7f9410008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:35:44.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:44.761+0000 7f9418ff9700 1 -- 172.21.15.72:0/33777872 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f941c0ac850 con 0x7f941c151950 2023-07-25T14:35:45.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:44.991+0000 7f942258b700 1 -- 172.21.15.72:0/33777872 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) v1 -- 0x7f941c1eca50 con 0x7f941c151950 2023-07-25T14:35:45.524 INFO:tasks.ceph.mds.b.smithi092.stderr:2023-07-25T14:35:45.512+0000 7f4851d49700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-25T14:35:45.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:45.595+0000 7f9418ff9700 1 -- 172.21.15.72:0/33777872 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 5 to fsmap v6) v1 ==== 137+0+0 (secure 0 0 0) 0x7f941c1eca50 con 0x7f941c151950 2023-07-25T14:35:45.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:45.598+0000 7f942258b700 1 -- 172.21.15.72:0/33777872 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f940806ace0 msgr2=0x7f940806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:45.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:45.598+0000 7f942258b700 1 --2- 172.21.15.72:0/33777872 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f940806ace0 0x7f940806d1a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f9410009d20 tx=0x7f9410008040 comp rx=0 tx=0).stop 2023-07-25T14:35:45.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:45.598+0000 7f942258b700 1 -- 172.21.15.72:0/33777872 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f941c151950 msgr2=0x7f941c1ed110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:45.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:45.598+0000 7f942258b700 1 --2- 172.21.15.72:0/33777872 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f941c151950 0x7f941c1ed110 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f941400cbc0 tx=0x7f941400ced0 comp rx=0 tx=0).stop 2023-07-25T14:35:45.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:45.598+0000 7f942258b700 1 -- 172.21.15.72:0/33777872 shutdown_connections 2023-07-25T14:35:45.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:45.598+0000 7f942258b700 1 --2- 172.21.15.72:0/33777872 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f940806ace0 0x7f940806d1a0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:45.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:45.598+0000 7f942258b700 1 --2- 172.21.15.72:0/33777872 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f941c151950 0x7f941c1ed110 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:45.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:45.598+0000 7f942258b700 1 --2- 172.21.15.72:0/33777872 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f941c06a6d0 0x7f941c14da50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:45.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:45.598+0000 7f942258b700 1 --2- 172.21.15.72:0/33777872 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f941c0724c0 0x7f941c14d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:45.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:45.598+0000 7f942258b700 1 -- 172.21.15.72:0/33777872 >> 172.21.15.72:0/33777872 conn(0x7f941c0a87e0 msgr2=0x7f941c0c45e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:35:45.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:45.598+0000 7f942258b700 1 -- 172.21.15.72:0/33777872 shutdown_connections 2023-07-25T14:35:45.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:45.598+0000 7f942258b700 1 -- 172.21.15.72:0/33777872 wait complete. 2023-07-25T14:35:45.611 INFO:teuthology.orchestra.run.smithi072.stderr:added data pool 5 to fsmap 2023-07-25T14:35:45.622 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-25T14:35:45.651 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T14:35:45.666 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T14:35:45.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:45.734+0000 7f03db293700 1 Processor -- start 2023-07-25T14:35:45.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:45.734+0000 7f03db293700 1 -- start start 2023-07-25T14:35:45.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:45.735+0000 7f03db293700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f03d414f810 0x7f03d40c4370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:45.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:45.735+0000 7f03db293700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03d40c5890 con 0x7f03d40a9cc0 2023-07-25T14:35:45.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:45.735+0000 7f03db293700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03d4152150 con 0x7f03d40bb0b0 2023-07-25T14:35:45.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:45.735+0000 7f03db293700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03d414fbf0 con 0x7f03d414f810 2023-07-25T14:35:45.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:45.735+0000 7f03d882e700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f03d40a9cc0 0x7f03d41525e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:58424/0 (socket says 172.21.15.72:58424) 2023-07-25T14:35:45.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:45.735+0000 7f03d882e700 1 -- 172.21.15.72:0/3439734539 learned_addr learned my addr 172.21.15.72:0/3439734539 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:35:45.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:45.735+0000 7f03cbfff700 1 -- 172.21.15.72:0/3439734539 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1534962503 0 0) 0x7f03d40c5890 con 0x7f03d40a9cc0 2023-07-25T14:35:45.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:45.735+0000 7f03cbfff700 1 -- 172.21.15.72:0/3439734539 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f03c00035b0 con 0x7f03d40a9cc0 2023-07-25T14:35:45.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:45.735+0000 7f03d902f700 1 --2- 172.21.15.72:0/3439734539 >> v2:172.21.15.92:3300/0 conn(0x7f03d414f810 0x7f03d40c4370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:45.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:45.735+0000 7f03cbfff700 1 -- 172.21.15.72:0/3439734539 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3103337145 0 0) 0x7f03c00035b0 con 0x7f03d40a9cc0 2023-07-25T14:35:45.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:45.735+0000 7f03cbfff700 1 -- 172.21.15.72:0/3439734539 >> v2:172.21.15.92:3300/0 conn(0x7f03d414f810 msgr2=0x7f03d40c4370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:35:45.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:45.735+0000 7f03cbfff700 1 --2- 172.21.15.72:0/3439734539 >> v2:172.21.15.92:3300/0 conn(0x7f03d414f810 0x7f03d40c4370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:45.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:45.735+0000 7f03cbfff700 1 -- 172.21.15.72:0/3439734539 >> v1:172.21.15.92:6789/0 conn(0x7f03d40bb0b0 legacy=0x7f03d415cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:45.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:45.735+0000 7f03cbfff700 1 -- 172.21.15.72:0/3439734539 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03d41566a0 con 0x7f03d40a9cc0 2023-07-25T14:35:45.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:45.736+0000 7f03cbfff700 1 -- 172.21.15.72:0/3439734539 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2559588315 0 0) 0x7f03d0001670 con 0x7f03d40a9cc0 2023-07-25T14:35:45.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:45.736+0000 7f03cbfff700 1 -- 172.21.15.72:0/3439734539 >> v1:172.21.15.72:6789/0 conn(0x7f03d40a9cc0 legacy=0x7f03d41525e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:45.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:45.736+0000 7f03cbfff700 1 --2- 172.21.15.72:0/3439734539 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f03c0003a00 0x7f03c0003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:45.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:45.736+0000 7f03cbfff700 1 --2- 172.21.15.72:0/3439734539 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f03c0004850 0x7f03c0004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:45.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:45.736+0000 7f03cbfff700 1 --2- 172.21.15.72:0/3439734539 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f03c0005330 0x7f03c000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:45.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:45.736+0000 7f03cbfff700 1 -- 172.21.15.72:0/3439734539 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03d414fbf0 con 0x7f03c0005330 2023-07-25T14:35:45.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:45.736+0000 7f03cbfff700 1 -- 172.21.15.72:0/3439734539 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03c000c200 con 0x7f03c0004850 2023-07-25T14:35:45.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:45.736+0000 7f03cbfff700 1 -- 172.21.15.72:0/3439734539 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03c000c3c0 con 0x7f03c0003a00 2023-07-25T14:35:45.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:45.736+0000 7f03d9830700 1 --2- 172.21.15.72:0/3439734539 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f03c0005330 0x7f03c000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:45.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:45.736+0000 7f03d882e700 1 --2- 172.21.15.72:0/3439734539 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f03c0004850 0x7f03c0004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:45.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:45.736+0000 7f03d902f700 1 --2- 172.21.15.72:0/3439734539 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f03c0003a00 0x7f03c0003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:45.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:45.736+0000 7f03d9830700 1 -- 172.21.15.72:0/3439734539 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f03c0003a00 msgr2=0x7f03c0003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:35:45.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:45.736+0000 7f03d9830700 1 --2- 172.21.15.72:0/3439734539 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f03c0003a00 0x7f03c0003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:45.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:45.736+0000 7f03d9830700 1 -- 172.21.15.72:0/3439734539 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f03c0004850 msgr2=0x7f03c0004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:35:45.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:45.736+0000 7f03d9830700 1 --2- 172.21.15.72:0/3439734539 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f03c0004850 0x7f03c0004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:45.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:45.736+0000 7f03d9830700 1 -- 172.21.15.72:0/3439734539 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03c00035b0 con 0x7f03c0005330 2023-07-25T14:35:45.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:45.736+0000 7f03d9830700 1 -- 172.21.15.72:0/3439734539 reap_dead start 2023-07-25T14:35:45.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:45.736+0000 7f03d9830700 1 --2- 172.21.15.72:0/3439734539 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f03c0005330 0x7f03c000ba10 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f03d40c78b0 tx=0x7f03c0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59dfb42973dcb348 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:35:45.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:45.736+0000 7f03cbfff700 1 -- 172.21.15.72:0/3439734539 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03cc001de0 con 0x7f03c0005330 2023-07-25T14:35:45.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:45.736+0000 7f03cbfff700 1 -- 172.21.15.72:0/3439734539 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03cc00ccb0 con 0x7f03c0005330 2023-07-25T14:35:45.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:45.736+0000 7f03cbfff700 1 -- 172.21.15.72:0/3439734539 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03cc003c90 con 0x7f03c0005330 2023-07-25T14:35:45.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:45.737+0000 7f03db293700 1 -- 172.21.15.72:0/3439734539 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f03c0005330 msgr2=0x7f03c000ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:45.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:45.737+0000 7f03db293700 1 --2- 172.21.15.72:0/3439734539 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f03c0005330 0x7f03c000ba10 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f03d40c78b0 tx=0x7f03c0005880 comp rx=0 tx=0).stop 2023-07-25T14:35:45.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:45.737+0000 7f03db293700 1 -- 172.21.15.72:0/3439734539 shutdown_connections 2023-07-25T14:35:45.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:45.737+0000 7f03db293700 1 --2- 172.21.15.72:0/3439734539 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f03c0005330 0x7f03c000ba10 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:45.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:45.737+0000 7f03db293700 1 -- 172.21.15.72:0/3439734539 >> 172.21.15.72:0/3439734539 conn(0x7f03d406a8d0 msgr2=0x7f03d40a94e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:35:45.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:45.737+0000 7f03db293700 1 -- 172.21.15.72:0/3439734539 shutdown_connections 2023-07-25T14:35:45.756 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:45.737+0000 7f03db293700 1 -- 172.21.15.72:0/3439734539 wait complete. 2023-07-25T14:35:45.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:45.738+0000 7f03db293700 1 Processor -- start 2023-07-25T14:35:45.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:45.738+0000 7f03db293700 1 -- start start 2023-07-25T14:35:45.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:45.739+0000 7f03db293700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f03c0005330 0x7f03d414c120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:45.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:45.739+0000 7f03db293700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f03d40c0a60 0x7f03d40c0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:45.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:45.739+0000 7f03db293700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f03d41e9620 0x7f03d41e9aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:45.759 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:45.739+0000 7f03db293700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03d406c420 con 0x7f03d41e9620 2023-07-25T14:35:45.759 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:45.739+0000 7f03db293700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03d406ccb0 con 0x7f03c0005330 2023-07-25T14:35:45.759 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:45.739+0000 7f03db293700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03d406cf90 con 0x7f03d40c0a60 2023-07-25T14:35:45.759 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:45.739+0000 7f03d9830700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f03d41e9620 0x7f03d41e9aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:45.759 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:45.739+0000 7f03d9830700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f03d41e9620 0x7f03d41e9aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:39470/0 (socket says 172.21.15.72:39470) 2023-07-25T14:35:45.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:45.739+0000 7f03d9830700 1 -- 172.21.15.72:0/2732456598 learned_addr learned my addr 172.21.15.72:0/2732456598 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:35:45.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:45.739+0000 7f03d902f700 1 --2- 172.21.15.72:0/2732456598 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f03c0005330 0x7f03d414c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:45.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:45.739+0000 7f03d882e700 1 --2- 172.21.15.72:0/2732456598 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f03d40c0a60 0x7f03d40c0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:45.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:45.739+0000 7f03d9830700 1 -- 172.21.15.72:0/2732456598 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f03d40c0a60 msgr2=0x7f03d40c0ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:45.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:45.739+0000 7f03d9830700 1 --2- 172.21.15.72:0/2732456598 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f03d40c0a60 0x7f03d40c0ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:45.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:45.739+0000 7f03d9830700 1 -- 172.21.15.72:0/2732456598 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f03c0005330 msgr2=0x7f03d414c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:45.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:45.739+0000 7f03d9830700 1 --2- 172.21.15.72:0/2732456598 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f03c0005330 0x7f03d414c120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:45.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:45.739+0000 7f03d9830700 1 -- 172.21.15.72:0/2732456598 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03d406d270 con 0x7f03d41e9620 2023-07-25T14:35:45.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:45.739+0000 7f03d9830700 1 --2- 172.21.15.72:0/2732456598 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f03d41e9620 0x7f03d41e9aa0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f03cc005040 tx=0x7f03cc0014f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:35:45.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:45.739+0000 7f03c9ffb700 1 -- 172.21.15.72:0/2732456598 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03cc003e60 con 0x7f03d41e9620 2023-07-25T14:35:45.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:45.739+0000 7f03c9ffb700 1 -- 172.21.15.72:0/2732456598 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03cc0050d0 con 0x7f03d41e9620 2023-07-25T14:35:45.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:45.739+0000 7f03db293700 1 -- 172.21.15.72:0/2732456598 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03d406c040 con 0x7f03d41e9620 2023-07-25T14:35:45.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:45.739+0000 7f03c9ffb700 1 -- 172.21.15.72:0/2732456598 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03cc005460 con 0x7f03d41e9620 2023-07-25T14:35:45.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:45.739+0000 7f03db293700 1 -- 172.21.15.72:0/2732456598 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03d40a6e40 con 0x7f03d41e9620 2023-07-25T14:35:45.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:45.740+0000 7f03db293700 1 -- 172.21.15.72:0/2732456598 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03d406c200 con 0x7f03d41e9620 2023-07-25T14:35:45.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:45.741+0000 7f03c9ffb700 1 -- 172.21.15.72:0/2732456598 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f03cc0055c0 con 0x7f03d41e9620 2023-07-25T14:35:45.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:45.741+0000 7f03c9ffb700 1 --2- 172.21.15.72:0/2732456598 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f03b806ace0 0x7f03b806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:45.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:45.741+0000 7f03d902f700 1 --2- 172.21.15.72:0/2732456598 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f03b806ace0 0x7f03b806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:45.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:45.741+0000 7f03c9ffb700 1 -- 172.21.15.72:0/2732456598 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f03cc08a950 con 0x7f03d41e9620 2023-07-25T14:35:45.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:45.742+0000 7f03d902f700 1 --2- 172.21.15.72:0/2732456598 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f03b806ace0 0x7f03b806d1a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f03c4009980 tx=0x7f03c4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:35:45.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:45.746+0000 7f03c9ffb700 1 -- 172.21.15.72:0/2732456598 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f03cc0557a0 con 0x7f03d41e9620 2023-07-25T14:35:45.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:45.973+0000 7f03db293700 1 -- 172.21.15.72:0/2732456598 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f03d40ad9a0 con 0x7f03d41e9620 2023-07-25T14:35:45.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:45.974+0000 7f03c9ffb700 1 -- 172.21.15.72:0/2732456598 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4664 (secure 0 0 0) 0x7f03cc058dc0 con 0x7f03d41e9620 2023-07-25T14:35:45.986 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-25T14:35:45.986 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4220,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6836/4293785067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":4293785067},{"type":"v1","addr":"172.21.15.72:6836","nonce":4293785067}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4229,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6834/681290755","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":681290755},{"type":"v1","addr":"172.21.15.92:6834","nonce":681290755}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6837/3376375642","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6835","nonce":3376375642},{"type":"v1","addr":"172.21.15.72:6837","nonce":3376375642}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-25T14:35:39.939860+0000","modified":"2023-07-25T14:35:45.587223+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.92:6835/2045555979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6833","nonce":2045555979},{"type":"v1","addr":"172.21.15.92:6835","nonce":2045555979}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-07-25T14:35:45.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:45.976+0000 7f03db293700 1 -- 172.21.15.72:0/2732456598 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f03b806ace0 msgr2=0x7f03b806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:45.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:45.976+0000 7f03db293700 1 --2- 172.21.15.72:0/2732456598 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f03b806ace0 0x7f03b806d1a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f03c4009980 tx=0x7f03c4008040 comp rx=0 tx=0).stop 2023-07-25T14:35:45.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:45.976+0000 7f03db293700 1 -- 172.21.15.72:0/2732456598 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f03d41e9620 msgr2=0x7f03d41e9aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:45.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:45.976+0000 7f03db293700 1 --2- 172.21.15.72:0/2732456598 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f03d41e9620 0x7f03d41e9aa0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f03cc005040 tx=0x7f03cc0014f0 comp rx=0 tx=0).stop 2023-07-25T14:35:45.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:45.976+0000 7f03db293700 1 -- 172.21.15.72:0/2732456598 shutdown_connections 2023-07-25T14:35:45.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:45.976+0000 7f03db293700 1 --2- 172.21.15.72:0/2732456598 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f03b806ace0 0x7f03b806d1a0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:45.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:45.976+0000 7f03db293700 1 --2- 172.21.15.72:0/2732456598 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f03d41e9620 0x7f03d41e9aa0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:45.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:45.976+0000 7f03db293700 1 --2- 172.21.15.72:0/2732456598 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f03c0005330 0x7f03d414c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:45.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:45.976+0000 7f03db293700 1 --2- 172.21.15.72:0/2732456598 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f03d40c0a60 0x7f03d40c0ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:45.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:45.976+0000 7f03db293700 1 -- 172.21.15.72:0/2732456598 >> 172.21.15.72:0/2732456598 conn(0x7f03d406a8d0 msgr2=0x7f03d4151820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:35:45.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:45.976+0000 7f03db293700 1 -- 172.21.15.72:0/2732456598 shutdown_connections 2023-07-25T14:35:45.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:45.976+0000 7f03db293700 1 -- 172.21.15.72:0/2732456598 wait complete. 2023-07-25T14:35:45.991 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 6 2023-07-25T14:35:46.001 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-25T14:35:46.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.148+0000 7f4b33f8d700 1 Processor -- start 2023-07-25T14:35:46.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.149+0000 7f4b33f8d700 1 -- start start 2023-07-25T14:35:46.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.149+0000 7f4b33f8d700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4b2c0c5f40 0x7f4b2c154640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:46.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.149+0000 7f4b33f8d700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f4b2c0ba0e0 0x7f4b2c154b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:46.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.149+0000 7f4b33f8d700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b2c0c54f0 con 0x7f4b2c151ba0 2023-07-25T14:35:46.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.149+0000 7f4b33f8d700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b2c0c6670 con 0x7f4b2c0ba0e0 2023-07-25T14:35:46.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.149+0000 7f4b33f8d700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b2c0c5740 con 0x7f4b2c0c5f40 2023-07-25T14:35:46.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.149+0000 7f4b31d29700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f4b2c151ba0 0x7f4b2c0c2230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:58442/0 (socket says 172.21.15.72:58442) 2023-07-25T14:35:46.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.149+0000 7f4b31d29700 1 -- 172.21.15.72:0/3009106494 learned_addr learned my addr 172.21.15.72:0/3009106494 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:35:46.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.150+0000 7f4b3252a700 1 --2- 172.21.15.72:0/3009106494 >> v2:172.21.15.92:3300/0 conn(0x7f4b2c0ba0e0 0x7f4b2c154b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:46.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.150+0000 7f4b31528700 1 --2- 172.21.15.72:0/3009106494 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4b2c0c5f40 0x7f4b2c154640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:46.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.150+0000 7f4b30d27700 1 -- 172.21.15.72:0/3009106494 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3891371420 0 0) 0x7f4b2c0c54f0 con 0x7f4b2c151ba0 2023-07-25T14:35:46.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.150+0000 7f4b30d27700 1 -- 172.21.15.72:0/3009106494 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4b180035b0 con 0x7f4b2c151ba0 2023-07-25T14:35:46.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.150+0000 7f4b30d27700 1 -- 172.21.15.72:0/3009106494 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2375423692 0 0) 0x7f4b180035b0 con 0x7f4b2c151ba0 2023-07-25T14:35:46.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.150+0000 7f4b3252a700 1 -- 172.21.15.72:0/3009106494 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4b2c0c5f40 msgr2=0x7f4b2c154640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:35:46.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.150+0000 7f4b3252a700 1 --2- 172.21.15.72:0/3009106494 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4b2c0c5f40 0x7f4b2c154640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:46.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.150+0000 7f4b3252a700 1 -- 172.21.15.72:0/3009106494 >> v1:172.21.15.72:6789/0 conn(0x7f4b2c151ba0 legacy=0x7f4b2c0c2230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:46.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.150+0000 7f4b3252a700 1 -- 172.21.15.72:0/3009106494 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b2c0c5a20 con 0x7f4b2c0ba0e0 2023-07-25T14:35:46.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.150+0000 7f4b31528700 1 --2- 172.21.15.72:0/3009106494 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4b2c0c5f40 0x7f4b2c154640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-25T14:35:46.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.150+0000 7f4b3252a700 1 --2- 172.21.15.72:0/3009106494 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4b2c0ba0e0 0x7f4b2c154b80 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f4b24009d90 tx=0x7f4b2400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a1551c58301dec1d server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:35:46.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.150+0000 7f4b30d27700 1 -- 172.21.15.72:0/3009106494 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b2400e070 con 0x7f4b2c0ba0e0 2023-07-25T14:35:46.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.150+0000 7f4b30d27700 1 -- 172.21.15.72:0/3009106494 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b24003a20 con 0x7f4b2c0ba0e0 2023-07-25T14:35:46.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.150+0000 7f4b30d27700 1 -- 172.21.15.72:0/3009106494 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b1c001670 con 0x7f4b2c0ba0e0 2023-07-25T14:35:46.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.151+0000 7f4b33f8d700 1 -- 172.21.15.72:0/3009106494 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4b2c0ba0e0 msgr2=0x7f4b2c154b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:46.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.151+0000 7f4b33f8d700 1 --2- 172.21.15.72:0/3009106494 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4b2c0ba0e0 0x7f4b2c154b80 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f4b24009d90 tx=0x7f4b2400b330 comp rx=0 tx=0).stop 2023-07-25T14:35:46.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.151+0000 7f4b33f8d700 1 -- 172.21.15.72:0/3009106494 shutdown_connections 2023-07-25T14:35:46.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.151+0000 7f4b33f8d700 1 --2- 172.21.15.72:0/3009106494 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4b2c0ba0e0 0x7f4b2c154b80 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:46.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.151+0000 7f4b33f8d700 1 --2- 172.21.15.72:0/3009106494 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4b2c0c5f40 0x7f4b2c154640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:46.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.151+0000 7f4b33f8d700 1 -- 172.21.15.72:0/3009106494 >> 172.21.15.72:0/3009106494 conn(0x7f4b2c0a87e0 msgr2=0x7f4b2c0a8bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:35:46.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.151+0000 7f4b33f8d700 1 -- 172.21.15.72:0/3009106494 shutdown_connections 2023-07-25T14:35:46.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.151+0000 7f4b33f8d700 1 -- 172.21.15.72:0/3009106494 wait complete. 2023-07-25T14:35:46.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.152+0000 7f4b33f8d700 1 Processor -- start 2023-07-25T14:35:46.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.152+0000 7f4b33f8d700 1 -- start start 2023-07-25T14:35:46.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.153+0000 7f4b33f8d700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4b2c0ba0e0 0x7f4b2c1ea330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:46.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.153+0000 7f4b33f8d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4b2c0c5f40 0x7f4b2c0bc9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:46.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.153+0000 7f4b33f8d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4b2c151ba0 0x7f4b2c14e740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:46.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.153+0000 7f4b33f8d700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b2c0bdd30 con 0x7f4b2c0c5f40 2023-07-25T14:35:46.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.153+0000 7f4b33f8d700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b2c1ea870 con 0x7f4b2c151ba0 2023-07-25T14:35:46.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.153+0000 7f4b33f8d700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b2c153070 con 0x7f4b2c0ba0e0 2023-07-25T14:35:46.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.153+0000 7f4b31528700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4b2c0c5f40 0x7f4b2c0bc9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:46.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.153+0000 7f4b31528700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4b2c0c5f40 0x7f4b2c0bc9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:39482/0 (socket says 172.21.15.72:39482) 2023-07-25T14:35:46.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.153+0000 7f4b31528700 1 -- 172.21.15.72:0/1254038083 learned_addr learned my addr 172.21.15.72:0/1254038083 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:35:46.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.153+0000 7f4b3252a700 1 --2- 172.21.15.72:0/1254038083 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4b2c151ba0 0x7f4b2c14e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:46.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.153+0000 7f4b31d29700 1 --2- 172.21.15.72:0/1254038083 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4b2c0ba0e0 0x7f4b2c1ea330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:46.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.153+0000 7f4b31528700 1 -- 172.21.15.72:0/1254038083 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4b2c0ba0e0 msgr2=0x7f4b2c1ea330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:46.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.153+0000 7f4b31528700 1 --2- 172.21.15.72:0/1254038083 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4b2c0ba0e0 0x7f4b2c1ea330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:46.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.153+0000 7f4b31528700 1 -- 172.21.15.72:0/1254038083 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4b2c151ba0 msgr2=0x7f4b2c14e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:46.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.153+0000 7f4b31528700 1 --2- 172.21.15.72:0/1254038083 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4b2c151ba0 0x7f4b2c14e740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:46.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.153+0000 7f4b31528700 1 -- 172.21.15.72:0/1254038083 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b280094a0 con 0x7f4b2c0c5f40 2023-07-25T14:35:46.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.153+0000 7f4b3252a700 1 --2- 172.21.15.72:0/1254038083 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4b2c151ba0 0x7f4b2c14e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-25T14:35:46.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.153+0000 7f4b31d29700 1 --2- 172.21.15.72:0/1254038083 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4b2c0ba0e0 0x7f4b2c1ea330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-25T14:35:46.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.153+0000 7f4b31528700 1 --2- 172.21.15.72:0/1254038083 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4b2c0c5f40 0x7f4b2c0bc9a0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f4b28010df0 tx=0x7f4b2800e640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:35:46.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.153+0000 7f4b227fc700 1 -- 172.21.15.72:0/1254038083 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b28011650 con 0x7f4b2c0c5f40 2023-07-25T14:35:46.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.153+0000 7f4b33f8d700 1 -- 172.21.15.72:0/1254038083 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b24009a70 con 0x7f4b2c0c5f40 2023-07-25T14:35:46.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.153+0000 7f4b227fc700 1 -- 172.21.15.72:0/1254038083 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b280117b0 con 0x7f4b2c0c5f40 2023-07-25T14:35:46.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.153+0000 7f4b227fc700 1 -- 172.21.15.72:0/1254038083 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b28011b60 con 0x7f4b2c0c5f40 2023-07-25T14:35:46.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.153+0000 7f4b33f8d700 1 -- 172.21.15.72:0/1254038083 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b2c099a20 con 0x7f4b2c0c5f40 2023-07-25T14:35:46.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.155+0000 7f4b33f8d700 1 -- 172.21.15.72:0/1254038083 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b2c04e470 con 0x7f4b2c0c5f40 2023-07-25T14:35:46.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.155+0000 7f4b227fc700 1 -- 172.21.15.72:0/1254038083 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4b28011cc0 con 0x7f4b2c0c5f40 2023-07-25T14:35:46.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.155+0000 7f4b227fc700 1 --2- 172.21.15.72:0/1254038083 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f4b1006ace0 0x7f4b1006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:46.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.155+0000 7f4b227fc700 1 -- 172.21.15.72:0/1254038083 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f4b2808bc90 con 0x7f4b2c0c5f40 2023-07-25T14:35:46.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.155+0000 7f4b31d29700 1 --2- 172.21.15.72:0/1254038083 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f4b1006ace0 0x7f4b1006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:46.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.156+0000 7f4b31d29700 1 --2- 172.21.15.72:0/1254038083 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f4b1006ace0 0x7f4b1006d1a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f4b1c0011e0 tx=0x7f4b1c007b00 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:35:46.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.160+0000 7f4b227fc700 1 -- 172.21.15.72:0/1254038083 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f4b28056a60 con 0x7f4b2c0c5f40 2023-07-25T14:35:46.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.346+0000 7f4b33f8d700 1 -- 172.21.15.72:0/1254038083 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4b2c0c52d0 con 0x7f4b2c0c5f40 2023-07-25T14:35:46.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.347+0000 7f4b227fc700 1 -- 172.21.15.72:0/1254038083 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+20014 (secure 0 0 0) 0x7f4b2800ee60 con 0x7f4b2c0c5f40 2023-07-25T14:35:46.359 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-25T14:35:46.359 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":25,"fsid":"9170db48-9170-43e8-8ccb-9813e6240906","created":"2023-07-25T14:35:21.733262+0000","modified":"2023-07-25T14:35:44.992669+0000","last_up_change":"2023-07-25T14:35:31.355010+0000","last_in_change":"2023-07-25T14:35:24.195785+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-25T14:35:32.983457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-25T14:35:33.326342+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-25T14:35:37.534158+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-25T14:35:38.891571+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-25T14:35:42.596923+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d517fdad-0bfe-49f0-89f2-9421c3761839","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6801","nonce":2475407414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6803","nonce":2475407414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6807","nonce":2475407414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6805","nonce":2475407414}]},"public_addr":"172.21.15.72:6801/2475407414","cluster_addr":"172.21.15.72:6803/2475407414","heartbeat_back_addr":"172.21.15.72:6807/2475407414","heartbeat_front_addr":"172.21.15.72:6805/2475407414","state":["exists","up"]},{"osd":1,"uuid":"e1564be3-f209-47e5-a8d0-32fc618a474f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6822","nonce":870954016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6825","nonce":870954016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6831","nonce":870954016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6827","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6829","nonce":870954016}]},"public_addr":"172.21.15.72:6822/870954016","cluster_addr":"172.21.15.72:6825/870954016","heartbeat_back_addr":"172.21.15.72:6831/870954016","heartbeat_front_addr":"172.21.15.72:6829/870954016","state":["exists","up"]},{"osd":2,"uuid":"c4647d30-ffa6-417a-9026-ef530c75910e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6809","nonce":2143129442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6811","nonce":2143129442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6815","nonce":2143129442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6813","nonce":2143129442}]},"public_addr":"172.21.15.72:6809/2143129442","cluster_addr":"172.21.15.72:6811/2143129442","heartbeat_back_addr":"172.21.15.72:6815/2143129442","heartbeat_front_addr":"172.21.15.72:6813/2143129442","state":["exists","up"]},{"osd":3,"uuid":"76c9d9a7-c2e2-4612-a58b-d6882dd76b58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6817","nonce":3404066311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6819","nonce":3404066311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6828","nonce":3404066311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6821","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6823","nonce":3404066311}]},"public_addr":"172.21.15.72:6817/3404066311","cluster_addr":"172.21.15.72:6819/3404066311","heartbeat_back_addr":"172.21.15.72:6828/3404066311","heartbeat_front_addr":"172.21.15.72:6823/3404066311","state":["exists","up"]},{"osd":4,"uuid":"7f8920dc-0ad4-4a73-ab40-65408f83eadd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6817","nonce":2381008739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6819","nonce":2381008739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6825","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6827","nonce":2381008739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6822","nonce":2381008739}]},"public_addr":"172.21.15.92:6817/2381008739","cluster_addr":"172.21.15.92:6819/2381008739","heartbeat_back_addr":"172.21.15.92:6827/2381008739","heartbeat_front_addr":"172.21.15.92:6822/2381008739","state":["exists","up"]},{"osd":5,"uuid":"56257e7c-31eb-44c5-9ec7-1318a4e0bb35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6801","nonce":2161935604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6803","nonce":2161935604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6807","nonce":2161935604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6805","nonce":2161935604}]},"public_addr":"172.21.15.92:6801/2161935604","cluster_addr":"172.21.15.92:6803/2161935604","heartbeat_back_addr":"172.21.15.92:6807/2161935604","heartbeat_front_addr":"172.21.15.92:6805/2161935604","state":["exists","up"]},{"osd":6,"uuid":"a150d3d8-a0c9-4955-968a-8d98eff4ffb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6809","nonce":3770163493}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6811","nonce":3770163493}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6815","nonce":3770163493}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6813","nonce":3770163493}]},"public_addr":"172.21.15.92:6809/3770163493","cluster_addr":"172.21.15.92:6811/3770163493","heartbeat_back_addr":"172.21.15.92:6815/3770163493","heartbeat_front_addr":"172.21.15.92:6813/3770163493","state":["exists","up"]},{"osd":7,"uuid":"07799c27-54ee-4591-a42d-a978d6b32065","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6821","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6823","nonce":2135777609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6826","nonce":2135777609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6831","nonce":2135777609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6829","nonce":2135777609}]},"public_addr":"172.21.15.92:6823/2135777609","cluster_addr":"172.21.15.92:6826/2135777609","heartbeat_back_addr":"172.21.15.92:6831/2135777609","heartbeat_front_addr":"172.21.15.92:6829/2135777609","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.345365+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.378150+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.146566+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.372172+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:30.398421+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.385632+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.465611+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.443583+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-25T14:35:46.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.349+0000 7f4b33f8d700 1 -- 172.21.15.72:0/1254038083 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f4b1006ace0 msgr2=0x7f4b1006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:46.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.349+0000 7f4b33f8d700 1 --2- 172.21.15.72:0/1254038083 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f4b1006ace0 0x7f4b1006d1a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f4b1c0011e0 tx=0x7f4b1c007b00 comp rx=0 tx=0).stop 2023-07-25T14:35:46.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.349+0000 7f4b33f8d700 1 -- 172.21.15.72:0/1254038083 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4b2c0c5f40 msgr2=0x7f4b2c0bc9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:46.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.349+0000 7f4b33f8d700 1 --2- 172.21.15.72:0/1254038083 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4b2c0c5f40 0x7f4b2c0bc9a0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f4b28010df0 tx=0x7f4b2800e640 comp rx=0 tx=0).stop 2023-07-25T14:35:46.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.349+0000 7f4b33f8d700 1 -- 172.21.15.72:0/1254038083 shutdown_connections 2023-07-25T14:35:46.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.349+0000 7f4b33f8d700 1 --2- 172.21.15.72:0/1254038083 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f4b1006ace0 0x7f4b1006d1a0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:46.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.349+0000 7f4b33f8d700 1 --2- 172.21.15.72:0/1254038083 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4b2c0ba0e0 0x7f4b2c1ea330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:46.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.349+0000 7f4b33f8d700 1 --2- 172.21.15.72:0/1254038083 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4b2c151ba0 0x7f4b2c14e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:46.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.349+0000 7f4b33f8d700 1 --2- 172.21.15.72:0/1254038083 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4b2c0c5f40 0x7f4b2c0bc9a0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:46.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.349+0000 7f4b33f8d700 1 -- 172.21.15.72:0/1254038083 >> 172.21.15.72:0/1254038083 conn(0x7f4b2c0a87e0 msgr2=0x7f4b2c06fcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:35:46.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.349+0000 7f4b33f8d700 1 -- 172.21.15.72:0/1254038083 shutdown_connections 2023-07-25T14:35:46.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.349+0000 7f4b33f8d700 1 -- 172.21.15.72:0/1254038083 wait complete. 2023-07-25T14:35:46.373 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-25T14:35:46.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.481+0000 7facb42f4700 1 Processor -- start 2023-07-25T14:35:46.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.481+0000 7facb42f4700 1 -- start start 2023-07-25T14:35:46.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.482+0000 7facb42f4700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7facac0724c0 0x7facac0c34c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:46.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.482+0000 7facb42f4700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7facac0c2fe0 con 0x7facac151950 2023-07-25T14:35:46.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.482+0000 7facb42f4700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7facac155070 con 0x7facac0c4930 2023-07-25T14:35:46.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.482+0000 7facb42f4700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7facac071a60 con 0x7facac0724c0 2023-07-25T14:35:46.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.482+0000 7facb188f700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7facac0724c0 0x7facac0c34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:46.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.482+0000 7facb2090700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7facac151950 0x7facac06a190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:58456/0 (socket says 172.21.15.72:58456) 2023-07-25T14:35:46.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.482+0000 7facb2090700 1 -- 172.21.15.72:0/2731401160 learned_addr learned my addr 172.21.15.72:0/2731401160 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:35:46.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.482+0000 7facb188f700 1 -- 172.21.15.72:0/2731401160 >> v1:172.21.15.92:6789/0 conn(0x7facac0c4930 legacy=0x7facac0c3a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:46.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.482+0000 7facb188f700 1 -- 172.21.15.72:0/2731401160 >> v1:172.21.15.72:6789/0 conn(0x7facac151950 legacy=0x7facac06a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:46.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.482+0000 7facb108e700 1 -- 172.21.15.72:0/2731401160 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1979769988 0 0) 0x7facac0c2fe0 con 0x7facac151950 2023-07-25T14:35:46.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.482+0000 7facb188f700 1 -- 172.21.15.72:0/2731401160 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facac0c15c0 con 0x7facac0724c0 2023-07-25T14:35:46.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.482+0000 7facb188f700 1 --2- 172.21.15.72:0/2731401160 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7facac0724c0 0x7facac0c34c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fac9c009840 tx=0x7fac9c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a43dde8b22c62ad7 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:35:46.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.483+0000 7facb108e700 1 -- 172.21.15.72:0/2731401160 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac9c011830 con 0x7facac0724c0 2023-07-25T14:35:46.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.483+0000 7facb108e700 1 -- 172.21.15.72:0/2731401160 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac9c011990 con 0x7facac0724c0 2023-07-25T14:35:46.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.483+0000 7facb108e700 1 -- 172.21.15.72:0/2731401160 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac9c011d20 con 0x7facac0724c0 2023-07-25T14:35:46.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.483+0000 7facb42f4700 1 -- 172.21.15.72:0/2731401160 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7facac0724c0 msgr2=0x7facac0c34c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:46.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.483+0000 7facb42f4700 1 --2- 172.21.15.72:0/2731401160 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7facac0724c0 0x7facac0c34c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fac9c009840 tx=0x7fac9c009b50 comp rx=0 tx=0).stop 2023-07-25T14:35:46.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.483+0000 7facb42f4700 1 -- 172.21.15.72:0/2731401160 shutdown_connections 2023-07-25T14:35:46.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.483+0000 7facb42f4700 1 --2- 172.21.15.72:0/2731401160 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7facac0724c0 0x7facac0c34c0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:46.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.483+0000 7facb42f4700 1 -- 172.21.15.72:0/2731401160 >> 172.21.15.72:0/2731401160 conn(0x7facac0a87e0 msgr2=0x7facac0a8bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:35:46.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.483+0000 7facb42f4700 1 -- 172.21.15.72:0/2731401160 shutdown_connections 2023-07-25T14:35:46.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.483+0000 7facb42f4700 1 -- 172.21.15.72:0/2731401160 wait complete. 2023-07-25T14:35:46.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.484+0000 7facb42f4700 1 Processor -- start 2023-07-25T14:35:46.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.484+0000 7facb42f4700 1 -- start start 2023-07-25T14:35:46.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.485+0000 7facb42f4700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7facac0724c0 0x7facac0c6d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:46.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.485+0000 7facb42f4700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7facac0c4930 0x7facac149710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:46.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.485+0000 7facb42f4700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7facac151950 0x7facac0bfca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:46.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.485+0000 7facb42f4700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facac0bebe0 con 0x7facac151950 2023-07-25T14:35:46.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.485+0000 7facb42f4700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facac0bdbb0 con 0x7facac0724c0 2023-07-25T14:35:46.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.485+0000 7facb42f4700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facac0bef90 con 0x7facac0c4930 2023-07-25T14:35:46.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.485+0000 7facb2891700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7facac151950 0x7facac0bfca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:46.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.485+0000 7facb2891700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7facac151950 0x7facac0bfca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:39498/0 (socket says 172.21.15.72:39498) 2023-07-25T14:35:46.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.485+0000 7facb2891700 1 -- 172.21.15.72:0/2746355714 learned_addr learned my addr 172.21.15.72:0/2746355714 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:35:46.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.485+0000 7facb2090700 1 --2- 172.21.15.72:0/2746355714 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7facac0724c0 0x7facac0c6d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:46.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.485+0000 7facb188f700 1 --2- 172.21.15.72:0/2746355714 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7facac0c4930 0x7facac149710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:46.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.485+0000 7facb2891700 1 -- 172.21.15.72:0/2746355714 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7facac0c4930 msgr2=0x7facac149710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:46.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.485+0000 7facb2891700 1 --2- 172.21.15.72:0/2746355714 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7facac0c4930 0x7facac149710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:46.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.485+0000 7facb2891700 1 -- 172.21.15.72:0/2746355714 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7facac0724c0 msgr2=0x7facac0c6d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:46.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.485+0000 7facb2891700 1 --2- 172.21.15.72:0/2746355714 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7facac0724c0 0x7facac0c6d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:46.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.485+0000 7facb2891700 1 -- 172.21.15.72:0/2746355714 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac9c0094a0 con 0x7facac151950 2023-07-25T14:35:46.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.485+0000 7facb2090700 1 --2- 172.21.15.72:0/2746355714 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7facac0724c0 0x7facac0c6d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-25T14:35:46.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.485+0000 7facb188f700 1 --2- 172.21.15.72:0/2746355714 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7facac0c4930 0x7facac149710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-25T14:35:46.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.486+0000 7facb2891700 1 --2- 172.21.15.72:0/2746355714 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7facac151950 0x7facac0bfca0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7faca400cc50 tx=0x7faca400a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:35:46.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.486+0000 7faca2ffd700 1 -- 172.21.15.72:0/2746355714 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faca400ade0 con 0x7facac151950 2023-07-25T14:35:46.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.486+0000 7faca2ffd700 1 -- 172.21.15.72:0/2746355714 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faca400ce50 con 0x7facac151950 2023-07-25T14:35:46.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.486+0000 7facb42f4700 1 -- 172.21.15.72:0/2746355714 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facac0bf810 con 0x7facac151950 2023-07-25T14:35:46.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.486+0000 7faca2ffd700 1 -- 172.21.15.72:0/2746355714 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faca4003c20 con 0x7facac151950 2023-07-25T14:35:46.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.486+0000 7facb42f4700 1 -- 172.21.15.72:0/2746355714 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facac0bf1c0 con 0x7facac151950 2023-07-25T14:35:46.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.487+0000 7facb42f4700 1 -- 172.21.15.72:0/2746355714 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facac0bf9c0 con 0x7facac151950 2023-07-25T14:35:46.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.487+0000 7faca2ffd700 1 -- 172.21.15.72:0/2746355714 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7faca40050d0 con 0x7facac151950 2023-07-25T14:35:46.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.488+0000 7faca2ffd700 1 --2- 172.21.15.72:0/2746355714 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fac9006ace0 0x7fac9006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:46.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.488+0000 7faca2ffd700 1 -- 172.21.15.72:0/2746355714 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7faca40898d0 con 0x7facac151950 2023-07-25T14:35:46.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.488+0000 7facb2090700 1 --2- 172.21.15.72:0/2746355714 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fac9006ace0 0x7fac9006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:46.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.488+0000 7facb2090700 1 --2- 172.21.15.72:0/2746355714 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fac9006ace0 0x7fac9006d1a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7faca8000f60 tx=0x7faca8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:35:46.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.492+0000 7faca2ffd700 1 -- 172.21.15.72:0/2746355714 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7faca40546a0 con 0x7facac151950 2023-07-25T14:35:46.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.683+0000 7facb42f4700 1 -- 172.21.15.72:0/2746355714 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7facac0c2870 con 0x7facac151950 2023-07-25T14:35:46.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.684+0000 7faca2ffd700 1 -- 172.21.15.72:0/2746355714 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+20014 (secure 0 0 0) 0x7faca4057cc0 con 0x7facac151950 2023-07-25T14:35:46.696 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-25T14:35:46.697 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":25,"fsid":"9170db48-9170-43e8-8ccb-9813e6240906","created":"2023-07-25T14:35:21.733262+0000","modified":"2023-07-25T14:35:44.992669+0000","last_up_change":"2023-07-25T14:35:31.355010+0000","last_in_change":"2023-07-25T14:35:24.195785+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-25T14:35:32.983457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-25T14:35:33.326342+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-25T14:35:37.534158+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-25T14:35:38.891571+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-25T14:35:42.596923+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d517fdad-0bfe-49f0-89f2-9421c3761839","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6801","nonce":2475407414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6803","nonce":2475407414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6807","nonce":2475407414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6805","nonce":2475407414}]},"public_addr":"172.21.15.72:6801/2475407414","cluster_addr":"172.21.15.72:6803/2475407414","heartbeat_back_addr":"172.21.15.72:6807/2475407414","heartbeat_front_addr":"172.21.15.72:6805/2475407414","state":["exists","up"]},{"osd":1,"uuid":"e1564be3-f209-47e5-a8d0-32fc618a474f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6822","nonce":870954016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6825","nonce":870954016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6831","nonce":870954016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6827","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6829","nonce":870954016}]},"public_addr":"172.21.15.72:6822/870954016","cluster_addr":"172.21.15.72:6825/870954016","heartbeat_back_addr":"172.21.15.72:6831/870954016","heartbeat_front_addr":"172.21.15.72:6829/870954016","state":["exists","up"]},{"osd":2,"uuid":"c4647d30-ffa6-417a-9026-ef530c75910e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6809","nonce":2143129442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6811","nonce":2143129442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6815","nonce":2143129442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6813","nonce":2143129442}]},"public_addr":"172.21.15.72:6809/2143129442","cluster_addr":"172.21.15.72:6811/2143129442","heartbeat_back_addr":"172.21.15.72:6815/2143129442","heartbeat_front_addr":"172.21.15.72:6813/2143129442","state":["exists","up"]},{"osd":3,"uuid":"76c9d9a7-c2e2-4612-a58b-d6882dd76b58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6817","nonce":3404066311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6819","nonce":3404066311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6828","nonce":3404066311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6821","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6823","nonce":3404066311}]},"public_addr":"172.21.15.72:6817/3404066311","cluster_addr":"172.21.15.72:6819/3404066311","heartbeat_back_addr":"172.21.15.72:6828/3404066311","heartbeat_front_addr":"172.21.15.72:6823/3404066311","state":["exists","up"]},{"osd":4,"uuid":"7f8920dc-0ad4-4a73-ab40-65408f83eadd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6817","nonce":2381008739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6819","nonce":2381008739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6825","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6827","nonce":2381008739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6822","nonce":2381008739}]},"public_addr":"172.21.15.92:6817/2381008739","cluster_addr":"172.21.15.92:6819/2381008739","heartbeat_back_addr":"172.21.15.92:6827/2381008739","heartbeat_front_addr":"172.21.15.92:6822/2381008739","state":["exists","up"]},{"osd":5,"uuid":"56257e7c-31eb-44c5-9ec7-1318a4e0bb35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6801","nonce":2161935604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6803","nonce":2161935604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6807","nonce":2161935604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6805","nonce":2161935604}]},"public_addr":"172.21.15.92:6801/2161935604","cluster_addr":"172.21.15.92:6803/2161935604","heartbeat_back_addr":"172.21.15.92:6807/2161935604","heartbeat_front_addr":"172.21.15.92:6805/2161935604","state":["exists","up"]},{"osd":6,"uuid":"a150d3d8-a0c9-4955-968a-8d98eff4ffb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6809","nonce":3770163493}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6811","nonce":3770163493}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6815","nonce":3770163493}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6813","nonce":3770163493}]},"public_addr":"172.21.15.92:6809/3770163493","cluster_addr":"172.21.15.92:6811/3770163493","heartbeat_back_addr":"172.21.15.92:6815/3770163493","heartbeat_front_addr":"172.21.15.92:6813/3770163493","state":["exists","up"]},{"osd":7,"uuid":"07799c27-54ee-4591-a42d-a978d6b32065","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6821","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6823","nonce":2135777609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6826","nonce":2135777609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6831","nonce":2135777609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6829","nonce":2135777609}]},"public_addr":"172.21.15.92:6823/2135777609","cluster_addr":"172.21.15.92:6826/2135777609","heartbeat_back_addr":"172.21.15.92:6831/2135777609","heartbeat_front_addr":"172.21.15.92:6829/2135777609","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.345365+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.378150+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.146566+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.372172+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:30.398421+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.385632+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.465611+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.443583+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-25T14:35:46.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.686+0000 7facb42f4700 1 -- 172.21.15.72:0/2746355714 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fac9006ace0 msgr2=0x7fac9006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:46.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.686+0000 7facb42f4700 1 --2- 172.21.15.72:0/2746355714 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fac9006ace0 0x7fac9006d1a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7faca8000f60 tx=0x7faca8009040 comp rx=0 tx=0).stop 2023-07-25T14:35:46.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.686+0000 7facb42f4700 1 -- 172.21.15.72:0/2746355714 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7facac151950 msgr2=0x7facac0bfca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:46.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.686+0000 7facb42f4700 1 --2- 172.21.15.72:0/2746355714 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7facac151950 0x7facac0bfca0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7faca400cc50 tx=0x7faca400a340 comp rx=0 tx=0).stop 2023-07-25T14:35:46.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.686+0000 7facb42f4700 1 -- 172.21.15.72:0/2746355714 shutdown_connections 2023-07-25T14:35:46.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.686+0000 7facb42f4700 1 --2- 172.21.15.72:0/2746355714 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fac9006ace0 0x7fac9006d1a0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:46.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.686+0000 7facb42f4700 1 --2- 172.21.15.72:0/2746355714 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7facac151950 0x7facac0bfca0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:46.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.686+0000 7facb42f4700 1 --2- 172.21.15.72:0/2746355714 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7facac0724c0 0x7facac0c6d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:46.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.686+0000 7facb42f4700 1 --2- 172.21.15.72:0/2746355714 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7facac0c4930 0x7facac149710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:46.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.686+0000 7facb42f4700 1 -- 172.21.15.72:0/2746355714 >> 172.21.15.72:0/2746355714 conn(0x7facac0a87e0 msgr2=0x7facac06f940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:35:46.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.687+0000 7facb42f4700 1 -- 172.21.15.72:0/2746355714 shutdown_connections 2023-07-25T14:35:46.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.687+0000 7facb42f4700 1 -- 172.21.15.72:0/2746355714 wait complete. 2023-07-25T14:35:46.726 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-25T14:35:46.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.833+0000 7fe8de18e700 1 Processor -- start 2023-07-25T14:35:46.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.834+0000 7fe8de18e700 1 -- start start 2023-07-25T14:35:46.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.834+0000 7fe8de18e700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe8d8154d50 0x7fe8d815c980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:46.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.834+0000 7fe8de18e700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8d80c54f0 con 0x7fe8d8151ba0 2023-07-25T14:35:46.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.834+0000 7fe8de18e700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8d80c6670 con 0x7fe8d80c5f40 2023-07-25T14:35:46.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.834+0000 7fe8de18e700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8d80c5740 con 0x7fe8d8154d50 2023-07-25T14:35:46.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.834+0000 7fe8d77fe700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fe8d8151ba0 0x7fe8d80c2230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:58470/0 (socket says 172.21.15.72:58470) 2023-07-25T14:35:46.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.834+0000 7fe8d77fe700 1 -- 172.21.15.72:0/2835324029 learned_addr learned my addr 172.21.15.72:0/2835324029 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:35:46.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.835+0000 7fe8d7fff700 1 --2- 172.21.15.72:0/2835324029 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe8d8154d50 0x7fe8d815c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:46.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.835+0000 7fe8d67fc700 1 -- 172.21.15.72:0/2835324029 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3020766255 0 0) 0x7fe8d80c54f0 con 0x7fe8d8151ba0 2023-07-25T14:35:46.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.835+0000 7fe8d67fc700 1 -- 172.21.15.72:0/2835324029 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe8c40035b0 con 0x7fe8d8151ba0 2023-07-25T14:35:46.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.835+0000 7fe8d67fc700 1 -- 172.21.15.72:0/2835324029 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4132284918 0 0) 0x7fe8c40035b0 con 0x7fe8d8151ba0 2023-07-25T14:35:46.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.835+0000 7fe8d67fc700 1 -- 172.21.15.72:0/2835324029 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe8d8154d50 msgr2=0x7fe8d815c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:35:46.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.835+0000 7fe8d67fc700 1 --2- 172.21.15.72:0/2835324029 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe8d8154d50 0x7fe8d815c980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:46.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.835+0000 7fe8d67fc700 1 -- 172.21.15.72:0/2835324029 >> v1:172.21.15.92:6789/0 conn(0x7fe8d80c5f40 legacy=0x7fe8d8154640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:46.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.835+0000 7fe8d67fc700 1 -- 172.21.15.72:0/2835324029 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8d80c5a20 con 0x7fe8d8151ba0 2023-07-25T14:35:46.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.835+0000 7fe8d67fc700 1 -- 172.21.15.72:0/2835324029 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2559588315 0 0) 0x7fe8c8001670 con 0x7fe8d8151ba0 2023-07-25T14:35:46.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.835+0000 7fe8d67fc700 1 -- 172.21.15.72:0/2835324029 >> v1:172.21.15.72:6789/0 conn(0x7fe8d8151ba0 legacy=0x7fe8d80c2230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:46.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.835+0000 7fe8d67fc700 1 --2- 172.21.15.72:0/2835324029 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe8c4003a30 0x7fe8c4003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:46.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.835+0000 7fe8d67fc700 1 --2- 172.21.15.72:0/2835324029 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe8c4004850 0x7fe8c4004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:46.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.835+0000 7fe8d67fc700 1 --2- 172.21.15.72:0/2835324029 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe8c40051d0 0x7fe8c400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:46.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.835+0000 7fe8d67fc700 1 -- 172.21.15.72:0/2835324029 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8d80c5740 con 0x7fe8c40051d0 2023-07-25T14:35:46.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.835+0000 7fe8d67fc700 1 -- 172.21.15.72:0/2835324029 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8c400c060 con 0x7fe8c4003a30 2023-07-25T14:35:46.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.835+0000 7fe8d67fc700 1 -- 172.21.15.72:0/2835324029 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8c400e430 con 0x7fe8c4004850 2023-07-25T14:35:46.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.835+0000 7fe8d7fff700 1 --2- 172.21.15.72:0/2835324029 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe8c40051d0 0x7fe8c400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:46.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.835+0000 7fe8d77fe700 1 --2- 172.21.15.72:0/2835324029 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe8c4003a30 0x7fe8c4003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:46.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.835+0000 7fe8d6ffd700 1 --2- 172.21.15.72:0/2835324029 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe8c4004850 0x7fe8c4004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:46.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.835+0000 7fe8d7fff700 1 -- 172.21.15.72:0/2835324029 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe8c4004850 msgr2=0x7fe8c4004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:35:46.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.835+0000 7fe8d7fff700 1 --2- 172.21.15.72:0/2835324029 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe8c4004850 0x7fe8c4004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:46.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.835+0000 7fe8d7fff700 1 -- 172.21.15.72:0/2835324029 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe8c4003a30 msgr2=0x7fe8c4003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:35:46.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.835+0000 7fe8d7fff700 1 --2- 172.21.15.72:0/2835324029 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe8c4003a30 0x7fe8c4003e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:46.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.835+0000 7fe8d7fff700 1 -- 172.21.15.72:0/2835324029 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8c40035b0 con 0x7fe8c40051d0 2023-07-25T14:35:46.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.835+0000 7fe8d7fff700 1 --2- 172.21.15.72:0/2835324029 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe8c40051d0 0x7fe8c400ba10 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fe8d0007330 tx=0x7fe8c4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=511c5eab76a679df server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:35:46.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.835+0000 7fe8d67fc700 1 -- 172.21.15.72:0/2835324029 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8d0007e50 con 0x7fe8c40051d0 2023-07-25T14:35:46.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.836+0000 7fe8d67fc700 1 -- 172.21.15.72:0/2835324029 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8d0003a20 con 0x7fe8c40051d0 2023-07-25T14:35:46.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.836+0000 7fe8d67fc700 1 -- 172.21.15.72:0/2835324029 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8d0003dd0 con 0x7fe8c40051d0 2023-07-25T14:35:46.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.836+0000 7fe8de18e700 1 -- 172.21.15.72:0/2835324029 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe8c40051d0 msgr2=0x7fe8c400ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:46.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.836+0000 7fe8de18e700 1 --2- 172.21.15.72:0/2835324029 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe8c40051d0 0x7fe8c400ba10 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fe8d0007330 tx=0x7fe8c4005880 comp rx=0 tx=0).stop 2023-07-25T14:35:46.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.836+0000 7fe8d7fff700 1 -- 172.21.15.72:0/2835324029 reap_dead start 2023-07-25T14:35:46.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.836+0000 7fe8de18e700 1 -- 172.21.15.72:0/2835324029 shutdown_connections 2023-07-25T14:35:46.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.836+0000 7fe8de18e700 1 -- 172.21.15.72:0/2835324029 >> 172.21.15.72:0/2835324029 conn(0x7fe8d80a87e0 msgr2=0x7fe8d80a8bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:35:46.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.836+0000 7fe8de18e700 1 -- 172.21.15.72:0/2835324029 shutdown_connections 2023-07-25T14:35:46.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.836+0000 7fe8de18e700 1 -- 172.21.15.72:0/2835324029 wait complete. 2023-07-25T14:35:46.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.837+0000 7fe8de18e700 1 Processor -- start 2023-07-25T14:35:46.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.837+0000 7fe8de18e700 1 -- start start 2023-07-25T14:35:46.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.838+0000 7fe8de18e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe8d814e020 0x7fe8d80abf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:46.858 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.838+0000 7fe8de18e700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe8d81ed110 0x7fe8d80bf2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:46.858 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.838+0000 7fe8de18e700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe8d80bf820 0x7fe8d80bdb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:46.858 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.838+0000 7fe8de18e700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8d80aae50 con 0x7fe8d814e020 2023-07-25T14:35:46.858 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.838+0000 7fe8de18e700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8d80c0a60 con 0x7fe8d80bf820 2023-07-25T14:35:46.858 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.838+0000 7fe8de18e700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8d8154970 con 0x7fe8d81ed110 2023-07-25T14:35:46.858 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.838+0000 7fe8d77fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe8d814e020 0x7fe8d80abf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:46.858 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.838+0000 7fe8d77fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe8d814e020 0x7fe8d80abf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:39514/0 (socket says 172.21.15.72:39514) 2023-07-25T14:35:46.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.838+0000 7fe8d77fe700 1 -- 172.21.15.72:0/4184702798 learned_addr learned my addr 172.21.15.72:0/4184702798 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:35:46.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.838+0000 7fe8d6ffd700 1 --2- 172.21.15.72:0/4184702798 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe8d81ed110 0x7fe8d80bf2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:46.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.838+0000 7fe8d7fff700 1 --2- 172.21.15.72:0/4184702798 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe8d80bf820 0x7fe8d80bdb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:46.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.838+0000 7fe8d77fe700 1 -- 172.21.15.72:0/4184702798 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe8d81ed110 msgr2=0x7fe8d80bf2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:46.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.838+0000 7fe8d77fe700 1 --2- 172.21.15.72:0/4184702798 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe8d81ed110 0x7fe8d80bf2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:46.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.838+0000 7fe8d77fe700 1 -- 172.21.15.72:0/4184702798 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe8d80bf820 msgr2=0x7fe8d80bdb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:46.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.838+0000 7fe8d77fe700 1 --2- 172.21.15.72:0/4184702798 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe8d80bf820 0x7fe8d80bdb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:46.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.838+0000 7fe8d77fe700 1 -- 172.21.15.72:0/4184702798 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8d80c0130 con 0x7fe8d814e020 2023-07-25T14:35:46.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.839+0000 7fe8d77fe700 1 --2- 172.21.15.72:0/4184702798 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe8d814e020 0x7fe8d80abf30 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fe8c8007340 tx=0x7fe8c8007650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:35:46.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.839+0000 7fe8cffff700 1 -- 172.21.15.72:0/4184702798 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8c800f660 con 0x7fe8d814e020 2023-07-25T14:35:46.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.839+0000 7fe8cffff700 1 -- 172.21.15.72:0/4184702798 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8c800f7e0 con 0x7fe8d814e020 2023-07-25T14:35:46.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.839+0000 7fe8de18e700 1 -- 172.21.15.72:0/4184702798 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8d80c0410 con 0x7fe8d814e020 2023-07-25T14:35:46.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.839+0000 7fe8cffff700 1 -- 172.21.15.72:0/4184702798 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8c800fb90 con 0x7fe8d814e020 2023-07-25T14:35:46.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.839+0000 7fe8de18e700 1 -- 172.21.15.72:0/4184702798 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8d80ac470 con 0x7fe8d814e020 2023-07-25T14:35:46.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.840+0000 7fe8de18e700 1 -- 172.21.15.72:0/4184702798 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8d80c12b0 con 0x7fe8d814e020 2023-07-25T14:35:46.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.840+0000 7fe8cffff700 1 -- 172.21.15.72:0/4184702798 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe8c800fcf0 con 0x7fe8d814e020 2023-07-25T14:35:46.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.841+0000 7fe8cffff700 1 --2- 172.21.15.72:0/4184702798 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fe8b806ad10 0x7fe8b806d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:46.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.841+0000 7fe8cffff700 1 -- 172.21.15.72:0/4184702798 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fe8c808a060 con 0x7fe8d814e020 2023-07-25T14:35:46.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.841+0000 7fe8d6ffd700 1 --2- 172.21.15.72:0/4184702798 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fe8b806ad10 0x7fe8b806d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:46.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.841+0000 7fe8d6ffd700 1 --2- 172.21.15.72:0/4184702798 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fe8b806ad10 0x7fe8b806d1d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fe8d806e3d0 tx=0x7fe8c0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:35:46.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:46.845+0000 7fe8cffff700 1 -- 172.21.15.72:0/4184702798 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fe8c8054f90 con 0x7fe8d814e020 2023-07-25T14:35:47.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.074+0000 7fe8de18e700 1 -- 172.21.15.72:0/4184702798 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe8d804e470 con 0x7fe8d814e020 2023-07-25T14:35:47.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.074+0000 7fe8cffff700 1 -- 172.21.15.72:0/4184702798 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4664 (secure 0 0 0) 0x7fe8c80585b0 con 0x7fe8d814e020 2023-07-25T14:35:47.086 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-25T14:35:47.086 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4220,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6836/4293785067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":4293785067},{"type":"v1","addr":"172.21.15.72:6836","nonce":4293785067}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4229,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6834/681290755","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":681290755},{"type":"v1","addr":"172.21.15.92:6834","nonce":681290755}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6837/3376375642","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6835","nonce":3376375642},{"type":"v1","addr":"172.21.15.72:6837","nonce":3376375642}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-25T14:35:39.939860+0000","modified":"2023-07-25T14:35:45.587223+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.92:6835/2045555979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6833","nonce":2045555979},{"type":"v1","addr":"172.21.15.92:6835","nonce":2045555979}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-07-25T14:35:47.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.077+0000 7fe8de18e700 1 -- 172.21.15.72:0/4184702798 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fe8b806ad10 msgr2=0x7fe8b806d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:47.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.077+0000 7fe8de18e700 1 --2- 172.21.15.72:0/4184702798 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fe8b806ad10 0x7fe8b806d1d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fe8d806e3d0 tx=0x7fe8c0009040 comp rx=0 tx=0).stop 2023-07-25T14:35:47.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.077+0000 7fe8de18e700 1 -- 172.21.15.72:0/4184702798 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe8d814e020 msgr2=0x7fe8d80abf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:47.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.077+0000 7fe8de18e700 1 --2- 172.21.15.72:0/4184702798 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe8d814e020 0x7fe8d80abf30 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fe8c8007340 tx=0x7fe8c8007650 comp rx=0 tx=0).stop 2023-07-25T14:35:47.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.077+0000 7fe8de18e700 1 -- 172.21.15.72:0/4184702798 shutdown_connections 2023-07-25T14:35:47.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.077+0000 7fe8de18e700 1 --2- 172.21.15.72:0/4184702798 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fe8b806ad10 0x7fe8b806d1d0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:47.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.077+0000 7fe8de18e700 1 --2- 172.21.15.72:0/4184702798 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe8d80bf820 0x7fe8d80bdb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:47.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.077+0000 7fe8de18e700 1 --2- 172.21.15.72:0/4184702798 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe8d814e020 0x7fe8d80abf30 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:47.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.077+0000 7fe8de18e700 1 --2- 172.21.15.72:0/4184702798 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe8d81ed110 0x7fe8d80bf2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:47.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.077+0000 7fe8de18e700 1 -- 172.21.15.72:0/4184702798 >> 172.21.15.72:0/4184702798 conn(0x7fe8d80a87e0 msgr2=0x7fe8d80c4600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:35:47.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.077+0000 7fe8de18e700 1 -- 172.21.15.72:0/4184702798 shutdown_connections 2023-07-25T14:35:47.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.077+0000 7fe8de18e700 1 -- 172.21.15.72:0/4184702798 wait complete. 2023-07-25T14:35:47.091 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 6 2023-07-25T14:35:47.100 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-25T14:35:47.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.208+0000 7fce5a2b6700 1 Processor -- start 2023-07-25T14:35:47.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.208+0000 7fce5a2b6700 1 -- start start 2023-07-25T14:35:47.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.209+0000 7fce5a2b6700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fce54151950 0x7fce5406a190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:47.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.209+0000 7fce5a2b6700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fce540724c0 0x7fce540c34c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:47.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.209+0000 7fce5a2b6700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce540c2fe0 con 0x7fce5406a6d0 2023-07-25T14:35:47.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.209+0000 7fce5a2b6700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce54071a60 con 0x7fce540724c0 2023-07-25T14:35:47.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.209+0000 7fce5a2b6700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce540c2a70 con 0x7fce54151950 2023-07-25T14:35:47.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.209+0000 7fce537fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fce540724c0 0x7fce540c34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:47.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.209+0000 7fce537fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fce540724c0 0x7fce540c34c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:39524/0 (socket says 172.21.15.72:39524) 2023-07-25T14:35:47.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.209+0000 7fce537fe700 1 -- 172.21.15.72:0/243333491 learned_addr learned my addr 172.21.15.72:0/243333491 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:35:47.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.209+0000 7fce53fff700 1 --2- 172.21.15.72:0/243333491 >> v2:172.21.15.92:3300/0 conn(0x7fce54151950 0x7fce5406a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:47.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.210+0000 7fce537fe700 1 -- 172.21.15.72:0/243333491 >> v2:172.21.15.92:3300/0 conn(0x7fce54151950 msgr2=0x7fce5406a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:35:47.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.210+0000 7fce537fe700 1 --2- 172.21.15.72:0/243333491 >> v2:172.21.15.92:3300/0 conn(0x7fce54151950 0x7fce5406a190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:47.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.210+0000 7fce537fe700 1 -- 172.21.15.72:0/243333491 >> v1:172.21.15.92:6789/0 conn(0x7fce5406a6d0 legacy=0x7fce540c3a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:47.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.210+0000 7fce537fe700 1 -- 172.21.15.72:0/243333491 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce54155070 con 0x7fce540724c0 2023-07-25T14:35:47.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.210+0000 7fce53fff700 1 --2- 172.21.15.72:0/243333491 >> v2:172.21.15.92:3300/0 conn(0x7fce54151950 0x7fce5406a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-25T14:35:47.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.210+0000 7fce537fe700 1 --2- 172.21.15.72:0/243333491 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fce540724c0 0x7fce540c34c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fce5406ad50 tx=0x7fce3c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb88b06687cb34dd server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:35:47.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.210+0000 7fce52ffd700 1 -- 172.21.15.72:0/243333491 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce3c00b870 con 0x7fce540724c0 2023-07-25T14:35:47.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.210+0000 7fce52ffd700 1 -- 172.21.15.72:0/243333491 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce3c00b9d0 con 0x7fce540724c0 2023-07-25T14:35:47.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.210+0000 7fce52ffd700 1 -- 172.21.15.72:0/243333491 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce3c00bd60 con 0x7fce540724c0 2023-07-25T14:35:47.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.210+0000 7fce5a2b6700 1 -- 172.21.15.72:0/243333491 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fce540724c0 msgr2=0x7fce540c34c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:47.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.210+0000 7fce5a2b6700 1 --2- 172.21.15.72:0/243333491 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fce540724c0 0x7fce540c34c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fce5406ad50 tx=0x7fce3c009bd0 comp rx=0 tx=0).stop 2023-07-25T14:35:47.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.210+0000 7fce5a2b6700 1 -- 172.21.15.72:0/243333491 shutdown_connections 2023-07-25T14:35:47.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.210+0000 7fce5a2b6700 1 --2- 172.21.15.72:0/243333491 >> v2:172.21.15.92:3300/0 conn(0x7fce54151950 0x7fce5406a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:47.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.210+0000 7fce5a2b6700 1 --2- 172.21.15.72:0/243333491 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fce540724c0 0x7fce540c34c0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:47.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.210+0000 7fce5a2b6700 1 -- 172.21.15.72:0/243333491 >> 172.21.15.72:0/243333491 conn(0x7fce540a87e0 msgr2=0x7fce540a8bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:35:47.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.210+0000 7fce5a2b6700 1 -- 172.21.15.72:0/243333491 shutdown_connections 2023-07-25T14:35:47.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.210+0000 7fce5a2b6700 1 -- 172.21.15.72:0/243333491 wait complete. 2023-07-25T14:35:47.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.211+0000 7fce5a2b6700 1 Processor -- start 2023-07-25T14:35:47.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.212+0000 7fce5a2b6700 1 -- start start 2023-07-25T14:35:47.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.212+0000 7fce5a2b6700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fce5406a6d0 0x7fce540c6c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:47.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.212+0000 7fce5a2b6700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fce540724c0 0x7fce540abd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:47.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.212+0000 7fce5a2b6700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fce54151950 0x7fce540ac280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:47.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.212+0000 7fce5a2b6700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce540ac7c0 con 0x7fce54151950 2023-07-25T14:35:47.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.212+0000 7fce5a2b6700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce541580b0 con 0x7fce5406a6d0 2023-07-25T14:35:47.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.212+0000 7fce5a2b6700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce540ab840 con 0x7fce540724c0 2023-07-25T14:35:47.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.212+0000 7fce58853700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fce54151950 0x7fce540ac280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:47.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.212+0000 7fce58853700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fce54151950 0x7fce540ac280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:39532/0 (socket says 172.21.15.72:39532) 2023-07-25T14:35:47.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.212+0000 7fce58853700 1 -- 172.21.15.72:0/192995661 learned_addr learned my addr 172.21.15.72:0/192995661 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:35:47.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.213+0000 7fce53fff700 1 --2- 172.21.15.72:0/192995661 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fce5406a6d0 0x7fce540c6c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:47.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.213+0000 7fce537fe700 1 --2- 172.21.15.72:0/192995661 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fce540724c0 0x7fce540abd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:47.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.213+0000 7fce58853700 1 -- 172.21.15.72:0/192995661 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fce540724c0 msgr2=0x7fce540abd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:47.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.213+0000 7fce58853700 1 --2- 172.21.15.72:0/192995661 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fce540724c0 0x7fce540abd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:47.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.213+0000 7fce58853700 1 -- 172.21.15.72:0/192995661 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fce5406a6d0 msgr2=0x7fce540c6c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:47.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.213+0000 7fce58853700 1 --2- 172.21.15.72:0/192995661 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fce5406a6d0 0x7fce540c6c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:47.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.213+0000 7fce58853700 1 -- 172.21.15.72:0/192995661 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce3c009550 con 0x7fce54151950 2023-07-25T14:35:47.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.213+0000 7fce58853700 1 --2- 172.21.15.72:0/192995661 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fce54151950 0x7fce540ac280 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fce4c00cc80 tx=0x7fce4c00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:35:47.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.213+0000 7fce50ff9700 1 -- 172.21.15.72:0/192995661 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce4c003c00 con 0x7fce54151950 2023-07-25T14:35:47.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.213+0000 7fce50ff9700 1 -- 172.21.15.72:0/192995661 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce4c003d60 con 0x7fce54151950 2023-07-25T14:35:47.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.213+0000 7fce5a2b6700 1 -- 172.21.15.72:0/192995661 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce5414c8c0 con 0x7fce54151950 2023-07-25T14:35:47.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.213+0000 7fce50ff9700 1 -- 172.21.15.72:0/192995661 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce4c00aaa0 con 0x7fce54151950 2023-07-25T14:35:47.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.213+0000 7fce5a2b6700 1 -- 172.21.15.72:0/192995661 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce540c7180 con 0x7fce54151950 2023-07-25T14:35:47.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.214+0000 7fce5a2b6700 1 -- 172.21.15.72:0/192995661 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce540c7930 con 0x7fce54151950 2023-07-25T14:35:47.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.214+0000 7fce50ff9700 1 -- 172.21.15.72:0/192995661 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fce4c00ac00 con 0x7fce54151950 2023-07-25T14:35:47.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.215+0000 7fce50ff9700 1 --2- 172.21.15.72:0/192995661 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fce3406ace0 0x7fce3406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:47.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.215+0000 7fce50ff9700 1 -- 172.21.15.72:0/192995661 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fce4c089670 con 0x7fce54151950 2023-07-25T14:35:47.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.215+0000 7fce53fff700 1 --2- 172.21.15.72:0/192995661 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fce3406ace0 0x7fce3406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:47.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.215+0000 7fce53fff700 1 --2- 172.21.15.72:0/192995661 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fce3406ace0 0x7fce3406d1a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fce4400c940 tx=0x7fce44008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:35:47.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.219+0000 7fce50ff9700 1 -- 172.21.15.72:0/192995661 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fce4c0544c0 con 0x7fce54151950 2023-07-25T14:35:47.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.408+0000 7fce5a2b6700 1 -- 172.21.15.72:0/192995661 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fce540aba60 con 0x7fce54151950 2023-07-25T14:35:47.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.409+0000 7fce50ff9700 1 -- 172.21.15.72:0/192995661 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+20014 (secure 0 0 0) 0x7fce540aba60 con 0x7fce54151950 2023-07-25T14:35:47.421 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-25T14:35:47.421 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":25,"fsid":"9170db48-9170-43e8-8ccb-9813e6240906","created":"2023-07-25T14:35:21.733262+0000","modified":"2023-07-25T14:35:44.992669+0000","last_up_change":"2023-07-25T14:35:31.355010+0000","last_in_change":"2023-07-25T14:35:24.195785+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-25T14:35:32.983457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-25T14:35:33.326342+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-25T14:35:37.534158+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-25T14:35:38.891571+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-25T14:35:42.596923+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d517fdad-0bfe-49f0-89f2-9421c3761839","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6801","nonce":2475407414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6803","nonce":2475407414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6807","nonce":2475407414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6805","nonce":2475407414}]},"public_addr":"172.21.15.72:6801/2475407414","cluster_addr":"172.21.15.72:6803/2475407414","heartbeat_back_addr":"172.21.15.72:6807/2475407414","heartbeat_front_addr":"172.21.15.72:6805/2475407414","state":["exists","up"]},{"osd":1,"uuid":"e1564be3-f209-47e5-a8d0-32fc618a474f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6822","nonce":870954016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6825","nonce":870954016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6831","nonce":870954016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6827","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6829","nonce":870954016}]},"public_addr":"172.21.15.72:6822/870954016","cluster_addr":"172.21.15.72:6825/870954016","heartbeat_back_addr":"172.21.15.72:6831/870954016","heartbeat_front_addr":"172.21.15.72:6829/870954016","state":["exists","up"]},{"osd":2,"uuid":"c4647d30-ffa6-417a-9026-ef530c75910e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6809","nonce":2143129442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6811","nonce":2143129442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6815","nonce":2143129442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6813","nonce":2143129442}]},"public_addr":"172.21.15.72:6809/2143129442","cluster_addr":"172.21.15.72:6811/2143129442","heartbeat_back_addr":"172.21.15.72:6815/2143129442","heartbeat_front_addr":"172.21.15.72:6813/2143129442","state":["exists","up"]},{"osd":3,"uuid":"76c9d9a7-c2e2-4612-a58b-d6882dd76b58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6817","nonce":3404066311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6819","nonce":3404066311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6828","nonce":3404066311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6821","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6823","nonce":3404066311}]},"public_addr":"172.21.15.72:6817/3404066311","cluster_addr":"172.21.15.72:6819/3404066311","heartbeat_back_addr":"172.21.15.72:6828/3404066311","heartbeat_front_addr":"172.21.15.72:6823/3404066311","state":["exists","up"]},{"osd":4,"uuid":"7f8920dc-0ad4-4a73-ab40-65408f83eadd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6817","nonce":2381008739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6819","nonce":2381008739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6825","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6827","nonce":2381008739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6822","nonce":2381008739}]},"public_addr":"172.21.15.92:6817/2381008739","cluster_addr":"172.21.15.92:6819/2381008739","heartbeat_back_addr":"172.21.15.92:6827/2381008739","heartbeat_front_addr":"172.21.15.92:6822/2381008739","state":["exists","up"]},{"osd":5,"uuid":"56257e7c-31eb-44c5-9ec7-1318a4e0bb35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6801","nonce":2161935604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6803","nonce":2161935604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6807","nonce":2161935604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6805","nonce":2161935604}]},"public_addr":"172.21.15.92:6801/2161935604","cluster_addr":"172.21.15.92:6803/2161935604","heartbeat_back_addr":"172.21.15.92:6807/2161935604","heartbeat_front_addr":"172.21.15.92:6805/2161935604","state":["exists","up"]},{"osd":6,"uuid":"a150d3d8-a0c9-4955-968a-8d98eff4ffb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6809","nonce":3770163493}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6811","nonce":3770163493}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6815","nonce":3770163493}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6813","nonce":3770163493}]},"public_addr":"172.21.15.92:6809/3770163493","cluster_addr":"172.21.15.92:6811/3770163493","heartbeat_back_addr":"172.21.15.92:6815/3770163493","heartbeat_front_addr":"172.21.15.92:6813/3770163493","state":["exists","up"]},{"osd":7,"uuid":"07799c27-54ee-4591-a42d-a978d6b32065","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6821","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6823","nonce":2135777609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6826","nonce":2135777609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6831","nonce":2135777609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6829","nonce":2135777609}]},"public_addr":"172.21.15.92:6823/2135777609","cluster_addr":"172.21.15.92:6826/2135777609","heartbeat_back_addr":"172.21.15.92:6831/2135777609","heartbeat_front_addr":"172.21.15.92:6829/2135777609","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.345365+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.378150+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.146566+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.372172+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:30.398421+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.385632+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.465611+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.443583+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-25T14:35:47.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.411+0000 7fce5a2b6700 1 -- 172.21.15.72:0/192995661 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fce3406ace0 msgr2=0x7fce3406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:47.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.411+0000 7fce5a2b6700 1 --2- 172.21.15.72:0/192995661 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fce3406ace0 0x7fce3406d1a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fce4400c940 tx=0x7fce44008040 comp rx=0 tx=0).stop 2023-07-25T14:35:47.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.411+0000 7fce5a2b6700 1 -- 172.21.15.72:0/192995661 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fce54151950 msgr2=0x7fce540ac280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:47.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.411+0000 7fce5a2b6700 1 --2- 172.21.15.72:0/192995661 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fce54151950 0x7fce540ac280 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fce4c00cc80 tx=0x7fce4c00cf90 comp rx=0 tx=0).stop 2023-07-25T14:35:47.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.411+0000 7fce5a2b6700 1 -- 172.21.15.72:0/192995661 shutdown_connections 2023-07-25T14:35:47.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.411+0000 7fce5a2b6700 1 --2- 172.21.15.72:0/192995661 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fce3406ace0 0x7fce3406d1a0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:47.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.411+0000 7fce5a2b6700 1 --2- 172.21.15.72:0/192995661 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fce54151950 0x7fce540ac280 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:47.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.411+0000 7fce5a2b6700 1 --2- 172.21.15.72:0/192995661 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fce5406a6d0 0x7fce540c6c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:47.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.411+0000 7fce5a2b6700 1 --2- 172.21.15.72:0/192995661 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fce540724c0 0x7fce540abd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:47.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.411+0000 7fce5a2b6700 1 -- 172.21.15.72:0/192995661 >> 172.21.15.72:0/192995661 conn(0x7fce540a87e0 msgr2=0x7fce5414eae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:35:47.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.411+0000 7fce5a2b6700 1 -- 172.21.15.72:0/192995661 shutdown_connections 2023-07-25T14:35:47.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.411+0000 7fce5a2b6700 1 -- 172.21.15.72:0/192995661 wait complete. 2023-07-25T14:35:47.838 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-07-25T14:35:39.939860+0000', 'modified': '2023-07-25T14:35:45.587223+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4285}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4285': {'gid': 4285, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.92:6835/2045555979', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.92:6833', 'nonce': 2045555979}, {'type': 'v1', 'addr': '172.21.15.92:6835', 'nonce': 2045555979}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4, 5], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1} 2023-07-25T14:35:47.839 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-07-25T14:35:47.839 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-07-25T14:35:47.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.949+0000 7f988d771700 1 Processor -- start 2023-07-25T14:35:47.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.949+0000 7f988d771700 1 -- start start 2023-07-25T14:35:47.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.950+0000 7f988d771700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f98880c42e0 0x7f988814f160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:47.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.950+0000 7f988d771700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f98880c58a0 0x7f98880ac810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:47.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.950+0000 7f988d771700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98880c27f0 con 0x7f98880ad6c0 2023-07-25T14:35:47.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.950+0000 7f988d771700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98880c24a0 con 0x7f98880c42e0 2023-07-25T14:35:47.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.950+0000 7f988d771700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9888152ec0 con 0x7f98880c58a0 2023-07-25T14:35:47.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.950+0000 7f9886ffd700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f98880c42e0 0x7f988814f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:47.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.950+0000 7f98877fe700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f98880c58a0 0x7f98880ac810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:47.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.950+0000 7f98867fc700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f98880ad6c0 0x7f988814f6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.72:53848/0 (socket says 172.21.15.72:53848) 2023-07-25T14:35:47.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.950+0000 7f9886ffd700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f98880c42e0 0x7f988814f160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.72:35108/0 (socket says 172.21.15.72:35108) 2023-07-25T14:35:47.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.950+0000 7f98877fe700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f98880c58a0 0x7f98880ac810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3301/0 says I am v2:172.21.15.72:44768/0 (socket says 172.21.15.72:44768) 2023-07-25T14:35:47.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.950+0000 7f98867fc700 1 -- 172.21.15.72:0/814845175 learned_addr learned my addr 172.21.15.72:0/814845175 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:35:47.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.950+0000 7f98877fe700 1 -- 172.21.15.72:0/814845175 >> v2:172.21.15.92:3300/0 conn(0x7f98880c42e0 msgr2=0x7f988814f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:35:47.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.950+0000 7f98877fe700 1 --2- 172.21.15.72:0/814845175 >> v2:172.21.15.92:3300/0 conn(0x7f98880c42e0 0x7f988814f160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:47.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.950+0000 7f98877fe700 1 -- 172.21.15.72:0/814845175 >> v1:172.21.15.92:6789/0 conn(0x7f98880ad6c0 legacy=0x7f988814f6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:47.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.950+0000 7f9885ffb700 1 -- 172.21.15.72:0/814845175 <== mon.1 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2115019400 0 0) 0x7f98880c27f0 con 0x7f98880ad6c0 2023-07-25T14:35:47.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.950+0000 7f98877fe700 1 -- 172.21.15.72:0/814845175 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9888152b70 con 0x7f98880c58a0 2023-07-25T14:35:47.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.950+0000 7f9886ffd700 1 --2- 172.21.15.72:0/814845175 >> v2:172.21.15.92:3300/0 conn(0x7f98880c42e0 0x7f988814f160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-25T14:35:47.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.951+0000 7f98877fe700 1 --2- 172.21.15.72:0/814845175 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f98880c58a0 0x7f98880ac810 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f9880009d90 tx=0x7f988000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=133881ad78b19a05 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:35:47.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.951+0000 7f9885ffb700 1 -- 172.21.15.72:0/814845175 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f988000e070 con 0x7f98880c58a0 2023-07-25T14:35:47.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.951+0000 7f9885ffb700 1 -- 172.21.15.72:0/814845175 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f988000bb20 con 0x7f98880c58a0 2023-07-25T14:35:47.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.951+0000 7f9885ffb700 1 -- 172.21.15.72:0/814845175 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9880012430 con 0x7f98880c58a0 2023-07-25T14:35:47.968 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.951+0000 7f988d771700 1 -- 172.21.15.72:0/814845175 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f98880c58a0 msgr2=0x7f98880ac810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:47.968 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.951+0000 7f988d771700 1 --2- 172.21.15.72:0/814845175 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f98880c58a0 0x7f98880ac810 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f9880009d90 tx=0x7f988000b330 comp rx=0 tx=0).stop 2023-07-25T14:35:47.968 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.951+0000 7f988d771700 1 -- 172.21.15.72:0/814845175 shutdown_connections 2023-07-25T14:35:47.968 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.951+0000 7f988d771700 1 --2- 172.21.15.72:0/814845175 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f98880c58a0 0x7f98880ac810 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:47.968 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.951+0000 7f988d771700 1 --2- 172.21.15.72:0/814845175 >> v2:172.21.15.92:3300/0 conn(0x7f98880c42e0 0x7f988814f160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:47.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.951+0000 7f988d771700 1 -- 172.21.15.72:0/814845175 >> 172.21.15.72:0/814845175 conn(0x7f988806a950 msgr2=0x7f98880a94b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:35:47.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.951+0000 7f988d771700 1 -- 172.21.15.72:0/814845175 shutdown_connections 2023-07-25T14:35:47.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.951+0000 7f988d771700 1 -- 172.21.15.72:0/814845175 wait complete. 2023-07-25T14:35:47.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.953+0000 7f988d771700 1 Processor -- start 2023-07-25T14:35:47.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.953+0000 7f988d771700 1 -- start start 2023-07-25T14:35:47.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.953+0000 7f988d771700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f98880ad6c0 0x7f9888156120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:47.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.953+0000 7f988d771700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f98880c42e0 0x7f98881e95e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:47.970 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.953+0000 7f988d771700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f98880c58a0 0x7f98881540c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:47.970 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.953+0000 7f988d771700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9888153990 con 0x7f98880ad6c0 2023-07-25T14:35:47.970 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.953+0000 7f988d771700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f988814c2e0 con 0x7f98880c58a0 2023-07-25T14:35:47.970 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.953+0000 7f988d771700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98880be390 con 0x7f98880c42e0 2023-07-25T14:35:47.970 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.953+0000 7f9886ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f98880ad6c0 0x7f9888156120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:47.970 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.953+0000 7f9886ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f98880ad6c0 0x7f9888156120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:39542/0 (socket says 172.21.15.72:39542) 2023-07-25T14:35:47.970 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.953+0000 7f9886ffd700 1 -- 172.21.15.72:0/2728632118 learned_addr learned my addr 172.21.15.72:0/2728632118 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:35:47.970 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.953+0000 7f98867fc700 1 --2- 172.21.15.72:0/2728632118 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f98880c42e0 0x7f98881e95e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:47.971 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.953+0000 7f98877fe700 1 --2- 172.21.15.72:0/2728632118 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f98880c58a0 0x7f98881540c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:47.971 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.954+0000 7f9886ffd700 1 -- 172.21.15.72:0/2728632118 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f98880c42e0 msgr2=0x7f98881e95e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:47.971 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.954+0000 7f9886ffd700 1 --2- 172.21.15.72:0/2728632118 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f98880c42e0 0x7f98881e95e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:47.971 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.954+0000 7f9886ffd700 1 -- 172.21.15.72:0/2728632118 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f98880c58a0 msgr2=0x7f98881540c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:47.971 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.954+0000 7f9886ffd700 1 --2- 172.21.15.72:0/2728632118 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f98880c58a0 0x7f98881540c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:47.971 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.954+0000 7f9886ffd700 1 -- 172.21.15.72:0/2728632118 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f987c0094a0 con 0x7f98880ad6c0 2023-07-25T14:35:47.971 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.954+0000 7f9886ffd700 1 --2- 172.21.15.72:0/2728632118 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f98880ad6c0 0x7f9888156120 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f987c00ebe0 tx=0x7f987c00eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:35:47.972 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.954+0000 7f986f7fe700 1 -- 172.21.15.72:0/2728632118 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f987c00c850 con 0x7f98880ad6c0 2023-07-25T14:35:47.972 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.954+0000 7f986f7fe700 1 -- 172.21.15.72:0/2728632118 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f987c00c9b0 con 0x7f98880ad6c0 2023-07-25T14:35:47.972 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.954+0000 7f988d771700 1 -- 172.21.15.72:0/2728632118 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9880009a70 con 0x7f98880ad6c0 2023-07-25T14:35:47.972 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.954+0000 7f986f7fe700 1 -- 172.21.15.72:0/2728632118 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f987c00cd40 con 0x7f98880ad6c0 2023-07-25T14:35:47.972 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.954+0000 7f988d771700 1 -- 172.21.15.72:0/2728632118 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98880be040 con 0x7f98880ad6c0 2023-07-25T14:35:47.972 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.955+0000 7f986f7fe700 1 -- 172.21.15.72:0/2728632118 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f987c013470 con 0x7f98880ad6c0 2023-07-25T14:35:47.972 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.956+0000 7f986f7fe700 1 --2- 172.21.15.72:0/2728632118 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f987406ace0 0x7f987406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:47.972 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.956+0000 7f986f7fe700 1 -- 172.21.15.72:0/2728632118 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f987c089830 con 0x7f98880ad6c0 2023-07-25T14:35:47.973 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.956+0000 7f98867fc700 1 --2- 172.21.15.72:0/2728632118 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f987406ace0 0x7f987406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:47.973 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.956+0000 7f98867fc700 1 --2- 172.21.15.72:0/2728632118 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f987406ace0 0x7f987406d1a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f9888151030 tx=0x7f9878007e70 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:35:47.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.958+0000 7f9899909b80 1 Processor -- start 2023-07-25T14:35:47.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.958+0000 7f9899909b80 1 -- start start 2023-07-25T14:35:47.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.958+0000 7f9899909b80 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x55623d7e3910 0x55623d7de1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:47.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.958+0000 7f9899909b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55623d7e4c90 0x55623d7de700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:47.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.958+0000 7f9899909b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55623d7dec40 0x55623d8012c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:47.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.958+0000 7f9899909b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x55623d6dbb80 con 0x55623d7dec40 2023-07-25T14:35:47.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.958+0000 7f9899909b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55623d73b540 con 0x55623d7e4c90 2023-07-25T14:35:47.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.958+0000 7f9899909b80 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x55623d738e60 con 0x55623d7e3910 2023-07-25T14:35:47.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.959+0000 7f98877fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55623d7dec40 0x55623d8012c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:47.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.959+0000 7f98877fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55623d7dec40 0x55623d8012c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:39552/0 (socket says 172.21.15.72:39552) 2023-07-25T14:35:47.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.959+0000 7f98877fe700 1 -- 172.21.15.72:0/338142570 learned_addr learned my addr 172.21.15.72:0/338142570 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:35:47.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.959+0000 7f98867fc700 1 --2- 172.21.15.72:0/338142570 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55623d7e4c90 0x55623d7de700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:47.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.959+0000 7f9886ffd700 1 --2- 172.21.15.72:0/338142570 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x55623d7e3910 0x55623d7de1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:47.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.959+0000 7f98877fe700 1 -- 172.21.15.72:0/338142570 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x55623d7e3910 msgr2=0x55623d7de1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:35:47.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.959+0000 7f98877fe700 1 --2- 172.21.15.72:0/338142570 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x55623d7e3910 0x55623d7de1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:47.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.959+0000 7f98877fe700 1 -- 172.21.15.72:0/338142570 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55623d7e4c90 msgr2=0x55623d7de700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:35:47.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.959+0000 7f98877fe700 1 --2- 172.21.15.72:0/338142570 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55623d7e4c90 0x55623d7de700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:47.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.959+0000 7f98877fe700 1 -- 172.21.15.72:0/338142570 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55623d5b55e0 con 0x55623d7dec40 2023-07-25T14:35:47.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.959+0000 7f98877fe700 1 --2- 172.21.15.72:0/338142570 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55623d7dec40 0x55623d8012c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f98800099a0 tx=0x7f9880010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0df558d6959ec9d server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:35:47.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.959+0000 7f986cff9700 1 -- 172.21.15.72:0/338142570 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9880003b20 con 0x55623d7dec40 2023-07-25T14:35:47.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.959+0000 7f986cff9700 1 -- 172.21.15.72:0/338142570 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9880003c80 con 0x55623d7dec40 2023-07-25T14:35:47.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.959+0000 7f986cff9700 1 -- 172.21.15.72:0/338142570 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98800125e0 con 0x55623d7dec40 2023-07-25T14:35:47.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.960+0000 7f9899909b80 1 -- 172.21.15.72:0/338142570 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55623d7dec40 msgr2=0x55623d8012c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:47.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.960+0000 7f9899909b80 1 --2- 172.21.15.72:0/338142570 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55623d7dec40 0x55623d8012c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f98800099a0 tx=0x7f9880010000 comp rx=0 tx=0).stop 2023-07-25T14:35:47.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.960+0000 7f9899909b80 1 -- 172.21.15.72:0/338142570 shutdown_connections 2023-07-25T14:35:47.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.960+0000 7f9899909b80 1 --2- 172.21.15.72:0/338142570 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x55623d7e3910 0x55623d7de1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:47.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.960+0000 7f9899909b80 1 --2- 172.21.15.72:0/338142570 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55623d7dec40 0x55623d8012c0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:47.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.960+0000 7f9899909b80 1 --2- 172.21.15.72:0/338142570 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55623d7e4c90 0x55623d7de700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:47.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.960+0000 7f9899909b80 1 -- 172.21.15.72:0/338142570 >> 172.21.15.72:0/338142570 conn(0x55623d740c80 msgr2=0x55623d7e1570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:35:47.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.960+0000 7f9899909b80 1 -- 172.21.15.72:0/338142570 shutdown_connections 2023-07-25T14:35:47.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.960+0000 7f9899909b80 1 -- 172.21.15.72:0/338142570 wait complete. 2023-07-25T14:35:47.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.960+0000 7f9899909b80 1 -- start start 2023-07-25T14:35:47.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.961+0000 7f9899909b80 1 Processor -- start 2023-07-25T14:35:47.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.961+0000 7f9899909b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55623d7dec40 0x55623d7fc0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:47.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.961+0000 7f9899909b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55623d7e3910 0x55623d802d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:47.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.961+0000 7f9899909b80 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x55623d7e4c90 0x55623d8032d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:47.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.961+0000 7f9899909b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x55623d734750 con 0x55623d7e3910 2023-07-25T14:35:47.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.961+0000 7f9899909b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55623d6d3a70 con 0x55623d7dec40 2023-07-25T14:35:47.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.961+0000 7f9899909b80 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x55623d6d3770 con 0x55623d7e4c90 2023-07-25T14:35:47.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.961+0000 7f9899909b80 10 client.0 _ll_register_callbacks cb 0x55623d6d1630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-25T14:35:47.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.961+0000 7f98867fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55623d7e3910 0x55623d802d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:47.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.961+0000 7f98867fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55623d7e3910 0x55623d802d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:39556/0 (socket says 172.21.15.72:39556) 2023-07-25T14:35:47.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.961+0000 7f98867fc700 1 -- 172.21.15.72:0/4287780436 learned_addr learned my addr 172.21.15.72:0/4287780436 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:35:47.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.961+0000 7f9886ffd700 1 --2- 172.21.15.72:0/4287780436 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55623d7dec40 0x55623d7fc0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:47.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.961+0000 7f98877fe700 1 --2- 172.21.15.72:0/4287780436 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x55623d7e4c90 0x55623d8032d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:47.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.962+0000 7f98867fc700 1 -- 172.21.15.72:0/4287780436 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x55623d7e4c90 msgr2=0x55623d8032d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:35:47.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.962+0000 7f98867fc700 1 --2- 172.21.15.72:0/4287780436 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x55623d7e4c90 0x55623d8032d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:47.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.962+0000 7f98867fc700 1 -- 172.21.15.72:0/4287780436 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55623d7dec40 msgr2=0x55623d7fc0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:35:47.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.962+0000 7f98867fc700 1 --2- 172.21.15.72:0/4287780436 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55623d7dec40 0x55623d7fc0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:47.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.962+0000 7f98867fc700 1 -- 172.21.15.72:0/4287780436 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9888152b70 con 0x55623d7e3910 2023-07-25T14:35:47.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.962+0000 7f98867fc700 1 --2- 172.21.15.72:0/4287780436 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55623d7e3910 0x55623d802d90 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f988814c680 tx=0x7f9878000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=223b421737f3860f server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:35:47.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.962+0000 7f9865ffb700 10 client.0 ms_handle_connect on v2:172.21.15.72:3300/0 2023-07-25T14:35:47.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.962+0000 7f9865ffb700 1 -- 172.21.15.72:0/4287780436 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98780018e0 con 0x55623d7e3910 2023-07-25T14:35:47.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.962+0000 7f9865ffb700 1 -- 172.21.15.72:0/4287780436 <== mon.0 v2:172.21.15.72:3300/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f9878001a40 con 0x55623d7e3910 2023-07-25T14:35:47.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.962+0000 7f9899909b80 1 -- 172.21.15.72:0/4287780436 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55623d7b2b40 con 0x55623d7e3910 2023-07-25T14:35:47.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.962+0000 7f9865ffb700 1 -- 172.21.15.72:0/4287780436 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9878001c00 con 0x55623d7e3910 2023-07-25T14:35:47.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.962+0000 7f9899909b80 10 client.4422 fetch_fsmap learned FSMap version 6 2023-07-25T14:35:47.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.962+0000 7f9899909b80 1 -- 172.21.15.72:0/4287780436 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) v3 -- 0x55623d561d90 con 0x55623d7e3910 2023-07-25T14:35:47.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.962+0000 7f9865ffb700 1 -- 172.21.15.72:0/4287780436 <== mon.0 v2:172.21.15.72:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55623d7b2b40 con 0x55623d7e3910 2023-07-25T14:35:47.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.962+0000 7f9865ffb700 1 -- 172.21.15.72:0/4287780436 <== mon.0 v2:172.21.15.72:3300/0 5 ==== fsmap(e 6) v1 ==== 3122+0+0 (secure 0 0 0) 0x7f9878028250 con 0x55623d7e3910 2023-07-25T14:35:47.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.962+0000 7f9899909b80 10 client.4422 fetch_fsmap finished waiting for FSMap version 6 2023-07-25T14:35:47.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.962+0000 7f9899909b80 10 client.4422 resolve_mds: resolved name 'b' to daemon mds.b 2023-07-25T14:35:47.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.962+0000 7f9899909b80 20 client.4422 populate_metadata read hostname 'smithi072' 2023-07-25T14:35:47.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.962+0000 7f9899909b80 1 --2- 172.21.15.72:0/4287780436 >> [v2:172.21.15.92:6833/2045555979,v1:172.21.15.92:6835/2045555979] conn(0x55623d8324e0 0x55623d8328c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:47.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.962+0000 7f9899909b80 4 client.4422 mds_command: new command op to 4285 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-25T14:35:47.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.962+0000 7f9899909b80 1 -- 172.21.15.72:0/4287780436 --> [v2:172.21.15.92:6833/2045555979,v1:172.21.15.92:6835/2045555979] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55623d75ed40 con 0x55623d8324e0 2023-07-25T14:35:47.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.962+0000 7f9886ffd700 1 --2- 172.21.15.72:0/4287780436 >> [v2:172.21.15.92:6833/2045555979,v1:172.21.15.92:6835/2045555979] conn(0x55623d8324e0 0x55623d8328c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:47.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.963+0000 7f9886ffd700 1 --2- 172.21.15.72:0/4287780436 >> [v2:172.21.15.92:6833/2045555979,v1:172.21.15.92:6835/2045555979] conn(0x55623d8324e0 0x55623d8328c0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=729f955ccb9181b4 server_cookie=d06410437142a442 in_seq=0 out_seq=0 2023-07-25T14:35:47.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.963+0000 7f9865ffb700 10 client.4422 ms_handle_connect on v2:172.21.15.92:6833/2045555979 2023-07-25T14:35:47.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.963+0000 7f9865ffb700 1 -- 172.21.15.72:0/4287780436 <== mds.0 v2:172.21.15.92:6833/2045555979 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x55623d75ed40 con 0x55623d8324e0 2023-07-25T14:35:47.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.963+0000 7f9865ffb700 10 client.4422 handle_command_reply: tid=0 2023-07-25T14:35:47.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.963+0000 7f9899909b80 1 client.4422 shutdown 2023-07-25T14:35:47.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.964+0000 7f9899909b80 1 -- 172.21.15.72:0/4287780436 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55623d7e3910 msgr2=0x55623d802d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:47.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.964+0000 7f9899909b80 1 --2- 172.21.15.72:0/4287780436 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55623d7e3910 0x55623d802d90 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f988814c680 tx=0x7f9878000ed0 comp rx=0 tx=0).stop 2023-07-25T14:35:47.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.964+0000 7f9899909b80 1 -- 172.21.15.72:0/4287780436 shutdown_connections 2023-07-25T14:35:47.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.964+0000 7f9899909b80 1 --2- 172.21.15.72:0/4287780436 >> [v2:172.21.15.92:6833/2045555979,v1:172.21.15.92:6835/2045555979] conn(0x55623d8324e0 0x55623d8328c0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:47.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.964+0000 7f9899909b80 1 --2- 172.21.15.72:0/4287780436 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x55623d7e4c90 0x55623d8032d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:47.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.964+0000 7f9899909b80 1 --2- 172.21.15.72:0/4287780436 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55623d7dec40 0x55623d7fc0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:47.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.964+0000 7f9865ffb700 0 client.4422 ms_handle_reset on v2:172.21.15.92:6833/2045555979 2023-07-25T14:35:47.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.964+0000 7f9899909b80 1 --2- 172.21.15.72:0/4287780436 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55623d7e3910 0x55623d802d90 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:47.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.964+0000 7f9899909b80 1 -- 172.21.15.72:0/4287780436 >> 172.21.15.72:0/4287780436 conn(0x55623d740c80 msgr2=0x55623d7dd020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:35:47.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.964+0000 7f9899909b80 1 -- 172.21.15.72:0/4287780436 shutdown_connections 2023-07-25T14:35:47.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.964+0000 7f9899909b80 1 -- 172.21.15.72:0/4287780436 wait complete. 2023-07-25T14:35:47.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.964+0000 7f9899909b80 20 client.4422 trim_cache size 0 max 16384 2023-07-25T14:35:47.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.981+0000 7f9899909b80 1 Processor -- start 2023-07-25T14:35:47.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.981+0000 7f9899909b80 1 -- start start 2023-07-25T14:35:47.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.982+0000 7f9899909b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55623d7dec40 0x55623d7dff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:47.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.982+0000 7f9899909b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55623d7e3910 0x55623d7dde70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:47.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.982+0000 7f9899909b80 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x55623d7e4c90 0x55623d7de3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:47.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.982+0000 7f9899909b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x55623d5b78d0 con 0x55623d7dec40 2023-07-25T14:35:47.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.982+0000 7f9899909b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55623d7fb8e0 con 0x55623d7e3910 2023-07-25T14:35:47.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.982+0000 7f9899909b80 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x55623d800600 con 0x55623d7e4c90 2023-07-25T14:35:47.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.982+0000 7f9886ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55623d7dec40 0x55623d7dff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:47.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.982+0000 7f9886ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55623d7dec40 0x55623d7dff80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:39562/0 (socket says 172.21.15.72:39562) 2023-07-25T14:35:47.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.982+0000 7f9886ffd700 1 -- 172.21.15.72:0/1719055233 learned_addr learned my addr 172.21.15.72:0/1719055233 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:35:47.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.982+0000 7f9886ffd700 1 -- 172.21.15.72:0/1719055233 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x55623d7e4c90 msgr2=0x55623d7de3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:35:47.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.982+0000 7f9886ffd700 1 --2- 172.21.15.72:0/1719055233 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x55623d7e4c90 0x55623d7de3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:47.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.982+0000 7f9886ffd700 1 -- 172.21.15.72:0/1719055233 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55623d7e3910 msgr2=0x55623d7dde70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:35:47.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.982+0000 7f9886ffd700 1 --2- 172.21.15.72:0/1719055233 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55623d7e3910 0x55623d7dde70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:47.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.982+0000 7f9886ffd700 1 -- 172.21.15.72:0/1719055233 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55623d54ac10 con 0x55623d7dec40 2023-07-25T14:35:47.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.982+0000 7f9886ffd700 1 --2- 172.21.15.72:0/1719055233 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55623d7dec40 0x55623d7dff80 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f987c0547a0 tx=0x7f987c0877d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6aca84578044bd94 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:35:47.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.982+0000 7f986d7fa700 1 -- 172.21.15.72:0/1719055233 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f987c06bea0 con 0x55623d7dec40 2023-07-25T14:35:47.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.982+0000 7f986d7fa700 1 -- 172.21.15.72:0/1719055233 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f987c0563e0 con 0x55623d7dec40 2023-07-25T14:35:47.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.982+0000 7f986d7fa700 1 -- 172.21.15.72:0/1719055233 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f987c056640 con 0x55623d7dec40 2023-07-25T14:35:47.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.983+0000 7f9899909b80 1 -- 172.21.15.72:0/1719055233 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55623d7dec40 msgr2=0x55623d7dff80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:47.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.983+0000 7f9899909b80 1 --2- 172.21.15.72:0/1719055233 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55623d7dec40 0x55623d7dff80 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f987c0547a0 tx=0x7f987c0877d0 comp rx=0 tx=0).stop 2023-07-25T14:35:47.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.983+0000 7f9899909b80 1 -- 172.21.15.72:0/1719055233 shutdown_connections 2023-07-25T14:35:47.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.983+0000 7f9899909b80 1 --2- 172.21.15.72:0/1719055233 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x55623d7e4c90 0x55623d7de3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:47.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.983+0000 7f9899909b80 1 --2- 172.21.15.72:0/1719055233 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55623d7dec40 0x55623d7dff80 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:47.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.983+0000 7f9899909b80 1 --2- 172.21.15.72:0/1719055233 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55623d7e3910 0x55623d7dde70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:47.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.983+0000 7f9899909b80 1 -- 172.21.15.72:0/1719055233 >> 172.21.15.72:0/1719055233 conn(0x55623d740c80 msgr2=0x55623d81c900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:35:47.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.983+0000 7f9899909b80 1 -- 172.21.15.72:0/1719055233 shutdown_connections 2023-07-25T14:35:47.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.983+0000 7f9899909b80 1 -- 172.21.15.72:0/1719055233 wait complete. 2023-07-25T14:35:48.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.983+0000 7f9899909b80 1 -- start start 2023-07-25T14:35:48.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.983+0000 7f9899909b80 1 Processor -- start 2023-07-25T14:35:48.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.985+0000 7f9899909b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55623d7dec40 0x55623d82bac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:48.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.985+0000 7f9899909b80 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x55623d7e3910 0x55623d838ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:48.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.985+0000 7f9899909b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55623d7e4c90 0x55623d7dcdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:48.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.985+0000 7f9899909b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x55623d823ce0 con 0x55623d7e4c90 2023-07-25T14:35:48.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.985+0000 7f9899909b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55623d889ad0 con 0x55623d7dec40 2023-07-25T14:35:48.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.985+0000 7f9899909b80 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x55623d8009d0 con 0x55623d7e3910 2023-07-25T14:35:48.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.985+0000 7f9899909b80 10 client.0 _ll_register_callbacks cb 0x55623d82fe00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-25T14:35:48.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.985+0000 7f98877fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55623d7e4c90 0x55623d7dcdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:48.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.985+0000 7f98877fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55623d7e4c90 0x55623d7dcdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:39572/0 (socket says 172.21.15.72:39572) 2023-07-25T14:35:48.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.985+0000 7f98877fe700 1 -- 172.21.15.72:0/2679500080 learned_addr learned my addr 172.21.15.72:0/2679500080 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:35:48.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.985+0000 7f98877fe700 1 -- 172.21.15.72:0/2679500080 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x55623d7e3910 msgr2=0x55623d838ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:35:48.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.985+0000 7f98877fe700 1 --2- 172.21.15.72:0/2679500080 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x55623d7e3910 0x55623d838ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:48.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.985+0000 7f98877fe700 1 -- 172.21.15.72:0/2679500080 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55623d7dec40 msgr2=0x55623d82bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:35:48.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.985+0000 7f9886ffd700 1 --2- 172.21.15.72:0/2679500080 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55623d7dec40 0x55623d82bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:48.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.985+0000 7f98877fe700 1 --2- 172.21.15.72:0/2679500080 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55623d7dec40 0x55623d82bac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:48.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.985+0000 7f98877fe700 1 -- 172.21.15.72:0/2679500080 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98880be040 con 0x55623d7e4c90 2023-07-25T14:35:48.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.985+0000 7f98877fe700 1 --2- 172.21.15.72:0/2679500080 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55623d7e4c90 0x55623d7dcdf0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f988000b370 tx=0x7f9880004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eab63a67189359aa server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:35:48.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.985+0000 7f9865ffb700 10 client.0 ms_handle_connect on v2:172.21.15.72:3300/0 2023-07-25T14:35:48.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.985+0000 7f9865ffb700 1 -- 172.21.15.72:0/2679500080 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9880012e00 con 0x55623d7e4c90 2023-07-25T14:35:48.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.985+0000 7f9865ffb700 1 -- 172.21.15.72:0/2679500080 <== mon.0 v2:172.21.15.72:3300/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f9880026670 con 0x55623d7e4c90 2023-07-25T14:35:48.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.985+0000 7f9899909b80 1 -- 172.21.15.72:0/2679500080 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55623d7d5fe0 con 0x55623d7e4c90 2023-07-25T14:35:48.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.985+0000 7f9865ffb700 1 -- 172.21.15.72:0/2679500080 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9880026830 con 0x55623d7e4c90 2023-07-25T14:35:48.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.985+0000 7f9899909b80 10 client.4428 fetch_fsmap learned FSMap version 6 2023-07-25T14:35:48.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.985+0000 7f9899909b80 1 -- 172.21.15.72:0/2679500080 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) v3 -- 0x55623d588200 con 0x55623d7e4c90 2023-07-25T14:35:48.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.986+0000 7f9865ffb700 1 -- 172.21.15.72:0/2679500080 <== mon.0 v2:172.21.15.72:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55623d7d5fe0 con 0x55623d7e4c90 2023-07-25T14:35:48.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.986+0000 7f9865ffb700 1 -- 172.21.15.72:0/2679500080 <== mon.0 v2:172.21.15.72:3300/0 5 ==== fsmap(e 6) v1 ==== 3122+0+0 (secure 0 0 0) 0x7f9880026990 con 0x55623d7e4c90 2023-07-25T14:35:48.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.986+0000 7f9899909b80 10 client.4428 fetch_fsmap finished waiting for FSMap version 6 2023-07-25T14:35:48.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.986+0000 7f9899909b80 10 client.4428 resolve_mds: resolved name 'b' to daemon mds.b 2023-07-25T14:35:48.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.986+0000 7f9899909b80 20 client.4428 populate_metadata read hostname 'smithi072' 2023-07-25T14:35:48.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.986+0000 7f9899909b80 1 --2- 172.21.15.72:0/2679500080 >> [v2:172.21.15.92:6833/2045555979,v1:172.21.15.92:6835/2045555979] conn(0x55623d7dd330 0x55623d7dd710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:48.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.986+0000 7f9899909b80 4 client.4428 mds_command: new command op to 4285 tid=0[{"prefix": "status"}] 2023-07-25T14:35:48.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.986+0000 7f9899909b80 1 -- 172.21.15.72:0/2679500080 --> [v2:172.21.15.92:6833/2045555979,v1:172.21.15.92:6835/2045555979] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55623d72d730 con 0x55623d7dd330 2023-07-25T14:35:48.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.986+0000 7f9886ffd700 1 --2- 172.21.15.72:0/2679500080 >> [v2:172.21.15.92:6833/2045555979,v1:172.21.15.92:6835/2045555979] conn(0x55623d7dd330 0x55623d7dd710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:48.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.986+0000 7f9865ffb700 10 client.4428 ms_handle_connect on v2:172.21.15.92:6833/2045555979 2023-07-25T14:35:48.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.986+0000 7f9886ffd700 1 --2- 172.21.15.72:0/2679500080 >> [v2:172.21.15.92:6833/2045555979,v1:172.21.15.92:6835/2045555979] conn(0x55623d7dd330 0x55623d7dd710 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f5929c9d8289ac0f server_cookie=910c181e9dd8f4a4 in_seq=0 out_seq=0 2023-07-25T14:35:48.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.986+0000 7f9865ffb700 1 -- 172.21.15.72:0/2679500080 <== mds.0 v2:172.21.15.92:6833/2045555979 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+323 (crc 0 0 0) 0x55623d72d730 con 0x55623d7dd330 2023-07-25T14:35:48.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.986+0000 7f9865ffb700 10 client.4428 handle_command_reply: tid=0 2023-07-25T14:35:48.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.986+0000 7f9899909b80 1 client.4428 shutdown 2023-07-25T14:35:48.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.987+0000 7f9899909b80 1 -- 172.21.15.72:0/2679500080 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55623d7e4c90 msgr2=0x55623d7dcdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:48.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.987+0000 7f9899909b80 1 --2- 172.21.15.72:0/2679500080 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55623d7e4c90 0x55623d7dcdf0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f988000b370 tx=0x7f9880004b40 comp rx=0 tx=0).stop 2023-07-25T14:35:48.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.987+0000 7f9899909b80 1 -- 172.21.15.72:0/2679500080 shutdown_connections 2023-07-25T14:35:48.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.987+0000 7f9899909b80 1 --2- 172.21.15.72:0/2679500080 >> [v2:172.21.15.92:6833/2045555979,v1:172.21.15.92:6835/2045555979] conn(0x55623d7dd330 0x55623d7dd710 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:48.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.987+0000 7f9899909b80 1 --2- 172.21.15.72:0/2679500080 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55623d7e4c90 0x55623d7dcdf0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:48.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.987+0000 7f9865ffb700 0 client.4428 ms_handle_reset on v2:172.21.15.92:6833/2045555979 2023-07-25T14:35:48.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.987+0000 7f9899909b80 1 --2- 172.21.15.72:0/2679500080 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55623d7dec40 0x55623d82bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:48.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.987+0000 7f9899909b80 1 --2- 172.21.15.72:0/2679500080 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x55623d7e3910 0x55623d838ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:48.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.987+0000 7f9899909b80 1 -- 172.21.15.72:0/2679500080 >> 172.21.15.72:0/2679500080 conn(0x55623d740c80 msgr2=0x55623d7dde70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:35:48.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.987+0000 7f9899909b80 1 -- 172.21.15.72:0/2679500080 shutdown_connections 2023-07-25T14:35:48.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.987+0000 7f9899909b80 1 -- 172.21.15.72:0/2679500080 wait complete. 2023-07-25T14:35:48.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.987+0000 7f9899909b80 20 client.4428 trim_cache size 0 max 16384 2023-07-25T14:35:48.011 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-07-25T14:35:48.011 INFO:teuthology.orchestra.run.smithi072.stdout: "cluster_fsid": "9170db48-9170-43e8-8ccb-9813e6240906", 2023-07-25T14:35:48.012 INFO:teuthology.orchestra.run.smithi072.stdout: "whoami": 0, 2023-07-25T14:35:48.012 INFO:teuthology.orchestra.run.smithi072.stdout: "id": 4285, 2023-07-25T14:35:48.012 INFO:teuthology.orchestra.run.smithi072.stdout: "want_state": "up:active", 2023-07-25T14:35:48.012 INFO:teuthology.orchestra.run.smithi072.stdout: "state": "up:active", 2023-07-25T14:35:48.012 INFO:teuthology.orchestra.run.smithi072.stdout: "fs_name": "cephfs", 2023-07-25T14:35:48.012 INFO:teuthology.orchestra.run.smithi072.stdout: "rank_uptime": 7.4368239269999998, 2023-07-25T14:35:48.012 INFO:teuthology.orchestra.run.smithi072.stdout: "mdsmap_epoch": 6, 2023-07-25T14:35:48.013 INFO:teuthology.orchestra.run.smithi072.stdout: "osdmap_epoch": 25, 2023-07-25T14:35:48.013 INFO:teuthology.orchestra.run.smithi072.stdout: "osdmap_epoch_barrier": 25, 2023-07-25T14:35:48.013 INFO:teuthology.orchestra.run.smithi072.stdout: "uptime": 13.49393285 2023-07-25T14:35:48.013 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-07-25T14:35:48.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.987+0000 7f988d771700 1 -- 172.21.15.72:0/2728632118 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f987406ace0 msgr2=0x7f987406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:48.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.987+0000 7f988d771700 1 --2- 172.21.15.72:0/2728632118 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f987406ace0 0x7f987406d1a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f9888151030 tx=0x7f9878007e70 comp rx=0 tx=0).stop 2023-07-25T14:35:48.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.987+0000 7f988d771700 1 -- 172.21.15.72:0/2728632118 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f98880ad6c0 msgr2=0x7f9888156120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:48.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.987+0000 7f988d771700 1 --2- 172.21.15.72:0/2728632118 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f98880ad6c0 0x7f9888156120 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f987c00ebe0 tx=0x7f987c00eef0 comp rx=0 tx=0).stop 2023-07-25T14:35:48.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.987+0000 7f988d771700 1 -- 172.21.15.72:0/2728632118 shutdown_connections 2023-07-25T14:35:48.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.987+0000 7f988d771700 1 --2- 172.21.15.72:0/2728632118 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f987406ace0 0x7f987406d1a0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:48.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.987+0000 7f988d771700 1 --2- 172.21.15.72:0/2728632118 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f98880c58a0 0x7f98881540c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:48.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.987+0000 7f988d771700 1 --2- 172.21.15.72:0/2728632118 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f98880ad6c0 0x7f9888156120 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:48.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.987+0000 7f988d771700 1 --2- 172.21.15.72:0/2728632118 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f98880c42e0 0x7f98881e95e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:48.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.987+0000 7f988d771700 1 -- 172.21.15.72:0/2728632118 >> 172.21.15.72:0/2728632118 conn(0x7f988806a950 msgr2=0x7f98880c5db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:35:48.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.987+0000 7f988d771700 1 -- 172.21.15.72:0/2728632118 shutdown_connections 2023-07-25T14:35:48.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:47.987+0000 7f988d771700 1 -- 172.21.15.72:0/2728632118 wait complete. 2023-07-25T14:35:48.016 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-07-25T14:35:48.017 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-07-25T14:35:48.017 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-25T14:35:48.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:48.125+0000 7fcdd1941700 1 Processor -- start 2023-07-25T14:35:48.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:48.125+0000 7fcdd1941700 1 -- start start 2023-07-25T14:35:48.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:48.125+0000 7fcdd1941700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fcdcc151a90 0x7fcdcc154d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:48.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:48.126+0000 7fcdd1941700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fcdcc0c44d0 0x7fcdcc0c4940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:48.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:48.126+0000 7fcdd1941700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcdcc0bfeb0 con 0x7fcdcc0bead0 2023-07-25T14:35:48.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:48.126+0000 7fcdd1941700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcdcc0c10b0 con 0x7fcdcc151a90 2023-07-25T14:35:48.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:48.126+0000 7fcdd1941700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdcc0c1940 con 0x7fcdcc0c44d0 2023-07-25T14:35:48.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:48.126+0000 7fcdcaffd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fcdcc151a90 0x7fcdcc154d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:48.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:48.126+0000 7fcdcaffd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fcdcc151a90 0x7fcdcc154d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:39576/0 (socket says 172.21.15.72:39576) 2023-07-25T14:35:48.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:48.126+0000 7fcdcaffd700 1 -- 172.21.15.72:0/3682003597 learned_addr learned my addr 172.21.15.72:0/3682003597 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:35:48.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:48.126+0000 7fcdcb7fe700 1 --2- 172.21.15.72:0/3682003597 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fcdcc0c44d0 0x7fcdcc0c4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:48.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:48.126+0000 7fcdcaffd700 1 -- 172.21.15.72:0/3682003597 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fcdcc0c44d0 msgr2=0x7fcdcc0c4940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:35:48.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:48.126+0000 7fcdcaffd700 1 --2- 172.21.15.72:0/3682003597 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fcdcc0c44d0 0x7fcdcc0c4940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:48.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:48.126+0000 7fcdcaffd700 1 -- 172.21.15.72:0/3682003597 >> v1:172.21.15.92:6789/0 conn(0x7fcdcc0bead0 legacy=0x7fcdcc0c0350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:35:48.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:48.126+0000 7fcdcaffd700 1 -- 172.21.15.72:0/3682003597 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdcc0bf2e0 con 0x7fcdcc151a90 2023-07-25T14:35:48.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:48.126+0000 7fcdcb7fe700 1 --2- 172.21.15.72:0/3682003597 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fcdcc0c44d0 0x7fcdcc0c4940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-25T14:35:48.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:48.126+0000 7fcdcaffd700 1 --2- 172.21.15.72:0/3682003597 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcdcc151a90 0x7fcdcc154d10 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fcdbc0098f0 tx=0x7fcdbc009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17d2608c8a382833 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:35:48.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:48.126+0000 7fcdc9ffb700 1 -- 172.21.15.72:0/3682003597 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdbc004230 con 0x7fcdcc151a90 2023-07-25T14:35:48.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:48.126+0000 7fcdc9ffb700 1 -- 172.21.15.72:0/3682003597 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdbc004390 con 0x7fcdcc151a90 2023-07-25T14:35:48.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:48.126+0000 7fcdc9ffb700 1 -- 172.21.15.72:0/3682003597 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdbc0036a0 con 0x7fcdcc151a90 2023-07-25T14:35:48.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:48.127+0000 7fcdd1941700 1 -- 172.21.15.72:0/3682003597 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcdcc151a90 msgr2=0x7fcdcc154d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:48.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:48.127+0000 7fcdd1941700 1 --2- 172.21.15.72:0/3682003597 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcdcc151a90 0x7fcdcc154d10 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fcdbc0098f0 tx=0x7fcdbc009c00 comp rx=0 tx=0).stop 2023-07-25T14:35:48.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:48.127+0000 7fcdd1941700 1 -- 172.21.15.72:0/3682003597 shutdown_connections 2023-07-25T14:35:48.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:48.127+0000 7fcdd1941700 1 --2- 172.21.15.72:0/3682003597 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fcdcc0c44d0 0x7fcdcc0c4940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:48.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:48.127+0000 7fcdd1941700 1 --2- 172.21.15.72:0/3682003597 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcdcc151a90 0x7fcdcc154d10 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:48.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:48.127+0000 7fcdd1941700 1 -- 172.21.15.72:0/3682003597 >> 172.21.15.72:0/3682003597 conn(0x7fcdcc06c3a0 msgr2=0x7fcdcc06c780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:35:48.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:48.127+0000 7fcdd1941700 1 -- 172.21.15.72:0/3682003597 shutdown_connections 2023-07-25T14:35:48.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:48.127+0000 7fcdd1941700 1 -- 172.21.15.72:0/3682003597 wait complete. 2023-07-25T14:35:48.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:48.128+0000 7fcdd1941700 1 Processor -- start 2023-07-25T14:35:48.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:48.128+0000 7fcdd1941700 1 -- start start 2023-07-25T14:35:48.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:48.129+0000 7fcdd1941700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fcdcc0bead0 0x7fcdcc156900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:48.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:48.129+0000 7fcdd1941700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcdcc0c44d0 0x7fcdcc1ecf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:48.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:48.129+0000 7fcdd1941700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcdcc151a90 0x7fcdcc1ed470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:48.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:48.129+0000 7fcdd1941700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdcc149a80 con 0x7fcdcc0c44d0 2023-07-25T14:35:48.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:48.129+0000 7fcdd1941700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdcc0c9740 con 0x7fcdcc151a90 2023-07-25T14:35:48.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:48.129+0000 7fcdd1941700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdcc158080 con 0x7fcdcc0bead0 2023-07-25T14:35:48.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:48.129+0000 7fcdca7fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcdcc0c44d0 0x7fcdcc1ecf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:48.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:48.129+0000 7fcdca7fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcdcc0c44d0 0x7fcdcc1ecf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:39582/0 (socket says 172.21.15.72:39582) 2023-07-25T14:35:48.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:48.129+0000 7fcdca7fc700 1 -- 172.21.15.72:0/1505008827 learned_addr learned my addr 172.21.15.72:0/1505008827 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:35:48.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:48.129+0000 7fcdca7fc700 1 -- 172.21.15.72:0/1505008827 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fcdcc0bead0 msgr2=0x7fcdcc156900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:48.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:48.129+0000 7fcdca7fc700 1 --2- 172.21.15.72:0/1505008827 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fcdcc0bead0 0x7fcdcc156900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:48.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:48.129+0000 7fcdca7fc700 1 -- 172.21.15.72:0/1505008827 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcdcc151a90 msgr2=0x7fcdcc1ed470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:48.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:48.129+0000 7fcdcb7fe700 1 --2- 172.21.15.72:0/1505008827 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcdcc151a90 0x7fcdcc1ed470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:48.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:48.129+0000 7fcdca7fc700 1 --2- 172.21.15.72:0/1505008827 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcdcc151a90 0x7fcdcc1ed470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:48.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:48.129+0000 7fcdca7fc700 1 -- 172.21.15.72:0/1505008827 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdbc009550 con 0x7fcdcc0c44d0 2023-07-25T14:35:48.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:48.129+0000 7fcdca7fc700 1 --2- 172.21.15.72:0/1505008827 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcdcc0c44d0 0x7fcdcc1ecf30 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fcdc000b4a0 tx=0x7fcdc000b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:35:48.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:48.129+0000 7fcdb3fff700 1 -- 172.21.15.72:0/1505008827 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdc0011830 con 0x7fcdcc0c44d0 2023-07-25T14:35:48.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:48.130+0000 7fcdb3fff700 1 -- 172.21.15.72:0/1505008827 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdc0011990 con 0x7fcdcc0c44d0 2023-07-25T14:35:48.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:48.130+0000 7fcdd1941700 1 -- 172.21.15.72:0/1505008827 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdcc0ca810 con 0x7fcdcc0c44d0 2023-07-25T14:35:48.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:48.130+0000 7fcdb3fff700 1 -- 172.21.15.72:0/1505008827 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdc0011d40 con 0x7fcdcc0c44d0 2023-07-25T14:35:48.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:48.130+0000 7fcdd1941700 1 -- 172.21.15.72:0/1505008827 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdcc0c9c30 con 0x7fcdcc0c44d0 2023-07-25T14:35:48.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:48.130+0000 7fcdd1941700 1 -- 172.21.15.72:0/1505008827 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdcc0c9e50 con 0x7fcdcc0c44d0 2023-07-25T14:35:48.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:48.131+0000 7fcdb3fff700 1 -- 172.21.15.72:0/1505008827 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fcdc001a400 con 0x7fcdcc0c44d0 2023-07-25T14:35:48.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:48.131+0000 7fcdb3fff700 1 --2- 172.21.15.72:0/1505008827 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fcdb806ace0 0x7fcdb806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:48.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:48.131+0000 7fcdb3fff700 1 -- 172.21.15.72:0/1505008827 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fcdc0089400 con 0x7fcdcc0c44d0 2023-07-25T14:35:48.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:48.131+0000 7fcdcaffd700 1 --2- 172.21.15.72:0/1505008827 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fcdb806ace0 0x7fcdb806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:48.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:48.132+0000 7fcdcaffd700 1 --2- 172.21.15.72:0/1505008827 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fcdb806ace0 0x7fcdb806d1a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fcdcc153ec0 tx=0x7fcdbc010000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:35:48.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:48.136+0000 7fcdb3fff700 1 -- 172.21.15.72:0/1505008827 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fcdc0054270 con 0x7fcdcc0c44d0 2023-07-25T14:35:48.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:48.369+0000 7fcdd1941700 1 -- 172.21.15.72:0/1505008827 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fcdcc04e470 con 0x7fcdcc0c44d0 2023-07-25T14:35:48.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:48.369+0000 7fcdb3fff700 1 -- 172.21.15.72:0/1505008827 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) v1 ==== 53+0+88 (secure 0 0 0) 0x7fcdc0057890 con 0x7fcdcc0c44d0 2023-07-25T14:35:48.381 INFO:teuthology.orchestra.run.smithi072.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-07-25T14:35:48.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:48.371+0000 7fcdd1941700 1 -- 172.21.15.72:0/1505008827 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fcdb806ace0 msgr2=0x7fcdb806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:48.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:48.371+0000 7fcdd1941700 1 --2- 172.21.15.72:0/1505008827 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fcdb806ace0 0x7fcdb806d1a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fcdcc153ec0 tx=0x7fcdbc010000 comp rx=0 tx=0).stop 2023-07-25T14:35:48.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:48.371+0000 7fcdd1941700 1 -- 172.21.15.72:0/1505008827 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcdcc0c44d0 msgr2=0x7fcdcc1ecf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:48.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:48.371+0000 7fcdd1941700 1 --2- 172.21.15.72:0/1505008827 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcdcc0c44d0 0x7fcdcc1ecf30 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fcdc000b4a0 tx=0x7fcdc000b860 comp rx=0 tx=0).stop 2023-07-25T14:35:48.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:48.371+0000 7fcdd1941700 1 -- 172.21.15.72:0/1505008827 shutdown_connections 2023-07-25T14:35:48.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:48.371+0000 7fcdd1941700 1 --2- 172.21.15.72:0/1505008827 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fcdb806ace0 0x7fcdb806d1a0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:48.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:48.371+0000 7fcdd1941700 1 --2- 172.21.15.72:0/1505008827 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fcdcc0bead0 0x7fcdcc156900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:48.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:48.371+0000 7fcdd1941700 1 --2- 172.21.15.72:0/1505008827 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcdcc151a90 0x7fcdcc1ed470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:48.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:48.371+0000 7fcdd1941700 1 --2- 172.21.15.72:0/1505008827 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcdcc0c44d0 0x7fcdcc1ecf30 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:48.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:48.371+0000 7fcdd1941700 1 -- 172.21.15.72:0/1505008827 >> 172.21.15.72:0/1505008827 conn(0x7fcdcc06c3a0 msgr2=0x7fcdcc152570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:35:48.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:48.371+0000 7fcdd1941700 1 -- 172.21.15.72:0/1505008827 shutdown_connections 2023-07-25T14:35:48.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:48.371+0000 7fcdd1941700 1 -- 172.21.15.72:0/1505008827 wait complete. 2023-07-25T14:35:48.394 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-07-25T14:35:48.395 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-25T14:35:48.395 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi072.front.sepia.ceph.com 2023-07-25T14:35:48.395 INFO:tasks.cephfs.mount:self.client.name = client.admin 2023-07-25T14:35:48.396 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-07-25T14:35:48.396 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-07-25T14:35:48.396 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-07-25T14:35:48.396 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-25T14:35:48.397 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2023-07-25T14:35:48.397 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-25T14:35:48.397 DEBUG:teuthology.orchestra.run.smithi072:> ip addr 2023-07-25T14:35:48.414 INFO:teuthology.orchestra.run.smithi072.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-25T14:35:48.414 INFO:teuthology.orchestra.run.smithi072.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-25T14:35:48.414 INFO:teuthology.orchestra.run.smithi072.stdout: inet 127.0.0.1/8 scope host lo 2023-07-25T14:35:48.415 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-07-25T14:35:48.415 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 ::1/128 scope host 2023-07-25T14:35:48.415 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-07-25T14:35:48.415 INFO:teuthology.orchestra.run.smithi072.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-25T14:35:48.415 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:d8:da:f4 brd ff:ff:ff:ff:ff:ff 2023-07-25T14:35:48.415 INFO:teuthology.orchestra.run.smithi072.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-25T14:35:48.415 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:d8:da:f5 brd ff:ff:ff:ff:ff:ff 2023-07-25T14:35:48.415 INFO:teuthology.orchestra.run.smithi072.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-25T14:35:48.416 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:8f:b7:64 brd ff:ff:ff:ff:ff:ff 2023-07-25T14:35:48.416 INFO:teuthology.orchestra.run.smithi072.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-25T14:35:48.416 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:8f:b7:65 brd ff:ff:ff:ff:ff:ff 2023-07-25T14:35:48.417 INFO:teuthology.orchestra.run.smithi072.stdout: inet 172.21.15.72/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-07-25T14:35:48.417 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft 42289sec preferred_lft 42289sec 2023-07-25T14:35:48.417 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 fe80::3ce1:9f7:ed06:b425/64 scope link noprefixroute 2023-07-25T14:35:48.417 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-07-25T14:35:48.417 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-07-25T14:35:48.418 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-25T14:35:48.418 DEBUG:teuthology.orchestra.run.smithi072:> (cd / && exec bash -c ' 2023-07-25T14:35:48.418 DEBUG:teuthology.orchestra.run.smithi072:> set -e 2023-07-25T14:35:48.419 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip link add name ceph-brx type bridge 2023-07-25T14:35:48.419 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip addr flush dev ceph-brx 2023-07-25T14:35:48.419 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip link set ceph-brx up 2023-07-25T14:35:48.419 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-07-25T14:35:48.420 DEBUG:teuthology.orchestra.run.smithi072:> ') 2023-07-25T14:35:48.585 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-25T14:35:48.586 DEBUG:teuthology.orchestra.run.smithi072:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-25T14:35:48.613 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-07-25T14:35:48.615 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-25T14:35:48.615 DEBUG:teuthology.orchestra.run.smithi072:> route 2023-07-25T14:35:48.692 INFO:teuthology.orchestra.run.smithi072.stdout:Kernel IP routing table 2023-07-25T14:35:48.693 INFO:teuthology.orchestra.run.smithi072.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-25T14:35:48.693 INFO:teuthology.orchestra.run.smithi072.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-07-25T14:35:48.693 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-07-25T14:35:48.693 INFO:teuthology.orchestra.run.smithi072.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-25T14:35:48.694 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-25T14:35:48.694 DEBUG:teuthology.orchestra.run.smithi072:> (cd / && exec bash -c ' 2023-07-25T14:35:48.694 DEBUG:teuthology.orchestra.run.smithi072:> set -e 2023-07-25T14:35:48.695 DEBUG:teuthology.orchestra.run.smithi072:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-07-25T14:35:48.696 DEBUG:teuthology.orchestra.run.smithi072:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-07-25T14:35:48.696 DEBUG:teuthology.orchestra.run.smithi072:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-07-25T14:35:48.697 DEBUG:teuthology.orchestra.run.smithi072:> ') 2023-07-25T14:35:48.966 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-25T14:35:48.967 DEBUG:teuthology.orchestra.run.smithi072:> ip netns list 2023-07-25T14:35:48.985 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-25T14:35:48.986 DEBUG:teuthology.orchestra.run.smithi072:> ip netns list-id 2023-07-25T14:35:49.041 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-25T14:35:49.042 DEBUG:teuthology.orchestra.run.smithi072:> (cd / && exec bash -c ' 2023-07-25T14:35:49.042 DEBUG:teuthology.orchestra.run.smithi072:> set -e 2023-07-25T14:35:49.042 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-07-25T14:35:49.043 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2023-07-25T14:35:49.043 DEBUG:teuthology.orchestra.run.smithi072:> ') 2023-07-25T14:35:49.135 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2023-07-25T14:35:49.136 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-25T14:35:49.136 DEBUG:teuthology.orchestra.run.smithi072:> (cd / && exec bash -c ' 2023-07-25T14:35:49.136 DEBUG:teuthology.orchestra.run.smithi072:> set -e 2023-07-25T14:35:49.137 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2023-07-25T14:35:49.137 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-07-25T14:35:49.137 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2023-07-25T14:35:49.137 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2023-07-25T14:35:49.138 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2023-07-25T14:35:49.138 DEBUG:teuthology.orchestra.run.smithi072:> ') 2023-07-25T14:35:49.343 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-25T14:35:49.343 DEBUG:teuthology.orchestra.run.smithi072:> (cd / && exec bash -c ' 2023-07-25T14:35:49.343 DEBUG:teuthology.orchestra.run.smithi072:> set -e 2023-07-25T14:35:49.344 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip link set brx.0 up 2023-07-25T14:35:49.345 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip link set dev brx.0 master ceph-brx 2023-07-25T14:35:49.345 DEBUG:teuthology.orchestra.run.smithi072:> ') 2023-07-25T14:35:49.465 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2023-07-25T14:35:49.466 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-25T14:35:49.467 DEBUG:teuthology.orchestra.run.smithi072:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2023-07-25T14:35:49.484 INFO:teuthology.orchestra.run.smithi072.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2023-07-25T14:35:49.484 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-25T14:35:49.485 DEBUG:teuthology.orchestra.run.smithi072:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2023-07-25T14:35:49.541 DEBUG:teuthology.orchestra.run.smithi072:> sudo modprobe fuse 2023-07-25T14:35:49.607 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-07-25T14:35:49.608 DEBUG:teuthology.orchestra.run.smithi072:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-07-25T14:35:49.674 INFO:teuthology.orchestra.run.smithi072.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-07-25T14:35:49.675 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-07-25T14:35:49.676 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-25T14:35:49.676 DEBUG:teuthology.orchestra.run.smithi072:> ls /sys/fs/fuse/connections 2023-07-25T14:35:49.732 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-07-25T14:35:49.733 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2023-07-25T14:35:49.774 DEBUG:teuthology.orchestra.run.smithi072:> sudo modprobe fuse 2023-07-25T14:35:49.800 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-07-25T14:35:49.800 DEBUG:teuthology.orchestra.run.smithi072:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-07-25T14:35:49.865 INFO:teuthology.orchestra.run.smithi072.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-07-25T14:35:49.866 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-07-25T14:35:49.866 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-25T14:35:49.867 DEBUG:teuthology.orchestra.run.smithi072:> ls /sys/fs/fuse/connections 2023-07-25T14:35:49.932 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi072.stderr:2023-07-25T14:35:49.920+0000 7feec93b25c0 -1 init, newargv = 0x55a8f0b4d780 newargc=15 2023-07-25T14:35:49.932 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi072.stderr:ceph-fuse[107003]: starting ceph client 2023-07-25T14:35:49.937 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi072.stderr:ceph-fuse[107003]: starting fuse 2023-07-25T14:35:51.023 DEBUG:teuthology.orchestra.run.smithi072:> sudo modprobe fuse 2023-07-25T14:35:51.057 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-07-25T14:35:51.057 DEBUG:teuthology.orchestra.run.smithi072:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-07-25T14:35:51.126 INFO:teuthology.orchestra.run.smithi072.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-07-25T14:35:51.127 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-07-25T14:35:51.127 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-25T14:35:51.128 DEBUG:teuthology.orchestra.run.smithi072:> ls /sys/fs/fuse/connections 2023-07-25T14:35:51.186 INFO:teuthology.orchestra.run.smithi072.stdout:47 2023-07-25T14:35:51.187 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [47] 2023-07-25T14:35:51.188 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-07-25T14:35:51.189 DEBUG:teuthology.orchestra.run.smithi072:> import glob 2023-07-25T14:35:51.189 DEBUG:teuthology.orchestra.run.smithi072:> import re 2023-07-25T14:35:51.189 DEBUG:teuthology.orchestra.run.smithi072:> import os 2023-07-25T14:35:51.190 DEBUG:teuthology.orchestra.run.smithi072:> import subprocess 2023-07-25T14:35:51.190 DEBUG:teuthology.orchestra.run.smithi072:> 2023-07-25T14:35:51.190 DEBUG:teuthology.orchestra.run.smithi072:> def _find_admin_socket(client_name): 2023-07-25T14:35:51.190 DEBUG:teuthology.orchestra.run.smithi072:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2023-07-25T14:35:51.191 DEBUG:teuthology.orchestra.run.smithi072:> files = glob.glob(asok_path) 2023-07-25T14:35:51.191 DEBUG:teuthology.orchestra.run.smithi072:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2023-07-25T14:35:51.191 DEBUG:teuthology.orchestra.run.smithi072:> 2023-07-25T14:35:51.192 DEBUG:teuthology.orchestra.run.smithi072:> # Given a non-glob path, it better be there 2023-07-25T14:35:51.192 DEBUG:teuthology.orchestra.run.smithi072:> if "*" not in asok_path: 2023-07-25T14:35:51.192 DEBUG:teuthology.orchestra.run.smithi072:> assert(len(files) == 1) 2023-07-25T14:35:51.192 DEBUG:teuthology.orchestra.run.smithi072:> return files[0] 2023-07-25T14:35:51.193 DEBUG:teuthology.orchestra.run.smithi072:> 2023-07-25T14:35:51.193 DEBUG:teuthology.orchestra.run.smithi072:> for f in files: 2023-07-25T14:35:51.193 DEBUG:teuthology.orchestra.run.smithi072:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-07-25T14:35:51.193 DEBUG:teuthology.orchestra.run.smithi072:> if os.path.exists("/proc/{0}".format(pid)): 2023-07-25T14:35:51.194 DEBUG:teuthology.orchestra.run.smithi072:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-07-25T14:35:51.194 DEBUG:teuthology.orchestra.run.smithi072:> contents = proc_f.read() 2023-07-25T14:35:51.194 DEBUG:teuthology.orchestra.run.smithi072:> if mountpoint in contents: 2023-07-25T14:35:51.194 DEBUG:teuthology.orchestra.run.smithi072:> return f 2023-07-25T14:35:51.195 DEBUG:teuthology.orchestra.run.smithi072:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-07-25T14:35:51.195 DEBUG:teuthology.orchestra.run.smithi072:> 2023-07-25T14:35:51.195 DEBUG:teuthology.orchestra.run.smithi072:> print(_find_admin_socket("client.admin")) 2023-07-25T14:35:51.196 DEBUG:teuthology.orchestra.run.smithi072:> ' 2023-07-25T14:35:51.315 INFO:teuthology.orchestra.run.smithi072.stdout:/var/run/ceph/ceph-client.admin.107003.asok 2023-07-25T14:35:51.496 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.107003.asok 2023-07-25T14:35:51.496 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-25T14:35:51.497 DEBUG:teuthology.orchestra.run.smithi072:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.107003.asok status 2023-07-25T14:35:51.652 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-07-25T14:35:51.653 INFO:teuthology.orchestra.run.smithi072.stdout: "metadata": { 2023-07-25T14:35:51.653 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph_sha1": "a5d48e8c688c2543997a98b8acbae2ce9635578c", 2023-07-25T14:35:51.653 INFO:teuthology.orchestra.run.smithi072.stdout: "ceph_version": "ceph version 18.0.0-5128-ga5d48e8c (a5d48e8c688c2543997a98b8acbae2ce9635578c) reef (dev)", 2023-07-25T14:35:51.653 INFO:teuthology.orchestra.run.smithi072.stdout: "entity_id": "admin", 2023-07-25T14:35:51.653 INFO:teuthology.orchestra.run.smithi072.stdout: "hostname": "smithi072", 2023-07-25T14:35:51.653 INFO:teuthology.orchestra.run.smithi072.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2023-07-25T14:35:51.653 INFO:teuthology.orchestra.run.smithi072.stdout: "pid": "107003", 2023-07-25T14:35:51.654 INFO:teuthology.orchestra.run.smithi072.stdout: "root": "/" 2023-07-25T14:35:51.654 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-07-25T14:35:51.654 INFO:teuthology.orchestra.run.smithi072.stdout: "dentry_count": 0, 2023-07-25T14:35:51.654 INFO:teuthology.orchestra.run.smithi072.stdout: "dentry_pinned_count": 0, 2023-07-25T14:35:51.654 INFO:teuthology.orchestra.run.smithi072.stdout: "id": 4440, 2023-07-25T14:35:51.654 INFO:teuthology.orchestra.run.smithi072.stdout: "inst": { 2023-07-25T14:35:51.654 INFO:teuthology.orchestra.run.smithi072.stdout: "name": { 2023-07-25T14:35:51.654 INFO:teuthology.orchestra.run.smithi072.stdout: "type": "client", 2023-07-25T14:35:51.655 INFO:teuthology.orchestra.run.smithi072.stdout: "num": 4440 2023-07-25T14:35:51.655 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-07-25T14:35:51.655 INFO:teuthology.orchestra.run.smithi072.stdout: "addr": { 2023-07-25T14:35:51.655 INFO:teuthology.orchestra.run.smithi072.stdout: "type": "v1", 2023-07-25T14:35:51.655 INFO:teuthology.orchestra.run.smithi072.stdout: "addr": "192.168.0.1:0", 2023-07-25T14:35:51.655 INFO:teuthology.orchestra.run.smithi072.stdout: "nonce": 3642193680 2023-07-25T14:35:51.655 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-07-25T14:35:51.656 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-07-25T14:35:51.656 INFO:teuthology.orchestra.run.smithi072.stdout: "addr": { 2023-07-25T14:35:51.656 INFO:teuthology.orchestra.run.smithi072.stdout: "type": "v1", 2023-07-25T14:35:51.656 INFO:teuthology.orchestra.run.smithi072.stdout: "addr": "192.168.0.1:0", 2023-07-25T14:35:51.656 INFO:teuthology.orchestra.run.smithi072.stdout: "nonce": 3642193680 2023-07-25T14:35:51.656 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-07-25T14:35:51.656 INFO:teuthology.orchestra.run.smithi072.stdout: "inst_str": "client.4440 192.168.0.1:0/3642193680", 2023-07-25T14:35:51.656 INFO:teuthology.orchestra.run.smithi072.stdout: "addr_str": "192.168.0.1:0/3642193680", 2023-07-25T14:35:51.657 INFO:teuthology.orchestra.run.smithi072.stdout: "inode_count": 1, 2023-07-25T14:35:51.657 INFO:teuthology.orchestra.run.smithi072.stdout: "mds_epoch": 6, 2023-07-25T14:35:51.657 INFO:teuthology.orchestra.run.smithi072.stdout: "osd_epoch": 25, 2023-07-25T14:35:51.657 INFO:teuthology.orchestra.run.smithi072.stdout: "osd_epoch_barrier": 0, 2023-07-25T14:35:51.657 INFO:teuthology.orchestra.run.smithi072.stdout: "blocklisted": false, 2023-07-25T14:35:51.657 INFO:teuthology.orchestra.run.smithi072.stdout: "fs_name": "cephfs" 2023-07-25T14:35:51.657 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-07-25T14:35:51.662 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-25T14:35:51.663 DEBUG:teuthology.orchestra.run.smithi072:> stat --file-system '--printf=%T 2023-07-25T14:35:51.663 DEBUG:teuthology.orchestra.run.smithi072:> ' -- /home/ubuntu/cephtest/mnt.admin 2023-07-25T14:35:51.680 INFO:teuthology.orchestra.run.smithi072.stdout:fuseblk 2023-07-25T14:35:51.681 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2023-07-25T14:35:51.681 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-25T14:35:51.681 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2023-07-25T14:35:51.747 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-25T14:35:51.748 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.admin && exec bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2023-07-25T14:35:52.005 INFO:teuthology.orchestra.run.smithi072.stdout:# file: . 2023-07-25T14:35:52.006 INFO:teuthology.orchestra.run.smithi072.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2023-07-25T14:35:52.006 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-25T14:35:52.007 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-07-25T14:35:52.007 DEBUG:teuthology.orchestra.run.smithi072:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-25T14:35:52.024 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-25T14:35:52.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.173+0000 7fc2e8851700 1 Processor -- start 2023-07-25T14:35:52.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.173+0000 7fc2e8851700 1 -- start start 2023-07-25T14:35:52.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.173+0000 7fc2e8851700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc2e4151950 0x7fc2e406a190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:52.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.173+0000 7fc2e8851700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fc2e40724c0 0x7fc2e40c34c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:52.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.174+0000 7fc2e8851700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2e40c2fe0 con 0x7fc2e406a6d0 2023-07-25T14:35:52.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.174+0000 7fc2e8851700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2e4071a60 con 0x7fc2e40724c0 2023-07-25T14:35:52.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.174+0000 7fc2e8851700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2e40c2a70 con 0x7fc2e4151950 2023-07-25T14:35:52.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.174+0000 7fc2e2d9d700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fc2e406a6d0 0x7fc2e40c3a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:58590/0 (socket says 172.21.15.72:58590) 2023-07-25T14:35:52.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.174+0000 7fc2e2d9d700 1 -- 172.21.15.72:0/2781022256 learned_addr learned my addr 172.21.15.72:0/2781022256 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:35:52.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.174+0000 7fc2e1d9b700 1 --2- 172.21.15.72:0/2781022256 >> v2:172.21.15.92:3300/0 conn(0x7fc2e40724c0 0x7fc2e40c34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:52.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.174+0000 7fc2e259c700 1 --2- 172.21.15.72:0/2781022256 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc2e4151950 0x7fc2e406a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:52.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.174+0000 7fc2e159a700 1 -- 172.21.15.72:0/2781022256 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 785545216 0 0) 0x7fc2e40c2fe0 con 0x7fc2e406a6d0 2023-07-25T14:35:52.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.174+0000 7fc2e159a700 1 -- 172.21.15.72:0/2781022256 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc2cc0035b0 con 0x7fc2e406a6d0 2023-07-25T14:35:52.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.174+0000 7fc2e159a700 1 -- 172.21.15.72:0/2781022256 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 337060313 0 0) 0x7fc2cc0035b0 con 0x7fc2e406a6d0 2023-07-25T14:35:52.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.174+0000 7fc2e259c700 1 -- 172.21.15.72:0/2781022256 >> v2:172.21.15.92:3300/0 conn(0x7fc2e40724c0 msgr2=0x7fc2e40c34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:35:52.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.174+0000 7fc2e259c700 1 --2- 172.21.15.72:0/2781022256 >> v2:172.21.15.92:3300/0 conn(0x7fc2e40724c0 0x7fc2e40c34c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:52.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.174+0000 7fc2e259c700 1 -- 172.21.15.72:0/2781022256 >> v1:172.21.15.72:6789/0 conn(0x7fc2e406a6d0 legacy=0x7fc2e40c3a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:52.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.174+0000 7fc2e259c700 1 -- 172.21.15.72:0/2781022256 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2e4155070 con 0x7fc2e4151950 2023-07-25T14:35:52.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.174+0000 7fc2e259c700 1 --2- 172.21.15.72:0/2781022256 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc2e4151950 0x7fc2e406a190 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fc2d8009840 tx=0x7fc2d8009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c8a8810f3ac359a6 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:35:52.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.175+0000 7fc2e159a700 1 -- 172.21.15.72:0/2781022256 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2dc0019f0 con 0x7fc2e4151950 2023-07-25T14:35:52.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.175+0000 7fc2e159a700 1 -- 172.21.15.72:0/2781022256 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2d8004030 con 0x7fc2e4151950 2023-07-25T14:35:52.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.175+0000 7fc2e159a700 1 -- 172.21.15.72:0/2781022256 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2d80043c0 con 0x7fc2e4151950 2023-07-25T14:35:52.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.175+0000 7fc2e8851700 1 -- 172.21.15.72:0/2781022256 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc2e4151950 msgr2=0x7fc2e406a190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:52.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.175+0000 7fc2e8851700 1 --2- 172.21.15.72:0/2781022256 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc2e4151950 0x7fc2e406a190 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fc2d8009840 tx=0x7fc2d8009b50 comp rx=0 tx=0).stop 2023-07-25T14:35:52.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.175+0000 7fc2e8851700 1 -- 172.21.15.72:0/2781022256 shutdown_connections 2023-07-25T14:35:52.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.175+0000 7fc2e8851700 1 --2- 172.21.15.72:0/2781022256 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc2e4151950 0x7fc2e406a190 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:52.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.175+0000 7fc2e8851700 1 --2- 172.21.15.72:0/2781022256 >> v2:172.21.15.92:3300/0 conn(0x7fc2e40724c0 0x7fc2e40c34c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:52.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.175+0000 7fc2e8851700 1 -- 172.21.15.72:0/2781022256 >> 172.21.15.72:0/2781022256 conn(0x7fc2e40a87e0 msgr2=0x7fc2e40a8bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:35:52.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.175+0000 7fc2e8851700 1 -- 172.21.15.72:0/2781022256 shutdown_connections 2023-07-25T14:35:52.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.175+0000 7fc2e8851700 1 -- 172.21.15.72:0/2781022256 wait complete. 2023-07-25T14:35:52.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.176+0000 7fc2e8851700 1 Processor -- start 2023-07-25T14:35:52.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.176+0000 7fc2e8851700 1 -- start start 2023-07-25T14:35:52.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.177+0000 7fc2e8851700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc2e406a6d0 0x7fc2e41ec920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:52.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.177+0000 7fc2e8851700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc2e40724c0 0x7fc2e41ecff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:52.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.177+0000 7fc2e8851700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc2e4151950 0x7fc2e41ed530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:52.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.177+0000 7fc2e8851700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2e41eafb0 con 0x7fc2e40724c0 2023-07-25T14:35:52.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.177+0000 7fc2e8851700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2e41edb10 con 0x7fc2e406a6d0 2023-07-25T14:35:52.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.177+0000 7fc2e8851700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2e4153cd0 con 0x7fc2e4151950 2023-07-25T14:35:52.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.177+0000 7fc2e1d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc2e40724c0 0x7fc2e41ecff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:52.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.177+0000 7fc2e1d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc2e40724c0 0x7fc2e41ecff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:39626/0 (socket says 172.21.15.72:39626) 2023-07-25T14:35:52.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.177+0000 7fc2e1d9b700 1 -- 172.21.15.72:0/3193739668 learned_addr learned my addr 172.21.15.72:0/3193739668 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:35:52.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.177+0000 7fc2e259c700 1 --2- 172.21.15.72:0/3193739668 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc2e406a6d0 0x7fc2e41ec920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:52.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.177+0000 7fc2e2d9d700 1 --2- 172.21.15.72:0/3193739668 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc2e4151950 0x7fc2e41ed530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:52.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.178+0000 7fc2e1d9b700 1 -- 172.21.15.72:0/3193739668 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc2e4151950 msgr2=0x7fc2e41ed530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:52.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.178+0000 7fc2e1d9b700 1 --2- 172.21.15.72:0/3193739668 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc2e4151950 0x7fc2e41ed530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:52.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.178+0000 7fc2e1d9b700 1 -- 172.21.15.72:0/3193739668 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc2e406a6d0 msgr2=0x7fc2e41ec920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:52.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.178+0000 7fc2e1d9b700 1 --2- 172.21.15.72:0/3193739668 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc2e406a6d0 0x7fc2e41ec920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:52.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.178+0000 7fc2e1d9b700 1 -- 172.21.15.72:0/3193739668 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2d80094a0 con 0x7fc2e40724c0 2023-07-25T14:35:52.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.178+0000 7fc2e2d9d700 1 --2- 172.21.15.72:0/3193739668 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc2e4151950 0x7fc2e41ed530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-25T14:35:52.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.178+0000 7fc2e1d9b700 1 --2- 172.21.15.72:0/3193739668 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc2e40724c0 0x7fc2e41ecff0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fc2d400e980 tx=0x7fc2d400ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:35:52.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.178+0000 7fc2d2ffd700 1 -- 172.21.15.72:0/3193739668 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2d4009710 con 0x7fc2e40724c0 2023-07-25T14:35:52.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.178+0000 7fc2d2ffd700 1 -- 172.21.15.72:0/3193739668 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2d400eed0 con 0x7fc2e40724c0 2023-07-25T14:35:52.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.178+0000 7fc2d2ffd700 1 -- 172.21.15.72:0/3193739668 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2d400ca90 con 0x7fc2e40724c0 2023-07-25T14:35:52.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.178+0000 7fc2e8851700 1 -- 172.21.15.72:0/3193739668 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2e4150aa0 con 0x7fc2e40724c0 2023-07-25T14:35:52.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.178+0000 7fc2e8851700 1 -- 172.21.15.72:0/3193739668 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2e4153fb0 con 0x7fc2e40724c0 2023-07-25T14:35:52.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.179+0000 7fc2e8851700 1 -- 172.21.15.72:0/3193739668 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2e404e470 con 0x7fc2e40724c0 2023-07-25T14:35:52.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.179+0000 7fc2d2ffd700 1 -- 172.21.15.72:0/3193739668 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc2d400cbf0 con 0x7fc2e40724c0 2023-07-25T14:35:52.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.180+0000 7fc2d2ffd700 1 --2- 172.21.15.72:0/3193739668 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fc2c406ace0 0x7fc2c406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:52.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.180+0000 7fc2d2ffd700 1 -- 172.21.15.72:0/3193739668 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fc2d40897b0 con 0x7fc2e40724c0 2023-07-25T14:35:52.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.180+0000 7fc2e259c700 1 --2- 172.21.15.72:0/3193739668 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fc2c406ace0 0x7fc2c406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:52.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.180+0000 7fc2e259c700 1 --2- 172.21.15.72:0/3193739668 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fc2c406ace0 0x7fc2c406d1a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fc2d80090b0 tx=0x7fc2d8008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:35:52.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.184+0000 7fc2d2ffd700 1 -- 172.21.15.72:0/3193739668 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fc2d4054600 con 0x7fc2e40724c0 2023-07-25T14:35:52.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.374+0000 7fc2e8851700 1 -- 172.21.15.72:0/3193739668 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc2e40c4940 con 0x7fc2e40724c0 2023-07-25T14:35:52.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.375+0000 7fc2d2ffd700 1 -- 172.21.15.72:0/3193739668 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+20014 (secure 0 0 0) 0x7fc2d4057c20 con 0x7fc2e40724c0 2023-07-25T14:35:52.387 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-25T14:35:52.387 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":25,"fsid":"9170db48-9170-43e8-8ccb-9813e6240906","created":"2023-07-25T14:35:21.733262+0000","modified":"2023-07-25T14:35:44.992669+0000","last_up_change":"2023-07-25T14:35:31.355010+0000","last_in_change":"2023-07-25T14:35:24.195785+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-25T14:35:32.983457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-25T14:35:33.326342+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-25T14:35:37.534158+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-25T14:35:38.891571+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-25T14:35:42.596923+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d517fdad-0bfe-49f0-89f2-9421c3761839","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6801","nonce":2475407414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6803","nonce":2475407414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6807","nonce":2475407414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6805","nonce":2475407414}]},"public_addr":"172.21.15.72:6801/2475407414","cluster_addr":"172.21.15.72:6803/2475407414","heartbeat_back_addr":"172.21.15.72:6807/2475407414","heartbeat_front_addr":"172.21.15.72:6805/2475407414","state":["exists","up"]},{"osd":1,"uuid":"e1564be3-f209-47e5-a8d0-32fc618a474f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6822","nonce":870954016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6825","nonce":870954016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6831","nonce":870954016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6827","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6829","nonce":870954016}]},"public_addr":"172.21.15.72:6822/870954016","cluster_addr":"172.21.15.72:6825/870954016","heartbeat_back_addr":"172.21.15.72:6831/870954016","heartbeat_front_addr":"172.21.15.72:6829/870954016","state":["exists","up"]},{"osd":2,"uuid":"c4647d30-ffa6-417a-9026-ef530c75910e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6809","nonce":2143129442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6811","nonce":2143129442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6815","nonce":2143129442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6813","nonce":2143129442}]},"public_addr":"172.21.15.72:6809/2143129442","cluster_addr":"172.21.15.72:6811/2143129442","heartbeat_back_addr":"172.21.15.72:6815/2143129442","heartbeat_front_addr":"172.21.15.72:6813/2143129442","state":["exists","up"]},{"osd":3,"uuid":"76c9d9a7-c2e2-4612-a58b-d6882dd76b58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6817","nonce":3404066311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6819","nonce":3404066311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6828","nonce":3404066311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6821","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6823","nonce":3404066311}]},"public_addr":"172.21.15.72:6817/3404066311","cluster_addr":"172.21.15.72:6819/3404066311","heartbeat_back_addr":"172.21.15.72:6828/3404066311","heartbeat_front_addr":"172.21.15.72:6823/3404066311","state":["exists","up"]},{"osd":4,"uuid":"7f8920dc-0ad4-4a73-ab40-65408f83eadd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6817","nonce":2381008739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6819","nonce":2381008739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6825","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6827","nonce":2381008739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6822","nonce":2381008739}]},"public_addr":"172.21.15.92:6817/2381008739","cluster_addr":"172.21.15.92:6819/2381008739","heartbeat_back_addr":"172.21.15.92:6827/2381008739","heartbeat_front_addr":"172.21.15.92:6822/2381008739","state":["exists","up"]},{"osd":5,"uuid":"56257e7c-31eb-44c5-9ec7-1318a4e0bb35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6801","nonce":2161935604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6803","nonce":2161935604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6807","nonce":2161935604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6805","nonce":2161935604}]},"public_addr":"172.21.15.92:6801/2161935604","cluster_addr":"172.21.15.92:6803/2161935604","heartbeat_back_addr":"172.21.15.92:6807/2161935604","heartbeat_front_addr":"172.21.15.92:6805/2161935604","state":["exists","up"]},{"osd":6,"uuid":"a150d3d8-a0c9-4955-968a-8d98eff4ffb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6809","nonce":3770163493}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6811","nonce":3770163493}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6815","nonce":3770163493}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6813","nonce":3770163493}]},"public_addr":"172.21.15.92:6809/3770163493","cluster_addr":"172.21.15.92:6811/3770163493","heartbeat_back_addr":"172.21.15.92:6815/3770163493","heartbeat_front_addr":"172.21.15.92:6813/3770163493","state":["exists","up"]},{"osd":7,"uuid":"07799c27-54ee-4591-a42d-a978d6b32065","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6821","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6823","nonce":2135777609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6826","nonce":2135777609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6831","nonce":2135777609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6829","nonce":2135777609}]},"public_addr":"172.21.15.92:6823/2135777609","cluster_addr":"172.21.15.92:6826/2135777609","heartbeat_back_addr":"172.21.15.92:6831/2135777609","heartbeat_front_addr":"172.21.15.92:6829/2135777609","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.345365+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.378150+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.146566+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.372172+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:30.398421+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.385632+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.465611+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.443583+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-25T14:35:52.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.377+0000 7fc2e8851700 1 -- 172.21.15.72:0/3193739668 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fc2c406ace0 msgr2=0x7fc2c406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:52.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.377+0000 7fc2e8851700 1 --2- 172.21.15.72:0/3193739668 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fc2c406ace0 0x7fc2c406d1a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fc2d80090b0 tx=0x7fc2d8008030 comp rx=0 tx=0).stop 2023-07-25T14:35:52.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.377+0000 7fc2e8851700 1 -- 172.21.15.72:0/3193739668 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc2e40724c0 msgr2=0x7fc2e41ecff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:52.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.377+0000 7fc2e8851700 1 --2- 172.21.15.72:0/3193739668 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc2e40724c0 0x7fc2e41ecff0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fc2d400e980 tx=0x7fc2d400ec90 comp rx=0 tx=0).stop 2023-07-25T14:35:52.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.377+0000 7fc2e8851700 1 -- 172.21.15.72:0/3193739668 shutdown_connections 2023-07-25T14:35:52.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.377+0000 7fc2e8851700 1 --2- 172.21.15.72:0/3193739668 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fc2c406ace0 0x7fc2c406d1a0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:52.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.377+0000 7fc2e8851700 1 --2- 172.21.15.72:0/3193739668 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc2e4151950 0x7fc2e41ed530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:52.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.377+0000 7fc2e8851700 1 --2- 172.21.15.72:0/3193739668 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc2e406a6d0 0x7fc2e41ec920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:52.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.377+0000 7fc2e8851700 1 --2- 172.21.15.72:0/3193739668 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc2e40724c0 0x7fc2e41ecff0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:52.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.377+0000 7fc2e8851700 1 -- 172.21.15.72:0/3193739668 >> 172.21.15.72:0/3193739668 conn(0x7fc2e40a87e0 msgr2=0x7fc2e40c36a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:35:52.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.377+0000 7fc2e8851700 1 -- 172.21.15.72:0/3193739668 shutdown_connections 2023-07-25T14:35:52.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.377+0000 7fc2e8851700 1 -- 172.21.15.72:0/3193739668 wait complete. 2023-07-25T14:35:52.401 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-07-25T14:35:32.983457+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-07-25T14:35:33.326342+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-25T14:35:37.534158+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-25T14:35:38.891571+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-07-25T14:35:42.596923+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-25T14:35:52.402 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-25T14:35:52.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.514+0000 7effba795700 1 Processor -- start 2023-07-25T14:35:52.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.514+0000 7effba795700 1 -- start start 2023-07-25T14:35:52.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.514+0000 7effba795700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7effb414dea0 0x7effb406a190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:52.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.514+0000 7effba795700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effb40a8230 con 0x7effb4072300 2023-07-25T14:35:52.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.514+0000 7effba795700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effb40a7c20 con 0x7effb40a86c0 2023-07-25T14:35:52.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.514+0000 7effba795700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effb40c18d0 con 0x7effb414dea0 2023-07-25T14:35:52.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.515+0000 7effb37fe700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7effb4072300 0x7effb4151200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:58600/0 (socket says 172.21.15.72:58600) 2023-07-25T14:35:52.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.515+0000 7effb37fe700 1 -- 172.21.15.72:0/3869389226 learned_addr learned my addr 172.21.15.72:0/3869389226 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:35:52.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.515+0000 7effb3fff700 1 --2- 172.21.15.72:0/3869389226 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7effb414dea0 0x7effb406a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:52.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.515+0000 7effb2ffd700 1 -- 172.21.15.72:0/3869389226 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2684664534 0 0) 0x7effb40a8230 con 0x7effb4072300 2023-07-25T14:35:52.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.515+0000 7effb2ffd700 1 -- 172.21.15.72:0/3869389226 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7eff9c0035b0 con 0x7effb4072300 2023-07-25T14:35:52.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.515+0000 7effb2ffd700 1 -- 172.21.15.72:0/3869389226 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2355754867 0 0) 0x7eff9c0035b0 con 0x7effb4072300 2023-07-25T14:35:52.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.515+0000 7effb2ffd700 1 -- 172.21.15.72:0/3869389226 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7effb414dea0 msgr2=0x7effb406a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:35:52.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.515+0000 7effb2ffd700 1 --2- 172.21.15.72:0/3869389226 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7effb414dea0 0x7effb406a190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:52.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.515+0000 7effb2ffd700 1 -- 172.21.15.72:0/3869389226 >> v1:172.21.15.92:6789/0 conn(0x7effb40a86c0 legacy=0x7effb40c0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:52.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.515+0000 7effb2ffd700 1 -- 172.21.15.72:0/3869389226 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effb406ec20 con 0x7effb4072300 2023-07-25T14:35:52.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.515+0000 7effb2ffd700 1 -- 172.21.15.72:0/3869389226 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2559588315 0 0) 0x7effa4001670 con 0x7effb4072300 2023-07-25T14:35:52.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.515+0000 7effb2ffd700 1 -- 172.21.15.72:0/3869389226 >> v1:172.21.15.72:6789/0 conn(0x7effb4072300 legacy=0x7effb4151200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:52.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.515+0000 7effb2ffd700 1 --2- 172.21.15.72:0/3869389226 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7eff9c003a30 0x7eff9c003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:52.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.515+0000 7effb2ffd700 1 --2- 172.21.15.72:0/3869389226 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7eff9c004850 0x7eff9c004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:52.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.515+0000 7effb2ffd700 1 --2- 172.21.15.72:0/3869389226 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7eff9c005210 0x7eff9c00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:52.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.515+0000 7effb2ffd700 1 -- 172.21.15.72:0/3869389226 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effb40c18d0 con 0x7eff9c005210 2023-07-25T14:35:52.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.515+0000 7effb2ffd700 1 -- 172.21.15.72:0/3869389226 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff9c00c0e0 con 0x7eff9c004850 2023-07-25T14:35:52.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.515+0000 7effb2ffd700 1 -- 172.21.15.72:0/3869389226 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff9c00c2a0 con 0x7eff9c003a30 2023-07-25T14:35:52.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.515+0000 7effb3fff700 1 --2- 172.21.15.72:0/3869389226 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7effb414dea0 0x7effb406a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-25T14:35:52.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.515+0000 7effb8d32700 1 --2- 172.21.15.72:0/3869389226 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7eff9c005210 0x7eff9c00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:52.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.515+0000 7effb37fe700 1 --2- 172.21.15.72:0/3869389226 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7eff9c004850 0x7eff9c004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:52.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.515+0000 7effb3fff700 1 --2- 172.21.15.72:0/3869389226 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7eff9c003a30 0x7eff9c003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:52.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.515+0000 7effb8d32700 1 -- 172.21.15.72:0/3869389226 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7eff9c003a30 msgr2=0x7eff9c003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:35:52.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.515+0000 7effb8d32700 1 --2- 172.21.15.72:0/3869389226 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7eff9c003a30 0x7eff9c003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:52.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.515+0000 7effb8d32700 1 -- 172.21.15.72:0/3869389226 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7eff9c004850 msgr2=0x7eff9c004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:35:52.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.515+0000 7effb8d32700 1 --2- 172.21.15.72:0/3869389226 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7eff9c004850 0x7eff9c004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:52.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.516+0000 7effb8d32700 1 -- 172.21.15.72:0/3869389226 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff9c0035b0 con 0x7eff9c005210 2023-07-25T14:35:52.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.516+0000 7effb3fff700 1 --2- 172.21.15.72:0/3869389226 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7eff9c003a30 0x7eff9c003e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-25T14:35:52.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.516+0000 7effb8d32700 1 --2- 172.21.15.72:0/3869389226 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7eff9c005210 0x7eff9c00ba10 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7effac00c290 tx=0x7eff9c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=584e8d95b92a108a server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:35:52.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.516+0000 7effb2ffd700 1 -- 172.21.15.72:0/3869389226 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effac001e70 con 0x7eff9c005210 2023-07-25T14:35:52.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.516+0000 7effb2ffd700 1 -- 172.21.15.72:0/3869389226 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effac00ce50 con 0x7eff9c005210 2023-07-25T14:35:52.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.516+0000 7effb2ffd700 1 -- 172.21.15.72:0/3869389226 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effac012660 con 0x7eff9c005210 2023-07-25T14:35:52.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.516+0000 7effba795700 1 -- 172.21.15.72:0/3869389226 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7eff9c005210 msgr2=0x7eff9c00ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:52.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.516+0000 7effba795700 1 --2- 172.21.15.72:0/3869389226 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7eff9c005210 0x7eff9c00ba10 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7effac00c290 tx=0x7eff9c005880 comp rx=0 tx=0).stop 2023-07-25T14:35:52.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.516+0000 7effb8d32700 1 -- 172.21.15.72:0/3869389226 reap_dead start 2023-07-25T14:35:52.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.516+0000 7effba795700 1 -- 172.21.15.72:0/3869389226 shutdown_connections 2023-07-25T14:35:52.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.516+0000 7effba795700 1 -- 172.21.15.72:0/3869389226 >> 172.21.15.72:0/3869389226 conn(0x7effb406def0 msgr2=0x7effb406e300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:35:52.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.516+0000 7effba795700 1 -- 172.21.15.72:0/3869389226 shutdown_connections 2023-07-25T14:35:52.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.516+0000 7effba795700 1 -- 172.21.15.72:0/3869389226 wait complete. 2023-07-25T14:35:52.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.517+0000 7effba795700 1 Processor -- start 2023-07-25T14:35:52.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.518+0000 7effba795700 1 -- start start 2023-07-25T14:35:52.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.518+0000 7effba795700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7effb4150f90 0x7effb414a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:52.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.518+0000 7effba795700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7effb414a7f0 0x7effb40c49a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:52.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.518+0000 7effba795700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7effb40bffc0 0x7effb40c4ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:52.538 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.518+0000 7effba795700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effb40c4510 con 0x7effb4150f90 2023-07-25T14:35:52.538 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.518+0000 7effba795700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effb40c41c0 con 0x7effb414a7f0 2023-07-25T14:35:52.538 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.518+0000 7effba795700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effb41e9c30 con 0x7effb40bffc0 2023-07-25T14:35:52.538 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.518+0000 7effb3fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7effb4150f90 0x7effb414a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:52.538 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.518+0000 7effb3fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7effb4150f90 0x7effb414a2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:39642/0 (socket says 172.21.15.72:39642) 2023-07-25T14:35:52.538 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.518+0000 7effb3fff700 1 -- 172.21.15.72:0/1642562282 learned_addr learned my addr 172.21.15.72:0/1642562282 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:35:52.538 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.518+0000 7effb8d32700 1 --2- 172.21.15.72:0/1642562282 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7effb40bffc0 0x7effb40c4ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:52.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.519+0000 7effb37fe700 1 --2- 172.21.15.72:0/1642562282 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7effb414a7f0 0x7effb40c49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:52.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.519+0000 7effb3fff700 1 -- 172.21.15.72:0/1642562282 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7effb40bffc0 msgr2=0x7effb40c4ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:52.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.519+0000 7effb3fff700 1 --2- 172.21.15.72:0/1642562282 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7effb40bffc0 0x7effb40c4ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:52.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.519+0000 7effb3fff700 1 -- 172.21.15.72:0/1642562282 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7effb414a7f0 msgr2=0x7effb40c49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:52.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.519+0000 7effb3fff700 1 --2- 172.21.15.72:0/1642562282 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7effb414a7f0 0x7effb40c49a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:52.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.519+0000 7effb3fff700 1 -- 172.21.15.72:0/1642562282 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effb41e9f10 con 0x7effb4150f90 2023-07-25T14:35:52.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.519+0000 7effb3fff700 1 --2- 172.21.15.72:0/1642562282 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7effb4150f90 0x7effb414a2b0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7effa80118b0 tx=0x7effa8011bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:35:52.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.519+0000 7effb0ff9700 1 -- 172.21.15.72:0/1642562282 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effa8015870 con 0x7effb4150f90 2023-07-25T14:35:52.540 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.519+0000 7effb0ff9700 1 -- 172.21.15.72:0/1642562282 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effa80159d0 con 0x7effb4150f90 2023-07-25T14:35:52.540 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.519+0000 7effba795700 1 -- 172.21.15.72:0/1642562282 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effb4151370 con 0x7effb4150f90 2023-07-25T14:35:52.540 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.519+0000 7effb0ff9700 1 -- 172.21.15.72:0/1642562282 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effa8015d40 con 0x7effb4150f90 2023-07-25T14:35:52.540 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.519+0000 7effba795700 1 -- 172.21.15.72:0/1642562282 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effb40a93c0 con 0x7effb4150f90 2023-07-25T14:35:52.540 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.520+0000 7effba795700 1 -- 172.21.15.72:0/1642562282 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effb40c4020 con 0x7effb4150f90 2023-07-25T14:35:52.540 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.521+0000 7effb0ff9700 1 -- 172.21.15.72:0/1642562282 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7effa801d400 con 0x7effb4150f90 2023-07-25T14:35:52.540 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.521+0000 7effb0ff9700 1 --2- 172.21.15.72:0/1642562282 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7effa006ace0 0x7effa006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:52.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.521+0000 7effb0ff9700 1 -- 172.21.15.72:0/1642562282 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7effa808a160 con 0x7effb4150f90 2023-07-25T14:35:52.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.521+0000 7effb37fe700 1 --2- 172.21.15.72:0/1642562282 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7effa006ace0 0x7effa006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:52.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.522+0000 7effb37fe700 1 --2- 172.21.15.72:0/1642562282 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7effa006ace0 0x7effa006d1a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7effb414ad20 tx=0x7effa4001c40 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:35:52.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.525+0000 7effb0ff9700 1 -- 172.21.15.72:0/1642562282 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7effa8054fb0 con 0x7effb4150f90 2023-07-25T14:35:52.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.718+0000 7effba795700 1 -- 172.21.15.72:0/1642562282 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7effb40c4020 con 0x7effb4150f90 2023-07-25T14:35:52.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.718+0000 7effb0ff9700 1 -- 172.21.15.72:0/1642562282 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7effb40c4020 con 0x7effb4150f90 2023-07-25T14:35:52.730 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 8 2023-07-25T14:35:52.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.720+0000 7effba795700 1 -- 172.21.15.72:0/1642562282 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7effa006ace0 msgr2=0x7effa006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:52.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.720+0000 7effba795700 1 --2- 172.21.15.72:0/1642562282 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7effa006ace0 0x7effa006d1a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7effb414ad20 tx=0x7effa4001c40 comp rx=0 tx=0).stop 2023-07-25T14:35:52.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.720+0000 7effba795700 1 -- 172.21.15.72:0/1642562282 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7effb4150f90 msgr2=0x7effb414a2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:52.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.720+0000 7effba795700 1 --2- 172.21.15.72:0/1642562282 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7effb4150f90 0x7effb414a2b0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7effa80118b0 tx=0x7effa8011bc0 comp rx=0 tx=0).stop 2023-07-25T14:35:52.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.721+0000 7effba795700 1 -- 172.21.15.72:0/1642562282 shutdown_connections 2023-07-25T14:35:52.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.721+0000 7effba795700 1 --2- 172.21.15.72:0/1642562282 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7effa006ace0 0x7effa006d1a0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:52.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.721+0000 7effba795700 1 --2- 172.21.15.72:0/1642562282 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7effb40bffc0 0x7effb40c4ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:52.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.721+0000 7effba795700 1 --2- 172.21.15.72:0/1642562282 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7effb4150f90 0x7effb414a2b0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:52.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.721+0000 7effba795700 1 --2- 172.21.15.72:0/1642562282 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7effb414a7f0 0x7effb40c49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:52.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.721+0000 7effba795700 1 -- 172.21.15.72:0/1642562282 >> 172.21.15.72:0/1642562282 conn(0x7effb406def0 msgr2=0x7effb414b0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:35:52.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.721+0000 7effba795700 1 -- 172.21.15.72:0/1642562282 shutdown_connections 2023-07-25T14:35:52.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.721+0000 7effba795700 1 -- 172.21.15.72:0/1642562282 wait complete. 2023-07-25T14:35:52.744 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-25T14:35:52.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.856+0000 7f524b9c6700 1 Processor -- start 2023-07-25T14:35:52.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.856+0000 7f524b9c6700 1 -- start start 2023-07-25T14:35:52.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.857+0000 7f524b9c6700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f5244151ba0 0x7f52440c2230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:52.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.857+0000 7f524b9c6700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f5244154d50 0x7f524415b970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:52.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.857+0000 7f524b9c6700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52440c54f0 con 0x7f52440c5f40 2023-07-25T14:35:52.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.857+0000 7f524b9c6700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52440c6670 con 0x7f5244154d50 2023-07-25T14:35:52.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.857+0000 7f524b9c6700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52440c5740 con 0x7f5244151ba0 2023-07-25T14:35:52.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.857+0000 7f5249f63700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f5244154d50 0x7f524415b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:52.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.857+0000 7f5249f63700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f5244154d50 0x7f524415b970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:39658/0 (socket says 172.21.15.72:39658) 2023-07-25T14:35:52.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.857+0000 7f5249f63700 1 -- 172.21.15.72:0/1456138062 learned_addr learned my addr 172.21.15.72:0/1456138062 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:35:52.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.857+0000 7f5249762700 1 --2- 172.21.15.72:0/1456138062 >> v2:172.21.15.92:3300/0 conn(0x7f5244151ba0 0x7f52440c2230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:52.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.857+0000 7f5249f63700 1 -- 172.21.15.72:0/1456138062 >> v2:172.21.15.92:3300/0 conn(0x7f5244151ba0 msgr2=0x7f52440c2230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:35:52.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.857+0000 7f5249f63700 1 --2- 172.21.15.72:0/1456138062 >> v2:172.21.15.92:3300/0 conn(0x7f5244151ba0 0x7f52440c2230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:52.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.857+0000 7f5249f63700 1 -- 172.21.15.72:0/1456138062 >> v1:172.21.15.92:6789/0 conn(0x7f52440c5f40 legacy=0x7f5244154640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:35:52.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.857+0000 7f5249f63700 1 -- 172.21.15.72:0/1456138062 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52440c5a20 con 0x7f5244154d50 2023-07-25T14:35:52.872 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.857+0000 7f5249f63700 1 --2- 172.21.15.72:0/1456138062 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5244154d50 0x7f524415b970 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f52440c52a0 tx=0x7f523c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9c2eb3ad0bab053 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:35:52.872 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.857+0000 7f523bfff700 1 -- 172.21.15.72:0/1456138062 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f523c00e070 con 0x7f5244154d50 2023-07-25T14:35:52.872 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.857+0000 7f523bfff700 1 -- 172.21.15.72:0/1456138062 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f523c003a20 con 0x7f5244154d50 2023-07-25T14:35:52.872 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.857+0000 7f523bfff700 1 -- 172.21.15.72:0/1456138062 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f523c003dd0 con 0x7f5244154d50 2023-07-25T14:35:52.872 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.858+0000 7f524b9c6700 1 -- 172.21.15.72:0/1456138062 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5244154d50 msgr2=0x7f524415b970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:52.872 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.858+0000 7f524b9c6700 1 --2- 172.21.15.72:0/1456138062 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5244154d50 0x7f524415b970 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f52440c52a0 tx=0x7f523c00b330 comp rx=0 tx=0).stop 2023-07-25T14:35:52.872 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.858+0000 7f524b9c6700 1 -- 172.21.15.72:0/1456138062 shutdown_connections 2023-07-25T14:35:52.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.858+0000 7f524b9c6700 1 --2- 172.21.15.72:0/1456138062 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5244154d50 0x7f524415b970 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:52.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.858+0000 7f524b9c6700 1 --2- 172.21.15.72:0/1456138062 >> v2:172.21.15.92:3300/0 conn(0x7f5244151ba0 0x7f52440c2230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:52.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.858+0000 7f524b9c6700 1 -- 172.21.15.72:0/1456138062 >> 172.21.15.72:0/1456138062 conn(0x7f52440a87e0 msgr2=0x7f52440a8bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:35:52.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.858+0000 7f524b9c6700 1 -- 172.21.15.72:0/1456138062 shutdown_connections 2023-07-25T14:35:52.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.858+0000 7f524b9c6700 1 -- 172.21.15.72:0/1456138062 wait complete. 2023-07-25T14:35:52.876 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.859+0000 7f524b9c6700 1 Processor -- start 2023-07-25T14:35:52.876 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.859+0000 7f524b9c6700 1 -- start start 2023-07-25T14:35:52.876 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.860+0000 7f524b9c6700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f52440c5f40 0x7f52440be280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:52.876 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.860+0000 7f524b9c6700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5244151ba0 0x7f52440ab0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:52.876 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.860+0000 7f524b9c6700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f524406a190 0x7f52440bbce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:52.876 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.860+0000 7f524b9c6700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52440aac10 con 0x7f5244151ba0 2023-07-25T14:35:52.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.860+0000 7f524b9c6700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52440aa8e0 con 0x7f52440c5f40 2023-07-25T14:35:52.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.860+0000 7f524b9c6700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f524406a690 con 0x7f524406a190 2023-07-25T14:35:52.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.860+0000 7f5248f61700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5244151ba0 0x7f52440ab0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:52.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.860+0000 7f5248f61700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5244151ba0 0x7f52440ab0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:39662/0 (socket says 172.21.15.72:39662) 2023-07-25T14:35:52.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.860+0000 7f5248f61700 1 -- 172.21.15.72:0/4122066436 learned_addr learned my addr 172.21.15.72:0/4122066436 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:35:52.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.860+0000 7f5249762700 1 --2- 172.21.15.72:0/4122066436 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f52440c5f40 0x7f52440be280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:52.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.860+0000 7f5249f63700 1 --2- 172.21.15.72:0/4122066436 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f524406a190 0x7f52440bbce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:52.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.860+0000 7f5248f61700 1 -- 172.21.15.72:0/4122066436 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f524406a190 msgr2=0x7f52440bbce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:52.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.860+0000 7f5248f61700 1 --2- 172.21.15.72:0/4122066436 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f524406a190 0x7f52440bbce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:52.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.860+0000 7f5248f61700 1 -- 172.21.15.72:0/4122066436 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f52440c5f40 msgr2=0x7f52440be280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:52.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.860+0000 7f5248f61700 1 --2- 172.21.15.72:0/4122066436 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f52440c5f40 0x7f52440be280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:52.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.860+0000 7f5248f61700 1 -- 172.21.15.72:0/4122066436 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f523c009b30 con 0x7f5244151ba0 2023-07-25T14:35:52.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.860+0000 7f5249762700 1 --2- 172.21.15.72:0/4122066436 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f52440c5f40 0x7f52440be280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-25T14:35:52.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.860+0000 7f5249f63700 1 --2- 172.21.15.72:0/4122066436 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f524406a190 0x7f52440bbce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-25T14:35:52.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.860+0000 7f5248f61700 1 --2- 172.21.15.72:0/4122066436 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5244151ba0 0x7f52440ab0a0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f524000c4a0 tx=0x7f524000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:35:52.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.860+0000 7f5239ffb700 1 -- 172.21.15.72:0/4122066436 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5240011790 con 0x7f5244151ba0 2023-07-25T14:35:52.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.860+0000 7f5239ffb700 1 -- 172.21.15.72:0/4122066436 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52400118f0 con 0x7f5244151ba0 2023-07-25T14:35:52.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.860+0000 7f5239ffb700 1 -- 172.21.15.72:0/4122066436 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5240011ca0 con 0x7f5244151ba0 2023-07-25T14:35:52.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.860+0000 7f524b9c6700 1 -- 172.21.15.72:0/4122066436 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f524406a970 con 0x7f5244151ba0 2023-07-25T14:35:52.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.861+0000 7f524b9c6700 1 -- 172.21.15.72:0/4122066436 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52440a5da0 con 0x7f5244151ba0 2023-07-25T14:35:52.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.861+0000 7f524b9c6700 1 -- 172.21.15.72:0/4122066436 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52440aaa50 con 0x7f5244151ba0 2023-07-25T14:35:52.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.862+0000 7f5239ffb700 1 -- 172.21.15.72:0/4122066436 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f524001c460 con 0x7f5244151ba0 2023-07-25T14:35:52.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.862+0000 7f5239ffb700 1 --2- 172.21.15.72:0/4122066436 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f522806ad10 0x7f522806d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:52.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.862+0000 7f5249762700 1 --2- 172.21.15.72:0/4122066436 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f522806ad10 0x7f522806d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:52.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.862+0000 7f5239ffb700 1 -- 172.21.15.72:0/4122066436 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f5240089510 con 0x7f5244151ba0 2023-07-25T14:35:52.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.863+0000 7f5249762700 1 --2- 172.21.15.72:0/4122066436 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f522806ad10 0x7f522806d1d0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f52340099f0 tx=0x7f5234008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:35:52.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:52.867+0000 7f5239ffb700 1 -- 172.21.15.72:0/4122066436 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f52440aaa50 con 0x7f5244151ba0 2023-07-25T14:35:53.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.052+0000 7f524b9c6700 1 -- 172.21.15.72:0/4122066436 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f52440aaa50 con 0x7f5244151ba0 2023-07-25T14:35:53.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.052+0000 7f5239ffb700 1 -- 172.21.15.72:0/4122066436 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7f52440aaa50 con 0x7f5244151ba0 2023-07-25T14:35:53.064 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 1 2023-07-25T14:35:53.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.054+0000 7f524b9c6700 1 -- 172.21.15.72:0/4122066436 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f522806ad10 msgr2=0x7f522806d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:53.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.054+0000 7f524b9c6700 1 --2- 172.21.15.72:0/4122066436 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f522806ad10 0x7f522806d1d0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f52340099f0 tx=0x7f5234008040 comp rx=0 tx=0).stop 2023-07-25T14:35:53.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.054+0000 7f524b9c6700 1 -- 172.21.15.72:0/4122066436 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5244151ba0 msgr2=0x7f52440ab0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:53.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.054+0000 7f524b9c6700 1 --2- 172.21.15.72:0/4122066436 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5244151ba0 0x7f52440ab0a0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f524000c4a0 tx=0x7f524000c860 comp rx=0 tx=0).stop 2023-07-25T14:35:53.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.054+0000 7f524b9c6700 1 -- 172.21.15.72:0/4122066436 shutdown_connections 2023-07-25T14:35:53.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.054+0000 7f524b9c6700 1 --2- 172.21.15.72:0/4122066436 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f522806ad10 0x7f522806d1d0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:53.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.054+0000 7f524b9c6700 1 --2- 172.21.15.72:0/4122066436 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f524406a190 0x7f52440bbce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:53.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.054+0000 7f524b9c6700 1 --2- 172.21.15.72:0/4122066436 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f52440c5f40 0x7f52440be280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:53.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.054+0000 7f524b9c6700 1 --2- 172.21.15.72:0/4122066436 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5244151ba0 0x7f52440ab0a0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:53.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.054+0000 7f524b9c6700 1 -- 172.21.15.72:0/4122066436 >> 172.21.15.72:0/4122066436 conn(0x7f52440a87e0 msgr2=0x7f5244150df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:35:53.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.054+0000 7f524b9c6700 1 -- 172.21.15.72:0/4122066436 shutdown_connections 2023-07-25T14:35:53.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.054+0000 7f524b9c6700 1 -- 172.21.15.72:0/4122066436 wait complete. 2023-07-25T14:35:53.077 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-25T14:35:53.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.188+0000 7fc96ea6a700 1 Processor -- start 2023-07-25T14:35:53.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.188+0000 7fc96ea6a700 1 -- start start 2023-07-25T14:35:53.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.189+0000 7fc96ea6a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc96814e6f0 0x7fc9680c67d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:53.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.189+0000 7fc96ea6a700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc96806f280 0x7fc9680a8170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:53.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.189+0000 7fc96ea6a700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9680ba1c0 con 0x7fc9680c11f0 2023-07-25T14:35:53.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.189+0000 7fc96ea6a700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9680a7920 con 0x7fc96814e6f0 2023-07-25T14:35:53.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.189+0000 7fc96ea6a700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc968154640 con 0x7fc96806f280 2023-07-25T14:35:53.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.189+0000 7fc96c806700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc96814e6f0 0x7fc9680c67d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:53.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.189+0000 7fc96c806700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc96814e6f0 0x7fc9680c67d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:39668/0 (socket says 172.21.15.72:39668) 2023-07-25T14:35:53.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.189+0000 7fc96d007700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fc9680c11f0 0x7fc9680a86b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:58640/0 (socket says 172.21.15.72:58640) 2023-07-25T14:35:53.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.189+0000 7fc96c806700 1 -- 172.21.15.72:0/3656809253 learned_addr learned my addr 172.21.15.72:0/3656809253 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:35:53.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.189+0000 7fc967fff700 1 --2- 172.21.15.72:0/3656809253 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc96806f280 0x7fc9680a8170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:53.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.189+0000 7fc96c806700 1 -- 172.21.15.72:0/3656809253 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc96806f280 msgr2=0x7fc9680a8170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:35:53.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.189+0000 7fc96c806700 1 --2- 172.21.15.72:0/3656809253 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc96806f280 0x7fc9680a8170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:53.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.189+0000 7fc96c806700 1 -- 172.21.15.72:0/3656809253 >> v1:172.21.15.72:6789/0 conn(0x7fc9680c11f0 legacy=0x7fc9680a86b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:53.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.189+0000 7fc9677fe700 1 -- 172.21.15.72:0/3656809253 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1690456102 0 0) 0x7fc9680ba1c0 con 0x7fc9680c11f0 2023-07-25T14:35:53.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.189+0000 7fc96c806700 1 -- 172.21.15.72:0/3656809253 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc968154900 con 0x7fc96814e6f0 2023-07-25T14:35:53.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.189+0000 7fc967fff700 1 --2- 172.21.15.72:0/3656809253 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc96806f280 0x7fc9680a8170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-25T14:35:53.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.189+0000 7fc96c806700 1 --2- 172.21.15.72:0/3656809253 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc96814e6f0 0x7fc9680c67d0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fc95c0098f0 tx=0x7fc95c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55c1009c0d1b5fa7 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:35:53.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.190+0000 7fc9677fe700 1 -- 172.21.15.72:0/3656809253 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc95c00b8a0 con 0x7fc96814e6f0 2023-07-25T14:35:53.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.190+0000 7fc9677fe700 1 -- 172.21.15.72:0/3656809253 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc95c00ba00 con 0x7fc96814e6f0 2023-07-25T14:35:53.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.190+0000 7fc9677fe700 1 -- 172.21.15.72:0/3656809253 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc95c00bd90 con 0x7fc96814e6f0 2023-07-25T14:35:53.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.190+0000 7fc96ea6a700 1 -- 172.21.15.72:0/3656809253 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc96814e6f0 msgr2=0x7fc9680c67d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:53.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.190+0000 7fc96ea6a700 1 --2- 172.21.15.72:0/3656809253 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc96814e6f0 0x7fc9680c67d0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fc95c0098f0 tx=0x7fc95c009c00 comp rx=0 tx=0).stop 2023-07-25T14:35:53.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.190+0000 7fc96ea6a700 1 -- 172.21.15.72:0/3656809253 shutdown_connections 2023-07-25T14:35:53.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.190+0000 7fc96ea6a700 1 --2- 172.21.15.72:0/3656809253 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc96814e6f0 0x7fc9680c67d0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:53.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.190+0000 7fc96ea6a700 1 --2- 172.21.15.72:0/3656809253 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc96806f280 0x7fc9680a8170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:53.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.190+0000 7fc96ea6a700 1 -- 172.21.15.72:0/3656809253 >> 172.21.15.72:0/3656809253 conn(0x7fc9680714f0 msgr2=0x7fc968071900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:35:53.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.190+0000 7fc96ea6a700 1 -- 172.21.15.72:0/3656809253 shutdown_connections 2023-07-25T14:35:53.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.190+0000 7fc96ea6a700 1 -- 172.21.15.72:0/3656809253 wait complete. 2023-07-25T14:35:53.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.191+0000 7fc96ea6a700 1 Processor -- start 2023-07-25T14:35:53.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.191+0000 7fc96ea6a700 1 -- start start 2023-07-25T14:35:53.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.192+0000 7fc96ea6a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc96806f280 0x7fc9680ab8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:53.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.192+0000 7fc96ea6a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc9680c11f0 0x7fc96814b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:53.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.192+0000 7fc96ea6a700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc96814e6f0 0x7fc96814bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:53.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.192+0000 7fc96ea6a700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc96814a5d0 con 0x7fc9680c11f0 2023-07-25T14:35:53.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.192+0000 7fc96ea6a700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9680a6a60 con 0x7fc96806f280 2023-07-25T14:35:53.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.192+0000 7fc96ea6a700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc96814a820 con 0x7fc96814e6f0 2023-07-25T14:35:53.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.192+0000 7fc967fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc9680c11f0 0x7fc96814b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:53.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.192+0000 7fc967fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc9680c11f0 0x7fc96814b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:39676/0 (socket says 172.21.15.72:39676) 2023-07-25T14:35:53.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.192+0000 7fc967fff700 1 -- 172.21.15.72:0/1137321345 learned_addr learned my addr 172.21.15.72:0/1137321345 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:35:53.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.192+0000 7fc96d007700 1 --2- 172.21.15.72:0/1137321345 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc96814e6f0 0x7fc96814bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:53.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.192+0000 7fc96c806700 1 --2- 172.21.15.72:0/1137321345 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc96806f280 0x7fc9680ab8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:53.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.193+0000 7fc967fff700 1 -- 172.21.15.72:0/1137321345 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc96814e6f0 msgr2=0x7fc96814bb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:53.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.193+0000 7fc967fff700 1 --2- 172.21.15.72:0/1137321345 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc96814e6f0 0x7fc96814bb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:53.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.193+0000 7fc967fff700 1 -- 172.21.15.72:0/1137321345 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc96806f280 msgr2=0x7fc9680ab8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:53.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.193+0000 7fc967fff700 1 --2- 172.21.15.72:0/1137321345 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc96806f280 0x7fc9680ab8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:53.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.193+0000 7fc967fff700 1 -- 172.21.15.72:0/1137321345 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc95c009550 con 0x7fc9680c11f0 2023-07-25T14:35:53.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.193+0000 7fc967fff700 1 --2- 172.21.15.72:0/1137321345 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc9680c11f0 0x7fc96814b5e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fc95400c7f0 tx=0x7fc95400cb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:35:53.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.193+0000 7fc9657fa700 1 -- 172.21.15.72:0/1137321345 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc954011800 con 0x7fc9680c11f0 2023-07-25T14:35:53.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.193+0000 7fc9657fa700 1 -- 172.21.15.72:0/1137321345 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc954011960 con 0x7fc9680c11f0 2023-07-25T14:35:53.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.193+0000 7fc96ea6a700 1 -- 172.21.15.72:0/1137321345 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc96814ab00 con 0x7fc9680c11f0 2023-07-25T14:35:53.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.193+0000 7fc9657fa700 1 -- 172.21.15.72:0/1137321345 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc954011cf0 con 0x7fc9680c11f0 2023-07-25T14:35:53.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.193+0000 7fc96ea6a700 1 -- 172.21.15.72:0/1137321345 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc96814b0c0 con 0x7fc9680c11f0 2023-07-25T14:35:53.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.194+0000 7fc96ea6a700 1 -- 172.21.15.72:0/1137321345 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc96814b2e0 con 0x7fc9680c11f0 2023-07-25T14:35:53.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.194+0000 7fc9657fa700 1 -- 172.21.15.72:0/1137321345 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc954018360 con 0x7fc9680c11f0 2023-07-25T14:35:53.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.195+0000 7fc9657fa700 1 --2- 172.21.15.72:0/1137321345 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fc94c06ad10 0x7fc94c06d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:53.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.195+0000 7fc9657fa700 1 -- 172.21.15.72:0/1137321345 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fc954089540 con 0x7fc9680c11f0 2023-07-25T14:35:53.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.195+0000 7fc96c806700 1 --2- 172.21.15.72:0/1137321345 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fc94c06ad10 0x7fc94c06d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:53.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.195+0000 7fc96c806700 1 --2- 172.21.15.72:0/1137321345 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fc94c06ad10 0x7fc94c06d1d0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fc95c014040 tx=0x7fc95c008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:35:53.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.199+0000 7fc9657fa700 1 -- 172.21.15.72:0/1137321345 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fc954054390 con 0x7fc9680c11f0 2023-07-25T14:35:53.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.386+0000 7fc96ea6a700 1 -- 172.21.15.72:0/1137321345 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc9680a6bd0 con 0x7fc9680c11f0 2023-07-25T14:35:53.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.387+0000 7fc9657fa700 1 -- 172.21.15.72:0/1137321345 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc9540579b0 con 0x7fc9680c11f0 2023-07-25T14:35:53.398 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2023-07-25T14:35:53.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.389+0000 7fc96ea6a700 1 -- 172.21.15.72:0/1137321345 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fc94c06ad10 msgr2=0x7fc94c06d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:53.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.389+0000 7fc96ea6a700 1 --2- 172.21.15.72:0/1137321345 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fc94c06ad10 0x7fc94c06d1d0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fc95c014040 tx=0x7fc95c008030 comp rx=0 tx=0).stop 2023-07-25T14:35:53.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.389+0000 7fc96ea6a700 1 -- 172.21.15.72:0/1137321345 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc9680c11f0 msgr2=0x7fc96814b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:53.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.389+0000 7fc96ea6a700 1 --2- 172.21.15.72:0/1137321345 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc9680c11f0 0x7fc96814b5e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fc95400c7f0 tx=0x7fc95400cb00 comp rx=0 tx=0).stop 2023-07-25T14:35:53.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.389+0000 7fc96ea6a700 1 -- 172.21.15.72:0/1137321345 shutdown_connections 2023-07-25T14:35:53.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.389+0000 7fc96ea6a700 1 --2- 172.21.15.72:0/1137321345 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fc94c06ad10 0x7fc94c06d1d0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:53.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.389+0000 7fc96ea6a700 1 --2- 172.21.15.72:0/1137321345 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc96814e6f0 0x7fc96814bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:53.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.389+0000 7fc96ea6a700 1 --2- 172.21.15.72:0/1137321345 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc96806f280 0x7fc9680ab8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:53.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.389+0000 7fc96ea6a700 1 --2- 172.21.15.72:0/1137321345 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc9680c11f0 0x7fc96814b5e0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:53.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.389+0000 7fc96ea6a700 1 -- 172.21.15.72:0/1137321345 >> 172.21.15.72:0/1137321345 conn(0x7fc9680714f0 msgr2=0x7fc9680c26d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:35:53.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.389+0000 7fc96ea6a700 1 -- 172.21.15.72:0/1137321345 shutdown_connections 2023-07-25T14:35:53.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.389+0000 7fc96ea6a700 1 -- 172.21.15.72:0/1137321345 wait complete. 2023-07-25T14:35:53.412 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-25T14:35:53.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.524+0000 7f951b212700 1 Processor -- start 2023-07-25T14:35:53.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.524+0000 7f951b212700 1 -- start start 2023-07-25T14:35:53.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.524+0000 7f951b212700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f951414faf0 0x7f95140c5e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:53.538 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.525+0000 7f951b212700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f95140ba0e0 0x7f95141558a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:53.538 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.525+0000 7f951b212700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95140c4930 con 0x7f9514155de0 2023-07-25T14:35:53.538 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.525+0000 7f951b212700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95140c5670 con 0x7f95140ba0e0 2023-07-25T14:35:53.538 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.525+0000 7f951b212700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95140726e0 con 0x7f951414faf0 2023-07-25T14:35:53.538 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.525+0000 7f9513fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f95140ba0e0 0x7f95141558a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:53.538 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.525+0000 7f95197af700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f9514155de0 0x7f9514071960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:58654/0 (socket says 172.21.15.72:58654) 2023-07-25T14:35:53.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.525+0000 7f95197af700 1 -- 172.21.15.72:0/3574508356 learned_addr learned my addr 172.21.15.72:0/3574508356 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:35:53.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.525+0000 7f9518fae700 1 --2- 172.21.15.72:0/3574508356 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f951414faf0 0x7f95140c5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:53.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.525+0000 7f9513fff700 1 -- 172.21.15.72:0/3574508356 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f951414faf0 msgr2=0x7f95140c5e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:35:53.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.525+0000 7f9513fff700 1 --2- 172.21.15.72:0/3574508356 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f951414faf0 0x7f95140c5e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:53.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.525+0000 7f9513fff700 1 -- 172.21.15.72:0/3574508356 >> v1:172.21.15.72:6789/0 conn(0x7f9514155de0 legacy=0x7f9514071960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:53.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.525+0000 7f95137fe700 1 -- 172.21.15.72:0/3574508356 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1067619328 0 0) 0x7f95140c4930 con 0x7f9514155de0 2023-07-25T14:35:53.540 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.525+0000 7f9513fff700 1 -- 172.21.15.72:0/3574508356 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95140c4b80 con 0x7f95140ba0e0 2023-07-25T14:35:53.540 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.525+0000 7f9518fae700 1 --2- 172.21.15.72:0/3574508356 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f951414faf0 0x7f95140c5e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-25T14:35:53.540 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.525+0000 7f9513fff700 1 --2- 172.21.15.72:0/3574508356 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f95140ba0e0 0x7f95141558a0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f9500009840 tx=0x7f9500009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=661ab2d52d3ca34 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:35:53.540 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.525+0000 7f95137fe700 1 -- 172.21.15.72:0/3574508356 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9500011830 con 0x7f95140ba0e0 2023-07-25T14:35:53.540 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.525+0000 7f95137fe700 1 -- 172.21.15.72:0/3574508356 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9500011990 con 0x7f95140ba0e0 2023-07-25T14:35:53.540 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.525+0000 7f95137fe700 1 -- 172.21.15.72:0/3574508356 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9500011d20 con 0x7f95140ba0e0 2023-07-25T14:35:53.540 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.526+0000 7f951b212700 1 -- 172.21.15.72:0/3574508356 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f95140ba0e0 msgr2=0x7f95141558a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:53.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.526+0000 7f951b212700 1 --2- 172.21.15.72:0/3574508356 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f95140ba0e0 0x7f95141558a0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f9500009840 tx=0x7f9500009b50 comp rx=0 tx=0).stop 2023-07-25T14:35:53.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.526+0000 7f951b212700 1 -- 172.21.15.72:0/3574508356 shutdown_connections 2023-07-25T14:35:53.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.526+0000 7f951b212700 1 --2- 172.21.15.72:0/3574508356 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f951414faf0 0x7f95140c5e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:53.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.526+0000 7f951b212700 1 --2- 172.21.15.72:0/3574508356 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f95140ba0e0 0x7f95141558a0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:53.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.526+0000 7f951b212700 1 -- 172.21.15.72:0/3574508356 >> 172.21.15.72:0/3574508356 conn(0x7f95140a87e0 msgr2=0x7f95140a8bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:35:53.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.526+0000 7f951b212700 1 -- 172.21.15.72:0/3574508356 shutdown_connections 2023-07-25T14:35:53.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.526+0000 7f951b212700 1 -- 172.21.15.72:0/3574508356 wait complete. 2023-07-25T14:35:53.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.527+0000 7f951b212700 1 Processor -- start 2023-07-25T14:35:53.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.527+0000 7f951b212700 1 -- start start 2023-07-25T14:35:53.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.528+0000 7f951b212700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f95140ba0e0 0x7f95141ed000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:53.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.528+0000 7f951b212700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f951414faf0 0x7f95141ec310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:53.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.528+0000 7f951b212700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9514155de0 0x7f95141ec850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:53.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.528+0000 7f951b212700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95140a5a60 con 0x7f95140ba0e0 2023-07-25T14:35:53.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.528+0000 7f951b212700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f951414c360 con 0x7f951414faf0 2023-07-25T14:35:53.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.528+0000 7f951b212700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95140a54a0 con 0x7f9514155de0 2023-07-25T14:35:53.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.528+0000 7f9518fae700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f95140ba0e0 0x7f95141ed000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:53.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.528+0000 7f9518fae700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f95140ba0e0 0x7f95141ed000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:39688/0 (socket says 172.21.15.72:39688) 2023-07-25T14:35:53.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.528+0000 7f9518fae700 1 -- 172.21.15.72:0/1578360287 learned_addr learned my addr 172.21.15.72:0/1578360287 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:35:53.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.528+0000 7f9513fff700 1 --2- 172.21.15.72:0/1578360287 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f951414faf0 0x7f95141ec310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:53.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.528+0000 7f9518fae700 1 -- 172.21.15.72:0/1578360287 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9514155de0 msgr2=0x7f95141ec850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:53.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.528+0000 7f9518fae700 1 --2- 172.21.15.72:0/1578360287 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9514155de0 0x7f95141ec850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:53.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.528+0000 7f9518fae700 1 -- 172.21.15.72:0/1578360287 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f951414faf0 msgr2=0x7f95141ec310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:53.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.528+0000 7f9518fae700 1 --2- 172.21.15.72:0/1578360287 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f951414faf0 0x7f95141ec310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:53.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.528+0000 7f9518fae700 1 -- 172.21.15.72:0/1578360287 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95000094a0 con 0x7f95140ba0e0 2023-07-25T14:35:53.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.528+0000 7f9518fae700 1 --2- 172.21.15.72:0/1578360287 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f95140ba0e0 0x7f95141ed000 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f950800c7f0 tx=0x7f950800cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:35:53.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.528+0000 7f95117fa700 1 -- 172.21.15.72:0/1578360287 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9508011800 con 0x7f95140ba0e0 2023-07-25T14:35:53.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.528+0000 7f95117fa700 1 -- 172.21.15.72:0/1578360287 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9508011960 con 0x7f95140ba0e0 2023-07-25T14:35:53.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.528+0000 7f951b212700 1 -- 172.21.15.72:0/1578360287 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95141ed9d0 con 0x7f95140ba0e0 2023-07-25T14:35:53.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.528+0000 7f95117fa700 1 -- 172.21.15.72:0/1578360287 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9508011d10 con 0x7f95140ba0e0 2023-07-25T14:35:53.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.529+0000 7f951b212700 1 -- 172.21.15.72:0/1578360287 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9514155640 con 0x7f95140ba0e0 2023-07-25T14:35:53.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.529+0000 7f951b212700 1 -- 172.21.15.72:0/1578360287 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f951404e470 con 0x7f95140ba0e0 2023-07-25T14:35:53.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.530+0000 7f95117fa700 1 -- 172.21.15.72:0/1578360287 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9508018360 con 0x7f95140ba0e0 2023-07-25T14:35:53.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.530+0000 7f95117fa700 1 --2- 172.21.15.72:0/1578360287 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f94f806ace0 0x7f94f806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:53.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.530+0000 7f95117fa700 1 -- 172.21.15.72:0/1578360287 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f9508089710 con 0x7f95140ba0e0 2023-07-25T14:35:53.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.530+0000 7f9513fff700 1 --2- 172.21.15.72:0/1578360287 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f94f806ace0 0x7f94f806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:53.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.531+0000 7f9513fff700 1 --2- 172.21.15.72:0/1578360287 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f94f806ace0 0x7f94f806d1a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f95140a7ad0 tx=0x7f9500008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:35:53.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.535+0000 7f95117fa700 1 -- 172.21.15.72:0/1578360287 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f9508054560 con 0x7f95140ba0e0 2023-07-25T14:35:53.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.722+0000 7f951b212700 1 -- 172.21.15.72:0/1578360287 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9514071740 con 0x7f95140ba0e0 2023-07-25T14:35:53.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.722+0000 7f95117fa700 1 -- 172.21.15.72:0/1578360287 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9508057b80 con 0x7f95140ba0e0 2023-07-25T14:35:53.734 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 64 2023-07-25T14:35:53.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.724+0000 7f951b212700 1 -- 172.21.15.72:0/1578360287 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f94f806ace0 msgr2=0x7f94f806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:53.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.724+0000 7f951b212700 1 --2- 172.21.15.72:0/1578360287 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f94f806ace0 0x7f94f806d1a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f95140a7ad0 tx=0x7f9500008030 comp rx=0 tx=0).stop 2023-07-25T14:35:53.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.724+0000 7f951b212700 1 -- 172.21.15.72:0/1578360287 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f95140ba0e0 msgr2=0x7f95141ed000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:53.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.724+0000 7f951b212700 1 --2- 172.21.15.72:0/1578360287 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f95140ba0e0 0x7f95141ed000 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f950800c7f0 tx=0x7f950800cbb0 comp rx=0 tx=0).stop 2023-07-25T14:35:53.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.724+0000 7f951b212700 1 -- 172.21.15.72:0/1578360287 shutdown_connections 2023-07-25T14:35:53.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.724+0000 7f951b212700 1 --2- 172.21.15.72:0/1578360287 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f94f806ace0 0x7f94f806d1a0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:53.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.724+0000 7f951b212700 1 --2- 172.21.15.72:0/1578360287 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9514155de0 0x7f95141ec850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:53.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.724+0000 7f951b212700 1 --2- 172.21.15.72:0/1578360287 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f95140ba0e0 0x7f95141ed000 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:53.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.724+0000 7f951b212700 1 --2- 172.21.15.72:0/1578360287 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f951414faf0 0x7f95141ec310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:53.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.724+0000 7f951b212700 1 -- 172.21.15.72:0/1578360287 >> 172.21.15.72:0/1578360287 conn(0x7f95140a87e0 msgr2=0x7f9514071960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:35:53.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.724+0000 7f951b212700 1 -- 172.21.15.72:0/1578360287 shutdown_connections 2023-07-25T14:35:53.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.724+0000 7f951b212700 1 -- 172.21.15.72:0/1578360287 wait complete. 2023-07-25T14:35:53.747 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-07-25T14:35:53.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.857+0000 7ff76634c700 1 Processor -- start 2023-07-25T14:35:53.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.858+0000 7ff76634c700 1 -- start start 2023-07-25T14:35:53.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.858+0000 7ff76634c700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7ff760151950 0x7ff76006a190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:53.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.858+0000 7ff76634c700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff76006a6d0 0x7ff7600c3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:53.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.858+0000 7ff76634c700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7600c2fe0 con 0x7ff7600724c0 2023-07-25T14:35:53.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.858+0000 7ff76634c700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff760071a60 con 0x7ff760151950 2023-07-25T14:35:53.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.858+0000 7ff76634c700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7600c2a70 con 0x7ff76006a6d0 2023-07-25T14:35:53.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.859+0000 7ff7648e9700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff76006a6d0 0x7ff7600c3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:53.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.859+0000 7ff75ffff700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7ff760151950 0x7ff76006a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:53.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.859+0000 7ff75f7fe700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7ff7600724c0 0x7ff7600c34c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.72:54006/0 (socket says 172.21.15.72:54006) 2023-07-25T14:35:53.872 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.859+0000 7ff75ffff700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7ff760151950 0x7ff76006a190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.72:35268/0 (socket says 172.21.15.72:35268) 2023-07-25T14:35:53.872 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.859+0000 7ff7648e9700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff76006a6d0 0x7ff7600c3bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3301/0 says I am v2:172.21.15.72:44928/0 (socket says 172.21.15.72:44928) 2023-07-25T14:35:53.872 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.859+0000 7ff75f7fe700 1 -- 172.21.15.72:0/3650382481 learned_addr learned my addr 172.21.15.72:0/3650382481 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:35:53.872 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.859+0000 7ff7648e9700 1 -- 172.21.15.72:0/3650382481 >> v2:172.21.15.92:3300/0 conn(0x7ff760151950 msgr2=0x7ff76006a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:35:53.872 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.859+0000 7ff7648e9700 1 --2- 172.21.15.72:0/3650382481 >> v2:172.21.15.92:3300/0 conn(0x7ff760151950 0x7ff76006a190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:53.872 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.859+0000 7ff7648e9700 1 -- 172.21.15.72:0/3650382481 >> v1:172.21.15.92:6789/0 conn(0x7ff7600724c0 legacy=0x7ff7600c34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:53.872 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.859+0000 7ff7648e9700 1 -- 172.21.15.72:0/3650382481 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff760155070 con 0x7ff76006a6d0 2023-07-25T14:35:53.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.859+0000 7ff75ffff700 1 --2- 172.21.15.72:0/3650382481 >> v2:172.21.15.92:3300/0 conn(0x7ff760151950 0x7ff76006a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-25T14:35:53.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.859+0000 7ff7648e9700 1 --2- 172.21.15.72:0/3650382481 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff76006a6d0 0x7ff7600c3bd0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7ff758009d90 tx=0x7ff75800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c0a428d030599237 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:35:53.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.859+0000 7ff75effd700 1 -- 172.21.15.72:0/3650382481 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff75800e070 con 0x7ff76006a6d0 2023-07-25T14:35:53.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.859+0000 7ff75effd700 1 -- 172.21.15.72:0/3650382481 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff75800bb20 con 0x7ff76006a6d0 2023-07-25T14:35:53.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.859+0000 7ff75effd700 1 -- 172.21.15.72:0/3650382481 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff758012430 con 0x7ff76006a6d0 2023-07-25T14:35:53.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.860+0000 7ff76634c700 1 -- 172.21.15.72:0/3650382481 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff76006a6d0 msgr2=0x7ff7600c3bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:53.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.860+0000 7ff76634c700 1 --2- 172.21.15.72:0/3650382481 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff76006a6d0 0x7ff7600c3bd0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7ff758009d90 tx=0x7ff75800b330 comp rx=0 tx=0).stop 2023-07-25T14:35:53.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.860+0000 7ff76634c700 1 -- 172.21.15.72:0/3650382481 shutdown_connections 2023-07-25T14:35:53.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.860+0000 7ff76634c700 1 --2- 172.21.15.72:0/3650382481 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff76006a6d0 0x7ff7600c3bd0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:53.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.860+0000 7ff76634c700 1 --2- 172.21.15.72:0/3650382481 >> v2:172.21.15.92:3300/0 conn(0x7ff760151950 0x7ff76006a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:53.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.860+0000 7ff76634c700 1 -- 172.21.15.72:0/3650382481 >> 172.21.15.72:0/3650382481 conn(0x7ff7600a87e0 msgr2=0x7ff7600a8bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:35:53.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.860+0000 7ff76634c700 1 -- 172.21.15.72:0/3650382481 shutdown_connections 2023-07-25T14:35:53.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.860+0000 7ff76634c700 1 -- 172.21.15.72:0/3650382481 wait complete. 2023-07-25T14:35:53.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.861+0000 7ff76634c700 1 Processor -- start 2023-07-25T14:35:53.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.861+0000 7ff76634c700 1 -- start start 2023-07-25T14:35:53.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.862+0000 7ff76634c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff76006a6d0 0x7ff7601ed420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:53.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.862+0000 7ff76634c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff7600724c0 0x7ff76014d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:53.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.862+0000 7ff76634c700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff760151950 0x7ff76014a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:53.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.862+0000 7ff76634c700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7601ec9d0 con 0x7ff76006a6d0 2023-07-25T14:35:53.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.862+0000 7ff76634c700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7601ecf90 con 0x7ff7600724c0 2023-07-25T14:35:53.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.862+0000 7ff76634c700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7600a77a0 con 0x7ff760151950 2023-07-25T14:35:53.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.862+0000 7ff75ffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff76006a6d0 0x7ff7601ed420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:53.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.862+0000 7ff75ffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff76006a6d0 0x7ff7601ed420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:39702/0 (socket says 172.21.15.72:39702) 2023-07-25T14:35:53.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.862+0000 7ff75ffff700 1 -- 172.21.15.72:0/3439033161 learned_addr learned my addr 172.21.15.72:0/3439033161 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:35:53.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.862+0000 7ff75f7fe700 1 --2- 172.21.15.72:0/3439033161 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff7600724c0 0x7ff76014d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:53.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.862+0000 7ff7648e9700 1 --2- 172.21.15.72:0/3439033161 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff760151950 0x7ff76014a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:53.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.862+0000 7ff75ffff700 1 -- 172.21.15.72:0/3439033161 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff760151950 msgr2=0x7ff76014a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:53.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.862+0000 7ff75ffff700 1 --2- 172.21.15.72:0/3439033161 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff760151950 0x7ff76014a360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:53.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.862+0000 7ff75ffff700 1 -- 172.21.15.72:0/3439033161 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff7600724c0 msgr2=0x7ff76014d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:53.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.862+0000 7ff75ffff700 1 --2- 172.21.15.72:0/3439033161 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff7600724c0 0x7ff76014d1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:53.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.862+0000 7ff75ffff700 1 -- 172.21.15.72:0/3439033161 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7540094a0 con 0x7ff76006a6d0 2023-07-25T14:35:53.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.862+0000 7ff75f7fe700 1 --2- 172.21.15.72:0/3439033161 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff7600724c0 0x7ff76014d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-25T14:35:53.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.862+0000 7ff75ffff700 1 --2- 172.21.15.72:0/3439033161 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff76006a6d0 0x7ff7601ed420 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ff75400ec10 tx=0x7ff754009e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:35:53.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.863+0000 7ff75cff9700 1 -- 172.21.15.72:0/3439033161 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff75400c8e0 con 0x7ff76006a6d0 2023-07-25T14:35:53.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.863+0000 7ff75cff9700 1 -- 172.21.15.72:0/3439033161 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff75400ca40 con 0x7ff76006a6d0 2023-07-25T14:35:53.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.863+0000 7ff76634c700 1 -- 172.21.15.72:0/3439033161 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff758009a70 con 0x7ff76006a6d0 2023-07-25T14:35:53.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.863+0000 7ff75cff9700 1 -- 172.21.15.72:0/3439033161 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff75400cdd0 con 0x7ff76006a6d0 2023-07-25T14:35:53.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.863+0000 7ff76634c700 1 -- 172.21.15.72:0/3439033161 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7601ed960 con 0x7ff76006a6d0 2023-07-25T14:35:53.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.864+0000 7ff76634c700 1 -- 172.21.15.72:0/3439033161 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7601ea430 con 0x7ff76006a6d0 2023-07-25T14:35:53.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.864+0000 7ff75cff9700 1 -- 172.21.15.72:0/3439033161 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff754013470 con 0x7ff76006a6d0 2023-07-25T14:35:53.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.864+0000 7ff75cff9700 1 --2- 172.21.15.72:0/3439033161 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7ff74c06ace0 0x7ff74c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:53.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.864+0000 7ff75cff9700 1 -- 172.21.15.72:0/3439033161 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7ff754089bc0 con 0x7ff76006a6d0 2023-07-25T14:35:53.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.864+0000 7ff75f7fe700 1 --2- 172.21.15.72:0/3439033161 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7ff74c06ace0 0x7ff74c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:53.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.865+0000 7ff75f7fe700 1 --2- 172.21.15.72:0/3439033161 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7ff74c06ace0 0x7ff74c06d1a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ff7600bd4e0 tx=0x7ff750009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:35:53.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:53.869+0000 7ff75cff9700 1 -- 172.21.15.72:0/3439033161 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7ff754054a10 con 0x7ff76006a6d0 2023-07-25T14:35:54.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.058+0000 7ff76634c700 1 -- 172.21.15.72:0/3439033161 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7ff7601e9f80 con 0x7ff76006a6d0 2023-07-25T14:35:54.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.058+0000 7ff75cff9700 1 -- 172.21.15.72:0/3439033161 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+11 (secure 0 0 0) 0x7ff754058030 con 0x7ff76006a6d0 2023-07-25T14:35:54.070 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2023-07-25T14:35:54.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.060+0000 7ff76634c700 1 -- 172.21.15.72:0/3439033161 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7ff74c06ace0 msgr2=0x7ff74c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:54.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.060+0000 7ff76634c700 1 --2- 172.21.15.72:0/3439033161 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7ff74c06ace0 0x7ff74c06d1a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ff7600bd4e0 tx=0x7ff750009040 comp rx=0 tx=0).stop 2023-07-25T14:35:54.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.060+0000 7ff76634c700 1 -- 172.21.15.72:0/3439033161 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff76006a6d0 msgr2=0x7ff7601ed420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:54.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.060+0000 7ff76634c700 1 --2- 172.21.15.72:0/3439033161 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff76006a6d0 0x7ff7601ed420 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ff75400ec10 tx=0x7ff754009e20 comp rx=0 tx=0).stop 2023-07-25T14:35:54.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.060+0000 7ff76634c700 1 -- 172.21.15.72:0/3439033161 shutdown_connections 2023-07-25T14:35:54.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.060+0000 7ff76634c700 1 --2- 172.21.15.72:0/3439033161 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7ff74c06ace0 0x7ff74c06d1a0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:54.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.060+0000 7ff76634c700 1 --2- 172.21.15.72:0/3439033161 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff760151950 0x7ff76014a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:54.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.060+0000 7ff76634c700 1 --2- 172.21.15.72:0/3439033161 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff76006a6d0 0x7ff7601ed420 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:54.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.060+0000 7ff76634c700 1 --2- 172.21.15.72:0/3439033161 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff7600724c0 0x7ff76014d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:54.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.060+0000 7ff76634c700 1 -- 172.21.15.72:0/3439033161 >> 172.21.15.72:0/3439033161 conn(0x7ff7600a87e0 msgr2=0x7ff7600c45e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:35:54.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.060+0000 7ff76634c700 1 -- 172.21.15.72:0/3439033161 shutdown_connections 2023-07-25T14:35:54.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.060+0000 7ff76634c700 1 -- 172.21.15.72:0/3439033161 wait complete. 2023-07-25T14:35:54.083 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-25T14:35:54.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.192+0000 7fb62b867700 1 Processor -- start 2023-07-25T14:35:54.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.192+0000 7fb62b867700 1 -- start start 2023-07-25T14:35:54.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.193+0000 7fb62b867700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb62406e580 0x7fb6240c4c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:54.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.193+0000 7fb62b867700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb62406f9b0 0x7fb6240c51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:54.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.193+0000 7fb62b867700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb62406eaf0 con 0x7fb624151980 2023-07-25T14:35:54.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.193+0000 7fb62b867700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb62406f770 con 0x7fb62406f9b0 2023-07-25T14:35:54.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.193+0000 7fb62b867700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6240c29e0 con 0x7fb62406e580 2023-07-25T14:35:54.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.193+0000 7fb628e02700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb62406e580 0x7fb6240c4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:54.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.193+0000 7fb629e04700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb62406f9b0 0x7fb6240c51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:54.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.193+0000 7fb629603700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fb624151980 0x7fb6240c12b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:58678/0 (socket says 172.21.15.72:58678) 2023-07-25T14:35:54.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.193+0000 7fb629603700 1 -- 172.21.15.72:0/3675414241 learned_addr learned my addr 172.21.15.72:0/3675414241 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:35:54.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.193+0000 7fb629e04700 1 -- 172.21.15.72:0/3675414241 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb62406e580 msgr2=0x7fb6240c4c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:35:54.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.193+0000 7fb629e04700 1 --2- 172.21.15.72:0/3675414241 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb62406e580 0x7fb6240c4c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:54.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.193+0000 7fb629e04700 1 -- 172.21.15.72:0/3675414241 >> v1:172.21.15.72:6789/0 conn(0x7fb624151980 legacy=0x7fb6240c12b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:54.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.193+0000 7fb629e04700 1 -- 172.21.15.72:0/3675414241 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb62406edd0 con 0x7fb62406f9b0 2023-07-25T14:35:54.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.193+0000 7fb61bfff700 1 -- 172.21.15.72:0/3675414241 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1124638608 0 0) 0x7fb62406eaf0 con 0x7fb624151980 2023-07-25T14:35:54.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.194+0000 7fb629e04700 1 --2- 172.21.15.72:0/3675414241 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb62406f9b0 0x7fb6240c51b0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fb61c009d90 tx=0x7fb61c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31b155c49c270e92 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:35:54.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.194+0000 7fb61bfff700 1 -- 172.21.15.72:0/3675414241 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb61c00e070 con 0x7fb62406f9b0 2023-07-25T14:35:54.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.194+0000 7fb61bfff700 1 -- 172.21.15.72:0/3675414241 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb61c00bb20 con 0x7fb62406f9b0 2023-07-25T14:35:54.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.194+0000 7fb61bfff700 1 -- 172.21.15.72:0/3675414241 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb61c012430 con 0x7fb62406f9b0 2023-07-25T14:35:54.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.194+0000 7fb62b867700 1 -- 172.21.15.72:0/3675414241 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb62406f9b0 msgr2=0x7fb6240c51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:54.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.194+0000 7fb62b867700 1 --2- 172.21.15.72:0/3675414241 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb62406f9b0 0x7fb6240c51b0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fb61c009d90 tx=0x7fb61c00b330 comp rx=0 tx=0).stop 2023-07-25T14:35:54.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.194+0000 7fb62b867700 1 -- 172.21.15.72:0/3675414241 shutdown_connections 2023-07-25T14:35:54.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.194+0000 7fb62b867700 1 --2- 172.21.15.72:0/3675414241 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb62406f9b0 0x7fb6240c51b0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:54.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.194+0000 7fb62b867700 1 --2- 172.21.15.72:0/3675414241 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb62406e580 0x7fb6240c4c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:54.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.194+0000 7fb62b867700 1 -- 172.21.15.72:0/3675414241 >> 172.21.15.72:0/3675414241 conn(0x7fb6240a8520 msgr2=0x7fb6240a8900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:35:54.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.194+0000 7fb62b867700 1 -- 172.21.15.72:0/3675414241 shutdown_connections 2023-07-25T14:35:54.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.195+0000 7fb62b867700 1 -- 172.21.15.72:0/3675414241 wait complete. 2023-07-25T14:35:54.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.196+0000 7fb62b867700 1 Processor -- start 2023-07-25T14:35:54.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.196+0000 7fb62b867700 1 -- start start 2023-07-25T14:35:54.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.197+0000 7fb62b867700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb62406e580 0x7fb6241e9b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:54.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.197+0000 7fb62b867700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb62406f9b0 0x7fb6240bbac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:54.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.197+0000 7fb62b867700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb624151980 0x7fb6240bcd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:54.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.197+0000 7fb62b867700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6240a5ef0 con 0x7fb624151980 2023-07-25T14:35:54.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.197+0000 7fb62b867700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6240baa20 con 0x7fb62406e580 2023-07-25T14:35:54.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.197+0000 7fb62b867700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6240bad00 con 0x7fb62406f9b0 2023-07-25T14:35:54.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.197+0000 7fb629e04700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb624151980 0x7fb6240bcd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:54.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.197+0000 7fb629e04700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb624151980 0x7fb6240bcd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:39720/0 (socket says 172.21.15.72:39720) 2023-07-25T14:35:54.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.197+0000 7fb629e04700 1 -- 172.21.15.72:0/137811368 learned_addr learned my addr 172.21.15.72:0/137811368 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:35:54.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.197+0000 7fb629603700 1 --2- 172.21.15.72:0/137811368 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb62406e580 0x7fb6241e9b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:54.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.197+0000 7fb628e02700 1 --2- 172.21.15.72:0/137811368 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb62406f9b0 0x7fb6240bbac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:54.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.197+0000 7fb629e04700 1 -- 172.21.15.72:0/137811368 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb62406f9b0 msgr2=0x7fb6240bbac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:54.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.197+0000 7fb629e04700 1 --2- 172.21.15.72:0/137811368 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb62406f9b0 0x7fb6240bbac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:54.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.197+0000 7fb629e04700 1 -- 172.21.15.72:0/137811368 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb62406e580 msgr2=0x7fb6241e9b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:54.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.197+0000 7fb629e04700 1 --2- 172.21.15.72:0/137811368 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb62406e580 0x7fb6241e9b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:54.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.197+0000 7fb629e04700 1 -- 172.21.15.72:0/137811368 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb61c009a70 con 0x7fb624151980 2023-07-25T14:35:54.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.197+0000 7fb629e04700 1 --2- 172.21.15.72:0/137811368 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb624151980 0x7fb6240bcd80 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fb61c014040 tx=0x7fb61c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:35:54.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.197+0000 7fb619ffb700 1 -- 172.21.15.72:0/137811368 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb61c012430 con 0x7fb624151980 2023-07-25T14:35:54.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.197+0000 7fb619ffb700 1 -- 172.21.15.72:0/137811368 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb61c020070 con 0x7fb624151980 2023-07-25T14:35:54.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.197+0000 7fb62b867700 1 -- 172.21.15.72:0/137811368 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6240bafe0 con 0x7fb624151980 2023-07-25T14:35:54.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.197+0000 7fb619ffb700 1 -- 172.21.15.72:0/137811368 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb61c004280 con 0x7fb624151980 2023-07-25T14:35:54.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.198+0000 7fb62b867700 1 -- 172.21.15.72:0/137811368 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6240bb5a0 con 0x7fb624151980 2023-07-25T14:35:54.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.198+0000 7fb62b867700 1 -- 172.21.15.72:0/137811368 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6240bc000 con 0x7fb624151980 2023-07-25T14:35:54.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.199+0000 7fb619ffb700 1 -- 172.21.15.72:0/137811368 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb61c0043e0 con 0x7fb624151980 2023-07-25T14:35:54.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.199+0000 7fb619ffb700 1 --2- 172.21.15.72:0/137811368 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fb60806ace0 0x7fb60806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:54.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.199+0000 7fb619ffb700 1 -- 172.21.15.72:0/137811368 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fb61c022070 con 0x7fb624151980 2023-07-25T14:35:54.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.199+0000 7fb629603700 1 --2- 172.21.15.72:0/137811368 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fb60806ace0 0x7fb60806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:54.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.200+0000 7fb629603700 1 --2- 172.21.15.72:0/137811368 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fb60806ace0 0x7fb60806d1a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb620004c90 tx=0x7fb620009400 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:35:54.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.204+0000 7fb619ffb700 1 -- 172.21.15.72:0/137811368 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fb61c0561d0 con 0x7fb624151980 2023-07-25T14:35:54.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.405+0000 7fb62b867700 1 -- 172.21.15.72:0/137811368 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fb624074270 con 0x7fb624151980 2023-07-25T14:35:54.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.405+0000 7fb619ffb700 1 -- 172.21.15.72:0/137811368 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) v1 ==== 80+0+0 (secure 0 0 0) 0x7fb61c0597f0 con 0x7fb624151980 2023-07-25T14:35:54.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.407+0000 7fb62b867700 1 -- 172.21.15.72:0/137811368 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fb60806ace0 msgr2=0x7fb60806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:54.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.407+0000 7fb62b867700 1 --2- 172.21.15.72:0/137811368 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fb60806ace0 0x7fb60806d1a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb620004c90 tx=0x7fb620009400 comp rx=0 tx=0).stop 2023-07-25T14:35:54.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.407+0000 7fb62b867700 1 -- 172.21.15.72:0/137811368 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb624151980 msgr2=0x7fb6240bcd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:54.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.407+0000 7fb62b867700 1 --2- 172.21.15.72:0/137811368 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb624151980 0x7fb6240bcd80 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fb61c014040 tx=0x7fb61c004ad0 comp rx=0 tx=0).stop 2023-07-25T14:35:54.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.407+0000 7fb62b867700 1 -- 172.21.15.72:0/137811368 shutdown_connections 2023-07-25T14:35:54.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.407+0000 7fb62b867700 1 --2- 172.21.15.72:0/137811368 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fb60806ace0 0x7fb60806d1a0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:54.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.407+0000 7fb62b867700 1 --2- 172.21.15.72:0/137811368 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb624151980 0x7fb6240bcd80 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:54.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.407+0000 7fb62b867700 1 --2- 172.21.15.72:0/137811368 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb62406e580 0x7fb6241e9b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:54.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.407+0000 7fb62b867700 1 --2- 172.21.15.72:0/137811368 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb62406f9b0 0x7fb6240bbac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:54.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.407+0000 7fb62b867700 1 -- 172.21.15.72:0/137811368 >> 172.21.15.72:0/137811368 conn(0x7fb6240a8520 msgr2=0x7fb6240a8900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:35:54.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.407+0000 7fb62b867700 1 -- 172.21.15.72:0/137811368 shutdown_connections 2023-07-25T14:35:54.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.407+0000 7fb62b867700 1 -- 172.21.15.72:0/137811368 wait complete. 2023-07-25T14:35:54.423 INFO:teuthology.orchestra.run.smithi072.stderr:listed 0 entries 2023-07-25T14:35:54.431 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-07-25T14:35:54.431 DEBUG:teuthology.orchestra.run.smithi072:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-25T14:35:54.448 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-25T14:35:54.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.595+0000 7fa5a8af8700 1 Processor -- start 2023-07-25T14:35:54.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.595+0000 7fa5a8af8700 1 -- start start 2023-07-25T14:35:54.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.596+0000 7fa5a8af8700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fa5a406ea10 0x7fa5a4151c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:54.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.596+0000 7fa5a8af8700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5a4152190 con 0x7fa5a40a7490 2023-07-25T14:35:54.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.596+0000 7fa5a8af8700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5a40ac350 con 0x7fa5a406b510 2023-07-25T14:35:54.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.596+0000 7fa5a8af8700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5a40c1670 con 0x7fa5a406ea10 2023-07-25T14:35:54.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.596+0000 7fa5a2d9d700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fa5a40a7490 0x7fa5a40a7940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:58696/0 (socket says 172.21.15.72:58696) 2023-07-25T14:35:54.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.596+0000 7fa5a2d9d700 1 -- 172.21.15.72:0/4085423012 learned_addr learned my addr 172.21.15.72:0/4085423012 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:35:54.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.597+0000 7fa5a1d9b700 1 --2- 172.21.15.72:0/4085423012 >> v2:172.21.15.92:3300/0 conn(0x7fa5a406ea10 0x7fa5a4151c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:54.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.597+0000 7fa5a159a700 1 -- 172.21.15.72:0/4085423012 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 520069533 0 0) 0x7fa59c001490 con 0x7fa5a40a7490 2023-07-25T14:35:54.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.597+0000 7fa5a159a700 1 -- 172.21.15.72:0/4085423012 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa58c0035b0 con 0x7fa5a40a7490 2023-07-25T14:35:54.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.597+0000 7fa5a159a700 1 -- 172.21.15.72:0/4085423012 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3420139124 0 0) 0x7fa58c0035b0 con 0x7fa5a40a7490 2023-07-25T14:35:54.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.597+0000 7fa5a159a700 1 -- 172.21.15.72:0/4085423012 >> v2:172.21.15.92:3300/0 conn(0x7fa5a406ea10 msgr2=0x7fa5a4151c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:35:54.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.597+0000 7fa5a159a700 1 --2- 172.21.15.72:0/4085423012 >> v2:172.21.15.92:3300/0 conn(0x7fa5a406ea10 0x7fa5a4151c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:54.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.597+0000 7fa5a159a700 1 -- 172.21.15.72:0/4085423012 >> v1:172.21.15.92:6789/0 conn(0x7fa5a406b510 legacy=0x7fa5a414e5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:54.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.597+0000 7fa5a159a700 1 -- 172.21.15.72:0/4085423012 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5a4066480 con 0x7fa5a40a7490 2023-07-25T14:35:54.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.597+0000 7fa5a159a700 1 -- 172.21.15.72:0/4085423012 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2559588315 0 0) 0x7fa59c001b80 con 0x7fa5a40a7490 2023-07-25T14:35:54.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.597+0000 7fa5a159a700 1 -- 172.21.15.72:0/4085423012 >> v1:172.21.15.72:6789/0 conn(0x7fa5a40a7490 legacy=0x7fa5a40a7940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:54.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.597+0000 7fa5a159a700 1 --2- 172.21.15.72:0/4085423012 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa58c003a00 0x7fa58c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:54.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.597+0000 7fa5a159a700 1 --2- 172.21.15.72:0/4085423012 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa58c004400 0x7fa58c0048d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:54.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.597+0000 7fa5a159a700 1 --2- 172.21.15.72:0/4085423012 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa58c005170 0x7fa58c00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:54.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.597+0000 7fa5a159a700 1 -- 172.21.15.72:0/4085423012 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5a40c1670 con 0x7fa58c004400 2023-07-25T14:35:54.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.597+0000 7fa5a159a700 1 -- 172.21.15.72:0/4085423012 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa58c00c0b0 con 0x7fa58c003a00 2023-07-25T14:35:54.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.597+0000 7fa5a159a700 1 -- 172.21.15.72:0/4085423012 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa58c00c270 con 0x7fa58c005170 2023-07-25T14:35:54.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.597+0000 7fa5a1d9b700 1 --2- 172.21.15.72:0/4085423012 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa58c004400 0x7fa58c0048d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:54.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.597+0000 7fa5a2d9d700 1 --2- 172.21.15.72:0/4085423012 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa58c005170 0x7fa58c00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:54.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.597+0000 7fa5a259c700 1 --2- 172.21.15.72:0/4085423012 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa58c003a00 0x7fa58c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:54.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.597+0000 7fa5a1d9b700 1 -- 172.21.15.72:0/4085423012 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa58c005170 msgr2=0x7fa58c00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:35:54.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.597+0000 7fa5a1d9b700 1 --2- 172.21.15.72:0/4085423012 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa58c005170 0x7fa58c00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:54.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.597+0000 7fa5a1d9b700 1 -- 172.21.15.72:0/4085423012 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa58c003a00 msgr2=0x7fa58c003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:35:54.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.597+0000 7fa5a1d9b700 1 --2- 172.21.15.72:0/4085423012 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa58c003a00 0x7fa58c003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:54.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.597+0000 7fa5a2d9d700 1 -- 172.21.15.72:0/4085423012 reap_dead start 2023-07-25T14:35:54.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.597+0000 7fa5a1d9b700 1 -- 172.21.15.72:0/4085423012 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa58c0035b0 con 0x7fa58c004400 2023-07-25T14:35:54.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.598+0000 7fa5a1d9b700 1 --2- 172.21.15.72:0/4085423012 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa58c004400 0x7fa58c0048d0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fa594009b60 tx=0x7fa58c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b04023cdc4f4097 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:35:54.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.598+0000 7fa5a159a700 1 -- 172.21.15.72:0/4085423012 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa59400e6c0 con 0x7fa58c004400 2023-07-25T14:35:54.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.598+0000 7fa5a159a700 1 -- 172.21.15.72:0/4085423012 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa59400e820 con 0x7fa58c004400 2023-07-25T14:35:54.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.598+0000 7fa5a159a700 1 -- 172.21.15.72:0/4085423012 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa59400eb90 con 0x7fa58c004400 2023-07-25T14:35:54.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.598+0000 7fa5a8af8700 1 -- 172.21.15.72:0/4085423012 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa58c004400 msgr2=0x7fa58c0048d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:54.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.598+0000 7fa5a8af8700 1 --2- 172.21.15.72:0/4085423012 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa58c004400 0x7fa58c0048d0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fa594009b60 tx=0x7fa58c005880 comp rx=0 tx=0).stop 2023-07-25T14:35:54.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.598+0000 7fa5a8af8700 1 -- 172.21.15.72:0/4085423012 shutdown_connections 2023-07-25T14:35:54.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.598+0000 7fa5a8af8700 1 --2- 172.21.15.72:0/4085423012 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa58c004400 0x7fa58c0048d0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:54.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.598+0000 7fa5a8af8700 1 -- 172.21.15.72:0/4085423012 >> 172.21.15.72:0/4085423012 conn(0x7fa5a406def0 msgr2=0x7fa5a406e300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:35:54.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.598+0000 7fa5a8af8700 1 -- 172.21.15.72:0/4085423012 shutdown_connections 2023-07-25T14:35:54.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.598+0000 7fa5a8af8700 1 -- 172.21.15.72:0/4085423012 wait complete. 2023-07-25T14:35:54.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.600+0000 7fa5a8af8700 1 Processor -- start 2023-07-25T14:35:54.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.600+0000 7fa5a8af8700 1 -- start start 2023-07-25T14:35:54.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.600+0000 7fa5a8af8700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa58c004400 0x7fa5a414f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:54.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.600+0000 7fa5a8af8700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa5a40c5ca0 0x7fa5a40bf840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:54.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.600+0000 7fa5a8af8700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa5a4146630 0x7fa5a41456b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:54.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.600+0000 7fa5a8af8700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5a41ea300 con 0x7fa5a40c5ca0 2023-07-25T14:35:54.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.600+0000 7fa5a8af8700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5a4144bd0 con 0x7fa58c004400 2023-07-25T14:35:54.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.600+0000 7fa5a8af8700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5a4144eb0 con 0x7fa5a4146630 2023-07-25T14:35:54.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.600+0000 7fa5a1d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa5a40c5ca0 0x7fa5a40bf840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:54.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.601+0000 7fa5a1d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa5a40c5ca0 0x7fa5a40bf840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:39738/0 (socket says 172.21.15.72:39738) 2023-07-25T14:35:54.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.601+0000 7fa5a259c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa58c004400 0x7fa5a414f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:54.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.601+0000 7fa5a1d9b700 1 -- 172.21.15.72:0/935596539 learned_addr learned my addr 172.21.15.72:0/935596539 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:35:54.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.601+0000 7fa5a2d9d700 1 --2- 172.21.15.72:0/935596539 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa5a4146630 0x7fa5a41456b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:54.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.601+0000 7fa5a1d9b700 1 -- 172.21.15.72:0/935596539 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa5a4146630 msgr2=0x7fa5a41456b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:54.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.601+0000 7fa5a1d9b700 1 --2- 172.21.15.72:0/935596539 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa5a4146630 0x7fa5a41456b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:54.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.601+0000 7fa5a1d9b700 1 -- 172.21.15.72:0/935596539 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa58c004400 msgr2=0x7fa5a414f2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:54.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.601+0000 7fa5a1d9b700 1 --2- 172.21.15.72:0/935596539 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa58c004400 0x7fa5a414f2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:54.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.601+0000 7fa5a1d9b700 1 -- 172.21.15.72:0/935596539 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5a4145190 con 0x7fa5a40c5ca0 2023-07-25T14:35:54.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.601+0000 7fa5a1d9b700 1 --2- 172.21.15.72:0/935596539 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa5a40c5ca0 0x7fa5a40bf840 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fa58c00c080 tx=0x7fa5940047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:35:54.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.601+0000 7fa592ffd700 1 -- 172.21.15.72:0/935596539 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa59400e6c0 con 0x7fa5a40c5ca0 2023-07-25T14:35:54.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.601+0000 7fa592ffd700 1 -- 172.21.15.72:0/935596539 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5940038c0 con 0x7fa5a40c5ca0 2023-07-25T14:35:54.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.601+0000 7fa5a8af8700 1 -- 172.21.15.72:0/935596539 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5a41ea300 con 0x7fa5a40c5ca0 2023-07-25T14:35:54.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.601+0000 7fa592ffd700 1 -- 172.21.15.72:0/935596539 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa594003c70 con 0x7fa5a40c5ca0 2023-07-25T14:35:54.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.601+0000 7fa5a8af8700 1 -- 172.21.15.72:0/935596539 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5a41e9fd0 con 0x7fa5a40c5ca0 2023-07-25T14:35:54.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.602+0000 7fa5a8af8700 1 -- 172.21.15.72:0/935596539 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5a4144a30 con 0x7fa5a40c5ca0 2023-07-25T14:35:54.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.602+0000 7fa592ffd700 1 -- 172.21.15.72:0/935596539 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa594013470 con 0x7fa5a40c5ca0 2023-07-25T14:35:54.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.603+0000 7fa592ffd700 1 --2- 172.21.15.72:0/935596539 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fa58406ace0 0x7fa58406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:54.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.603+0000 7fa592ffd700 1 -- 172.21.15.72:0/935596539 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fa59408b000 con 0x7fa5a40c5ca0 2023-07-25T14:35:54.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.603+0000 7fa5a259c700 1 --2- 172.21.15.72:0/935596539 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fa58406ace0 0x7fa58406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:54.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.603+0000 7fa5a259c700 1 --2- 172.21.15.72:0/935596539 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fa58406ace0 0x7fa58406d1a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa5980010e0 tx=0x7fa598009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:35:54.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.607+0000 7fa592ffd700 1 -- 172.21.15.72:0/935596539 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fa5a4144a30 con 0x7fa5a40c5ca0 2023-07-25T14:35:54.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.797+0000 7fa5a8af8700 1 -- 172.21.15.72:0/935596539 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa5a4144a30 con 0x7fa5a40c5ca0 2023-07-25T14:35:54.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.798+0000 7fa592ffd700 1 -- 172.21.15.72:0/935596539 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+20014 (secure 0 0 0) 0x7fa5a4144a30 con 0x7fa5a40c5ca0 2023-07-25T14:35:54.810 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-25T14:35:54.810 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":25,"fsid":"9170db48-9170-43e8-8ccb-9813e6240906","created":"2023-07-25T14:35:21.733262+0000","modified":"2023-07-25T14:35:44.992669+0000","last_up_change":"2023-07-25T14:35:31.355010+0000","last_in_change":"2023-07-25T14:35:24.195785+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-25T14:35:32.983457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-25T14:35:33.326342+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-25T14:35:37.534158+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-25T14:35:38.891571+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-25T14:35:42.596923+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d517fdad-0bfe-49f0-89f2-9421c3761839","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6801","nonce":2475407414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6803","nonce":2475407414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6807","nonce":2475407414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6805","nonce":2475407414}]},"public_addr":"172.21.15.72:6801/2475407414","cluster_addr":"172.21.15.72:6803/2475407414","heartbeat_back_addr":"172.21.15.72:6807/2475407414","heartbeat_front_addr":"172.21.15.72:6805/2475407414","state":["exists","up"]},{"osd":1,"uuid":"e1564be3-f209-47e5-a8d0-32fc618a474f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6822","nonce":870954016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6825","nonce":870954016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6831","nonce":870954016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6827","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6829","nonce":870954016}]},"public_addr":"172.21.15.72:6822/870954016","cluster_addr":"172.21.15.72:6825/870954016","heartbeat_back_addr":"172.21.15.72:6831/870954016","heartbeat_front_addr":"172.21.15.72:6829/870954016","state":["exists","up"]},{"osd":2,"uuid":"c4647d30-ffa6-417a-9026-ef530c75910e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6809","nonce":2143129442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6811","nonce":2143129442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6815","nonce":2143129442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6813","nonce":2143129442}]},"public_addr":"172.21.15.72:6809/2143129442","cluster_addr":"172.21.15.72:6811/2143129442","heartbeat_back_addr":"172.21.15.72:6815/2143129442","heartbeat_front_addr":"172.21.15.72:6813/2143129442","state":["exists","up"]},{"osd":3,"uuid":"76c9d9a7-c2e2-4612-a58b-d6882dd76b58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6817","nonce":3404066311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6819","nonce":3404066311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6828","nonce":3404066311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6821","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6823","nonce":3404066311}]},"public_addr":"172.21.15.72:6817/3404066311","cluster_addr":"172.21.15.72:6819/3404066311","heartbeat_back_addr":"172.21.15.72:6828/3404066311","heartbeat_front_addr":"172.21.15.72:6823/3404066311","state":["exists","up"]},{"osd":4,"uuid":"7f8920dc-0ad4-4a73-ab40-65408f83eadd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6817","nonce":2381008739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6819","nonce":2381008739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6825","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6827","nonce":2381008739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6822","nonce":2381008739}]},"public_addr":"172.21.15.92:6817/2381008739","cluster_addr":"172.21.15.92:6819/2381008739","heartbeat_back_addr":"172.21.15.92:6827/2381008739","heartbeat_front_addr":"172.21.15.92:6822/2381008739","state":["exists","up"]},{"osd":5,"uuid":"56257e7c-31eb-44c5-9ec7-1318a4e0bb35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6801","nonce":2161935604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6803","nonce":2161935604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6807","nonce":2161935604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6805","nonce":2161935604}]},"public_addr":"172.21.15.92:6801/2161935604","cluster_addr":"172.21.15.92:6803/2161935604","heartbeat_back_addr":"172.21.15.92:6807/2161935604","heartbeat_front_addr":"172.21.15.92:6805/2161935604","state":["exists","up"]},{"osd":6,"uuid":"a150d3d8-a0c9-4955-968a-8d98eff4ffb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6809","nonce":3770163493}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6811","nonce":3770163493}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6815","nonce":3770163493}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6813","nonce":3770163493}]},"public_addr":"172.21.15.92:6809/3770163493","cluster_addr":"172.21.15.92:6811/3770163493","heartbeat_back_addr":"172.21.15.92:6815/3770163493","heartbeat_front_addr":"172.21.15.92:6813/3770163493","state":["exists","up"]},{"osd":7,"uuid":"07799c27-54ee-4591-a42d-a978d6b32065","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6821","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6823","nonce":2135777609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6826","nonce":2135777609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6831","nonce":2135777609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6829","nonce":2135777609}]},"public_addr":"172.21.15.92:6823/2135777609","cluster_addr":"172.21.15.92:6826/2135777609","heartbeat_back_addr":"172.21.15.92:6831/2135777609","heartbeat_front_addr":"172.21.15.92:6829/2135777609","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.345365+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.378150+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.146566+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.372172+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:30.398421+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.385632+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.465611+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.443583+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-25T14:35:54.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.800+0000 7fa5a8af8700 1 -- 172.21.15.72:0/935596539 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fa58406ace0 msgr2=0x7fa58406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:54.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.800+0000 7fa5a8af8700 1 --2- 172.21.15.72:0/935596539 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fa58406ace0 0x7fa58406d1a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa5980010e0 tx=0x7fa598009040 comp rx=0 tx=0).stop 2023-07-25T14:35:54.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.800+0000 7fa5a8af8700 1 -- 172.21.15.72:0/935596539 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa5a40c5ca0 msgr2=0x7fa5a40bf840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:54.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.800+0000 7fa5a8af8700 1 --2- 172.21.15.72:0/935596539 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa5a40c5ca0 0x7fa5a40bf840 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fa58c00c080 tx=0x7fa5940047c0 comp rx=0 tx=0).stop 2023-07-25T14:35:54.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.800+0000 7fa5a8af8700 1 -- 172.21.15.72:0/935596539 shutdown_connections 2023-07-25T14:35:54.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.800+0000 7fa5a8af8700 1 --2- 172.21.15.72:0/935596539 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fa58406ace0 0x7fa58406d1a0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:54.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.800+0000 7fa5a8af8700 1 --2- 172.21.15.72:0/935596539 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa5a4146630 0x7fa5a41456b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:54.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.800+0000 7fa5a8af8700 1 --2- 172.21.15.72:0/935596539 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa58c004400 0x7fa5a414f2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:54.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.800+0000 7fa5a8af8700 1 --2- 172.21.15.72:0/935596539 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa5a40c5ca0 0x7fa5a40bf840 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:54.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.800+0000 7fa5a8af8700 1 -- 172.21.15.72:0/935596539 >> 172.21.15.72:0/935596539 conn(0x7fa5a406def0 msgr2=0x7fa5a414e3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:35:54.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.800+0000 7fa5a8af8700 1 -- 172.21.15.72:0/935596539 shutdown_connections 2023-07-25T14:35:54.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.800+0000 7fa5a8af8700 1 -- 172.21.15.72:0/935596539 wait complete. 2023-07-25T14:35:54.823 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-07-25T14:35:32.983457+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-07-25T14:35:33.326342+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-25T14:35:37.534158+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-25T14:35:38.891571+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-07-25T14:35:42.596923+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-25T14:35:54.824 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-25T14:35:54.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.936+0000 7f59c136a700 1 Processor -- start 2023-07-25T14:35:54.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.936+0000 7f59c136a700 1 -- start start 2023-07-25T14:35:54.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.937+0000 7f59c136a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f59bc151a90 0x7f59bc154d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:54.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.937+0000 7f59c136a700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f59bc0c44d0 0x7f59bc0c4900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:54.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.937+0000 7f59c136a700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59bc0bfeb0 con 0x7f59bc0bead0 2023-07-25T14:35:54.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.937+0000 7f59c136a700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59bc0c10b0 con 0x7f59bc151a90 2023-07-25T14:35:54.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.937+0000 7f59c136a700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59bc0c1940 con 0x7f59bc0c44d0 2023-07-25T14:35:54.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.937+0000 7f59baffd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f59bc151a90 0x7f59bc154d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:54.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.937+0000 7f59baffd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f59bc151a90 0x7f59bc154d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:39744/0 (socket says 172.21.15.72:39744) 2023-07-25T14:35:54.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.937+0000 7f59baffd700 1 -- 172.21.15.72:0/805774664 learned_addr learned my addr 172.21.15.72:0/805774664 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:35:54.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.937+0000 7f59ba7fc700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f59bc0bead0 0x7f59bc0c0350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:58712/0 (socket says 172.21.15.72:58712) 2023-07-25T14:35:54.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.937+0000 7f59bb7fe700 1 --2- 172.21.15.72:0/805774664 >> v2:172.21.15.92:3300/0 conn(0x7f59bc0c44d0 0x7f59bc0c4900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:54.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.937+0000 7f59baffd700 1 -- 172.21.15.72:0/805774664 >> v2:172.21.15.92:3300/0 conn(0x7f59bc0c44d0 msgr2=0x7f59bc0c4900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:35:54.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.937+0000 7f59baffd700 1 --2- 172.21.15.72:0/805774664 >> v2:172.21.15.92:3300/0 conn(0x7f59bc0c44d0 0x7f59bc0c4900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:54.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.937+0000 7f59baffd700 1 -- 172.21.15.72:0/805774664 >> v1:172.21.15.72:6789/0 conn(0x7f59bc0bead0 legacy=0x7f59bc0c0350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:54.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.937+0000 7f59baffd700 1 -- 172.21.15.72:0/805774664 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59bc0bf2e0 con 0x7f59bc151a90 2023-07-25T14:35:54.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.937+0000 7f59b9ffb700 1 -- 172.21.15.72:0/805774664 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3411313686 0 0) 0x7f59bc0bfeb0 con 0x7f59bc0bead0 2023-07-25T14:35:54.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.937+0000 7f59bb7fe700 1 --2- 172.21.15.72:0/805774664 >> v2:172.21.15.92:3300/0 conn(0x7f59bc0c44d0 0x7f59bc0c4900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-25T14:35:54.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.938+0000 7f59baffd700 1 --2- 172.21.15.72:0/805774664 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f59bc151a90 0x7f59bc154d10 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f59bc06d3e0 tx=0x7f59b0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=801b8a699fcc4df2 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:35:54.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.938+0000 7f59b9ffb700 1 -- 172.21.15.72:0/805774664 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59b000b870 con 0x7f59bc151a90 2023-07-25T14:35:54.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.938+0000 7f59b9ffb700 1 -- 172.21.15.72:0/805774664 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59b000b9d0 con 0x7f59bc151a90 2023-07-25T14:35:54.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.938+0000 7f59b9ffb700 1 -- 172.21.15.72:0/805774664 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59b000bd60 con 0x7f59bc151a90 2023-07-25T14:35:54.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.938+0000 7f59c136a700 1 -- 172.21.15.72:0/805774664 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f59bc151a90 msgr2=0x7f59bc154d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:54.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.938+0000 7f59c136a700 1 --2- 172.21.15.72:0/805774664 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f59bc151a90 0x7f59bc154d10 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f59bc06d3e0 tx=0x7f59b0009bd0 comp rx=0 tx=0).stop 2023-07-25T14:35:54.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.938+0000 7f59c136a700 1 -- 172.21.15.72:0/805774664 shutdown_connections 2023-07-25T14:35:54.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.938+0000 7f59c136a700 1 --2- 172.21.15.72:0/805774664 >> v2:172.21.15.92:3300/0 conn(0x7f59bc0c44d0 0x7f59bc0c4900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:54.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.938+0000 7f59c136a700 1 --2- 172.21.15.72:0/805774664 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f59bc151a90 0x7f59bc154d10 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:54.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.938+0000 7f59c136a700 1 -- 172.21.15.72:0/805774664 >> 172.21.15.72:0/805774664 conn(0x7f59bc06c3a0 msgr2=0x7f59bc06c780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:35:54.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.938+0000 7f59c136a700 1 -- 172.21.15.72:0/805774664 shutdown_connections 2023-07-25T14:35:54.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.938+0000 7f59c136a700 1 -- 172.21.15.72:0/805774664 wait complete. 2023-07-25T14:35:54.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.940+0000 7f59c136a700 1 Processor -- start 2023-07-25T14:35:54.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.940+0000 7f59c136a700 1 -- start start 2023-07-25T14:35:54.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.940+0000 7f59c136a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f59bc0bead0 0x7f59bc0c9380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:54.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.940+0000 7f59c136a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f59bc0c44d0 0x7f59bc1560d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:54.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.940+0000 7f59c136a700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f59bc151a90 0x7f59bc150910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:54.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.940+0000 7f59c136a700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59bc1e9ef0 con 0x7f59bc0bead0 2023-07-25T14:35:54.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.940+0000 7f59c136a700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59bc0c98c0 con 0x7f59bc0c44d0 2023-07-25T14:35:54.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.940+0000 7f59c136a700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59bc156610 con 0x7f59bc151a90 2023-07-25T14:35:54.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.940+0000 7f59baffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f59bc0bead0 0x7f59bc0c9380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:54.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.940+0000 7f59baffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f59bc0bead0 0x7f59bc0c9380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:39750/0 (socket says 172.21.15.72:39750) 2023-07-25T14:35:54.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.940+0000 7f59baffd700 1 -- 172.21.15.72:0/208529246 learned_addr learned my addr 172.21.15.72:0/208529246 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:35:54.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.940+0000 7f59ba7fc700 1 --2- 172.21.15.72:0/208529246 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f59bc0c44d0 0x7f59bc1560d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:54.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.941+0000 7f59bb7fe700 1 --2- 172.21.15.72:0/208529246 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f59bc151a90 0x7f59bc150910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:54.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.941+0000 7f59baffd700 1 -- 172.21.15.72:0/208529246 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f59bc151a90 msgr2=0x7f59bc150910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:54.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.941+0000 7f59baffd700 1 --2- 172.21.15.72:0/208529246 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f59bc151a90 0x7f59bc150910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:54.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.941+0000 7f59baffd700 1 -- 172.21.15.72:0/208529246 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f59bc0c44d0 msgr2=0x7f59bc1560d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:54.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.941+0000 7f59baffd700 1 --2- 172.21.15.72:0/208529246 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f59bc0c44d0 0x7f59bc1560d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:54.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.941+0000 7f59baffd700 1 -- 172.21.15.72:0/208529246 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59b0009550 con 0x7f59bc0bead0 2023-07-25T14:35:54.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.941+0000 7f59ba7fc700 1 --2- 172.21.15.72:0/208529246 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f59bc0c44d0 0x7f59bc1560d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-25T14:35:54.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.941+0000 7f59baffd700 1 --2- 172.21.15.72:0/208529246 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f59bc0bead0 0x7f59bc0c9380 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f59bc06d1b0 tx=0x7f59b0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:35:54.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.941+0000 7f59a37fe700 1 -- 172.21.15.72:0/208529246 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59b0012940 con 0x7f59bc0bead0 2023-07-25T14:35:54.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.941+0000 7f59a37fe700 1 -- 172.21.15.72:0/208529246 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59b001e070 con 0x7f59bc0bead0 2023-07-25T14:35:54.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.941+0000 7f59a37fe700 1 -- 172.21.15.72:0/208529246 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59b0012cc0 con 0x7f59bc0bead0 2023-07-25T14:35:54.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.941+0000 7f59c136a700 1 -- 172.21.15.72:0/208529246 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59bc1587b0 con 0x7f59bc0bead0 2023-07-25T14:35:54.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.941+0000 7f59c136a700 1 -- 172.21.15.72:0/208529246 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59bc0ca790 con 0x7f59bc0bead0 2023-07-25T14:35:54.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.942+0000 7f59c136a700 1 -- 172.21.15.72:0/208529246 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59bc0ca980 con 0x7f59bc0bead0 2023-07-25T14:35:54.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.942+0000 7f59a37fe700 1 -- 172.21.15.72:0/208529246 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f59b001a420 con 0x7f59bc0bead0 2023-07-25T14:35:54.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.943+0000 7f59a37fe700 1 --2- 172.21.15.72:0/208529246 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f59a806ace0 0x7f59a806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:54.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.943+0000 7f59a37fe700 1 -- 172.21.15.72:0/208529246 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f59b008a930 con 0x7f59bc0bead0 2023-07-25T14:35:54.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.943+0000 7f59ba7fc700 1 --2- 172.21.15.72:0/208529246 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f59a806ace0 0x7f59a806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:54.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.943+0000 7f59ba7fc700 1 --2- 172.21.15.72:0/208529246 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f59a806ace0 0x7f59a806d1a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f59ac000f60 tx=0x7f59ac007ca0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:35:54.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:54.947+0000 7f59a37fe700 1 -- 172.21.15.72:0/208529246 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f59b00556e0 con 0x7f59bc0bead0 2023-07-25T14:35:55.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.135+0000 7f59c136a700 1 -- 172.21.15.72:0/208529246 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f59bc04e470 con 0x7f59bc0bead0 2023-07-25T14:35:55.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.135+0000 7f59a37fe700 1 -- 172.21.15.72:0/208529246 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7f59b0058d00 con 0x7f59bc0bead0 2023-07-25T14:35:55.147 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 8 2023-07-25T14:35:55.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.137+0000 7f59c136a700 1 -- 172.21.15.72:0/208529246 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f59a806ace0 msgr2=0x7f59a806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:55.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.137+0000 7f59c136a700 1 --2- 172.21.15.72:0/208529246 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f59a806ace0 0x7f59a806d1a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f59ac000f60 tx=0x7f59ac007ca0 comp rx=0 tx=0).stop 2023-07-25T14:35:55.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.137+0000 7f59c136a700 1 -- 172.21.15.72:0/208529246 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f59bc0bead0 msgr2=0x7f59bc0c9380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:55.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.137+0000 7f59c136a700 1 --2- 172.21.15.72:0/208529246 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f59bc0bead0 0x7f59bc0c9380 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f59bc06d1b0 tx=0x7f59b0004750 comp rx=0 tx=0).stop 2023-07-25T14:35:55.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.138+0000 7f59c136a700 1 -- 172.21.15.72:0/208529246 shutdown_connections 2023-07-25T14:35:55.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.138+0000 7f59c136a700 1 --2- 172.21.15.72:0/208529246 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f59a806ace0 0x7f59a806d1a0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:55.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.138+0000 7f59c136a700 1 --2- 172.21.15.72:0/208529246 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f59bc151a90 0x7f59bc150910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:55.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.138+0000 7f59c136a700 1 --2- 172.21.15.72:0/208529246 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f59bc0bead0 0x7f59bc0c9380 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:55.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.138+0000 7f59c136a700 1 --2- 172.21.15.72:0/208529246 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f59bc0c44d0 0x7f59bc1560d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:55.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.138+0000 7f59c136a700 1 -- 172.21.15.72:0/208529246 >> 172.21.15.72:0/208529246 conn(0x7f59bc06c3a0 msgr2=0x7f59bc06c780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:35:55.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.138+0000 7f59c136a700 1 -- 172.21.15.72:0/208529246 shutdown_connections 2023-07-25T14:35:55.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.138+0000 7f59c136a700 1 -- 172.21.15.72:0/208529246 wait complete. 2023-07-25T14:35:55.161 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-25T14:35:55.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.272+0000 7fa575705700 1 Processor -- start 2023-07-25T14:35:55.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.272+0000 7fa575705700 1 -- start start 2023-07-25T14:35:55.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.273+0000 7fa575705700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa57014f810 0x7fa5700c4370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:55.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.273+0000 7fa575705700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa5700bb0b0 0x7fa570152cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:55.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.273+0000 7fa575705700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5700c5890 con 0x7fa5700a9cc0 2023-07-25T14:35:55.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.273+0000 7fa575705700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa570152150 con 0x7fa57014f810 2023-07-25T14:35:55.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.273+0000 7fa575705700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa57014fbf0 con 0x7fa5700bb0b0 2023-07-25T14:35:55.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.273+0000 7fa56effd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa57014f810 0x7fa5700c4370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:55.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.273+0000 7fa56e7fc700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fa5700a9cc0 0x7fa5701525e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:58726/0 (socket says 172.21.15.72:58726) 2023-07-25T14:35:55.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.273+0000 7fa56e7fc700 1 -- 172.21.15.72:0/4065392036 learned_addr learned my addr 172.21.15.72:0/4065392036 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:35:55.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.273+0000 7fa56f7fe700 1 --2- 172.21.15.72:0/4065392036 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa5700bb0b0 0x7fa570152cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:55.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.273+0000 7fa56effd700 1 -- 172.21.15.72:0/4065392036 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa5700bb0b0 msgr2=0x7fa570152cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:35:55.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.273+0000 7fa56effd700 1 --2- 172.21.15.72:0/4065392036 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa5700bb0b0 0x7fa570152cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:55.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.273+0000 7fa56effd700 1 -- 172.21.15.72:0/4065392036 >> v1:172.21.15.72:6789/0 conn(0x7fa5700a9cc0 legacy=0x7fa5701525e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:55.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.273+0000 7fa56effd700 1 -- 172.21.15.72:0/4065392036 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5701566a0 con 0x7fa57014f810 2023-07-25T14:35:55.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.273+0000 7fa56dffb700 1 -- 172.21.15.72:0/4065392036 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3219915905 0 0) 0x7fa5700c5890 con 0x7fa5700a9cc0 2023-07-25T14:35:55.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.274+0000 7fa56effd700 1 --2- 172.21.15.72:0/4065392036 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa57014f810 0x7fa5700c4370 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fa564009840 tx=0x7fa564009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38f69e21aa35d98f server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:35:55.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.274+0000 7fa56dffb700 1 -- 172.21.15.72:0/4065392036 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa564011830 con 0x7fa57014f810 2023-07-25T14:35:55.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.274+0000 7fa56dffb700 1 -- 172.21.15.72:0/4065392036 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa564011990 con 0x7fa57014f810 2023-07-25T14:35:55.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.274+0000 7fa56dffb700 1 -- 172.21.15.72:0/4065392036 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa564011d20 con 0x7fa57014f810 2023-07-25T14:35:55.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.274+0000 7fa575705700 1 -- 172.21.15.72:0/4065392036 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa57014f810 msgr2=0x7fa5700c4370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:55.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.274+0000 7fa575705700 1 --2- 172.21.15.72:0/4065392036 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa57014f810 0x7fa5700c4370 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fa564009840 tx=0x7fa564009b50 comp rx=0 tx=0).stop 2023-07-25T14:35:55.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.274+0000 7fa575705700 1 -- 172.21.15.72:0/4065392036 shutdown_connections 2023-07-25T14:35:55.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.274+0000 7fa575705700 1 --2- 172.21.15.72:0/4065392036 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa5700bb0b0 0x7fa570152cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:55.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.274+0000 7fa575705700 1 --2- 172.21.15.72:0/4065392036 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa57014f810 0x7fa5700c4370 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:55.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.274+0000 7fa575705700 1 -- 172.21.15.72:0/4065392036 >> 172.21.15.72:0/4065392036 conn(0x7fa57006a8d0 msgr2=0x7fa5700a94e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:35:55.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.274+0000 7fa575705700 1 -- 172.21.15.72:0/4065392036 shutdown_connections 2023-07-25T14:35:55.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.274+0000 7fa575705700 1 -- 172.21.15.72:0/4065392036 wait complete. 2023-07-25T14:35:55.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.276+0000 7fa575705700 1 Processor -- start 2023-07-25T14:35:55.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.276+0000 7fa575705700 1 -- start start 2023-07-25T14:35:55.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.277+0000 7fa575705700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa5700a9cc0 0x7fa5700c0740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:55.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.277+0000 7fa575705700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa5700bb0b0 0x7fa5700aa5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:55.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.277+0000 7fa575705700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa57014f810 0x7fa5700aaaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:55.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.277+0000 7fa575705700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5700c1160 con 0x7fa5700a9cc0 2023-07-25T14:35:55.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.277+0000 7fa575705700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5700acfa0 con 0x7fa57014f810 2023-07-25T14:35:55.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.277+0000 7fa575705700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5700bb490 con 0x7fa5700bb0b0 2023-07-25T14:35:55.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.277+0000 7fa56effd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa5700a9cc0 0x7fa5700c0740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:55.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.277+0000 7fa56effd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa5700a9cc0 0x7fa5700c0740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:39764/0 (socket says 172.21.15.72:39764) 2023-07-25T14:35:55.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.277+0000 7fa56effd700 1 -- 172.21.15.72:0/2504093803 learned_addr learned my addr 172.21.15.72:0/2504093803 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:35:55.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.277+0000 7fa56f7fe700 1 --2- 172.21.15.72:0/2504093803 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa57014f810 0x7fa5700aaaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:55.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.277+0000 7fa56e7fc700 1 --2- 172.21.15.72:0/2504093803 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa5700bb0b0 0x7fa5700aa5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:55.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.277+0000 7fa56effd700 1 -- 172.21.15.72:0/2504093803 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa5700bb0b0 msgr2=0x7fa5700aa5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:55.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.277+0000 7fa56effd700 1 --2- 172.21.15.72:0/2504093803 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa5700bb0b0 0x7fa5700aa5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:55.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.277+0000 7fa56effd700 1 -- 172.21.15.72:0/2504093803 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa57014f810 msgr2=0x7fa5700aaaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:55.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.277+0000 7fa56effd700 1 --2- 172.21.15.72:0/2504093803 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa57014f810 0x7fa5700aaaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:55.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.277+0000 7fa56effd700 1 -- 172.21.15.72:0/2504093803 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5640094a0 con 0x7fa5700a9cc0 2023-07-25T14:35:55.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.277+0000 7fa56effd700 1 --2- 172.21.15.72:0/2504093803 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa5700a9cc0 0x7fa5700c0740 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fa564014040 tx=0x7fa564004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:35:55.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.277+0000 7fa5577fe700 1 -- 172.21.15.72:0/2504093803 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5640045f0 con 0x7fa5700a9cc0 2023-07-25T14:35:55.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.278+0000 7fa5577fe700 1 -- 172.21.15.72:0/2504093803 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa56401e070 con 0x7fa5700a9cc0 2023-07-25T14:35:55.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.278+0000 7fa575705700 1 -- 172.21.15.72:0/2504093803 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5700bb770 con 0x7fa5700a9cc0 2023-07-25T14:35:55.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.278+0000 7fa5577fe700 1 -- 172.21.15.72:0/2504093803 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa564003ae0 con 0x7fa5700a9cc0 2023-07-25T14:35:55.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.278+0000 7fa575705700 1 -- 172.21.15.72:0/2504093803 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5700bc110 con 0x7fa5700a9cc0 2023-07-25T14:35:55.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.279+0000 7fa575705700 1 -- 172.21.15.72:0/2504093803 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5700ad160 con 0x7fa5700a9cc0 2023-07-25T14:35:55.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.279+0000 7fa5577fe700 1 -- 172.21.15.72:0/2504093803 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa564003c40 con 0x7fa5700a9cc0 2023-07-25T14:35:55.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.279+0000 7fa5577fe700 1 --2- 172.21.15.72:0/2504093803 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fa55c06ace0 0x7fa55c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:55.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.279+0000 7fa5577fe700 1 -- 172.21.15.72:0/2504093803 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fa56408a7e0 con 0x7fa5700a9cc0 2023-07-25T14:35:55.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.279+0000 7fa56e7fc700 1 --2- 172.21.15.72:0/2504093803 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fa55c06ace0 0x7fa55c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:55.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.280+0000 7fa56e7fc700 1 --2- 172.21.15.72:0/2504093803 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fa55c06ace0 0x7fa55c06d1a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fa5701e8d30 tx=0x7fa560007be0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:35:55.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.284+0000 7fa5577fe700 1 -- 172.21.15.72:0/2504093803 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fa564055630 con 0x7fa5700a9cc0 2023-07-25T14:35:55.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.470+0000 7fa575705700 1 -- 172.21.15.72:0/2504093803 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa57004e470 con 0x7fa5700a9cc0 2023-07-25T14:35:55.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.470+0000 7fa5577fe700 1 -- 172.21.15.72:0/2504093803 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa564020020 con 0x7fa5700a9cc0 2023-07-25T14:35:55.482 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 1 2023-07-25T14:35:55.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.472+0000 7fa575705700 1 -- 172.21.15.72:0/2504093803 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fa55c06ace0 msgr2=0x7fa55c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:55.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.472+0000 7fa575705700 1 --2- 172.21.15.72:0/2504093803 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fa55c06ace0 0x7fa55c06d1a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fa5701e8d30 tx=0x7fa560007be0 comp rx=0 tx=0).stop 2023-07-25T14:35:55.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.472+0000 7fa575705700 1 -- 172.21.15.72:0/2504093803 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa5700a9cc0 msgr2=0x7fa5700c0740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:55.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.472+0000 7fa575705700 1 --2- 172.21.15.72:0/2504093803 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa5700a9cc0 0x7fa5700c0740 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fa564014040 tx=0x7fa564004750 comp rx=0 tx=0).stop 2023-07-25T14:35:55.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.472+0000 7fa575705700 1 -- 172.21.15.72:0/2504093803 shutdown_connections 2023-07-25T14:35:55.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.472+0000 7fa575705700 1 --2- 172.21.15.72:0/2504093803 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fa55c06ace0 0x7fa55c06d1a0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:55.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.472+0000 7fa575705700 1 --2- 172.21.15.72:0/2504093803 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa57014f810 0x7fa5700aaaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:55.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.472+0000 7fa575705700 1 --2- 172.21.15.72:0/2504093803 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa5700a9cc0 0x7fa5700c0740 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:55.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.472+0000 7fa575705700 1 --2- 172.21.15.72:0/2504093803 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa5700bb0b0 0x7fa5700aa5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:55.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.472+0000 7fa575705700 1 -- 172.21.15.72:0/2504093803 >> 172.21.15.72:0/2504093803 conn(0x7fa57006a8d0 msgr2=0x7fa5700c5e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:35:55.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.473+0000 7fa575705700 1 -- 172.21.15.72:0/2504093803 shutdown_connections 2023-07-25T14:35:55.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.473+0000 7fa575705700 1 -- 172.21.15.72:0/2504093803 wait complete. 2023-07-25T14:35:55.496 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-25T14:35:55.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.609+0000 7f454606a700 1 Processor -- start 2023-07-25T14:35:55.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.609+0000 7f454606a700 1 -- start start 2023-07-25T14:35:55.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.609+0000 7f454606a700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f45400724c0 0x7f45400c34c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:55.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.609+0000 7f454606a700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f45400c4930 0x7f45400c3a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:55.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.609+0000 7f454606a700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45400c2fe0 con 0x7f4540151950 2023-07-25T14:35:55.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.609+0000 7f454606a700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4540071a60 con 0x7f45400c4930 2023-07-25T14:35:55.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.609+0000 7f454606a700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45400c2a70 con 0x7f45400724c0 2023-07-25T14:35:55.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.610+0000 7f453ffff700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f45400c4930 0x7f45400c3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:55.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.610+0000 7f453effd700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f45400724c0 0x7f45400c34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:55.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.610+0000 7f453f7fe700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f4540151950 0x7f454006a190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.72:54082/0 (socket says 172.21.15.72:54082) 2023-07-25T14:35:55.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.610+0000 7f453f7fe700 1 -- 172.21.15.72:0/822408840 learned_addr learned my addr 172.21.15.72:0/822408840 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:35:55.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.610+0000 7f453ffff700 1 -- 172.21.15.72:0/822408840 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f45400724c0 msgr2=0x7f45400c34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:35:55.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.610+0000 7f453ffff700 1 --2- 172.21.15.72:0/822408840 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f45400724c0 0x7f45400c34c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:55.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.610+0000 7f453ffff700 1 -- 172.21.15.72:0/822408840 >> v1:172.21.15.92:6789/0 conn(0x7f4540151950 legacy=0x7f454006a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:55.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.610+0000 7f453ffff700 1 -- 172.21.15.72:0/822408840 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4540155070 con 0x7f45400c4930 2023-07-25T14:35:55.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.610+0000 7f453effd700 1 --2- 172.21.15.72:0/822408840 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f45400724c0 0x7f45400c34c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-25T14:35:55.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.610+0000 7f453ffff700 1 --2- 172.21.15.72:0/822408840 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f45400c4930 0x7f45400c3a00 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f4538009d90 tx=0x7f453800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ff0e7aab22f90fd6 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:35:55.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.610+0000 7f453e7fc700 1 -- 172.21.15.72:0/822408840 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f453800e070 con 0x7f45400c4930 2023-07-25T14:35:55.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.610+0000 7f453e7fc700 1 -- 172.21.15.72:0/822408840 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f453800bb20 con 0x7f45400c4930 2023-07-25T14:35:55.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.610+0000 7f453e7fc700 1 -- 172.21.15.72:0/822408840 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4538012430 con 0x7f45400c4930 2023-07-25T14:35:55.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.611+0000 7f454606a700 1 -- 172.21.15.72:0/822408840 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f45400c4930 msgr2=0x7f45400c3a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:55.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.611+0000 7f454606a700 1 --2- 172.21.15.72:0/822408840 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f45400c4930 0x7f45400c3a00 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f4538009d90 tx=0x7f453800b330 comp rx=0 tx=0).stop 2023-07-25T14:35:55.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.611+0000 7f454606a700 1 -- 172.21.15.72:0/822408840 shutdown_connections 2023-07-25T14:35:55.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.611+0000 7f454606a700 1 --2- 172.21.15.72:0/822408840 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f45400c4930 0x7f45400c3a00 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:55.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.611+0000 7f454606a700 1 --2- 172.21.15.72:0/822408840 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f45400724c0 0x7f45400c34c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:55.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.611+0000 7f454606a700 1 -- 172.21.15.72:0/822408840 >> 172.21.15.72:0/822408840 conn(0x7f45400a87e0 msgr2=0x7f45400a8bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:35:55.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.611+0000 7f454606a700 1 -- 172.21.15.72:0/822408840 shutdown_connections 2023-07-25T14:35:55.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.611+0000 7f454606a700 1 -- 172.21.15.72:0/822408840 wait complete. 2023-07-25T14:35:55.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.613+0000 7f454606a700 1 Processor -- start 2023-07-25T14:35:55.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.613+0000 7f454606a700 1 -- start start 2023-07-25T14:35:55.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.614+0000 7f454606a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f45400724c0 0x7f45401e9d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:55.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.614+0000 7f454606a700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f45400c4930 0x7f45401edd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:55.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.614+0000 7f454606a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4540151950 0x7f4540153950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:55.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.614+0000 7f454606a700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45400be7b0 con 0x7f4540151950 2023-07-25T14:35:55.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.614+0000 7f454606a700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45401ee250 con 0x7f45400724c0 2023-07-25T14:35:55.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.614+0000 7f454606a700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4540154460 con 0x7f45400c4930 2023-07-25T14:35:55.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.614+0000 7f453f7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f45400724c0 0x7f45401e9d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:55.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.614+0000 7f453effd700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f45400c4930 0x7f45401edd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:55.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.614+0000 7f453f7fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f45400724c0 0x7f45401e9d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.72:35350/0 (socket says 172.21.15.72:35350) 2023-07-25T14:35:55.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.614+0000 7f453ffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4540151950 0x7f4540153950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:55.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.614+0000 7f453f7fe700 1 -- 172.21.15.72:0/3531777854 learned_addr learned my addr 172.21.15.72:0/3531777854 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:35:55.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.614+0000 7f453effd700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f45400c4930 0x7f45401edd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3301/0 says I am v2:172.21.15.72:45006/0 (socket says 172.21.15.72:45006) 2023-07-25T14:35:55.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.614+0000 7f453ffff700 1 -- 172.21.15.72:0/3531777854 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f45400c4930 msgr2=0x7f45401edd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:55.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.614+0000 7f453ffff700 1 --2- 172.21.15.72:0/3531777854 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f45400c4930 0x7f45401edd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:55.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.614+0000 7f453ffff700 1 -- 172.21.15.72:0/3531777854 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f45400724c0 msgr2=0x7f45401e9d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:55.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.614+0000 7f453ffff700 1 --2- 172.21.15.72:0/3531777854 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f45400724c0 0x7f45401e9d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:55.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.614+0000 7f453ffff700 1 -- 172.21.15.72:0/3531777854 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45280094a0 con 0x7f4540151950 2023-07-25T14:35:55.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.615+0000 7f453ffff700 1 --2- 172.21.15.72:0/3531777854 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4540151950 0x7f4540153950 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f4538016000 tx=0x7f4538004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:35:55.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.617+0000 7f4537fff700 1 -- 172.21.15.72:0/3531777854 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4538012430 con 0x7f4540151950 2023-07-25T14:35:55.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.617+0000 7f454606a700 1 -- 172.21.15.72:0/3531777854 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4538009a70 con 0x7f4540151950 2023-07-25T14:35:55.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.617+0000 7f4537fff700 1 -- 172.21.15.72:0/3531777854 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4538020070 con 0x7f4540151950 2023-07-25T14:35:55.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.617+0000 7f4537fff700 1 -- 172.21.15.72:0/3531777854 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45380098f0 con 0x7f4540151950 2023-07-25T14:35:55.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.617+0000 7f454606a700 1 -- 172.21.15.72:0/3531777854 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f454014b350 con 0x7f4540151950 2023-07-25T14:35:55.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.618+0000 7f454606a700 1 -- 172.21.15.72:0/3531777854 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45400c59c0 con 0x7f4540151950 2023-07-25T14:35:55.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.618+0000 7f4537fff700 1 -- 172.21.15.72:0/3531777854 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4538004040 con 0x7f4540151950 2023-07-25T14:35:55.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.618+0000 7f4537fff700 1 --2- 172.21.15.72:0/3531777854 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f452006ace0 0x7f452006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:55.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.618+0000 7f4537fff700 1 -- 172.21.15.72:0/3531777854 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f4538022070 con 0x7f4540151950 2023-07-25T14:35:55.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.618+0000 7f453f7fe700 1 --2- 172.21.15.72:0/3531777854 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f452006ace0 0x7f452006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:55.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.619+0000 7f453f7fe700 1 --2- 172.21.15.72:0/3531777854 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f452006ace0 0x7f452006d1a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f4530005910 tx=0x7f4530009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:35:55.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.623+0000 7f4537fff700 1 -- 172.21.15.72:0/3531777854 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f45400c59c0 con 0x7f4540151950 2023-07-25T14:35:55.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.810+0000 7f454606a700 1 -- 172.21.15.72:0/3531777854 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f45400c59c0 con 0x7f4540151950 2023-07-25T14:35:55.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.811+0000 7f4537fff700 1 -- 172.21.15.72:0/3531777854 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7f45400c59c0 con 0x7f4540151950 2023-07-25T14:35:55.823 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2023-07-25T14:35:55.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.812+0000 7f454606a700 1 -- 172.21.15.72:0/3531777854 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f452006ace0 msgr2=0x7f452006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:55.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.812+0000 7f454606a700 1 --2- 172.21.15.72:0/3531777854 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f452006ace0 0x7f452006d1a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f4530005910 tx=0x7f4530009040 comp rx=0 tx=0).stop 2023-07-25T14:35:55.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.812+0000 7f454606a700 1 -- 172.21.15.72:0/3531777854 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4540151950 msgr2=0x7f4540153950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:55.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.812+0000 7f454606a700 1 --2- 172.21.15.72:0/3531777854 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4540151950 0x7f4540153950 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f4538016000 tx=0x7f4538004ad0 comp rx=0 tx=0).stop 2023-07-25T14:35:55.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.813+0000 7f454606a700 1 -- 172.21.15.72:0/3531777854 shutdown_connections 2023-07-25T14:35:55.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.813+0000 7f454606a700 1 --2- 172.21.15.72:0/3531777854 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f452006ace0 0x7f452006d1a0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:55.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.813+0000 7f454606a700 1 --2- 172.21.15.72:0/3531777854 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4540151950 0x7f4540153950 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:55.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.813+0000 7f454606a700 1 --2- 172.21.15.72:0/3531777854 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f45400724c0 0x7f45401e9d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:55.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.813+0000 7f454606a700 1 --2- 172.21.15.72:0/3531777854 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f45400c4930 0x7f45401edd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:55.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.813+0000 7f454606a700 1 -- 172.21.15.72:0/3531777854 >> 172.21.15.72:0/3531777854 conn(0x7f45400a87e0 msgr2=0x7f454014f960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:35:55.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.813+0000 7f454606a700 1 -- 172.21.15.72:0/3531777854 shutdown_connections 2023-07-25T14:35:55.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.813+0000 7f454606a700 1 -- 172.21.15.72:0/3531777854 wait complete. 2023-07-25T14:35:55.836 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-25T14:35:55.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.948+0000 7fc3e536c700 1 Processor -- start 2023-07-25T14:35:55.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.948+0000 7fc3e536c700 1 -- start start 2023-07-25T14:35:55.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.949+0000 7fc3e536c700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc3e00c6910 0x7fc3e0158520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:55.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.949+0000 7fc3e536c700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fc3e00c2310 0x7fc3e00c27a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:55.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.949+0000 7fc3e536c700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3e00c6270 con 0x7fc3e0155050 2023-07-25T14:35:55.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.949+0000 7fc3e536c700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3e00c5d70 con 0x7fc3e00c2310 2023-07-25T14:35:55.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.949+0000 7fc3e536c700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3e00c5f90 con 0x7fc3e00c6910 2023-07-25T14:35:55.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.949+0000 7fc3df7fe700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fc3e00c2310 0x7fc3e00c27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:55.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.949+0000 7fc3deffd700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc3e00c6910 0x7fc3e0158520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:55.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.949+0000 7fc3df7fe700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fc3e00c2310 0x7fc3e00c27a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.72:35362/0 (socket says 172.21.15.72:35362) 2023-07-25T14:35:55.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.949+0000 7fc3deffd700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc3e00c6910 0x7fc3e0158520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3301/0 says I am v2:172.21.15.72:45014/0 (socket says 172.21.15.72:45014) 2023-07-25T14:35:55.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.949+0000 7fc3df7fe700 1 -- 172.21.15.72:0/326348569 learned_addr learned my addr 172.21.15.72:0/326348569 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:35:55.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.949+0000 7fc3df7fe700 1 -- 172.21.15.72:0/326348569 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc3e00c6910 msgr2=0x7fc3e0158520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:35:55.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.949+0000 7fc3df7fe700 1 --2- 172.21.15.72:0/326348569 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc3e00c6910 0x7fc3e0158520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:55.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.949+0000 7fc3df7fe700 1 -- 172.21.15.72:0/326348569 >> v1:172.21.15.92:6789/0 conn(0x7fc3e0155050 legacy=0x7fc3e00c5660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:55.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.949+0000 7fc3df7fe700 1 -- 172.21.15.72:0/326348569 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3e0157a40 con 0x7fc3e00c2310 2023-07-25T14:35:55.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.950+0000 7fc3df7fe700 1 --2- 172.21.15.72:0/326348569 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc3e00c2310 0x7fc3e00c27a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fc3d8009e50 tx=0x7fc3d800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d63b7393d9579105 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:35:55.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.950+0000 7fc3ddffb700 1 -- 172.21.15.72:0/326348569 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3d800e070 con 0x7fc3e00c2310 2023-07-25T14:35:55.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.950+0000 7fc3ddffb700 1 -- 172.21.15.72:0/326348569 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3d800b910 con 0x7fc3e00c2310 2023-07-25T14:35:55.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.950+0000 7fc3ddffb700 1 -- 172.21.15.72:0/326348569 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3d800bcc0 con 0x7fc3e00c2310 2023-07-25T14:35:55.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.950+0000 7fc3e536c700 1 -- 172.21.15.72:0/326348569 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc3e00c2310 msgr2=0x7fc3e00c27a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:55.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.950+0000 7fc3e536c700 1 --2- 172.21.15.72:0/326348569 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc3e00c2310 0x7fc3e00c27a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fc3d8009e50 tx=0x7fc3d800b330 comp rx=0 tx=0).stop 2023-07-25T14:35:55.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.950+0000 7fc3e536c700 1 -- 172.21.15.72:0/326348569 shutdown_connections 2023-07-25T14:35:55.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.950+0000 7fc3e536c700 1 --2- 172.21.15.72:0/326348569 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc3e00c6910 0x7fc3e0158520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:55.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.950+0000 7fc3e536c700 1 --2- 172.21.15.72:0/326348569 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc3e00c2310 0x7fc3e00c27a0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:55.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.950+0000 7fc3e536c700 1 -- 172.21.15.72:0/326348569 >> 172.21.15.72:0/326348569 conn(0x7fc3e006c410 msgr2=0x7fc3e006c820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:35:55.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.950+0000 7fc3e536c700 1 -- 172.21.15.72:0/326348569 shutdown_connections 2023-07-25T14:35:55.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.950+0000 7fc3e536c700 1 -- 172.21.15.72:0/326348569 wait complete. 2023-07-25T14:35:55.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.952+0000 7fc3e536c700 1 Processor -- start 2023-07-25T14:35:55.968 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.952+0000 7fc3e536c700 1 -- start start 2023-07-25T14:35:55.968 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.952+0000 7fc3e536c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc3e00c2310 0x7fc3e00c2f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:55.968 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.952+0000 7fc3e536c700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc3e00c6910 0x7fc3e00bebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:55.968 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.952+0000 7fc3e536c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc3e0155050 0x7fc3e00bf0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:55.968 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.952+0000 7fc3e536c700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3e01472c0 con 0x7fc3e00c2310 2023-07-25T14:35:55.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.952+0000 7fc3e536c700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3e0154070 con 0x7fc3e0155050 2023-07-25T14:35:55.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.952+0000 7fc3e536c700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3e0147510 con 0x7fc3e00c6910 2023-07-25T14:35:55.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.952+0000 7fc3deffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc3e00c2310 0x7fc3e00c2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:55.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.952+0000 7fc3de7fc700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc3e00c6910 0x7fc3e00bebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:55.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.952+0000 7fc3deffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc3e00c2310 0x7fc3e00c2f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:39796/0 (socket says 172.21.15.72:39796) 2023-07-25T14:35:55.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.952+0000 7fc3deffd700 1 -- 172.21.15.72:0/152642733 learned_addr learned my addr 172.21.15.72:0/152642733 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:35:55.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.952+0000 7fc3df7fe700 1 --2- 172.21.15.72:0/152642733 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc3e0155050 0x7fc3e00bf0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:55.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.953+0000 7fc3deffd700 1 -- 172.21.15.72:0/152642733 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc3e00c6910 msgr2=0x7fc3e00bebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:55.970 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.953+0000 7fc3deffd700 1 --2- 172.21.15.72:0/152642733 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc3e00c6910 0x7fc3e00bebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:55.970 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.953+0000 7fc3deffd700 1 -- 172.21.15.72:0/152642733 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc3e0155050 msgr2=0x7fc3e00bf0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:55.970 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.953+0000 7fc3deffd700 1 --2- 172.21.15.72:0/152642733 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc3e0155050 0x7fc3e00bf0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:55.970 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.953+0000 7fc3deffd700 1 -- 172.21.15.72:0/152642733 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3d8009b30 con 0x7fc3e00c2310 2023-07-25T14:35:55.970 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.953+0000 7fc3df7fe700 1 --2- 172.21.15.72:0/152642733 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc3e0155050 0x7fc3e00bf0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-25T14:35:55.970 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.953+0000 7fc3deffd700 1 --2- 172.21.15.72:0/152642733 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc3e00c2310 0x7fc3e00c2f80 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fc3d000e9b0 tx=0x7fc3d000ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:35:55.970 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.953+0000 7fc3c77fe700 1 -- 172.21.15.72:0/152642733 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3d0009710 con 0x7fc3e00c2310 2023-07-25T14:35:55.970 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.953+0000 7fc3c77fe700 1 -- 172.21.15.72:0/152642733 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3d000ee50 con 0x7fc3e00c2310 2023-07-25T14:35:55.971 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.953+0000 7fc3c77fe700 1 -- 172.21.15.72:0/152642733 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3d000ca50 con 0x7fc3e00c2310 2023-07-25T14:35:55.971 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.953+0000 7fc3e536c700 1 -- 172.21.15.72:0/152642733 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3e01477f0 con 0x7fc3e00c2310 2023-07-25T14:35:55.971 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.953+0000 7fc3e536c700 1 -- 172.21.15.72:0/152642733 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3e00c34c0 con 0x7fc3e00c2310 2023-07-25T14:35:55.971 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.954+0000 7fc3e536c700 1 -- 172.21.15.72:0/152642733 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3e004e470 con 0x7fc3e00c2310 2023-07-25T14:35:55.972 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.955+0000 7fc3c77fe700 1 -- 172.21.15.72:0/152642733 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc3d000cbb0 con 0x7fc3e00c2310 2023-07-25T14:35:55.972 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.955+0000 7fc3c77fe700 1 --2- 172.21.15.72:0/152642733 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fc3cc06ace0 0x7fc3cc06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:55.972 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.955+0000 7fc3c77fe700 1 -- 172.21.15.72:0/152642733 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fc3d00896d0 con 0x7fc3e00c2310 2023-07-25T14:35:55.972 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.955+0000 7fc3de7fc700 1 --2- 172.21.15.72:0/152642733 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fc3cc06ace0 0x7fc3cc06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:55.972 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.956+0000 7fc3de7fc700 1 --2- 172.21.15.72:0/152642733 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fc3cc06ace0 0x7fc3cc06d1a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc3e00c3930 tx=0x7fc3d4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:35:55.973 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:55.959+0000 7fc3c77fe700 1 -- 172.21.15.72:0/152642733 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fc3d0057fb0 con 0x7fc3e00c2310 2023-07-25T14:35:56.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:56.144+0000 7fc3e536c700 1 -- 172.21.15.72:0/152642733 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc3e00737a0 con 0x7fc3e00c2310 2023-07-25T14:35:56.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:56.145+0000 7fc3c77fe700 1 -- 172.21.15.72:0/152642733 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc3d000ce60 con 0x7fc3e00c2310 2023-07-25T14:35:56.158 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 64 2023-07-25T14:35:56.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:56.147+0000 7fc3e536c700 1 -- 172.21.15.72:0/152642733 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fc3cc06ace0 msgr2=0x7fc3cc06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:56.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:56.147+0000 7fc3e536c700 1 --2- 172.21.15.72:0/152642733 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fc3cc06ace0 0x7fc3cc06d1a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc3e00c3930 tx=0x7fc3d4009040 comp rx=0 tx=0).stop 2023-07-25T14:35:56.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:56.147+0000 7fc3e536c700 1 -- 172.21.15.72:0/152642733 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc3e00c2310 msgr2=0x7fc3e00c2f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:56.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:56.147+0000 7fc3e536c700 1 --2- 172.21.15.72:0/152642733 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc3e00c2310 0x7fc3e00c2f80 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fc3d000e9b0 tx=0x7fc3d000ecc0 comp rx=0 tx=0).stop 2023-07-25T14:35:56.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:56.147+0000 7fc3e536c700 1 -- 172.21.15.72:0/152642733 shutdown_connections 2023-07-25T14:35:56.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:56.147+0000 7fc3e536c700 1 --2- 172.21.15.72:0/152642733 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fc3cc06ace0 0x7fc3cc06d1a0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:56.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:56.147+0000 7fc3e536c700 1 --2- 172.21.15.72:0/152642733 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc3e0155050 0x7fc3e00bf0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:56.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:56.147+0000 7fc3e536c700 1 --2- 172.21.15.72:0/152642733 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc3e00c2310 0x7fc3e00c2f80 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:56.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:56.147+0000 7fc3e536c700 1 --2- 172.21.15.72:0/152642733 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc3e00c6910 0x7fc3e00bebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:56.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:56.147+0000 7fc3e536c700 1 -- 172.21.15.72:0/152642733 >> 172.21.15.72:0/152642733 conn(0x7fc3e006c410 msgr2=0x7fc3e0149260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:35:56.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:56.147+0000 7fc3e536c700 1 -- 172.21.15.72:0/152642733 shutdown_connections 2023-07-25T14:35:56.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:56.147+0000 7fc3e536c700 1 -- 172.21.15.72:0/152642733 wait complete. 2023-07-25T14:35:56.171 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-07-25T14:35:56.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:56.282+0000 7f10855df700 1 Processor -- start 2023-07-25T14:35:56.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:56.282+0000 7f10855df700 1 -- start start 2023-07-25T14:35:56.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:56.283+0000 7f10855df700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1080151a90 0x7f1080154d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:56.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:56.283+0000 7f10855df700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f10800bead0 0x7f10800c0350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:56.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:56.283+0000 7f10855df700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f10800c0890 0x7f10800c44d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:56.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:56.283+0000 7f10855df700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10800c10b0 con 0x7f10800bead0 2023-07-25T14:35:56.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:56.283+0000 7f10855df700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10800c1940 con 0x7f10800c0890 2023-07-25T14:35:56.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:56.283+0000 7f10855df700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10800bfeb0 con 0x7f1080151a90 2023-07-25T14:35:56.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:56.283+0000 7f107e7fc700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f10800bead0 0x7f10800c0350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:56.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:56.283+0000 7f107e7fc700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f10800bead0 0x7f10800c0350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:39800/0 (socket says 172.21.15.72:39800) 2023-07-25T14:35:56.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:56.283+0000 7f107e7fc700 1 -- 172.21.15.72:0/1729277786 learned_addr learned my addr 172.21.15.72:0/1729277786 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:35:56.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:56.283+0000 7f107effd700 1 --2- 172.21.15.72:0/1729277786 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1080151a90 0x7f1080154d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:56.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:56.283+0000 7f107f7fe700 1 --2- 172.21.15.72:0/1729277786 >> v2:172.21.15.92:3300/0 conn(0x7f10800c0890 0x7f10800c44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:56.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:56.284+0000 7f107e7fc700 1 -- 172.21.15.72:0/1729277786 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1080151a90 msgr2=0x7f1080154d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:35:56.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:56.284+0000 7f107e7fc700 1 --2- 172.21.15.72:0/1729277786 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1080151a90 0x7f1080154d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:56.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:56.284+0000 7f107e7fc700 1 -- 172.21.15.72:0/1729277786 >> v2:172.21.15.92:3300/0 conn(0x7f10800c0890 msgr2=0x7f10800c44d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:35:56.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:56.284+0000 7f107e7fc700 1 --2- 172.21.15.72:0/1729277786 >> v2:172.21.15.92:3300/0 conn(0x7f10800c0890 0x7f10800c44d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:56.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:56.284+0000 7f107e7fc700 1 -- 172.21.15.72:0/1729277786 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10800bf2e0 con 0x7f10800bead0 2023-07-25T14:35:56.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:56.284+0000 7f107e7fc700 1 --2- 172.21.15.72:0/1729277786 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f10800bead0 0x7f10800c0350 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f108006b490 tx=0x7f1070009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9009a87c9430e45 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:35:56.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:56.284+0000 7f107dffb700 1 -- 172.21.15.72:0/1729277786 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1070011830 con 0x7f10800bead0 2023-07-25T14:35:56.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:56.284+0000 7f107dffb700 1 -- 172.21.15.72:0/1729277786 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1070011990 con 0x7f10800bead0 2023-07-25T14:35:56.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:56.284+0000 7f107dffb700 1 -- 172.21.15.72:0/1729277786 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1070011d20 con 0x7f10800bead0 2023-07-25T14:35:56.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:56.284+0000 7f10855df700 1 -- 172.21.15.72:0/1729277786 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f10800bead0 msgr2=0x7f10800c0350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:56.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:56.284+0000 7f10855df700 1 --2- 172.21.15.72:0/1729277786 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f10800bead0 0x7f10800c0350 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f108006b490 tx=0x7f1070009bd0 comp rx=0 tx=0).stop 2023-07-25T14:35:56.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:56.284+0000 7f10855df700 1 -- 172.21.15.72:0/1729277786 shutdown_connections 2023-07-25T14:35:56.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:56.285+0000 7f10855df700 1 --2- 172.21.15.72:0/1729277786 >> v2:172.21.15.92:3300/0 conn(0x7f10800c0890 0x7f10800c44d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:56.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:56.285+0000 7f10855df700 1 --2- 172.21.15.72:0/1729277786 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1080151a90 0x7f1080154d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:56.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:56.285+0000 7f10855df700 1 --2- 172.21.15.72:0/1729277786 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f10800bead0 0x7f10800c0350 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:56.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:56.285+0000 7f10855df700 1 -- 172.21.15.72:0/1729277786 >> 172.21.15.72:0/1729277786 conn(0x7f108006c3a0 msgr2=0x7f108006c780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:35:56.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:56.285+0000 7f10855df700 1 -- 172.21.15.72:0/1729277786 shutdown_connections 2023-07-25T14:35:56.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:56.285+0000 7f10855df700 1 -- 172.21.15.72:0/1729277786 wait complete. 2023-07-25T14:35:56.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:56.286+0000 7f10855df700 1 Processor -- start 2023-07-25T14:35:56.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:56.286+0000 7f10855df700 1 -- start start 2023-07-25T14:35:56.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:56.286+0000 7f10855df700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f10800bead0 0x7f1080156710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:56.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:56.287+0000 7f10855df700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f10800c0890 0x7f10800c35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:56.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:56.287+0000 7f10855df700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1080151a90 0x7f10801ecd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:56.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:56.287+0000 7f10855df700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10801df8e0 con 0x7f10800c0890 2023-07-25T14:35:56.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:56.287+0000 7f10855df700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10801de8a0 con 0x7f1080151a90 2023-07-25T14:35:56.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:56.287+0000 7f10855df700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10801eda90 con 0x7f10800bead0 2023-07-25T14:35:56.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:56.287+0000 7f107e7fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f10800c0890 0x7f10800c35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:56.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:56.287+0000 7f107e7fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f10800c0890 0x7f10800c35d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:39808/0 (socket says 172.21.15.72:39808) 2023-07-25T14:35:56.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:56.287+0000 7f107e7fc700 1 -- 172.21.15.72:0/785992907 learned_addr learned my addr 172.21.15.72:0/785992907 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:35:56.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:56.287+0000 7f107f7fe700 1 --2- 172.21.15.72:0/785992907 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1080151a90 0x7f10801ecd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:56.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:56.287+0000 7f107effd700 1 --2- 172.21.15.72:0/785992907 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f10800bead0 0x7f1080156710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:56.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:56.287+0000 7f107e7fc700 1 -- 172.21.15.72:0/785992907 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f10800bead0 msgr2=0x7f1080156710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:56.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:56.287+0000 7f107e7fc700 1 --2- 172.21.15.72:0/785992907 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f10800bead0 0x7f1080156710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:56.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:56.287+0000 7f107e7fc700 1 -- 172.21.15.72:0/785992907 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1080151a90 msgr2=0x7f10801ecd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:56.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:56.287+0000 7f107e7fc700 1 --2- 172.21.15.72:0/785992907 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1080151a90 0x7f10801ecd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:56.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:56.287+0000 7f107e7fc700 1 -- 172.21.15.72:0/785992907 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1070009550 con 0x7f10800c0890 2023-07-25T14:35:56.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:56.287+0000 7f107e7fc700 1 --2- 172.21.15.72:0/785992907 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f10800c0890 0x7f10800c35d0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f1070009c10 tx=0x7f1070004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:35:56.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:56.287+0000 7f10677fe700 1 -- 172.21.15.72:0/785992907 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1070004510 con 0x7f10800c0890 2023-07-25T14:35:56.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:56.287+0000 7f10677fe700 1 -- 172.21.15.72:0/785992907 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f107001e070 con 0x7f10800c0890 2023-07-25T14:35:56.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:56.287+0000 7f10855df700 1 -- 172.21.15.72:0/785992907 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1080158620 con 0x7f10800c0890 2023-07-25T14:35:56.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:56.287+0000 7f10677fe700 1 -- 172.21.15.72:0/785992907 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10700038e0 con 0x7f10800c0890 2023-07-25T14:35:56.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:56.287+0000 7f10855df700 1 -- 172.21.15.72:0/785992907 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10800c30b0 con 0x7f10800c0890 2023-07-25T14:35:56.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:56.288+0000 7f10855df700 1 -- 172.21.15.72:0/785992907 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10800af890 con 0x7f10800c0890 2023-07-25T14:35:56.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:56.289+0000 7f10677fe700 1 -- 172.21.15.72:0/785992907 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1070003a40 con 0x7f10800c0890 2023-07-25T14:35:56.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:56.289+0000 7f10677fe700 1 --2- 172.21.15.72:0/785992907 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f106c06ace0 0x7f106c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:56.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:56.289+0000 7f10677fe700 1 -- 172.21.15.72:0/785992907 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f107008a520 con 0x7f10800c0890 2023-07-25T14:35:56.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:56.289+0000 7f107effd700 1 --2- 172.21.15.72:0/785992907 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f106c06ace0 0x7f106c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:56.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:56.290+0000 7f107effd700 1 --2- 172.21.15.72:0/785992907 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f106c06ace0 0x7f106c06d1a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f1074009b70 tx=0x7f1074008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:35:56.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:56.293+0000 7f10677fe700 1 -- 172.21.15.72:0/785992907 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f1070055370 con 0x7f10800c0890 2023-07-25T14:35:56.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:56.481+0000 7f10855df700 1 -- 172.21.15.72:0/785992907 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f10800c32a0 con 0x7f10800c0890 2023-07-25T14:35:56.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:56.482+0000 7f10677fe700 1 -- 172.21.15.72:0/785992907 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+11 (secure 0 0 0) 0x7f107002c3b0 con 0x7f10800c0890 2023-07-25T14:35:56.494 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2023-07-25T14:35:56.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:56.484+0000 7f10855df700 1 -- 172.21.15.72:0/785992907 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f106c06ace0 msgr2=0x7f106c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:56.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:56.484+0000 7f10855df700 1 --2- 172.21.15.72:0/785992907 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f106c06ace0 0x7f106c06d1a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f1074009b70 tx=0x7f1074008040 comp rx=0 tx=0).stop 2023-07-25T14:35:56.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:56.484+0000 7f10855df700 1 -- 172.21.15.72:0/785992907 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f10800c0890 msgr2=0x7f10800c35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:56.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:56.484+0000 7f10855df700 1 --2- 172.21.15.72:0/785992907 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f10800c0890 0x7f10800c35d0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f1070009c10 tx=0x7f1070004750 comp rx=0 tx=0).stop 2023-07-25T14:35:56.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:56.484+0000 7f10855df700 1 -- 172.21.15.72:0/785992907 shutdown_connections 2023-07-25T14:35:56.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:56.484+0000 7f10855df700 1 --2- 172.21.15.72:0/785992907 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f106c06ace0 0x7f106c06d1a0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:56.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:56.484+0000 7f10855df700 1 --2- 172.21.15.72:0/785992907 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f10800bead0 0x7f1080156710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:56.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:56.484+0000 7f10855df700 1 --2- 172.21.15.72:0/785992907 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1080151a90 0x7f10801ecd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:56.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:56.484+0000 7f10855df700 1 --2- 172.21.15.72:0/785992907 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f10800c0890 0x7f10800c35d0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:56.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:56.484+0000 7f10855df700 1 -- 172.21.15.72:0/785992907 >> 172.21.15.72:0/785992907 conn(0x7f108006c3a0 msgr2=0x7f10800c6670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:35:56.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:56.484+0000 7f10855df700 1 -- 172.21.15.72:0/785992907 shutdown_connections 2023-07-25T14:35:56.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:56.484+0000 7f10855df700 1 -- 172.21.15.72:0/785992907 wait complete. 2023-07-25T14:35:56.508 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-25T14:35:56.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:56.620+0000 7fb69e562700 1 Processor -- start 2023-07-25T14:35:56.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:56.621+0000 7fb69e562700 1 -- start start 2023-07-25T14:35:56.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:56.621+0000 7fb69e562700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fb6980bb0a0 0x7fb69806f120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:56.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:56.621+0000 7fb69e562700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb6980c5910 0x7fb69806f660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:56.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:56.621+0000 7fb69e562700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6980c4cc0 con 0x7fb69814f820 2023-07-25T14:35:56.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:56.621+0000 7fb69e562700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb698152f30 con 0x7fb6980c5910 2023-07-25T14:35:56.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:56.621+0000 7fb69e562700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6980c4420 con 0x7fb6980bb0a0 2023-07-25T14:35:56.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:56.621+0000 7fb69caff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb6980c5910 0x7fb69806f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:56.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:56.621+0000 7fb69caff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb6980c5910 0x7fb69806f660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:39818/0 (socket says 172.21.15.72:39818) 2023-07-25T14:35:56.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:56.621+0000 7fb69caff700 1 -- 172.21.15.72:0/4210840083 learned_addr learned my addr 172.21.15.72:0/4210840083 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:35:56.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:56.621+0000 7fb6977fe700 1 --2- 172.21.15.72:0/4210840083 >> v2:172.21.15.92:3300/0 conn(0x7fb6980bb0a0 0x7fb69806f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:56.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:56.622+0000 7fb69caff700 1 -- 172.21.15.72:0/4210840083 >> v2:172.21.15.92:3300/0 conn(0x7fb6980bb0a0 msgr2=0x7fb69806f120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:35:56.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:56.622+0000 7fb69caff700 1 --2- 172.21.15.72:0/4210840083 >> v2:172.21.15.92:3300/0 conn(0x7fb6980bb0a0 0x7fb69806f120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:56.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:56.622+0000 7fb69caff700 1 -- 172.21.15.72:0/4210840083 >> v1:172.21.15.92:6789/0 conn(0x7fb69814f820 legacy=0x7fb6980c2390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:56.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:56.622+0000 7fb69caff700 1 -- 172.21.15.72:0/4210840083 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6980c4700 con 0x7fb6980c5910 2023-07-25T14:35:56.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:56.622+0000 7fb6977fe700 1 --2- 172.21.15.72:0/4210840083 >> v2:172.21.15.92:3300/0 conn(0x7fb6980bb0a0 0x7fb69806f120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-25T14:35:56.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:56.622+0000 7fb69caff700 1 --2- 172.21.15.72:0/4210840083 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb6980c5910 0x7fb69806f660 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fb69806b010 tx=0x7fb69000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=953ba5da291ee3a2 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:35:56.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:56.622+0000 7fb696ffd700 1 -- 172.21.15.72:0/4210840083 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb69000e070 con 0x7fb6980c5910 2023-07-25T14:35:56.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:56.622+0000 7fb696ffd700 1 -- 172.21.15.72:0/4210840083 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb69000b9c0 con 0x7fb6980c5910 2023-07-25T14:35:56.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:56.622+0000 7fb696ffd700 1 -- 172.21.15.72:0/4210840083 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb69000bd70 con 0x7fb6980c5910 2023-07-25T14:35:56.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:56.622+0000 7fb69e562700 1 -- 172.21.15.72:0/4210840083 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb6980c5910 msgr2=0x7fb69806f660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:56.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:56.622+0000 7fb69e562700 1 --2- 172.21.15.72:0/4210840083 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb6980c5910 0x7fb69806f660 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fb69806b010 tx=0x7fb69000b330 comp rx=0 tx=0).stop 2023-07-25T14:35:56.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:56.622+0000 7fb69e562700 1 -- 172.21.15.72:0/4210840083 shutdown_connections 2023-07-25T14:35:56.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:56.622+0000 7fb69e562700 1 --2- 172.21.15.72:0/4210840083 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb6980c5910 0x7fb69806f660 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:56.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:56.622+0000 7fb69e562700 1 --2- 172.21.15.72:0/4210840083 >> v2:172.21.15.92:3300/0 conn(0x7fb6980bb0a0 0x7fb69806f120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:56.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:56.623+0000 7fb69e562700 1 -- 172.21.15.72:0/4210840083 >> 172.21.15.72:0/4210840083 conn(0x7fb69806a980 msgr2=0x7fb6980a9540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:35:56.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:56.623+0000 7fb69e562700 1 -- 172.21.15.72:0/4210840083 shutdown_connections 2023-07-25T14:35:56.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:56.623+0000 7fb69e562700 1 -- 172.21.15.72:0/4210840083 wait complete. 2023-07-25T14:35:56.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:56.624+0000 7fb69e562700 1 Processor -- start 2023-07-25T14:35:56.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:56.624+0000 7fb69e562700 1 -- start start 2023-07-25T14:35:56.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:56.624+0000 7fb69e562700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb6980bb0a0 0x7fb6980a7f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:56.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:56.624+0000 7fb69e562700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb6980c5910 0x7fb6981eb000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:56.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:56.624+0000 7fb69e562700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb69814f820 0x7fb6980bf8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:56.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:56.625+0000 7fb69e562700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb698156330 con 0x7fb6980bb0a0 2023-07-25T14:35:56.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:56.625+0000 7fb69e562700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6981eb9d0 con 0x7fb69814f820 2023-07-25T14:35:56.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:56.625+0000 7fb69e562700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb698155fd0 con 0x7fb6980c5910 2023-07-25T14:35:56.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:56.625+0000 7fb697fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb6980bb0a0 0x7fb6980a7f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:56.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:56.625+0000 7fb697fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb6980bb0a0 0x7fb6980a7f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:39820/0 (socket says 172.21.15.72:39820) 2023-07-25T14:35:56.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:56.625+0000 7fb697fff700 1 -- 172.21.15.72:0/1741893775 learned_addr learned my addr 172.21.15.72:0/1741893775 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:35:56.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:56.625+0000 7fb69caff700 1 --2- 172.21.15.72:0/1741893775 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb69814f820 0x7fb6980bf8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:56.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:56.625+0000 7fb6977fe700 1 --2- 172.21.15.72:0/1741893775 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb6980c5910 0x7fb6981eb000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:56.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:56.625+0000 7fb697fff700 1 -- 172.21.15.72:0/1741893775 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb6980c5910 msgr2=0x7fb6981eb000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:56.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:56.625+0000 7fb697fff700 1 --2- 172.21.15.72:0/1741893775 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb6980c5910 0x7fb6981eb000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:56.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:56.625+0000 7fb697fff700 1 -- 172.21.15.72:0/1741893775 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb69814f820 msgr2=0x7fb6980bf8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:56.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:56.625+0000 7fb697fff700 1 --2- 172.21.15.72:0/1741893775 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb69814f820 0x7fb6980bf8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:56.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:56.625+0000 7fb697fff700 1 -- 172.21.15.72:0/1741893775 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb690009b30 con 0x7fb6980bb0a0 2023-07-25T14:35:56.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:56.625+0000 7fb697fff700 1 --2- 172.21.15.72:0/1741893775 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb6980bb0a0 0x7fb6980a7f30 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fb68800c4d0 tx=0x7fb68800c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:35:56.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:56.625+0000 7fb694ff9700 1 -- 172.21.15.72:0/1741893775 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6880052d0 con 0x7fb6980bb0a0 2023-07-25T14:35:56.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:56.625+0000 7fb694ff9700 1 -- 172.21.15.72:0/1741893775 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb688005430 con 0x7fb6980bb0a0 2023-07-25T14:35:56.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:56.625+0000 7fb69e562700 1 -- 172.21.15.72:0/1741893775 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6980a8470 con 0x7fb6980bb0a0 2023-07-25T14:35:56.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:56.625+0000 7fb694ff9700 1 -- 172.21.15.72:0/1741893775 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6880038f0 con 0x7fb6980bb0a0 2023-07-25T14:35:56.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:56.625+0000 7fb69e562700 1 -- 172.21.15.72:0/1741893775 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6980a7c50 con 0x7fb6980bb0a0 2023-07-25T14:35:56.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:56.626+0000 7fb69e562700 1 -- 172.21.15.72:0/1741893775 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6981ebc40 con 0x7fb6980bb0a0 2023-07-25T14:35:56.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:56.627+0000 7fb694ff9700 1 -- 172.21.15.72:0/1741893775 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb688003a50 con 0x7fb6980bb0a0 2023-07-25T14:35:56.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:56.627+0000 7fb694ff9700 1 --2- 172.21.15.72:0/1741893775 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fb68406ace0 0x7fb68406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:56.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:56.627+0000 7fb694ff9700 1 -- 172.21.15.72:0/1741893775 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fb688088930 con 0x7fb6980bb0a0 2023-07-25T14:35:56.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:56.627+0000 7fb6977fe700 1 --2- 172.21.15.72:0/1741893775 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fb68406ace0 0x7fb68406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:56.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:56.627+0000 7fb6977fe700 1 --2- 172.21.15.72:0/1741893775 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fb68406ace0 0x7fb68406d1a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb698152510 tx=0x7fb68c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:35:56.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:56.631+0000 7fb694ff9700 1 -- 172.21.15.72:0/1741893775 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fb688053780 con 0x7fb6980bb0a0 2023-07-25T14:35:56.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:56.835+0000 7fb69e562700 1 -- 172.21.15.72:0/1741893775 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fb6980a8470 con 0x7fb6980bb0a0 2023-07-25T14:35:56.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:56.835+0000 7fb694ff9700 1 -- 172.21.15.72:0/1741893775 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) v1 ==== 80+0+0 (secure 0 0 0) 0x7fb6980a8470 con 0x7fb6980bb0a0 2023-07-25T14:35:56.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:56.837+0000 7fb69e562700 1 -- 172.21.15.72:0/1741893775 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fb68406ace0 msgr2=0x7fb68406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:56.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:56.837+0000 7fb69e562700 1 --2- 172.21.15.72:0/1741893775 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fb68406ace0 0x7fb68406d1a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb698152510 tx=0x7fb68c008040 comp rx=0 tx=0).stop 2023-07-25T14:35:56.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:56.837+0000 7fb69e562700 1 -- 172.21.15.72:0/1741893775 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb6980bb0a0 msgr2=0x7fb6980a7f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:56.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:56.837+0000 7fb69e562700 1 --2- 172.21.15.72:0/1741893775 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb6980bb0a0 0x7fb6980a7f30 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fb68800c4d0 tx=0x7fb68800c7e0 comp rx=0 tx=0).stop 2023-07-25T14:35:56.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:56.837+0000 7fb69e562700 1 -- 172.21.15.72:0/1741893775 shutdown_connections 2023-07-25T14:35:56.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:56.837+0000 7fb69e562700 1 --2- 172.21.15.72:0/1741893775 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fb68406ace0 0x7fb68406d1a0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:56.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:56.837+0000 7fb69e562700 1 --2- 172.21.15.72:0/1741893775 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb69814f820 0x7fb6980bf8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:56.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:56.837+0000 7fb69e562700 1 --2- 172.21.15.72:0/1741893775 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb6980bb0a0 0x7fb6980a7f30 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:56.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:56.837+0000 7fb69e562700 1 --2- 172.21.15.72:0/1741893775 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb6980c5910 0x7fb6981eb000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:56.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:56.837+0000 7fb69e562700 1 -- 172.21.15.72:0/1741893775 >> 172.21.15.72:0/1741893775 conn(0x7fb69806a980 msgr2=0x7fb6980c2390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:35:56.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:56.837+0000 7fb69e562700 1 -- 172.21.15.72:0/1741893775 shutdown_connections 2023-07-25T14:35:56.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:56.837+0000 7fb69e562700 1 -- 172.21.15.72:0/1741893775 wait complete. 2023-07-25T14:35:56.852 INFO:teuthology.orchestra.run.smithi072.stderr:listed 0 entries 2023-07-25T14:35:56.861 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi072.front.sepia.ceph.com... 2023-07-25T14:35:56.862 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-25T14:35:56.862 DEBUG:teuthology.orchestra.run.smithi072:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2023-07-25T14:35:56.903 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi072.stderr:ceph-fuse[107003]: fuse finished with error 0 and tester_r 0 2023-07-25T14:35:56.904 INFO:teuthology.orchestra.run:waiting for 300 2023-07-25T14:35:56.926 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi072.front.sepia.ceph.com 2023-07-25T14:35:56.927 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-25T14:35:56.927 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2023-07-25T14:35:56.989 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-25T14:35:57.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.136+0000 7fe56d79a700 1 Processor -- start 2023-07-25T14:35:57.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.136+0000 7fe56d79a700 1 -- start start 2023-07-25T14:35:57.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.137+0000 7fe56d79a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe568151a90 0x7fe568154d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:57.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.137+0000 7fe56d79a700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fe5680bead0 0x7fe5680c0350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:57.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.137+0000 7fe56d79a700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5680bfeb0 con 0x7fe5680c0890 2023-07-25T14:35:57.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.137+0000 7fe56d79a700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5680c10b0 con 0x7fe568151a90 2023-07-25T14:35:57.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.137+0000 7fe56d79a700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5680c1940 con 0x7fe5680bead0 2023-07-25T14:35:57.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.137+0000 7fe566ffd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe568151a90 0x7fe568154d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:57.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.137+0000 7fe566ffd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe568151a90 0x7fe568154d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:39828/0 (socket says 172.21.15.72:39828) 2023-07-25T14:35:57.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.137+0000 7fe566ffd700 1 -- 172.21.15.72:0/30284200 learned_addr learned my addr 172.21.15.72:0/30284200 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:35:57.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.137+0000 7fe5667fc700 1 --2- 172.21.15.72:0/30284200 >> v2:172.21.15.92:3300/0 conn(0x7fe5680bead0 0x7fe5680c0350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:57.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.137+0000 7fe566ffd700 1 -- 172.21.15.72:0/30284200 >> v2:172.21.15.92:3300/0 conn(0x7fe5680bead0 msgr2=0x7fe5680c0350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:35:57.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.137+0000 7fe566ffd700 1 --2- 172.21.15.72:0/30284200 >> v2:172.21.15.92:3300/0 conn(0x7fe5680bead0 0x7fe5680c0350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:57.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.137+0000 7fe566ffd700 1 -- 172.21.15.72:0/30284200 >> v1:172.21.15.92:6789/0 conn(0x7fe5680c0890 legacy=0x7fe5680c44d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:35:57.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.137+0000 7fe566ffd700 1 -- 172.21.15.72:0/30284200 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5680bf2e0 con 0x7fe568151a90 2023-07-25T14:35:57.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.137+0000 7fe566ffd700 1 --2- 172.21.15.72:0/30284200 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe568151a90 0x7fe568154d10 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fe56806cf50 tx=0x7fe55c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c886ad7261b318c7 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:35:57.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.138+0000 7fe565ffb700 1 -- 172.21.15.72:0/30284200 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe55c004230 con 0x7fe568151a90 2023-07-25T14:35:57.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.138+0000 7fe565ffb700 1 -- 172.21.15.72:0/30284200 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe55c004390 con 0x7fe568151a90 2023-07-25T14:35:57.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.138+0000 7fe565ffb700 1 -- 172.21.15.72:0/30284200 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe55c0036a0 con 0x7fe568151a90 2023-07-25T14:35:57.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.138+0000 7fe56d79a700 1 -- 172.21.15.72:0/30284200 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe568151a90 msgr2=0x7fe568154d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:57.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.138+0000 7fe56d79a700 1 --2- 172.21.15.72:0/30284200 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe568151a90 0x7fe568154d10 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fe56806cf50 tx=0x7fe55c009bd0 comp rx=0 tx=0).stop 2023-07-25T14:35:57.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.138+0000 7fe56d79a700 1 -- 172.21.15.72:0/30284200 shutdown_connections 2023-07-25T14:35:57.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.138+0000 7fe56d79a700 1 --2- 172.21.15.72:0/30284200 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe568151a90 0x7fe568154d10 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:57.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.138+0000 7fe56d79a700 1 --2- 172.21.15.72:0/30284200 >> v2:172.21.15.92:3300/0 conn(0x7fe5680bead0 0x7fe5680c0350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:57.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.138+0000 7fe56d79a700 1 -- 172.21.15.72:0/30284200 >> 172.21.15.72:0/30284200 conn(0x7fe56806c3a0 msgr2=0x7fe56806c780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:35:57.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.138+0000 7fe56d79a700 1 -- 172.21.15.72:0/30284200 shutdown_connections 2023-07-25T14:35:57.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.138+0000 7fe56d79a700 1 -- 172.21.15.72:0/30284200 wait complete. 2023-07-25T14:35:57.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.140+0000 7fe56d79a700 1 Processor -- start 2023-07-25T14:35:57.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.140+0000 7fe56d79a700 1 -- start start 2023-07-25T14:35:57.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.140+0000 7fe56d79a700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe5680bead0 0x7fe5681ea4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:57.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.140+0000 7fe56d79a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe5680c0890 0x7fe56814f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:57.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.140+0000 7fe56d79a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe568151a90 0x7fe5680c7950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:57.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.140+0000 7fe56d79a700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe568150250 con 0x7fe568151a90 2023-07-25T14:35:57.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.140+0000 7fe56d79a700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5680c90c0 con 0x7fe5680c0890 2023-07-25T14:35:57.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.140+0000 7fe56d79a700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5681ea9f0 con 0x7fe5680bead0 2023-07-25T14:35:57.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.140+0000 7fe5677fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe568151a90 0x7fe5680c7950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:57.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.140+0000 7fe5677fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe568151a90 0x7fe5680c7950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:39838/0 (socket says 172.21.15.72:39838) 2023-07-25T14:35:57.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.140+0000 7fe5677fe700 1 -- 172.21.15.72:0/353877162 learned_addr learned my addr 172.21.15.72:0/353877162 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:35:57.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.140+0000 7fe5667fc700 1 --2- 172.21.15.72:0/353877162 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe5680c0890 0x7fe56814f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:57.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.140+0000 7fe566ffd700 1 --2- 172.21.15.72:0/353877162 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe5680bead0 0x7fe5681ea4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:57.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.141+0000 7fe5677fe700 1 -- 172.21.15.72:0/353877162 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe5680bead0 msgr2=0x7fe5681ea4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:57.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.141+0000 7fe5677fe700 1 --2- 172.21.15.72:0/353877162 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe5680bead0 0x7fe5681ea4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:57.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.141+0000 7fe5677fe700 1 -- 172.21.15.72:0/353877162 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe5680c0890 msgr2=0x7fe56814f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:57.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.141+0000 7fe5677fe700 1 --2- 172.21.15.72:0/353877162 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe5680c0890 0x7fe56814f3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:57.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.141+0000 7fe5677fe700 1 -- 172.21.15.72:0/353877162 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe55c009550 con 0x7fe568151a90 2023-07-25T14:35:57.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.141+0000 7fe5677fe700 1 --2- 172.21.15.72:0/353877162 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe568151a90 0x7fe5680c7950 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fe56000cc40 tx=0x7fe56000cf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:35:57.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.141+0000 7fe54f7fe700 1 -- 172.21.15.72:0/353877162 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe56000aa80 con 0x7fe568151a90 2023-07-25T14:35:57.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.141+0000 7fe54f7fe700 1 -- 172.21.15.72:0/353877162 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe56000abe0 con 0x7fe568151a90 2023-07-25T14:35:57.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.141+0000 7fe56d79a700 1 -- 172.21.15.72:0/353877162 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5680c9bc0 con 0x7fe568151a90 2023-07-25T14:35:57.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.141+0000 7fe54f7fe700 1 -- 172.21.15.72:0/353877162 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe560012420 con 0x7fe568151a90 2023-07-25T14:35:57.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.141+0000 7fe56d79a700 1 -- 172.21.15.72:0/353877162 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5680c9e60 con 0x7fe568151a90 2023-07-25T14:35:57.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.142+0000 7fe56d79a700 1 -- 172.21.15.72:0/353877162 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5680c9270 con 0x7fe568151a90 2023-07-25T14:35:57.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.142+0000 7fe54f7fe700 1 -- 172.21.15.72:0/353877162 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe560012580 con 0x7fe568151a90 2023-07-25T14:35:57.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.143+0000 7fe54f7fe700 1 --2- 172.21.15.72:0/353877162 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fe55406ace0 0x7fe55406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:57.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.143+0000 7fe54f7fe700 1 -- 172.21.15.72:0/353877162 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fe560089cd0 con 0x7fe568151a90 2023-07-25T14:35:57.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.143+0000 7fe566ffd700 1 --2- 172.21.15.72:0/353877162 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fe55406ace0 0x7fe55406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:57.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.143+0000 7fe566ffd700 1 --2- 172.21.15.72:0/353877162 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fe55406ace0 0x7fe55406d1a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fe55c009130 tx=0x7fe55c008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:35:57.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.147+0000 7fe54f7fe700 1 -- 172.21.15.72:0/353877162 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fe5680c9270 con 0x7fe568151a90 2023-07-25T14:35:57.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.339+0000 7fe56d79a700 1 -- 172.21.15.72:0/353877162 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe5680c9270 con 0x7fe568151a90 2023-07-25T14:35:57.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.340+0000 7fe54f7fe700 1 -- 172.21.15.72:0/353877162 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+20014 (secure 0 0 0) 0x7fe5680c9270 con 0x7fe568151a90 2023-07-25T14:35:57.353 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-25T14:35:57.353 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":25,"fsid":"9170db48-9170-43e8-8ccb-9813e6240906","created":"2023-07-25T14:35:21.733262+0000","modified":"2023-07-25T14:35:44.992669+0000","last_up_change":"2023-07-25T14:35:31.355010+0000","last_in_change":"2023-07-25T14:35:24.195785+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-25T14:35:32.983457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-25T14:35:33.326342+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-25T14:35:37.534158+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-25T14:35:38.891571+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-25T14:35:42.596923+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d517fdad-0bfe-49f0-89f2-9421c3761839","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6801","nonce":2475407414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6803","nonce":2475407414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6807","nonce":2475407414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6805","nonce":2475407414}]},"public_addr":"172.21.15.72:6801/2475407414","cluster_addr":"172.21.15.72:6803/2475407414","heartbeat_back_addr":"172.21.15.72:6807/2475407414","heartbeat_front_addr":"172.21.15.72:6805/2475407414","state":["exists","up"]},{"osd":1,"uuid":"e1564be3-f209-47e5-a8d0-32fc618a474f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6822","nonce":870954016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6825","nonce":870954016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6831","nonce":870954016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6827","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6829","nonce":870954016}]},"public_addr":"172.21.15.72:6822/870954016","cluster_addr":"172.21.15.72:6825/870954016","heartbeat_back_addr":"172.21.15.72:6831/870954016","heartbeat_front_addr":"172.21.15.72:6829/870954016","state":["exists","up"]},{"osd":2,"uuid":"c4647d30-ffa6-417a-9026-ef530c75910e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6809","nonce":2143129442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6811","nonce":2143129442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6815","nonce":2143129442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6813","nonce":2143129442}]},"public_addr":"172.21.15.72:6809/2143129442","cluster_addr":"172.21.15.72:6811/2143129442","heartbeat_back_addr":"172.21.15.72:6815/2143129442","heartbeat_front_addr":"172.21.15.72:6813/2143129442","state":["exists","up"]},{"osd":3,"uuid":"76c9d9a7-c2e2-4612-a58b-d6882dd76b58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6817","nonce":3404066311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6819","nonce":3404066311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6828","nonce":3404066311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6821","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6823","nonce":3404066311}]},"public_addr":"172.21.15.72:6817/3404066311","cluster_addr":"172.21.15.72:6819/3404066311","heartbeat_back_addr":"172.21.15.72:6828/3404066311","heartbeat_front_addr":"172.21.15.72:6823/3404066311","state":["exists","up"]},{"osd":4,"uuid":"7f8920dc-0ad4-4a73-ab40-65408f83eadd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6817","nonce":2381008739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6819","nonce":2381008739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6825","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6827","nonce":2381008739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6822","nonce":2381008739}]},"public_addr":"172.21.15.92:6817/2381008739","cluster_addr":"172.21.15.92:6819/2381008739","heartbeat_back_addr":"172.21.15.92:6827/2381008739","heartbeat_front_addr":"172.21.15.92:6822/2381008739","state":["exists","up"]},{"osd":5,"uuid":"56257e7c-31eb-44c5-9ec7-1318a4e0bb35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6801","nonce":2161935604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6803","nonce":2161935604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6807","nonce":2161935604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6805","nonce":2161935604}]},"public_addr":"172.21.15.92:6801/2161935604","cluster_addr":"172.21.15.92:6803/2161935604","heartbeat_back_addr":"172.21.15.92:6807/2161935604","heartbeat_front_addr":"172.21.15.92:6805/2161935604","state":["exists","up"]},{"osd":6,"uuid":"a150d3d8-a0c9-4955-968a-8d98eff4ffb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6809","nonce":3770163493}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6811","nonce":3770163493}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6815","nonce":3770163493}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6813","nonce":3770163493}]},"public_addr":"172.21.15.92:6809/3770163493","cluster_addr":"172.21.15.92:6811/3770163493","heartbeat_back_addr":"172.21.15.92:6815/3770163493","heartbeat_front_addr":"172.21.15.92:6813/3770163493","state":["exists","up"]},{"osd":7,"uuid":"07799c27-54ee-4591-a42d-a978d6b32065","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6821","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6823","nonce":2135777609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6826","nonce":2135777609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6831","nonce":2135777609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6829","nonce":2135777609}]},"public_addr":"172.21.15.92:6823/2135777609","cluster_addr":"172.21.15.92:6826/2135777609","heartbeat_back_addr":"172.21.15.92:6831/2135777609","heartbeat_front_addr":"172.21.15.92:6829/2135777609","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.345365+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.378150+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.146566+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.372172+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:30.398421+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.385632+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.465611+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.443583+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-25T14:35:57.355 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.342+0000 7fe56d79a700 1 -- 172.21.15.72:0/353877162 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fe55406ace0 msgr2=0x7fe55406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:57.355 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.342+0000 7fe56d79a700 1 --2- 172.21.15.72:0/353877162 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fe55406ace0 0x7fe55406d1a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fe55c009130 tx=0x7fe55c008030 comp rx=0 tx=0).stop 2023-07-25T14:35:57.355 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.342+0000 7fe56d79a700 1 -- 172.21.15.72:0/353877162 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe568151a90 msgr2=0x7fe5680c7950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:57.355 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.342+0000 7fe56d79a700 1 --2- 172.21.15.72:0/353877162 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe568151a90 0x7fe5680c7950 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fe56000cc40 tx=0x7fe56000cf50 comp rx=0 tx=0).stop 2023-07-25T14:35:57.355 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.342+0000 7fe56d79a700 1 -- 172.21.15.72:0/353877162 shutdown_connections 2023-07-25T14:35:57.355 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.342+0000 7fe56d79a700 1 --2- 172.21.15.72:0/353877162 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fe55406ace0 0x7fe55406d1a0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:57.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.342+0000 7fe56d79a700 1 --2- 172.21.15.72:0/353877162 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe5680bead0 0x7fe5681ea4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:57.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.342+0000 7fe56d79a700 1 --2- 172.21.15.72:0/353877162 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe568151a90 0x7fe5680c7950 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:57.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.342+0000 7fe56d79a700 1 --2- 172.21.15.72:0/353877162 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe5680c0890 0x7fe56814f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:57.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.342+0000 7fe56d79a700 1 -- 172.21.15.72:0/353877162 >> 172.21.15.72:0/353877162 conn(0x7fe56806c3a0 msgr2=0x7fe568152970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:35:57.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.342+0000 7fe56d79a700 1 -- 172.21.15.72:0/353877162 shutdown_connections 2023-07-25T14:35:57.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.342+0000 7fe56d79a700 1 -- 172.21.15.72:0/353877162 wait complete. 2023-07-25T14:35:57.367 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-25T14:35:57.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.474+0000 7fa88e80f700 1 Processor -- start 2023-07-25T14:35:57.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.474+0000 7fa88e80f700 1 -- start start 2023-07-25T14:35:57.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.475+0000 7fa88e80f700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa8880c5f40 0x7fa888154640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:57.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.475+0000 7fa88e80f700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa8880ba0e0 0x7fa888154b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:57.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.475+0000 7fa88e80f700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8880c54f0 con 0x7fa888151ba0 2023-07-25T14:35:57.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.475+0000 7fa88e80f700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8880c6670 con 0x7fa8880c5f40 2023-07-25T14:35:57.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.475+0000 7fa88e80f700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8880c5740 con 0x7fa8880ba0e0 2023-07-25T14:35:57.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.475+0000 7fa8877fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa8880c5f40 0x7fa888154640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:57.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.475+0000 7fa8877fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa8880c5f40 0x7fa888154640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:39844/0 (socket says 172.21.15.72:39844) 2023-07-25T14:35:57.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.475+0000 7fa8877fe700 1 -- 172.21.15.72:0/945299084 learned_addr learned my addr 172.21.15.72:0/945299084 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:35:57.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.475+0000 7fa887fff700 1 --1- 172.21.15.72:0/945299084 >> v1:172.21.15.72:6789/0 conn(0x7fa888151ba0 0x7fa8880c2230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:58810/0 (socket says 172.21.15.72:58810) 2023-07-25T14:35:57.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.475+0000 7fa8877fe700 1 -- 172.21.15.72:0/945299084 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa8880ba0e0 msgr2=0x7fa888154b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:35:57.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.475+0000 7fa8877fe700 1 --2- 172.21.15.72:0/945299084 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa8880ba0e0 0x7fa888154b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:57.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.475+0000 7fa8877fe700 1 -- 172.21.15.72:0/945299084 >> v1:172.21.15.72:6789/0 conn(0x7fa888151ba0 legacy=0x7fa8880c2230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:57.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.475+0000 7fa8877fe700 1 -- 172.21.15.72:0/945299084 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8880c5a20 con 0x7fa8880c5f40 2023-07-25T14:35:57.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.475+0000 7fa886ffd700 1 -- 172.21.15.72:0/945299084 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1201080391 0 0) 0x7fa8880c54f0 con 0x7fa888151ba0 2023-07-25T14:35:57.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.475+0000 7fa8877fe700 1 --2- 172.21.15.72:0/945299084 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa8880c5f40 0x7fa888154640 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fa87c0098f0 tx=0x7fa87c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d88b73cbf49f10d server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:35:57.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.476+0000 7fa886ffd700 1 -- 172.21.15.72:0/945299084 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa87c00b8a0 con 0x7fa8880c5f40 2023-07-25T14:35:57.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.476+0000 7fa886ffd700 1 -- 172.21.15.72:0/945299084 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa87c00ba00 con 0x7fa8880c5f40 2023-07-25T14:35:57.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.476+0000 7fa886ffd700 1 -- 172.21.15.72:0/945299084 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa87c00bd90 con 0x7fa8880c5f40 2023-07-25T14:35:57.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.476+0000 7fa88e80f700 1 -- 172.21.15.72:0/945299084 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa8880c5f40 msgr2=0x7fa888154640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:57.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.476+0000 7fa88e80f700 1 --2- 172.21.15.72:0/945299084 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa8880c5f40 0x7fa888154640 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fa87c0098f0 tx=0x7fa87c009c00 comp rx=0 tx=0).stop 2023-07-25T14:35:57.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.476+0000 7fa88e80f700 1 -- 172.21.15.72:0/945299084 shutdown_connections 2023-07-25T14:35:57.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.476+0000 7fa88e80f700 1 --2- 172.21.15.72:0/945299084 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa8880ba0e0 0x7fa888154b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:57.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.476+0000 7fa88e80f700 1 --2- 172.21.15.72:0/945299084 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa8880c5f40 0x7fa888154640 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:57.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.476+0000 7fa88e80f700 1 -- 172.21.15.72:0/945299084 >> 172.21.15.72:0/945299084 conn(0x7fa8880a87e0 msgr2=0x7fa8880a8bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:35:57.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.476+0000 7fa88e80f700 1 -- 172.21.15.72:0/945299084 shutdown_connections 2023-07-25T14:35:57.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.476+0000 7fa88e80f700 1 -- 172.21.15.72:0/945299084 wait complete. 2023-07-25T14:35:57.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.477+0000 7fa88e80f700 1 Processor -- start 2023-07-25T14:35:57.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.478+0000 7fa88e80f700 1 -- start start 2023-07-25T14:35:57.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.478+0000 7fa88e80f700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa8880ba0e0 0x7fa888152dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:57.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.478+0000 7fa88e80f700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa8880c5f40 0x7fa8881eaf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:57.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.478+0000 7fa88e80f700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa888151ba0 0x7fa8881eb4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:57.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.478+0000 7fa88e80f700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8880bfd10 con 0x7fa888151ba0 2023-07-25T14:35:57.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.478+0000 7fa88e80f700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8881e8000 con 0x7fa8880ba0e0 2023-07-25T14:35:57.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.478+0000 7fa88e80f700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8881eab40 con 0x7fa8880c5f40 2023-07-25T14:35:57.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.478+0000 7fa88cdac700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa888151ba0 0x7fa8881eb4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:57.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.478+0000 7fa88cdac700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa888151ba0 0x7fa8881eb4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:39852/0 (socket says 172.21.15.72:39852) 2023-07-25T14:35:57.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.478+0000 7fa88cdac700 1 -- 172.21.15.72:0/1293665518 learned_addr learned my addr 172.21.15.72:0/1293665518 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:35:57.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.478+0000 7fa887fff700 1 --2- 172.21.15.72:0/1293665518 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa8880ba0e0 0x7fa888152dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:57.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.478+0000 7fa8877fe700 1 --2- 172.21.15.72:0/1293665518 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa8880c5f40 0x7fa8881eaf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:57.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.479+0000 7fa88cdac700 1 -- 172.21.15.72:0/1293665518 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa8880c5f40 msgr2=0x7fa8881eaf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:57.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.479+0000 7fa88cdac700 1 --2- 172.21.15.72:0/1293665518 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa8880c5f40 0x7fa8881eaf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:57.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.479+0000 7fa88cdac700 1 -- 172.21.15.72:0/1293665518 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa8880ba0e0 msgr2=0x7fa888152dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:57.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.479+0000 7fa88cdac700 1 --2- 172.21.15.72:0/1293665518 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa8880ba0e0 0x7fa888152dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:57.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.479+0000 7fa88cdac700 1 -- 172.21.15.72:0/1293665518 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa87c009550 con 0x7fa888151ba0 2023-07-25T14:35:57.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.479+0000 7fa88cdac700 1 --2- 172.21.15.72:0/1293665518 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa888151ba0 0x7fa8881eb4d0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fa88000b9e0 tx=0x7fa88000bcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:35:57.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.479+0000 7fa884ff9700 1 -- 172.21.15.72:0/1293665518 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa88000d8e0 con 0x7fa888151ba0 2023-07-25T14:35:57.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.479+0000 7fa884ff9700 1 -- 172.21.15.72:0/1293665518 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa88000da80 con 0x7fa888151ba0 2023-07-25T14:35:57.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.479+0000 7fa88e80f700 1 -- 172.21.15.72:0/1293665518 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8880ac130 con 0x7fa888151ba0 2023-07-25T14:35:57.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.479+0000 7fa884ff9700 1 -- 172.21.15.72:0/1293665518 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa88000de30 con 0x7fa888151ba0 2023-07-25T14:35:57.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.479+0000 7fa88e80f700 1 -- 172.21.15.72:0/1293665518 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8880bdb00 con 0x7fa888151ba0 2023-07-25T14:35:57.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.480+0000 7fa88e80f700 1 -- 172.21.15.72:0/1293665518 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8881eacb0 con 0x7fa888151ba0 2023-07-25T14:35:57.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.480+0000 7fa884ff9700 1 -- 172.21.15.72:0/1293665518 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa880015420 con 0x7fa888151ba0 2023-07-25T14:35:57.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.481+0000 7fa884ff9700 1 --2- 172.21.15.72:0/1293665518 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fa87406ace0 0x7fa87406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:57.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.481+0000 7fa884ff9700 1 -- 172.21.15.72:0/1293665518 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fa880011070 con 0x7fa888151ba0 2023-07-25T14:35:57.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.481+0000 7fa887fff700 1 --2- 172.21.15.72:0/1293665518 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fa87406ace0 0x7fa87406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:57.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.481+0000 7fa887fff700 1 --2- 172.21.15.72:0/1293665518 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fa87406ace0 0x7fa87406d1a0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa878000f60 tx=0x7fa878007e70 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:35:57.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.485+0000 7fa884ff9700 1 -- 172.21.15.72:0/1293665518 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fa88004e310 con 0x7fa888151ba0 2023-07-25T14:35:57.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.674+0000 7fa88e80f700 1 -- 172.21.15.72:0/1293665518 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa88804e470 con 0x7fa888151ba0 2023-07-25T14:35:57.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.675+0000 7fa884ff9700 1 -- 172.21.15.72:0/1293665518 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+20014 (secure 0 0 0) 0x7fa8881eacb0 con 0x7fa888151ba0 2023-07-25T14:35:57.688 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-25T14:35:57.688 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":25,"fsid":"9170db48-9170-43e8-8ccb-9813e6240906","created":"2023-07-25T14:35:21.733262+0000","modified":"2023-07-25T14:35:44.992669+0000","last_up_change":"2023-07-25T14:35:31.355010+0000","last_in_change":"2023-07-25T14:35:24.195785+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-25T14:35:32.983457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-25T14:35:33.326342+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-25T14:35:37.534158+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-25T14:35:38.891571+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-25T14:35:42.596923+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d517fdad-0bfe-49f0-89f2-9421c3761839","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6801","nonce":2475407414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6803","nonce":2475407414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6807","nonce":2475407414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6805","nonce":2475407414}]},"public_addr":"172.21.15.72:6801/2475407414","cluster_addr":"172.21.15.72:6803/2475407414","heartbeat_back_addr":"172.21.15.72:6807/2475407414","heartbeat_front_addr":"172.21.15.72:6805/2475407414","state":["exists","up"]},{"osd":1,"uuid":"e1564be3-f209-47e5-a8d0-32fc618a474f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6822","nonce":870954016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6825","nonce":870954016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6831","nonce":870954016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6827","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6829","nonce":870954016}]},"public_addr":"172.21.15.72:6822/870954016","cluster_addr":"172.21.15.72:6825/870954016","heartbeat_back_addr":"172.21.15.72:6831/870954016","heartbeat_front_addr":"172.21.15.72:6829/870954016","state":["exists","up"]},{"osd":2,"uuid":"c4647d30-ffa6-417a-9026-ef530c75910e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6809","nonce":2143129442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6811","nonce":2143129442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6815","nonce":2143129442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6813","nonce":2143129442}]},"public_addr":"172.21.15.72:6809/2143129442","cluster_addr":"172.21.15.72:6811/2143129442","heartbeat_back_addr":"172.21.15.72:6815/2143129442","heartbeat_front_addr":"172.21.15.72:6813/2143129442","state":["exists","up"]},{"osd":3,"uuid":"76c9d9a7-c2e2-4612-a58b-d6882dd76b58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6817","nonce":3404066311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6819","nonce":3404066311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6828","nonce":3404066311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6821","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6823","nonce":3404066311}]},"public_addr":"172.21.15.72:6817/3404066311","cluster_addr":"172.21.15.72:6819/3404066311","heartbeat_back_addr":"172.21.15.72:6828/3404066311","heartbeat_front_addr":"172.21.15.72:6823/3404066311","state":["exists","up"]},{"osd":4,"uuid":"7f8920dc-0ad4-4a73-ab40-65408f83eadd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6817","nonce":2381008739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6819","nonce":2381008739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6825","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6827","nonce":2381008739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6822","nonce":2381008739}]},"public_addr":"172.21.15.92:6817/2381008739","cluster_addr":"172.21.15.92:6819/2381008739","heartbeat_back_addr":"172.21.15.92:6827/2381008739","heartbeat_front_addr":"172.21.15.92:6822/2381008739","state":["exists","up"]},{"osd":5,"uuid":"56257e7c-31eb-44c5-9ec7-1318a4e0bb35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6801","nonce":2161935604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6803","nonce":2161935604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6807","nonce":2161935604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6805","nonce":2161935604}]},"public_addr":"172.21.15.92:6801/2161935604","cluster_addr":"172.21.15.92:6803/2161935604","heartbeat_back_addr":"172.21.15.92:6807/2161935604","heartbeat_front_addr":"172.21.15.92:6805/2161935604","state":["exists","up"]},{"osd":6,"uuid":"a150d3d8-a0c9-4955-968a-8d98eff4ffb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6809","nonce":3770163493}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6811","nonce":3770163493}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6815","nonce":3770163493}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6813","nonce":3770163493}]},"public_addr":"172.21.15.92:6809/3770163493","cluster_addr":"172.21.15.92:6811/3770163493","heartbeat_back_addr":"172.21.15.92:6815/3770163493","heartbeat_front_addr":"172.21.15.92:6813/3770163493","state":["exists","up"]},{"osd":7,"uuid":"07799c27-54ee-4591-a42d-a978d6b32065","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6821","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6823","nonce":2135777609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6826","nonce":2135777609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6831","nonce":2135777609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6829","nonce":2135777609}]},"public_addr":"172.21.15.92:6823/2135777609","cluster_addr":"172.21.15.92:6826/2135777609","heartbeat_back_addr":"172.21.15.92:6831/2135777609","heartbeat_front_addr":"172.21.15.92:6829/2135777609","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.345365+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.378150+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.146566+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.372172+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:30.398421+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.385632+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.465611+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.443583+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-25T14:35:57.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.677+0000 7fa88e80f700 1 -- 172.21.15.72:0/1293665518 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fa87406ace0 msgr2=0x7fa87406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:57.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.677+0000 7fa88e80f700 1 --2- 172.21.15.72:0/1293665518 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fa87406ace0 0x7fa87406d1a0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa878000f60 tx=0x7fa878007e70 comp rx=0 tx=0).stop 2023-07-25T14:35:57.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.677+0000 7fa88e80f700 1 -- 172.21.15.72:0/1293665518 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa888151ba0 msgr2=0x7fa8881eb4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:57.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.677+0000 7fa88e80f700 1 --2- 172.21.15.72:0/1293665518 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa888151ba0 0x7fa8881eb4d0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fa88000b9e0 tx=0x7fa88000bcf0 comp rx=0 tx=0).stop 2023-07-25T14:35:57.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.677+0000 7fa88e80f700 1 -- 172.21.15.72:0/1293665518 shutdown_connections 2023-07-25T14:35:57.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.677+0000 7fa88e80f700 1 --2- 172.21.15.72:0/1293665518 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fa87406ace0 0x7fa87406d1a0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:57.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.677+0000 7fa88e80f700 1 --2- 172.21.15.72:0/1293665518 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa888151ba0 0x7fa8881eb4d0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:57.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.677+0000 7fa88e80f700 1 --2- 172.21.15.72:0/1293665518 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa8880ba0e0 0x7fa888152dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:57.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.677+0000 7fa88e80f700 1 --2- 172.21.15.72:0/1293665518 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa8880c5f40 0x7fa8881eaf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:57.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.677+0000 7fa88e80f700 1 -- 172.21.15.72:0/1293665518 >> 172.21.15.72:0/1293665518 conn(0x7fa8880a87e0 msgr2=0x7fa8881506b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:35:57.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.677+0000 7fa88e80f700 1 -- 172.21.15.72:0/1293665518 shutdown_connections 2023-07-25T14:35:57.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.677+0000 7fa88e80f700 1 -- 172.21.15.72:0/1293665518 wait complete. 2023-07-25T14:35:57.702 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-07-25T14:35:57.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.812+0000 7f7479010700 1 Processor -- start 2023-07-25T14:35:57.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.812+0000 7f7479010700 1 -- start start 2023-07-25T14:35:57.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.813+0000 7f7479010700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7474151950 0x7f747406a190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:57.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.813+0000 7f7479010700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f747406a6d0 0x7f74740c3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:57.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.813+0000 7f7479010700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74740c2fe0 con 0x7f74740724c0 2023-07-25T14:35:57.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.813+0000 7f7479010700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7474071a60 con 0x7f747406a6d0 2023-07-25T14:35:57.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.813+0000 7f7479010700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74740c2a70 con 0x7f7474151950 2023-07-25T14:35:57.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.813+0000 7f747259c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f74740724c0 0x7f74740c34c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:58824/0 (socket says 172.21.15.72:58824) 2023-07-25T14:35:57.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.813+0000 7f747259c700 1 -- 172.21.15.72:0/1858496891 learned_addr learned my addr 172.21.15.72:0/1858496891 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:35:57.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.813+0000 7f7472d9d700 1 --2- 172.21.15.72:0/1858496891 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7474151950 0x7f747406a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:57.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.813+0000 7f747359e700 1 --2- 172.21.15.72:0/1858496891 >> v2:172.21.15.92:3300/0 conn(0x7f747406a6d0 0x7f74740c3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:57.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.813+0000 7f7471d9b700 1 -- 172.21.15.72:0/1858496891 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2739312054 0 0) 0x7f74740c2fe0 con 0x7f74740724c0 2023-07-25T14:35:57.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.813+0000 7f7471d9b700 1 -- 172.21.15.72:0/1858496891 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f745c0035b0 con 0x7f74740724c0 2023-07-25T14:35:57.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.814+0000 7f7471d9b700 1 -- 172.21.15.72:0/1858496891 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3001716858 0 0) 0x7f745c0035b0 con 0x7f74740724c0 2023-07-25T14:35:57.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.814+0000 7f7471d9b700 1 -- 172.21.15.72:0/1858496891 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7474151950 msgr2=0x7f747406a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:35:57.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.814+0000 7f7471d9b700 1 --2- 172.21.15.72:0/1858496891 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7474151950 0x7f747406a190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:57.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.814+0000 7f7471d9b700 1 -- 172.21.15.72:0/1858496891 >> v2:172.21.15.92:3300/0 conn(0x7f747406a6d0 msgr2=0x7f74740c3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:35:57.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.814+0000 7f7471d9b700 1 --2- 172.21.15.72:0/1858496891 >> v2:172.21.15.92:3300/0 conn(0x7f747406a6d0 0x7f74740c3bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:57.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.814+0000 7f7471d9b700 1 -- 172.21.15.72:0/1858496891 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7474155070 con 0x7f74740724c0 2023-07-25T14:35:57.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.814+0000 7f7471d9b700 1 -- 172.21.15.72:0/1858496891 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2559588315 0 0) 0x7f7464001670 con 0x7f74740724c0 2023-07-25T14:35:57.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.814+0000 7f747359e700 1 --2- 172.21.15.72:0/1858496891 >> v2:172.21.15.92:3300/0 conn(0x7f747406a6d0 0x7f74740c3bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-25T14:35:57.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.814+0000 7f7472d9d700 1 --2- 172.21.15.72:0/1858496891 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7474151950 0x7f747406a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-25T14:35:57.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.814+0000 7f7471d9b700 1 -- 172.21.15.72:0/1858496891 >> v1:172.21.15.72:6789/0 conn(0x7f74740724c0 legacy=0x7f74740c34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:57.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.814+0000 7f7471d9b700 1 --2- 172.21.15.72:0/1858496891 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f745c003a00 0x7f745c003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:57.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.814+0000 7f7471d9b700 1 --2- 172.21.15.72:0/1858496891 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7474151950 0x7f745c004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:57.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.814+0000 7f7471d9b700 1 --2- 172.21.15.72:0/1858496891 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f745c004d90 0x7f745c005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:57.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.814+0000 7f7471d9b700 1 -- 172.21.15.72:0/1858496891 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7474071a60 con 0x7f745c003a00 2023-07-25T14:35:57.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.814+0000 7f7471d9b700 1 -- 172.21.15.72:0/1858496891 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f745c00ba10 con 0x7f745c004d90 2023-07-25T14:35:57.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.814+0000 7f7471d9b700 1 -- 172.21.15.72:0/1858496891 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f745c00bb50 con 0x7f7474151950 2023-07-25T14:35:57.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.814+0000 7f7472d9d700 1 --2- 172.21.15.72:0/1858496891 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f745c003a00 0x7f745c003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:57.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.814+0000 7f747259c700 1 --2- 172.21.15.72:0/1858496891 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7474151950 0x7f745c004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:57.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.814+0000 7f747359e700 1 --2- 172.21.15.72:0/1858496891 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f745c004d90 0x7f745c005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:57.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.814+0000 7f7472d9d700 1 -- 172.21.15.72:0/1858496891 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7474151950 msgr2=0x7f745c004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:35:57.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.814+0000 7f7472d9d700 1 --2- 172.21.15.72:0/1858496891 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7474151950 0x7f745c004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:57.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.814+0000 7f7472d9d700 1 -- 172.21.15.72:0/1858496891 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f745c004d90 msgr2=0x7f745c005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:35:57.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.814+0000 7f7472d9d700 1 --2- 172.21.15.72:0/1858496891 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f745c004d90 0x7f745c005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:57.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.814+0000 7f7472d9d700 1 -- 172.21.15.72:0/1858496891 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74680094a0 con 0x7f745c003a00 2023-07-25T14:35:57.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.814+0000 7f7472d9d700 1 --2- 172.21.15.72:0/1858496891 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f745c003a00 0x7f745c003e20 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f7468009d30 tx=0x7f745c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=889d698c0a857e25 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:35:57.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.814+0000 7f7471d9b700 1 -- 172.21.15.72:0/1858496891 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7468009e80 con 0x7f745c003a00 2023-07-25T14:35:57.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.814+0000 7f7471d9b700 1 -- 172.21.15.72:0/1858496891 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f746800e940 con 0x7f745c003a00 2023-07-25T14:35:57.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.814+0000 7f7471d9b700 1 -- 172.21.15.72:0/1858496891 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f746800ecb0 con 0x7f745c003a00 2023-07-25T14:35:57.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.815+0000 7f7479010700 1 -- 172.21.15.72:0/1858496891 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f745c003a00 msgr2=0x7f745c003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:57.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.815+0000 7f7479010700 1 --2- 172.21.15.72:0/1858496891 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f745c003a00 0x7f745c003e20 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f7468009d30 tx=0x7f745c005880 comp rx=0 tx=0).stop 2023-07-25T14:35:57.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.815+0000 7f747359e700 1 -- 172.21.15.72:0/1858496891 reap_dead start 2023-07-25T14:35:57.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.815+0000 7f7479010700 1 -- 172.21.15.72:0/1858496891 shutdown_connections 2023-07-25T14:35:57.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.815+0000 7f7479010700 1 -- 172.21.15.72:0/1858496891 >> 172.21.15.72:0/1858496891 conn(0x7f74740a87e0 msgr2=0x7f74740a8bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:35:57.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.815+0000 7f7479010700 1 -- 172.21.15.72:0/1858496891 shutdown_connections 2023-07-25T14:35:57.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.815+0000 7f7479010700 1 -- 172.21.15.72:0/1858496891 wait complete. 2023-07-25T14:35:57.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.816+0000 7f7479010700 1 Processor -- start 2023-07-25T14:35:57.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.816+0000 7f7479010700 1 -- start start 2023-07-25T14:35:57.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.817+0000 7f7479010700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f745c003a00 0x7f74740bdce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:57.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.817+0000 7f7479010700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f747406fdd0 0x7f74741532f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:57.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.817+0000 7f7479010700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7474153830 0x7f74741ed120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:57.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.817+0000 7f7479010700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74740be640 con 0x7f747406fdd0 2023-07-25T14:35:57.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.817+0000 7f7479010700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74740be8e0 con 0x7f745c003a00 2023-07-25T14:35:57.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.817+0000 7f7479010700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74741ea6d0 con 0x7f7474153830 2023-07-25T14:35:57.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.817+0000 7f747259c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f747406fdd0 0x7f74741532f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:57.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.817+0000 7f747259c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f747406fdd0 0x7f74741532f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:39870/0 (socket says 172.21.15.72:39870) 2023-07-25T14:35:57.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.817+0000 7f747259c700 1 -- 172.21.15.72:0/3412116624 learned_addr learned my addr 172.21.15.72:0/3412116624 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:35:57.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.817+0000 7f747359e700 1 --2- 172.21.15.72:0/3412116624 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7474153830 0x7f74741ed120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:57.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.817+0000 7f7472d9d700 1 --2- 172.21.15.72:0/3412116624 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f745c003a00 0x7f74740bdce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:57.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.817+0000 7f747259c700 1 -- 172.21.15.72:0/3412116624 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7474153830 msgr2=0x7f74741ed120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:57.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.817+0000 7f747259c700 1 --2- 172.21.15.72:0/3412116624 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7474153830 0x7f74741ed120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:57.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.817+0000 7f747259c700 1 -- 172.21.15.72:0/3412116624 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f745c003a00 msgr2=0x7f74740bdce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:57.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.817+0000 7f747259c700 1 --2- 172.21.15.72:0/3412116624 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f745c003a00 0x7f74740bdce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:57.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.817+0000 7f747259c700 1 -- 172.21.15.72:0/3412116624 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74740c5450 con 0x7f747406fdd0 2023-07-25T14:35:57.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.818+0000 7f747259c700 1 --2- 172.21.15.72:0/3412116624 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f747406fdd0 0x7f74741532f0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f7464007340 tx=0x7f7464007650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:35:57.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.818+0000 7f745b7fe700 1 -- 172.21.15.72:0/3412116624 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f746400f6c0 con 0x7f747406fdd0 2023-07-25T14:35:57.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.818+0000 7f745b7fe700 1 -- 172.21.15.72:0/3412116624 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f746400f820 con 0x7f747406fdd0 2023-07-25T14:35:57.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.818+0000 7f7479010700 1 -- 172.21.15.72:0/3412116624 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74741559c0 con 0x7f747406fdd0 2023-07-25T14:35:57.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.818+0000 7f745b7fe700 1 -- 172.21.15.72:0/3412116624 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f746400fbb0 con 0x7f747406fdd0 2023-07-25T14:35:57.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.818+0000 7f7479010700 1 -- 172.21.15.72:0/3412116624 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74740c08f0 con 0x7f747406fdd0 2023-07-25T14:35:57.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.819+0000 7f745b7fe700 1 -- 172.21.15.72:0/3412116624 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f746400fd10 con 0x7f747406fdd0 2023-07-25T14:35:57.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.819+0000 7f7479010700 1 -- 172.21.15.72:0/3412116624 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7474153140 con 0x7f747406fdd0 2023-07-25T14:35:57.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.820+0000 7f745b7fe700 1 --2- 172.21.15.72:0/3412116624 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f746006ad10 0x7f746006d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:57.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.820+0000 7f745b7fe700 1 -- 172.21.15.72:0/3412116624 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f74640895a0 con 0x7f747406fdd0 2023-07-25T14:35:57.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.820+0000 7f7472d9d700 1 --2- 172.21.15.72:0/3412116624 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f746006ad10 0x7f746006d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:57.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.820+0000 7f7472d9d700 1 --2- 172.21.15.72:0/3412116624 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f746006ad10 0x7f746006d1d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f74680090b0 tx=0x7f746801f040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:35:57.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:57.824+0000 7f745b7fe700 1 -- 172.21.15.72:0/3412116624 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f74640543f0 con 0x7f747406fdd0 2023-07-25T14:35:58.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:58.056+0000 7f7479010700 1 -- 172.21.15.72:0/3412116624 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f747404e470 con 0x7f747406fdd0 2023-07-25T14:35:58.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:58.628+0000 7f745b7fe700 1 -- 172.21.15.72:0/3412116624 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) v1 ==== 118+0+0 (secure 0 0 0) 0x7f7464057a10 con 0x7f747406fdd0 2023-07-25T14:35:58.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:58.631+0000 7f7479010700 1 -- 172.21.15.72:0/3412116624 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f746006ad10 msgr2=0x7f746006d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:58.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:58.631+0000 7f7479010700 1 --2- 172.21.15.72:0/3412116624 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f746006ad10 0x7f746006d1d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f74680090b0 tx=0x7f746801f040 comp rx=0 tx=0).stop 2023-07-25T14:35:58.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:58.631+0000 7f7479010700 1 -- 172.21.15.72:0/3412116624 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f747406fdd0 msgr2=0x7f74741532f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:58.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:58.631+0000 7f7479010700 1 --2- 172.21.15.72:0/3412116624 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f747406fdd0 0x7f74741532f0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f7464007340 tx=0x7f7464007650 comp rx=0 tx=0).stop 2023-07-25T14:35:58.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:58.631+0000 7f7479010700 1 -- 172.21.15.72:0/3412116624 shutdown_connections 2023-07-25T14:35:58.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:58.631+0000 7f7479010700 1 --2- 172.21.15.72:0/3412116624 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f746006ad10 0x7f746006d1d0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:58.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:58.631+0000 7f7479010700 1 --2- 172.21.15.72:0/3412116624 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7474153830 0x7f74741ed120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:58.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:58.631+0000 7f7479010700 1 --2- 172.21.15.72:0/3412116624 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f745c003a00 0x7f74740bdce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:58.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:58.631+0000 7f7479010700 1 --2- 172.21.15.72:0/3412116624 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f747406fdd0 0x7f74741532f0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:58.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:58.631+0000 7f7479010700 1 -- 172.21.15.72:0/3412116624 >> 172.21.15.72:0/3412116624 conn(0x7f74740a87e0 msgr2=0x7f7474150b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:35:58.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:58.631+0000 7f7479010700 1 -- 172.21.15.72:0/3412116624 shutdown_connections 2023-07-25T14:35:58.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:58.631+0000 7f7479010700 1 -- 172.21.15.72:0/3412116624 wait complete. 2023-07-25T14:35:58.655 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']} 2023-07-25T14:35:58.656 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-07-25T14:35:58.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:58.766+0000 7f3e1ec0b700 1 Processor -- start 2023-07-25T14:35:58.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:58.766+0000 7f3e1ec0b700 1 -- start start 2023-07-25T14:35:58.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:58.767+0000 7f3e1ec0b700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f3e1814dea0 0x7f3e1806a190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:58.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:58.767+0000 7f3e1ec0b700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3e180a86c0 0x7f3e180c0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:58.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:58.767+0000 7f3e1ec0b700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e180a8230 con 0x7f3e18072300 2023-07-25T14:35:58.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:58.767+0000 7f3e1ec0b700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e180c18d0 con 0x7f3e1814dea0 2023-07-25T14:35:58.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:58.767+0000 7f3e1ec0b700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e1806ea10 con 0x7f3e180a86c0 2023-07-25T14:35:58.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:58.767+0000 7f3e17fff700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f3e18072300 0x7f3e18151200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:58846/0 (socket says 172.21.15.72:58846) 2023-07-25T14:35:58.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:58.767+0000 7f3e17fff700 1 -- 172.21.15.72:0/2973438562 learned_addr learned my addr 172.21.15.72:0/2973438562 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:35:58.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:58.767+0000 7f3e1d1a8700 1 --2- 172.21.15.72:0/2973438562 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3e180a86c0 0x7f3e180c0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:58.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:58.767+0000 7f3e1c9a7700 1 --2- 172.21.15.72:0/2973438562 >> v2:172.21.15.92:3300/0 conn(0x7f3e1814dea0 0x7f3e1806a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:58.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:58.768+0000 7f3e177fe700 1 -- 172.21.15.72:0/2973438562 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3627713931 0 0) 0x7f3e180a8230 con 0x7f3e18072300 2023-07-25T14:35:58.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:58.768+0000 7f3e177fe700 1 -- 172.21.15.72:0/2973438562 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3e080035b0 con 0x7f3e18072300 2023-07-25T14:35:58.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:58.768+0000 7f3e177fe700 1 -- 172.21.15.72:0/2973438562 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3362299583 0 0) 0x7f3e080035b0 con 0x7f3e18072300 2023-07-25T14:35:58.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:58.768+0000 7f3e177fe700 1 -- 172.21.15.72:0/2973438562 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3e180a86c0 msgr2=0x7f3e180c0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:35:58.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:58.768+0000 7f3e177fe700 1 --2- 172.21.15.72:0/2973438562 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3e180a86c0 0x7f3e180c0bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:58.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:58.768+0000 7f3e177fe700 1 -- 172.21.15.72:0/2973438562 >> v2:172.21.15.92:3300/0 conn(0x7f3e1814dea0 msgr2=0x7f3e1806a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:35:58.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:58.768+0000 7f3e177fe700 1 --2- 172.21.15.72:0/2973438562 >> v2:172.21.15.92:3300/0 conn(0x7f3e1814dea0 0x7f3e1806a190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:58.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:58.768+0000 7f3e177fe700 1 -- 172.21.15.72:0/2973438562 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e180a7c20 con 0x7f3e18072300 2023-07-25T14:35:58.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:58.768+0000 7f3e177fe700 1 -- 172.21.15.72:0/2973438562 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2559588315 0 0) 0x7f3e04001670 con 0x7f3e18072300 2023-07-25T14:35:58.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:58.768+0000 7f3e177fe700 1 -- 172.21.15.72:0/2973438562 >> v1:172.21.15.72:6789/0 conn(0x7f3e18072300 legacy=0x7f3e18151200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:58.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:58.768+0000 7f3e177fe700 1 --2- 172.21.15.72:0/2973438562 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3e180a86c0 0x7f3e08003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:58.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:58.768+0000 7f3e177fe700 1 --2- 172.21.15.72:0/2973438562 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3e08003f80 0x7f3e08004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:58.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:58.768+0000 7f3e177fe700 1 --2- 172.21.15.72:0/2973438562 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3e08004d90 0x7f3e08005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:58.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:58.768+0000 7f3e177fe700 1 -- 172.21.15.72:0/2973438562 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e180c18d0 con 0x7f3e08003f80 2023-07-25T14:35:58.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:58.768+0000 7f3e177fe700 1 -- 172.21.15.72:0/2973438562 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e1806ea10 con 0x7f3e08004d90 2023-07-25T14:35:58.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:58.768+0000 7f3e177fe700 1 -- 172.21.15.72:0/2973438562 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e0800dd00 con 0x7f3e180a86c0 2023-07-25T14:35:58.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:58.768+0000 7f3e17fff700 1 --2- 172.21.15.72:0/2973438562 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3e08003f80 0x7f3e08004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:58.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:58.768+0000 7f3e1c9a7700 1 --2- 172.21.15.72:0/2973438562 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3e180a86c0 0x7f3e08003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:58.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:58.768+0000 7f3e1d1a8700 1 --2- 172.21.15.72:0/2973438562 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3e08004d90 0x7f3e08005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:58.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:58.768+0000 7f3e17fff700 1 -- 172.21.15.72:0/2973438562 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3e180a86c0 msgr2=0x7f3e08003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:35:58.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:58.768+0000 7f3e17fff700 1 --2- 172.21.15.72:0/2973438562 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3e180a86c0 0x7f3e08003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:58.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:58.768+0000 7f3e17fff700 1 -- 172.21.15.72:0/2973438562 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3e08004d90 msgr2=0x7f3e08005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:35:58.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:58.768+0000 7f3e17fff700 1 --2- 172.21.15.72:0/2973438562 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3e08004d90 0x7f3e08005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:58.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:58.768+0000 7f3e17fff700 1 -- 172.21.15.72:0/2973438562 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e080035b0 con 0x7f3e08003f80 2023-07-25T14:35:58.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:58.768+0000 7f3e17fff700 1 --2- 172.21.15.72:0/2973438562 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3e08003f80 0x7f3e08004850 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f3e0400c370 tx=0x7f3e08005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35a4b6aa4b16c71c server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:35:58.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:58.769+0000 7f3e177fe700 1 -- 172.21.15.72:0/2973438562 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e04007c60 con 0x7f3e08003f80 2023-07-25T14:35:58.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:58.769+0000 7f3e177fe700 1 -- 172.21.15.72:0/2973438562 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e04005960 con 0x7f3e08003f80 2023-07-25T14:35:58.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:58.769+0000 7f3e177fe700 1 -- 172.21.15.72:0/2973438562 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e04005d10 con 0x7f3e08003f80 2023-07-25T14:35:58.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:58.769+0000 7f3e1ec0b700 1 -- 172.21.15.72:0/2973438562 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3e08003f80 msgr2=0x7f3e08004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:58.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:58.769+0000 7f3e1ec0b700 1 --2- 172.21.15.72:0/2973438562 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3e08003f80 0x7f3e08004850 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f3e0400c370 tx=0x7f3e08005880 comp rx=0 tx=0).stop 2023-07-25T14:35:58.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:58.769+0000 7f3e1d1a8700 1 -- 172.21.15.72:0/2973438562 reap_dead start 2023-07-25T14:35:58.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:58.769+0000 7f3e1ec0b700 1 -- 172.21.15.72:0/2973438562 shutdown_connections 2023-07-25T14:35:58.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:58.769+0000 7f3e1ec0b700 1 -- 172.21.15.72:0/2973438562 >> 172.21.15.72:0/2973438562 conn(0x7f3e1806def0 msgr2=0x7f3e1806e300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:35:58.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:58.769+0000 7f3e1ec0b700 1 -- 172.21.15.72:0/2973438562 shutdown_connections 2023-07-25T14:35:58.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:58.769+0000 7f3e1ec0b700 1 -- 172.21.15.72:0/2973438562 wait complete. 2023-07-25T14:35:58.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:58.771+0000 7f3e1ec0b700 1 Processor -- start 2023-07-25T14:35:58.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:58.771+0000 7f3e1ec0b700 1 -- start start 2023-07-25T14:35:58.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:58.772+0000 7f3e1ec0b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3e08003f80 0x7f3e1814d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:58.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:58.772+0000 7f3e1ec0b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3e18145950 0x7f3e181e64f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:58.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:58.772+0000 7f3e1ec0b700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3e180a93c0 0x7f3e181e6a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:58.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:58.772+0000 7f3e1ec0b700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e180abf00 con 0x7f3e08003f80 2023-07-25T14:35:58.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:58.772+0000 7f3e1ec0b700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e180c5b00 con 0x7f3e18145950 2023-07-25T14:35:58.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:58.772+0000 7f3e1ec0b700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e1814a920 con 0x7f3e180a93c0 2023-07-25T14:35:58.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:58.772+0000 7f3e1c9a7700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3e08003f80 0x7f3e1814d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:58.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:58.772+0000 7f3e1c9a7700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3e08003f80 0x7f3e1814d110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:39888/0 (socket says 172.21.15.72:39888) 2023-07-25T14:35:58.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:58.772+0000 7f3e1c9a7700 1 -- 172.21.15.72:0/2910887755 learned_addr learned my addr 172.21.15.72:0/2910887755 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:35:58.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:58.772+0000 7f3e1d1a8700 1 --2- 172.21.15.72:0/2910887755 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3e180a93c0 0x7f3e181e6a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:58.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:58.772+0000 7f3e17fff700 1 --2- 172.21.15.72:0/2910887755 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3e18145950 0x7f3e181e64f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:58.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:58.772+0000 7f3e1c9a7700 1 -- 172.21.15.72:0/2910887755 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3e180a93c0 msgr2=0x7f3e181e6a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:58.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:58.772+0000 7f3e1c9a7700 1 --2- 172.21.15.72:0/2910887755 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3e180a93c0 0x7f3e181e6a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:58.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:58.772+0000 7f3e1c9a7700 1 -- 172.21.15.72:0/2910887755 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3e18145950 msgr2=0x7f3e181e64f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:58.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:58.772+0000 7f3e1c9a7700 1 --2- 172.21.15.72:0/2910887755 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3e18145950 0x7f3e181e64f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:58.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:58.772+0000 7f3e1c9a7700 1 -- 172.21.15.72:0/2910887755 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e18145670 con 0x7f3e08003f80 2023-07-25T14:35:58.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:58.772+0000 7f3e1d1a8700 1 --2- 172.21.15.72:0/2910887755 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3e180a93c0 0x7f3e181e6a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-25T14:35:58.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:58.772+0000 7f3e17fff700 1 --2- 172.21.15.72:0/2910887755 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3e18145950 0x7f3e181e64f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-25T14:35:58.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:58.772+0000 7f3e1c9a7700 1 --2- 172.21.15.72:0/2910887755 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3e08003f80 0x7f3e1814d110 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f3e0c011aa0 tx=0x7f3e0c011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:35:58.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:58.772+0000 7f3e157fa700 1 -- 172.21.15.72:0/2910887755 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e0c00f980 con 0x7f3e08003f80 2023-07-25T14:35:58.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:58.772+0000 7f3e157fa700 1 -- 172.21.15.72:0/2910887755 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e0c00fb00 con 0x7f3e08003f80 2023-07-25T14:35:58.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:58.772+0000 7f3e1ec0b700 1 -- 172.21.15.72:0/2910887755 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e180c5d10 con 0x7f3e08003f80 2023-07-25T14:35:58.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:58.772+0000 7f3e157fa700 1 -- 172.21.15.72:0/2910887755 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e0c00feb0 con 0x7f3e08003f80 2023-07-25T14:35:58.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:58.772+0000 7f3e1ec0b700 1 -- 172.21.15.72:0/2910887755 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e180c4e30 con 0x7f3e08003f80 2023-07-25T14:35:58.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:58.773+0000 7f3e1ec0b700 1 -- 172.21.15.72:0/2910887755 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e180c4c80 con 0x7f3e08003f80 2023-07-25T14:35:58.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:58.774+0000 7f3e157fa700 1 -- 172.21.15.72:0/2910887755 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3e0c014440 con 0x7f3e08003f80 2023-07-25T14:35:58.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:58.774+0000 7f3e157fa700 1 --2- 172.21.15.72:0/2910887755 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f3dfc06ace0 0x7f3dfc06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:58.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:58.774+0000 7f3e157fa700 1 -- 172.21.15.72:0/2910887755 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f3e0c089f60 con 0x7f3e08003f80 2023-07-25T14:35:58.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:58.774+0000 7f3e17fff700 1 --2- 172.21.15.72:0/2910887755 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f3dfc06ace0 0x7f3dfc06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:58.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:58.774+0000 7f3e17fff700 1 --2- 172.21.15.72:0/2910887755 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f3dfc06ace0 0x7f3dfc06d1a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f3e04015040 tx=0x7f3e0400a000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:35:58.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:58.778+0000 7f3e157fa700 1 -- 172.21.15.72:0/2910887755 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f3e0c058920 con 0x7f3e08003f80 2023-07-25T14:35:59.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:59.007+0000 7f3e1ec0b700 1 -- 172.21.15.72:0/2910887755 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f3e180c5f50 con 0x7f3e08003f80 2023-07-25T14:35:59.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:59.633+0000 7f3e157fa700 1 -- 172.21.15.72:0/2910887755 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7f3e180c5f50 con 0x7f3e08003f80 2023-07-25T14:35:59.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:59.636+0000 7f3e1ec0b700 1 -- 172.21.15.72:0/2910887755 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f3dfc06ace0 msgr2=0x7f3dfc06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:59.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:59.636+0000 7f3e1ec0b700 1 --2- 172.21.15.72:0/2910887755 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f3dfc06ace0 0x7f3dfc06d1a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f3e04015040 tx=0x7f3e0400a000 comp rx=0 tx=0).stop 2023-07-25T14:35:59.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:59.636+0000 7f3e1ec0b700 1 -- 172.21.15.72:0/2910887755 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3e08003f80 msgr2=0x7f3e1814d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:59.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:59.636+0000 7f3e1ec0b700 1 --2- 172.21.15.72:0/2910887755 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3e08003f80 0x7f3e1814d110 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f3e0c011aa0 tx=0x7f3e0c011e60 comp rx=0 tx=0).stop 2023-07-25T14:35:59.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:59.636+0000 7f3e1ec0b700 1 -- 172.21.15.72:0/2910887755 shutdown_connections 2023-07-25T14:35:59.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:59.636+0000 7f3e1ec0b700 1 --2- 172.21.15.72:0/2910887755 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f3dfc06ace0 0x7f3dfc06d1a0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:59.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:59.636+0000 7f3e1ec0b700 1 --2- 172.21.15.72:0/2910887755 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3e180a93c0 0x7f3e181e6a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:59.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:59.636+0000 7f3e1ec0b700 1 --2- 172.21.15.72:0/2910887755 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3e08003f80 0x7f3e1814d110 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:59.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:59.636+0000 7f3e1ec0b700 1 --2- 172.21.15.72:0/2910887755 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3e18145950 0x7f3e181e64f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:59.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:59.636+0000 7f3e1ec0b700 1 -- 172.21.15.72:0/2910887755 >> 172.21.15.72:0/2910887755 conn(0x7f3e1806def0 msgr2=0x7f3e1806e300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:35:59.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:59.636+0000 7f3e1ec0b700 1 -- 172.21.15.72:0/2910887755 shutdown_connections 2023-07-25T14:35:59.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:59.636+0000 7f3e1ec0b700 1 -- 172.21.15.72:0/2910887755 wait complete. 2023-07-25T14:35:59.662 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-07-25T14:35:59.662 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-25T14:35:59.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:59.774+0000 7fa21da80700 1 Processor -- start 2023-07-25T14:35:59.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:59.774+0000 7fa21da80700 1 -- start start 2023-07-25T14:35:59.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:59.775+0000 7fa21da80700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa2181518c0 0x7fa21806b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:59.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:59.775+0000 7fa21da80700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa218154df0 0x7fa218158160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:59.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:59.775+0000 7fa21da80700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa218157cd0 con 0x7fa2180c4370 2023-07-25T14:35:59.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:59.775+0000 7fa21da80700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2180c2310 con 0x7fa218154df0 2023-07-25T14:35:59.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:59.775+0000 7fa21da80700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2181552a0 con 0x7fa2181518c0 2023-07-25T14:35:59.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:59.775+0000 7fa216ffd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa218154df0 0x7fa218158160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:59.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:59.775+0000 7fa216ffd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa218154df0 0x7fa218158160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:39898/0 (socket says 172.21.15.72:39898) 2023-07-25T14:35:59.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:59.775+0000 7fa216ffd700 1 -- 172.21.15.72:0/3978846821 learned_addr learned my addr 172.21.15.72:0/3978846821 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:35:59.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:59.775+0000 7fa2177fe700 1 --2- 172.21.15.72:0/3978846821 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa2181518c0 0x7fa21806b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:59.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:59.776+0000 7fa216ffd700 1 -- 172.21.15.72:0/3978846821 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa2181518c0 msgr2=0x7fa21806b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:35:59.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:59.776+0000 7fa216ffd700 1 --2- 172.21.15.72:0/3978846821 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa2181518c0 0x7fa21806b2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:59.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:59.776+0000 7fa216ffd700 1 -- 172.21.15.72:0/3978846821 >> v1:172.21.15.92:6789/0 conn(0x7fa2180c4370 legacy=0x7fa21806ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:59.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:59.776+0000 7fa216ffd700 1 -- 172.21.15.72:0/3978846821 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2180c2520 con 0x7fa218154df0 2023-07-25T14:35:59.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:59.776+0000 7fa216ffd700 1 --2- 172.21.15.72:0/3978846821 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa218154df0 0x7fa218158160 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fa2080098f0 tx=0x7fa208009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b41c15866f6531 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:35:59.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:59.776+0000 7fa2167fc700 1 -- 172.21.15.72:0/3978846821 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa208011830 con 0x7fa218154df0 2023-07-25T14:35:59.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:59.776+0000 7fa2167fc700 1 -- 172.21.15.72:0/3978846821 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa208011990 con 0x7fa218154df0 2023-07-25T14:35:59.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:59.776+0000 7fa2167fc700 1 -- 172.21.15.72:0/3978846821 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa208011d20 con 0x7fa218154df0 2023-07-25T14:35:59.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:59.776+0000 7fa21da80700 1 -- 172.21.15.72:0/3978846821 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa218154df0 msgr2=0x7fa218158160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:59.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:59.776+0000 7fa21da80700 1 --2- 172.21.15.72:0/3978846821 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa218154df0 0x7fa218158160 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fa2080098f0 tx=0x7fa208009c00 comp rx=0 tx=0).stop 2023-07-25T14:35:59.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:59.776+0000 7fa21da80700 1 -- 172.21.15.72:0/3978846821 shutdown_connections 2023-07-25T14:35:59.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:59.776+0000 7fa21da80700 1 --2- 172.21.15.72:0/3978846821 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa2181518c0 0x7fa21806b2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:59.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:59.776+0000 7fa21da80700 1 --2- 172.21.15.72:0/3978846821 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa218154df0 0x7fa218158160 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:59.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:59.776+0000 7fa21da80700 1 -- 172.21.15.72:0/3978846821 >> 172.21.15.72:0/3978846821 conn(0x7fa21806a8d0 msgr2=0x7fa2180a94e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:35:59.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:59.777+0000 7fa21da80700 1 -- 172.21.15.72:0/3978846821 shutdown_connections 2023-07-25T14:35:59.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:59.777+0000 7fa21da80700 1 -- 172.21.15.72:0/3978846821 wait complete. 2023-07-25T14:35:59.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:59.778+0000 7fa21da80700 1 Processor -- start 2023-07-25T14:35:59.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:59.778+0000 7fa21da80700 1 -- start start 2023-07-25T14:35:59.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:59.778+0000 7fa21da80700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa2180c4370 0x7fa2181ea900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:59.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:59.778+0000 7fa21da80700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa2181518c0 0x7fa2180ac3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:59.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:59.778+0000 7fa21da80700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa218154df0 0x7fa2181532e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:59.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:59.778+0000 7fa21da80700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2180aa170 con 0x7fa218154df0 2023-07-25T14:35:59.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:59.778+0000 7fa21da80700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2180aa450 con 0x7fa2180c4370 2023-07-25T14:35:59.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:59.778+0000 7fa21da80700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2180c0cc0 con 0x7fa2181518c0 2023-07-25T14:35:59.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:59.779+0000 7fa217fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa218154df0 0x7fa2181532e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:59.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:59.779+0000 7fa217fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa218154df0 0x7fa2181532e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:39906/0 (socket says 172.21.15.72:39906) 2023-07-25T14:35:59.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:59.779+0000 7fa217fff700 1 -- 172.21.15.72:0/2365552282 learned_addr learned my addr 172.21.15.72:0/2365552282 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:35:59.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:59.779+0000 7fa216ffd700 1 --2- 172.21.15.72:0/2365552282 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa2181518c0 0x7fa2180ac3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:59.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:59.779+0000 7fa2177fe700 1 --2- 172.21.15.72:0/2365552282 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa2180c4370 0x7fa2181ea900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:59.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:59.779+0000 7fa217fff700 1 -- 172.21.15.72:0/2365552282 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa2181518c0 msgr2=0x7fa2180ac3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:59.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:59.779+0000 7fa217fff700 1 --2- 172.21.15.72:0/2365552282 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa2181518c0 0x7fa2180ac3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:59.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:59.779+0000 7fa217fff700 1 -- 172.21.15.72:0/2365552282 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa2180c4370 msgr2=0x7fa2181ea900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:35:59.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:59.779+0000 7fa217fff700 1 --2- 172.21.15.72:0/2365552282 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa2180c4370 0x7fa2181ea900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:35:59.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:59.779+0000 7fa217fff700 1 -- 172.21.15.72:0/2365552282 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa208009550 con 0x7fa218154df0 2023-07-25T14:35:59.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:59.779+0000 7fa2177fe700 1 --2- 172.21.15.72:0/2365552282 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa2180c4370 0x7fa2181ea900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-25T14:35:59.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:59.779+0000 7fa217fff700 1 --2- 172.21.15.72:0/2365552282 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa218154df0 0x7fa2181532e0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fa21000cb90 tx=0x7fa21000cf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:35:59.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:59.779+0000 7fa1fffff700 1 -- 172.21.15.72:0/2365552282 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa210003c50 con 0x7fa218154df0 2023-07-25T14:35:59.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:59.779+0000 7fa1fffff700 1 -- 172.21.15.72:0/2365552282 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa210003dd0 con 0x7fa218154df0 2023-07-25T14:35:59.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:59.779+0000 7fa21da80700 1 -- 172.21.15.72:0/2365552282 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa218153820 con 0x7fa218154df0 2023-07-25T14:35:59.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:59.779+0000 7fa1fffff700 1 -- 172.21.15.72:0/2365552282 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa21000abb0 con 0x7fa218154df0 2023-07-25T14:35:59.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:59.779+0000 7fa21da80700 1 -- 172.21.15.72:0/2365552282 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2180c0980 con 0x7fa218154df0 2023-07-25T14:35:59.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:59.780+0000 7fa21da80700 1 -- 172.21.15.72:0/2365552282 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa21804e470 con 0x7fa218154df0 2023-07-25T14:35:59.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:59.781+0000 7fa1fffff700 1 -- 172.21.15.72:0/2365552282 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa21000ad10 con 0x7fa218154df0 2023-07-25T14:35:59.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:59.781+0000 7fa1fffff700 1 --2- 172.21.15.72:0/2365552282 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fa20406ace0 0x7fa20406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:35:59.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:59.781+0000 7fa1fffff700 1 -- 172.21.15.72:0/2365552282 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fa210089890 con 0x7fa218154df0 2023-07-25T14:35:59.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:59.781+0000 7fa2177fe700 1 --2- 172.21.15.72:0/2365552282 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fa20406ace0 0x7fa20406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:35:59.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:59.782+0000 7fa2177fe700 1 --2- 172.21.15.72:0/2365552282 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fa20406ace0 0x7fa20406d1a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fa21806f680 tx=0x7fa20c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:35:59.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:35:59.786+0000 7fa1fffff700 1 -- 172.21.15.72:0/2365552282 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fa210054650 con 0x7fa218154df0 2023-07-25T14:36:00.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.015+0000 7fa21da80700 1 -- 172.21.15.72:0/2365552282 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa2180aa2b0 con 0x7fa218154df0 2023-07-25T14:36:00.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.016+0000 7fa1fffff700 1 -- 172.21.15.72:0/2365552282 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4664 (secure 0 0 0) 0x7fa2180aa2b0 con 0x7fa218154df0 2023-07-25T14:36:00.029 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-25T14:36:00.029 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4220,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6836/4293785067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":4293785067},{"type":"v1","addr":"172.21.15.72:6836","nonce":4293785067}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4229,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6834/681290755","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":681290755},{"type":"v1","addr":"172.21.15.92:6834","nonce":681290755}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6837/3376375642","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6835","nonce":3376375642},{"type":"v1","addr":"172.21.15.72:6837","nonce":3376375642}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-25T14:35:39.939860+0000","modified":"2023-07-25T14:35:59.629155+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.92:6835/2045555979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6833","nonce":2045555979},{"type":"v1","addr":"172.21.15.92:6835","nonce":2045555979}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-25T14:36:00.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.018+0000 7fa21da80700 1 -- 172.21.15.72:0/2365552282 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fa20406ace0 msgr2=0x7fa20406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:00.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.018+0000 7fa21da80700 1 --2- 172.21.15.72:0/2365552282 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fa20406ace0 0x7fa20406d1a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fa21806f680 tx=0x7fa20c008040 comp rx=0 tx=0).stop 2023-07-25T14:36:00.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.018+0000 7fa21da80700 1 -- 172.21.15.72:0/2365552282 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa218154df0 msgr2=0x7fa2181532e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:00.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.018+0000 7fa21da80700 1 --2- 172.21.15.72:0/2365552282 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa218154df0 0x7fa2181532e0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fa21000cb90 tx=0x7fa21000cf50 comp rx=0 tx=0).stop 2023-07-25T14:36:00.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.018+0000 7fa21da80700 1 -- 172.21.15.72:0/2365552282 shutdown_connections 2023-07-25T14:36:00.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.018+0000 7fa21da80700 1 --2- 172.21.15.72:0/2365552282 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fa20406ace0 0x7fa20406d1a0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:00.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.018+0000 7fa21da80700 1 --2- 172.21.15.72:0/2365552282 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa218154df0 0x7fa2181532e0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:00.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.018+0000 7fa21da80700 1 --2- 172.21.15.72:0/2365552282 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa2180c4370 0x7fa2181ea900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:00.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.018+0000 7fa21da80700 1 --2- 172.21.15.72:0/2365552282 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa2181518c0 0x7fa2180ac3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:00.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.018+0000 7fa21da80700 1 -- 172.21.15.72:0/2365552282 >> 172.21.15.72:0/2365552282 conn(0x7fa21806a8d0 msgr2=0x7fa218156c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:00.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.018+0000 7fa21da80700 1 -- 172.21.15.72:0/2365552282 shutdown_connections 2023-07-25T14:36:00.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.018+0000 7fa21da80700 1 -- 172.21.15.72:0/2365552282 wait complete. 2023-07-25T14:36:00.032 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 8 2023-07-25T14:36:00.042 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-25T14:36:00.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.150+0000 7f41e809e700 1 Processor -- start 2023-07-25T14:36:00.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.150+0000 7f41e809e700 1 -- start start 2023-07-25T14:36:00.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.151+0000 7f41e809e700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f41e00a9cc0 0x7f41e01525e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:00.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.151+0000 7f41e809e700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f41e00bb0b0 0x7f41e0152b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:00.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.151+0000 7f41e809e700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41e00c5890 con 0x7f41e014f810 2023-07-25T14:36:00.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.151+0000 7f41e809e700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41e0152150 con 0x7f41e00bb0b0 2023-07-25T14:36:00.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.151+0000 7f41e809e700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41e014fbf0 con 0x7f41e00a9cc0 2023-07-25T14:36:00.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.151+0000 7f41e5e3a700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f41e014f810 0x7f41e00c4370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:58878/0 (socket says 172.21.15.72:58878) 2023-07-25T14:36:00.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.151+0000 7f41e5e3a700 1 -- 172.21.15.72:0/3984884730 learned_addr learned my addr 172.21.15.72:0/3984884730 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:36:00.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.151+0000 7f41e663b700 1 --2- 172.21.15.72:0/3984884730 >> v2:172.21.15.72:3300/0 conn(0x7f41e00bb0b0 0x7f41e0152b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:00.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.151+0000 7f41e5639700 1 --2- 172.21.15.72:0/3984884730 >> v2:172.21.15.92:3300/0 conn(0x7f41e00a9cc0 0x7f41e01525e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:00.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.151+0000 7f41e4e38700 1 -- 172.21.15.72:0/3984884730 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3501912972 0 0) 0x7f41e00c5890 con 0x7f41e014f810 2023-07-25T14:36:00.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.151+0000 7f41e4e38700 1 -- 172.21.15.72:0/3984884730 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f41cc0035b0 con 0x7f41e014f810 2023-07-25T14:36:00.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.151+0000 7f41e663b700 1 -- 172.21.15.72:0/3984884730 >> v2:172.21.15.92:3300/0 conn(0x7f41e00a9cc0 msgr2=0x7f41e01525e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:00.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.151+0000 7f41e663b700 1 --2- 172.21.15.72:0/3984884730 >> v2:172.21.15.92:3300/0 conn(0x7f41e00a9cc0 0x7f41e01525e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:00.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.151+0000 7f41e663b700 1 -- 172.21.15.72:0/3984884730 >> v1:172.21.15.72:6789/0 conn(0x7f41e014f810 legacy=0x7f41e00c4370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:00.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.151+0000 7f41e663b700 1 -- 172.21.15.72:0/3984884730 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41e01566a0 con 0x7f41e00bb0b0 2023-07-25T14:36:00.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.151+0000 7f41e5639700 1 --2- 172.21.15.72:0/3984884730 >> v2:172.21.15.92:3300/0 conn(0x7f41e00a9cc0 0x7f41e01525e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-25T14:36:00.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.151+0000 7f41e663b700 1 --2- 172.21.15.72:0/3984884730 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f41e00bb0b0 0x7f41e0152b20 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f41e00c1f90 tx=0x7f41d800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb17788a177b8b3b server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:00.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.151+0000 7f41e4e38700 1 -- 172.21.15.72:0/3984884730 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41d800e070 con 0x7f41e00bb0b0 2023-07-25T14:36:00.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.151+0000 7f41e4e38700 1 -- 172.21.15.72:0/3984884730 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41d800bb20 con 0x7f41e00bb0b0 2023-07-25T14:36:00.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.151+0000 7f41e4e38700 1 -- 172.21.15.72:0/3984884730 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41d8012430 con 0x7f41e00bb0b0 2023-07-25T14:36:00.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.152+0000 7f41e809e700 1 -- 172.21.15.72:0/3984884730 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f41e00bb0b0 msgr2=0x7f41e0152b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:00.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.152+0000 7f41e809e700 1 --2- 172.21.15.72:0/3984884730 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f41e00bb0b0 0x7f41e0152b20 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f41e00c1f90 tx=0x7f41d800b330 comp rx=0 tx=0).stop 2023-07-25T14:36:00.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.152+0000 7f41e809e700 1 -- 172.21.15.72:0/3984884730 shutdown_connections 2023-07-25T14:36:00.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.152+0000 7f41e809e700 1 --2- 172.21.15.72:0/3984884730 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f41e00bb0b0 0x7f41e0152b20 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:00.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.152+0000 7f41e809e700 1 --2- 172.21.15.72:0/3984884730 >> v2:172.21.15.92:3300/0 conn(0x7f41e00a9cc0 0x7f41e01525e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:00.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.152+0000 7f41e809e700 1 -- 172.21.15.72:0/3984884730 >> 172.21.15.72:0/3984884730 conn(0x7f41e006a8d0 msgr2=0x7f41e00a94e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:00.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.152+0000 7f41e809e700 1 -- 172.21.15.72:0/3984884730 shutdown_connections 2023-07-25T14:36:00.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.152+0000 7f41e809e700 1 -- 172.21.15.72:0/3984884730 wait complete. 2023-07-25T14:36:00.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.153+0000 7f41e809e700 1 Processor -- start 2023-07-25T14:36:00.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.154+0000 7f41e809e700 1 -- start start 2023-07-25T14:36:00.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.154+0000 7f41e809e700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f41e00a9cc0 0x7f41e00a93e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:00.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.154+0000 7f41e809e700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f41e00bb0b0 0x7f41e00acc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:00.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.154+0000 7f41e809e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f41e014f810 0x7f41e00a64a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:00.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.154+0000 7f41e809e700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41e00a9b50 con 0x7f41e014f810 2023-07-25T14:36:00.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.154+0000 7f41e809e700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41e00a9920 con 0x7f41e00bb0b0 2023-07-25T14:36:00.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.154+0000 7f41e809e700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41e00bc300 con 0x7f41e00a9cc0 2023-07-25T14:36:00.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.154+0000 7f41e663b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f41e014f810 0x7f41e00a64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:00.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.155+0000 7f41e663b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f41e014f810 0x7f41e00a64a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:39920/0 (socket says 172.21.15.72:39920) 2023-07-25T14:36:00.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.155+0000 7f41e663b700 1 -- 172.21.15.72:0/2790218430 learned_addr learned my addr 172.21.15.72:0/2790218430 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:00.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.155+0000 7f41e5639700 1 --2- 172.21.15.72:0/2790218430 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f41e00bb0b0 0x7f41e00acc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:00.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.155+0000 7f41e5e3a700 1 --2- 172.21.15.72:0/2790218430 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f41e00a9cc0 0x7f41e00a93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:00.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.155+0000 7f41e663b700 1 -- 172.21.15.72:0/2790218430 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f41e00a9cc0 msgr2=0x7f41e00a93e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:00.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.155+0000 7f41e663b700 1 --2- 172.21.15.72:0/2790218430 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f41e00a9cc0 0x7f41e00a93e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:00.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.155+0000 7f41e663b700 1 -- 172.21.15.72:0/2790218430 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f41e00bb0b0 msgr2=0x7f41e00acc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:00.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.155+0000 7f41e663b700 1 --2- 172.21.15.72:0/2790218430 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f41e00bb0b0 0x7f41e00acc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:00.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.155+0000 7f41e663b700 1 -- 172.21.15.72:0/2790218430 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41d8009a70 con 0x7f41e014f810 2023-07-25T14:36:00.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.155+0000 7f41e663b700 1 --2- 172.21.15.72:0/2790218430 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f41e014f810 0x7f41e00a64a0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f41d8014040 tx=0x7f41d8004b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:00.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.155+0000 7f41d67fc700 1 -- 172.21.15.72:0/2790218430 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41d8012430 con 0x7f41e014f810 2023-07-25T14:36:00.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.155+0000 7f41d67fc700 1 -- 172.21.15.72:0/2790218430 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41d8020070 con 0x7f41e014f810 2023-07-25T14:36:00.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.155+0000 7f41e809e700 1 -- 172.21.15.72:0/2790218430 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41e00bb9d0 con 0x7f41e014f810 2023-07-25T14:36:00.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.155+0000 7f41d67fc700 1 -- 172.21.15.72:0/2790218430 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41d8004040 con 0x7f41e014f810 2023-07-25T14:36:00.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.155+0000 7f41e809e700 1 -- 172.21.15.72:0/2790218430 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41e00bbf90 con 0x7f41e014f810 2023-07-25T14:36:00.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.156+0000 7f41e809e700 1 -- 172.21.15.72:0/2790218430 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41e004e470 con 0x7f41e014f810 2023-07-25T14:36:00.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.156+0000 7f41d67fc700 1 -- 172.21.15.72:0/2790218430 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f41d80041a0 con 0x7f41e014f810 2023-07-25T14:36:00.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.157+0000 7f41d67fc700 1 --2- 172.21.15.72:0/2790218430 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f41c406ace0 0x7f41c406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:00.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.157+0000 7f41d67fc700 1 -- 172.21.15.72:0/2790218430 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f41d8022070 con 0x7f41e014f810 2023-07-25T14:36:00.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.157+0000 7f41e5e3a700 1 --2- 172.21.15.72:0/2790218430 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f41c406ace0 0x7f41c406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:00.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.157+0000 7f41e5e3a700 1 --2- 172.21.15.72:0/2790218430 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f41c406ace0 0x7f41c406d1a0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f41dc007fd0 tx=0x7f41dc007dc0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:00.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.161+0000 7f41d67fc700 1 -- 172.21.15.72:0/2790218430 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f41d8056050 con 0x7f41e014f810 2023-07-25T14:36:00.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.347+0000 7f41e809e700 1 -- 172.21.15.72:0/2790218430 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f41e00702b0 con 0x7f41e014f810 2023-07-25T14:36:00.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.348+0000 7f41d67fc700 1 -- 172.21.15.72:0/2790218430 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+20014 (secure 0 0 0) 0x7f41d8059670 con 0x7f41e014f810 2023-07-25T14:36:00.361 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-25T14:36:00.361 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":25,"fsid":"9170db48-9170-43e8-8ccb-9813e6240906","created":"2023-07-25T14:35:21.733262+0000","modified":"2023-07-25T14:35:44.992669+0000","last_up_change":"2023-07-25T14:35:31.355010+0000","last_in_change":"2023-07-25T14:35:24.195785+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-25T14:35:32.983457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-25T14:35:33.326342+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-25T14:35:37.534158+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-25T14:35:38.891571+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-25T14:35:42.596923+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d517fdad-0bfe-49f0-89f2-9421c3761839","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6801","nonce":2475407414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6803","nonce":2475407414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6807","nonce":2475407414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6805","nonce":2475407414}]},"public_addr":"172.21.15.72:6801/2475407414","cluster_addr":"172.21.15.72:6803/2475407414","heartbeat_back_addr":"172.21.15.72:6807/2475407414","heartbeat_front_addr":"172.21.15.72:6805/2475407414","state":["exists","up"]},{"osd":1,"uuid":"e1564be3-f209-47e5-a8d0-32fc618a474f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6822","nonce":870954016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6825","nonce":870954016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6831","nonce":870954016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6827","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6829","nonce":870954016}]},"public_addr":"172.21.15.72:6822/870954016","cluster_addr":"172.21.15.72:6825/870954016","heartbeat_back_addr":"172.21.15.72:6831/870954016","heartbeat_front_addr":"172.21.15.72:6829/870954016","state":["exists","up"]},{"osd":2,"uuid":"c4647d30-ffa6-417a-9026-ef530c75910e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6809","nonce":2143129442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6811","nonce":2143129442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6815","nonce":2143129442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6813","nonce":2143129442}]},"public_addr":"172.21.15.72:6809/2143129442","cluster_addr":"172.21.15.72:6811/2143129442","heartbeat_back_addr":"172.21.15.72:6815/2143129442","heartbeat_front_addr":"172.21.15.72:6813/2143129442","state":["exists","up"]},{"osd":3,"uuid":"76c9d9a7-c2e2-4612-a58b-d6882dd76b58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6817","nonce":3404066311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6819","nonce":3404066311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6828","nonce":3404066311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6821","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6823","nonce":3404066311}]},"public_addr":"172.21.15.72:6817/3404066311","cluster_addr":"172.21.15.72:6819/3404066311","heartbeat_back_addr":"172.21.15.72:6828/3404066311","heartbeat_front_addr":"172.21.15.72:6823/3404066311","state":["exists","up"]},{"osd":4,"uuid":"7f8920dc-0ad4-4a73-ab40-65408f83eadd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6817","nonce":2381008739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6819","nonce":2381008739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6825","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6827","nonce":2381008739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6822","nonce":2381008739}]},"public_addr":"172.21.15.92:6817/2381008739","cluster_addr":"172.21.15.92:6819/2381008739","heartbeat_back_addr":"172.21.15.92:6827/2381008739","heartbeat_front_addr":"172.21.15.92:6822/2381008739","state":["exists","up"]},{"osd":5,"uuid":"56257e7c-31eb-44c5-9ec7-1318a4e0bb35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6801","nonce":2161935604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6803","nonce":2161935604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6807","nonce":2161935604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6805","nonce":2161935604}]},"public_addr":"172.21.15.92:6801/2161935604","cluster_addr":"172.21.15.92:6803/2161935604","heartbeat_back_addr":"172.21.15.92:6807/2161935604","heartbeat_front_addr":"172.21.15.92:6805/2161935604","state":["exists","up"]},{"osd":6,"uuid":"a150d3d8-a0c9-4955-968a-8d98eff4ffb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6809","nonce":3770163493}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6811","nonce":3770163493}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6815","nonce":3770163493}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6813","nonce":3770163493}]},"public_addr":"172.21.15.92:6809/3770163493","cluster_addr":"172.21.15.92:6811/3770163493","heartbeat_back_addr":"172.21.15.92:6815/3770163493","heartbeat_front_addr":"172.21.15.92:6813/3770163493","state":["exists","up"]},{"osd":7,"uuid":"07799c27-54ee-4591-a42d-a978d6b32065","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6821","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6823","nonce":2135777609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6826","nonce":2135777609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6831","nonce":2135777609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6829","nonce":2135777609}]},"public_addr":"172.21.15.92:6823/2135777609","cluster_addr":"172.21.15.92:6826/2135777609","heartbeat_back_addr":"172.21.15.92:6831/2135777609","heartbeat_front_addr":"172.21.15.92:6829/2135777609","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.345365+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.378150+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.146566+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.372172+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:30.398421+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.385632+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.465611+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.443583+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-25T14:36:00.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.351+0000 7f41e809e700 1 -- 172.21.15.72:0/2790218430 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f41c406ace0 msgr2=0x7f41c406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:00.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.351+0000 7f41e809e700 1 --2- 172.21.15.72:0/2790218430 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f41c406ace0 0x7f41c406d1a0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f41dc007fd0 tx=0x7f41dc007dc0 comp rx=0 tx=0).stop 2023-07-25T14:36:00.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.351+0000 7f41e809e700 1 -- 172.21.15.72:0/2790218430 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f41e014f810 msgr2=0x7f41e00a64a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:00.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.351+0000 7f41e809e700 1 --2- 172.21.15.72:0/2790218430 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f41e014f810 0x7f41e00a64a0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f41d8014040 tx=0x7f41d8004b20 comp rx=0 tx=0).stop 2023-07-25T14:36:00.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.351+0000 7f41e809e700 1 -- 172.21.15.72:0/2790218430 shutdown_connections 2023-07-25T14:36:00.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.351+0000 7f41e809e700 1 --2- 172.21.15.72:0/2790218430 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f41c406ace0 0x7f41c406d1a0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:00.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.351+0000 7f41e809e700 1 --2- 172.21.15.72:0/2790218430 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f41e00a9cc0 0x7f41e00a93e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:00.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.351+0000 7f41e809e700 1 --2- 172.21.15.72:0/2790218430 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f41e014f810 0x7f41e00a64a0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:00.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.351+0000 7f41e809e700 1 --2- 172.21.15.72:0/2790218430 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f41e00bb0b0 0x7f41e00acc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:00.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.351+0000 7f41e809e700 1 -- 172.21.15.72:0/2790218430 >> 172.21.15.72:0/2790218430 conn(0x7f41e006a8d0 msgr2=0x7f41e006ee10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:00.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.351+0000 7f41e809e700 1 -- 172.21.15.72:0/2790218430 shutdown_connections 2023-07-25T14:36:00.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.351+0000 7f41e809e700 1 -- 172.21.15.72:0/2790218430 wait complete. 2023-07-25T14:36:00.375 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-07-25T14:36:00.376 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-25T14:36:00.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.482+0000 7f96d7b58700 1 Processor -- start 2023-07-25T14:36:00.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.482+0000 7f96d7b58700 1 -- start start 2023-07-25T14:36:00.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.483+0000 7f96d7b58700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f96d0151950 0x7f96d006a190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:00.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.483+0000 7f96d7b58700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f96d00724c0 0x7f96d00c34c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:00.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.483+0000 7f96d7b58700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f96d006a6d0 0x7f96d00c3a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:00.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.483+0000 7f96d7b58700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96d0071a60 con 0x7f96d006a6d0 2023-07-25T14:36:00.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.483+0000 7f96d7b58700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96d00c2a70 con 0x7f96d0151950 2023-07-25T14:36:00.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.483+0000 7f96d7b58700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96d0151d30 con 0x7f96d00724c0 2023-07-25T14:36:00.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.483+0000 7f96d60f5700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f96d006a6d0 0x7f96d00c3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:00.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.483+0000 7f96d60f5700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f96d006a6d0 0x7f96d00c3a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:39928/0 (socket says 172.21.15.72:39928) 2023-07-25T14:36:00.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.483+0000 7f96d60f5700 1 -- 172.21.15.72:0/3806525185 learned_addr learned my addr 172.21.15.72:0/3806525185 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:00.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.483+0000 7f96d50f3700 1 --2- 172.21.15.72:0/3806525185 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f96d00724c0 0x7f96d00c34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:00.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.483+0000 7f96d58f4700 1 --2- 172.21.15.72:0/3806525185 >> v2:172.21.15.92:3300/0 conn(0x7f96d0151950 0x7f96d006a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:00.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.483+0000 7f96d60f5700 1 -- 172.21.15.72:0/3806525185 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f96d00724c0 msgr2=0x7f96d00c34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:00.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.483+0000 7f96d60f5700 1 --2- 172.21.15.72:0/3806525185 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f96d00724c0 0x7f96d00c34c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:00.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.483+0000 7f96d60f5700 1 -- 172.21.15.72:0/3806525185 >> v2:172.21.15.92:3300/0 conn(0x7f96d0151950 msgr2=0x7f96d006a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:00.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.483+0000 7f96d60f5700 1 --2- 172.21.15.72:0/3806525185 >> v2:172.21.15.92:3300/0 conn(0x7f96d0151950 0x7f96d006a190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:00.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.483+0000 7f96d60f5700 1 -- 172.21.15.72:0/3806525185 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96d00c2fe0 con 0x7f96d006a6d0 2023-07-25T14:36:00.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.483+0000 7f96d58f4700 1 --2- 172.21.15.72:0/3806525185 >> v2:172.21.15.92:3300/0 conn(0x7f96d0151950 0x7f96d006a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-25T14:36:00.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.483+0000 7f96d60f5700 1 --2- 172.21.15.72:0/3806525185 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f96d006a6d0 0x7f96d00c3a00 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f96d006ad50 tx=0x7f96c800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af2cf8d826593750 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:00.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.484+0000 7f96d48f2700 1 -- 172.21.15.72:0/3806525185 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96c800e070 con 0x7f96d006a6d0 2023-07-25T14:36:00.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.484+0000 7f96d48f2700 1 -- 172.21.15.72:0/3806525185 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96c800b910 con 0x7f96d006a6d0 2023-07-25T14:36:00.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.484+0000 7f96d48f2700 1 -- 172.21.15.72:0/3806525185 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96c800bcc0 con 0x7f96d006a6d0 2023-07-25T14:36:00.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.484+0000 7f96d7b58700 1 -- 172.21.15.72:0/3806525185 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f96d006a6d0 msgr2=0x7f96d00c3a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:00.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.484+0000 7f96d7b58700 1 --2- 172.21.15.72:0/3806525185 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f96d006a6d0 0x7f96d00c3a00 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f96d006ad50 tx=0x7f96c800b330 comp rx=0 tx=0).stop 2023-07-25T14:36:00.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.484+0000 7f96d7b58700 1 -- 172.21.15.72:0/3806525185 shutdown_connections 2023-07-25T14:36:00.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.484+0000 7f96d7b58700 1 --2- 172.21.15.72:0/3806525185 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f96d006a6d0 0x7f96d00c3a00 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:00.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.484+0000 7f96d7b58700 1 --2- 172.21.15.72:0/3806525185 >> v2:172.21.15.92:3300/0 conn(0x7f96d0151950 0x7f96d006a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:00.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.484+0000 7f96d7b58700 1 --2- 172.21.15.72:0/3806525185 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f96d00724c0 0x7f96d00c34c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:00.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.484+0000 7f96d7b58700 1 -- 172.21.15.72:0/3806525185 >> 172.21.15.72:0/3806525185 conn(0x7f96d00a87e0 msgr2=0x7f96d00a8bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:00.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.484+0000 7f96d7b58700 1 -- 172.21.15.72:0/3806525185 shutdown_connections 2023-07-25T14:36:00.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.484+0000 7f96d7b58700 1 -- 172.21.15.72:0/3806525185 wait complete. 2023-07-25T14:36:00.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.485+0000 7f96d7b58700 1 Processor -- start 2023-07-25T14:36:00.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.485+0000 7f96d7b58700 1 -- start start 2023-07-25T14:36:00.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.486+0000 7f96d7b58700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f96d006a6d0 0x7f96d01ed400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:00.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.486+0000 7f96d7b58700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f96d00724c0 0x7f96d0152330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:00.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.486+0000 7f96d7b58700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f96d0151950 0x7f96d0152870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:00.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.486+0000 7f96d7b58700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96d00bdfd0 con 0x7f96d006a6d0 2023-07-25T14:36:00.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.486+0000 7f96d7b58700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96d014eb20 con 0x7f96d0151950 2023-07-25T14:36:00.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.486+0000 7f96d7b58700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96d01ecfc0 con 0x7f96d00724c0 2023-07-25T14:36:00.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.486+0000 7f96d58f4700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f96d006a6d0 0x7f96d01ed400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:00.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.486+0000 7f96d58f4700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f96d006a6d0 0x7f96d01ed400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:39930/0 (socket says 172.21.15.72:39930) 2023-07-25T14:36:00.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.486+0000 7f96d58f4700 1 -- 172.21.15.72:0/3840064970 learned_addr learned my addr 172.21.15.72:0/3840064970 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:00.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.486+0000 7f96d60f5700 1 --2- 172.21.15.72:0/3840064970 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f96d0151950 0x7f96d0152870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:00.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.486+0000 7f96d50f3700 1 --2- 172.21.15.72:0/3840064970 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f96d00724c0 0x7f96d0152330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:00.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.486+0000 7f96d58f4700 1 -- 172.21.15.72:0/3840064970 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f96d00724c0 msgr2=0x7f96d0152330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:00.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.486+0000 7f96d58f4700 1 --2- 172.21.15.72:0/3840064970 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f96d00724c0 0x7f96d0152330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:00.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.486+0000 7f96d58f4700 1 -- 172.21.15.72:0/3840064970 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f96d0151950 msgr2=0x7f96d0152870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:00.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.486+0000 7f96d58f4700 1 --2- 172.21.15.72:0/3840064970 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f96d0151950 0x7f96d0152870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:00.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.486+0000 7f96d58f4700 1 -- 172.21.15.72:0/3840064970 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96c8009b30 con 0x7f96d006a6d0 2023-07-25T14:36:00.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.486+0000 7f96d50f3700 1 --2- 172.21.15.72:0/3840064970 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f96d00724c0 0x7f96d0152330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-25T14:36:00.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.487+0000 7f96d58f4700 1 --2- 172.21.15.72:0/3840064970 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f96d006a6d0 0x7f96d01ed400 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f96cc00e810 tx=0x7f96cc00eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:00.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.487+0000 7f96c67fc700 1 -- 172.21.15.72:0/3840064970 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96cc00c020 con 0x7f96d006a6d0 2023-07-25T14:36:00.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.487+0000 7f96c67fc700 1 -- 172.21.15.72:0/3840064970 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96cc004250 con 0x7f96d006a6d0 2023-07-25T14:36:00.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.487+0000 7f96d7b58700 1 -- 172.21.15.72:0/3840064970 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96d01edd60 con 0x7f96d006a6d0 2023-07-25T14:36:00.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.487+0000 7f96c67fc700 1 -- 172.21.15.72:0/3840064970 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96cc0036a0 con 0x7f96d006a6d0 2023-07-25T14:36:00.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.487+0000 7f96d7b58700 1 -- 172.21.15.72:0/3840064970 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96d01ee000 con 0x7f96d006a6d0 2023-07-25T14:36:00.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.488+0000 7f96d7b58700 1 -- 172.21.15.72:0/3840064970 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96d004e470 con 0x7f96d006a6d0 2023-07-25T14:36:00.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.488+0000 7f96c67fc700 1 -- 172.21.15.72:0/3840064970 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f96cc003800 con 0x7f96d006a6d0 2023-07-25T14:36:00.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.488+0000 7f96c67fc700 1 --2- 172.21.15.72:0/3840064970 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f96b406ace0 0x7f96b406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:00.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.489+0000 7f96d50f3700 1 --2- 172.21.15.72:0/3840064970 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f96b406ace0 0x7f96b406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:00.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.489+0000 7f96c67fc700 1 -- 172.21.15.72:0/3840064970 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f96cc0891a0 con 0x7f96d006a6d0 2023-07-25T14:36:00.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.489+0000 7f96d50f3700 1 --2- 172.21.15.72:0/3840064970 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f96b406ace0 0x7f96b406d1a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f96d00728c0 tx=0x7f96c0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:00.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.493+0000 7f96c67fc700 1 -- 172.21.15.72:0/3840064970 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f96cc053ff0 con 0x7f96d006a6d0 2023-07-25T14:36:00.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.680+0000 7f96d7b58700 1 -- 172.21.15.72:0/3840064970 --> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f96d00c15c0 con 0x7f96b406ace0 2023-07-25T14:36:00.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.690+0000 7f96c67fc700 1 -- 172.21.15.72:0/3840064970 <== mgr.4104 v2:172.21.15.72:6832/1171220306 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367630 (secure 0 0 0) 0x7f96c00117b0 con 0x7f96b406ace0 2023-07-25T14:36:00.706 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-25T14:36:00.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.693+0000 7f96d7b58700 1 -- 172.21.15.72:0/3840064970 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f96b406ace0 msgr2=0x7f96b406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:00.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.694+0000 7f96d7b58700 1 --2- 172.21.15.72:0/3840064970 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f96b406ace0 0x7f96b406d1a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f96d00728c0 tx=0x7f96c0008040 comp rx=0 tx=0).stop 2023-07-25T14:36:00.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.694+0000 7f96d7b58700 1 -- 172.21.15.72:0/3840064970 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f96d006a6d0 msgr2=0x7f96d01ed400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:00.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.694+0000 7f96d7b58700 1 --2- 172.21.15.72:0/3840064970 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f96d006a6d0 0x7f96d01ed400 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f96cc00e810 tx=0x7f96cc00eb20 comp rx=0 tx=0).stop 2023-07-25T14:36:00.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.694+0000 7f96d7b58700 1 -- 172.21.15.72:0/3840064970 shutdown_connections 2023-07-25T14:36:00.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.694+0000 7f96d7b58700 1 --2- 172.21.15.72:0/3840064970 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f96b406ace0 0x7f96b406d1a0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:00.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.694+0000 7f96d7b58700 1 --2- 172.21.15.72:0/3840064970 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f96d0151950 0x7f96d0152870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:00.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.694+0000 7f96d7b58700 1 --2- 172.21.15.72:0/3840064970 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f96d006a6d0 0x7f96d01ed400 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:00.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.694+0000 7f96d7b58700 1 --2- 172.21.15.72:0/3840064970 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f96d00724c0 0x7f96d0152330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:00.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.694+0000 7f96d7b58700 1 -- 172.21.15.72:0/3840064970 >> 172.21.15.72:0/3840064970 conn(0x7f96d00a87e0 msgr2=0x7f96d006f610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:00.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.694+0000 7f96d7b58700 1 -- 172.21.15.72:0/3840064970 shutdown_connections 2023-07-25T14:36:00.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.694+0000 7f96d7b58700 1 -- 172.21.15.72:0/3840064970 wait complete. 2023-07-25T14:36:00.709 INFO:teuthology.orchestra.run.smithi072.stderr:dumped all 2023-07-25T14:36:00.718 INFO:teuthology.orchestra.run.smithi072.stdout:{"pg_ready":true,"pg_map":{"version":32,"stamp":"2023-07-25T14:35:59.289797+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594819,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":206,"num_write_kb":2433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":158,"ondisk_log_size":158,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218416,"kb_used_data":2260,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754756304,"statfs":{"total":773094113280,"available":772870455296,"internally_reserved":0,"allocated":2314240,"data_stored":2061663,"data_compressed":64510,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2089,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002913"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:47.033294+0000","last_change":"2023-07-25T14:35:40.579709+0000","last_active":"2023-07-25T14:35:47.033294+0000","last_peered":"2023-07-25T14:35:47.033294+0000","last_clean":"2023-07-25T14:35:47.033294+0000","last_became_active":"2023-07-25T14:35:40.579434+0000","last_became_peered":"2023-07-25T14:35:40.579434+0000","last_unstale":"2023-07-25T14:35:47.033294+0000","last_undegraded":"2023-07-25T14:35:47.033294+0000","last_fullsized":"2023-07-25T14:35:47.033294+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T16:53:04.752134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.591767+0000","last_change":"2023-07-25T14:35:40.569410+0000","last_active":"2023-07-25T14:35:45.591767+0000","last_peered":"2023-07-25T14:35:45.591767+0000","last_clean":"2023-07-25T14:35:45.591767+0000","last_became_active":"2023-07-25T14:35:40.569117+0000","last_became_peered":"2023-07-25T14:35:40.569117+0000","last_unstale":"2023-07-25T14:35:45.591767+0000","last_undegraded":"2023-07-25T14:35:45.591767+0000","last_fullsized":"2023-07-25T14:35:45.591767+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T21:31:31.770554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.594527+0000","last_change":"2023-07-25T14:35:40.575183+0000","last_active":"2023-07-25T14:35:45.594527+0000","last_peered":"2023-07-25T14:35:45.594527+0000","last_clean":"2023-07-25T14:35:45.594527+0000","last_became_active":"2023-07-25T14:35:40.574827+0000","last_became_peered":"2023-07-25T14:35:40.574827+0000","last_unstale":"2023-07-25T14:35:45.594527+0000","last_undegraded":"2023-07-25T14:35:45.594527+0000","last_fullsized":"2023-07-25T14:35:45.594527+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T01:51:45.574143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.591232+0000","last_change":"2023-07-25T14:35:40.573336+0000","last_active":"2023-07-25T14:35:45.591232+0000","last_peered":"2023-07-25T14:35:45.591232+0000","last_clean":"2023-07-25T14:35:45.591232+0000","last_became_active":"2023-07-25T14:35:40.573034+0000","last_became_peered":"2023-07-25T14:35:40.573034+0000","last_unstale":"2023-07-25T14:35:45.591232+0000","last_undegraded":"2023-07-25T14:35:45.591232+0000","last_fullsized":"2023-07-25T14:35:45.591232+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T18:55:52.687430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:46.554959+0000","last_change":"2023-07-25T14:35:40.583811+0000","last_active":"2023-07-25T14:35:46.554959+0000","last_peered":"2023-07-25T14:35:46.554959+0000","last_clean":"2023-07-25T14:35:46.554959+0000","last_became_active":"2023-07-25T14:35:40.583515+0000","last_became_peered":"2023-07-25T14:35:40.583515+0000","last_unstale":"2023-07-25T14:35:46.554959+0000","last_undegraded":"2023-07-25T14:35:46.554959+0000","last_fullsized":"2023-07-25T14:35:46.554959+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:09:34.369879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.594150+0000","last_change":"2023-07-25T14:35:40.575186+0000","last_active":"2023-07-25T14:35:45.594150+0000","last_peered":"2023-07-25T14:35:45.594150+0000","last_clean":"2023-07-25T14:35:45.594150+0000","last_became_active":"2023-07-25T14:35:40.574889+0000","last_became_peered":"2023-07-25T14:35:40.574889+0000","last_unstale":"2023-07-25T14:35:45.594150+0000","last_undegraded":"2023-07-25T14:35:45.594150+0000","last_fullsized":"2023-07-25T14:35:45.594150+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:40:27.273006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:46.548788+0000","last_change":"2023-07-25T14:35:40.569889+0000","last_active":"2023-07-25T14:35:46.548788+0000","last_peered":"2023-07-25T14:35:46.548788+0000","last_clean":"2023-07-25T14:35:46.548788+0000","last_became_active":"2023-07-25T14:35:40.569608+0000","last_became_peered":"2023-07-25T14:35:40.569608+0000","last_unstale":"2023-07-25T14:35:46.548788+0000","last_undegraded":"2023-07-25T14:35:46.548788+0000","last_fullsized":"2023-07-25T14:35:46.548788+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T15:50:12.108725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.591268+0000","last_change":"2023-07-25T14:35:40.574254+0000","last_active":"2023-07-25T14:35:45.591268+0000","last_peered":"2023-07-25T14:35:45.591268+0000","last_clean":"2023-07-25T14:35:45.591268+0000","last_became_active":"2023-07-25T14:35:40.573341+0000","last_became_peered":"2023-07-25T14:35:40.573341+0000","last_unstale":"2023-07-25T14:35:45.591268+0000","last_undegraded":"2023-07-25T14:35:45.591268+0000","last_fullsized":"2023-07-25T14:35:45.591268+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T17:24:11.100853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:46.554711+0000","last_change":"2023-07-25T14:35:40.582969+0000","last_active":"2023-07-25T14:35:46.554711+0000","last_peered":"2023-07-25T14:35:46.554711+0000","last_clean":"2023-07-25T14:35:46.554711+0000","last_became_active":"2023-07-25T14:35:40.582686+0000","last_became_peered":"2023-07-25T14:35:40.582686+0000","last_unstale":"2023-07-25T14:35:46.554711+0000","last_undegraded":"2023-07-25T14:35:46.554711+0000","last_fullsized":"2023-07-25T14:35:46.554711+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:55:22.829223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.592271+0000","last_change":"2023-07-25T14:35:40.574207+0000","last_active":"2023-07-25T14:35:45.592271+0000","last_peered":"2023-07-25T14:35:45.592271+0000","last_clean":"2023-07-25T14:35:45.592271+0000","last_became_active":"2023-07-25T14:35:40.573926+0000","last_became_peered":"2023-07-25T14:35:40.573926+0000","last_unstale":"2023-07-25T14:35:45.592271+0000","last_undegraded":"2023-07-25T14:35:45.592271+0000","last_fullsized":"2023-07-25T14:35:45.592271+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T17:56:22.295388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.594484+0000","last_change":"2023-07-25T14:35:40.571893+0000","last_active":"2023-07-25T14:35:45.594484+0000","last_peered":"2023-07-25T14:35:45.594484+0000","last_clean":"2023-07-25T14:35:45.594484+0000","last_became_active":"2023-07-25T14:35:40.571559+0000","last_became_peered":"2023-07-25T14:35:40.571559+0000","last_unstale":"2023-07-25T14:35:45.594484+0000","last_undegraded":"2023-07-25T14:35:45.594484+0000","last_fullsized":"2023-07-25T14:35:45.594484+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T14:46:37.446654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:47.032918+0000","last_change":"2023-07-25T14:35:40.574741+0000","last_active":"2023-07-25T14:35:47.032918+0000","last_peered":"2023-07-25T14:35:47.032918+0000","last_clean":"2023-07-25T14:35:47.032918+0000","last_became_active":"2023-07-25T14:35:40.574462+0000","last_became_peered":"2023-07-25T14:35:40.574462+0000","last_unstale":"2023-07-25T14:35:47.032918+0000","last_undegraded":"2023-07-25T14:35:47.032918+0000","last_fullsized":"2023-07-25T14:35:47.032918+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T01:21:26.238044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:47.032882+0000","last_change":"2023-07-25T14:35:40.571479+0000","last_active":"2023-07-25T14:35:47.032882+0000","last_peered":"2023-07-25T14:35:47.032882+0000","last_clean":"2023-07-25T14:35:47.032882+0000","last_became_active":"2023-07-25T14:35:40.571126+0000","last_became_peered":"2023-07-25T14:35:40.571126+0000","last_unstale":"2023-07-25T14:35:47.032882+0000","last_undegraded":"2023-07-25T14:35:47.032882+0000","last_fullsized":"2023-07-25T14:35:47.032882+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T22:30:57.251961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.591494+0000","last_change":"2023-07-25T14:35:40.569982+0000","last_active":"2023-07-25T14:35:45.591494+0000","last_peered":"2023-07-25T14:35:45.591494+0000","last_clean":"2023-07-25T14:35:45.591494+0000","last_became_active":"2023-07-25T14:35:40.569644+0000","last_became_peered":"2023-07-25T14:35:40.569644+0000","last_unstale":"2023-07-25T14:35:45.591494+0000","last_undegraded":"2023-07-25T14:35:45.591494+0000","last_fullsized":"2023-07-25T14:35:45.591494+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T14:44:33.489813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:46.548596+0000","last_change":"2023-07-25T14:35:40.570367+0000","last_active":"2023-07-25T14:35:46.548596+0000","last_peered":"2023-07-25T14:35:46.548596+0000","last_clean":"2023-07-25T14:35:46.548596+0000","last_became_active":"2023-07-25T14:35:40.570106+0000","last_became_peered":"2023-07-25T14:35:40.570106+0000","last_unstale":"2023-07-25T14:35:46.548596+0000","last_undegraded":"2023-07-25T14:35:46.548596+0000","last_fullsized":"2023-07-25T14:35:46.548596+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T19:42:01.927591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.593622+0000","last_change":"2023-07-25T14:35:40.575177+0000","last_active":"2023-07-25T14:35:45.593622+0000","last_peered":"2023-07-25T14:35:45.593622+0000","last_clean":"2023-07-25T14:35:45.593622+0000","last_became_active":"2023-07-25T14:35:40.574874+0000","last_became_peered":"2023-07-25T14:35:40.574874+0000","last_unstale":"2023-07-25T14:35:45.593622+0000","last_undegraded":"2023-07-25T14:35:45.593622+0000","last_fullsized":"2023-07-25T14:35:45.593622+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T22:45:19.433847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:46.554879+0000","last_change":"2023-07-25T14:35:40.582903+0000","last_active":"2023-07-25T14:35:46.554879+0000","last_peered":"2023-07-25T14:35:46.554879+0000","last_clean":"2023-07-25T14:35:46.554879+0000","last_became_active":"2023-07-25T14:35:40.582627+0000","last_became_peered":"2023-07-25T14:35:40.582627+0000","last_unstale":"2023-07-25T14:35:46.554879+0000","last_undegraded":"2023-07-25T14:35:46.554879+0000","last_fullsized":"2023-07-25T14:35:46.554879+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T17:56:22.295388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.594691+0000","last_change":"2023-07-25T14:35:40.571572+0000","last_active":"2023-07-25T14:35:45.594691+0000","last_peered":"2023-07-25T14:35:45.594691+0000","last_clean":"2023-07-25T14:35:45.594691+0000","last_became_active":"2023-07-25T14:35:40.570802+0000","last_became_peered":"2023-07-25T14:35:40.570802+0000","last_unstale":"2023-07-25T14:35:45.594691+0000","last_undegraded":"2023-07-25T14:35:45.594691+0000","last_fullsized":"2023-07-25T14:35:45.594691+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T20:18:12.135635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:47.033091+0000","last_change":"2023-07-25T14:35:40.576638+0000","last_active":"2023-07-25T14:35:47.033091+0000","last_peered":"2023-07-25T14:35:47.033091+0000","last_clean":"2023-07-25T14:35:47.033091+0000","last_became_active":"2023-07-25T14:35:40.576359+0000","last_became_peered":"2023-07-25T14:35:40.576359+0000","last_unstale":"2023-07-25T14:35:47.033091+0000","last_undegraded":"2023-07-25T14:35:47.033091+0000","last_fullsized":"2023-07-25T14:35:47.033091+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T20:38:34.383462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.593850+0000","last_change":"2023-07-25T14:35:40.581183+0000","last_active":"2023-07-25T14:35:45.593850+0000","last_peered":"2023-07-25T14:35:45.593850+0000","last_clean":"2023-07-25T14:35:45.593850+0000","last_became_active":"2023-07-25T14:35:40.577150+0000","last_became_peered":"2023-07-25T14:35:40.577150+0000","last_unstale":"2023-07-25T14:35:45.593850+0000","last_undegraded":"2023-07-25T14:35:45.593850+0000","last_fullsized":"2023-07-25T14:35:45.593850+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T22:52:07.934045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:46.549236+0000","last_change":"2023-07-25T14:35:40.584074+0000","last_active":"2023-07-25T14:35:46.549236+0000","last_peered":"2023-07-25T14:35:46.549236+0000","last_clean":"2023-07-25T14:35:46.549236+0000","last_became_active":"2023-07-25T14:35:40.583729+0000","last_became_peered":"2023-07-25T14:35:40.583729+0000","last_unstale":"2023-07-25T14:35:46.549236+0000","last_undegraded":"2023-07-25T14:35:46.549236+0000","last_fullsized":"2023-07-25T14:35:46.549236+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:37:32.340440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:46.554400+0000","last_change":"2023-07-25T14:35:40.569049+0000","last_active":"2023-07-25T14:35:46.554400+0000","last_peered":"2023-07-25T14:35:46.554400+0000","last_clean":"2023-07-25T14:35:46.554400+0000","last_became_active":"2023-07-25T14:35:40.568749+0000","last_became_peered":"2023-07-25T14:35:40.568749+0000","last_unstale":"2023-07-25T14:35:46.554400+0000","last_undegraded":"2023-07-25T14:35:46.554400+0000","last_fullsized":"2023-07-25T14:35:46.554400+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:12:05.117844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.812807+0000","last_change":"2023-07-25T14:35:40.579628+0000","last_active":"2023-07-25T14:35:45.812807+0000","last_peered":"2023-07-25T14:35:45.812807+0000","last_clean":"2023-07-25T14:35:45.812807+0000","last_became_active":"2023-07-25T14:35:40.579163+0000","last_became_peered":"2023-07-25T14:35:40.579163+0000","last_unstale":"2023-07-25T14:35:45.812807+0000","last_undegraded":"2023-07-25T14:35:45.812807+0000","last_fullsized":"2023-07-25T14:35:45.812807+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T14:39:11.675726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:46.548669+0000","last_change":"2023-07-25T14:35:40.580196+0000","last_active":"2023-07-25T14:35:46.548669+0000","last_peered":"2023-07-25T14:35:46.548669+0000","last_clean":"2023-07-25T14:35:46.548669+0000","last_became_active":"2023-07-25T14:35:40.579875+0000","last_became_peered":"2023-07-25T14:35:40.579875+0000","last_unstale":"2023-07-25T14:35:46.548669+0000","last_undegraded":"2023-07-25T14:35:46.548669+0000","last_fullsized":"2023-07-25T14:35:46.548669+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T17:56:22.295388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:47.033370+0000","last_change":"2023-07-25T14:35:40.567264+0000","last_active":"2023-07-25T14:35:47.033370+0000","last_peered":"2023-07-25T14:35:47.033370+0000","last_clean":"2023-07-25T14:35:47.033370+0000","last_became_active":"2023-07-25T14:35:40.566933+0000","last_became_peered":"2023-07-25T14:35:40.566933+0000","last_unstale":"2023-07-25T14:35:47.033370+0000","last_undegraded":"2023-07-25T14:35:47.033370+0000","last_fullsized":"2023-07-25T14:35:47.033370+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T21:36:38.996750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:47.033405+0000","last_change":"2023-07-25T14:35:40.562595+0000","last_active":"2023-07-25T14:35:47.033405+0000","last_peered":"2023-07-25T14:35:47.033405+0000","last_clean":"2023-07-25T14:35:47.033405+0000","last_became_active":"2023-07-25T14:35:40.562281+0000","last_became_peered":"2023-07-25T14:35:40.562281+0000","last_unstale":"2023-07-25T14:35:47.033405+0000","last_undegraded":"2023-07-25T14:35:47.033405+0000","last_fullsized":"2023-07-25T14:35:47.033405+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T14:44:33.489813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.592182+0000","last_change":"2023-07-25T14:35:40.570857+0000","last_active":"2023-07-25T14:35:45.592182+0000","last_peered":"2023-07-25T14:35:45.592182+0000","last_clean":"2023-07-25T14:35:45.592182+0000","last_became_active":"2023-07-25T14:35:40.570601+0000","last_became_peered":"2023-07-25T14:35:40.570601+0000","last_unstale":"2023-07-25T14:35:45.592182+0000","last_undegraded":"2023-07-25T14:35:45.592182+0000","last_fullsized":"2023-07-25T14:35:45.592182+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:43:26.302693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.594376+0000","last_change":"2023-07-25T14:35:44.610459+0000","last_active":"2023-07-25T14:35:45.594376+0000","last_peered":"2023-07-25T14:35:45.594376+0000","last_clean":"2023-07-25T14:35:45.594376+0000","last_became_active":"2023-07-25T14:35:44.610112+0000","last_became_peered":"2023-07-25T14:35:44.610112+0000","last_unstale":"2023-07-25T14:35:45.594376+0000","last_undegraded":"2023-07-25T14:35:45.594376+0000","last_fullsized":"2023-07-25T14:35:45.594376+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_clean_scrub_stamp":"2023-07-25T14:35:43.577860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T21:11:47.831552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"20'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.593786+0000","last_change":"2023-07-25T14:35:39.539424+0000","last_active":"2023-07-25T14:35:45.593786+0000","last_peered":"2023-07-25T14:35:45.593786+0000","last_clean":"2023-07-25T14:35:45.593786+0000","last_became_active":"2023-07-25T14:35:39.539198+0000","last_became_peered":"2023-07-25T14:35:39.539198+0000","last_unstale":"2023-07-25T14:35:45.593786+0000","last_undegraded":"2023-07-25T14:35:45.593786+0000","last_fullsized":"2023-07-25T14:35:45.593786+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_clean_scrub_stamp":"2023-07-25T14:35:38.515226+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T20:19:13.284229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.813167+0000","last_change":"2023-07-25T14:35:40.571557+0000","last_active":"2023-07-25T14:35:45.813167+0000","last_peered":"2023-07-25T14:35:45.813167+0000","last_clean":"2023-07-25T14:35:45.813167+0000","last_became_active":"2023-07-25T14:35:40.571278+0000","last_became_peered":"2023-07-25T14:35:40.571278+0000","last_unstale":"2023-07-25T14:35:45.813167+0000","last_undegraded":"2023-07-25T14:35:45.813167+0000","last_fullsized":"2023-07-25T14:35:45.813167+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T17:57:59.593211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.592906+0000","last_change":"2023-07-25T14:35:44.608945+0000","last_active":"2023-07-25T14:35:45.592906+0000","last_peered":"2023-07-25T14:35:45.592906+0000","last_clean":"2023-07-25T14:35:45.592906+0000","last_became_active":"2023-07-25T14:35:44.608355+0000","last_became_peered":"2023-07-25T14:35:44.608355+0000","last_unstale":"2023-07-25T14:35:45.592906+0000","last_undegraded":"2023-07-25T14:35:45.592906+0000","last_fullsized":"2023-07-25T14:35:45.592906+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_clean_scrub_stamp":"2023-07-25T14:35:43.577860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T01:37:47.118522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:47.032243+0000","last_change":"2023-07-25T14:35:39.546003+0000","last_active":"2023-07-25T14:35:47.032243+0000","last_peered":"2023-07-25T14:35:47.032243+0000","last_clean":"2023-07-25T14:35:47.032243+0000","last_became_active":"2023-07-25T14:35:39.545724+0000","last_became_peered":"2023-07-25T14:35:39.545724+0000","last_unstale":"2023-07-25T14:35:47.032243+0000","last_undegraded":"2023-07-25T14:35:47.032243+0000","last_fullsized":"2023-07-25T14:35:47.032243+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_clean_scrub_stamp":"2023-07-25T14:35:38.515226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T17:55:30.391084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:46.554711+0000","last_change":"2023-07-25T14:35:40.570219+0000","last_active":"2023-07-25T14:35:46.554711+0000","last_peered":"2023-07-25T14:35:46.554711+0000","last_clean":"2023-07-25T14:35:46.554711+0000","last_became_active":"2023-07-25T14:35:40.569892+0000","last_became_peered":"2023-07-25T14:35:40.569892+0000","last_unstale":"2023-07-25T14:35:46.554711+0000","last_undegraded":"2023-07-25T14:35:46.554711+0000","last_fullsized":"2023-07-25T14:35:46.554711+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T17:42:33.268060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:46.554870+0000","last_change":"2023-07-25T14:35:44.617481+0000","last_active":"2023-07-25T14:35:46.554870+0000","last_peered":"2023-07-25T14:35:46.554870+0000","last_clean":"2023-07-25T14:35:46.554870+0000","last_became_active":"2023-07-25T14:35:44.616199+0000","last_became_peered":"2023-07-25T14:35:44.616199+0000","last_unstale":"2023-07-25T14:35:46.554870+0000","last_undegraded":"2023-07-25T14:35:46.554870+0000","last_fullsized":"2023-07-25T14:35:46.554870+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_clean_scrub_stamp":"2023-07-25T14:35:43.577860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T15:17:51.741356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.812854+0000","last_change":"2023-07-25T14:35:39.535284+0000","last_active":"2023-07-25T14:35:45.812854+0000","last_peered":"2023-07-25T14:35:45.812854+0000","last_clean":"2023-07-25T14:35:45.812854+0000","last_became_active":"2023-07-25T14:35:39.535009+0000","last_became_peered":"2023-07-25T14:35:39.535009+0000","last_unstale":"2023-07-25T14:35:45.812854+0000","last_undegraded":"2023-07-25T14:35:45.812854+0000","last_fullsized":"2023-07-25T14:35:45.812854+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_clean_scrub_stamp":"2023-07-25T14:35:38.515226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T01:30:24.432069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.593125+0000","last_change":"2023-07-25T14:35:40.576038+0000","last_active":"2023-07-25T14:35:45.593125+0000","last_peered":"2023-07-25T14:35:45.593125+0000","last_clean":"2023-07-25T14:35:45.593125+0000","last_became_active":"2023-07-25T14:35:40.575678+0000","last_became_peered":"2023-07-25T14:35:40.575678+0000","last_unstale":"2023-07-25T14:35:45.593125+0000","last_undegraded":"2023-07-25T14:35:45.593125+0000","last_fullsized":"2023-07-25T14:35:45.593125+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T23:32:51.759335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.592398+0000","last_change":"2023-07-25T14:35:44.613589+0000","last_active":"2023-07-25T14:35:45.592398+0000","last_peered":"2023-07-25T14:35:45.592398+0000","last_clean":"2023-07-25T14:35:45.592398+0000","last_became_active":"2023-07-25T14:35:44.613150+0000","last_became_peered":"2023-07-25T14:35:44.613150+0000","last_unstale":"2023-07-25T14:35:45.592398+0000","last_undegraded":"2023-07-25T14:35:45.592398+0000","last_fullsized":"2023-07-25T14:35:45.592398+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_clean_scrub_stamp":"2023-07-25T14:35:43.577860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T20:48:55.652351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:46.554838+0000","last_change":"2023-07-25T14:35:39.534927+0000","last_active":"2023-07-25T14:35:46.554838+0000","last_peered":"2023-07-25T14:35:46.554838+0000","last_clean":"2023-07-25T14:35:46.554838+0000","last_became_active":"2023-07-25T14:35:39.534642+0000","last_became_peered":"2023-07-25T14:35:39.534642+0000","last_unstale":"2023-07-25T14:35:46.554838+0000","last_undegraded":"2023-07-25T14:35:46.554838+0000","last_fullsized":"2023-07-25T14:35:46.554838+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_clean_scrub_stamp":"2023-07-25T14:35:38.515226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:43:25.300568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.812812+0000","last_change":"2023-07-25T14:35:40.570225+0000","last_active":"2023-07-25T14:35:45.812812+0000","last_peered":"2023-07-25T14:35:45.812812+0000","last_clean":"2023-07-25T14:35:45.812812+0000","last_became_active":"2023-07-25T14:35:40.569840+0000","last_became_peered":"2023-07-25T14:35:40.569840+0000","last_unstale":"2023-07-25T14:35:45.812812+0000","last_undegraded":"2023-07-25T14:35:45.812812+0000","last_fullsized":"2023-07-25T14:35:45.812812+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T21:39:00.919174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:46.548495+0000","last_change":"2023-07-25T14:35:44.607298+0000","last_active":"2023-07-25T14:35:46.548495+0000","last_peered":"2023-07-25T14:35:46.548495+0000","last_clean":"2023-07-25T14:35:46.548495+0000","last_became_active":"2023-07-25T14:35:44.606891+0000","last_became_peered":"2023-07-25T14:35:44.606891+0000","last_unstale":"2023-07-25T14:35:46.548495+0000","last_undegraded":"2023-07-25T14:35:46.548495+0000","last_fullsized":"2023-07-25T14:35:46.548495+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_clean_scrub_stamp":"2023-07-25T14:35:43.577860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:55:26.889732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.592326+0000","last_change":"2023-07-25T14:35:39.537294+0000","last_active":"2023-07-25T14:35:45.592326+0000","last_peered":"2023-07-25T14:35:45.592326+0000","last_clean":"2023-07-25T14:35:45.592326+0000","last_became_active":"2023-07-25T14:35:39.536993+0000","last_became_peered":"2023-07-25T14:35:39.536993+0000","last_unstale":"2023-07-25T14:35:45.592326+0000","last_undegraded":"2023-07-25T14:35:45.592326+0000","last_fullsized":"2023-07-25T14:35:45.592326+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_clean_scrub_stamp":"2023-07-25T14:35:38.515226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T15:17:46.678722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.812671+0000","last_change":"2023-07-25T14:35:40.578807+0000","last_active":"2023-07-25T14:35:45.812671+0000","last_peered":"2023-07-25T14:35:45.812671+0000","last_clean":"2023-07-25T14:35:45.812671+0000","last_became_active":"2023-07-25T14:35:40.577361+0000","last_became_peered":"2023-07-25T14:35:40.577361+0000","last_unstale":"2023-07-25T14:35:45.812671+0000","last_undegraded":"2023-07-25T14:35:45.812671+0000","last_fullsized":"2023-07-25T14:35:45.812671+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:37:32.340440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.813426+0000","last_change":"2023-07-25T14:35:44.610450+0000","last_active":"2023-07-25T14:35:45.813426+0000","last_peered":"2023-07-25T14:35:45.813426+0000","last_clean":"2023-07-25T14:35:45.813426+0000","last_became_active":"2023-07-25T14:35:44.610074+0000","last_became_peered":"2023-07-25T14:35:44.610074+0000","last_unstale":"2023-07-25T14:35:45.813426+0000","last_undegraded":"2023-07-25T14:35:45.813426+0000","last_fullsized":"2023-07-25T14:35:45.813426+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_clean_scrub_stamp":"2023-07-25T14:35:43.577860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T16:23:18.284233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"20'3","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:46.549394+0000","last_change":"2023-07-25T14:35:39.543982+0000","last_active":"2023-07-25T14:35:46.549394+0000","last_peered":"2023-07-25T14:35:46.549394+0000","last_clean":"2023-07-25T14:35:46.549394+0000","last_became_active":"2023-07-25T14:35:39.543760+0000","last_became_peered":"2023-07-25T14:35:39.543760+0000","last_unstale":"2023-07-25T14:35:46.549394+0000","last_undegraded":"2023-07-25T14:35:46.549394+0000","last_fullsized":"2023-07-25T14:35:46.549394+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_clean_scrub_stamp":"2023-07-25T14:35:38.515226+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:42:37.075884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:47.032949+0000","last_change":"2023-07-25T14:35:40.577934+0000","last_active":"2023-07-25T14:35:47.032949+0000","last_peered":"2023-07-25T14:35:47.032949+0000","last_clean":"2023-07-25T14:35:47.032949+0000","last_became_active":"2023-07-25T14:35:40.577675+0000","last_became_peered":"2023-07-25T14:35:40.577675+0000","last_unstale":"2023-07-25T14:35:47.032949+0000","last_undegraded":"2023-07-25T14:35:47.032949+0000","last_fullsized":"2023-07-25T14:35:47.032949+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T23:32:02.358536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:47.033082+0000","last_change":"2023-07-25T14:35:44.611931+0000","last_active":"2023-07-25T14:35:47.033082+0000","last_peered":"2023-07-25T14:35:47.033082+0000","last_clean":"2023-07-25T14:35:47.033082+0000","last_became_active":"2023-07-25T14:35:44.611566+0000","last_became_peered":"2023-07-25T14:35:44.611566+0000","last_unstale":"2023-07-25T14:35:47.033082+0000","last_undegraded":"2023-07-25T14:35:47.033082+0000","last_fullsized":"2023-07-25T14:35:47.033082+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_clean_scrub_stamp":"2023-07-25T14:35:43.577860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T21:16:02.383581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"25'8","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:49.925778+0000","last_change":"2023-07-25T14:35:39.537231+0000","last_active":"2023-07-25T14:35:49.925778+0000","last_peered":"2023-07-25T14:35:49.925778+0000","last_clean":"2023-07-25T14:35:49.925778+0000","last_became_active":"2023-07-25T14:35:39.536936+0000","last_became_peered":"2023-07-25T14:35:39.536936+0000","last_unstale":"2023-07-25T14:35:49.925778+0000","last_undegraded":"2023-07-25T14:35:49.925778+0000","last_fullsized":"2023-07-25T14:35:49.925778+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_clean_scrub_stamp":"2023-07-25T14:35:38.515226+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T14:38:33.447792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3653,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.594207+0000","last_change":"2023-07-25T14:35:40.581925+0000","last_active":"2023-07-25T14:35:45.594207+0000","last_peered":"2023-07-25T14:35:45.594207+0000","last_clean":"2023-07-25T14:35:45.594207+0000","last_became_active":"2023-07-25T14:35:40.581612+0000","last_became_peered":"2023-07-25T14:35:40.581612+0000","last_unstale":"2023-07-25T14:35:45.594207+0000","last_undegraded":"2023-07-25T14:35:45.594207+0000","last_fullsized":"2023-07-25T14:35:45.594207+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T21:19:54.060418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.592462+0000","last_change":"2023-07-25T14:35:44.610512+0000","last_active":"2023-07-25T14:35:45.592462+0000","last_peered":"2023-07-25T14:35:45.592462+0000","last_clean":"2023-07-25T14:35:45.592462+0000","last_became_active":"2023-07-25T14:35:44.610029+0000","last_became_peered":"2023-07-25T14:35:44.610029+0000","last_unstale":"2023-07-25T14:35:45.592462+0000","last_undegraded":"2023-07-25T14:35:45.592462+0000","last_fullsized":"2023-07-25T14:35:45.592462+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_clean_scrub_stamp":"2023-07-25T14:35:43.577860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T15:50:16.169233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:46.549117+0000","last_change":"2023-07-25T14:35:39.541876+0000","last_active":"2023-07-25T14:35:46.549117+0000","last_peered":"2023-07-25T14:35:46.549117+0000","last_clean":"2023-07-25T14:35:46.549117+0000","last_became_active":"2023-07-25T14:35:39.541630+0000","last_became_peered":"2023-07-25T14:35:39.541630+0000","last_unstale":"2023-07-25T14:35:46.549117+0000","last_undegraded":"2023-07-25T14:35:46.549117+0000","last_fullsized":"2023-07-25T14:35:46.549117+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_clean_scrub_stamp":"2023-07-25T14:35:38.515226+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T21:17:39.462457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.813224+0000","last_change":"2023-07-25T14:35:40.571048+0000","last_active":"2023-07-25T14:35:45.813224+0000","last_peered":"2023-07-25T14:35:45.813224+0000","last_clean":"2023-07-25T14:35:45.813224+0000","last_became_active":"2023-07-25T14:35:40.570758+0000","last_became_peered":"2023-07-25T14:35:40.570758+0000","last_unstale":"2023-07-25T14:35:45.813224+0000","last_undegraded":"2023-07-25T14:35:45.813224+0000","last_fullsized":"2023-07-25T14:35:45.813224+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T01:55:22.618189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.813383+0000","last_change":"2023-07-25T14:35:44.611202+0000","last_active":"2023-07-25T14:35:45.813383+0000","last_peered":"2023-07-25T14:35:45.813383+0000","last_clean":"2023-07-25T14:35:45.813383+0000","last_became_active":"2023-07-25T14:35:44.610870+0000","last_became_peered":"2023-07-25T14:35:44.610870+0000","last_unstale":"2023-07-25T14:35:45.813383+0000","last_undegraded":"2023-07-25T14:35:45.813383+0000","last_fullsized":"2023-07-25T14:35:45.813383+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_clean_scrub_stamp":"2023-07-25T14:35:43.577860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T21:04:57.404448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:46.554898+0000","last_change":"2023-07-25T14:35:39.536644+0000","last_active":"2023-07-25T14:35:46.554898+0000","last_peered":"2023-07-25T14:35:46.554898+0000","last_clean":"2023-07-25T14:35:46.554898+0000","last_became_active":"2023-07-25T14:35:39.536369+0000","last_became_peered":"2023-07-25T14:35:39.536369+0000","last_unstale":"2023-07-25T14:35:46.554898+0000","last_undegraded":"2023-07-25T14:35:46.554898+0000","last_fullsized":"2023-07-25T14:35:46.554898+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_clean_scrub_stamp":"2023-07-25T14:35:38.515226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T15:50:11.106599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.591980+0000","last_change":"2023-07-25T14:35:40.562867+0000","last_active":"2023-07-25T14:35:45.591980+0000","last_peered":"2023-07-25T14:35:45.591980+0000","last_clean":"2023-07-25T14:35:45.591980+0000","last_became_active":"2023-07-25T14:35:40.562586+0000","last_became_peered":"2023-07-25T14:35:40.562586+0000","last_unstale":"2023-07-25T14:35:45.591980+0000","last_undegraded":"2023-07-25T14:35:45.591980+0000","last_fullsized":"2023-07-25T14:35:45.591980+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T20:23:13.132615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.813522+0000","last_change":"2023-07-25T14:35:44.614158+0000","last_active":"2023-07-25T14:35:45.813522+0000","last_peered":"2023-07-25T14:35:45.813522+0000","last_clean":"2023-07-25T14:35:45.813522+0000","last_became_active":"2023-07-25T14:35:44.613814+0000","last_became_peered":"2023-07-25T14:35:44.613814+0000","last_unstale":"2023-07-25T14:35:45.813522+0000","last_undegraded":"2023-07-25T14:35:45.813522+0000","last_fullsized":"2023-07-25T14:35:45.813522+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_clean_scrub_stamp":"2023-07-25T14:35:43.577860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:03:49.133248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:46.548772+0000","last_change":"2023-07-25T14:35:39.538871+0000","last_active":"2023-07-25T14:35:46.548772+0000","last_peered":"2023-07-25T14:35:46.548772+0000","last_clean":"2023-07-25T14:35:46.548772+0000","last_became_active":"2023-07-25T14:35:39.538503+0000","last_became_peered":"2023-07-25T14:35:39.538503+0000","last_unstale":"2023-07-25T14:35:46.548772+0000","last_undegraded":"2023-07-25T14:35:46.548772+0000","last_fullsized":"2023-07-25T14:35:46.548772+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_clean_scrub_stamp":"2023-07-25T14:35:38.515226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T14:52:14.647241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:46.554998+0000","last_change":"2023-07-25T14:35:40.579376+0000","last_active":"2023-07-25T14:35:46.554998+0000","last_peered":"2023-07-25T14:35:46.554998+0000","last_clean":"2023-07-25T14:35:46.554998+0000","last_became_active":"2023-07-25T14:35:40.579086+0000","last_became_peered":"2023-07-25T14:35:40.579086+0000","last_unstale":"2023-07-25T14:35:46.554998+0000","last_undegraded":"2023-07-25T14:35:46.554998+0000","last_fullsized":"2023-07-25T14:35:46.554998+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T14:52:15.649366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.591678+0000","last_change":"2023-07-25T14:35:44.610005+0000","last_active":"2023-07-25T14:35:45.591678+0000","last_peered":"2023-07-25T14:35:45.591678+0000","last_clean":"2023-07-25T14:35:45.591678+0000","last_became_active":"2023-07-25T14:35:44.609602+0000","last_became_peered":"2023-07-25T14:35:44.609602+0000","last_unstale":"2023-07-25T14:35:45.591678+0000","last_undegraded":"2023-07-25T14:35:45.591678+0000","last_fullsized":"2023-07-25T14:35:45.591678+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_clean_scrub_stamp":"2023-07-25T14:35:43.577860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:12:09.178353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"20'8","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.591599+0000","last_change":"2023-07-25T14:35:39.537282+0000","last_active":"2023-07-25T14:35:45.591599+0000","last_peered":"2023-07-25T14:35:45.591599+0000","last_clean":"2023-07-25T14:35:45.591599+0000","last_became_active":"2023-07-25T14:35:39.537001+0000","last_became_peered":"2023-07-25T14:35:39.537001+0000","last_unstale":"2023-07-25T14:35:45.591599+0000","last_undegraded":"2023-07-25T14:35:45.591599+0000","last_fullsized":"2023-07-25T14:35:45.591599+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_clean_scrub_stamp":"2023-07-25T14:35:38.515226+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T22:11:24.268503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.813644+0000","last_change":"2023-07-25T14:35:40.582310+0000","last_active":"2023-07-25T14:35:45.813644+0000","last_peered":"2023-07-25T14:35:45.813644+0000","last_clean":"2023-07-25T14:35:45.813644+0000","last_became_active":"2023-07-25T14:35:40.581913+0000","last_became_peered":"2023-07-25T14:35:40.581913+0000","last_unstale":"2023-07-25T14:35:45.813644+0000","last_undegraded":"2023-07-25T14:35:45.813644+0000","last_fullsized":"2023-07-25T14:35:45.813644+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T21:29:36.633963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:46.549014+0000","last_change":"2023-07-25T14:35:44.609817+0000","last_active":"2023-07-25T14:35:46.549014+0000","last_peered":"2023-07-25T14:35:46.549014+0000","last_clean":"2023-07-25T14:35:46.549014+0000","last_became_active":"2023-07-25T14:35:44.608964+0000","last_became_peered":"2023-07-25T14:35:44.608964+0000","last_unstale":"2023-07-25T14:35:46.549014+0000","last_undegraded":"2023-07-25T14:35:46.549014+0000","last_fullsized":"2023-07-25T14:35:46.549014+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_clean_scrub_stamp":"2023-07-25T14:35:43.577860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T17:08:37.225551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"20'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:46.549184+0000","last_change":"2023-07-25T14:35:39.540328+0000","last_active":"2023-07-25T14:35:46.549184+0000","last_peered":"2023-07-25T14:35:46.549184+0000","last_clean":"2023-07-25T14:35:46.549184+0000","last_became_active":"2023-07-25T14:35:39.540044+0000","last_became_peered":"2023-07-25T14:35:39.540044+0000","last_unstale":"2023-07-25T14:35:46.549184+0000","last_undegraded":"2023-07-25T14:35:46.549184+0000","last_fullsized":"2023-07-25T14:35:46.549184+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_clean_scrub_stamp":"2023-07-25T14:35:38.515226+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:24:56.192863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.591126+0000","last_change":"2023-07-25T14:35:40.566443+0000","last_active":"2023-07-25T14:35:45.591126+0000","last_peered":"2023-07-25T14:35:45.591126+0000","last_clean":"2023-07-25T14:35:45.591126+0000","last_became_active":"2023-07-25T14:35:40.566162+0000","last_became_peered":"2023-07-25T14:35:40.566162+0000","last_unstale":"2023-07-25T14:35:45.591126+0000","last_undegraded":"2023-07-25T14:35:45.591126+0000","last_fullsized":"2023-07-25T14:35:45.591126+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:14:11.945159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:47.032573+0000","last_change":"2023-07-25T14:35:44.615276+0000","last_active":"2023-07-25T14:35:47.032573+0000","last_peered":"2023-07-25T14:35:47.032573+0000","last_clean":"2023-07-25T14:35:47.032573+0000","last_became_active":"2023-07-25T14:35:44.614935+0000","last_became_peered":"2023-07-25T14:35:44.614935+0000","last_unstale":"2023-07-25T14:35:47.032573+0000","last_undegraded":"2023-07-25T14:35:47.032573+0000","last_fullsized":"2023-07-25T14:35:47.032573+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_clean_scrub_stamp":"2023-07-25T14:35:43.577860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T19:32:58.526454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:46.549428+0000","last_change":"2023-07-25T14:35:39.538857+0000","last_active":"2023-07-25T14:35:46.549428+0000","last_peered":"2023-07-25T14:35:46.549428+0000","last_clean":"2023-07-25T14:35:46.549428+0000","last_became_active":"2023-07-25T14:35:39.538533+0000","last_became_peered":"2023-07-25T14:35:39.538533+0000","last_unstale":"2023-07-25T14:35:46.549428+0000","last_undegraded":"2023-07-25T14:35:46.549428+0000","last_fullsized":"2023-07-25T14:35:46.549428+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_clean_scrub_stamp":"2023-07-25T14:35:38.515226+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T23:06:55.013283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.593610+0000","last_change":"2023-07-25T14:35:40.571933+0000","last_active":"2023-07-25T14:35:45.593610+0000","last_peered":"2023-07-25T14:35:45.593610+0000","last_clean":"2023-07-25T14:35:45.593610+0000","last_became_active":"2023-07-25T14:35:40.570814+0000","last_became_peered":"2023-07-25T14:35:40.570814+0000","last_unstale":"2023-07-25T14:35:45.593610+0000","last_undegraded":"2023-07-25T14:35:45.593610+0000","last_fullsized":"2023-07-25T14:35:45.593610+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T22:11:31.858060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:47.032762+0000","last_change":"2023-07-25T14:35:44.606624+0000","last_active":"2023-07-25T14:35:47.032762+0000","last_peered":"2023-07-25T14:35:47.032762+0000","last_clean":"2023-07-25T14:35:47.032762+0000","last_became_active":"2023-07-25T14:35:44.606139+0000","last_became_peered":"2023-07-25T14:35:44.606139+0000","last_unstale":"2023-07-25T14:35:47.032762+0000","last_undegraded":"2023-07-25T14:35:47.032762+0000","last_fullsized":"2023-07-25T14:35:47.032762+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_clean_scrub_stamp":"2023-07-25T14:35:43.577860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T01:22:16.213854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"20'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:46.549292+0000","last_change":"2023-07-25T14:35:39.536361+0000","last_active":"2023-07-25T14:35:46.549292+0000","last_peered":"2023-07-25T14:35:46.549292+0000","last_clean":"2023-07-25T14:35:46.549292+0000","last_became_active":"2023-07-25T14:35:39.536071+0000","last_became_peered":"2023-07-25T14:35:39.536071+0000","last_unstale":"2023-07-25T14:35:46.549292+0000","last_undegraded":"2023-07-25T14:35:46.549292+0000","last_fullsized":"2023-07-25T14:35:46.549292+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_clean_scrub_stamp":"2023-07-25T14:35:38.515226+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T18:51:17.455450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.590781+0000","last_change":"2023-07-25T14:35:40.569105+0000","last_active":"2023-07-25T14:35:45.590781+0000","last_peered":"2023-07-25T14:35:45.590781+0000","last_clean":"2023-07-25T14:35:45.590781+0000","last_became_active":"2023-07-25T14:35:40.568843+0000","last_became_peered":"2023-07-25T14:35:40.568843+0000","last_unstale":"2023-07-25T14:35:45.590781+0000","last_undegraded":"2023-07-25T14:35:45.590781+0000","last_fullsized":"2023-07-25T14:35:45.590781+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T23:38:20.059103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:47.032831+0000","last_change":"2023-07-25T14:35:44.611780+0000","last_active":"2023-07-25T14:35:47.032831+0000","last_peered":"2023-07-25T14:35:47.032831+0000","last_clean":"2023-07-25T14:35:47.032831+0000","last_became_active":"2023-07-25T14:35:44.606160+0000","last_became_peered":"2023-07-25T14:35:44.606160+0000","last_unstale":"2023-07-25T14:35:47.032831+0000","last_undegraded":"2023-07-25T14:35:47.032831+0000","last_fullsized":"2023-07-25T14:35:47.032831+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_clean_scrub_stamp":"2023-07-25T14:35:43.577860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T15:47:56.186166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.592846+0000","last_change":"2023-07-25T14:35:39.543540+0000","last_active":"2023-07-25T14:35:45.592846+0000","last_peered":"2023-07-25T14:35:45.592846+0000","last_clean":"2023-07-25T14:35:45.592846+0000","last_became_active":"2023-07-25T14:35:39.543276+0000","last_became_peered":"2023-07-25T14:35:39.543276+0000","last_unstale":"2023-07-25T14:35:45.592846+0000","last_undegraded":"2023-07-25T14:35:45.592846+0000","last_fullsized":"2023-07-25T14:35:45.592846+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_clean_scrub_stamp":"2023-07-25T14:35:38.515226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T14:52:14.647241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:46.555100+0000","last_change":"2023-07-25T14:35:40.571035+0000","last_active":"2023-07-25T14:35:46.555100+0000","last_peered":"2023-07-25T14:35:46.555100+0000","last_clean":"2023-07-25T14:35:46.555100+0000","last_became_active":"2023-07-25T14:35:40.570770+0000","last_became_peered":"2023-07-25T14:35:40.570770+0000","last_unstale":"2023-07-25T14:35:46.555100+0000","last_undegraded":"2023-07-25T14:35:46.555100+0000","last_fullsized":"2023-07-25T14:35:46.555100+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T19:57:14.056118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:47.032847+0000","last_change":"2023-07-25T14:35:44.608600+0000","last_active":"2023-07-25T14:35:47.032847+0000","last_peered":"2023-07-25T14:35:47.032847+0000","last_clean":"2023-07-25T14:35:47.032847+0000","last_became_active":"2023-07-25T14:35:44.606326+0000","last_became_peered":"2023-07-25T14:35:44.606326+0000","last_unstale":"2023-07-25T14:35:47.032847+0000","last_undegraded":"2023-07-25T14:35:47.032847+0000","last_fullsized":"2023-07-25T14:35:47.032847+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_clean_scrub_stamp":"2023-07-25T14:35:43.577860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T16:02:38.366335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.813032+0000","last_change":"2023-07-25T14:35:39.540008+0000","last_active":"2023-07-25T14:35:45.813032+0000","last_peered":"2023-07-25T14:35:45.813032+0000","last_clean":"2023-07-25T14:35:45.813032+0000","last_became_active":"2023-07-25T14:35:39.539753+0000","last_became_peered":"2023-07-25T14:35:39.539753+0000","last_unstale":"2023-07-25T14:35:45.813032+0000","last_undegraded":"2023-07-25T14:35:45.813032+0000","last_fullsized":"2023-07-25T14:35:45.813032+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_clean_scrub_stamp":"2023-07-25T14:35:38.515226+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T16:18:56.015550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.593664+0000","last_change":"2023-07-25T14:35:40.573373+0000","last_active":"2023-07-25T14:35:45.593664+0000","last_peered":"2023-07-25T14:35:45.593664+0000","last_clean":"2023-07-25T14:35:45.593664+0000","last_became_active":"2023-07-25T14:35:40.569647+0000","last_became_peered":"2023-07-25T14:35:40.569647+0000","last_unstale":"2023-07-25T14:35:45.593664+0000","last_undegraded":"2023-07-25T14:35:45.593664+0000","last_fullsized":"2023-07-25T14:35:45.593664+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T23:26:04.449433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:47.033427+0000","last_change":"2023-07-25T14:35:44.610221+0000","last_active":"2023-07-25T14:35:47.033427+0000","last_peered":"2023-07-25T14:35:47.033427+0000","last_clean":"2023-07-25T14:35:47.033427+0000","last_became_active":"2023-07-25T14:35:44.609802+0000","last_became_peered":"2023-07-25T14:35:44.609802+0000","last_unstale":"2023-07-25T14:35:47.033427+0000","last_undegraded":"2023-07-25T14:35:47.033427+0000","last_fullsized":"2023-07-25T14:35:47.033427+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_clean_scrub_stamp":"2023-07-25T14:35:43.577860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:12:09.178353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.590976+0000","last_change":"2023-07-25T14:35:39.542216+0000","last_active":"2023-07-25T14:35:45.590976+0000","last_peered":"2023-07-25T14:35:45.590976+0000","last_clean":"2023-07-25T14:35:45.590976+0000","last_became_active":"2023-07-25T14:35:39.541786+0000","last_became_peered":"2023-07-25T14:35:39.541786+0000","last_unstale":"2023-07-25T14:35:45.590976+0000","last_undegraded":"2023-07-25T14:35:45.590976+0000","last_fullsized":"2023-07-25T14:35:45.590976+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_clean_scrub_stamp":"2023-07-25T14:35:38.515226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T21:48:28.076390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.594037+0000","last_change":"2023-07-25T14:35:40.572398+0000","last_active":"2023-07-25T14:35:45.594037+0000","last_peered":"2023-07-25T14:35:45.594037+0000","last_clean":"2023-07-25T14:35:45.594037+0000","last_became_active":"2023-07-25T14:35:40.572184+0000","last_became_peered":"2023-07-25T14:35:40.572184+0000","last_unstale":"2023-07-25T14:35:45.594037+0000","last_undegraded":"2023-07-25T14:35:45.594037+0000","last_fullsized":"2023-07-25T14:35:45.594037+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T20:41:25.611682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.592232+0000","last_change":"2023-07-25T14:35:44.608573+0000","last_active":"2023-07-25T14:35:45.592232+0000","last_peered":"2023-07-25T14:35:45.592232+0000","last_clean":"2023-07-25T14:35:45.592232+0000","last_became_active":"2023-07-25T14:35:44.608195+0000","last_became_peered":"2023-07-25T14:35:44.608195+0000","last_unstale":"2023-07-25T14:35:45.592232+0000","last_undegraded":"2023-07-25T14:35:45.592232+0000","last_fullsized":"2023-07-25T14:35:45.592232+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_clean_scrub_stamp":"2023-07-25T14:35:43.577860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T19:42:05.988099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.593367+0000","last_change":"2023-07-25T14:35:39.534458+0000","last_active":"2023-07-25T14:35:45.593367+0000","last_peered":"2023-07-25T14:35:45.593367+0000","last_clean":"2023-07-25T14:35:45.593367+0000","last_became_active":"2023-07-25T14:35:39.534185+0000","last_became_peered":"2023-07-25T14:35:39.534185+0000","last_unstale":"2023-07-25T14:35:45.593367+0000","last_undegraded":"2023-07-25T14:35:45.593367+0000","last_fullsized":"2023-07-25T14:35:45.593367+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_clean_scrub_stamp":"2023-07-25T14:35:38.515226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T16:23:13.221599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.594751+0000","last_change":"2023-07-25T14:35:40.577364+0000","last_active":"2023-07-25T14:35:45.594751+0000","last_peered":"2023-07-25T14:35:45.594751+0000","last_clean":"2023-07-25T14:35:45.594751+0000","last_became_active":"2023-07-25T14:35:40.577048+0000","last_became_peered":"2023-07-25T14:35:40.577048+0000","last_unstale":"2023-07-25T14:35:45.594751+0000","last_undegraded":"2023-07-25T14:35:45.594751+0000","last_fullsized":"2023-07-25T14:35:45.594751+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T15:35:25.781647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.594516+0000","last_change":"2023-07-25T14:35:44.605512+0000","last_active":"2023-07-25T14:35:45.594516+0000","last_peered":"2023-07-25T14:35:45.594516+0000","last_clean":"2023-07-25T14:35:45.594516+0000","last_became_active":"2023-07-25T14:35:44.605134+0000","last_became_peered":"2023-07-25T14:35:44.605134+0000","last_unstale":"2023-07-25T14:35:45.594516+0000","last_undegraded":"2023-07-25T14:35:45.594516+0000","last_fullsized":"2023-07-25T14:35:45.594516+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_clean_scrub_stamp":"2023-07-25T14:35:43.577860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T21:23:30.279301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.812760+0000","last_change":"2023-07-25T14:35:39.540299+0000","last_active":"2023-07-25T14:35:45.812760+0000","last_peered":"2023-07-25T14:35:45.812760+0000","last_clean":"2023-07-25T14:35:45.812760+0000","last_became_active":"2023-07-25T14:35:39.540013+0000","last_became_peered":"2023-07-25T14:35:39.540013+0000","last_unstale":"2023-07-25T14:35:45.812760+0000","last_undegraded":"2023-07-25T14:35:45.812760+0000","last_fullsized":"2023-07-25T14:35:45.812760+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_clean_scrub_stamp":"2023-07-25T14:35:38.515226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:42:37.075884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:47.033534+0000","last_change":"2023-07-25T14:35:40.580966+0000","last_active":"2023-07-25T14:35:47.033534+0000","last_peered":"2023-07-25T14:35:47.033534+0000","last_clean":"2023-07-25T14:35:47.033534+0000","last_became_active":"2023-07-25T14:35:40.580713+0000","last_became_peered":"2023-07-25T14:35:40.580713+0000","last_unstale":"2023-07-25T14:35:47.033534+0000","last_undegraded":"2023-07-25T14:35:47.033534+0000","last_fullsized":"2023-07-25T14:35:47.033534+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T17:42:33.268060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.593698+0000","last_change":"2023-07-25T14:35:44.608905+0000","last_active":"2023-07-25T14:35:45.593698+0000","last_peered":"2023-07-25T14:35:45.593698+0000","last_clean":"2023-07-25T14:35:45.593698+0000","last_became_active":"2023-07-25T14:35:44.608522+0000","last_became_peered":"2023-07-25T14:35:44.608522+0000","last_unstale":"2023-07-25T14:35:45.593698+0000","last_undegraded":"2023-07-25T14:35:45.593698+0000","last_fullsized":"2023-07-25T14:35:45.593698+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_clean_scrub_stamp":"2023-07-25T14:35:43.577860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T22:11:48.857968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.813615+0000","last_change":"2023-07-25T14:35:39.543373+0000","last_active":"2023-07-25T14:35:45.813615+0000","last_peered":"2023-07-25T14:35:45.813615+0000","last_clean":"2023-07-25T14:35:45.813615+0000","last_became_active":"2023-07-25T14:35:39.542998+0000","last_became_peered":"2023-07-25T14:35:39.542998+0000","last_unstale":"2023-07-25T14:35:45.813615+0000","last_undegraded":"2023-07-25T14:35:45.813615+0000","last_fullsized":"2023-07-25T14:35:45.813615+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_clean_scrub_stamp":"2023-07-25T14:35:38.515226+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T19:24:35.653665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.594297+0000","last_change":"2023-07-25T14:35:34.371347+0000","last_active":"2023-07-25T14:35:45.594297+0000","last_peered":"2023-07-25T14:35:45.594297+0000","last_clean":"2023-07-25T14:35:45.594297+0000","last_became_active":"2023-07-25T14:35:34.371044+0000","last_became_peered":"2023-07-25T14:35:34.371044+0000","last_unstale":"2023-07-25T14:35:45.594297+0000","last_undegraded":"2023-07-25T14:35:45.594297+0000","last_fullsized":"2023-07-25T14:35:45.594297+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_clean_scrub_stamp":"2023-07-25T14:35:33.358525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T18:48:18.013494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.812672+0000","last_change":"2023-07-25T14:35:40.570033+0000","last_active":"2023-07-25T14:35:45.812672+0000","last_peered":"2023-07-25T14:35:45.812672+0000","last_clean":"2023-07-25T14:35:45.812672+0000","last_became_active":"2023-07-25T14:35:40.569434+0000","last_became_peered":"2023-07-25T14:35:40.569434+0000","last_unstale":"2023-07-25T14:35:45.812672+0000","last_undegraded":"2023-07-25T14:35:45.812672+0000","last_fullsized":"2023-07-25T14:35:45.812672+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T18:51:18.457575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.812670+0000","last_change":"2023-07-25T14:35:44.609023+0000","last_active":"2023-07-25T14:35:45.812670+0000","last_peered":"2023-07-25T14:35:45.812670+0000","last_clean":"2023-07-25T14:35:45.812670+0000","last_became_active":"2023-07-25T14:35:44.608633+0000","last_became_peered":"2023-07-25T14:35:44.608633+0000","last_unstale":"2023-07-25T14:35:45.812670+0000","last_undegraded":"2023-07-25T14:35:45.812670+0000","last_fullsized":"2023-07-25T14:35:45.812670+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_clean_scrub_stamp":"2023-07-25T14:35:43.577860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:25:01.255497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.813164+0000","last_change":"2023-07-25T14:35:34.371737+0000","last_active":"2023-07-25T14:35:45.813164+0000","last_peered":"2023-07-25T14:35:45.813164+0000","last_clean":"2023-07-25T14:35:45.813164+0000","last_became_active":"2023-07-25T14:35:34.371411+0000","last_became_peered":"2023-07-25T14:35:34.371411+0000","last_unstale":"2023-07-25T14:35:45.813164+0000","last_undegraded":"2023-07-25T14:35:45.813164+0000","last_fullsized":"2023-07-25T14:35:45.813164+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_clean_scrub_stamp":"2023-07-25T14:35:33.358525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T23:20:13.045467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"23'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:46.554714+0000","last_change":"2023-07-25T14:35:39.539692+0000","last_active":"2023-07-25T14:35:46.554714+0000","last_peered":"2023-07-25T14:35:46.554714+0000","last_clean":"2023-07-25T14:35:46.554714+0000","last_became_active":"2023-07-25T14:35:39.539376+0000","last_became_peered":"2023-07-25T14:35:39.539376+0000","last_unstale":"2023-07-25T14:35:46.554714+0000","last_undegraded":"2023-07-25T14:35:46.554714+0000","last_fullsized":"2023-07-25T14:35:46.554714+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_clean_scrub_stamp":"2023-07-25T14:35:38.515226+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T17:03:30.120782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.593423+0000","last_change":"2023-07-25T14:35:40.572322+0000","last_active":"2023-07-25T14:35:45.593423+0000","last_peered":"2023-07-25T14:35:45.593423+0000","last_clean":"2023-07-25T14:35:45.593423+0000","last_became_active":"2023-07-25T14:35:40.571140+0000","last_became_peered":"2023-07-25T14:35:40.571140+0000","last_unstale":"2023-07-25T14:35:45.593423+0000","last_undegraded":"2023-07-25T14:35:45.593423+0000","last_fullsized":"2023-07-25T14:35:45.593423+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:03:45.072739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.591989+0000","last_change":"2023-07-25T14:35:44.611488+0000","last_active":"2023-07-25T14:35:45.591989+0000","last_peered":"2023-07-25T14:35:45.591989+0000","last_clean":"2023-07-25T14:35:45.591989+0000","last_became_active":"2023-07-25T14:35:44.610632+0000","last_became_peered":"2023-07-25T14:35:44.610632+0000","last_unstale":"2023-07-25T14:35:45.591989+0000","last_undegraded":"2023-07-25T14:35:45.591989+0000","last_fullsized":"2023-07-25T14:35:45.591989+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_clean_scrub_stamp":"2023-07-25T14:35:43.577860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T17:03:35.183416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:47.032770+0000","last_change":"2023-07-25T14:35:34.370121+0000","last_active":"2023-07-25T14:35:47.032770+0000","last_peered":"2023-07-25T14:35:47.032770+0000","last_clean":"2023-07-25T14:35:47.032770+0000","last_became_active":"2023-07-25T14:35:34.369795+0000","last_became_peered":"2023-07-25T14:35:34.369795+0000","last_unstale":"2023-07-25T14:35:47.032770+0000","last_undegraded":"2023-07-25T14:35:47.032770+0000","last_fullsized":"2023-07-25T14:35:47.032770+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_clean_scrub_stamp":"2023-07-25T14:35:33.358525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T22:23:26.576696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":177,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:46.548822+0000","last_change":"2023-07-25T14:35:34.372381+0000","last_active":"2023-07-25T14:35:46.548822+0000","last_peered":"2023-07-25T14:35:46.548822+0000","last_clean":"2023-07-25T14:35:46.548822+0000","last_became_active":"2023-07-25T14:35:34.371110+0000","last_became_peered":"2023-07-25T14:35:34.371110+0000","last_unstale":"2023-07-25T14:35:46.548822+0000","last_undegraded":"2023-07-25T14:35:46.548822+0000","last_fullsized":"2023-07-25T14:35:46.548822+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_clean_scrub_stamp":"2023-07-25T14:35:33.358525+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:20:22.063773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:46.554511+0000","last_change":"2023-07-25T14:35:39.541815+0000","last_active":"2023-07-25T14:35:46.554511+0000","last_peered":"2023-07-25T14:35:46.554511+0000","last_clean":"2023-07-25T14:35:46.554511+0000","last_became_active":"2023-07-25T14:35:39.541600+0000","last_became_peered":"2023-07-25T14:35:39.541600+0000","last_unstale":"2023-07-25T14:35:46.554511+0000","last_undegraded":"2023-07-25T14:35:46.554511+0000","last_fullsized":"2023-07-25T14:35:46.554511+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_clean_scrub_stamp":"2023-07-25T14:35:38.515226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T21:31:30.768429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:46.554954+0000","last_change":"2023-07-25T14:35:40.572449+0000","last_active":"2023-07-25T14:35:46.554954+0000","last_peered":"2023-07-25T14:35:46.554954+0000","last_clean":"2023-07-25T14:35:46.554954+0000","last_became_active":"2023-07-25T14:35:40.572096+0000","last_became_peered":"2023-07-25T14:35:40.572096+0000","last_unstale":"2023-07-25T14:35:46.554954+0000","last_undegraded":"2023-07-25T14:35:46.554954+0000","last_fullsized":"2023-07-25T14:35:46.554954+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:20:28.222599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:47.033330+0000","last_change":"2023-07-25T14:35:44.612010+0000","last_active":"2023-07-25T14:35:47.033330+0000","last_peered":"2023-07-25T14:35:47.033330+0000","last_clean":"2023-07-25T14:35:47.033330+0000","last_became_active":"2023-07-25T14:35:44.611576+0000","last_became_peered":"2023-07-25T14:35:44.611576+0000","last_unstale":"2023-07-25T14:35:47.033330+0000","last_undegraded":"2023-07-25T14:35:47.033330+0000","last_fullsized":"2023-07-25T14:35:47.033330+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_clean_scrub_stamp":"2023-07-25T14:35:43.577860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T20:58:23.211755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:46.548801+0000","last_change":"2023-07-25T14:35:35.321448+0000","last_active":"2023-07-25T14:35:46.548801+0000","last_peered":"2023-07-25T14:35:46.548801+0000","last_clean":"2023-07-25T14:35:46.548801+0000","last_became_active":"2023-07-25T14:35:35.320830+0000","last_became_peered":"2023-07-25T14:35:35.320830+0000","last_unstale":"2023-07-25T14:35:46.548801+0000","last_undegraded":"2023-07-25T14:35:46.548801+0000","last_fullsized":"2023-07-25T14:35:46.548801+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_clean_scrub_stamp":"2023-07-25T14:35:33.358525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:09:28.211053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:47.032318+0000","last_change":"2023-07-25T14:35:39.536830+0000","last_active":"2023-07-25T14:35:47.032318+0000","last_peered":"2023-07-25T14:35:47.032318+0000","last_clean":"2023-07-25T14:35:47.032318+0000","last_became_active":"2023-07-25T14:35:39.536580+0000","last_became_peered":"2023-07-25T14:35:39.536580+0000","last_unstale":"2023-07-25T14:35:47.032318+0000","last_undegraded":"2023-07-25T14:35:47.032318+0000","last_fullsized":"2023-07-25T14:35:47.032318+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_clean_scrub_stamp":"2023-07-25T14:35:38.515226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T14:53:19.398227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:47.033471+0000","last_change":"2023-07-25T14:35:40.574429+0000","last_active":"2023-07-25T14:35:47.033471+0000","last_peered":"2023-07-25T14:35:47.033471+0000","last_clean":"2023-07-25T14:35:47.033471+0000","last_became_active":"2023-07-25T14:35:40.574108+0000","last_became_peered":"2023-07-25T14:35:40.574108+0000","last_unstale":"2023-07-25T14:35:47.033471+0000","last_undegraded":"2023-07-25T14:35:47.033471+0000","last_fullsized":"2023-07-25T14:35:47.033471+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T21:31:31.770554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:46.549141+0000","last_change":"2023-07-25T14:35:44.613889+0000","last_active":"2023-07-25T14:35:46.549141+0000","last_peered":"2023-07-25T14:35:46.549141+0000","last_clean":"2023-07-25T14:35:46.549141+0000","last_became_active":"2023-07-25T14:35:44.613279+0000","last_became_peered":"2023-07-25T14:35:44.613279+0000","last_unstale":"2023-07-25T14:35:46.549141+0000","last_undegraded":"2023-07-25T14:35:46.549141+0000","last_fullsized":"2023-07-25T14:35:46.549141+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_clean_scrub_stamp":"2023-07-25T14:35:43.577860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T19:57:18.116626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:46.548653+0000","last_change":"2023-07-25T14:35:35.321201+0000","last_active":"2023-07-25T14:35:46.548653+0000","last_peered":"2023-07-25T14:35:46.548653+0000","last_clean":"2023-07-25T14:35:46.548653+0000","last_became_active":"2023-07-25T14:35:35.320728+0000","last_became_peered":"2023-07-25T14:35:35.320728+0000","last_unstale":"2023-07-25T14:35:46.548653+0000","last_undegraded":"2023-07-25T14:35:46.548653+0000","last_fullsized":"2023-07-25T14:35:46.548653+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_clean_scrub_stamp":"2023-07-25T14:35:33.358525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:43:20.143867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.812837+0000","last_change":"2023-07-25T14:35:39.540111+0000","last_active":"2023-07-25T14:35:45.812837+0000","last_peered":"2023-07-25T14:35:45.812837+0000","last_clean":"2023-07-25T14:35:45.812837+0000","last_became_active":"2023-07-25T14:35:39.539829+0000","last_became_peered":"2023-07-25T14:35:39.539829+0000","last_unstale":"2023-07-25T14:35:45.812837+0000","last_undegraded":"2023-07-25T14:35:45.812837+0000","last_fullsized":"2023-07-25T14:35:45.812837+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_clean_scrub_stamp":"2023-07-25T14:35:38.515226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T20:10:32.190837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.591417+0000","last_change":"2023-07-25T14:35:40.572819+0000","last_active":"2023-07-25T14:35:45.591417+0000","last_peered":"2023-07-25T14:35:45.591417+0000","last_clean":"2023-07-25T14:35:45.591417+0000","last_became_active":"2023-07-25T14:35:40.572460+0000","last_became_peered":"2023-07-25T14:35:40.572460+0000","last_unstale":"2023-07-25T14:35:45.591417+0000","last_undegraded":"2023-07-25T14:35:45.591417+0000","last_fullsized":"2023-07-25T14:35:45.591417+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T19:36:38.983536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:46.554722+0000","last_change":"2023-07-25T14:35:44.617264+0000","last_active":"2023-07-25T14:35:46.554722+0000","last_peered":"2023-07-25T14:35:46.554722+0000","last_clean":"2023-07-25T14:35:46.554722+0000","last_became_active":"2023-07-25T14:35:44.616864+0000","last_became_peered":"2023-07-25T14:35:44.616864+0000","last_unstale":"2023-07-25T14:35:46.554722+0000","last_undegraded":"2023-07-25T14:35:46.554722+0000","last_fullsized":"2023-07-25T14:35:46.554722+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_clean_scrub_stamp":"2023-07-25T14:35:43.577860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T20:23:17.193123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.592094+0000","last_change":"2023-07-25T14:35:35.321057+0000","last_active":"2023-07-25T14:35:45.592094+0000","last_peered":"2023-07-25T14:35:45.592094+0000","last_clean":"2023-07-25T14:35:45.592094+0000","last_became_active":"2023-07-25T14:35:35.320751+0000","last_became_peered":"2023-07-25T14:35:35.320751+0000","last_unstale":"2023-07-25T14:35:45.592094+0000","last_undegraded":"2023-07-25T14:35:45.592094+0000","last_fullsized":"2023-07-25T14:35:45.592094+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_clean_scrub_stamp":"2023-07-25T14:35:33.358525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:55:16.670397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.593801+0000","last_change":"2023-07-25T14:35:39.535048+0000","last_active":"2023-07-25T14:35:45.593801+0000","last_peered":"2023-07-25T14:35:45.593801+0000","last_clean":"2023-07-25T14:35:45.593801+0000","last_became_active":"2023-07-25T14:35:39.534749+0000","last_became_peered":"2023-07-25T14:35:39.534749+0000","last_unstale":"2023-07-25T14:35:45.593801+0000","last_undegraded":"2023-07-25T14:35:45.593801+0000","last_fullsized":"2023-07-25T14:35:45.593801+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_clean_scrub_stamp":"2023-07-25T14:35:38.515226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T19:56:32.500581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:47.032972+0000","last_change":"2023-07-25T14:35:40.562358+0000","last_active":"2023-07-25T14:35:47.032972+0000","last_peered":"2023-07-25T14:35:47.032972+0000","last_clean":"2023-07-25T14:35:47.032972+0000","last_became_active":"2023-07-25T14:35:40.562072+0000","last_became_peered":"2023-07-25T14:35:40.562072+0000","last_unstale":"2023-07-25T14:35:47.032972+0000","last_undegraded":"2023-07-25T14:35:47.032972+0000","last_fullsized":"2023-07-25T14:35:47.032972+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T23:39:16.694925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.591232+0000","last_change":"2023-07-25T14:35:44.605076+0000","last_active":"2023-07-25T14:35:45.591232+0000","last_peered":"2023-07-25T14:35:45.591232+0000","last_clean":"2023-07-25T14:35:45.591232+0000","last_became_active":"2023-07-25T14:35:44.604627+0000","last_became_peered":"2023-07-25T14:35:44.604627+0000","last_unstale":"2023-07-25T14:35:45.591232+0000","last_undegraded":"2023-07-25T14:35:45.591232+0000","last_fullsized":"2023-07-25T14:35:45.591232+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_clean_scrub_stamp":"2023-07-25T14:35:43.577860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T17:14:14.382524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.591663+0000","last_change":"2023-07-25T14:35:35.321055+0000","last_active":"2023-07-25T14:35:45.591663+0000","last_peered":"2023-07-25T14:35:45.591663+0000","last_clean":"2023-07-25T14:35:45.591663+0000","last_became_active":"2023-07-25T14:35:35.320739+0000","last_became_peered":"2023-07-25T14:35:35.320739+0000","last_unstale":"2023-07-25T14:35:45.591663+0000","last_undegraded":"2023-07-25T14:35:45.591663+0000","last_fullsized":"2023-07-25T14:35:45.591663+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_clean_scrub_stamp":"2023-07-25T14:35:33.358525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T17:42:19.164577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:47.033169+0000","last_change":"2023-07-25T14:35:39.539756+0000","last_active":"2023-07-25T14:35:47.033169+0000","last_peered":"2023-07-25T14:35:47.033169+0000","last_clean":"2023-07-25T14:35:47.033169+0000","last_became_active":"2023-07-25T14:35:39.539459+0000","last_became_peered":"2023-07-25T14:35:39.539459+0000","last_unstale":"2023-07-25T14:35:47.033169+0000","last_undegraded":"2023-07-25T14:35:47.033169+0000","last_fullsized":"2023-07-25T14:35:47.033169+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_clean_scrub_stamp":"2023-07-25T14:35:38.515226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:14:10.943034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:46.555037+0000","last_change":"2023-07-25T14:35:40.569961+0000","last_active":"2023-07-25T14:35:46.555037+0000","last_peered":"2023-07-25T14:35:46.555037+0000","last_clean":"2023-07-25T14:35:46.555037+0000","last_became_active":"2023-07-25T14:35:40.569660+0000","last_became_peered":"2023-07-25T14:35:40.569660+0000","last_unstale":"2023-07-25T14:35:46.555037+0000","last_undegraded":"2023-07-25T14:35:46.555037+0000","last_fullsized":"2023-07-25T14:35:46.555037+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T21:17:40.464582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:46.554816+0000","last_change":"2023-07-25T14:35:44.616675+0000","last_active":"2023-07-25T14:35:46.554816+0000","last_peered":"2023-07-25T14:35:46.554816+0000","last_clean":"2023-07-25T14:35:46.554816+0000","last_became_active":"2023-07-25T14:35:44.616241+0000","last_became_peered":"2023-07-25T14:35:44.616241+0000","last_unstale":"2023-07-25T14:35:46.554816+0000","last_undegraded":"2023-07-25T14:35:46.554816+0000","last_fullsized":"2023-07-25T14:35:46.554816+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_clean_scrub_stamp":"2023-07-25T14:35:43.577860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T19:42:05.988099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.593040+0000","last_change":"2023-07-25T14:35:34.370772+0000","last_active":"2023-07-25T14:35:45.593040+0000","last_peered":"2023-07-25T14:35:45.593040+0000","last_clean":"2023-07-25T14:35:45.593040+0000","last_became_active":"2023-07-25T14:35:34.370549+0000","last_became_peered":"2023-07-25T14:35:34.370549+0000","last_unstale":"2023-07-25T14:35:45.593040+0000","last_undegraded":"2023-07-25T14:35:45.593040+0000","last_fullsized":"2023-07-25T14:35:45.593040+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_clean_scrub_stamp":"2023-07-25T14:35:33.358525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T19:34:32.153689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.591780+0000","last_change":"2023-07-25T14:35:39.543278+0000","last_active":"2023-07-25T14:35:45.591780+0000","last_peered":"2023-07-25T14:35:45.591780+0000","last_clean":"2023-07-25T14:35:45.591780+0000","last_became_active":"2023-07-25T14:35:39.543017+0000","last_became_peered":"2023-07-25T14:35:39.543017+0000","last_unstale":"2023-07-25T14:35:45.591780+0000","last_undegraded":"2023-07-25T14:35:45.591780+0000","last_fullsized":"2023-07-25T14:35:45.591780+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_clean_scrub_stamp":"2023-07-25T14:35:38.515226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T17:42:32.265934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:47.032289+0000","last_change":"2023-07-25T14:35:40.574583+0000","last_active":"2023-07-25T14:35:47.032289+0000","last_peered":"2023-07-25T14:35:47.032289+0000","last_clean":"2023-07-25T14:35:47.032289+0000","last_became_active":"2023-07-25T14:35:40.574298+0000","last_became_peered":"2023-07-25T14:35:40.574298+0000","last_unstale":"2023-07-25T14:35:47.032289+0000","last_undegraded":"2023-07-25T14:35:47.032289+0000","last_fullsized":"2023-07-25T14:35:47.032289+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T01:29:43.918829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:47.033044+0000","last_change":"2023-07-25T14:35:44.609515+0000","last_active":"2023-07-25T14:35:47.033044+0000","last_peered":"2023-07-25T14:35:47.033044+0000","last_clean":"2023-07-25T14:35:47.033044+0000","last_became_active":"2023-07-25T14:35:44.609128+0000","last_became_peered":"2023-07-25T14:35:44.609128+0000","last_unstale":"2023-07-25T14:35:47.033044+0000","last_undegraded":"2023-07-25T14:35:47.033044+0000","last_fullsized":"2023-07-25T14:35:47.033044+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_clean_scrub_stamp":"2023-07-25T14:35:43.577860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T01:26:57.336329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"20'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:46.555117+0000","last_change":"2023-07-25T14:35:39.542444+0000","last_active":"2023-07-25T14:35:46.555117+0000","last_peered":"2023-07-25T14:35:46.555117+0000","last_clean":"2023-07-25T14:35:46.555117+0000","last_became_active":"2023-07-25T14:35:39.542159+0000","last_became_peered":"2023-07-25T14:35:39.542159+0000","last_unstale":"2023-07-25T14:35:46.555117+0000","last_undegraded":"2023-07-25T14:35:46.555117+0000","last_fullsized":"2023-07-25T14:35:46.555117+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_clean_scrub_stamp":"2023-07-25T14:35:38.515226+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:24:56.192863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:47.033068+0000","last_change":"2023-07-25T14:35:40.560846+0000","last_active":"2023-07-25T14:35:47.033068+0000","last_peered":"2023-07-25T14:35:47.033068+0000","last_clean":"2023-07-25T14:35:47.033068+0000","last_became_active":"2023-07-25T14:35:40.560390+0000","last_became_peered":"2023-07-25T14:35:40.560390+0000","last_unstale":"2023-07-25T14:35:47.033068+0000","last_undegraded":"2023-07-25T14:35:47.033068+0000","last_fullsized":"2023-07-25T14:35:47.033068+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T02:30:11.217603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:46.548733+0000","last_change":"2023-07-25T14:35:44.612963+0000","last_active":"2023-07-25T14:35:46.548733+0000","last_peered":"2023-07-25T14:35:46.548733+0000","last_clean":"2023-07-25T14:35:46.548733+0000","last_became_active":"2023-07-25T14:35:44.612473+0000","last_became_peered":"2023-07-25T14:35:44.612473+0000","last_unstale":"2023-07-25T14:35:46.548733+0000","last_undegraded":"2023-07-25T14:35:46.548733+0000","last_fullsized":"2023-07-25T14:35:46.548733+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_clean_scrub_stamp":"2023-07-25T14:35:43.577860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T15:17:51.741356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.592714+0000","last_change":"2023-07-25T14:35:39.533066+0000","last_active":"2023-07-25T14:35:45.592714+0000","last_peered":"2023-07-25T14:35:45.592714+0000","last_clean":"2023-07-25T14:35:45.592714+0000","last_became_active":"2023-07-25T14:35:39.532788+0000","last_became_peered":"2023-07-25T14:35:39.532788+0000","last_unstale":"2023-07-25T14:35:45.592714+0000","last_undegraded":"2023-07-25T14:35:45.592714+0000","last_fullsized":"2023-07-25T14:35:45.592714+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_clean_scrub_stamp":"2023-07-25T14:35:38.515226+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:20:27.220474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.593805+0000","last_change":"2023-07-25T14:35:40.583948+0000","last_active":"2023-07-25T14:35:45.593805+0000","last_peered":"2023-07-25T14:35:45.593805+0000","last_clean":"2023-07-25T14:35:45.593805+0000","last_became_active":"2023-07-25T14:35:40.583649+0000","last_became_peered":"2023-07-25T14:35:40.583649+0000","last_unstale":"2023-07-25T14:35:45.593805+0000","last_undegraded":"2023-07-25T14:35:45.593805+0000","last_fullsized":"2023-07-25T14:35:45.593805+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T23:42:40.581448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.592627+0000","last_change":"2023-07-25T14:35:44.605812+0000","last_active":"2023-07-25T14:35:45.592627+0000","last_peered":"2023-07-25T14:35:45.592627+0000","last_clean":"2023-07-25T14:35:45.592627+0000","last_became_active":"2023-07-25T14:35:44.605416+0000","last_became_peered":"2023-07-25T14:35:44.605416+0000","last_unstale":"2023-07-25T14:35:45.592627+0000","last_undegraded":"2023-07-25T14:35:45.592627+0000","last_fullsized":"2023-07-25T14:35:45.592627+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_clean_scrub_stamp":"2023-07-25T14:35:43.577860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:09:38.430388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.591482+0000","last_change":"2023-07-25T14:35:39.538303+0000","last_active":"2023-07-25T14:35:45.591482+0000","last_peered":"2023-07-25T14:35:45.591482+0000","last_clean":"2023-07-25T14:35:45.591482+0000","last_became_active":"2023-07-25T14:35:39.538019+0000","last_became_peered":"2023-07-25T14:35:39.538019+0000","last_unstale":"2023-07-25T14:35:45.591482+0000","last_undegraded":"2023-07-25T14:35:45.591482+0000","last_fullsized":"2023-07-25T14:35:45.591482+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_clean_scrub_stamp":"2023-07-25T14:35:38.515226+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T21:36:37.994624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.593528+0000","last_change":"2023-07-25T14:35:40.573130+0000","last_active":"2023-07-25T14:35:45.593528+0000","last_peered":"2023-07-25T14:35:45.593528+0000","last_clean":"2023-07-25T14:35:45.593528+0000","last_became_active":"2023-07-25T14:35:40.572465+0000","last_became_peered":"2023-07-25T14:35:40.572465+0000","last_unstale":"2023-07-25T14:35:45.593528+0000","last_undegraded":"2023-07-25T14:35:45.593528+0000","last_fullsized":"2023-07-25T14:35:45.593528+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T21:29:36.633963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.593380+0000","last_change":"2023-07-25T14:35:44.610311+0000","last_active":"2023-07-25T14:35:45.593380+0000","last_peered":"2023-07-25T14:35:45.593380+0000","last_clean":"2023-07-25T14:35:45.593380+0000","last_became_active":"2023-07-25T14:35:44.609672+0000","last_became_peered":"2023-07-25T14:35:44.609672+0000","last_unstale":"2023-07-25T14:35:45.593380+0000","last_undegraded":"2023-07-25T14:35:45.593380+0000","last_fullsized":"2023-07-25T14:35:45.593380+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_clean_scrub_stamp":"2023-07-25T14:35:43.577860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T21:04:57.404448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"20'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.813281+0000","last_change":"2023-07-25T14:35:39.542215+0000","last_active":"2023-07-25T14:35:45.813281+0000","last_peered":"2023-07-25T14:35:45.813281+0000","last_clean":"2023-07-25T14:35:45.813281+0000","last_became_active":"2023-07-25T14:35:39.541943+0000","last_became_peered":"2023-07-25T14:35:39.541943+0000","last_unstale":"2023-07-25T14:35:45.813281+0000","last_undegraded":"2023-07-25T14:35:45.813281+0000","last_fullsized":"2023-07-25T14:35:45.813281+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_clean_scrub_stamp":"2023-07-25T14:35:38.515226+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T18:16:10.455351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.812997+0000","last_change":"2023-07-25T14:35:40.579154+0000","last_active":"2023-07-25T14:35:45.812997+0000","last_peered":"2023-07-25T14:35:45.812997+0000","last_clean":"2023-07-25T14:35:45.812997+0000","last_became_active":"2023-07-25T14:35:40.578884+0000","last_became_peered":"2023-07-25T14:35:40.578884+0000","last_unstale":"2023-07-25T14:35:45.812997+0000","last_undegraded":"2023-07-25T14:35:45.812997+0000","last_fullsized":"2023-07-25T14:35:45.812997+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T17:49:05.620750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:47.032543+0000","last_change":"2023-07-25T14:35:44.612196+0000","last_active":"2023-07-25T14:35:47.032543+0000","last_peered":"2023-07-25T14:35:47.032543+0000","last_clean":"2023-07-25T14:35:47.032543+0000","last_became_active":"2023-07-25T14:35:44.607198+0000","last_became_peered":"2023-07-25T14:35:44.607198+0000","last_unstale":"2023-07-25T14:35:47.032543+0000","last_undegraded":"2023-07-25T14:35:47.032543+0000","last_fullsized":"2023-07-25T14:35:47.032543+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_clean_scrub_stamp":"2023-07-25T14:35:43.577860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T01:05:07.252828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"20'4","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:46.555008+0000","last_change":"2023-07-25T14:35:39.532403+0000","last_active":"2023-07-25T14:35:46.555008+0000","last_peered":"2023-07-25T14:35:46.555008+0000","last_clean":"2023-07-25T14:35:46.555008+0000","last_became_active":"2023-07-25T14:35:39.532093+0000","last_became_peered":"2023-07-25T14:35:39.532093+0000","last_unstale":"2023-07-25T14:35:46.555008+0000","last_undegraded":"2023-07-25T14:35:46.555008+0000","last_fullsized":"2023-07-25T14:35:46.555008+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_clean_scrub_stamp":"2023-07-25T14:35:38.515226+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T17:08:32.162917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.593485+0000","last_change":"2023-07-25T14:35:40.577967+0000","last_active":"2023-07-25T14:35:45.593485+0000","last_peered":"2023-07-25T14:35:45.593485+0000","last_clean":"2023-07-25T14:35:45.593485+0000","last_became_active":"2023-07-25T14:35:40.577650+0000","last_became_peered":"2023-07-25T14:35:40.577650+0000","last_unstale":"2023-07-25T14:35:45.593485+0000","last_undegraded":"2023-07-25T14:35:45.593485+0000","last_fullsized":"2023-07-25T14:35:45.593485+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T19:24:36.655790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.590805+0000","last_change":"2023-07-25T14:35:40.571775+0000","last_active":"2023-07-25T14:35:45.590805+0000","last_peered":"2023-07-25T14:35:45.590805+0000","last_clean":"2023-07-25T14:35:45.590805+0000","last_became_active":"2023-07-25T14:35:40.571515+0000","last_became_peered":"2023-07-25T14:35:40.571515+0000","last_unstale":"2023-07-25T14:35:45.590805+0000","last_undegraded":"2023-07-25T14:35:45.590805+0000","last_fullsized":"2023-07-25T14:35:45.590805+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T01:27:20.879412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.812791+0000","last_change":"2023-07-25T14:35:40.580145+0000","last_active":"2023-07-25T14:35:45.812791+0000","last_peered":"2023-07-25T14:35:45.812791+0000","last_clean":"2023-07-25T14:35:45.812791+0000","last_became_active":"2023-07-25T14:35:40.579840+0000","last_became_peered":"2023-07-25T14:35:40.579840+0000","last_unstale":"2023-07-25T14:35:45.812791+0000","last_undegraded":"2023-07-25T14:35:45.812791+0000","last_fullsized":"2023-07-25T14:35:45.812791+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T23:06:56.015409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.593959+0000","last_change":"2023-07-25T14:35:40.582132+0000","last_active":"2023-07-25T14:35:45.593959+0000","last_peered":"2023-07-25T14:35:45.593959+0000","last_clean":"2023-07-25T14:35:45.593959+0000","last_became_active":"2023-07-25T14:35:40.581759+0000","last_became_peered":"2023-07-25T14:35:40.581759+0000","last_unstale":"2023-07-25T14:35:45.593959+0000","last_undegraded":"2023-07-25T14:35:45.593959+0000","last_fullsized":"2023-07-25T14:35:45.593959+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T17:04:15.120194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.812954+0000","last_change":"2023-07-25T14:35:40.583199+0000","last_active":"2023-07-25T14:35:45.812954+0000","last_peered":"2023-07-25T14:35:45.812954+0000","last_clean":"2023-07-25T14:35:45.812954+0000","last_became_active":"2023-07-25T14:35:40.582969+0000","last_became_peered":"2023-07-25T14:35:40.582969+0000","last_unstale":"2023-07-25T14:35:45.812954+0000","last_undegraded":"2023-07-25T14:35:45.812954+0000","last_fullsized":"2023-07-25T14:35:45.812954+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T16:19:19.724875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:47.033086+0000","last_change":"2023-07-25T14:35:40.560945+0000","last_active":"2023-07-25T14:35:47.033086+0000","last_peered":"2023-07-25T14:35:47.033086+0000","last_clean":"2023-07-25T14:35:47.033086+0000","last_became_active":"2023-07-25T14:35:40.560663+0000","last_became_peered":"2023-07-25T14:35:40.560663+0000","last_unstale":"2023-07-25T14:35:47.033086+0000","last_undegraded":"2023-07-25T14:35:47.033086+0000","last_fullsized":"2023-07-25T14:35:47.033086+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T17:24:11.100853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4451,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":8902,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64510,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574856,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":360448,"data_stored":703638,"data_compressed":32255,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42799999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40100000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46899999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50800000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":266240,"data_stored":109401,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.307}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28699999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46100000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53100000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41399999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":331776,"data_stored":699769,"data_compressed":32255,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.374}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52900000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72399999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":266240,"data_stored":108922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32400000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41799999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64800000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47299999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]}]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":262144,"data_stored":108340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36299999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28899999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.311}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50800000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68700000000000006}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52300000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":266240,"data_stored":108430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40000000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35299999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44400000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60399999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51900000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":286720,"data_stored":113110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38800000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40500000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.372}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33400000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]}]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":274432,"data_stored":110053,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41799999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48699999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.443}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32255,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32255,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3709,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":3869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-25T14:36:00.728 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-25T14:36:00.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.865+0000 7f62495b0700 1 Processor -- start 2023-07-25T14:36:00.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.865+0000 7f62495b0700 1 -- start start 2023-07-25T14:36:00.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.865+0000 7f62495b0700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f62440bead0 0x7f62440c0350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:00.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.865+0000 7f62495b0700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f62440c0890 0x7f62440c44d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:00.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.866+0000 7f62495b0700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62440bfeb0 con 0x7f6244151a90 2023-07-25T14:36:00.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.866+0000 7f62495b0700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62440c10b0 con 0x7f62440c0890 2023-07-25T14:36:00.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.866+0000 7f62495b0700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62440c1940 con 0x7f62440bead0 2023-07-25T14:36:00.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.866+0000 7f62437fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f62440c0890 0x7f62440c44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:00.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.866+0000 7f62437fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f62440c0890 0x7f62440c44d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:39942/0 (socket says 172.21.15.72:39942) 2023-07-25T14:36:00.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.866+0000 7f6242ffd700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f6244151a90 0x7f6244154d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:58906/0 (socket says 172.21.15.72:58906) 2023-07-25T14:36:00.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.866+0000 7f62437fe700 1 -- 172.21.15.72:0/3834802928 learned_addr learned my addr 172.21.15.72:0/3834802928 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:00.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.866+0000 7f62427fc700 1 --2- 172.21.15.72:0/3834802928 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f62440bead0 0x7f62440c0350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:00.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.866+0000 7f62437fe700 1 -- 172.21.15.72:0/3834802928 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f62440bead0 msgr2=0x7f62440c0350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:00.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.866+0000 7f62437fe700 1 --2- 172.21.15.72:0/3834802928 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f62440bead0 0x7f62440c0350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:00.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.866+0000 7f62437fe700 1 -- 172.21.15.72:0/3834802928 >> v1:172.21.15.72:6789/0 conn(0x7f6244151a90 legacy=0x7f6244154d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:00.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.866+0000 7f62437fe700 1 -- 172.21.15.72:0/3834802928 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62440bf2e0 con 0x7f62440c0890 2023-07-25T14:36:00.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.866+0000 7f6241ffb700 1 -- 172.21.15.72:0/3834802928 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2155554580 0 0) 0x7f62440bfeb0 con 0x7f6244151a90 2023-07-25T14:36:00.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.866+0000 7f62437fe700 1 --2- 172.21.15.72:0/3834802928 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f62440c0890 0x7f62440c44d0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f623c009e50 tx=0x7f623c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a8f0a02df79d15b server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:00.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.866+0000 7f6241ffb700 1 -- 172.21.15.72:0/3834802928 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f623c00e070 con 0x7f62440c0890 2023-07-25T14:36:00.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.866+0000 7f6241ffb700 1 -- 172.21.15.72:0/3834802928 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f623c00b910 con 0x7f62440c0890 2023-07-25T14:36:00.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.866+0000 7f6241ffb700 1 -- 172.21.15.72:0/3834802928 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f623c00bcc0 con 0x7f62440c0890 2023-07-25T14:36:00.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.867+0000 7f62495b0700 1 -- 172.21.15.72:0/3834802928 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f62440c0890 msgr2=0x7f62440c44d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:00.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.867+0000 7f62495b0700 1 --2- 172.21.15.72:0/3834802928 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f62440c0890 0x7f62440c44d0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f623c009e50 tx=0x7f623c00b330 comp rx=0 tx=0).stop 2023-07-25T14:36:00.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.867+0000 7f62495b0700 1 -- 172.21.15.72:0/3834802928 shutdown_connections 2023-07-25T14:36:00.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.867+0000 7f62495b0700 1 --2- 172.21.15.72:0/3834802928 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f62440c0890 0x7f62440c44d0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:00.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.867+0000 7f62495b0700 1 --2- 172.21.15.72:0/3834802928 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f62440bead0 0x7f62440c0350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:00.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.867+0000 7f62495b0700 1 -- 172.21.15.72:0/3834802928 >> 172.21.15.72:0/3834802928 conn(0x7f624406c3a0 msgr2=0x7f624406c780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:00.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.867+0000 7f62495b0700 1 -- 172.21.15.72:0/3834802928 shutdown_connections 2023-07-25T14:36:00.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.867+0000 7f62495b0700 1 -- 172.21.15.72:0/3834802928 wait complete. 2023-07-25T14:36:00.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.868+0000 7f62495b0700 1 Processor -- start 2023-07-25T14:36:00.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.868+0000 7f62495b0700 1 -- start start 2023-07-25T14:36:00.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.869+0000 7f62495b0700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f62440bead0 0x7f624414c200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:00.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.869+0000 7f62495b0700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f62440c0890 0x7f62441475c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:00.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.869+0000 7f62495b0700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6244151a90 0x7f62441eaf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:00.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.869+0000 7f62495b0700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f624414bd70 con 0x7f6244151a90 2023-07-25T14:36:00.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.869+0000 7f62495b0700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f624414b790 con 0x7f62440c0890 2023-07-25T14:36:00.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.869+0000 7f62495b0700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f624414c740 con 0x7f62440bead0 2023-07-25T14:36:00.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.869+0000 7f62437fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6244151a90 0x7f62441eaf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:00.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.869+0000 7f62437fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6244151a90 0x7f62441eaf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:39948/0 (socket says 172.21.15.72:39948) 2023-07-25T14:36:00.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.869+0000 7f62437fe700 1 -- 172.21.15.72:0/2947111980 learned_addr learned my addr 172.21.15.72:0/2947111980 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:00.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.869+0000 7f6242ffd700 1 --2- 172.21.15.72:0/2947111980 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f62440bead0 0x7f624414c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:00.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.869+0000 7f62427fc700 1 --2- 172.21.15.72:0/2947111980 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f62440c0890 0x7f62441475c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:00.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.869+0000 7f62437fe700 1 -- 172.21.15.72:0/2947111980 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f62440bead0 msgr2=0x7f624414c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:00.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.869+0000 7f62437fe700 1 --2- 172.21.15.72:0/2947111980 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f62440bead0 0x7f624414c200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:00.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.869+0000 7f62437fe700 1 -- 172.21.15.72:0/2947111980 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f62440c0890 msgr2=0x7f62441475c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:00.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.869+0000 7f62437fe700 1 --2- 172.21.15.72:0/2947111980 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f62440c0890 0x7f62441475c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:00.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.869+0000 7f62437fe700 1 -- 172.21.15.72:0/2947111980 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f623c009b30 con 0x7f6244151a90 2023-07-25T14:36:00.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.869+0000 7f62437fe700 1 --2- 172.21.15.72:0/2947111980 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6244151a90 0x7f62441eaf80 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f623c00b680 tx=0x7f623c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:00.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.869+0000 7f622b7fe700 1 -- 172.21.15.72:0/2947111980 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f623c0099b0 con 0x7f6244151a90 2023-07-25T14:36:00.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.869+0000 7f622b7fe700 1 -- 172.21.15.72:0/2947111980 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f623c0092e0 con 0x7f6244151a90 2023-07-25T14:36:00.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.869+0000 7f62495b0700 1 -- 172.21.15.72:0/2947111980 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6244147b00 con 0x7f6244151a90 2023-07-25T14:36:00.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.870+0000 7f622b7fe700 1 -- 172.21.15.72:0/2947111980 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f623c01c640 con 0x7f6244151a90 2023-07-25T14:36:00.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.870+0000 7f62495b0700 1 -- 172.21.15.72:0/2947111980 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f624414ba00 con 0x7f6244151a90 2023-07-25T14:36:00.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.870+0000 7f62495b0700 1 -- 172.21.15.72:0/2947111980 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f624414bbc0 con 0x7f6244151a90 2023-07-25T14:36:00.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.871+0000 7f622b7fe700 1 -- 172.21.15.72:0/2947111980 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f623c01c7a0 con 0x7f6244151a90 2023-07-25T14:36:00.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.871+0000 7f622b7fe700 1 --2- 172.21.15.72:0/2947111980 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f623006ace0 0x7f623006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:00.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.871+0000 7f622b7fe700 1 -- 172.21.15.72:0/2947111980 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f623c08b3e0 con 0x7f6244151a90 2023-07-25T14:36:00.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.871+0000 7f6242ffd700 1 --2- 172.21.15.72:0/2947111980 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f623006ace0 0x7f623006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:00.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.872+0000 7f6242ffd700 1 --2- 172.21.15.72:0/2947111980 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f623006ace0 0x7f623006d1a0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f6234000f60 tx=0x7f6234007c00 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:00.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:00.876+0000 7f622b7fe700 1 -- 172.21.15.72:0/2947111980 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f623c056230 con 0x7f6244151a90 2023-07-25T14:36:01.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.059+0000 7f62495b0700 1 -- 172.21.15.72:0/2947111980 --> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f62440bf860 con 0x7f623006ace0 2023-07-25T14:36:01.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.069+0000 7f622b7fe700 1 -- 172.21.15.72:0/2947111980 <== mgr.4104 v2:172.21.15.72:6832/1171220306 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367630 (secure 0 0 0) 0x7f62340012b0 con 0x7f623006ace0 2023-07-25T14:36:01.085 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-25T14:36:01.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.072+0000 7f62495b0700 1 -- 172.21.15.72:0/2947111980 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f623006ace0 msgr2=0x7f623006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:01.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.072+0000 7f62495b0700 1 --2- 172.21.15.72:0/2947111980 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f623006ace0 0x7f623006d1a0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f6234000f60 tx=0x7f6234007c00 comp rx=0 tx=0).stop 2023-07-25T14:36:01.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.072+0000 7f62495b0700 1 -- 172.21.15.72:0/2947111980 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6244151a90 msgr2=0x7f62441eaf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:01.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.072+0000 7f62495b0700 1 --2- 172.21.15.72:0/2947111980 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6244151a90 0x7f62441eaf80 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f623c00b680 tx=0x7f623c004ad0 comp rx=0 tx=0).stop 2023-07-25T14:36:01.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.072+0000 7f62495b0700 1 -- 172.21.15.72:0/2947111980 shutdown_connections 2023-07-25T14:36:01.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.072+0000 7f62495b0700 1 --2- 172.21.15.72:0/2947111980 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f623006ace0 0x7f623006d1a0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:01.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.072+0000 7f62495b0700 1 --2- 172.21.15.72:0/2947111980 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f62440bead0 0x7f624414c200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:01.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.072+0000 7f62495b0700 1 --2- 172.21.15.72:0/2947111980 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6244151a90 0x7f62441eaf80 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:01.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.072+0000 7f62495b0700 1 --2- 172.21.15.72:0/2947111980 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f62440c0890 0x7f62441475c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:01.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.072+0000 7f62495b0700 1 -- 172.21.15.72:0/2947111980 >> 172.21.15.72:0/2947111980 conn(0x7f624406c3a0 msgr2=0x7f62441524e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:01.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.072+0000 7f62495b0700 1 -- 172.21.15.72:0/2947111980 shutdown_connections 2023-07-25T14:36:01.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.072+0000 7f62495b0700 1 -- 172.21.15.72:0/2947111980 wait complete. 2023-07-25T14:36:01.088 INFO:teuthology.orchestra.run.smithi072.stderr:dumped all 2023-07-25T14:36:01.097 INFO:teuthology.orchestra.run.smithi072.stdout:{"pg_ready":true,"pg_map":{"version":32,"stamp":"2023-07-25T14:35:59.289797+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594819,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":206,"num_write_kb":2433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":158,"ondisk_log_size":158,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218416,"kb_used_data":2260,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754756304,"statfs":{"total":773094113280,"available":772870455296,"internally_reserved":0,"allocated":2314240,"data_stored":2061663,"data_compressed":64510,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2089,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002913"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:47.033294+0000","last_change":"2023-07-25T14:35:40.579709+0000","last_active":"2023-07-25T14:35:47.033294+0000","last_peered":"2023-07-25T14:35:47.033294+0000","last_clean":"2023-07-25T14:35:47.033294+0000","last_became_active":"2023-07-25T14:35:40.579434+0000","last_became_peered":"2023-07-25T14:35:40.579434+0000","last_unstale":"2023-07-25T14:35:47.033294+0000","last_undegraded":"2023-07-25T14:35:47.033294+0000","last_fullsized":"2023-07-25T14:35:47.033294+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T16:53:04.752134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.591767+0000","last_change":"2023-07-25T14:35:40.569410+0000","last_active":"2023-07-25T14:35:45.591767+0000","last_peered":"2023-07-25T14:35:45.591767+0000","last_clean":"2023-07-25T14:35:45.591767+0000","last_became_active":"2023-07-25T14:35:40.569117+0000","last_became_peered":"2023-07-25T14:35:40.569117+0000","last_unstale":"2023-07-25T14:35:45.591767+0000","last_undegraded":"2023-07-25T14:35:45.591767+0000","last_fullsized":"2023-07-25T14:35:45.591767+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T21:31:31.770554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.594527+0000","last_change":"2023-07-25T14:35:40.575183+0000","last_active":"2023-07-25T14:35:45.594527+0000","last_peered":"2023-07-25T14:35:45.594527+0000","last_clean":"2023-07-25T14:35:45.594527+0000","last_became_active":"2023-07-25T14:35:40.574827+0000","last_became_peered":"2023-07-25T14:35:40.574827+0000","last_unstale":"2023-07-25T14:35:45.594527+0000","last_undegraded":"2023-07-25T14:35:45.594527+0000","last_fullsized":"2023-07-25T14:35:45.594527+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T01:51:45.574143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.591232+0000","last_change":"2023-07-25T14:35:40.573336+0000","last_active":"2023-07-25T14:35:45.591232+0000","last_peered":"2023-07-25T14:35:45.591232+0000","last_clean":"2023-07-25T14:35:45.591232+0000","last_became_active":"2023-07-25T14:35:40.573034+0000","last_became_peered":"2023-07-25T14:35:40.573034+0000","last_unstale":"2023-07-25T14:35:45.591232+0000","last_undegraded":"2023-07-25T14:35:45.591232+0000","last_fullsized":"2023-07-25T14:35:45.591232+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T18:55:52.687430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:46.554959+0000","last_change":"2023-07-25T14:35:40.583811+0000","last_active":"2023-07-25T14:35:46.554959+0000","last_peered":"2023-07-25T14:35:46.554959+0000","last_clean":"2023-07-25T14:35:46.554959+0000","last_became_active":"2023-07-25T14:35:40.583515+0000","last_became_peered":"2023-07-25T14:35:40.583515+0000","last_unstale":"2023-07-25T14:35:46.554959+0000","last_undegraded":"2023-07-25T14:35:46.554959+0000","last_fullsized":"2023-07-25T14:35:46.554959+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:09:34.369879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.594150+0000","last_change":"2023-07-25T14:35:40.575186+0000","last_active":"2023-07-25T14:35:45.594150+0000","last_peered":"2023-07-25T14:35:45.594150+0000","last_clean":"2023-07-25T14:35:45.594150+0000","last_became_active":"2023-07-25T14:35:40.574889+0000","last_became_peered":"2023-07-25T14:35:40.574889+0000","last_unstale":"2023-07-25T14:35:45.594150+0000","last_undegraded":"2023-07-25T14:35:45.594150+0000","last_fullsized":"2023-07-25T14:35:45.594150+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:40:27.273006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:46.548788+0000","last_change":"2023-07-25T14:35:40.569889+0000","last_active":"2023-07-25T14:35:46.548788+0000","last_peered":"2023-07-25T14:35:46.548788+0000","last_clean":"2023-07-25T14:35:46.548788+0000","last_became_active":"2023-07-25T14:35:40.569608+0000","last_became_peered":"2023-07-25T14:35:40.569608+0000","last_unstale":"2023-07-25T14:35:46.548788+0000","last_undegraded":"2023-07-25T14:35:46.548788+0000","last_fullsized":"2023-07-25T14:35:46.548788+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T15:50:12.108725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.591268+0000","last_change":"2023-07-25T14:35:40.574254+0000","last_active":"2023-07-25T14:35:45.591268+0000","last_peered":"2023-07-25T14:35:45.591268+0000","last_clean":"2023-07-25T14:35:45.591268+0000","last_became_active":"2023-07-25T14:35:40.573341+0000","last_became_peered":"2023-07-25T14:35:40.573341+0000","last_unstale":"2023-07-25T14:35:45.591268+0000","last_undegraded":"2023-07-25T14:35:45.591268+0000","last_fullsized":"2023-07-25T14:35:45.591268+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T17:24:11.100853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:46.554711+0000","last_change":"2023-07-25T14:35:40.582969+0000","last_active":"2023-07-25T14:35:46.554711+0000","last_peered":"2023-07-25T14:35:46.554711+0000","last_clean":"2023-07-25T14:35:46.554711+0000","last_became_active":"2023-07-25T14:35:40.582686+0000","last_became_peered":"2023-07-25T14:35:40.582686+0000","last_unstale":"2023-07-25T14:35:46.554711+0000","last_undegraded":"2023-07-25T14:35:46.554711+0000","last_fullsized":"2023-07-25T14:35:46.554711+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:55:22.829223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.592271+0000","last_change":"2023-07-25T14:35:40.574207+0000","last_active":"2023-07-25T14:35:45.592271+0000","last_peered":"2023-07-25T14:35:45.592271+0000","last_clean":"2023-07-25T14:35:45.592271+0000","last_became_active":"2023-07-25T14:35:40.573926+0000","last_became_peered":"2023-07-25T14:35:40.573926+0000","last_unstale":"2023-07-25T14:35:45.592271+0000","last_undegraded":"2023-07-25T14:35:45.592271+0000","last_fullsized":"2023-07-25T14:35:45.592271+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T17:56:22.295388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.594484+0000","last_change":"2023-07-25T14:35:40.571893+0000","last_active":"2023-07-25T14:35:45.594484+0000","last_peered":"2023-07-25T14:35:45.594484+0000","last_clean":"2023-07-25T14:35:45.594484+0000","last_became_active":"2023-07-25T14:35:40.571559+0000","last_became_peered":"2023-07-25T14:35:40.571559+0000","last_unstale":"2023-07-25T14:35:45.594484+0000","last_undegraded":"2023-07-25T14:35:45.594484+0000","last_fullsized":"2023-07-25T14:35:45.594484+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T14:46:37.446654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:47.032918+0000","last_change":"2023-07-25T14:35:40.574741+0000","last_active":"2023-07-25T14:35:47.032918+0000","last_peered":"2023-07-25T14:35:47.032918+0000","last_clean":"2023-07-25T14:35:47.032918+0000","last_became_active":"2023-07-25T14:35:40.574462+0000","last_became_peered":"2023-07-25T14:35:40.574462+0000","last_unstale":"2023-07-25T14:35:47.032918+0000","last_undegraded":"2023-07-25T14:35:47.032918+0000","last_fullsized":"2023-07-25T14:35:47.032918+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T01:21:26.238044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:47.032882+0000","last_change":"2023-07-25T14:35:40.571479+0000","last_active":"2023-07-25T14:35:47.032882+0000","last_peered":"2023-07-25T14:35:47.032882+0000","last_clean":"2023-07-25T14:35:47.032882+0000","last_became_active":"2023-07-25T14:35:40.571126+0000","last_became_peered":"2023-07-25T14:35:40.571126+0000","last_unstale":"2023-07-25T14:35:47.032882+0000","last_undegraded":"2023-07-25T14:35:47.032882+0000","last_fullsized":"2023-07-25T14:35:47.032882+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T22:30:57.251961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.591494+0000","last_change":"2023-07-25T14:35:40.569982+0000","last_active":"2023-07-25T14:35:45.591494+0000","last_peered":"2023-07-25T14:35:45.591494+0000","last_clean":"2023-07-25T14:35:45.591494+0000","last_became_active":"2023-07-25T14:35:40.569644+0000","last_became_peered":"2023-07-25T14:35:40.569644+0000","last_unstale":"2023-07-25T14:35:45.591494+0000","last_undegraded":"2023-07-25T14:35:45.591494+0000","last_fullsized":"2023-07-25T14:35:45.591494+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T14:44:33.489813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:46.548596+0000","last_change":"2023-07-25T14:35:40.570367+0000","last_active":"2023-07-25T14:35:46.548596+0000","last_peered":"2023-07-25T14:35:46.548596+0000","last_clean":"2023-07-25T14:35:46.548596+0000","last_became_active":"2023-07-25T14:35:40.570106+0000","last_became_peered":"2023-07-25T14:35:40.570106+0000","last_unstale":"2023-07-25T14:35:46.548596+0000","last_undegraded":"2023-07-25T14:35:46.548596+0000","last_fullsized":"2023-07-25T14:35:46.548596+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T19:42:01.927591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.593622+0000","last_change":"2023-07-25T14:35:40.575177+0000","last_active":"2023-07-25T14:35:45.593622+0000","last_peered":"2023-07-25T14:35:45.593622+0000","last_clean":"2023-07-25T14:35:45.593622+0000","last_became_active":"2023-07-25T14:35:40.574874+0000","last_became_peered":"2023-07-25T14:35:40.574874+0000","last_unstale":"2023-07-25T14:35:45.593622+0000","last_undegraded":"2023-07-25T14:35:45.593622+0000","last_fullsized":"2023-07-25T14:35:45.593622+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T22:45:19.433847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:46.554879+0000","last_change":"2023-07-25T14:35:40.582903+0000","last_active":"2023-07-25T14:35:46.554879+0000","last_peered":"2023-07-25T14:35:46.554879+0000","last_clean":"2023-07-25T14:35:46.554879+0000","last_became_active":"2023-07-25T14:35:40.582627+0000","last_became_peered":"2023-07-25T14:35:40.582627+0000","last_unstale":"2023-07-25T14:35:46.554879+0000","last_undegraded":"2023-07-25T14:35:46.554879+0000","last_fullsized":"2023-07-25T14:35:46.554879+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T17:56:22.295388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.594691+0000","last_change":"2023-07-25T14:35:40.571572+0000","last_active":"2023-07-25T14:35:45.594691+0000","last_peered":"2023-07-25T14:35:45.594691+0000","last_clean":"2023-07-25T14:35:45.594691+0000","last_became_active":"2023-07-25T14:35:40.570802+0000","last_became_peered":"2023-07-25T14:35:40.570802+0000","last_unstale":"2023-07-25T14:35:45.594691+0000","last_undegraded":"2023-07-25T14:35:45.594691+0000","last_fullsized":"2023-07-25T14:35:45.594691+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T20:18:12.135635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:47.033091+0000","last_change":"2023-07-25T14:35:40.576638+0000","last_active":"2023-07-25T14:35:47.033091+0000","last_peered":"2023-07-25T14:35:47.033091+0000","last_clean":"2023-07-25T14:35:47.033091+0000","last_became_active":"2023-07-25T14:35:40.576359+0000","last_became_peered":"2023-07-25T14:35:40.576359+0000","last_unstale":"2023-07-25T14:35:47.033091+0000","last_undegraded":"2023-07-25T14:35:47.033091+0000","last_fullsized":"2023-07-25T14:35:47.033091+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T20:38:34.383462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.593850+0000","last_change":"2023-07-25T14:35:40.581183+0000","last_active":"2023-07-25T14:35:45.593850+0000","last_peered":"2023-07-25T14:35:45.593850+0000","last_clean":"2023-07-25T14:35:45.593850+0000","last_became_active":"2023-07-25T14:35:40.577150+0000","last_became_peered":"2023-07-25T14:35:40.577150+0000","last_unstale":"2023-07-25T14:35:45.593850+0000","last_undegraded":"2023-07-25T14:35:45.593850+0000","last_fullsized":"2023-07-25T14:35:45.593850+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T22:52:07.934045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:46.549236+0000","last_change":"2023-07-25T14:35:40.584074+0000","last_active":"2023-07-25T14:35:46.549236+0000","last_peered":"2023-07-25T14:35:46.549236+0000","last_clean":"2023-07-25T14:35:46.549236+0000","last_became_active":"2023-07-25T14:35:40.583729+0000","last_became_peered":"2023-07-25T14:35:40.583729+0000","last_unstale":"2023-07-25T14:35:46.549236+0000","last_undegraded":"2023-07-25T14:35:46.549236+0000","last_fullsized":"2023-07-25T14:35:46.549236+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:37:32.340440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:46.554400+0000","last_change":"2023-07-25T14:35:40.569049+0000","last_active":"2023-07-25T14:35:46.554400+0000","last_peered":"2023-07-25T14:35:46.554400+0000","last_clean":"2023-07-25T14:35:46.554400+0000","last_became_active":"2023-07-25T14:35:40.568749+0000","last_became_peered":"2023-07-25T14:35:40.568749+0000","last_unstale":"2023-07-25T14:35:46.554400+0000","last_undegraded":"2023-07-25T14:35:46.554400+0000","last_fullsized":"2023-07-25T14:35:46.554400+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:12:05.117844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.812807+0000","last_change":"2023-07-25T14:35:40.579628+0000","last_active":"2023-07-25T14:35:45.812807+0000","last_peered":"2023-07-25T14:35:45.812807+0000","last_clean":"2023-07-25T14:35:45.812807+0000","last_became_active":"2023-07-25T14:35:40.579163+0000","last_became_peered":"2023-07-25T14:35:40.579163+0000","last_unstale":"2023-07-25T14:35:45.812807+0000","last_undegraded":"2023-07-25T14:35:45.812807+0000","last_fullsized":"2023-07-25T14:35:45.812807+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T14:39:11.675726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:46.548669+0000","last_change":"2023-07-25T14:35:40.580196+0000","last_active":"2023-07-25T14:35:46.548669+0000","last_peered":"2023-07-25T14:35:46.548669+0000","last_clean":"2023-07-25T14:35:46.548669+0000","last_became_active":"2023-07-25T14:35:40.579875+0000","last_became_peered":"2023-07-25T14:35:40.579875+0000","last_unstale":"2023-07-25T14:35:46.548669+0000","last_undegraded":"2023-07-25T14:35:46.548669+0000","last_fullsized":"2023-07-25T14:35:46.548669+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T17:56:22.295388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:47.033370+0000","last_change":"2023-07-25T14:35:40.567264+0000","last_active":"2023-07-25T14:35:47.033370+0000","last_peered":"2023-07-25T14:35:47.033370+0000","last_clean":"2023-07-25T14:35:47.033370+0000","last_became_active":"2023-07-25T14:35:40.566933+0000","last_became_peered":"2023-07-25T14:35:40.566933+0000","last_unstale":"2023-07-25T14:35:47.033370+0000","last_undegraded":"2023-07-25T14:35:47.033370+0000","last_fullsized":"2023-07-25T14:35:47.033370+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T21:36:38.996750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:47.033405+0000","last_change":"2023-07-25T14:35:40.562595+0000","last_active":"2023-07-25T14:35:47.033405+0000","last_peered":"2023-07-25T14:35:47.033405+0000","last_clean":"2023-07-25T14:35:47.033405+0000","last_became_active":"2023-07-25T14:35:40.562281+0000","last_became_peered":"2023-07-25T14:35:40.562281+0000","last_unstale":"2023-07-25T14:35:47.033405+0000","last_undegraded":"2023-07-25T14:35:47.033405+0000","last_fullsized":"2023-07-25T14:35:47.033405+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T14:44:33.489813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.592182+0000","last_change":"2023-07-25T14:35:40.570857+0000","last_active":"2023-07-25T14:35:45.592182+0000","last_peered":"2023-07-25T14:35:45.592182+0000","last_clean":"2023-07-25T14:35:45.592182+0000","last_became_active":"2023-07-25T14:35:40.570601+0000","last_became_peered":"2023-07-25T14:35:40.570601+0000","last_unstale":"2023-07-25T14:35:45.592182+0000","last_undegraded":"2023-07-25T14:35:45.592182+0000","last_fullsized":"2023-07-25T14:35:45.592182+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:43:26.302693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.594376+0000","last_change":"2023-07-25T14:35:44.610459+0000","last_active":"2023-07-25T14:35:45.594376+0000","last_peered":"2023-07-25T14:35:45.594376+0000","last_clean":"2023-07-25T14:35:45.594376+0000","last_became_active":"2023-07-25T14:35:44.610112+0000","last_became_peered":"2023-07-25T14:35:44.610112+0000","last_unstale":"2023-07-25T14:35:45.594376+0000","last_undegraded":"2023-07-25T14:35:45.594376+0000","last_fullsized":"2023-07-25T14:35:45.594376+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_clean_scrub_stamp":"2023-07-25T14:35:43.577860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T21:11:47.831552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"20'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.593786+0000","last_change":"2023-07-25T14:35:39.539424+0000","last_active":"2023-07-25T14:35:45.593786+0000","last_peered":"2023-07-25T14:35:45.593786+0000","last_clean":"2023-07-25T14:35:45.593786+0000","last_became_active":"2023-07-25T14:35:39.539198+0000","last_became_peered":"2023-07-25T14:35:39.539198+0000","last_unstale":"2023-07-25T14:35:45.593786+0000","last_undegraded":"2023-07-25T14:35:45.593786+0000","last_fullsized":"2023-07-25T14:35:45.593786+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_clean_scrub_stamp":"2023-07-25T14:35:38.515226+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T20:19:13.284229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.813167+0000","last_change":"2023-07-25T14:35:40.571557+0000","last_active":"2023-07-25T14:35:45.813167+0000","last_peered":"2023-07-25T14:35:45.813167+0000","last_clean":"2023-07-25T14:35:45.813167+0000","last_became_active":"2023-07-25T14:35:40.571278+0000","last_became_peered":"2023-07-25T14:35:40.571278+0000","last_unstale":"2023-07-25T14:35:45.813167+0000","last_undegraded":"2023-07-25T14:35:45.813167+0000","last_fullsized":"2023-07-25T14:35:45.813167+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T17:57:59.593211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.592906+0000","last_change":"2023-07-25T14:35:44.608945+0000","last_active":"2023-07-25T14:35:45.592906+0000","last_peered":"2023-07-25T14:35:45.592906+0000","last_clean":"2023-07-25T14:35:45.592906+0000","last_became_active":"2023-07-25T14:35:44.608355+0000","last_became_peered":"2023-07-25T14:35:44.608355+0000","last_unstale":"2023-07-25T14:35:45.592906+0000","last_undegraded":"2023-07-25T14:35:45.592906+0000","last_fullsized":"2023-07-25T14:35:45.592906+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_clean_scrub_stamp":"2023-07-25T14:35:43.577860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T01:37:47.118522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:47.032243+0000","last_change":"2023-07-25T14:35:39.546003+0000","last_active":"2023-07-25T14:35:47.032243+0000","last_peered":"2023-07-25T14:35:47.032243+0000","last_clean":"2023-07-25T14:35:47.032243+0000","last_became_active":"2023-07-25T14:35:39.545724+0000","last_became_peered":"2023-07-25T14:35:39.545724+0000","last_unstale":"2023-07-25T14:35:47.032243+0000","last_undegraded":"2023-07-25T14:35:47.032243+0000","last_fullsized":"2023-07-25T14:35:47.032243+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_clean_scrub_stamp":"2023-07-25T14:35:38.515226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T17:55:30.391084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:46.554711+0000","last_change":"2023-07-25T14:35:40.570219+0000","last_active":"2023-07-25T14:35:46.554711+0000","last_peered":"2023-07-25T14:35:46.554711+0000","last_clean":"2023-07-25T14:35:46.554711+0000","last_became_active":"2023-07-25T14:35:40.569892+0000","last_became_peered":"2023-07-25T14:35:40.569892+0000","last_unstale":"2023-07-25T14:35:46.554711+0000","last_undegraded":"2023-07-25T14:35:46.554711+0000","last_fullsized":"2023-07-25T14:35:46.554711+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T17:42:33.268060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:46.554870+0000","last_change":"2023-07-25T14:35:44.617481+0000","last_active":"2023-07-25T14:35:46.554870+0000","last_peered":"2023-07-25T14:35:46.554870+0000","last_clean":"2023-07-25T14:35:46.554870+0000","last_became_active":"2023-07-25T14:35:44.616199+0000","last_became_peered":"2023-07-25T14:35:44.616199+0000","last_unstale":"2023-07-25T14:35:46.554870+0000","last_undegraded":"2023-07-25T14:35:46.554870+0000","last_fullsized":"2023-07-25T14:35:46.554870+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_clean_scrub_stamp":"2023-07-25T14:35:43.577860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T15:17:51.741356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.812854+0000","last_change":"2023-07-25T14:35:39.535284+0000","last_active":"2023-07-25T14:35:45.812854+0000","last_peered":"2023-07-25T14:35:45.812854+0000","last_clean":"2023-07-25T14:35:45.812854+0000","last_became_active":"2023-07-25T14:35:39.535009+0000","last_became_peered":"2023-07-25T14:35:39.535009+0000","last_unstale":"2023-07-25T14:35:45.812854+0000","last_undegraded":"2023-07-25T14:35:45.812854+0000","last_fullsized":"2023-07-25T14:35:45.812854+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_clean_scrub_stamp":"2023-07-25T14:35:38.515226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T01:30:24.432069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.593125+0000","last_change":"2023-07-25T14:35:40.576038+0000","last_active":"2023-07-25T14:35:45.593125+0000","last_peered":"2023-07-25T14:35:45.593125+0000","last_clean":"2023-07-25T14:35:45.593125+0000","last_became_active":"2023-07-25T14:35:40.575678+0000","last_became_peered":"2023-07-25T14:35:40.575678+0000","last_unstale":"2023-07-25T14:35:45.593125+0000","last_undegraded":"2023-07-25T14:35:45.593125+0000","last_fullsized":"2023-07-25T14:35:45.593125+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T23:32:51.759335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.592398+0000","last_change":"2023-07-25T14:35:44.613589+0000","last_active":"2023-07-25T14:35:45.592398+0000","last_peered":"2023-07-25T14:35:45.592398+0000","last_clean":"2023-07-25T14:35:45.592398+0000","last_became_active":"2023-07-25T14:35:44.613150+0000","last_became_peered":"2023-07-25T14:35:44.613150+0000","last_unstale":"2023-07-25T14:35:45.592398+0000","last_undegraded":"2023-07-25T14:35:45.592398+0000","last_fullsized":"2023-07-25T14:35:45.592398+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_clean_scrub_stamp":"2023-07-25T14:35:43.577860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T20:48:55.652351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:46.554838+0000","last_change":"2023-07-25T14:35:39.534927+0000","last_active":"2023-07-25T14:35:46.554838+0000","last_peered":"2023-07-25T14:35:46.554838+0000","last_clean":"2023-07-25T14:35:46.554838+0000","last_became_active":"2023-07-25T14:35:39.534642+0000","last_became_peered":"2023-07-25T14:35:39.534642+0000","last_unstale":"2023-07-25T14:35:46.554838+0000","last_undegraded":"2023-07-25T14:35:46.554838+0000","last_fullsized":"2023-07-25T14:35:46.554838+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_clean_scrub_stamp":"2023-07-25T14:35:38.515226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:43:25.300568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.812812+0000","last_change":"2023-07-25T14:35:40.570225+0000","last_active":"2023-07-25T14:35:45.812812+0000","last_peered":"2023-07-25T14:35:45.812812+0000","last_clean":"2023-07-25T14:35:45.812812+0000","last_became_active":"2023-07-25T14:35:40.569840+0000","last_became_peered":"2023-07-25T14:35:40.569840+0000","last_unstale":"2023-07-25T14:35:45.812812+0000","last_undegraded":"2023-07-25T14:35:45.812812+0000","last_fullsized":"2023-07-25T14:35:45.812812+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T21:39:00.919174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:46.548495+0000","last_change":"2023-07-25T14:35:44.607298+0000","last_active":"2023-07-25T14:35:46.548495+0000","last_peered":"2023-07-25T14:35:46.548495+0000","last_clean":"2023-07-25T14:35:46.548495+0000","last_became_active":"2023-07-25T14:35:44.606891+0000","last_became_peered":"2023-07-25T14:35:44.606891+0000","last_unstale":"2023-07-25T14:35:46.548495+0000","last_undegraded":"2023-07-25T14:35:46.548495+0000","last_fullsized":"2023-07-25T14:35:46.548495+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_clean_scrub_stamp":"2023-07-25T14:35:43.577860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:55:26.889732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.592326+0000","last_change":"2023-07-25T14:35:39.537294+0000","last_active":"2023-07-25T14:35:45.592326+0000","last_peered":"2023-07-25T14:35:45.592326+0000","last_clean":"2023-07-25T14:35:45.592326+0000","last_became_active":"2023-07-25T14:35:39.536993+0000","last_became_peered":"2023-07-25T14:35:39.536993+0000","last_unstale":"2023-07-25T14:35:45.592326+0000","last_undegraded":"2023-07-25T14:35:45.592326+0000","last_fullsized":"2023-07-25T14:35:45.592326+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_clean_scrub_stamp":"2023-07-25T14:35:38.515226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T15:17:46.678722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.812671+0000","last_change":"2023-07-25T14:35:40.578807+0000","last_active":"2023-07-25T14:35:45.812671+0000","last_peered":"2023-07-25T14:35:45.812671+0000","last_clean":"2023-07-25T14:35:45.812671+0000","last_became_active":"2023-07-25T14:35:40.577361+0000","last_became_peered":"2023-07-25T14:35:40.577361+0000","last_unstale":"2023-07-25T14:35:45.812671+0000","last_undegraded":"2023-07-25T14:35:45.812671+0000","last_fullsized":"2023-07-25T14:35:45.812671+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:37:32.340440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.813426+0000","last_change":"2023-07-25T14:35:44.610450+0000","last_active":"2023-07-25T14:35:45.813426+0000","last_peered":"2023-07-25T14:35:45.813426+0000","last_clean":"2023-07-25T14:35:45.813426+0000","last_became_active":"2023-07-25T14:35:44.610074+0000","last_became_peered":"2023-07-25T14:35:44.610074+0000","last_unstale":"2023-07-25T14:35:45.813426+0000","last_undegraded":"2023-07-25T14:35:45.813426+0000","last_fullsized":"2023-07-25T14:35:45.813426+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_clean_scrub_stamp":"2023-07-25T14:35:43.577860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T16:23:18.284233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"20'3","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:46.549394+0000","last_change":"2023-07-25T14:35:39.543982+0000","last_active":"2023-07-25T14:35:46.549394+0000","last_peered":"2023-07-25T14:35:46.549394+0000","last_clean":"2023-07-25T14:35:46.549394+0000","last_became_active":"2023-07-25T14:35:39.543760+0000","last_became_peered":"2023-07-25T14:35:39.543760+0000","last_unstale":"2023-07-25T14:35:46.549394+0000","last_undegraded":"2023-07-25T14:35:46.549394+0000","last_fullsized":"2023-07-25T14:35:46.549394+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_clean_scrub_stamp":"2023-07-25T14:35:38.515226+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:42:37.075884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:47.032949+0000","last_change":"2023-07-25T14:35:40.577934+0000","last_active":"2023-07-25T14:35:47.032949+0000","last_peered":"2023-07-25T14:35:47.032949+0000","last_clean":"2023-07-25T14:35:47.032949+0000","last_became_active":"2023-07-25T14:35:40.577675+0000","last_became_peered":"2023-07-25T14:35:40.577675+0000","last_unstale":"2023-07-25T14:35:47.032949+0000","last_undegraded":"2023-07-25T14:35:47.032949+0000","last_fullsized":"2023-07-25T14:35:47.032949+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T23:32:02.358536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:47.033082+0000","last_change":"2023-07-25T14:35:44.611931+0000","last_active":"2023-07-25T14:35:47.033082+0000","last_peered":"2023-07-25T14:35:47.033082+0000","last_clean":"2023-07-25T14:35:47.033082+0000","last_became_active":"2023-07-25T14:35:44.611566+0000","last_became_peered":"2023-07-25T14:35:44.611566+0000","last_unstale":"2023-07-25T14:35:47.033082+0000","last_undegraded":"2023-07-25T14:35:47.033082+0000","last_fullsized":"2023-07-25T14:35:47.033082+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_clean_scrub_stamp":"2023-07-25T14:35:43.577860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T21:16:02.383581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"25'8","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:49.925778+0000","last_change":"2023-07-25T14:35:39.537231+0000","last_active":"2023-07-25T14:35:49.925778+0000","last_peered":"2023-07-25T14:35:49.925778+0000","last_clean":"2023-07-25T14:35:49.925778+0000","last_became_active":"2023-07-25T14:35:39.536936+0000","last_became_peered":"2023-07-25T14:35:39.536936+0000","last_unstale":"2023-07-25T14:35:49.925778+0000","last_undegraded":"2023-07-25T14:35:49.925778+0000","last_fullsized":"2023-07-25T14:35:49.925778+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_clean_scrub_stamp":"2023-07-25T14:35:38.515226+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T14:38:33.447792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3653,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.594207+0000","last_change":"2023-07-25T14:35:40.581925+0000","last_active":"2023-07-25T14:35:45.594207+0000","last_peered":"2023-07-25T14:35:45.594207+0000","last_clean":"2023-07-25T14:35:45.594207+0000","last_became_active":"2023-07-25T14:35:40.581612+0000","last_became_peered":"2023-07-25T14:35:40.581612+0000","last_unstale":"2023-07-25T14:35:45.594207+0000","last_undegraded":"2023-07-25T14:35:45.594207+0000","last_fullsized":"2023-07-25T14:35:45.594207+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T21:19:54.060418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.592462+0000","last_change":"2023-07-25T14:35:44.610512+0000","last_active":"2023-07-25T14:35:45.592462+0000","last_peered":"2023-07-25T14:35:45.592462+0000","last_clean":"2023-07-25T14:35:45.592462+0000","last_became_active":"2023-07-25T14:35:44.610029+0000","last_became_peered":"2023-07-25T14:35:44.610029+0000","last_unstale":"2023-07-25T14:35:45.592462+0000","last_undegraded":"2023-07-25T14:35:45.592462+0000","last_fullsized":"2023-07-25T14:35:45.592462+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_clean_scrub_stamp":"2023-07-25T14:35:43.577860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T15:50:16.169233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:46.549117+0000","last_change":"2023-07-25T14:35:39.541876+0000","last_active":"2023-07-25T14:35:46.549117+0000","last_peered":"2023-07-25T14:35:46.549117+0000","last_clean":"2023-07-25T14:35:46.549117+0000","last_became_active":"2023-07-25T14:35:39.541630+0000","last_became_peered":"2023-07-25T14:35:39.541630+0000","last_unstale":"2023-07-25T14:35:46.549117+0000","last_undegraded":"2023-07-25T14:35:46.549117+0000","last_fullsized":"2023-07-25T14:35:46.549117+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_clean_scrub_stamp":"2023-07-25T14:35:38.515226+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T21:17:39.462457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.813224+0000","last_change":"2023-07-25T14:35:40.571048+0000","last_active":"2023-07-25T14:35:45.813224+0000","last_peered":"2023-07-25T14:35:45.813224+0000","last_clean":"2023-07-25T14:35:45.813224+0000","last_became_active":"2023-07-25T14:35:40.570758+0000","last_became_peered":"2023-07-25T14:35:40.570758+0000","last_unstale":"2023-07-25T14:35:45.813224+0000","last_undegraded":"2023-07-25T14:35:45.813224+0000","last_fullsized":"2023-07-25T14:35:45.813224+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T01:55:22.618189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.813383+0000","last_change":"2023-07-25T14:35:44.611202+0000","last_active":"2023-07-25T14:35:45.813383+0000","last_peered":"2023-07-25T14:35:45.813383+0000","last_clean":"2023-07-25T14:35:45.813383+0000","last_became_active":"2023-07-25T14:35:44.610870+0000","last_became_peered":"2023-07-25T14:35:44.610870+0000","last_unstale":"2023-07-25T14:35:45.813383+0000","last_undegraded":"2023-07-25T14:35:45.813383+0000","last_fullsized":"2023-07-25T14:35:45.813383+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_clean_scrub_stamp":"2023-07-25T14:35:43.577860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T21:04:57.404448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:46.554898+0000","last_change":"2023-07-25T14:35:39.536644+0000","last_active":"2023-07-25T14:35:46.554898+0000","last_peered":"2023-07-25T14:35:46.554898+0000","last_clean":"2023-07-25T14:35:46.554898+0000","last_became_active":"2023-07-25T14:35:39.536369+0000","last_became_peered":"2023-07-25T14:35:39.536369+0000","last_unstale":"2023-07-25T14:35:46.554898+0000","last_undegraded":"2023-07-25T14:35:46.554898+0000","last_fullsized":"2023-07-25T14:35:46.554898+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_clean_scrub_stamp":"2023-07-25T14:35:38.515226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T15:50:11.106599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.591980+0000","last_change":"2023-07-25T14:35:40.562867+0000","last_active":"2023-07-25T14:35:45.591980+0000","last_peered":"2023-07-25T14:35:45.591980+0000","last_clean":"2023-07-25T14:35:45.591980+0000","last_became_active":"2023-07-25T14:35:40.562586+0000","last_became_peered":"2023-07-25T14:35:40.562586+0000","last_unstale":"2023-07-25T14:35:45.591980+0000","last_undegraded":"2023-07-25T14:35:45.591980+0000","last_fullsized":"2023-07-25T14:35:45.591980+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T20:23:13.132615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.813522+0000","last_change":"2023-07-25T14:35:44.614158+0000","last_active":"2023-07-25T14:35:45.813522+0000","last_peered":"2023-07-25T14:35:45.813522+0000","last_clean":"2023-07-25T14:35:45.813522+0000","last_became_active":"2023-07-25T14:35:44.613814+0000","last_became_peered":"2023-07-25T14:35:44.613814+0000","last_unstale":"2023-07-25T14:35:45.813522+0000","last_undegraded":"2023-07-25T14:35:45.813522+0000","last_fullsized":"2023-07-25T14:35:45.813522+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_clean_scrub_stamp":"2023-07-25T14:35:43.577860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:03:49.133248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:46.548772+0000","last_change":"2023-07-25T14:35:39.538871+0000","last_active":"2023-07-25T14:35:46.548772+0000","last_peered":"2023-07-25T14:35:46.548772+0000","last_clean":"2023-07-25T14:35:46.548772+0000","last_became_active":"2023-07-25T14:35:39.538503+0000","last_became_peered":"2023-07-25T14:35:39.538503+0000","last_unstale":"2023-07-25T14:35:46.548772+0000","last_undegraded":"2023-07-25T14:35:46.548772+0000","last_fullsized":"2023-07-25T14:35:46.548772+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_clean_scrub_stamp":"2023-07-25T14:35:38.515226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T14:52:14.647241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:46.554998+0000","last_change":"2023-07-25T14:35:40.579376+0000","last_active":"2023-07-25T14:35:46.554998+0000","last_peered":"2023-07-25T14:35:46.554998+0000","last_clean":"2023-07-25T14:35:46.554998+0000","last_became_active":"2023-07-25T14:35:40.579086+0000","last_became_peered":"2023-07-25T14:35:40.579086+0000","last_unstale":"2023-07-25T14:35:46.554998+0000","last_undegraded":"2023-07-25T14:35:46.554998+0000","last_fullsized":"2023-07-25T14:35:46.554998+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T14:52:15.649366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.591678+0000","last_change":"2023-07-25T14:35:44.610005+0000","last_active":"2023-07-25T14:35:45.591678+0000","last_peered":"2023-07-25T14:35:45.591678+0000","last_clean":"2023-07-25T14:35:45.591678+0000","last_became_active":"2023-07-25T14:35:44.609602+0000","last_became_peered":"2023-07-25T14:35:44.609602+0000","last_unstale":"2023-07-25T14:35:45.591678+0000","last_undegraded":"2023-07-25T14:35:45.591678+0000","last_fullsized":"2023-07-25T14:35:45.591678+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_clean_scrub_stamp":"2023-07-25T14:35:43.577860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:12:09.178353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"20'8","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.591599+0000","last_change":"2023-07-25T14:35:39.537282+0000","last_active":"2023-07-25T14:35:45.591599+0000","last_peered":"2023-07-25T14:35:45.591599+0000","last_clean":"2023-07-25T14:35:45.591599+0000","last_became_active":"2023-07-25T14:35:39.537001+0000","last_became_peered":"2023-07-25T14:35:39.537001+0000","last_unstale":"2023-07-25T14:35:45.591599+0000","last_undegraded":"2023-07-25T14:35:45.591599+0000","last_fullsized":"2023-07-25T14:35:45.591599+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_clean_scrub_stamp":"2023-07-25T14:35:38.515226+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T22:11:24.268503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.813644+0000","last_change":"2023-07-25T14:35:40.582310+0000","last_active":"2023-07-25T14:35:45.813644+0000","last_peered":"2023-07-25T14:35:45.813644+0000","last_clean":"2023-07-25T14:35:45.813644+0000","last_became_active":"2023-07-25T14:35:40.581913+0000","last_became_peered":"2023-07-25T14:35:40.581913+0000","last_unstale":"2023-07-25T14:35:45.813644+0000","last_undegraded":"2023-07-25T14:35:45.813644+0000","last_fullsized":"2023-07-25T14:35:45.813644+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T21:29:36.633963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:46.549014+0000","last_change":"2023-07-25T14:35:44.609817+0000","last_active":"2023-07-25T14:35:46.549014+0000","last_peered":"2023-07-25T14:35:46.549014+0000","last_clean":"2023-07-25T14:35:46.549014+0000","last_became_active":"2023-07-25T14:35:44.608964+0000","last_became_peered":"2023-07-25T14:35:44.608964+0000","last_unstale":"2023-07-25T14:35:46.549014+0000","last_undegraded":"2023-07-25T14:35:46.549014+0000","last_fullsized":"2023-07-25T14:35:46.549014+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_clean_scrub_stamp":"2023-07-25T14:35:43.577860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T17:08:37.225551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"20'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:46.549184+0000","last_change":"2023-07-25T14:35:39.540328+0000","last_active":"2023-07-25T14:35:46.549184+0000","last_peered":"2023-07-25T14:35:46.549184+0000","last_clean":"2023-07-25T14:35:46.549184+0000","last_became_active":"2023-07-25T14:35:39.540044+0000","last_became_peered":"2023-07-25T14:35:39.540044+0000","last_unstale":"2023-07-25T14:35:46.549184+0000","last_undegraded":"2023-07-25T14:35:46.549184+0000","last_fullsized":"2023-07-25T14:35:46.549184+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_clean_scrub_stamp":"2023-07-25T14:35:38.515226+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:24:56.192863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.591126+0000","last_change":"2023-07-25T14:35:40.566443+0000","last_active":"2023-07-25T14:35:45.591126+0000","last_peered":"2023-07-25T14:35:45.591126+0000","last_clean":"2023-07-25T14:35:45.591126+0000","last_became_active":"2023-07-25T14:35:40.566162+0000","last_became_peered":"2023-07-25T14:35:40.566162+0000","last_unstale":"2023-07-25T14:35:45.591126+0000","last_undegraded":"2023-07-25T14:35:45.591126+0000","last_fullsized":"2023-07-25T14:35:45.591126+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:14:11.945159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:47.032573+0000","last_change":"2023-07-25T14:35:44.615276+0000","last_active":"2023-07-25T14:35:47.032573+0000","last_peered":"2023-07-25T14:35:47.032573+0000","last_clean":"2023-07-25T14:35:47.032573+0000","last_became_active":"2023-07-25T14:35:44.614935+0000","last_became_peered":"2023-07-25T14:35:44.614935+0000","last_unstale":"2023-07-25T14:35:47.032573+0000","last_undegraded":"2023-07-25T14:35:47.032573+0000","last_fullsized":"2023-07-25T14:35:47.032573+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_clean_scrub_stamp":"2023-07-25T14:35:43.577860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T19:32:58.526454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:46.549428+0000","last_change":"2023-07-25T14:35:39.538857+0000","last_active":"2023-07-25T14:35:46.549428+0000","last_peered":"2023-07-25T14:35:46.549428+0000","last_clean":"2023-07-25T14:35:46.549428+0000","last_became_active":"2023-07-25T14:35:39.538533+0000","last_became_peered":"2023-07-25T14:35:39.538533+0000","last_unstale":"2023-07-25T14:35:46.549428+0000","last_undegraded":"2023-07-25T14:35:46.549428+0000","last_fullsized":"2023-07-25T14:35:46.549428+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_clean_scrub_stamp":"2023-07-25T14:35:38.515226+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T23:06:55.013283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.593610+0000","last_change":"2023-07-25T14:35:40.571933+0000","last_active":"2023-07-25T14:35:45.593610+0000","last_peered":"2023-07-25T14:35:45.593610+0000","last_clean":"2023-07-25T14:35:45.593610+0000","last_became_active":"2023-07-25T14:35:40.570814+0000","last_became_peered":"2023-07-25T14:35:40.570814+0000","last_unstale":"2023-07-25T14:35:45.593610+0000","last_undegraded":"2023-07-25T14:35:45.593610+0000","last_fullsized":"2023-07-25T14:35:45.593610+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T22:11:31.858060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:47.032762+0000","last_change":"2023-07-25T14:35:44.606624+0000","last_active":"2023-07-25T14:35:47.032762+0000","last_peered":"2023-07-25T14:35:47.032762+0000","last_clean":"2023-07-25T14:35:47.032762+0000","last_became_active":"2023-07-25T14:35:44.606139+0000","last_became_peered":"2023-07-25T14:35:44.606139+0000","last_unstale":"2023-07-25T14:35:47.032762+0000","last_undegraded":"2023-07-25T14:35:47.032762+0000","last_fullsized":"2023-07-25T14:35:47.032762+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_clean_scrub_stamp":"2023-07-25T14:35:43.577860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T01:22:16.213854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"20'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:46.549292+0000","last_change":"2023-07-25T14:35:39.536361+0000","last_active":"2023-07-25T14:35:46.549292+0000","last_peered":"2023-07-25T14:35:46.549292+0000","last_clean":"2023-07-25T14:35:46.549292+0000","last_became_active":"2023-07-25T14:35:39.536071+0000","last_became_peered":"2023-07-25T14:35:39.536071+0000","last_unstale":"2023-07-25T14:35:46.549292+0000","last_undegraded":"2023-07-25T14:35:46.549292+0000","last_fullsized":"2023-07-25T14:35:46.549292+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_clean_scrub_stamp":"2023-07-25T14:35:38.515226+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T18:51:17.455450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.590781+0000","last_change":"2023-07-25T14:35:40.569105+0000","last_active":"2023-07-25T14:35:45.590781+0000","last_peered":"2023-07-25T14:35:45.590781+0000","last_clean":"2023-07-25T14:35:45.590781+0000","last_became_active":"2023-07-25T14:35:40.568843+0000","last_became_peered":"2023-07-25T14:35:40.568843+0000","last_unstale":"2023-07-25T14:35:45.590781+0000","last_undegraded":"2023-07-25T14:35:45.590781+0000","last_fullsized":"2023-07-25T14:35:45.590781+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T23:38:20.059103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:47.032831+0000","last_change":"2023-07-25T14:35:44.611780+0000","last_active":"2023-07-25T14:35:47.032831+0000","last_peered":"2023-07-25T14:35:47.032831+0000","last_clean":"2023-07-25T14:35:47.032831+0000","last_became_active":"2023-07-25T14:35:44.606160+0000","last_became_peered":"2023-07-25T14:35:44.606160+0000","last_unstale":"2023-07-25T14:35:47.032831+0000","last_undegraded":"2023-07-25T14:35:47.032831+0000","last_fullsized":"2023-07-25T14:35:47.032831+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_clean_scrub_stamp":"2023-07-25T14:35:43.577860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T15:47:56.186166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.592846+0000","last_change":"2023-07-25T14:35:39.543540+0000","last_active":"2023-07-25T14:35:45.592846+0000","last_peered":"2023-07-25T14:35:45.592846+0000","last_clean":"2023-07-25T14:35:45.592846+0000","last_became_active":"2023-07-25T14:35:39.543276+0000","last_became_peered":"2023-07-25T14:35:39.543276+0000","last_unstale":"2023-07-25T14:35:45.592846+0000","last_undegraded":"2023-07-25T14:35:45.592846+0000","last_fullsized":"2023-07-25T14:35:45.592846+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_clean_scrub_stamp":"2023-07-25T14:35:38.515226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T14:52:14.647241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:46.555100+0000","last_change":"2023-07-25T14:35:40.571035+0000","last_active":"2023-07-25T14:35:46.555100+0000","last_peered":"2023-07-25T14:35:46.555100+0000","last_clean":"2023-07-25T14:35:46.555100+0000","last_became_active":"2023-07-25T14:35:40.570770+0000","last_became_peered":"2023-07-25T14:35:40.570770+0000","last_unstale":"2023-07-25T14:35:46.555100+0000","last_undegraded":"2023-07-25T14:35:46.555100+0000","last_fullsized":"2023-07-25T14:35:46.555100+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T19:57:14.056118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:47.032847+0000","last_change":"2023-07-25T14:35:44.608600+0000","last_active":"2023-07-25T14:35:47.032847+0000","last_peered":"2023-07-25T14:35:47.032847+0000","last_clean":"2023-07-25T14:35:47.032847+0000","last_became_active":"2023-07-25T14:35:44.606326+0000","last_became_peered":"2023-07-25T14:35:44.606326+0000","last_unstale":"2023-07-25T14:35:47.032847+0000","last_undegraded":"2023-07-25T14:35:47.032847+0000","last_fullsized":"2023-07-25T14:35:47.032847+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_clean_scrub_stamp":"2023-07-25T14:35:43.577860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T16:02:38.366335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.813032+0000","last_change":"2023-07-25T14:35:39.540008+0000","last_active":"2023-07-25T14:35:45.813032+0000","last_peered":"2023-07-25T14:35:45.813032+0000","last_clean":"2023-07-25T14:35:45.813032+0000","last_became_active":"2023-07-25T14:35:39.539753+0000","last_became_peered":"2023-07-25T14:35:39.539753+0000","last_unstale":"2023-07-25T14:35:45.813032+0000","last_undegraded":"2023-07-25T14:35:45.813032+0000","last_fullsized":"2023-07-25T14:35:45.813032+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_clean_scrub_stamp":"2023-07-25T14:35:38.515226+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T16:18:56.015550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.593664+0000","last_change":"2023-07-25T14:35:40.573373+0000","last_active":"2023-07-25T14:35:45.593664+0000","last_peered":"2023-07-25T14:35:45.593664+0000","last_clean":"2023-07-25T14:35:45.593664+0000","last_became_active":"2023-07-25T14:35:40.569647+0000","last_became_peered":"2023-07-25T14:35:40.569647+0000","last_unstale":"2023-07-25T14:35:45.593664+0000","last_undegraded":"2023-07-25T14:35:45.593664+0000","last_fullsized":"2023-07-25T14:35:45.593664+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T23:26:04.449433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:47.033427+0000","last_change":"2023-07-25T14:35:44.610221+0000","last_active":"2023-07-25T14:35:47.033427+0000","last_peered":"2023-07-25T14:35:47.033427+0000","last_clean":"2023-07-25T14:35:47.033427+0000","last_became_active":"2023-07-25T14:35:44.609802+0000","last_became_peered":"2023-07-25T14:35:44.609802+0000","last_unstale":"2023-07-25T14:35:47.033427+0000","last_undegraded":"2023-07-25T14:35:47.033427+0000","last_fullsized":"2023-07-25T14:35:47.033427+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_clean_scrub_stamp":"2023-07-25T14:35:43.577860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:12:09.178353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.590976+0000","last_change":"2023-07-25T14:35:39.542216+0000","last_active":"2023-07-25T14:35:45.590976+0000","last_peered":"2023-07-25T14:35:45.590976+0000","last_clean":"2023-07-25T14:35:45.590976+0000","last_became_active":"2023-07-25T14:35:39.541786+0000","last_became_peered":"2023-07-25T14:35:39.541786+0000","last_unstale":"2023-07-25T14:35:45.590976+0000","last_undegraded":"2023-07-25T14:35:45.590976+0000","last_fullsized":"2023-07-25T14:35:45.590976+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_clean_scrub_stamp":"2023-07-25T14:35:38.515226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T21:48:28.076390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.594037+0000","last_change":"2023-07-25T14:35:40.572398+0000","last_active":"2023-07-25T14:35:45.594037+0000","last_peered":"2023-07-25T14:35:45.594037+0000","last_clean":"2023-07-25T14:35:45.594037+0000","last_became_active":"2023-07-25T14:35:40.572184+0000","last_became_peered":"2023-07-25T14:35:40.572184+0000","last_unstale":"2023-07-25T14:35:45.594037+0000","last_undegraded":"2023-07-25T14:35:45.594037+0000","last_fullsized":"2023-07-25T14:35:45.594037+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T20:41:25.611682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.592232+0000","last_change":"2023-07-25T14:35:44.608573+0000","last_active":"2023-07-25T14:35:45.592232+0000","last_peered":"2023-07-25T14:35:45.592232+0000","last_clean":"2023-07-25T14:35:45.592232+0000","last_became_active":"2023-07-25T14:35:44.608195+0000","last_became_peered":"2023-07-25T14:35:44.608195+0000","last_unstale":"2023-07-25T14:35:45.592232+0000","last_undegraded":"2023-07-25T14:35:45.592232+0000","last_fullsized":"2023-07-25T14:35:45.592232+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_clean_scrub_stamp":"2023-07-25T14:35:43.577860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T19:42:05.988099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.593367+0000","last_change":"2023-07-25T14:35:39.534458+0000","last_active":"2023-07-25T14:35:45.593367+0000","last_peered":"2023-07-25T14:35:45.593367+0000","last_clean":"2023-07-25T14:35:45.593367+0000","last_became_active":"2023-07-25T14:35:39.534185+0000","last_became_peered":"2023-07-25T14:35:39.534185+0000","last_unstale":"2023-07-25T14:35:45.593367+0000","last_undegraded":"2023-07-25T14:35:45.593367+0000","last_fullsized":"2023-07-25T14:35:45.593367+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_clean_scrub_stamp":"2023-07-25T14:35:38.515226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T16:23:13.221599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.594751+0000","last_change":"2023-07-25T14:35:40.577364+0000","last_active":"2023-07-25T14:35:45.594751+0000","last_peered":"2023-07-25T14:35:45.594751+0000","last_clean":"2023-07-25T14:35:45.594751+0000","last_became_active":"2023-07-25T14:35:40.577048+0000","last_became_peered":"2023-07-25T14:35:40.577048+0000","last_unstale":"2023-07-25T14:35:45.594751+0000","last_undegraded":"2023-07-25T14:35:45.594751+0000","last_fullsized":"2023-07-25T14:35:45.594751+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T15:35:25.781647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.594516+0000","last_change":"2023-07-25T14:35:44.605512+0000","last_active":"2023-07-25T14:35:45.594516+0000","last_peered":"2023-07-25T14:35:45.594516+0000","last_clean":"2023-07-25T14:35:45.594516+0000","last_became_active":"2023-07-25T14:35:44.605134+0000","last_became_peered":"2023-07-25T14:35:44.605134+0000","last_unstale":"2023-07-25T14:35:45.594516+0000","last_undegraded":"2023-07-25T14:35:45.594516+0000","last_fullsized":"2023-07-25T14:35:45.594516+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_clean_scrub_stamp":"2023-07-25T14:35:43.577860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T21:23:30.279301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.812760+0000","last_change":"2023-07-25T14:35:39.540299+0000","last_active":"2023-07-25T14:35:45.812760+0000","last_peered":"2023-07-25T14:35:45.812760+0000","last_clean":"2023-07-25T14:35:45.812760+0000","last_became_active":"2023-07-25T14:35:39.540013+0000","last_became_peered":"2023-07-25T14:35:39.540013+0000","last_unstale":"2023-07-25T14:35:45.812760+0000","last_undegraded":"2023-07-25T14:35:45.812760+0000","last_fullsized":"2023-07-25T14:35:45.812760+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_clean_scrub_stamp":"2023-07-25T14:35:38.515226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:42:37.075884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:47.033534+0000","last_change":"2023-07-25T14:35:40.580966+0000","last_active":"2023-07-25T14:35:47.033534+0000","last_peered":"2023-07-25T14:35:47.033534+0000","last_clean":"2023-07-25T14:35:47.033534+0000","last_became_active":"2023-07-25T14:35:40.580713+0000","last_became_peered":"2023-07-25T14:35:40.580713+0000","last_unstale":"2023-07-25T14:35:47.033534+0000","last_undegraded":"2023-07-25T14:35:47.033534+0000","last_fullsized":"2023-07-25T14:35:47.033534+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T17:42:33.268060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.593698+0000","last_change":"2023-07-25T14:35:44.608905+0000","last_active":"2023-07-25T14:35:45.593698+0000","last_peered":"2023-07-25T14:35:45.593698+0000","last_clean":"2023-07-25T14:35:45.593698+0000","last_became_active":"2023-07-25T14:35:44.608522+0000","last_became_peered":"2023-07-25T14:35:44.608522+0000","last_unstale":"2023-07-25T14:35:45.593698+0000","last_undegraded":"2023-07-25T14:35:45.593698+0000","last_fullsized":"2023-07-25T14:35:45.593698+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_clean_scrub_stamp":"2023-07-25T14:35:43.577860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T22:11:48.857968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.813615+0000","last_change":"2023-07-25T14:35:39.543373+0000","last_active":"2023-07-25T14:35:45.813615+0000","last_peered":"2023-07-25T14:35:45.813615+0000","last_clean":"2023-07-25T14:35:45.813615+0000","last_became_active":"2023-07-25T14:35:39.542998+0000","last_became_peered":"2023-07-25T14:35:39.542998+0000","last_unstale":"2023-07-25T14:35:45.813615+0000","last_undegraded":"2023-07-25T14:35:45.813615+0000","last_fullsized":"2023-07-25T14:35:45.813615+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_clean_scrub_stamp":"2023-07-25T14:35:38.515226+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T19:24:35.653665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.594297+0000","last_change":"2023-07-25T14:35:34.371347+0000","last_active":"2023-07-25T14:35:45.594297+0000","last_peered":"2023-07-25T14:35:45.594297+0000","last_clean":"2023-07-25T14:35:45.594297+0000","last_became_active":"2023-07-25T14:35:34.371044+0000","last_became_peered":"2023-07-25T14:35:34.371044+0000","last_unstale":"2023-07-25T14:35:45.594297+0000","last_undegraded":"2023-07-25T14:35:45.594297+0000","last_fullsized":"2023-07-25T14:35:45.594297+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_clean_scrub_stamp":"2023-07-25T14:35:33.358525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T18:48:18.013494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.812672+0000","last_change":"2023-07-25T14:35:40.570033+0000","last_active":"2023-07-25T14:35:45.812672+0000","last_peered":"2023-07-25T14:35:45.812672+0000","last_clean":"2023-07-25T14:35:45.812672+0000","last_became_active":"2023-07-25T14:35:40.569434+0000","last_became_peered":"2023-07-25T14:35:40.569434+0000","last_unstale":"2023-07-25T14:35:45.812672+0000","last_undegraded":"2023-07-25T14:35:45.812672+0000","last_fullsized":"2023-07-25T14:35:45.812672+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T18:51:18.457575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.812670+0000","last_change":"2023-07-25T14:35:44.609023+0000","last_active":"2023-07-25T14:35:45.812670+0000","last_peered":"2023-07-25T14:35:45.812670+0000","last_clean":"2023-07-25T14:35:45.812670+0000","last_became_active":"2023-07-25T14:35:44.608633+0000","last_became_peered":"2023-07-25T14:35:44.608633+0000","last_unstale":"2023-07-25T14:35:45.812670+0000","last_undegraded":"2023-07-25T14:35:45.812670+0000","last_fullsized":"2023-07-25T14:35:45.812670+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_clean_scrub_stamp":"2023-07-25T14:35:43.577860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:25:01.255497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.813164+0000","last_change":"2023-07-25T14:35:34.371737+0000","last_active":"2023-07-25T14:35:45.813164+0000","last_peered":"2023-07-25T14:35:45.813164+0000","last_clean":"2023-07-25T14:35:45.813164+0000","last_became_active":"2023-07-25T14:35:34.371411+0000","last_became_peered":"2023-07-25T14:35:34.371411+0000","last_unstale":"2023-07-25T14:35:45.813164+0000","last_undegraded":"2023-07-25T14:35:45.813164+0000","last_fullsized":"2023-07-25T14:35:45.813164+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_clean_scrub_stamp":"2023-07-25T14:35:33.358525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T23:20:13.045467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"23'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:46.554714+0000","last_change":"2023-07-25T14:35:39.539692+0000","last_active":"2023-07-25T14:35:46.554714+0000","last_peered":"2023-07-25T14:35:46.554714+0000","last_clean":"2023-07-25T14:35:46.554714+0000","last_became_active":"2023-07-25T14:35:39.539376+0000","last_became_peered":"2023-07-25T14:35:39.539376+0000","last_unstale":"2023-07-25T14:35:46.554714+0000","last_undegraded":"2023-07-25T14:35:46.554714+0000","last_fullsized":"2023-07-25T14:35:46.554714+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_clean_scrub_stamp":"2023-07-25T14:35:38.515226+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T17:03:30.120782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.593423+0000","last_change":"2023-07-25T14:35:40.572322+0000","last_active":"2023-07-25T14:35:45.593423+0000","last_peered":"2023-07-25T14:35:45.593423+0000","last_clean":"2023-07-25T14:35:45.593423+0000","last_became_active":"2023-07-25T14:35:40.571140+0000","last_became_peered":"2023-07-25T14:35:40.571140+0000","last_unstale":"2023-07-25T14:35:45.593423+0000","last_undegraded":"2023-07-25T14:35:45.593423+0000","last_fullsized":"2023-07-25T14:35:45.593423+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:03:45.072739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.591989+0000","last_change":"2023-07-25T14:35:44.611488+0000","last_active":"2023-07-25T14:35:45.591989+0000","last_peered":"2023-07-25T14:35:45.591989+0000","last_clean":"2023-07-25T14:35:45.591989+0000","last_became_active":"2023-07-25T14:35:44.610632+0000","last_became_peered":"2023-07-25T14:35:44.610632+0000","last_unstale":"2023-07-25T14:35:45.591989+0000","last_undegraded":"2023-07-25T14:35:45.591989+0000","last_fullsized":"2023-07-25T14:35:45.591989+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_clean_scrub_stamp":"2023-07-25T14:35:43.577860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T17:03:35.183416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:47.032770+0000","last_change":"2023-07-25T14:35:34.370121+0000","last_active":"2023-07-25T14:35:47.032770+0000","last_peered":"2023-07-25T14:35:47.032770+0000","last_clean":"2023-07-25T14:35:47.032770+0000","last_became_active":"2023-07-25T14:35:34.369795+0000","last_became_peered":"2023-07-25T14:35:34.369795+0000","last_unstale":"2023-07-25T14:35:47.032770+0000","last_undegraded":"2023-07-25T14:35:47.032770+0000","last_fullsized":"2023-07-25T14:35:47.032770+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_clean_scrub_stamp":"2023-07-25T14:35:33.358525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T22:23:26.576696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":177,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:46.548822+0000","last_change":"2023-07-25T14:35:34.372381+0000","last_active":"2023-07-25T14:35:46.548822+0000","last_peered":"2023-07-25T14:35:46.548822+0000","last_clean":"2023-07-25T14:35:46.548822+0000","last_became_active":"2023-07-25T14:35:34.371110+0000","last_became_peered":"2023-07-25T14:35:34.371110+0000","last_unstale":"2023-07-25T14:35:46.548822+0000","last_undegraded":"2023-07-25T14:35:46.548822+0000","last_fullsized":"2023-07-25T14:35:46.548822+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_clean_scrub_stamp":"2023-07-25T14:35:33.358525+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:20:22.063773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:46.554511+0000","last_change":"2023-07-25T14:35:39.541815+0000","last_active":"2023-07-25T14:35:46.554511+0000","last_peered":"2023-07-25T14:35:46.554511+0000","last_clean":"2023-07-25T14:35:46.554511+0000","last_became_active":"2023-07-25T14:35:39.541600+0000","last_became_peered":"2023-07-25T14:35:39.541600+0000","last_unstale":"2023-07-25T14:35:46.554511+0000","last_undegraded":"2023-07-25T14:35:46.554511+0000","last_fullsized":"2023-07-25T14:35:46.554511+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_clean_scrub_stamp":"2023-07-25T14:35:38.515226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T21:31:30.768429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:46.554954+0000","last_change":"2023-07-25T14:35:40.572449+0000","last_active":"2023-07-25T14:35:46.554954+0000","last_peered":"2023-07-25T14:35:46.554954+0000","last_clean":"2023-07-25T14:35:46.554954+0000","last_became_active":"2023-07-25T14:35:40.572096+0000","last_became_peered":"2023-07-25T14:35:40.572096+0000","last_unstale":"2023-07-25T14:35:46.554954+0000","last_undegraded":"2023-07-25T14:35:46.554954+0000","last_fullsized":"2023-07-25T14:35:46.554954+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:20:28.222599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:47.033330+0000","last_change":"2023-07-25T14:35:44.612010+0000","last_active":"2023-07-25T14:35:47.033330+0000","last_peered":"2023-07-25T14:35:47.033330+0000","last_clean":"2023-07-25T14:35:47.033330+0000","last_became_active":"2023-07-25T14:35:44.611576+0000","last_became_peered":"2023-07-25T14:35:44.611576+0000","last_unstale":"2023-07-25T14:35:47.033330+0000","last_undegraded":"2023-07-25T14:35:47.033330+0000","last_fullsized":"2023-07-25T14:35:47.033330+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_clean_scrub_stamp":"2023-07-25T14:35:43.577860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T20:58:23.211755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:46.548801+0000","last_change":"2023-07-25T14:35:35.321448+0000","last_active":"2023-07-25T14:35:46.548801+0000","last_peered":"2023-07-25T14:35:46.548801+0000","last_clean":"2023-07-25T14:35:46.548801+0000","last_became_active":"2023-07-25T14:35:35.320830+0000","last_became_peered":"2023-07-25T14:35:35.320830+0000","last_unstale":"2023-07-25T14:35:46.548801+0000","last_undegraded":"2023-07-25T14:35:46.548801+0000","last_fullsized":"2023-07-25T14:35:46.548801+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_clean_scrub_stamp":"2023-07-25T14:35:33.358525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:09:28.211053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:47.032318+0000","last_change":"2023-07-25T14:35:39.536830+0000","last_active":"2023-07-25T14:35:47.032318+0000","last_peered":"2023-07-25T14:35:47.032318+0000","last_clean":"2023-07-25T14:35:47.032318+0000","last_became_active":"2023-07-25T14:35:39.536580+0000","last_became_peered":"2023-07-25T14:35:39.536580+0000","last_unstale":"2023-07-25T14:35:47.032318+0000","last_undegraded":"2023-07-25T14:35:47.032318+0000","last_fullsized":"2023-07-25T14:35:47.032318+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_clean_scrub_stamp":"2023-07-25T14:35:38.515226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T14:53:19.398227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:47.033471+0000","last_change":"2023-07-25T14:35:40.574429+0000","last_active":"2023-07-25T14:35:47.033471+0000","last_peered":"2023-07-25T14:35:47.033471+0000","last_clean":"2023-07-25T14:35:47.033471+0000","last_became_active":"2023-07-25T14:35:40.574108+0000","last_became_peered":"2023-07-25T14:35:40.574108+0000","last_unstale":"2023-07-25T14:35:47.033471+0000","last_undegraded":"2023-07-25T14:35:47.033471+0000","last_fullsized":"2023-07-25T14:35:47.033471+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T21:31:31.770554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:46.549141+0000","last_change":"2023-07-25T14:35:44.613889+0000","last_active":"2023-07-25T14:35:46.549141+0000","last_peered":"2023-07-25T14:35:46.549141+0000","last_clean":"2023-07-25T14:35:46.549141+0000","last_became_active":"2023-07-25T14:35:44.613279+0000","last_became_peered":"2023-07-25T14:35:44.613279+0000","last_unstale":"2023-07-25T14:35:46.549141+0000","last_undegraded":"2023-07-25T14:35:46.549141+0000","last_fullsized":"2023-07-25T14:35:46.549141+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_clean_scrub_stamp":"2023-07-25T14:35:43.577860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T19:57:18.116626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:46.548653+0000","last_change":"2023-07-25T14:35:35.321201+0000","last_active":"2023-07-25T14:35:46.548653+0000","last_peered":"2023-07-25T14:35:46.548653+0000","last_clean":"2023-07-25T14:35:46.548653+0000","last_became_active":"2023-07-25T14:35:35.320728+0000","last_became_peered":"2023-07-25T14:35:35.320728+0000","last_unstale":"2023-07-25T14:35:46.548653+0000","last_undegraded":"2023-07-25T14:35:46.548653+0000","last_fullsized":"2023-07-25T14:35:46.548653+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_clean_scrub_stamp":"2023-07-25T14:35:33.358525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:43:20.143867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.812837+0000","last_change":"2023-07-25T14:35:39.540111+0000","last_active":"2023-07-25T14:35:45.812837+0000","last_peered":"2023-07-25T14:35:45.812837+0000","last_clean":"2023-07-25T14:35:45.812837+0000","last_became_active":"2023-07-25T14:35:39.539829+0000","last_became_peered":"2023-07-25T14:35:39.539829+0000","last_unstale":"2023-07-25T14:35:45.812837+0000","last_undegraded":"2023-07-25T14:35:45.812837+0000","last_fullsized":"2023-07-25T14:35:45.812837+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_clean_scrub_stamp":"2023-07-25T14:35:38.515226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T20:10:32.190837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.591417+0000","last_change":"2023-07-25T14:35:40.572819+0000","last_active":"2023-07-25T14:35:45.591417+0000","last_peered":"2023-07-25T14:35:45.591417+0000","last_clean":"2023-07-25T14:35:45.591417+0000","last_became_active":"2023-07-25T14:35:40.572460+0000","last_became_peered":"2023-07-25T14:35:40.572460+0000","last_unstale":"2023-07-25T14:35:45.591417+0000","last_undegraded":"2023-07-25T14:35:45.591417+0000","last_fullsized":"2023-07-25T14:35:45.591417+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T19:36:38.983536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:46.554722+0000","last_change":"2023-07-25T14:35:44.617264+0000","last_active":"2023-07-25T14:35:46.554722+0000","last_peered":"2023-07-25T14:35:46.554722+0000","last_clean":"2023-07-25T14:35:46.554722+0000","last_became_active":"2023-07-25T14:35:44.616864+0000","last_became_peered":"2023-07-25T14:35:44.616864+0000","last_unstale":"2023-07-25T14:35:46.554722+0000","last_undegraded":"2023-07-25T14:35:46.554722+0000","last_fullsized":"2023-07-25T14:35:46.554722+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_clean_scrub_stamp":"2023-07-25T14:35:43.577860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T20:23:17.193123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.592094+0000","last_change":"2023-07-25T14:35:35.321057+0000","last_active":"2023-07-25T14:35:45.592094+0000","last_peered":"2023-07-25T14:35:45.592094+0000","last_clean":"2023-07-25T14:35:45.592094+0000","last_became_active":"2023-07-25T14:35:35.320751+0000","last_became_peered":"2023-07-25T14:35:35.320751+0000","last_unstale":"2023-07-25T14:35:45.592094+0000","last_undegraded":"2023-07-25T14:35:45.592094+0000","last_fullsized":"2023-07-25T14:35:45.592094+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_clean_scrub_stamp":"2023-07-25T14:35:33.358525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:55:16.670397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.593801+0000","last_change":"2023-07-25T14:35:39.535048+0000","last_active":"2023-07-25T14:35:45.593801+0000","last_peered":"2023-07-25T14:35:45.593801+0000","last_clean":"2023-07-25T14:35:45.593801+0000","last_became_active":"2023-07-25T14:35:39.534749+0000","last_became_peered":"2023-07-25T14:35:39.534749+0000","last_unstale":"2023-07-25T14:35:45.593801+0000","last_undegraded":"2023-07-25T14:35:45.593801+0000","last_fullsized":"2023-07-25T14:35:45.593801+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_clean_scrub_stamp":"2023-07-25T14:35:38.515226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T19:56:32.500581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:47.032972+0000","last_change":"2023-07-25T14:35:40.562358+0000","last_active":"2023-07-25T14:35:47.032972+0000","last_peered":"2023-07-25T14:35:47.032972+0000","last_clean":"2023-07-25T14:35:47.032972+0000","last_became_active":"2023-07-25T14:35:40.562072+0000","last_became_peered":"2023-07-25T14:35:40.562072+0000","last_unstale":"2023-07-25T14:35:47.032972+0000","last_undegraded":"2023-07-25T14:35:47.032972+0000","last_fullsized":"2023-07-25T14:35:47.032972+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T23:39:16.694925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.591232+0000","last_change":"2023-07-25T14:35:44.605076+0000","last_active":"2023-07-25T14:35:45.591232+0000","last_peered":"2023-07-25T14:35:45.591232+0000","last_clean":"2023-07-25T14:35:45.591232+0000","last_became_active":"2023-07-25T14:35:44.604627+0000","last_became_peered":"2023-07-25T14:35:44.604627+0000","last_unstale":"2023-07-25T14:35:45.591232+0000","last_undegraded":"2023-07-25T14:35:45.591232+0000","last_fullsized":"2023-07-25T14:35:45.591232+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_clean_scrub_stamp":"2023-07-25T14:35:43.577860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T17:14:14.382524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.591663+0000","last_change":"2023-07-25T14:35:35.321055+0000","last_active":"2023-07-25T14:35:45.591663+0000","last_peered":"2023-07-25T14:35:45.591663+0000","last_clean":"2023-07-25T14:35:45.591663+0000","last_became_active":"2023-07-25T14:35:35.320739+0000","last_became_peered":"2023-07-25T14:35:35.320739+0000","last_unstale":"2023-07-25T14:35:45.591663+0000","last_undegraded":"2023-07-25T14:35:45.591663+0000","last_fullsized":"2023-07-25T14:35:45.591663+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_clean_scrub_stamp":"2023-07-25T14:35:33.358525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T17:42:19.164577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:47.033169+0000","last_change":"2023-07-25T14:35:39.539756+0000","last_active":"2023-07-25T14:35:47.033169+0000","last_peered":"2023-07-25T14:35:47.033169+0000","last_clean":"2023-07-25T14:35:47.033169+0000","last_became_active":"2023-07-25T14:35:39.539459+0000","last_became_peered":"2023-07-25T14:35:39.539459+0000","last_unstale":"2023-07-25T14:35:47.033169+0000","last_undegraded":"2023-07-25T14:35:47.033169+0000","last_fullsized":"2023-07-25T14:35:47.033169+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_clean_scrub_stamp":"2023-07-25T14:35:38.515226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:14:10.943034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:46.555037+0000","last_change":"2023-07-25T14:35:40.569961+0000","last_active":"2023-07-25T14:35:46.555037+0000","last_peered":"2023-07-25T14:35:46.555037+0000","last_clean":"2023-07-25T14:35:46.555037+0000","last_became_active":"2023-07-25T14:35:40.569660+0000","last_became_peered":"2023-07-25T14:35:40.569660+0000","last_unstale":"2023-07-25T14:35:46.555037+0000","last_undegraded":"2023-07-25T14:35:46.555037+0000","last_fullsized":"2023-07-25T14:35:46.555037+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T21:17:40.464582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:46.554816+0000","last_change":"2023-07-25T14:35:44.616675+0000","last_active":"2023-07-25T14:35:46.554816+0000","last_peered":"2023-07-25T14:35:46.554816+0000","last_clean":"2023-07-25T14:35:46.554816+0000","last_became_active":"2023-07-25T14:35:44.616241+0000","last_became_peered":"2023-07-25T14:35:44.616241+0000","last_unstale":"2023-07-25T14:35:46.554816+0000","last_undegraded":"2023-07-25T14:35:46.554816+0000","last_fullsized":"2023-07-25T14:35:46.554816+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_clean_scrub_stamp":"2023-07-25T14:35:43.577860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T19:42:05.988099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.593040+0000","last_change":"2023-07-25T14:35:34.370772+0000","last_active":"2023-07-25T14:35:45.593040+0000","last_peered":"2023-07-25T14:35:45.593040+0000","last_clean":"2023-07-25T14:35:45.593040+0000","last_became_active":"2023-07-25T14:35:34.370549+0000","last_became_peered":"2023-07-25T14:35:34.370549+0000","last_unstale":"2023-07-25T14:35:45.593040+0000","last_undegraded":"2023-07-25T14:35:45.593040+0000","last_fullsized":"2023-07-25T14:35:45.593040+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_clean_scrub_stamp":"2023-07-25T14:35:33.358525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T19:34:32.153689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.591780+0000","last_change":"2023-07-25T14:35:39.543278+0000","last_active":"2023-07-25T14:35:45.591780+0000","last_peered":"2023-07-25T14:35:45.591780+0000","last_clean":"2023-07-25T14:35:45.591780+0000","last_became_active":"2023-07-25T14:35:39.543017+0000","last_became_peered":"2023-07-25T14:35:39.543017+0000","last_unstale":"2023-07-25T14:35:45.591780+0000","last_undegraded":"2023-07-25T14:35:45.591780+0000","last_fullsized":"2023-07-25T14:35:45.591780+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_clean_scrub_stamp":"2023-07-25T14:35:38.515226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T17:42:32.265934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:47.032289+0000","last_change":"2023-07-25T14:35:40.574583+0000","last_active":"2023-07-25T14:35:47.032289+0000","last_peered":"2023-07-25T14:35:47.032289+0000","last_clean":"2023-07-25T14:35:47.032289+0000","last_became_active":"2023-07-25T14:35:40.574298+0000","last_became_peered":"2023-07-25T14:35:40.574298+0000","last_unstale":"2023-07-25T14:35:47.032289+0000","last_undegraded":"2023-07-25T14:35:47.032289+0000","last_fullsized":"2023-07-25T14:35:47.032289+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T01:29:43.918829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:47.033044+0000","last_change":"2023-07-25T14:35:44.609515+0000","last_active":"2023-07-25T14:35:47.033044+0000","last_peered":"2023-07-25T14:35:47.033044+0000","last_clean":"2023-07-25T14:35:47.033044+0000","last_became_active":"2023-07-25T14:35:44.609128+0000","last_became_peered":"2023-07-25T14:35:44.609128+0000","last_unstale":"2023-07-25T14:35:47.033044+0000","last_undegraded":"2023-07-25T14:35:47.033044+0000","last_fullsized":"2023-07-25T14:35:47.033044+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_clean_scrub_stamp":"2023-07-25T14:35:43.577860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T01:26:57.336329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"20'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:46.555117+0000","last_change":"2023-07-25T14:35:39.542444+0000","last_active":"2023-07-25T14:35:46.555117+0000","last_peered":"2023-07-25T14:35:46.555117+0000","last_clean":"2023-07-25T14:35:46.555117+0000","last_became_active":"2023-07-25T14:35:39.542159+0000","last_became_peered":"2023-07-25T14:35:39.542159+0000","last_unstale":"2023-07-25T14:35:46.555117+0000","last_undegraded":"2023-07-25T14:35:46.555117+0000","last_fullsized":"2023-07-25T14:35:46.555117+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_clean_scrub_stamp":"2023-07-25T14:35:38.515226+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:24:56.192863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:47.033068+0000","last_change":"2023-07-25T14:35:40.560846+0000","last_active":"2023-07-25T14:35:47.033068+0000","last_peered":"2023-07-25T14:35:47.033068+0000","last_clean":"2023-07-25T14:35:47.033068+0000","last_became_active":"2023-07-25T14:35:40.560390+0000","last_became_peered":"2023-07-25T14:35:40.560390+0000","last_unstale":"2023-07-25T14:35:47.033068+0000","last_undegraded":"2023-07-25T14:35:47.033068+0000","last_fullsized":"2023-07-25T14:35:47.033068+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T02:30:11.217603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:46.548733+0000","last_change":"2023-07-25T14:35:44.612963+0000","last_active":"2023-07-25T14:35:46.548733+0000","last_peered":"2023-07-25T14:35:46.548733+0000","last_clean":"2023-07-25T14:35:46.548733+0000","last_became_active":"2023-07-25T14:35:44.612473+0000","last_became_peered":"2023-07-25T14:35:44.612473+0000","last_unstale":"2023-07-25T14:35:46.548733+0000","last_undegraded":"2023-07-25T14:35:46.548733+0000","last_fullsized":"2023-07-25T14:35:46.548733+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_clean_scrub_stamp":"2023-07-25T14:35:43.577860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T15:17:51.741356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.592714+0000","last_change":"2023-07-25T14:35:39.533066+0000","last_active":"2023-07-25T14:35:45.592714+0000","last_peered":"2023-07-25T14:35:45.592714+0000","last_clean":"2023-07-25T14:35:45.592714+0000","last_became_active":"2023-07-25T14:35:39.532788+0000","last_became_peered":"2023-07-25T14:35:39.532788+0000","last_unstale":"2023-07-25T14:35:45.592714+0000","last_undegraded":"2023-07-25T14:35:45.592714+0000","last_fullsized":"2023-07-25T14:35:45.592714+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_clean_scrub_stamp":"2023-07-25T14:35:38.515226+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:20:27.220474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.593805+0000","last_change":"2023-07-25T14:35:40.583948+0000","last_active":"2023-07-25T14:35:45.593805+0000","last_peered":"2023-07-25T14:35:45.593805+0000","last_clean":"2023-07-25T14:35:45.593805+0000","last_became_active":"2023-07-25T14:35:40.583649+0000","last_became_peered":"2023-07-25T14:35:40.583649+0000","last_unstale":"2023-07-25T14:35:45.593805+0000","last_undegraded":"2023-07-25T14:35:45.593805+0000","last_fullsized":"2023-07-25T14:35:45.593805+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T23:42:40.581448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.592627+0000","last_change":"2023-07-25T14:35:44.605812+0000","last_active":"2023-07-25T14:35:45.592627+0000","last_peered":"2023-07-25T14:35:45.592627+0000","last_clean":"2023-07-25T14:35:45.592627+0000","last_became_active":"2023-07-25T14:35:44.605416+0000","last_became_peered":"2023-07-25T14:35:44.605416+0000","last_unstale":"2023-07-25T14:35:45.592627+0000","last_undegraded":"2023-07-25T14:35:45.592627+0000","last_fullsized":"2023-07-25T14:35:45.592627+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_clean_scrub_stamp":"2023-07-25T14:35:43.577860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:09:38.430388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.591482+0000","last_change":"2023-07-25T14:35:39.538303+0000","last_active":"2023-07-25T14:35:45.591482+0000","last_peered":"2023-07-25T14:35:45.591482+0000","last_clean":"2023-07-25T14:35:45.591482+0000","last_became_active":"2023-07-25T14:35:39.538019+0000","last_became_peered":"2023-07-25T14:35:39.538019+0000","last_unstale":"2023-07-25T14:35:45.591482+0000","last_undegraded":"2023-07-25T14:35:45.591482+0000","last_fullsized":"2023-07-25T14:35:45.591482+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_clean_scrub_stamp":"2023-07-25T14:35:38.515226+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T21:36:37.994624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.593528+0000","last_change":"2023-07-25T14:35:40.573130+0000","last_active":"2023-07-25T14:35:45.593528+0000","last_peered":"2023-07-25T14:35:45.593528+0000","last_clean":"2023-07-25T14:35:45.593528+0000","last_became_active":"2023-07-25T14:35:40.572465+0000","last_became_peered":"2023-07-25T14:35:40.572465+0000","last_unstale":"2023-07-25T14:35:45.593528+0000","last_undegraded":"2023-07-25T14:35:45.593528+0000","last_fullsized":"2023-07-25T14:35:45.593528+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T21:29:36.633963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.593380+0000","last_change":"2023-07-25T14:35:44.610311+0000","last_active":"2023-07-25T14:35:45.593380+0000","last_peered":"2023-07-25T14:35:45.593380+0000","last_clean":"2023-07-25T14:35:45.593380+0000","last_became_active":"2023-07-25T14:35:44.609672+0000","last_became_peered":"2023-07-25T14:35:44.609672+0000","last_unstale":"2023-07-25T14:35:45.593380+0000","last_undegraded":"2023-07-25T14:35:45.593380+0000","last_fullsized":"2023-07-25T14:35:45.593380+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_clean_scrub_stamp":"2023-07-25T14:35:43.577860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T21:04:57.404448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"20'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.813281+0000","last_change":"2023-07-25T14:35:39.542215+0000","last_active":"2023-07-25T14:35:45.813281+0000","last_peered":"2023-07-25T14:35:45.813281+0000","last_clean":"2023-07-25T14:35:45.813281+0000","last_became_active":"2023-07-25T14:35:39.541943+0000","last_became_peered":"2023-07-25T14:35:39.541943+0000","last_unstale":"2023-07-25T14:35:45.813281+0000","last_undegraded":"2023-07-25T14:35:45.813281+0000","last_fullsized":"2023-07-25T14:35:45.813281+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_clean_scrub_stamp":"2023-07-25T14:35:38.515226+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T18:16:10.455351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.812997+0000","last_change":"2023-07-25T14:35:40.579154+0000","last_active":"2023-07-25T14:35:45.812997+0000","last_peered":"2023-07-25T14:35:45.812997+0000","last_clean":"2023-07-25T14:35:45.812997+0000","last_became_active":"2023-07-25T14:35:40.578884+0000","last_became_peered":"2023-07-25T14:35:40.578884+0000","last_unstale":"2023-07-25T14:35:45.812997+0000","last_undegraded":"2023-07-25T14:35:45.812997+0000","last_fullsized":"2023-07-25T14:35:45.812997+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T17:49:05.620750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:47.032543+0000","last_change":"2023-07-25T14:35:44.612196+0000","last_active":"2023-07-25T14:35:47.032543+0000","last_peered":"2023-07-25T14:35:47.032543+0000","last_clean":"2023-07-25T14:35:47.032543+0000","last_became_active":"2023-07-25T14:35:44.607198+0000","last_became_peered":"2023-07-25T14:35:44.607198+0000","last_unstale":"2023-07-25T14:35:47.032543+0000","last_undegraded":"2023-07-25T14:35:47.032543+0000","last_fullsized":"2023-07-25T14:35:47.032543+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_clean_scrub_stamp":"2023-07-25T14:35:43.577860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T01:05:07.252828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"20'4","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:46.555008+0000","last_change":"2023-07-25T14:35:39.532403+0000","last_active":"2023-07-25T14:35:46.555008+0000","last_peered":"2023-07-25T14:35:46.555008+0000","last_clean":"2023-07-25T14:35:46.555008+0000","last_became_active":"2023-07-25T14:35:39.532093+0000","last_became_peered":"2023-07-25T14:35:39.532093+0000","last_unstale":"2023-07-25T14:35:46.555008+0000","last_undegraded":"2023-07-25T14:35:46.555008+0000","last_fullsized":"2023-07-25T14:35:46.555008+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_clean_scrub_stamp":"2023-07-25T14:35:38.515226+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T17:08:32.162917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.593485+0000","last_change":"2023-07-25T14:35:40.577967+0000","last_active":"2023-07-25T14:35:45.593485+0000","last_peered":"2023-07-25T14:35:45.593485+0000","last_clean":"2023-07-25T14:35:45.593485+0000","last_became_active":"2023-07-25T14:35:40.577650+0000","last_became_peered":"2023-07-25T14:35:40.577650+0000","last_unstale":"2023-07-25T14:35:45.593485+0000","last_undegraded":"2023-07-25T14:35:45.593485+0000","last_fullsized":"2023-07-25T14:35:45.593485+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T19:24:36.655790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.590805+0000","last_change":"2023-07-25T14:35:40.571775+0000","last_active":"2023-07-25T14:35:45.590805+0000","last_peered":"2023-07-25T14:35:45.590805+0000","last_clean":"2023-07-25T14:35:45.590805+0000","last_became_active":"2023-07-25T14:35:40.571515+0000","last_became_peered":"2023-07-25T14:35:40.571515+0000","last_unstale":"2023-07-25T14:35:45.590805+0000","last_undegraded":"2023-07-25T14:35:45.590805+0000","last_fullsized":"2023-07-25T14:35:45.590805+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T01:27:20.879412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.812791+0000","last_change":"2023-07-25T14:35:40.580145+0000","last_active":"2023-07-25T14:35:45.812791+0000","last_peered":"2023-07-25T14:35:45.812791+0000","last_clean":"2023-07-25T14:35:45.812791+0000","last_became_active":"2023-07-25T14:35:40.579840+0000","last_became_peered":"2023-07-25T14:35:40.579840+0000","last_unstale":"2023-07-25T14:35:45.812791+0000","last_undegraded":"2023-07-25T14:35:45.812791+0000","last_fullsized":"2023-07-25T14:35:45.812791+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T23:06:56.015409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.593959+0000","last_change":"2023-07-25T14:35:40.582132+0000","last_active":"2023-07-25T14:35:45.593959+0000","last_peered":"2023-07-25T14:35:45.593959+0000","last_clean":"2023-07-25T14:35:45.593959+0000","last_became_active":"2023-07-25T14:35:40.581759+0000","last_became_peered":"2023-07-25T14:35:40.581759+0000","last_unstale":"2023-07-25T14:35:45.593959+0000","last_undegraded":"2023-07-25T14:35:45.593959+0000","last_fullsized":"2023-07-25T14:35:45.593959+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T17:04:15.120194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.812954+0000","last_change":"2023-07-25T14:35:40.583199+0000","last_active":"2023-07-25T14:35:45.812954+0000","last_peered":"2023-07-25T14:35:45.812954+0000","last_clean":"2023-07-25T14:35:45.812954+0000","last_became_active":"2023-07-25T14:35:40.582969+0000","last_became_peered":"2023-07-25T14:35:40.582969+0000","last_unstale":"2023-07-25T14:35:45.812954+0000","last_undegraded":"2023-07-25T14:35:45.812954+0000","last_fullsized":"2023-07-25T14:35:45.812954+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T16:19:19.724875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:47.033086+0000","last_change":"2023-07-25T14:35:40.560945+0000","last_active":"2023-07-25T14:35:47.033086+0000","last_peered":"2023-07-25T14:35:47.033086+0000","last_clean":"2023-07-25T14:35:47.033086+0000","last_became_active":"2023-07-25T14:35:40.560663+0000","last_became_peered":"2023-07-25T14:35:40.560663+0000","last_unstale":"2023-07-25T14:35:47.033086+0000","last_undegraded":"2023-07-25T14:35:47.033086+0000","last_fullsized":"2023-07-25T14:35:47.033086+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T17:24:11.100853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4451,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":8902,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64510,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574856,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":360448,"data_stored":703638,"data_compressed":32255,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42799999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40100000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46899999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50800000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":266240,"data_stored":109401,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.307}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28699999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46100000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53100000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41399999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":331776,"data_stored":699769,"data_compressed":32255,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.374}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52900000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72399999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":266240,"data_stored":108922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32400000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41799999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64800000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47299999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]}]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":262144,"data_stored":108340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36299999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28899999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.311}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50800000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68700000000000006}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52300000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":266240,"data_stored":108430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40000000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35299999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44400000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60399999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51900000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":286720,"data_stored":113110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38800000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40500000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.372}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33400000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]}]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":274432,"data_stored":110053,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41799999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48699999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.443}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32255,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32255,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3709,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":3869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-25T14:36:01.104 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-07-25T14:36:01.105 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-07-25T14:36:01.105 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-07-25T14:36:01.105 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-07-25T14:36:01.106 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-07-25T14:36:01.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.244+0000 7f83d96a4700 1 Processor -- start 2023-07-25T14:36:01.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.244+0000 7f83d96a4700 1 -- start start 2023-07-25T14:36:01.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.245+0000 7f83d96a4700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f83d4151b40 0x7f83d40c5c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:01.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.245+0000 7f83d96a4700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f83d4154490 0x7f83d40c0470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:01.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.245+0000 7f83d96a4700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83d4151f20 con 0x7f83d40c09b0 2023-07-25T14:36:01.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.245+0000 7f83d96a4700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83d4154950 con 0x7f83d4154490 2023-07-25T14:36:01.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.245+0000 7f83d96a4700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83d4154c30 con 0x7f83d4151b40 2023-07-25T14:36:01.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.245+0000 7f83d27fc700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f83d4154490 0x7f83d40c0470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:01.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.245+0000 7f83d27fc700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f83d4154490 0x7f83d40c0470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:39952/0 (socket says 172.21.15.72:39952) 2023-07-25T14:36:01.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.245+0000 7f83d37fe700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f83d40c09b0 0x7f83d4157e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:58922/0 (socket says 172.21.15.72:58922) 2023-07-25T14:36:01.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.245+0000 7f83d27fc700 1 -- 172.21.15.72:0/2539519414 learned_addr learned my addr 172.21.15.72:0/2539519414 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:01.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.245+0000 7f83d2ffd700 1 --2- 172.21.15.72:0/2539519414 >> v2:172.21.15.92:3300/0 conn(0x7f83d4151b40 0x7f83d40c5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:01.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.245+0000 7f83d27fc700 1 -- 172.21.15.72:0/2539519414 >> v2:172.21.15.92:3300/0 conn(0x7f83d4151b40 msgr2=0x7f83d40c5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:01.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.245+0000 7f83d27fc700 1 --2- 172.21.15.72:0/2539519414 >> v2:172.21.15.92:3300/0 conn(0x7f83d4151b40 0x7f83d40c5c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:01.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.245+0000 7f83d27fc700 1 -- 172.21.15.72:0/2539519414 >> v1:172.21.15.72:6789/0 conn(0x7f83d40c09b0 legacy=0x7f83d4157e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:01.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.245+0000 7f83d1ffb700 1 -- 172.21.15.72:0/2539519414 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2556009736 0 0) 0x7f83d4151f20 con 0x7f83d40c09b0 2023-07-25T14:36:01.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.245+0000 7f83d27fc700 1 -- 172.21.15.72:0/2539519414 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83d40bebb0 con 0x7f83d4154490 2023-07-25T14:36:01.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.245+0000 7f83d2ffd700 1 --2- 172.21.15.72:0/2539519414 >> v2:172.21.15.92:3300/0 conn(0x7f83d4151b40 0x7f83d40c5c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-25T14:36:01.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.245+0000 7f83d27fc700 1 --2- 172.21.15.72:0/2539519414 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83d4154490 0x7f83d40c0470 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f83d408ac70 tx=0x7f83c8009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16740702dd20e88d server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:01.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.245+0000 7f83d1ffb700 1 -- 172.21.15.72:0/2539519414 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83c800b870 con 0x7f83d4154490 2023-07-25T14:36:01.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.246+0000 7f83d1ffb700 1 -- 172.21.15.72:0/2539519414 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83c800b9d0 con 0x7f83d4154490 2023-07-25T14:36:01.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.246+0000 7f83d1ffb700 1 -- 172.21.15.72:0/2539519414 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83c800bd60 con 0x7f83d4154490 2023-07-25T14:36:01.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.246+0000 7f83d96a4700 1 -- 172.21.15.72:0/2539519414 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83d4154490 msgr2=0x7f83d40c0470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:01.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.246+0000 7f83d96a4700 1 --2- 172.21.15.72:0/2539519414 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83d4154490 0x7f83d40c0470 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f83d408ac70 tx=0x7f83c8009bd0 comp rx=0 tx=0).stop 2023-07-25T14:36:01.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.246+0000 7f83d96a4700 1 -- 172.21.15.72:0/2539519414 shutdown_connections 2023-07-25T14:36:01.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.246+0000 7f83d96a4700 1 --2- 172.21.15.72:0/2539519414 >> v2:172.21.15.92:3300/0 conn(0x7f83d4151b40 0x7f83d40c5c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:01.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.246+0000 7f83d96a4700 1 --2- 172.21.15.72:0/2539519414 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83d4154490 0x7f83d40c0470 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:01.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.246+0000 7f83d96a4700 1 -- 172.21.15.72:0/2539519414 >> 172.21.15.72:0/2539519414 conn(0x7f83d406c410 msgr2=0x7f83d406c820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:01.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.246+0000 7f83d96a4700 1 -- 172.21.15.72:0/2539519414 shutdown_connections 2023-07-25T14:36:01.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.246+0000 7f83d96a4700 1 -- 172.21.15.72:0/2539519414 wait complete. 2023-07-25T14:36:01.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.247+0000 7f83d96a4700 1 Processor -- start 2023-07-25T14:36:01.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.247+0000 7f83d96a4700 1 -- start start 2023-07-25T14:36:01.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.248+0000 7f83d96a4700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f83d40c09b0 0x7f83d4150230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:01.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.248+0000 7f83d96a4700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83d4151b40 0x7f83d40c8d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:01.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.248+0000 7f83d96a4700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f83d4154490 0x7f83d41edbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:01.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.248+0000 7f83d96a4700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83d4157540 con 0x7f83d4151b40 2023-07-25T14:36:01.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.248+0000 7f83d96a4700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83d41513b0 con 0x7f83d40c09b0 2023-07-25T14:36:01.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.248+0000 7f83d96a4700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83d4150b10 con 0x7f83d4154490 2023-07-25T14:36:01.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.248+0000 7f83d27fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83d4151b40 0x7f83d40c8d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:01.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.248+0000 7f83d27fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83d4151b40 0x7f83d40c8d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:39958/0 (socket says 172.21.15.72:39958) 2023-07-25T14:36:01.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.248+0000 7f83d27fc700 1 -- 172.21.15.72:0/3751170149 learned_addr learned my addr 172.21.15.72:0/3751170149 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:01.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.248+0000 7f83d2ffd700 1 --2- 172.21.15.72:0/3751170149 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f83d40c09b0 0x7f83d4150230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:01.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.248+0000 7f83d37fe700 1 --2- 172.21.15.72:0/3751170149 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f83d4154490 0x7f83d41edbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:01.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.248+0000 7f83d27fc700 1 -- 172.21.15.72:0/3751170149 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f83d4154490 msgr2=0x7f83d41edbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:01.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.248+0000 7f83d27fc700 1 --2- 172.21.15.72:0/3751170149 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f83d4154490 0x7f83d41edbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:01.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.248+0000 7f83d27fc700 1 -- 172.21.15.72:0/3751170149 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f83d40c09b0 msgr2=0x7f83d4150230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:01.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.248+0000 7f83d27fc700 1 --2- 172.21.15.72:0/3751170149 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f83d40c09b0 0x7f83d4150230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:01.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.248+0000 7f83d27fc700 1 -- 172.21.15.72:0/3751170149 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83c8009550 con 0x7f83d4151b40 2023-07-25T14:36:01.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.248+0000 7f83d2ffd700 1 --2- 172.21.15.72:0/3751170149 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f83d40c09b0 0x7f83d4150230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-25T14:36:01.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.249+0000 7f83d27fc700 1 --2- 172.21.15.72:0/3751170149 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83d4151b40 0x7f83d40c8d40 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f83c8000c00 tx=0x7f83c8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:01.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.249+0000 7f83bb7fe700 1 -- 172.21.15.72:0/3751170149 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83c8004310 con 0x7f83d4151b40 2023-07-25T14:36:01.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.249+0000 7f83bb7fe700 1 -- 172.21.15.72:0/3751170149 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83c801f070 con 0x7f83d4151b40 2023-07-25T14:36:01.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.249+0000 7f83d96a4700 1 -- 172.21.15.72:0/3751170149 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83d4150df0 con 0x7f83d4151b40 2023-07-25T14:36:01.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.249+0000 7f83bb7fe700 1 -- 172.21.15.72:0/3751170149 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83c80036a0 con 0x7f83d4151b40 2023-07-25T14:36:01.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.249+0000 7f83d96a4700 1 -- 172.21.15.72:0/3751170149 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83d41ed6d0 con 0x7f83d4151b40 2023-07-25T14:36:01.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.250+0000 7f83d96a4700 1 -- 172.21.15.72:0/3751170149 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83d406a670 con 0x7f83d4151b40 2023-07-25T14:36:01.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.250+0000 7f83bb7fe700 1 -- 172.21.15.72:0/3751170149 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f83c8021030 con 0x7f83d4151b40 2023-07-25T14:36:01.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.251+0000 7f83bb7fe700 1 --2- 172.21.15.72:0/3751170149 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f83c006ace0 0x7f83c006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:01.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.251+0000 7f83bb7fe700 1 -- 172.21.15.72:0/3751170149 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f83c808ab40 con 0x7f83d4151b40 2023-07-25T14:36:01.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.251+0000 7f83d2ffd700 1 --2- 172.21.15.72:0/3751170149 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f83c006ace0 0x7f83c006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:01.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.251+0000 7f83d2ffd700 1 --2- 172.21.15.72:0/3751170149 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f83c006ace0 0x7f83c006d1a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f83d414a660 tx=0x7f83c4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:01.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.255+0000 7f83bb7fe700 1 -- 172.21.15.72:0/3751170149 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f83c8055ab0 con 0x7f83d4151b40 2023-07-25T14:36:01.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.500+0000 7f83d96a4700 1 -- 172.21.15.72:0/3751170149 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f83d404e470 con 0x7f83d4151b40 2023-07-25T14:36:01.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.503+0000 7f83bb7fe700 1 -- 172.21.15.72:0/3751170149 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+170841 (secure 0 0 0) 0x7f83c80590d0 con 0x7f83d4151b40 2023-07-25T14:36:01.517 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-25T14:36:01.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.506+0000 7f83d96a4700 1 -- 172.21.15.72:0/3751170149 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f83c006ace0 msgr2=0x7f83c006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:01.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.506+0000 7f83d96a4700 1 --2- 172.21.15.72:0/3751170149 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f83c006ace0 0x7f83c006d1a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f83d414a660 tx=0x7f83c4008040 comp rx=0 tx=0).stop 2023-07-25T14:36:01.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.506+0000 7f83d96a4700 1 -- 172.21.15.72:0/3751170149 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83d4151b40 msgr2=0x7f83d40c8d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:01.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.506+0000 7f83d96a4700 1 --2- 172.21.15.72:0/3751170149 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83d4151b40 0x7f83d40c8d40 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f83c8000c00 tx=0x7f83c8004750 comp rx=0 tx=0).stop 2023-07-25T14:36:01.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.506+0000 7f83d96a4700 1 -- 172.21.15.72:0/3751170149 shutdown_connections 2023-07-25T14:36:01.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.506+0000 7f83d96a4700 1 --2- 172.21.15.72:0/3751170149 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f83c006ace0 0x7f83c006d1a0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:01.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.506+0000 7f83d96a4700 1 --2- 172.21.15.72:0/3751170149 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f83d4154490 0x7f83d41edbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:01.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.506+0000 7f83d96a4700 1 --2- 172.21.15.72:0/3751170149 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f83d40c09b0 0x7f83d4150230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:01.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.506+0000 7f83d96a4700 1 --2- 172.21.15.72:0/3751170149 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83d4151b40 0x7f83d40c8d40 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:01.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.506+0000 7f83d96a4700 1 -- 172.21.15.72:0/3751170149 >> 172.21.15.72:0/3751170149 conn(0x7f83d406c410 msgr2=0x7f83d40af610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:01.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.506+0000 7f83d96a4700 1 -- 172.21.15.72:0/3751170149 shutdown_connections 2023-07-25T14:36:01.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.506+0000 7f83d96a4700 1 -- 172.21.15.72:0/3751170149 wait complete. 2023-07-25T14:36:01.530 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":5,"active_gid":4104,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6832","nonce":1171220306},{"type":"v1","addr":"172.21.15.72:6833","nonce":1171220306}]},"active_addr":"172.21.15.72:6833/1171220306","active_change":"2023-07-25T14:35:27.278442+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4108,"name":"x","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.72:0","nonce":1071868232}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.72:0","nonce":2933951371}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.72:0","nonce":905382936}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.72:0","nonce":2171674679}]}]} 2023-07-25T14:36:01.534 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-07-25T14:36:01.534 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-07-25T14:36:01.535 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-25T14:36:01.654 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.642+0000 7fec7ae2d700 1 Processor -- start 2023-07-25T14:36:01.654 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.642+0000 7fec7ae2d700 1 -- start start 2023-07-25T14:36:01.656 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.643+0000 7fec7ae2d700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fec74151950 0x7fec7406a190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:01.656 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.643+0000 7fec7ae2d700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fec740724c0 0x7fec740c34c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:01.656 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.643+0000 7fec7ae2d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fec7406a6d0 0x7fec740c3a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:01.656 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.643+0000 7fec7ae2d700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec74071a60 con 0x7fec7406a6d0 2023-07-25T14:36:01.656 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.643+0000 7fec7ae2d700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec740c2a70 con 0x7fec74151950 2023-07-25T14:36:01.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.643+0000 7fec7ae2d700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec74151d30 con 0x7fec740724c0 2023-07-25T14:36:01.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.643+0000 7fec793ca700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fec7406a6d0 0x7fec740c3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:01.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.643+0000 7fec793ca700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fec7406a6d0 0x7fec740c3a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:39968/0 (socket says 172.21.15.72:39968) 2023-07-25T14:36:01.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.643+0000 7fec793ca700 1 -- 172.21.15.72:0/1662140083 learned_addr learned my addr 172.21.15.72:0/1662140083 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:01.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.643+0000 7fec78bc9700 1 --2- 172.21.15.72:0/1662140083 >> v2:172.21.15.92:3300/0 conn(0x7fec74151950 0x7fec7406a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:01.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.643+0000 7fec73fff700 1 --2- 172.21.15.72:0/1662140083 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fec740724c0 0x7fec740c34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:01.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.643+0000 7fec793ca700 1 -- 172.21.15.72:0/1662140083 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fec740724c0 msgr2=0x7fec740c34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:01.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.643+0000 7fec793ca700 1 --2- 172.21.15.72:0/1662140083 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fec740724c0 0x7fec740c34c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:01.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.643+0000 7fec793ca700 1 -- 172.21.15.72:0/1662140083 >> v2:172.21.15.92:3300/0 conn(0x7fec74151950 msgr2=0x7fec7406a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:01.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.643+0000 7fec793ca700 1 --2- 172.21.15.72:0/1662140083 >> v2:172.21.15.92:3300/0 conn(0x7fec74151950 0x7fec7406a190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:01.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.643+0000 7fec793ca700 1 -- 172.21.15.72:0/1662140083 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec740c2fe0 con 0x7fec7406a6d0 2023-07-25T14:36:01.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.643+0000 7fec78bc9700 1 --2- 172.21.15.72:0/1662140083 >> v2:172.21.15.92:3300/0 conn(0x7fec74151950 0x7fec7406a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-25T14:36:01.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.643+0000 7fec793ca700 1 --2- 172.21.15.72:0/1662140083 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fec7406a6d0 0x7fec740c3a00 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fec7406ad50 tx=0x7fec6c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1532589563e2731c server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:01.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.644+0000 7fec737fe700 1 -- 172.21.15.72:0/1662140083 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec6c00e070 con 0x7fec7406a6d0 2023-07-25T14:36:01.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.644+0000 7fec737fe700 1 -- 172.21.15.72:0/1662140083 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec6c00b910 con 0x7fec7406a6d0 2023-07-25T14:36:01.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.644+0000 7fec737fe700 1 -- 172.21.15.72:0/1662140083 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec6c00bcc0 con 0x7fec7406a6d0 2023-07-25T14:36:01.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.644+0000 7fec7ae2d700 1 -- 172.21.15.72:0/1662140083 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fec7406a6d0 msgr2=0x7fec740c3a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:01.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.644+0000 7fec7ae2d700 1 --2- 172.21.15.72:0/1662140083 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fec7406a6d0 0x7fec740c3a00 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fec7406ad50 tx=0x7fec6c00b330 comp rx=0 tx=0).stop 2023-07-25T14:36:01.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.644+0000 7fec7ae2d700 1 -- 172.21.15.72:0/1662140083 shutdown_connections 2023-07-25T14:36:01.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.644+0000 7fec7ae2d700 1 --2- 172.21.15.72:0/1662140083 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fec7406a6d0 0x7fec740c3a00 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:01.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.644+0000 7fec7ae2d700 1 --2- 172.21.15.72:0/1662140083 >> v2:172.21.15.92:3300/0 conn(0x7fec74151950 0x7fec7406a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:01.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.644+0000 7fec7ae2d700 1 --2- 172.21.15.72:0/1662140083 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fec740724c0 0x7fec740c34c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:01.662 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.644+0000 7fec7ae2d700 1 -- 172.21.15.72:0/1662140083 >> 172.21.15.72:0/1662140083 conn(0x7fec740a87e0 msgr2=0x7fec740a8bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:01.662 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.644+0000 7fec7ae2d700 1 -- 172.21.15.72:0/1662140083 shutdown_connections 2023-07-25T14:36:01.662 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.644+0000 7fec7ae2d700 1 -- 172.21.15.72:0/1662140083 wait complete. 2023-07-25T14:36:01.662 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.645+0000 7fec7ae2d700 1 Processor -- start 2023-07-25T14:36:01.662 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.646+0000 7fec7ae2d700 1 -- start start 2023-07-25T14:36:01.662 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.646+0000 7fec7ae2d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fec7406a6d0 0x7fec741533b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:01.662 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.646+0000 7fec7ae2d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fec740724c0 0x7fec7414b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:01.662 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.646+0000 7fec7ae2d700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fec74151950 0x7fec7414bef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:01.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.646+0000 7fec7ae2d700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec741edba0 con 0x7fec740724c0 2023-07-25T14:36:01.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.646+0000 7fec7ae2d700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec741ee0d0 con 0x7fec7406a6d0 2023-07-25T14:36:01.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.646+0000 7fec7ae2d700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec74150d80 con 0x7fec74151950 2023-07-25T14:36:01.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.646+0000 7fec73fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fec740724c0 0x7fec7414b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:01.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.646+0000 7fec73fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fec740724c0 0x7fec7414b9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:39972/0 (socket says 172.21.15.72:39972) 2023-07-25T14:36:01.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.646+0000 7fec73fff700 1 -- 172.21.15.72:0/939059450 learned_addr learned my addr 172.21.15.72:0/939059450 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:01.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.646+0000 7fec78bc9700 1 --2- 172.21.15.72:0/939059450 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fec7406a6d0 0x7fec741533b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:01.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.647+0000 7fec793ca700 1 --2- 172.21.15.72:0/939059450 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fec74151950 0x7fec7414bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:01.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.647+0000 7fec73fff700 1 -- 172.21.15.72:0/939059450 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fec74151950 msgr2=0x7fec7414bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:01.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.647+0000 7fec73fff700 1 --2- 172.21.15.72:0/939059450 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fec74151950 0x7fec7414bef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:01.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.647+0000 7fec73fff700 1 -- 172.21.15.72:0/939059450 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fec7406a6d0 msgr2=0x7fec741533b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:01.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.647+0000 7fec73fff700 1 --2- 172.21.15.72:0/939059450 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fec7406a6d0 0x7fec741533b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:01.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.647+0000 7fec73fff700 1 -- 172.21.15.72:0/939059450 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec6c009b30 con 0x7fec740724c0 2023-07-25T14:36:01.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.647+0000 7fec73fff700 1 --2- 172.21.15.72:0/939059450 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fec740724c0 0x7fec7414b9b0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fec6000e900 tx=0x7fec6000ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:01.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.647+0000 7fec717fa700 1 -- 172.21.15.72:0/939059450 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec60013680 con 0x7fec740724c0 2023-07-25T14:36:01.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.647+0000 7fec717fa700 1 -- 172.21.15.72:0/939059450 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec600137e0 con 0x7fec740724c0 2023-07-25T14:36:01.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.647+0000 7fec717fa700 1 -- 172.21.15.72:0/939059450 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec60013b70 con 0x7fec740724c0 2023-07-25T14:36:01.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.647+0000 7fec7ae2d700 1 -- 172.21.15.72:0/939059450 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec741eddf0 con 0x7fec740724c0 2023-07-25T14:36:01.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.647+0000 7fec7ae2d700 1 -- 172.21.15.72:0/939059450 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec74155a80 con 0x7fec740724c0 2023-07-25T14:36:01.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.648+0000 7fec7ae2d700 1 -- 172.21.15.72:0/939059450 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec740bdbc0 con 0x7fec740724c0 2023-07-25T14:36:01.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.648+0000 7fec717fa700 1 -- 172.21.15.72:0/939059450 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fec60013cd0 con 0x7fec740724c0 2023-07-25T14:36:01.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.649+0000 7fec717fa700 1 --2- 172.21.15.72:0/939059450 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fec5806ace0 0x7fec5806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:01.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.649+0000 7fec78bc9700 1 --2- 172.21.15.72:0/939059450 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fec5806ace0 0x7fec5806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:01.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.649+0000 7fec717fa700 1 -- 172.21.15.72:0/939059450 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fec60089640 con 0x7fec740724c0 2023-07-25T14:36:01.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.649+0000 7fec78bc9700 1 --2- 172.21.15.72:0/939059450 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fec5806ace0 0x7fec5806d1a0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fec680099d0 tx=0x7fec68008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:01.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.653+0000 7fec717fa700 1 -- 172.21.15.72:0/939059450 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fec60057f20 con 0x7fec740724c0 2023-07-25T14:36:01.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.840+0000 7fec7ae2d700 1 -- 172.21.15.72:0/939059450 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fec74155430 con 0x7fec740724c0 2023-07-25T14:36:01.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.841+0000 7fec717fa700 1 -- 172.21.15.72:0/939059450 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+20014 (secure 0 0 0) 0x7fec60057ab0 con 0x7fec740724c0 2023-07-25T14:36:01.854 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-25T14:36:01.854 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":25,"fsid":"9170db48-9170-43e8-8ccb-9813e6240906","created":"2023-07-25T14:35:21.733262+0000","modified":"2023-07-25T14:35:44.992669+0000","last_up_change":"2023-07-25T14:35:31.355010+0000","last_in_change":"2023-07-25T14:35:24.195785+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-25T14:35:32.983457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-25T14:35:33.326342+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-25T14:35:37.534158+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-25T14:35:38.891571+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-25T14:35:42.596923+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d517fdad-0bfe-49f0-89f2-9421c3761839","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6801","nonce":2475407414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6803","nonce":2475407414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6807","nonce":2475407414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6805","nonce":2475407414}]},"public_addr":"172.21.15.72:6801/2475407414","cluster_addr":"172.21.15.72:6803/2475407414","heartbeat_back_addr":"172.21.15.72:6807/2475407414","heartbeat_front_addr":"172.21.15.72:6805/2475407414","state":["exists","up"]},{"osd":1,"uuid":"e1564be3-f209-47e5-a8d0-32fc618a474f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6822","nonce":870954016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6825","nonce":870954016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6831","nonce":870954016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6827","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6829","nonce":870954016}]},"public_addr":"172.21.15.72:6822/870954016","cluster_addr":"172.21.15.72:6825/870954016","heartbeat_back_addr":"172.21.15.72:6831/870954016","heartbeat_front_addr":"172.21.15.72:6829/870954016","state":["exists","up"]},{"osd":2,"uuid":"c4647d30-ffa6-417a-9026-ef530c75910e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6809","nonce":2143129442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6811","nonce":2143129442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6815","nonce":2143129442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6813","nonce":2143129442}]},"public_addr":"172.21.15.72:6809/2143129442","cluster_addr":"172.21.15.72:6811/2143129442","heartbeat_back_addr":"172.21.15.72:6815/2143129442","heartbeat_front_addr":"172.21.15.72:6813/2143129442","state":["exists","up"]},{"osd":3,"uuid":"76c9d9a7-c2e2-4612-a58b-d6882dd76b58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6817","nonce":3404066311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6819","nonce":3404066311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6828","nonce":3404066311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6821","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6823","nonce":3404066311}]},"public_addr":"172.21.15.72:6817/3404066311","cluster_addr":"172.21.15.72:6819/3404066311","heartbeat_back_addr":"172.21.15.72:6828/3404066311","heartbeat_front_addr":"172.21.15.72:6823/3404066311","state":["exists","up"]},{"osd":4,"uuid":"7f8920dc-0ad4-4a73-ab40-65408f83eadd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6817","nonce":2381008739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6819","nonce":2381008739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6825","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6827","nonce":2381008739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6822","nonce":2381008739}]},"public_addr":"172.21.15.92:6817/2381008739","cluster_addr":"172.21.15.92:6819/2381008739","heartbeat_back_addr":"172.21.15.92:6827/2381008739","heartbeat_front_addr":"172.21.15.92:6822/2381008739","state":["exists","up"]},{"osd":5,"uuid":"56257e7c-31eb-44c5-9ec7-1318a4e0bb35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6801","nonce":2161935604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6803","nonce":2161935604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6807","nonce":2161935604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6805","nonce":2161935604}]},"public_addr":"172.21.15.92:6801/2161935604","cluster_addr":"172.21.15.92:6803/2161935604","heartbeat_back_addr":"172.21.15.92:6807/2161935604","heartbeat_front_addr":"172.21.15.92:6805/2161935604","state":["exists","up"]},{"osd":6,"uuid":"a150d3d8-a0c9-4955-968a-8d98eff4ffb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6809","nonce":3770163493}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6811","nonce":3770163493}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6815","nonce":3770163493}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6813","nonce":3770163493}]},"public_addr":"172.21.15.92:6809/3770163493","cluster_addr":"172.21.15.92:6811/3770163493","heartbeat_back_addr":"172.21.15.92:6815/3770163493","heartbeat_front_addr":"172.21.15.92:6813/3770163493","state":["exists","up"]},{"osd":7,"uuid":"07799c27-54ee-4591-a42d-a978d6b32065","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6821","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6823","nonce":2135777609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6826","nonce":2135777609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6831","nonce":2135777609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6829","nonce":2135777609}]},"public_addr":"172.21.15.92:6823/2135777609","cluster_addr":"172.21.15.92:6826/2135777609","heartbeat_back_addr":"172.21.15.92:6831/2135777609","heartbeat_front_addr":"172.21.15.92:6829/2135777609","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.345365+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.378150+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.146566+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.372172+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:30.398421+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.385632+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.465611+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.443583+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-25T14:36:01.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.844+0000 7fec7ae2d700 1 -- 172.21.15.72:0/939059450 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fec5806ace0 msgr2=0x7fec5806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:01.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.844+0000 7fec7ae2d700 1 --2- 172.21.15.72:0/939059450 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fec5806ace0 0x7fec5806d1a0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fec680099d0 tx=0x7fec68008040 comp rx=0 tx=0).stop 2023-07-25T14:36:01.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.844+0000 7fec7ae2d700 1 -- 172.21.15.72:0/939059450 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fec740724c0 msgr2=0x7fec7414b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:01.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.844+0000 7fec7ae2d700 1 --2- 172.21.15.72:0/939059450 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fec740724c0 0x7fec7414b9b0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fec6000e900 tx=0x7fec6000ec10 comp rx=0 tx=0).stop 2023-07-25T14:36:01.858 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.844+0000 7fec7ae2d700 1 -- 172.21.15.72:0/939059450 shutdown_connections 2023-07-25T14:36:01.858 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.844+0000 7fec7ae2d700 1 --2- 172.21.15.72:0/939059450 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fec5806ace0 0x7fec5806d1a0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:01.858 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.844+0000 7fec7ae2d700 1 --2- 172.21.15.72:0/939059450 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fec74151950 0x7fec7414bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:01.858 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.844+0000 7fec7ae2d700 1 --2- 172.21.15.72:0/939059450 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fec7406a6d0 0x7fec741533b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:01.858 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.844+0000 7fec7ae2d700 1 --2- 172.21.15.72:0/939059450 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fec740724c0 0x7fec7414b9b0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:01.858 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.844+0000 7fec7ae2d700 1 -- 172.21.15.72:0/939059450 >> 172.21.15.72:0/939059450 conn(0x7fec740a87e0 msgr2=0x7fec740c53e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:01.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.844+0000 7fec7ae2d700 1 -- 172.21.15.72:0/939059450 shutdown_connections 2023-07-25T14:36:01.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.844+0000 7fec7ae2d700 1 -- 172.21.15.72:0/939059450 wait complete. 2023-07-25T14:36:01.868 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-07-25T14:36:01.869 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-25T14:36:01.988 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.976+0000 7ffb208fb700 1 Processor -- start 2023-07-25T14:36:01.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.976+0000 7ffb208fb700 1 -- start start 2023-07-25T14:36:01.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.977+0000 7ffb208fb700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ffb1c151950 0x7ffb1c06a190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:01.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.977+0000 7ffb208fb700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb1c0c2fe0 con 0x7ffb1c06a6d0 2023-07-25T14:36:01.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.977+0000 7ffb208fb700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb1c155070 con 0x7ffb1c0724c0 2023-07-25T14:36:01.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.977+0000 7ffb208fb700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb1c071a60 con 0x7ffb1c151950 2023-07-25T14:36:01.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.977+0000 7ffb1ad9d700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7ffb1c06a6d0 0x7ffb1c0c3bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:58950/0 (socket says 172.21.15.72:58950) 2023-07-25T14:36:01.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.977+0000 7ffb1ad9d700 1 -- 172.21.15.72:0/1967921652 learned_addr learned my addr 172.21.15.72:0/1967921652 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:36:01.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.977+0000 7ffb1959a700 1 -- 172.21.15.72:0/1967921652 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1163648882 0 0) 0x7ffb1c0c2fe0 con 0x7ffb1c06a6d0 2023-07-25T14:36:01.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.977+0000 7ffb1a59c700 1 --2- 172.21.15.72:0/1967921652 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ffb1c151950 0x7ffb1c06a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:01.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.977+0000 7ffb1959a700 1 -- 172.21.15.72:0/1967921652 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffb040035b0 con 0x7ffb1c06a6d0 2023-07-25T14:36:01.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.977+0000 7ffb1959a700 1 -- 172.21.15.72:0/1967921652 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1602677460 0 0) 0x7ffb040035b0 con 0x7ffb1c06a6d0 2023-07-25T14:36:01.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.977+0000 7ffb1959a700 1 -- 172.21.15.72:0/1967921652 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ffb1c151950 msgr2=0x7ffb1c06a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:01.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.977+0000 7ffb1959a700 1 --2- 172.21.15.72:0/1967921652 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ffb1c151950 0x7ffb1c06a190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:01.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.977+0000 7ffb1959a700 1 -- 172.21.15.72:0/1967921652 >> v1:172.21.15.92:6789/0 conn(0x7ffb1c0724c0 legacy=0x7ffb1c0c34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:01.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.977+0000 7ffb1959a700 1 -- 172.21.15.72:0/1967921652 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb1c0c15c0 con 0x7ffb1c06a6d0 2023-07-25T14:36:01.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.977+0000 7ffb1959a700 1 -- 172.21.15.72:0/1967921652 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2559588315 0 0) 0x7ffb140019f0 con 0x7ffb1c06a6d0 2023-07-25T14:36:01.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.977+0000 7ffb1959a700 1 -- 172.21.15.72:0/1967921652 >> v1:172.21.15.72:6789/0 conn(0x7ffb1c06a6d0 legacy=0x7ffb1c0c3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:01.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.978+0000 7ffb1959a700 1 --2- 172.21.15.72:0/1967921652 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ffb1c151950 0x7ffb04003a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:01.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.978+0000 7ffb1959a700 1 --2- 172.21.15.72:0/1967921652 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffb04003fb0 0x7ffb04004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:01.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.978+0000 7ffb1959a700 1 --2- 172.21.15.72:0/1967921652 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffb04004d90 0x7ffb04005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:01.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.978+0000 7ffb1959a700 1 -- 172.21.15.72:0/1967921652 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb1c071a60 con 0x7ffb04004d90 2023-07-25T14:36:01.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.978+0000 7ffb1959a700 1 -- 172.21.15.72:0/1967921652 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb0400bba0 con 0x7ffb04003fb0 2023-07-25T14:36:01.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.978+0000 7ffb1959a700 1 -- 172.21.15.72:0/1967921652 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb0400bd60 con 0x7ffb1c151950 2023-07-25T14:36:01.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.978+0000 7ffb1ad9d700 1 --2- 172.21.15.72:0/1967921652 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffb04004d90 0x7ffb04005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:01.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.978+0000 7ffb1a59c700 1 --2- 172.21.15.72:0/1967921652 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ffb1c151950 0x7ffb04003a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:01.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.978+0000 7ffb19d9b700 1 --2- 172.21.15.72:0/1967921652 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffb04003fb0 0x7ffb04004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:01.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.978+0000 7ffb1ad9d700 1 -- 172.21.15.72:0/1967921652 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ffb1c151950 msgr2=0x7ffb04003a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:01.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.978+0000 7ffb1ad9d700 1 --2- 172.21.15.72:0/1967921652 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ffb1c151950 0x7ffb04003a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:01.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.978+0000 7ffb1ad9d700 1 -- 172.21.15.72:0/1967921652 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffb04003fb0 msgr2=0x7ffb04004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:01.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.978+0000 7ffb1ad9d700 1 --2- 172.21.15.72:0/1967921652 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffb04003fb0 0x7ffb04004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:01.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.978+0000 7ffb1ad9d700 1 -- 172.21.15.72:0/1967921652 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb040035b0 con 0x7ffb04004d90 2023-07-25T14:36:01.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.978+0000 7ffb1ad9d700 1 --2- 172.21.15.72:0/1967921652 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffb04004d90 0x7ffb04005210 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7ffb140013d0 tx=0x7ffb04005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cfb5521fd3867cd server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:01.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.978+0000 7ffb1959a700 1 -- 172.21.15.72:0/1967921652 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb14012600 con 0x7ffb04004d90 2023-07-25T14:36:01.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.978+0000 7ffb1959a700 1 -- 172.21.15.72:0/1967921652 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb14012760 con 0x7ffb04004d90 2023-07-25T14:36:01.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.978+0000 7ffb1959a700 1 -- 172.21.15.72:0/1967921652 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb14012b10 con 0x7ffb04004d90 2023-07-25T14:36:01.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.979+0000 7ffb208fb700 1 -- 172.21.15.72:0/1967921652 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffb04004d90 msgr2=0x7ffb04005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:01.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.979+0000 7ffb208fb700 1 --2- 172.21.15.72:0/1967921652 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffb04004d90 0x7ffb04005210 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7ffb140013d0 tx=0x7ffb04005880 comp rx=0 tx=0).stop 2023-07-25T14:36:01.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.979+0000 7ffb1ad9d700 1 -- 172.21.15.72:0/1967921652 reap_dead start 2023-07-25T14:36:01.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.979+0000 7ffb208fb700 1 -- 172.21.15.72:0/1967921652 shutdown_connections 2023-07-25T14:36:01.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.979+0000 7ffb208fb700 1 -- 172.21.15.72:0/1967921652 >> 172.21.15.72:0/1967921652 conn(0x7ffb1c0a87e0 msgr2=0x7ffb1c0a8bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:01.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.979+0000 7ffb208fb700 1 -- 172.21.15.72:0/1967921652 shutdown_connections 2023-07-25T14:36:01.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.979+0000 7ffb208fb700 1 -- 172.21.15.72:0/1967921652 wait complete. 2023-07-25T14:36:01.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.980+0000 7ffb208fb700 1 Processor -- start 2023-07-25T14:36:01.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.980+0000 7ffb208fb700 1 -- start start 2023-07-25T14:36:01.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.981+0000 7ffb208fb700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffb04004d90 0x7ffb1c153950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:02.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.981+0000 7ffb208fb700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ffb1c0ac990 0x7ffb1c1ea110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:02.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.981+0000 7ffb208fb700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffb1c1ea650 0x7ffb1c1ed580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:02.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.981+0000 7ffb208fb700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb1c0be770 con 0x7ffb04004d90 2023-07-25T14:36:02.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.981+0000 7ffb208fb700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb1c0c02f0 con 0x7ffb1c1ea650 2023-07-25T14:36:02.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.981+0000 7ffb208fb700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb1c0bdb00 con 0x7ffb1c0ac990 2023-07-25T14:36:02.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.981+0000 7ffb1a59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffb04004d90 0x7ffb1c153950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:02.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.981+0000 7ffb1a59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffb04004d90 0x7ffb1c153950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:39990/0 (socket says 172.21.15.72:39990) 2023-07-25T14:36:02.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.981+0000 7ffb1a59c700 1 -- 172.21.15.72:0/865073867 learned_addr learned my addr 172.21.15.72:0/865073867 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:02.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.981+0000 7ffb19d9b700 1 --2- 172.21.15.72:0/865073867 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ffb1c0ac990 0x7ffb1c1ea110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:02.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.981+0000 7ffb1ad9d700 1 --2- 172.21.15.72:0/865073867 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffb1c1ea650 0x7ffb1c1ed580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:02.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.981+0000 7ffb1a59c700 1 -- 172.21.15.72:0/865073867 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ffb1c0ac990 msgr2=0x7ffb1c1ea110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:02.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.981+0000 7ffb1a59c700 1 --2- 172.21.15.72:0/865073867 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ffb1c0ac990 0x7ffb1c1ea110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:02.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.981+0000 7ffb1a59c700 1 -- 172.21.15.72:0/865073867 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffb1c1ea650 msgr2=0x7ffb1c1ed580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:02.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.981+0000 7ffb1a59c700 1 --2- 172.21.15.72:0/865073867 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffb1c1ea650 0x7ffb1c1ed580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:02.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.981+0000 7ffb1a59c700 1 -- 172.21.15.72:0/865073867 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb1c0be0c0 con 0x7ffb04004d90 2023-07-25T14:36:02.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.981+0000 7ffb1ad9d700 1 --2- 172.21.15.72:0/865073867 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffb1c1ea650 0x7ffb1c1ed580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-25T14:36:02.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.981+0000 7ffb1a59c700 1 --2- 172.21.15.72:0/865073867 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffb04004d90 0x7ffb1c153950 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7ffb10011b00 tx=0x7ffb10011e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:02.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.981+0000 7ffb0affd700 1 -- 172.21.15.72:0/865073867 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb1000f940 con 0x7ffb04004d90 2023-07-25T14:36:02.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.982+0000 7ffb0affd700 1 -- 172.21.15.72:0/865073867 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb1000faa0 con 0x7ffb04004d90 2023-07-25T14:36:02.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.982+0000 7ffb208fb700 1 -- 172.21.15.72:0/865073867 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb1c0c04d0 con 0x7ffb04004d90 2023-07-25T14:36:02.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.982+0000 7ffb0affd700 1 -- 172.21.15.72:0/865073867 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb1000fe50 con 0x7ffb04004d90 2023-07-25T14:36:02.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.982+0000 7ffb208fb700 1 -- 172.21.15.72:0/865073867 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb1c153e90 con 0x7ffb04004d90 2023-07-25T14:36:02.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.983+0000 7ffb208fb700 1 -- 172.21.15.72:0/865073867 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb1c0bd3d0 con 0x7ffb04004d90 2023-07-25T14:36:02.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.983+0000 7ffb0affd700 1 -- 172.21.15.72:0/865073867 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ffb10014440 con 0x7ffb04004d90 2023-07-25T14:36:02.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.983+0000 7ffb0affd700 1 --2- 172.21.15.72:0/865073867 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7ffafc06ace0 0x7ffafc06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:02.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.983+0000 7ffb0affd700 1 -- 172.21.15.72:0/865073867 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7ffb10089f10 con 0x7ffb04004d90 2023-07-25T14:36:02.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.983+0000 7ffb19d9b700 1 --2- 172.21.15.72:0/865073867 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7ffafc06ace0 0x7ffafc06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:02.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.984+0000 7ffb19d9b700 1 --2- 172.21.15.72:0/865073867 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7ffafc06ace0 0x7ffafc06d1a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ffb1c0a5d00 tx=0x7ffb0c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:02.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:01.988+0000 7ffb0affd700 1 -- 172.21.15.72:0/865073867 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7ffb100587f0 con 0x7ffb04004d90 2023-07-25T14:36:02.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.175+0000 7ffb208fb700 1 -- 172.21.15.72:0/865073867 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ffb1c0c2760 con 0x7ffb04004d90 2023-07-25T14:36:02.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.176+0000 7ffb0affd700 1 -- 172.21.15.72:0/865073867 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+20014 (secure 0 0 0) 0x7ffb10058380 con 0x7ffb04004d90 2023-07-25T14:36:02.189 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-25T14:36:02.189 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":25,"fsid":"9170db48-9170-43e8-8ccb-9813e6240906","created":"2023-07-25T14:35:21.733262+0000","modified":"2023-07-25T14:35:44.992669+0000","last_up_change":"2023-07-25T14:35:31.355010+0000","last_in_change":"2023-07-25T14:35:24.195785+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-25T14:35:32.983457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-25T14:35:33.326342+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-25T14:35:37.534158+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-25T14:35:38.891571+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-25T14:35:42.596923+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d517fdad-0bfe-49f0-89f2-9421c3761839","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6801","nonce":2475407414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6803","nonce":2475407414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6807","nonce":2475407414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6805","nonce":2475407414}]},"public_addr":"172.21.15.72:6801/2475407414","cluster_addr":"172.21.15.72:6803/2475407414","heartbeat_back_addr":"172.21.15.72:6807/2475407414","heartbeat_front_addr":"172.21.15.72:6805/2475407414","state":["exists","up"]},{"osd":1,"uuid":"e1564be3-f209-47e5-a8d0-32fc618a474f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6822","nonce":870954016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6825","nonce":870954016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6831","nonce":870954016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6827","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6829","nonce":870954016}]},"public_addr":"172.21.15.72:6822/870954016","cluster_addr":"172.21.15.72:6825/870954016","heartbeat_back_addr":"172.21.15.72:6831/870954016","heartbeat_front_addr":"172.21.15.72:6829/870954016","state":["exists","up"]},{"osd":2,"uuid":"c4647d30-ffa6-417a-9026-ef530c75910e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6809","nonce":2143129442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6811","nonce":2143129442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6815","nonce":2143129442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6813","nonce":2143129442}]},"public_addr":"172.21.15.72:6809/2143129442","cluster_addr":"172.21.15.72:6811/2143129442","heartbeat_back_addr":"172.21.15.72:6815/2143129442","heartbeat_front_addr":"172.21.15.72:6813/2143129442","state":["exists","up"]},{"osd":3,"uuid":"76c9d9a7-c2e2-4612-a58b-d6882dd76b58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6817","nonce":3404066311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6819","nonce":3404066311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6828","nonce":3404066311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6821","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6823","nonce":3404066311}]},"public_addr":"172.21.15.72:6817/3404066311","cluster_addr":"172.21.15.72:6819/3404066311","heartbeat_back_addr":"172.21.15.72:6828/3404066311","heartbeat_front_addr":"172.21.15.72:6823/3404066311","state":["exists","up"]},{"osd":4,"uuid":"7f8920dc-0ad4-4a73-ab40-65408f83eadd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6817","nonce":2381008739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6819","nonce":2381008739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6825","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6827","nonce":2381008739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6822","nonce":2381008739}]},"public_addr":"172.21.15.92:6817/2381008739","cluster_addr":"172.21.15.92:6819/2381008739","heartbeat_back_addr":"172.21.15.92:6827/2381008739","heartbeat_front_addr":"172.21.15.92:6822/2381008739","state":["exists","up"]},{"osd":5,"uuid":"56257e7c-31eb-44c5-9ec7-1318a4e0bb35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6801","nonce":2161935604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6803","nonce":2161935604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6807","nonce":2161935604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6805","nonce":2161935604}]},"public_addr":"172.21.15.92:6801/2161935604","cluster_addr":"172.21.15.92:6803/2161935604","heartbeat_back_addr":"172.21.15.92:6807/2161935604","heartbeat_front_addr":"172.21.15.92:6805/2161935604","state":["exists","up"]},{"osd":6,"uuid":"a150d3d8-a0c9-4955-968a-8d98eff4ffb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6809","nonce":3770163493}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6811","nonce":3770163493}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6815","nonce":3770163493}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6813","nonce":3770163493}]},"public_addr":"172.21.15.92:6809/3770163493","cluster_addr":"172.21.15.92:6811/3770163493","heartbeat_back_addr":"172.21.15.92:6815/3770163493","heartbeat_front_addr":"172.21.15.92:6813/3770163493","state":["exists","up"]},{"osd":7,"uuid":"07799c27-54ee-4591-a42d-a978d6b32065","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6821","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6823","nonce":2135777609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6826","nonce":2135777609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6831","nonce":2135777609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6829","nonce":2135777609}]},"public_addr":"172.21.15.92:6823/2135777609","cluster_addr":"172.21.15.92:6826/2135777609","heartbeat_back_addr":"172.21.15.92:6831/2135777609","heartbeat_front_addr":"172.21.15.92:6829/2135777609","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.345365+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.378150+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.146566+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.372172+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:30.398421+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.385632+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.465611+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.443583+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-25T14:36:02.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.178+0000 7ffb208fb700 1 -- 172.21.15.72:0/865073867 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7ffafc06ace0 msgr2=0x7ffafc06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:02.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.178+0000 7ffb208fb700 1 --2- 172.21.15.72:0/865073867 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7ffafc06ace0 0x7ffafc06d1a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ffb1c0a5d00 tx=0x7ffb0c009040 comp rx=0 tx=0).stop 2023-07-25T14:36:02.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.178+0000 7ffb208fb700 1 -- 172.21.15.72:0/865073867 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffb04004d90 msgr2=0x7ffb1c153950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:02.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.178+0000 7ffb208fb700 1 --2- 172.21.15.72:0/865073867 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffb04004d90 0x7ffb1c153950 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7ffb10011b00 tx=0x7ffb10011e10 comp rx=0 tx=0).stop 2023-07-25T14:36:02.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.178+0000 7ffb208fb700 1 -- 172.21.15.72:0/865073867 shutdown_connections 2023-07-25T14:36:02.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.178+0000 7ffb208fb700 1 --2- 172.21.15.72:0/865073867 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7ffafc06ace0 0x7ffafc06d1a0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:02.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.178+0000 7ffb208fb700 1 --2- 172.21.15.72:0/865073867 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffb1c1ea650 0x7ffb1c1ed580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:02.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.178+0000 7ffb208fb700 1 --2- 172.21.15.72:0/865073867 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffb04004d90 0x7ffb1c153950 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:02.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.178+0000 7ffb208fb700 1 --2- 172.21.15.72:0/865073867 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ffb1c0ac990 0x7ffb1c1ea110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:02.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.178+0000 7ffb208fb700 1 -- 172.21.15.72:0/865073867 >> 172.21.15.72:0/865073867 conn(0x7ffb1c0a87e0 msgr2=0x7ffb1c0c53c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:02.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.178+0000 7ffb208fb700 1 -- 172.21.15.72:0/865073867 shutdown_connections 2023-07-25T14:36:02.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.178+0000 7ffb208fb700 1 -- 172.21.15.72:0/865073867 wait complete. 2023-07-25T14:36:02.204 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-07-25T14:36:02.205 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-07-25T14:36:02.206 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-07-25T14:36:02.206 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-07-25T14:36:02.207 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-07-25T14:36:02.208 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-07-25T14:36:02.209 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-07-25T14:36:02.210 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-07-25T14:36:02.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.408+0000 7ff446125700 1 Processor -- start 2023-07-25T14:36:02.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.408+0000 7ff446125700 1 -- start start 2023-07-25T14:36:02.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.409+0000 7ff446125700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff44014db20 0x7ff4400bad70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:02.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.409+0000 7ff446125700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff4401546f0 0x7ff44015ad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:02.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.409+0000 7ff446125700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff440153b00 con 0x7ff4401504f0 2023-07-25T14:36:02.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.409+0000 7ff446125700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4400c0aa0 con 0x7ff44014db20 2023-07-25T14:36:02.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.409+0000 7ff446125700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4400c0d80 con 0x7ff4401546f0 2023-07-25T14:36:02.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.410+0000 7fbb02f62700 1 Processor -- start 2023-07-25T14:36:02.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.409+0000 7f4eefcd6700 1 Processor -- start 2023-07-25T14:36:02.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.410+0000 7f4eefcd6700 1 -- start start 2023-07-25T14:36:02.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.411+0000 7f4eefcd6700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f4ee80a6d80 0x7f4ee815bd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:02.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.411+0000 7f4eefcd6700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ee80a7260 con 0x7f4ee80bc340 2023-07-25T14:36:02.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.411+0000 7f4eefcd6700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ee81587f0 con 0x7f4ee80a5f70 2023-07-25T14:36:02.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.411+0000 7f4eefcd6700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ee81596e0 con 0x7f4ee80a6d80 2023-07-25T14:36:02.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.412+0000 7f4eeda72700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f4ee80bc340 0x7f4ee8158fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:58972/0 (socket says 172.21.15.72:58972) 2023-07-25T14:36:02.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.412+0000 7f4eeda72700 1 -- 172.21.15.72:0/4049862893 learned_addr learned my addr 172.21.15.72:0/4049862893 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:36:02.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.412+0000 7f4eee273700 1 --2- 172.21.15.72:0/4049862893 >> v2:172.21.15.92:3300/0 conn(0x7f4ee80a6d80 0x7f4ee815bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:02.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.412+0000 7f4eeca70700 1 -- 172.21.15.72:0/4049862893 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 307984861 0 0) 0x7f4ee80a7260 con 0x7f4ee80bc340 2023-07-25T14:36:02.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.412+0000 7f4eeca70700 1 -- 172.21.15.72:0/4049862893 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4ed40035b0 con 0x7f4ee80bc340 2023-07-25T14:36:02.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.412+0000 7f4eeca70700 1 -- 172.21.15.72:0/4049862893 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1826965612 0 0) 0x7f4ed40035b0 con 0x7f4ee80bc340 2023-07-25T14:36:02.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.412+0000 7f4eeca70700 1 -- 172.21.15.72:0/4049862893 >> v2:172.21.15.92:3300/0 conn(0x7f4ee80a6d80 msgr2=0x7f4ee815bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:02.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.412+0000 7f4eeca70700 1 --2- 172.21.15.72:0/4049862893 >> v2:172.21.15.92:3300/0 conn(0x7f4ee80a6d80 0x7f4ee815bd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:02.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.412+0000 7f4eeca70700 1 -- 172.21.15.72:0/4049862893 >> v1:172.21.15.92:6789/0 conn(0x7f4ee80a5f70 legacy=0x7f4ee806a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:02.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.412+0000 7f4eeca70700 1 -- 172.21.15.72:0/4049862893 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ee80c0b00 con 0x7f4ee80bc340 2023-07-25T14:36:02.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.413+0000 7f4eeca70700 1 -- 172.21.15.72:0/4049862893 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2559588315 0 0) 0x7f4ee4001670 con 0x7f4ee80bc340 2023-07-25T14:36:02.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.413+0000 7f4eeca70700 1 -- 172.21.15.72:0/4049862893 >> v1:172.21.15.72:6789/0 conn(0x7f4ee80bc340 legacy=0x7f4ee8158fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:02.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.413+0000 7f4eeca70700 1 --2- 172.21.15.72:0/4049862893 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4ed4003a50 0x7f4ed4003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:02.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.413+0000 7f4eeca70700 1 --2- 172.21.15.72:0/4049862893 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4ed4004850 0x7f4ed4004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:02.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.413+0000 7f4eeca70700 1 --2- 172.21.15.72:0/4049862893 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4ed4005330 0x7f4ed400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:02.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.413+0000 7f4eeca70700 1 -- 172.21.15.72:0/4049862893 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ee81596e0 con 0x7f4ed4005330 2023-07-25T14:36:02.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.413+0000 7f4eeca70700 1 -- 172.21.15.72:0/4049862893 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ed400c230 con 0x7f4ed4004850 2023-07-25T14:36:02.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.413+0000 7f4eeca70700 1 -- 172.21.15.72:0/4049862893 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ed400c3f0 con 0x7f4ed4003a50 2023-07-25T14:36:02.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.413+0000 7f4eee273700 1 --2- 172.21.15.72:0/4049862893 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4ed4005330 0x7f4ed400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:02.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.410+0000 7ff43f7fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff44014db20 0x7ff4400bad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:02.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.410+0000 7ff43f7fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff44014db20 0x7ff4400bad70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:39998/0 (socket says 172.21.15.72:39998) 2023-07-25T14:36:02.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.410+0000 7ff43f7fe700 1 -- 172.21.15.72:0/1726719116 learned_addr learned my addr 172.21.15.72:0/1726719116 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:02.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.411+0000 7ff43ffff700 1 --2- 172.21.15.72:0/1726719116 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff4401546f0 0x7ff44015ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:02.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.411+0000 7ff43f7fe700 1 -- 172.21.15.72:0/1726719116 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff4401546f0 msgr2=0x7ff44015ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:02.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.411+0000 7ff43f7fe700 1 --2- 172.21.15.72:0/1726719116 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff4401546f0 0x7ff44015ad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:02.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.411+0000 7ff43f7fe700 1 -- 172.21.15.72:0/1726719116 >> v1:172.21.15.92:6789/0 conn(0x7ff4401504f0 legacy=0x7ff440153fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:02.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.411+0000 7ff43f7fe700 1 -- 172.21.15.72:0/1726719116 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4400c1060 con 0x7ff44014db20 2023-07-25T14:36:02.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.411+0000 7ff43f7fe700 1 --2- 172.21.15.72:0/1726719116 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff44014db20 0x7ff4400bad70 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7ff43000a990 tx=0x7ff430009520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12eb0dfec01bddc5 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:02.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.412+0000 7ff43e7fc700 1 -- 172.21.15.72:0/1726719116 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff430004030 con 0x7ff44014db20 2023-07-25T14:36:02.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.412+0000 7ff43e7fc700 1 -- 172.21.15.72:0/1726719116 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff430004190 con 0x7ff44014db20 2023-07-25T14:36:02.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.412+0000 7ff43e7fc700 1 -- 172.21.15.72:0/1726719116 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff430004520 con 0x7ff44014db20 2023-07-25T14:36:02.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.413+0000 7ff446125700 1 -- 172.21.15.72:0/1726719116 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff44014db20 msgr2=0x7ff4400bad70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:02.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.413+0000 7ff446125700 1 --2- 172.21.15.72:0/1726719116 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff44014db20 0x7ff4400bad70 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7ff43000a990 tx=0x7ff430009520 comp rx=0 tx=0).stop 2023-07-25T14:36:02.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.412+0000 7f5b5006c700 1 Processor -- start 2023-07-25T14:36:02.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.410+0000 7fbb02f62700 1 -- start start 2023-07-25T14:36:02.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.411+0000 7fbb02f62700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fbafc14db20 0x7fbafc0bad70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:02.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.411+0000 7fbb02f62700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fbafc1504f0 0x7fbafc153fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:02.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.411+0000 7fbb02f62700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fbafc0bb2b0 0x7fbafc154520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:02.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.411+0000 7fbb02f62700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbafc153b00 con 0x7fbafc1504f0 2023-07-25T14:36:02.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.411+0000 7fbb02f62700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbafc0c0aa0 con 0x7fbafc14db20 2023-07-25T14:36:02.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.411+0000 7fbb02f62700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbafc0c0d80 con 0x7fbafc0bb2b0 2023-07-25T14:36:02.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.412+0000 7fbafbfff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fbafc1504f0 0x7fbafc153fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:02.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.412+0000 7fbafbfff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fbafc1504f0 0x7fbafc153fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40008/0 (socket says 172.21.15.72:40008) 2023-07-25T14:36:02.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.412+0000 7fbafbfff700 1 -- 172.21.15.72:0/4116876432 learned_addr learned my addr 172.21.15.72:0/4116876432 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:02.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.412+0000 7fbb00cfe700 1 --2- 172.21.15.72:0/4116876432 >> v2:172.21.15.92:3300/0 conn(0x7fbafc14db20 0x7fbafc0bad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:02.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.412+0000 7fbafbfff700 1 -- 172.21.15.72:0/4116876432 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fbafc0bb2b0 msgr2=0x7fbafc154520 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-25T14:36:02.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.412+0000 7fbafbfff700 1 --2- 172.21.15.72:0/4116876432 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fbafc0bb2b0 0x7fbafc154520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:02.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.412+0000 7fbafbfff700 1 -- 172.21.15.72:0/4116876432 >> v2:172.21.15.92:3300/0 conn(0x7fbafc14db20 msgr2=0x7fbafc0bad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:02.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.412+0000 7fbafbfff700 1 --2- 172.21.15.72:0/4116876432 >> v2:172.21.15.92:3300/0 conn(0x7fbafc14db20 0x7fbafc0bad70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:02.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.412+0000 7fbafbfff700 1 -- 172.21.15.72:0/4116876432 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbafc0c1060 con 0x7fbafc1504f0 2023-07-25T14:36:02.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.412+0000 7fbb00cfe700 1 --2- 172.21.15.72:0/4116876432 >> v2:172.21.15.92:3300/0 conn(0x7fbafc14db20 0x7fbafc0bad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-25T14:36:02.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.412+0000 7fbafbfff700 1 --2- 172.21.15.72:0/4116876432 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbafc1504f0 0x7fbafc153fe0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fbafc06e620 tx=0x7fbaec0073a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5f9255e582794ca server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:02.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.413+0000 7fbafb7fe700 1 -- 172.21.15.72:0/4116876432 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaec007ae0 con 0x7fbafc1504f0 2023-07-25T14:36:02.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.413+0000 7fbafb7fe700 1 -- 172.21.15.72:0/4116876432 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbaec007c40 con 0x7fbafc1504f0 2023-07-25T14:36:02.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.413+0000 7fbafb7fe700 1 -- 172.21.15.72:0/4116876432 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaec0090d0 con 0x7fbafc1504f0 2023-07-25T14:36:02.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.412+0000 7f5b5006c700 1 -- start start 2023-07-25T14:36:02.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.414+0000 7f5b5006c700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5b48151920 0x7f5b48158220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:02.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.414+0000 7f5b5006c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f5b480c2570 0x7f5b480c29e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:02.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.414+0000 7f5b5006c700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b480c4620 con 0x7f5b480c5d70 2023-07-25T14:36:02.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.414+0000 7f5b5006c700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b480c4f50 con 0x7f5b480c2570 2023-07-25T14:36:02.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.414+0000 7f5b5006c700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b48158760 con 0x7f5b48151920 2023-07-25T14:36:02.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.414+0000 7f544e494700 1 Processor -- start 2023-07-25T14:36:02.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.414+0000 7f5b4e609700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f5b480c2570 0x7f5b480c29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:02.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.414+0000 7f5b4d607700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f5b480c5d70 0x7f5b480c6610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.72:54334/0 (socket says 172.21.15.72:54334) 2023-07-25T14:36:02.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.414+0000 7f5b4e609700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f5b480c2570 0x7f5b480c29e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40026/0 (socket says 172.21.15.72:40026) 2023-07-25T14:36:02.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.414+0000 7f5b4e609700 1 -- 172.21.15.72:0/836083006 learned_addr learned my addr 172.21.15.72:0/836083006 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:02.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.414+0000 7f5b4de08700 1 --2- 172.21.15.72:0/836083006 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5b48151920 0x7f5b48158220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:02.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.414+0000 7ff446125700 1 -- 172.21.15.72:0/1726719116 shutdown_connections 2023-07-25T14:36:02.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.414+0000 7ff446125700 1 --2- 172.21.15.72:0/1726719116 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff4401546f0 0x7ff44015ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:02.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.414+0000 7ff446125700 1 --2- 172.21.15.72:0/1726719116 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff44014db20 0x7ff4400bad70 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:02.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.414+0000 7ff446125700 1 -- 172.21.15.72:0/1726719116 >> 172.21.15.72:0/1726719116 conn(0x7ff4400a7860 msgr2=0x7ff4400a7c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:02.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.413+0000 7f4eed271700 1 --2- 172.21.15.72:0/4049862893 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4ed4004850 0x7f4ed4004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:02.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.413+0000 7f4eee273700 1 -- 172.21.15.72:0/4049862893 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4ed4003a50 msgr2=0x7f4ed4003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:02.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.413+0000 7f4eee273700 1 --2- 172.21.15.72:0/4049862893 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4ed4003a50 0x7f4ed4003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:02.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.413+0000 7f4eee273700 1 -- 172.21.15.72:0/4049862893 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4ed4004850 msgr2=0x7f4ed4004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:02.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.413+0000 7f4eee273700 1 --2- 172.21.15.72:0/4049862893 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4ed4004850 0x7f4ed4004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:02.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.413+0000 7f4eee273700 1 -- 172.21.15.72:0/4049862893 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ed40035b0 con 0x7f4ed4005330 2023-07-25T14:36:02.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.413+0000 7f4eee273700 1 -- 172.21.15.72:0/4049862893 reap_dead start 2023-07-25T14:36:02.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.413+0000 7f4eed271700 1 --2- 172.21.15.72:0/4049862893 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4ed4004850 0x7f4ed4004cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-25T14:36:02.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.414+0000 7f4eee273700 1 --2- 172.21.15.72:0/4049862893 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4ed4005330 0x7f4ed400ba10 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f4ee0009f90 tx=0x7f4ed4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c497b710f68bf80f server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:02.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.414+0000 7f5b4e609700 1 -- 172.21.15.72:0/836083006 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5b48151920 msgr2=0x7f5b48158220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:02.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.414+0000 7f5b4e609700 1 --2- 172.21.15.72:0/836083006 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5b48151920 0x7f5b48158220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:02.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.414+0000 7f5b4e609700 1 -- 172.21.15.72:0/836083006 >> v1:172.21.15.92:6789/0 conn(0x7f5b480c5d70 legacy=0x7f5b480c6610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:02.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.414+0000 7f5b4ce06700 1 -- 172.21.15.72:0/836083006 <== mon.1 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1834406843 0 0) 0x7f5b480c4620 con 0x7f5b480c5d70 2023-07-25T14:36:02.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.414+0000 7f5b4e609700 1 -- 172.21.15.72:0/836083006 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b48151d00 con 0x7f5b480c2570 2023-07-25T14:36:02.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.414+0000 7f95d10a3700 1 Processor -- start 2023-07-25T14:36:02.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.415+0000 7f5b4e609700 1 --2- 172.21.15.72:0/836083006 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5b480c2570 0x7f5b480c29e0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f5b380098f0 tx=0x7f5b38009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8b4b07dfa8edcc9 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:02.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.415+0000 7f95d10a3700 1 -- start start 2023-07-25T14:36:02.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.416+0000 7f95d10a3700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f95cc1504f0 0x7f95cc153fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:02.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.415+0000 7f4eeca70700 1 -- 172.21.15.72:0/4049862893 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ee0003a20 con 0x7f4ed4005330 2023-07-25T14:36:02.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.415+0000 7f4eeca70700 1 -- 172.21.15.72:0/4049862893 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ee000f040 con 0x7f4ed4005330 2023-07-25T14:36:02.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.415+0000 7f4eeca70700 1 -- 172.21.15.72:0/4049862893 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ee0003dc0 con 0x7f4ed4005330 2023-07-25T14:36:02.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.416+0000 7f4eefcd6700 1 -- 172.21.15.72:0/4049862893 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4ed4005330 msgr2=0x7f4ed400ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:02.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.416+0000 7f4eefcd6700 1 --2- 172.21.15.72:0/4049862893 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4ed4005330 0x7f4ed400ba10 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f4ee0009f90 tx=0x7f4ed4005880 comp rx=0 tx=0).stop 2023-07-25T14:36:02.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.415+0000 7ff446125700 1 -- 172.21.15.72:0/1726719116 shutdown_connections 2023-07-25T14:36:02.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.414+0000 7fbb02f62700 1 -- 172.21.15.72:0/4116876432 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbafc1504f0 msgr2=0x7fbafc153fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:02.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.414+0000 7fbb02f62700 1 --2- 172.21.15.72:0/4116876432 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbafc1504f0 0x7fbafc153fe0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fbafc06e620 tx=0x7fbaec0073a0 comp rx=0 tx=0).stop 2023-07-25T14:36:02.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.414+0000 7fbb02f62700 1 -- 172.21.15.72:0/4116876432 shutdown_connections 2023-07-25T14:36:02.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.414+0000 7fbb02f62700 1 --2- 172.21.15.72:0/4116876432 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fbafc0bb2b0 0x7fbafc154520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:02.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.414+0000 7fbb02f62700 1 --2- 172.21.15.72:0/4116876432 >> v2:172.21.15.92:3300/0 conn(0x7fbafc14db20 0x7fbafc0bad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:02.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.415+0000 7fbb02f62700 1 --2- 172.21.15.72:0/4116876432 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbafc1504f0 0x7fbafc153fe0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:02.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.415+0000 7fbb02f62700 1 -- 172.21.15.72:0/4116876432 >> 172.21.15.72:0/4116876432 conn(0x7fbafc0a7860 msgr2=0x7fbafc0a7c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:02.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.414+0000 7f544e494700 1 -- start start 2023-07-25T14:36:02.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.415+0000 7f544e494700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f54481504f0 0x7f5448153fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:02.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.415+0000 7f544e494700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f54480c21a0 0x7f5448154520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:02.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.415+0000 7f544e494700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5448153b00 con 0x7f544814db20 2023-07-25T14:36:02.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.415+0000 7f544e494700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54480c0aa0 con 0x7f54481504f0 2023-07-25T14:36:02.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.415+0000 7f544e494700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54480c0d80 con 0x7f54480c21a0 2023-07-25T14:36:02.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.415+0000 7f544ca31700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f54480c21a0 0x7f5448154520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:02.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.415+0000 7f544ca31700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f54480c21a0 0x7f5448154520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3301/0 says I am v2:172.21.15.72:45258/0 (socket says 172.21.15.72:45258) 2023-07-25T14:36:02.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.415+0000 7f5447fff700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f544814db20 0x7f54480bad70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.72:54338/0 (socket says 172.21.15.72:54338) 2023-07-25T14:36:02.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.415+0000 7f544ca31700 1 -- 172.21.15.72:0/3320155349 learned_addr learned my addr 172.21.15.72:0/3320155349 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:02.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.416+0000 7f544ca31700 1 -- 172.21.15.72:0/3320155349 >> v2:172.21.15.72:3300/0 conn(0x7f54481504f0 msgr2=0x7f5448153fe0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-25T14:36:02.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.416+0000 7f544ca31700 1 --2- 172.21.15.72:0/3320155349 >> v2:172.21.15.72:3300/0 conn(0x7f54481504f0 0x7f5448153fe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:02.450 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.416+0000 7f544ca31700 1 -- 172.21.15.72:0/3320155349 >> v1:172.21.15.92:6789/0 conn(0x7f544814db20 legacy=0x7f54480bad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:02.450 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.416+0000 7f544ca31700 1 -- 172.21.15.72:0/3320155349 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54480c1060 con 0x7f54480c21a0 2023-07-25T14:36:02.450 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.416+0000 7f544ca31700 1 --2- 172.21.15.72:0/3320155349 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f54480c21a0 0x7f5448154520 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f54380098f0 tx=0x7f5438009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4486d5134e039d61 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:02.450 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.416+0000 7f5446ffd700 1 -- 172.21.15.72:0/3320155349 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f543800b8a0 con 0x7f54480c21a0 2023-07-25T14:36:02.450 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.416+0000 7fbb02f62700 1 -- 172.21.15.72:0/4116876432 shutdown_connections 2023-07-25T14:36:02.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.416+0000 7f4eefcd6700 1 -- 172.21.15.72:0/4049862893 shutdown_connections 2023-07-25T14:36:02.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.416+0000 7f4eefcd6700 1 --2- 172.21.15.72:0/4049862893 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4ed4005330 0x7f4ed400ba10 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:02.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.416+0000 7f4eefcd6700 1 -- 172.21.15.72:0/4049862893 >> 172.21.15.72:0/4049862893 conn(0x7f4ee80a7860 msgr2=0x7f4ee80a7c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:02.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.416+0000 7f95d10a3700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95cc153b00 con 0x7f95cc14db20 2023-07-25T14:36:02.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.416+0000 7f95d10a3700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95cc0c0aa0 con 0x7f95cc0c17b0 2023-07-25T14:36:02.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.416+0000 7f95d10a3700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95cc0c0d80 con 0x7f95cc1504f0 2023-07-25T14:36:02.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.416+0000 7f95cad9d700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f95cc14db20 0x7f95cc0bad70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:59000/0 (socket says 172.21.15.72:59000) 2023-07-25T14:36:02.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.416+0000 7f95cad9d700 1 -- 172.21.15.72:0/2741262051 learned_addr learned my addr 172.21.15.72:0/2741262051 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:36:02.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.415+0000 7ff446125700 1 -- 172.21.15.72:0/1726719116 wait complete. 2023-07-25T14:36:02.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.416+0000 7ff446125700 1 Processor -- start 2023-07-25T14:36:02.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.417+0000 7ff446125700 1 -- start start 2023-07-25T14:36:02.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.416+0000 7f5b4ce06700 1 -- 172.21.15.72:0/836083006 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b38011830 con 0x7f5b480c2570 2023-07-25T14:36:02.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.416+0000 7f5b4ce06700 1 -- 172.21.15.72:0/836083006 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b38011990 con 0x7f5b480c2570 2023-07-25T14:36:02.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.417+0000 7f5b4ce06700 1 -- 172.21.15.72:0/836083006 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b38011d20 con 0x7f5b480c2570 2023-07-25T14:36:02.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.417+0000 7f5b5006c700 1 -- 172.21.15.72:0/836083006 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5b480c2570 msgr2=0x7f5b480c29e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:02.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.417+0000 7f5b5006c700 1 --2- 172.21.15.72:0/836083006 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5b480c2570 0x7f5b480c29e0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f5b380098f0 tx=0x7f5b38009c00 comp rx=0 tx=0).stop 2023-07-25T14:36:02.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.417+0000 7f5b5006c700 1 -- 172.21.15.72:0/836083006 shutdown_connections 2023-07-25T14:36:02.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.418+0000 7f5b5006c700 1 --2- 172.21.15.72:0/836083006 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5b480c2570 0x7f5b480c29e0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:02.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.418+0000 7f5b5006c700 1 --2- 172.21.15.72:0/836083006 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5b48151920 0x7f5b48158220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:02.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.418+0000 7f5b5006c700 1 -- 172.21.15.72:0/836083006 >> 172.21.15.72:0/836083006 conn(0x7f5b4806cdb0 msgr2=0x7f5b480718c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:02.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.416+0000 7f5446ffd700 1 -- 172.21.15.72:0/3320155349 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f543800ba00 con 0x7f54480c21a0 2023-07-25T14:36:02.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.416+0000 7f5446ffd700 1 -- 172.21.15.72:0/3320155349 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f543800bd90 con 0x7f54480c21a0 2023-07-25T14:36:02.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.417+0000 7f544e494700 1 -- 172.21.15.72:0/3320155349 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f54480c21a0 msgr2=0x7f5448154520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:02.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.417+0000 7f544e494700 1 --2- 172.21.15.72:0/3320155349 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f54480c21a0 0x7f5448154520 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f54380098f0 tx=0x7f5438009c00 comp rx=0 tx=0).stop 2023-07-25T14:36:02.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.418+0000 7f544e494700 1 -- 172.21.15.72:0/3320155349 shutdown_connections 2023-07-25T14:36:02.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.418+0000 7f544e494700 1 --2- 172.21.15.72:0/3320155349 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f54480c21a0 0x7f5448154520 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:02.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.418+0000 7f544e494700 1 --2- 172.21.15.72:0/3320155349 >> v2:172.21.15.72:3300/0 conn(0x7f54481504f0 0x7f5448153fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:02.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.418+0000 7f544e494700 1 -- 172.21.15.72:0/3320155349 >> 172.21.15.72:0/3320155349 conn(0x7f54480a7860 msgr2=0x7f54480a7c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:02.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.418+0000 7ff446125700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff44014db20 0x7ff4401e9790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:02.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.418+0000 7ff446125700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff4401504f0 0x7ff44014b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:02.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.418+0000 7ff446125700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff4401546f0 0x7ff4400aab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:02.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.418+0000 7ff446125700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4400bd290 con 0x7ff4401546f0 2023-07-25T14:36:02.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.418+0000 7ff446125700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4400a6f80 con 0x7ff44014db20 2023-07-25T14:36:02.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.418+0000 7ff446125700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4401e9cd0 con 0x7ff4401504f0 2023-07-25T14:36:02.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.418+0000 7f95ca59c700 1 --2- 172.21.15.72:0/2741262051 >> v2:172.21.15.92:3300/0 conn(0x7f95cc1504f0 0x7f95cc153fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:02.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.418+0000 7f95c9d9b700 1 -- 172.21.15.72:0/2741262051 <== mon.1 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3370987406 0 0) 0x7f95cc0c0aa0 con 0x7f95cc0c17b0 2023-07-25T14:36:02.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.418+0000 7f95c9d9b700 1 -- 172.21.15.72:0/2741262051 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f95b40035b0 con 0x7f95cc0c17b0 2023-07-25T14:36:02.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.418+0000 7f95c9d9b700 1 -- 172.21.15.72:0/2741262051 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1398229912 0 0) 0x7f95cc153b00 con 0x7f95cc14db20 2023-07-25T14:36:02.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.418+0000 7f95c9d9b700 1 -- 172.21.15.72:0/2741262051 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f95cc0c0aa0 con 0x7f95cc14db20 2023-07-25T14:36:02.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.418+0000 7ff43effd700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff4401504f0 0x7ff44014b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:02.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.418+0000 7ff43effd700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff4401504f0 0x7ff44014b360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3301/0 says I am v2:172.21.15.72:45266/0 (socket says 172.21.15.72:45266) 2023-07-25T14:36:02.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.418+0000 7ff43effd700 1 -- 172.21.15.72:0/1398920508 learned_addr learned my addr 172.21.15.72:0/1398920508 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:02.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.418+0000 7ff43ffff700 1 --2- 172.21.15.72:0/1398920508 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff4401546f0 0x7ff4400aab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:02.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.416+0000 7fbb02f62700 1 -- 172.21.15.72:0/4116876432 wait complete. 2023-07-25T14:36:02.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.418+0000 7fbb02f62700 1 Processor -- start 2023-07-25T14:36:02.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.418+0000 7ff43f7fe700 1 --2- 172.21.15.72:0/1398920508 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff44014db20 0x7ff4401e9790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:02.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.418+0000 7f4eefcd6700 1 -- 172.21.15.72:0/4049862893 shutdown_connections 2023-07-25T14:36:02.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.418+0000 7f4eefcd6700 1 -- 172.21.15.72:0/4049862893 wait complete. 2023-07-25T14:36:02.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.418+0000 7f95c9d9b700 1 -- 172.21.15.72:0/2741262051 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1284216547 0 0) 0x7f95cc0c0aa0 con 0x7f95cc14db20 2023-07-25T14:36:02.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.418+0000 7f95ca59c700 1 -- 172.21.15.72:0/2741262051 >> v1:172.21.15.92:6789/0 conn(0x7f95cc0c17b0 legacy=0x7f95cc15ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:02.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.418+0000 7f95ca59c700 1 -- 172.21.15.72:0/2741262051 >> v1:172.21.15.72:6789/0 conn(0x7f95cc14db20 legacy=0x7f95cc0bad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:02.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.418+0000 7f95ca59c700 1 -- 172.21.15.72:0/2741262051 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95cc0c1060 con 0x7f95cc1504f0 2023-07-25T14:36:02.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.418+0000 7f95ca59c700 1 --2- 172.21.15.72:0/2741262051 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f95cc1504f0 0x7f95cc153fe0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f95c00097c0 tx=0x7f95c0009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2669e1dc492f884b server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:02.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.419+0000 7f95c9d9b700 1 -- 172.21.15.72:0/2741262051 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95c40019f0 con 0x7f95cc1504f0 2023-07-25T14:36:02.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.419+0000 7f95c9d9b700 1 -- 172.21.15.72:0/2741262051 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95c0004030 con 0x7f95cc1504f0 2023-07-25T14:36:02.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.419+0000 7f95c9d9b700 1 -- 172.21.15.72:0/2741262051 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95bc001520 con 0x7f95cc1504f0 2023-07-25T14:36:02.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.420+0000 7f95d10a3700 1 -- 172.21.15.72:0/2741262051 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f95cc1504f0 msgr2=0x7f95cc153fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:02.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.420+0000 7f95d10a3700 1 --2- 172.21.15.72:0/2741262051 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f95cc1504f0 0x7f95cc153fe0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f95c00097c0 tx=0x7f95c0009b50 comp rx=0 tx=0).stop 2023-07-25T14:36:02.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.420+0000 7f95d10a3700 1 -- 172.21.15.72:0/2741262051 shutdown_connections 2023-07-25T14:36:02.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.420+0000 7f95d10a3700 1 --2- 172.21.15.72:0/2741262051 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f95cc1504f0 0x7f95cc153fe0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:02.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.420+0000 7f95d10a3700 1 -- 172.21.15.72:0/2741262051 >> 172.21.15.72:0/2741262051 conn(0x7f95cc0a7860 msgr2=0x7f95cc0a7c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:02.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.420+0000 7f95d10a3700 1 -- 172.21.15.72:0/2741262051 shutdown_connections 2023-07-25T14:36:02.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.420+0000 7f95d10a3700 1 -- 172.21.15.72:0/2741262051 wait complete. 2023-07-25T14:36:02.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.418+0000 7fbb02f62700 1 -- start start 2023-07-25T14:36:02.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.420+0000 7fbb02f62700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbafc0bb2b0 0x7fbafc149a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:02.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.420+0000 7fbb02f62700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fbafc14db20 0x7fbafc14ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:02.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.420+0000 7fbb02f62700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbafc1504f0 0x7fbafc14f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:02.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.420+0000 7fbb02f62700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbafc151a60 con 0x7fbafc1504f0 2023-07-25T14:36:02.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.420+0000 7fbb02f62700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbafc1ee550 con 0x7fbafc0bb2b0 2023-07-25T14:36:02.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.420+0000 7fbb02f62700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbafc152d70 con 0x7fbafc14db20 2023-07-25T14:36:02.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.420+0000 7fbafbfff700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fbafc14db20 0x7fbafc14ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:02.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.420+0000 7fbb014ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbafc1504f0 0x7fbafc14f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:02.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.420+0000 7fbb014ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbafc1504f0 0x7fbafc14f110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40048/0 (socket says 172.21.15.72:40048) 2023-07-25T14:36:02.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.420+0000 7fbb014ff700 1 -- 172.21.15.72:0/971520691 learned_addr learned my addr 172.21.15.72:0/971520691 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:02.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.420+0000 7fbafbfff700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fbafc14db20 0x7fbafc14ebd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3301/0 says I am v2:172.21.15.72:45274/0 (socket says 172.21.15.72:45274) 2023-07-25T14:36:02.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.420+0000 7f5b5006c700 1 -- 172.21.15.72:0/836083006 shutdown_connections 2023-07-25T14:36:02.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.420+0000 7fbb00cfe700 1 --2- 172.21.15.72:0/971520691 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbafc0bb2b0 0x7fbafc149a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:02.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.420+0000 7fbb014ff700 1 -- 172.21.15.72:0/971520691 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fbafc14db20 msgr2=0x7fbafc14ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:02.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.420+0000 7fbb014ff700 1 --2- 172.21.15.72:0/971520691 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fbafc14db20 0x7fbafc14ebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:02.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.420+0000 7fbb014ff700 1 -- 172.21.15.72:0/971520691 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbafc0bb2b0 msgr2=0x7fbafc149a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:02.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.420+0000 7f544e494700 1 -- 172.21.15.72:0/3320155349 shutdown_connections 2023-07-25T14:36:02.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.420+0000 7fbb014ff700 1 --2- 172.21.15.72:0/971520691 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbafc0bb2b0 0x7fbafc149a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:02.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.420+0000 7fbb014ff700 1 -- 172.21.15.72:0/971520691 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbaec00d040 con 0x7fbafc1504f0 2023-07-25T14:36:02.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.420+0000 7f4eefcd6700 1 Processor -- start 2023-07-25T14:36:02.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.420+0000 7fbafbfff700 1 --2- 172.21.15.72:0/971520691 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fbafc14db20 0x7fbafc14ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-25T14:36:02.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.420+0000 7f4eefcd6700 1 -- start start 2023-07-25T14:36:02.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.419+0000 7ff43effd700 1 -- 172.21.15.72:0/1398920508 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff44014db20 msgr2=0x7ff4401e9790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:02.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.419+0000 7ff43effd700 1 --2- 172.21.15.72:0/1398920508 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff44014db20 0x7ff4401e9790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:02.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.419+0000 7ff43effd700 1 -- 172.21.15.72:0/1398920508 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff4401546f0 msgr2=0x7ff4400aab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:02.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.419+0000 7ff43effd700 1 --2- 172.21.15.72:0/1398920508 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff4401546f0 0x7ff4400aab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:02.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.419+0000 7ff43effd700 1 -- 172.21.15.72:0/1398920508 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff43000a5f0 con 0x7ff4401504f0 2023-07-25T14:36:02.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.420+0000 7ff43ffff700 1 --2- 172.21.15.72:0/1398920508 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff4401546f0 0x7ff4400aab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-25T14:36:02.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.420+0000 7ff43f7fe700 1 --2- 172.21.15.72:0/1398920508 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff44014db20 0x7ff4401e9790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-25T14:36:02.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.420+0000 7ff43effd700 1 --2- 172.21.15.72:0/1398920508 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff4401504f0 0x7ff44014b360 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7ff43400c4d0 tx=0x7ff43400c890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:02.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.420+0000 7f544e494700 1 -- 172.21.15.72:0/3320155349 wait complete. 2023-07-25T14:36:02.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.421+0000 7fbb014ff700 1 --2- 172.21.15.72:0/971520691 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbafc1504f0 0x7fbafc14f110 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fbae400b4a0 tx=0x7fbae400b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:02.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.421+0000 7fbaf97fa700 1 -- 172.21.15.72:0/971520691 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbae4011830 con 0x7fbafc1504f0 2023-07-25T14:36:02.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.421+0000 7fbaf97fa700 1 -- 172.21.15.72:0/971520691 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbae40119b0 con 0x7fbafc1504f0 2023-07-25T14:36:02.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.421+0000 7fbaf97fa700 1 -- 172.21.15.72:0/971520691 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbae4011d60 con 0x7fbafc1504f0 2023-07-25T14:36:02.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.421+0000 7f4eefcd6700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4ed4005330 0x7f4ee80c47e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:02.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.421+0000 7f4eefcd6700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4ee814c5c0 0x7f4ee814b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:02.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.422+0000 7f4eefcd6700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4ee814beb0 0x7f4ee80bcc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:02.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.422+0000 7f4eefcd6700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ee81f1530 con 0x7f4ee814beb0 2023-07-25T14:36:02.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.422+0000 7f4eefcd6700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ee81f2390 con 0x7f4ee814c5c0 2023-07-25T14:36:02.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.422+0000 7f4eefcd6700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ee81f1780 con 0x7f4ed4005330 2023-07-25T14:36:02.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.422+0000 7f4eeda72700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4ed4005330 0x7f4ee80c47e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:02.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.422+0000 7f4eeda72700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4ed4005330 0x7f4ee80c47e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3301/0 says I am v2:172.21.15.72:45278/0 (socket says 172.21.15.72:45278) 2023-07-25T14:36:02.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.422+0000 7f4eeda72700 1 -- 172.21.15.72:0/3497775522 learned_addr learned my addr 172.21.15.72:0/3497775522 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:02.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.422+0000 7f95d10a3700 1 Processor -- start 2023-07-25T14:36:02.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.422+0000 7fbb02f62700 1 -- 172.21.15.72:0/971520691 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbafc1ee810 con 0x7fbafc1504f0 2023-07-25T14:36:02.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.422+0000 7fbb02f62700 1 -- 172.21.15.72:0/971520691 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbafc1eedd0 con 0x7fbafc1504f0 2023-07-25T14:36:02.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.420+0000 7f5b5006c700 1 -- 172.21.15.72:0/836083006 wait complete. 2023-07-25T14:36:02.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.422+0000 7f5b5006c700 1 Processor -- start 2023-07-25T14:36:02.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.422+0000 7f95d10a3700 1 -- start start 2023-07-25T14:36:02.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.423+0000 7f95d10a3700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f95cc0c17b0 0x7f95cc1441e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:02.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.423+0000 7f95d10a3700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f95cc14db20 0x7f95cc144720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:02.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.423+0000 7f95d10a3700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f95cc1504f0 0x7f95cc145070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:02.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.423+0000 7f95d10a3700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95cc152d80 con 0x7f95cc14db20 2023-07-25T14:36:02.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.423+0000 7f95d10a3700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95cc143dc0 con 0x7f95cc1504f0 2023-07-25T14:36:02.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.423+0000 7f95d10a3700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95cc152770 con 0x7f95cc0c17b0 2023-07-25T14:36:02.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.423+0000 7f95ca59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f95cc14db20 0x7f95cc144720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:02.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.423+0000 7f95ca59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f95cc14db20 0x7f95cc144720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40058/0 (socket says 172.21.15.72:40058) 2023-07-25T14:36:02.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.423+0000 7f95ca59c700 1 -- 172.21.15.72:0/2003157241 learned_addr learned my addr 172.21.15.72:0/2003157241 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:02.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.422+0000 7f544e494700 1 Processor -- start 2023-07-25T14:36:02.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.422+0000 7f544e494700 1 -- start start 2023-07-25T14:36:02.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.423+0000 7f544e494700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f54480c21a0 0x7f5448151ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:02.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.423+0000 7f544e494700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f544814db20 0x7f54480aa5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:02.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.423+0000 7f544e494700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f54481ea5d0 0x7f54480aab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:02.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.423+0000 7f544e494700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54481eab50 con 0x7f544814db20 2023-07-25T14:36:02.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.423+0000 7f544e494700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54480ab060 con 0x7f54480c21a0 2023-07-25T14:36:02.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.423+0000 7f544e494700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54480a84e0 con 0x7f54481ea5d0 2023-07-25T14:36:02.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.423+0000 7f54477fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f544814db20 0x7f54480aa5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:02.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.423+0000 7f54477fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f544814db20 0x7f54480aa5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40064/0 (socket says 172.21.15.72:40064) 2023-07-25T14:36:02.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.423+0000 7f5447fff700 1 --2- 172.21.15.72:0/1519338987 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f54480c21a0 0x7f5448151ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:02.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.423+0000 7f54477fe700 1 -- 172.21.15.72:0/1519338987 learned_addr learned my addr 172.21.15.72:0/1519338987 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:02.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.422+0000 7f4eee273700 1 --2- 172.21.15.72:0/3497775522 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4ee814beb0 0x7f4ee80bcc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:02.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.422+0000 7f4eed271700 1 --2- 172.21.15.72:0/3497775522 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4ee814c5c0 0x7f4ee814b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:02.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.422+0000 7f4eee273700 1 -- 172.21.15.72:0/3497775522 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4ed4005330 msgr2=0x7f4ee80c47e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:02.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.422+0000 7f4eee273700 1 --2- 172.21.15.72:0/3497775522 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4ed4005330 0x7f4ee80c47e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:02.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.422+0000 7f4eee273700 1 -- 172.21.15.72:0/3497775522 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4ee814c5c0 msgr2=0x7f4ee814b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:02.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.422+0000 7f4eee273700 1 --2- 172.21.15.72:0/3497775522 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4ee814c5c0 0x7f4ee814b970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:02.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.422+0000 7f4eee273700 1 -- 172.21.15.72:0/3497775522 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ee81f1a60 con 0x7f4ee814beb0 2023-07-25T14:36:02.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.423+0000 7f4eee273700 1 --2- 172.21.15.72:0/3497775522 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4ee814beb0 0x7f4ee80bcc60 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f4ee80a5cc0 tx=0x7f4ee0004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:02.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.424+0000 7f4ede7fc700 1 -- 172.21.15.72:0/3497775522 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ee0015a80 con 0x7f4ee814beb0 2023-07-25T14:36:02.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.423+0000 7ff427fff700 1 -- 172.21.15.72:0/1398920508 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff434011790 con 0x7ff4401504f0 2023-07-25T14:36:02.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.423+0000 7ff427fff700 1 -- 172.21.15.72:0/1398920508 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff434011910 con 0x7ff4401504f0 2023-07-25T14:36:02.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.423+0000 7ff427fff700 1 -- 172.21.15.72:0/1398920508 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff434011cc0 con 0x7ff4401504f0 2023-07-25T14:36:02.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.423+0000 7ff446125700 1 -- 172.21.15.72:0/1398920508 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4400c58b0 con 0x7ff4401504f0 2023-07-25T14:36:02.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.423+0000 7ff446125700 1 -- 172.21.15.72:0/1398920508 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4400c5e70 con 0x7ff4401504f0 2023-07-25T14:36:02.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.424+0000 7f95cad9d700 1 --2- 172.21.15.72:0/2003157241 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f95cc0c17b0 0x7f95cc1441e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:02.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.425+0000 7f95cad9d700 1 -- 172.21.15.72:0/2003157241 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f95cc1504f0 msgr2=0x7f95cc145070 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-07-25T14:36:02.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.425+0000 7f95cad9d700 1 --2- 172.21.15.72:0/2003157241 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f95cc1504f0 0x7f95cc145070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:02.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.425+0000 7f95cad9d700 1 -- 172.21.15.72:0/2003157241 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f95cc14db20 msgr2=0x7f95cc144720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:02.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.425+0000 7f95cad9d700 1 --2- 172.21.15.72:0/2003157241 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f95cc14db20 0x7f95cc144720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:02.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.425+0000 7f95cad9d700 1 -- 172.21.15.72:0/2003157241 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95c00094a0 con 0x7f95cc0c17b0 2023-07-25T14:36:02.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.425+0000 7f95cad9d700 1 --2- 172.21.15.72:0/2003157241 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f95cc0c17b0 0x7f95cc1441e0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f95c4001b20 tx=0x7f95c400cf70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:02.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.425+0000 7f95b37fe700 1 -- 172.21.15.72:0/2003157241 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95c400abb0 con 0x7f95cc0c17b0 2023-07-25T14:36:02.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.425+0000 7f95b37fe700 1 -- 172.21.15.72:0/2003157241 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95c400ad10 con 0x7f95cc0c17b0 2023-07-25T14:36:02.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.425+0000 7f95d10a3700 1 -- 172.21.15.72:0/2003157241 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95cc072160 con 0x7f95cc0c17b0 2023-07-25T14:36:02.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.425+0000 7f95d10a3700 1 -- 172.21.15.72:0/2003157241 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95cc152a10 con 0x7f95cc0c17b0 2023-07-25T14:36:02.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.425+0000 7f95b37fe700 1 -- 172.21.15.72:0/2003157241 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95c4007310 con 0x7f95cc0c17b0 2023-07-25T14:36:02.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.424+0000 7f4ede7fc700 1 -- 172.21.15.72:0/3497775522 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ee0015c00 con 0x7f4ee814beb0 2023-07-25T14:36:02.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.424+0000 7f4ede7fc700 1 -- 172.21.15.72:0/3497775522 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ee001d440 con 0x7f4ee814beb0 2023-07-25T14:36:02.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.424+0000 7f4eefcd6700 1 -- 172.21.15.72:0/3497775522 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ee81f1d40 con 0x7f4ee814beb0 2023-07-25T14:36:02.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.424+0000 7f4eefcd6700 1 -- 172.21.15.72:0/3497775522 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ee80c4d20 con 0x7f4ee814beb0 2023-07-25T14:36:02.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.425+0000 7f4eefcd6700 1 -- 172.21.15.72:0/3497775522 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4ed0000fc0 con 0x7f4ee814beb0 2023-07-25T14:36:02.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.425+0000 7ff446125700 1 -- 172.21.15.72:0/1398920508 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff420000fc0 con 0x7ff4401504f0 2023-07-25T14:36:02.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.426+0000 7f5b5006c700 1 -- start start 2023-07-25T14:36:02.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.425+0000 7fbaf97fa700 1 -- 172.21.15.72:0/971520691 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fbae401a400 con 0x7fbafc1504f0 2023-07-25T14:36:02.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.424+0000 7f5447fff700 1 -- 172.21.15.72:0/1519338987 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f54481ea5d0 msgr2=0x7f54480aab20 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-07-25T14:36:02.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.424+0000 7f5447fff700 1 --2- 172.21.15.72:0/1519338987 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f54481ea5d0 0x7f54480aab20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:02.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.424+0000 7f5447fff700 1 -- 172.21.15.72:0/1519338987 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f544814db20 msgr2=0x7f54480aa5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:02.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.424+0000 7f5447fff700 1 --2- 172.21.15.72:0/1519338987 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f544814db20 0x7f54480aa5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:02.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.424+0000 7f5447fff700 1 -- 172.21.15.72:0/1519338987 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5438009550 con 0x7f54480c21a0 2023-07-25T14:36:02.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.425+0000 7f5447fff700 1 --2- 172.21.15.72:0/1519338987 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f54480c21a0 0x7f5448151ad0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f544000caf0 tx=0x7f544000ce00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:02.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.427+0000 7f5b5006c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5b480c2570 0x7f5b48156ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:02.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.426+0000 7fbaf97fa700 1 --2- 172.21.15.72:0/971520691 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fbadc06ad00 0x7fbadc06d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:02.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.426+0000 7fbaf97fa700 1 -- 172.21.15.72:0/971520691 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fbae4089700 con 0x7fbafc1504f0 2023-07-25T14:36:02.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.427+0000 7fbb00cfe700 1 --2- 172.21.15.72:0/971520691 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fbadc06ad00 0x7fbadc06d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:02.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.427+0000 7f5b5006c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5b480c5d70 0x7f5b48157020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:02.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.427+0000 7f5b5006c700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5b48151920 0x7f5b48155640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:02.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.427+0000 7f5b5006c700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b481f78c0 con 0x7f5b480c2570 2023-07-25T14:36:02.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.427+0000 7f5b5006c700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b48149240 con 0x7f5b480c5d70 2023-07-25T14:36:02.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.427+0000 7f5b5006c700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b481488a0 con 0x7f5b48151920 2023-07-25T14:36:02.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.426+0000 7f5444ff9700 1 -- 172.21.15.72:0/1519338987 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f544000aaa0 con 0x7f54480c21a0 2023-07-25T14:36:02.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.426+0000 7f5444ff9700 1 -- 172.21.15.72:0/1519338987 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f544000ac00 con 0x7f54480c21a0 2023-07-25T14:36:02.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.426+0000 7f5444ff9700 1 -- 172.21.15.72:0/1519338987 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5440007070 con 0x7f54480c21a0 2023-07-25T14:36:02.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.426+0000 7f544e494700 1 -- 172.21.15.72:0/1519338987 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54480a8b30 con 0x7f54480c21a0 2023-07-25T14:36:02.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.426+0000 7f544e494700 1 -- 172.21.15.72:0/1519338987 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54480bf500 con 0x7f54480c21a0 2023-07-25T14:36:02.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.428+0000 7f5b4d607700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5b480c5d70 0x7f5b48157020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:02.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.427+0000 7fbb02f62700 1 --2- 172.21.15.72:0/971520691 >> [v2:172.21.15.92:6816/2381008739,v1:172.21.15.92:6817/2381008739] conn(0x7fbafc0c6140 0x7fbafc0ba880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:02.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.427+0000 7fbb02f62700 1 -- 172.21.15.72:0/971520691 --> [v2:172.21.15.92:6816/2381008739,v1:172.21.15.92:6817/2381008739] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbafc14df00 con 0x7fbafc0c6140 2023-07-25T14:36:02.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.427+0000 7fbafbfff700 1 --2- 172.21.15.72:0/971520691 >> [v2:172.21.15.92:6816/2381008739,v1:172.21.15.92:6817/2381008739] conn(0x7fbafc0c6140 0x7fbafc0ba880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:02.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.427+0000 7fbb00cfe700 1 --2- 172.21.15.72:0/971520691 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fbadc06ad00 0x7fbadc06d1c0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fbaf400ba90 tx=0x7fbaf400d040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:02.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.427+0000 7f95b37fe700 1 -- 172.21.15.72:0/2003157241 <== mon.2 v2:172.21.15.92:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f95c4007470 con 0x7f95cc0c17b0 2023-07-25T14:36:02.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.427+0000 7f95d10a3700 1 -- 172.21.15.72:0/2003157241 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f95cc0c1340 con 0x7f95cc0c17b0 2023-07-25T14:36:02.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.428+0000 7f95b37fe700 1 --2- 172.21.15.72:0/2003157241 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f95b806ace0 0x7f95b806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:02.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.427+0000 7f544e494700 1 -- 172.21.15.72:0/1519338987 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5434000ff0 con 0x7f54480c21a0 2023-07-25T14:36:02.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.428+0000 7f95b37fe700 1 -- 172.21.15.72:0/2003157241 <== mon.2 v2:172.21.15.92:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f95c40897e0 con 0x7f95cc0c17b0 2023-07-25T14:36:02.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.428+0000 7f95b37fe700 1 --2- 172.21.15.72:0/2003157241 >> [v2:172.21.15.72:6800/2475407414,v1:172.21.15.72:6801/2475407414] conn(0x7f95b8074940 0x7f95b8076d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:02.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.428+0000 7f95b37fe700 1 -- 172.21.15.72:0/2003157241 --> [v2:172.21.15.72:6800/2475407414,v1:172.21.15.72:6801/2475407414] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f95b8077450 con 0x7f95b8074940 2023-07-25T14:36:02.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.428+0000 7f95b37fe700 1 -- 172.21.15.72:0/2003157241 <== mon.2 v2:172.21.15.92:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f95c4054590 con 0x7f95cc0c17b0 2023-07-25T14:36:02.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.428+0000 7f95ca59c700 1 --2- 172.21.15.72:0/2003157241 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f95b806ace0 0x7f95b806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:02.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.428+0000 7fbafbfff700 1 --2- 172.21.15.72:0/971520691 >> [v2:172.21.15.92:6816/2381008739,v1:172.21.15.92:6817/2381008739] conn(0x7fbafc0c6140 0x7fbafc0ba880 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:02.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.428+0000 7f95cb59e700 1 --2- 172.21.15.72:0/2003157241 >> [v2:172.21.15.72:6800/2475407414,v1:172.21.15.72:6801/2475407414] conn(0x7f95b8074940 0x7f95b8076d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:02.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.428+0000 7f5b4d607700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5b480c5d70 0x7f5b48157020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.72:35644/0 (socket says 172.21.15.72:35644) 2023-07-25T14:36:02.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.428+0000 7f5b4d607700 1 -- 172.21.15.72:0/3380930996 learned_addr learned my addr 172.21.15.72:0/3380930996 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:02.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.428+0000 7f5b4e609700 1 --2- 172.21.15.72:0/3380930996 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5b48151920 0x7f5b48155640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:02.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.428+0000 7f5b4de08700 1 --2- 172.21.15.72:0/3380930996 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5b480c2570 0x7f5b48156ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:02.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.428+0000 7f5b4de08700 1 -- 172.21.15.72:0/3380930996 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5b48151920 msgr2=0x7f5b48155640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:02.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.428+0000 7f5b4de08700 1 --2- 172.21.15.72:0/3380930996 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5b48151920 0x7f5b48155640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:02.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.428+0000 7f5b4de08700 1 -- 172.21.15.72:0/3380930996 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5b480c5d70 msgr2=0x7f5b48157020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:02.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.428+0000 7f5b4de08700 1 --2- 172.21.15.72:0/3380930996 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5b480c5d70 0x7f5b48157020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:02.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.428+0000 7f5b4de08700 1 -- 172.21.15.72:0/3380930996 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b38009550 con 0x7f5b480c2570 2023-07-25T14:36:02.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.428+0000 7f5b4e609700 1 --2- 172.21.15.72:0/3380930996 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5b48151920 0x7f5b48155640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-25T14:36:02.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.428+0000 7f4ede7fc700 1 -- 172.21.15.72:0/3497775522 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4ee001d5a0 con 0x7f4ee814beb0 2023-07-25T14:36:02.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.428+0000 7f4ede7fc700 1 --2- 172.21.15.72:0/3497775522 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f4ecc06ad60 0x7f4ecc06d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:02.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.428+0000 7f4ede7fc700 1 -- 172.21.15.72:0/3497775522 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f4ee008b3c0 con 0x7f4ee814beb0 2023-07-25T14:36:02.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.429+0000 7f4ede7fc700 1 --2- 172.21.15.72:0/3497775522 >> [v2:172.21.15.72:6820/870954016,v1:172.21.15.72:6822/870954016] conn(0x7f4ecc074a40 0x7f4ecc076e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:02.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.429+0000 7f4ede7fc700 1 -- 172.21.15.72:0/3497775522 --> [v2:172.21.15.72:6820/870954016,v1:172.21.15.72:6822/870954016] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4ecc077550 con 0x7f4ecc074a40 2023-07-25T14:36:02.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.429+0000 7f4ede7fc700 1 -- 172.21.15.72:0/3497775522 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4ee008b860 con 0x7f4ee814beb0 2023-07-25T14:36:02.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.426+0000 7ff427fff700 1 -- 172.21.15.72:0/1398920508 <== mon.2 v2:172.21.15.92:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff43401c460 con 0x7ff4401504f0 2023-07-25T14:36:02.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.427+0000 7ff427fff700 1 --2- 172.21.15.72:0/1398920508 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7ff42c06adb0 0x7ff42c06d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:02.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.427+0000 7ff427fff700 1 -- 172.21.15.72:0/1398920508 <== mon.2 v2:172.21.15.92:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7ff4340895c0 con 0x7ff4401504f0 2023-07-25T14:36:02.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.427+0000 7ff427fff700 1 --2- 172.21.15.72:0/1398920508 >> [v2:172.21.15.72:6808/2143129442,v1:172.21.15.72:6809/2143129442] conn(0x7ff42c074a10 0x7ff42c076e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:02.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.427+0000 7ff427fff700 1 -- 172.21.15.72:0/1398920508 --> [v2:172.21.15.72:6808/2143129442,v1:172.21.15.72:6809/2143129442] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff42c077520 con 0x7ff42c074a10 2023-07-25T14:36:02.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.429+0000 7ff43f7fe700 1 --2- 172.21.15.72:0/1398920508 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7ff42c06adb0 0x7ff42c06d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:02.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.429+0000 7ff43ffff700 1 --2- 172.21.15.72:0/1398920508 >> [v2:172.21.15.72:6808/2143129442,v1:172.21.15.72:6809/2143129442] conn(0x7ff42c074a10 0x7ff42c076e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:02.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.429+0000 7f5b4de08700 1 --2- 172.21.15.72:0/3380930996 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5b480c2570 0x7f5b48156ae0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f5b4400e870 tx=0x7f5b4400eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:02.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.429+0000 7fbaf97fa700 1 -- 172.21.15.72:0/971520691 <== osd.4 v2:172.21.15.92:6816/2381008739 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fbaec0041c0 con 0x7fbafc0c6140 2023-07-25T14:36:02.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.429+0000 7ff43ffff700 1 --2- 172.21.15.72:0/1398920508 >> [v2:172.21.15.72:6808/2143129442,v1:172.21.15.72:6809/2143129442] conn(0x7ff42c074a10 0x7ff42c076e50 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:02.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.429+0000 7f95cb59e700 1 --2- 172.21.15.72:0/2003157241 >> [v2:172.21.15.72:6800/2475407414,v1:172.21.15.72:6801/2475407414] conn(0x7f95b8074940 0x7f95b8076d80 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:02.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.429+0000 7ff427fff700 1 -- 172.21.15.72:0/1398920508 <== mon.2 v2:172.21.15.92:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff434054360 con 0x7ff4401504f0 2023-07-25T14:36:02.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.430+0000 7f4eed271700 1 --2- 172.21.15.72:0/3497775522 >> [v2:172.21.15.72:6820/870954016,v1:172.21.15.72:6822/870954016] conn(0x7f4ecc074a40 0x7f4ecc076e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:02.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.430+0000 7f5b3e7fc700 1 -- 172.21.15.72:0/3380930996 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b44013680 con 0x7f5b480c2570 2023-07-25T14:36:02.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.430+0000 7f5b3e7fc700 1 -- 172.21.15.72:0/3380930996 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b440137e0 con 0x7f5b480c2570 2023-07-25T14:36:02.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.430+0000 7f5b3e7fc700 1 -- 172.21.15.72:0/3380930996 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b44013b70 con 0x7f5b480c2570 2023-07-25T14:36:02.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.430+0000 7f95ca59c700 1 --2- 172.21.15.72:0/2003157241 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f95b806ace0 0x7f95b806d1a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f95c0000c00 tx=0x7f95c0008000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:02.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.430+0000 7f95b37fe700 1 -- 172.21.15.72:0/2003157241 <== osd.0 v2:172.21.15.72:6800/2475407414 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f95b8077450 con 0x7f95b8074940 2023-07-25T14:36:02.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.430+0000 7f4eeda72700 1 --2- 172.21.15.72:0/3497775522 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f4ecc06ad60 0x7f4ecc06d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:02.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.430+0000 7f4eed271700 1 --2- 172.21.15.72:0/3497775522 >> [v2:172.21.15.72:6820/870954016,v1:172.21.15.72:6822/870954016] conn(0x7f4ecc074a40 0x7f4ecc076e80 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:02.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.430+0000 7f5b5006c700 1 -- 172.21.15.72:0/3380930996 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b48148b80 con 0x7f5b480c2570 2023-07-25T14:36:02.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.431+0000 7f5b5006c700 1 -- 172.21.15.72:0/3380930996 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b48149640 con 0x7f5b480c2570 2023-07-25T14:36:02.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.430+0000 7ff43f7fe700 1 --2- 172.21.15.72:0/1398920508 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7ff42c06adb0 0x7ff42c06d270 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ff430009560 tx=0x7ff43001a000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:02.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.431+0000 7ff427fff700 1 -- 172.21.15.72:0/1398920508 <== osd.2 v2:172.21.15.72:6808/2143129442 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7ff42c077520 con 0x7ff42c074a10 2023-07-25T14:36:02.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.431+0000 7f59e0198700 1 Processor -- start 2023-07-25T14:36:02.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.431+0000 7f4ede7fc700 1 -- 172.21.15.72:0/3497775522 <== osd.1 v2:172.21.15.72:6820/870954016 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f4ecc077550 con 0x7f4ecc074a40 2023-07-25T14:36:02.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.431+0000 7f4eeda72700 1 --2- 172.21.15.72:0/3497775522 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f4ecc06ad60 0x7f4ecc06d220 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f4ee4001eb0 tx=0x7f4ee4001a00 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:02.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.431+0000 7f5b5006c700 1 -- 172.21.15.72:0/3380930996 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5b480c4b70 con 0x7f5b480c2570 2023-07-25T14:36:02.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.433+0000 7f5b3e7fc700 1 -- 172.21.15.72:0/3380930996 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5b44013cd0 con 0x7f5b480c2570 2023-07-25T14:36:02.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.433+0000 7fd80df96700 1 Processor -- start 2023-07-25T14:36:02.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.431+0000 7f59e0198700 1 -- start start 2023-07-25T14:36:02.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.432+0000 7f59e0198700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f59d8155d30 0x7f59d8070e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:02.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.432+0000 7f59e0198700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f59d80af820 0x7f59d8071360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:02.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.433+0000 7f59e0198700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59d8159290 con 0x7f59d80c5e00 2023-07-25T14:36:02.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.433+0000 7f59e0198700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59d8156110 con 0x7f59d8155d30 2023-07-25T14:36:02.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.433+0000 7f59e0198700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59d81586a0 con 0x7f59d80af820 2023-07-25T14:36:02.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.433+0000 7f59dd733700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f59d80c5e00 0x7f59d80c4580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:59060/0 (socket says 172.21.15.72:59060) 2023-07-25T14:36:02.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.433+0000 7f59dd733700 1 -- 172.21.15.72:0/2194919793 learned_addr learned my addr 172.21.15.72:0/2194919793 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:36:02.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.433+0000 7f59ddf34700 1 --2- 172.21.15.72:0/2194919793 >> v2:172.21.15.72:3300/0 conn(0x7f59d8155d30 0x7f59d8070e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:02.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.433+0000 7f59dcf32700 1 -- 172.21.15.72:0/2194919793 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4266934613 0 0) 0x7f59d8159290 con 0x7f59d80c5e00 2023-07-25T14:36:02.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.433+0000 7f59dcf32700 1 -- 172.21.15.72:0/2194919793 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f59c40035b0 con 0x7f59d80c5e00 2023-07-25T14:36:02.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.433+0000 7f59ddf34700 1 -- 172.21.15.72:0/2194919793 >> v2:172.21.15.92:3300/0 conn(0x7f59d80af820 msgr2=0x7f59d8071360 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-25T14:36:02.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.433+0000 7f59ddf34700 1 --2- 172.21.15.72:0/2194919793 >> v2:172.21.15.92:3300/0 conn(0x7f59d80af820 0x7f59d8071360 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:02.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.433+0000 7f59ddf34700 1 -- 172.21.15.72:0/2194919793 >> v1:172.21.15.72:6789/0 conn(0x7f59d80c5e00 legacy=0x7f59d80c4580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:02.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.433+0000 7f59ddf34700 1 -- 172.21.15.72:0/2194919793 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59d8158960 con 0x7f59d8155d30 2023-07-25T14:36:02.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.434+0000 7f59ddf34700 1 --2- 172.21.15.72:0/2194919793 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f59d8155d30 0x7f59d8070e20 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f59d806d910 tx=0x7f59d4009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3e0598c6caf5ca server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:02.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.434+0000 7f59dcf32700 1 -- 172.21.15.72:0/2194919793 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59d4011830 con 0x7f59d8155d30 2023-07-25T14:36:02.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.434+0000 7f59dcf32700 1 -- 172.21.15.72:0/2194919793 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59d4011990 con 0x7f59d8155d30 2023-07-25T14:36:02.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.434+0000 7f59dcf32700 1 -- 172.21.15.72:0/2194919793 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59d4011d00 con 0x7f59d8155d30 2023-07-25T14:36:02.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.433+0000 7f5b3e7fc700 1 --2- 172.21.15.72:0/3380930996 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f5b2c06ad30 0x7f5b2c06d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:02.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.434+0000 7f5b3e7fc700 1 -- 172.21.15.72:0/3380930996 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f5b440894b0 con 0x7f5b480c2570 2023-07-25T14:36:02.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.434+0000 7f5b3e7fc700 1 --2- 172.21.15.72:0/3380930996 >> [v2:172.21.15.72:6816/3404066311,v1:172.21.15.72:6817/3404066311] conn(0x7f5b2c074a10 0x7f5b2c076e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:02.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.434+0000 7f5b3e7fc700 1 -- 172.21.15.72:0/3380930996 --> [v2:172.21.15.72:6816/3404066311,v1:172.21.15.72:6817/3404066311] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5b2c077520 con 0x7f5b2c074a10 2023-07-25T14:36:02.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.434+0000 7f5b3e7fc700 1 -- 172.21.15.72:0/3380930996 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5b4408bb60 con 0x7f5b480c2570 2023-07-25T14:36:02.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.434+0000 7f5b4d607700 1 --2- 172.21.15.72:0/3380930996 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f5b2c06ad30 0x7f5b2c06d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:02.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.434+0000 7f5b4d607700 1 --2- 172.21.15.72:0/3380930996 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f5b2c06ad30 0x7f5b2c06d1f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f5b40002230 tx=0x7f5b40001db0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:02.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.433+0000 7fd80df96700 1 -- start start 2023-07-25T14:36:02.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.434+0000 7fd80df96700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd8080a5ec0 0x7fd808158970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:02.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.434+0000 7fd80df96700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd8080c2d90 0x7fd8080c3200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:02.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.434+0000 7fd80df96700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8080c2640 con 0x7fd8080b9bb0 2023-07-25T14:36:02.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.434+0000 7fd80df96700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8080c1560 con 0x7fd8080c2d90 2023-07-25T14:36:02.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.434+0000 7fd80df96700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd80806ff10 con 0x7fd8080a5ec0 2023-07-25T14:36:02.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.435+0000 7fd807fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd8080c2d90 0x7fd8080c3200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:02.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.435+0000 7fd807fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd8080c2d90 0x7fd8080c3200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40102/0 (socket says 172.21.15.72:40102) 2023-07-25T14:36:02.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.435+0000 7fd807fff700 1 -- 172.21.15.72:0/2900233204 learned_addr learned my addr 172.21.15.72:0/2900233204 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:02.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.435+0000 7fd806ffd700 1 --2- 172.21.15.72:0/2900233204 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd8080a5ec0 0x7fd808158970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:02.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.435+0000 7fd807fff700 1 -- 172.21.15.72:0/2900233204 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd8080a5ec0 msgr2=0x7fd808158970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:02.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.435+0000 7fd807fff700 1 --2- 172.21.15.72:0/2900233204 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd8080a5ec0 0x7fd808158970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:02.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.435+0000 7fd807fff700 1 -- 172.21.15.72:0/2900233204 >> v1:172.21.15.92:6789/0 conn(0x7fd8080b9bb0 legacy=0x7fd808155b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:02.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.435+0000 7fd807fff700 1 -- 172.21.15.72:0/2900233204 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd808158eb0 con 0x7fd8080c2d90 2023-07-25T14:36:02.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.435+0000 7f59e0198700 1 -- 172.21.15.72:0/2194919793 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f59d8155d30 msgr2=0x7f59d8070e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:02.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.435+0000 7f59e0198700 1 --2- 172.21.15.72:0/2194919793 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f59d8155d30 0x7f59d8070e20 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f59d806d910 tx=0x7f59d4009b20 comp rx=0 tx=0).stop 2023-07-25T14:36:02.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.435+0000 7fd807fff700 1 --2- 172.21.15.72:0/2900233204 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd8080c2d90 0x7fd8080c3200 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fd800009e50 tx=0x7fd80000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e35b415e6ad7ba84 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:02.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.435+0000 7f59e0198700 1 -- 172.21.15.72:0/2194919793 shutdown_connections 2023-07-25T14:36:02.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.435+0000 7f59e0198700 1 --2- 172.21.15.72:0/2194919793 >> v2:172.21.15.92:3300/0 conn(0x7f59d80af820 0x7f59d8071360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:02.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.435+0000 7f59e0198700 1 --2- 172.21.15.72:0/2194919793 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f59d8155d30 0x7f59d8070e20 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:02.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.435+0000 7f59e0198700 1 -- 172.21.15.72:0/2194919793 >> 172.21.15.72:0/2194919793 conn(0x7f59d806cdb0 msgr2=0x7f59d80718c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:02.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.435+0000 7fd8067fc700 1 -- 172.21.15.72:0/2900233204 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd80000e070 con 0x7fd8080c2d90 2023-07-25T14:36:02.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.435+0000 7f59e0198700 1 -- 172.21.15.72:0/2194919793 shutdown_connections 2023-07-25T14:36:02.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.435+0000 7fd8067fc700 1 -- 172.21.15.72:0/2900233204 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd800003a20 con 0x7fd8080c2d90 2023-07-25T14:36:02.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.435+0000 7f59e0198700 1 -- 172.21.15.72:0/2194919793 wait complete. 2023-07-25T14:36:02.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.436+0000 7fd8067fc700 1 -- 172.21.15.72:0/2900233204 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd800003dd0 con 0x7fd8080c2d90 2023-07-25T14:36:02.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.436+0000 7fd80df96700 1 -- 172.21.15.72:0/2900233204 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd8080c2d90 msgr2=0x7fd8080c3200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:02.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.436+0000 7fd80df96700 1 --2- 172.21.15.72:0/2900233204 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd8080c2d90 0x7fd8080c3200 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fd800009e50 tx=0x7fd80000b330 comp rx=0 tx=0).stop 2023-07-25T14:36:02.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.437+0000 7f59e0198700 1 Processor -- start 2023-07-25T14:36:02.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.437+0000 7fd80df96700 1 -- 172.21.15.72:0/2900233204 shutdown_connections 2023-07-25T14:36:02.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.437+0000 7fd80df96700 1 --2- 172.21.15.72:0/2900233204 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd8080c2d90 0x7fd8080c3200 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:02.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.437+0000 7fd80df96700 1 --2- 172.21.15.72:0/2900233204 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd8080a5ec0 0x7fd808158970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:02.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.437+0000 7fd80df96700 1 -- 172.21.15.72:0/2900233204 >> 172.21.15.72:0/2900233204 conn(0x7fd8080a8520 msgr2=0x7fd8080a8900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:02.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.437+0000 7f59e0198700 1 -- start start 2023-07-25T14:36:02.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.438+0000 7f59e0198700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f59d80af820 0x7f59d813f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:02.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.438+0000 7f59e0198700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f59d8155d30 0x7f59d8146bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:02.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.438+0000 7f59e0198700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f59d81483f0 0x7f59d80c77d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:02.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.438+0000 7f59e0198700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59d815bb70 con 0x7f59d81483f0 2023-07-25T14:36:02.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.438+0000 7f59e0198700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59d813fd20 con 0x7f59d80af820 2023-07-25T14:36:02.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.438+0000 7f59e0198700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59d80c4680 con 0x7f59d8155d30 2023-07-25T14:36:02.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.439+0000 7f59de735700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f59d81483f0 0x7f59d80c77d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:02.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.439+0000 7f59de735700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f59d81483f0 0x7f59d80c77d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40110/0 (socket says 172.21.15.72:40110) 2023-07-25T14:36:02.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.439+0000 7f59de735700 1 -- 172.21.15.72:0/3873085824 learned_addr learned my addr 172.21.15.72:0/3873085824 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:02.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.439+0000 7f59ddf34700 1 --2- 172.21.15.72:0/3873085824 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f59d80af820 0x7f59d813f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:02.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.439+0000 7f59dd733700 1 --2- 172.21.15.72:0/3873085824 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f59d8155d30 0x7f59d8146bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:02.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.439+0000 7f59de735700 1 -- 172.21.15.72:0/3873085824 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f59d8155d30 msgr2=0x7f59d8146bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:02.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.439+0000 7f59de735700 1 --2- 172.21.15.72:0/3873085824 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f59d8155d30 0x7f59d8146bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:02.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.439+0000 7f59de735700 1 -- 172.21.15.72:0/3873085824 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f59d80af820 msgr2=0x7f59d813f7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:02.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.439+0000 7f59de735700 1 --2- 172.21.15.72:0/3873085824 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f59d80af820 0x7f59d813f7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:02.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.439+0000 7f59de735700 1 -- 172.21.15.72:0/3873085824 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59d40094a0 con 0x7f59d81483f0 2023-07-25T14:36:02.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.439+0000 7f59ddf34700 1 --2- 172.21.15.72:0/3873085824 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f59d80af820 0x7f59d813f7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-25T14:36:02.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.439+0000 7f59de735700 1 --2- 172.21.15.72:0/3873085824 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f59d81483f0 0x7f59d80c77d0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f59d000b9c0 tx=0x7f59d000bcd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:02.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.439+0000 7f59ce7fc700 1 -- 172.21.15.72:0/3873085824 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59d000c930 con 0x7f59d81483f0 2023-07-25T14:36:02.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.439+0000 7f59ce7fc700 1 -- 172.21.15.72:0/3873085824 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59d000ca90 con 0x7f59d81483f0 2023-07-25T14:36:02.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.439+0000 7f59e0198700 1 -- 172.21.15.72:0/3873085824 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59d80c9930 con 0x7f59d81483f0 2023-07-25T14:36:02.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.439+0000 7f59ce7fc700 1 -- 172.21.15.72:0/3873085824 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59d000ce40 con 0x7f59d81483f0 2023-07-25T14:36:02.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.439+0000 7f59e0198700 1 -- 172.21.15.72:0/3873085824 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59d8141710 con 0x7f59d81483f0 2023-07-25T14:36:02.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.441+0000 7f5444ff9700 1 -- 172.21.15.72:0/1519338987 <== mon.1 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f54400071d0 con 0x7f54480c21a0 2023-07-25T14:36:02.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.441+0000 7f5b4e609700 1 --2- 172.21.15.72:0/3380930996 >> [v2:172.21.15.72:6816/3404066311,v1:172.21.15.72:6817/3404066311] conn(0x7f5b2c074a10 0x7f5b2c076e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:02.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.441+0000 7fd80df96700 1 -- 172.21.15.72:0/2900233204 shutdown_connections 2023-07-25T14:36:02.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.441+0000 7f5b4e609700 1 --2- 172.21.15.72:0/3380930996 >> [v2:172.21.15.72:6816/3404066311,v1:172.21.15.72:6817/3404066311] conn(0x7f5b2c074a10 0x7f5b2c076e50 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:02.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.441+0000 7f5444ff9700 1 --2- 172.21.15.72:0/1519338987 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f543006adf0 0x7f543006d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:02.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.441+0000 7f5444ff9700 1 -- 172.21.15.72:0/1519338987 <== mon.1 v2:172.21.15.92:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f54400893e0 con 0x7f54480c21a0 2023-07-25T14:36:02.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.441+0000 7f5444ff9700 1 --2- 172.21.15.72:0/1519338987 >> [v2:172.21.15.92:6808/3770163493,v1:172.21.15.92:6809/3770163493] conn(0x7f5430074ad0 0x7f5430076f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:02.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.441+0000 7f5444ff9700 1 -- 172.21.15.72:0/1519338987 --> [v2:172.21.15.92:6808/3770163493,v1:172.21.15.92:6809/3770163493] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f54300775e0 con 0x7f5430074ad0 2023-07-25T14:36:02.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.441+0000 7f5444ff9700 1 -- 172.21.15.72:0/1519338987 <== mon.1 v2:172.21.15.92:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f544008ba00 con 0x7f54480c21a0 2023-07-25T14:36:02.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.442+0000 7f54477fe700 1 --2- 172.21.15.72:0/1519338987 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f543006adf0 0x7f543006d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:02.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.441+0000 7f59ce7fc700 1 -- 172.21.15.72:0/3873085824 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f59d0006d50 con 0x7f59d81483f0 2023-07-25T14:36:02.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.442+0000 7f59ce7fc700 1 --2- 172.21.15.72:0/3873085824 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f59bc06ace0 0x7f59bc06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:02.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.442+0000 7f59ce7fc700 1 -- 172.21.15.72:0/3873085824 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f59d00891f0 con 0x7f59d81483f0 2023-07-25T14:36:02.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.442+0000 7f54477fe700 1 --2- 172.21.15.72:0/1519338987 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f543006adf0 0x7f543006d2b0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f5448071d20 tx=0x7f543c009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:02.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.442+0000 7f5b3e7fc700 1 -- 172.21.15.72:0/3380930996 <== osd.3 v2:172.21.15.72:6816/3404066311 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f5b2c077520 con 0x7f5b2c074a10 2023-07-25T14:36:02.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.441+0000 7fd80df96700 1 -- 172.21.15.72:0/2900233204 wait complete. 2023-07-25T14:36:02.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.442+0000 7fd80df96700 1 Processor -- start 2023-07-25T14:36:02.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.443+0000 7fd80df96700 1 -- start start 2023-07-25T14:36:02.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.444+0000 7f59ddf34700 1 --2- 172.21.15.72:0/3873085824 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f59bc06ace0 0x7f59bc06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:02.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.444+0000 7fd80df96700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd8080a5ec0 0x7fd8080bca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:02.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.444+0000 7fd80df96700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd8080c2d90 0x7fd80814fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:02.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.444+0000 7fd80df96700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd80814e1d0 0x7fd8080ba440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:02.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.444+0000 7fd80df96700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8080bb660 con 0x7fd8080c2d90 2023-07-25T14:36:02.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.444+0000 7fd80df96700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd808150080 con 0x7fd80814e1d0 2023-07-25T14:36:02.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.444+0000 7fd80df96700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8080be470 con 0x7fd8080a5ec0 2023-07-25T14:36:02.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.444+0000 7fd8077fe700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd8080a5ec0 0x7fd8080bca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:02.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.444+0000 7fd8077fe700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd8080a5ec0 0x7fd8080bca20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3301/0 says I am v2:172.21.15.72:45346/0 (socket says 172.21.15.72:45346) 2023-07-25T14:36:02.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.444+0000 7fd8077fe700 1 -- 172.21.15.72:0/2705649609 learned_addr learned my addr 172.21.15.72:0/2705649609 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:02.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.444+0000 7fd806ffd700 1 --2- 172.21.15.72:0/2705649609 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd8080c2d90 0x7fd80814fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:02.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.445+0000 7f59ddf34700 1 --2- 172.21.15.72:0/3873085824 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f59bc06ace0 0x7f59bc06d1a0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f59d4009b60 tx=0x7f59d4008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:02.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.445+0000 7fd8077fe700 1 -- 172.21.15.72:0/2705649609 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd80814e1d0 msgr2=0x7fd8080ba440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:02.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.445+0000 7fd8077fe700 1 --2- 172.21.15.72:0/2705649609 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd80814e1d0 0x7fd8080ba440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:02.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.445+0000 7fd8077fe700 1 -- 172.21.15.72:0/2705649609 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd8080c2d90 msgr2=0x7fd80814fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:02.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.445+0000 7fd8077fe700 1 --2- 172.21.15.72:0/2705649609 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd8080c2d90 0x7fd80814fb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:02.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.445+0000 7fd8077fe700 1 -- 172.21.15.72:0/2705649609 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd800009b30 con 0x7fd8080a5ec0 2023-07-25T14:36:02.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.445+0000 7fd806ffd700 1 --2- 172.21.15.72:0/2705649609 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd8080c2d90 0x7fd80814fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-25T14:36:02.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.445+0000 7fd8077fe700 1 --2- 172.21.15.72:0/2705649609 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd8080a5ec0 0x7fd8080bca20 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fd7fc00c480 tx=0x7fd7fc00c790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:02.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.445+0000 7fd7effff700 1 -- 172.21.15.72:0/2705649609 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7fc0054e0 con 0x7fd8080a5ec0 2023-07-25T14:36:02.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.445+0000 7fd7effff700 1 -- 172.21.15.72:0/2705649609 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7fc0036a0 con 0x7fd8080a5ec0 2023-07-25T14:36:02.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.445+0000 7fd7effff700 1 -- 172.21.15.72:0/2705649609 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7fc003a50 con 0x7fd8080a5ec0 2023-07-25T14:36:02.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.446+0000 7f59e0198700 1 --2- 172.21.15.72:0/3873085824 >> [v2:172.21.15.92:6821/2135777609,v1:172.21.15.92:6823/2135777609] conn(0x7f59d80c9330 0x7f59d80c5be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:02.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.446+0000 7f59e0198700 1 -- 172.21.15.72:0/3873085824 --> [v2:172.21.15.92:6821/2135777609,v1:172.21.15.92:6823/2135777609] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f59d8158c40 con 0x7f59d80c9330 2023-07-25T14:36:02.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.446+0000 7fd80df96700 1 -- 172.21.15.72:0/2705649609 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8080be750 con 0x7fd8080a5ec0 2023-07-25T14:36:02.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.446+0000 7fd80df96700 1 -- 172.21.15.72:0/2705649609 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8080bc500 con 0x7fd8080a5ec0 2023-07-25T14:36:02.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.443+0000 7f544ca31700 1 --2- 172.21.15.72:0/1519338987 >> [v2:172.21.15.92:6808/3770163493,v1:172.21.15.92:6809/3770163493] conn(0x7f5430074ad0 0x7f5430076f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:02.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.444+0000 7f544ca31700 1 --2- 172.21.15.72:0/1519338987 >> [v2:172.21.15.92:6808/3770163493,v1:172.21.15.92:6809/3770163493] conn(0x7f5430074ad0 0x7f5430076f10 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:02.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.448+0000 7fd80df96700 1 -- 172.21.15.72:0/2705649609 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd8081593c0 con 0x7fd8080a5ec0 2023-07-25T14:36:02.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.449+0000 7f5444ff9700 1 -- 172.21.15.72:0/1519338987 <== osd.6 v2:172.21.15.92:6808/3770163493 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f54300775e0 con 0x7f5430074ad0 2023-07-25T14:36:02.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.449+0000 7fd7effff700 1 -- 172.21.15.72:0/2705649609 <== mon.2 v2:172.21.15.92:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd7fc003bb0 con 0x7fd8080a5ec0 2023-07-25T14:36:02.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.449+0000 7fd7effff700 1 --2- 172.21.15.72:0/2705649609 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fd7f406ace0 0x7fd7f406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:02.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.449+0000 7fd7effff700 1 -- 172.21.15.72:0/2705649609 <== mon.2 v2:172.21.15.92:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fd7fc0887c0 con 0x7fd8080a5ec0 2023-07-25T14:36:02.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.449+0000 7fd806ffd700 1 --2- 172.21.15.72:0/2705649609 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fd7f406ace0 0x7fd7f406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:02.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.450+0000 7fd7effff700 1 --2- 172.21.15.72:0/2705649609 >> [v2:172.21.15.92:6800/2161935604,v1:172.21.15.92:6801/2161935604] conn(0x7fd7f4074940 0x7fd7f4076d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:02.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.450+0000 7fd7effff700 1 -- 172.21.15.72:0/2705649609 --> [v2:172.21.15.92:6800/2161935604,v1:172.21.15.92:6801/2161935604] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd7f4077450 con 0x7fd7f4074940 2023-07-25T14:36:02.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.450+0000 7fd7effff700 1 -- 172.21.15.72:0/2705649609 <== mon.2 v2:172.21.15.92:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd7fc08ae80 con 0x7fd8080a5ec0 2023-07-25T14:36:02.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.450+0000 7fd806ffd700 1 --2- 172.21.15.72:0/2705649609 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fd7f406ace0 0x7fd7f406d1a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fd8080be270 tx=0x7fd7f8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:02.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.453+0000 7f59dd733700 1 --2- 172.21.15.72:0/3873085824 >> [v2:172.21.15.92:6821/2135777609,v1:172.21.15.92:6823/2135777609] conn(0x7f59d80c9330 0x7f59d80c5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:02.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.453+0000 7f59dd733700 1 --2- 172.21.15.72:0/3873085824 >> [v2:172.21.15.92:6821/2135777609,v1:172.21.15.92:6823/2135777609] conn(0x7f59d80c9330 0x7f59d80c5be0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:02.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.454+0000 7f59ce7fc700 1 -- 172.21.15.72:0/3873085824 <== osd.7 v2:172.21.15.92:6821/2135777609 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f59c8006bd0 con 0x7f59d80c9330 2023-07-25T14:36:02.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.455+0000 7fbb02f62700 1 -- 172.21.15.72:0/971520691 --> [v2:172.21.15.92:6816/2381008739,v1:172.21.15.92:6817/2381008739] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fbafc0c1e90 con 0x7fbafc0c6140 2023-07-25T14:36:02.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.456+0000 7fd807fff700 1 --2- 172.21.15.72:0/2705649609 >> [v2:172.21.15.92:6800/2161935604,v1:172.21.15.92:6801/2161935604] conn(0x7fd7f4074940 0x7fd7f4076d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:02.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.456+0000 7fbaf97fa700 1 -- 172.21.15.72:0/971520691 <== osd.4 v2:172.21.15.92:6816/2381008739 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fbaec004330 con 0x7fbafc0c6140 2023-07-25T14:36:02.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.456+0000 7fd807fff700 1 --2- 172.21.15.72:0/2705649609 >> [v2:172.21.15.92:6800/2161935604,v1:172.21.15.92:6801/2161935604] conn(0x7fd7f4074940 0x7fd7f4076d80 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:02.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.456+0000 7fbb02f62700 1 -- 172.21.15.72:0/971520691 >> [v2:172.21.15.92:6816/2381008739,v1:172.21.15.92:6817/2381008739] conn(0x7fbafc0c6140 msgr2=0x7fbafc0ba880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:02.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.456+0000 7fbb02f62700 1 --2- 172.21.15.72:0/971520691 >> [v2:172.21.15.92:6816/2381008739,v1:172.21.15.92:6817/2381008739] conn(0x7fbafc0c6140 0x7fbafc0ba880 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:02.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.456+0000 7f4eefcd6700 1 -- 172.21.15.72:0/3497775522 --> [v2:172.21.15.72:6820/870954016,v1:172.21.15.72:6822/870954016] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f4ed0002d40 con 0x7f4ecc074a40 2023-07-25T14:36:02.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.456+0000 7fbb02f62700 1 -- 172.21.15.72:0/971520691 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fbadc06ad00 msgr2=0x7fbadc06d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:02.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.456+0000 7fbb02f62700 1 --2- 172.21.15.72:0/971520691 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fbadc06ad00 0x7fbadc06d1c0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fbaf400ba90 tx=0x7fbaf400d040 comp rx=0 tx=0).stop 2023-07-25T14:36:02.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.456+0000 7fbb02f62700 1 -- 172.21.15.72:0/971520691 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbafc1504f0 msgr2=0x7fbafc14f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:02.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.456+0000 7fbb02f62700 1 --2- 172.21.15.72:0/971520691 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbafc1504f0 0x7fbafc14f110 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fbae400b4a0 tx=0x7fbae400b860 comp rx=0 tx=0).stop 2023-07-25T14:36:02.534 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.457+0000 7fbb014ff700 1 -- 172.21.15.72:0/971520691 reap_dead start 2023-07-25T14:36:02.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.457+0000 7fd7effff700 1 -- 172.21.15.72:0/2705649609 <== osd.5 v2:172.21.15.92:6800/2161935604 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fd7f4077450 con 0x7fd7f4074940 2023-07-25T14:36:02.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.457+0000 7f4ede7fc700 1 -- 172.21.15.72:0/3497775522 <== osd.1 v2:172.21.15.72:6820/870954016 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f4ed0002d40 con 0x7f4ecc074a40 2023-07-25T14:36:02.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.458+0000 7f4eefcd6700 1 -- 172.21.15.72:0/3497775522 >> [v2:172.21.15.72:6820/870954016,v1:172.21.15.72:6822/870954016] conn(0x7f4ecc074a40 msgr2=0x7f4ecc076e80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:02.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.458+0000 7f4eefcd6700 1 --2- 172.21.15.72:0/3497775522 >> [v2:172.21.15.72:6820/870954016,v1:172.21.15.72:6822/870954016] conn(0x7f4ecc074a40 0x7f4ecc076e80 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:02.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.458+0000 7f4eefcd6700 1 -- 172.21.15.72:0/3497775522 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f4ecc06ad60 msgr2=0x7f4ecc06d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:02.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.458+0000 7f4eefcd6700 1 --2- 172.21.15.72:0/3497775522 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f4ecc06ad60 0x7f4ecc06d220 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f4ee4001eb0 tx=0x7f4ee4001a00 comp rx=0 tx=0).stop 2023-07-25T14:36:02.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.458+0000 7f4eefcd6700 1 -- 172.21.15.72:0/3497775522 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4ee814beb0 msgr2=0x7f4ee80bcc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:02.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.458+0000 7f4eefcd6700 1 --2- 172.21.15.72:0/3497775522 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4ee814beb0 0x7f4ee80bcc60 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f4ee80a5cc0 tx=0x7f4ee0004b40 comp rx=0 tx=0).stop 2023-07-25T14:36:02.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.458+0000 7f4eee273700 1 -- 172.21.15.72:0/3497775522 reap_dead start 2023-07-25T14:36:02.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.458+0000 7f4eefcd6700 1 -- 172.21.15.72:0/3497775522 shutdown_connections 2023-07-25T14:36:02.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.458+0000 7f4eefcd6700 1 -- 172.21.15.72:0/3497775522 >> 172.21.15.72:0/3497775522 conn(0x7f4ee80a7860 msgr2=0x7f4ee80baad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:02.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.459+0000 7fbb02f62700 1 -- 172.21.15.72:0/971520691 shutdown_connections 2023-07-25T14:36:02.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.459+0000 7fbb02f62700 1 -- 172.21.15.72:0/971520691 >> 172.21.15.72:0/971520691 conn(0x7fbafc0a7860 msgr2=0x7fbafc1d9a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:02.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.460+0000 7f95d10a3700 1 -- 172.21.15.72:0/2003157241 --> [v2:172.21.15.72:6800/2475407414,v1:172.21.15.72:6801/2475407414] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f95cc14df00 con 0x7f95b8074940 2023-07-25T14:36:02.538 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.460+0000 7f4eefcd6700 1 -- 172.21.15.72:0/3497775522 shutdown_connections 2023-07-25T14:36:02.538 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.460+0000 7f4eefcd6700 1 -- 172.21.15.72:0/3497775522 wait complete. 2023-07-25T14:36:02.538 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.461+0000 7f95b37fe700 1 -- 172.21.15.72:0/2003157241 <== osd.0 v2:172.21.15.72:6800/2475407414 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f95bc0050b0 con 0x7f95b8074940 2023-07-25T14:36:02.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.462+0000 7f95d10a3700 1 -- 172.21.15.72:0/2003157241 >> [v2:172.21.15.72:6800/2475407414,v1:172.21.15.72:6801/2475407414] conn(0x7f95b8074940 msgr2=0x7f95b8076d80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:02.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.462+0000 7f95d10a3700 1 --2- 172.21.15.72:0/2003157241 >> [v2:172.21.15.72:6800/2475407414,v1:172.21.15.72:6801/2475407414] conn(0x7f95b8074940 0x7f95b8076d80 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:02.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.462+0000 7f95d10a3700 1 -- 172.21.15.72:0/2003157241 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f95b806ace0 msgr2=0x7f95b806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:02.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.462+0000 7f95d10a3700 1 --2- 172.21.15.72:0/2003157241 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f95b806ace0 0x7f95b806d1a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f95c0000c00 tx=0x7f95c0008000 comp rx=0 tx=0).stop 2023-07-25T14:36:02.540 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.462+0000 7f95d10a3700 1 -- 172.21.15.72:0/2003157241 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f95cc0c17b0 msgr2=0x7f95cc1441e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:02.540 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.462+0000 7f95d10a3700 1 --2- 172.21.15.72:0/2003157241 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f95cc0c17b0 0x7f95cc1441e0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f95c4001b20 tx=0x7f95c400cf70 comp rx=0 tx=0).stop 2023-07-25T14:36:02.540 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.462+0000 7f95cb59e700 1 -- 172.21.15.72:0/2003157241 reap_dead start 2023-07-25T14:36:02.540 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.462+0000 7f95d10a3700 1 -- 172.21.15.72:0/2003157241 shutdown_connections 2023-07-25T14:36:02.540 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.462+0000 7f95d10a3700 1 -- 172.21.15.72:0/2003157241 >> 172.21.15.72:0/2003157241 conn(0x7f95cc0a7860 msgr2=0x7f95cc06dc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:02.540 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.462+0000 7f95d10a3700 1 -- 172.21.15.72:0/2003157241 shutdown_connections 2023-07-25T14:36:02.540 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.462+0000 7f95d10a3700 1 -- 172.21.15.72:0/2003157241 wait complete. 2023-07-25T14:36:02.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.463+0000 7ff446125700 1 -- 172.21.15.72:0/1398920508 --> [v2:172.21.15.72:6808/2143129442,v1:172.21.15.72:6809/2143129442] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ff420002d40 con 0x7ff42c074a10 2023-07-25T14:36:02.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.464+0000 7ff427fff700 1 -- 172.21.15.72:0/1398920508 <== osd.2 v2:172.21.15.72:6808/2143129442 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7ff420002d40 con 0x7ff42c074a10 2023-07-25T14:36:02.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.465+0000 7fbb02f62700 1 -- 172.21.15.72:0/971520691 shutdown_connections 2023-07-25T14:36:02.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.465+0000 7fbb02f62700 1 -- 172.21.15.72:0/971520691 wait complete. 2023-07-25T14:36:02.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.470+0000 7f5b5006c700 1 -- 172.21.15.72:0/3380930996 --> [v2:172.21.15.72:6816/3404066311,v1:172.21.15.72:6817/3404066311] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f5b480c4890 con 0x7f5b2c074a10 2023-07-25T14:36:02.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.470+0000 7f5b3e7fc700 1 -- 172.21.15.72:0/3380930996 <== osd.3 v2:172.21.15.72:6816/3404066311 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f5b38011810 con 0x7f5b2c074a10 2023-07-25T14:36:02.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.470+0000 7f5b5006c700 1 -- 172.21.15.72:0/3380930996 >> [v2:172.21.15.72:6816/3404066311,v1:172.21.15.72:6817/3404066311] conn(0x7f5b2c074a10 msgr2=0x7f5b2c076e50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:02.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.471+0000 7f5b5006c700 1 --2- 172.21.15.72:0/3380930996 >> [v2:172.21.15.72:6816/3404066311,v1:172.21.15.72:6817/3404066311] conn(0x7f5b2c074a10 0x7f5b2c076e50 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:02.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.471+0000 7f5b5006c700 1 -- 172.21.15.72:0/3380930996 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f5b2c06ad30 msgr2=0x7f5b2c06d1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:02.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.471+0000 7f5b5006c700 1 --2- 172.21.15.72:0/3380930996 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f5b2c06ad30 0x7f5b2c06d1f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f5b40002230 tx=0x7f5b40001db0 comp rx=0 tx=0).stop 2023-07-25T14:36:02.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.471+0000 7f5b5006c700 1 -- 172.21.15.72:0/3380930996 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5b480c2570 msgr2=0x7f5b48156ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:02.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.471+0000 7f5b5006c700 1 --2- 172.21.15.72:0/3380930996 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5b480c2570 0x7f5b48156ae0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f5b4400e870 tx=0x7f5b4400eb80 comp rx=0 tx=0).stop 2023-07-25T14:36:02.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.471+0000 7f5b4e609700 1 -- 172.21.15.72:0/3380930996 reap_dead start 2023-07-25T14:36:02.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.471+0000 7f5b5006c700 1 -- 172.21.15.72:0/3380930996 shutdown_connections 2023-07-25T14:36:02.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.471+0000 7f5b5006c700 1 -- 172.21.15.72:0/3380930996 >> 172.21.15.72:0/3380930996 conn(0x7f5b4806cdb0 msgr2=0x7f5b480c07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:02.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.471+0000 7f5b5006c700 1 -- 172.21.15.72:0/3380930996 shutdown_connections 2023-07-25T14:36:02.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.471+0000 7f5b5006c700 1 -- 172.21.15.72:0/3380930996 wait complete. 2023-07-25T14:36:02.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.481+0000 7ff446125700 1 -- 172.21.15.72:0/1398920508 >> [v2:172.21.15.72:6808/2143129442,v1:172.21.15.72:6809/2143129442] conn(0x7ff42c074a10 msgr2=0x7ff42c076e50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:02.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.481+0000 7ff446125700 1 --2- 172.21.15.72:0/1398920508 >> [v2:172.21.15.72:6808/2143129442,v1:172.21.15.72:6809/2143129442] conn(0x7ff42c074a10 0x7ff42c076e50 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:02.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.481+0000 7ff446125700 1 -- 172.21.15.72:0/1398920508 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7ff42c06adb0 msgr2=0x7ff42c06d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:02.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.481+0000 7ff446125700 1 --2- 172.21.15.72:0/1398920508 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7ff42c06adb0 0x7ff42c06d270 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ff430009560 tx=0x7ff43001a000 comp rx=0 tx=0).stop 2023-07-25T14:36:02.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.481+0000 7ff446125700 1 -- 172.21.15.72:0/1398920508 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff4401504f0 msgr2=0x7ff44014b360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:02.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.481+0000 7ff446125700 1 --2- 172.21.15.72:0/1398920508 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff4401504f0 0x7ff44014b360 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7ff43400c4d0 tx=0x7ff43400c890 comp rx=0 tx=0).stop 2023-07-25T14:36:02.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.481+0000 7ff43ffff700 1 -- 172.21.15.72:0/1398920508 reap_dead start 2023-07-25T14:36:02.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.481+0000 7ff446125700 1 -- 172.21.15.72:0/1398920508 shutdown_connections 2023-07-25T14:36:02.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.481+0000 7ff446125700 1 -- 172.21.15.72:0/1398920508 >> 172.21.15.72:0/1398920508 conn(0x7ff4400a7860 msgr2=0x7ff440153fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:02.546 INFO:teuthology.orchestra.run.smithi072.stdout:55834574857 2023-07-25T14:36:02.547 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-07-25T14:36:02.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.482+0000 7f544e494700 1 -- 172.21.15.72:0/1519338987 --> [v2:172.21.15.92:6808/3770163493,v1:172.21.15.92:6809/3770163493] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f5434002d70 con 0x7f5430074ad0 2023-07-25T14:36:02.548 INFO:teuthology.orchestra.run.smithi072.stdout:55834574857 2023-07-25T14:36:02.548 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-07-25T14:36:02.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.482+0000 7f5444ff9700 1 -- 172.21.15.72:0/1519338987 <== osd.6 v2:172.21.15.92:6808/3770163493 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f5434002d70 con 0x7f5430074ad0 2023-07-25T14:36:02.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.483+0000 7f544e494700 1 -- 172.21.15.72:0/1519338987 >> [v2:172.21.15.92:6808/3770163493,v1:172.21.15.92:6809/3770163493] conn(0x7f5430074ad0 msgr2=0x7f5430076f10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:02.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.483+0000 7f544e494700 1 --2- 172.21.15.72:0/1519338987 >> [v2:172.21.15.92:6808/3770163493,v1:172.21.15.92:6809/3770163493] conn(0x7f5430074ad0 0x7f5430076f10 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:02.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.483+0000 7f544e494700 1 -- 172.21.15.72:0/1519338987 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f543006adf0 msgr2=0x7f543006d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:02.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.483+0000 7f544e494700 1 --2- 172.21.15.72:0/1519338987 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f543006adf0 0x7f543006d2b0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f5448071d20 tx=0x7f543c009190 comp rx=0 tx=0).stop 2023-07-25T14:36:02.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.483+0000 7f544e494700 1 -- 172.21.15.72:0/1519338987 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f54480c21a0 msgr2=0x7f5448151ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:02.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.483+0000 7f544e494700 1 --2- 172.21.15.72:0/1519338987 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f54480c21a0 0x7f5448151ad0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f544000caf0 tx=0x7f544000ce00 comp rx=0 tx=0).stop 2023-07-25T14:36:02.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.483+0000 7f544ca31700 1 -- 172.21.15.72:0/1519338987 reap_dead start 2023-07-25T14:36:02.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.483+0000 7f544e494700 1 -- 172.21.15.72:0/1519338987 shutdown_connections 2023-07-25T14:36:02.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.483+0000 7f544e494700 1 -- 172.21.15.72:0/1519338987 >> 172.21.15.72:0/1519338987 conn(0x7f54480a7860 msgr2=0x7f544814f7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:02.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.483+0000 7f544e494700 1 -- 172.21.15.72:0/1519338987 shutdown_connections 2023-07-25T14:36:02.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.483+0000 7f544e494700 1 -- 172.21.15.72:0/1519338987 wait complete. 2023-07-25T14:36:02.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.484+0000 7ff446125700 1 -- 172.21.15.72:0/1398920508 shutdown_connections 2023-07-25T14:36:02.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.484+0000 7ff446125700 1 -- 172.21.15.72:0/1398920508 wait complete. 2023-07-25T14:36:02.552 INFO:teuthology.orchestra.run.smithi072.stdout:55834574857 2023-07-25T14:36:02.552 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-07-25T14:36:02.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.489+0000 7fd80df96700 1 -- 172.21.15.72:0/2705649609 --> [v2:172.21.15.92:6800/2161935604,v1:172.21.15.92:6801/2161935604] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd8081590e0 con 0x7fd7f4074940 2023-07-25T14:36:02.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.489+0000 7fd7effff700 1 -- 172.21.15.72:0/2705649609 <== osd.5 v2:172.21.15.92:6800/2161935604 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fd800003b90 con 0x7fd7f4074940 2023-07-25T14:36:02.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.490+0000 7fd80df96700 1 -- 172.21.15.72:0/2705649609 >> [v2:172.21.15.92:6800/2161935604,v1:172.21.15.92:6801/2161935604] conn(0x7fd7f4074940 msgr2=0x7fd7f4076d80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:02.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.490+0000 7fd80df96700 1 --2- 172.21.15.72:0/2705649609 >> [v2:172.21.15.92:6800/2161935604,v1:172.21.15.92:6801/2161935604] conn(0x7fd7f4074940 0x7fd7f4076d80 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:02.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.490+0000 7fd80df96700 1 -- 172.21.15.72:0/2705649609 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fd7f406ace0 msgr2=0x7fd7f406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:02.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.490+0000 7fd80df96700 1 --2- 172.21.15.72:0/2705649609 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fd7f406ace0 0x7fd7f406d1a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fd8080be270 tx=0x7fd7f8008040 comp rx=0 tx=0).stop 2023-07-25T14:36:02.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.490+0000 7fd80df96700 1 -- 172.21.15.72:0/2705649609 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd8080a5ec0 msgr2=0x7fd8080bca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:02.555 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.490+0000 7fd80df96700 1 --2- 172.21.15.72:0/2705649609 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd8080a5ec0 0x7fd8080bca20 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fd7fc00c480 tx=0x7fd7fc00c790 comp rx=0 tx=0).stop 2023-07-25T14:36:02.555 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.491+0000 7f59e0198700 1 -- 172.21.15.72:0/3873085824 --> [v2:172.21.15.92:6821/2135777609,v1:172.21.15.92:6823/2135777609] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f59d806d3a0 con 0x7f59d80c9330 2023-07-25T14:36:02.555 INFO:teuthology.orchestra.run.smithi072.stdout:55834574857 2023-07-25T14:36:02.556 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-07-25T14:36:02.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.491+0000 7fd807fff700 1 -- 172.21.15.72:0/2705649609 reap_dead start 2023-07-25T14:36:02.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.491+0000 7fd80df96700 1 -- 172.21.15.72:0/2705649609 shutdown_connections 2023-07-25T14:36:02.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.491+0000 7fd80df96700 1 -- 172.21.15.72:0/2705649609 >> 172.21.15.72:0/2705649609 conn(0x7fd8080a8520 msgr2=0x7fd8081639a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:02.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.491+0000 7fd80df96700 1 -- 172.21.15.72:0/2705649609 shutdown_connections 2023-07-25T14:36:02.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.491+0000 7fd80df96700 1 -- 172.21.15.72:0/2705649609 wait complete. 2023-07-25T14:36:02.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.491+0000 7f59ce7fc700 1 -- 172.21.15.72:0/3873085824 <== osd.7 v2:172.21.15.92:6821/2135777609 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f59c8004870 con 0x7f59d80c9330 2023-07-25T14:36:02.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.492+0000 7f59e0198700 1 -- 172.21.15.72:0/3873085824 >> [v2:172.21.15.92:6821/2135777609,v1:172.21.15.92:6823/2135777609] conn(0x7f59d80c9330 msgr2=0x7f59d80c5be0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:02.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.492+0000 7f59e0198700 1 --2- 172.21.15.72:0/3873085824 >> [v2:172.21.15.92:6821/2135777609,v1:172.21.15.92:6823/2135777609] conn(0x7f59d80c9330 0x7f59d80c5be0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:02.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.492+0000 7f59e0198700 1 -- 172.21.15.72:0/3873085824 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f59bc06ace0 msgr2=0x7f59bc06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:02.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.492+0000 7f59e0198700 1 --2- 172.21.15.72:0/3873085824 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f59bc06ace0 0x7f59bc06d1a0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f59d4009b60 tx=0x7f59d4008030 comp rx=0 tx=0).stop 2023-07-25T14:36:02.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.492+0000 7f59e0198700 1 -- 172.21.15.72:0/3873085824 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f59d81483f0 msgr2=0x7f59d80c77d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:02.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.492+0000 7f59e0198700 1 --2- 172.21.15.72:0/3873085824 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f59d81483f0 0x7f59d80c77d0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f59d000b9c0 tx=0x7f59d000bcd0 comp rx=0 tx=0).stop 2023-07-25T14:36:02.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.492+0000 7f59de735700 1 -- 172.21.15.72:0/3873085824 reap_dead start 2023-07-25T14:36:02.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.492+0000 7f59e0198700 1 -- 172.21.15.72:0/3873085824 shutdown_connections 2023-07-25T14:36:02.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.492+0000 7f59e0198700 1 -- 172.21.15.72:0/3873085824 >> 172.21.15.72:0/3873085824 conn(0x7f59d806cdb0 msgr2=0x7f59d80718c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:02.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.492+0000 7f59e0198700 1 -- 172.21.15.72:0/3873085824 shutdown_connections 2023-07-25T14:36:02.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.492+0000 7f59e0198700 1 -- 172.21.15.72:0/3873085824 wait complete. 2023-07-25T14:36:02.560 INFO:teuthology.orchestra.run.smithi072.stdout:55834574857 2023-07-25T14:36:02.560 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-07-25T14:36:02.561 INFO:teuthology.orchestra.run.smithi072.stdout:55834574857 2023-07-25T14:36:02.562 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-07-25T14:36:02.562 INFO:teuthology.orchestra.run.smithi072.stdout:55834574857 2023-07-25T14:36:02.563 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-07-25T14:36:02.563 INFO:teuthology.orchestra.run.smithi072.stdout:55834574858 2023-07-25T14:36:02.564 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-07-25T14:36:02.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.782+0000 7f6f9bbed700 1 Processor -- start 2023-07-25T14:36:02.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.782+0000 7f6f9bbed700 1 -- start start 2023-07-25T14:36:02.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.783+0000 7f6f9bbed700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6f941546f0 0x7f6f9414da90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:02.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.783+0000 7f6f9bbed700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f94153b00 con 0x7f6f940c21a0 2023-07-25T14:36:02.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.783+0000 7f6f9bbed700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f940c0aa0 con 0x7f6f941504f0 2023-07-25T14:36:02.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.783+0000 7f02995fa700 1 Processor -- start 2023-07-25T14:36:02.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.783+0000 7f6f9bbed700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f9414dfd0 con 0x7f6f941546f0 2023-07-25T14:36:02.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.784+0000 7f6f9a18a700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6f941546f0 0x7f6f9414da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:02.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.784+0000 7f6f9a18a700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6f941546f0 0x7f6f9414da90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3301/0 says I am v2:172.21.15.72:45358/0 (socket says 172.21.15.72:45358) 2023-07-25T14:36:02.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.784+0000 7f6f9a18a700 1 -- 172.21.15.72:0/307656927 learned_addr learned my addr 172.21.15.72:0/307656927 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:02.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.784+0000 7f02995fa700 1 -- start start 2023-07-25T14:36:02.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.784+0000 7f6f98987700 1 -- 172.21.15.72:0/307656927 <== mon.1 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3462196050 0 0) 0x7f6f940c0aa0 con 0x7f6f941504f0 2023-07-25T14:36:02.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.784+0000 7f6f98987700 1 -- 172.21.15.72:0/307656927 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6f800035b0 con 0x7f6f941504f0 2023-07-25T14:36:02.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.784+0000 7f6f9a18a700 1 -- 172.21.15.72:0/307656927 >> v1:172.21.15.92:6789/0 conn(0x7f6f941504f0 legacy=0x7f6f940bad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:02.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.784+0000 7f6f9a18a700 1 -- 172.21.15.72:0/307656927 >> v1:172.21.15.72:6789/0 conn(0x7f6f940c21a0 legacy=0x7f6f94153fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:02.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.784+0000 7f6f9a18a700 1 -- 172.21.15.72:0/307656927 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f940c0d80 con 0x7f6f941546f0 2023-07-25T14:36:02.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.784+0000 7ff4043e7700 1 Processor -- start 2023-07-25T14:36:02.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.784+0000 7ff4043e7700 1 -- start start 2023-07-25T14:36:02.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.786+0000 7ff4043e7700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7ff3fc0c25c0 0x7ff3fc0c29a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:02.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.786+0000 7ff4043e7700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff3fc0c1d30 0x7ff3fc16b960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:02.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.786+0000 7ff4043e7700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3fc165570 con 0x7ff3fc089240 2023-07-25T14:36:02.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.786+0000 7ff4043e7700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3fc0728b0 con 0x7ff3fc0c1d30 2023-07-25T14:36:02.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.786+0000 7ff4043e7700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3fc072380 con 0x7ff3fc0c25c0 2023-07-25T14:36:02.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.785+0000 7f6f9a18a700 1 --2- 172.21.15.72:0/307656927 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6f941546f0 0x7f6f9414da90 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f6f84009920 tx=0x7f6f84009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=10458330463da70 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:02.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.785+0000 7f6f98987700 1 -- 172.21.15.72:0/307656927 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f84011830 con 0x7f6f941546f0 2023-07-25T14:36:02.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.785+0000 7f6f98987700 1 -- 172.21.15.72:0/307656927 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f84011990 con 0x7f6f941546f0 2023-07-25T14:36:02.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.785+0000 7f6f98987700 1 -- 172.21.15.72:0/307656927 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f84011d20 con 0x7f6f941546f0 2023-07-25T14:36:02.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.785+0000 7f02995fa700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0294155ea0 0x7f02940c1ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:02.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.785+0000 7f02995fa700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f02940c2530 0x7f0294158d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:02.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.785+0000 7f02995fa700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f029415c8e0 con 0x7f02940af7d0 2023-07-25T14:36:02.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.785+0000 7f02995fa700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0294156280 con 0x7f0294155ea0 2023-07-25T14:36:02.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.785+0000 7f02995fa700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f029415bcd0 con 0x7f02940c2530 2023-07-25T14:36:02.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.785+0000 7f02927fc700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f02940af7d0 0x7f0294158640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:59104/0 (socket says 172.21.15.72:59104) 2023-07-25T14:36:02.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.785+0000 7f02927fc700 1 -- 172.21.15.72:0/3700903862 learned_addr learned my addr 172.21.15.72:0/3700903862 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:36:02.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.785+0000 7f02937fe700 1 --2- 172.21.15.72:0/3700903862 >> v2:172.21.15.92:3300/0 conn(0x7f02940c2530 0x7f0294158d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:02.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.786+0000 7f0291ffb700 1 -- 172.21.15.72:0/3700903862 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3910891558 0 0) 0x7f029415c8e0 con 0x7f02940af7d0 2023-07-25T14:36:02.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.786+0000 7f0291ffb700 1 -- 172.21.15.72:0/3700903862 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f027c0035b0 con 0x7f02940af7d0 2023-07-25T14:36:02.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.786+0000 7ff401982700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7ff3fc089240 0x7ff3fc0ba780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.72:54452/0 (socket says 172.21.15.72:54452) 2023-07-25T14:36:02.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.786+0000 7ff401982700 1 -- 172.21.15.72:0/2370354462 learned_addr learned my addr 172.21.15.72:0/2370354462 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:36:02.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.786+0000 7f0292ffd700 1 --2- 172.21.15.72:0/3700903862 >> v2:172.21.15.72:3300/0 conn(0x7f0294155ea0 0x7f02940c1ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:02.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.786+0000 7f02937fe700 1 -- 172.21.15.72:0/3700903862 >> v2:172.21.15.72:3300/0 conn(0x7f0294155ea0 msgr2=0x7f02940c1ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:02.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.786+0000 7f02937fe700 1 --2- 172.21.15.72:0/3700903862 >> v2:172.21.15.72:3300/0 conn(0x7f0294155ea0 0x7f02940c1ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:02.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.786+0000 7f02937fe700 1 -- 172.21.15.72:0/3700903862 >> v1:172.21.15.72:6789/0 conn(0x7f02940af7d0 legacy=0x7f0294158640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:02.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.786+0000 7f0291ffb700 1 -- 172.21.15.72:0/3700903862 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3651036082 0 0) 0x7f027c0035b0 con 0x7f02940af7d0 2023-07-25T14:36:02.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.786+0000 7f6f9bbed700 1 -- 172.21.15.72:0/307656927 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6f941546f0 msgr2=0x7f6f9414da90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:02.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.786+0000 7f6f9bbed700 1 --2- 172.21.15.72:0/307656927 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6f941546f0 0x7f6f9414da90 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f6f84009920 tx=0x7f6f84009c30 comp rx=0 tx=0).stop 2023-07-25T14:36:02.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.786+0000 7ff402984700 1 --2- 172.21.15.72:0/2370354462 >> v2:172.21.15.72:3300/0 conn(0x7ff3fc0c1d30 0x7ff3fc16b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:02.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.786+0000 7ff402183700 1 --2- 172.21.15.72:0/2370354462 >> v2:172.21.15.92:3300/0 conn(0x7ff3fc0c25c0 0x7ff3fc0c29a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:02.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.786+0000 7f6f9bbed700 1 -- 172.21.15.72:0/307656927 shutdown_connections 2023-07-25T14:36:02.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.786+0000 7f6f9bbed700 1 --2- 172.21.15.72:0/307656927 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6f941546f0 0x7f6f9414da90 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:02.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.786+0000 7f6f9bbed700 1 -- 172.21.15.72:0/307656927 >> 172.21.15.72:0/307656927 conn(0x7f6f940a7860 msgr2=0x7f6f940a7c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:02.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.786+0000 7f02937fe700 1 -- 172.21.15.72:0/3700903862 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f029415bfb0 con 0x7f02940c2530 2023-07-25T14:36:02.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.787+0000 7f02937fe700 1 --2- 172.21.15.72:0/3700903862 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f02940c2530 0x7f0294158d50 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f02940c1f20 tx=0x7f028c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bb820a2bbece423f server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:02.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.786+0000 7ff401181700 1 -- 172.21.15.72:0/2370354462 <== mon.1 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2933434445 0 0) 0x7ff3fc165570 con 0x7ff3fc089240 2023-07-25T14:36:02.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.787+0000 7ff401181700 1 -- 172.21.15.72:0/2370354462 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff3e80057c0 con 0x7ff3fc089240 2023-07-25T14:36:02.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.787+0000 7f6f9bbed700 1 -- 172.21.15.72:0/307656927 shutdown_connections 2023-07-25T14:36:02.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.787+0000 7ff402984700 1 -- 172.21.15.72:0/2370354462 >> v2:172.21.15.92:3300/0 conn(0x7ff3fc0c25c0 msgr2=0x7ff3fc0c29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:02.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.787+0000 7ff402984700 1 --2- 172.21.15.72:0/2370354462 >> v2:172.21.15.92:3300/0 conn(0x7ff3fc0c25c0 0x7ff3fc0c29a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:02.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.787+0000 7ff402984700 1 -- 172.21.15.72:0/2370354462 >> v1:172.21.15.92:6789/0 conn(0x7ff3fc089240 legacy=0x7ff3fc0ba780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:02.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.787+0000 7ff402984700 1 -- 172.21.15.72:0/2370354462 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3fc0c0d40 con 0x7ff3fc0c1d30 2023-07-25T14:36:02.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.787+0000 7f0291ffb700 1 -- 172.21.15.72:0/3700903862 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f028c00e070 con 0x7f02940c2530 2023-07-25T14:36:02.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.787+0000 7f6f9bbed700 1 -- 172.21.15.72:0/307656927 wait complete. 2023-07-25T14:36:02.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.787+0000 7f0291ffb700 1 -- 172.21.15.72:0/3700903862 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f028c003a20 con 0x7f02940c2530 2023-07-25T14:36:02.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.787+0000 7f0291ffb700 1 -- 172.21.15.72:0/3700903862 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0284001670 con 0x7f02940c2530 2023-07-25T14:36:02.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.787+0000 7ff402984700 1 --2- 172.21.15.72:0/2370354462 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff3fc0c1d30 0x7ff3fc16b960 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7ff3fc06dff0 tx=0x7ff3f400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d5d4891591b26fc server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:02.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.787+0000 7fe0480a3700 1 Processor -- start 2023-07-25T14:36:02.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.788+0000 7f02995fa700 1 -- 172.21.15.72:0/3700903862 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f02940c2530 msgr2=0x7f0294158d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:02.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.788+0000 7f02995fa700 1 --2- 172.21.15.72:0/3700903862 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f02940c2530 0x7f0294158d50 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f02940c1f20 tx=0x7f028c00b330 comp rx=0 tx=0).stop 2023-07-25T14:36:02.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.788+0000 7fe0480a3700 1 -- start start 2023-07-25T14:36:02.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.788+0000 7f6f9bbed700 1 Processor -- start 2023-07-25T14:36:02.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.788+0000 7f02995fa700 1 -- 172.21.15.72:0/3700903862 shutdown_connections 2023-07-25T14:36:02.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.788+0000 7f02995fa700 1 --2- 172.21.15.72:0/3700903862 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f02940c2530 0x7f0294158d50 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:02.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.788+0000 7f02995fa700 1 --2- 172.21.15.72:0/3700903862 >> v2:172.21.15.72:3300/0 conn(0x7f0294155ea0 0x7f02940c1ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:02.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.788+0000 7f02995fa700 1 -- 172.21.15.72:0/3700903862 >> 172.21.15.72:0/3700903862 conn(0x7f02940c9fc0 msgr2=0x7f02940ca3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:02.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.788+0000 7f6f9bbed700 1 -- start start 2023-07-25T14:36:02.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.787+0000 7ff401181700 1 -- 172.21.15.72:0/2370354462 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3f400e070 con 0x7ff3fc0c1d30 2023-07-25T14:36:02.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.787+0000 7ff401181700 1 -- 172.21.15.72:0/2370354462 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3f400bb20 con 0x7ff3fc0c1d30 2023-07-25T14:36:02.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.787+0000 7ff401181700 1 -- 172.21.15.72:0/2370354462 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3f4012430 con 0x7ff3fc0c1d30 2023-07-25T14:36:02.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.788+0000 7ff4043e7700 1 -- 172.21.15.72:0/2370354462 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff3fc0c1d30 msgr2=0x7ff3fc16b960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:02.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.788+0000 7ff4043e7700 1 --2- 172.21.15.72:0/2370354462 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff3fc0c1d30 0x7ff3fc16b960 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7ff3fc06dff0 tx=0x7ff3f400b330 comp rx=0 tx=0).stop 2023-07-25T14:36:02.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.788+0000 7ff4043e7700 1 -- 172.21.15.72:0/2370354462 shutdown_connections 2023-07-25T14:36:02.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.788+0000 7ff4043e7700 1 --2- 172.21.15.72:0/2370354462 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff3fc0c1d30 0x7ff3fc16b960 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:02.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.788+0000 7ff4043e7700 1 --2- 172.21.15.72:0/2370354462 >> v2:172.21.15.92:3300/0 conn(0x7ff3fc0c25c0 0x7ff3fc0c29a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:02.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.788+0000 7ff4043e7700 1 -- 172.21.15.72:0/2370354462 >> 172.21.15.72:0/2370354462 conn(0x7ff3fc0a7860 msgr2=0x7ff3fc0a7c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:02.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.788+0000 7ff4043e7700 1 -- 172.21.15.72:0/2370354462 shutdown_connections 2023-07-25T14:36:02.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.789+0000 7f02995fa700 1 -- 172.21.15.72:0/3700903862 shutdown_connections 2023-07-25T14:36:02.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.789+0000 7fe0480a3700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fe0400c2570 0x7fe0400c2950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:02.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.789+0000 7fe0480a3700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe0400c04e0 0x7fe04006ce30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:02.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.789+0000 7fe0480a3700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0400c5600 con 0x7fe0400b9290 2023-07-25T14:36:02.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.789+0000 7fe0480a3700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0400c5850 con 0x7fe0400c2570 2023-07-25T14:36:02.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.789+0000 7fe0480a3700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe04015cb00 con 0x7fe0400c04e0 2023-07-25T14:36:02.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.789+0000 7fe045e3f700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fe0400c2570 0x7fe0400c2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:02.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.789+0000 7fe045e3f700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fe0400c2570 0x7fe0400c2950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.72:35720/0 (socket says 172.21.15.72:35720) 2023-07-25T14:36:02.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.789+0000 7fe046640700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe0400c04e0 0x7fe04006ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:02.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.789+0000 7fe045e3f700 1 -- 172.21.15.72:0/2270038673 learned_addr learned my addr 172.21.15.72:0/2270038673 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:02.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.789+0000 7fe045e3f700 1 -- 172.21.15.72:0/2270038673 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe0400c04e0 msgr2=0x7fe04006ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:02.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.789+0000 7fe045e3f700 1 --2- 172.21.15.72:0/2270038673 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe0400c04e0 0x7fe04006ce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:02.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.789+0000 7fe045e3f700 1 -- 172.21.15.72:0/2270038673 >> v1:172.21.15.92:6789/0 conn(0x7fe0400b9290 legacy=0x7fe0401588a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:02.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.789+0000 7fe045e3f700 1 -- 172.21.15.72:0/2270038673 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe040158fb0 con 0x7fe0400c2570 2023-07-25T14:36:02.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.789+0000 7ff4043e7700 1 -- 172.21.15.72:0/2370354462 wait complete. 2023-07-25T14:36:02.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.789+0000 7f02995fa700 1 -- 172.21.15.72:0/3700903862 wait complete. 2023-07-25T14:36:02.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.790+0000 7fe045e3f700 1 --2- 172.21.15.72:0/2270038673 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe0400c2570 0x7fe0400c2950 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fe03c0098f0 tx=0x7fe03c009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f045853e874b4829 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:02.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.790+0000 7fe044e3d700 1 -- 172.21.15.72:0/2270038673 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe03c00b8a0 con 0x7fe0400c2570 2023-07-25T14:36:02.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.790+0000 7fe044e3d700 1 -- 172.21.15.72:0/2270038673 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe03c00ba00 con 0x7fe0400c2570 2023-07-25T14:36:02.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.790+0000 7fe044e3d700 1 -- 172.21.15.72:0/2270038673 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe03c00bd90 con 0x7fe0400c2570 2023-07-25T14:36:02.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.790+0000 7f6f9bbed700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6f940c21a0 0x7f6f940ab320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:02.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.790+0000 7f6f9bbed700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6f941504f0 0x7f6f940c5e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:02.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.790+0000 7f6f9bbed700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6f941546f0 0x7f6f941406c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:02.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.790+0000 7f6f9bbed700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f940bd950 con 0x7f6f941546f0 2023-07-25T14:36:02.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.790+0000 7f6f9bbed700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f940bcdd0 con 0x7f6f940c21a0 2023-07-25T14:36:02.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.790+0000 7f6f9bbed700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f940bd0b0 con 0x7f6f941504f0 2023-07-25T14:36:02.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.790+0000 7f6f99188700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6f941504f0 0x7f6f940c5e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:02.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.790+0000 7f6f99188700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6f941504f0 0x7f6f940c5e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3301/0 says I am v2:172.21.15.72:45384/0 (socket says 172.21.15.72:45384) 2023-07-25T14:36:02.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.790+0000 7f6f99188700 1 -- 172.21.15.72:0/4118308613 learned_addr learned my addr 172.21.15.72:0/4118308613 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:02.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.790+0000 7f6f9a18a700 1 --2- 172.21.15.72:0/4118308613 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6f941546f0 0x7f6f941406c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:02.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.790+0000 7f02995fa700 1 Processor -- start 2023-07-25T14:36:02.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.790+0000 7f6f99188700 1 -- 172.21.15.72:0/4118308613 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6f940c21a0 msgr2=0x7f6f940ab320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:02.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.790+0000 7f6f99188700 1 --2- 172.21.15.72:0/4118308613 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6f940c21a0 0x7f6f940ab320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:02.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.790+0000 7f6f99188700 1 -- 172.21.15.72:0/4118308613 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6f941546f0 msgr2=0x7f6f941406c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:02.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.790+0000 7f6f99188700 1 --2- 172.21.15.72:0/4118308613 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6f941546f0 0x7f6f941406c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:02.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.790+0000 7f6f99188700 1 -- 172.21.15.72:0/4118308613 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f84009550 con 0x7f6f941504f0 2023-07-25T14:36:02.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.791+0000 7f6f99188700 1 --2- 172.21.15.72:0/4118308613 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6f941504f0 0x7f6f940c5e70 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f6f8c001ed0 tx=0x7f6f8c0021e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:02.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.791+0000 7fe0480a3700 1 -- 172.21.15.72:0/2270038673 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe0400c2570 msgr2=0x7fe0400c2950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:02.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.791+0000 7fe0480a3700 1 --2- 172.21.15.72:0/2270038673 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe0400c2570 0x7fe0400c2950 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fe03c0098f0 tx=0x7fe03c009c00 comp rx=0 tx=0).stop 2023-07-25T14:36:02.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.791+0000 7ff4043e7700 1 Processor -- start 2023-07-25T14:36:02.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.791+0000 7ff4043e7700 1 -- start start 2023-07-25T14:36:02.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.791+0000 7fde0e26d700 1 Processor -- start 2023-07-25T14:36:02.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.791+0000 7fe0480a3700 1 -- 172.21.15.72:0/2270038673 shutdown_connections 2023-07-25T14:36:02.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.791+0000 7fe0480a3700 1 --2- 172.21.15.72:0/2270038673 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe0400c04e0 0x7fe04006ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:02.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.791+0000 7fe0480a3700 1 --2- 172.21.15.72:0/2270038673 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe0400c2570 0x7fe0400c2950 secure :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fe03c0098f0 tx=0x7fe03c009c00 comp rx=0 tx=0).stop 2023-07-25T14:36:02.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.791+0000 7fe0480a3700 1 -- 172.21.15.72:0/2270038673 >> 172.21.15.72:0/2270038673 conn(0x7fe0400a78b0 msgr2=0x7fe0400a7c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:02.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.791+0000 7fde0e26d700 1 -- start start 2023-07-25T14:36:02.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.790+0000 7f02995fa700 1 -- start start 2023-07-25T14:36:02.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.791+0000 7f02995fa700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f02940af7d0 0x7f02941f1500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:02.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.791+0000 7f02995fa700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f02940c2530 0x7f02941ef620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:02.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.791+0000 7f02995fa700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0294155ea0 0x7f02941efb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:02.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.791+0000 7f02995fa700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02941f2020 con 0x7f0294155ea0 2023-07-25T14:36:02.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.791+0000 7f02995fa700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02941ef190 con 0x7f02940af7d0 2023-07-25T14:36:02.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.791+0000 7f02995fa700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02941f1d40 con 0x7f02940c2530 2023-07-25T14:36:02.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.792+0000 7f0292ffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f02940af7d0 0x7f02941f1500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:02.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.792+0000 7f0292ffd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f02940af7d0 0x7f02941f1500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.72:35732/0 (socket says 172.21.15.72:35732) 2023-07-25T14:36:02.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.792+0000 7f0292ffd700 1 -- 172.21.15.72:0/2130494750 learned_addr learned my addr 172.21.15.72:0/2130494750 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:02.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.792+0000 7f02927fc700 1 --2- 172.21.15.72:0/2130494750 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f02940c2530 0x7f02941ef620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:02.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.792+0000 7f6f8a7fc700 1 -- 172.21.15.72:0/4118308613 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f8c003c00 con 0x7f6f941504f0 2023-07-25T14:36:02.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.792+0000 7f6f8a7fc700 1 -- 172.21.15.72:0/4118308613 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f8c003d60 con 0x7f6f941504f0 2023-07-25T14:36:02.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.792+0000 7f6f8a7fc700 1 -- 172.21.15.72:0/4118308613 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f8c00abd0 con 0x7f6f941504f0 2023-07-25T14:36:02.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.792+0000 7f02937fe700 1 --2- 172.21.15.72:0/2130494750 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0294155ea0 0x7f02941efb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:02.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.792+0000 7f6f9bbed700 1 -- 172.21.15.72:0/4118308613 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f940bd390 con 0x7f6f941504f0 2023-07-25T14:36:02.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.792+0000 7f6f9bbed700 1 -- 172.21.15.72:0/4118308613 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f940c63b0 con 0x7f6f941504f0 2023-07-25T14:36:02.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.792+0000 7f0292ffd700 1 -- 172.21.15.72:0/2130494750 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f02940c2530 msgr2=0x7f02941ef620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:02.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.792+0000 7f0292ffd700 1 --2- 172.21.15.72:0/2130494750 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f02940c2530 0x7f02941ef620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:02.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.792+0000 7f0292ffd700 1 -- 172.21.15.72:0/2130494750 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0294155ea0 msgr2=0x7f02941efb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:02.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.792+0000 7f0292ffd700 1 --2- 172.21.15.72:0/2130494750 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0294155ea0 0x7f02941efb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:02.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.792+0000 7f0292ffd700 1 -- 172.21.15.72:0/2130494750 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f028c009a70 con 0x7f02940af7d0 2023-07-25T14:36:02.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.792+0000 7ff4043e7700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff3fc089240 0x7ff3fc0ab340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:02.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.792+0000 7ff4043e7700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff3fc0c1d30 0x7ff3fc0bf540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:02.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.792+0000 7ff4043e7700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff3fc0c25c0 0x7ff3fc0bd9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:02.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.792+0000 7ff4043e7700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3fc0aa260 con 0x7ff3fc089240 2023-07-25T14:36:02.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.792+0000 7ff4043e7700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3fc0888c0 con 0x7ff3fc0c1d30 2023-07-25T14:36:02.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.792+0000 7ff4043e7700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3fc0bed80 con 0x7ff3fc0c25c0 2023-07-25T14:36:02.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.792+0000 7fde0e26d700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fde08151b40 0x7fde080c0c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:02.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.792+0000 7ff402984700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff3fc0c25c0 0x7ff3fc0bd9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:02.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.792+0000 7ff402984700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff3fc0c25c0 0x7ff3fc0bd9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3301/0 says I am v2:172.21.15.72:45394/0 (socket says 172.21.15.72:45394) 2023-07-25T14:36:02.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.792+0000 7ff402984700 1 -- 172.21.15.72:0/949859323 learned_addr learned my addr 172.21.15.72:0/949859323 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:02.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.792+0000 7fde0e26d700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde080c1c00 con 0x7fde080c1140 2023-07-25T14:36:02.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.792+0000 7fde0e26d700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde080bac40 con 0x7fde080ba680 2023-07-25T14:36:02.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.792+0000 7fde0e26d700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde08151f20 con 0x7fde08151b40 2023-07-25T14:36:02.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.792+0000 7f0292ffd700 1 --2- 172.21.15.72:0/2130494750 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f02940af7d0 0x7f02941f1500 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f028800d800 tx=0x7f028800db10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:02.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.793+0000 7ff402984700 1 -- 172.21.15.72:0/949859323 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff3fc0c1d30 msgr2=0x7ff3fc0bf540 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-07-25T14:36:02.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.793+0000 7ff402984700 1 --2- 172.21.15.72:0/949859323 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff3fc0c1d30 0x7ff3fc0bf540 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:02.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.793+0000 7ff402984700 1 -- 172.21.15.72:0/949859323 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff3fc089240 msgr2=0x7ff3fc0ab340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:02.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.793+0000 7ff402984700 1 --2- 172.21.15.72:0/949859323 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff3fc089240 0x7ff3fc0ab340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:02.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.793+0000 7ff402984700 1 -- 172.21.15.72:0/949859323 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3f4009a70 con 0x7ff3fc0c25c0 2023-07-25T14:36:02.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.793+0000 7ff402984700 1 --2- 172.21.15.72:0/949859323 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff3fc0c25c0 0x7ff3fc0bd9a0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7ff3fc06d5f0 tx=0x7ff3f4004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:02.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.793+0000 7ff3f2ffd700 1 -- 172.21.15.72:0/949859323 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3f40048e0 con 0x7ff3fc0c25c0 2023-07-25T14:36:02.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.793+0000 7ff3f2ffd700 1 -- 172.21.15.72:0/949859323 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3f4020070 con 0x7ff3fc0c25c0 2023-07-25T14:36:02.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.793+0000 7ff4043e7700 1 -- 172.21.15.72:0/949859323 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3fc0be7c0 con 0x7ff3fc0c25c0 2023-07-25T14:36:02.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.793+0000 7ff3f2ffd700 1 -- 172.21.15.72:0/949859323 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3f40276c0 con 0x7ff3fc0c25c0 2023-07-25T14:36:02.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.794+0000 7ff4043e7700 1 -- 172.21.15.72:0/949859323 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3fc0bd480 con 0x7ff3fc0c25c0 2023-07-25T14:36:02.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.793+0000 7fde07fff700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fde08151b40 0x7fde080c0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:02.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.793+0000 7fde07fff700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fde08151b40 0x7fde080c0c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3301/0 says I am v2:172.21.15.72:45400/0 (socket says 172.21.15.72:45400) 2023-07-25T14:36:02.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.793+0000 7fde07fff700 1 -- 172.21.15.72:0/3094127625 learned_addr learned my addr 172.21.15.72:0/3094127625 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:02.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.793+0000 7fde07fff700 1 -- 172.21.15.72:0/3094127625 >> v1:172.21.15.92:6789/0 conn(0x7fde080ba680 legacy=0x7fde08154430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:02.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.793+0000 7fde07fff700 1 -- 172.21.15.72:0/3094127625 >> v1:172.21.15.72:6789/0 conn(0x7fde080c1140 legacy=0x7fde08154b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:02.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.793+0000 7fde07fff700 1 -- 172.21.15.72:0/3094127625 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde080bae90 con 0x7fde08151b40 2023-07-25T14:36:02.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.793+0000 7fde07fff700 1 --2- 172.21.15.72:0/3094127625 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fde08151b40 0x7fde080c0c00 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fddfc009920 tx=0x7fddfc009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ea9922e02d207786 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:02.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.794+0000 7fde06ffd700 1 -- 172.21.15.72:0/3094127625 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddfc004230 con 0x7fde08151b40 2023-07-25T14:36:02.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.794+0000 7fde06ffd700 1 -- 172.21.15.72:0/3094127625 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddfc004390 con 0x7fde08151b40 2023-07-25T14:36:02.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.794+0000 7fde06ffd700 1 -- 172.21.15.72:0/3094127625 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddfc009e70 con 0x7fde08151b40 2023-07-25T14:36:02.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.793+0000 7fe0480a3700 1 -- 172.21.15.72:0/2270038673 shutdown_connections 2023-07-25T14:36:02.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.793+0000 7fe0480a3700 1 -- 172.21.15.72:0/2270038673 wait complete. 2023-07-25T14:36:02.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.793+0000 7f6f9bbed700 1 -- 172.21.15.72:0/4118308613 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f7c0052f0 con 0x7f6f941504f0 2023-07-25T14:36:02.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.794+0000 7f6f8a7fc700 1 -- 172.21.15.72:0/4118308613 <== mon.2 v2:172.21.15.92:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6f8c00ad30 con 0x7f6f941504f0 2023-07-25T14:36:02.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.794+0000 7f6f8a7fc700 1 --2- 172.21.15.72:0/4118308613 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f6f7806ace0 0x7f6f7806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:02.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.794+0000 7f6f8a7fc700 1 -- 172.21.15.72:0/4118308613 <== mon.2 v2:172.21.15.92:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f6f8c0898a0 con 0x7f6f941504f0 2023-07-25T14:36:02.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.795+0000 7ff3f2ffd700 1 -- 172.21.15.72:0/949859323 <== mon.2 v2:172.21.15.92:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff3f4012430 con 0x7ff3fc0c25c0 2023-07-25T14:36:02.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.795+0000 7fe0480a3700 1 Processor -- start 2023-07-25T14:36:02.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.795+0000 7ff3f2ffd700 1 --2- 172.21.15.72:0/949859323 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7ff3e006ace0 0x7ff3e006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:02.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.796+0000 7ff402183700 1 --2- 172.21.15.72:0/949859323 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7ff3e006ace0 0x7ff3e006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:02.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.796+0000 7ff402183700 1 --2- 172.21.15.72:0/949859323 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7ff3e006ace0 0x7ff3e006d1a0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff3f8006b20 tx=0x7ff3f8004220 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:02.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.795+0000 7fde0e26d700 1 -- 172.21.15.72:0/3094127625 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fde08151b40 msgr2=0x7fde080c0c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:02.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.795+0000 7fde0e26d700 1 --2- 172.21.15.72:0/3094127625 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fde08151b40 0x7fde080c0c00 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fddfc009920 tx=0x7fddfc009c30 comp rx=0 tx=0).stop 2023-07-25T14:36:02.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.796+0000 7fde0e26d700 1 -- 172.21.15.72:0/3094127625 shutdown_connections 2023-07-25T14:36:02.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.796+0000 7fde0e26d700 1 --2- 172.21.15.72:0/3094127625 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fde08151b40 0x7fde080c0c00 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:02.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.796+0000 7fde0e26d700 1 -- 172.21.15.72:0/3094127625 >> 172.21.15.72:0/3094127625 conn(0x7fde080a7860 msgr2=0x7fde080a7c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:02.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.796+0000 7fde0e26d700 1 -- 172.21.15.72:0/3094127625 shutdown_connections 2023-07-25T14:36:02.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.796+0000 7fde0e26d700 1 -- 172.21.15.72:0/3094127625 wait complete. 2023-07-25T14:36:02.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.795+0000 7fe0480a3700 1 -- start start 2023-07-25T14:36:02.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.796+0000 7fe0480a3700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe0400b9290 0x7fe0400bf0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:02.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.796+0000 7fe0480a3700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe0400c04e0 0x7fe0401f18d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:02.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.796+0000 7fe0480a3700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe040155510 0x7fe0400bd640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:02.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.796+0000 7fe0480a3700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0400bec40 con 0x7fe040155510 2023-07-25T14:36:02.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.796+0000 7fe0480a3700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0400bfba0 con 0x7fe0400c04e0 2023-07-25T14:36:02.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.796+0000 7fe0480a3700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0400bf8c0 con 0x7fe0400b9290 2023-07-25T14:36:02.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.795+0000 7f6f99989700 1 --2- 172.21.15.72:0/4118308613 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f6f7806ace0 0x7f6f7806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:02.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.796+0000 7f6f99989700 1 --2- 172.21.15.72:0/4118308613 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f6f7806ace0 0x7f6f7806d1a0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f6f900010e0 tx=0x7f6f900079e0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:02.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.796+0000 7fe046640700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe040155510 0x7fe0400bd640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:02.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.796+0000 7fe046640700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe040155510 0x7fe0400bd640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40186/0 (socket says 172.21.15.72:40186) 2023-07-25T14:36:02.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.796+0000 7fe046640700 1 -- 172.21.15.72:0/1375537816 learned_addr learned my addr 172.21.15.72:0/1375537816 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:02.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.796+0000 7fe045e3f700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe0400b9290 0x7fe0400bf0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:02.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.796+0000 7fe04563e700 1 --2- 172.21.15.72:0/1375537816 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe0400c04e0 0x7fe0401f18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:02.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.796+0000 7ff4043e7700 1 -- 172.21.15.72:0/949859323 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3fc04e470 con 0x7ff3fc0c25c0 2023-07-25T14:36:02.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.797+0000 7fe046640700 1 -- 172.21.15.72:0/1375537816 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe0400b9290 msgr2=0x7fe0400bf0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:02.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.797+0000 7fe046640700 1 --2- 172.21.15.72:0/1375537816 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe0400b9290 0x7fe0400bf0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:02.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.797+0000 7fe046640700 1 -- 172.21.15.72:0/1375537816 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe0400c04e0 msgr2=0x7fe0401f18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:02.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.797+0000 7fe046640700 1 --2- 172.21.15.72:0/1375537816 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe0400c04e0 0x7fe0401f18d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:02.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.797+0000 7fe046640700 1 -- 172.21.15.72:0/1375537816 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe03c009550 con 0x7fe040155510 2023-07-25T14:36:02.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.797+0000 7fe045e3f700 1 --2- 172.21.15.72:0/1375537816 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe0400b9290 0x7fe0400bf0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-25T14:36:02.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.797+0000 7fe046640700 1 --2- 172.21.15.72:0/1375537816 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe040155510 0x7fe0400bd640 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fe03000d800 tx=0x7fe03000db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:02.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.797+0000 7fe0367fc700 1 -- 172.21.15.72:0/1375537816 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe030017070 con 0x7fe040155510 2023-07-25T14:36:02.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.797+0000 7fe0367fc700 1 -- 172.21.15.72:0/1375537816 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe030005a70 con 0x7fe040155510 2023-07-25T14:36:02.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.797+0000 7fe0480a3700 1 -- 172.21.15.72:0/1375537816 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0401f2110 con 0x7fe040155510 2023-07-25T14:36:02.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.797+0000 7fe0367fc700 1 -- 172.21.15.72:0/1375537816 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe030005c00 con 0x7fe040155510 2023-07-25T14:36:02.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.797+0000 7fe0480a3700 1 -- 172.21.15.72:0/1375537816 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0401f1e10 con 0x7fe040155510 2023-07-25T14:36:02.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.798+0000 7fde0e26d700 1 Processor -- start 2023-07-25T14:36:02.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.798+0000 7fe0480a3700 1 -- 172.21.15.72:0/1375537816 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0400bc9d0 con 0x7fe040155510 2023-07-25T14:36:02.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.798+0000 7fde0e26d700 1 -- start start 2023-07-25T14:36:02.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.799+0000 7f027b7fe700 1 -- 172.21.15.72:0/2130494750 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02880125f0 con 0x7f02940af7d0 2023-07-25T14:36:02.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.799+0000 7f027b7fe700 1 -- 172.21.15.72:0/2130494750 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0288012750 con 0x7f02940af7d0 2023-07-25T14:36:02.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.799+0000 7f02995fa700 1 -- 172.21.15.72:0/2130494750 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0294151110 con 0x7f02940af7d0 2023-07-25T14:36:02.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.799+0000 7fde0e26d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fde080ba680 0x7fde0814aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:02.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.799+0000 7fde0e26d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fde080c1140 0x7fde081500e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:02.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.799+0000 7fde0e26d700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fde08151b40 0x7fde080c3520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:02.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.799+0000 7fde0e26d700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde081ed580 con 0x7fde080c1140 2023-07-25T14:36:02.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.799+0000 7fde0e26d700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde081ed7d0 con 0x7fde080ba680 2023-07-25T14:36:02.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.799+0000 7fde0e26d700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde081edab0 con 0x7fde08151b40 2023-07-25T14:36:02.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.799+0000 7fde07fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fde080ba680 0x7fde0814aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:02.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.799+0000 7fde077fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fde080c1140 0x7fde081500e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:02.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.799+0000 7fde07fff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fde080ba680 0x7fde0814aad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.72:35760/0 (socket says 172.21.15.72:35760) 2023-07-25T14:36:02.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.799+0000 7fde07fff700 1 -- 172.21.15.72:0/1575956606 learned_addr learned my addr 172.21.15.72:0/1575956606 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:02.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.799+0000 7fde0c80a700 1 --2- 172.21.15.72:0/1575956606 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fde08151b40 0x7fde080c3520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:02.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.799+0000 7fde07fff700 1 -- 172.21.15.72:0/1575956606 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fde08151b40 msgr2=0x7fde080c3520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:02.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.799+0000 7fde07fff700 1 --2- 172.21.15.72:0/1575956606 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fde08151b40 0x7fde080c3520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:02.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.799+0000 7fde07fff700 1 -- 172.21.15.72:0/1575956606 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fde080c1140 msgr2=0x7fde081500e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:02.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.799+0000 7fde07fff700 1 --2- 172.21.15.72:0/1575956606 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fde080c1140 0x7fde081500e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:02.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.799+0000 7fde07fff700 1 -- 172.21.15.72:0/1575956606 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddfc009550 con 0x7fde080ba680 2023-07-25T14:36:02.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.800+0000 7f6f8a7fc700 1 -- 172.21.15.72:0/4118308613 <== mon.2 v2:172.21.15.92:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f6f8c054650 con 0x7f6f941504f0 2023-07-25T14:36:02.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.800+0000 7fde07fff700 1 --2- 172.21.15.72:0/1575956606 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fde080ba680 0x7fde0814aad0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fddfc009870 tx=0x7fddfc004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:02.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.799+0000 7f02995fa700 1 -- 172.21.15.72:0/2130494750 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02941f1a40 con 0x7f02940af7d0 2023-07-25T14:36:02.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.800+0000 7fde04ff9700 1 -- 172.21.15.72:0/1575956606 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddfc00bea0 con 0x7fde080ba680 2023-07-25T14:36:02.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.800+0000 7f027b7fe700 1 -- 172.21.15.72:0/2130494750 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0288012b00 con 0x7f02940af7d0 2023-07-25T14:36:02.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.800+0000 7fe0367fc700 1 -- 172.21.15.72:0/1375537816 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe0300125f0 con 0x7fe040155510 2023-07-25T14:36:02.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.801+0000 7fe0367fc700 1 --2- 172.21.15.72:0/1375537816 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fe02c06adf0 0x7fe02c06d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:02.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.801+0000 7fe0367fc700 1 -- 172.21.15.72:0/1375537816 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fe030088ff0 con 0x7fe040155510 2023-07-25T14:36:02.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.800+0000 7fde0e26d700 1 -- 172.21.15.72:0/1575956606 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde081edd90 con 0x7fde080ba680 2023-07-25T14:36:02.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.800+0000 7fde0e26d700 1 -- 172.21.15.72:0/1575956606 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde08150620 con 0x7fde080ba680 2023-07-25T14:36:02.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.800+0000 7fde04ff9700 1 -- 172.21.15.72:0/1575956606 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddfc0036a0 con 0x7fde080ba680 2023-07-25T14:36:02.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.800+0000 7fde04ff9700 1 -- 172.21.15.72:0/1575956606 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddfc003a30 con 0x7fde080ba680 2023-07-25T14:36:02.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.801+0000 7fe045e3f700 1 --2- 172.21.15.72:0/1375537816 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fe02c06adf0 0x7fe02c06d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:02.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.801+0000 7ff3f2ffd700 1 -- 172.21.15.72:0/949859323 <== mon.2 v2:172.21.15.92:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7ff3f4022070 con 0x7ff3fc0c25c0 2023-07-25T14:36:02.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.802+0000 7fe045e3f700 1 --2- 172.21.15.72:0/1375537816 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fe02c06adf0 0x7fe02c06d2b0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fe0400c3470 tx=0x7fe03c008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:02.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.801+0000 7f027b7fe700 1 -- 172.21.15.72:0/2130494750 <== mon.1 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0288012ca0 con 0x7f02940af7d0 2023-07-25T14:36:02.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.801+0000 7f02995fa700 1 -- 172.21.15.72:0/2130494750 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02740052f0 con 0x7f02940af7d0 2023-07-25T14:36:02.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.802+0000 7f027b7fe700 1 --2- 172.21.15.72:0/2130494750 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f028006ade0 0x7f028006d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:02.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.802+0000 7f027b7fe700 1 -- 172.21.15.72:0/2130494750 <== mon.1 v2:172.21.15.92:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f0288089a00 con 0x7f02940af7d0 2023-07-25T14:36:02.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.802+0000 7f02927fc700 1 --2- 172.21.15.72:0/2130494750 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f028006ade0 0x7f028006d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:02.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.802+0000 7f02927fc700 1 --2- 172.21.15.72:0/2130494750 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f028006ade0 0x7f028006d2a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f0284001eb0 tx=0x7f0284001730 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:02.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.803+0000 7f6a6b942700 1 Processor -- start 2023-07-25T14:36:02.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.803+0000 7f6a6b942700 1 -- start start 2023-07-25T14:36:02.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.804+0000 7f6a6b942700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6a640c27e0 0x7f6a6406cd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:02.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.804+0000 7f6a6b942700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f6a6406e770 0x7f6a641578f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:02.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.804+0000 7f6a6b942700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a64154ce0 con 0x7f6a640c04e0 2023-07-25T14:36:02.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.804+0000 7f6a6b942700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a640c59a0 con 0x7f6a6406e770 2023-07-25T14:36:02.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.804+0000 7f6a6b942700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a640c51f0 con 0x7f6a640c27e0 2023-07-25T14:36:02.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.804+0000 7f6a69edf700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f6a640c04e0 0x7f6a64071830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:59168/0 (socket says 172.21.15.72:59168) 2023-07-25T14:36:02.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.804+0000 7f6a69edf700 1 -- 172.21.15.72:0/1988109815 learned_addr learned my addr 172.21.15.72:0/1988109815 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:36:02.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.804+0000 7f6a696de700 1 --2- 172.21.15.72:0/1988109815 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6a640c27e0 0x7f6a6406cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:02.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.804+0000 7f6a68edd700 1 --2- 172.21.15.72:0/1988109815 >> v2:172.21.15.92:3300/0 conn(0x7f6a6406e770 0x7f6a641578f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:02.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.804+0000 7f6a696de700 1 -- 172.21.15.72:0/1988109815 >> v2:172.21.15.92:3300/0 conn(0x7f6a6406e770 msgr2=0x7f6a641578f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:02.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.804+0000 7f6a696de700 1 --2- 172.21.15.72:0/1988109815 >> v2:172.21.15.92:3300/0 conn(0x7f6a6406e770 0x7f6a641578f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:02.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.804+0000 7f6a696de700 1 -- 172.21.15.72:0/1988109815 >> v1:172.21.15.72:6789/0 conn(0x7f6a640c04e0 legacy=0x7f6a64071830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:02.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.804+0000 7f6a696de700 1 -- 172.21.15.72:0/1988109815 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a64154f60 con 0x7f6a640c27e0 2023-07-25T14:36:02.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.804+0000 7f6a696de700 1 --2- 172.21.15.72:0/1988109815 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6a640c27e0 0x7f6a6406cd70 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f6a60009840 tx=0x7f6a60009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b413351f61bf3f82 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:02.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.805+0000 7f6a5bfff700 1 -- 172.21.15.72:0/1988109815 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a60011830 con 0x7f6a640c27e0 2023-07-25T14:36:02.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.805+0000 7f6a5bfff700 1 -- 172.21.15.72:0/1988109815 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a60011990 con 0x7f6a640c27e0 2023-07-25T14:36:02.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.805+0000 7ff3f2ffd700 1 -- 172.21.15.72:0/949859323 <== mon.2 v2:172.21.15.92:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7ff3f40555d0 con 0x7ff3fc0c25c0 2023-07-25T14:36:02.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.805+0000 7f6a5bfff700 1 -- 172.21.15.72:0/1988109815 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a60011d20 con 0x7f6a640c27e0 2023-07-25T14:36:02.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.805+0000 7f6a6b942700 1 -- 172.21.15.72:0/1988109815 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6a640c27e0 msgr2=0x7f6a6406cd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:02.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.805+0000 7f6a6b942700 1 --2- 172.21.15.72:0/1988109815 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6a640c27e0 0x7f6a6406cd70 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f6a60009840 tx=0x7f6a60009b50 comp rx=0 tx=0).stop 2023-07-25T14:36:02.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.805+0000 7f6a6b942700 1 -- 172.21.15.72:0/1988109815 shutdown_connections 2023-07-25T14:36:02.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.805+0000 7f6a6b942700 1 --2- 172.21.15.72:0/1988109815 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6a640c27e0 0x7f6a6406cd70 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:02.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.805+0000 7f6a6b942700 1 --2- 172.21.15.72:0/1988109815 >> v2:172.21.15.92:3300/0 conn(0x7f6a6406e770 0x7f6a641578f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:02.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.805+0000 7f6a6b942700 1 -- 172.21.15.72:0/1988109815 >> 172.21.15.72:0/1988109815 conn(0x7f6a640a78b0 msgr2=0x7f6a640a7c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:02.858 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.805+0000 7fde0e26d700 1 -- 172.21.15.72:0/1575956606 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdde80052f0 con 0x7fde080ba680 2023-07-25T14:36:02.858 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.807+0000 7fde04ff9700 1 -- 172.21.15.72:0/1575956606 <== mon.1 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fddfc022070 con 0x7fde080ba680 2023-07-25T14:36:02.858 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.807+0000 7f6a6b942700 1 -- 172.21.15.72:0/1988109815 shutdown_connections 2023-07-25T14:36:02.858 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.807+0000 7f63d90bc700 1 Processor -- start 2023-07-25T14:36:02.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.807+0000 7fde04ff9700 1 --2- 172.21.15.72:0/1575956606 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fddf406ace0 0x7fddf406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:02.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.807+0000 7fde04ff9700 1 -- 172.21.15.72:0/1575956606 <== mon.1 v2:172.21.15.92:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fddfc08b400 con 0x7fde080ba680 2023-07-25T14:36:02.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.808+0000 7f6a6b942700 1 -- 172.21.15.72:0/1988109815 wait complete. 2023-07-25T14:36:02.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.807+0000 7f63d90bc700 1 -- start start 2023-07-25T14:36:02.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.808+0000 7f63d90bc700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f63d41504f0 0x7f63d4153fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:02.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.808+0000 7f63d90bc700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f63d40c17b0 0x7f63d4154520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:02.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.808+0000 7f63d90bc700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63d4153b00 con 0x7f63d414db20 2023-07-25T14:36:02.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.808+0000 7f63d90bc700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63d40c0aa0 con 0x7f63d41504f0 2023-07-25T14:36:02.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.808+0000 7f63d90bc700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63d40c0d80 con 0x7f63d40c17b0 2023-07-25T14:36:02.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.809+0000 7fde077fe700 1 --2- 172.21.15.72:0/1575956606 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fddf406ace0 0x7fddf406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:02.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.809+0000 7f63d359e700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f63d40c17b0 0x7f63d4154520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:02.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.809+0000 7f63d359e700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f63d40c17b0 0x7f63d4154520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3301/0 says I am v2:172.21.15.72:45436/0 (socket says 172.21.15.72:45436) 2023-07-25T14:36:02.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.809+0000 7f63d359e700 1 -- 172.21.15.72:0/3848860943 learned_addr learned my addr 172.21.15.72:0/3848860943 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:02.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.809+0000 7f027b7fe700 1 -- 172.21.15.72:0/2130494750 <== mon.1 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f0288054830 con 0x7f02940af7d0 2023-07-25T14:36:02.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.809+0000 7f63d359e700 1 -- 172.21.15.72:0/3848860943 >> v2:172.21.15.92:3300/0 conn(0x7f63d41504f0 msgr2=0x7f63d4153fe0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-25T14:36:02.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.809+0000 7f63d359e700 1 --2- 172.21.15.72:0/3848860943 >> v2:172.21.15.92:3300/0 conn(0x7f63d41504f0 0x7f63d4153fe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:02.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.809+0000 7f63d359e700 1 -- 172.21.15.72:0/3848860943 >> v1:172.21.15.92:6789/0 conn(0x7f63d414db20 legacy=0x7f63d40bad70 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-25T14:36:02.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.809+0000 7f63d359e700 1 -- 172.21.15.72:0/3848860943 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63d40c1060 con 0x7f63d40c17b0 2023-07-25T14:36:02.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.809+0000 7fde077fe700 1 --2- 172.21.15.72:0/1575956606 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fddf406ace0 0x7fddf406d1a0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fde00009fd0 tx=0x7fde0000d040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:02.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.810+0000 7fe0367fc700 1 -- 172.21.15.72:0/1375537816 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fe0300578d0 con 0x7fe040155510 2023-07-25T14:36:02.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.810+0000 7f6a6b942700 1 Processor -- start 2023-07-25T14:36:02.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.810+0000 7f6a6b942700 1 -- start start 2023-07-25T14:36:02.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.811+0000 7f6a6b942700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6a6406e770 0x7f6a640a6af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:02.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.811+0000 7f6a6b942700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6a640c04e0 0x7f6a640aa330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:02.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.811+0000 7f6a6b942700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6a640c27e0 0x7f6a641f3450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:02.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.811+0000 7f6a6b942700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a641f6390 con 0x7f6a6406e770 2023-07-25T14:36:02.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.811+0000 7f6a6b942700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a641f6650 con 0x7f6a640c04e0 2023-07-25T14:36:02.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.811+0000 7f6a6b942700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a641f6930 con 0x7f6a640c27e0 2023-07-25T14:36:02.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.812+0000 7fb0545af700 1 Processor -- start 2023-07-25T14:36:02.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.812+0000 7fb0545af700 1 -- start start 2023-07-25T14:36:02.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.814+0000 7fb0545af700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fb04c0bf6a0 0x7fb04c1515a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:02.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.814+0000 7fb0545af700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb04c1553e0 con 0x7fb04c072140 2023-07-25T14:36:02.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.814+0000 7fb0545af700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb04c154640 con 0x7fb04c0c0370 2023-07-25T14:36:02.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.814+0000 7fb0545af700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb04c0660c0 con 0x7fb04c0bf6a0 2023-07-25T14:36:02.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.814+0000 7fb05234b700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fb04c0bf6a0 0x7fb04c1515a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:02.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.814+0000 7fb05234b700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fb04c0bf6a0 0x7fb04c1515a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.72:35784/0 (socket says 172.21.15.72:35784) 2023-07-25T14:36:02.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.814+0000 7fb05234b700 1 -- 172.21.15.72:0/4281039179 learned_addr learned my addr 172.21.15.72:0/4281039179 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:02.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.814+0000 7fb051b4a700 1 --1- 172.21.15.72:0/4281039179 >> v1:172.21.15.72:6789/0 conn(0x7fb04c072140 0x7fb04c06a190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:59184/0 (socket says 172.21.15.72:59184) 2023-07-25T14:36:02.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.814+0000 7fb05234b700 1 -- 172.21.15.72:0/4281039179 >> v1:172.21.15.92:6789/0 conn(0x7fb04c0c0370 legacy=0x7fb04c15edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:02.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.814+0000 7fb051349700 1 -- 172.21.15.72:0/4281039179 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4260048822 0 0) 0x7fb04c1553e0 con 0x7fb04c072140 2023-07-25T14:36:02.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.814+0000 7fb05234b700 1 -- 172.21.15.72:0/4281039179 >> v1:172.21.15.72:6789/0 conn(0x7fb04c072140 legacy=0x7fb04c06a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:02.868 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.814+0000 7fb05234b700 1 -- 172.21.15.72:0/4281039179 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb04c154920 con 0x7fb04c0bf6a0 2023-07-25T14:36:02.868 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.814+0000 7fb05234b700 1 --2- 172.21.15.72:0/4281039179 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb04c0bf6a0 0x7fb04c1515a0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fb03c0098f0 tx=0x7fb03c009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=86b44dc733eda63d server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:02.868 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.815+0000 7fb051349700 1 -- 172.21.15.72:0/4281039179 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb03c004230 con 0x7fb04c0bf6a0 2023-07-25T14:36:02.868 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.815+0000 7fb051349700 1 -- 172.21.15.72:0/4281039179 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb03c004390 con 0x7fb04c0bf6a0 2023-07-25T14:36:02.868 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.815+0000 7fb051349700 1 -- 172.21.15.72:0/4281039179 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb03c0036a0 con 0x7fb04c0bf6a0 2023-07-25T14:36:02.868 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.815+0000 7fb0545af700 1 -- 172.21.15.72:0/4281039179 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb04c0bf6a0 msgr2=0x7fb04c1515a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:02.868 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.815+0000 7fb0545af700 1 --2- 172.21.15.72:0/4281039179 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb04c0bf6a0 0x7fb04c1515a0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fb03c0098f0 tx=0x7fb03c009c00 comp rx=0 tx=0).stop 2023-07-25T14:36:02.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.817+0000 7f6a696de700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6a6406e770 0x7f6a640a6af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:02.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.817+0000 7f6a696de700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6a6406e770 0x7f6a640a6af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40220/0 (socket says 172.21.15.72:40220) 2023-07-25T14:36:02.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.817+0000 7f6a696de700 1 -- 172.21.15.72:0/2218233898 learned_addr learned my addr 172.21.15.72:0/2218233898 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:02.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.817+0000 7f6a68edd700 1 --2- 172.21.15.72:0/2218233898 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6a640c04e0 0x7f6a640aa330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:02.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.817+0000 7f6a696de700 1 -- 172.21.15.72:0/2218233898 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6a640c27e0 msgr2=0x7f6a641f3450 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-25T14:36:02.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.817+0000 7f6a696de700 1 --2- 172.21.15.72:0/2218233898 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6a640c27e0 0x7f6a641f3450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:02.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.817+0000 7f6a696de700 1 -- 172.21.15.72:0/2218233898 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6a640c04e0 msgr2=0x7f6a640aa330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:02.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.817+0000 7f6a696de700 1 --2- 172.21.15.72:0/2218233898 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6a640c04e0 0x7f6a640aa330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:02.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.817+0000 7f6a696de700 1 -- 172.21.15.72:0/2218233898 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a600094a0 con 0x7f6a6406e770 2023-07-25T14:36:02.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.817+0000 7f6a696de700 1 --2- 172.21.15.72:0/2218233898 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6a6406e770 0x7f6a640a6af0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f6a60009fd0 tx=0x7f6a60004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:02.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.817+0000 7f6a59ffb700 1 -- 172.21.15.72:0/2218233898 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a600045d0 con 0x7f6a6406e770 2023-07-25T14:36:02.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.818+0000 7f6a59ffb700 1 -- 172.21.15.72:0/2218233898 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a6001e070 con 0x7f6a6406e770 2023-07-25T14:36:02.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.818+0000 7f6a59ffb700 1 -- 172.21.15.72:0/2218233898 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a600038a0 con 0x7f6a6406e770 2023-07-25T14:36:02.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.818+0000 7f6a6b942700 1 -- 172.21.15.72:0/2218233898 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a641f6c10 con 0x7f6a6406e770 2023-07-25T14:36:02.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.818+0000 7f6a6b942700 1 -- 172.21.15.72:0/2218233898 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a640a7030 con 0x7f6a6406e770 2023-07-25T14:36:02.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.819+0000 7f6a4f7fe700 1 -- 172.21.15.72:0/2218233898 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a3c0052f0 con 0x7f6a6406e770 2023-07-25T14:36:02.872 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.812+0000 7fde04ff9700 1 -- 172.21.15.72:0/1575956606 <== mon.1 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fddfc0561b0 con 0x7fde080ba680 2023-07-25T14:36:02.872 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.821+0000 7f6a59ffb700 1 -- 172.21.15.72:0/2218233898 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6a60003a00 con 0x7f6a6406e770 2023-07-25T14:36:02.872 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.821+0000 7f6a59ffb700 1 --2- 172.21.15.72:0/2218233898 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f6a4806ace0 0x7f6a4806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:02.872 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.821+0000 7f6a59ffb700 1 -- 172.21.15.72:0/2218233898 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f6a6008aab0 con 0x7f6a6406e770 2023-07-25T14:36:02.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.823+0000 7fb0545af700 1 -- 172.21.15.72:0/4281039179 shutdown_connections 2023-07-25T14:36:02.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.823+0000 7fb0545af700 1 --2- 172.21.15.72:0/4281039179 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb04c0bf6a0 0x7fb04c1515a0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:02.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.823+0000 7fb0545af700 1 -- 172.21.15.72:0/4281039179 >> 172.21.15.72:0/4281039179 conn(0x7fb04c06dd10 msgr2=0x7fb04c06e120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:02.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.823+0000 7f6a68edd700 1 --2- 172.21.15.72:0/2218233898 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f6a4806ace0 0x7f6a4806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:02.874 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.824+0000 7f6a68edd700 1 --2- 172.21.15.72:0/2218233898 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f6a4806ace0 0x7f6a4806d1a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f6a641f41d0 tx=0x7f6a54009210 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:02.874 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.825+0000 7f6a59ffb700 1 -- 172.21.15.72:0/2218233898 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f6a600559e0 con 0x7f6a6406e770 2023-07-25T14:36:02.874 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.809+0000 7f63d359e700 1 --2- 172.21.15.72:0/3848860943 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f63d40c17b0 0x7f63d4154520 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f63c80088f0 tx=0x7f63c800d330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fbd722a5e2eeca72 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:02.874 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.820+0000 7f63d1d9b700 1 -- 172.21.15.72:0/3848860943 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63c8010070 con 0x7f63d40c17b0 2023-07-25T14:36:02.874 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.820+0000 7f63d1d9b700 1 -- 172.21.15.72:0/3848860943 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63c800da40 con 0x7f63d40c17b0 2023-07-25T14:36:02.874 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.820+0000 7f63d1d9b700 1 -- 172.21.15.72:0/3848860943 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63c800ddd0 con 0x7f63d40c17b0 2023-07-25T14:36:02.875 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.821+0000 7f63d90bc700 1 -- 172.21.15.72:0/3848860943 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f63d40c17b0 msgr2=0x7f63d4154520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:02.875 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.821+0000 7f63d90bc700 1 --2- 172.21.15.72:0/3848860943 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f63d40c17b0 0x7f63d4154520 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f63c80088f0 tx=0x7f63c800d330 comp rx=0 tx=0).stop 2023-07-25T14:36:02.875 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.821+0000 7f63d90bc700 1 -- 172.21.15.72:0/3848860943 shutdown_connections 2023-07-25T14:36:02.875 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.821+0000 7f63d90bc700 1 --2- 172.21.15.72:0/3848860943 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f63d40c17b0 0x7f63d4154520 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:02.875 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.821+0000 7f63d90bc700 1 --2- 172.21.15.72:0/3848860943 >> v2:172.21.15.92:3300/0 conn(0x7f63d41504f0 0x7f63d4153fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:02.875 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.821+0000 7f63d90bc700 1 -- 172.21.15.72:0/3848860943 >> 172.21.15.72:0/3848860943 conn(0x7f63d40a7860 msgr2=0x7f63d40a7c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:02.875 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.821+0000 7f63d90bc700 1 -- 172.21.15.72:0/3848860943 shutdown_connections 2023-07-25T14:36:02.876 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.821+0000 7f63d90bc700 1 -- 172.21.15.72:0/3848860943 wait complete. 2023-07-25T14:36:02.876 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.823+0000 7f63d90bc700 1 Processor -- start 2023-07-25T14:36:02.876 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.823+0000 7f63d90bc700 1 -- start start 2023-07-25T14:36:02.876 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.825+0000 7f63d90bc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f63d40c17b0 0x7f63d4071f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:02.876 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.825+0000 7f63d90bc700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f63d414db20 0x7f63d413cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:02.876 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.825+0000 7f63d90bc700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f63d41504f0 0x7f63d413d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:02.876 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.825+0000 7f63d90bc700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63d40c5ed0 con 0x7f63d40c17b0 2023-07-25T14:36:02.876 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.825+0000 7f63d90bc700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63d40c3650 con 0x7f63d41504f0 2023-07-25T14:36:02.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.825+0000 7f63d90bc700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63d40c3930 con 0x7f63d414db20 2023-07-25T14:36:02.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.825+0000 7f63d259c700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f63d414db20 0x7f63d413cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:02.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.825+0000 7f63d259c700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f63d414db20 0x7f63d413cff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3301/0 says I am v2:172.21.15.72:45452/0 (socket says 172.21.15.72:45452) 2023-07-25T14:36:02.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.825+0000 7f63d259c700 1 -- 172.21.15.72:0/3977420073 learned_addr learned my addr 172.21.15.72:0/3977420073 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:02.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.826+0000 7f63d259c700 1 -- 172.21.15.72:0/3977420073 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f63d41504f0 msgr2=0x7f63d413d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:02.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.826+0000 7f63d259c700 1 --2- 172.21.15.72:0/3977420073 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f63d41504f0 0x7f63d413d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:02.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.826+0000 7f63d259c700 1 -- 172.21.15.72:0/3977420073 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f63d40c17b0 msgr2=0x7f63d4071f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:02.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.826+0000 7f63d259c700 1 --2- 172.21.15.72:0/3977420073 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f63d40c17b0 0x7f63d4071f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:02.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.826+0000 7f63d259c700 1 -- 172.21.15.72:0/3977420073 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63c80085d0 con 0x7f63d414db20 2023-07-25T14:36:02.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.826+0000 7f63d259c700 1 --2- 172.21.15.72:0/3977420073 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f63d414db20 0x7f63d413cff0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f63c400b470 tx=0x7f63c400b830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:02.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.826+0000 7f63bb7fe700 1 -- 172.21.15.72:0/3977420073 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63c4055640 con 0x7f63d414db20 2023-07-25T14:36:02.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.826+0000 7f63bb7fe700 1 -- 172.21.15.72:0/3977420073 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63c40557c0 con 0x7f63d414db20 2023-07-25T14:36:02.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.826+0000 7f63d90bc700 1 -- 172.21.15.72:0/3977420073 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63d40c3c10 con 0x7f63d414db20 2023-07-25T14:36:02.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.826+0000 7f63bb7fe700 1 -- 172.21.15.72:0/3977420073 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63c4055b70 con 0x7f63d414db20 2023-07-25T14:36:02.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.826+0000 7f63d90bc700 1 -- 172.21.15.72:0/3977420073 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63d40c3ef0 con 0x7f63d414db20 2023-07-25T14:36:02.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.828+0000 7f63bb7fe700 1 -- 172.21.15.72:0/3977420073 <== mon.2 v2:172.21.15.92:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f63c4055cd0 con 0x7f63d414db20 2023-07-25T14:36:02.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.829+0000 7f63d90bc700 1 -- 172.21.15.72:0/3977420073 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63d413cd10 con 0x7f63d414db20 2023-07-25T14:36:02.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.829+0000 7f63bb7fe700 1 --2- 172.21.15.72:0/3977420073 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f63c006ace0 0x7f63c006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:02.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.829+0000 7f63bb7fe700 1 -- 172.21.15.72:0/3977420073 <== mon.2 v2:172.21.15.92:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f63c40cd580 con 0x7f63d414db20 2023-07-25T14:36:02.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.832+0000 7f63d2d9d700 1 --2- 172.21.15.72:0/3977420073 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f63c006ace0 0x7f63c006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:02.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.837+0000 7fb0545af700 1 -- 172.21.15.72:0/4281039179 shutdown_connections 2023-07-25T14:36:02.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.832+0000 7f63d2d9d700 1 --2- 172.21.15.72:0/3977420073 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f63c006ace0 0x7f63c006d1a0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f63d406ad50 tx=0x7f63cc009250 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:02.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.834+0000 7f63bb7fe700 1 -- 172.21.15.72:0/3977420073 <== mon.2 v2:172.21.15.92:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f63d413cd10 con 0x7f63d414db20 2023-07-25T14:36:02.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.845+0000 7fb0545af700 1 -- 172.21.15.72:0/4281039179 wait complete. 2023-07-25T14:36:02.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.846+0000 7fb0545af700 1 Processor -- start 2023-07-25T14:36:02.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.847+0000 7fb0545af700 1 -- start start 2023-07-25T14:36:02.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.848+0000 7fb0545af700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb04c072140 0x7fb04c14b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:02.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.848+0000 7fb0545af700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb04c0bf6a0 0x7fb04c157b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:02.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.848+0000 7fb0545af700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb04c0c0370 0x7fb04c1f6610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:02.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.848+0000 7fb0545af700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb04c14b880 con 0x7fb04c0bf6a0 2023-07-25T14:36:02.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.848+0000 7fb0545af700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb04c14ad10 con 0x7fb04c0c0370 2023-07-25T14:36:02.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.848+0000 7fb0545af700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb04c1472c0 con 0x7fb04c072140 2023-07-25T14:36:02.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.848+0000 7fb051b4a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb04c0bf6a0 0x7fb04c157b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:02.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.848+0000 7fb051b4a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb04c0bf6a0 0x7fb04c157b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40236/0 (socket says 172.21.15.72:40236) 2023-07-25T14:36:02.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.848+0000 7fb051b4a700 1 -- 172.21.15.72:0/2481276141 learned_addr learned my addr 172.21.15.72:0/2481276141 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:02.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.849+0000 7fb051b4a700 1 -- 172.21.15.72:0/2481276141 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb04c072140 msgr2=0x7fb04c14b340 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-07-25T14:36:02.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.849+0000 7fb051b4a700 1 --2- 172.21.15.72:0/2481276141 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb04c072140 0x7fb04c14b340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:02.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.849+0000 7fb051b4a700 1 -- 172.21.15.72:0/2481276141 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb04c0c0370 msgr2=0x7fb04c1f6610 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-07-25T14:36:02.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.849+0000 7fb051b4a700 1 --2- 172.21.15.72:0/2481276141 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb04c0c0370 0x7fb04c1f6610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:02.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.849+0000 7fb051b4a700 1 -- 172.21.15.72:0/2481276141 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb03c009550 con 0x7fb04c0bf6a0 2023-07-25T14:36:02.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.849+0000 7fb051b4a700 1 --2- 172.21.15.72:0/2481276141 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb04c0bf6a0 0x7fb04c157b20 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fb048001eb0 tx=0x7fb04800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:02.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.850+0000 7fb042ffd700 1 -- 172.21.15.72:0/2481276141 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb048004c80 con 0x7fb04c0bf6a0 2023-07-25T14:36:02.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.850+0000 7fb042ffd700 1 -- 172.21.15.72:0/2481276141 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb048004de0 con 0x7fb04c0bf6a0 2023-07-25T14:36:02.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.850+0000 7fb042ffd700 1 -- 172.21.15.72:0/2481276141 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb048007310 con 0x7fb04c0bf6a0 2023-07-25T14:36:02.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.850+0000 7fb0545af700 1 -- 172.21.15.72:0/2481276141 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb04c1475a0 con 0x7fb04c0bf6a0 2023-07-25T14:36:02.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.850+0000 7fb0545af700 1 -- 172.21.15.72:0/2481276141 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb04c157320 con 0x7fb04c0bf6a0 2023-07-25T14:36:02.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.852+0000 7fb042ffd700 1 -- 172.21.15.72:0/2481276141 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb048007470 con 0x7fb04c0bf6a0 2023-07-25T14:36:02.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.853+0000 7fb042ffd700 1 --2- 172.21.15.72:0/2481276141 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fb03806aec0 0x7fb03806d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:02.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.853+0000 7fb042ffd700 1 -- 172.21.15.72:0/2481276141 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fb0480894e0 con 0x7fb04c0bf6a0 2023-07-25T14:36:02.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.854+0000 7fb0545af700 1 -- 172.21.15.72:0/2481276141 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0340052f0 con 0x7fb04c0bf6a0 2023-07-25T14:36:02.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.860+0000 7fb05234b700 1 --2- 172.21.15.72:0/2481276141 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fb03806aec0 0x7fb03806d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:02.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.860+0000 7fb05234b700 1 --2- 172.21.15.72:0/2481276141 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fb03806aec0 0x7fb03806d380 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fb03c000c00 tx=0x7fb03c008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:02.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:02.865+0000 7fb042ffd700 1 -- 172.21.15.72:0/2481276141 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fb048054280 con 0x7fb04c0bf6a0 2023-07-25T14:36:03.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:03.180+0000 7ff4043e7700 1 -- 172.21.15.72:0/949859323 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ff3fc163bb0 con 0x7ff3fc0c25c0 2023-07-25T14:36:03.196 INFO:teuthology.orchestra.run.smithi072.stdout:55834574855 2023-07-25T14:36:03.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:03.181+0000 7ff3f2ffd700 1 -- 172.21.15.72:0/949859323 <== mon.2 v2:172.21.15.92:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff3f4058bf0 con 0x7ff3fc0c25c0 2023-07-25T14:36:03.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:03.185+0000 7ff4043e7700 1 -- 172.21.15.72:0/949859323 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7ff3e006ace0 msgr2=0x7ff3e006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:03.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:03.185+0000 7ff4043e7700 1 --2- 172.21.15.72:0/949859323 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7ff3e006ace0 0x7ff3e006d1a0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff3f8006b20 tx=0x7ff3f8004220 comp rx=0 tx=0).stop 2023-07-25T14:36:03.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:03.185+0000 7ff4043e7700 1 -- 172.21.15.72:0/949859323 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff3fc0c25c0 msgr2=0x7ff3fc0bd9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:03.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:03.185+0000 7ff4043e7700 1 --2- 172.21.15.72:0/949859323 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff3fc0c25c0 0x7ff3fc0bd9a0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7ff3fc06d5f0 tx=0x7ff3f4004ad0 comp rx=0 tx=0).stop 2023-07-25T14:36:03.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:03.185+0000 7ff4043e7700 1 -- 172.21.15.72:0/949859323 shutdown_connections 2023-07-25T14:36:03.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:03.185+0000 7ff4043e7700 1 --2- 172.21.15.72:0/949859323 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7ff3e006ace0 0x7ff3e006d1a0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:03.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:03.185+0000 7ff4043e7700 1 --2- 172.21.15.72:0/949859323 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff3fc0c25c0 0x7ff3fc0bd9a0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:03.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:03.185+0000 7ff4043e7700 1 --2- 172.21.15.72:0/949859323 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff3fc089240 0x7ff3fc0ab340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:03.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:03.185+0000 7ff4043e7700 1 --2- 172.21.15.72:0/949859323 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff3fc0c1d30 0x7ff3fc0bf540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:03.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:03.185+0000 7ff4043e7700 1 -- 172.21.15.72:0/949859323 >> 172.21.15.72:0/949859323 conn(0x7ff3fc0a7860 msgr2=0x7ff3fc162c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:03.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:03.185+0000 7ff4043e7700 1 -- 172.21.15.72:0/949859323 shutdown_connections 2023-07-25T14:36:03.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:03.185+0000 7ff4043e7700 1 -- 172.21.15.72:0/949859323 wait complete. 2023-07-25T14:36:03.216 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574855 for osd.1 2023-07-25T14:36:03.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:03.203+0000 7f6f9bbed700 1 -- 172.21.15.72:0/4118308613 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f6f7c0055a0 con 0x7f6f941504f0 2023-07-25T14:36:03.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:03.204+0000 7f6f8a7fc700 1 -- 172.21.15.72:0/4118308613 <== mon.2 v2:172.21.15.92:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6f8c057c70 con 0x7f6f941504f0 2023-07-25T14:36:03.217 INFO:teuthology.orchestra.run.smithi072.stdout:55834574855 2023-07-25T14:36:03.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:03.207+0000 7f6f9bbed700 1 -- 172.21.15.72:0/4118308613 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f6f7806ace0 msgr2=0x7f6f7806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:03.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:03.207+0000 7f6f9bbed700 1 --2- 172.21.15.72:0/4118308613 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f6f7806ace0 0x7f6f7806d1a0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f6f900010e0 tx=0x7f6f900079e0 comp rx=0 tx=0).stop 2023-07-25T14:36:03.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:03.207+0000 7f6f9bbed700 1 -- 172.21.15.72:0/4118308613 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6f941504f0 msgr2=0x7f6f940c5e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:03.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:03.207+0000 7f6f9bbed700 1 --2- 172.21.15.72:0/4118308613 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6f941504f0 0x7f6f940c5e70 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f6f8c001ed0 tx=0x7f6f8c0021e0 comp rx=0 tx=0).stop 2023-07-25T14:36:03.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:03.208+0000 7f6f9bbed700 1 -- 172.21.15.72:0/4118308613 shutdown_connections 2023-07-25T14:36:03.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:03.208+0000 7f6f9bbed700 1 --2- 172.21.15.72:0/4118308613 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f6f7806ace0 0x7f6f7806d1a0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:03.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:03.208+0000 7f6f9bbed700 1 --2- 172.21.15.72:0/4118308613 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6f941546f0 0x7f6f941406c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:03.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:03.208+0000 7f6f9bbed700 1 --2- 172.21.15.72:0/4118308613 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6f940c21a0 0x7f6f940ab320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:03.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:03.208+0000 7f6f9bbed700 1 --2- 172.21.15.72:0/4118308613 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6f941504f0 0x7f6f940c5e70 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:03.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:03.208+0000 7f6f9bbed700 1 -- 172.21.15.72:0/4118308613 >> 172.21.15.72:0/4118308613 conn(0x7f6f940a7860 msgr2=0x7f6f9406d500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:03.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:03.208+0000 7f6f9bbed700 1 -- 172.21.15.72:0/4118308613 shutdown_connections 2023-07-25T14:36:03.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:03.208+0000 7f6f9bbed700 1 -- 172.21.15.72:0/4118308613 wait complete. 2023-07-25T14:36:03.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:03.211+0000 7fe0480a3700 1 -- 172.21.15.72:0/1375537816 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fe04004e470 con 0x7fe040155510 2023-07-25T14:36:03.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:03.214+0000 7fe0367fc700 1 -- 172.21.15.72:0/1375537816 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe030057460 con 0x7fe040155510 2023-07-25T14:36:03.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:03.214+0000 7fde0e26d700 1 -- 172.21.15.72:0/1575956606 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fdde80055a0 con 0x7fde080ba680 2023-07-25T14:36:03.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:03.214+0000 7f6a4f7fe700 1 -- 172.21.15.72:0/2218233898 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f6a3c005870 con 0x7f6a6406e770 2023-07-25T14:36:03.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:03.214+0000 7f02995fa700 1 -- 172.21.15.72:0/2130494750 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f02740055a0 con 0x7f02940af7d0 2023-07-25T14:36:03.227 INFO:teuthology.orchestra.run.smithi072.stdout:55834574855 2023-07-25T14:36:03.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:03.215+0000 7fde04ff9700 1 -- 172.21.15.72:0/1575956606 <== mon.1 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fddfc0597d0 con 0x7fde080ba680 2023-07-25T14:36:03.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:03.215+0000 7f027b7fe700 1 -- 172.21.15.72:0/2130494750 <== mon.1 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0288057e50 con 0x7f02940af7d0 2023-07-25T14:36:03.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:03.215+0000 7f6a59ffb700 1 -- 172.21.15.72:0/2218233898 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6a60020020 con 0x7f6a6406e770 2023-07-25T14:36:03.229 INFO:teuthology.orchestra.run.smithi072.stdout:55834574855 2023-07-25T14:36:03.229 INFO:teuthology.orchestra.run.smithi072.stdout:55834574856 2023-07-25T14:36:03.230 INFO:teuthology.orchestra.run.smithi072.stdout:55834574855 2023-07-25T14:36:03.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:03.218+0000 7fe0480a3700 1 -- 172.21.15.72:0/1375537816 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fe02c06adf0 msgr2=0x7fe02c06d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:03.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:03.218+0000 7fe0480a3700 1 --2- 172.21.15.72:0/1375537816 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fe02c06adf0 0x7fe02c06d2b0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fe0400c3470 tx=0x7fe03c008030 comp rx=0 tx=0).stop 2023-07-25T14:36:03.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:03.218+0000 7fe0480a3700 1 -- 172.21.15.72:0/1375537816 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe040155510 msgr2=0x7fe0400bd640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:03.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:03.218+0000 7fe0480a3700 1 --2- 172.21.15.72:0/1375537816 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe040155510 0x7fe0400bd640 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fe03000d800 tx=0x7fe03000db10 comp rx=0 tx=0).stop 2023-07-25T14:36:03.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:03.219+0000 7f6a4f7fe700 1 -- 172.21.15.72:0/2218233898 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f6a4806ace0 msgr2=0x7f6a4806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:03.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:03.219+0000 7f6a4f7fe700 1 --2- 172.21.15.72:0/2218233898 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f6a4806ace0 0x7f6a4806d1a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f6a641f41d0 tx=0x7f6a54009210 comp rx=0 tx=0).stop 2023-07-25T14:36:03.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:03.219+0000 7f6a4f7fe700 1 -- 172.21.15.72:0/2218233898 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6a6406e770 msgr2=0x7f6a640a6af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:03.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:03.219+0000 7f6a4f7fe700 1 --2- 172.21.15.72:0/2218233898 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6a6406e770 0x7f6a640a6af0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f6a60009fd0 tx=0x7f6a60004750 comp rx=0 tx=0).stop 2023-07-25T14:36:03.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:03.220+0000 7fde0e26d700 1 -- 172.21.15.72:0/1575956606 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fddf406ace0 msgr2=0x7fddf406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:03.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:03.220+0000 7fde0e26d700 1 --2- 172.21.15.72:0/1575956606 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fddf406ace0 0x7fddf406d1a0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fde00009fd0 tx=0x7fde0000d040 comp rx=0 tx=0).stop 2023-07-25T14:36:03.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:03.220+0000 7fde0e26d700 1 -- 172.21.15.72:0/1575956606 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fde080ba680 msgr2=0x7fde0814aad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:03.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:03.220+0000 7fde0e26d700 1 --2- 172.21.15.72:0/1575956606 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fde080ba680 0x7fde0814aad0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fddfc009870 tx=0x7fddfc004750 comp rx=0 tx=0).stop 2023-07-25T14:36:03.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:03.220+0000 7fde0e26d700 1 -- 172.21.15.72:0/1575956606 shutdown_connections 2023-07-25T14:36:03.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:03.220+0000 7fde0e26d700 1 --2- 172.21.15.72:0/1575956606 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fddf406ace0 0x7fddf406d1a0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:03.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:03.220+0000 7fde0e26d700 1 --2- 172.21.15.72:0/1575956606 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fde08151b40 0x7fde080c3520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:03.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:03.220+0000 7fde0e26d700 1 --2- 172.21.15.72:0/1575956606 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fde080ba680 0x7fde0814aad0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:03.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:03.220+0000 7fde0e26d700 1 --2- 172.21.15.72:0/1575956606 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fde080c1140 0x7fde081500e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:03.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:03.220+0000 7fde0e26d700 1 -- 172.21.15.72:0/1575956606 >> 172.21.15.72:0/1575956606 conn(0x7fde080a7860 msgr2=0x7fde080a7c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:03.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:03.220+0000 7f02995fa700 1 -- 172.21.15.72:0/2130494750 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f028006ade0 msgr2=0x7f028006d2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:03.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:03.220+0000 7f02995fa700 1 --2- 172.21.15.72:0/2130494750 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f028006ade0 0x7f028006d2a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f0284001eb0 tx=0x7f0284001730 comp rx=0 tx=0).stop 2023-07-25T14:36:03.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:03.220+0000 7f02995fa700 1 -- 172.21.15.72:0/2130494750 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f02940af7d0 msgr2=0x7f02941f1500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:03.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:03.220+0000 7f02995fa700 1 --2- 172.21.15.72:0/2130494750 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f02940af7d0 0x7f02941f1500 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f028800d800 tx=0x7f028800db10 comp rx=0 tx=0).stop 2023-07-25T14:36:03.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:03.220+0000 7fde0e26d700 1 -- 172.21.15.72:0/1575956606 shutdown_connections 2023-07-25T14:36:03.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:03.220+0000 7fde0e26d700 1 -- 172.21.15.72:0/1575956606 wait complete. 2023-07-25T14:36:03.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:03.221+0000 7fe0480a3700 1 -- 172.21.15.72:0/1375537816 shutdown_connections 2023-07-25T14:36:03.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:03.221+0000 7fe0480a3700 1 --2- 172.21.15.72:0/1375537816 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fe02c06adf0 0x7fe02c06d2b0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:03.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:03.221+0000 7fe0480a3700 1 --2- 172.21.15.72:0/1375537816 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe0400b9290 0x7fe0400bf0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:03.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:03.221+0000 7fe0480a3700 1 --2- 172.21.15.72:0/1375537816 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe040155510 0x7fe0400bd640 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:03.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:03.221+0000 7fe0480a3700 1 --2- 172.21.15.72:0/1375537816 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe0400c04e0 0x7fe0401f18d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:03.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:03.221+0000 7fe0480a3700 1 -- 172.21.15.72:0/1375537816 >> 172.21.15.72:0/1375537816 conn(0x7fe0400a78b0 msgr2=0x7fe040071f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:03.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:03.221+0000 7fe0480a3700 1 -- 172.21.15.72:0/1375537816 shutdown_connections 2023-07-25T14:36:03.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:03.221+0000 7fe0480a3700 1 -- 172.21.15.72:0/1375537816 wait complete. 2023-07-25T14:36:03.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:03.223+0000 7f02995fa700 1 -- 172.21.15.72:0/2130494750 shutdown_connections 2023-07-25T14:36:03.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:03.223+0000 7f02995fa700 1 --2- 172.21.15.72:0/2130494750 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f028006ade0 0x7f028006d2a0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:03.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:03.223+0000 7f02995fa700 1 --2- 172.21.15.72:0/2130494750 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0294155ea0 0x7f02941efb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:03.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:03.223+0000 7f02995fa700 1 --2- 172.21.15.72:0/2130494750 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f02940af7d0 0x7f02941f1500 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:03.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:03.223+0000 7f02995fa700 1 --2- 172.21.15.72:0/2130494750 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f02940c2530 0x7f02941ef620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:03.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:03.223+0000 7f02995fa700 1 -- 172.21.15.72:0/2130494750 >> 172.21.15.72:0/2130494750 conn(0x7f02940c9fc0 msgr2=0x7f02940ca3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:03.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:03.223+0000 7f6a4f7fe700 1 -- 172.21.15.72:0/2218233898 shutdown_connections 2023-07-25T14:36:03.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:03.223+0000 7f6a4f7fe700 1 --2- 172.21.15.72:0/2218233898 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f6a4806ace0 0x7f6a4806d1a0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:03.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:03.223+0000 7f6a4f7fe700 1 --2- 172.21.15.72:0/2218233898 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6a640c27e0 0x7f6a641f3450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:03.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:03.223+0000 7f6a4f7fe700 1 --2- 172.21.15.72:0/2218233898 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6a6406e770 0x7f6a640a6af0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:03.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:03.223+0000 7f6a4f7fe700 1 --2- 172.21.15.72:0/2218233898 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6a640c04e0 0x7f6a640aa330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:03.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:03.223+0000 7f6a4f7fe700 1 -- 172.21.15.72:0/2218233898 >> 172.21.15.72:0/2218233898 conn(0x7f6a640a78b0 msgr2=0x7f6a640c0dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:03.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:03.223+0000 7f02995fa700 1 -- 172.21.15.72:0/2130494750 shutdown_connections 2023-07-25T14:36:03.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:03.223+0000 7f02995fa700 1 -- 172.21.15.72:0/2130494750 wait complete. 2023-07-25T14:36:03.246 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574855 for osd.6 2023-07-25T14:36:03.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:03.230+0000 7f6a4f7fe700 1 -- 172.21.15.72:0/2218233898 shutdown_connections 2023-07-25T14:36:03.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:03.231+0000 7f6a4f7fe700 1 -- 172.21.15.72:0/2218233898 wait complete. 2023-07-25T14:36:03.247 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:03.234+0000 7f63d90bc700 1 -- 172.21.15.72:0/3977420073 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f63d413cd10 con 0x7f63d414db20 2023-07-25T14:36:03.247 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:03.235+0000 7f63bb7fe700 1 -- 172.21.15.72:0/3977420073 <== mon.2 v2:172.21.15.92:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f63d413cd10 con 0x7f63d414db20 2023-07-25T14:36:03.248 INFO:teuthology.orchestra.run.smithi072.stdout:55834574855 2023-07-25T14:36:03.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:03.238+0000 7f63d90bc700 1 -- 172.21.15.72:0/3977420073 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f63c006ace0 msgr2=0x7f63c006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:03.251 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:03.238+0000 7f63d90bc700 1 --2- 172.21.15.72:0/3977420073 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f63c006ace0 0x7f63c006d1a0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f63d406ad50 tx=0x7f63cc009250 comp rx=0 tx=0).stop 2023-07-25T14:36:03.251 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:03.238+0000 7f63d90bc700 1 -- 172.21.15.72:0/3977420073 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f63d414db20 msgr2=0x7f63d413cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:03.251 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:03.238+0000 7f63d90bc700 1 --2- 172.21.15.72:0/3977420073 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f63d414db20 0x7f63d413cff0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f63c400b470 tx=0x7f63c400b830 comp rx=0 tx=0).stop 2023-07-25T14:36:03.252 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:03.238+0000 7f63d90bc700 1 -- 172.21.15.72:0/3977420073 shutdown_connections 2023-07-25T14:36:03.252 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:03.238+0000 7f63d90bc700 1 --2- 172.21.15.72:0/3977420073 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f63c006ace0 0x7f63c006d1a0 secure :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f63d406ad50 tx=0x7f63cc009250 comp rx=0 tx=0).stop 2023-07-25T14:36:03.252 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:03.238+0000 7f63d90bc700 1 --2- 172.21.15.72:0/3977420073 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f63d41504f0 0x7f63d413d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:03.252 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:03.238+0000 7f63d90bc700 1 --2- 172.21.15.72:0/3977420073 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f63d40c17b0 0x7f63d4071f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:03.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:03.238+0000 7f63d90bc700 1 --2- 172.21.15.72:0/3977420073 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f63d414db20 0x7f63d413cff0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:03.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:03.238+0000 7f63d90bc700 1 -- 172.21.15.72:0/3977420073 >> 172.21.15.72:0/3977420073 conn(0x7f63d40a7860 msgr2=0x7f63d40a7c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:03.255 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574855 for osd.4 2023-07-25T14:36:03.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:03.241+0000 7f63d90bc700 1 -- 172.21.15.72:0/3977420073 shutdown_connections 2023-07-25T14:36:03.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:03.241+0000 7f63d90bc700 1 -- 172.21.15.72:0/3977420073 wait complete. 2023-07-25T14:36:03.258 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574855 for osd.3 2023-07-25T14:36:03.259 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574855 for osd.5 2023-07-25T14:36:03.262 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574856 for osd.7 2023-07-25T14:36:03.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:03.250+0000 7fb0545af700 1 -- 172.21.15.72:0/2481276141 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fb0340055a0 con 0x7fb04c0bf6a0 2023-07-25T14:36:03.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:03.250+0000 7fb042ffd700 1 -- 172.21.15.72:0/2481276141 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb0480578a0 con 0x7fb04c0bf6a0 2023-07-25T14:36:03.263 INFO:teuthology.orchestra.run.smithi072.stdout:55834574855 2023-07-25T14:36:03.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:03.252+0000 7fb0545af700 1 -- 172.21.15.72:0/2481276141 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fb03806aec0 msgr2=0x7fb03806d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:03.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:03.252+0000 7fb0545af700 1 --2- 172.21.15.72:0/2481276141 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fb03806aec0 0x7fb03806d380 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fb03c000c00 tx=0x7fb03c008030 comp rx=0 tx=0).stop 2023-07-25T14:36:03.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:03.252+0000 7fb0545af700 1 -- 172.21.15.72:0/2481276141 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb04c0bf6a0 msgr2=0x7fb04c157b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:03.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:03.252+0000 7fb0545af700 1 --2- 172.21.15.72:0/2481276141 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb04c0bf6a0 0x7fb04c157b20 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fb048001eb0 tx=0x7fb04800c8b0 comp rx=0 tx=0).stop 2023-07-25T14:36:03.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:03.252+0000 7fb0545af700 1 -- 172.21.15.72:0/2481276141 shutdown_connections 2023-07-25T14:36:03.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:03.252+0000 7fb0545af700 1 --2- 172.21.15.72:0/2481276141 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fb03806aec0 0x7fb03806d380 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:03.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:03.252+0000 7fb0545af700 1 --2- 172.21.15.72:0/2481276141 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb04c072140 0x7fb04c14b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:03.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:03.252+0000 7fb0545af700 1 --2- 172.21.15.72:0/2481276141 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb04c0c0370 0x7fb04c1f6610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:03.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:03.252+0000 7fb0545af700 1 --2- 172.21.15.72:0/2481276141 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb04c0bf6a0 0x7fb04c157b20 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:03.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:03.252+0000 7fb0545af700 1 -- 172.21.15.72:0/2481276141 >> 172.21.15.72:0/2481276141 conn(0x7fb04c06dd10 msgr2=0x7fb04c1468b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:03.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:03.252+0000 7fb0545af700 1 -- 172.21.15.72:0/2481276141 shutdown_connections 2023-07-25T14:36:03.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:03.252+0000 7fb0545af700 1 -- 172.21.15.72:0/2481276141 wait complete. 2023-07-25T14:36:03.269 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574855 for osd.2 2023-07-25T14:36:03.278 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574855 for osd.0 2023-07-25T14:36:04.217 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-07-25T14:36:04.247 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-07-25T14:36:04.255 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-07-25T14:36:04.259 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-07-25T14:36:04.260 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-07-25T14:36:04.263 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-07-25T14:36:04.270 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-07-25T14:36:04.279 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-07-25T14:36:04.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.410+0000 7f4dee4d6700 1 Processor -- start 2023-07-25T14:36:04.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.410+0000 7f4dee4d6700 1 -- start start 2023-07-25T14:36:04.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.411+0000 7f4dee4d6700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f4de80bc340 0x7f4de815bd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:04.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.411+0000 7f4dee4d6700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4de80a6d80 0x7f4de806a190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:04.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.411+0000 7f4dee4d6700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4de80a7260 con 0x7f4de80a5f70 2023-07-25T14:36:04.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.411+0000 7f4dee4d6700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4de81587f0 con 0x7f4de80bc340 2023-07-25T14:36:04.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.411+0000 7f4dee4d6700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4de81596e0 con 0x7f4de80a6d80 2023-07-25T14:36:04.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.412+0000 7f4deca73700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4de80a6d80 0x7f4de806a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:04.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.413+0000 7f4deca73700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4de80a6d80 0x7f4de806a190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3301/0 says I am v2:172.21.15.72:45468/0 (socket says 172.21.15.72:45468) 2023-07-25T14:36:04.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.413+0000 7f4deca73700 1 -- 172.21.15.72:0/2683537665 learned_addr learned my addr 172.21.15.72:0/2683537665 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:04.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.413+0000 7f4de7fff700 1 --2- 172.21.15.72:0/2683537665 >> v2:172.21.15.92:3300/0 conn(0x7f4de80bc340 0x7f4de815bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:04.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.413+0000 7f4deca73700 1 -- 172.21.15.72:0/2683537665 >> v2:172.21.15.92:3300/0 conn(0x7f4de80bc340 msgr2=0x7f4de815bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:04.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.413+0000 7f4deca73700 1 --2- 172.21.15.72:0/2683537665 >> v2:172.21.15.92:3300/0 conn(0x7f4de80bc340 0x7f4de815bd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:04.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.413+0000 7f4deca73700 1 -- 172.21.15.72:0/2683537665 >> v1:172.21.15.72:6789/0 conn(0x7f4de80a5f70 legacy=0x7f4de8158fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:04.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.413+0000 7f4deca73700 1 -- 172.21.15.72:0/2683537665 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4de80c0b00 con 0x7f4de80a6d80 2023-07-25T14:36:04.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.414+0000 7f4deca73700 1 --2- 172.21.15.72:0/2683537665 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4de80a6d80 0x7f4de806a190 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f4de0009e50 tx=0x7f4de000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=52174686a3d2912e server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:04.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.415+0000 7f4de6ffd700 1 -- 172.21.15.72:0/2683537665 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4de000e070 con 0x7f4de80a6d80 2023-07-25T14:36:04.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.415+0000 7f4de6ffd700 1 -- 172.21.15.72:0/2683537665 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4de0003a20 con 0x7f4de80a6d80 2023-07-25T14:36:04.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.415+0000 7f4de6ffd700 1 -- 172.21.15.72:0/2683537665 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4de0003dd0 con 0x7f4de80a6d80 2023-07-25T14:36:04.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.416+0000 7f4dee4d6700 1 -- 172.21.15.72:0/2683537665 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4de80a6d80 msgr2=0x7f4de806a190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:04.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.416+0000 7f4dee4d6700 1 --2- 172.21.15.72:0/2683537665 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4de80a6d80 0x7f4de806a190 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f4de0009e50 tx=0x7f4de000b330 comp rx=0 tx=0).stop 2023-07-25T14:36:04.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.416+0000 7f4dee4d6700 1 -- 172.21.15.72:0/2683537665 shutdown_connections 2023-07-25T14:36:04.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.416+0000 7f4dee4d6700 1 --2- 172.21.15.72:0/2683537665 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4de80a6d80 0x7f4de806a190 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:04.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.416+0000 7f4dee4d6700 1 --2- 172.21.15.72:0/2683537665 >> v2:172.21.15.92:3300/0 conn(0x7f4de80bc340 0x7f4de815bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:04.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.416+0000 7f4dee4d6700 1 -- 172.21.15.72:0/2683537665 >> 172.21.15.72:0/2683537665 conn(0x7f4de80a7860 msgr2=0x7f4de80a7c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:04.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.416+0000 7f4dee4d6700 1 -- 172.21.15.72:0/2683537665 shutdown_connections 2023-07-25T14:36:04.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.416+0000 7f4dee4d6700 1 -- 172.21.15.72:0/2683537665 wait complete. 2023-07-25T14:36:04.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.418+0000 7f4dee4d6700 1 Processor -- start 2023-07-25T14:36:04.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.418+0000 7f4dee4d6700 1 -- start start 2023-07-25T14:36:04.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.419+0000 7f4dee4d6700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4de80a5f70 0x7f4de80a5470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:04.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.419+0000 7f4dee4d6700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4de80a6d80 0x7f4de813f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:04.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.420+0000 7f4dee4d6700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4de80bc340 0x7f4de81454d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:04.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.420+0000 7f4dee4d6700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4de81445b0 con 0x7f4de80a5f70 2023-07-25T14:36:04.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.420+0000 7f4dee4d6700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4de80be7e0 con 0x7f4de80bc340 2023-07-25T14:36:04.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.420+0000 7f4dee4d6700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4de80a59b0 con 0x7f4de80a6d80 2023-07-25T14:36:04.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.420+0000 7f4de7fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4de80a5f70 0x7f4de80a5470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:04.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.420+0000 7f4de7fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4de80a5f70 0x7f4de80a5470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40246/0 (socket says 172.21.15.72:40246) 2023-07-25T14:36:04.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.420+0000 7f4de7fff700 1 -- 172.21.15.72:0/968945079 learned_addr learned my addr 172.21.15.72:0/968945079 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:04.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.420+0000 7f4de7fff700 1 -- 172.21.15.72:0/968945079 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4de80a6d80 msgr2=0x7f4de813f090 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-25T14:36:04.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.420+0000 7f4de7fff700 1 --2- 172.21.15.72:0/968945079 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4de80a6d80 0x7f4de813f090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:04.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.420+0000 7f4de7fff700 1 -- 172.21.15.72:0/968945079 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4de80bc340 msgr2=0x7f4de81454d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-25T14:36:04.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.420+0000 7f4de7fff700 1 --2- 172.21.15.72:0/968945079 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4de80bc340 0x7f4de81454d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:04.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.420+0000 7f4de7fff700 1 -- 172.21.15.72:0/968945079 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4de0009b30 con 0x7f4de80a5f70 2023-07-25T14:36:04.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.421+0000 7f4de7fff700 1 --2- 172.21.15.72:0/968945079 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4de80a5f70 0x7f4de80a5470 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f4dd800e9b0 tx=0x7f4dd800ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:04.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.421+0000 7f4de4ff9700 1 -- 172.21.15.72:0/968945079 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dd8009710 con 0x7f4de80a5f70 2023-07-25T14:36:04.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.421+0000 7f4dee4d6700 1 -- 172.21.15.72:0/968945079 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4de8071c00 con 0x7f4de80a5f70 2023-07-25T14:36:04.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.421+0000 7f4dee4d6700 1 -- 172.21.15.72:0/968945079 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4de80715b0 con 0x7f4de80a5f70 2023-07-25T14:36:04.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.421+0000 7f4de4ff9700 1 -- 172.21.15.72:0/968945079 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dd800c850 con 0x7f4de80a5f70 2023-07-25T14:36:04.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.421+0000 7f4de4ff9700 1 -- 172.21.15.72:0/968945079 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dd800cbc0 con 0x7f4de80a5f70 2023-07-25T14:36:04.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.424+0000 7f4de4ff9700 1 -- 172.21.15.72:0/968945079 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4dd800cd20 con 0x7f4de80a5f70 2023-07-25T14:36:04.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.424+0000 7f4de4ff9700 1 --2- 172.21.15.72:0/968945079 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f4dd406ace0 0x7f4dd406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:04.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.424+0000 7f4de4ff9700 1 -- 172.21.15.72:0/968945079 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f4dd80897c0 con 0x7f4de80a5f70 2023-07-25T14:36:04.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.424+0000 7f4de77fe700 1 --2- 172.21.15.72:0/968945079 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f4dd406ace0 0x7f4dd406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:04.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.425+0000 7f4de77fe700 1 --2- 172.21.15.72:0/968945079 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f4dd406ace0 0x7f4dd406d1a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f4ddc006fd0 tx=0x7f4ddc006bc0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:04.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.431+0000 7f4dee4d6700 1 -- 172.21.15.72:0/968945079 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4dc80052f0 con 0x7f4de80a5f70 2023-07-25T14:36:04.450 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.438+0000 7f34dc196700 1 Processor -- start 2023-07-25T14:36:04.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.438+0000 7f34dc196700 1 -- start start 2023-07-25T14:36:04.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.439+0000 7f34dc196700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f34d40c21a0 0x7f34d414da90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:04.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.439+0000 7f34dc196700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f34d40c17b0 0x7f34d4153fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:04.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.439+0000 7f34dc196700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34d4153b00 con 0x7f34d41504f0 2023-07-25T14:36:04.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.439+0000 7f34dc196700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34d414dfd0 con 0x7f34d40c17b0 2023-07-25T14:36:04.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.439+0000 7f34dc196700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34d40c0aa0 con 0x7f34d40c21a0 2023-07-25T14:36:04.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.440+0000 7f34da733700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f34d40c17b0 0x7f34d4153fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:04.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.440+0000 7f34da733700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f34d40c17b0 0x7f34d4153fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40254/0 (socket says 172.21.15.72:40254) 2023-07-25T14:36:04.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.440+0000 7f34da733700 1 -- 172.21.15.72:0/2728035882 learned_addr learned my addr 172.21.15.72:0/2728035882 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:04.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.441+0000 7f34da733700 1 -- 172.21.15.72:0/2728035882 >> v2:172.21.15.92:3300/0 conn(0x7f34d40c21a0 msgr2=0x7f34d414da90 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-25T14:36:04.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.441+0000 7f34da733700 1 --2- 172.21.15.72:0/2728035882 >> v2:172.21.15.92:3300/0 conn(0x7f34d40c21a0 0x7f34d414da90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:04.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.441+0000 7f34da733700 1 -- 172.21.15.72:0/2728035882 >> v1:172.21.15.92:6789/0 conn(0x7f34d41504f0 legacy=0x7f34d40bad70 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-25T14:36:04.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.441+0000 7f34da733700 1 -- 172.21.15.72:0/2728035882 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34d40c0d80 con 0x7f34d40c17b0 2023-07-25T14:36:04.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.441+0000 7f4de4ff9700 1 -- 172.21.15.72:0/968945079 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f4dd80580a0 con 0x7f4de80a5f70 2023-07-25T14:36:04.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.441+0000 7f34da733700 1 --2- 172.21.15.72:0/2728035882 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f34d40c17b0 0x7f34d4153fe0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f34d40a84b0 tx=0x7f34cc009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=436fdb353b82c817 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:04.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.442+0000 7f34d8f30700 1 -- 172.21.15.72:0/2728035882 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34cc004230 con 0x7f34d40c17b0 2023-07-25T14:36:04.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.442+0000 7f34d8f30700 1 -- 172.21.15.72:0/2728035882 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34cc004390 con 0x7f34d40c17b0 2023-07-25T14:36:04.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.442+0000 7f34d8f30700 1 -- 172.21.15.72:0/2728035882 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34cc0036a0 con 0x7f34d40c17b0 2023-07-25T14:36:04.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.443+0000 7f34dc196700 1 -- 172.21.15.72:0/2728035882 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f34d40c17b0 msgr2=0x7f34d4153fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:04.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.443+0000 7f34dc196700 1 --2- 172.21.15.72:0/2728035882 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f34d40c17b0 0x7f34d4153fe0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f34d40a84b0 tx=0x7f34cc009bd0 comp rx=0 tx=0).stop 2023-07-25T14:36:04.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.443+0000 7f34dc196700 1 -- 172.21.15.72:0/2728035882 shutdown_connections 2023-07-25T14:36:04.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.443+0000 7f34dc196700 1 --2- 172.21.15.72:0/2728035882 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f34d40c17b0 0x7f34d4153fe0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:04.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.443+0000 7f34dc196700 1 --2- 172.21.15.72:0/2728035882 >> v2:172.21.15.92:3300/0 conn(0x7f34d40c21a0 0x7f34d414da90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:04.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.443+0000 7f34dc196700 1 -- 172.21.15.72:0/2728035882 >> 172.21.15.72:0/2728035882 conn(0x7f34d40a7860 msgr2=0x7f34d40a7c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:04.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.443+0000 7f34dc196700 1 -- 172.21.15.72:0/2728035882 shutdown_connections 2023-07-25T14:36:04.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.443+0000 7f34dc196700 1 -- 172.21.15.72:0/2728035882 wait complete. 2023-07-25T14:36:04.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.445+0000 7f34dc196700 1 Processor -- start 2023-07-25T14:36:04.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.445+0000 7f34dc196700 1 -- start start 2023-07-25T14:36:04.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.446+0000 7f34dc196700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f34d40c17b0 0x7f34d41421b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:04.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.446+0000 7f34dc196700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f34d40c21a0 0x7f34d40a84e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:04.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.446+0000 7f34dc196700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f34d41504f0 0x7f34d4153fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:04.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.446+0000 7f34dc196700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34d4142b80 con 0x7f34d40c17b0 2023-07-25T14:36:04.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.446+0000 7f34dc196700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34d41426f0 con 0x7f34d41504f0 2023-07-25T14:36:04.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.446+0000 7f34dc196700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34d4151a40 con 0x7f34d40c21a0 2023-07-25T14:36:04.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.446+0000 7f34da733700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f34d41504f0 0x7f34d4153fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:04.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.447+0000 7f34d9f32700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f34d40c17b0 0x7f34d41421b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:04.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.447+0000 7f34d9f32700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f34d40c17b0 0x7f34d41421b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40256/0 (socket says 172.21.15.72:40256) 2023-07-25T14:36:04.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.447+0000 7f34d9f32700 1 -- 172.21.15.72:0/143905043 learned_addr learned my addr 172.21.15.72:0/143905043 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:04.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.447+0000 7f34d9731700 1 --2- 172.21.15.72:0/143905043 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f34d40c21a0 0x7f34d40a84e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:04.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.447+0000 7f34da733700 1 -- 172.21.15.72:0/143905043 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f34d40c21a0 msgr2=0x7f34d40a84e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:04.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.447+0000 7f34da733700 1 --2- 172.21.15.72:0/143905043 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f34d40c21a0 0x7f34d40a84e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:04.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.447+0000 7f34da733700 1 -- 172.21.15.72:0/143905043 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f34d40c17b0 msgr2=0x7f34d41421b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:04.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.447+0000 7f34da733700 1 --2- 172.21.15.72:0/143905043 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f34d40c17b0 0x7f34d41421b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:04.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.447+0000 7f34da733700 1 -- 172.21.15.72:0/143905043 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34cc009550 con 0x7f34d41504f0 2023-07-25T14:36:04.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.447+0000 7f34da733700 1 --2- 172.21.15.72:0/143905043 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f34d41504f0 0x7f34d4153fe0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f34d406e620 tx=0x7f34cc004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:04.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.448+0000 7f34ca7fc700 1 -- 172.21.15.72:0/143905043 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34cc003d60 con 0x7f34d41504f0 2023-07-25T14:36:04.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.448+0000 7f34ca7fc700 1 -- 172.21.15.72:0/143905043 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34cc011630 con 0x7f34d41504f0 2023-07-25T14:36:04.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.448+0000 7f34ca7fc700 1 -- 172.21.15.72:0/143905043 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34cc0119c0 con 0x7f34d41504f0 2023-07-25T14:36:04.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.448+0000 7f34dc196700 1 -- 172.21.15.72:0/143905043 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34d4145700 con 0x7f34d41504f0 2023-07-25T14:36:04.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.448+0000 7f34dc196700 1 -- 172.21.15.72:0/143905043 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34d4151760 con 0x7f34d41504f0 2023-07-25T14:36:04.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.451+0000 7f86edf74700 1 Processor -- start 2023-07-25T14:36:04.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.449+0000 7fa6f258d700 1 Processor -- start 2023-07-25T14:36:04.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.449+0000 7fa6f258d700 1 -- start start 2023-07-25T14:36:04.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.450+0000 7fa6f258d700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa6ec14db20 0x7fa6ec0bad70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:04.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.450+0000 7fa6f258d700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fa6ec1546f0 0x7fa6ec15ad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:04.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.450+0000 7fa6f258d700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6ec153b00 con 0x7fa6ec1504f0 2023-07-25T14:36:04.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.450+0000 7fa6f258d700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6ec0c0aa0 con 0x7fa6ec1546f0 2023-07-25T14:36:04.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.450+0000 7fa6f258d700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6ec0c0d80 con 0x7fa6ec14db20 2023-07-25T14:36:04.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.451+0000 7fa6eb7fe700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fa6ec1504f0 0x7fa6ec153fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:59230/0 (socket says 172.21.15.72:59230) 2023-07-25T14:36:04.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.451+0000 7fa6eb7fe700 1 -- 172.21.15.72:0/4154291007 learned_addr learned my addr 172.21.15.72:0/4154291007 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:36:04.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.451+0000 7fa6eaffd700 1 -- 172.21.15.72:0/4154291007 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3173032946 0 0) 0x7fa6ec153b00 con 0x7fa6ec1504f0 2023-07-25T14:36:04.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.451+0000 7fa6eaffd700 1 -- 172.21.15.72:0/4154291007 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa6d40035b0 con 0x7fa6ec1504f0 2023-07-25T14:36:04.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.452+0000 7fa6f0b2a700 1 --2- 172.21.15.72:0/4154291007 >> v2:172.21.15.92:3300/0 conn(0x7fa6ec1546f0 0x7fa6ec15ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:04.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.452+0000 7fa6eaffd700 1 -- 172.21.15.72:0/4154291007 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1263912600 0 0) 0x7fa6d40035b0 con 0x7fa6ec1504f0 2023-07-25T14:36:04.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.452+0000 7fa6eaffd700 1 -- 172.21.15.72:0/4154291007 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa6ec14db20 msgr2=0x7fa6ec0bad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:04.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.452+0000 7fa6eaffd700 1 --2- 172.21.15.72:0/4154291007 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa6ec14db20 0x7fa6ec0bad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:04.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.452+0000 7fa6eaffd700 1 -- 172.21.15.72:0/4154291007 >> v2:172.21.15.92:3300/0 conn(0x7fa6ec1546f0 msgr2=0x7fa6ec15ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:04.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.452+0000 7fa6eaffd700 1 --2- 172.21.15.72:0/4154291007 >> v2:172.21.15.92:3300/0 conn(0x7fa6ec1546f0 0x7fa6ec15ad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:04.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.452+0000 7fa6eaffd700 1 -- 172.21.15.72:0/4154291007 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6ec0c1060 con 0x7fa6ec1504f0 2023-07-25T14:36:04.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.452+0000 7fa6eaffd700 1 -- 172.21.15.72:0/4154291007 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2559588315 0 0) 0x7fa6dc001670 con 0x7fa6ec1504f0 2023-07-25T14:36:04.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.452+0000 7fa6eaffd700 1 -- 172.21.15.72:0/4154291007 >> v1:172.21.15.72:6789/0 conn(0x7fa6ec1504f0 legacy=0x7fa6ec153fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:04.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.452+0000 7fa6eaffd700 1 --2- 172.21.15.72:0/4154291007 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa6d4003a00 0x7fa6d4003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:04.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.452+0000 7fa6eaffd700 1 --2- 172.21.15.72:0/4154291007 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa6d4004850 0x7fa6d4004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:04.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.452+0000 7fa6eaffd700 1 --2- 172.21.15.72:0/4154291007 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa6ec14db20 0x7fa6d40052c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:04.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.452+0000 7fa6eaffd700 1 -- 172.21.15.72:0/4154291007 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6ec0c0aa0 con 0x7fa6d4003a00 2023-07-25T14:36:04.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.452+0000 7fa6eaffd700 1 -- 172.21.15.72:0/4154291007 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6ec0c0d80 con 0x7fa6d4004850 2023-07-25T14:36:04.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.452+0000 7fa6eaffd700 1 -- 172.21.15.72:0/4154291007 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6d4007c50 con 0x7fa6ec14db20 2023-07-25T14:36:04.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.451+0000 7f86edf74700 1 -- start start 2023-07-25T14:36:04.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.452+0000 7f86edf74700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f86e8155d70 0x7f86e815bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:04.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.452+0000 7f86edf74700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f86e815c320 0x7f86e806ae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:04.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.452+0000 7f86edf74700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86e8159ce0 con 0x7f86e80ab990 2023-07-25T14:36:04.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.452+0000 7f86edf74700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86e806e830 con 0x7f86e815c320 2023-07-25T14:36:04.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.452+0000 7f86edf74700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86e806ed60 con 0x7f86e8155d70 2023-07-25T14:36:04.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.452+0000 7fa6eb7fe700 1 --2- 172.21.15.72:0/4154291007 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa6d4004850 0x7fa6d4004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:04.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.452+0000 7fa6f0b2a700 1 --2- 172.21.15.72:0/4154291007 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa6ec14db20 0x7fa6d40052c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:04.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.452+0000 7f86e77fe700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f86e8155d70 0x7f86e815bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:04.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.452+0000 7f86e77fe700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f86e8155d70 0x7f86e815bde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3301/0 says I am v2:172.21.15.72:45506/0 (socket says 172.21.15.72:45506) 2023-07-25T14:36:04.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.452+0000 7f86e77fe700 1 -- 172.21.15.72:0/3756366818 learned_addr learned my addr 172.21.15.72:0/3756366818 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:04.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.452+0000 7f86e7fff700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f86e80ab990 0x7f86e806b3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.72:54590/0 (socket says 172.21.15.72:54590) 2023-07-25T14:36:04.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.453+0000 7f86e6ffd700 1 --2- 172.21.15.72:0/3756366818 >> v2:172.21.15.92:3300/0 conn(0x7f86e815c320 0x7f86e806ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:04.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.452+0000 7fa6ebfff700 1 --2- 172.21.15.72:0/4154291007 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa6d4003a00 0x7fa6d4003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:04.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.453+0000 7fa6eb7fe700 1 -- 172.21.15.72:0/4154291007 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa6ec14db20 msgr2=0x7fa6d40052c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:04.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.453+0000 7fa6eb7fe700 1 --2- 172.21.15.72:0/4154291007 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa6ec14db20 0x7fa6d40052c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:04.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.453+0000 7fa6eb7fe700 1 -- 172.21.15.72:0/4154291007 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa6d4003a00 msgr2=0x7fa6d4003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:04.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.453+0000 7fa6eb7fe700 1 --2- 172.21.15.72:0/4154291007 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa6d4003a00 0x7fa6d4003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:04.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.453+0000 7fa6eb7fe700 1 -- 172.21.15.72:0/4154291007 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6ec0c1060 con 0x7fa6d4004850 2023-07-25T14:36:04.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.450+0000 7f34ca7fc700 1 -- 172.21.15.72:0/143905043 <== mon.1 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f34cc021070 con 0x7f34d41504f0 2023-07-25T14:36:04.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.450+0000 7f34ca7fc700 1 --2- 172.21.15.72:0/143905043 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f34b806ace0 0x7f34b806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:04.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.451+0000 7f34ca7fc700 1 -- 172.21.15.72:0/143905043 <== mon.1 v2:172.21.15.92:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f34cc08a990 con 0x7f34d41504f0 2023-07-25T14:36:04.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.452+0000 7f34d9f32700 1 --2- 172.21.15.72:0/143905043 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f34b806ace0 0x7f34b806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:04.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.452+0000 7f34d9f32700 1 --2- 172.21.15.72:0/143905043 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f34b806ace0 0x7f34b806d1a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f34d41622f0 tx=0x7f34c4009210 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:04.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.453+0000 7fa6eb7fe700 1 --2- 172.21.15.72:0/4154291007 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa6d4004850 0x7fa6d4004cd0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fa6dc00d3a0 tx=0x7fa6d4005880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=56852b90a7cb2a43 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:04.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.453+0000 7f86e77fe700 1 -- 172.21.15.72:0/3756366818 >> v2:172.21.15.92:3300/0 conn(0x7f86e815c320 msgr2=0x7f86e806ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:04.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.453+0000 7f86e77fe700 1 --2- 172.21.15.72:0/3756366818 >> v2:172.21.15.92:3300/0 conn(0x7f86e815c320 0x7f86e806ae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:04.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.453+0000 7f86e77fe700 1 -- 172.21.15.72:0/3756366818 >> v1:172.21.15.92:6789/0 conn(0x7f86e80ab990 legacy=0x7f86e806b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:04.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.453+0000 7f86e77fe700 1 -- 172.21.15.72:0/3756366818 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86e815c890 con 0x7f86e8155d70 2023-07-25T14:36:04.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.453+0000 7f86e6ffd700 1 --2- 172.21.15.72:0/3756366818 >> v2:172.21.15.92:3300/0 conn(0x7f86e815c320 0x7f86e806ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-25T14:36:04.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.453+0000 7f86e77fe700 1 --2- 172.21.15.72:0/3756366818 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f86e8155d70 0x7f86e815bde0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f86d80098f0 tx=0x7f86d8009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=27897e12c94294b3 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:04.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.453+0000 7fa6eaffd700 1 -- 172.21.15.72:0/4154291007 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6dc004c90 con 0x7fa6d4004850 2023-07-25T14:36:04.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.453+0000 7fa6eaffd700 1 -- 172.21.15.72:0/4154291007 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6dc00f400 con 0x7fa6d4004850 2023-07-25T14:36:04.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.453+0000 7fa6eaffd700 1 -- 172.21.15.72:0/4154291007 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6dc00f790 con 0x7fa6d4004850 2023-07-25T14:36:04.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.454+0000 7fa6f258d700 1 -- 172.21.15.72:0/4154291007 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa6d4004850 msgr2=0x7fa6d4004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:04.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.454+0000 7fa6f258d700 1 --2- 172.21.15.72:0/4154291007 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa6d4004850 0x7fa6d4004cd0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fa6dc00d3a0 tx=0x7fa6d4005880 comp rx=0 tx=0).stop 2023-07-25T14:36:04.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.454+0000 7fa6f0b2a700 1 -- 172.21.15.72:0/4154291007 reap_dead start 2023-07-25T14:36:04.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.454+0000 7f86e67fc700 1 -- 172.21.15.72:0/3756366818 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86d8011830 con 0x7f86e8155d70 2023-07-25T14:36:04.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.455+0000 7f86e67fc700 1 -- 172.21.15.72:0/3756366818 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86d8011990 con 0x7f86e8155d70 2023-07-25T14:36:04.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.455+0000 7f86e67fc700 1 -- 172.21.15.72:0/3756366818 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86d8011d20 con 0x7f86e8155d70 2023-07-25T14:36:04.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.455+0000 7f86edf74700 1 -- 172.21.15.72:0/3756366818 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f86e8155d70 msgr2=0x7f86e815bde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:04.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.455+0000 7f86edf74700 1 --2- 172.21.15.72:0/3756366818 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f86e8155d70 0x7f86e815bde0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f86d80098f0 tx=0x7f86d8009c00 comp rx=0 tx=0).stop 2023-07-25T14:36:04.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.456+0000 7f86edf74700 1 -- 172.21.15.72:0/3756366818 shutdown_connections 2023-07-25T14:36:04.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.456+0000 7f86edf74700 1 --2- 172.21.15.72:0/3756366818 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f86e8155d70 0x7f86e815bde0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:04.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.456+0000 7f86edf74700 1 --2- 172.21.15.72:0/3756366818 >> v2:172.21.15.92:3300/0 conn(0x7f86e815c320 0x7f86e806ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:04.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.456+0000 7f86edf74700 1 -- 172.21.15.72:0/3756366818 >> 172.21.15.72:0/3756366818 conn(0x7f86e806dd10 msgr2=0x7f86e806e120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:04.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.456+0000 7fa6f258d700 1 -- 172.21.15.72:0/4154291007 shutdown_connections 2023-07-25T14:36:04.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.456+0000 7fa6f258d700 1 -- 172.21.15.72:0/4154291007 >> 172.21.15.72:0/4154291007 conn(0x7fa6ec0a7860 msgr2=0x7fa6ec0a7c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:04.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.456+0000 7fa6f258d700 1 -- 172.21.15.72:0/4154291007 shutdown_connections 2023-07-25T14:36:04.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.456+0000 7fa6f258d700 1 -- 172.21.15.72:0/4154291007 wait complete. 2023-07-25T14:36:04.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.457+0000 7f34dc196700 1 -- 172.21.15.72:0/143905043 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34bc0052f0 con 0x7f34d41504f0 2023-07-25T14:36:04.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.458+0000 7fa6f258d700 1 Processor -- start 2023-07-25T14:36:04.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.458+0000 7fa6f258d700 1 -- start start 2023-07-25T14:36:04.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.459+0000 7fa6f258d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa6d4004850 0x7fa6ec0bd250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:04.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.459+0000 7fa6f258d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa6ec14bde0 0x7fa6ec0c5f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:04.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.459+0000 7fa6f258d700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa6ec1f19a0 0x7fa6ec1f1e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:04.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.459+0000 7fa6f258d700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6ec0bf8b0 con 0x7fa6ec14bde0 2023-07-25T14:36:04.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.459+0000 7fa6f258d700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6ec0bef50 con 0x7fa6d4004850 2023-07-25T14:36:04.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.459+0000 7fa6f258d700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6ec0bf1f0 con 0x7fa6ec1f19a0 2023-07-25T14:36:04.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.459+0000 7fa6ebfff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa6d4004850 0x7fa6ec0bd250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:04.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.459+0000 7fa6f0b2a700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa6ec1f19a0 0x7fa6ec1f1e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:04.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.459+0000 7fa6ebfff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa6d4004850 0x7fa6ec0bd250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.72:35854/0 (socket says 172.21.15.72:35854) 2023-07-25T14:36:04.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.459+0000 7fa6ebfff700 1 -- 172.21.15.72:0/3225701270 learned_addr learned my addr 172.21.15.72:0/3225701270 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:04.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.460+0000 7fa6eb7fe700 1 --2- 172.21.15.72:0/3225701270 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa6ec14bde0 0x7fa6ec0c5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:04.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.460+0000 7fa6ebfff700 1 -- 172.21.15.72:0/3225701270 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa6ec1f19a0 msgr2=0x7fa6ec1f1e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:04.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.460+0000 7fa6ebfff700 1 --2- 172.21.15.72:0/3225701270 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa6ec1f19a0 0x7fa6ec1f1e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:04.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.460+0000 7fa6ebfff700 1 -- 172.21.15.72:0/3225701270 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa6ec14bde0 msgr2=0x7fa6ec0c5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:04.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.460+0000 7fa6ebfff700 1 --2- 172.21.15.72:0/3225701270 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa6ec14bde0 0x7fa6ec0c5f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:04.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.460+0000 7fa6ebfff700 1 -- 172.21.15.72:0/3225701270 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6ec0bf4d0 con 0x7fa6d4004850 2023-07-25T14:36:04.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.460+0000 7fa6ebfff700 1 --2- 172.21.15.72:0/3225701270 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa6d4004850 0x7fa6ec0bd250 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fa6e000d7d0 tx=0x7fa6e000dae0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:04.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.460+0000 7f86edf74700 1 -- 172.21.15.72:0/3756366818 shutdown_connections 2023-07-25T14:36:04.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.460+0000 7f86edf74700 1 -- 172.21.15.72:0/3756366818 wait complete. 2023-07-25T14:36:04.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.460+0000 7fa6e8ff9700 1 -- 172.21.15.72:0/3225701270 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6e0012630 con 0x7fa6d4004850 2023-07-25T14:36:04.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.460+0000 7fa6e8ff9700 1 -- 172.21.15.72:0/3225701270 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6e0012790 con 0x7fa6d4004850 2023-07-25T14:36:04.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.460+0000 7fa6e8ff9700 1 -- 172.21.15.72:0/3225701270 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6e0012b40 con 0x7fa6d4004850 2023-07-25T14:36:04.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.460+0000 7fa6f258d700 1 -- 172.21.15.72:0/3225701270 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6ec0c6450 con 0x7fa6d4004850 2023-07-25T14:36:04.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.460+0000 7fa6f258d700 1 -- 172.21.15.72:0/3225701270 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6ec0bd830 con 0x7fa6d4004850 2023-07-25T14:36:04.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.462+0000 7f86edf74700 1 Processor -- start 2023-07-25T14:36:04.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.463+0000 7fa6e8ff9700 1 -- 172.21.15.72:0/3225701270 <== mon.1 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa6e0012ca0 con 0x7fa6d4004850 2023-07-25T14:36:04.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.463+0000 7fa6e8ff9700 1 --2- 172.21.15.72:0/3225701270 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fa6d806ad30 0x7fa6d806d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:04.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.463+0000 7fa6e8ff9700 1 -- 172.21.15.72:0/3225701270 <== mon.1 v2:172.21.15.92:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fa6e0089120 con 0x7fa6d4004850 2023-07-25T14:36:04.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.463+0000 7fa6eb7fe700 1 --2- 172.21.15.72:0/3225701270 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fa6d806ad30 0x7fa6d806d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:04.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.463+0000 7f86edf74700 1 -- start start 2023-07-25T14:36:04.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.464+0000 7f86edf74700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f86e80ab990 0x7f86e81344d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:04.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.464+0000 7f86edf74700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f86e8155d70 0x7f86e80c4810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:04.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.464+0000 7f86edf74700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f86e815c320 0x7f86e80c4d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:04.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.464+0000 7f86edf74700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86e80a98b0 con 0x7f86e8155d70 2023-07-25T14:36:04.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.464+0000 7f86edf74700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86e81451e0 con 0x7f86e815c320 2023-07-25T14:36:04.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.464+0000 7f86edf74700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86e8130160 con 0x7f86e80ab990 2023-07-25T14:36:04.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.464+0000 7f86e77fe700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f86e80ab990 0x7f86e81344d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:04.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.464+0000 7f86e77fe700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f86e80ab990 0x7f86e81344d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3301/0 says I am v2:172.21.15.72:45518/0 (socket says 172.21.15.72:45518) 2023-07-25T14:36:04.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.464+0000 7f86e77fe700 1 -- 172.21.15.72:0/1616580942 learned_addr learned my addr 172.21.15.72:0/1616580942 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:04.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.464+0000 7fa6eb7fe700 1 --2- 172.21.15.72:0/3225701270 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fa6d806ad30 0x7fa6d806d1f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fa6dc000c00 tx=0x7fa6dc01b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:04.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.464+0000 7f86e6ffd700 1 --2- 172.21.15.72:0/1616580942 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f86e8155d70 0x7f86e80c4810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:04.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.464+0000 7f86e77fe700 1 -- 172.21.15.72:0/1616580942 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f86e815c320 msgr2=0x7f86e80c4d50 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-07-25T14:36:04.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.464+0000 7f86e77fe700 1 --2- 172.21.15.72:0/1616580942 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f86e815c320 0x7f86e80c4d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:04.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.464+0000 7f86e77fe700 1 -- 172.21.15.72:0/1616580942 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f86e8155d70 msgr2=0x7f86e80c4810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:04.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.464+0000 7f86e77fe700 1 --2- 172.21.15.72:0/1616580942 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f86e8155d70 0x7f86e80c4810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:04.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.464+0000 7f86e77fe700 1 -- 172.21.15.72:0/1616580942 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86dc0094a0 con 0x7f86e80ab990 2023-07-25T14:36:04.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.465+0000 7f86e6ffd700 1 --2- 172.21.15.72:0/1616580942 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f86e8155d70 0x7f86e80c4810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-25T14:36:04.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.465+0000 7f86e77fe700 1 --2- 172.21.15.72:0/1616580942 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f86e80ab990 0x7f86e81344d0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f86e806eea0 tx=0x7f86d8004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:04.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.465+0000 7f86cffff700 1 -- 172.21.15.72:0/1616580942 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86d8004450 con 0x7f86e80ab990 2023-07-25T14:36:04.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.465+0000 7f86cffff700 1 -- 172.21.15.72:0/1616580942 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86d801f070 con 0x7f86e80ab990 2023-07-25T14:36:04.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.465+0000 7f86edf74700 1 -- 172.21.15.72:0/1616580942 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86d8009550 con 0x7f86e80ab990 2023-07-25T14:36:04.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.465+0000 7f86edf74700 1 -- 172.21.15.72:0/1616580942 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86e80c4010 con 0x7f86e80ab990 2023-07-25T14:36:04.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.465+0000 7f86cffff700 1 -- 172.21.15.72:0/1616580942 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86d80038e0 con 0x7f86e80ab990 2023-07-25T14:36:04.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.467+0000 7f86edf74700 1 -- 172.21.15.72:0/1616580942 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86c80052f0 con 0x7f86e80ab990 2023-07-25T14:36:04.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.468+0000 7fa6f258d700 1 -- 172.21.15.72:0/3225701270 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6ec0bf9f0 con 0x7fa6d4004850 2023-07-25T14:36:04.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.465+0000 7fb8442d4700 1 Processor -- start 2023-07-25T14:36:04.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.465+0000 7fb8442d4700 1 -- start start 2023-07-25T14:36:04.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.467+0000 7fb8442d4700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fb83c0bad90 0x7fb83c16c970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:04.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.467+0000 7fb8442d4700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb83c0c19a0 con 0x7fb83c1620a0 2023-07-25T14:36:04.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.467+0000 7fb8442d4700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb83c0c1070 con 0x7fb83c089240 2023-07-25T14:36:04.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.467+0000 7fb8442d4700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb83c0c12e0 con 0x7fb83c0bad90 2023-07-25T14:36:04.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.467+0000 7fb842070700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fb83c1620a0 0x7fb83c0c25c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:59264/0 (socket says 172.21.15.72:59264) 2023-07-25T14:36:04.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.467+0000 7fb842070700 1 -- 172.21.15.72:0/2064702916 learned_addr learned my addr 172.21.15.72:0/2064702916 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:36:04.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.467+0000 7fb842871700 1 --2- 172.21.15.72:0/2064702916 >> v2:172.21.15.92:3300/0 conn(0x7fb83c0bad90 0x7fb83c16c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:04.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.467+0000 7fb84106e700 1 -- 172.21.15.72:0/2064702916 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3693946804 0 0) 0x7fb83c0c19a0 con 0x7fb83c1620a0 2023-07-25T14:36:04.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.468+0000 7fb84106e700 1 -- 172.21.15.72:0/2064702916 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb828003590 con 0x7fb83c1620a0 2023-07-25T14:36:04.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.468+0000 7f34ca7fc700 1 -- 172.21.15.72:0/143905043 <== mon.1 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f34cc0557e0 con 0x7f34d41504f0 2023-07-25T14:36:04.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.468+0000 7fb84106e700 1 -- 172.21.15.72:0/2064702916 <== mon.1 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 893335081 0 0) 0x7fb83c0c1070 con 0x7fb83c089240 2023-07-25T14:36:04.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.468+0000 7fb84106e700 1 -- 172.21.15.72:0/2064702916 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb83c0c19a0 con 0x7fb83c089240 2023-07-25T14:36:04.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.468+0000 7fb84106e700 1 -- 172.21.15.72:0/2064702916 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3069175459 0 0) 0x7fb828003590 con 0x7fb83c1620a0 2023-07-25T14:36:04.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.468+0000 7fb842871700 1 -- 172.21.15.72:0/2064702916 >> v1:172.21.15.92:6789/0 conn(0x7fb83c089240 legacy=0x7fb83c0ba680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:04.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.468+0000 7fb842871700 1 -- 172.21.15.72:0/2064702916 >> v1:172.21.15.72:6789/0 conn(0x7fb83c1620a0 legacy=0x7fb83c0c25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:04.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.468+0000 7fb842871700 1 -- 172.21.15.72:0/2064702916 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb83c0c0cf0 con 0x7fb83c0bad90 2023-07-25T14:36:04.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.468+0000 7fb842871700 1 --2- 172.21.15.72:0/2064702916 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb83c0bad90 0x7fb83c16c970 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fb834007670 tx=0x7fb83400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f69964e1c6fa9e6a server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:04.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.469+0000 7f86cffff700 1 -- 172.21.15.72:0/1616580942 <== mon.2 v2:172.21.15.92:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f86d8003a40 con 0x7f86e80ab990 2023-07-25T14:36:04.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.470+0000 7f86cffff700 1 --2- 172.21.15.72:0/1616580942 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f86d406ad30 0x7f86d406d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:04.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.470+0000 7f86cffff700 1 -- 172.21.15.72:0/1616580942 <== mon.2 v2:172.21.15.92:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f86d8021070 con 0x7f86e80ab990 2023-07-25T14:36:04.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.470+0000 7f86e6ffd700 1 --2- 172.21.15.72:0/1616580942 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f86d406ad30 0x7f86d406d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:04.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.471+0000 7f86e6ffd700 1 --2- 172.21.15.72:0/1616580942 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f86d406ad30 0x7f86d406d1f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f86e80ab450 tx=0x7f86dc009210 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:04.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.473+0000 7f86cffff700 1 -- 172.21.15.72:0/1616580942 <== mon.2 v2:172.21.15.92:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f86d8056100 con 0x7f86e80ab990 2023-07-25T14:36:04.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.474+0000 7fa6e8ff9700 1 -- 172.21.15.72:0/3225701270 <== mon.1 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fa6ec0bf9f0 con 0x7fa6d4004850 2023-07-25T14:36:04.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.473+0000 7fb84106e700 1 -- 172.21.15.72:0/2064702916 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb83400e070 con 0x7fb83c0bad90 2023-07-25T14:36:04.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.473+0000 7fb84106e700 1 -- 172.21.15.72:0/2064702916 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8340092e0 con 0x7fb83c0bad90 2023-07-25T14:36:04.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.473+0000 7fb84106e700 1 -- 172.21.15.72:0/2064702916 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8380015f0 con 0x7fb83c0bad90 2023-07-25T14:36:04.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.474+0000 7fb8442d4700 1 -- 172.21.15.72:0/2064702916 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb83c0bad90 msgr2=0x7fb83c16c970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:04.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.474+0000 7fb8442d4700 1 --2- 172.21.15.72:0/2064702916 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb83c0bad90 0x7fb83c16c970 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fb834007670 tx=0x7fb83400b330 comp rx=0 tx=0).stop 2023-07-25T14:36:04.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.475+0000 7fb8442d4700 1 -- 172.21.15.72:0/2064702916 shutdown_connections 2023-07-25T14:36:04.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.475+0000 7fb8442d4700 1 --2- 172.21.15.72:0/2064702916 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb83c0bad90 0x7fb83c16c970 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:04.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.475+0000 7fb8442d4700 1 -- 172.21.15.72:0/2064702916 >> 172.21.15.72:0/2064702916 conn(0x7fb83c0a7860 msgr2=0x7fb83c0a7c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:04.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.478+0000 7fb8442d4700 1 -- 172.21.15.72:0/2064702916 shutdown_connections 2023-07-25T14:36:04.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.478+0000 7fb8442d4700 1 -- 172.21.15.72:0/2064702916 wait complete. 2023-07-25T14:36:04.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.480+0000 7fb8442d4700 1 Processor -- start 2023-07-25T14:36:04.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.480+0000 7fb8442d4700 1 -- start start 2023-07-25T14:36:04.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.481+0000 7fb8442d4700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb83c089240 0x7fb83c15d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:04.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.481+0000 7fb8442d4700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb83c0bad90 0x7fb83c15fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:04.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.481+0000 7fb8442d4700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb83c1620a0 0x7fb83c160230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:04.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.481+0000 7fb8442d4700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb83c0a8f40 con 0x7fb83c0bad90 2023-07-25T14:36:04.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.481+0000 7fb8442d4700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb83c15dc70 con 0x7fb83c1620a0 2023-07-25T14:36:04.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.481+0000 7fb8442d4700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb83c0a85a0 con 0x7fb83c089240 2023-07-25T14:36:04.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.481+0000 7fb842070700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb83c089240 0x7fb83c15d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:04.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.481+0000 7fb842070700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb83c089240 0x7fb83c15d730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3301/0 says I am v2:172.21.15.72:45536/0 (socket says 172.21.15.72:45536) 2023-07-25T14:36:04.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.481+0000 7fb842070700 1 -- 172.21.15.72:0/3527588772 learned_addr learned my addr 172.21.15.72:0/3527588772 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:04.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.481+0000 7fb842871700 1 --2- 172.21.15.72:0/3527588772 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb83c1620a0 0x7fb83c160230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:04.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.482+0000 7fb84186f700 1 --2- 172.21.15.72:0/3527588772 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb83c0bad90 0x7fb83c15fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:04.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.484+0000 7fb842871700 1 -- 172.21.15.72:0/3527588772 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb83c089240 msgr2=0x7fb83c15d730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:04.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.484+0000 7fb842871700 1 --2- 172.21.15.72:0/3527588772 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb83c089240 0x7fb83c15d730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:04.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.484+0000 7fb842871700 1 -- 172.21.15.72:0/3527588772 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb83c0bad90 msgr2=0x7fb83c15fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:04.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.484+0000 7fb842871700 1 --2- 172.21.15.72:0/3527588772 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb83c0bad90 0x7fb83c15fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:04.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.484+0000 7fb842871700 1 -- 172.21.15.72:0/3527588772 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb834009a80 con 0x7fb83c1620a0 2023-07-25T14:36:04.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.484+0000 7fb842871700 1 --2- 172.21.15.72:0/3527588772 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb83c1620a0 0x7fb83c160230 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fb834013000 tx=0x7fb834004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:04.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.496+0000 7fb832ffd700 1 -- 172.21.15.72:0/3527588772 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb83401f070 con 0x7fb83c1620a0 2023-07-25T14:36:04.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.496+0000 7fb832ffd700 1 -- 172.21.15.72:0/3527588772 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb834003e10 con 0x7fb83c1620a0 2023-07-25T14:36:04.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.496+0000 7fb832ffd700 1 -- 172.21.15.72:0/3527588772 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb834007780 con 0x7fb83c1620a0 2023-07-25T14:36:04.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.496+0000 7fb8442d4700 1 -- 172.21.15.72:0/3527588772 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb83c0a8880 con 0x7fb83c1620a0 2023-07-25T14:36:04.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.496+0000 7fb8442d4700 1 -- 172.21.15.72:0/3527588772 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb83c0a7ef0 con 0x7fb83c1620a0 2023-07-25T14:36:04.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.499+0000 7fb8442d4700 1 -- 172.21.15.72:0/3527588772 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8240052f0 con 0x7fb83c1620a0 2023-07-25T14:36:04.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.503+0000 7fb832ffd700 1 -- 172.21.15.72:0/3527588772 <== mon.1 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb8340078e0 con 0x7fb83c1620a0 2023-07-25T14:36:04.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.504+0000 7fb832ffd700 1 --2- 172.21.15.72:0/3527588772 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fb82006ad30 0x7fb82006d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:04.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.504+0000 7fb832ffd700 1 -- 172.21.15.72:0/3527588772 <== mon.1 v2:172.21.15.92:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fb83408de50 con 0x7fb83c1620a0 2023-07-25T14:36:04.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.504+0000 7fb842070700 1 --2- 172.21.15.72:0/3527588772 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fb82006ad30 0x7fb82006d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:04.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.505+0000 7fb842070700 1 --2- 172.21.15.72:0/3527588772 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fb82006ad30 0x7fb82006d1f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fb8380012a0 tx=0x7fb838001210 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:04.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.512+0000 7fb832ffd700 1 -- 172.21.15.72:0/3527588772 <== mon.1 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fb834058d00 con 0x7fb83c1620a0 2023-07-25T14:36:04.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.517+0000 7f8a02641700 1 Processor -- start 2023-07-25T14:36:04.535 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.517+0000 7f8a02641700 1 -- start start 2023-07-25T14:36:04.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.518+0000 7f8a02641700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f89fc0a5f70 0x7f89fc15bd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:04.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.518+0000 7f8a02641700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f89fc0a6d80 0x7f89fc06a190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:04.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.518+0000 7f8a02641700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89fc0a7260 con 0x7f89fc0bc340 2023-07-25T14:36:04.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.518+0000 7f8a02641700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89fc1587f0 con 0x7f89fc0a5f70 2023-07-25T14:36:04.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.518+0000 7f8a02641700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89fc1596e0 con 0x7f89fc0a6d80 2023-07-25T14:36:04.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.519+0000 7f89fb7fe700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f89fc0a5f70 0x7f89fc15bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:04.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.519+0000 7f89fb7fe700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f89fc0a5f70 0x7f89fc15bd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.72:35888/0 (socket says 172.21.15.72:35888) 2023-07-25T14:36:04.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.519+0000 7f89fb7fe700 1 -- 172.21.15.72:0/2055469314 learned_addr learned my addr 172.21.15.72:0/2055469314 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:04.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.519+0000 7f89fb7fe700 1 -- 172.21.15.72:0/2055469314 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f89fc0a6d80 msgr2=0x7f89fc06a190 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-25T14:36:04.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.519+0000 7f89fb7fe700 1 --2- 172.21.15.72:0/2055469314 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f89fc0a6d80 0x7f89fc06a190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:04.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.519+0000 7f89fb7fe700 1 -- 172.21.15.72:0/2055469314 >> v1:172.21.15.92:6789/0 conn(0x7f89fc0bc340 legacy=0x7f89fc158fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:04.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.519+0000 7f89fb7fe700 1 -- 172.21.15.72:0/2055469314 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89fc0c0b00 con 0x7f89fc0a5f70 2023-07-25T14:36:04.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.519+0000 7f89fb7fe700 1 --2- 172.21.15.72:0/2055469314 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f89fc0a5f70 0x7f89fc15bd60 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f89ec0098f0 tx=0x7f89ec009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=af876a7c88a53eba server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:04.538 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.522+0000 7f89faffd700 1 -- 172.21.15.72:0/2055469314 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89ec004230 con 0x7f89fc0a5f70 2023-07-25T14:36:04.538 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.522+0000 7f89faffd700 1 -- 172.21.15.72:0/2055469314 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89ec004390 con 0x7f89fc0a5f70 2023-07-25T14:36:04.538 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.522+0000 7f89faffd700 1 -- 172.21.15.72:0/2055469314 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89ec0036a0 con 0x7f89fc0a5f70 2023-07-25T14:36:04.538 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.523+0000 7f8a02641700 1 -- 172.21.15.72:0/2055469314 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f89fc0a5f70 msgr2=0x7f89fc15bd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:04.538 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.523+0000 7f8a02641700 1 --2- 172.21.15.72:0/2055469314 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f89fc0a5f70 0x7f89fc15bd60 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f89ec0098f0 tx=0x7f89ec009c00 comp rx=0 tx=0).stop 2023-07-25T14:36:04.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.523+0000 7f8a02641700 1 -- 172.21.15.72:0/2055469314 shutdown_connections 2023-07-25T14:36:04.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.523+0000 7f8a02641700 1 --2- 172.21.15.72:0/2055469314 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f89fc0a6d80 0x7f89fc06a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:04.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.523+0000 7f8a02641700 1 --2- 172.21.15.72:0/2055469314 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f89fc0a5f70 0x7f89fc15bd60 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:04.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.523+0000 7f8a02641700 1 -- 172.21.15.72:0/2055469314 >> 172.21.15.72:0/2055469314 conn(0x7f89fc0a7860 msgr2=0x7f89fc0a7c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:04.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.524+0000 7f8a02641700 1 -- 172.21.15.72:0/2055469314 shutdown_connections 2023-07-25T14:36:04.540 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.524+0000 7f8a02641700 1 -- 172.21.15.72:0/2055469314 wait complete. 2023-07-25T14:36:04.540 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.525+0000 7f8a02641700 1 Processor -- start 2023-07-25T14:36:04.540 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.526+0000 7f8a02641700 1 -- start start 2023-07-25T14:36:04.540 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.527+0000 7f8a02641700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f89fc0a5f70 0x7f89fc0a87d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:04.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.527+0000 7f8a02641700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f89fc0a6d80 0x7f89fc0bd7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:04.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.527+0000 7f8a02641700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f89fc0bc340 0x7f89fc15b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:04.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.527+0000 7f8a02641700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89fc14e350 con 0x7f89fc0bc340 2023-07-25T14:36:04.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.527+0000 7f8a02641700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89fc14f810 con 0x7f89fc0a5f70 2023-07-25T14:36:04.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.527+0000 7f8a02641700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89fc0be2c0 con 0x7f89fc0a6d80 2023-07-25T14:36:04.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.527+0000 7f8a00bde700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f89fc0bc340 0x7f89fc15b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:04.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.527+0000 7f8a00bde700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f89fc0bc340 0x7f89fc15b4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40322/0 (socket says 172.21.15.72:40322) 2023-07-25T14:36:04.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.527+0000 7f8a00bde700 1 -- 172.21.15.72:0/3722323586 learned_addr learned my addr 172.21.15.72:0/3722323586 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:04.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.528+0000 7f89fb7fe700 1 --2- 172.21.15.72:0/3722323586 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f89fc0a6d80 0x7f89fc0bd7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:04.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.528+0000 7f8a00bde700 1 -- 172.21.15.72:0/3722323586 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f89fc0a6d80 msgr2=0x7f89fc0bd7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:04.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.528+0000 7f8a00bde700 1 --2- 172.21.15.72:0/3722323586 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f89fc0a6d80 0x7f89fc0bd7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:04.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.528+0000 7f8a00bde700 1 -- 172.21.15.72:0/3722323586 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f89fc0a5f70 msgr2=0x7f89fc0a87d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:04.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.528+0000 7f8a00bde700 1 --2- 172.21.15.72:0/3722323586 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f89fc0a5f70 0x7f89fc0a87d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:04.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.528+0000 7f8a00bde700 1 -- 172.21.15.72:0/3722323586 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89ec009550 con 0x7f89fc0bc340 2023-07-25T14:36:04.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.528+0000 7f8a00bde700 1 --2- 172.21.15.72:0/3722323586 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f89fc0bc340 0x7f89fc15b4f0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f89f0009fd0 tx=0x7f89f000b770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:04.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.529+0000 7f89f8ff9700 1 -- 172.21.15.72:0/3722323586 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89f0011830 con 0x7f89fc0bc340 2023-07-25T14:36:04.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.529+0000 7f89f8ff9700 1 -- 172.21.15.72:0/3722323586 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89f0011990 con 0x7f89fc0bc340 2023-07-25T14:36:04.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.529+0000 7f89f8ff9700 1 -- 172.21.15.72:0/3722323586 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89f0011d40 con 0x7f89fc0bc340 2023-07-25T14:36:04.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.529+0000 7f8a02641700 1 -- 172.21.15.72:0/3722323586 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89fc14ef70 con 0x7f89fc0bc340 2023-07-25T14:36:04.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.530+0000 7f8a02641700 1 -- 172.21.15.72:0/3722323586 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89fc14f530 con 0x7f89fc0bc340 2023-07-25T14:36:04.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.532+0000 7f89f8ff9700 1 -- 172.21.15.72:0/3722323586 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f89f001a400 con 0x7f89fc0bc340 2023-07-25T14:36:04.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.533+0000 7f89f8ff9700 1 --2- 172.21.15.72:0/3722323586 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f89e806adb0 0x7f89e806d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:04.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.533+0000 7f89f8ff9700 1 -- 172.21.15.72:0/3722323586 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f89f0089660 con 0x7f89fc0bc340 2023-07-25T14:36:04.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.533+0000 7f89fbfff700 1 --2- 172.21.15.72:0/3722323586 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f89e806adb0 0x7f89e806d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:04.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.531+0000 7f6bf8a05700 1 Processor -- start 2023-07-25T14:36:04.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.531+0000 7f6bf8a05700 1 -- start start 2023-07-25T14:36:04.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.532+0000 7f6bf8a05700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6bf41620a0 0x7f6bf40c25c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:04.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.532+0000 7f6bf8a05700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bf40c19a0 con 0x7f6bf40bad90 2023-07-25T14:36:04.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.532+0000 7f6bf8a05700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bf40c1070 con 0x7f6bf40c2b00 2023-07-25T14:36:04.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.532+0000 7f6bf8a05700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bf40c12e0 con 0x7f6bf41620a0 2023-07-25T14:36:04.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.532+0000 7f6bf2d9d700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f6bf40bad90 0x7f6bf416b960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:59296/0 (socket says 172.21.15.72:59296) 2023-07-25T14:36:04.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.532+0000 7f6bf2d9d700 1 -- 172.21.15.72:0/1422354268 learned_addr learned my addr 172.21.15.72:0/1422354268 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:36:04.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.533+0000 7f6bf159a700 1 -- 172.21.15.72:0/1422354268 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1476617987 0 0) 0x7f6bf40c19a0 con 0x7f6bf40bad90 2023-07-25T14:36:04.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.534+0000 7f89fbfff700 1 --2- 172.21.15.72:0/3722323586 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f89e806adb0 0x7f89e806d270 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f89fc04eea0 tx=0x7f89f4009250 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:04.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.534+0000 7f74fc919700 1 Processor -- start 2023-07-25T14:36:04.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.533+0000 7f6bf259c700 1 --2- 172.21.15.72:0/1422354268 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6bf41620a0 0x7f6bf40c25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:04.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.534+0000 7f74fc919700 1 -- start start 2023-07-25T14:36:04.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.534+0000 7f6bf159a700 1 -- 172.21.15.72:0/1422354268 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6bdc0035b0 con 0x7f6bf40bad90 2023-07-25T14:36:04.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.534+0000 7f6bf159a700 1 -- 172.21.15.72:0/1422354268 <== mon.1 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1987215030 0 0) 0x7f6bf40c1070 con 0x7f6bf40c2b00 2023-07-25T14:36:04.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.534+0000 7f6bf159a700 1 -- 172.21.15.72:0/1422354268 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6bf40c19a0 con 0x7f6bf40c2b00 2023-07-25T14:36:04.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.535+0000 7f6bf159a700 1 -- 172.21.15.72:0/1422354268 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 320835427 0 0) 0x7f6bdc0035b0 con 0x7f6bf40bad90 2023-07-25T14:36:04.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.535+0000 7f6bf159a700 1 -- 172.21.15.72:0/1422354268 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6bf41620a0 msgr2=0x7f6bf40c25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:04.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.535+0000 7f6bf159a700 1 --2- 172.21.15.72:0/1422354268 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6bf41620a0 0x7f6bf40c25c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:04.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.535+0000 7f6bf159a700 1 -- 172.21.15.72:0/1422354268 >> v1:172.21.15.92:6789/0 conn(0x7f6bf40c2b00 legacy=0x7f6bf40ba680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:04.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.535+0000 7f6bf159a700 1 -- 172.21.15.72:0/1422354268 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bf40c0cf0 con 0x7f6bf40bad90 2023-07-25T14:36:04.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.535+0000 7f6bf159a700 1 -- 172.21.15.72:0/1422354268 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2559588315 0 0) 0x7f6be8001670 con 0x7f6bf40bad90 2023-07-25T14:36:04.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.535+0000 7f6bf159a700 1 -- 172.21.15.72:0/1422354268 >> v1:172.21.15.72:6789/0 conn(0x7f6bf40bad90 legacy=0x7f6bf416b960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:04.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.535+0000 7f6bf159a700 1 --2- 172.21.15.72:0/1422354268 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6bdc004c20 0x7f6bdc005020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:04.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.535+0000 7f6bf159a700 1 --2- 172.21.15.72:0/1422354268 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6bdc0037f0 0x7f6bdc003c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:04.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.535+0000 7f6bf159a700 1 --2- 172.21.15.72:0/1422354268 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6bdc0041b0 0x7f6bdc00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:04.552 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.535+0000 7f6bf159a700 1 -- 172.21.15.72:0/1422354268 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bf40c12e0 con 0x7f6bdc0037f0 2023-07-25T14:36:04.552 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.535+0000 7f6bf159a700 1 -- 172.21.15.72:0/1422354268 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bdc00c160 con 0x7f6bdc0041b0 2023-07-25T14:36:04.552 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.535+0000 7f6bf159a700 1 -- 172.21.15.72:0/1422354268 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bdc00c320 con 0x7f6bdc004c20 2023-07-25T14:36:04.552 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.536+0000 7f6bf1d9b700 1 --2- 172.21.15.72:0/1422354268 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6bdc0037f0 0x7f6bdc003c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:04.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.536+0000 7f74fc919700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f74f80bbef0 0x7f74f8155170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:04.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.536+0000 7f74fc919700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74f8151880 con 0x7f74f8151d10 2023-07-25T14:36:04.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.536+0000 7f74fc919700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74f80c1c80 con 0x7f74f8071300 2023-07-25T14:36:04.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.536+0000 7f74fc919700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74f80c1f60 con 0x7f74f80bbef0 2023-07-25T14:36:04.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.536+0000 7f74f5d9b700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f74f8151d10 0x7f74f80c2560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:59308/0 (socket says 172.21.15.72:59308) 2023-07-25T14:36:04.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.536+0000 7f74f5d9b700 1 -- 172.21.15.72:0/22053470 learned_addr learned my addr 172.21.15.72:0/22053470 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:36:04.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.536+0000 7f74f659c700 1 --2- 172.21.15.72:0/22053470 >> v2:172.21.15.72:3300/0 conn(0x7f74f80bbef0 0x7f74f8155170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:04.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.536+0000 7f74f659c700 1 -- 172.21.15.72:0/22053470 >> v1:172.21.15.92:6789/0 conn(0x7f74f8071300 legacy=0x7f74f815b9a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-25T14:36:04.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.536+0000 7f74f659c700 1 -- 172.21.15.72:0/22053470 >> v1:172.21.15.72:6789/0 conn(0x7f74f8151d10 legacy=0x7f74f80c2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:04.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.536+0000 7f74f659c700 1 -- 172.21.15.72:0/22053470 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74f8151230 con 0x7f74f80bbef0 2023-07-25T14:36:04.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.536+0000 7f74f659c700 1 --2- 172.21.15.72:0/22053470 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f74f80bbef0 0x7f74f8155170 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f74ec009840 tx=0x7f74ec009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c05def83acc0c24 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:04.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.536+0000 7f6bf1d9b700 1 -- 172.21.15.72:0/1422354268 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6bdc004c20 msgr2=0x7f6bdc005020 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-25T14:36:04.555 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.536+0000 7f6bf1d9b700 1 --2- 172.21.15.72:0/1422354268 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6bdc004c20 0x7f6bdc005020 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:04.555 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.537+0000 7f6bf1d9b700 1 -- 172.21.15.72:0/1422354268 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6bdc0041b0 msgr2=0x7f6bdc00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:04.555 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.537+0000 7f6bf1d9b700 1 --2- 172.21.15.72:0/1422354268 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6bdc0041b0 0x7f6bdc00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:04.555 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.537+0000 7f6bf1d9b700 1 -- 172.21.15.72:0/1422354268 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bf40c0cf0 con 0x7f6bdc0037f0 2023-07-25T14:36:04.555 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.537+0000 7f74f559a700 1 -- 172.21.15.72:0/22053470 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74ec004230 con 0x7f74f80bbef0 2023-07-25T14:36:04.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.537+0000 7f6bf1d9b700 1 --2- 172.21.15.72:0/1422354268 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6bdc0037f0 0x7f6bdc003c70 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f6be4001840 tx=0x7f6bdc005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d4c7c791bce8754 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:04.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.537+0000 7f74f559a700 1 -- 172.21.15.72:0/22053470 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74ec004390 con 0x7f74f80bbef0 2023-07-25T14:36:04.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.537+0000 7f74f559a700 1 -- 172.21.15.72:0/22053470 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74ec0036a0 con 0x7f74f80bbef0 2023-07-25T14:36:04.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.537+0000 7f6bf159a700 1 -- 172.21.15.72:0/1422354268 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6be40052d0 con 0x7f6bdc0037f0 2023-07-25T14:36:04.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.537+0000 7f6bf159a700 1 -- 172.21.15.72:0/1422354268 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6be4005430 con 0x7f6bdc0037f0 2023-07-25T14:36:04.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.537+0000 7f6bf159a700 1 -- 172.21.15.72:0/1422354268 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6be4003880 con 0x7f6bdc0037f0 2023-07-25T14:36:04.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.538+0000 7f74fc919700 1 -- 172.21.15.72:0/22053470 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f74f80bbef0 msgr2=0x7f74f8155170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:04.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.538+0000 7f74fc919700 1 --2- 172.21.15.72:0/22053470 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f74f80bbef0 0x7f74f8155170 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f74ec009840 tx=0x7f74ec009b50 comp rx=0 tx=0).stop 2023-07-25T14:36:04.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.538+0000 7f6bf8a05700 1 -- 172.21.15.72:0/1422354268 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6bdc0037f0 msgr2=0x7f6bdc003c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:04.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.538+0000 7f6bf8a05700 1 --2- 172.21.15.72:0/1422354268 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6bdc0037f0 0x7f6bdc003c70 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f6be4001840 tx=0x7f6bdc005880 comp rx=0 tx=0).stop 2023-07-25T14:36:04.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.538+0000 7f74fc919700 1 -- 172.21.15.72:0/22053470 shutdown_connections 2023-07-25T14:36:04.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.538+0000 7f74fc919700 1 --2- 172.21.15.72:0/22053470 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f74f80bbef0 0x7f74f8155170 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:04.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.538+0000 7f74fc919700 1 -- 172.21.15.72:0/22053470 >> 172.21.15.72:0/22053470 conn(0x7f74f80a7860 msgr2=0x7f74f80a7c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:04.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.539+0000 7f8a02641700 1 -- 172.21.15.72:0/3722323586 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89dc0052f0 con 0x7f89fc0bc340 2023-07-25T14:36:04.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.539+0000 7f74fc919700 1 -- 172.21.15.72:0/22053470 shutdown_connections 2023-07-25T14:36:04.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.540+0000 7f74fc919700 1 -- 172.21.15.72:0/22053470 wait complete. 2023-07-25T14:36:04.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.541+0000 7f74fc919700 1 Processor -- start 2023-07-25T14:36:04.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.543+0000 7f6bf2d9d700 1 -- 172.21.15.72:0/1422354268 reap_dead start 2023-07-25T14:36:04.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.543+0000 7f6bf8a05700 1 -- 172.21.15.72:0/1422354268 shutdown_connections 2023-07-25T14:36:04.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.543+0000 7f6bf8a05700 1 -- 172.21.15.72:0/1422354268 >> 172.21.15.72:0/1422354268 conn(0x7f6bf40a7860 msgr2=0x7f6bf40a7c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:04.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.542+0000 7f74fc919700 1 -- start start 2023-07-25T14:36:04.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.543+0000 7f74fc919700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f74f8071300 0x7f74f81fa070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:04.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.543+0000 7f74fc919700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f74f80bbef0 0x7f74f81ed790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:04.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.543+0000 7f74fc919700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f74f8151d10 0x7f74f81edcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:04.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.543+0000 7f74fc919700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74f81fabe0 con 0x7f74f8151d10 2023-07-25T14:36:04.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.543+0000 7f74fc919700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74f81f82f0 con 0x7f74f80bbef0 2023-07-25T14:36:04.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.543+0000 7f74fc919700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74f80a8e10 con 0x7f74f8071300 2023-07-25T14:36:04.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.543+0000 7f74f659c700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f74f8071300 0x7f74f81fa070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:04.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.543+0000 7f74f5d9b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f74f80bbef0 0x7f74f81ed790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:04.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.543+0000 7f74f659c700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f74f8071300 0x7f74f81fa070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3301/0 says I am v2:172.21.15.72:45570/0 (socket says 172.21.15.72:45570) 2023-07-25T14:36:04.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.543+0000 7f74f659c700 1 -- 172.21.15.72:0/3707402863 learned_addr learned my addr 172.21.15.72:0/3707402863 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:04.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.543+0000 7f74f659c700 1 -- 172.21.15.72:0/3707402863 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f74f80bbef0 msgr2=0x7f74f81ed790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:04.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.543+0000 7f74f659c700 1 --2- 172.21.15.72:0/3707402863 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f74f80bbef0 0x7f74f81ed790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:04.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.543+0000 7f74f659c700 1 -- 172.21.15.72:0/3707402863 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f74f8151d10 msgr2=0x7f74f81edcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:04.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.543+0000 7f74f659c700 1 --2- 172.21.15.72:0/3707402863 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f74f8151d10 0x7f74f81edcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:04.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.543+0000 7f74f659c700 1 -- 172.21.15.72:0/3707402863 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74ec0094a0 con 0x7f74f8071300 2023-07-25T14:36:04.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.544+0000 7f74f659c700 1 --2- 172.21.15.72:0/3707402863 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f74f8071300 0x7f74f81fa070 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f74ec009f50 tx=0x7f74ec004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:04.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.547+0000 7f6bf8a05700 1 -- 172.21.15.72:0/1422354268 shutdown_connections 2023-07-25T14:36:04.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.547+0000 7f74f5d9b700 1 --2- 172.21.15.72:0/3707402863 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f74f80bbef0 0x7f74f81ed790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-25T14:36:04.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.548+0000 7f89f8ff9700 1 -- 172.21.15.72:0/3722323586 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f89f0054490 con 0x7f89fc0bc340 2023-07-25T14:36:04.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.547+0000 7f6bf8a05700 1 -- 172.21.15.72:0/1422354268 wait complete. 2023-07-25T14:36:04.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.549+0000 7f6bf8a05700 1 Processor -- start 2023-07-25T14:36:04.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.549+0000 7f6bf8a05700 1 -- start start 2023-07-25T14:36:04.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.550+0000 7f6bf8a05700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6bf41608e0 0x7f6bf40a5fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:04.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.550+0000 7f6bf8a05700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6bf41624a0 0x7f6bf40a6500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:04.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.550+0000 7f6bf8a05700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6bf4162980 0x7f6bf40868d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:04.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.550+0000 7f6bf8a05700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bf4163dc0 con 0x7f6bf41624a0 2023-07-25T14:36:04.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.550+0000 7f6bf8a05700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bf4165560 con 0x7f6bf41608e0 2023-07-25T14:36:04.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.550+0000 7f6bf8a05700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bf40c5110 con 0x7f6bf4162980 2023-07-25T14:36:04.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.550+0000 7f6bf259c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6bf41608e0 0x7f6bf40a5fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:04.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.550+0000 7f6bf259c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6bf41608e0 0x7f6bf40a5fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.72:35920/0 (socket says 172.21.15.72:35920) 2023-07-25T14:36:04.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.550+0000 7f6bf259c700 1 -- 172.21.15.72:0/2988368279 learned_addr learned my addr 172.21.15.72:0/2988368279 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:04.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.551+0000 7f6bf1d9b700 1 --2- 172.21.15.72:0/2988368279 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6bf41624a0 0x7f6bf40a6500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:04.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.551+0000 7f6bf259c700 1 -- 172.21.15.72:0/2988368279 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6bf4162980 msgr2=0x7f6bf40868d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:04.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.551+0000 7f6bf259c700 1 --2- 172.21.15.72:0/2988368279 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6bf4162980 0x7f6bf40868d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:04.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.551+0000 7f6bf259c700 1 -- 172.21.15.72:0/2988368279 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6bf41624a0 msgr2=0x7f6bf40a6500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:04.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.551+0000 7f6bf259c700 1 --2- 172.21.15.72:0/2988368279 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6bf41624a0 0x7f6bf40a6500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:04.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.551+0000 7f6bf259c700 1 -- 172.21.15.72:0/2988368279 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bf4164fe0 con 0x7f6bf41608e0 2023-07-25T14:36:04.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.551+0000 7f6bf259c700 1 --2- 172.21.15.72:0/2988368279 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6bf41608e0 0x7f6bf40a5fc0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f6bec00ee30 tx=0x7f6bec00c670 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:04.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.551+0000 7f6be2ffd700 1 -- 172.21.15.72:0/2988368279 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bec00a600 con 0x7f6bf41608e0 2023-07-25T14:36:04.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.551+0000 7f6be2ffd700 1 -- 172.21.15.72:0/2988368279 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bec00a760 con 0x7f6bf41608e0 2023-07-25T14:36:04.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.551+0000 7f6be2ffd700 1 -- 172.21.15.72:0/2988368279 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bec00ab10 con 0x7f6bf41608e0 2023-07-25T14:36:04.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.552+0000 7f6bf8a05700 1 -- 172.21.15.72:0/2988368279 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bf40c4de0 con 0x7f6bf41608e0 2023-07-25T14:36:04.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.552+0000 7f6bf8a05700 1 -- 172.21.15.72:0/2988368279 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bf4071230 con 0x7f6bf41608e0 2023-07-25T14:36:04.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.554+0000 7f6bf8a05700 1 -- 172.21.15.72:0/2988368279 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bf40c4c40 con 0x7f6bf41608e0 2023-07-25T14:36:04.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.554+0000 7f6be2ffd700 1 -- 172.21.15.72:0/2988368279 <== mon.1 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6bec008040 con 0x7f6bf41608e0 2023-07-25T14:36:04.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.555+0000 7f6be2ffd700 1 --2- 172.21.15.72:0/2988368279 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f6bdc06c880 0x7f6bdc06ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:04.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.555+0000 7f6be2ffd700 1 -- 172.21.15.72:0/2988368279 <== mon.1 v2:172.21.15.92:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f6bec089b70 con 0x7f6bf41608e0 2023-07-25T14:36:04.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.556+0000 7f6bf1d9b700 1 --2- 172.21.15.72:0/2988368279 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f6bdc06c880 0x7f6bdc06ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:04.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.556+0000 7f74e6ffd700 1 -- 172.21.15.72:0/3707402863 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74ec01e070 con 0x7f74f8071300 2023-07-25T14:36:04.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.556+0000 7f74e6ffd700 1 -- 172.21.15.72:0/3707402863 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74ec003e40 con 0x7f74f8071300 2023-07-25T14:36:04.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.556+0000 7f74e6ffd700 1 -- 172.21.15.72:0/3707402863 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74ec00faf0 con 0x7f74f8071300 2023-07-25T14:36:04.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.557+0000 7f6bf1d9b700 1 --2- 172.21.15.72:0/2988368279 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f6bdc06c880 0x7f6bdc06ed40 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f6bf40c62a0 tx=0x7f6be400a000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:04.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.559+0000 7f74fc919700 1 -- 172.21.15.72:0/3707402863 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74f81ee210 con 0x7f74f8071300 2023-07-25T14:36:04.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.559+0000 7f74fc919700 1 -- 172.21.15.72:0/3707402863 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74f81f7f10 con 0x7f74f8071300 2023-07-25T14:36:04.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.566+0000 7f74e6ffd700 1 -- 172.21.15.72:0/3707402863 <== mon.2 v2:172.21.15.92:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f74ec00fc50 con 0x7f74f8071300 2023-07-25T14:36:04.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.567+0000 7f74e6ffd700 1 --2- 172.21.15.72:0/3707402863 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f74d806ade0 0x7f74d806d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:04.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.567+0000 7f74e6ffd700 1 -- 172.21.15.72:0/3707402863 <== mon.2 v2:172.21.15.92:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f74ec08a870 con 0x7f74f8071300 2023-07-25T14:36:04.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.564+0000 7f6be2ffd700 1 -- 172.21.15.72:0/2988368279 <== mon.1 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f6bf40c4c40 con 0x7f6bf41608e0 2023-07-25T14:36:04.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.568+0000 7f74f5d9b700 1 --2- 172.21.15.72:0/3707402863 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f74d806ade0 0x7f74d806d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:04.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.569+0000 7f74fc919700 1 -- 172.21.15.72:0/3707402863 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74f81f80d0 con 0x7f74f8071300 2023-07-25T14:36:04.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.569+0000 7f74f5d9b700 1 --2- 172.21.15.72:0/3707402863 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f74d806ade0 0x7f74d806d2a0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f74f81f9d60 tx=0x7f74e8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:04.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.577+0000 7f74e6ffd700 1 -- 172.21.15.72:0/3707402863 <== mon.2 v2:172.21.15.92:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f74ec059250 con 0x7f74f8071300 2023-07-25T14:36:04.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.842+0000 7fa6f258d700 1 -- 172.21.15.72:0/3225701270 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fa6ec0bf9f0 con 0x7fa6d4004850 2023-07-25T14:36:04.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.845+0000 7f4dee4d6700 1 -- 172.21.15.72:0/968945079 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f4dc8005870 con 0x7f4de80a5f70 2023-07-25T14:36:04.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.846+0000 7fa6e8ff9700 1 -- 172.21.15.72:0/3225701270 <== mon.1 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa6ec0bf9f0 con 0x7fa6d4004850 2023-07-25T14:36:04.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.849+0000 7f86edf74700 1 -- 172.21.15.72:0/1616580942 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f86c8005870 con 0x7f86e80ab990 2023-07-25T14:36:04.862 INFO:teuthology.orchestra.run.smithi072.stdout:55834574857 2023-07-25T14:36:04.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.850+0000 7f86cffff700 1 -- 172.21.15.72:0/1616580942 <== mon.2 v2:172.21.15.92:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f86d80045b0 con 0x7f86e80ab990 2023-07-25T14:36:04.862 INFO:teuthology.orchestra.run.smithi072.stdout:55834574857 2023-07-25T14:36:04.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.852+0000 7f4de4ff9700 1 -- 172.21.15.72:0/968945079 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4dd8021090 con 0x7f4de80a5f70 2023-07-25T14:36:04.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.852+0000 7fa6f258d700 1 -- 172.21.15.72:0/3225701270 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fa6d806ad30 msgr2=0x7fa6d806d1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:04.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.852+0000 7fa6f258d700 1 --2- 172.21.15.72:0/3225701270 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fa6d806ad30 0x7fa6d806d1f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fa6dc000c00 tx=0x7fa6dc01b040 comp rx=0 tx=0).stop 2023-07-25T14:36:04.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.852+0000 7fa6f258d700 1 -- 172.21.15.72:0/3225701270 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa6d4004850 msgr2=0x7fa6ec0bd250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:04.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.852+0000 7fa6f258d700 1 --2- 172.21.15.72:0/3225701270 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa6d4004850 0x7fa6ec0bd250 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fa6e000d7d0 tx=0x7fa6e000dae0 comp rx=0 tx=0).stop 2023-07-25T14:36:04.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.854+0000 7f86edf74700 1 -- 172.21.15.72:0/1616580942 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f86d406ad30 msgr2=0x7f86d406d1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:04.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.854+0000 7f86edf74700 1 --2- 172.21.15.72:0/1616580942 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f86d406ad30 0x7f86d406d1f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f86e80ab450 tx=0x7f86dc009210 comp rx=0 tx=0).stop 2023-07-25T14:36:04.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.854+0000 7f86edf74700 1 -- 172.21.15.72:0/1616580942 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f86e80ab990 msgr2=0x7f86e81344d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:04.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.854+0000 7f86edf74700 1 --2- 172.21.15.72:0/1616580942 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f86e80ab990 0x7f86e81344d0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f86e806eea0 tx=0x7f86d8004750 comp rx=0 tx=0).stop 2023-07-25T14:36:04.867 INFO:teuthology.orchestra.run.smithi072.stdout:55834574857 2023-07-25T14:36:04.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.855+0000 7fa6f258d700 1 -- 172.21.15.72:0/3225701270 shutdown_connections 2023-07-25T14:36:04.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.855+0000 7fa6f258d700 1 --2- 172.21.15.72:0/3225701270 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fa6d806ad30 0x7fa6d806d1f0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:04.868 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.855+0000 7fa6f258d700 1 --2- 172.21.15.72:0/3225701270 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa6ec1f19a0 0x7fa6ec1f1e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:04.868 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.855+0000 7fa6f258d700 1 --2- 172.21.15.72:0/3225701270 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa6d4004850 0x7fa6ec0bd250 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:04.868 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.855+0000 7fa6f258d700 1 --2- 172.21.15.72:0/3225701270 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa6ec14bde0 0x7fa6ec0c5f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:04.868 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.855+0000 7fa6f258d700 1 -- 172.21.15.72:0/3225701270 >> 172.21.15.72:0/3225701270 conn(0x7fa6ec0a7860 msgr2=0x7fa6ec14cb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:04.868 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.855+0000 7fa6f258d700 1 -- 172.21.15.72:0/3225701270 shutdown_connections 2023-07-25T14:36:04.868 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.855+0000 7fa6f258d700 1 -- 172.21.15.72:0/3225701270 wait complete. 2023-07-25T14:36:04.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.855+0000 7f86edf74700 1 -- 172.21.15.72:0/1616580942 shutdown_connections 2023-07-25T14:36:04.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.855+0000 7f86edf74700 1 --2- 172.21.15.72:0/1616580942 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f86d406ad30 0x7f86d406d1f0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:04.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.855+0000 7f86edf74700 1 --2- 172.21.15.72:0/1616580942 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f86e80ab990 0x7f86e81344d0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:04.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.855+0000 7f86edf74700 1 --2- 172.21.15.72:0/1616580942 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f86e815c320 0x7f86e80c4d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:04.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.855+0000 7f86edf74700 1 --2- 172.21.15.72:0/1616580942 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f86e8155d70 0x7f86e80c4810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:04.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.855+0000 7f86edf74700 1 -- 172.21.15.72:0/1616580942 >> 172.21.15.72:0/1616580942 conn(0x7f86e806dd10 msgr2=0x7f86e8147670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:04.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.855+0000 7f86edf74700 1 -- 172.21.15.72:0/1616580942 shutdown_connections 2023-07-25T14:36:04.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.855+0000 7f86edf74700 1 -- 172.21.15.72:0/1616580942 wait complete. 2023-07-25T14:36:04.872 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.860+0000 7f4dee4d6700 1 -- 172.21.15.72:0/968945079 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f4dd406ace0 msgr2=0x7f4dd406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:04.872 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.860+0000 7f4dee4d6700 1 --2- 172.21.15.72:0/968945079 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f4dd406ace0 0x7f4dd406d1a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f4ddc006fd0 tx=0x7f4ddc006bc0 comp rx=0 tx=0).stop 2023-07-25T14:36:04.872 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.860+0000 7f4dee4d6700 1 -- 172.21.15.72:0/968945079 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4de80a5f70 msgr2=0x7f4de80a5470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:04.872 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.860+0000 7f4dee4d6700 1 --2- 172.21.15.72:0/968945079 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4de80a5f70 0x7f4de80a5470 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f4dd800e9b0 tx=0x7f4dd800ed70 comp rx=0 tx=0).stop 2023-07-25T14:36:04.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.867+0000 7f4dee4d6700 1 -- 172.21.15.72:0/968945079 shutdown_connections 2023-07-25T14:36:04.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.867+0000 7f4dee4d6700 1 --2- 172.21.15.72:0/968945079 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f4dd406ace0 0x7f4dd406d1a0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:04.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.867+0000 7f4dee4d6700 1 --2- 172.21.15.72:0/968945079 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4de80bc340 0x7f4de81454d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:04.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.867+0000 7f4dee4d6700 1 --2- 172.21.15.72:0/968945079 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4de80a5f70 0x7f4de80a5470 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:04.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.867+0000 7f4dee4d6700 1 --2- 172.21.15.72:0/968945079 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4de80a6d80 0x7f4de813f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:04.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.867+0000 7f4dee4d6700 1 -- 172.21.15.72:0/968945079 >> 172.21.15.72:0/968945079 conn(0x7f4de80a7860 msgr2=0x7f4de81577f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:04.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.871+0000 7f4dee4d6700 1 -- 172.21.15.72:0/968945079 shutdown_connections 2023-07-25T14:36:04.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.871+0000 7f4dee4d6700 1 -- 172.21.15.72:0/968945079 wait complete. 2023-07-25T14:36:04.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.872+0000 7f34dc196700 1 -- 172.21.15.72:0/143905043 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f34bc005870 con 0x7f34d41504f0 2023-07-25T14:36:04.886 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.3 2023-07-25T14:36:04.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.874+0000 7f34ca7fc700 1 -- 172.21.15.72:0/143905043 <== mon.1 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f34cc028070 con 0x7f34d41504f0 2023-07-25T14:36:04.886 DEBUG:teuthology.parallel:result is None 2023-07-25T14:36:04.893 INFO:teuthology.orchestra.run.smithi072.stdout:55834574857 2023-07-25T14:36:04.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.883+0000 7f34dc196700 1 -- 172.21.15.72:0/143905043 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f34b806ace0 msgr2=0x7f34b806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:04.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.883+0000 7f34dc196700 1 --2- 172.21.15.72:0/143905043 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f34b806ace0 0x7f34b806d1a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f34d41622f0 tx=0x7f34c4009210 comp rx=0 tx=0).stop 2023-07-25T14:36:04.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.883+0000 7f34dc196700 1 -- 172.21.15.72:0/143905043 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f34d41504f0 msgr2=0x7f34d4153fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:04.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.883+0000 7f34dc196700 1 --2- 172.21.15.72:0/143905043 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f34d41504f0 0x7f34d4153fe0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f34d406e620 tx=0x7f34cc004750 comp rx=0 tx=0).stop 2023-07-25T14:36:04.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.883+0000 7f34dc196700 1 -- 172.21.15.72:0/143905043 shutdown_connections 2023-07-25T14:36:04.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.883+0000 7f34dc196700 1 --2- 172.21.15.72:0/143905043 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f34b806ace0 0x7f34b806d1a0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:04.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.883+0000 7f34dc196700 1 --2- 172.21.15.72:0/143905043 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f34d41504f0 0x7f34d4153fe0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:04.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.883+0000 7f34dc196700 1 --2- 172.21.15.72:0/143905043 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f34d40c17b0 0x7f34d41421b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:04.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.883+0000 7f34dc196700 1 --2- 172.21.15.72:0/143905043 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f34d40c21a0 0x7f34d40a84e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:04.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.883+0000 7f34dc196700 1 -- 172.21.15.72:0/143905043 >> 172.21.15.72:0/143905043 conn(0x7f34d40a7860 msgr2=0x7f34d40720a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:04.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.883+0000 7f34dc196700 1 -- 172.21.15.72:0/143905043 shutdown_connections 2023-07-25T14:36:04.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.883+0000 7f34dc196700 1 -- 172.21.15.72:0/143905043 wait complete. 2023-07-25T14:36:04.898 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.4 2023-07-25T14:36:04.898 DEBUG:teuthology.parallel:result is None 2023-07-25T14:36:04.904 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.1 2023-07-25T14:36:04.904 DEBUG:teuthology.parallel:result is None 2023-07-25T14:36:04.909 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.5 2023-07-25T14:36:04.910 DEBUG:teuthology.parallel:result is None 2023-07-25T14:36:04.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.907+0000 7fb8442d4700 1 -- 172.21.15.72:0/3527588772 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fb824005870 con 0x7fb83c1620a0 2023-07-25T14:36:04.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.908+0000 7fb832ffd700 1 -- 172.21.15.72:0/3527588772 <== mon.1 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb83405c320 con 0x7fb83c1620a0 2023-07-25T14:36:04.920 INFO:teuthology.orchestra.run.smithi072.stdout:55834574857 2023-07-25T14:36:04.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.911+0000 7fb8442d4700 1 -- 172.21.15.72:0/3527588772 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fb82006ad30 msgr2=0x7fb82006d1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:04.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.911+0000 7fb8442d4700 1 --2- 172.21.15.72:0/3527588772 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fb82006ad30 0x7fb82006d1f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fb8380012a0 tx=0x7fb838001210 comp rx=0 tx=0).stop 2023-07-25T14:36:04.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.911+0000 7fb8442d4700 1 -- 172.21.15.72:0/3527588772 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb83c1620a0 msgr2=0x7fb83c160230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:04.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.911+0000 7fb8442d4700 1 --2- 172.21.15.72:0/3527588772 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb83c1620a0 0x7fb83c160230 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fb834013000 tx=0x7fb834004ad0 comp rx=0 tx=0).stop 2023-07-25T14:36:04.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.911+0000 7fb8442d4700 1 -- 172.21.15.72:0/3527588772 shutdown_connections 2023-07-25T14:36:04.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.911+0000 7fb8442d4700 1 --2- 172.21.15.72:0/3527588772 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fb82006ad30 0x7fb82006d1f0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:04.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.911+0000 7fb8442d4700 1 --2- 172.21.15.72:0/3527588772 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb83c089240 0x7fb83c15d730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:04.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.911+0000 7fb8442d4700 1 --2- 172.21.15.72:0/3527588772 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb83c1620a0 0x7fb83c160230 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:04.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.911+0000 7fb8442d4700 1 --2- 172.21.15.72:0/3527588772 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb83c0bad90 0x7fb83c15fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:04.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.911+0000 7fb8442d4700 1 -- 172.21.15.72:0/3527588772 >> 172.21.15.72:0/3527588772 conn(0x7fb83c0a7860 msgr2=0x7fb83c0718e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:04.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.911+0000 7fb8442d4700 1 -- 172.21.15.72:0/3527588772 shutdown_connections 2023-07-25T14:36:04.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.911+0000 7fb8442d4700 1 -- 172.21.15.72:0/3527588772 wait complete. 2023-07-25T14:36:04.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.915+0000 7f6bf8a05700 1 -- 172.21.15.72:0/2988368279 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f6bf40c15a0 con 0x7f6bf41608e0 2023-07-25T14:36:04.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.915+0000 7f6be2ffd700 1 -- 172.21.15.72:0/2988368279 <== mon.1 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6bf40c15a0 con 0x7f6bf41608e0 2023-07-25T14:36:04.928 INFO:teuthology.orchestra.run.smithi072.stdout:55834574857 2023-07-25T14:36:04.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.917+0000 7f6bf8a05700 1 -- 172.21.15.72:0/2988368279 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f6bdc06c880 msgr2=0x7f6bdc06ed40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:04.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.918+0000 7f6bf8a05700 1 --2- 172.21.15.72:0/2988368279 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f6bdc06c880 0x7f6bdc06ed40 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f6bf40c62a0 tx=0x7f6be400a000 comp rx=0 tx=0).stop 2023-07-25T14:36:04.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.918+0000 7f6bf8a05700 1 -- 172.21.15.72:0/2988368279 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6bf41608e0 msgr2=0x7f6bf40a5fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:04.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.918+0000 7f6bf8a05700 1 --2- 172.21.15.72:0/2988368279 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6bf41608e0 0x7f6bf40a5fc0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f6bec00ee30 tx=0x7f6bec00c670 comp rx=0 tx=0).stop 2023-07-25T14:36:04.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.918+0000 7f6bf8a05700 1 -- 172.21.15.72:0/2988368279 shutdown_connections 2023-07-25T14:36:04.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.918+0000 7f6bf8a05700 1 --2- 172.21.15.72:0/2988368279 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f6bdc06c880 0x7f6bdc06ed40 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:04.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.918+0000 7f6bf8a05700 1 --2- 172.21.15.72:0/2988368279 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6bf4162980 0x7f6bf40868d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:04.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.918+0000 7f6bf8a05700 1 --2- 172.21.15.72:0/2988368279 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6bf41608e0 0x7f6bf40a5fc0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:04.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.918+0000 7f6bf8a05700 1 --2- 172.21.15.72:0/2988368279 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6bf41624a0 0x7f6bf40a6500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:04.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.918+0000 7f6bf8a05700 1 -- 172.21.15.72:0/2988368279 >> 172.21.15.72:0/2988368279 conn(0x7f6bf40a7860 msgr2=0x7f6bf40c56b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:04.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.918+0000 7f6bf8a05700 1 -- 172.21.15.72:0/2988368279 shutdown_connections 2023-07-25T14:36:04.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.918+0000 7f6bf8a05700 1 -- 172.21.15.72:0/2988368279 wait complete. 2023-07-25T14:36:04.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.924+0000 7f8a02641700 1 -- 172.21.15.72:0/3722323586 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f89dc0055a0 con 0x7f89fc0bc340 2023-07-25T14:36:04.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.924+0000 7f89f8ff9700 1 -- 172.21.15.72:0/3722323586 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f89f0015030 con 0x7f89fc0bc340 2023-07-25T14:36:04.936 INFO:teuthology.orchestra.run.smithi072.stdout:55834574858 2023-07-25T14:36:04.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.926+0000 7f8a02641700 1 -- 172.21.15.72:0/3722323586 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f89e806adb0 msgr2=0x7f89e806d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:04.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.926+0000 7f8a02641700 1 --2- 172.21.15.72:0/3722323586 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f89e806adb0 0x7f89e806d270 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f89fc04eea0 tx=0x7f89f4009250 comp rx=0 tx=0).stop 2023-07-25T14:36:04.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.926+0000 7f8a02641700 1 -- 172.21.15.72:0/3722323586 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f89fc0bc340 msgr2=0x7f89fc15b4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:04.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.926+0000 7f8a02641700 1 --2- 172.21.15.72:0/3722323586 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f89fc0bc340 0x7f89fc15b4f0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f89f0009fd0 tx=0x7f89f000b770 comp rx=0 tx=0).stop 2023-07-25T14:36:04.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.927+0000 7f8a02641700 1 -- 172.21.15.72:0/3722323586 shutdown_connections 2023-07-25T14:36:04.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.927+0000 7f8a02641700 1 --2- 172.21.15.72:0/3722323586 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f89e806adb0 0x7f89e806d270 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:04.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.927+0000 7f8a02641700 1 --2- 172.21.15.72:0/3722323586 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f89fc0bc340 0x7f89fc15b4f0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:04.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.927+0000 7f8a02641700 1 --2- 172.21.15.72:0/3722323586 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f89fc0a5f70 0x7f89fc0a87d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:04.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.927+0000 7f8a02641700 1 --2- 172.21.15.72:0/3722323586 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f89fc0a6d80 0x7f89fc0bd7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:04.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.927+0000 7f8a02641700 1 -- 172.21.15.72:0/3722323586 >> 172.21.15.72:0/3722323586 conn(0x7f89fc0a7860 msgr2=0x7f89fc0bb2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:04.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.927+0000 7f8a02641700 1 -- 172.21.15.72:0/3722323586 shutdown_connections 2023-07-25T14:36:04.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.927+0000 7f8a02641700 1 -- 172.21.15.72:0/3722323586 wait complete. 2023-07-25T14:36:04.941 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.6 2023-07-25T14:36:04.941 DEBUG:teuthology.parallel:result is None 2023-07-25T14:36:04.944 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.2 2023-07-25T14:36:04.944 DEBUG:teuthology.parallel:result is None 2023-07-25T14:36:04.952 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.7 2023-07-25T14:36:04.953 DEBUG:teuthology.parallel:result is None 2023-07-25T14:36:04.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.948+0000 7f74fc919700 1 -- 172.21.15.72:0/3707402863 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f74f81f7d70 con 0x7f74f8071300 2023-07-25T14:36:04.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.948+0000 7f74e6ffd700 1 -- 172.21.15.72:0/3707402863 <== mon.2 v2:172.21.15.92:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f74f81f7d70 con 0x7f74f8071300 2023-07-25T14:36:04.961 INFO:teuthology.orchestra.run.smithi072.stdout:55834574857 2023-07-25T14:36:04.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.950+0000 7f74fc919700 1 -- 172.21.15.72:0/3707402863 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f74d806ade0 msgr2=0x7f74d806d2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:04.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.950+0000 7f74fc919700 1 --2- 172.21.15.72:0/3707402863 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f74d806ade0 0x7f74d806d2a0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f74f81f9d60 tx=0x7f74e8009040 comp rx=0 tx=0).stop 2023-07-25T14:36:04.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.950+0000 7f74fc919700 1 -- 172.21.15.72:0/3707402863 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f74f8071300 msgr2=0x7f74f81fa070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:04.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.950+0000 7f74fc919700 1 --2- 172.21.15.72:0/3707402863 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f74f8071300 0x7f74f81fa070 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f74ec009f50 tx=0x7f74ec004750 comp rx=0 tx=0).stop 2023-07-25T14:36:04.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.950+0000 7f74fc919700 1 -- 172.21.15.72:0/3707402863 shutdown_connections 2023-07-25T14:36:04.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.950+0000 7f74fc919700 1 --2- 172.21.15.72:0/3707402863 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f74d806ade0 0x7f74d806d2a0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:04.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.950+0000 7f74fc919700 1 --2- 172.21.15.72:0/3707402863 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f74f8071300 0x7f74f81fa070 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:04.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.950+0000 7f74fc919700 1 --2- 172.21.15.72:0/3707402863 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f74f8151d10 0x7f74f81edcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:04.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.951+0000 7f74fc919700 1 --2- 172.21.15.72:0/3707402863 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f74f80bbef0 0x7f74f81ed790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:04.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.951+0000 7f74fc919700 1 -- 172.21.15.72:0/3707402863 >> 172.21.15.72:0/3707402863 conn(0x7f74f80a7860 msgr2=0x7f74f814ec10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:04.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.951+0000 7f74fc919700 1 -- 172.21.15.72:0/3707402863 shutdown_connections 2023-07-25T14:36:04.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:04.951+0000 7f74fc919700 1 -- 172.21.15.72:0/3707402863 wait complete. 2023-07-25T14:36:04.975 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.0 2023-07-25T14:36:04.975 DEBUG:teuthology.parallel:result is None 2023-07-25T14:36:04.975 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-07-25T14:36:04.976 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-25T14:36:05.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.123+0000 7fe2d76a3700 1 Processor -- start 2023-07-25T14:36:05.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.123+0000 7fe2d76a3700 1 -- start start 2023-07-25T14:36:05.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.124+0000 7fe2d76a3700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fe2d014dea0 0x7fe2d006a190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:05.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.124+0000 7fe2d76a3700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe2d0072300 0x7fe2d0151200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:05.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.124+0000 7fe2d76a3700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe2d00a86c0 0x7fe2d00c0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:05.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.124+0000 7fe2d76a3700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2d00c18d0 con 0x7fe2d00a86c0 2023-07-25T14:36:05.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.124+0000 7fe2d76a3700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2d006ea10 con 0x7fe2d014dea0 2023-07-25T14:36:05.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.124+0000 7fe2d76a3700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2d00a8230 con 0x7fe2d0072300 2023-07-25T14:36:05.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.124+0000 7fe2d5c40700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe2d00a86c0 0x7fe2d00c0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:05.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.124+0000 7fe2d5c40700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe2d00a86c0 0x7fe2d00c0bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40362/0 (socket says 172.21.15.72:40362) 2023-07-25T14:36:05.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.124+0000 7fe2d5c40700 1 -- 172.21.15.72:0/3756814598 learned_addr learned my addr 172.21.15.72:0/3756814598 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:05.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.124+0000 7fe2d4c3e700 1 --2- 172.21.15.72:0/3756814598 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe2d0072300 0x7fe2d0151200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:05.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.124+0000 7fe2d543f700 1 --2- 172.21.15.72:0/3756814598 >> v2:172.21.15.92:3300/0 conn(0x7fe2d014dea0 0x7fe2d006a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:05.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.125+0000 7fe2d5c40700 1 -- 172.21.15.72:0/3756814598 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe2d0072300 msgr2=0x7fe2d0151200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:05.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.125+0000 7fe2d5c40700 1 --2- 172.21.15.72:0/3756814598 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe2d0072300 0x7fe2d0151200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:05.140 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.125+0000 7fe2d5c40700 1 -- 172.21.15.72:0/3756814598 >> v2:172.21.15.92:3300/0 conn(0x7fe2d014dea0 msgr2=0x7fe2d006a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:05.140 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.125+0000 7fe2d5c40700 1 --2- 172.21.15.72:0/3756814598 >> v2:172.21.15.92:3300/0 conn(0x7fe2d014dea0 0x7fe2d006a190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:05.140 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.125+0000 7fe2d5c40700 1 -- 172.21.15.72:0/3756814598 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2d00a7c20 con 0x7fe2d00a86c0 2023-07-25T14:36:05.140 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.125+0000 7fe2d5c40700 1 --2- 172.21.15.72:0/3756814598 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe2d00a86c0 0x7fe2d00c0bc0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fe2d0061e10 tx=0x7fe2c800d430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fa6607289737ed5 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:05.140 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.125+0000 7fe2c7fff700 1 -- 172.21.15.72:0/3756814598 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2c8010070 con 0x7fe2d00a86c0 2023-07-25T14:36:05.140 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.125+0000 7fe2c7fff700 1 -- 172.21.15.72:0/3756814598 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2c800dad0 con 0x7fe2d00a86c0 2023-07-25T14:36:05.140 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.125+0000 7fe2c7fff700 1 -- 172.21.15.72:0/3756814598 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2c800de80 con 0x7fe2d00a86c0 2023-07-25T14:36:05.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.126+0000 7fe2d76a3700 1 -- 172.21.15.72:0/3756814598 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe2d00a86c0 msgr2=0x7fe2d00c0bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:05.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.126+0000 7fe2d76a3700 1 --2- 172.21.15.72:0/3756814598 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe2d00a86c0 0x7fe2d00c0bc0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fe2d0061e10 tx=0x7fe2c800d430 comp rx=0 tx=0).stop 2023-07-25T14:36:05.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.126+0000 7fe2d76a3700 1 -- 172.21.15.72:0/3756814598 shutdown_connections 2023-07-25T14:36:05.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.126+0000 7fe2d76a3700 1 --2- 172.21.15.72:0/3756814598 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe2d00a86c0 0x7fe2d00c0bc0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:05.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.126+0000 7fe2d76a3700 1 --2- 172.21.15.72:0/3756814598 >> v2:172.21.15.92:3300/0 conn(0x7fe2d014dea0 0x7fe2d006a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:05.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.126+0000 7fe2d76a3700 1 --2- 172.21.15.72:0/3756814598 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe2d0072300 0x7fe2d0151200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:05.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.126+0000 7fe2d76a3700 1 -- 172.21.15.72:0/3756814598 >> 172.21.15.72:0/3756814598 conn(0x7fe2d006def0 msgr2=0x7fe2d006e300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:05.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.126+0000 7fe2d76a3700 1 -- 172.21.15.72:0/3756814598 shutdown_connections 2023-07-25T14:36:05.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.126+0000 7fe2d76a3700 1 -- 172.21.15.72:0/3756814598 wait complete. 2023-07-25T14:36:05.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.127+0000 7fe2d76a3700 1 Processor -- start 2023-07-25T14:36:05.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.127+0000 7fe2d76a3700 1 -- start start 2023-07-25T14:36:05.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.127+0000 7fe2d76a3700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe2d0072300 0x7fe2d013a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:05.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.127+0000 7fe2d76a3700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe2d00a86c0 0x7fe2d0138900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:05.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.127+0000 7fe2d76a3700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe2d014dea0 0x7fe2d0138e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:05.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.127+0000 7fe2d76a3700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2d0142710 con 0x7fe2d0072300 2023-07-25T14:36:05.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.127+0000 7fe2d76a3700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2d0140260 con 0x7fe2d00a86c0 2023-07-25T14:36:05.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.127+0000 7fe2d76a3700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2d0141e60 con 0x7fe2d014dea0 2023-07-25T14:36:05.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.128+0000 7fe2d543f700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe2d0072300 0x7fe2d013a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:05.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.128+0000 7fe2d543f700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe2d0072300 0x7fe2d013a980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40364/0 (socket says 172.21.15.72:40364) 2023-07-25T14:36:05.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.128+0000 7fe2d543f700 1 -- 172.21.15.72:0/3086225401 learned_addr learned my addr 172.21.15.72:0/3086225401 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:05.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.128+0000 7fe2d4c3e700 1 --2- 172.21.15.72:0/3086225401 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe2d00a86c0 0x7fe2d0138900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:05.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.128+0000 7fe2d5c40700 1 --2- 172.21.15.72:0/3086225401 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe2d014dea0 0x7fe2d0138e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:05.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.128+0000 7fe2d543f700 1 -- 172.21.15.72:0/3086225401 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe2d014dea0 msgr2=0x7fe2d0138e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:05.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.128+0000 7fe2d543f700 1 --2- 172.21.15.72:0/3086225401 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe2d014dea0 0x7fe2d0138e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:05.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.128+0000 7fe2d543f700 1 -- 172.21.15.72:0/3086225401 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe2d00a86c0 msgr2=0x7fe2d0138900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:05.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.128+0000 7fe2d543f700 1 --2- 172.21.15.72:0/3086225401 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe2d00a86c0 0x7fe2d0138900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:05.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.128+0000 7fe2d543f700 1 -- 172.21.15.72:0/3086225401 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2c800bd40 con 0x7fe2d0072300 2023-07-25T14:36:05.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.128+0000 7fe2d4c3e700 1 --2- 172.21.15.72:0/3086225401 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe2d00a86c0 0x7fe2d0138900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-25T14:36:05.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.128+0000 7fe2d543f700 1 --2- 172.21.15.72:0/3086225401 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe2d0072300 0x7fe2d013a980 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fe2c000e870 tx=0x7fe2c000ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:05.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.128+0000 7fe2c5ffb700 1 -- 172.21.15.72:0/3086225401 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2c0009590 con 0x7fe2d0072300 2023-07-25T14:36:05.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.128+0000 7fe2c5ffb700 1 -- 172.21.15.72:0/3086225401 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2c000ee70 con 0x7fe2d0072300 2023-07-25T14:36:05.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.128+0000 7fe2d76a3700 1 -- 172.21.15.72:0/3086225401 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2d0142120 con 0x7fe2d0072300 2023-07-25T14:36:05.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.128+0000 7fe2c5ffb700 1 -- 172.21.15.72:0/3086225401 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2c000ca50 con 0x7fe2d0072300 2023-07-25T14:36:05.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.128+0000 7fe2d76a3700 1 -- 172.21.15.72:0/3086225401 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2d00c5420 con 0x7fe2d0072300 2023-07-25T14:36:05.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.129+0000 7fe2d76a3700 1 -- 172.21.15.72:0/3086225401 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2d00a7ea0 con 0x7fe2d0072300 2023-07-25T14:36:05.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.131+0000 7fe2c5ffb700 1 -- 172.21.15.72:0/3086225401 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe2c000cbb0 con 0x7fe2d0072300 2023-07-25T14:36:05.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.131+0000 7fe2c5ffb700 1 --2- 172.21.15.72:0/3086225401 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fe2b406ace0 0x7fe2b406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:05.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.131+0000 7fe2c5ffb700 1 -- 172.21.15.72:0/3086225401 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fe2c0089db0 con 0x7fe2d0072300 2023-07-25T14:36:05.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.131+0000 7fe2d4c3e700 1 --2- 172.21.15.72:0/3086225401 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fe2b406ace0 0x7fe2b406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:05.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.132+0000 7fe2d4c3e700 1 --2- 172.21.15.72:0/3086225401 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fe2b406ace0 0x7fe2b406d1a0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fe2d0141070 tx=0x7fe2cc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:05.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.135+0000 7fe2c5ffb700 1 -- 172.21.15.72:0/3086225401 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fe2c0058670 con 0x7fe2d0072300 2023-07-25T14:36:05.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.318+0000 7fe2d76a3700 1 -- 172.21.15.72:0/3086225401 --> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe2d006ec20 con 0x7fe2b406ace0 2023-07-25T14:36:05.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.327+0000 7fe2c5ffb700 1 -- 172.21.15.72:0/3086225401 <== mgr.4104 v2:172.21.15.72:6832/1171220306 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367605 (secure 0 0 0) 0x7fe2cc011780 con 0x7fe2b406ace0 2023-07-25T14:36:05.343 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-25T14:36:05.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.331+0000 7fe2d76a3700 1 -- 172.21.15.72:0/3086225401 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fe2b406ace0 msgr2=0x7fe2b406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:05.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.331+0000 7fe2d76a3700 1 --2- 172.21.15.72:0/3086225401 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fe2b406ace0 0x7fe2b406d1a0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fe2d0141070 tx=0x7fe2cc008040 comp rx=0 tx=0).stop 2023-07-25T14:36:05.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.331+0000 7fe2d76a3700 1 -- 172.21.15.72:0/3086225401 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe2d0072300 msgr2=0x7fe2d013a980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:05.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.331+0000 7fe2d76a3700 1 --2- 172.21.15.72:0/3086225401 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe2d0072300 0x7fe2d013a980 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fe2c000e870 tx=0x7fe2c000ec30 comp rx=0 tx=0).stop 2023-07-25T14:36:05.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.331+0000 7fe2d76a3700 1 -- 172.21.15.72:0/3086225401 shutdown_connections 2023-07-25T14:36:05.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.331+0000 7fe2d76a3700 1 --2- 172.21.15.72:0/3086225401 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fe2b406ace0 0x7fe2b406d1a0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:05.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.331+0000 7fe2d76a3700 1 --2- 172.21.15.72:0/3086225401 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe2d014dea0 0x7fe2d0138e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:05.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.331+0000 7fe2d76a3700 1 --2- 172.21.15.72:0/3086225401 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe2d0072300 0x7fe2d013a980 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:05.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.331+0000 7fe2d76a3700 1 --2- 172.21.15.72:0/3086225401 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe2d00a86c0 0x7fe2d0138900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:05.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.331+0000 7fe2d76a3700 1 -- 172.21.15.72:0/3086225401 >> 172.21.15.72:0/3086225401 conn(0x7fe2d006def0 msgr2=0x7fe2d00a8aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:05.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.331+0000 7fe2d76a3700 1 -- 172.21.15.72:0/3086225401 shutdown_connections 2023-07-25T14:36:05.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.331+0000 7fe2d76a3700 1 -- 172.21.15.72:0/3086225401 wait complete. 2023-07-25T14:36:05.347 INFO:teuthology.orchestra.run.smithi072.stderr:dumped all 2023-07-25T14:36:05.355 INFO:teuthology.orchestra.run.smithi072.stdout:{"pg_ready":true,"pg_map":{"version":35,"stamp":"2023-07-25T14:36:05.291153+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594960,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218416,"kb_used_data":2260,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754756304,"statfs":{"total":773094113280,"available":772870455296,"internally_reserved":0,"allocated":2314240,"data_stored":2061945,"data_compressed":64510,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1781,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002906"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:47.033294+0000","last_change":"2023-07-25T14:35:40.579709+0000","last_active":"2023-07-25T14:35:47.033294+0000","last_peered":"2023-07-25T14:35:47.033294+0000","last_clean":"2023-07-25T14:35:47.033294+0000","last_became_active":"2023-07-25T14:35:40.579434+0000","last_became_peered":"2023-07-25T14:35:40.579434+0000","last_unstale":"2023-07-25T14:35:47.033294+0000","last_undegraded":"2023-07-25T14:35:47.033294+0000","last_fullsized":"2023-07-25T14:35:47.033294+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T16:53:04.752134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.591767+0000","last_change":"2023-07-25T14:35:40.569410+0000","last_active":"2023-07-25T14:35:45.591767+0000","last_peered":"2023-07-25T14:35:45.591767+0000","last_clean":"2023-07-25T14:35:45.591767+0000","last_became_active":"2023-07-25T14:35:40.569117+0000","last_became_peered":"2023-07-25T14:35:40.569117+0000","last_unstale":"2023-07-25T14:35:45.591767+0000","last_undegraded":"2023-07-25T14:35:45.591767+0000","last_fullsized":"2023-07-25T14:35:45.591767+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T21:31:31.770554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.594527+0000","last_change":"2023-07-25T14:35:40.575183+0000","last_active":"2023-07-25T14:35:45.594527+0000","last_peered":"2023-07-25T14:35:45.594527+0000","last_clean":"2023-07-25T14:35:45.594527+0000","last_became_active":"2023-07-25T14:35:40.574827+0000","last_became_peered":"2023-07-25T14:35:40.574827+0000","last_unstale":"2023-07-25T14:35:45.594527+0000","last_undegraded":"2023-07-25T14:35:45.594527+0000","last_fullsized":"2023-07-25T14:35:45.594527+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T01:51:45.574143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.591232+0000","last_change":"2023-07-25T14:35:40.573336+0000","last_active":"2023-07-25T14:35:45.591232+0000","last_peered":"2023-07-25T14:35:45.591232+0000","last_clean":"2023-07-25T14:35:45.591232+0000","last_became_active":"2023-07-25T14:35:40.573034+0000","last_became_peered":"2023-07-25T14:35:40.573034+0000","last_unstale":"2023-07-25T14:35:45.591232+0000","last_undegraded":"2023-07-25T14:35:45.591232+0000","last_fullsized":"2023-07-25T14:35:45.591232+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T18:55:52.687430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:46.554959+0000","last_change":"2023-07-25T14:35:40.583811+0000","last_active":"2023-07-25T14:35:46.554959+0000","last_peered":"2023-07-25T14:35:46.554959+0000","last_clean":"2023-07-25T14:35:46.554959+0000","last_became_active":"2023-07-25T14:35:40.583515+0000","last_became_peered":"2023-07-25T14:35:40.583515+0000","last_unstale":"2023-07-25T14:35:46.554959+0000","last_undegraded":"2023-07-25T14:35:46.554959+0000","last_fullsized":"2023-07-25T14:35:46.554959+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:09:34.369879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.594150+0000","last_change":"2023-07-25T14:35:40.575186+0000","last_active":"2023-07-25T14:35:45.594150+0000","last_peered":"2023-07-25T14:35:45.594150+0000","last_clean":"2023-07-25T14:35:45.594150+0000","last_became_active":"2023-07-25T14:35:40.574889+0000","last_became_peered":"2023-07-25T14:35:40.574889+0000","last_unstale":"2023-07-25T14:35:45.594150+0000","last_undegraded":"2023-07-25T14:35:45.594150+0000","last_fullsized":"2023-07-25T14:35:45.594150+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:40:27.273006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:46.548788+0000","last_change":"2023-07-25T14:35:40.569889+0000","last_active":"2023-07-25T14:35:46.548788+0000","last_peered":"2023-07-25T14:35:46.548788+0000","last_clean":"2023-07-25T14:35:46.548788+0000","last_became_active":"2023-07-25T14:35:40.569608+0000","last_became_peered":"2023-07-25T14:35:40.569608+0000","last_unstale":"2023-07-25T14:35:46.548788+0000","last_undegraded":"2023-07-25T14:35:46.548788+0000","last_fullsized":"2023-07-25T14:35:46.548788+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T15:50:12.108725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.591268+0000","last_change":"2023-07-25T14:35:40.574254+0000","last_active":"2023-07-25T14:35:45.591268+0000","last_peered":"2023-07-25T14:35:45.591268+0000","last_clean":"2023-07-25T14:35:45.591268+0000","last_became_active":"2023-07-25T14:35:40.573341+0000","last_became_peered":"2023-07-25T14:35:40.573341+0000","last_unstale":"2023-07-25T14:35:45.591268+0000","last_undegraded":"2023-07-25T14:35:45.591268+0000","last_fullsized":"2023-07-25T14:35:45.591268+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T17:24:11.100853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:46.554711+0000","last_change":"2023-07-25T14:35:40.582969+0000","last_active":"2023-07-25T14:35:46.554711+0000","last_peered":"2023-07-25T14:35:46.554711+0000","last_clean":"2023-07-25T14:35:46.554711+0000","last_became_active":"2023-07-25T14:35:40.582686+0000","last_became_peered":"2023-07-25T14:35:40.582686+0000","last_unstale":"2023-07-25T14:35:46.554711+0000","last_undegraded":"2023-07-25T14:35:46.554711+0000","last_fullsized":"2023-07-25T14:35:46.554711+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:55:22.829223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.592271+0000","last_change":"2023-07-25T14:35:40.574207+0000","last_active":"2023-07-25T14:35:45.592271+0000","last_peered":"2023-07-25T14:35:45.592271+0000","last_clean":"2023-07-25T14:35:45.592271+0000","last_became_active":"2023-07-25T14:35:40.573926+0000","last_became_peered":"2023-07-25T14:35:40.573926+0000","last_unstale":"2023-07-25T14:35:45.592271+0000","last_undegraded":"2023-07-25T14:35:45.592271+0000","last_fullsized":"2023-07-25T14:35:45.592271+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T17:56:22.295388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.594484+0000","last_change":"2023-07-25T14:35:40.571893+0000","last_active":"2023-07-25T14:35:45.594484+0000","last_peered":"2023-07-25T14:35:45.594484+0000","last_clean":"2023-07-25T14:35:45.594484+0000","last_became_active":"2023-07-25T14:35:40.571559+0000","last_became_peered":"2023-07-25T14:35:40.571559+0000","last_unstale":"2023-07-25T14:35:45.594484+0000","last_undegraded":"2023-07-25T14:35:45.594484+0000","last_fullsized":"2023-07-25T14:35:45.594484+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T14:46:37.446654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:47.032918+0000","last_change":"2023-07-25T14:35:40.574741+0000","last_active":"2023-07-25T14:35:47.032918+0000","last_peered":"2023-07-25T14:35:47.032918+0000","last_clean":"2023-07-25T14:35:47.032918+0000","last_became_active":"2023-07-25T14:35:40.574462+0000","last_became_peered":"2023-07-25T14:35:40.574462+0000","last_unstale":"2023-07-25T14:35:47.032918+0000","last_undegraded":"2023-07-25T14:35:47.032918+0000","last_fullsized":"2023-07-25T14:35:47.032918+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T01:21:26.238044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:47.032882+0000","last_change":"2023-07-25T14:35:40.571479+0000","last_active":"2023-07-25T14:35:47.032882+0000","last_peered":"2023-07-25T14:35:47.032882+0000","last_clean":"2023-07-25T14:35:47.032882+0000","last_became_active":"2023-07-25T14:35:40.571126+0000","last_became_peered":"2023-07-25T14:35:40.571126+0000","last_unstale":"2023-07-25T14:35:47.032882+0000","last_undegraded":"2023-07-25T14:35:47.032882+0000","last_fullsized":"2023-07-25T14:35:47.032882+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T22:30:57.251961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.591494+0000","last_change":"2023-07-25T14:35:40.569982+0000","last_active":"2023-07-25T14:35:45.591494+0000","last_peered":"2023-07-25T14:35:45.591494+0000","last_clean":"2023-07-25T14:35:45.591494+0000","last_became_active":"2023-07-25T14:35:40.569644+0000","last_became_peered":"2023-07-25T14:35:40.569644+0000","last_unstale":"2023-07-25T14:35:45.591494+0000","last_undegraded":"2023-07-25T14:35:45.591494+0000","last_fullsized":"2023-07-25T14:35:45.591494+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T14:44:33.489813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:46.548596+0000","last_change":"2023-07-25T14:35:40.570367+0000","last_active":"2023-07-25T14:35:46.548596+0000","last_peered":"2023-07-25T14:35:46.548596+0000","last_clean":"2023-07-25T14:35:46.548596+0000","last_became_active":"2023-07-25T14:35:40.570106+0000","last_became_peered":"2023-07-25T14:35:40.570106+0000","last_unstale":"2023-07-25T14:35:46.548596+0000","last_undegraded":"2023-07-25T14:35:46.548596+0000","last_fullsized":"2023-07-25T14:35:46.548596+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T19:42:01.927591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.593622+0000","last_change":"2023-07-25T14:35:40.575177+0000","last_active":"2023-07-25T14:35:45.593622+0000","last_peered":"2023-07-25T14:35:45.593622+0000","last_clean":"2023-07-25T14:35:45.593622+0000","last_became_active":"2023-07-25T14:35:40.574874+0000","last_became_peered":"2023-07-25T14:35:40.574874+0000","last_unstale":"2023-07-25T14:35:45.593622+0000","last_undegraded":"2023-07-25T14:35:45.593622+0000","last_fullsized":"2023-07-25T14:35:45.593622+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T22:45:19.433847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:46.554879+0000","last_change":"2023-07-25T14:35:40.582903+0000","last_active":"2023-07-25T14:35:46.554879+0000","last_peered":"2023-07-25T14:35:46.554879+0000","last_clean":"2023-07-25T14:35:46.554879+0000","last_became_active":"2023-07-25T14:35:40.582627+0000","last_became_peered":"2023-07-25T14:35:40.582627+0000","last_unstale":"2023-07-25T14:35:46.554879+0000","last_undegraded":"2023-07-25T14:35:46.554879+0000","last_fullsized":"2023-07-25T14:35:46.554879+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T17:56:22.295388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.594691+0000","last_change":"2023-07-25T14:35:40.571572+0000","last_active":"2023-07-25T14:35:45.594691+0000","last_peered":"2023-07-25T14:35:45.594691+0000","last_clean":"2023-07-25T14:35:45.594691+0000","last_became_active":"2023-07-25T14:35:40.570802+0000","last_became_peered":"2023-07-25T14:35:40.570802+0000","last_unstale":"2023-07-25T14:35:45.594691+0000","last_undegraded":"2023-07-25T14:35:45.594691+0000","last_fullsized":"2023-07-25T14:35:45.594691+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T20:18:12.135635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:47.033091+0000","last_change":"2023-07-25T14:35:40.576638+0000","last_active":"2023-07-25T14:35:47.033091+0000","last_peered":"2023-07-25T14:35:47.033091+0000","last_clean":"2023-07-25T14:35:47.033091+0000","last_became_active":"2023-07-25T14:35:40.576359+0000","last_became_peered":"2023-07-25T14:35:40.576359+0000","last_unstale":"2023-07-25T14:35:47.033091+0000","last_undegraded":"2023-07-25T14:35:47.033091+0000","last_fullsized":"2023-07-25T14:35:47.033091+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T20:38:34.383462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.593850+0000","last_change":"2023-07-25T14:35:40.581183+0000","last_active":"2023-07-25T14:35:45.593850+0000","last_peered":"2023-07-25T14:35:45.593850+0000","last_clean":"2023-07-25T14:35:45.593850+0000","last_became_active":"2023-07-25T14:35:40.577150+0000","last_became_peered":"2023-07-25T14:35:40.577150+0000","last_unstale":"2023-07-25T14:35:45.593850+0000","last_undegraded":"2023-07-25T14:35:45.593850+0000","last_fullsized":"2023-07-25T14:35:45.593850+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T22:52:07.934045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:46.549236+0000","last_change":"2023-07-25T14:35:40.584074+0000","last_active":"2023-07-25T14:35:46.549236+0000","last_peered":"2023-07-25T14:35:46.549236+0000","last_clean":"2023-07-25T14:35:46.549236+0000","last_became_active":"2023-07-25T14:35:40.583729+0000","last_became_peered":"2023-07-25T14:35:40.583729+0000","last_unstale":"2023-07-25T14:35:46.549236+0000","last_undegraded":"2023-07-25T14:35:46.549236+0000","last_fullsized":"2023-07-25T14:35:46.549236+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:37:32.340440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:46.554400+0000","last_change":"2023-07-25T14:35:40.569049+0000","last_active":"2023-07-25T14:35:46.554400+0000","last_peered":"2023-07-25T14:35:46.554400+0000","last_clean":"2023-07-25T14:35:46.554400+0000","last_became_active":"2023-07-25T14:35:40.568749+0000","last_became_peered":"2023-07-25T14:35:40.568749+0000","last_unstale":"2023-07-25T14:35:46.554400+0000","last_undegraded":"2023-07-25T14:35:46.554400+0000","last_fullsized":"2023-07-25T14:35:46.554400+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:12:05.117844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.812807+0000","last_change":"2023-07-25T14:35:40.579628+0000","last_active":"2023-07-25T14:35:45.812807+0000","last_peered":"2023-07-25T14:35:45.812807+0000","last_clean":"2023-07-25T14:35:45.812807+0000","last_became_active":"2023-07-25T14:35:40.579163+0000","last_became_peered":"2023-07-25T14:35:40.579163+0000","last_unstale":"2023-07-25T14:35:45.812807+0000","last_undegraded":"2023-07-25T14:35:45.812807+0000","last_fullsized":"2023-07-25T14:35:45.812807+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T14:39:11.675726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:46.548669+0000","last_change":"2023-07-25T14:35:40.580196+0000","last_active":"2023-07-25T14:35:46.548669+0000","last_peered":"2023-07-25T14:35:46.548669+0000","last_clean":"2023-07-25T14:35:46.548669+0000","last_became_active":"2023-07-25T14:35:40.579875+0000","last_became_peered":"2023-07-25T14:35:40.579875+0000","last_unstale":"2023-07-25T14:35:46.548669+0000","last_undegraded":"2023-07-25T14:35:46.548669+0000","last_fullsized":"2023-07-25T14:35:46.548669+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T17:56:22.295388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:47.033370+0000","last_change":"2023-07-25T14:35:40.567264+0000","last_active":"2023-07-25T14:35:47.033370+0000","last_peered":"2023-07-25T14:35:47.033370+0000","last_clean":"2023-07-25T14:35:47.033370+0000","last_became_active":"2023-07-25T14:35:40.566933+0000","last_became_peered":"2023-07-25T14:35:40.566933+0000","last_unstale":"2023-07-25T14:35:47.033370+0000","last_undegraded":"2023-07-25T14:35:47.033370+0000","last_fullsized":"2023-07-25T14:35:47.033370+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T21:36:38.996750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:47.033405+0000","last_change":"2023-07-25T14:35:40.562595+0000","last_active":"2023-07-25T14:35:47.033405+0000","last_peered":"2023-07-25T14:35:47.033405+0000","last_clean":"2023-07-25T14:35:47.033405+0000","last_became_active":"2023-07-25T14:35:40.562281+0000","last_became_peered":"2023-07-25T14:35:40.562281+0000","last_unstale":"2023-07-25T14:35:47.033405+0000","last_undegraded":"2023-07-25T14:35:47.033405+0000","last_fullsized":"2023-07-25T14:35:47.033405+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T14:44:33.489813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.592182+0000","last_change":"2023-07-25T14:35:40.570857+0000","last_active":"2023-07-25T14:35:45.592182+0000","last_peered":"2023-07-25T14:35:45.592182+0000","last_clean":"2023-07-25T14:35:45.592182+0000","last_became_active":"2023-07-25T14:35:40.570601+0000","last_became_peered":"2023-07-25T14:35:40.570601+0000","last_unstale":"2023-07-25T14:35:45.592182+0000","last_undegraded":"2023-07-25T14:35:45.592182+0000","last_fullsized":"2023-07-25T14:35:45.592182+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:43:26.302693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.594376+0000","last_change":"2023-07-25T14:35:44.610459+0000","last_active":"2023-07-25T14:35:45.594376+0000","last_peered":"2023-07-25T14:35:45.594376+0000","last_clean":"2023-07-25T14:35:45.594376+0000","last_became_active":"2023-07-25T14:35:44.610112+0000","last_became_peered":"2023-07-25T14:35:44.610112+0000","last_unstale":"2023-07-25T14:35:45.594376+0000","last_undegraded":"2023-07-25T14:35:45.594376+0000","last_fullsized":"2023-07-25T14:35:45.594376+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_clean_scrub_stamp":"2023-07-25T14:35:43.577860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T21:11:47.831552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"20'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.593786+0000","last_change":"2023-07-25T14:35:39.539424+0000","last_active":"2023-07-25T14:35:45.593786+0000","last_peered":"2023-07-25T14:35:45.593786+0000","last_clean":"2023-07-25T14:35:45.593786+0000","last_became_active":"2023-07-25T14:35:39.539198+0000","last_became_peered":"2023-07-25T14:35:39.539198+0000","last_unstale":"2023-07-25T14:35:45.593786+0000","last_undegraded":"2023-07-25T14:35:45.593786+0000","last_fullsized":"2023-07-25T14:35:45.593786+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_clean_scrub_stamp":"2023-07-25T14:35:38.515226+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T20:19:13.284229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.813167+0000","last_change":"2023-07-25T14:35:40.571557+0000","last_active":"2023-07-25T14:35:45.813167+0000","last_peered":"2023-07-25T14:35:45.813167+0000","last_clean":"2023-07-25T14:35:45.813167+0000","last_became_active":"2023-07-25T14:35:40.571278+0000","last_became_peered":"2023-07-25T14:35:40.571278+0000","last_unstale":"2023-07-25T14:35:45.813167+0000","last_undegraded":"2023-07-25T14:35:45.813167+0000","last_fullsized":"2023-07-25T14:35:45.813167+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T17:57:59.593211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.592906+0000","last_change":"2023-07-25T14:35:44.608945+0000","last_active":"2023-07-25T14:35:45.592906+0000","last_peered":"2023-07-25T14:35:45.592906+0000","last_clean":"2023-07-25T14:35:45.592906+0000","last_became_active":"2023-07-25T14:35:44.608355+0000","last_became_peered":"2023-07-25T14:35:44.608355+0000","last_unstale":"2023-07-25T14:35:45.592906+0000","last_undegraded":"2023-07-25T14:35:45.592906+0000","last_fullsized":"2023-07-25T14:35:45.592906+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_clean_scrub_stamp":"2023-07-25T14:35:43.577860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T01:37:47.118522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:47.032243+0000","last_change":"2023-07-25T14:35:39.546003+0000","last_active":"2023-07-25T14:35:47.032243+0000","last_peered":"2023-07-25T14:35:47.032243+0000","last_clean":"2023-07-25T14:35:47.032243+0000","last_became_active":"2023-07-25T14:35:39.545724+0000","last_became_peered":"2023-07-25T14:35:39.545724+0000","last_unstale":"2023-07-25T14:35:47.032243+0000","last_undegraded":"2023-07-25T14:35:47.032243+0000","last_fullsized":"2023-07-25T14:35:47.032243+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_clean_scrub_stamp":"2023-07-25T14:35:38.515226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T17:55:30.391084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:46.554711+0000","last_change":"2023-07-25T14:35:40.570219+0000","last_active":"2023-07-25T14:35:46.554711+0000","last_peered":"2023-07-25T14:35:46.554711+0000","last_clean":"2023-07-25T14:35:46.554711+0000","last_became_active":"2023-07-25T14:35:40.569892+0000","last_became_peered":"2023-07-25T14:35:40.569892+0000","last_unstale":"2023-07-25T14:35:46.554711+0000","last_undegraded":"2023-07-25T14:35:46.554711+0000","last_fullsized":"2023-07-25T14:35:46.554711+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T17:42:33.268060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:46.554870+0000","last_change":"2023-07-25T14:35:44.617481+0000","last_active":"2023-07-25T14:35:46.554870+0000","last_peered":"2023-07-25T14:35:46.554870+0000","last_clean":"2023-07-25T14:35:46.554870+0000","last_became_active":"2023-07-25T14:35:44.616199+0000","last_became_peered":"2023-07-25T14:35:44.616199+0000","last_unstale":"2023-07-25T14:35:46.554870+0000","last_undegraded":"2023-07-25T14:35:46.554870+0000","last_fullsized":"2023-07-25T14:35:46.554870+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_clean_scrub_stamp":"2023-07-25T14:35:43.577860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T15:17:51.741356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.812854+0000","last_change":"2023-07-25T14:35:39.535284+0000","last_active":"2023-07-25T14:35:45.812854+0000","last_peered":"2023-07-25T14:35:45.812854+0000","last_clean":"2023-07-25T14:35:45.812854+0000","last_became_active":"2023-07-25T14:35:39.535009+0000","last_became_peered":"2023-07-25T14:35:39.535009+0000","last_unstale":"2023-07-25T14:35:45.812854+0000","last_undegraded":"2023-07-25T14:35:45.812854+0000","last_fullsized":"2023-07-25T14:35:45.812854+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_clean_scrub_stamp":"2023-07-25T14:35:38.515226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T01:30:24.432069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.593125+0000","last_change":"2023-07-25T14:35:40.576038+0000","last_active":"2023-07-25T14:35:45.593125+0000","last_peered":"2023-07-25T14:35:45.593125+0000","last_clean":"2023-07-25T14:35:45.593125+0000","last_became_active":"2023-07-25T14:35:40.575678+0000","last_became_peered":"2023-07-25T14:35:40.575678+0000","last_unstale":"2023-07-25T14:35:45.593125+0000","last_undegraded":"2023-07-25T14:35:45.593125+0000","last_fullsized":"2023-07-25T14:35:45.593125+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T23:32:51.759335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.592398+0000","last_change":"2023-07-25T14:35:44.613589+0000","last_active":"2023-07-25T14:35:45.592398+0000","last_peered":"2023-07-25T14:35:45.592398+0000","last_clean":"2023-07-25T14:35:45.592398+0000","last_became_active":"2023-07-25T14:35:44.613150+0000","last_became_peered":"2023-07-25T14:35:44.613150+0000","last_unstale":"2023-07-25T14:35:45.592398+0000","last_undegraded":"2023-07-25T14:35:45.592398+0000","last_fullsized":"2023-07-25T14:35:45.592398+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_clean_scrub_stamp":"2023-07-25T14:35:43.577860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T20:48:55.652351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:46.554838+0000","last_change":"2023-07-25T14:35:39.534927+0000","last_active":"2023-07-25T14:35:46.554838+0000","last_peered":"2023-07-25T14:35:46.554838+0000","last_clean":"2023-07-25T14:35:46.554838+0000","last_became_active":"2023-07-25T14:35:39.534642+0000","last_became_peered":"2023-07-25T14:35:39.534642+0000","last_unstale":"2023-07-25T14:35:46.554838+0000","last_undegraded":"2023-07-25T14:35:46.554838+0000","last_fullsized":"2023-07-25T14:35:46.554838+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_clean_scrub_stamp":"2023-07-25T14:35:38.515226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:43:25.300568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.812812+0000","last_change":"2023-07-25T14:35:40.570225+0000","last_active":"2023-07-25T14:35:45.812812+0000","last_peered":"2023-07-25T14:35:45.812812+0000","last_clean":"2023-07-25T14:35:45.812812+0000","last_became_active":"2023-07-25T14:35:40.569840+0000","last_became_peered":"2023-07-25T14:35:40.569840+0000","last_unstale":"2023-07-25T14:35:45.812812+0000","last_undegraded":"2023-07-25T14:35:45.812812+0000","last_fullsized":"2023-07-25T14:35:45.812812+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T21:39:00.919174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:46.548495+0000","last_change":"2023-07-25T14:35:44.607298+0000","last_active":"2023-07-25T14:35:46.548495+0000","last_peered":"2023-07-25T14:35:46.548495+0000","last_clean":"2023-07-25T14:35:46.548495+0000","last_became_active":"2023-07-25T14:35:44.606891+0000","last_became_peered":"2023-07-25T14:35:44.606891+0000","last_unstale":"2023-07-25T14:35:46.548495+0000","last_undegraded":"2023-07-25T14:35:46.548495+0000","last_fullsized":"2023-07-25T14:35:46.548495+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_clean_scrub_stamp":"2023-07-25T14:35:43.577860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:55:26.889732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.592326+0000","last_change":"2023-07-25T14:35:39.537294+0000","last_active":"2023-07-25T14:35:45.592326+0000","last_peered":"2023-07-25T14:35:45.592326+0000","last_clean":"2023-07-25T14:35:45.592326+0000","last_became_active":"2023-07-25T14:35:39.536993+0000","last_became_peered":"2023-07-25T14:35:39.536993+0000","last_unstale":"2023-07-25T14:35:45.592326+0000","last_undegraded":"2023-07-25T14:35:45.592326+0000","last_fullsized":"2023-07-25T14:35:45.592326+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_clean_scrub_stamp":"2023-07-25T14:35:38.515226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T15:17:46.678722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.812671+0000","last_change":"2023-07-25T14:35:40.578807+0000","last_active":"2023-07-25T14:35:45.812671+0000","last_peered":"2023-07-25T14:35:45.812671+0000","last_clean":"2023-07-25T14:35:45.812671+0000","last_became_active":"2023-07-25T14:35:40.577361+0000","last_became_peered":"2023-07-25T14:35:40.577361+0000","last_unstale":"2023-07-25T14:35:45.812671+0000","last_undegraded":"2023-07-25T14:35:45.812671+0000","last_fullsized":"2023-07-25T14:35:45.812671+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:37:32.340440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.813426+0000","last_change":"2023-07-25T14:35:44.610450+0000","last_active":"2023-07-25T14:35:45.813426+0000","last_peered":"2023-07-25T14:35:45.813426+0000","last_clean":"2023-07-25T14:35:45.813426+0000","last_became_active":"2023-07-25T14:35:44.610074+0000","last_became_peered":"2023-07-25T14:35:44.610074+0000","last_unstale":"2023-07-25T14:35:45.813426+0000","last_undegraded":"2023-07-25T14:35:45.813426+0000","last_fullsized":"2023-07-25T14:35:45.813426+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_clean_scrub_stamp":"2023-07-25T14:35:43.577860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T16:23:18.284233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"20'3","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:46.549394+0000","last_change":"2023-07-25T14:35:39.543982+0000","last_active":"2023-07-25T14:35:46.549394+0000","last_peered":"2023-07-25T14:35:46.549394+0000","last_clean":"2023-07-25T14:35:46.549394+0000","last_became_active":"2023-07-25T14:35:39.543760+0000","last_became_peered":"2023-07-25T14:35:39.543760+0000","last_unstale":"2023-07-25T14:35:46.549394+0000","last_undegraded":"2023-07-25T14:35:46.549394+0000","last_fullsized":"2023-07-25T14:35:46.549394+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_clean_scrub_stamp":"2023-07-25T14:35:38.515226+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:42:37.075884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:47.032949+0000","last_change":"2023-07-25T14:35:40.577934+0000","last_active":"2023-07-25T14:35:47.032949+0000","last_peered":"2023-07-25T14:35:47.032949+0000","last_clean":"2023-07-25T14:35:47.032949+0000","last_became_active":"2023-07-25T14:35:40.577675+0000","last_became_peered":"2023-07-25T14:35:40.577675+0000","last_unstale":"2023-07-25T14:35:47.032949+0000","last_undegraded":"2023-07-25T14:35:47.032949+0000","last_fullsized":"2023-07-25T14:35:47.032949+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T23:32:02.358536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:47.033082+0000","last_change":"2023-07-25T14:35:44.611931+0000","last_active":"2023-07-25T14:35:47.033082+0000","last_peered":"2023-07-25T14:35:47.033082+0000","last_clean":"2023-07-25T14:35:47.033082+0000","last_became_active":"2023-07-25T14:35:44.611566+0000","last_became_peered":"2023-07-25T14:35:44.611566+0000","last_unstale":"2023-07-25T14:35:47.033082+0000","last_undegraded":"2023-07-25T14:35:47.033082+0000","last_fullsized":"2023-07-25T14:35:47.033082+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_clean_scrub_stamp":"2023-07-25T14:35:43.577860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T21:16:02.383581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"25'10","reported_seq":31,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:56.894906+0000","last_change":"2023-07-25T14:35:39.537231+0000","last_active":"2023-07-25T14:35:56.894906+0000","last_peered":"2023-07-25T14:35:56.894906+0000","last_clean":"2023-07-25T14:35:56.894906+0000","last_became_active":"2023-07-25T14:35:39.536936+0000","last_became_peered":"2023-07-25T14:35:39.536936+0000","last_unstale":"2023-07-25T14:35:56.894906+0000","last_undegraded":"2023-07-25T14:35:56.894906+0000","last_fullsized":"2023-07-25T14:35:56.894906+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_clean_scrub_stamp":"2023-07-25T14:35:38.515226+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T14:38:33.447792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3794,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.594207+0000","last_change":"2023-07-25T14:35:40.581925+0000","last_active":"2023-07-25T14:35:45.594207+0000","last_peered":"2023-07-25T14:35:45.594207+0000","last_clean":"2023-07-25T14:35:45.594207+0000","last_became_active":"2023-07-25T14:35:40.581612+0000","last_became_peered":"2023-07-25T14:35:40.581612+0000","last_unstale":"2023-07-25T14:35:45.594207+0000","last_undegraded":"2023-07-25T14:35:45.594207+0000","last_fullsized":"2023-07-25T14:35:45.594207+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T21:19:54.060418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.592462+0000","last_change":"2023-07-25T14:35:44.610512+0000","last_active":"2023-07-25T14:35:45.592462+0000","last_peered":"2023-07-25T14:35:45.592462+0000","last_clean":"2023-07-25T14:35:45.592462+0000","last_became_active":"2023-07-25T14:35:44.610029+0000","last_became_peered":"2023-07-25T14:35:44.610029+0000","last_unstale":"2023-07-25T14:35:45.592462+0000","last_undegraded":"2023-07-25T14:35:45.592462+0000","last_fullsized":"2023-07-25T14:35:45.592462+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_clean_scrub_stamp":"2023-07-25T14:35:43.577860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T15:50:16.169233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:46.549117+0000","last_change":"2023-07-25T14:35:39.541876+0000","last_active":"2023-07-25T14:35:46.549117+0000","last_peered":"2023-07-25T14:35:46.549117+0000","last_clean":"2023-07-25T14:35:46.549117+0000","last_became_active":"2023-07-25T14:35:39.541630+0000","last_became_peered":"2023-07-25T14:35:39.541630+0000","last_unstale":"2023-07-25T14:35:46.549117+0000","last_undegraded":"2023-07-25T14:35:46.549117+0000","last_fullsized":"2023-07-25T14:35:46.549117+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_clean_scrub_stamp":"2023-07-25T14:35:38.515226+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T21:17:39.462457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.813224+0000","last_change":"2023-07-25T14:35:40.571048+0000","last_active":"2023-07-25T14:35:45.813224+0000","last_peered":"2023-07-25T14:35:45.813224+0000","last_clean":"2023-07-25T14:35:45.813224+0000","last_became_active":"2023-07-25T14:35:40.570758+0000","last_became_peered":"2023-07-25T14:35:40.570758+0000","last_unstale":"2023-07-25T14:35:45.813224+0000","last_undegraded":"2023-07-25T14:35:45.813224+0000","last_fullsized":"2023-07-25T14:35:45.813224+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T01:55:22.618189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.813383+0000","last_change":"2023-07-25T14:35:44.611202+0000","last_active":"2023-07-25T14:35:45.813383+0000","last_peered":"2023-07-25T14:35:45.813383+0000","last_clean":"2023-07-25T14:35:45.813383+0000","last_became_active":"2023-07-25T14:35:44.610870+0000","last_became_peered":"2023-07-25T14:35:44.610870+0000","last_unstale":"2023-07-25T14:35:45.813383+0000","last_undegraded":"2023-07-25T14:35:45.813383+0000","last_fullsized":"2023-07-25T14:35:45.813383+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_clean_scrub_stamp":"2023-07-25T14:35:43.577860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T21:04:57.404448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:46.554898+0000","last_change":"2023-07-25T14:35:39.536644+0000","last_active":"2023-07-25T14:35:46.554898+0000","last_peered":"2023-07-25T14:35:46.554898+0000","last_clean":"2023-07-25T14:35:46.554898+0000","last_became_active":"2023-07-25T14:35:39.536369+0000","last_became_peered":"2023-07-25T14:35:39.536369+0000","last_unstale":"2023-07-25T14:35:46.554898+0000","last_undegraded":"2023-07-25T14:35:46.554898+0000","last_fullsized":"2023-07-25T14:35:46.554898+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_clean_scrub_stamp":"2023-07-25T14:35:38.515226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T15:50:11.106599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.591980+0000","last_change":"2023-07-25T14:35:40.562867+0000","last_active":"2023-07-25T14:35:45.591980+0000","last_peered":"2023-07-25T14:35:45.591980+0000","last_clean":"2023-07-25T14:35:45.591980+0000","last_became_active":"2023-07-25T14:35:40.562586+0000","last_became_peered":"2023-07-25T14:35:40.562586+0000","last_unstale":"2023-07-25T14:35:45.591980+0000","last_undegraded":"2023-07-25T14:35:45.591980+0000","last_fullsized":"2023-07-25T14:35:45.591980+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T20:23:13.132615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.813522+0000","last_change":"2023-07-25T14:35:44.614158+0000","last_active":"2023-07-25T14:35:45.813522+0000","last_peered":"2023-07-25T14:35:45.813522+0000","last_clean":"2023-07-25T14:35:45.813522+0000","last_became_active":"2023-07-25T14:35:44.613814+0000","last_became_peered":"2023-07-25T14:35:44.613814+0000","last_unstale":"2023-07-25T14:35:45.813522+0000","last_undegraded":"2023-07-25T14:35:45.813522+0000","last_fullsized":"2023-07-25T14:35:45.813522+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_clean_scrub_stamp":"2023-07-25T14:35:43.577860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:03:49.133248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:46.548772+0000","last_change":"2023-07-25T14:35:39.538871+0000","last_active":"2023-07-25T14:35:46.548772+0000","last_peered":"2023-07-25T14:35:46.548772+0000","last_clean":"2023-07-25T14:35:46.548772+0000","last_became_active":"2023-07-25T14:35:39.538503+0000","last_became_peered":"2023-07-25T14:35:39.538503+0000","last_unstale":"2023-07-25T14:35:46.548772+0000","last_undegraded":"2023-07-25T14:35:46.548772+0000","last_fullsized":"2023-07-25T14:35:46.548772+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_clean_scrub_stamp":"2023-07-25T14:35:38.515226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T14:52:14.647241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:46.554998+0000","last_change":"2023-07-25T14:35:40.579376+0000","last_active":"2023-07-25T14:35:46.554998+0000","last_peered":"2023-07-25T14:35:46.554998+0000","last_clean":"2023-07-25T14:35:46.554998+0000","last_became_active":"2023-07-25T14:35:40.579086+0000","last_became_peered":"2023-07-25T14:35:40.579086+0000","last_unstale":"2023-07-25T14:35:46.554998+0000","last_undegraded":"2023-07-25T14:35:46.554998+0000","last_fullsized":"2023-07-25T14:35:46.554998+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T14:52:15.649366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.591678+0000","last_change":"2023-07-25T14:35:44.610005+0000","last_active":"2023-07-25T14:35:45.591678+0000","last_peered":"2023-07-25T14:35:45.591678+0000","last_clean":"2023-07-25T14:35:45.591678+0000","last_became_active":"2023-07-25T14:35:44.609602+0000","last_became_peered":"2023-07-25T14:35:44.609602+0000","last_unstale":"2023-07-25T14:35:45.591678+0000","last_undegraded":"2023-07-25T14:35:45.591678+0000","last_fullsized":"2023-07-25T14:35:45.591678+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_clean_scrub_stamp":"2023-07-25T14:35:43.577860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:12:09.178353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"20'8","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.591599+0000","last_change":"2023-07-25T14:35:39.537282+0000","last_active":"2023-07-25T14:35:45.591599+0000","last_peered":"2023-07-25T14:35:45.591599+0000","last_clean":"2023-07-25T14:35:45.591599+0000","last_became_active":"2023-07-25T14:35:39.537001+0000","last_became_peered":"2023-07-25T14:35:39.537001+0000","last_unstale":"2023-07-25T14:35:45.591599+0000","last_undegraded":"2023-07-25T14:35:45.591599+0000","last_fullsized":"2023-07-25T14:35:45.591599+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_clean_scrub_stamp":"2023-07-25T14:35:38.515226+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T22:11:24.268503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.813644+0000","last_change":"2023-07-25T14:35:40.582310+0000","last_active":"2023-07-25T14:35:45.813644+0000","last_peered":"2023-07-25T14:35:45.813644+0000","last_clean":"2023-07-25T14:35:45.813644+0000","last_became_active":"2023-07-25T14:35:40.581913+0000","last_became_peered":"2023-07-25T14:35:40.581913+0000","last_unstale":"2023-07-25T14:35:45.813644+0000","last_undegraded":"2023-07-25T14:35:45.813644+0000","last_fullsized":"2023-07-25T14:35:45.813644+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T21:29:36.633963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:46.549014+0000","last_change":"2023-07-25T14:35:44.609817+0000","last_active":"2023-07-25T14:35:46.549014+0000","last_peered":"2023-07-25T14:35:46.549014+0000","last_clean":"2023-07-25T14:35:46.549014+0000","last_became_active":"2023-07-25T14:35:44.608964+0000","last_became_peered":"2023-07-25T14:35:44.608964+0000","last_unstale":"2023-07-25T14:35:46.549014+0000","last_undegraded":"2023-07-25T14:35:46.549014+0000","last_fullsized":"2023-07-25T14:35:46.549014+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_clean_scrub_stamp":"2023-07-25T14:35:43.577860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T17:08:37.225551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"20'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:46.549184+0000","last_change":"2023-07-25T14:35:39.540328+0000","last_active":"2023-07-25T14:35:46.549184+0000","last_peered":"2023-07-25T14:35:46.549184+0000","last_clean":"2023-07-25T14:35:46.549184+0000","last_became_active":"2023-07-25T14:35:39.540044+0000","last_became_peered":"2023-07-25T14:35:39.540044+0000","last_unstale":"2023-07-25T14:35:46.549184+0000","last_undegraded":"2023-07-25T14:35:46.549184+0000","last_fullsized":"2023-07-25T14:35:46.549184+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_clean_scrub_stamp":"2023-07-25T14:35:38.515226+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:24:56.192863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.591126+0000","last_change":"2023-07-25T14:35:40.566443+0000","last_active":"2023-07-25T14:35:45.591126+0000","last_peered":"2023-07-25T14:35:45.591126+0000","last_clean":"2023-07-25T14:35:45.591126+0000","last_became_active":"2023-07-25T14:35:40.566162+0000","last_became_peered":"2023-07-25T14:35:40.566162+0000","last_unstale":"2023-07-25T14:35:45.591126+0000","last_undegraded":"2023-07-25T14:35:45.591126+0000","last_fullsized":"2023-07-25T14:35:45.591126+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:14:11.945159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:47.032573+0000","last_change":"2023-07-25T14:35:44.615276+0000","last_active":"2023-07-25T14:35:47.032573+0000","last_peered":"2023-07-25T14:35:47.032573+0000","last_clean":"2023-07-25T14:35:47.032573+0000","last_became_active":"2023-07-25T14:35:44.614935+0000","last_became_peered":"2023-07-25T14:35:44.614935+0000","last_unstale":"2023-07-25T14:35:47.032573+0000","last_undegraded":"2023-07-25T14:35:47.032573+0000","last_fullsized":"2023-07-25T14:35:47.032573+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_clean_scrub_stamp":"2023-07-25T14:35:43.577860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T19:32:58.526454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:46.549428+0000","last_change":"2023-07-25T14:35:39.538857+0000","last_active":"2023-07-25T14:35:46.549428+0000","last_peered":"2023-07-25T14:35:46.549428+0000","last_clean":"2023-07-25T14:35:46.549428+0000","last_became_active":"2023-07-25T14:35:39.538533+0000","last_became_peered":"2023-07-25T14:35:39.538533+0000","last_unstale":"2023-07-25T14:35:46.549428+0000","last_undegraded":"2023-07-25T14:35:46.549428+0000","last_fullsized":"2023-07-25T14:35:46.549428+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_clean_scrub_stamp":"2023-07-25T14:35:38.515226+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T23:06:55.013283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.593610+0000","last_change":"2023-07-25T14:35:40.571933+0000","last_active":"2023-07-25T14:35:45.593610+0000","last_peered":"2023-07-25T14:35:45.593610+0000","last_clean":"2023-07-25T14:35:45.593610+0000","last_became_active":"2023-07-25T14:35:40.570814+0000","last_became_peered":"2023-07-25T14:35:40.570814+0000","last_unstale":"2023-07-25T14:35:45.593610+0000","last_undegraded":"2023-07-25T14:35:45.593610+0000","last_fullsized":"2023-07-25T14:35:45.593610+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T22:11:31.858060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:47.032762+0000","last_change":"2023-07-25T14:35:44.606624+0000","last_active":"2023-07-25T14:35:47.032762+0000","last_peered":"2023-07-25T14:35:47.032762+0000","last_clean":"2023-07-25T14:35:47.032762+0000","last_became_active":"2023-07-25T14:35:44.606139+0000","last_became_peered":"2023-07-25T14:35:44.606139+0000","last_unstale":"2023-07-25T14:35:47.032762+0000","last_undegraded":"2023-07-25T14:35:47.032762+0000","last_fullsized":"2023-07-25T14:35:47.032762+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_clean_scrub_stamp":"2023-07-25T14:35:43.577860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T01:22:16.213854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"20'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:46.549292+0000","last_change":"2023-07-25T14:35:39.536361+0000","last_active":"2023-07-25T14:35:46.549292+0000","last_peered":"2023-07-25T14:35:46.549292+0000","last_clean":"2023-07-25T14:35:46.549292+0000","last_became_active":"2023-07-25T14:35:39.536071+0000","last_became_peered":"2023-07-25T14:35:39.536071+0000","last_unstale":"2023-07-25T14:35:46.549292+0000","last_undegraded":"2023-07-25T14:35:46.549292+0000","last_fullsized":"2023-07-25T14:35:46.549292+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_clean_scrub_stamp":"2023-07-25T14:35:38.515226+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T18:51:17.455450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.590781+0000","last_change":"2023-07-25T14:35:40.569105+0000","last_active":"2023-07-25T14:35:45.590781+0000","last_peered":"2023-07-25T14:35:45.590781+0000","last_clean":"2023-07-25T14:35:45.590781+0000","last_became_active":"2023-07-25T14:35:40.568843+0000","last_became_peered":"2023-07-25T14:35:40.568843+0000","last_unstale":"2023-07-25T14:35:45.590781+0000","last_undegraded":"2023-07-25T14:35:45.590781+0000","last_fullsized":"2023-07-25T14:35:45.590781+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T23:38:20.059103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:47.032831+0000","last_change":"2023-07-25T14:35:44.611780+0000","last_active":"2023-07-25T14:35:47.032831+0000","last_peered":"2023-07-25T14:35:47.032831+0000","last_clean":"2023-07-25T14:35:47.032831+0000","last_became_active":"2023-07-25T14:35:44.606160+0000","last_became_peered":"2023-07-25T14:35:44.606160+0000","last_unstale":"2023-07-25T14:35:47.032831+0000","last_undegraded":"2023-07-25T14:35:47.032831+0000","last_fullsized":"2023-07-25T14:35:47.032831+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_clean_scrub_stamp":"2023-07-25T14:35:43.577860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T15:47:56.186166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.592846+0000","last_change":"2023-07-25T14:35:39.543540+0000","last_active":"2023-07-25T14:35:45.592846+0000","last_peered":"2023-07-25T14:35:45.592846+0000","last_clean":"2023-07-25T14:35:45.592846+0000","last_became_active":"2023-07-25T14:35:39.543276+0000","last_became_peered":"2023-07-25T14:35:39.543276+0000","last_unstale":"2023-07-25T14:35:45.592846+0000","last_undegraded":"2023-07-25T14:35:45.592846+0000","last_fullsized":"2023-07-25T14:35:45.592846+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_clean_scrub_stamp":"2023-07-25T14:35:38.515226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T14:52:14.647241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:46.555100+0000","last_change":"2023-07-25T14:35:40.571035+0000","last_active":"2023-07-25T14:35:46.555100+0000","last_peered":"2023-07-25T14:35:46.555100+0000","last_clean":"2023-07-25T14:35:46.555100+0000","last_became_active":"2023-07-25T14:35:40.570770+0000","last_became_peered":"2023-07-25T14:35:40.570770+0000","last_unstale":"2023-07-25T14:35:46.555100+0000","last_undegraded":"2023-07-25T14:35:46.555100+0000","last_fullsized":"2023-07-25T14:35:46.555100+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T19:57:14.056118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:47.032847+0000","last_change":"2023-07-25T14:35:44.608600+0000","last_active":"2023-07-25T14:35:47.032847+0000","last_peered":"2023-07-25T14:35:47.032847+0000","last_clean":"2023-07-25T14:35:47.032847+0000","last_became_active":"2023-07-25T14:35:44.606326+0000","last_became_peered":"2023-07-25T14:35:44.606326+0000","last_unstale":"2023-07-25T14:35:47.032847+0000","last_undegraded":"2023-07-25T14:35:47.032847+0000","last_fullsized":"2023-07-25T14:35:47.032847+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_clean_scrub_stamp":"2023-07-25T14:35:43.577860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T16:02:38.366335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.813032+0000","last_change":"2023-07-25T14:35:39.540008+0000","last_active":"2023-07-25T14:35:45.813032+0000","last_peered":"2023-07-25T14:35:45.813032+0000","last_clean":"2023-07-25T14:35:45.813032+0000","last_became_active":"2023-07-25T14:35:39.539753+0000","last_became_peered":"2023-07-25T14:35:39.539753+0000","last_unstale":"2023-07-25T14:35:45.813032+0000","last_undegraded":"2023-07-25T14:35:45.813032+0000","last_fullsized":"2023-07-25T14:35:45.813032+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_clean_scrub_stamp":"2023-07-25T14:35:38.515226+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T16:18:56.015550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.593664+0000","last_change":"2023-07-25T14:35:40.573373+0000","last_active":"2023-07-25T14:35:45.593664+0000","last_peered":"2023-07-25T14:35:45.593664+0000","last_clean":"2023-07-25T14:35:45.593664+0000","last_became_active":"2023-07-25T14:35:40.569647+0000","last_became_peered":"2023-07-25T14:35:40.569647+0000","last_unstale":"2023-07-25T14:35:45.593664+0000","last_undegraded":"2023-07-25T14:35:45.593664+0000","last_fullsized":"2023-07-25T14:35:45.593664+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T23:26:04.449433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:47.033427+0000","last_change":"2023-07-25T14:35:44.610221+0000","last_active":"2023-07-25T14:35:47.033427+0000","last_peered":"2023-07-25T14:35:47.033427+0000","last_clean":"2023-07-25T14:35:47.033427+0000","last_became_active":"2023-07-25T14:35:44.609802+0000","last_became_peered":"2023-07-25T14:35:44.609802+0000","last_unstale":"2023-07-25T14:35:47.033427+0000","last_undegraded":"2023-07-25T14:35:47.033427+0000","last_fullsized":"2023-07-25T14:35:47.033427+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_clean_scrub_stamp":"2023-07-25T14:35:43.577860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:12:09.178353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.590976+0000","last_change":"2023-07-25T14:35:39.542216+0000","last_active":"2023-07-25T14:35:45.590976+0000","last_peered":"2023-07-25T14:35:45.590976+0000","last_clean":"2023-07-25T14:35:45.590976+0000","last_became_active":"2023-07-25T14:35:39.541786+0000","last_became_peered":"2023-07-25T14:35:39.541786+0000","last_unstale":"2023-07-25T14:35:45.590976+0000","last_undegraded":"2023-07-25T14:35:45.590976+0000","last_fullsized":"2023-07-25T14:35:45.590976+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_clean_scrub_stamp":"2023-07-25T14:35:38.515226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T21:48:28.076390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.594037+0000","last_change":"2023-07-25T14:35:40.572398+0000","last_active":"2023-07-25T14:35:45.594037+0000","last_peered":"2023-07-25T14:35:45.594037+0000","last_clean":"2023-07-25T14:35:45.594037+0000","last_became_active":"2023-07-25T14:35:40.572184+0000","last_became_peered":"2023-07-25T14:35:40.572184+0000","last_unstale":"2023-07-25T14:35:45.594037+0000","last_undegraded":"2023-07-25T14:35:45.594037+0000","last_fullsized":"2023-07-25T14:35:45.594037+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T20:41:25.611682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.592232+0000","last_change":"2023-07-25T14:35:44.608573+0000","last_active":"2023-07-25T14:35:45.592232+0000","last_peered":"2023-07-25T14:35:45.592232+0000","last_clean":"2023-07-25T14:35:45.592232+0000","last_became_active":"2023-07-25T14:35:44.608195+0000","last_became_peered":"2023-07-25T14:35:44.608195+0000","last_unstale":"2023-07-25T14:35:45.592232+0000","last_undegraded":"2023-07-25T14:35:45.592232+0000","last_fullsized":"2023-07-25T14:35:45.592232+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_clean_scrub_stamp":"2023-07-25T14:35:43.577860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T19:42:05.988099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.593367+0000","last_change":"2023-07-25T14:35:39.534458+0000","last_active":"2023-07-25T14:35:45.593367+0000","last_peered":"2023-07-25T14:35:45.593367+0000","last_clean":"2023-07-25T14:35:45.593367+0000","last_became_active":"2023-07-25T14:35:39.534185+0000","last_became_peered":"2023-07-25T14:35:39.534185+0000","last_unstale":"2023-07-25T14:35:45.593367+0000","last_undegraded":"2023-07-25T14:35:45.593367+0000","last_fullsized":"2023-07-25T14:35:45.593367+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_clean_scrub_stamp":"2023-07-25T14:35:38.515226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T16:23:13.221599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.594751+0000","last_change":"2023-07-25T14:35:40.577364+0000","last_active":"2023-07-25T14:35:45.594751+0000","last_peered":"2023-07-25T14:35:45.594751+0000","last_clean":"2023-07-25T14:35:45.594751+0000","last_became_active":"2023-07-25T14:35:40.577048+0000","last_became_peered":"2023-07-25T14:35:40.577048+0000","last_unstale":"2023-07-25T14:35:45.594751+0000","last_undegraded":"2023-07-25T14:35:45.594751+0000","last_fullsized":"2023-07-25T14:35:45.594751+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T15:35:25.781647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.594516+0000","last_change":"2023-07-25T14:35:44.605512+0000","last_active":"2023-07-25T14:35:45.594516+0000","last_peered":"2023-07-25T14:35:45.594516+0000","last_clean":"2023-07-25T14:35:45.594516+0000","last_became_active":"2023-07-25T14:35:44.605134+0000","last_became_peered":"2023-07-25T14:35:44.605134+0000","last_unstale":"2023-07-25T14:35:45.594516+0000","last_undegraded":"2023-07-25T14:35:45.594516+0000","last_fullsized":"2023-07-25T14:35:45.594516+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_clean_scrub_stamp":"2023-07-25T14:35:43.577860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T21:23:30.279301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.812760+0000","last_change":"2023-07-25T14:35:39.540299+0000","last_active":"2023-07-25T14:35:45.812760+0000","last_peered":"2023-07-25T14:35:45.812760+0000","last_clean":"2023-07-25T14:35:45.812760+0000","last_became_active":"2023-07-25T14:35:39.540013+0000","last_became_peered":"2023-07-25T14:35:39.540013+0000","last_unstale":"2023-07-25T14:35:45.812760+0000","last_undegraded":"2023-07-25T14:35:45.812760+0000","last_fullsized":"2023-07-25T14:35:45.812760+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_clean_scrub_stamp":"2023-07-25T14:35:38.515226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:42:37.075884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:47.033534+0000","last_change":"2023-07-25T14:35:40.580966+0000","last_active":"2023-07-25T14:35:47.033534+0000","last_peered":"2023-07-25T14:35:47.033534+0000","last_clean":"2023-07-25T14:35:47.033534+0000","last_became_active":"2023-07-25T14:35:40.580713+0000","last_became_peered":"2023-07-25T14:35:40.580713+0000","last_unstale":"2023-07-25T14:35:47.033534+0000","last_undegraded":"2023-07-25T14:35:47.033534+0000","last_fullsized":"2023-07-25T14:35:47.033534+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T17:42:33.268060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.593698+0000","last_change":"2023-07-25T14:35:44.608905+0000","last_active":"2023-07-25T14:35:45.593698+0000","last_peered":"2023-07-25T14:35:45.593698+0000","last_clean":"2023-07-25T14:35:45.593698+0000","last_became_active":"2023-07-25T14:35:44.608522+0000","last_became_peered":"2023-07-25T14:35:44.608522+0000","last_unstale":"2023-07-25T14:35:45.593698+0000","last_undegraded":"2023-07-25T14:35:45.593698+0000","last_fullsized":"2023-07-25T14:35:45.593698+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_clean_scrub_stamp":"2023-07-25T14:35:43.577860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T22:11:48.857968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.813615+0000","last_change":"2023-07-25T14:35:39.543373+0000","last_active":"2023-07-25T14:35:45.813615+0000","last_peered":"2023-07-25T14:35:45.813615+0000","last_clean":"2023-07-25T14:35:45.813615+0000","last_became_active":"2023-07-25T14:35:39.542998+0000","last_became_peered":"2023-07-25T14:35:39.542998+0000","last_unstale":"2023-07-25T14:35:45.813615+0000","last_undegraded":"2023-07-25T14:35:45.813615+0000","last_fullsized":"2023-07-25T14:35:45.813615+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_clean_scrub_stamp":"2023-07-25T14:35:38.515226+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T19:24:35.653665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.594297+0000","last_change":"2023-07-25T14:35:34.371347+0000","last_active":"2023-07-25T14:35:45.594297+0000","last_peered":"2023-07-25T14:35:45.594297+0000","last_clean":"2023-07-25T14:35:45.594297+0000","last_became_active":"2023-07-25T14:35:34.371044+0000","last_became_peered":"2023-07-25T14:35:34.371044+0000","last_unstale":"2023-07-25T14:35:45.594297+0000","last_undegraded":"2023-07-25T14:35:45.594297+0000","last_fullsized":"2023-07-25T14:35:45.594297+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_clean_scrub_stamp":"2023-07-25T14:35:33.358525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T18:48:18.013494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.812672+0000","last_change":"2023-07-25T14:35:40.570033+0000","last_active":"2023-07-25T14:35:45.812672+0000","last_peered":"2023-07-25T14:35:45.812672+0000","last_clean":"2023-07-25T14:35:45.812672+0000","last_became_active":"2023-07-25T14:35:40.569434+0000","last_became_peered":"2023-07-25T14:35:40.569434+0000","last_unstale":"2023-07-25T14:35:45.812672+0000","last_undegraded":"2023-07-25T14:35:45.812672+0000","last_fullsized":"2023-07-25T14:35:45.812672+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T18:51:18.457575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.812670+0000","last_change":"2023-07-25T14:35:44.609023+0000","last_active":"2023-07-25T14:35:45.812670+0000","last_peered":"2023-07-25T14:35:45.812670+0000","last_clean":"2023-07-25T14:35:45.812670+0000","last_became_active":"2023-07-25T14:35:44.608633+0000","last_became_peered":"2023-07-25T14:35:44.608633+0000","last_unstale":"2023-07-25T14:35:45.812670+0000","last_undegraded":"2023-07-25T14:35:45.812670+0000","last_fullsized":"2023-07-25T14:35:45.812670+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_clean_scrub_stamp":"2023-07-25T14:35:43.577860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:25:01.255497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.813164+0000","last_change":"2023-07-25T14:35:34.371737+0000","last_active":"2023-07-25T14:35:45.813164+0000","last_peered":"2023-07-25T14:35:45.813164+0000","last_clean":"2023-07-25T14:35:45.813164+0000","last_became_active":"2023-07-25T14:35:34.371411+0000","last_became_peered":"2023-07-25T14:35:34.371411+0000","last_unstale":"2023-07-25T14:35:45.813164+0000","last_undegraded":"2023-07-25T14:35:45.813164+0000","last_fullsized":"2023-07-25T14:35:45.813164+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_clean_scrub_stamp":"2023-07-25T14:35:33.358525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T23:20:13.045467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"23'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:46.554714+0000","last_change":"2023-07-25T14:35:39.539692+0000","last_active":"2023-07-25T14:35:46.554714+0000","last_peered":"2023-07-25T14:35:46.554714+0000","last_clean":"2023-07-25T14:35:46.554714+0000","last_became_active":"2023-07-25T14:35:39.539376+0000","last_became_peered":"2023-07-25T14:35:39.539376+0000","last_unstale":"2023-07-25T14:35:46.554714+0000","last_undegraded":"2023-07-25T14:35:46.554714+0000","last_fullsized":"2023-07-25T14:35:46.554714+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_clean_scrub_stamp":"2023-07-25T14:35:38.515226+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T17:03:30.120782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.593423+0000","last_change":"2023-07-25T14:35:40.572322+0000","last_active":"2023-07-25T14:35:45.593423+0000","last_peered":"2023-07-25T14:35:45.593423+0000","last_clean":"2023-07-25T14:35:45.593423+0000","last_became_active":"2023-07-25T14:35:40.571140+0000","last_became_peered":"2023-07-25T14:35:40.571140+0000","last_unstale":"2023-07-25T14:35:45.593423+0000","last_undegraded":"2023-07-25T14:35:45.593423+0000","last_fullsized":"2023-07-25T14:35:45.593423+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:03:45.072739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.591989+0000","last_change":"2023-07-25T14:35:44.611488+0000","last_active":"2023-07-25T14:35:45.591989+0000","last_peered":"2023-07-25T14:35:45.591989+0000","last_clean":"2023-07-25T14:35:45.591989+0000","last_became_active":"2023-07-25T14:35:44.610632+0000","last_became_peered":"2023-07-25T14:35:44.610632+0000","last_unstale":"2023-07-25T14:35:45.591989+0000","last_undegraded":"2023-07-25T14:35:45.591989+0000","last_fullsized":"2023-07-25T14:35:45.591989+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_clean_scrub_stamp":"2023-07-25T14:35:43.577860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T17:03:35.183416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:47.032770+0000","last_change":"2023-07-25T14:35:34.370121+0000","last_active":"2023-07-25T14:35:47.032770+0000","last_peered":"2023-07-25T14:35:47.032770+0000","last_clean":"2023-07-25T14:35:47.032770+0000","last_became_active":"2023-07-25T14:35:34.369795+0000","last_became_peered":"2023-07-25T14:35:34.369795+0000","last_unstale":"2023-07-25T14:35:47.032770+0000","last_undegraded":"2023-07-25T14:35:47.032770+0000","last_fullsized":"2023-07-25T14:35:47.032770+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_clean_scrub_stamp":"2023-07-25T14:35:33.358525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T22:23:26.576696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":177,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:46.548822+0000","last_change":"2023-07-25T14:35:34.372381+0000","last_active":"2023-07-25T14:35:46.548822+0000","last_peered":"2023-07-25T14:35:46.548822+0000","last_clean":"2023-07-25T14:35:46.548822+0000","last_became_active":"2023-07-25T14:35:34.371110+0000","last_became_peered":"2023-07-25T14:35:34.371110+0000","last_unstale":"2023-07-25T14:35:46.548822+0000","last_undegraded":"2023-07-25T14:35:46.548822+0000","last_fullsized":"2023-07-25T14:35:46.548822+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_clean_scrub_stamp":"2023-07-25T14:35:33.358525+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:20:22.063773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:46.554511+0000","last_change":"2023-07-25T14:35:39.541815+0000","last_active":"2023-07-25T14:35:46.554511+0000","last_peered":"2023-07-25T14:35:46.554511+0000","last_clean":"2023-07-25T14:35:46.554511+0000","last_became_active":"2023-07-25T14:35:39.541600+0000","last_became_peered":"2023-07-25T14:35:39.541600+0000","last_unstale":"2023-07-25T14:35:46.554511+0000","last_undegraded":"2023-07-25T14:35:46.554511+0000","last_fullsized":"2023-07-25T14:35:46.554511+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_clean_scrub_stamp":"2023-07-25T14:35:38.515226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T21:31:30.768429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:46.554954+0000","last_change":"2023-07-25T14:35:40.572449+0000","last_active":"2023-07-25T14:35:46.554954+0000","last_peered":"2023-07-25T14:35:46.554954+0000","last_clean":"2023-07-25T14:35:46.554954+0000","last_became_active":"2023-07-25T14:35:40.572096+0000","last_became_peered":"2023-07-25T14:35:40.572096+0000","last_unstale":"2023-07-25T14:35:46.554954+0000","last_undegraded":"2023-07-25T14:35:46.554954+0000","last_fullsized":"2023-07-25T14:35:46.554954+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:20:28.222599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:47.033330+0000","last_change":"2023-07-25T14:35:44.612010+0000","last_active":"2023-07-25T14:35:47.033330+0000","last_peered":"2023-07-25T14:35:47.033330+0000","last_clean":"2023-07-25T14:35:47.033330+0000","last_became_active":"2023-07-25T14:35:44.611576+0000","last_became_peered":"2023-07-25T14:35:44.611576+0000","last_unstale":"2023-07-25T14:35:47.033330+0000","last_undegraded":"2023-07-25T14:35:47.033330+0000","last_fullsized":"2023-07-25T14:35:47.033330+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_clean_scrub_stamp":"2023-07-25T14:35:43.577860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T20:58:23.211755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:46.548801+0000","last_change":"2023-07-25T14:35:35.321448+0000","last_active":"2023-07-25T14:35:46.548801+0000","last_peered":"2023-07-25T14:35:46.548801+0000","last_clean":"2023-07-25T14:35:46.548801+0000","last_became_active":"2023-07-25T14:35:35.320830+0000","last_became_peered":"2023-07-25T14:35:35.320830+0000","last_unstale":"2023-07-25T14:35:46.548801+0000","last_undegraded":"2023-07-25T14:35:46.548801+0000","last_fullsized":"2023-07-25T14:35:46.548801+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_clean_scrub_stamp":"2023-07-25T14:35:33.358525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:09:28.211053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:47.032318+0000","last_change":"2023-07-25T14:35:39.536830+0000","last_active":"2023-07-25T14:35:47.032318+0000","last_peered":"2023-07-25T14:35:47.032318+0000","last_clean":"2023-07-25T14:35:47.032318+0000","last_became_active":"2023-07-25T14:35:39.536580+0000","last_became_peered":"2023-07-25T14:35:39.536580+0000","last_unstale":"2023-07-25T14:35:47.032318+0000","last_undegraded":"2023-07-25T14:35:47.032318+0000","last_fullsized":"2023-07-25T14:35:47.032318+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_clean_scrub_stamp":"2023-07-25T14:35:38.515226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T14:53:19.398227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:47.033471+0000","last_change":"2023-07-25T14:35:40.574429+0000","last_active":"2023-07-25T14:35:47.033471+0000","last_peered":"2023-07-25T14:35:47.033471+0000","last_clean":"2023-07-25T14:35:47.033471+0000","last_became_active":"2023-07-25T14:35:40.574108+0000","last_became_peered":"2023-07-25T14:35:40.574108+0000","last_unstale":"2023-07-25T14:35:47.033471+0000","last_undegraded":"2023-07-25T14:35:47.033471+0000","last_fullsized":"2023-07-25T14:35:47.033471+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T21:31:31.770554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:46.549141+0000","last_change":"2023-07-25T14:35:44.613889+0000","last_active":"2023-07-25T14:35:46.549141+0000","last_peered":"2023-07-25T14:35:46.549141+0000","last_clean":"2023-07-25T14:35:46.549141+0000","last_became_active":"2023-07-25T14:35:44.613279+0000","last_became_peered":"2023-07-25T14:35:44.613279+0000","last_unstale":"2023-07-25T14:35:46.549141+0000","last_undegraded":"2023-07-25T14:35:46.549141+0000","last_fullsized":"2023-07-25T14:35:46.549141+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_clean_scrub_stamp":"2023-07-25T14:35:43.577860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T19:57:18.116626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:46.548653+0000","last_change":"2023-07-25T14:35:35.321201+0000","last_active":"2023-07-25T14:35:46.548653+0000","last_peered":"2023-07-25T14:35:46.548653+0000","last_clean":"2023-07-25T14:35:46.548653+0000","last_became_active":"2023-07-25T14:35:35.320728+0000","last_became_peered":"2023-07-25T14:35:35.320728+0000","last_unstale":"2023-07-25T14:35:46.548653+0000","last_undegraded":"2023-07-25T14:35:46.548653+0000","last_fullsized":"2023-07-25T14:35:46.548653+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_clean_scrub_stamp":"2023-07-25T14:35:33.358525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:43:20.143867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.812837+0000","last_change":"2023-07-25T14:35:39.540111+0000","last_active":"2023-07-25T14:35:45.812837+0000","last_peered":"2023-07-25T14:35:45.812837+0000","last_clean":"2023-07-25T14:35:45.812837+0000","last_became_active":"2023-07-25T14:35:39.539829+0000","last_became_peered":"2023-07-25T14:35:39.539829+0000","last_unstale":"2023-07-25T14:35:45.812837+0000","last_undegraded":"2023-07-25T14:35:45.812837+0000","last_fullsized":"2023-07-25T14:35:45.812837+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_clean_scrub_stamp":"2023-07-25T14:35:38.515226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T20:10:32.190837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.591417+0000","last_change":"2023-07-25T14:35:40.572819+0000","last_active":"2023-07-25T14:35:45.591417+0000","last_peered":"2023-07-25T14:35:45.591417+0000","last_clean":"2023-07-25T14:35:45.591417+0000","last_became_active":"2023-07-25T14:35:40.572460+0000","last_became_peered":"2023-07-25T14:35:40.572460+0000","last_unstale":"2023-07-25T14:35:45.591417+0000","last_undegraded":"2023-07-25T14:35:45.591417+0000","last_fullsized":"2023-07-25T14:35:45.591417+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T19:36:38.983536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:46.554722+0000","last_change":"2023-07-25T14:35:44.617264+0000","last_active":"2023-07-25T14:35:46.554722+0000","last_peered":"2023-07-25T14:35:46.554722+0000","last_clean":"2023-07-25T14:35:46.554722+0000","last_became_active":"2023-07-25T14:35:44.616864+0000","last_became_peered":"2023-07-25T14:35:44.616864+0000","last_unstale":"2023-07-25T14:35:46.554722+0000","last_undegraded":"2023-07-25T14:35:46.554722+0000","last_fullsized":"2023-07-25T14:35:46.554722+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_clean_scrub_stamp":"2023-07-25T14:35:43.577860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T20:23:17.193123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.592094+0000","last_change":"2023-07-25T14:35:35.321057+0000","last_active":"2023-07-25T14:35:45.592094+0000","last_peered":"2023-07-25T14:35:45.592094+0000","last_clean":"2023-07-25T14:35:45.592094+0000","last_became_active":"2023-07-25T14:35:35.320751+0000","last_became_peered":"2023-07-25T14:35:35.320751+0000","last_unstale":"2023-07-25T14:35:45.592094+0000","last_undegraded":"2023-07-25T14:35:45.592094+0000","last_fullsized":"2023-07-25T14:35:45.592094+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_clean_scrub_stamp":"2023-07-25T14:35:33.358525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:55:16.670397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.593801+0000","last_change":"2023-07-25T14:35:39.535048+0000","last_active":"2023-07-25T14:35:45.593801+0000","last_peered":"2023-07-25T14:35:45.593801+0000","last_clean":"2023-07-25T14:35:45.593801+0000","last_became_active":"2023-07-25T14:35:39.534749+0000","last_became_peered":"2023-07-25T14:35:39.534749+0000","last_unstale":"2023-07-25T14:35:45.593801+0000","last_undegraded":"2023-07-25T14:35:45.593801+0000","last_fullsized":"2023-07-25T14:35:45.593801+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_clean_scrub_stamp":"2023-07-25T14:35:38.515226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T19:56:32.500581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:47.032972+0000","last_change":"2023-07-25T14:35:40.562358+0000","last_active":"2023-07-25T14:35:47.032972+0000","last_peered":"2023-07-25T14:35:47.032972+0000","last_clean":"2023-07-25T14:35:47.032972+0000","last_became_active":"2023-07-25T14:35:40.562072+0000","last_became_peered":"2023-07-25T14:35:40.562072+0000","last_unstale":"2023-07-25T14:35:47.032972+0000","last_undegraded":"2023-07-25T14:35:47.032972+0000","last_fullsized":"2023-07-25T14:35:47.032972+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T23:39:16.694925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.591232+0000","last_change":"2023-07-25T14:35:44.605076+0000","last_active":"2023-07-25T14:35:45.591232+0000","last_peered":"2023-07-25T14:35:45.591232+0000","last_clean":"2023-07-25T14:35:45.591232+0000","last_became_active":"2023-07-25T14:35:44.604627+0000","last_became_peered":"2023-07-25T14:35:44.604627+0000","last_unstale":"2023-07-25T14:35:45.591232+0000","last_undegraded":"2023-07-25T14:35:45.591232+0000","last_fullsized":"2023-07-25T14:35:45.591232+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_clean_scrub_stamp":"2023-07-25T14:35:43.577860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T17:14:14.382524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.591663+0000","last_change":"2023-07-25T14:35:35.321055+0000","last_active":"2023-07-25T14:35:45.591663+0000","last_peered":"2023-07-25T14:35:45.591663+0000","last_clean":"2023-07-25T14:35:45.591663+0000","last_became_active":"2023-07-25T14:35:35.320739+0000","last_became_peered":"2023-07-25T14:35:35.320739+0000","last_unstale":"2023-07-25T14:35:45.591663+0000","last_undegraded":"2023-07-25T14:35:45.591663+0000","last_fullsized":"2023-07-25T14:35:45.591663+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_clean_scrub_stamp":"2023-07-25T14:35:33.358525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T17:42:19.164577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:47.033169+0000","last_change":"2023-07-25T14:35:39.539756+0000","last_active":"2023-07-25T14:35:47.033169+0000","last_peered":"2023-07-25T14:35:47.033169+0000","last_clean":"2023-07-25T14:35:47.033169+0000","last_became_active":"2023-07-25T14:35:39.539459+0000","last_became_peered":"2023-07-25T14:35:39.539459+0000","last_unstale":"2023-07-25T14:35:47.033169+0000","last_undegraded":"2023-07-25T14:35:47.033169+0000","last_fullsized":"2023-07-25T14:35:47.033169+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_clean_scrub_stamp":"2023-07-25T14:35:38.515226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:14:10.943034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:46.555037+0000","last_change":"2023-07-25T14:35:40.569961+0000","last_active":"2023-07-25T14:35:46.555037+0000","last_peered":"2023-07-25T14:35:46.555037+0000","last_clean":"2023-07-25T14:35:46.555037+0000","last_became_active":"2023-07-25T14:35:40.569660+0000","last_became_peered":"2023-07-25T14:35:40.569660+0000","last_unstale":"2023-07-25T14:35:46.555037+0000","last_undegraded":"2023-07-25T14:35:46.555037+0000","last_fullsized":"2023-07-25T14:35:46.555037+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T21:17:40.464582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:46.554816+0000","last_change":"2023-07-25T14:35:44.616675+0000","last_active":"2023-07-25T14:35:46.554816+0000","last_peered":"2023-07-25T14:35:46.554816+0000","last_clean":"2023-07-25T14:35:46.554816+0000","last_became_active":"2023-07-25T14:35:44.616241+0000","last_became_peered":"2023-07-25T14:35:44.616241+0000","last_unstale":"2023-07-25T14:35:46.554816+0000","last_undegraded":"2023-07-25T14:35:46.554816+0000","last_fullsized":"2023-07-25T14:35:46.554816+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_clean_scrub_stamp":"2023-07-25T14:35:43.577860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T19:42:05.988099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.593040+0000","last_change":"2023-07-25T14:35:34.370772+0000","last_active":"2023-07-25T14:35:45.593040+0000","last_peered":"2023-07-25T14:35:45.593040+0000","last_clean":"2023-07-25T14:35:45.593040+0000","last_became_active":"2023-07-25T14:35:34.370549+0000","last_became_peered":"2023-07-25T14:35:34.370549+0000","last_unstale":"2023-07-25T14:35:45.593040+0000","last_undegraded":"2023-07-25T14:35:45.593040+0000","last_fullsized":"2023-07-25T14:35:45.593040+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_clean_scrub_stamp":"2023-07-25T14:35:33.358525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T19:34:32.153689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.591780+0000","last_change":"2023-07-25T14:35:39.543278+0000","last_active":"2023-07-25T14:35:45.591780+0000","last_peered":"2023-07-25T14:35:45.591780+0000","last_clean":"2023-07-25T14:35:45.591780+0000","last_became_active":"2023-07-25T14:35:39.543017+0000","last_became_peered":"2023-07-25T14:35:39.543017+0000","last_unstale":"2023-07-25T14:35:45.591780+0000","last_undegraded":"2023-07-25T14:35:45.591780+0000","last_fullsized":"2023-07-25T14:35:45.591780+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_clean_scrub_stamp":"2023-07-25T14:35:38.515226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T17:42:32.265934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:47.032289+0000","last_change":"2023-07-25T14:35:40.574583+0000","last_active":"2023-07-25T14:35:47.032289+0000","last_peered":"2023-07-25T14:35:47.032289+0000","last_clean":"2023-07-25T14:35:47.032289+0000","last_became_active":"2023-07-25T14:35:40.574298+0000","last_became_peered":"2023-07-25T14:35:40.574298+0000","last_unstale":"2023-07-25T14:35:47.032289+0000","last_undegraded":"2023-07-25T14:35:47.032289+0000","last_fullsized":"2023-07-25T14:35:47.032289+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T01:29:43.918829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:47.033044+0000","last_change":"2023-07-25T14:35:44.609515+0000","last_active":"2023-07-25T14:35:47.033044+0000","last_peered":"2023-07-25T14:35:47.033044+0000","last_clean":"2023-07-25T14:35:47.033044+0000","last_became_active":"2023-07-25T14:35:44.609128+0000","last_became_peered":"2023-07-25T14:35:44.609128+0000","last_unstale":"2023-07-25T14:35:47.033044+0000","last_undegraded":"2023-07-25T14:35:47.033044+0000","last_fullsized":"2023-07-25T14:35:47.033044+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_clean_scrub_stamp":"2023-07-25T14:35:43.577860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T01:26:57.336329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"20'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:46.555117+0000","last_change":"2023-07-25T14:35:39.542444+0000","last_active":"2023-07-25T14:35:46.555117+0000","last_peered":"2023-07-25T14:35:46.555117+0000","last_clean":"2023-07-25T14:35:46.555117+0000","last_became_active":"2023-07-25T14:35:39.542159+0000","last_became_peered":"2023-07-25T14:35:39.542159+0000","last_unstale":"2023-07-25T14:35:46.555117+0000","last_undegraded":"2023-07-25T14:35:46.555117+0000","last_fullsized":"2023-07-25T14:35:46.555117+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_clean_scrub_stamp":"2023-07-25T14:35:38.515226+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:24:56.192863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:47.033068+0000","last_change":"2023-07-25T14:35:40.560846+0000","last_active":"2023-07-25T14:35:47.033068+0000","last_peered":"2023-07-25T14:35:47.033068+0000","last_clean":"2023-07-25T14:35:47.033068+0000","last_became_active":"2023-07-25T14:35:40.560390+0000","last_became_peered":"2023-07-25T14:35:40.560390+0000","last_unstale":"2023-07-25T14:35:47.033068+0000","last_undegraded":"2023-07-25T14:35:47.033068+0000","last_fullsized":"2023-07-25T14:35:47.033068+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T02:30:11.217603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:46.548733+0000","last_change":"2023-07-25T14:35:44.612963+0000","last_active":"2023-07-25T14:35:46.548733+0000","last_peered":"2023-07-25T14:35:46.548733+0000","last_clean":"2023-07-25T14:35:46.548733+0000","last_became_active":"2023-07-25T14:35:44.612473+0000","last_became_peered":"2023-07-25T14:35:44.612473+0000","last_unstale":"2023-07-25T14:35:46.548733+0000","last_undegraded":"2023-07-25T14:35:46.548733+0000","last_fullsized":"2023-07-25T14:35:46.548733+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_clean_scrub_stamp":"2023-07-25T14:35:43.577860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T15:17:51.741356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.592714+0000","last_change":"2023-07-25T14:35:39.533066+0000","last_active":"2023-07-25T14:35:45.592714+0000","last_peered":"2023-07-25T14:35:45.592714+0000","last_clean":"2023-07-25T14:35:45.592714+0000","last_became_active":"2023-07-25T14:35:39.532788+0000","last_became_peered":"2023-07-25T14:35:39.532788+0000","last_unstale":"2023-07-25T14:35:45.592714+0000","last_undegraded":"2023-07-25T14:35:45.592714+0000","last_fullsized":"2023-07-25T14:35:45.592714+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_clean_scrub_stamp":"2023-07-25T14:35:38.515226+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:20:27.220474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.593805+0000","last_change":"2023-07-25T14:35:40.583948+0000","last_active":"2023-07-25T14:35:45.593805+0000","last_peered":"2023-07-25T14:35:45.593805+0000","last_clean":"2023-07-25T14:35:45.593805+0000","last_became_active":"2023-07-25T14:35:40.583649+0000","last_became_peered":"2023-07-25T14:35:40.583649+0000","last_unstale":"2023-07-25T14:35:45.593805+0000","last_undegraded":"2023-07-25T14:35:45.593805+0000","last_fullsized":"2023-07-25T14:35:45.593805+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T23:42:40.581448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.592627+0000","last_change":"2023-07-25T14:35:44.605812+0000","last_active":"2023-07-25T14:35:45.592627+0000","last_peered":"2023-07-25T14:35:45.592627+0000","last_clean":"2023-07-25T14:35:45.592627+0000","last_became_active":"2023-07-25T14:35:44.605416+0000","last_became_peered":"2023-07-25T14:35:44.605416+0000","last_unstale":"2023-07-25T14:35:45.592627+0000","last_undegraded":"2023-07-25T14:35:45.592627+0000","last_fullsized":"2023-07-25T14:35:45.592627+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_clean_scrub_stamp":"2023-07-25T14:35:43.577860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:09:38.430388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.591482+0000","last_change":"2023-07-25T14:35:39.538303+0000","last_active":"2023-07-25T14:35:45.591482+0000","last_peered":"2023-07-25T14:35:45.591482+0000","last_clean":"2023-07-25T14:35:45.591482+0000","last_became_active":"2023-07-25T14:35:39.538019+0000","last_became_peered":"2023-07-25T14:35:39.538019+0000","last_unstale":"2023-07-25T14:35:45.591482+0000","last_undegraded":"2023-07-25T14:35:45.591482+0000","last_fullsized":"2023-07-25T14:35:45.591482+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_clean_scrub_stamp":"2023-07-25T14:35:38.515226+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T21:36:37.994624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.593528+0000","last_change":"2023-07-25T14:35:40.573130+0000","last_active":"2023-07-25T14:35:45.593528+0000","last_peered":"2023-07-25T14:35:45.593528+0000","last_clean":"2023-07-25T14:35:45.593528+0000","last_became_active":"2023-07-25T14:35:40.572465+0000","last_became_peered":"2023-07-25T14:35:40.572465+0000","last_unstale":"2023-07-25T14:35:45.593528+0000","last_undegraded":"2023-07-25T14:35:45.593528+0000","last_fullsized":"2023-07-25T14:35:45.593528+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T21:29:36.633963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.593380+0000","last_change":"2023-07-25T14:35:44.610311+0000","last_active":"2023-07-25T14:35:45.593380+0000","last_peered":"2023-07-25T14:35:45.593380+0000","last_clean":"2023-07-25T14:35:45.593380+0000","last_became_active":"2023-07-25T14:35:44.609672+0000","last_became_peered":"2023-07-25T14:35:44.609672+0000","last_unstale":"2023-07-25T14:35:45.593380+0000","last_undegraded":"2023-07-25T14:35:45.593380+0000","last_fullsized":"2023-07-25T14:35:45.593380+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_clean_scrub_stamp":"2023-07-25T14:35:43.577860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T21:04:57.404448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"20'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.813281+0000","last_change":"2023-07-25T14:35:39.542215+0000","last_active":"2023-07-25T14:35:45.813281+0000","last_peered":"2023-07-25T14:35:45.813281+0000","last_clean":"2023-07-25T14:35:45.813281+0000","last_became_active":"2023-07-25T14:35:39.541943+0000","last_became_peered":"2023-07-25T14:35:39.541943+0000","last_unstale":"2023-07-25T14:35:45.813281+0000","last_undegraded":"2023-07-25T14:35:45.813281+0000","last_fullsized":"2023-07-25T14:35:45.813281+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_clean_scrub_stamp":"2023-07-25T14:35:38.515226+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T18:16:10.455351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.812997+0000","last_change":"2023-07-25T14:35:40.579154+0000","last_active":"2023-07-25T14:35:45.812997+0000","last_peered":"2023-07-25T14:35:45.812997+0000","last_clean":"2023-07-25T14:35:45.812997+0000","last_became_active":"2023-07-25T14:35:40.578884+0000","last_became_peered":"2023-07-25T14:35:40.578884+0000","last_unstale":"2023-07-25T14:35:45.812997+0000","last_undegraded":"2023-07-25T14:35:45.812997+0000","last_fullsized":"2023-07-25T14:35:45.812997+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T17:49:05.620750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:47.032543+0000","last_change":"2023-07-25T14:35:44.612196+0000","last_active":"2023-07-25T14:35:47.032543+0000","last_peered":"2023-07-25T14:35:47.032543+0000","last_clean":"2023-07-25T14:35:47.032543+0000","last_became_active":"2023-07-25T14:35:44.607198+0000","last_became_peered":"2023-07-25T14:35:44.607198+0000","last_unstale":"2023-07-25T14:35:47.032543+0000","last_undegraded":"2023-07-25T14:35:47.032543+0000","last_fullsized":"2023-07-25T14:35:47.032543+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_clean_scrub_stamp":"2023-07-25T14:35:43.577860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T01:05:07.252828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"20'4","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:46.555008+0000","last_change":"2023-07-25T14:35:39.532403+0000","last_active":"2023-07-25T14:35:46.555008+0000","last_peered":"2023-07-25T14:35:46.555008+0000","last_clean":"2023-07-25T14:35:46.555008+0000","last_became_active":"2023-07-25T14:35:39.532093+0000","last_became_peered":"2023-07-25T14:35:39.532093+0000","last_unstale":"2023-07-25T14:35:46.555008+0000","last_undegraded":"2023-07-25T14:35:46.555008+0000","last_fullsized":"2023-07-25T14:35:46.555008+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_clean_scrub_stamp":"2023-07-25T14:35:38.515226+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T17:08:32.162917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.593485+0000","last_change":"2023-07-25T14:35:40.577967+0000","last_active":"2023-07-25T14:35:45.593485+0000","last_peered":"2023-07-25T14:35:45.593485+0000","last_clean":"2023-07-25T14:35:45.593485+0000","last_became_active":"2023-07-25T14:35:40.577650+0000","last_became_peered":"2023-07-25T14:35:40.577650+0000","last_unstale":"2023-07-25T14:35:45.593485+0000","last_undegraded":"2023-07-25T14:35:45.593485+0000","last_fullsized":"2023-07-25T14:35:45.593485+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T19:24:36.655790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.590805+0000","last_change":"2023-07-25T14:35:40.571775+0000","last_active":"2023-07-25T14:35:45.590805+0000","last_peered":"2023-07-25T14:35:45.590805+0000","last_clean":"2023-07-25T14:35:45.590805+0000","last_became_active":"2023-07-25T14:35:40.571515+0000","last_became_peered":"2023-07-25T14:35:40.571515+0000","last_unstale":"2023-07-25T14:35:45.590805+0000","last_undegraded":"2023-07-25T14:35:45.590805+0000","last_fullsized":"2023-07-25T14:35:45.590805+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T01:27:20.879412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.812791+0000","last_change":"2023-07-25T14:35:40.580145+0000","last_active":"2023-07-25T14:35:45.812791+0000","last_peered":"2023-07-25T14:35:45.812791+0000","last_clean":"2023-07-25T14:35:45.812791+0000","last_became_active":"2023-07-25T14:35:40.579840+0000","last_became_peered":"2023-07-25T14:35:40.579840+0000","last_unstale":"2023-07-25T14:35:45.812791+0000","last_undegraded":"2023-07-25T14:35:45.812791+0000","last_fullsized":"2023-07-25T14:35:45.812791+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T23:06:56.015409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.593959+0000","last_change":"2023-07-25T14:35:40.582132+0000","last_active":"2023-07-25T14:35:45.593959+0000","last_peered":"2023-07-25T14:35:45.593959+0000","last_clean":"2023-07-25T14:35:45.593959+0000","last_became_active":"2023-07-25T14:35:40.581759+0000","last_became_peered":"2023-07-25T14:35:40.581759+0000","last_unstale":"2023-07-25T14:35:45.593959+0000","last_undegraded":"2023-07-25T14:35:45.593959+0000","last_fullsized":"2023-07-25T14:35:45.593959+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T17:04:15.120194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.812954+0000","last_change":"2023-07-25T14:35:40.583199+0000","last_active":"2023-07-25T14:35:45.812954+0000","last_peered":"2023-07-25T14:35:45.812954+0000","last_clean":"2023-07-25T14:35:45.812954+0000","last_became_active":"2023-07-25T14:35:40.582969+0000","last_became_peered":"2023-07-25T14:35:40.582969+0000","last_unstale":"2023-07-25T14:35:45.812954+0000","last_undegraded":"2023-07-25T14:35:45.812954+0000","last_fullsized":"2023-07-25T14:35:45.812954+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T16:19:19.724875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:47.033086+0000","last_change":"2023-07-25T14:35:40.560945+0000","last_active":"2023-07-25T14:35:47.033086+0000","last_peered":"2023-07-25T14:35:47.033086+0000","last_clean":"2023-07-25T14:35:47.033086+0000","last_became_active":"2023-07-25T14:35:40.560663+0000","last_became_peered":"2023-07-25T14:35:40.560663+0000","last_unstale":"2023-07-25T14:35:47.033086+0000","last_undegraded":"2023-07-25T14:35:47.033086+0000","last_fullsized":"2023-07-25T14:35:47.033086+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T17:24:11.100853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4592,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64510,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574858,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":360448,"data_stored":703779,"data_compressed":32255,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34799999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.43099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40699999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59999999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574857,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":266240,"data_stored":109401,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.374}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.624}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34699999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574857,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":331776,"data_stored":699769,"data_compressed":32255,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.245}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30199999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42199999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.432}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574857,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":266240,"data_stored":108922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29999999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32500000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69399999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72899999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574857,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":262144,"data_stored":108340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35799999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33700000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.62}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574857,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":266240,"data_stored":108430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30599999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45700000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45000000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]}]},{"osd":4,"up_from":13,"seq":55834574857,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":286720,"data_stored":113251,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.876}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65600000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48799999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574857,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":274432,"data_stored":110053,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.657}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.872}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54400000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71899999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32255,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32255,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":4010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-25T14:36:05.365 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-25T14:36:05.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.502+0000 7f2ac7f79700 1 Processor -- start 2023-07-25T14:36:05.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.503+0000 7f2ac7f79700 1 -- start start 2023-07-25T14:36:05.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.503+0000 7f2ac7f79700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2ac00c4930 0x7f2ac00c3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:05.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.503+0000 7f2ac7f79700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ac00c2fe0 con 0x7f2ac0151950 2023-07-25T14:36:05.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.503+0000 7f2ac7f79700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ac0155070 con 0x7f2ac00724c0 2023-07-25T14:36:05.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.503+0000 7f2ac7f79700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ac0071a60 con 0x7f2ac00c4930 2023-07-25T14:36:05.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.503+0000 7f2ac5d15700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f2ac0151950 0x7f2ac006a190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:59340/0 (socket says 172.21.15.72:59340) 2023-07-25T14:36:05.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.504+0000 7f2ac5d15700 1 -- 172.21.15.72:0/1504524697 learned_addr learned my addr 172.21.15.72:0/1504524697 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:36:05.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.504+0000 7f2ac6516700 1 --2- 172.21.15.72:0/1504524697 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2ac00c4930 0x7f2ac00c3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:05.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.504+0000 7f2ac4d13700 1 -- 172.21.15.72:0/1504524697 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1855629606 0 0) 0x7f2ac00c2fe0 con 0x7f2ac0151950 2023-07-25T14:36:05.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.504+0000 7f2ac4d13700 1 -- 172.21.15.72:0/1504524697 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2aac0035b0 con 0x7f2ac0151950 2023-07-25T14:36:05.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.504+0000 7f2ac6516700 1 -- 172.21.15.72:0/1504524697 >> v1:172.21.15.92:6789/0 conn(0x7f2ac00724c0 legacy=0x7f2ac00c34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:05.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.504+0000 7f2ac4d13700 1 -- 172.21.15.72:0/1504524697 <== mon.1 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 194778738 0 0) 0x7f2ac0155070 con 0x7f2ac00724c0 2023-07-25T14:36:05.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.504+0000 7f2ac6516700 1 -- 172.21.15.72:0/1504524697 >> v1:172.21.15.72:6789/0 conn(0x7f2ac0151950 legacy=0x7f2ac006a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:05.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.504+0000 7f2ac6516700 1 -- 172.21.15.72:0/1504524697 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ac00c15c0 con 0x7f2ac00c4930 2023-07-25T14:36:05.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.504+0000 7f2ac6516700 1 --2- 172.21.15.72:0/1504524697 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2ac00c4930 0x7f2ac00c3bd0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f2ab8009dc0 tx=0x7f2ab800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=636b02947f42ee0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:05.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.504+0000 7f2ac4d13700 1 -- 172.21.15.72:0/1504524697 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ab800e070 con 0x7f2ac00c4930 2023-07-25T14:36:05.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.504+0000 7f2ac4d13700 1 -- 172.21.15.72:0/1504524697 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ab800bb20 con 0x7f2ac00c4930 2023-07-25T14:36:05.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.504+0000 7f2ac4d13700 1 -- 172.21.15.72:0/1504524697 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ab800bed0 con 0x7f2ac00c4930 2023-07-25T14:36:05.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.505+0000 7f2ac7f79700 1 -- 172.21.15.72:0/1504524697 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2ac00c4930 msgr2=0x7f2ac00c3bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:05.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.505+0000 7f2ac7f79700 1 --2- 172.21.15.72:0/1504524697 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2ac00c4930 0x7f2ac00c3bd0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f2ab8009dc0 tx=0x7f2ab800b330 comp rx=0 tx=0).stop 2023-07-25T14:36:05.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.505+0000 7f2ac7f79700 1 -- 172.21.15.72:0/1504524697 shutdown_connections 2023-07-25T14:36:05.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.505+0000 7f2ac7f79700 1 --2- 172.21.15.72:0/1504524697 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2ac00c4930 0x7f2ac00c3bd0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:05.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.505+0000 7f2ac7f79700 1 -- 172.21.15.72:0/1504524697 >> 172.21.15.72:0/1504524697 conn(0x7f2ac00a87e0 msgr2=0x7f2ac00a8bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:05.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.505+0000 7f2ac7f79700 1 -- 172.21.15.72:0/1504524697 shutdown_connections 2023-07-25T14:36:05.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.505+0000 7f2ac7f79700 1 -- 172.21.15.72:0/1504524697 wait complete. 2023-07-25T14:36:05.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.506+0000 7f2ac7f79700 1 Processor -- start 2023-07-25T14:36:05.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.506+0000 7f2ac7f79700 1 -- start start 2023-07-25T14:36:05.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.507+0000 7f2ac7f79700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2ac00724c0 0x7f2ac0156b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:05.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.507+0000 7f2ac7f79700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2ac00c4930 0x7f2ac01539f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:05.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.507+0000 7f2ac7f79700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2ac0151950 0x7f2ac00a7bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:05.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.507+0000 7f2ac7f79700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ac01570d0 con 0x7f2ac0151950 2023-07-25T14:36:05.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.507+0000 7f2ac7f79700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ac00a7130 con 0x7f2ac00c4930 2023-07-25T14:36:05.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.507+0000 7f2ac7f79700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ac01e9f20 con 0x7f2ac00724c0 2023-07-25T14:36:05.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.507+0000 7f2ac6516700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2ac0151950 0x7f2ac00a7bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:05.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.507+0000 7f2ac6516700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2ac0151950 0x7f2ac00a7bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40378/0 (socket says 172.21.15.72:40378) 2023-07-25T14:36:05.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.507+0000 7f2ac6516700 1 -- 172.21.15.72:0/3969828035 learned_addr learned my addr 172.21.15.72:0/3969828035 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:05.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.507+0000 7f2ac5d15700 1 --2- 172.21.15.72:0/3969828035 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2ac00724c0 0x7f2ac0156b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:05.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.507+0000 7f2ac5514700 1 --2- 172.21.15.72:0/3969828035 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2ac00c4930 0x7f2ac01539f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:05.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.507+0000 7f2ac6516700 1 -- 172.21.15.72:0/3969828035 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2ac00724c0 msgr2=0x7f2ac0156b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:05.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.507+0000 7f2ac6516700 1 --2- 172.21.15.72:0/3969828035 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2ac00724c0 0x7f2ac0156b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:05.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.507+0000 7f2ac6516700 1 -- 172.21.15.72:0/3969828035 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2ac00c4930 msgr2=0x7f2ac01539f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:05.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.507+0000 7f2ac6516700 1 --2- 172.21.15.72:0/3969828035 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2ac00c4930 0x7f2ac01539f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:05.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.507+0000 7f2ac6516700 1 -- 172.21.15.72:0/3969828035 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ab8009a70 con 0x7f2ac0151950 2023-07-25T14:36:05.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.507+0000 7f2ac6516700 1 --2- 172.21.15.72:0/3969828035 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2ac0151950 0x7f2ac00a7bd0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f2ab8009f30 tx=0x7f2ab8004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:05.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.507+0000 7f2ab67fc700 1 -- 172.21.15.72:0/3969828035 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ab801b810 con 0x7f2ac0151950 2023-07-25T14:36:05.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.508+0000 7f2ab67fc700 1 -- 172.21.15.72:0/3969828035 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ab8020070 con 0x7f2ac0151950 2023-07-25T14:36:05.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.508+0000 7f2ab67fc700 1 -- 172.21.15.72:0/3969828035 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ab801bbd0 con 0x7f2ac0151950 2023-07-25T14:36:05.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.508+0000 7f2ac7f79700 1 -- 172.21.15.72:0/3969828035 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ac01ea200 con 0x7f2ac0151950 2023-07-25T14:36:05.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.508+0000 7f2ac7f79700 1 -- 172.21.15.72:0/3969828035 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ac00a76b0 con 0x7f2ac0151950 2023-07-25T14:36:05.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.508+0000 7f2ac7f79700 1 -- 172.21.15.72:0/3969828035 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ac0074270 con 0x7f2ac0151950 2023-07-25T14:36:05.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.509+0000 7f2ab67fc700 1 -- 172.21.15.72:0/3969828035 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2ab801bd30 con 0x7f2ac0151950 2023-07-25T14:36:05.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.509+0000 7f2ab67fc700 1 --2- 172.21.15.72:0/3969828035 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f2aa406ace0 0x7f2aa406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:05.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.509+0000 7f2ab67fc700 1 -- 172.21.15.72:0/3969828035 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f2ab8022070 con 0x7f2ac0151950 2023-07-25T14:36:05.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.509+0000 7f2ac5d15700 1 --2- 172.21.15.72:0/3969828035 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f2aa406ace0 0x7f2aa406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:05.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.510+0000 7f2ac5d15700 1 --2- 172.21.15.72:0/3969828035 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f2aa406ace0 0x7f2aa406d1a0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f2ab0007fd0 tx=0x7f2ab0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:05.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.514+0000 7f2ab67fc700 1 -- 172.21.15.72:0/3969828035 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f2ab8056480 con 0x7f2ac0151950 2023-07-25T14:36:05.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.696+0000 7f2ac7f79700 1 -- 172.21.15.72:0/3969828035 --> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2ac00c4110 con 0x7f2aa406ace0 2023-07-25T14:36:05.718 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.706+0000 7f2ab67fc700 1 -- 172.21.15.72:0/3969828035 <== mgr.4104 v2:172.21.15.72:6832/1171220306 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367605 (secure 0 0 0) 0x7f2ab0001d50 con 0x7f2aa406ace0 2023-07-25T14:36:05.724 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-25T14:36:05.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.709+0000 7f2ac7f79700 1 -- 172.21.15.72:0/3969828035 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f2aa406ace0 msgr2=0x7f2aa406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:05.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.709+0000 7f2ac7f79700 1 --2- 172.21.15.72:0/3969828035 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f2aa406ace0 0x7f2aa406d1a0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f2ab0007fd0 tx=0x7f2ab0009040 comp rx=0 tx=0).stop 2023-07-25T14:36:05.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.709+0000 7f2ac7f79700 1 -- 172.21.15.72:0/3969828035 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2ac0151950 msgr2=0x7f2ac00a7bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:05.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.709+0000 7f2ac7f79700 1 --2- 172.21.15.72:0/3969828035 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2ac0151950 0x7f2ac00a7bd0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f2ab8009f30 tx=0x7f2ab8004ad0 comp rx=0 tx=0).stop 2023-07-25T14:36:05.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.709+0000 7f2ac7f79700 1 -- 172.21.15.72:0/3969828035 shutdown_connections 2023-07-25T14:36:05.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.709+0000 7f2ac7f79700 1 --2- 172.21.15.72:0/3969828035 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f2aa406ace0 0x7f2aa406d1a0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:05.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.709+0000 7f2ac7f79700 1 --2- 172.21.15.72:0/3969828035 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2ac00724c0 0x7f2ac0156b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:05.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.709+0000 7f2ac7f79700 1 --2- 172.21.15.72:0/3969828035 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2ac0151950 0x7f2ac00a7bd0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:05.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.709+0000 7f2ac7f79700 1 --2- 172.21.15.72:0/3969828035 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2ac00c4930 0x7f2ac01539f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:05.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.709+0000 7f2ac7f79700 1 -- 172.21.15.72:0/3969828035 >> 172.21.15.72:0/3969828035 conn(0x7f2ac00a87e0 msgr2=0x7f2ac0150870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:05.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.710+0000 7f2ac7f79700 1 -- 172.21.15.72:0/3969828035 shutdown_connections 2023-07-25T14:36:05.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.710+0000 7f2ac7f79700 1 -- 172.21.15.72:0/3969828035 wait complete. 2023-07-25T14:36:05.731 INFO:teuthology.orchestra.run.smithi072.stderr:dumped all 2023-07-25T14:36:05.734 INFO:teuthology.orchestra.run.smithi072.stdout:{"pg_ready":true,"pg_map":{"version":35,"stamp":"2023-07-25T14:36:05.291153+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594960,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218416,"kb_used_data":2260,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754756304,"statfs":{"total":773094113280,"available":772870455296,"internally_reserved":0,"allocated":2314240,"data_stored":2061945,"data_compressed":64510,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1781,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002906"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:47.033294+0000","last_change":"2023-07-25T14:35:40.579709+0000","last_active":"2023-07-25T14:35:47.033294+0000","last_peered":"2023-07-25T14:35:47.033294+0000","last_clean":"2023-07-25T14:35:47.033294+0000","last_became_active":"2023-07-25T14:35:40.579434+0000","last_became_peered":"2023-07-25T14:35:40.579434+0000","last_unstale":"2023-07-25T14:35:47.033294+0000","last_undegraded":"2023-07-25T14:35:47.033294+0000","last_fullsized":"2023-07-25T14:35:47.033294+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T16:53:04.752134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.591767+0000","last_change":"2023-07-25T14:35:40.569410+0000","last_active":"2023-07-25T14:35:45.591767+0000","last_peered":"2023-07-25T14:35:45.591767+0000","last_clean":"2023-07-25T14:35:45.591767+0000","last_became_active":"2023-07-25T14:35:40.569117+0000","last_became_peered":"2023-07-25T14:35:40.569117+0000","last_unstale":"2023-07-25T14:35:45.591767+0000","last_undegraded":"2023-07-25T14:35:45.591767+0000","last_fullsized":"2023-07-25T14:35:45.591767+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T21:31:31.770554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.594527+0000","last_change":"2023-07-25T14:35:40.575183+0000","last_active":"2023-07-25T14:35:45.594527+0000","last_peered":"2023-07-25T14:35:45.594527+0000","last_clean":"2023-07-25T14:35:45.594527+0000","last_became_active":"2023-07-25T14:35:40.574827+0000","last_became_peered":"2023-07-25T14:35:40.574827+0000","last_unstale":"2023-07-25T14:35:45.594527+0000","last_undegraded":"2023-07-25T14:35:45.594527+0000","last_fullsized":"2023-07-25T14:35:45.594527+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T01:51:45.574143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.591232+0000","last_change":"2023-07-25T14:35:40.573336+0000","last_active":"2023-07-25T14:35:45.591232+0000","last_peered":"2023-07-25T14:35:45.591232+0000","last_clean":"2023-07-25T14:35:45.591232+0000","last_became_active":"2023-07-25T14:35:40.573034+0000","last_became_peered":"2023-07-25T14:35:40.573034+0000","last_unstale":"2023-07-25T14:35:45.591232+0000","last_undegraded":"2023-07-25T14:35:45.591232+0000","last_fullsized":"2023-07-25T14:35:45.591232+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T18:55:52.687430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:46.554959+0000","last_change":"2023-07-25T14:35:40.583811+0000","last_active":"2023-07-25T14:35:46.554959+0000","last_peered":"2023-07-25T14:35:46.554959+0000","last_clean":"2023-07-25T14:35:46.554959+0000","last_became_active":"2023-07-25T14:35:40.583515+0000","last_became_peered":"2023-07-25T14:35:40.583515+0000","last_unstale":"2023-07-25T14:35:46.554959+0000","last_undegraded":"2023-07-25T14:35:46.554959+0000","last_fullsized":"2023-07-25T14:35:46.554959+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:09:34.369879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.594150+0000","last_change":"2023-07-25T14:35:40.575186+0000","last_active":"2023-07-25T14:35:45.594150+0000","last_peered":"2023-07-25T14:35:45.594150+0000","last_clean":"2023-07-25T14:35:45.594150+0000","last_became_active":"2023-07-25T14:35:40.574889+0000","last_became_peered":"2023-07-25T14:35:40.574889+0000","last_unstale":"2023-07-25T14:35:45.594150+0000","last_undegraded":"2023-07-25T14:35:45.594150+0000","last_fullsized":"2023-07-25T14:35:45.594150+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:40:27.273006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:46.548788+0000","last_change":"2023-07-25T14:35:40.569889+0000","last_active":"2023-07-25T14:35:46.548788+0000","last_peered":"2023-07-25T14:35:46.548788+0000","last_clean":"2023-07-25T14:35:46.548788+0000","last_became_active":"2023-07-25T14:35:40.569608+0000","last_became_peered":"2023-07-25T14:35:40.569608+0000","last_unstale":"2023-07-25T14:35:46.548788+0000","last_undegraded":"2023-07-25T14:35:46.548788+0000","last_fullsized":"2023-07-25T14:35:46.548788+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T15:50:12.108725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.591268+0000","last_change":"2023-07-25T14:35:40.574254+0000","last_active":"2023-07-25T14:35:45.591268+0000","last_peered":"2023-07-25T14:35:45.591268+0000","last_clean":"2023-07-25T14:35:45.591268+0000","last_became_active":"2023-07-25T14:35:40.573341+0000","last_became_peered":"2023-07-25T14:35:40.573341+0000","last_unstale":"2023-07-25T14:35:45.591268+0000","last_undegraded":"2023-07-25T14:35:45.591268+0000","last_fullsized":"2023-07-25T14:35:45.591268+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T17:24:11.100853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:46.554711+0000","last_change":"2023-07-25T14:35:40.582969+0000","last_active":"2023-07-25T14:35:46.554711+0000","last_peered":"2023-07-25T14:35:46.554711+0000","last_clean":"2023-07-25T14:35:46.554711+0000","last_became_active":"2023-07-25T14:35:40.582686+0000","last_became_peered":"2023-07-25T14:35:40.582686+0000","last_unstale":"2023-07-25T14:35:46.554711+0000","last_undegraded":"2023-07-25T14:35:46.554711+0000","last_fullsized":"2023-07-25T14:35:46.554711+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:55:22.829223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.592271+0000","last_change":"2023-07-25T14:35:40.574207+0000","last_active":"2023-07-25T14:35:45.592271+0000","last_peered":"2023-07-25T14:35:45.592271+0000","last_clean":"2023-07-25T14:35:45.592271+0000","last_became_active":"2023-07-25T14:35:40.573926+0000","last_became_peered":"2023-07-25T14:35:40.573926+0000","last_unstale":"2023-07-25T14:35:45.592271+0000","last_undegraded":"2023-07-25T14:35:45.592271+0000","last_fullsized":"2023-07-25T14:35:45.592271+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T17:56:22.295388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.594484+0000","last_change":"2023-07-25T14:35:40.571893+0000","last_active":"2023-07-25T14:35:45.594484+0000","last_peered":"2023-07-25T14:35:45.594484+0000","last_clean":"2023-07-25T14:35:45.594484+0000","last_became_active":"2023-07-25T14:35:40.571559+0000","last_became_peered":"2023-07-25T14:35:40.571559+0000","last_unstale":"2023-07-25T14:35:45.594484+0000","last_undegraded":"2023-07-25T14:35:45.594484+0000","last_fullsized":"2023-07-25T14:35:45.594484+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T14:46:37.446654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:47.032918+0000","last_change":"2023-07-25T14:35:40.574741+0000","last_active":"2023-07-25T14:35:47.032918+0000","last_peered":"2023-07-25T14:35:47.032918+0000","last_clean":"2023-07-25T14:35:47.032918+0000","last_became_active":"2023-07-25T14:35:40.574462+0000","last_became_peered":"2023-07-25T14:35:40.574462+0000","last_unstale":"2023-07-25T14:35:47.032918+0000","last_undegraded":"2023-07-25T14:35:47.032918+0000","last_fullsized":"2023-07-25T14:35:47.032918+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T01:21:26.238044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:47.032882+0000","last_change":"2023-07-25T14:35:40.571479+0000","last_active":"2023-07-25T14:35:47.032882+0000","last_peered":"2023-07-25T14:35:47.032882+0000","last_clean":"2023-07-25T14:35:47.032882+0000","last_became_active":"2023-07-25T14:35:40.571126+0000","last_became_peered":"2023-07-25T14:35:40.571126+0000","last_unstale":"2023-07-25T14:35:47.032882+0000","last_undegraded":"2023-07-25T14:35:47.032882+0000","last_fullsized":"2023-07-25T14:35:47.032882+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T22:30:57.251961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.591494+0000","last_change":"2023-07-25T14:35:40.569982+0000","last_active":"2023-07-25T14:35:45.591494+0000","last_peered":"2023-07-25T14:35:45.591494+0000","last_clean":"2023-07-25T14:35:45.591494+0000","last_became_active":"2023-07-25T14:35:40.569644+0000","last_became_peered":"2023-07-25T14:35:40.569644+0000","last_unstale":"2023-07-25T14:35:45.591494+0000","last_undegraded":"2023-07-25T14:35:45.591494+0000","last_fullsized":"2023-07-25T14:35:45.591494+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T14:44:33.489813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:46.548596+0000","last_change":"2023-07-25T14:35:40.570367+0000","last_active":"2023-07-25T14:35:46.548596+0000","last_peered":"2023-07-25T14:35:46.548596+0000","last_clean":"2023-07-25T14:35:46.548596+0000","last_became_active":"2023-07-25T14:35:40.570106+0000","last_became_peered":"2023-07-25T14:35:40.570106+0000","last_unstale":"2023-07-25T14:35:46.548596+0000","last_undegraded":"2023-07-25T14:35:46.548596+0000","last_fullsized":"2023-07-25T14:35:46.548596+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T19:42:01.927591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.593622+0000","last_change":"2023-07-25T14:35:40.575177+0000","last_active":"2023-07-25T14:35:45.593622+0000","last_peered":"2023-07-25T14:35:45.593622+0000","last_clean":"2023-07-25T14:35:45.593622+0000","last_became_active":"2023-07-25T14:35:40.574874+0000","last_became_peered":"2023-07-25T14:35:40.574874+0000","last_unstale":"2023-07-25T14:35:45.593622+0000","last_undegraded":"2023-07-25T14:35:45.593622+0000","last_fullsized":"2023-07-25T14:35:45.593622+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T22:45:19.433847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:46.554879+0000","last_change":"2023-07-25T14:35:40.582903+0000","last_active":"2023-07-25T14:35:46.554879+0000","last_peered":"2023-07-25T14:35:46.554879+0000","last_clean":"2023-07-25T14:35:46.554879+0000","last_became_active":"2023-07-25T14:35:40.582627+0000","last_became_peered":"2023-07-25T14:35:40.582627+0000","last_unstale":"2023-07-25T14:35:46.554879+0000","last_undegraded":"2023-07-25T14:35:46.554879+0000","last_fullsized":"2023-07-25T14:35:46.554879+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T17:56:22.295388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.594691+0000","last_change":"2023-07-25T14:35:40.571572+0000","last_active":"2023-07-25T14:35:45.594691+0000","last_peered":"2023-07-25T14:35:45.594691+0000","last_clean":"2023-07-25T14:35:45.594691+0000","last_became_active":"2023-07-25T14:35:40.570802+0000","last_became_peered":"2023-07-25T14:35:40.570802+0000","last_unstale":"2023-07-25T14:35:45.594691+0000","last_undegraded":"2023-07-25T14:35:45.594691+0000","last_fullsized":"2023-07-25T14:35:45.594691+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T20:18:12.135635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:47.033091+0000","last_change":"2023-07-25T14:35:40.576638+0000","last_active":"2023-07-25T14:35:47.033091+0000","last_peered":"2023-07-25T14:35:47.033091+0000","last_clean":"2023-07-25T14:35:47.033091+0000","last_became_active":"2023-07-25T14:35:40.576359+0000","last_became_peered":"2023-07-25T14:35:40.576359+0000","last_unstale":"2023-07-25T14:35:47.033091+0000","last_undegraded":"2023-07-25T14:35:47.033091+0000","last_fullsized":"2023-07-25T14:35:47.033091+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T20:38:34.383462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.593850+0000","last_change":"2023-07-25T14:35:40.581183+0000","last_active":"2023-07-25T14:35:45.593850+0000","last_peered":"2023-07-25T14:35:45.593850+0000","last_clean":"2023-07-25T14:35:45.593850+0000","last_became_active":"2023-07-25T14:35:40.577150+0000","last_became_peered":"2023-07-25T14:35:40.577150+0000","last_unstale":"2023-07-25T14:35:45.593850+0000","last_undegraded":"2023-07-25T14:35:45.593850+0000","last_fullsized":"2023-07-25T14:35:45.593850+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T22:52:07.934045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:46.549236+0000","last_change":"2023-07-25T14:35:40.584074+0000","last_active":"2023-07-25T14:35:46.549236+0000","last_peered":"2023-07-25T14:35:46.549236+0000","last_clean":"2023-07-25T14:35:46.549236+0000","last_became_active":"2023-07-25T14:35:40.583729+0000","last_became_peered":"2023-07-25T14:35:40.583729+0000","last_unstale":"2023-07-25T14:35:46.549236+0000","last_undegraded":"2023-07-25T14:35:46.549236+0000","last_fullsized":"2023-07-25T14:35:46.549236+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:37:32.340440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:46.554400+0000","last_change":"2023-07-25T14:35:40.569049+0000","last_active":"2023-07-25T14:35:46.554400+0000","last_peered":"2023-07-25T14:35:46.554400+0000","last_clean":"2023-07-25T14:35:46.554400+0000","last_became_active":"2023-07-25T14:35:40.568749+0000","last_became_peered":"2023-07-25T14:35:40.568749+0000","last_unstale":"2023-07-25T14:35:46.554400+0000","last_undegraded":"2023-07-25T14:35:46.554400+0000","last_fullsized":"2023-07-25T14:35:46.554400+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:12:05.117844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.812807+0000","last_change":"2023-07-25T14:35:40.579628+0000","last_active":"2023-07-25T14:35:45.812807+0000","last_peered":"2023-07-25T14:35:45.812807+0000","last_clean":"2023-07-25T14:35:45.812807+0000","last_became_active":"2023-07-25T14:35:40.579163+0000","last_became_peered":"2023-07-25T14:35:40.579163+0000","last_unstale":"2023-07-25T14:35:45.812807+0000","last_undegraded":"2023-07-25T14:35:45.812807+0000","last_fullsized":"2023-07-25T14:35:45.812807+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T14:39:11.675726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:46.548669+0000","last_change":"2023-07-25T14:35:40.580196+0000","last_active":"2023-07-25T14:35:46.548669+0000","last_peered":"2023-07-25T14:35:46.548669+0000","last_clean":"2023-07-25T14:35:46.548669+0000","last_became_active":"2023-07-25T14:35:40.579875+0000","last_became_peered":"2023-07-25T14:35:40.579875+0000","last_unstale":"2023-07-25T14:35:46.548669+0000","last_undegraded":"2023-07-25T14:35:46.548669+0000","last_fullsized":"2023-07-25T14:35:46.548669+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T17:56:22.295388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:47.033370+0000","last_change":"2023-07-25T14:35:40.567264+0000","last_active":"2023-07-25T14:35:47.033370+0000","last_peered":"2023-07-25T14:35:47.033370+0000","last_clean":"2023-07-25T14:35:47.033370+0000","last_became_active":"2023-07-25T14:35:40.566933+0000","last_became_peered":"2023-07-25T14:35:40.566933+0000","last_unstale":"2023-07-25T14:35:47.033370+0000","last_undegraded":"2023-07-25T14:35:47.033370+0000","last_fullsized":"2023-07-25T14:35:47.033370+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T21:36:38.996750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:47.033405+0000","last_change":"2023-07-25T14:35:40.562595+0000","last_active":"2023-07-25T14:35:47.033405+0000","last_peered":"2023-07-25T14:35:47.033405+0000","last_clean":"2023-07-25T14:35:47.033405+0000","last_became_active":"2023-07-25T14:35:40.562281+0000","last_became_peered":"2023-07-25T14:35:40.562281+0000","last_unstale":"2023-07-25T14:35:47.033405+0000","last_undegraded":"2023-07-25T14:35:47.033405+0000","last_fullsized":"2023-07-25T14:35:47.033405+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T14:44:33.489813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.592182+0000","last_change":"2023-07-25T14:35:40.570857+0000","last_active":"2023-07-25T14:35:45.592182+0000","last_peered":"2023-07-25T14:35:45.592182+0000","last_clean":"2023-07-25T14:35:45.592182+0000","last_became_active":"2023-07-25T14:35:40.570601+0000","last_became_peered":"2023-07-25T14:35:40.570601+0000","last_unstale":"2023-07-25T14:35:45.592182+0000","last_undegraded":"2023-07-25T14:35:45.592182+0000","last_fullsized":"2023-07-25T14:35:45.592182+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:43:26.302693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.594376+0000","last_change":"2023-07-25T14:35:44.610459+0000","last_active":"2023-07-25T14:35:45.594376+0000","last_peered":"2023-07-25T14:35:45.594376+0000","last_clean":"2023-07-25T14:35:45.594376+0000","last_became_active":"2023-07-25T14:35:44.610112+0000","last_became_peered":"2023-07-25T14:35:44.610112+0000","last_unstale":"2023-07-25T14:35:45.594376+0000","last_undegraded":"2023-07-25T14:35:45.594376+0000","last_fullsized":"2023-07-25T14:35:45.594376+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_clean_scrub_stamp":"2023-07-25T14:35:43.577860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T21:11:47.831552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"20'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.593786+0000","last_change":"2023-07-25T14:35:39.539424+0000","last_active":"2023-07-25T14:35:45.593786+0000","last_peered":"2023-07-25T14:35:45.593786+0000","last_clean":"2023-07-25T14:35:45.593786+0000","last_became_active":"2023-07-25T14:35:39.539198+0000","last_became_peered":"2023-07-25T14:35:39.539198+0000","last_unstale":"2023-07-25T14:35:45.593786+0000","last_undegraded":"2023-07-25T14:35:45.593786+0000","last_fullsized":"2023-07-25T14:35:45.593786+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_clean_scrub_stamp":"2023-07-25T14:35:38.515226+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T20:19:13.284229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.813167+0000","last_change":"2023-07-25T14:35:40.571557+0000","last_active":"2023-07-25T14:35:45.813167+0000","last_peered":"2023-07-25T14:35:45.813167+0000","last_clean":"2023-07-25T14:35:45.813167+0000","last_became_active":"2023-07-25T14:35:40.571278+0000","last_became_peered":"2023-07-25T14:35:40.571278+0000","last_unstale":"2023-07-25T14:35:45.813167+0000","last_undegraded":"2023-07-25T14:35:45.813167+0000","last_fullsized":"2023-07-25T14:35:45.813167+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T17:57:59.593211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.592906+0000","last_change":"2023-07-25T14:35:44.608945+0000","last_active":"2023-07-25T14:35:45.592906+0000","last_peered":"2023-07-25T14:35:45.592906+0000","last_clean":"2023-07-25T14:35:45.592906+0000","last_became_active":"2023-07-25T14:35:44.608355+0000","last_became_peered":"2023-07-25T14:35:44.608355+0000","last_unstale":"2023-07-25T14:35:45.592906+0000","last_undegraded":"2023-07-25T14:35:45.592906+0000","last_fullsized":"2023-07-25T14:35:45.592906+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_clean_scrub_stamp":"2023-07-25T14:35:43.577860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T01:37:47.118522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:47.032243+0000","last_change":"2023-07-25T14:35:39.546003+0000","last_active":"2023-07-25T14:35:47.032243+0000","last_peered":"2023-07-25T14:35:47.032243+0000","last_clean":"2023-07-25T14:35:47.032243+0000","last_became_active":"2023-07-25T14:35:39.545724+0000","last_became_peered":"2023-07-25T14:35:39.545724+0000","last_unstale":"2023-07-25T14:35:47.032243+0000","last_undegraded":"2023-07-25T14:35:47.032243+0000","last_fullsized":"2023-07-25T14:35:47.032243+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_clean_scrub_stamp":"2023-07-25T14:35:38.515226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T17:55:30.391084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:46.554711+0000","last_change":"2023-07-25T14:35:40.570219+0000","last_active":"2023-07-25T14:35:46.554711+0000","last_peered":"2023-07-25T14:35:46.554711+0000","last_clean":"2023-07-25T14:35:46.554711+0000","last_became_active":"2023-07-25T14:35:40.569892+0000","last_became_peered":"2023-07-25T14:35:40.569892+0000","last_unstale":"2023-07-25T14:35:46.554711+0000","last_undegraded":"2023-07-25T14:35:46.554711+0000","last_fullsized":"2023-07-25T14:35:46.554711+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T17:42:33.268060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:46.554870+0000","last_change":"2023-07-25T14:35:44.617481+0000","last_active":"2023-07-25T14:35:46.554870+0000","last_peered":"2023-07-25T14:35:46.554870+0000","last_clean":"2023-07-25T14:35:46.554870+0000","last_became_active":"2023-07-25T14:35:44.616199+0000","last_became_peered":"2023-07-25T14:35:44.616199+0000","last_unstale":"2023-07-25T14:35:46.554870+0000","last_undegraded":"2023-07-25T14:35:46.554870+0000","last_fullsized":"2023-07-25T14:35:46.554870+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_clean_scrub_stamp":"2023-07-25T14:35:43.577860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T15:17:51.741356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.812854+0000","last_change":"2023-07-25T14:35:39.535284+0000","last_active":"2023-07-25T14:35:45.812854+0000","last_peered":"2023-07-25T14:35:45.812854+0000","last_clean":"2023-07-25T14:35:45.812854+0000","last_became_active":"2023-07-25T14:35:39.535009+0000","last_became_peered":"2023-07-25T14:35:39.535009+0000","last_unstale":"2023-07-25T14:35:45.812854+0000","last_undegraded":"2023-07-25T14:35:45.812854+0000","last_fullsized":"2023-07-25T14:35:45.812854+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_clean_scrub_stamp":"2023-07-25T14:35:38.515226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T01:30:24.432069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.593125+0000","last_change":"2023-07-25T14:35:40.576038+0000","last_active":"2023-07-25T14:35:45.593125+0000","last_peered":"2023-07-25T14:35:45.593125+0000","last_clean":"2023-07-25T14:35:45.593125+0000","last_became_active":"2023-07-25T14:35:40.575678+0000","last_became_peered":"2023-07-25T14:35:40.575678+0000","last_unstale":"2023-07-25T14:35:45.593125+0000","last_undegraded":"2023-07-25T14:35:45.593125+0000","last_fullsized":"2023-07-25T14:35:45.593125+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T23:32:51.759335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.592398+0000","last_change":"2023-07-25T14:35:44.613589+0000","last_active":"2023-07-25T14:35:45.592398+0000","last_peered":"2023-07-25T14:35:45.592398+0000","last_clean":"2023-07-25T14:35:45.592398+0000","last_became_active":"2023-07-25T14:35:44.613150+0000","last_became_peered":"2023-07-25T14:35:44.613150+0000","last_unstale":"2023-07-25T14:35:45.592398+0000","last_undegraded":"2023-07-25T14:35:45.592398+0000","last_fullsized":"2023-07-25T14:35:45.592398+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_clean_scrub_stamp":"2023-07-25T14:35:43.577860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T20:48:55.652351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:46.554838+0000","last_change":"2023-07-25T14:35:39.534927+0000","last_active":"2023-07-25T14:35:46.554838+0000","last_peered":"2023-07-25T14:35:46.554838+0000","last_clean":"2023-07-25T14:35:46.554838+0000","last_became_active":"2023-07-25T14:35:39.534642+0000","last_became_peered":"2023-07-25T14:35:39.534642+0000","last_unstale":"2023-07-25T14:35:46.554838+0000","last_undegraded":"2023-07-25T14:35:46.554838+0000","last_fullsized":"2023-07-25T14:35:46.554838+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_clean_scrub_stamp":"2023-07-25T14:35:38.515226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:43:25.300568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.812812+0000","last_change":"2023-07-25T14:35:40.570225+0000","last_active":"2023-07-25T14:35:45.812812+0000","last_peered":"2023-07-25T14:35:45.812812+0000","last_clean":"2023-07-25T14:35:45.812812+0000","last_became_active":"2023-07-25T14:35:40.569840+0000","last_became_peered":"2023-07-25T14:35:40.569840+0000","last_unstale":"2023-07-25T14:35:45.812812+0000","last_undegraded":"2023-07-25T14:35:45.812812+0000","last_fullsized":"2023-07-25T14:35:45.812812+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T21:39:00.919174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:46.548495+0000","last_change":"2023-07-25T14:35:44.607298+0000","last_active":"2023-07-25T14:35:46.548495+0000","last_peered":"2023-07-25T14:35:46.548495+0000","last_clean":"2023-07-25T14:35:46.548495+0000","last_became_active":"2023-07-25T14:35:44.606891+0000","last_became_peered":"2023-07-25T14:35:44.606891+0000","last_unstale":"2023-07-25T14:35:46.548495+0000","last_undegraded":"2023-07-25T14:35:46.548495+0000","last_fullsized":"2023-07-25T14:35:46.548495+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_clean_scrub_stamp":"2023-07-25T14:35:43.577860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:55:26.889732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.592326+0000","last_change":"2023-07-25T14:35:39.537294+0000","last_active":"2023-07-25T14:35:45.592326+0000","last_peered":"2023-07-25T14:35:45.592326+0000","last_clean":"2023-07-25T14:35:45.592326+0000","last_became_active":"2023-07-25T14:35:39.536993+0000","last_became_peered":"2023-07-25T14:35:39.536993+0000","last_unstale":"2023-07-25T14:35:45.592326+0000","last_undegraded":"2023-07-25T14:35:45.592326+0000","last_fullsized":"2023-07-25T14:35:45.592326+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_clean_scrub_stamp":"2023-07-25T14:35:38.515226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T15:17:46.678722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.812671+0000","last_change":"2023-07-25T14:35:40.578807+0000","last_active":"2023-07-25T14:35:45.812671+0000","last_peered":"2023-07-25T14:35:45.812671+0000","last_clean":"2023-07-25T14:35:45.812671+0000","last_became_active":"2023-07-25T14:35:40.577361+0000","last_became_peered":"2023-07-25T14:35:40.577361+0000","last_unstale":"2023-07-25T14:35:45.812671+0000","last_undegraded":"2023-07-25T14:35:45.812671+0000","last_fullsized":"2023-07-25T14:35:45.812671+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:37:32.340440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.813426+0000","last_change":"2023-07-25T14:35:44.610450+0000","last_active":"2023-07-25T14:35:45.813426+0000","last_peered":"2023-07-25T14:35:45.813426+0000","last_clean":"2023-07-25T14:35:45.813426+0000","last_became_active":"2023-07-25T14:35:44.610074+0000","last_became_peered":"2023-07-25T14:35:44.610074+0000","last_unstale":"2023-07-25T14:35:45.813426+0000","last_undegraded":"2023-07-25T14:35:45.813426+0000","last_fullsized":"2023-07-25T14:35:45.813426+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_clean_scrub_stamp":"2023-07-25T14:35:43.577860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T16:23:18.284233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"20'3","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:46.549394+0000","last_change":"2023-07-25T14:35:39.543982+0000","last_active":"2023-07-25T14:35:46.549394+0000","last_peered":"2023-07-25T14:35:46.549394+0000","last_clean":"2023-07-25T14:35:46.549394+0000","last_became_active":"2023-07-25T14:35:39.543760+0000","last_became_peered":"2023-07-25T14:35:39.543760+0000","last_unstale":"2023-07-25T14:35:46.549394+0000","last_undegraded":"2023-07-25T14:35:46.549394+0000","last_fullsized":"2023-07-25T14:35:46.549394+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_clean_scrub_stamp":"2023-07-25T14:35:38.515226+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:42:37.075884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:47.032949+0000","last_change":"2023-07-25T14:35:40.577934+0000","last_active":"2023-07-25T14:35:47.032949+0000","last_peered":"2023-07-25T14:35:47.032949+0000","last_clean":"2023-07-25T14:35:47.032949+0000","last_became_active":"2023-07-25T14:35:40.577675+0000","last_became_peered":"2023-07-25T14:35:40.577675+0000","last_unstale":"2023-07-25T14:35:47.032949+0000","last_undegraded":"2023-07-25T14:35:47.032949+0000","last_fullsized":"2023-07-25T14:35:47.032949+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T23:32:02.358536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:47.033082+0000","last_change":"2023-07-25T14:35:44.611931+0000","last_active":"2023-07-25T14:35:47.033082+0000","last_peered":"2023-07-25T14:35:47.033082+0000","last_clean":"2023-07-25T14:35:47.033082+0000","last_became_active":"2023-07-25T14:35:44.611566+0000","last_became_peered":"2023-07-25T14:35:44.611566+0000","last_unstale":"2023-07-25T14:35:47.033082+0000","last_undegraded":"2023-07-25T14:35:47.033082+0000","last_fullsized":"2023-07-25T14:35:47.033082+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_clean_scrub_stamp":"2023-07-25T14:35:43.577860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T21:16:02.383581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"25'10","reported_seq":31,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:56.894906+0000","last_change":"2023-07-25T14:35:39.537231+0000","last_active":"2023-07-25T14:35:56.894906+0000","last_peered":"2023-07-25T14:35:56.894906+0000","last_clean":"2023-07-25T14:35:56.894906+0000","last_became_active":"2023-07-25T14:35:39.536936+0000","last_became_peered":"2023-07-25T14:35:39.536936+0000","last_unstale":"2023-07-25T14:35:56.894906+0000","last_undegraded":"2023-07-25T14:35:56.894906+0000","last_fullsized":"2023-07-25T14:35:56.894906+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_clean_scrub_stamp":"2023-07-25T14:35:38.515226+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T14:38:33.447792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3794,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.594207+0000","last_change":"2023-07-25T14:35:40.581925+0000","last_active":"2023-07-25T14:35:45.594207+0000","last_peered":"2023-07-25T14:35:45.594207+0000","last_clean":"2023-07-25T14:35:45.594207+0000","last_became_active":"2023-07-25T14:35:40.581612+0000","last_became_peered":"2023-07-25T14:35:40.581612+0000","last_unstale":"2023-07-25T14:35:45.594207+0000","last_undegraded":"2023-07-25T14:35:45.594207+0000","last_fullsized":"2023-07-25T14:35:45.594207+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T21:19:54.060418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.592462+0000","last_change":"2023-07-25T14:35:44.610512+0000","last_active":"2023-07-25T14:35:45.592462+0000","last_peered":"2023-07-25T14:35:45.592462+0000","last_clean":"2023-07-25T14:35:45.592462+0000","last_became_active":"2023-07-25T14:35:44.610029+0000","last_became_peered":"2023-07-25T14:35:44.610029+0000","last_unstale":"2023-07-25T14:35:45.592462+0000","last_undegraded":"2023-07-25T14:35:45.592462+0000","last_fullsized":"2023-07-25T14:35:45.592462+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_clean_scrub_stamp":"2023-07-25T14:35:43.577860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T15:50:16.169233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:46.549117+0000","last_change":"2023-07-25T14:35:39.541876+0000","last_active":"2023-07-25T14:35:46.549117+0000","last_peered":"2023-07-25T14:35:46.549117+0000","last_clean":"2023-07-25T14:35:46.549117+0000","last_became_active":"2023-07-25T14:35:39.541630+0000","last_became_peered":"2023-07-25T14:35:39.541630+0000","last_unstale":"2023-07-25T14:35:46.549117+0000","last_undegraded":"2023-07-25T14:35:46.549117+0000","last_fullsized":"2023-07-25T14:35:46.549117+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_clean_scrub_stamp":"2023-07-25T14:35:38.515226+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T21:17:39.462457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.813224+0000","last_change":"2023-07-25T14:35:40.571048+0000","last_active":"2023-07-25T14:35:45.813224+0000","last_peered":"2023-07-25T14:35:45.813224+0000","last_clean":"2023-07-25T14:35:45.813224+0000","last_became_active":"2023-07-25T14:35:40.570758+0000","last_became_peered":"2023-07-25T14:35:40.570758+0000","last_unstale":"2023-07-25T14:35:45.813224+0000","last_undegraded":"2023-07-25T14:35:45.813224+0000","last_fullsized":"2023-07-25T14:35:45.813224+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T01:55:22.618189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.813383+0000","last_change":"2023-07-25T14:35:44.611202+0000","last_active":"2023-07-25T14:35:45.813383+0000","last_peered":"2023-07-25T14:35:45.813383+0000","last_clean":"2023-07-25T14:35:45.813383+0000","last_became_active":"2023-07-25T14:35:44.610870+0000","last_became_peered":"2023-07-25T14:35:44.610870+0000","last_unstale":"2023-07-25T14:35:45.813383+0000","last_undegraded":"2023-07-25T14:35:45.813383+0000","last_fullsized":"2023-07-25T14:35:45.813383+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_clean_scrub_stamp":"2023-07-25T14:35:43.577860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T21:04:57.404448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:46.554898+0000","last_change":"2023-07-25T14:35:39.536644+0000","last_active":"2023-07-25T14:35:46.554898+0000","last_peered":"2023-07-25T14:35:46.554898+0000","last_clean":"2023-07-25T14:35:46.554898+0000","last_became_active":"2023-07-25T14:35:39.536369+0000","last_became_peered":"2023-07-25T14:35:39.536369+0000","last_unstale":"2023-07-25T14:35:46.554898+0000","last_undegraded":"2023-07-25T14:35:46.554898+0000","last_fullsized":"2023-07-25T14:35:46.554898+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_clean_scrub_stamp":"2023-07-25T14:35:38.515226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T15:50:11.106599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.591980+0000","last_change":"2023-07-25T14:35:40.562867+0000","last_active":"2023-07-25T14:35:45.591980+0000","last_peered":"2023-07-25T14:35:45.591980+0000","last_clean":"2023-07-25T14:35:45.591980+0000","last_became_active":"2023-07-25T14:35:40.562586+0000","last_became_peered":"2023-07-25T14:35:40.562586+0000","last_unstale":"2023-07-25T14:35:45.591980+0000","last_undegraded":"2023-07-25T14:35:45.591980+0000","last_fullsized":"2023-07-25T14:35:45.591980+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T20:23:13.132615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.813522+0000","last_change":"2023-07-25T14:35:44.614158+0000","last_active":"2023-07-25T14:35:45.813522+0000","last_peered":"2023-07-25T14:35:45.813522+0000","last_clean":"2023-07-25T14:35:45.813522+0000","last_became_active":"2023-07-25T14:35:44.613814+0000","last_became_peered":"2023-07-25T14:35:44.613814+0000","last_unstale":"2023-07-25T14:35:45.813522+0000","last_undegraded":"2023-07-25T14:35:45.813522+0000","last_fullsized":"2023-07-25T14:35:45.813522+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_clean_scrub_stamp":"2023-07-25T14:35:43.577860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:03:49.133248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:46.548772+0000","last_change":"2023-07-25T14:35:39.538871+0000","last_active":"2023-07-25T14:35:46.548772+0000","last_peered":"2023-07-25T14:35:46.548772+0000","last_clean":"2023-07-25T14:35:46.548772+0000","last_became_active":"2023-07-25T14:35:39.538503+0000","last_became_peered":"2023-07-25T14:35:39.538503+0000","last_unstale":"2023-07-25T14:35:46.548772+0000","last_undegraded":"2023-07-25T14:35:46.548772+0000","last_fullsized":"2023-07-25T14:35:46.548772+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_clean_scrub_stamp":"2023-07-25T14:35:38.515226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T14:52:14.647241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:46.554998+0000","last_change":"2023-07-25T14:35:40.579376+0000","last_active":"2023-07-25T14:35:46.554998+0000","last_peered":"2023-07-25T14:35:46.554998+0000","last_clean":"2023-07-25T14:35:46.554998+0000","last_became_active":"2023-07-25T14:35:40.579086+0000","last_became_peered":"2023-07-25T14:35:40.579086+0000","last_unstale":"2023-07-25T14:35:46.554998+0000","last_undegraded":"2023-07-25T14:35:46.554998+0000","last_fullsized":"2023-07-25T14:35:46.554998+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T14:52:15.649366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.591678+0000","last_change":"2023-07-25T14:35:44.610005+0000","last_active":"2023-07-25T14:35:45.591678+0000","last_peered":"2023-07-25T14:35:45.591678+0000","last_clean":"2023-07-25T14:35:45.591678+0000","last_became_active":"2023-07-25T14:35:44.609602+0000","last_became_peered":"2023-07-25T14:35:44.609602+0000","last_unstale":"2023-07-25T14:35:45.591678+0000","last_undegraded":"2023-07-25T14:35:45.591678+0000","last_fullsized":"2023-07-25T14:35:45.591678+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_clean_scrub_stamp":"2023-07-25T14:35:43.577860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:12:09.178353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"20'8","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.591599+0000","last_change":"2023-07-25T14:35:39.537282+0000","last_active":"2023-07-25T14:35:45.591599+0000","last_peered":"2023-07-25T14:35:45.591599+0000","last_clean":"2023-07-25T14:35:45.591599+0000","last_became_active":"2023-07-25T14:35:39.537001+0000","last_became_peered":"2023-07-25T14:35:39.537001+0000","last_unstale":"2023-07-25T14:35:45.591599+0000","last_undegraded":"2023-07-25T14:35:45.591599+0000","last_fullsized":"2023-07-25T14:35:45.591599+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_clean_scrub_stamp":"2023-07-25T14:35:38.515226+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T22:11:24.268503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.813644+0000","last_change":"2023-07-25T14:35:40.582310+0000","last_active":"2023-07-25T14:35:45.813644+0000","last_peered":"2023-07-25T14:35:45.813644+0000","last_clean":"2023-07-25T14:35:45.813644+0000","last_became_active":"2023-07-25T14:35:40.581913+0000","last_became_peered":"2023-07-25T14:35:40.581913+0000","last_unstale":"2023-07-25T14:35:45.813644+0000","last_undegraded":"2023-07-25T14:35:45.813644+0000","last_fullsized":"2023-07-25T14:35:45.813644+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T21:29:36.633963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:46.549014+0000","last_change":"2023-07-25T14:35:44.609817+0000","last_active":"2023-07-25T14:35:46.549014+0000","last_peered":"2023-07-25T14:35:46.549014+0000","last_clean":"2023-07-25T14:35:46.549014+0000","last_became_active":"2023-07-25T14:35:44.608964+0000","last_became_peered":"2023-07-25T14:35:44.608964+0000","last_unstale":"2023-07-25T14:35:46.549014+0000","last_undegraded":"2023-07-25T14:35:46.549014+0000","last_fullsized":"2023-07-25T14:35:46.549014+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_clean_scrub_stamp":"2023-07-25T14:35:43.577860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T17:08:37.225551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"20'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:46.549184+0000","last_change":"2023-07-25T14:35:39.540328+0000","last_active":"2023-07-25T14:35:46.549184+0000","last_peered":"2023-07-25T14:35:46.549184+0000","last_clean":"2023-07-25T14:35:46.549184+0000","last_became_active":"2023-07-25T14:35:39.540044+0000","last_became_peered":"2023-07-25T14:35:39.540044+0000","last_unstale":"2023-07-25T14:35:46.549184+0000","last_undegraded":"2023-07-25T14:35:46.549184+0000","last_fullsized":"2023-07-25T14:35:46.549184+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_clean_scrub_stamp":"2023-07-25T14:35:38.515226+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:24:56.192863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.591126+0000","last_change":"2023-07-25T14:35:40.566443+0000","last_active":"2023-07-25T14:35:45.591126+0000","last_peered":"2023-07-25T14:35:45.591126+0000","last_clean":"2023-07-25T14:35:45.591126+0000","last_became_active":"2023-07-25T14:35:40.566162+0000","last_became_peered":"2023-07-25T14:35:40.566162+0000","last_unstale":"2023-07-25T14:35:45.591126+0000","last_undegraded":"2023-07-25T14:35:45.591126+0000","last_fullsized":"2023-07-25T14:35:45.591126+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:14:11.945159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:47.032573+0000","last_change":"2023-07-25T14:35:44.615276+0000","last_active":"2023-07-25T14:35:47.032573+0000","last_peered":"2023-07-25T14:35:47.032573+0000","last_clean":"2023-07-25T14:35:47.032573+0000","last_became_active":"2023-07-25T14:35:44.614935+0000","last_became_peered":"2023-07-25T14:35:44.614935+0000","last_unstale":"2023-07-25T14:35:47.032573+0000","last_undegraded":"2023-07-25T14:35:47.032573+0000","last_fullsized":"2023-07-25T14:35:47.032573+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_clean_scrub_stamp":"2023-07-25T14:35:43.577860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T19:32:58.526454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:46.549428+0000","last_change":"2023-07-25T14:35:39.538857+0000","last_active":"2023-07-25T14:35:46.549428+0000","last_peered":"2023-07-25T14:35:46.549428+0000","last_clean":"2023-07-25T14:35:46.549428+0000","last_became_active":"2023-07-25T14:35:39.538533+0000","last_became_peered":"2023-07-25T14:35:39.538533+0000","last_unstale":"2023-07-25T14:35:46.549428+0000","last_undegraded":"2023-07-25T14:35:46.549428+0000","last_fullsized":"2023-07-25T14:35:46.549428+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_clean_scrub_stamp":"2023-07-25T14:35:38.515226+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T23:06:55.013283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.593610+0000","last_change":"2023-07-25T14:35:40.571933+0000","last_active":"2023-07-25T14:35:45.593610+0000","last_peered":"2023-07-25T14:35:45.593610+0000","last_clean":"2023-07-25T14:35:45.593610+0000","last_became_active":"2023-07-25T14:35:40.570814+0000","last_became_peered":"2023-07-25T14:35:40.570814+0000","last_unstale":"2023-07-25T14:35:45.593610+0000","last_undegraded":"2023-07-25T14:35:45.593610+0000","last_fullsized":"2023-07-25T14:35:45.593610+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T22:11:31.858060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:47.032762+0000","last_change":"2023-07-25T14:35:44.606624+0000","last_active":"2023-07-25T14:35:47.032762+0000","last_peered":"2023-07-25T14:35:47.032762+0000","last_clean":"2023-07-25T14:35:47.032762+0000","last_became_active":"2023-07-25T14:35:44.606139+0000","last_became_peered":"2023-07-25T14:35:44.606139+0000","last_unstale":"2023-07-25T14:35:47.032762+0000","last_undegraded":"2023-07-25T14:35:47.032762+0000","last_fullsized":"2023-07-25T14:35:47.032762+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_clean_scrub_stamp":"2023-07-25T14:35:43.577860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T01:22:16.213854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"20'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:46.549292+0000","last_change":"2023-07-25T14:35:39.536361+0000","last_active":"2023-07-25T14:35:46.549292+0000","last_peered":"2023-07-25T14:35:46.549292+0000","last_clean":"2023-07-25T14:35:46.549292+0000","last_became_active":"2023-07-25T14:35:39.536071+0000","last_became_peered":"2023-07-25T14:35:39.536071+0000","last_unstale":"2023-07-25T14:35:46.549292+0000","last_undegraded":"2023-07-25T14:35:46.549292+0000","last_fullsized":"2023-07-25T14:35:46.549292+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_clean_scrub_stamp":"2023-07-25T14:35:38.515226+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T18:51:17.455450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.590781+0000","last_change":"2023-07-25T14:35:40.569105+0000","last_active":"2023-07-25T14:35:45.590781+0000","last_peered":"2023-07-25T14:35:45.590781+0000","last_clean":"2023-07-25T14:35:45.590781+0000","last_became_active":"2023-07-25T14:35:40.568843+0000","last_became_peered":"2023-07-25T14:35:40.568843+0000","last_unstale":"2023-07-25T14:35:45.590781+0000","last_undegraded":"2023-07-25T14:35:45.590781+0000","last_fullsized":"2023-07-25T14:35:45.590781+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T23:38:20.059103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:47.032831+0000","last_change":"2023-07-25T14:35:44.611780+0000","last_active":"2023-07-25T14:35:47.032831+0000","last_peered":"2023-07-25T14:35:47.032831+0000","last_clean":"2023-07-25T14:35:47.032831+0000","last_became_active":"2023-07-25T14:35:44.606160+0000","last_became_peered":"2023-07-25T14:35:44.606160+0000","last_unstale":"2023-07-25T14:35:47.032831+0000","last_undegraded":"2023-07-25T14:35:47.032831+0000","last_fullsized":"2023-07-25T14:35:47.032831+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_clean_scrub_stamp":"2023-07-25T14:35:43.577860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T15:47:56.186166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.592846+0000","last_change":"2023-07-25T14:35:39.543540+0000","last_active":"2023-07-25T14:35:45.592846+0000","last_peered":"2023-07-25T14:35:45.592846+0000","last_clean":"2023-07-25T14:35:45.592846+0000","last_became_active":"2023-07-25T14:35:39.543276+0000","last_became_peered":"2023-07-25T14:35:39.543276+0000","last_unstale":"2023-07-25T14:35:45.592846+0000","last_undegraded":"2023-07-25T14:35:45.592846+0000","last_fullsized":"2023-07-25T14:35:45.592846+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_clean_scrub_stamp":"2023-07-25T14:35:38.515226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T14:52:14.647241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:46.555100+0000","last_change":"2023-07-25T14:35:40.571035+0000","last_active":"2023-07-25T14:35:46.555100+0000","last_peered":"2023-07-25T14:35:46.555100+0000","last_clean":"2023-07-25T14:35:46.555100+0000","last_became_active":"2023-07-25T14:35:40.570770+0000","last_became_peered":"2023-07-25T14:35:40.570770+0000","last_unstale":"2023-07-25T14:35:46.555100+0000","last_undegraded":"2023-07-25T14:35:46.555100+0000","last_fullsized":"2023-07-25T14:35:46.555100+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T19:57:14.056118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:47.032847+0000","last_change":"2023-07-25T14:35:44.608600+0000","last_active":"2023-07-25T14:35:47.032847+0000","last_peered":"2023-07-25T14:35:47.032847+0000","last_clean":"2023-07-25T14:35:47.032847+0000","last_became_active":"2023-07-25T14:35:44.606326+0000","last_became_peered":"2023-07-25T14:35:44.606326+0000","last_unstale":"2023-07-25T14:35:47.032847+0000","last_undegraded":"2023-07-25T14:35:47.032847+0000","last_fullsized":"2023-07-25T14:35:47.032847+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_clean_scrub_stamp":"2023-07-25T14:35:43.577860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T16:02:38.366335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.813032+0000","last_change":"2023-07-25T14:35:39.540008+0000","last_active":"2023-07-25T14:35:45.813032+0000","last_peered":"2023-07-25T14:35:45.813032+0000","last_clean":"2023-07-25T14:35:45.813032+0000","last_became_active":"2023-07-25T14:35:39.539753+0000","last_became_peered":"2023-07-25T14:35:39.539753+0000","last_unstale":"2023-07-25T14:35:45.813032+0000","last_undegraded":"2023-07-25T14:35:45.813032+0000","last_fullsized":"2023-07-25T14:35:45.813032+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_clean_scrub_stamp":"2023-07-25T14:35:38.515226+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T16:18:56.015550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.593664+0000","last_change":"2023-07-25T14:35:40.573373+0000","last_active":"2023-07-25T14:35:45.593664+0000","last_peered":"2023-07-25T14:35:45.593664+0000","last_clean":"2023-07-25T14:35:45.593664+0000","last_became_active":"2023-07-25T14:35:40.569647+0000","last_became_peered":"2023-07-25T14:35:40.569647+0000","last_unstale":"2023-07-25T14:35:45.593664+0000","last_undegraded":"2023-07-25T14:35:45.593664+0000","last_fullsized":"2023-07-25T14:35:45.593664+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T23:26:04.449433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:47.033427+0000","last_change":"2023-07-25T14:35:44.610221+0000","last_active":"2023-07-25T14:35:47.033427+0000","last_peered":"2023-07-25T14:35:47.033427+0000","last_clean":"2023-07-25T14:35:47.033427+0000","last_became_active":"2023-07-25T14:35:44.609802+0000","last_became_peered":"2023-07-25T14:35:44.609802+0000","last_unstale":"2023-07-25T14:35:47.033427+0000","last_undegraded":"2023-07-25T14:35:47.033427+0000","last_fullsized":"2023-07-25T14:35:47.033427+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_clean_scrub_stamp":"2023-07-25T14:35:43.577860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:12:09.178353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.590976+0000","last_change":"2023-07-25T14:35:39.542216+0000","last_active":"2023-07-25T14:35:45.590976+0000","last_peered":"2023-07-25T14:35:45.590976+0000","last_clean":"2023-07-25T14:35:45.590976+0000","last_became_active":"2023-07-25T14:35:39.541786+0000","last_became_peered":"2023-07-25T14:35:39.541786+0000","last_unstale":"2023-07-25T14:35:45.590976+0000","last_undegraded":"2023-07-25T14:35:45.590976+0000","last_fullsized":"2023-07-25T14:35:45.590976+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_clean_scrub_stamp":"2023-07-25T14:35:38.515226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T21:48:28.076390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.594037+0000","last_change":"2023-07-25T14:35:40.572398+0000","last_active":"2023-07-25T14:35:45.594037+0000","last_peered":"2023-07-25T14:35:45.594037+0000","last_clean":"2023-07-25T14:35:45.594037+0000","last_became_active":"2023-07-25T14:35:40.572184+0000","last_became_peered":"2023-07-25T14:35:40.572184+0000","last_unstale":"2023-07-25T14:35:45.594037+0000","last_undegraded":"2023-07-25T14:35:45.594037+0000","last_fullsized":"2023-07-25T14:35:45.594037+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T20:41:25.611682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.592232+0000","last_change":"2023-07-25T14:35:44.608573+0000","last_active":"2023-07-25T14:35:45.592232+0000","last_peered":"2023-07-25T14:35:45.592232+0000","last_clean":"2023-07-25T14:35:45.592232+0000","last_became_active":"2023-07-25T14:35:44.608195+0000","last_became_peered":"2023-07-25T14:35:44.608195+0000","last_unstale":"2023-07-25T14:35:45.592232+0000","last_undegraded":"2023-07-25T14:35:45.592232+0000","last_fullsized":"2023-07-25T14:35:45.592232+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_clean_scrub_stamp":"2023-07-25T14:35:43.577860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T19:42:05.988099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.593367+0000","last_change":"2023-07-25T14:35:39.534458+0000","last_active":"2023-07-25T14:35:45.593367+0000","last_peered":"2023-07-25T14:35:45.593367+0000","last_clean":"2023-07-25T14:35:45.593367+0000","last_became_active":"2023-07-25T14:35:39.534185+0000","last_became_peered":"2023-07-25T14:35:39.534185+0000","last_unstale":"2023-07-25T14:35:45.593367+0000","last_undegraded":"2023-07-25T14:35:45.593367+0000","last_fullsized":"2023-07-25T14:35:45.593367+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_clean_scrub_stamp":"2023-07-25T14:35:38.515226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T16:23:13.221599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.594751+0000","last_change":"2023-07-25T14:35:40.577364+0000","last_active":"2023-07-25T14:35:45.594751+0000","last_peered":"2023-07-25T14:35:45.594751+0000","last_clean":"2023-07-25T14:35:45.594751+0000","last_became_active":"2023-07-25T14:35:40.577048+0000","last_became_peered":"2023-07-25T14:35:40.577048+0000","last_unstale":"2023-07-25T14:35:45.594751+0000","last_undegraded":"2023-07-25T14:35:45.594751+0000","last_fullsized":"2023-07-25T14:35:45.594751+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T15:35:25.781647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.594516+0000","last_change":"2023-07-25T14:35:44.605512+0000","last_active":"2023-07-25T14:35:45.594516+0000","last_peered":"2023-07-25T14:35:45.594516+0000","last_clean":"2023-07-25T14:35:45.594516+0000","last_became_active":"2023-07-25T14:35:44.605134+0000","last_became_peered":"2023-07-25T14:35:44.605134+0000","last_unstale":"2023-07-25T14:35:45.594516+0000","last_undegraded":"2023-07-25T14:35:45.594516+0000","last_fullsized":"2023-07-25T14:35:45.594516+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_clean_scrub_stamp":"2023-07-25T14:35:43.577860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T21:23:30.279301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.812760+0000","last_change":"2023-07-25T14:35:39.540299+0000","last_active":"2023-07-25T14:35:45.812760+0000","last_peered":"2023-07-25T14:35:45.812760+0000","last_clean":"2023-07-25T14:35:45.812760+0000","last_became_active":"2023-07-25T14:35:39.540013+0000","last_became_peered":"2023-07-25T14:35:39.540013+0000","last_unstale":"2023-07-25T14:35:45.812760+0000","last_undegraded":"2023-07-25T14:35:45.812760+0000","last_fullsized":"2023-07-25T14:35:45.812760+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_clean_scrub_stamp":"2023-07-25T14:35:38.515226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:42:37.075884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:47.033534+0000","last_change":"2023-07-25T14:35:40.580966+0000","last_active":"2023-07-25T14:35:47.033534+0000","last_peered":"2023-07-25T14:35:47.033534+0000","last_clean":"2023-07-25T14:35:47.033534+0000","last_became_active":"2023-07-25T14:35:40.580713+0000","last_became_peered":"2023-07-25T14:35:40.580713+0000","last_unstale":"2023-07-25T14:35:47.033534+0000","last_undegraded":"2023-07-25T14:35:47.033534+0000","last_fullsized":"2023-07-25T14:35:47.033534+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T17:42:33.268060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.593698+0000","last_change":"2023-07-25T14:35:44.608905+0000","last_active":"2023-07-25T14:35:45.593698+0000","last_peered":"2023-07-25T14:35:45.593698+0000","last_clean":"2023-07-25T14:35:45.593698+0000","last_became_active":"2023-07-25T14:35:44.608522+0000","last_became_peered":"2023-07-25T14:35:44.608522+0000","last_unstale":"2023-07-25T14:35:45.593698+0000","last_undegraded":"2023-07-25T14:35:45.593698+0000","last_fullsized":"2023-07-25T14:35:45.593698+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_clean_scrub_stamp":"2023-07-25T14:35:43.577860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T22:11:48.857968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.813615+0000","last_change":"2023-07-25T14:35:39.543373+0000","last_active":"2023-07-25T14:35:45.813615+0000","last_peered":"2023-07-25T14:35:45.813615+0000","last_clean":"2023-07-25T14:35:45.813615+0000","last_became_active":"2023-07-25T14:35:39.542998+0000","last_became_peered":"2023-07-25T14:35:39.542998+0000","last_unstale":"2023-07-25T14:35:45.813615+0000","last_undegraded":"2023-07-25T14:35:45.813615+0000","last_fullsized":"2023-07-25T14:35:45.813615+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_clean_scrub_stamp":"2023-07-25T14:35:38.515226+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T19:24:35.653665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.594297+0000","last_change":"2023-07-25T14:35:34.371347+0000","last_active":"2023-07-25T14:35:45.594297+0000","last_peered":"2023-07-25T14:35:45.594297+0000","last_clean":"2023-07-25T14:35:45.594297+0000","last_became_active":"2023-07-25T14:35:34.371044+0000","last_became_peered":"2023-07-25T14:35:34.371044+0000","last_unstale":"2023-07-25T14:35:45.594297+0000","last_undegraded":"2023-07-25T14:35:45.594297+0000","last_fullsized":"2023-07-25T14:35:45.594297+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_clean_scrub_stamp":"2023-07-25T14:35:33.358525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T18:48:18.013494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.812672+0000","last_change":"2023-07-25T14:35:40.570033+0000","last_active":"2023-07-25T14:35:45.812672+0000","last_peered":"2023-07-25T14:35:45.812672+0000","last_clean":"2023-07-25T14:35:45.812672+0000","last_became_active":"2023-07-25T14:35:40.569434+0000","last_became_peered":"2023-07-25T14:35:40.569434+0000","last_unstale":"2023-07-25T14:35:45.812672+0000","last_undegraded":"2023-07-25T14:35:45.812672+0000","last_fullsized":"2023-07-25T14:35:45.812672+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T18:51:18.457575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.812670+0000","last_change":"2023-07-25T14:35:44.609023+0000","last_active":"2023-07-25T14:35:45.812670+0000","last_peered":"2023-07-25T14:35:45.812670+0000","last_clean":"2023-07-25T14:35:45.812670+0000","last_became_active":"2023-07-25T14:35:44.608633+0000","last_became_peered":"2023-07-25T14:35:44.608633+0000","last_unstale":"2023-07-25T14:35:45.812670+0000","last_undegraded":"2023-07-25T14:35:45.812670+0000","last_fullsized":"2023-07-25T14:35:45.812670+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_clean_scrub_stamp":"2023-07-25T14:35:43.577860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:25:01.255497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.813164+0000","last_change":"2023-07-25T14:35:34.371737+0000","last_active":"2023-07-25T14:35:45.813164+0000","last_peered":"2023-07-25T14:35:45.813164+0000","last_clean":"2023-07-25T14:35:45.813164+0000","last_became_active":"2023-07-25T14:35:34.371411+0000","last_became_peered":"2023-07-25T14:35:34.371411+0000","last_unstale":"2023-07-25T14:35:45.813164+0000","last_undegraded":"2023-07-25T14:35:45.813164+0000","last_fullsized":"2023-07-25T14:35:45.813164+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_clean_scrub_stamp":"2023-07-25T14:35:33.358525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T23:20:13.045467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"23'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:46.554714+0000","last_change":"2023-07-25T14:35:39.539692+0000","last_active":"2023-07-25T14:35:46.554714+0000","last_peered":"2023-07-25T14:35:46.554714+0000","last_clean":"2023-07-25T14:35:46.554714+0000","last_became_active":"2023-07-25T14:35:39.539376+0000","last_became_peered":"2023-07-25T14:35:39.539376+0000","last_unstale":"2023-07-25T14:35:46.554714+0000","last_undegraded":"2023-07-25T14:35:46.554714+0000","last_fullsized":"2023-07-25T14:35:46.554714+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_clean_scrub_stamp":"2023-07-25T14:35:38.515226+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T17:03:30.120782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.593423+0000","last_change":"2023-07-25T14:35:40.572322+0000","last_active":"2023-07-25T14:35:45.593423+0000","last_peered":"2023-07-25T14:35:45.593423+0000","last_clean":"2023-07-25T14:35:45.593423+0000","last_became_active":"2023-07-25T14:35:40.571140+0000","last_became_peered":"2023-07-25T14:35:40.571140+0000","last_unstale":"2023-07-25T14:35:45.593423+0000","last_undegraded":"2023-07-25T14:35:45.593423+0000","last_fullsized":"2023-07-25T14:35:45.593423+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:03:45.072739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.591989+0000","last_change":"2023-07-25T14:35:44.611488+0000","last_active":"2023-07-25T14:35:45.591989+0000","last_peered":"2023-07-25T14:35:45.591989+0000","last_clean":"2023-07-25T14:35:45.591989+0000","last_became_active":"2023-07-25T14:35:44.610632+0000","last_became_peered":"2023-07-25T14:35:44.610632+0000","last_unstale":"2023-07-25T14:35:45.591989+0000","last_undegraded":"2023-07-25T14:35:45.591989+0000","last_fullsized":"2023-07-25T14:35:45.591989+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_clean_scrub_stamp":"2023-07-25T14:35:43.577860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T17:03:35.183416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:47.032770+0000","last_change":"2023-07-25T14:35:34.370121+0000","last_active":"2023-07-25T14:35:47.032770+0000","last_peered":"2023-07-25T14:35:47.032770+0000","last_clean":"2023-07-25T14:35:47.032770+0000","last_became_active":"2023-07-25T14:35:34.369795+0000","last_became_peered":"2023-07-25T14:35:34.369795+0000","last_unstale":"2023-07-25T14:35:47.032770+0000","last_undegraded":"2023-07-25T14:35:47.032770+0000","last_fullsized":"2023-07-25T14:35:47.032770+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_clean_scrub_stamp":"2023-07-25T14:35:33.358525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T22:23:26.576696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":177,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:46.548822+0000","last_change":"2023-07-25T14:35:34.372381+0000","last_active":"2023-07-25T14:35:46.548822+0000","last_peered":"2023-07-25T14:35:46.548822+0000","last_clean":"2023-07-25T14:35:46.548822+0000","last_became_active":"2023-07-25T14:35:34.371110+0000","last_became_peered":"2023-07-25T14:35:34.371110+0000","last_unstale":"2023-07-25T14:35:46.548822+0000","last_undegraded":"2023-07-25T14:35:46.548822+0000","last_fullsized":"2023-07-25T14:35:46.548822+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_clean_scrub_stamp":"2023-07-25T14:35:33.358525+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:20:22.063773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:46.554511+0000","last_change":"2023-07-25T14:35:39.541815+0000","last_active":"2023-07-25T14:35:46.554511+0000","last_peered":"2023-07-25T14:35:46.554511+0000","last_clean":"2023-07-25T14:35:46.554511+0000","last_became_active":"2023-07-25T14:35:39.541600+0000","last_became_peered":"2023-07-25T14:35:39.541600+0000","last_unstale":"2023-07-25T14:35:46.554511+0000","last_undegraded":"2023-07-25T14:35:46.554511+0000","last_fullsized":"2023-07-25T14:35:46.554511+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_clean_scrub_stamp":"2023-07-25T14:35:38.515226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T21:31:30.768429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:46.554954+0000","last_change":"2023-07-25T14:35:40.572449+0000","last_active":"2023-07-25T14:35:46.554954+0000","last_peered":"2023-07-25T14:35:46.554954+0000","last_clean":"2023-07-25T14:35:46.554954+0000","last_became_active":"2023-07-25T14:35:40.572096+0000","last_became_peered":"2023-07-25T14:35:40.572096+0000","last_unstale":"2023-07-25T14:35:46.554954+0000","last_undegraded":"2023-07-25T14:35:46.554954+0000","last_fullsized":"2023-07-25T14:35:46.554954+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:20:28.222599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:47.033330+0000","last_change":"2023-07-25T14:35:44.612010+0000","last_active":"2023-07-25T14:35:47.033330+0000","last_peered":"2023-07-25T14:35:47.033330+0000","last_clean":"2023-07-25T14:35:47.033330+0000","last_became_active":"2023-07-25T14:35:44.611576+0000","last_became_peered":"2023-07-25T14:35:44.611576+0000","last_unstale":"2023-07-25T14:35:47.033330+0000","last_undegraded":"2023-07-25T14:35:47.033330+0000","last_fullsized":"2023-07-25T14:35:47.033330+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_clean_scrub_stamp":"2023-07-25T14:35:43.577860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T20:58:23.211755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:46.548801+0000","last_change":"2023-07-25T14:35:35.321448+0000","last_active":"2023-07-25T14:35:46.548801+0000","last_peered":"2023-07-25T14:35:46.548801+0000","last_clean":"2023-07-25T14:35:46.548801+0000","last_became_active":"2023-07-25T14:35:35.320830+0000","last_became_peered":"2023-07-25T14:35:35.320830+0000","last_unstale":"2023-07-25T14:35:46.548801+0000","last_undegraded":"2023-07-25T14:35:46.548801+0000","last_fullsized":"2023-07-25T14:35:46.548801+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_clean_scrub_stamp":"2023-07-25T14:35:33.358525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:09:28.211053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:47.032318+0000","last_change":"2023-07-25T14:35:39.536830+0000","last_active":"2023-07-25T14:35:47.032318+0000","last_peered":"2023-07-25T14:35:47.032318+0000","last_clean":"2023-07-25T14:35:47.032318+0000","last_became_active":"2023-07-25T14:35:39.536580+0000","last_became_peered":"2023-07-25T14:35:39.536580+0000","last_unstale":"2023-07-25T14:35:47.032318+0000","last_undegraded":"2023-07-25T14:35:47.032318+0000","last_fullsized":"2023-07-25T14:35:47.032318+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_clean_scrub_stamp":"2023-07-25T14:35:38.515226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T14:53:19.398227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:47.033471+0000","last_change":"2023-07-25T14:35:40.574429+0000","last_active":"2023-07-25T14:35:47.033471+0000","last_peered":"2023-07-25T14:35:47.033471+0000","last_clean":"2023-07-25T14:35:47.033471+0000","last_became_active":"2023-07-25T14:35:40.574108+0000","last_became_peered":"2023-07-25T14:35:40.574108+0000","last_unstale":"2023-07-25T14:35:47.033471+0000","last_undegraded":"2023-07-25T14:35:47.033471+0000","last_fullsized":"2023-07-25T14:35:47.033471+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T21:31:31.770554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:46.549141+0000","last_change":"2023-07-25T14:35:44.613889+0000","last_active":"2023-07-25T14:35:46.549141+0000","last_peered":"2023-07-25T14:35:46.549141+0000","last_clean":"2023-07-25T14:35:46.549141+0000","last_became_active":"2023-07-25T14:35:44.613279+0000","last_became_peered":"2023-07-25T14:35:44.613279+0000","last_unstale":"2023-07-25T14:35:46.549141+0000","last_undegraded":"2023-07-25T14:35:46.549141+0000","last_fullsized":"2023-07-25T14:35:46.549141+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_clean_scrub_stamp":"2023-07-25T14:35:43.577860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T19:57:18.116626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:46.548653+0000","last_change":"2023-07-25T14:35:35.321201+0000","last_active":"2023-07-25T14:35:46.548653+0000","last_peered":"2023-07-25T14:35:46.548653+0000","last_clean":"2023-07-25T14:35:46.548653+0000","last_became_active":"2023-07-25T14:35:35.320728+0000","last_became_peered":"2023-07-25T14:35:35.320728+0000","last_unstale":"2023-07-25T14:35:46.548653+0000","last_undegraded":"2023-07-25T14:35:46.548653+0000","last_fullsized":"2023-07-25T14:35:46.548653+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_clean_scrub_stamp":"2023-07-25T14:35:33.358525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:43:20.143867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.812837+0000","last_change":"2023-07-25T14:35:39.540111+0000","last_active":"2023-07-25T14:35:45.812837+0000","last_peered":"2023-07-25T14:35:45.812837+0000","last_clean":"2023-07-25T14:35:45.812837+0000","last_became_active":"2023-07-25T14:35:39.539829+0000","last_became_peered":"2023-07-25T14:35:39.539829+0000","last_unstale":"2023-07-25T14:35:45.812837+0000","last_undegraded":"2023-07-25T14:35:45.812837+0000","last_fullsized":"2023-07-25T14:35:45.812837+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_clean_scrub_stamp":"2023-07-25T14:35:38.515226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T20:10:32.190837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.591417+0000","last_change":"2023-07-25T14:35:40.572819+0000","last_active":"2023-07-25T14:35:45.591417+0000","last_peered":"2023-07-25T14:35:45.591417+0000","last_clean":"2023-07-25T14:35:45.591417+0000","last_became_active":"2023-07-25T14:35:40.572460+0000","last_became_peered":"2023-07-25T14:35:40.572460+0000","last_unstale":"2023-07-25T14:35:45.591417+0000","last_undegraded":"2023-07-25T14:35:45.591417+0000","last_fullsized":"2023-07-25T14:35:45.591417+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T19:36:38.983536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:46.554722+0000","last_change":"2023-07-25T14:35:44.617264+0000","last_active":"2023-07-25T14:35:46.554722+0000","last_peered":"2023-07-25T14:35:46.554722+0000","last_clean":"2023-07-25T14:35:46.554722+0000","last_became_active":"2023-07-25T14:35:44.616864+0000","last_became_peered":"2023-07-25T14:35:44.616864+0000","last_unstale":"2023-07-25T14:35:46.554722+0000","last_undegraded":"2023-07-25T14:35:46.554722+0000","last_fullsized":"2023-07-25T14:35:46.554722+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_clean_scrub_stamp":"2023-07-25T14:35:43.577860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T20:23:17.193123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.592094+0000","last_change":"2023-07-25T14:35:35.321057+0000","last_active":"2023-07-25T14:35:45.592094+0000","last_peered":"2023-07-25T14:35:45.592094+0000","last_clean":"2023-07-25T14:35:45.592094+0000","last_became_active":"2023-07-25T14:35:35.320751+0000","last_became_peered":"2023-07-25T14:35:35.320751+0000","last_unstale":"2023-07-25T14:35:45.592094+0000","last_undegraded":"2023-07-25T14:35:45.592094+0000","last_fullsized":"2023-07-25T14:35:45.592094+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_clean_scrub_stamp":"2023-07-25T14:35:33.358525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:55:16.670397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.593801+0000","last_change":"2023-07-25T14:35:39.535048+0000","last_active":"2023-07-25T14:35:45.593801+0000","last_peered":"2023-07-25T14:35:45.593801+0000","last_clean":"2023-07-25T14:35:45.593801+0000","last_became_active":"2023-07-25T14:35:39.534749+0000","last_became_peered":"2023-07-25T14:35:39.534749+0000","last_unstale":"2023-07-25T14:35:45.593801+0000","last_undegraded":"2023-07-25T14:35:45.593801+0000","last_fullsized":"2023-07-25T14:35:45.593801+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_clean_scrub_stamp":"2023-07-25T14:35:38.515226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T19:56:32.500581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:47.032972+0000","last_change":"2023-07-25T14:35:40.562358+0000","last_active":"2023-07-25T14:35:47.032972+0000","last_peered":"2023-07-25T14:35:47.032972+0000","last_clean":"2023-07-25T14:35:47.032972+0000","last_became_active":"2023-07-25T14:35:40.562072+0000","last_became_peered":"2023-07-25T14:35:40.562072+0000","last_unstale":"2023-07-25T14:35:47.032972+0000","last_undegraded":"2023-07-25T14:35:47.032972+0000","last_fullsized":"2023-07-25T14:35:47.032972+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T23:39:16.694925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.591232+0000","last_change":"2023-07-25T14:35:44.605076+0000","last_active":"2023-07-25T14:35:45.591232+0000","last_peered":"2023-07-25T14:35:45.591232+0000","last_clean":"2023-07-25T14:35:45.591232+0000","last_became_active":"2023-07-25T14:35:44.604627+0000","last_became_peered":"2023-07-25T14:35:44.604627+0000","last_unstale":"2023-07-25T14:35:45.591232+0000","last_undegraded":"2023-07-25T14:35:45.591232+0000","last_fullsized":"2023-07-25T14:35:45.591232+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_clean_scrub_stamp":"2023-07-25T14:35:43.577860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T17:14:14.382524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.591663+0000","last_change":"2023-07-25T14:35:35.321055+0000","last_active":"2023-07-25T14:35:45.591663+0000","last_peered":"2023-07-25T14:35:45.591663+0000","last_clean":"2023-07-25T14:35:45.591663+0000","last_became_active":"2023-07-25T14:35:35.320739+0000","last_became_peered":"2023-07-25T14:35:35.320739+0000","last_unstale":"2023-07-25T14:35:45.591663+0000","last_undegraded":"2023-07-25T14:35:45.591663+0000","last_fullsized":"2023-07-25T14:35:45.591663+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_clean_scrub_stamp":"2023-07-25T14:35:33.358525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T17:42:19.164577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:47.033169+0000","last_change":"2023-07-25T14:35:39.539756+0000","last_active":"2023-07-25T14:35:47.033169+0000","last_peered":"2023-07-25T14:35:47.033169+0000","last_clean":"2023-07-25T14:35:47.033169+0000","last_became_active":"2023-07-25T14:35:39.539459+0000","last_became_peered":"2023-07-25T14:35:39.539459+0000","last_unstale":"2023-07-25T14:35:47.033169+0000","last_undegraded":"2023-07-25T14:35:47.033169+0000","last_fullsized":"2023-07-25T14:35:47.033169+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_clean_scrub_stamp":"2023-07-25T14:35:38.515226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:14:10.943034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:46.555037+0000","last_change":"2023-07-25T14:35:40.569961+0000","last_active":"2023-07-25T14:35:46.555037+0000","last_peered":"2023-07-25T14:35:46.555037+0000","last_clean":"2023-07-25T14:35:46.555037+0000","last_became_active":"2023-07-25T14:35:40.569660+0000","last_became_peered":"2023-07-25T14:35:40.569660+0000","last_unstale":"2023-07-25T14:35:46.555037+0000","last_undegraded":"2023-07-25T14:35:46.555037+0000","last_fullsized":"2023-07-25T14:35:46.555037+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T21:17:40.464582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:46.554816+0000","last_change":"2023-07-25T14:35:44.616675+0000","last_active":"2023-07-25T14:35:46.554816+0000","last_peered":"2023-07-25T14:35:46.554816+0000","last_clean":"2023-07-25T14:35:46.554816+0000","last_became_active":"2023-07-25T14:35:44.616241+0000","last_became_peered":"2023-07-25T14:35:44.616241+0000","last_unstale":"2023-07-25T14:35:46.554816+0000","last_undegraded":"2023-07-25T14:35:46.554816+0000","last_fullsized":"2023-07-25T14:35:46.554816+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_clean_scrub_stamp":"2023-07-25T14:35:43.577860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T19:42:05.988099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.593040+0000","last_change":"2023-07-25T14:35:34.370772+0000","last_active":"2023-07-25T14:35:45.593040+0000","last_peered":"2023-07-25T14:35:45.593040+0000","last_clean":"2023-07-25T14:35:45.593040+0000","last_became_active":"2023-07-25T14:35:34.370549+0000","last_became_peered":"2023-07-25T14:35:34.370549+0000","last_unstale":"2023-07-25T14:35:45.593040+0000","last_undegraded":"2023-07-25T14:35:45.593040+0000","last_fullsized":"2023-07-25T14:35:45.593040+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_clean_scrub_stamp":"2023-07-25T14:35:33.358525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T19:34:32.153689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.591780+0000","last_change":"2023-07-25T14:35:39.543278+0000","last_active":"2023-07-25T14:35:45.591780+0000","last_peered":"2023-07-25T14:35:45.591780+0000","last_clean":"2023-07-25T14:35:45.591780+0000","last_became_active":"2023-07-25T14:35:39.543017+0000","last_became_peered":"2023-07-25T14:35:39.543017+0000","last_unstale":"2023-07-25T14:35:45.591780+0000","last_undegraded":"2023-07-25T14:35:45.591780+0000","last_fullsized":"2023-07-25T14:35:45.591780+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_clean_scrub_stamp":"2023-07-25T14:35:38.515226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T17:42:32.265934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:47.032289+0000","last_change":"2023-07-25T14:35:40.574583+0000","last_active":"2023-07-25T14:35:47.032289+0000","last_peered":"2023-07-25T14:35:47.032289+0000","last_clean":"2023-07-25T14:35:47.032289+0000","last_became_active":"2023-07-25T14:35:40.574298+0000","last_became_peered":"2023-07-25T14:35:40.574298+0000","last_unstale":"2023-07-25T14:35:47.032289+0000","last_undegraded":"2023-07-25T14:35:47.032289+0000","last_fullsized":"2023-07-25T14:35:47.032289+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T01:29:43.918829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:47.033044+0000","last_change":"2023-07-25T14:35:44.609515+0000","last_active":"2023-07-25T14:35:47.033044+0000","last_peered":"2023-07-25T14:35:47.033044+0000","last_clean":"2023-07-25T14:35:47.033044+0000","last_became_active":"2023-07-25T14:35:44.609128+0000","last_became_peered":"2023-07-25T14:35:44.609128+0000","last_unstale":"2023-07-25T14:35:47.033044+0000","last_undegraded":"2023-07-25T14:35:47.033044+0000","last_fullsized":"2023-07-25T14:35:47.033044+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_clean_scrub_stamp":"2023-07-25T14:35:43.577860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T01:26:57.336329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"20'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:46.555117+0000","last_change":"2023-07-25T14:35:39.542444+0000","last_active":"2023-07-25T14:35:46.555117+0000","last_peered":"2023-07-25T14:35:46.555117+0000","last_clean":"2023-07-25T14:35:46.555117+0000","last_became_active":"2023-07-25T14:35:39.542159+0000","last_became_peered":"2023-07-25T14:35:39.542159+0000","last_unstale":"2023-07-25T14:35:46.555117+0000","last_undegraded":"2023-07-25T14:35:46.555117+0000","last_fullsized":"2023-07-25T14:35:46.555117+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_clean_scrub_stamp":"2023-07-25T14:35:38.515226+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:24:56.192863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:47.033068+0000","last_change":"2023-07-25T14:35:40.560846+0000","last_active":"2023-07-25T14:35:47.033068+0000","last_peered":"2023-07-25T14:35:47.033068+0000","last_clean":"2023-07-25T14:35:47.033068+0000","last_became_active":"2023-07-25T14:35:40.560390+0000","last_became_peered":"2023-07-25T14:35:40.560390+0000","last_unstale":"2023-07-25T14:35:47.033068+0000","last_undegraded":"2023-07-25T14:35:47.033068+0000","last_fullsized":"2023-07-25T14:35:47.033068+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T02:30:11.217603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:46.548733+0000","last_change":"2023-07-25T14:35:44.612963+0000","last_active":"2023-07-25T14:35:46.548733+0000","last_peered":"2023-07-25T14:35:46.548733+0000","last_clean":"2023-07-25T14:35:46.548733+0000","last_became_active":"2023-07-25T14:35:44.612473+0000","last_became_peered":"2023-07-25T14:35:44.612473+0000","last_unstale":"2023-07-25T14:35:46.548733+0000","last_undegraded":"2023-07-25T14:35:46.548733+0000","last_fullsized":"2023-07-25T14:35:46.548733+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_clean_scrub_stamp":"2023-07-25T14:35:43.577860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T15:17:51.741356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.592714+0000","last_change":"2023-07-25T14:35:39.533066+0000","last_active":"2023-07-25T14:35:45.592714+0000","last_peered":"2023-07-25T14:35:45.592714+0000","last_clean":"2023-07-25T14:35:45.592714+0000","last_became_active":"2023-07-25T14:35:39.532788+0000","last_became_peered":"2023-07-25T14:35:39.532788+0000","last_unstale":"2023-07-25T14:35:45.592714+0000","last_undegraded":"2023-07-25T14:35:45.592714+0000","last_fullsized":"2023-07-25T14:35:45.592714+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_clean_scrub_stamp":"2023-07-25T14:35:38.515226+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:20:27.220474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.593805+0000","last_change":"2023-07-25T14:35:40.583948+0000","last_active":"2023-07-25T14:35:45.593805+0000","last_peered":"2023-07-25T14:35:45.593805+0000","last_clean":"2023-07-25T14:35:45.593805+0000","last_became_active":"2023-07-25T14:35:40.583649+0000","last_became_peered":"2023-07-25T14:35:40.583649+0000","last_unstale":"2023-07-25T14:35:45.593805+0000","last_undegraded":"2023-07-25T14:35:45.593805+0000","last_fullsized":"2023-07-25T14:35:45.593805+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T23:42:40.581448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.592627+0000","last_change":"2023-07-25T14:35:44.605812+0000","last_active":"2023-07-25T14:35:45.592627+0000","last_peered":"2023-07-25T14:35:45.592627+0000","last_clean":"2023-07-25T14:35:45.592627+0000","last_became_active":"2023-07-25T14:35:44.605416+0000","last_became_peered":"2023-07-25T14:35:44.605416+0000","last_unstale":"2023-07-25T14:35:45.592627+0000","last_undegraded":"2023-07-25T14:35:45.592627+0000","last_fullsized":"2023-07-25T14:35:45.592627+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_clean_scrub_stamp":"2023-07-25T14:35:43.577860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:09:38.430388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.591482+0000","last_change":"2023-07-25T14:35:39.538303+0000","last_active":"2023-07-25T14:35:45.591482+0000","last_peered":"2023-07-25T14:35:45.591482+0000","last_clean":"2023-07-25T14:35:45.591482+0000","last_became_active":"2023-07-25T14:35:39.538019+0000","last_became_peered":"2023-07-25T14:35:39.538019+0000","last_unstale":"2023-07-25T14:35:45.591482+0000","last_undegraded":"2023-07-25T14:35:45.591482+0000","last_fullsized":"2023-07-25T14:35:45.591482+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_clean_scrub_stamp":"2023-07-25T14:35:38.515226+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T21:36:37.994624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.593528+0000","last_change":"2023-07-25T14:35:40.573130+0000","last_active":"2023-07-25T14:35:45.593528+0000","last_peered":"2023-07-25T14:35:45.593528+0000","last_clean":"2023-07-25T14:35:45.593528+0000","last_became_active":"2023-07-25T14:35:40.572465+0000","last_became_peered":"2023-07-25T14:35:40.572465+0000","last_unstale":"2023-07-25T14:35:45.593528+0000","last_undegraded":"2023-07-25T14:35:45.593528+0000","last_fullsized":"2023-07-25T14:35:45.593528+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T21:29:36.633963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.593380+0000","last_change":"2023-07-25T14:35:44.610311+0000","last_active":"2023-07-25T14:35:45.593380+0000","last_peered":"2023-07-25T14:35:45.593380+0000","last_clean":"2023-07-25T14:35:45.593380+0000","last_became_active":"2023-07-25T14:35:44.609672+0000","last_became_peered":"2023-07-25T14:35:44.609672+0000","last_unstale":"2023-07-25T14:35:45.593380+0000","last_undegraded":"2023-07-25T14:35:45.593380+0000","last_fullsized":"2023-07-25T14:35:45.593380+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_clean_scrub_stamp":"2023-07-25T14:35:43.577860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T21:04:57.404448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"20'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.813281+0000","last_change":"2023-07-25T14:35:39.542215+0000","last_active":"2023-07-25T14:35:45.813281+0000","last_peered":"2023-07-25T14:35:45.813281+0000","last_clean":"2023-07-25T14:35:45.813281+0000","last_became_active":"2023-07-25T14:35:39.541943+0000","last_became_peered":"2023-07-25T14:35:39.541943+0000","last_unstale":"2023-07-25T14:35:45.813281+0000","last_undegraded":"2023-07-25T14:35:45.813281+0000","last_fullsized":"2023-07-25T14:35:45.813281+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_clean_scrub_stamp":"2023-07-25T14:35:38.515226+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T18:16:10.455351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.812997+0000","last_change":"2023-07-25T14:35:40.579154+0000","last_active":"2023-07-25T14:35:45.812997+0000","last_peered":"2023-07-25T14:35:45.812997+0000","last_clean":"2023-07-25T14:35:45.812997+0000","last_became_active":"2023-07-25T14:35:40.578884+0000","last_became_peered":"2023-07-25T14:35:40.578884+0000","last_unstale":"2023-07-25T14:35:45.812997+0000","last_undegraded":"2023-07-25T14:35:45.812997+0000","last_fullsized":"2023-07-25T14:35:45.812997+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T17:49:05.620750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:47.032543+0000","last_change":"2023-07-25T14:35:44.612196+0000","last_active":"2023-07-25T14:35:47.032543+0000","last_peered":"2023-07-25T14:35:47.032543+0000","last_clean":"2023-07-25T14:35:47.032543+0000","last_became_active":"2023-07-25T14:35:44.607198+0000","last_became_peered":"2023-07-25T14:35:44.607198+0000","last_unstale":"2023-07-25T14:35:47.032543+0000","last_undegraded":"2023-07-25T14:35:47.032543+0000","last_fullsized":"2023-07-25T14:35:47.032543+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:43.577860+0000","last_clean_scrub_stamp":"2023-07-25T14:35:43.577860+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T01:05:07.252828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"20'4","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:46.555008+0000","last_change":"2023-07-25T14:35:39.532403+0000","last_active":"2023-07-25T14:35:46.555008+0000","last_peered":"2023-07-25T14:35:46.555008+0000","last_clean":"2023-07-25T14:35:46.555008+0000","last_became_active":"2023-07-25T14:35:39.532093+0000","last_became_peered":"2023-07-25T14:35:39.532093+0000","last_unstale":"2023-07-25T14:35:46.555008+0000","last_undegraded":"2023-07-25T14:35:46.555008+0000","last_fullsized":"2023-07-25T14:35:46.555008+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:38.515226+0000","last_clean_scrub_stamp":"2023-07-25T14:35:38.515226+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T17:08:32.162917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.593485+0000","last_change":"2023-07-25T14:35:40.577967+0000","last_active":"2023-07-25T14:35:45.593485+0000","last_peered":"2023-07-25T14:35:45.593485+0000","last_clean":"2023-07-25T14:35:45.593485+0000","last_became_active":"2023-07-25T14:35:40.577650+0000","last_became_peered":"2023-07-25T14:35:40.577650+0000","last_unstale":"2023-07-25T14:35:45.593485+0000","last_undegraded":"2023-07-25T14:35:45.593485+0000","last_fullsized":"2023-07-25T14:35:45.593485+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T19:24:36.655790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.590805+0000","last_change":"2023-07-25T14:35:40.571775+0000","last_active":"2023-07-25T14:35:45.590805+0000","last_peered":"2023-07-25T14:35:45.590805+0000","last_clean":"2023-07-25T14:35:45.590805+0000","last_became_active":"2023-07-25T14:35:40.571515+0000","last_became_peered":"2023-07-25T14:35:40.571515+0000","last_unstale":"2023-07-25T14:35:45.590805+0000","last_undegraded":"2023-07-25T14:35:45.590805+0000","last_fullsized":"2023-07-25T14:35:45.590805+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T01:27:20.879412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.812791+0000","last_change":"2023-07-25T14:35:40.580145+0000","last_active":"2023-07-25T14:35:45.812791+0000","last_peered":"2023-07-25T14:35:45.812791+0000","last_clean":"2023-07-25T14:35:45.812791+0000","last_became_active":"2023-07-25T14:35:40.579840+0000","last_became_peered":"2023-07-25T14:35:40.579840+0000","last_unstale":"2023-07-25T14:35:45.812791+0000","last_undegraded":"2023-07-25T14:35:45.812791+0000","last_fullsized":"2023-07-25T14:35:45.812791+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T23:06:56.015409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.593959+0000","last_change":"2023-07-25T14:35:40.582132+0000","last_active":"2023-07-25T14:35:45.593959+0000","last_peered":"2023-07-25T14:35:45.593959+0000","last_clean":"2023-07-25T14:35:45.593959+0000","last_became_active":"2023-07-25T14:35:40.581759+0000","last_became_peered":"2023-07-25T14:35:40.581759+0000","last_unstale":"2023-07-25T14:35:45.593959+0000","last_undegraded":"2023-07-25T14:35:45.593959+0000","last_fullsized":"2023-07-25T14:35:45.593959+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T17:04:15.120194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:45.812954+0000","last_change":"2023-07-25T14:35:40.583199+0000","last_active":"2023-07-25T14:35:45.812954+0000","last_peered":"2023-07-25T14:35:45.812954+0000","last_clean":"2023-07-25T14:35:45.812954+0000","last_became_active":"2023-07-25T14:35:40.582969+0000","last_became_peered":"2023-07-25T14:35:40.582969+0000","last_unstale":"2023-07-25T14:35:45.812954+0000","last_undegraded":"2023-07-25T14:35:45.812954+0000","last_fullsized":"2023-07-25T14:35:45.812954+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T16:19:19.724875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-25T14:35:47.033086+0000","last_change":"2023-07-25T14:35:40.560945+0000","last_active":"2023-07-25T14:35:47.033086+0000","last_peered":"2023-07-25T14:35:47.033086+0000","last_clean":"2023-07-25T14:35:47.033086+0000","last_became_active":"2023-07-25T14:35:40.560663+0000","last_became_peered":"2023-07-25T14:35:40.560663+0000","last_unstale":"2023-07-25T14:35:47.033086+0000","last_undegraded":"2023-07-25T14:35:47.033086+0000","last_fullsized":"2023-07-25T14:35:47.033086+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:39.517352+0000","last_clean_scrub_stamp":"2023-07-25T14:35:39.517352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T17:24:11.100853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4592,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64510,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574858,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":360448,"data_stored":703779,"data_compressed":32255,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34799999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.43099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40699999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59999999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574857,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":266240,"data_stored":109401,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.374}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.624}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34699999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574857,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":331776,"data_stored":699769,"data_compressed":32255,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.245}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30199999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42199999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.432}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574857,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":266240,"data_stored":108922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29999999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32500000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69399999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72899999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574857,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":262144,"data_stored":108340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35799999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33700000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.62}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574857,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":266240,"data_stored":108430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30599999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45700000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45000000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]}]},{"osd":4,"up_from":13,"seq":55834574857,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":286720,"data_stored":113251,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.876}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65600000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48799999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574857,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":274432,"data_stored":110053,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.657}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.872}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54400000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71899999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32255,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32255,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":4010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-25T14:36:05.747 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-07-25T14:36:05.747 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-07-25T14:36:05.748 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-07-25T14:36:05.748 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-07-25T14:36:05.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.881+0000 7fb491f96700 1 Processor -- start 2023-07-25T14:36:05.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.881+0000 7fb491f96700 1 -- start start 2023-07-25T14:36:05.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.882+0000 7fb491f96700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb48c151ba0 0x7fb48c0c2230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:05.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.882+0000 7fb491f96700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb48c154d50 0x7fb48c15b970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:05.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.882+0000 7fb491f96700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb48c0c54f0 con 0x7fb48c0c5f40 2023-07-25T14:36:05.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.882+0000 7fb491f96700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb48c0c6670 con 0x7fb48c151ba0 2023-07-25T14:36:05.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.882+0000 7fb491f96700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb48c0c5740 con 0x7fb48c154d50 2023-07-25T14:36:05.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.882+0000 7fb48b7fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb48c151ba0 0x7fb48c0c2230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:05.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.882+0000 7fb48b7fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb48c151ba0 0x7fb48c0c2230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40382/0 (socket says 172.21.15.72:40382) 2023-07-25T14:36:05.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.882+0000 7fb48b7fe700 1 -- 172.21.15.72:0/1536329853 learned_addr learned my addr 172.21.15.72:0/1536329853 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:05.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.882+0000 7fb48bfff700 1 --2- 172.21.15.72:0/1536329853 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb48c154d50 0x7fb48c15b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:05.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.883+0000 7fb48b7fe700 1 -- 172.21.15.72:0/1536329853 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb48c154d50 msgr2=0x7fb48c15b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:05.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.883+0000 7fb48b7fe700 1 --2- 172.21.15.72:0/1536329853 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb48c154d50 0x7fb48c15b970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:05.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.883+0000 7fb48b7fe700 1 -- 172.21.15.72:0/1536329853 >> v1:172.21.15.92:6789/0 conn(0x7fb48c0c5f40 legacy=0x7fb48c154640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:05.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.883+0000 7fb48b7fe700 1 -- 172.21.15.72:0/1536329853 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb48c0c5a20 con 0x7fb48c151ba0 2023-07-25T14:36:05.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.883+0000 7fb48b7fe700 1 --2- 172.21.15.72:0/1536329853 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb48c151ba0 0x7fb48c0c2230 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fb47c00bb90 tx=0x7fb47c00bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b94ffb917ede402 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:05.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.883+0000 7fb48a7fc700 1 -- 172.21.15.72:0/1536329853 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb47c00dd50 con 0x7fb48c151ba0 2023-07-25T14:36:05.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.883+0000 7fb48a7fc700 1 -- 172.21.15.72:0/1536329853 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb47c010470 con 0x7fb48c151ba0 2023-07-25T14:36:05.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.883+0000 7fb48a7fc700 1 -- 172.21.15.72:0/1536329853 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb47c010800 con 0x7fb48c151ba0 2023-07-25T14:36:05.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.883+0000 7fb491f96700 1 -- 172.21.15.72:0/1536329853 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb48c151ba0 msgr2=0x7fb48c0c2230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:05.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.883+0000 7fb491f96700 1 --2- 172.21.15.72:0/1536329853 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb48c151ba0 0x7fb48c0c2230 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fb47c00bb90 tx=0x7fb47c00bea0 comp rx=0 tx=0).stop 2023-07-25T14:36:05.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.883+0000 7fb491f96700 1 -- 172.21.15.72:0/1536329853 shutdown_connections 2023-07-25T14:36:05.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.883+0000 7fb491f96700 1 --2- 172.21.15.72:0/1536329853 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb48c154d50 0x7fb48c15b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:05.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.883+0000 7fb491f96700 1 --2- 172.21.15.72:0/1536329853 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb48c151ba0 0x7fb48c0c2230 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:05.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.883+0000 7fb491f96700 1 -- 172.21.15.72:0/1536329853 >> 172.21.15.72:0/1536329853 conn(0x7fb48c0a87e0 msgr2=0x7fb48c0a8bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:05.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.883+0000 7fb491f96700 1 -- 172.21.15.72:0/1536329853 shutdown_connections 2023-07-25T14:36:05.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.883+0000 7fb491f96700 1 -- 172.21.15.72:0/1536329853 wait complete. 2023-07-25T14:36:05.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.884+0000 7fb491f96700 1 Processor -- start 2023-07-25T14:36:05.902 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.885+0000 7fb491f96700 1 -- start start 2023-07-25T14:36:05.902 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.885+0000 7fb491f96700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb48c0c5f40 0x7fb48c0bf070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:05.902 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.885+0000 7fb491f96700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb48c151ba0 0x7fb48c1ed210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:05.902 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.885+0000 7fb491f96700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb48c0bf5b0 0x7fb48c1ed750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:05.902 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.885+0000 7fb491f96700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb48c0bdc90 con 0x7fb48c0bf5b0 2023-07-25T14:36:05.902 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.885+0000 7fb491f96700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb48c1dcd40 con 0x7fb48c0c5f40 2023-07-25T14:36:05.902 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.885+0000 7fb491f96700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb48c1edc90 con 0x7fb48c151ba0 2023-07-25T14:36:05.902 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.885+0000 7fb48bfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb48c0bf5b0 0x7fb48c1ed750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:05.903 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.886+0000 7fb48bfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb48c0bf5b0 0x7fb48c1ed750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40390/0 (socket says 172.21.15.72:40390) 2023-07-25T14:36:05.903 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.886+0000 7fb48bfff700 1 -- 172.21.15.72:0/86503009 learned_addr learned my addr 172.21.15.72:0/86503009 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:05.903 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.886+0000 7fb48b7fe700 1 --2- 172.21.15.72:0/86503009 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb48c0c5f40 0x7fb48c0bf070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:05.903 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.886+0000 7fb48affd700 1 --2- 172.21.15.72:0/86503009 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb48c151ba0 0x7fb48c1ed210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:05.903 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.886+0000 7fb48bfff700 1 -- 172.21.15.72:0/86503009 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb48c151ba0 msgr2=0x7fb48c1ed210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:05.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.886+0000 7fb48bfff700 1 --2- 172.21.15.72:0/86503009 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb48c151ba0 0x7fb48c1ed210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:05.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.886+0000 7fb48bfff700 1 -- 172.21.15.72:0/86503009 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb48c0c5f40 msgr2=0x7fb48c0bf070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:05.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.886+0000 7fb48bfff700 1 --2- 172.21.15.72:0/86503009 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb48c0c5f40 0x7fb48c0bf070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:05.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.886+0000 7fb48bfff700 1 -- 172.21.15.72:0/86503009 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb47c00b7f0 con 0x7fb48c0bf5b0 2023-07-25T14:36:05.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.886+0000 7fb48bfff700 1 --2- 172.21.15.72:0/86503009 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb48c0bf5b0 0x7fb48c1ed750 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fb484009fd0 tx=0x7fb48400e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:05.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.886+0000 7fb473fff700 1 -- 172.21.15.72:0/86503009 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb484007ea0 con 0x7fb48c0bf5b0 2023-07-25T14:36:05.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.886+0000 7fb473fff700 1 -- 172.21.15.72:0/86503009 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb48400ed30 con 0x7fb48c0bf5b0 2023-07-25T14:36:05.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.886+0000 7fb491f96700 1 -- 172.21.15.72:0/86503009 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb48c0a97e0 con 0x7fb48c0bf5b0 2023-07-25T14:36:05.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.886+0000 7fb473fff700 1 -- 172.21.15.72:0/86503009 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb48400eea0 con 0x7fb48c0bf5b0 2023-07-25T14:36:05.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.886+0000 7fb491f96700 1 -- 172.21.15.72:0/86503009 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb48c1dc6f0 con 0x7fb48c0bf5b0 2023-07-25T14:36:05.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.887+0000 7fb491f96700 1 -- 172.21.15.72:0/86503009 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb48c04e470 con 0x7fb48c0bf5b0 2023-07-25T14:36:05.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.888+0000 7fb473fff700 1 -- 172.21.15.72:0/86503009 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb484014660 con 0x7fb48c0bf5b0 2023-07-25T14:36:05.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.888+0000 7fb473fff700 1 --2- 172.21.15.72:0/86503009 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fb47806ace0 0x7fb47806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:05.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.888+0000 7fb473fff700 1 -- 172.21.15.72:0/86503009 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fb48408a860 con 0x7fb48c0bf5b0 2023-07-25T14:36:05.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.888+0000 7fb48b7fe700 1 --2- 172.21.15.72:0/86503009 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fb47806ace0 0x7fb47806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:05.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.889+0000 7fb48b7fe700 1 --2- 172.21.15.72:0/86503009 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fb47806ace0 0x7fb47806d1a0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fb47c00bee0 tx=0x7fb47c013000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:05.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:05.892+0000 7fb473fff700 1 -- 172.21.15.72:0/86503009 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fb484059090 con 0x7fb48c0bf5b0 2023-07-25T14:36:06.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.121+0000 7fb491f96700 1 -- 172.21.15.72:0/86503009 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fb48c1dce80 con 0x7fb48c0bf5b0 2023-07-25T14:36:06.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.121+0000 7fb473fff700 1 -- 172.21.15.72:0/86503009 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7fb484058c20 con 0x7fb48c0bf5b0 2023-07-25T14:36:06.135 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-25T14:36:06.135 INFO:teuthology.orchestra.run.smithi072.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-07-25T14:36:06.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.123+0000 7fb491f96700 1 -- 172.21.15.72:0/86503009 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fb47806ace0 msgr2=0x7fb47806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:06.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.123+0000 7fb491f96700 1 --2- 172.21.15.72:0/86503009 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fb47806ace0 0x7fb47806d1a0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fb47c00bee0 tx=0x7fb47c013000 comp rx=0 tx=0).stop 2023-07-25T14:36:06.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.123+0000 7fb491f96700 1 -- 172.21.15.72:0/86503009 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb48c0bf5b0 msgr2=0x7fb48c1ed750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:06.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.123+0000 7fb491f96700 1 --2- 172.21.15.72:0/86503009 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb48c0bf5b0 0x7fb48c1ed750 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fb484009fd0 tx=0x7fb48400e3c0 comp rx=0 tx=0).stop 2023-07-25T14:36:06.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.124+0000 7fb491f96700 1 -- 172.21.15.72:0/86503009 shutdown_connections 2023-07-25T14:36:06.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.124+0000 7fb491f96700 1 --2- 172.21.15.72:0/86503009 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fb47806ace0 0x7fb47806d1a0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:06.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.124+0000 7fb491f96700 1 --2- 172.21.15.72:0/86503009 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb48c0bf5b0 0x7fb48c1ed750 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:06.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.124+0000 7fb491f96700 1 --2- 172.21.15.72:0/86503009 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb48c0c5f40 0x7fb48c0bf070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:06.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.124+0000 7fb491f96700 1 --2- 172.21.15.72:0/86503009 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb48c151ba0 0x7fb48c1ed210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:06.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.124+0000 7fb491f96700 1 -- 172.21.15.72:0/86503009 >> 172.21.15.72:0/86503009 conn(0x7fb48c0a87e0 msgr2=0x7fb48c0c4600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:06.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.124+0000 7fb491f96700 1 -- 172.21.15.72:0/86503009 shutdown_connections 2023-07-25T14:36:06.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.124+0000 7fb491f96700 1 -- 172.21.15.72:0/86503009 wait complete. 2023-07-25T14:36:06.148 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-07-25T14:36:06.148 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-25T14:36:06.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.255+0000 7ffa798d1700 1 Processor -- start 2023-07-25T14:36:06.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.255+0000 7ffa798d1700 1 -- start start 2023-07-25T14:36:06.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.256+0000 7ffa798d1700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ffa74151950 0x7ffa7406a190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:06.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.256+0000 7ffa798d1700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ffa740724c0 0x7ffa740c34c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:06.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.256+0000 7ffa798d1700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7ffa7406a6d0 0x7ffa740c3a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:06.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.256+0000 7ffa798d1700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa74071a60 con 0x7ffa740724c0 2023-07-25T14:36:06.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.256+0000 7ffa798d1700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa740c2a70 con 0x7ffa7406a6d0 2023-07-25T14:36:06.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.256+0000 7ffa798d1700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa74151d30 con 0x7ffa74151950 2023-07-25T14:36:06.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.256+0000 7ffa727fc700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ffa740724c0 0x7ffa740c34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:06.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.256+0000 7ffa727fc700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ffa740724c0 0x7ffa740c34c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40396/0 (socket says 172.21.15.72:40396) 2023-07-25T14:36:06.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.256+0000 7ffa727fc700 1 -- 172.21.15.72:0/971993057 learned_addr learned my addr 172.21.15.72:0/971993057 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:06.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.256+0000 7ffa737fe700 1 --2- 172.21.15.72:0/971993057 >> v2:172.21.15.92:3300/0 conn(0x7ffa7406a6d0 0x7ffa740c3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:06.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.256+0000 7ffa72ffd700 1 --2- 172.21.15.72:0/971993057 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ffa74151950 0x7ffa7406a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:06.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.257+0000 7ffa727fc700 1 -- 172.21.15.72:0/971993057 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ffa74151950 msgr2=0x7ffa7406a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:06.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.257+0000 7ffa727fc700 1 --2- 172.21.15.72:0/971993057 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ffa74151950 0x7ffa7406a190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:06.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.257+0000 7ffa727fc700 1 -- 172.21.15.72:0/971993057 >> v2:172.21.15.92:3300/0 conn(0x7ffa7406a6d0 msgr2=0x7ffa740c3a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:06.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.257+0000 7ffa727fc700 1 --2- 172.21.15.72:0/971993057 >> v2:172.21.15.92:3300/0 conn(0x7ffa7406a6d0 0x7ffa740c3a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:06.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.257+0000 7ffa727fc700 1 -- 172.21.15.72:0/971993057 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa740c2fe0 con 0x7ffa740724c0 2023-07-25T14:36:06.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.257+0000 7ffa737fe700 1 --2- 172.21.15.72:0/971993057 >> v2:172.21.15.92:3300/0 conn(0x7ffa7406a6d0 0x7ffa740c3a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-25T14:36:06.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.257+0000 7ffa72ffd700 1 --2- 172.21.15.72:0/971993057 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ffa74151950 0x7ffa7406a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-25T14:36:06.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.257+0000 7ffa727fc700 1 --2- 172.21.15.72:0/971993057 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffa740724c0 0x7ffa740c34c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7ffa7406d430 tx=0x7ffa64009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31f51f3edfd8fbc1 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:06.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.257+0000 7ffa71ffb700 1 -- 172.21.15.72:0/971993057 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa6400b870 con 0x7ffa740724c0 2023-07-25T14:36:06.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.257+0000 7ffa71ffb700 1 -- 172.21.15.72:0/971993057 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa6400b9d0 con 0x7ffa740724c0 2023-07-25T14:36:06.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.257+0000 7ffa71ffb700 1 -- 172.21.15.72:0/971993057 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa6400bd60 con 0x7ffa740724c0 2023-07-25T14:36:06.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.257+0000 7ffa798d1700 1 -- 172.21.15.72:0/971993057 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffa740724c0 msgr2=0x7ffa740c34c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:06.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.257+0000 7ffa798d1700 1 --2- 172.21.15.72:0/971993057 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffa740724c0 0x7ffa740c34c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7ffa7406d430 tx=0x7ffa64009bd0 comp rx=0 tx=0).stop 2023-07-25T14:36:06.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.257+0000 7ffa798d1700 1 -- 172.21.15.72:0/971993057 shutdown_connections 2023-07-25T14:36:06.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.257+0000 7ffa798d1700 1 --2- 172.21.15.72:0/971993057 >> v2:172.21.15.92:3300/0 conn(0x7ffa7406a6d0 0x7ffa740c3a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:06.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.257+0000 7ffa798d1700 1 --2- 172.21.15.72:0/971993057 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ffa74151950 0x7ffa7406a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:06.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.257+0000 7ffa798d1700 1 --2- 172.21.15.72:0/971993057 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffa740724c0 0x7ffa740c34c0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:06.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.257+0000 7ffa798d1700 1 -- 172.21.15.72:0/971993057 >> 172.21.15.72:0/971993057 conn(0x7ffa740a87e0 msgr2=0x7ffa740a8bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:06.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.257+0000 7ffa798d1700 1 -- 172.21.15.72:0/971993057 shutdown_connections 2023-07-25T14:36:06.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.257+0000 7ffa798d1700 1 -- 172.21.15.72:0/971993057 wait complete. 2023-07-25T14:36:06.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.259+0000 7ffa798d1700 1 Processor -- start 2023-07-25T14:36:06.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.259+0000 7ffa798d1700 1 -- start start 2023-07-25T14:36:06.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.260+0000 7ffa798d1700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffa7406a6d0 0x7ffa74153e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:06.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.260+0000 7ffa798d1700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ffa740724c0 0x7ffa74153140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:06.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.260+0000 7ffa798d1700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffa74151950 0x7ffa74153680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:06.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.260+0000 7ffa798d1700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa741ecb60 con 0x7ffa7406a6d0 2023-07-25T14:36:06.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.260+0000 7ffa798d1700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa741ece00 con 0x7ffa74151950 2023-07-25T14:36:06.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.260+0000 7ffa798d1700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa741ed0e0 con 0x7ffa740724c0 2023-07-25T14:36:06.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.260+0000 7ffa72ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffa7406a6d0 0x7ffa74153e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:06.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.260+0000 7ffa72ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffa7406a6d0 0x7ffa74153e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40400/0 (socket says 172.21.15.72:40400) 2023-07-25T14:36:06.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.260+0000 7ffa72ffd700 1 -- 172.21.15.72:0/489183217 learned_addr learned my addr 172.21.15.72:0/489183217 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:06.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.260+0000 7ffa737fe700 1 --2- 172.21.15.72:0/489183217 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffa74151950 0x7ffa74153680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:06.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.260+0000 7ffa727fc700 1 --2- 172.21.15.72:0/489183217 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ffa740724c0 0x7ffa74153140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:06.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.260+0000 7ffa72ffd700 1 -- 172.21.15.72:0/489183217 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ffa740724c0 msgr2=0x7ffa74153140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:06.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.260+0000 7ffa72ffd700 1 --2- 172.21.15.72:0/489183217 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ffa740724c0 0x7ffa74153140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:06.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.260+0000 7ffa72ffd700 1 -- 172.21.15.72:0/489183217 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffa74151950 msgr2=0x7ffa74153680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:06.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.260+0000 7ffa72ffd700 1 --2- 172.21.15.72:0/489183217 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffa74151950 0x7ffa74153680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:06.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.260+0000 7ffa72ffd700 1 -- 172.21.15.72:0/489183217 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa64009550 con 0x7ffa7406a6d0 2023-07-25T14:36:06.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.260+0000 7ffa737fe700 1 --2- 172.21.15.72:0/489183217 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffa74151950 0x7ffa74153680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-25T14:36:06.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.260+0000 7ffa72ffd700 1 --2- 172.21.15.72:0/489183217 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffa7406a6d0 0x7ffa74153e50 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7ffa6800c7f0 tx=0x7ffa6800cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:06.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.261+0000 7ffa5bfff700 1 -- 172.21.15.72:0/489183217 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa68011800 con 0x7ffa7406a6d0 2023-07-25T14:36:06.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.261+0000 7ffa5bfff700 1 -- 172.21.15.72:0/489183217 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa68011960 con 0x7ffa7406a6d0 2023-07-25T14:36:06.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.261+0000 7ffa5bfff700 1 -- 172.21.15.72:0/489183217 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa68011d10 con 0x7ffa7406a6d0 2023-07-25T14:36:06.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.261+0000 7ffa798d1700 1 -- 172.21.15.72:0/489183217 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa741ed3c0 con 0x7ffa7406a6d0 2023-07-25T14:36:06.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.261+0000 7ffa798d1700 1 -- 172.21.15.72:0/489183217 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa74154390 con 0x7ffa7406a6d0 2023-07-25T14:36:06.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.262+0000 7ffa798d1700 1 -- 172.21.15.72:0/489183217 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa741eda10 con 0x7ffa7406a6d0 2023-07-25T14:36:06.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.262+0000 7ffa5bfff700 1 -- 172.21.15.72:0/489183217 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ffa68018360 con 0x7ffa7406a6d0 2023-07-25T14:36:06.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.262+0000 7ffa5bfff700 1 --2- 172.21.15.72:0/489183217 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7ffa6006ad10 0x7ffa6006d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:06.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.263+0000 7ffa5bfff700 1 -- 172.21.15.72:0/489183217 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7ffa680896b0 con 0x7ffa7406a6d0 2023-07-25T14:36:06.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.263+0000 7ffa727fc700 1 --2- 172.21.15.72:0/489183217 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7ffa6006ad10 0x7ffa6006d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:06.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.263+0000 7ffa727fc700 1 --2- 172.21.15.72:0/489183217 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7ffa6006ad10 0x7ffa6006d1d0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7ffa740728c0 tx=0x7ffa64008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:06.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.267+0000 7ffa5bfff700 1 -- 172.21.15.72:0/489183217 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7ffa68057f90 con 0x7ffa7406a6d0 2023-07-25T14:36:06.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.454+0000 7ffa798d1700 1 -- 172.21.15.72:0/489183217 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ffa740c1870 con 0x7ffa7406a6d0 2023-07-25T14:36:06.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.455+0000 7ffa5bfff700 1 -- 172.21.15.72:0/489183217 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+20014 (secure 0 0 0) 0x7ffa68057b20 con 0x7ffa7406a6d0 2023-07-25T14:36:06.468 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-25T14:36:06.468 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":25,"fsid":"9170db48-9170-43e8-8ccb-9813e6240906","created":"2023-07-25T14:35:21.733262+0000","modified":"2023-07-25T14:35:44.992669+0000","last_up_change":"2023-07-25T14:35:31.355010+0000","last_in_change":"2023-07-25T14:35:24.195785+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-25T14:35:32.983457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-25T14:35:33.326342+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-25T14:35:37.534158+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-25T14:35:38.891571+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-25T14:35:42.596923+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d517fdad-0bfe-49f0-89f2-9421c3761839","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6801","nonce":2475407414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6803","nonce":2475407414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6807","nonce":2475407414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6805","nonce":2475407414}]},"public_addr":"172.21.15.72:6801/2475407414","cluster_addr":"172.21.15.72:6803/2475407414","heartbeat_back_addr":"172.21.15.72:6807/2475407414","heartbeat_front_addr":"172.21.15.72:6805/2475407414","state":["exists","up"]},{"osd":1,"uuid":"e1564be3-f209-47e5-a8d0-32fc618a474f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6822","nonce":870954016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6825","nonce":870954016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6831","nonce":870954016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6827","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6829","nonce":870954016}]},"public_addr":"172.21.15.72:6822/870954016","cluster_addr":"172.21.15.72:6825/870954016","heartbeat_back_addr":"172.21.15.72:6831/870954016","heartbeat_front_addr":"172.21.15.72:6829/870954016","state":["exists","up"]},{"osd":2,"uuid":"c4647d30-ffa6-417a-9026-ef530c75910e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6809","nonce":2143129442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6811","nonce":2143129442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6815","nonce":2143129442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6813","nonce":2143129442}]},"public_addr":"172.21.15.72:6809/2143129442","cluster_addr":"172.21.15.72:6811/2143129442","heartbeat_back_addr":"172.21.15.72:6815/2143129442","heartbeat_front_addr":"172.21.15.72:6813/2143129442","state":["exists","up"]},{"osd":3,"uuid":"76c9d9a7-c2e2-4612-a58b-d6882dd76b58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6817","nonce":3404066311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6819","nonce":3404066311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6828","nonce":3404066311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6821","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6823","nonce":3404066311}]},"public_addr":"172.21.15.72:6817/3404066311","cluster_addr":"172.21.15.72:6819/3404066311","heartbeat_back_addr":"172.21.15.72:6828/3404066311","heartbeat_front_addr":"172.21.15.72:6823/3404066311","state":["exists","up"]},{"osd":4,"uuid":"7f8920dc-0ad4-4a73-ab40-65408f83eadd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6817","nonce":2381008739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6819","nonce":2381008739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6825","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6827","nonce":2381008739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6822","nonce":2381008739}]},"public_addr":"172.21.15.92:6817/2381008739","cluster_addr":"172.21.15.92:6819/2381008739","heartbeat_back_addr":"172.21.15.92:6827/2381008739","heartbeat_front_addr":"172.21.15.92:6822/2381008739","state":["exists","up"]},{"osd":5,"uuid":"56257e7c-31eb-44c5-9ec7-1318a4e0bb35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6801","nonce":2161935604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6803","nonce":2161935604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6807","nonce":2161935604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6805","nonce":2161935604}]},"public_addr":"172.21.15.92:6801/2161935604","cluster_addr":"172.21.15.92:6803/2161935604","heartbeat_back_addr":"172.21.15.92:6807/2161935604","heartbeat_front_addr":"172.21.15.92:6805/2161935604","state":["exists","up"]},{"osd":6,"uuid":"a150d3d8-a0c9-4955-968a-8d98eff4ffb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6809","nonce":3770163493}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6811","nonce":3770163493}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6815","nonce":3770163493}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6813","nonce":3770163493}]},"public_addr":"172.21.15.92:6809/3770163493","cluster_addr":"172.21.15.92:6811/3770163493","heartbeat_back_addr":"172.21.15.92:6815/3770163493","heartbeat_front_addr":"172.21.15.92:6813/3770163493","state":["exists","up"]},{"osd":7,"uuid":"07799c27-54ee-4591-a42d-a978d6b32065","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6821","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6823","nonce":2135777609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6826","nonce":2135777609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6831","nonce":2135777609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6829","nonce":2135777609}]},"public_addr":"172.21.15.92:6823/2135777609","cluster_addr":"172.21.15.92:6826/2135777609","heartbeat_back_addr":"172.21.15.92:6831/2135777609","heartbeat_front_addr":"172.21.15.92:6829/2135777609","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.345365+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.378150+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.146566+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.372172+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:30.398421+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.385632+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.465611+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.443583+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-25T14:36:06.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.457+0000 7ffa798d1700 1 -- 172.21.15.72:0/489183217 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7ffa6006ad10 msgr2=0x7ffa6006d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:06.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.457+0000 7ffa798d1700 1 --2- 172.21.15.72:0/489183217 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7ffa6006ad10 0x7ffa6006d1d0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7ffa740728c0 tx=0x7ffa64008030 comp rx=0 tx=0).stop 2023-07-25T14:36:06.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.457+0000 7ffa798d1700 1 -- 172.21.15.72:0/489183217 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffa7406a6d0 msgr2=0x7ffa74153e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:06.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.457+0000 7ffa798d1700 1 --2- 172.21.15.72:0/489183217 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffa7406a6d0 0x7ffa74153e50 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7ffa6800c7f0 tx=0x7ffa6800cbb0 comp rx=0 tx=0).stop 2023-07-25T14:36:06.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.457+0000 7ffa798d1700 1 -- 172.21.15.72:0/489183217 shutdown_connections 2023-07-25T14:36:06.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.457+0000 7ffa798d1700 1 --2- 172.21.15.72:0/489183217 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7ffa6006ad10 0x7ffa6006d1d0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:06.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.457+0000 7ffa798d1700 1 --2- 172.21.15.72:0/489183217 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffa74151950 0x7ffa74153680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:06.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.457+0000 7ffa798d1700 1 --2- 172.21.15.72:0/489183217 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffa7406a6d0 0x7ffa74153e50 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:06.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.457+0000 7ffa798d1700 1 --2- 172.21.15.72:0/489183217 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ffa740724c0 0x7ffa74153140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:06.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.457+0000 7ffa798d1700 1 -- 172.21.15.72:0/489183217 >> 172.21.15.72:0/489183217 conn(0x7ffa740a87e0 msgr2=0x7ffa7414f7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:06.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.457+0000 7ffa798d1700 1 -- 172.21.15.72:0/489183217 shutdown_connections 2023-07-25T14:36:06.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.457+0000 7ffa798d1700 1 -- 172.21.15.72:0/489183217 wait complete. 2023-07-25T14:36:06.482 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-07-25T14:35:32.983457+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-07-25T14:35:33.326342+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-25T14:35:37.534158+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-25T14:35:38.891571+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-07-25T14:35:42.596923+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-25T14:36:06.483 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-25T14:36:06.605 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.593+0000 7f892a965700 1 Processor -- start 2023-07-25T14:36:06.605 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.593+0000 7f892a965700 1 -- start start 2023-07-25T14:36:06.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.593+0000 7f892a965700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f89240a9cc0 0x7f89241525e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:06.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.593+0000 7f892a965700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f89240bb0b0 0x7f8924152b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:06.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.594+0000 7f892a965700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89240c5890 con 0x7f892414f810 2023-07-25T14:36:06.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.594+0000 7f892a965700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8924152150 con 0x7f89240bb0b0 2023-07-25T14:36:06.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.594+0000 7f892a965700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f892414fbf0 con 0x7f89240a9cc0 2023-07-25T14:36:06.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.594+0000 7f8928f02700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f89240bb0b0 0x7f8924152b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:06.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.594+0000 7f8928f02700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f89240bb0b0 0x7f8924152b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40412/0 (socket says 172.21.15.72:40412) 2023-07-25T14:36:06.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.594+0000 7f8928f02700 1 -- 172.21.15.72:0/379536535 learned_addr learned my addr 172.21.15.72:0/379536535 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:06.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.594+0000 7f8928f02700 1 -- 172.21.15.72:0/379536535 >> v2:172.21.15.92:3300/0 conn(0x7f89240a9cc0 msgr2=0x7f89241525e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:06.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.594+0000 7f8928f02700 1 --2- 172.21.15.72:0/379536535 >> v2:172.21.15.92:3300/0 conn(0x7f89240a9cc0 0x7f89241525e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:06.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.594+0000 7f8928f02700 1 -- 172.21.15.72:0/379536535 >> v1:172.21.15.92:6789/0 conn(0x7f892414f810 legacy=0x7f89240c4370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:06.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.594+0000 7f8928f02700 1 -- 172.21.15.72:0/379536535 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89241566a0 con 0x7f89240bb0b0 2023-07-25T14:36:06.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.594+0000 7f8928f02700 1 --2- 172.21.15.72:0/379536535 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f89240bb0b0 0x7f8924152b20 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f89240c1f90 tx=0x7f891c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fddee684726c60c server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:06.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.594+0000 7f8922ffd700 1 -- 172.21.15.72:0/379536535 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f891c00e070 con 0x7f89240bb0b0 2023-07-25T14:36:06.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.594+0000 7f8922ffd700 1 -- 172.21.15.72:0/379536535 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f891c003a70 con 0x7f89240bb0b0 2023-07-25T14:36:06.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.594+0000 7f8922ffd700 1 -- 172.21.15.72:0/379536535 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f891c003e20 con 0x7f89240bb0b0 2023-07-25T14:36:06.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.595+0000 7f892a965700 1 -- 172.21.15.72:0/379536535 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f89240bb0b0 msgr2=0x7f8924152b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:06.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.595+0000 7f892a965700 1 --2- 172.21.15.72:0/379536535 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f89240bb0b0 0x7f8924152b20 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f89240c1f90 tx=0x7f891c00b330 comp rx=0 tx=0).stop 2023-07-25T14:36:06.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.595+0000 7f892a965700 1 -- 172.21.15.72:0/379536535 shutdown_connections 2023-07-25T14:36:06.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.595+0000 7f892a965700 1 --2- 172.21.15.72:0/379536535 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f89240bb0b0 0x7f8924152b20 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:06.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.595+0000 7f892a965700 1 --2- 172.21.15.72:0/379536535 >> v2:172.21.15.92:3300/0 conn(0x7f89240a9cc0 0x7f89241525e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:06.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.595+0000 7f892a965700 1 -- 172.21.15.72:0/379536535 >> 172.21.15.72:0/379536535 conn(0x7f892406a8d0 msgr2=0x7f89240a94e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:06.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.595+0000 7f892a965700 1 -- 172.21.15.72:0/379536535 shutdown_connections 2023-07-25T14:36:06.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.595+0000 7f892a965700 1 -- 172.21.15.72:0/379536535 wait complete. 2023-07-25T14:36:06.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.596+0000 7f892a965700 1 Processor -- start 2023-07-25T14:36:06.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.596+0000 7f892a965700 1 -- start start 2023-07-25T14:36:06.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.597+0000 7f892a965700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f89240a9cc0 0x7f89241e7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:06.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.597+0000 7f892a965700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f89240bb0b0 0x7f89240a80b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:06.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.597+0000 7f892a965700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f892414f810 0x7f89241eb9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:06.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.597+0000 7f892a965700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89240bfc80 con 0x7f892414f810 2023-07-25T14:36:06.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.597+0000 7f892a965700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89241eb2c0 con 0x7f89240a9cc0 2023-07-25T14:36:06.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.597+0000 7f892a965700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89241eb560 con 0x7f89240bb0b0 2023-07-25T14:36:06.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.597+0000 7f8928f02700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f892414f810 0x7f89241eb9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:06.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.597+0000 7f8928f02700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f892414f810 0x7f89241eb9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40418/0 (socket says 172.21.15.72:40418) 2023-07-25T14:36:06.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.597+0000 7f8928f02700 1 -- 172.21.15.72:0/27946506 learned_addr learned my addr 172.21.15.72:0/27946506 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:06.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.597+0000 7f89237fe700 1 --2- 172.21.15.72:0/27946506 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f89240bb0b0 0x7f89240a80b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:06.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.597+0000 7f8923fff700 1 --2- 172.21.15.72:0/27946506 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f89240a9cc0 0x7f89241e7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:06.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.597+0000 7f8928f02700 1 -- 172.21.15.72:0/27946506 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f89240bb0b0 msgr2=0x7f89240a80b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:06.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.597+0000 7f8928f02700 1 --2- 172.21.15.72:0/27946506 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f89240bb0b0 0x7f89240a80b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:06.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.597+0000 7f8928f02700 1 -- 172.21.15.72:0/27946506 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f89240a9cc0 msgr2=0x7f89241e7cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:06.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.597+0000 7f8928f02700 1 --2- 172.21.15.72:0/27946506 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f89240a9cc0 0x7f89241e7cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:06.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.597+0000 7f8928f02700 1 -- 172.21.15.72:0/27946506 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f891c009b30 con 0x7f892414f810 2023-07-25T14:36:06.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.597+0000 7f89237fe700 1 --2- 172.21.15.72:0/27946506 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f89240bb0b0 0x7f89240a80b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-25T14:36:06.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.597+0000 7f8923fff700 1 --2- 172.21.15.72:0/27946506 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f89240a9cc0 0x7f89241e7cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-25T14:36:06.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.597+0000 7f8928f02700 1 --2- 172.21.15.72:0/27946506 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f892414f810 0x7f89241eb9f0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f891c00b370 tx=0x7f891c004b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:06.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.597+0000 7f8920ff9700 1 -- 172.21.15.72:0/27946506 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f891c0044c0 con 0x7f892414f810 2023-07-25T14:36:06.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.597+0000 7f8920ff9700 1 -- 172.21.15.72:0/27946506 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f891c004620 con 0x7f892414f810 2023-07-25T14:36:06.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.597+0000 7f8920ff9700 1 -- 172.21.15.72:0/27946506 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f891c012430 con 0x7f892414f810 2023-07-25T14:36:06.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.597+0000 7f892a965700 1 -- 172.21.15.72:0/27946506 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89240bf3e0 con 0x7f892414f810 2023-07-25T14:36:06.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.598+0000 7f892a965700 1 -- 172.21.15.72:0/27946506 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89240bf9a0 con 0x7f892414f810 2023-07-25T14:36:06.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.598+0000 7f892a965700 1 -- 172.21.15.72:0/27946506 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89241eb710 con 0x7f892414f810 2023-07-25T14:36:06.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.599+0000 7f8920ff9700 1 -- 172.21.15.72:0/27946506 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f891c019030 con 0x7f892414f810 2023-07-25T14:36:06.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.599+0000 7f8920ff9700 1 --2- 172.21.15.72:0/27946506 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f891006ace0 0x7f891006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:06.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.599+0000 7f8920ff9700 1 -- 172.21.15.72:0/27946506 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f891c08aaf0 con 0x7f892414f810 2023-07-25T14:36:06.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.599+0000 7f8923fff700 1 --2- 172.21.15.72:0/27946506 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f891006ace0 0x7f891006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:06.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.600+0000 7f8923fff700 1 --2- 172.21.15.72:0/27946506 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f891006ace0 0x7f891006d1a0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f89240c61c0 tx=0x7f8914009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:06.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.604+0000 7f8920ff9700 1 -- 172.21.15.72:0/27946506 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f89241eb710 con 0x7f892414f810 2023-07-25T14:36:06.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.791+0000 7f892a965700 1 -- 172.21.15.72:0/27946506 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f89241eb6d0 con 0x7f892414f810 2023-07-25T14:36:06.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.791+0000 7f8920ff9700 1 -- 172.21.15.72:0/27946506 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7f891c0558c0 con 0x7f892414f810 2023-07-25T14:36:06.804 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 8 2023-07-25T14:36:06.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.793+0000 7f892a965700 1 -- 172.21.15.72:0/27946506 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f891006ace0 msgr2=0x7f891006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:06.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.793+0000 7f892a965700 1 --2- 172.21.15.72:0/27946506 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f891006ace0 0x7f891006d1a0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f89240c61c0 tx=0x7f8914009040 comp rx=0 tx=0).stop 2023-07-25T14:36:06.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.793+0000 7f892a965700 1 -- 172.21.15.72:0/27946506 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f892414f810 msgr2=0x7f89241eb9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:06.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.793+0000 7f892a965700 1 --2- 172.21.15.72:0/27946506 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f892414f810 0x7f89241eb9f0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f891c00b370 tx=0x7f891c004b20 comp rx=0 tx=0).stop 2023-07-25T14:36:06.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.793+0000 7f892a965700 1 -- 172.21.15.72:0/27946506 shutdown_connections 2023-07-25T14:36:06.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.793+0000 7f892a965700 1 --2- 172.21.15.72:0/27946506 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f891006ace0 0x7f891006d1a0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:06.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.793+0000 7f892a965700 1 --2- 172.21.15.72:0/27946506 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f892414f810 0x7f89241eb9f0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:06.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.793+0000 7f892a965700 1 --2- 172.21.15.72:0/27946506 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f89240a9cc0 0x7f89241e7cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:06.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.793+0000 7f892a965700 1 --2- 172.21.15.72:0/27946506 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f89240bb0b0 0x7f89240a80b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:06.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.793+0000 7f892a965700 1 -- 172.21.15.72:0/27946506 >> 172.21.15.72:0/27946506 conn(0x7f892406a8d0 msgr2=0x7f89241507a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:06.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.793+0000 7f892a965700 1 -- 172.21.15.72:0/27946506 shutdown_connections 2023-07-25T14:36:06.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.793+0000 7f892a965700 1 -- 172.21.15.72:0/27946506 wait complete. 2023-07-25T14:36:06.817 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-25T14:36:06.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.928+0000 7fa7624c9700 1 Processor -- start 2023-07-25T14:36:06.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.928+0000 7fa7624c9700 1 -- start start 2023-07-25T14:36:06.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.928+0000 7fa7624c9700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa75c151ba0 0x7fa75c0c2230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:06.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.928+0000 7fa7624c9700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fa75c0c5f40 0x7fa75c154640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:06.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.928+0000 7fa7624c9700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa75c0c54f0 con 0x7fa75c0ba0e0 2023-07-25T14:36:06.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.928+0000 7fa7624c9700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa75c0c6670 con 0x7fa75c151ba0 2023-07-25T14:36:06.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.928+0000 7fa7624c9700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa75c0c5740 con 0x7fa75c0c5f40 2023-07-25T14:36:06.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.928+0000 7fa75bfff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fa75c151ba0 0x7fa75c0c2230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:06.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.929+0000 7fa760a66700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fa75c0ba0e0 0x7fa75c071740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:59394/0 (socket says 172.21.15.72:59394) 2023-07-25T14:36:06.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.929+0000 7fa760a66700 1 -- 172.21.15.72:0/24842675 learned_addr learned my addr 172.21.15.72:0/24842675 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:36:06.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.929+0000 7fa75b7fe700 1 --2- 172.21.15.72:0/24842675 >> v2:172.21.15.92:3300/0 conn(0x7fa75c0c5f40 0x7fa75c154640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:06.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.929+0000 7fa75bfff700 1 -- 172.21.15.72:0/24842675 >> v2:172.21.15.92:3300/0 conn(0x7fa75c0c5f40 msgr2=0x7fa75c154640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:06.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.929+0000 7fa75bfff700 1 --2- 172.21.15.72:0/24842675 >> v2:172.21.15.92:3300/0 conn(0x7fa75c0c5f40 0x7fa75c154640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:06.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.929+0000 7fa75bfff700 1 -- 172.21.15.72:0/24842675 >> v1:172.21.15.72:6789/0 conn(0x7fa75c0ba0e0 legacy=0x7fa75c071740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:06.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.929+0000 7fa75bfff700 1 -- 172.21.15.72:0/24842675 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa75c0c5a20 con 0x7fa75c151ba0 2023-07-25T14:36:06.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.929+0000 7fa75affd700 1 -- 172.21.15.72:0/24842675 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2124793756 0 0) 0x7fa75c0c54f0 con 0x7fa75c0ba0e0 2023-07-25T14:36:06.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.929+0000 7fa75b7fe700 1 --2- 172.21.15.72:0/24842675 >> v2:172.21.15.92:3300/0 conn(0x7fa75c0c5f40 0x7fa75c154640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-25T14:36:06.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.929+0000 7fa75bfff700 1 --2- 172.21.15.72:0/24842675 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa75c151ba0 0x7fa75c0c2230 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fa75c0727e0 tx=0x7fa74c009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d715f36c67f6d39 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:06.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.929+0000 7fa75affd700 1 -- 172.21.15.72:0/24842675 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa74c011830 con 0x7fa75c151ba0 2023-07-25T14:36:06.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.929+0000 7fa75affd700 1 -- 172.21.15.72:0/24842675 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa74c011990 con 0x7fa75c151ba0 2023-07-25T14:36:06.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.929+0000 7fa75affd700 1 -- 172.21.15.72:0/24842675 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa74c011d20 con 0x7fa75c151ba0 2023-07-25T14:36:06.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.930+0000 7fa7624c9700 1 -- 172.21.15.72:0/24842675 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa75c151ba0 msgr2=0x7fa75c0c2230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:06.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.930+0000 7fa7624c9700 1 --2- 172.21.15.72:0/24842675 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa75c151ba0 0x7fa75c0c2230 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fa75c0727e0 tx=0x7fa74c009b20 comp rx=0 tx=0).stop 2023-07-25T14:36:06.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.930+0000 7fa7624c9700 1 -- 172.21.15.72:0/24842675 shutdown_connections 2023-07-25T14:36:06.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.930+0000 7fa7624c9700 1 --2- 172.21.15.72:0/24842675 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa75c151ba0 0x7fa75c0c2230 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:06.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.930+0000 7fa7624c9700 1 --2- 172.21.15.72:0/24842675 >> v2:172.21.15.92:3300/0 conn(0x7fa75c0c5f40 0x7fa75c154640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:06.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.930+0000 7fa7624c9700 1 -- 172.21.15.72:0/24842675 >> 172.21.15.72:0/24842675 conn(0x7fa75c0a87e0 msgr2=0x7fa75c0a8bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:06.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.930+0000 7fa7624c9700 1 -- 172.21.15.72:0/24842675 shutdown_connections 2023-07-25T14:36:06.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.930+0000 7fa7624c9700 1 -- 172.21.15.72:0/24842675 wait complete. 2023-07-25T14:36:06.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.931+0000 7fa7624c9700 1 Processor -- start 2023-07-25T14:36:06.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.931+0000 7fa7624c9700 1 -- start start 2023-07-25T14:36:06.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.932+0000 7fa7624c9700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa75c0ba0e0 0x7fa75c1529a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:06.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.932+0000 7fa7624c9700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa75c0c5f40 0x7fa75c1ea020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:06.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.932+0000 7fa7624c9700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa75c151ba0 0x7fa75c1e6c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:06.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.932+0000 7fa7624c9700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa75c1ea560 con 0x7fa75c0ba0e0 2023-07-25T14:36:06.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.932+0000 7fa7624c9700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa75c0bb880 con 0x7fa75c0c5f40 2023-07-25T14:36:06.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.932+0000 7fa7624c9700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa75c0c4bb0 con 0x7fa75c151ba0 2023-07-25T14:36:06.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.932+0000 7fa75bfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa75c0ba0e0 0x7fa75c1529a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:06.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.932+0000 7fa75bfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa75c0ba0e0 0x7fa75c1529a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40428/0 (socket says 172.21.15.72:40428) 2023-07-25T14:36:06.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.932+0000 7fa75bfff700 1 -- 172.21.15.72:0/4110132447 learned_addr learned my addr 172.21.15.72:0/4110132447 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:06.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.932+0000 7fa75b7fe700 1 --2- 172.21.15.72:0/4110132447 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa75c0c5f40 0x7fa75c1ea020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:06.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.932+0000 7fa760a66700 1 --2- 172.21.15.72:0/4110132447 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa75c151ba0 0x7fa75c1e6c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:06.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.932+0000 7fa75bfff700 1 -- 172.21.15.72:0/4110132447 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa75c151ba0 msgr2=0x7fa75c1e6c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:06.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.932+0000 7fa75bfff700 1 --2- 172.21.15.72:0/4110132447 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa75c151ba0 0x7fa75c1e6c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:06.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.932+0000 7fa75bfff700 1 -- 172.21.15.72:0/4110132447 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa75c0c5f40 msgr2=0x7fa75c1ea020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:06.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.932+0000 7fa75bfff700 1 --2- 172.21.15.72:0/4110132447 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa75c0c5f40 0x7fa75c1ea020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:06.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.932+0000 7fa75bfff700 1 -- 172.21.15.72:0/4110132447 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa74c0094a0 con 0x7fa75c0ba0e0 2023-07-25T14:36:06.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.932+0000 7fa760a66700 1 --2- 172.21.15.72:0/4110132447 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa75c151ba0 0x7fa75c1e6c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-25T14:36:06.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.932+0000 7fa75bfff700 1 --2- 172.21.15.72:0/4110132447 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa75c0ba0e0 0x7fa75c1529a0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fa74c014040 tx=0x7fa74c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:06.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.932+0000 7fa758ff9700 1 -- 172.21.15.72:0/4110132447 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa74c0038a0 con 0x7fa75c0ba0e0 2023-07-25T14:36:06.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.932+0000 7fa758ff9700 1 -- 172.21.15.72:0/4110132447 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa74c01e070 con 0x7fa75c0ba0e0 2023-07-25T14:36:06.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.932+0000 7fa758ff9700 1 -- 172.21.15.72:0/4110132447 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa74c003c20 con 0x7fa75c0ba0e0 2023-07-25T14:36:06.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.932+0000 7fa7624c9700 1 -- 172.21.15.72:0/4110132447 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa75c0bcd10 con 0x7fa75c0ba0e0 2023-07-25T14:36:06.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.932+0000 7fa7624c9700 1 -- 172.21.15.72:0/4110132447 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa75c0bd2d0 con 0x7fa75c0ba0e0 2023-07-25T14:36:06.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.933+0000 7fa7624c9700 1 -- 172.21.15.72:0/4110132447 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa75c04e470 con 0x7fa75c0ba0e0 2023-07-25T14:36:06.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.934+0000 7fa758ff9700 1 -- 172.21.15.72:0/4110132447 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa74c02d450 con 0x7fa75c0ba0e0 2023-07-25T14:36:06.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.934+0000 7fa758ff9700 1 --2- 172.21.15.72:0/4110132447 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fa74806ace0 0x7fa74806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:06.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.934+0000 7fa758ff9700 1 -- 172.21.15.72:0/4110132447 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fa74c08a6f0 con 0x7fa75c0ba0e0 2023-07-25T14:36:06.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.934+0000 7fa75b7fe700 1 --2- 172.21.15.72:0/4110132447 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fa74806ace0 0x7fa74806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:06.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.934+0000 7fa75b7fe700 1 --2- 172.21.15.72:0/4110132447 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fa74806ace0 0x7fa74806d1a0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fa75c0c6320 tx=0x7fa750008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:06.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:06.938+0000 7fa758ff9700 1 -- 172.21.15.72:0/4110132447 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fa74c055540 con 0x7fa75c0ba0e0 2023-07-25T14:36:07.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.123+0000 7fa7624c9700 1 -- 172.21.15.72:0/4110132447 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa75c0c52d0 con 0x7fa75c0ba0e0 2023-07-25T14:36:07.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.124+0000 7fa758ff9700 1 -- 172.21.15.72:0/4110132447 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa74c02c3b0 con 0x7fa75c0ba0e0 2023-07-25T14:36:07.136 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 1 2023-07-25T14:36:07.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.126+0000 7fa7624c9700 1 -- 172.21.15.72:0/4110132447 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fa74806ace0 msgr2=0x7fa74806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:07.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.126+0000 7fa7624c9700 1 --2- 172.21.15.72:0/4110132447 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fa74806ace0 0x7fa74806d1a0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fa75c0c6320 tx=0x7fa750008040 comp rx=0 tx=0).stop 2023-07-25T14:36:07.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.126+0000 7fa7624c9700 1 -- 172.21.15.72:0/4110132447 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa75c0ba0e0 msgr2=0x7fa75c1529a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:07.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.126+0000 7fa7624c9700 1 --2- 172.21.15.72:0/4110132447 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa75c0ba0e0 0x7fa75c1529a0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fa74c014040 tx=0x7fa74c004750 comp rx=0 tx=0).stop 2023-07-25T14:36:07.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.126+0000 7fa7624c9700 1 -- 172.21.15.72:0/4110132447 shutdown_connections 2023-07-25T14:36:07.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.126+0000 7fa7624c9700 1 --2- 172.21.15.72:0/4110132447 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fa74806ace0 0x7fa74806d1a0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:07.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.126+0000 7fa7624c9700 1 --2- 172.21.15.72:0/4110132447 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa75c151ba0 0x7fa75c1e6c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:07.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.126+0000 7fa7624c9700 1 --2- 172.21.15.72:0/4110132447 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa75c0ba0e0 0x7fa75c1529a0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:07.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.126+0000 7fa7624c9700 1 --2- 172.21.15.72:0/4110132447 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa75c0c5f40 0x7fa75c1ea020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:07.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.126+0000 7fa7624c9700 1 -- 172.21.15.72:0/4110132447 >> 172.21.15.72:0/4110132447 conn(0x7fa75c0a87e0 msgr2=0x7fa75c14f430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:07.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.126+0000 7fa7624c9700 1 -- 172.21.15.72:0/4110132447 shutdown_connections 2023-07-25T14:36:07.140 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.126+0000 7fa7624c9700 1 -- 172.21.15.72:0/4110132447 wait complete. 2023-07-25T14:36:07.150 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-25T14:36:07.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.260+0000 7fb98204c700 1 Processor -- start 2023-07-25T14:36:07.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.260+0000 7fb98204c700 1 -- start start 2023-07-25T14:36:07.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.261+0000 7fb98204c700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fb97c06ed70 0x7fb97c0bf9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:07.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.261+0000 7fb98204c700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb97c066050 con 0x7fb97c06a190 2023-07-25T14:36:07.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.261+0000 7fb98204c700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb97c06b560 con 0x7fb97c0bf5d0 2023-07-25T14:36:07.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.261+0000 7fb98204c700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb97c151be0 con 0x7fb97c06ed70 2023-07-25T14:36:07.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.261+0000 7fb97bfff700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fb97c06a190 0x7fb97c15ebc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:59408/0 (socket says 172.21.15.72:59408) 2023-07-25T14:36:07.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.261+0000 7fb97bfff700 1 -- 172.21.15.72:0/2700050514 learned_addr learned my addr 172.21.15.72:0/2700050514 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:36:07.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.261+0000 7fb97affd700 1 --2- 172.21.15.72:0/2700050514 >> v2:172.21.15.92:3300/0 conn(0x7fb97c06ed70 0x7fb97c0bf9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:07.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.261+0000 7fb97a7fc700 1 -- 172.21.15.72:0/2700050514 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3893567221 0 0) 0x7fb97c066050 con 0x7fb97c06a190 2023-07-25T14:36:07.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.261+0000 7fb97a7fc700 1 -- 172.21.15.72:0/2700050514 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb9640035b0 con 0x7fb97c06a190 2023-07-25T14:36:07.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.262+0000 7fb97a7fc700 1 -- 172.21.15.72:0/2700050514 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 290735288 0 0) 0x7fb9640035b0 con 0x7fb97c06a190 2023-07-25T14:36:07.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.262+0000 7fb97a7fc700 1 -- 172.21.15.72:0/2700050514 >> v2:172.21.15.92:3300/0 conn(0x7fb97c06ed70 msgr2=0x7fb97c0bf9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:07.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.262+0000 7fb97a7fc700 1 --2- 172.21.15.72:0/2700050514 >> v2:172.21.15.92:3300/0 conn(0x7fb97c06ed70 0x7fb97c0bf9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:07.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.262+0000 7fb97a7fc700 1 -- 172.21.15.72:0/2700050514 >> v1:172.21.15.92:6789/0 conn(0x7fb97c0bf5d0 legacy=0x7fb97c0a7490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:07.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.262+0000 7fb97a7fc700 1 -- 172.21.15.72:0/2700050514 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb97c154d60 con 0x7fb97c06a190 2023-07-25T14:36:07.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.262+0000 7fb97a7fc700 1 -- 172.21.15.72:0/2700050514 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2559588315 0 0) 0x7fb9740019f0 con 0x7fb97c06a190 2023-07-25T14:36:07.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.262+0000 7fb97a7fc700 1 -- 172.21.15.72:0/2700050514 >> v1:172.21.15.72:6789/0 conn(0x7fb97c06a190 legacy=0x7fb97c15ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:07.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.262+0000 7fb97a7fc700 1 --2- 172.21.15.72:0/2700050514 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb964003a00 0x7fb964003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:07.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.262+0000 7fb97a7fc700 1 --2- 172.21.15.72:0/2700050514 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb964004850 0x7fb964004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:07.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.262+0000 7fb97a7fc700 1 --2- 172.21.15.72:0/2700050514 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb964005210 0x7fb96400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:07.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.262+0000 7fb97a7fc700 1 -- 172.21.15.72:0/2700050514 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb97c151be0 con 0x7fb964005210 2023-07-25T14:36:07.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.262+0000 7fb97a7fc700 1 -- 172.21.15.72:0/2700050514 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb96400c0b0 con 0x7fb964004850 2023-07-25T14:36:07.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.262+0000 7fb97a7fc700 1 -- 172.21.15.72:0/2700050514 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb96400c270 con 0x7fb964003a00 2023-07-25T14:36:07.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.262+0000 7fb97bfff700 1 --2- 172.21.15.72:0/2700050514 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb964005210 0x7fb96400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:07.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.262+0000 7fb97b7fe700 1 --2- 172.21.15.72:0/2700050514 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb964003a00 0x7fb964003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:07.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.262+0000 7fb97affd700 1 --2- 172.21.15.72:0/2700050514 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb964004850 0x7fb964004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:07.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.262+0000 7fb97bfff700 1 -- 172.21.15.72:0/2700050514 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb964003a00 msgr2=0x7fb964003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:07.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.262+0000 7fb97bfff700 1 --2- 172.21.15.72:0/2700050514 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb964003a00 0x7fb964003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:07.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.262+0000 7fb97bfff700 1 -- 172.21.15.72:0/2700050514 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb964004850 msgr2=0x7fb964004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:07.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.262+0000 7fb97bfff700 1 --2- 172.21.15.72:0/2700050514 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb964004850 0x7fb964004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:07.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.262+0000 7fb97bfff700 1 -- 172.21.15.72:0/2700050514 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9640035b0 con 0x7fb964005210 2023-07-25T14:36:07.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.262+0000 7fb97bfff700 1 -- 172.21.15.72:0/2700050514 reap_dead start 2023-07-25T14:36:07.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.262+0000 7fb97bfff700 1 --2- 172.21.15.72:0/2700050514 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb964005210 0x7fb96400ba10 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fb97400a830 tx=0x7fb964005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1736b2bdb384886 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:07.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.262+0000 7fb97a7fc700 1 -- 172.21.15.72:0/2700050514 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb97400a2f0 con 0x7fb964005210 2023-07-25T14:36:07.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.262+0000 7fb97a7fc700 1 -- 172.21.15.72:0/2700050514 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb974012600 con 0x7fb964005210 2023-07-25T14:36:07.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.262+0000 7fb97a7fc700 1 -- 172.21.15.72:0/2700050514 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9740129b0 con 0x7fb964005210 2023-07-25T14:36:07.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.263+0000 7fb98204c700 1 -- 172.21.15.72:0/2700050514 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb964005210 msgr2=0x7fb96400ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:07.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.263+0000 7fb98204c700 1 --2- 172.21.15.72:0/2700050514 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb964005210 0x7fb96400ba10 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fb97400a830 tx=0x7fb964005880 comp rx=0 tx=0).stop 2023-07-25T14:36:07.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.263+0000 7fb98204c700 1 -- 172.21.15.72:0/2700050514 shutdown_connections 2023-07-25T14:36:07.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.263+0000 7fb98204c700 1 --2- 172.21.15.72:0/2700050514 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb964005210 0x7fb96400ba10 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:07.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.263+0000 7fb98204c700 1 -- 172.21.15.72:0/2700050514 >> 172.21.15.72:0/2700050514 conn(0x7fb97c06def0 msgr2=0x7fb97c06e300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:07.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.263+0000 7fb98204c700 1 -- 172.21.15.72:0/2700050514 shutdown_connections 2023-07-25T14:36:07.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.263+0000 7fb98204c700 1 -- 172.21.15.72:0/2700050514 wait complete. 2023-07-25T14:36:07.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.264+0000 7fb98204c700 1 Processor -- start 2023-07-25T14:36:07.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.264+0000 7fb98204c700 1 -- start start 2023-07-25T14:36:07.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.265+0000 7fb98204c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb964005210 0x7fb97c1e0dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:07.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.265+0000 7fb98204c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb97c1eacd0 0x7fb97c1529b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:07.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.265+0000 7fb98204c700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb97c152ef0 0x7fb97c1ed7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:07.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.265+0000 7fb98204c700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb97c157860 con 0x7fb964005210 2023-07-25T14:36:07.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.265+0000 7fb98204c700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb97c1eb1d0 con 0x7fb97c1eacd0 2023-07-25T14:36:07.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.265+0000 7fb98204c700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb97c153770 con 0x7fb97c152ef0 2023-07-25T14:36:07.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.265+0000 7fb97b7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb964005210 0x7fb97c1e0dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:07.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.265+0000 7fb97b7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb964005210 0x7fb97c1e0dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40448/0 (socket says 172.21.15.72:40448) 2023-07-25T14:36:07.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.265+0000 7fb97b7fe700 1 -- 172.21.15.72:0/2472941366 learned_addr learned my addr 172.21.15.72:0/2472941366 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:07.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.265+0000 7fb97bfff700 1 --2- 172.21.15.72:0/2472941366 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb97c152ef0 0x7fb97c1ed7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:07.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.265+0000 7fb97affd700 1 --2- 172.21.15.72:0/2472941366 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb97c1eacd0 0x7fb97c1529b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:07.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.265+0000 7fb97b7fe700 1 -- 172.21.15.72:0/2472941366 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb97c152ef0 msgr2=0x7fb97c1ed7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:07.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.265+0000 7fb97b7fe700 1 --2- 172.21.15.72:0/2472941366 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb97c152ef0 0x7fb97c1ed7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:07.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.265+0000 7fb97b7fe700 1 -- 172.21.15.72:0/2472941366 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb97c1eacd0 msgr2=0x7fb97c1529b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:07.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.265+0000 7fb97b7fe700 1 --2- 172.21.15.72:0/2472941366 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb97c1eacd0 0x7fb97c1529b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:07.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.265+0000 7fb97b7fe700 1 -- 172.21.15.72:0/2472941366 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb97c153a50 con 0x7fb964005210 2023-07-25T14:36:07.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.265+0000 7fb97bfff700 1 --2- 172.21.15.72:0/2472941366 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb97c152ef0 0x7fb97c1ed7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-25T14:36:07.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.266+0000 7fb97b7fe700 1 --2- 172.21.15.72:0/2472941366 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb964005210 0x7fb97c1e0dc0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fb97000f7f0 tx=0x7fb97000fbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:07.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.266+0000 7fb963fff700 1 -- 172.21.15.72:0/2472941366 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb970005320 con 0x7fb964005210 2023-07-25T14:36:07.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.266+0000 7fb963fff700 1 -- 172.21.15.72:0/2472941366 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb970005480 con 0x7fb964005210 2023-07-25T14:36:07.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.266+0000 7fb98204c700 1 -- 172.21.15.72:0/2472941366 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb97c153d30 con 0x7fb964005210 2023-07-25T14:36:07.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.266+0000 7fb963fff700 1 -- 172.21.15.72:0/2472941366 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb970006aa0 con 0x7fb964005210 2023-07-25T14:36:07.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.266+0000 7fb98204c700 1 -- 172.21.15.72:0/2472941366 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb97c1e1300 con 0x7fb964005210 2023-07-25T14:36:07.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.267+0000 7fb98204c700 1 -- 172.21.15.72:0/2472941366 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb97c1526d0 con 0x7fb964005210 2023-07-25T14:36:07.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.267+0000 7fb963fff700 1 -- 172.21.15.72:0/2472941366 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb970006c00 con 0x7fb964005210 2023-07-25T14:36:07.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.268+0000 7fb963fff700 1 --2- 172.21.15.72:0/2472941366 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fb96806ad10 0x7fb96806d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:07.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.268+0000 7fb963fff700 1 -- 172.21.15.72:0/2472941366 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fb970089060 con 0x7fb964005210 2023-07-25T14:36:07.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.268+0000 7fb97affd700 1 --2- 172.21.15.72:0/2472941366 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fb96806ad10 0x7fb96806d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:07.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.268+0000 7fb97affd700 1 --2- 172.21.15.72:0/2472941366 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fb96806ad10 0x7fb96806d1d0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fb96c009be0 tx=0x7fb96c009210 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:07.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.272+0000 7fb963fff700 1 -- 172.21.15.72:0/2472941366 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fb970053f90 con 0x7fb964005210 2023-07-25T14:36:07.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.458+0000 7fb98204c700 1 -- 172.21.15.72:0/2472941366 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb97c1526d0 con 0x7fb964005210 2023-07-25T14:36:07.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.458+0000 7fb963fff700 1 -- 172.21.15.72:0/2472941366 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb97c1526d0 con 0x7fb964005210 2023-07-25T14:36:07.471 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2023-07-25T14:36:07.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.460+0000 7fb98204c700 1 -- 172.21.15.72:0/2472941366 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fb96806ad10 msgr2=0x7fb96806d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:07.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.460+0000 7fb98204c700 1 --2- 172.21.15.72:0/2472941366 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fb96806ad10 0x7fb96806d1d0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fb96c009be0 tx=0x7fb96c009210 comp rx=0 tx=0).stop 2023-07-25T14:36:07.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.460+0000 7fb98204c700 1 -- 172.21.15.72:0/2472941366 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb964005210 msgr2=0x7fb97c1e0dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:07.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.460+0000 7fb98204c700 1 --2- 172.21.15.72:0/2472941366 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb964005210 0x7fb97c1e0dc0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fb97000f7f0 tx=0x7fb97000fbb0 comp rx=0 tx=0).stop 2023-07-25T14:36:07.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.460+0000 7fb98204c700 1 -- 172.21.15.72:0/2472941366 shutdown_connections 2023-07-25T14:36:07.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.460+0000 7fb98204c700 1 --2- 172.21.15.72:0/2472941366 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fb96806ad10 0x7fb96806d1d0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:07.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.460+0000 7fb98204c700 1 --2- 172.21.15.72:0/2472941366 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb97c152ef0 0x7fb97c1ed7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:07.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.460+0000 7fb98204c700 1 --2- 172.21.15.72:0/2472941366 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb964005210 0x7fb97c1e0dc0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:07.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.460+0000 7fb98204c700 1 --2- 172.21.15.72:0/2472941366 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb97c1eacd0 0x7fb97c1529b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:07.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.460+0000 7fb98204c700 1 -- 172.21.15.72:0/2472941366 >> 172.21.15.72:0/2472941366 conn(0x7fb97c06def0 msgr2=0x7fb97c1502c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:07.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.460+0000 7fb98204c700 1 -- 172.21.15.72:0/2472941366 shutdown_connections 2023-07-25T14:36:07.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.460+0000 7fb98204c700 1 -- 172.21.15.72:0/2472941366 wait complete. 2023-07-25T14:36:07.485 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-25T14:36:07.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.596+0000 7f0125747700 1 Processor -- start 2023-07-25T14:36:07.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.596+0000 7f0125747700 1 -- start start 2023-07-25T14:36:07.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.596+0000 7f0125747700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f0120154c40 0x7f012006e410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:07.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.596+0000 7f0125747700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f012006da20 con 0x7f0120071740 2023-07-25T14:36:07.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.596+0000 7f0125747700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0120071b90 con 0x7f01200c4ff0 2023-07-25T14:36:07.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.596+0000 7f0125747700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f012006e170 con 0x7f0120154c40 2023-07-25T14:36:07.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.596+0000 7f011f7fe700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f0120071740 0x7f01200c04e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:59428/0 (socket says 172.21.15.72:59428) 2023-07-25T14:36:07.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.596+0000 7f011f7fe700 1 -- 172.21.15.72:0/3232575384 learned_addr learned my addr 172.21.15.72:0/3232575384 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:36:07.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.596+0000 7f011e7fc700 1 --2- 172.21.15.72:0/3232575384 >> v2:172.21.15.92:3300/0 conn(0x7f0120154c40 0x7f012006e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:07.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.597+0000 7f011dffb700 1 -- 172.21.15.72:0/3232575384 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2908942683 0 0) 0x7f012006da20 con 0x7f0120071740 2023-07-25T14:36:07.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.597+0000 7f011dffb700 1 -- 172.21.15.72:0/3232575384 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f01080035b0 con 0x7f0120071740 2023-07-25T14:36:07.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.597+0000 7f011e7fc700 1 -- 172.21.15.72:0/3232575384 >> v1:172.21.15.92:6789/0 conn(0x7f01200c4ff0 legacy=0x7f0120154530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:07.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.597+0000 7f011e7fc700 1 -- 172.21.15.72:0/3232575384 >> v1:172.21.15.72:6789/0 conn(0x7f0120071740 legacy=0x7f01200c04e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:07.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.597+0000 7f011e7fc700 1 -- 172.21.15.72:0/3232575384 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f012006d0f0 con 0x7f0120154c40 2023-07-25T14:36:07.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.597+0000 7f011e7fc700 1 --2- 172.21.15.72:0/3232575384 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0120154c40 0x7f012006e410 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f011000a9e0 tx=0x7f011000acf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ad7762c73c1121a5 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:07.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.597+0000 7f011dffb700 1 -- 172.21.15.72:0/3232575384 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f011000cb70 con 0x7f0120154c40 2023-07-25T14:36:07.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.597+0000 7f011dffb700 1 -- 172.21.15.72:0/3232575384 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f011000ccd0 con 0x7f0120154c40 2023-07-25T14:36:07.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.597+0000 7f011dffb700 1 -- 172.21.15.72:0/3232575384 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0110018620 con 0x7f0120154c40 2023-07-25T14:36:07.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.598+0000 7f0125747700 1 -- 172.21.15.72:0/3232575384 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0120154c40 msgr2=0x7f012006e410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:07.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.598+0000 7f0125747700 1 --2- 172.21.15.72:0/3232575384 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0120154c40 0x7f012006e410 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f011000a9e0 tx=0x7f011000acf0 comp rx=0 tx=0).stop 2023-07-25T14:36:07.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.598+0000 7f0125747700 1 -- 172.21.15.72:0/3232575384 shutdown_connections 2023-07-25T14:36:07.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.598+0000 7f0125747700 1 --2- 172.21.15.72:0/3232575384 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0120154c40 0x7f012006e410 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:07.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.598+0000 7f0125747700 1 -- 172.21.15.72:0/3232575384 >> 172.21.15.72:0/3232575384 conn(0x7f01200a7510 msgr2=0x7f01200a78f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:07.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.598+0000 7f0125747700 1 -- 172.21.15.72:0/3232575384 shutdown_connections 2023-07-25T14:36:07.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.598+0000 7f0125747700 1 -- 172.21.15.72:0/3232575384 wait complete. 2023-07-25T14:36:07.617 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.599+0000 7f0125747700 1 Processor -- start 2023-07-25T14:36:07.617 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.599+0000 7f0125747700 1 -- start start 2023-07-25T14:36:07.617 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.600+0000 7f0125747700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0120071740 0x7f0120150280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:07.617 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.600+0000 7f0125747700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f01200c4ff0 0x7f01200a9a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:07.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.600+0000 7f0125747700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0120154c40 0x7f01201e6640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:07.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.600+0000 7f0125747700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f012014f330 con 0x7f01200c4ff0 2023-07-25T14:36:07.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.600+0000 7f0125747700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01200a9670 con 0x7f0120071740 2023-07-25T14:36:07.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.600+0000 7f0125747700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01200a8c20 con 0x7f0120154c40 2023-07-25T14:36:07.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.600+0000 7f011e7fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f01200c4ff0 0x7f01200a9a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:07.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.600+0000 7f011e7fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f01200c4ff0 0x7f01200a9a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40464/0 (socket says 172.21.15.72:40464) 2023-07-25T14:36:07.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.600+0000 7f011e7fc700 1 -- 172.21.15.72:0/2652989947 learned_addr learned my addr 172.21.15.72:0/2652989947 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:07.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.600+0000 7f011effd700 1 --2- 172.21.15.72:0/2652989947 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0120071740 0x7f0120150280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:07.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.600+0000 7f011f7fe700 1 --2- 172.21.15.72:0/2652989947 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0120154c40 0x7f01201e6640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:07.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.600+0000 7f011e7fc700 1 -- 172.21.15.72:0/2652989947 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0120154c40 msgr2=0x7f01201e6640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:07.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.600+0000 7f011e7fc700 1 --2- 172.21.15.72:0/2652989947 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0120154c40 0x7f01201e6640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:07.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.600+0000 7f011e7fc700 1 -- 172.21.15.72:0/2652989947 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0120071740 msgr2=0x7f0120150280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:07.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.600+0000 7f011e7fc700 1 --2- 172.21.15.72:0/2652989947 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0120071740 0x7f0120150280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:07.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.600+0000 7f011e7fc700 1 -- 172.21.15.72:0/2652989947 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f011000a640 con 0x7f01200c4ff0 2023-07-25T14:36:07.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.600+0000 7f011effd700 1 --2- 172.21.15.72:0/2652989947 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0120071740 0x7f0120150280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-25T14:36:07.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.600+0000 7f011e7fc700 1 --2- 172.21.15.72:0/2652989947 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f01200c4ff0 0x7f01200a9a90 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f011000a1c0 tx=0x7f01100047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:07.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.600+0000 7f01077fe700 1 -- 172.21.15.72:0/2652989947 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0110003ab0 con 0x7f01200c4ff0 2023-07-25T14:36:07.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.600+0000 7f01077fe700 1 -- 172.21.15.72:0/2652989947 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0110003c10 con 0x7f01200c4ff0 2023-07-25T14:36:07.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.600+0000 7f0125747700 1 -- 172.21.15.72:0/2652989947 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01200a91e0 con 0x7f01200c4ff0 2023-07-25T14:36:07.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.600+0000 7f01077fe700 1 -- 172.21.15.72:0/2652989947 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0110021480 con 0x7f01200c4ff0 2023-07-25T14:36:07.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.600+0000 7f0125747700 1 -- 172.21.15.72:0/2652989947 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01201526d0 con 0x7f01200c4ff0 2023-07-25T14:36:07.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.601+0000 7f0125747700 1 -- 172.21.15.72:0/2652989947 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01200a9370 con 0x7f01200c4ff0 2023-07-25T14:36:07.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.602+0000 7f01077fe700 1 -- 172.21.15.72:0/2652989947 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0110018400 con 0x7f01200c4ff0 2023-07-25T14:36:07.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.602+0000 7f01077fe700 1 --2- 172.21.15.72:0/2652989947 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f010c06acb0 0x7f010c06d170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:07.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.602+0000 7f01077fe700 1 -- 172.21.15.72:0/2652989947 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f011008ad60 con 0x7f01200c4ff0 2023-07-25T14:36:07.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.602+0000 7f011effd700 1 --2- 172.21.15.72:0/2652989947 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f010c06acb0 0x7f010c06d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:07.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.603+0000 7f011effd700 1 --2- 172.21.15.72:0/2652989947 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f010c06acb0 0x7f010c06d170 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f0114000f60 tx=0x7f0114009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:07.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.606+0000 7f01077fe700 1 -- 172.21.15.72:0/2652989947 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f0110055be0 con 0x7f01200c4ff0 2023-07-25T14:36:07.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.795+0000 7f0125747700 1 -- 172.21.15.72:0/2652989947 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f012006d680 con 0x7f01200c4ff0 2023-07-25T14:36:07.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.796+0000 7f01077fe700 1 -- 172.21.15.72:0/2652989947 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0110059200 con 0x7f01200c4ff0 2023-07-25T14:36:07.808 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 64 2023-07-25T14:36:07.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.798+0000 7f0125747700 1 -- 172.21.15.72:0/2652989947 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f010c06acb0 msgr2=0x7f010c06d170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:07.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.798+0000 7f0125747700 1 --2- 172.21.15.72:0/2652989947 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f010c06acb0 0x7f010c06d170 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f0114000f60 tx=0x7f0114009040 comp rx=0 tx=0).stop 2023-07-25T14:36:07.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.798+0000 7f0125747700 1 -- 172.21.15.72:0/2652989947 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f01200c4ff0 msgr2=0x7f01200a9a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:07.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.798+0000 7f0125747700 1 --2- 172.21.15.72:0/2652989947 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f01200c4ff0 0x7f01200a9a90 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f011000a1c0 tx=0x7f01100047c0 comp rx=0 tx=0).stop 2023-07-25T14:36:07.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.798+0000 7f0125747700 1 -- 172.21.15.72:0/2652989947 shutdown_connections 2023-07-25T14:36:07.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.798+0000 7f0125747700 1 --2- 172.21.15.72:0/2652989947 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f010c06acb0 0x7f010c06d170 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:07.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.798+0000 7f0125747700 1 --2- 172.21.15.72:0/2652989947 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0120154c40 0x7f01201e6640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:07.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.798+0000 7f0125747700 1 --2- 172.21.15.72:0/2652989947 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0120071740 0x7f0120150280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:07.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.798+0000 7f0125747700 1 --2- 172.21.15.72:0/2652989947 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f01200c4ff0 0x7f01200a9a90 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:07.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.798+0000 7f0125747700 1 -- 172.21.15.72:0/2652989947 >> 172.21.15.72:0/2652989947 conn(0x7f01200a7510 msgr2=0x7f01200a5480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:07.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.798+0000 7f0125747700 1 -- 172.21.15.72:0/2652989947 shutdown_connections 2023-07-25T14:36:07.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.798+0000 7f0125747700 1 -- 172.21.15.72:0/2652989947 wait complete. 2023-07-25T14:36:07.822 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-07-25T14:36:07.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.932+0000 7f8f043ac700 1 Processor -- start 2023-07-25T14:36:07.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.932+0000 7f8f043ac700 1 -- start start 2023-07-25T14:36:07.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.933+0000 7f8f043ac700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f8efc151950 0x7f8efc06a190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:07.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.933+0000 7f8f043ac700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8efc0c2fe0 con 0x7f8efc06a6d0 2023-07-25T14:36:07.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.933+0000 7f8f043ac700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8efc155070 con 0x7f8efc0724c0 2023-07-25T14:36:07.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.933+0000 7f8f043ac700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8efc071a60 con 0x7f8efc151950 2023-07-25T14:36:07.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.933+0000 7f8f02949700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f8efc06a6d0 0x7f8efc0c3bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:59442/0 (socket says 172.21.15.72:59442) 2023-07-25T14:36:07.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.933+0000 7f8f02949700 1 -- 172.21.15.72:0/4099532623 learned_addr learned my addr 172.21.15.72:0/4099532623 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:36:07.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.933+0000 7f8f02148700 1 --2- 172.21.15.72:0/4099532623 >> v2:172.21.15.92:3300/0 conn(0x7f8efc151950 0x7f8efc06a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:07.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.933+0000 7f8f01146700 1 -- 172.21.15.72:0/4099532623 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2232244957 0 0) 0x7f8efc0c2fe0 con 0x7f8efc06a6d0 2023-07-25T14:36:07.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.933+0000 7f8f01146700 1 -- 172.21.15.72:0/4099532623 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8ee80035b0 con 0x7f8efc06a6d0 2023-07-25T14:36:07.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.933+0000 7f8f02148700 1 -- 172.21.15.72:0/4099532623 >> v1:172.21.15.92:6789/0 conn(0x7f8efc0724c0 legacy=0x7f8efc0c34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:07.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.933+0000 7f8f02148700 1 -- 172.21.15.72:0/4099532623 >> v1:172.21.15.72:6789/0 conn(0x7f8efc06a6d0 legacy=0x7f8efc0c3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:07.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.933+0000 7f8f02148700 1 -- 172.21.15.72:0/4099532623 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8efc0c15c0 con 0x7f8efc151950 2023-07-25T14:36:07.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.934+0000 7f8f02148700 1 --2- 172.21.15.72:0/4099532623 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8efc151950 0x7f8efc06a190 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f8ef8009840 tx=0x7f8ef8009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d5ac7a2a066239ce server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:07.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.934+0000 7f8f01146700 1 -- 172.21.15.72:0/4099532623 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ef8011830 con 0x7f8efc151950 2023-07-25T14:36:07.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.934+0000 7f8f01146700 1 -- 172.21.15.72:0/4099532623 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ef8011990 con 0x7f8efc151950 2023-07-25T14:36:07.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.934+0000 7f8f01146700 1 -- 172.21.15.72:0/4099532623 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ef8011d00 con 0x7f8efc151950 2023-07-25T14:36:07.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.934+0000 7f8f043ac700 1 -- 172.21.15.72:0/4099532623 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8efc151950 msgr2=0x7f8efc06a190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:07.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.934+0000 7f8f043ac700 1 --2- 172.21.15.72:0/4099532623 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8efc151950 0x7f8efc06a190 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f8ef8009840 tx=0x7f8ef8009b50 comp rx=0 tx=0).stop 2023-07-25T14:36:07.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.934+0000 7f8f043ac700 1 -- 172.21.15.72:0/4099532623 shutdown_connections 2023-07-25T14:36:07.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.934+0000 7f8f043ac700 1 --2- 172.21.15.72:0/4099532623 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8efc151950 0x7f8efc06a190 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:07.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.934+0000 7f8f043ac700 1 -- 172.21.15.72:0/4099532623 >> 172.21.15.72:0/4099532623 conn(0x7f8efc0a87e0 msgr2=0x7f8efc0a8bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:07.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.934+0000 7f8f043ac700 1 -- 172.21.15.72:0/4099532623 shutdown_connections 2023-07-25T14:36:07.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.934+0000 7f8f043ac700 1 -- 172.21.15.72:0/4099532623 wait complete. 2023-07-25T14:36:07.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.936+0000 7f8f043ac700 1 Processor -- start 2023-07-25T14:36:07.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.936+0000 7f8f043ac700 1 -- start start 2023-07-25T14:36:07.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.936+0000 7f8f043ac700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8efc06a6d0 0x7f8efc157ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:07.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.936+0000 7f8f043ac700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8efc0724c0 0x7f8efc0abe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:07.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.936+0000 7f8f043ac700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8efc151950 0x7f8efc0ac380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:07.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.936+0000 7f8f043ac700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8efc0aa4b0 con 0x7f8efc0724c0 2023-07-25T14:36:07.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.936+0000 7f8f043ac700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8efc1eacc0 con 0x7f8efc06a6d0 2023-07-25T14:36:07.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.936+0000 7f8f043ac700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8efc0a9070 con 0x7f8efc151950 2023-07-25T14:36:07.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.936+0000 7f8f01947700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8efc0724c0 0x7f8efc0abe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:07.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.936+0000 7f8f01947700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8efc0724c0 0x7f8efc0abe40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40478/0 (socket says 172.21.15.72:40478) 2023-07-25T14:36:07.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.936+0000 7f8f01947700 1 -- 172.21.15.72:0/872140584 learned_addr learned my addr 172.21.15.72:0/872140584 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:07.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.937+0000 7f8f02148700 1 --2- 172.21.15.72:0/872140584 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8efc06a6d0 0x7f8efc157ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:07.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.937+0000 7f8f02949700 1 --2- 172.21.15.72:0/872140584 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8efc151950 0x7f8efc0ac380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:07.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.937+0000 7f8f01947700 1 -- 172.21.15.72:0/872140584 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8efc151950 msgr2=0x7f8efc0ac380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:07.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.937+0000 7f8f01947700 1 --2- 172.21.15.72:0/872140584 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8efc151950 0x7f8efc0ac380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:07.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.937+0000 7f8f01947700 1 -- 172.21.15.72:0/872140584 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8efc06a6d0 msgr2=0x7f8efc157ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:07.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.937+0000 7f8f01947700 1 --2- 172.21.15.72:0/872140584 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8efc06a6d0 0x7f8efc157ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:07.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.937+0000 7f8f01947700 1 -- 172.21.15.72:0/872140584 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ef80094a0 con 0x7f8efc0724c0 2023-07-25T14:36:07.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.937+0000 7f8f01947700 1 --2- 172.21.15.72:0/872140584 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8efc0724c0 0x7f8efc0abe40 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f8eec00c490 tx=0x7f8eec00c7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:07.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.937+0000 7f8ef2ffd700 1 -- 172.21.15.72:0/872140584 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eec00cea0 con 0x7f8efc0724c0 2023-07-25T14:36:07.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.937+0000 7f8ef2ffd700 1 -- 172.21.15.72:0/872140584 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8eec0052f0 con 0x7f8efc0724c0 2023-07-25T14:36:07.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.937+0000 7f8f043ac700 1 -- 172.21.15.72:0/872140584 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8efc0c0640 con 0x7f8efc0724c0 2023-07-25T14:36:07.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.937+0000 7f8ef2ffd700 1 -- 172.21.15.72:0/872140584 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eec006860 con 0x7f8efc0724c0 2023-07-25T14:36:07.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.937+0000 7f8f043ac700 1 -- 172.21.15.72:0/872140584 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8efc0ab920 con 0x7f8efc0724c0 2023-07-25T14:36:07.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.938+0000 7f8f043ac700 1 -- 172.21.15.72:0/872140584 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8efc04e470 con 0x7f8efc0724c0 2023-07-25T14:36:07.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.938+0000 7f8ef2ffd700 1 -- 172.21.15.72:0/872140584 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8eec003680 con 0x7f8efc0724c0 2023-07-25T14:36:07.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.939+0000 7f8ef2ffd700 1 --2- 172.21.15.72:0/872140584 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f8ee006ace0 0x7f8ee006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:07.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.939+0000 7f8f02148700 1 --2- 172.21.15.72:0/872140584 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f8ee006ace0 0x7f8ee006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:07.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.939+0000 7f8ef2ffd700 1 -- 172.21.15.72:0/872140584 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f8eec0888c0 con 0x7f8efc0724c0 2023-07-25T14:36:07.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.939+0000 7f8f02148700 1 --2- 172.21.15.72:0/872140584 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f8ee006ace0 0x7f8ee006d1a0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f8ef8000c00 tx=0x7f8ef801c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:07.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:07.943+0000 7f8ef2ffd700 1 -- 172.21.15.72:0/872140584 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f8eec053710 con 0x7f8efc0724c0 2023-07-25T14:36:08.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.129+0000 7f8f043ac700 1 -- 172.21.15.72:0/872140584 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f8efc154cd0 con 0x7f8efc0724c0 2023-07-25T14:36:08.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.129+0000 7f8ef2ffd700 1 -- 172.21.15.72:0/872140584 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+11 (secure 0 0 0) 0x7f8eec056d30 con 0x7f8efc0724c0 2023-07-25T14:36:08.142 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2023-07-25T14:36:08.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.131+0000 7f8f043ac700 1 -- 172.21.15.72:0/872140584 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f8ee006ace0 msgr2=0x7f8ee006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:08.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.131+0000 7f8f043ac700 1 --2- 172.21.15.72:0/872140584 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f8ee006ace0 0x7f8ee006d1a0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f8ef8000c00 tx=0x7f8ef801c040 comp rx=0 tx=0).stop 2023-07-25T14:36:08.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.131+0000 7f8f043ac700 1 -- 172.21.15.72:0/872140584 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8efc0724c0 msgr2=0x7f8efc0abe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:08.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.131+0000 7f8f043ac700 1 --2- 172.21.15.72:0/872140584 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8efc0724c0 0x7f8efc0abe40 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f8eec00c490 tx=0x7f8eec00c7a0 comp rx=0 tx=0).stop 2023-07-25T14:36:08.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.131+0000 7f8f043ac700 1 -- 172.21.15.72:0/872140584 shutdown_connections 2023-07-25T14:36:08.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.131+0000 7f8f043ac700 1 --2- 172.21.15.72:0/872140584 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f8ee006ace0 0x7f8ee006d1a0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:08.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.131+0000 7f8f043ac700 1 --2- 172.21.15.72:0/872140584 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8efc151950 0x7f8efc0ac380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:08.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.131+0000 7f8f043ac700 1 --2- 172.21.15.72:0/872140584 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8efc06a6d0 0x7f8efc157ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:08.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.131+0000 7f8f043ac700 1 --2- 172.21.15.72:0/872140584 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8efc0724c0 0x7f8efc0abe40 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:08.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.131+0000 7f8f043ac700 1 -- 172.21.15.72:0/872140584 >> 172.21.15.72:0/872140584 conn(0x7f8efc0a87e0 msgr2=0x7f8efc153070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:08.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.131+0000 7f8f043ac700 1 -- 172.21.15.72:0/872140584 shutdown_connections 2023-07-25T14:36:08.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.131+0000 7f8f043ac700 1 -- 172.21.15.72:0/872140584 wait complete. 2023-07-25T14:36:08.156 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-25T14:36:08.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.262+0000 7f87474d9700 1 Processor -- start 2023-07-25T14:36:08.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.262+0000 7f87474d9700 1 -- start start 2023-07-25T14:36:08.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.263+0000 7f87474d9700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f87400c5f40 0x7f8740154640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:08.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.263+0000 7f87474d9700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f87400ba0e0 0x7f8740154b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:08.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.263+0000 7f87474d9700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87400c54f0 con 0x7f8740151ba0 2023-07-25T14:36:08.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.263+0000 7f87474d9700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87400c6670 con 0x7f87400c5f40 2023-07-25T14:36:08.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.263+0000 7f87474d9700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87400c5740 con 0x7f87400ba0e0 2023-07-25T14:36:08.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.263+0000 7f8744a74700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f87400c5f40 0x7f8740154640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:08.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.263+0000 7f8745275700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f8740151ba0 0x7f87400c2230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.72:54794/0 (socket says 172.21.15.72:54794) 2023-07-25T14:36:08.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.263+0000 7f8745275700 1 -- 172.21.15.72:0/1352107357 learned_addr learned my addr 172.21.15.72:0/1352107357 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:36:08.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.263+0000 7f8745a76700 1 --2- 172.21.15.72:0/1352107357 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f87400ba0e0 0x7f8740154b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:08.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.263+0000 7f8744a74700 1 -- 172.21.15.72:0/1352107357 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f87400ba0e0 msgr2=0x7f8740154b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:08.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.263+0000 7f8744a74700 1 --2- 172.21.15.72:0/1352107357 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f87400ba0e0 0x7f8740154b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:08.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.263+0000 7f8744a74700 1 -- 172.21.15.72:0/1352107357 >> v1:172.21.15.92:6789/0 conn(0x7f8740151ba0 legacy=0x7f87400c2230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:08.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.263+0000 7f8744a74700 1 -- 172.21.15.72:0/1352107357 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87400c5a20 con 0x7f87400c5f40 2023-07-25T14:36:08.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.264+0000 7f8744a74700 1 --2- 172.21.15.72:0/1352107357 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f87400c5f40 0x7f8740154640 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f873c009840 tx=0x7f873c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bafe160b92bd0ed2 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:08.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.264+0000 7f8737fff700 1 -- 172.21.15.72:0/1352107357 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f873c011830 con 0x7f87400c5f40 2023-07-25T14:36:08.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.264+0000 7f8737fff700 1 -- 172.21.15.72:0/1352107357 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f873c011990 con 0x7f87400c5f40 2023-07-25T14:36:08.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.264+0000 7f8737fff700 1 -- 172.21.15.72:0/1352107357 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f873c011d20 con 0x7f87400c5f40 2023-07-25T14:36:08.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.264+0000 7f87474d9700 1 -- 172.21.15.72:0/1352107357 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f87400c5f40 msgr2=0x7f8740154640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:08.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.264+0000 7f87474d9700 1 --2- 172.21.15.72:0/1352107357 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f87400c5f40 0x7f8740154640 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f873c009840 tx=0x7f873c009b50 comp rx=0 tx=0).stop 2023-07-25T14:36:08.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.264+0000 7f87474d9700 1 -- 172.21.15.72:0/1352107357 shutdown_connections 2023-07-25T14:36:08.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.264+0000 7f87474d9700 1 --2- 172.21.15.72:0/1352107357 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f87400ba0e0 0x7f8740154b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:08.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.264+0000 7f87474d9700 1 --2- 172.21.15.72:0/1352107357 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f87400c5f40 0x7f8740154640 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:08.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.264+0000 7f87474d9700 1 -- 172.21.15.72:0/1352107357 >> 172.21.15.72:0/1352107357 conn(0x7f87400a87e0 msgr2=0x7f87400a8bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:08.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.264+0000 7f87474d9700 1 -- 172.21.15.72:0/1352107357 shutdown_connections 2023-07-25T14:36:08.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.264+0000 7f87474d9700 1 -- 172.21.15.72:0/1352107357 wait complete. 2023-07-25T14:36:08.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.265+0000 7f87474d9700 1 Processor -- start 2023-07-25T14:36:08.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.266+0000 7f87474d9700 1 -- start start 2023-07-25T14:36:08.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.266+0000 7f87474d9700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f87400ba0e0 0x7f87400bc1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:08.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.266+0000 7f87474d9700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f87400c5f40 0x7f87400bcac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:08.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.266+0000 7f87474d9700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8740151ba0 0x7f87401dde00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:08.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.266+0000 7f87474d9700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87400bc710 con 0x7f87400ba0e0 2023-07-25T14:36:08.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.266+0000 7f87474d9700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8740153d50 con 0x7f87400c5f40 2023-07-25T14:36:08.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.266+0000 7f87474d9700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f874006a7e0 con 0x7f8740151ba0 2023-07-25T14:36:08.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.266+0000 7f8745275700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f87400ba0e0 0x7f87400bc1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:08.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.266+0000 7f8745275700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f87400ba0e0 0x7f87400bc1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40490/0 (socket says 172.21.15.72:40490) 2023-07-25T14:36:08.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.266+0000 7f8745275700 1 -- 172.21.15.72:0/3424437303 learned_addr learned my addr 172.21.15.72:0/3424437303 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:08.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.266+0000 7f8744a74700 1 --2- 172.21.15.72:0/3424437303 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f87400c5f40 0x7f87400bcac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:08.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.266+0000 7f8745a76700 1 --2- 172.21.15.72:0/3424437303 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8740151ba0 0x7f87401dde00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:08.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.267+0000 7f8745275700 1 -- 172.21.15.72:0/3424437303 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8740151ba0 msgr2=0x7f87401dde00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:08.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.267+0000 7f8745275700 1 --2- 172.21.15.72:0/3424437303 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8740151ba0 0x7f87401dde00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:08.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.267+0000 7f8745275700 1 -- 172.21.15.72:0/3424437303 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f87400c5f40 msgr2=0x7f87400bcac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:08.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.267+0000 7f8745275700 1 --2- 172.21.15.72:0/3424437303 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f87400c5f40 0x7f87400bcac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:08.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.267+0000 7f8745275700 1 -- 172.21.15.72:0/3424437303 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f873c0094a0 con 0x7f87400ba0e0 2023-07-25T14:36:08.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.267+0000 7f8744a74700 1 --2- 172.21.15.72:0/3424437303 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f87400c5f40 0x7f87400bcac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-25T14:36:08.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.267+0000 7f8745275700 1 --2- 172.21.15.72:0/3424437303 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f87400ba0e0 0x7f87400bc1d0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f873000c430 tx=0x7f873000c740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:08.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.267+0000 7f8735ffb700 1 -- 172.21.15.72:0/3424437303 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8730005b70 con 0x7f87400ba0e0 2023-07-25T14:36:08.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.267+0000 7f8735ffb700 1 -- 172.21.15.72:0/3424437303 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8730005cd0 con 0x7f87400ba0e0 2023-07-25T14:36:08.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.267+0000 7f87474d9700 1 -- 172.21.15.72:0/3424437303 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87400a6c20 con 0x7f87400ba0e0 2023-07-25T14:36:08.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.267+0000 7f8735ffb700 1 -- 172.21.15.72:0/3424437303 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87300072f0 con 0x7f87400ba0e0 2023-07-25T14:36:08.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.267+0000 7f87474d9700 1 -- 172.21.15.72:0/3424437303 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87401539e0 con 0x7f87400ba0e0 2023-07-25T14:36:08.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.268+0000 7f87474d9700 1 -- 172.21.15.72:0/3424437303 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8740153ba0 con 0x7f87400ba0e0 2023-07-25T14:36:08.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.268+0000 7f8735ffb700 1 -- 172.21.15.72:0/3424437303 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8730007450 con 0x7f87400ba0e0 2023-07-25T14:36:08.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.269+0000 7f8735ffb700 1 --2- 172.21.15.72:0/3424437303 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f872406ace0 0x7f872406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:08.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.269+0000 7f8735ffb700 1 -- 172.21.15.72:0/3424437303 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f87300889e0 con 0x7f87400ba0e0 2023-07-25T14:36:08.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.269+0000 7f8744a74700 1 --2- 172.21.15.72:0/3424437303 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f872406ace0 0x7f872406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:08.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.269+0000 7f8744a74700 1 --2- 172.21.15.72:0/3424437303 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f872406ace0 0x7f872406d1a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f87400c6320 tx=0x7f873c008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:08.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.273+0000 7f8735ffb700 1 -- 172.21.15.72:0/3424437303 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f8730053830 con 0x7f87400ba0e0 2023-07-25T14:36:08.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.502+0000 7f87474d9700 1 -- 172.21.15.72:0/3424437303 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f874006ca00 con 0x7f87400ba0e0 2023-07-25T14:36:08.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.503+0000 7f8735ffb700 1 -- 172.21.15.72:0/3424437303 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4664 (secure 0 0 0) 0x7f8730056e50 con 0x7f87400ba0e0 2023-07-25T14:36:08.516 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-25T14:36:08.516 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4220,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6836/4293785067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":4293785067},{"type":"v1","addr":"172.21.15.72:6836","nonce":4293785067}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4229,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6834/681290755","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":681290755},{"type":"v1","addr":"172.21.15.92:6834","nonce":681290755}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6837/3376375642","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6835","nonce":3376375642},{"type":"v1","addr":"172.21.15.72:6837","nonce":3376375642}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-25T14:35:39.939860+0000","modified":"2023-07-25T14:35:59.629155+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.92:6835/2045555979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6833","nonce":2045555979},{"type":"v1","addr":"172.21.15.92:6835","nonce":2045555979}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-25T14:36:08.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.505+0000 7f87474d9700 1 -- 172.21.15.72:0/3424437303 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f872406ace0 msgr2=0x7f872406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:08.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.505+0000 7f87474d9700 1 --2- 172.21.15.72:0/3424437303 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f872406ace0 0x7f872406d1a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f87400c6320 tx=0x7f873c008030 comp rx=0 tx=0).stop 2023-07-25T14:36:08.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.505+0000 7f87474d9700 1 -- 172.21.15.72:0/3424437303 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f87400ba0e0 msgr2=0x7f87400bc1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:08.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.505+0000 7f87474d9700 1 --2- 172.21.15.72:0/3424437303 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f87400ba0e0 0x7f87400bc1d0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f873000c430 tx=0x7f873000c740 comp rx=0 tx=0).stop 2023-07-25T14:36:08.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.505+0000 7f87474d9700 1 -- 172.21.15.72:0/3424437303 shutdown_connections 2023-07-25T14:36:08.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.505+0000 7f87474d9700 1 --2- 172.21.15.72:0/3424437303 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f872406ace0 0x7f872406d1a0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:08.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.505+0000 7f87474d9700 1 --2- 172.21.15.72:0/3424437303 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8740151ba0 0x7f87401dde00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:08.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.505+0000 7f87474d9700 1 --2- 172.21.15.72:0/3424437303 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f87400ba0e0 0x7f87400bc1d0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:08.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.505+0000 7f87474d9700 1 --2- 172.21.15.72:0/3424437303 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f87400c5f40 0x7f87400bcac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:08.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.505+0000 7f87474d9700 1 -- 172.21.15.72:0/3424437303 >> 172.21.15.72:0/3424437303 conn(0x7f87400a87e0 msgr2=0x7f8740071ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:08.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.505+0000 7f87474d9700 1 -- 172.21.15.72:0/3424437303 shutdown_connections 2023-07-25T14:36:08.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.505+0000 7f87474d9700 1 -- 172.21.15.72:0/3424437303 wait complete. 2023-07-25T14:36:08.521 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 8 2023-07-25T14:36:08.530 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-25T14:36:08.653 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.641+0000 7f62d7046700 1 Processor -- start 2023-07-25T14:36:08.654 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.641+0000 7f62d7046700 1 -- start start 2023-07-25T14:36:08.660 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.641+0000 7f62d7046700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f62d00c4930 0x7f62d00c3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:08.660 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.641+0000 7f62d7046700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62d00c2fe0 con 0x7f62d0151950 2023-07-25T14:36:08.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.641+0000 7f62d7046700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62d0155070 con 0x7f62d00724c0 2023-07-25T14:36:08.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.641+0000 7f62d7046700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62d0071a60 con 0x7f62d00c4930 2023-07-25T14:36:08.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.642+0000 7f62d4de2700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f62d0151950 0x7f62d006a190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:59466/0 (socket says 172.21.15.72:59466) 2023-07-25T14:36:08.662 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.642+0000 7f62d4de2700 1 -- 172.21.15.72:0/2276566829 learned_addr learned my addr 172.21.15.72:0/2276566829 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:36:08.662 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.642+0000 7f62d55e3700 1 --2- 172.21.15.72:0/2276566829 >> v2:172.21.15.92:3300/0 conn(0x7f62d00c4930 0x7f62d00c3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:08.662 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.642+0000 7f62cf7fe700 1 -- 172.21.15.72:0/2276566829 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1724044838 0 0) 0x7f62d00c2fe0 con 0x7f62d0151950 2023-07-25T14:36:08.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.642+0000 7f62cf7fe700 1 -- 172.21.15.72:0/2276566829 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f62c00035b0 con 0x7f62d0151950 2023-07-25T14:36:08.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.642+0000 7f62cf7fe700 1 -- 172.21.15.72:0/2276566829 <== mon.1 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2391242197 0 0) 0x7f62d0155070 con 0x7f62d00724c0 2023-07-25T14:36:08.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.642+0000 7f62cf7fe700 1 -- 172.21.15.72:0/2276566829 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f62d00c2fe0 con 0x7f62d00724c0 2023-07-25T14:36:08.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.642+0000 7f62d55e3700 1 -- 172.21.15.72:0/2276566829 >> v1:172.21.15.92:6789/0 conn(0x7f62d00724c0 legacy=0x7f62d00c34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:08.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.642+0000 7f62d55e3700 1 -- 172.21.15.72:0/2276566829 >> v1:172.21.15.72:6789/0 conn(0x7f62d0151950 legacy=0x7f62d006a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:08.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.642+0000 7f62d55e3700 1 -- 172.21.15.72:0/2276566829 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62d00c15c0 con 0x7f62d00c4930 2023-07-25T14:36:08.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.642+0000 7f62d55e3700 1 --2- 172.21.15.72:0/2276566829 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f62d00c4930 0x7f62d00c3bd0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f62c8009d90 tx=0x7f62c800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4029dc22f7c091e2 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:08.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.642+0000 7f62cf7fe700 1 -- 172.21.15.72:0/2276566829 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62c800e070 con 0x7f62d00c4930 2023-07-25T14:36:08.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.642+0000 7f62cf7fe700 1 -- 172.21.15.72:0/2276566829 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62c800bb20 con 0x7f62d00c4930 2023-07-25T14:36:08.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.642+0000 7f62cf7fe700 1 -- 172.21.15.72:0/2276566829 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62c800be90 con 0x7f62d00c4930 2023-07-25T14:36:08.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.643+0000 7f62d7046700 1 -- 172.21.15.72:0/2276566829 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f62d00c4930 msgr2=0x7f62d00c3bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:08.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.643+0000 7f62d7046700 1 --2- 172.21.15.72:0/2276566829 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f62d00c4930 0x7f62d00c3bd0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f62c8009d90 tx=0x7f62c800b330 comp rx=0 tx=0).stop 2023-07-25T14:36:08.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.643+0000 7f62d7046700 1 -- 172.21.15.72:0/2276566829 shutdown_connections 2023-07-25T14:36:08.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.643+0000 7f62d7046700 1 --2- 172.21.15.72:0/2276566829 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f62d00c4930 0x7f62d00c3bd0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:08.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.643+0000 7f62d7046700 1 -- 172.21.15.72:0/2276566829 >> 172.21.15.72:0/2276566829 conn(0x7f62d00a87e0 msgr2=0x7f62d00a8bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:08.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.643+0000 7f62d7046700 1 -- 172.21.15.72:0/2276566829 shutdown_connections 2023-07-25T14:36:08.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.643+0000 7f62d7046700 1 -- 172.21.15.72:0/2276566829 wait complete. 2023-07-25T14:36:08.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.644+0000 7f62d7046700 1 Processor -- start 2023-07-25T14:36:08.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.644+0000 7f62d7046700 1 -- start start 2023-07-25T14:36:08.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.645+0000 7f62d7046700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f62d00724c0 0x7f62d014e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:08.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.645+0000 7f62d7046700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f62d00c4930 0x7f62d0150400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:08.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.645+0000 7f62d7046700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f62d0151950 0x7f62d014d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:08.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.645+0000 7f62d7046700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62d00c0cd0 con 0x7f62d00c4930 2023-07-25T14:36:08.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.645+0000 7f62d7046700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62d0156070 con 0x7f62d00724c0 2023-07-25T14:36:08.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.645+0000 7f62d7046700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62d014e9f0 con 0x7f62d0151950 2023-07-25T14:36:08.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.645+0000 7f62cffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f62d00c4930 0x7f62d0150400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:08.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.645+0000 7f62cffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f62d00c4930 0x7f62d0150400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40506/0 (socket says 172.21.15.72:40506) 2023-07-25T14:36:08.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.645+0000 7f62cffff700 1 -- 172.21.15.72:0/2128135432 learned_addr learned my addr 172.21.15.72:0/2128135432 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:08.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.645+0000 7f62d4de2700 1 --2- 172.21.15.72:0/2128135432 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f62d00724c0 0x7f62d014e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:08.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.645+0000 7f62d55e3700 1 --2- 172.21.15.72:0/2128135432 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f62d0151950 0x7f62d014d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:08.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.645+0000 7f62cffff700 1 -- 172.21.15.72:0/2128135432 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f62d0151950 msgr2=0x7f62d014d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:08.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.645+0000 7f62cffff700 1 --2- 172.21.15.72:0/2128135432 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f62d0151950 0x7f62d014d610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:08.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.645+0000 7f62cffff700 1 -- 172.21.15.72:0/2128135432 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f62d00724c0 msgr2=0x7f62d014e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:08.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.645+0000 7f62cffff700 1 --2- 172.21.15.72:0/2128135432 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f62d00724c0 0x7f62d014e4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:08.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.645+0000 7f62cffff700 1 -- 172.21.15.72:0/2128135432 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62c8009a70 con 0x7f62d00c4930 2023-07-25T14:36:08.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.645+0000 7f62d4de2700 1 --2- 172.21.15.72:0/2128135432 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f62d00724c0 0x7f62d014e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-25T14:36:08.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.645+0000 7f62d55e3700 1 --2- 172.21.15.72:0/2128135432 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f62d0151950 0x7f62d014d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-25T14:36:08.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.645+0000 7f62cffff700 1 --2- 172.21.15.72:0/2128135432 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f62d00c4930 0x7f62d0150400 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f62bc00c530 tx=0x7f62bc00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:08.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.646+0000 7f62cd7fa700 1 -- 172.21.15.72:0/2128135432 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62bc0052d0 con 0x7f62d00c4930 2023-07-25T14:36:08.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.646+0000 7f62cd7fa700 1 -- 172.21.15.72:0/2128135432 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62bc005450 con 0x7f62d00c4930 2023-07-25T14:36:08.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.646+0000 7f62d7046700 1 -- 172.21.15.72:0/2128135432 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62d01ed9a0 con 0x7f62d00c4930 2023-07-25T14:36:08.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.646+0000 7f62cd7fa700 1 -- 172.21.15.72:0/2128135432 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62bc0038c0 con 0x7f62d00c4930 2023-07-25T14:36:08.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.646+0000 7f62d7046700 1 -- 172.21.15.72:0/2128135432 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62d00bdfe0 con 0x7f62d00c4930 2023-07-25T14:36:08.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.647+0000 7f62d7046700 1 -- 172.21.15.72:0/2128135432 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62d00be200 con 0x7f62d00c4930 2023-07-25T14:36:08.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.647+0000 7f62cd7fa700 1 -- 172.21.15.72:0/2128135432 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f62bc003a20 con 0x7f62d00c4930 2023-07-25T14:36:08.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.647+0000 7f62cd7fa700 1 --2- 172.21.15.72:0/2128135432 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f62b406ace0 0x7f62b406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:08.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.647+0000 7f62cd7fa700 1 -- 172.21.15.72:0/2128135432 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f62bc088c40 con 0x7f62d00c4930 2023-07-25T14:36:08.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.647+0000 7f62d4de2700 1 --2- 172.21.15.72:0/2128135432 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f62b406ace0 0x7f62b406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:08.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.648+0000 7f62d4de2700 1 --2- 172.21.15.72:0/2128135432 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f62b406ace0 0x7f62b406d1a0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f62c40011e0 tx=0x7f62c4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:08.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.652+0000 7f62cd7fa700 1 -- 172.21.15.72:0/2128135432 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f62bc053a90 con 0x7f62d00c4930 2023-07-25T14:36:08.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.841+0000 7f62d7046700 1 -- 172.21.15.72:0/2128135432 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f62d00bd7c0 con 0x7f62d00c4930 2023-07-25T14:36:08.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.842+0000 7f62cd7fa700 1 -- 172.21.15.72:0/2128135432 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+20014 (secure 0 0 0) 0x7f62bc0570b0 con 0x7f62d00c4930 2023-07-25T14:36:08.854 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-25T14:36:08.855 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":25,"fsid":"9170db48-9170-43e8-8ccb-9813e6240906","created":"2023-07-25T14:35:21.733262+0000","modified":"2023-07-25T14:35:44.992669+0000","last_up_change":"2023-07-25T14:35:31.355010+0000","last_in_change":"2023-07-25T14:35:24.195785+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-25T14:35:32.983457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-25T14:35:33.326342+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-25T14:35:37.534158+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-25T14:35:38.891571+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-25T14:35:42.596923+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d517fdad-0bfe-49f0-89f2-9421c3761839","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6801","nonce":2475407414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6803","nonce":2475407414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6807","nonce":2475407414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6805","nonce":2475407414}]},"public_addr":"172.21.15.72:6801/2475407414","cluster_addr":"172.21.15.72:6803/2475407414","heartbeat_back_addr":"172.21.15.72:6807/2475407414","heartbeat_front_addr":"172.21.15.72:6805/2475407414","state":["exists","up"]},{"osd":1,"uuid":"e1564be3-f209-47e5-a8d0-32fc618a474f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6822","nonce":870954016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6825","nonce":870954016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6831","nonce":870954016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6827","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6829","nonce":870954016}]},"public_addr":"172.21.15.72:6822/870954016","cluster_addr":"172.21.15.72:6825/870954016","heartbeat_back_addr":"172.21.15.72:6831/870954016","heartbeat_front_addr":"172.21.15.72:6829/870954016","state":["exists","up"]},{"osd":2,"uuid":"c4647d30-ffa6-417a-9026-ef530c75910e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6809","nonce":2143129442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6811","nonce":2143129442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6815","nonce":2143129442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6813","nonce":2143129442}]},"public_addr":"172.21.15.72:6809/2143129442","cluster_addr":"172.21.15.72:6811/2143129442","heartbeat_back_addr":"172.21.15.72:6815/2143129442","heartbeat_front_addr":"172.21.15.72:6813/2143129442","state":["exists","up"]},{"osd":3,"uuid":"76c9d9a7-c2e2-4612-a58b-d6882dd76b58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6817","nonce":3404066311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6819","nonce":3404066311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6828","nonce":3404066311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6821","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6823","nonce":3404066311}]},"public_addr":"172.21.15.72:6817/3404066311","cluster_addr":"172.21.15.72:6819/3404066311","heartbeat_back_addr":"172.21.15.72:6828/3404066311","heartbeat_front_addr":"172.21.15.72:6823/3404066311","state":["exists","up"]},{"osd":4,"uuid":"7f8920dc-0ad4-4a73-ab40-65408f83eadd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6817","nonce":2381008739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6819","nonce":2381008739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6825","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6827","nonce":2381008739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6822","nonce":2381008739}]},"public_addr":"172.21.15.92:6817/2381008739","cluster_addr":"172.21.15.92:6819/2381008739","heartbeat_back_addr":"172.21.15.92:6827/2381008739","heartbeat_front_addr":"172.21.15.92:6822/2381008739","state":["exists","up"]},{"osd":5,"uuid":"56257e7c-31eb-44c5-9ec7-1318a4e0bb35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6801","nonce":2161935604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6803","nonce":2161935604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6807","nonce":2161935604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6805","nonce":2161935604}]},"public_addr":"172.21.15.92:6801/2161935604","cluster_addr":"172.21.15.92:6803/2161935604","heartbeat_back_addr":"172.21.15.92:6807/2161935604","heartbeat_front_addr":"172.21.15.92:6805/2161935604","state":["exists","up"]},{"osd":6,"uuid":"a150d3d8-a0c9-4955-968a-8d98eff4ffb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6809","nonce":3770163493}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6811","nonce":3770163493}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6815","nonce":3770163493}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6813","nonce":3770163493}]},"public_addr":"172.21.15.92:6809/3770163493","cluster_addr":"172.21.15.92:6811/3770163493","heartbeat_back_addr":"172.21.15.92:6815/3770163493","heartbeat_front_addr":"172.21.15.92:6813/3770163493","state":["exists","up"]},{"osd":7,"uuid":"07799c27-54ee-4591-a42d-a978d6b32065","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6821","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6823","nonce":2135777609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6826","nonce":2135777609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6831","nonce":2135777609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6829","nonce":2135777609}]},"public_addr":"172.21.15.92:6823/2135777609","cluster_addr":"172.21.15.92:6826/2135777609","heartbeat_back_addr":"172.21.15.92:6831/2135777609","heartbeat_front_addr":"172.21.15.92:6829/2135777609","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.345365+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.378150+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.146566+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.372172+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:30.398421+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.385632+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.465611+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.443583+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-25T14:36:08.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.844+0000 7f62d7046700 1 -- 172.21.15.72:0/2128135432 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f62b406ace0 msgr2=0x7f62b406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:08.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.844+0000 7f62d7046700 1 --2- 172.21.15.72:0/2128135432 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f62b406ace0 0x7f62b406d1a0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f62c40011e0 tx=0x7f62c4009040 comp rx=0 tx=0).stop 2023-07-25T14:36:08.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.844+0000 7f62d7046700 1 -- 172.21.15.72:0/2128135432 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f62d00c4930 msgr2=0x7f62d0150400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:08.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.844+0000 7f62d7046700 1 --2- 172.21.15.72:0/2128135432 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f62d00c4930 0x7f62d0150400 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f62bc00c530 tx=0x7f62bc00c8f0 comp rx=0 tx=0).stop 2023-07-25T14:36:08.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.844+0000 7f62d7046700 1 -- 172.21.15.72:0/2128135432 shutdown_connections 2023-07-25T14:36:08.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.844+0000 7f62d7046700 1 --2- 172.21.15.72:0/2128135432 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f62b406ace0 0x7f62b406d1a0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:08.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.844+0000 7f62d7046700 1 --2- 172.21.15.72:0/2128135432 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f62d0151950 0x7f62d014d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:08.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.844+0000 7f62d7046700 1 --2- 172.21.15.72:0/2128135432 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f62d00724c0 0x7f62d014e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:08.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.844+0000 7f62d7046700 1 --2- 172.21.15.72:0/2128135432 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f62d00c4930 0x7f62d0150400 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:08.858 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.844+0000 7f62d7046700 1 -- 172.21.15.72:0/2128135432 >> 172.21.15.72:0/2128135432 conn(0x7f62d00a87e0 msgr2=0x7f62d00c34c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:08.858 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.844+0000 7f62d7046700 1 -- 172.21.15.72:0/2128135432 shutdown_connections 2023-07-25T14:36:08.858 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.844+0000 7f62d7046700 1 -- 172.21.15.72:0/2128135432 wait complete. 2023-07-25T14:36:08.869 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-07-25T14:35:32.983457+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-07-25T14:35:33.326342+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-25T14:35:37.534158+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-25T14:35:38.891571+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-07-25T14:35:42.596923+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-25T14:36:08.870 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-25T14:36:08.992 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.980+0000 7ff9eabdb700 1 Processor -- start 2023-07-25T14:36:08.993 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.980+0000 7ff9eabdb700 1 -- start start 2023-07-25T14:36:08.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.981+0000 7ff9eabdb700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff9e414f810 0x7ff9e40c4370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:08.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.981+0000 7ff9eabdb700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff9e40bb0b0 0x7ff9e4152cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:08.995 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.981+0000 7ff9eabdb700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9e40c5890 con 0x7ff9e40a9cc0 2023-07-25T14:36:08.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.981+0000 7ff9eabdb700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9e4152150 con 0x7ff9e40bb0b0 2023-07-25T14:36:08.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.981+0000 7ff9eabdb700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9e414fbf0 con 0x7ff9e414f810 2023-07-25T14:36:08.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.981+0000 7ff9e9178700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff9e40bb0b0 0x7ff9e4152cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:08.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.981+0000 7ff9e3fff700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7ff9e40a9cc0 0x7ff9e41525e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:59482/0 (socket says 172.21.15.72:59482) 2023-07-25T14:36:08.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.981+0000 7ff9e3fff700 1 -- 172.21.15.72:0/4128316880 learned_addr learned my addr 172.21.15.72:0/4128316880 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:36:08.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.981+0000 7ff9e9178700 1 -- 172.21.15.72:0/4128316880 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff9e414f810 msgr2=0x7ff9e40c4370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:08.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.981+0000 7ff9e9178700 1 --2- 172.21.15.72:0/4128316880 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff9e414f810 0x7ff9e40c4370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:08.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.981+0000 7ff9e9178700 1 -- 172.21.15.72:0/4128316880 >> v1:172.21.15.72:6789/0 conn(0x7ff9e40a9cc0 legacy=0x7ff9e41525e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:08.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.981+0000 7ff9e9178700 1 -- 172.21.15.72:0/4128316880 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9e41566a0 con 0x7ff9e40bb0b0 2023-07-25T14:36:08.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.981+0000 7ff9e37fe700 1 -- 172.21.15.72:0/4128316880 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1048248119 0 0) 0x7ff9e40c5890 con 0x7ff9e40a9cc0 2023-07-25T14:36:08.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.981+0000 7ff9e9178700 1 --2- 172.21.15.72:0/4128316880 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff9e40bb0b0 0x7ff9e4152cf0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7ff9dc009d90 tx=0x7ff9dc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e926186fe390981 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:08.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.982+0000 7ff9e37fe700 1 -- 172.21.15.72:0/4128316880 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9dc00e070 con 0x7ff9e40bb0b0 2023-07-25T14:36:08.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.982+0000 7ff9e37fe700 1 -- 172.21.15.72:0/4128316880 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9dc00bbd0 con 0x7ff9e40bb0b0 2023-07-25T14:36:08.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.982+0000 7ff9e37fe700 1 -- 172.21.15.72:0/4128316880 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9dc012430 con 0x7ff9e40bb0b0 2023-07-25T14:36:08.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.982+0000 7ff9eabdb700 1 -- 172.21.15.72:0/4128316880 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff9e40bb0b0 msgr2=0x7ff9e4152cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:08.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.982+0000 7ff9eabdb700 1 --2- 172.21.15.72:0/4128316880 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff9e40bb0b0 0x7ff9e4152cf0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7ff9dc009d90 tx=0x7ff9dc00b330 comp rx=0 tx=0).stop 2023-07-25T14:36:08.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.982+0000 7ff9eabdb700 1 -- 172.21.15.72:0/4128316880 shutdown_connections 2023-07-25T14:36:08.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.982+0000 7ff9eabdb700 1 --2- 172.21.15.72:0/4128316880 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff9e40bb0b0 0x7ff9e4152cf0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:08.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.982+0000 7ff9eabdb700 1 --2- 172.21.15.72:0/4128316880 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff9e414f810 0x7ff9e40c4370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:08.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.982+0000 7ff9eabdb700 1 -- 172.21.15.72:0/4128316880 >> 172.21.15.72:0/4128316880 conn(0x7ff9e406a8d0 msgr2=0x7ff9e40a94e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:08.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.982+0000 7ff9eabdb700 1 -- 172.21.15.72:0/4128316880 shutdown_connections 2023-07-25T14:36:08.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.982+0000 7ff9eabdb700 1 -- 172.21.15.72:0/4128316880 wait complete. 2023-07-25T14:36:08.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.983+0000 7ff9eabdb700 1 Processor -- start 2023-07-25T14:36:08.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.983+0000 7ff9eabdb700 1 -- start start 2023-07-25T14:36:09.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.984+0000 7ff9eabdb700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff9e40a9cc0 0x7ff9e40ac070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:09.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.984+0000 7ff9eabdb700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff9e40bb0b0 0x7ff9e40ad010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:09.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.984+0000 7ff9eabdb700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff9e414f810 0x7ff9e41e8c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:09.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.984+0000 7ff9eabdb700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9e40aafc0 con 0x7ff9e414f810 2023-07-25T14:36:09.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.984+0000 7ff9eabdb700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9e40ac5b0 con 0x7ff9e40a9cc0 2023-07-25T14:36:09.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.984+0000 7ff9eabdb700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9e40bdb80 con 0x7ff9e40bb0b0 2023-07-25T14:36:09.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.984+0000 7ff9e9178700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff9e414f810 0x7ff9e41e8c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:09.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.984+0000 7ff9e9178700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff9e414f810 0x7ff9e41e8c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40522/0 (socket says 172.21.15.72:40522) 2023-07-25T14:36:09.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.984+0000 7ff9e9178700 1 -- 172.21.15.72:0/2557119905 learned_addr learned my addr 172.21.15.72:0/2557119905 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:09.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.984+0000 7ff9e3fff700 1 --2- 172.21.15.72:0/2557119905 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff9e40bb0b0 0x7ff9e40ad010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:09.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.984+0000 7ff9e8977700 1 --2- 172.21.15.72:0/2557119905 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff9e40a9cc0 0x7ff9e40ac070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:09.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.984+0000 7ff9e9178700 1 -- 172.21.15.72:0/2557119905 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff9e40bb0b0 msgr2=0x7ff9e40ad010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:09.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.984+0000 7ff9e9178700 1 --2- 172.21.15.72:0/2557119905 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff9e40bb0b0 0x7ff9e40ad010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:09.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.984+0000 7ff9e9178700 1 -- 172.21.15.72:0/2557119905 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff9e40a9cc0 msgr2=0x7ff9e40ac070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:09.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.984+0000 7ff9e9178700 1 --2- 172.21.15.72:0/2557119905 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff9e40a9cc0 0x7ff9e40ac070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:09.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.984+0000 7ff9e9178700 1 -- 172.21.15.72:0/2557119905 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9dc009a70 con 0x7ff9e414f810 2023-07-25T14:36:09.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.985+0000 7ff9e9178700 1 --2- 172.21.15.72:0/2557119905 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff9e414f810 0x7ff9e41e8c80 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7ff9dc014040 tx=0x7ff9dc004b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:09.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.985+0000 7ff9e17fa700 1 -- 172.21.15.72:0/2557119905 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9dc012430 con 0x7ff9e414f810 2023-07-25T14:36:09.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.985+0000 7ff9e17fa700 1 -- 172.21.15.72:0/2557119905 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9dc020070 con 0x7ff9e414f810 2023-07-25T14:36:09.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.985+0000 7ff9eabdb700 1 -- 172.21.15.72:0/2557119905 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9e40bde60 con 0x7ff9e414f810 2023-07-25T14:36:09.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.985+0000 7ff9e17fa700 1 -- 172.21.15.72:0/2557119905 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9dc004280 con 0x7ff9e414f810 2023-07-25T14:36:09.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.985+0000 7ff9eabdb700 1 -- 172.21.15.72:0/2557119905 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9e40ab210 con 0x7ff9e414f810 2023-07-25T14:36:09.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.986+0000 7ff9eabdb700 1 -- 172.21.15.72:0/2557119905 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9e404e470 con 0x7ff9e414f810 2023-07-25T14:36:09.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.986+0000 7ff9e17fa700 1 -- 172.21.15.72:0/2557119905 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff9dc0043e0 con 0x7ff9e414f810 2023-07-25T14:36:09.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.986+0000 7ff9e17fa700 1 --2- 172.21.15.72:0/2557119905 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7ff9c806ace0 0x7ff9c806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:09.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.986+0000 7ff9e17fa700 1 -- 172.21.15.72:0/2557119905 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7ff9dc022070 con 0x7ff9e414f810 2023-07-25T14:36:09.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.986+0000 7ff9e8977700 1 --2- 172.21.15.72:0/2557119905 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7ff9c806ace0 0x7ff9c806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:09.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.987+0000 7ff9e8977700 1 --2- 172.21.15.72:0/2557119905 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7ff9c806ace0 0x7ff9c806d1a0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ff9d8006fd0 tx=0x7ff9d8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:09.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:08.991+0000 7ff9e17fa700 1 -- 172.21.15.72:0/2557119905 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7ff9dc056890 con 0x7ff9e414f810 2023-07-25T14:36:09.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.176+0000 7ff9eabdb700 1 -- 172.21.15.72:0/2557119905 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7ff9e4152b80 con 0x7ff9e414f810 2023-07-25T14:36:09.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.177+0000 7ff9e17fa700 1 -- 172.21.15.72:0/2557119905 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7ff9dc00e070 con 0x7ff9e414f810 2023-07-25T14:36:09.189 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 8 2023-07-25T14:36:09.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.179+0000 7ff9eabdb700 1 -- 172.21.15.72:0/2557119905 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7ff9c806ace0 msgr2=0x7ff9c806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:09.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.179+0000 7ff9eabdb700 1 --2- 172.21.15.72:0/2557119905 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7ff9c806ace0 0x7ff9c806d1a0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ff9d8006fd0 tx=0x7ff9d8008040 comp rx=0 tx=0).stop 2023-07-25T14:36:09.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.179+0000 7ff9eabdb700 1 -- 172.21.15.72:0/2557119905 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff9e414f810 msgr2=0x7ff9e41e8c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:09.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.179+0000 7ff9eabdb700 1 --2- 172.21.15.72:0/2557119905 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff9e414f810 0x7ff9e41e8c80 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7ff9dc014040 tx=0x7ff9dc004b20 comp rx=0 tx=0).stop 2023-07-25T14:36:09.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.179+0000 7ff9eabdb700 1 -- 172.21.15.72:0/2557119905 shutdown_connections 2023-07-25T14:36:09.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.179+0000 7ff9eabdb700 1 --2- 172.21.15.72:0/2557119905 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7ff9c806ace0 0x7ff9c806d1a0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:09.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.179+0000 7ff9eabdb700 1 --2- 172.21.15.72:0/2557119905 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff9e414f810 0x7ff9e41e8c80 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:09.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.179+0000 7ff9eabdb700 1 --2- 172.21.15.72:0/2557119905 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff9e40a9cc0 0x7ff9e40ac070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:09.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.179+0000 7ff9eabdb700 1 --2- 172.21.15.72:0/2557119905 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff9e40bb0b0 0x7ff9e40ad010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:09.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.179+0000 7ff9eabdb700 1 -- 172.21.15.72:0/2557119905 >> 172.21.15.72:0/2557119905 conn(0x7ff9e406a8d0 msgr2=0x7ff9e414ff80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:09.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.179+0000 7ff9eabdb700 1 -- 172.21.15.72:0/2557119905 shutdown_connections 2023-07-25T14:36:09.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.179+0000 7ff9eabdb700 1 -- 172.21.15.72:0/2557119905 wait complete. 2023-07-25T14:36:09.203 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-25T14:36:09.326 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.314+0000 7f4fd359e700 1 Processor -- start 2023-07-25T14:36:09.326 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.314+0000 7f4fd359e700 1 -- start start 2023-07-25T14:36:09.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.315+0000 7f4fd359e700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4fd4072140 0x7f4fd40c5390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:09.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.315+0000 7f4fd359e700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f4fd406f1f0 0x7f4fd414aa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:09.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.315+0000 7f4fd359e700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fd40c5ea0 con 0x7f4fd414afa0 2023-07-25T14:36:09.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.315+0000 7f4fd359e700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fd414b3a0 con 0x7f4fd406f1f0 2023-07-25T14:36:09.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.315+0000 7f4fd359e700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fd40c5bc0 con 0x7f4fd4072140 2023-07-25T14:36:09.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.315+0000 7f4fd2d9d700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f4fd414afa0 0x7f4fd4150ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:59498/0 (socket says 172.21.15.72:59498) 2023-07-25T14:36:09.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.315+0000 7f4fd2d9d700 1 -- 172.21.15.72:0/2963887368 learned_addr learned my addr 172.21.15.72:0/2963887368 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:36:09.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.315+0000 7f4fd1d9b700 1 --2- 172.21.15.72:0/2963887368 >> v2:172.21.15.92:3300/0 conn(0x7f4fd406f1f0 0x7f4fd414aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:09.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.315+0000 7f4fd159a700 1 -- 172.21.15.72:0/2963887368 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3977355760 0 0) 0x7f4fcc001490 con 0x7f4fd414afa0 2023-07-25T14:36:09.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.315+0000 7f4fd259c700 1 --2- 172.21.15.72:0/2963887368 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4fd4072140 0x7f4fd40c5390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:09.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.315+0000 7f4fd159a700 1 -- 172.21.15.72:0/2963887368 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4fbc0035b0 con 0x7f4fd414afa0 2023-07-25T14:36:09.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.315+0000 7f4fd159a700 1 -- 172.21.15.72:0/2963887368 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1874597198 0 0) 0x7f4fbc0035b0 con 0x7f4fd414afa0 2023-07-25T14:36:09.331 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.315+0000 7f4fd159a700 1 -- 172.21.15.72:0/2963887368 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4fd4072140 msgr2=0x7f4fd40c5390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:09.331 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.315+0000 7f4fd159a700 1 --2- 172.21.15.72:0/2963887368 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4fd4072140 0x7f4fd40c5390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:09.331 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.315+0000 7f4fd159a700 1 -- 172.21.15.72:0/2963887368 >> v2:172.21.15.92:3300/0 conn(0x7f4fd406f1f0 msgr2=0x7f4fd414aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:09.331 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.315+0000 7f4fd159a700 1 --2- 172.21.15.72:0/2963887368 >> v2:172.21.15.92:3300/0 conn(0x7f4fd406f1f0 0x7f4fd414aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:09.331 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.315+0000 7f4fd159a700 1 -- 172.21.15.72:0/2963887368 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fd40c47f0 con 0x7f4fd414afa0 2023-07-25T14:36:09.331 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.315+0000 7f4fd159a700 1 -- 172.21.15.72:0/2963887368 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2559588315 0 0) 0x7f4fcc001b80 con 0x7f4fd414afa0 2023-07-25T14:36:09.331 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.316+0000 7f4fd159a700 1 -- 172.21.15.72:0/2963887368 >> v1:172.21.15.72:6789/0 conn(0x7f4fd414afa0 legacy=0x7f4fd4150ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:09.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.316+0000 7f4fd159a700 1 --2- 172.21.15.72:0/2963887368 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4fbc003a00 0x7f4fbc003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:09.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.316+0000 7f4fd159a700 1 --2- 172.21.15.72:0/2963887368 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4fbc004850 0x7f4fbc004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:09.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.316+0000 7f4fd159a700 1 --2- 172.21.15.72:0/2963887368 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4fd4072140 0x7f4fbc005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:09.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.316+0000 7f4fd159a700 1 -- 172.21.15.72:0/2963887368 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fd414b3a0 con 0x7f4fbc004850 2023-07-25T14:36:09.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.316+0000 7f4fd159a700 1 -- 172.21.15.72:0/2963887368 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fd40c5bc0 con 0x7f4fbc003a00 2023-07-25T14:36:09.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.316+0000 7f4fd159a700 1 -- 172.21.15.72:0/2963887368 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fbc00ba10 con 0x7f4fd4072140 2023-07-25T14:36:09.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.316+0000 7f4fd1d9b700 1 --2- 172.21.15.72:0/2963887368 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4fbc004850 0x7f4fbc004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:09.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.316+0000 7f4fd259c700 1 --2- 172.21.15.72:0/2963887368 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4fbc003a00 0x7f4fbc003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:09.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.316+0000 7f4fd2d9d700 1 --2- 172.21.15.72:0/2963887368 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4fd4072140 0x7f4fbc005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:09.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.316+0000 7f4fd1d9b700 1 -- 172.21.15.72:0/2963887368 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4fd4072140 msgr2=0x7f4fbc005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:09.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.316+0000 7f4fd1d9b700 1 --2- 172.21.15.72:0/2963887368 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4fd4072140 0x7f4fbc005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:09.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.316+0000 7f4fd1d9b700 1 -- 172.21.15.72:0/2963887368 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4fbc003a00 msgr2=0x7f4fbc003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:09.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.316+0000 7f4fd1d9b700 1 --2- 172.21.15.72:0/2963887368 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4fbc003a00 0x7f4fbc003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:09.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.316+0000 7f4fd1d9b700 1 -- 172.21.15.72:0/2963887368 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fbc0035b0 con 0x7f4fbc004850 2023-07-25T14:36:09.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.316+0000 7f4fd1d9b700 1 --2- 172.21.15.72:0/2963887368 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4fbc004850 0x7f4fbc004cd0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f4fc4009b90 tx=0x7f4fbc005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24aa07729af66781 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:09.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.316+0000 7f4fd159a700 1 -- 172.21.15.72:0/2963887368 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fc400e6c0 con 0x7f4fbc004850 2023-07-25T14:36:09.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.316+0000 7f4fd159a700 1 -- 172.21.15.72:0/2963887368 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fc400e820 con 0x7f4fbc004850 2023-07-25T14:36:09.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.316+0000 7f4fd159a700 1 -- 172.21.15.72:0/2963887368 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fc400eb90 con 0x7f4fbc004850 2023-07-25T14:36:09.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.317+0000 7f4fd359e700 1 -- 172.21.15.72:0/2963887368 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4fbc004850 msgr2=0x7f4fbc004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:09.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.317+0000 7f4fd359e700 1 --2- 172.21.15.72:0/2963887368 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4fbc004850 0x7f4fbc004cd0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f4fc4009b90 tx=0x7f4fbc005880 comp rx=0 tx=0).stop 2023-07-25T14:36:09.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.317+0000 7f4fd2d9d700 1 -- 172.21.15.72:0/2963887368 reap_dead start 2023-07-25T14:36:09.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.317+0000 7f4fd359e700 1 -- 172.21.15.72:0/2963887368 shutdown_connections 2023-07-25T14:36:09.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.317+0000 7f4fd359e700 1 -- 172.21.15.72:0/2963887368 >> 172.21.15.72:0/2963887368 conn(0x7f4fd40a9ba0 msgr2=0x7f4fd40a9fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:09.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.317+0000 7f4fd359e700 1 -- 172.21.15.72:0/2963887368 shutdown_connections 2023-07-25T14:36:09.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.317+0000 7f4fd359e700 1 -- 172.21.15.72:0/2963887368 wait complete. 2023-07-25T14:36:09.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.318+0000 7f4fd359e700 1 Processor -- start 2023-07-25T14:36:09.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.318+0000 7f4fd359e700 1 -- start start 2023-07-25T14:36:09.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.319+0000 7f4fd359e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4fbc004850 0x7f4fd40c3bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:09.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.319+0000 7f4fd359e700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4fd40c1990 0x7f4fd40bfd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:09.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.319+0000 7f4fd359e700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4fd4151c40 0x7f4fd41ecf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:09.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.319+0000 7f4fd359e700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fd40c20a0 con 0x7f4fbc004850 2023-07-25T14:36:09.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.319+0000 7f4fd359e700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fd40c3790 con 0x7f4fd40c1990 2023-07-25T14:36:09.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.319+0000 7f4fd359e700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fd4146510 con 0x7f4fd4151c40 2023-07-25T14:36:09.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.319+0000 7f4fd259c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4fbc004850 0x7f4fd40c3bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:09.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.319+0000 7f4fd259c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4fbc004850 0x7f4fd40c3bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40538/0 (socket says 172.21.15.72:40538) 2023-07-25T14:36:09.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.319+0000 7f4fd259c700 1 -- 172.21.15.72:0/2295562330 learned_addr learned my addr 172.21.15.72:0/2295562330 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:09.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.319+0000 7f4fd1d9b700 1 --2- 172.21.15.72:0/2295562330 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4fd40c1990 0x7f4fd40bfd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:09.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.319+0000 7f4fd2d9d700 1 --2- 172.21.15.72:0/2295562330 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4fd4151c40 0x7f4fd41ecf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:09.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.319+0000 7f4fd259c700 1 -- 172.21.15.72:0/2295562330 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4fd4151c40 msgr2=0x7f4fd41ecf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:09.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.319+0000 7f4fd259c700 1 --2- 172.21.15.72:0/2295562330 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4fd4151c40 0x7f4fd41ecf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:09.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.319+0000 7f4fd259c700 1 -- 172.21.15.72:0/2295562330 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4fd40c1990 msgr2=0x7f4fd40bfd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:09.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.319+0000 7f4fd259c700 1 --2- 172.21.15.72:0/2295562330 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4fd40c1990 0x7f4fd40bfd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:09.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.319+0000 7f4fd259c700 1 -- 172.21.15.72:0/2295562330 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fd40c3180 con 0x7f4fbc004850 2023-07-25T14:36:09.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.319+0000 7f4fd259c700 1 --2- 172.21.15.72:0/2295562330 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4fbc004850 0x7f4fd40c3bb0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f4fc80119d0 tx=0x7f4fc8011ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:09.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.320+0000 7f4fc2ffd700 1 -- 172.21.15.72:0/2295562330 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fc8011e70 con 0x7f4fbc004850 2023-07-25T14:36:09.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.320+0000 7f4fc2ffd700 1 -- 172.21.15.72:0/2295562330 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fc800f940 con 0x7f4fbc004850 2023-07-25T14:36:09.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.320+0000 7f4fd359e700 1 -- 172.21.15.72:0/2295562330 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fd40a9520 con 0x7f4fbc004850 2023-07-25T14:36:09.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.320+0000 7f4fc2ffd700 1 -- 172.21.15.72:0/2295562330 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fc800fcd0 con 0x7f4fbc004850 2023-07-25T14:36:09.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.320+0000 7f4fd359e700 1 -- 172.21.15.72:0/2295562330 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fd4151a60 con 0x7f4fbc004850 2023-07-25T14:36:09.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.321+0000 7f4fd359e700 1 -- 172.21.15.72:0/2295562330 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fd404ecc0 con 0x7f4fbc004850 2023-07-25T14:36:09.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.321+0000 7f4fc2ffd700 1 -- 172.21.15.72:0/2295562330 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4fc8014440 con 0x7f4fbc004850 2023-07-25T14:36:09.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.321+0000 7f4fc2ffd700 1 --2- 172.21.15.72:0/2295562330 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f4fb406ac70 0x7f4fb406d130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:09.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.321+0000 7f4fc2ffd700 1 -- 172.21.15.72:0/2295562330 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f4fc8089bc0 con 0x7f4fbc004850 2023-07-25T14:36:09.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.321+0000 7f4fd1d9b700 1 --2- 172.21.15.72:0/2295562330 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f4fb406ac70 0x7f4fb406d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:09.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.322+0000 7f4fd1d9b700 1 --2- 172.21.15.72:0/2295562330 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f4fb406ac70 0x7f4fb406d130 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f4fc40090b0 tx=0x7f4fc4008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:09.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.325+0000 7f4fc2ffd700 1 -- 172.21.15.72:0/2295562330 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f4fc80548f0 con 0x7f4fbc004850 2023-07-25T14:36:09.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.511+0000 7f4fd359e700 1 -- 172.21.15.72:0/2295562330 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4fd4071830 con 0x7f4fbc004850 2023-07-25T14:36:09.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.512+0000 7f4fc2ffd700 1 -- 172.21.15.72:0/2295562330 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4fc8057f10 con 0x7f4fbc004850 2023-07-25T14:36:09.524 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 1 2023-07-25T14:36:09.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.514+0000 7f4fd359e700 1 -- 172.21.15.72:0/2295562330 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f4fb406ac70 msgr2=0x7f4fb406d130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:09.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.514+0000 7f4fd359e700 1 --2- 172.21.15.72:0/2295562330 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f4fb406ac70 0x7f4fb406d130 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f4fc40090b0 tx=0x7f4fc4008030 comp rx=0 tx=0).stop 2023-07-25T14:36:09.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.514+0000 7f4fd359e700 1 -- 172.21.15.72:0/2295562330 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4fbc004850 msgr2=0x7f4fd40c3bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:09.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.514+0000 7f4fd359e700 1 --2- 172.21.15.72:0/2295562330 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4fbc004850 0x7f4fd40c3bb0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f4fc80119d0 tx=0x7f4fc8011ce0 comp rx=0 tx=0).stop 2023-07-25T14:36:09.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.514+0000 7f4fd359e700 1 -- 172.21.15.72:0/2295562330 shutdown_connections 2023-07-25T14:36:09.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.514+0000 7f4fd359e700 1 --2- 172.21.15.72:0/2295562330 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f4fb406ac70 0x7f4fb406d130 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:09.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.514+0000 7f4fd359e700 1 --2- 172.21.15.72:0/2295562330 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4fd4151c40 0x7f4fd41ecf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:09.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.514+0000 7f4fd359e700 1 --2- 172.21.15.72:0/2295562330 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4fbc004850 0x7f4fd40c3bb0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:09.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.514+0000 7f4fd359e700 1 --2- 172.21.15.72:0/2295562330 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4fd40c1990 0x7f4fd40bfd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:09.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.514+0000 7f4fd359e700 1 -- 172.21.15.72:0/2295562330 >> 172.21.15.72:0/2295562330 conn(0x7f4fd40a9ba0 msgr2=0x7f4fd41424c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:09.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.514+0000 7f4fd359e700 1 -- 172.21.15.72:0/2295562330 shutdown_connections 2023-07-25T14:36:09.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.514+0000 7f4fd359e700 1 -- 172.21.15.72:0/2295562330 wait complete. 2023-07-25T14:36:09.538 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-25T14:36:09.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.649+0000 7ffab4c3f700 1 Processor -- start 2023-07-25T14:36:09.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.649+0000 7ffab4c3f700 1 -- start start 2023-07-25T14:36:09.662 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.649+0000 7ffab4c3f700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ffab0151ba0 0x7ffab00c2230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:09.662 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.649+0000 7ffab4c3f700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffab00c54f0 con 0x7ffab0154d50 2023-07-25T14:36:09.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.649+0000 7ffab4c3f700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffab00c6670 con 0x7ffab00c5f40 2023-07-25T14:36:09.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.649+0000 7ffab4c3f700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffab00c5740 con 0x7ffab0151ba0 2023-07-25T14:36:09.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.650+0000 7ffaae59c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ffab0151ba0 0x7ffab00c2230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:09.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.650+0000 7ffaaed9d700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7ffab0154d50 0x7ffab015b970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:59518/0 (socket says 172.21.15.72:59518) 2023-07-25T14:36:09.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.650+0000 7ffaaed9d700 1 -- 172.21.15.72:0/977453732 learned_addr learned my addr 172.21.15.72:0/977453732 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:36:09.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.650+0000 7ffaae59c700 1 -- 172.21.15.72:0/977453732 >> v1:172.21.15.92:6789/0 conn(0x7ffab00c5f40 legacy=0x7ffab0154640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:09.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.650+0000 7ffaae59c700 1 -- 172.21.15.72:0/977453732 >> v1:172.21.15.72:6789/0 conn(0x7ffab0154d50 legacy=0x7ffab015b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:09.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.650+0000 7ffaad59a700 1 -- 172.21.15.72:0/977453732 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2817663443 0 0) 0x7ffab00c54f0 con 0x7ffab0154d50 2023-07-25T14:36:09.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.650+0000 7ffaae59c700 1 -- 172.21.15.72:0/977453732 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffab00c5a20 con 0x7ffab0151ba0 2023-07-25T14:36:09.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.650+0000 7ffaae59c700 1 --2- 172.21.15.72:0/977453732 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffab0151ba0 0x7ffab00c2230 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7ffaa4009840 tx=0x7ffaa4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ceae94dc14a70016 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:09.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.650+0000 7ffaad59a700 1 -- 172.21.15.72:0/977453732 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaa4011830 con 0x7ffab0151ba0 2023-07-25T14:36:09.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.650+0000 7ffaad59a700 1 -- 172.21.15.72:0/977453732 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffaa4011990 con 0x7ffab0151ba0 2023-07-25T14:36:09.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.650+0000 7ffaad59a700 1 -- 172.21.15.72:0/977453732 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaa4011d20 con 0x7ffab0151ba0 2023-07-25T14:36:09.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.651+0000 7ffab4c3f700 1 -- 172.21.15.72:0/977453732 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffab0151ba0 msgr2=0x7ffab00c2230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:09.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.651+0000 7ffab4c3f700 1 --2- 172.21.15.72:0/977453732 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffab0151ba0 0x7ffab00c2230 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7ffaa4009840 tx=0x7ffaa4009b50 comp rx=0 tx=0).stop 2023-07-25T14:36:09.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.651+0000 7ffab4c3f700 1 -- 172.21.15.72:0/977453732 shutdown_connections 2023-07-25T14:36:09.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.651+0000 7ffab4c3f700 1 --2- 172.21.15.72:0/977453732 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffab0151ba0 0x7ffab00c2230 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:09.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.651+0000 7ffab4c3f700 1 -- 172.21.15.72:0/977453732 >> 172.21.15.72:0/977453732 conn(0x7ffab00a87e0 msgr2=0x7ffab00a8bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:09.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.651+0000 7ffab4c3f700 1 -- 172.21.15.72:0/977453732 shutdown_connections 2023-07-25T14:36:09.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.651+0000 7ffab4c3f700 1 -- 172.21.15.72:0/977453732 wait complete. 2023-07-25T14:36:09.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.652+0000 7ffab4c3f700 1 Processor -- start 2023-07-25T14:36:09.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.652+0000 7ffab4c3f700 1 -- start start 2023-07-25T14:36:09.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.653+0000 7ffab4c3f700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffab00c5f40 0x7ffab0150840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:09.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.653+0000 7ffab4c3f700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ffab0151ba0 0x7ffab00bc0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:09.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.653+0000 7ffab4c3f700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffab0154160 0x7ffab00bc5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:09.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.653+0000 7ffab4c3f700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffab014b3a0 con 0x7ffab0154160 2023-07-25T14:36:09.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.653+0000 7ffab4c3f700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffab01537a0 con 0x7ffab00c5f40 2023-07-25T14:36:09.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.653+0000 7ffab4c3f700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffab0153d20 con 0x7ffab0151ba0 2023-07-25T14:36:09.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.653+0000 7ffaaed9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffab0154160 0x7ffab00bc5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:09.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.653+0000 7ffaaed9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffab0154160 0x7ffab00bc5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40556/0 (socket says 172.21.15.72:40556) 2023-07-25T14:36:09.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.653+0000 7ffaaed9d700 1 -- 172.21.15.72:0/1165105310 learned_addr learned my addr 172.21.15.72:0/1165105310 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:09.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.653+0000 7ffaae59c700 1 --2- 172.21.15.72:0/1165105310 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffab00c5f40 0x7ffab0150840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:09.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.653+0000 7ffaadd9b700 1 --2- 172.21.15.72:0/1165105310 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ffab0151ba0 0x7ffab00bc0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:09.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.653+0000 7ffaaed9d700 1 -- 172.21.15.72:0/1165105310 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ffab0151ba0 msgr2=0x7ffab00bc0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:09.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.653+0000 7ffaaed9d700 1 --2- 172.21.15.72:0/1165105310 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ffab0151ba0 0x7ffab00bc0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:09.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.653+0000 7ffaaed9d700 1 -- 172.21.15.72:0/1165105310 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffab00c5f40 msgr2=0x7ffab0150840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:09.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.653+0000 7ffaaed9d700 1 --2- 172.21.15.72:0/1165105310 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffab00c5f40 0x7ffab0150840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:09.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.653+0000 7ffaaed9d700 1 -- 172.21.15.72:0/1165105310 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaa40094a0 con 0x7ffab0154160 2023-07-25T14:36:09.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.653+0000 7ffaadd9b700 1 --2- 172.21.15.72:0/1165105310 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ffab0151ba0 0x7ffab00bc0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-25T14:36:09.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.653+0000 7ffaaed9d700 1 --2- 172.21.15.72:0/1165105310 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffab0154160 0x7ffab00bc5e0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7ffaa800cb60 tx=0x7ffaa800ce70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:09.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.653+0000 7ffa9effd700 1 -- 172.21.15.72:0/1165105310 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaa800aaa0 con 0x7ffab0154160 2023-07-25T14:36:09.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.653+0000 7ffa9effd700 1 -- 172.21.15.72:0/1165105310 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffaa800ac00 con 0x7ffab0154160 2023-07-25T14:36:09.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.653+0000 7ffab4c3f700 1 -- 172.21.15.72:0/1165105310 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffab01e9b00 con 0x7ffab0154160 2023-07-25T14:36:09.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.654+0000 7ffa9effd700 1 -- 172.21.15.72:0/1165105310 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaa80070d0 con 0x7ffab0154160 2023-07-25T14:36:09.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.654+0000 7ffab4c3f700 1 -- 172.21.15.72:0/1165105310 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffab01e6cd0 con 0x7ffab0154160 2023-07-25T14:36:09.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.654+0000 7ffab4c3f700 1 -- 172.21.15.72:0/1165105310 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffab01e6ec0 con 0x7ffab0154160 2023-07-25T14:36:09.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.655+0000 7ffa9effd700 1 -- 172.21.15.72:0/1165105310 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ffaa8007230 con 0x7ffab0154160 2023-07-25T14:36:09.672 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.655+0000 7ffa9effd700 1 --2- 172.21.15.72:0/1165105310 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7ffa9006ad10 0x7ffa9006d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:09.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.655+0000 7ffa9effd700 1 -- 172.21.15.72:0/1165105310 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7ffaa80894f0 con 0x7ffab0154160 2023-07-25T14:36:09.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.655+0000 7ffaae59c700 1 --2- 172.21.15.72:0/1165105310 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7ffa9006ad10 0x7ffa9006d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:09.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.656+0000 7ffaae59c700 1 --2- 172.21.15.72:0/1165105310 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7ffa9006ad10 0x7ffa9006d1d0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7ffaa40090b0 tx=0x7ffaa4008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:09.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.660+0000 7ffa9effd700 1 -- 172.21.15.72:0/1165105310 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7ffaa80542b0 con 0x7ffab0154160 2023-07-25T14:36:09.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.848+0000 7ffab4c3f700 1 -- 172.21.15.72:0/1165105310 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ffab004e470 con 0x7ffab0154160 2023-07-25T14:36:09.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.848+0000 7ffa9effd700 1 -- 172.21.15.72:0/1165105310 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7ffaa80578d0 con 0x7ffab0154160 2023-07-25T14:36:09.861 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2023-07-25T14:36:09.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.850+0000 7ffab4c3f700 1 -- 172.21.15.72:0/1165105310 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7ffa9006ad10 msgr2=0x7ffa9006d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:09.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.850+0000 7ffab4c3f700 1 --2- 172.21.15.72:0/1165105310 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7ffa9006ad10 0x7ffa9006d1d0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7ffaa40090b0 tx=0x7ffaa4008030 comp rx=0 tx=0).stop 2023-07-25T14:36:09.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.850+0000 7ffab4c3f700 1 -- 172.21.15.72:0/1165105310 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffab0154160 msgr2=0x7ffab00bc5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:09.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.850+0000 7ffab4c3f700 1 --2- 172.21.15.72:0/1165105310 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffab0154160 0x7ffab00bc5e0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7ffaa800cb60 tx=0x7ffaa800ce70 comp rx=0 tx=0).stop 2023-07-25T14:36:09.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.850+0000 7ffab4c3f700 1 -- 172.21.15.72:0/1165105310 shutdown_connections 2023-07-25T14:36:09.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.850+0000 7ffab4c3f700 1 --2- 172.21.15.72:0/1165105310 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7ffa9006ad10 0x7ffa9006d1d0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:09.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.850+0000 7ffab4c3f700 1 --2- 172.21.15.72:0/1165105310 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffab0154160 0x7ffab00bc5e0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:09.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.850+0000 7ffab4c3f700 1 --2- 172.21.15.72:0/1165105310 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffab00c5f40 0x7ffab0150840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:09.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.850+0000 7ffab4c3f700 1 --2- 172.21.15.72:0/1165105310 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ffab0151ba0 0x7ffab00bc0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:09.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.850+0000 7ffab4c3f700 1 -- 172.21.15.72:0/1165105310 >> 172.21.15.72:0/1165105310 conn(0x7ffab00a87e0 msgr2=0x7ffab014fa30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:09.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.850+0000 7ffab4c3f700 1 -- 172.21.15.72:0/1165105310 shutdown_connections 2023-07-25T14:36:09.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.850+0000 7ffab4c3f700 1 -- 172.21.15.72:0/1165105310 wait complete. 2023-07-25T14:36:09.874 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-25T14:36:09.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.984+0000 7f2fc9b35700 1 Processor -- start 2023-07-25T14:36:09.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.984+0000 7f2fc9b35700 1 -- start start 2023-07-25T14:36:09.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.985+0000 7f2fc9b35700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f2fc4151950 0x7f2fc406a190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:09.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.985+0000 7f2fc9b35700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2fc406a6d0 0x7f2fc40c3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:09.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.985+0000 7f2fc9b35700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fc40c2fe0 con 0x7f2fc40724c0 2023-07-25T14:36:09.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.985+0000 7f2fc9b35700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fc4071a60 con 0x7f2fc406a6d0 2023-07-25T14:36:09.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.985+0000 7f2fc9b35700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fc40c2a70 con 0x7f2fc4151950 2023-07-25T14:36:09.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.985+0000 7f2fc3fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2fc406a6d0 0x7f2fc40c3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:09.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.985+0000 7f2fc2ffd700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f2fc40724c0 0x7f2fc40c34c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:59530/0 (socket says 172.21.15.72:59530) 2023-07-25T14:36:09.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.985+0000 7f2fc2ffd700 1 -- 172.21.15.72:0/2624211762 learned_addr learned my addr 172.21.15.72:0/2624211762 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:36:10.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.985+0000 7f2fc37fe700 1 --2- 172.21.15.72:0/2624211762 >> v2:172.21.15.92:3300/0 conn(0x7f2fc4151950 0x7f2fc406a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:10.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.985+0000 7f2fc3fff700 1 -- 172.21.15.72:0/2624211762 >> v2:172.21.15.92:3300/0 conn(0x7f2fc4151950 msgr2=0x7f2fc406a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:10.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.985+0000 7f2fc3fff700 1 --2- 172.21.15.72:0/2624211762 >> v2:172.21.15.92:3300/0 conn(0x7f2fc4151950 0x7f2fc406a190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:10.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.985+0000 7f2fc3fff700 1 -- 172.21.15.72:0/2624211762 >> v1:172.21.15.72:6789/0 conn(0x7f2fc40724c0 legacy=0x7f2fc40c34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:10.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.985+0000 7f2fc3fff700 1 -- 172.21.15.72:0/2624211762 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fc4155070 con 0x7f2fc406a6d0 2023-07-25T14:36:10.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.985+0000 7f2fc27fc700 1 -- 172.21.15.72:0/2624211762 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2501164747 0 0) 0x7f2fc40c2fe0 con 0x7f2fc40724c0 2023-07-25T14:36:10.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.985+0000 7f2fc37fe700 1 --2- 172.21.15.72:0/2624211762 >> v2:172.21.15.92:3300/0 conn(0x7f2fc4151950 0x7f2fc406a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-25T14:36:10.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.985+0000 7f2fc3fff700 1 --2- 172.21.15.72:0/2624211762 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2fc406a6d0 0x7f2fc40c3bd0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f2fc406ad50 tx=0x7f2fbc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e387e0044cf1eb5 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:10.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.986+0000 7f2fc27fc700 1 -- 172.21.15.72:0/2624211762 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fbc00e070 con 0x7f2fc406a6d0 2023-07-25T14:36:10.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.986+0000 7f2fc27fc700 1 -- 172.21.15.72:0/2624211762 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fbc00bbd0 con 0x7f2fc406a6d0 2023-07-25T14:36:10.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.986+0000 7f2fc27fc700 1 -- 172.21.15.72:0/2624211762 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fbc012430 con 0x7f2fc406a6d0 2023-07-25T14:36:10.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.986+0000 7f2fc9b35700 1 -- 172.21.15.72:0/2624211762 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2fc406a6d0 msgr2=0x7f2fc40c3bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:10.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.986+0000 7f2fc9b35700 1 --2- 172.21.15.72:0/2624211762 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2fc406a6d0 0x7f2fc40c3bd0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f2fc406ad50 tx=0x7f2fbc00b330 comp rx=0 tx=0).stop 2023-07-25T14:36:10.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.986+0000 7f2fc9b35700 1 -- 172.21.15.72:0/2624211762 shutdown_connections 2023-07-25T14:36:10.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.986+0000 7f2fc9b35700 1 --2- 172.21.15.72:0/2624211762 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2fc406a6d0 0x7f2fc40c3bd0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:10.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.986+0000 7f2fc9b35700 1 --2- 172.21.15.72:0/2624211762 >> v2:172.21.15.92:3300/0 conn(0x7f2fc4151950 0x7f2fc406a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:10.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.986+0000 7f2fc9b35700 1 -- 172.21.15.72:0/2624211762 >> 172.21.15.72:0/2624211762 conn(0x7f2fc40a87e0 msgr2=0x7f2fc40a8bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:10.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.986+0000 7f2fc9b35700 1 -- 172.21.15.72:0/2624211762 shutdown_connections 2023-07-25T14:36:10.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.986+0000 7f2fc9b35700 1 -- 172.21.15.72:0/2624211762 wait complete. 2023-07-25T14:36:10.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.988+0000 7f2fc9b35700 1 Processor -- start 2023-07-25T14:36:10.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.988+0000 7f2fc9b35700 1 -- start start 2023-07-25T14:36:10.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.989+0000 7f2fc9b35700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2fc406a6d0 0x7f2fc40a73a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:10.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.989+0000 7f2fc9b35700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2fc40724c0 0x7f2fc40a78e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:10.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.989+0000 7f2fc9b35700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2fc4151950 0x7f2fc4157df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:10.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.989+0000 7f2fc9b35700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fc40bed70 con 0x7f2fc40724c0 2023-07-25T14:36:10.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.989+0000 7f2fc9b35700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fc414c5b0 con 0x7f2fc4151950 2023-07-25T14:36:10.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.989+0000 7f2fc9b35700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fc41ecb20 con 0x7f2fc406a6d0 2023-07-25T14:36:10.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.989+0000 7f2fc2ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2fc40724c0 0x7f2fc40a78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:10.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.989+0000 7f2fc2ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2fc40724c0 0x7f2fc40a78e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40568/0 (socket says 172.21.15.72:40568) 2023-07-25T14:36:10.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.989+0000 7f2fc2ffd700 1 -- 172.21.15.72:0/1350031677 learned_addr learned my addr 172.21.15.72:0/1350031677 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:10.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.989+0000 7f2fc3fff700 1 --2- 172.21.15.72:0/1350031677 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2fc4151950 0x7f2fc4157df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:10.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.989+0000 7f2fc37fe700 1 --2- 172.21.15.72:0/1350031677 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2fc406a6d0 0x7f2fc40a73a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:10.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.989+0000 7f2fc2ffd700 1 -- 172.21.15.72:0/1350031677 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2fc406a6d0 msgr2=0x7f2fc40a73a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:10.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.989+0000 7f2fc2ffd700 1 --2- 172.21.15.72:0/1350031677 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2fc406a6d0 0x7f2fc40a73a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:10.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.989+0000 7f2fc2ffd700 1 -- 172.21.15.72:0/1350031677 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2fc4151950 msgr2=0x7f2fc4157df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:10.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.989+0000 7f2fc2ffd700 1 --2- 172.21.15.72:0/1350031677 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2fc4151950 0x7f2fc4157df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:10.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.989+0000 7f2fc2ffd700 1 -- 172.21.15.72:0/1350031677 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fbc009a70 con 0x7f2fc40724c0 2023-07-25T14:36:10.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.989+0000 7f2fc3fff700 1 --2- 172.21.15.72:0/1350031677 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2fc4151950 0x7f2fc4157df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-25T14:36:10.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.989+0000 7f2fc2ffd700 1 --2- 172.21.15.72:0/1350031677 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2fc40724c0 0x7f2fc40a78e0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f2fb40011e0 tx=0x7f2fb400cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:10.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.989+0000 7f2fbbfff700 1 -- 172.21.15.72:0/1350031677 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fb4004c80 con 0x7f2fc40724c0 2023-07-25T14:36:10.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.989+0000 7f2fbbfff700 1 -- 172.21.15.72:0/1350031677 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fb4004e00 con 0x7f2fc40724c0 2023-07-25T14:36:10.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.989+0000 7f2fc9b35700 1 -- 172.21.15.72:0/1350031677 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fc40a8240 con 0x7f2fc40724c0 2023-07-25T14:36:10.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.989+0000 7f2fbbfff700 1 -- 172.21.15.72:0/1350031677 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fb4007310 con 0x7f2fc40724c0 2023-07-25T14:36:10.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.989+0000 7f2fc9b35700 1 -- 172.21.15.72:0/1350031677 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fc40bf480 con 0x7f2fc40724c0 2023-07-25T14:36:10.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.990+0000 7f2fc9b35700 1 -- 172.21.15.72:0/1350031677 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fc404e470 con 0x7f2fc40724c0 2023-07-25T14:36:10.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.991+0000 7f2fbbfff700 1 -- 172.21.15.72:0/1350031677 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2fb4007470 con 0x7f2fc40724c0 2023-07-25T14:36:10.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.991+0000 7f2fbbfff700 1 --2- 172.21.15.72:0/1350031677 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f2fa406ace0 0x7f2fa406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:10.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.991+0000 7f2fbbfff700 1 -- 172.21.15.72:0/1350031677 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f2fb4089430 con 0x7f2fc40724c0 2023-07-25T14:36:10.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.991+0000 7f2fc37fe700 1 --2- 172.21.15.72:0/1350031677 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f2fa406ace0 0x7f2fa406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:10.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.992+0000 7f2fc37fe700 1 --2- 172.21.15.72:0/1350031677 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f2fa406ace0 0x7f2fa406d1a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f2fac006fd0 tx=0x7f2fac008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:10.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:09.995+0000 7f2fbbfff700 1 -- 172.21.15.72:0/1350031677 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f2fb4054280 con 0x7f2fc40724c0 2023-07-25T14:36:10.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:10.181+0000 7f2fc9b35700 1 -- 172.21.15.72:0/1350031677 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f2fc40722a0 con 0x7f2fc40724c0 2023-07-25T14:36:10.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:10.182+0000 7f2fbbfff700 1 -- 172.21.15.72:0/1350031677 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2fb40578a0 con 0x7f2fc40724c0 2023-07-25T14:36:10.194 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 64 2023-07-25T14:36:10.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:10.183+0000 7f2fc9b35700 1 -- 172.21.15.72:0/1350031677 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f2fa406ace0 msgr2=0x7f2fa406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:10.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:10.183+0000 7f2fc9b35700 1 --2- 172.21.15.72:0/1350031677 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f2fa406ace0 0x7f2fa406d1a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f2fac006fd0 tx=0x7f2fac008040 comp rx=0 tx=0).stop 2023-07-25T14:36:10.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:10.183+0000 7f2fc9b35700 1 -- 172.21.15.72:0/1350031677 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2fc40724c0 msgr2=0x7f2fc40a78e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:10.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:10.183+0000 7f2fc9b35700 1 --2- 172.21.15.72:0/1350031677 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2fc40724c0 0x7f2fc40a78e0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f2fb40011e0 tx=0x7f2fb400cae0 comp rx=0 tx=0).stop 2023-07-25T14:36:10.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:10.184+0000 7f2fc9b35700 1 -- 172.21.15.72:0/1350031677 shutdown_connections 2023-07-25T14:36:10.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:10.184+0000 7f2fc9b35700 1 --2- 172.21.15.72:0/1350031677 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f2fa406ace0 0x7f2fa406d1a0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:10.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:10.184+0000 7f2fc9b35700 1 --2- 172.21.15.72:0/1350031677 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2fc406a6d0 0x7f2fc40a73a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:10.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:10.184+0000 7f2fc9b35700 1 --2- 172.21.15.72:0/1350031677 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2fc4151950 0x7f2fc4157df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:10.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:10.184+0000 7f2fc9b35700 1 --2- 172.21.15.72:0/1350031677 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2fc40724c0 0x7f2fc40a78e0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:10.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:10.184+0000 7f2fc9b35700 1 -- 172.21.15.72:0/1350031677 >> 172.21.15.72:0/1350031677 conn(0x7f2fc40a87e0 msgr2=0x7f2fc414f730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:10.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:10.184+0000 7f2fc9b35700 1 -- 172.21.15.72:0/1350031677 shutdown_connections 2023-07-25T14:36:10.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:10.184+0000 7f2fc9b35700 1 -- 172.21.15.72:0/1350031677 wait complete. 2023-07-25T14:36:10.208 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-07-25T14:36:10.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:10.318+0000 7fd80e7ad700 1 Processor -- start 2023-07-25T14:36:10.331 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:10.318+0000 7fd80e7ad700 1 -- start start 2023-07-25T14:36:10.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:10.319+0000 7fd80e7ad700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd808151950 0x7fd80806a190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:10.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:10.319+0000 7fd80e7ad700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fd80806a6d0 0x7fd8080c3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:10.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:10.319+0000 7fd80e7ad700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8080c2fe0 con 0x7fd8080724c0 2023-07-25T14:36:10.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:10.319+0000 7fd80e7ad700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd808071a60 con 0x7fd80806a6d0 2023-07-25T14:36:10.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:10.319+0000 7fd80e7ad700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8080c2a70 con 0x7fd808151950 2023-07-25T14:36:10.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:10.319+0000 7fd8077fe700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fd8080724c0 0x7fd8080c34c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:59542/0 (socket says 172.21.15.72:59542) 2023-07-25T14:36:10.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:10.319+0000 7fd8077fe700 1 -- 172.21.15.72:0/343406223 learned_addr learned my addr 172.21.15.72:0/343406223 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:36:10.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:10.319+0000 7fd807fff700 1 --2- 172.21.15.72:0/343406223 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd808151950 0x7fd80806a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:10.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:10.319+0000 7fd80cd4a700 1 --2- 172.21.15.72:0/343406223 >> v2:172.21.15.92:3300/0 conn(0x7fd80806a6d0 0x7fd8080c3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:10.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:10.319+0000 7fd806ffd700 1 -- 172.21.15.72:0/343406223 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2523729220 0 0) 0x7fd8080c2fe0 con 0x7fd8080724c0 2023-07-25T14:36:10.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:10.319+0000 7fd806ffd700 1 -- 172.21.15.72:0/343406223 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd7f00035b0 con 0x7fd8080724c0 2023-07-25T14:36:10.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:10.320+0000 7fd806ffd700 1 -- 172.21.15.72:0/343406223 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3914808228 0 0) 0x7fd7f00035b0 con 0x7fd8080724c0 2023-07-25T14:36:10.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:10.320+0000 7fd806ffd700 1 -- 172.21.15.72:0/343406223 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd808151950 msgr2=0x7fd80806a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:10.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:10.320+0000 7fd806ffd700 1 --2- 172.21.15.72:0/343406223 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd808151950 0x7fd80806a190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:10.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:10.320+0000 7fd806ffd700 1 -- 172.21.15.72:0/343406223 >> v2:172.21.15.92:3300/0 conn(0x7fd80806a6d0 msgr2=0x7fd8080c3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:10.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:10.320+0000 7fd806ffd700 1 --2- 172.21.15.72:0/343406223 >> v2:172.21.15.92:3300/0 conn(0x7fd80806a6d0 0x7fd8080c3bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:10.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:10.320+0000 7fd806ffd700 1 -- 172.21.15.72:0/343406223 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd808155070 con 0x7fd8080724c0 2023-07-25T14:36:10.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:10.320+0000 7fd806ffd700 1 -- 172.21.15.72:0/343406223 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2559588315 0 0) 0x7fd7f8001670 con 0x7fd8080724c0 2023-07-25T14:36:10.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:10.320+0000 7fd806ffd700 1 -- 172.21.15.72:0/343406223 >> v1:172.21.15.72:6789/0 conn(0x7fd8080724c0 legacy=0x7fd8080c34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:10.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:10.320+0000 7fd806ffd700 1 --2- 172.21.15.72:0/343406223 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd808151950 0x7fd7f0003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:10.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:10.320+0000 7fd806ffd700 1 --2- 172.21.15.72:0/343406223 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd7f0003f80 0x7fd7f0004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:10.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:10.320+0000 7fd806ffd700 1 --2- 172.21.15.72:0/343406223 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd7f0004d90 0x7fd7f0005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:10.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:10.320+0000 7fd806ffd700 1 -- 172.21.15.72:0/343406223 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd808071a60 con 0x7fd7f0003f80 2023-07-25T14:36:10.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:10.320+0000 7fd806ffd700 1 -- 172.21.15.72:0/343406223 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7f000ba10 con 0x7fd7f0004d90 2023-07-25T14:36:10.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:10.320+0000 7fd806ffd700 1 -- 172.21.15.72:0/343406223 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7f000bba0 con 0x7fd808151950 2023-07-25T14:36:10.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:10.320+0000 7fd8077fe700 1 --2- 172.21.15.72:0/343406223 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd7f0003f80 0x7fd7f0004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:10.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:10.320+0000 7fd807fff700 1 --2- 172.21.15.72:0/343406223 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd808151950 0x7fd7f0003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:10.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:10.320+0000 7fd80cd4a700 1 --2- 172.21.15.72:0/343406223 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd7f0004d90 0x7fd7f0005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:10.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:10.320+0000 7fd8077fe700 1 -- 172.21.15.72:0/343406223 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd808151950 msgr2=0x7fd7f0003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:10.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:10.320+0000 7fd8077fe700 1 --2- 172.21.15.72:0/343406223 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd808151950 0x7fd7f0003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:10.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:10.320+0000 7fd8077fe700 1 -- 172.21.15.72:0/343406223 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd7f0004d90 msgr2=0x7fd7f0005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:10.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:10.320+0000 7fd8077fe700 1 --2- 172.21.15.72:0/343406223 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd7f0004d90 0x7fd7f0005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:10.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:10.320+0000 7fd8077fe700 1 -- 172.21.15.72:0/343406223 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7f00035b0 con 0x7fd7f0003f80 2023-07-25T14:36:10.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:10.320+0000 7fd8077fe700 1 --2- 172.21.15.72:0/343406223 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd7f0003f80 0x7fd7f0004850 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fd7f800c320 tx=0x7fd7f0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8507b021e35c622e server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:10.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:10.320+0000 7fd806ffd700 1 -- 172.21.15.72:0/343406223 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7f800ce20 con 0x7fd7f0003f80 2023-07-25T14:36:10.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:10.320+0000 7fd806ffd700 1 -- 172.21.15.72:0/343406223 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7f8005960 con 0x7fd7f0003f80 2023-07-25T14:36:10.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:10.320+0000 7fd806ffd700 1 -- 172.21.15.72:0/343406223 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7f8005d10 con 0x7fd7f0003f80 2023-07-25T14:36:10.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:10.321+0000 7fd80e7ad700 1 -- 172.21.15.72:0/343406223 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd7f0003f80 msgr2=0x7fd7f0004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:10.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:10.321+0000 7fd80e7ad700 1 --2- 172.21.15.72:0/343406223 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd7f0003f80 0x7fd7f0004850 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fd7f800c320 tx=0x7fd7f0005880 comp rx=0 tx=0).stop 2023-07-25T14:36:10.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:10.321+0000 7fd80cd4a700 1 -- 172.21.15.72:0/343406223 reap_dead start 2023-07-25T14:36:10.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:10.321+0000 7fd80e7ad700 1 -- 172.21.15.72:0/343406223 shutdown_connections 2023-07-25T14:36:10.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:10.321+0000 7fd80e7ad700 1 -- 172.21.15.72:0/343406223 >> 172.21.15.72:0/343406223 conn(0x7fd8080a87e0 msgr2=0x7fd8080a8bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:10.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:10.321+0000 7fd80e7ad700 1 -- 172.21.15.72:0/343406223 shutdown_connections 2023-07-25T14:36:10.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:10.321+0000 7fd80e7ad700 1 -- 172.21.15.72:0/343406223 wait complete. 2023-07-25T14:36:10.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:10.322+0000 7fd80e7ad700 1 Processor -- start 2023-07-25T14:36:10.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:10.322+0000 7fd80e7ad700 1 -- start start 2023-07-25T14:36:10.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:10.323+0000 7fd80e7ad700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd7f0003f80 0x7fd8081ec9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:10.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:10.323+0000 7fd80e7ad700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd80814fe50 0x7fd80814b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:10.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:10.323+0000 7fd80e7ad700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd8081ecee0 0x7fd80814bf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:10.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:10.323+0000 7fd80e7ad700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8080c0300 con 0x7fd8081ecee0 2023-07-25T14:36:10.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:10.323+0000 7fd80e7ad700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8080a5c70 con 0x7fd80814fe50 2023-07-25T14:36:10.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:10.323+0000 7fd80e7ad700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8081e9d70 con 0x7fd7f0003f80 2023-07-25T14:36:10.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:10.323+0000 7fd80cd4a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd8081ecee0 0x7fd80814bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:10.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:10.323+0000 7fd80cd4a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd8081ecee0 0x7fd80814bf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40590/0 (socket says 172.21.15.72:40590) 2023-07-25T14:36:10.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:10.323+0000 7fd80cd4a700 1 -- 172.21.15.72:0/2614864596 learned_addr learned my addr 172.21.15.72:0/2614864596 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:10.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:10.323+0000 7fd807fff700 1 --2- 172.21.15.72:0/2614864596 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd7f0003f80 0x7fd8081ec9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:10.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:10.323+0000 7fd8077fe700 1 --2- 172.21.15.72:0/2614864596 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd80814fe50 0x7fd80814b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:10.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:10.323+0000 7fd80cd4a700 1 -- 172.21.15.72:0/2614864596 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd7f0003f80 msgr2=0x7fd8081ec9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:10.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:10.323+0000 7fd80cd4a700 1 --2- 172.21.15.72:0/2614864596 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd7f0003f80 0x7fd8081ec9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:10.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:10.323+0000 7fd80cd4a700 1 -- 172.21.15.72:0/2614864596 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd80814fe50 msgr2=0x7fd80814b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:10.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:10.324+0000 7fd80cd4a700 1 --2- 172.21.15.72:0/2614864596 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd80814fe50 0x7fd80814b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:10.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:10.324+0000 7fd80cd4a700 1 -- 172.21.15.72:0/2614864596 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8081ea050 con 0x7fd8081ecee0 2023-07-25T14:36:10.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:10.324+0000 7fd80cd4a700 1 --2- 172.21.15.72:0/2614864596 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd8081ecee0 0x7fd80814bf10 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fd80806aec0 tx=0x7fd800011ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:10.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:10.324+0000 7fd804ff9700 1 -- 172.21.15.72:0/2614864596 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd80000e040 con 0x7fd8081ecee0 2023-07-25T14:36:10.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:10.324+0000 7fd804ff9700 1 -- 172.21.15.72:0/2614864596 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd80000f040 con 0x7fd8081ecee0 2023-07-25T14:36:10.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:10.324+0000 7fd80e7ad700 1 -- 172.21.15.72:0/2614864596 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8080c04e0 con 0x7fd8081ecee0 2023-07-25T14:36:10.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:10.324+0000 7fd804ff9700 1 -- 172.21.15.72:0/2614864596 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd80000fc40 con 0x7fd8081ecee0 2023-07-25T14:36:10.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:10.324+0000 7fd80e7ad700 1 -- 172.21.15.72:0/2614864596 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8080c6540 con 0x7fd8081ecee0 2023-07-25T14:36:10.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:10.325+0000 7fd80e7ad700 1 -- 172.21.15.72:0/2614864596 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd80804e470 con 0x7fd8081ecee0 2023-07-25T14:36:10.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:10.325+0000 7fd804ff9700 1 -- 172.21.15.72:0/2614864596 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd800015430 con 0x7fd8081ecee0 2023-07-25T14:36:10.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:10.326+0000 7fd804ff9700 1 --2- 172.21.15.72:0/2614864596 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fd7f406ace0 0x7fd7f406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:10.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:10.326+0000 7fd807fff700 1 --2- 172.21.15.72:0/2614864596 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fd7f406ace0 0x7fd7f406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:10.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:10.326+0000 7fd804ff9700 1 -- 172.21.15.72:0/2614864596 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fd800089f10 con 0x7fd8081ecee0 2023-07-25T14:36:10.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:10.326+0000 7fd807fff700 1 --2- 172.21.15.72:0/2614864596 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fd7f406ace0 0x7fd7f406d1a0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fd7fc009b80 tx=0x7fd7fc009210 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:10.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:10.330+0000 7fd804ff9700 1 -- 172.21.15.72:0/2614864596 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fd800054e10 con 0x7fd8081ecee0 2023-07-25T14:36:10.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:10.516+0000 7fd80e7ad700 1 -- 172.21.15.72:0/2614864596 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fd8081ea1e0 con 0x7fd8081ecee0 2023-07-25T14:36:10.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:10.516+0000 7fd804ff9700 1 -- 172.21.15.72:0/2614864596 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+11 (secure 0 0 0) 0x7fd800058430 con 0x7fd8081ecee0 2023-07-25T14:36:10.529 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2023-07-25T14:36:10.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:10.518+0000 7fd80e7ad700 1 -- 172.21.15.72:0/2614864596 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fd7f406ace0 msgr2=0x7fd7f406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:10.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:10.518+0000 7fd80e7ad700 1 --2- 172.21.15.72:0/2614864596 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fd7f406ace0 0x7fd7f406d1a0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fd7fc009b80 tx=0x7fd7fc009210 comp rx=0 tx=0).stop 2023-07-25T14:36:10.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:10.518+0000 7fd80e7ad700 1 -- 172.21.15.72:0/2614864596 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd8081ecee0 msgr2=0x7fd80814bf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:10.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:10.518+0000 7fd80e7ad700 1 --2- 172.21.15.72:0/2614864596 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd8081ecee0 0x7fd80814bf10 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fd80806aec0 tx=0x7fd800011ed0 comp rx=0 tx=0).stop 2023-07-25T14:36:10.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:10.518+0000 7fd80e7ad700 1 -- 172.21.15.72:0/2614864596 shutdown_connections 2023-07-25T14:36:10.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:10.518+0000 7fd80e7ad700 1 --2- 172.21.15.72:0/2614864596 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fd7f406ace0 0x7fd7f406d1a0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:10.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:10.518+0000 7fd80e7ad700 1 --2- 172.21.15.72:0/2614864596 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd7f0003f80 0x7fd8081ec9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:10.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:10.519+0000 7fd80e7ad700 1 --2- 172.21.15.72:0/2614864596 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd8081ecee0 0x7fd80814bf10 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:10.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:10.519+0000 7fd80e7ad700 1 --2- 172.21.15.72:0/2614864596 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd80814fe50 0x7fd80814b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:10.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:10.519+0000 7fd80e7ad700 1 -- 172.21.15.72:0/2614864596 >> 172.21.15.72:0/2614864596 conn(0x7fd8080a87e0 msgr2=0x7fd8080a6bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:10.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:10.519+0000 7fd80e7ad700 1 -- 172.21.15.72:0/2614864596 shutdown_connections 2023-07-25T14:36:10.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:10.519+0000 7fd80e7ad700 1 -- 172.21.15.72:0/2614864596 wait complete. 2023-07-25T14:36:10.543 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-25T14:36:10.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:10.651+0000 7f6ae4153700 1 Processor -- start 2023-07-25T14:36:10.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:10.651+0000 7f6ae4153700 1 -- start start 2023-07-25T14:36:10.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:10.652+0000 7f6ae4153700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6adc0c3110 0x7f6adc06a190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:10.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:10.652+0000 7f6ae4153700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f6adc06a6d0 0x7f6adc157980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:10.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:10.652+0000 7f6ae4153700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6adc0c2410 con 0x7f6adc151a50 2023-07-25T14:36:10.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:10.652+0000 7f6ae4153700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6adc0c20e0 con 0x7f6adc06a6d0 2023-07-25T14:36:10.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:10.652+0000 7f6ae4153700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6adc151e30 con 0x7f6adc0c3110 2023-07-25T14:36:10.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:10.652+0000 7f6ae26f0700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f6adc06a6d0 0x7f6adc157980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:10.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:10.652+0000 7f6ae26f0700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f6adc06a6d0 0x7f6adc157980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40598/0 (socket says 172.21.15.72:40598) 2023-07-25T14:36:10.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:10.652+0000 7f6ae26f0700 1 -- 172.21.15.72:0/2589653160 learned_addr learned my addr 172.21.15.72:0/2589653160 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:10.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:10.652+0000 7f6ae16ee700 1 --2- 172.21.15.72:0/2589653160 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6adc0c3110 0x7f6adc06a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:10.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:10.653+0000 7f6ae26f0700 1 -- 172.21.15.72:0/2589653160 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6adc0c3110 msgr2=0x7f6adc06a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:10.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:10.653+0000 7f6ae26f0700 1 --2- 172.21.15.72:0/2589653160 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6adc0c3110 0x7f6adc06a190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:10.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:10.653+0000 7f6ae26f0700 1 -- 172.21.15.72:0/2589653160 >> v1:172.21.15.92:6789/0 conn(0x7f6adc151a50 legacy=0x7f6adc0c1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:10.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:10.653+0000 7f6ae26f0700 1 -- 172.21.15.72:0/2589653160 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6adc0c1290 con 0x7f6adc06a6d0 2023-07-25T14:36:10.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:10.653+0000 7f6ae26f0700 1 --2- 172.21.15.72:0/2589653160 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6adc06a6d0 0x7f6adc157980 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f6ad4009e50 tx=0x7f6ad400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=610bb7dd8c7b2a51 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:10.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:10.653+0000 7f6ae0eed700 1 -- 172.21.15.72:0/2589653160 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ad400e070 con 0x7f6adc06a6d0 2023-07-25T14:36:10.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:10.653+0000 7f6ae0eed700 1 -- 172.21.15.72:0/2589653160 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ad400b910 con 0x7f6adc06a6d0 2023-07-25T14:36:10.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:10.653+0000 7f6ae0eed700 1 -- 172.21.15.72:0/2589653160 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ad400bcc0 con 0x7f6adc06a6d0 2023-07-25T14:36:10.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:10.653+0000 7f6ae4153700 1 -- 172.21.15.72:0/2589653160 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6adc06a6d0 msgr2=0x7f6adc157980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:10.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:10.653+0000 7f6ae4153700 1 --2- 172.21.15.72:0/2589653160 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6adc06a6d0 0x7f6adc157980 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f6ad4009e50 tx=0x7f6ad400b330 comp rx=0 tx=0).stop 2023-07-25T14:36:10.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:10.653+0000 7f6ae4153700 1 -- 172.21.15.72:0/2589653160 shutdown_connections 2023-07-25T14:36:10.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:10.653+0000 7f6ae4153700 1 --2- 172.21.15.72:0/2589653160 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6adc06a6d0 0x7f6adc157980 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:10.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:10.653+0000 7f6ae4153700 1 --2- 172.21.15.72:0/2589653160 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6adc0c3110 0x7f6adc06a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:10.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:10.653+0000 7f6ae4153700 1 -- 172.21.15.72:0/2589653160 >> 172.21.15.72:0/2589653160 conn(0x7f6adc0714f0 msgr2=0x7f6adc071900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:10.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:10.654+0000 7f6ae4153700 1 -- 172.21.15.72:0/2589653160 shutdown_connections 2023-07-25T14:36:10.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:10.654+0000 7f6ae4153700 1 -- 172.21.15.72:0/2589653160 wait complete. 2023-07-25T14:36:10.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:10.655+0000 7f6ae4153700 1 Processor -- start 2023-07-25T14:36:10.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:10.655+0000 7f6ae4153700 1 -- start start 2023-07-25T14:36:10.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:10.655+0000 7f6ae4153700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6adc06a6d0 0x7f6adc1ea9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:10.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:10.655+0000 7f6ae4153700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6adc0c3110 0x7f6adc0c56c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:10.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:10.655+0000 7f6ae4153700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6adc151a50 0x7f6adc1547d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:10.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:10.655+0000 7f6ae4153700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6adc0c6f80 con 0x7f6adc151a50 2023-07-25T14:36:10.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:10.655+0000 7f6ae4153700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6adc0bda40 con 0x7f6adc0c3110 2023-07-25T14:36:10.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:10.655+0000 7f6ae4153700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6adc0c7440 con 0x7f6adc06a6d0 2023-07-25T14:36:10.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:10.656+0000 7f6ae26f0700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6adc151a50 0x7f6adc1547d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:10.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:10.656+0000 7f6ae26f0700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6adc151a50 0x7f6adc1547d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40604/0 (socket says 172.21.15.72:40604) 2023-07-25T14:36:10.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:10.656+0000 7f6ae26f0700 1 -- 172.21.15.72:0/1970070764 learned_addr learned my addr 172.21.15.72:0/1970070764 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:10.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:10.656+0000 7f6ae16ee700 1 --2- 172.21.15.72:0/1970070764 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6adc0c3110 0x7f6adc0c56c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:10.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:10.656+0000 7f6ae1eef700 1 --2- 172.21.15.72:0/1970070764 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6adc06a6d0 0x7f6adc1ea9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:10.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:10.656+0000 7f6ae26f0700 1 -- 172.21.15.72:0/1970070764 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6adc06a6d0 msgr2=0x7f6adc1ea9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:10.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:10.656+0000 7f6ae26f0700 1 --2- 172.21.15.72:0/1970070764 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6adc06a6d0 0x7f6adc1ea9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:10.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:10.656+0000 7f6ae26f0700 1 -- 172.21.15.72:0/1970070764 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6adc0c3110 msgr2=0x7f6adc0c56c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:10.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:10.656+0000 7f6ae26f0700 1 --2- 172.21.15.72:0/1970070764 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6adc0c3110 0x7f6adc0c56c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:10.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:10.656+0000 7f6ae26f0700 1 -- 172.21.15.72:0/1970070764 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ad4009b30 con 0x7f6adc151a50 2023-07-25T14:36:10.675 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:10.656+0000 7f6ae26f0700 1 --2- 172.21.15.72:0/1970070764 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6adc151a50 0x7f6adc1547d0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f6adc06ae70 tx=0x7f6ad4004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:10.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:10.656+0000 7f6ad27fc700 1 -- 172.21.15.72:0/1970070764 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ad4004800 con 0x7f6adc151a50 2023-07-25T14:36:10.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:10.656+0000 7f6ad27fc700 1 -- 172.21.15.72:0/1970070764 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ad4004960 con 0x7f6adc151a50 2023-07-25T14:36:10.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:10.656+0000 7f6ae4153700 1 -- 172.21.15.72:0/1970070764 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6adc0c7160 con 0x7f6adc151a50 2023-07-25T14:36:10.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:10.656+0000 7f6ad27fc700 1 -- 172.21.15.72:0/1970070764 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ad401c680 con 0x7f6adc151a50 2023-07-25T14:36:10.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:10.656+0000 7f6ae4153700 1 -- 172.21.15.72:0/1970070764 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6adc1ea1c0 con 0x7f6adc151a50 2023-07-25T14:36:10.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:10.657+0000 7f6ae4153700 1 -- 172.21.15.72:0/1970070764 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6adc04e470 con 0x7f6adc151a50 2023-07-25T14:36:10.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:10.657+0000 7f6ad27fc700 1 -- 172.21.15.72:0/1970070764 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6ad401c7e0 con 0x7f6adc151a50 2023-07-25T14:36:10.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:10.658+0000 7f6ad27fc700 1 --2- 172.21.15.72:0/1970070764 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f6ac006ace0 0x7f6ac006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:10.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:10.658+0000 7f6ae1eef700 1 --2- 172.21.15.72:0/1970070764 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f6ac006ace0 0x7f6ac006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:10.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:10.658+0000 7f6ad27fc700 1 -- 172.21.15.72:0/1970070764 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f6ad408b230 con 0x7f6adc151a50 2023-07-25T14:36:10.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:10.658+0000 7f6ae1eef700 1 --2- 172.21.15.72:0/1970070764 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f6ac006ace0 0x7f6ac006d1a0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f6adc0c0c00 tx=0x7f6acc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:10.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:10.662+0000 7f6ad27fc700 1 -- 172.21.15.72:0/1970070764 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f6ad4056080 con 0x7f6adc151a50 2023-07-25T14:36:10.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:10.893+0000 7f6ae4153700 1 -- 172.21.15.72:0/1970070764 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6adc14ade0 con 0x7f6adc151a50 2023-07-25T14:36:10.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:10.894+0000 7f6ad27fc700 1 -- 172.21.15.72:0/1970070764 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4664 (secure 0 0 0) 0x7f6ad40596a0 con 0x7f6adc151a50 2023-07-25T14:36:10.906 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-25T14:36:10.906 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4220,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6836/4293785067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":4293785067},{"type":"v1","addr":"172.21.15.72:6836","nonce":4293785067}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4229,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6834/681290755","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":681290755},{"type":"v1","addr":"172.21.15.92:6834","nonce":681290755}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6837/3376375642","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6835","nonce":3376375642},{"type":"v1","addr":"172.21.15.72:6837","nonce":3376375642}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-25T14:35:39.939860+0000","modified":"2023-07-25T14:35:59.629155+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.92:6835/2045555979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6833","nonce":2045555979},{"type":"v1","addr":"172.21.15.92:6835","nonce":2045555979}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-25T14:36:10.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:10.896+0000 7f6ae4153700 1 -- 172.21.15.72:0/1970070764 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f6ac006ace0 msgr2=0x7f6ac006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:10.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:10.896+0000 7f6ae4153700 1 --2- 172.21.15.72:0/1970070764 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f6ac006ace0 0x7f6ac006d1a0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f6adc0c0c00 tx=0x7f6acc009040 comp rx=0 tx=0).stop 2023-07-25T14:36:10.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:10.896+0000 7f6ae4153700 1 -- 172.21.15.72:0/1970070764 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6adc151a50 msgr2=0x7f6adc1547d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:10.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:10.896+0000 7f6ae4153700 1 --2- 172.21.15.72:0/1970070764 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6adc151a50 0x7f6adc1547d0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f6adc06ae70 tx=0x7f6ad4004ad0 comp rx=0 tx=0).stop 2023-07-25T14:36:10.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:10.896+0000 7f6ae4153700 1 -- 172.21.15.72:0/1970070764 shutdown_connections 2023-07-25T14:36:10.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:10.896+0000 7f6ae4153700 1 --2- 172.21.15.72:0/1970070764 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f6ac006ace0 0x7f6ac006d1a0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:10.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:10.896+0000 7f6ae4153700 1 --2- 172.21.15.72:0/1970070764 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6adc06a6d0 0x7f6adc1ea9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:10.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:10.896+0000 7f6ae4153700 1 --2- 172.21.15.72:0/1970070764 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6adc151a50 0x7f6adc1547d0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:10.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:10.896+0000 7f6ae4153700 1 --2- 172.21.15.72:0/1970070764 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6adc0c3110 0x7f6adc0c56c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:10.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:10.896+0000 7f6ae4153700 1 -- 172.21.15.72:0/1970070764 >> 172.21.15.72:0/1970070764 conn(0x7f6adc0714f0 msgr2=0x7f6adc152280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:10.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:10.896+0000 7f6ae4153700 1 -- 172.21.15.72:0/1970070764 shutdown_connections 2023-07-25T14:36:10.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:10.896+0000 7f6ae4153700 1 -- 172.21.15.72:0/1970070764 wait complete. 2023-07-25T14:36:10.910 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 8 2023-07-25T14:36:10.920 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-25T14:36:11.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:11.028+0000 7f83ceaf6700 1 Processor -- start 2023-07-25T14:36:11.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:11.028+0000 7f83ceaf6700 1 -- start start 2023-07-25T14:36:11.042 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:11.029+0000 7f83ceaf6700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f83c80a9cc0 0x7f83c81525e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:11.042 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:11.029+0000 7f83ceaf6700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f83c80bb0b0 0x7f83c8152b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:11.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:11.029+0000 7f83ceaf6700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83c80c5890 con 0x7f83c814f810 2023-07-25T14:36:11.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:11.029+0000 7f83ceaf6700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83c8152150 con 0x7f83c80bb0b0 2023-07-25T14:36:11.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:11.029+0000 7f83ceaf6700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83c814fbf0 con 0x7f83c80a9cc0 2023-07-25T14:36:11.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:11.029+0000 7f83cd093700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f83c80bb0b0 0x7f83c8152b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:11.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:11.029+0000 7f83cc892700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f83c814f810 0x7f83c80c4370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:59576/0 (socket says 172.21.15.72:59576) 2023-07-25T14:36:11.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:11.029+0000 7f83cc892700 1 -- 172.21.15.72:0/3814166895 learned_addr learned my addr 172.21.15.72:0/3814166895 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:36:11.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:11.029+0000 7f83c77fe700 1 -- 172.21.15.72:0/3814166895 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2800364760 0 0) 0x7f83c80c5890 con 0x7f83c814f810 2023-07-25T14:36:11.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:11.029+0000 7f83c7fff700 1 --2- 172.21.15.72:0/3814166895 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f83c80a9cc0 0x7f83c81525e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:11.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:11.029+0000 7f83c77fe700 1 -- 172.21.15.72:0/3814166895 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f83b80035b0 con 0x7f83c814f810 2023-07-25T14:36:11.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:11.029+0000 7f83cd093700 1 -- 172.21.15.72:0/3814166895 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f83c80a9cc0 msgr2=0x7f83c81525e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:11.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:11.029+0000 7f83cd093700 1 --2- 172.21.15.72:0/3814166895 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f83c80a9cc0 0x7f83c81525e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:11.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:11.029+0000 7f83cd093700 1 -- 172.21.15.72:0/3814166895 >> v1:172.21.15.72:6789/0 conn(0x7f83c814f810 legacy=0x7f83c80c4370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:11.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:11.029+0000 7f83cd093700 1 -- 172.21.15.72:0/3814166895 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83c81566a0 con 0x7f83c80bb0b0 2023-07-25T14:36:11.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:11.029+0000 7f83cd093700 1 --2- 172.21.15.72:0/3814166895 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83c80bb0b0 0x7f83c8152b20 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f83c0009d90 tx=0x7f83c000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38305b607cbd8854 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:11.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:11.029+0000 7f83c77fe700 1 -- 172.21.15.72:0/3814166895 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83c000e070 con 0x7f83c80bb0b0 2023-07-25T14:36:11.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:11.029+0000 7f83c77fe700 1 -- 172.21.15.72:0/3814166895 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83c000bb20 con 0x7f83c80bb0b0 2023-07-25T14:36:11.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:11.029+0000 7f83c77fe700 1 -- 172.21.15.72:0/3814166895 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83c0012430 con 0x7f83c80bb0b0 2023-07-25T14:36:11.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:11.030+0000 7f83ceaf6700 1 -- 172.21.15.72:0/3814166895 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83c80bb0b0 msgr2=0x7f83c8152b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:11.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:11.030+0000 7f83ceaf6700 1 --2- 172.21.15.72:0/3814166895 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83c80bb0b0 0x7f83c8152b20 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f83c0009d90 tx=0x7f83c000b330 comp rx=0 tx=0).stop 2023-07-25T14:36:11.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:11.030+0000 7f83ceaf6700 1 -- 172.21.15.72:0/3814166895 shutdown_connections 2023-07-25T14:36:11.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:11.030+0000 7f83ceaf6700 1 --2- 172.21.15.72:0/3814166895 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83c80bb0b0 0x7f83c8152b20 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:11.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:11.030+0000 7f83ceaf6700 1 --2- 172.21.15.72:0/3814166895 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f83c80a9cc0 0x7f83c81525e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:11.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:11.030+0000 7f83ceaf6700 1 -- 172.21.15.72:0/3814166895 >> 172.21.15.72:0/3814166895 conn(0x7f83c806a8d0 msgr2=0x7f83c80a94e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:11.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:11.030+0000 7f83ceaf6700 1 -- 172.21.15.72:0/3814166895 shutdown_connections 2023-07-25T14:36:11.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:11.030+0000 7f83ceaf6700 1 -- 172.21.15.72:0/3814166895 wait complete. 2023-07-25T14:36:11.048 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:11.031+0000 7f83ceaf6700 1 Processor -- start 2023-07-25T14:36:11.048 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:11.031+0000 7f83ceaf6700 1 -- start start 2023-07-25T14:36:11.048 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:11.032+0000 7f83ceaf6700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f83c80a9cc0 0x7f83c80bbea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:11.048 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:11.032+0000 7f83ceaf6700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83c80bb0b0 0x7f83c80a8f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:11.048 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:11.032+0000 7f83ceaf6700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f83c814f810 0x7f83c814b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:11.048 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:11.032+0000 7f83ceaf6700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83c80bc630 con 0x7f83c80bb0b0 2023-07-25T14:36:11.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:11.032+0000 7f83ceaf6700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83c80bc3e0 con 0x7f83c80a9cc0 2023-07-25T14:36:11.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:11.032+0000 7f83ceaf6700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83c80c5cc0 con 0x7f83c814f810 2023-07-25T14:36:11.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:11.032+0000 7f83c7fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83c80bb0b0 0x7f83c80a8f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:11.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:11.032+0000 7f83c7fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83c80bb0b0 0x7f83c80a8f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40616/0 (socket says 172.21.15.72:40616) 2023-07-25T14:36:11.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:11.032+0000 7f83c7fff700 1 -- 172.21.15.72:0/2771211523 learned_addr learned my addr 172.21.15.72:0/2771211523 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:11.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:11.032+0000 7f83cd093700 1 --2- 172.21.15.72:0/2771211523 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f83c814f810 0x7f83c814b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:11.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:11.032+0000 7f83cc892700 1 --2- 172.21.15.72:0/2771211523 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f83c80a9cc0 0x7f83c80bbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:11.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:11.032+0000 7f83c7fff700 1 -- 172.21.15.72:0/2771211523 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f83c814f810 msgr2=0x7f83c814b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:11.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:11.032+0000 7f83c7fff700 1 --2- 172.21.15.72:0/2771211523 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f83c814f810 0x7f83c814b9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:11.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:11.032+0000 7f83c7fff700 1 -- 172.21.15.72:0/2771211523 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f83c80a9cc0 msgr2=0x7f83c80bbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:11.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:11.032+0000 7f83c7fff700 1 --2- 172.21.15.72:0/2771211523 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f83c80a9cc0 0x7f83c80bbea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:11.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:11.032+0000 7f83c7fff700 1 -- 172.21.15.72:0/2771211523 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83c0009a70 con 0x7f83c80bb0b0 2023-07-25T14:36:11.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:11.032+0000 7f83cc892700 1 --2- 172.21.15.72:0/2771211523 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f83c80a9cc0 0x7f83c80bbea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-25T14:36:11.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:11.033+0000 7f83c7fff700 1 --2- 172.21.15.72:0/2771211523 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83c80bb0b0 0x7f83c80a8f90 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f83b400d800 tx=0x7f83b400db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:11.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:11.033+0000 7f83c57fa700 1 -- 172.21.15.72:0/2771211523 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83b40125f0 con 0x7f83c80bb0b0 2023-07-25T14:36:11.051 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:11.033+0000 7f83c57fa700 1 -- 172.21.15.72:0/2771211523 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83b4012750 con 0x7f83c80bb0b0 2023-07-25T14:36:11.051 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:11.033+0000 7f83ceaf6700 1 -- 172.21.15.72:0/2771211523 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83c80c1280 con 0x7f83c80bb0b0 2023-07-25T14:36:11.051 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:11.033+0000 7f83c57fa700 1 -- 172.21.15.72:0/2771211523 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83b4012b00 con 0x7f83c80bb0b0 2023-07-25T14:36:11.051 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:11.033+0000 7f83ceaf6700 1 -- 172.21.15.72:0/2771211523 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83c80c1840 con 0x7f83c80bb0b0 2023-07-25T14:36:11.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:11.034+0000 7f83ceaf6700 1 -- 172.21.15.72:0/2771211523 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83c804e470 con 0x7f83c80bb0b0 2023-07-25T14:36:11.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:11.034+0000 7f83c57fa700 1 -- 172.21.15.72:0/2771211523 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f83b4012c60 con 0x7f83c80bb0b0 2023-07-25T14:36:11.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:11.034+0000 7f83c57fa700 1 --2- 172.21.15.72:0/2771211523 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f83ac06ace0 0x7f83ac06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:11.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:11.035+0000 7f83c57fa700 1 -- 172.21.15.72:0/2771211523 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f83b4089a40 con 0x7f83c80bb0b0 2023-07-25T14:36:11.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:11.035+0000 7f83cc892700 1 --2- 172.21.15.72:0/2771211523 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f83ac06ace0 0x7f83ac06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:11.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:11.035+0000 7f83cc892700 1 --2- 172.21.15.72:0/2771211523 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f83ac06ace0 0x7f83ac06d1a0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f83bc0011e0 tx=0x7f83bc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:11.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:11.039+0000 7f83c57fa700 1 -- 172.21.15.72:0/2771211523 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f83b408be60 con 0x7f83c80bb0b0 2023-07-25T14:36:11.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:11.226+0000 7f83ceaf6700 1 -- 172.21.15.72:0/2771211523 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f83c80702b0 con 0x7f83c80bb0b0 2023-07-25T14:36:11.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:11.227+0000 7f83c57fa700 1 -- 172.21.15.72:0/2771211523 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+20014 (secure 0 0 0) 0x7f83b4054890 con 0x7f83c80bb0b0 2023-07-25T14:36:11.240 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-25T14:36:11.241 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":25,"fsid":"9170db48-9170-43e8-8ccb-9813e6240906","created":"2023-07-25T14:35:21.733262+0000","modified":"2023-07-25T14:35:44.992669+0000","last_up_change":"2023-07-25T14:35:31.355010+0000","last_in_change":"2023-07-25T14:35:24.195785+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-25T14:35:32.983457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-25T14:35:33.326342+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-25T14:35:37.534158+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-25T14:35:38.891571+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-25T14:35:42.596923+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d517fdad-0bfe-49f0-89f2-9421c3761839","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6801","nonce":2475407414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6803","nonce":2475407414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6807","nonce":2475407414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6805","nonce":2475407414}]},"public_addr":"172.21.15.72:6801/2475407414","cluster_addr":"172.21.15.72:6803/2475407414","heartbeat_back_addr":"172.21.15.72:6807/2475407414","heartbeat_front_addr":"172.21.15.72:6805/2475407414","state":["exists","up"]},{"osd":1,"uuid":"e1564be3-f209-47e5-a8d0-32fc618a474f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6822","nonce":870954016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6825","nonce":870954016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6831","nonce":870954016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6827","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6829","nonce":870954016}]},"public_addr":"172.21.15.72:6822/870954016","cluster_addr":"172.21.15.72:6825/870954016","heartbeat_back_addr":"172.21.15.72:6831/870954016","heartbeat_front_addr":"172.21.15.72:6829/870954016","state":["exists","up"]},{"osd":2,"uuid":"c4647d30-ffa6-417a-9026-ef530c75910e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6809","nonce":2143129442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6811","nonce":2143129442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6815","nonce":2143129442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6813","nonce":2143129442}]},"public_addr":"172.21.15.72:6809/2143129442","cluster_addr":"172.21.15.72:6811/2143129442","heartbeat_back_addr":"172.21.15.72:6815/2143129442","heartbeat_front_addr":"172.21.15.72:6813/2143129442","state":["exists","up"]},{"osd":3,"uuid":"76c9d9a7-c2e2-4612-a58b-d6882dd76b58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6817","nonce":3404066311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6819","nonce":3404066311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6828","nonce":3404066311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6821","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6823","nonce":3404066311}]},"public_addr":"172.21.15.72:6817/3404066311","cluster_addr":"172.21.15.72:6819/3404066311","heartbeat_back_addr":"172.21.15.72:6828/3404066311","heartbeat_front_addr":"172.21.15.72:6823/3404066311","state":["exists","up"]},{"osd":4,"uuid":"7f8920dc-0ad4-4a73-ab40-65408f83eadd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6817","nonce":2381008739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6819","nonce":2381008739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6825","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6827","nonce":2381008739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6822","nonce":2381008739}]},"public_addr":"172.21.15.92:6817/2381008739","cluster_addr":"172.21.15.92:6819/2381008739","heartbeat_back_addr":"172.21.15.92:6827/2381008739","heartbeat_front_addr":"172.21.15.92:6822/2381008739","state":["exists","up"]},{"osd":5,"uuid":"56257e7c-31eb-44c5-9ec7-1318a4e0bb35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6801","nonce":2161935604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6803","nonce":2161935604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6807","nonce":2161935604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6805","nonce":2161935604}]},"public_addr":"172.21.15.92:6801/2161935604","cluster_addr":"172.21.15.92:6803/2161935604","heartbeat_back_addr":"172.21.15.92:6807/2161935604","heartbeat_front_addr":"172.21.15.92:6805/2161935604","state":["exists","up"]},{"osd":6,"uuid":"a150d3d8-a0c9-4955-968a-8d98eff4ffb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6809","nonce":3770163493}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6811","nonce":3770163493}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6815","nonce":3770163493}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6813","nonce":3770163493}]},"public_addr":"172.21.15.92:6809/3770163493","cluster_addr":"172.21.15.92:6811/3770163493","heartbeat_back_addr":"172.21.15.92:6815/3770163493","heartbeat_front_addr":"172.21.15.92:6813/3770163493","state":["exists","up"]},{"osd":7,"uuid":"07799c27-54ee-4591-a42d-a978d6b32065","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6821","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6823","nonce":2135777609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6826","nonce":2135777609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6831","nonce":2135777609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6829","nonce":2135777609}]},"public_addr":"172.21.15.92:6823/2135777609","cluster_addr":"172.21.15.92:6826/2135777609","heartbeat_back_addr":"172.21.15.92:6831/2135777609","heartbeat_front_addr":"172.21.15.92:6829/2135777609","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.345365+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.378150+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.146566+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.372172+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:30.398421+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.385632+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.465611+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.443583+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-25T14:36:11.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:11.229+0000 7f83ceaf6700 1 -- 172.21.15.72:0/2771211523 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f83ac06ace0 msgr2=0x7f83ac06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:11.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:11.229+0000 7f83ceaf6700 1 --2- 172.21.15.72:0/2771211523 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f83ac06ace0 0x7f83ac06d1a0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f83bc0011e0 tx=0x7f83bc009040 comp rx=0 tx=0).stop 2023-07-25T14:36:11.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:11.229+0000 7f83ceaf6700 1 -- 172.21.15.72:0/2771211523 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83c80bb0b0 msgr2=0x7f83c80a8f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:11.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:11.229+0000 7f83ceaf6700 1 --2- 172.21.15.72:0/2771211523 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83c80bb0b0 0x7f83c80a8f90 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f83b400d800 tx=0x7f83b400db10 comp rx=0 tx=0).stop 2023-07-25T14:36:11.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:11.230+0000 7f83ceaf6700 1 -- 172.21.15.72:0/2771211523 shutdown_connections 2023-07-25T14:36:11.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:11.230+0000 7f83ceaf6700 1 --2- 172.21.15.72:0/2771211523 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f83ac06ace0 0x7f83ac06d1a0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:11.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:11.230+0000 7f83ceaf6700 1 --2- 172.21.15.72:0/2771211523 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f83c814f810 0x7f83c814b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:11.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:11.230+0000 7f83ceaf6700 1 --2- 172.21.15.72:0/2771211523 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f83c80a9cc0 0x7f83c80bbea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:11.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:11.230+0000 7f83ceaf6700 1 --2- 172.21.15.72:0/2771211523 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f83c80bb0b0 0x7f83c80a8f90 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:11.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:11.230+0000 7f83ceaf6700 1 -- 172.21.15.72:0/2771211523 >> 172.21.15.72:0/2771211523 conn(0x7f83c806a8d0 msgr2=0x7f83c80c5540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:11.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:11.230+0000 7f83ceaf6700 1 -- 172.21.15.72:0/2771211523 shutdown_connections 2023-07-25T14:36:11.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:11.230+0000 7f83ceaf6700 1 -- 172.21.15.72:0/2771211523 wait complete. 2023-07-25T14:36:11.254 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-25T14:36:11.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:11.361+0000 7f61d57dc700 1 Processor -- start 2023-07-25T14:36:11.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:11.361+0000 7f61d57dc700 1 -- start start 2023-07-25T14:36:11.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:11.362+0000 7f61d57dc700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f61d0151a90 0x7f61d0154d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:11.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:11.362+0000 7f61d57dc700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f61d00bead0 0x7f61d00c0350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:11.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:11.362+0000 7f61d57dc700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61d00bfeb0 con 0x7f61d00c0890 2023-07-25T14:36:11.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:11.362+0000 7f61d57dc700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61d00c10b0 con 0x7f61d0151a90 2023-07-25T14:36:11.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:11.362+0000 7f61d57dc700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61d00c1940 con 0x7f61d00bead0 2023-07-25T14:36:11.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:11.362+0000 7f61ceffd700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f61d0151a90 0x7f61d0154d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:11.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:11.362+0000 7f61ce7fc700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f61d00bead0 0x7f61d00c0350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:11.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:11.362+0000 7f61cf7fe700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f61d00c0890 0x7f61d00c44d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.72:54936/0 (socket says 172.21.15.72:54936) 2023-07-25T14:36:11.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:11.362+0000 7f61ceffd700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f61d0151a90 0x7f61d0154d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.72:36194/0 (socket says 172.21.15.72:36194) 2023-07-25T14:36:11.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:11.362+0000 7f61cf7fe700 1 -- 172.21.15.72:0/2990674644 learned_addr learned my addr 172.21.15.72:0/2990674644 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:36:11.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:11.363+0000 7f61ceffd700 1 -- 172.21.15.72:0/2990674644 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f61d00bead0 msgr2=0x7f61d00c0350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:11.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:11.363+0000 7f61ceffd700 1 --2- 172.21.15.72:0/2990674644 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f61d00bead0 0x7f61d00c0350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:11.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:11.363+0000 7f61ceffd700 1 -- 172.21.15.72:0/2990674644 >> v1:172.21.15.92:6789/0 conn(0x7f61d00c0890 legacy=0x7f61d00c44d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:11.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:11.363+0000 7f61ceffd700 1 -- 172.21.15.72:0/2990674644 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61d00bf2e0 con 0x7f61d0151a90 2023-07-25T14:36:11.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:11.363+0000 7f61cdffb700 1 -- 172.21.15.72:0/2990674644 <== mon.1 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 822613390 0 0) 0x7f61d00bfeb0 con 0x7f61d00c0890 2023-07-25T14:36:11.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:11.363+0000 7f61ceffd700 1 --2- 172.21.15.72:0/2990674644 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f61d0151a90 0x7f61d0154d10 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f61c4009840 tx=0x7f61c4009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6af22a3a559dda5b server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:11.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:11.363+0000 7f61cdffb700 1 -- 172.21.15.72:0/2990674644 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61c4011830 con 0x7f61d0151a90 2023-07-25T14:36:11.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:11.363+0000 7f61cdffb700 1 -- 172.21.15.72:0/2990674644 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61c4011990 con 0x7f61d0151a90 2023-07-25T14:36:11.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:11.363+0000 7f61cdffb700 1 -- 172.21.15.72:0/2990674644 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61c4011d20 con 0x7f61d0151a90 2023-07-25T14:36:11.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:11.363+0000 7f61d57dc700 1 -- 172.21.15.72:0/2990674644 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f61d0151a90 msgr2=0x7f61d0154d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:11.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:11.363+0000 7f61d57dc700 1 --2- 172.21.15.72:0/2990674644 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f61d0151a90 0x7f61d0154d10 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f61c4009840 tx=0x7f61c4009b50 comp rx=0 tx=0).stop 2023-07-25T14:36:11.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:11.363+0000 7f61d57dc700 1 -- 172.21.15.72:0/2990674644 shutdown_connections 2023-07-25T14:36:11.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:11.363+0000 7f61d57dc700 1 --2- 172.21.15.72:0/2990674644 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f61d0151a90 0x7f61d0154d10 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:11.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:11.363+0000 7f61d57dc700 1 --2- 172.21.15.72:0/2990674644 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f61d00bead0 0x7f61d00c0350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:11.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:11.363+0000 7f61d57dc700 1 -- 172.21.15.72:0/2990674644 >> 172.21.15.72:0/2990674644 conn(0x7f61d006c3a0 msgr2=0x7f61d006c780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:11.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:11.364+0000 7f61d57dc700 1 -- 172.21.15.72:0/2990674644 shutdown_connections 2023-07-25T14:36:11.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:11.364+0000 7f61d57dc700 1 -- 172.21.15.72:0/2990674644 wait complete. 2023-07-25T14:36:11.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:11.365+0000 7f61d57dc700 1 Processor -- start 2023-07-25T14:36:11.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:11.365+0000 7f61d57dc700 1 -- start start 2023-07-25T14:36:11.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:11.365+0000 7f61d57dc700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f61d00bead0 0x7f61d014e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:11.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:11.365+0000 7f61d57dc700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f61d00c0890 0x7f61d00c7950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:11.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:11.366+0000 7f61d57dc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f61d0151a90 0x7f61d01556b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:11.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:11.366+0000 7f61d57dc700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61d0158770 con 0x7f61d0151a90 2023-07-25T14:36:11.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:11.366+0000 7f61d57dc700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61d0158240 con 0x7f61d00c0890 2023-07-25T14:36:11.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:11.366+0000 7f61d57dc700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61d01ecf30 con 0x7f61d00bead0 2023-07-25T14:36:11.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:11.366+0000 7f61cf7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f61d0151a90 0x7f61d01556b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:11.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:11.366+0000 7f61cf7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f61d0151a90 0x7f61d01556b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40632/0 (socket says 172.21.15.72:40632) 2023-07-25T14:36:11.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:11.366+0000 7f61cf7fe700 1 -- 172.21.15.72:0/2905828853 learned_addr learned my addr 172.21.15.72:0/2905828853 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:11.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:11.366+0000 7f61ceffd700 1 --2- 172.21.15.72:0/2905828853 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f61d00bead0 0x7f61d014e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:11.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:11.366+0000 7f61ce7fc700 1 --2- 172.21.15.72:0/2905828853 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f61d00c0890 0x7f61d00c7950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:11.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:11.366+0000 7f61cf7fe700 1 -- 172.21.15.72:0/2905828853 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f61d00bead0 msgr2=0x7f61d014e6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:11.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:11.366+0000 7f61cf7fe700 1 --2- 172.21.15.72:0/2905828853 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f61d00bead0 0x7f61d014e6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:11.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:11.366+0000 7f61cf7fe700 1 -- 172.21.15.72:0/2905828853 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f61d00c0890 msgr2=0x7f61d00c7950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:11.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:11.366+0000 7f61cf7fe700 1 --2- 172.21.15.72:0/2905828853 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f61d00c0890 0x7f61d00c7950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:11.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:11.366+0000 7f61cf7fe700 1 -- 172.21.15.72:0/2905828853 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61c40094a0 con 0x7f61d0151a90 2023-07-25T14:36:11.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:11.366+0000 7f61cf7fe700 1 --2- 172.21.15.72:0/2905828853 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f61d0151a90 0x7f61d01556b0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f61c8002230 tx=0x7f61c800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:11.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:11.366+0000 7f61b77fe700 1 -- 172.21.15.72:0/2905828853 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61c800ac20 con 0x7f61d0151a90 2023-07-25T14:36:11.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:11.366+0000 7f61b77fe700 1 -- 172.21.15.72:0/2905828853 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61c800ada0 con 0x7f61d0151a90 2023-07-25T14:36:11.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:11.366+0000 7f61d57dc700 1 -- 172.21.15.72:0/2905828853 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61d0158490 con 0x7f61d0151a90 2023-07-25T14:36:11.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:11.366+0000 7f61b77fe700 1 -- 172.21.15.72:0/2905828853 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61c8007310 con 0x7f61d0151a90 2023-07-25T14:36:11.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:11.366+0000 7f61d57dc700 1 -- 172.21.15.72:0/2905828853 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61d01ed4b0 con 0x7f61d0151a90 2023-07-25T14:36:11.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:11.367+0000 7f61d57dc700 1 -- 172.21.15.72:0/2905828853 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61d01ecd90 con 0x7f61d0151a90 2023-07-25T14:36:11.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:11.368+0000 7f61b77fe700 1 -- 172.21.15.72:0/2905828853 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f61c8007470 con 0x7f61d0151a90 2023-07-25T14:36:11.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:11.368+0000 7f61b77fe700 1 --2- 172.21.15.72:0/2905828853 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f61bc06ace0 0x7f61bc06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:11.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:11.368+0000 7f61b77fe700 1 -- 172.21.15.72:0/2905828853 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f61c8089660 con 0x7f61d0151a90 2023-07-25T14:36:11.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:11.368+0000 7f61ceffd700 1 --2- 172.21.15.72:0/2905828853 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f61bc06ace0 0x7f61bc06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:11.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:11.369+0000 7f61ceffd700 1 --2- 172.21.15.72:0/2905828853 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f61bc06ace0 0x7f61bc06d1a0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f61c4009fd0 tx=0x7f61c4008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:11.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:11.372+0000 7f61b77fe700 1 -- 172.21.15.72:0/2905828853 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f61d01ecd90 con 0x7f61d0151a90 2023-07-25T14:36:11.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:11.609+0000 7f61d57dc700 1 -- 172.21.15.72:0/2905828853 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f61d01ecd90 con 0x7f61d0151a90 2023-07-25T14:36:11.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:11.609+0000 7f61b77fe700 1 -- 172.21.15.72:0/2905828853 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4664 (secure 0 0 0) 0x7f61d01ecd90 con 0x7f61d0151a90 2023-07-25T14:36:11.622 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-25T14:36:11.622 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4220,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6836/4293785067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":4293785067},{"type":"v1","addr":"172.21.15.72:6836","nonce":4293785067}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4229,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6834/681290755","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":681290755},{"type":"v1","addr":"172.21.15.92:6834","nonce":681290755}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6837/3376375642","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6835","nonce":3376375642},{"type":"v1","addr":"172.21.15.72:6837","nonce":3376375642}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-25T14:35:39.939860+0000","modified":"2023-07-25T14:35:59.629155+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.92:6835/2045555979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6833","nonce":2045555979},{"type":"v1","addr":"172.21.15.92:6835","nonce":2045555979}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-25T14:36:11.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:11.612+0000 7f61d57dc700 1 -- 172.21.15.72:0/2905828853 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f61bc06ace0 msgr2=0x7f61bc06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:11.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:11.612+0000 7f61d57dc700 1 --2- 172.21.15.72:0/2905828853 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f61bc06ace0 0x7f61bc06d1a0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f61c4009fd0 tx=0x7f61c4008030 comp rx=0 tx=0).stop 2023-07-25T14:36:11.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:11.612+0000 7f61d57dc700 1 -- 172.21.15.72:0/2905828853 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f61d0151a90 msgr2=0x7f61d01556b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:11.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:11.612+0000 7f61d57dc700 1 --2- 172.21.15.72:0/2905828853 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f61d0151a90 0x7f61d01556b0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f61c8002230 tx=0x7f61c800a060 comp rx=0 tx=0).stop 2023-07-25T14:36:11.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:11.612+0000 7f61d57dc700 1 -- 172.21.15.72:0/2905828853 shutdown_connections 2023-07-25T14:36:11.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:11.612+0000 7f61d57dc700 1 --2- 172.21.15.72:0/2905828853 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f61bc06ace0 0x7f61bc06d1a0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:11.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:11.612+0000 7f61d57dc700 1 --2- 172.21.15.72:0/2905828853 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f61d00bead0 0x7f61d014e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:11.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:11.612+0000 7f61d57dc700 1 --2- 172.21.15.72:0/2905828853 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f61d0151a90 0x7f61d01556b0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:11.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:11.612+0000 7f61d57dc700 1 --2- 172.21.15.72:0/2905828853 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f61d00c0890 0x7f61d00c7950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:11.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:11.612+0000 7f61d57dc700 1 -- 172.21.15.72:0/2905828853 >> 172.21.15.72:0/2905828853 conn(0x7f61d006c3a0 msgr2=0x7f61d00c5cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:11.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:11.612+0000 7f61d57dc700 1 -- 172.21.15.72:0/2905828853 shutdown_connections 2023-07-25T14:36:11.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:11.612+0000 7f61d57dc700 1 -- 172.21.15.72:0/2905828853 wait complete. 2023-07-25T14:36:11.626 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 8 2023-07-25T14:36:12.038 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-07-25T14:35:39.939860+0000', 'modified': '2023-07-25T14:35:59.629155+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4285}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4285': {'gid': 4285, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.92:6835/2045555979', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.92:6833', 'nonce': 2045555979}, {'type': 'v1', 'addr': '172.21.15.92:6835', 'nonce': 2045555979}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4, 5], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-07-25T14:36:12.038 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-07-25T14:36:12.039 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-07-25T14:36:12.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.149+0000 7f5e1c6ea700 1 Processor -- start 2023-07-25T14:36:12.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.149+0000 7f5e1c6ea700 1 -- start start 2023-07-25T14:36:12.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.150+0000 7f5e1c6ea700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5e14151980 0x7f5e140c12b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:12.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.150+0000 7f5e1c6ea700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f5e1406e580 0x7f5e140c5380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:12.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.150+0000 7f5e1c6ea700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e1406eaf0 con 0x7f5e140c17f0 2023-07-25T14:36:12.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.150+0000 7f5e1c6ea700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e1406f770 con 0x7f5e1406e580 2023-07-25T14:36:12.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.150+0000 7f5e1c6ea700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e140c29e0 con 0x7f5e14151980 2023-07-25T14:36:12.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.150+0000 7f5e19c85700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f5e140c17f0 0x7f5e140c4c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:59606/0 (socket says 172.21.15.72:59606) 2023-07-25T14:36:12.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.150+0000 7f5e19c85700 1 -- 172.21.15.72:0/3626228976 learned_addr learned my addr 172.21.15.72:0/3626228976 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:36:12.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.151+0000 7f5e1ac87700 1 --2- 172.21.15.72:0/3626228976 >> v2:172.21.15.92:3300/0 conn(0x7f5e1406e580 0x7f5e140c5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:12.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.151+0000 7f5e1a486700 1 --2- 172.21.15.72:0/3626228976 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5e14151980 0x7f5e140c12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:12.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.151+0000 7f5e19484700 1 -- 172.21.15.72:0/3626228976 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1136158025 0 0) 0x7f5e1406eaf0 con 0x7f5e140c17f0 2023-07-25T14:36:12.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.151+0000 7f5e19484700 1 -- 172.21.15.72:0/3626228976 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5e000035b0 con 0x7f5e140c17f0 2023-07-25T14:36:12.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.151+0000 7f5e19484700 1 -- 172.21.15.72:0/3626228976 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 280806895 0 0) 0x7f5e000035b0 con 0x7f5e140c17f0 2023-07-25T14:36:12.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.151+0000 7f5e1ac87700 1 -- 172.21.15.72:0/3626228976 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5e14151980 msgr2=0x7f5e140c12b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:12.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.151+0000 7f5e1ac87700 1 --2- 172.21.15.72:0/3626228976 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5e14151980 0x7f5e140c12b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:12.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.151+0000 7f5e1ac87700 1 -- 172.21.15.72:0/3626228976 >> v1:172.21.15.72:6789/0 conn(0x7f5e140c17f0 legacy=0x7f5e140c4c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:12.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.151+0000 7f5e1ac87700 1 -- 172.21.15.72:0/3626228976 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e1406edd0 con 0x7f5e1406e580 2023-07-25T14:36:12.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.151+0000 7f5e1a486700 1 --2- 172.21.15.72:0/3626228976 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5e14151980 0x7f5e140c12b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-25T14:36:12.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.151+0000 7f5e1ac87700 1 --2- 172.21.15.72:0/3626228976 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5e1406e580 0x7f5e140c5380 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f5e0c009d90 tx=0x7f5e0c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6b0d539b43a431db server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:12.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.151+0000 7f5e19484700 1 -- 172.21.15.72:0/3626228976 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e0c00e070 con 0x7f5e1406e580 2023-07-25T14:36:12.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.151+0000 7f5e19484700 1 -- 172.21.15.72:0/3626228976 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e0c003a20 con 0x7f5e1406e580 2023-07-25T14:36:12.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.151+0000 7f5e19484700 1 -- 172.21.15.72:0/3626228976 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e10001670 con 0x7f5e1406e580 2023-07-25T14:36:12.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.152+0000 7f5e1c6ea700 1 -- 172.21.15.72:0/3626228976 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5e1406e580 msgr2=0x7f5e140c5380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:12.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.152+0000 7f5e1c6ea700 1 --2- 172.21.15.72:0/3626228976 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5e1406e580 0x7f5e140c5380 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f5e0c009d90 tx=0x7f5e0c00b330 comp rx=0 tx=0).stop 2023-07-25T14:36:12.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.152+0000 7f5e1c6ea700 1 -- 172.21.15.72:0/3626228976 shutdown_connections 2023-07-25T14:36:12.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.152+0000 7f5e1c6ea700 1 --2- 172.21.15.72:0/3626228976 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5e1406e580 0x7f5e140c5380 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:12.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.152+0000 7f5e1c6ea700 1 --2- 172.21.15.72:0/3626228976 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5e14151980 0x7f5e140c12b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:12.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.152+0000 7f5e1c6ea700 1 -- 172.21.15.72:0/3626228976 >> 172.21.15.72:0/3626228976 conn(0x7f5e140a8520 msgr2=0x7f5e140a8900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:12.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.152+0000 7f5e1c6ea700 1 -- 172.21.15.72:0/3626228976 shutdown_connections 2023-07-25T14:36:12.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.152+0000 7f5e1c6ea700 1 -- 172.21.15.72:0/3626228976 wait complete. 2023-07-25T14:36:12.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.153+0000 7f5e1c6ea700 1 Processor -- start 2023-07-25T14:36:12.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.153+0000 7f5e1c6ea700 1 -- start start 2023-07-25T14:36:12.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.154+0000 7f5e1c6ea700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5e1406e580 0x7f5e14156f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:12.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.154+0000 7f5e1c6ea700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5e140c17f0 0x7f5e140bda00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:12.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.154+0000 7f5e1c6ea700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5e14151980 0x7f5e1414efe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:12.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.154+0000 7f5e1c6ea700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e1414ff10 con 0x7f5e14151980 2023-07-25T14:36:12.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.154+0000 7f5e1c6ea700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e141ea1f0 con 0x7f5e140c17f0 2023-07-25T14:36:12.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.154+0000 7f5e1c6ea700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e140c07c0 con 0x7f5e1406e580 2023-07-25T14:36:12.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.154+0000 7f5e1ac87700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5e14151980 0x7f5e1414efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:12.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.154+0000 7f5e1ac87700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5e14151980 0x7f5e1414efe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40646/0 (socket says 172.21.15.72:40646) 2023-07-25T14:36:12.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.154+0000 7f5e1ac87700 1 -- 172.21.15.72:0/3738820844 learned_addr learned my addr 172.21.15.72:0/3738820844 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:12.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.154+0000 7f5e19c85700 1 --2- 172.21.15.72:0/3738820844 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5e140c17f0 0x7f5e140bda00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:12.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.154+0000 7f5e1a486700 1 --2- 172.21.15.72:0/3738820844 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5e1406e580 0x7f5e14156f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:12.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.154+0000 7f5e1ac87700 1 -- 172.21.15.72:0/3738820844 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5e1406e580 msgr2=0x7f5e14156f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:12.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.154+0000 7f5e1ac87700 1 --2- 172.21.15.72:0/3738820844 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5e1406e580 0x7f5e14156f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:12.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.154+0000 7f5e1ac87700 1 -- 172.21.15.72:0/3738820844 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5e140c17f0 msgr2=0x7f5e140bda00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:12.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.154+0000 7f5e1ac87700 1 --2- 172.21.15.72:0/3738820844 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5e140c17f0 0x7f5e140bda00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:12.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.154+0000 7f5e1ac87700 1 -- 172.21.15.72:0/3738820844 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e04009430 con 0x7f5e14151980 2023-07-25T14:36:12.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.154+0000 7f5e1a486700 1 --2- 172.21.15.72:0/3738820844 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5e1406e580 0x7f5e14156f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-25T14:36:12.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.154+0000 7f5e1ac87700 1 --2- 172.21.15.72:0/3738820844 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5e14151980 0x7f5e1414efe0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f5e0c00b680 tx=0x7f5e0c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:12.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.155+0000 7f5e0affd700 1 -- 172.21.15.72:0/3738820844 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e0c0045c0 con 0x7f5e14151980 2023-07-25T14:36:12.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.155+0000 7f5e0affd700 1 -- 172.21.15.72:0/3738820844 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e0c004720 con 0x7f5e14151980 2023-07-25T14:36:12.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.155+0000 7f5e1c6ea700 1 -- 172.21.15.72:0/3738820844 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e0c009a70 con 0x7f5e14151980 2023-07-25T14:36:12.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.155+0000 7f5e0affd700 1 -- 172.21.15.72:0/3738820844 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e0c01c440 con 0x7f5e14151980 2023-07-25T14:36:12.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.155+0000 7f5e1c6ea700 1 -- 172.21.15.72:0/3738820844 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e140c0aa0 con 0x7f5e14151980 2023-07-25T14:36:12.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.156+0000 7f5e0affd700 1 -- 172.21.15.72:0/3738820844 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5e0c01c5a0 con 0x7f5e14151980 2023-07-25T14:36:12.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.157+0000 7f5e0affd700 1 --2- 172.21.15.72:0/3738820844 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f5df806ace0 0x7f5df806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:12.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.157+0000 7f5e1a486700 1 --2- 172.21.15.72:0/3738820844 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f5df806ace0 0x7f5df806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:12.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.157+0000 7f5e0affd700 1 -- 172.21.15.72:0/3738820844 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f5e0c08b460 con 0x7f5e14151980 2023-07-25T14:36:12.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.157+0000 7f5e1a486700 1 --2- 172.21.15.72:0/3738820844 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f5df806ace0 0x7f5df806d1a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f5e04009d00 tx=0x7f5e04008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:12.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.159+0000 7f5e28882b80 1 Processor -- start 2023-07-25T14:36:12.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.159+0000 7f5e28882b80 1 -- start start 2023-07-25T14:36:12.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.159+0000 7f5e28882b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55b1e471e910 0x55b1e47191c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:12.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.159+0000 7f5e28882b80 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x55b1e471fc90 0x55b1e4719700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:12.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.159+0000 7f5e28882b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b1e4719c40 0x55b1e473c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:12.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.159+0000 7f5e28882b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b1e4616b80 con 0x55b1e471e910 2023-07-25T14:36:12.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.159+0000 7f5e28882b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b1e4676540 con 0x55b1e4719c40 2023-07-25T14:36:12.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.159+0000 7f5e28882b80 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b1e4673e60 con 0x55b1e471fc90 2023-07-25T14:36:12.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.159+0000 7f5e1a486700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55b1e471e910 0x55b1e47191c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:12.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.160+0000 7f5e1a486700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55b1e471e910 0x55b1e47191c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40650/0 (socket says 172.21.15.72:40650) 2023-07-25T14:36:12.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.160+0000 7f5e1a486700 1 -- 172.21.15.72:0/416914573 learned_addr learned my addr 172.21.15.72:0/416914573 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:12.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.160+0000 7f5e1ac87700 1 --2- 172.21.15.72:0/416914573 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b1e4719c40 0x55b1e473c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:12.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.160+0000 7f5e19c85700 1 --2- 172.21.15.72:0/416914573 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x55b1e471fc90 0x55b1e4719700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:12.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.160+0000 7f5e1a486700 1 -- 172.21.15.72:0/416914573 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x55b1e471fc90 msgr2=0x55b1e4719700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:12.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.160+0000 7f5e1a486700 1 --2- 172.21.15.72:0/416914573 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x55b1e471fc90 0x55b1e4719700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:12.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.160+0000 7f5e1a486700 1 -- 172.21.15.72:0/416914573 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b1e4719c40 msgr2=0x55b1e473c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:12.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.160+0000 7f5e1a486700 1 --2- 172.21.15.72:0/416914573 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b1e4719c40 0x55b1e473c2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:12.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.160+0000 7f5e1a486700 1 -- 172.21.15.72:0/416914573 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b1e44f05e0 con 0x55b1e471e910 2023-07-25T14:36:12.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.160+0000 7f5e1ac87700 1 --2- 172.21.15.72:0/416914573 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b1e4719c40 0x55b1e473c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-25T14:36:12.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.160+0000 7f5e1a486700 1 --2- 172.21.15.72:0/416914573 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55b1e471e910 0x55b1e47191c0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f5e04011e30 tx=0x7f5e04014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d6382848a8e39a8 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:12.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.160+0000 7f5df7fff700 1 -- 172.21.15.72:0/416914573 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e04011e60 con 0x55b1e471e910 2023-07-25T14:36:12.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.160+0000 7f5df7fff700 1 -- 172.21.15.72:0/416914573 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e04015c60 con 0x55b1e471e910 2023-07-25T14:36:12.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.160+0000 7f5df7fff700 1 -- 172.21.15.72:0/416914573 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e04021440 con 0x55b1e471e910 2023-07-25T14:36:12.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.161+0000 7f5e28882b80 1 -- 172.21.15.72:0/416914573 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55b1e471e910 msgr2=0x55b1e47191c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:12.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.161+0000 7f5e28882b80 1 --2- 172.21.15.72:0/416914573 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55b1e471e910 0x55b1e47191c0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f5e04011e30 tx=0x7f5e04014000 comp rx=0 tx=0).stop 2023-07-25T14:36:12.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.161+0000 7f5e28882b80 1 -- 172.21.15.72:0/416914573 shutdown_connections 2023-07-25T14:36:12.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.161+0000 7f5e28882b80 1 --2- 172.21.15.72:0/416914573 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b1e4719c40 0x55b1e473c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:12.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.161+0000 7f5e28882b80 1 --2- 172.21.15.72:0/416914573 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55b1e471e910 0x55b1e47191c0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:12.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.161+0000 7f5e28882b80 1 --2- 172.21.15.72:0/416914573 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x55b1e471fc90 0x55b1e4719700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:12.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.161+0000 7f5e28882b80 1 -- 172.21.15.72:0/416914573 >> 172.21.15.72:0/416914573 conn(0x55b1e467bc80 msgr2=0x55b1e471c570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:12.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.161+0000 7f5e28882b80 1 -- 172.21.15.72:0/416914573 shutdown_connections 2023-07-25T14:36:12.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.161+0000 7f5e28882b80 1 -- 172.21.15.72:0/416914573 wait complete. 2023-07-25T14:36:12.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.161+0000 7f5e28882b80 1 -- start start 2023-07-25T14:36:12.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.161+0000 7f5e28882b80 1 Processor -- start 2023-07-25T14:36:12.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.162+0000 7f5e28882b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55b1e4719c40 0x55b1e475dc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:12.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.162+0000 7f5e28882b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b1e471e910 0x55b1e475a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:12.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.162+0000 7f5e28882b80 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x55b1e471fc90 0x55b1e47369e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:12.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.162+0000 7f5e28882b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b1e466f750 con 0x55b1e4719c40 2023-07-25T14:36:12.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.162+0000 7f5e28882b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b1e460ea70 con 0x55b1e471e910 2023-07-25T14:36:12.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.162+0000 7f5e28882b80 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b1e460e770 con 0x55b1e471fc90 2023-07-25T14:36:12.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.162+0000 7f5e28882b80 10 client.0 _ll_register_callbacks cb 0x55b1e460c630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-25T14:36:12.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.162+0000 7f5e1a486700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55b1e4719c40 0x55b1e475dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:12.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.162+0000 7f5e1a486700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55b1e4719c40 0x55b1e475dc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40656/0 (socket says 172.21.15.72:40656) 2023-07-25T14:36:12.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.162+0000 7f5e1a486700 1 -- 172.21.15.72:0/1033891168 learned_addr learned my addr 172.21.15.72:0/1033891168 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:12.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.163+0000 7f5e19c85700 1 --2- 172.21.15.72:0/1033891168 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b1e471e910 0x55b1e475a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:12.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.163+0000 7f5e1ac87700 1 --2- 172.21.15.72:0/1033891168 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x55b1e471fc90 0x55b1e47369e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:12.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.163+0000 7f5e1a486700 1 -- 172.21.15.72:0/1033891168 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x55b1e471fc90 msgr2=0x55b1e47369e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:12.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.163+0000 7f5e1a486700 1 --2- 172.21.15.72:0/1033891168 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x55b1e471fc90 0x55b1e47369e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:12.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.163+0000 7f5e1a486700 1 -- 172.21.15.72:0/1033891168 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b1e471e910 msgr2=0x55b1e475a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:12.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.163+0000 7f5e1a486700 1 --2- 172.21.15.72:0/1033891168 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b1e471e910 0x55b1e475a0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:12.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.163+0000 7f5e1a486700 1 -- 172.21.15.72:0/1033891168 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e04011ae0 con 0x55b1e4719c40 2023-07-25T14:36:12.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.163+0000 7f5e1a486700 1 --2- 172.21.15.72:0/1033891168 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55b1e4719c40 0x55b1e475dc60 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f5e04008010 tx=0x7f5e04004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6b0485103faacf server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:12.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.163+0000 7f5df57fa700 10 client.0 ms_handle_connect on v2:172.21.15.72:3300/0 2023-07-25T14:36:12.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.163+0000 7f5df57fa700 1 -- 172.21.15.72:0/1033891168 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e04005a20 con 0x55b1e4719c40 2023-07-25T14:36:12.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.163+0000 7f5df57fa700 1 -- 172.21.15.72:0/1033891168 <== mon.0 v2:172.21.15.72:3300/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f5e04005b80 con 0x55b1e4719c40 2023-07-25T14:36:12.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.163+0000 7f5e28882b80 1 -- 172.21.15.72:0/1033891168 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b1e46edb40 con 0x55b1e4719c40 2023-07-25T14:36:12.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.163+0000 7f5df57fa700 1 -- 172.21.15.72:0/1033891168 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5e04005d40 con 0x55b1e4719c40 2023-07-25T14:36:12.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.163+0000 7f5e28882b80 10 client.4860 fetch_fsmap learned FSMap version 8 2023-07-25T14:36:12.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.163+0000 7f5e28882b80 1 -- 172.21.15.72:0/1033891168 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x55b1e449cd90 con 0x55b1e4719c40 2023-07-25T14:36:12.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.163+0000 7f5df57fa700 1 -- 172.21.15.72:0/1033891168 <== mon.0 v2:172.21.15.72:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55b1e46edb40 con 0x55b1e4719c40 2023-07-25T14:36:12.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.163+0000 7f5df57fa700 1 -- 172.21.15.72:0/1033891168 <== mon.0 v2:172.21.15.72:3300/0 5 ==== fsmap(e 8) v1 ==== 3122+0+0 (secure 0 0 0) 0x7f5e04006040 con 0x55b1e4719c40 2023-07-25T14:36:12.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.163+0000 7f5e28882b80 10 client.4860 fetch_fsmap finished waiting for FSMap version 8 2023-07-25T14:36:12.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.163+0000 7f5e28882b80 10 client.4860 resolve_mds: resolved name 'b' to daemon mds.b 2023-07-25T14:36:12.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.163+0000 7f5e28882b80 20 client.4860 populate_metadata read hostname 'smithi072' 2023-07-25T14:36:12.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.163+0000 7f5e28882b80 1 --2- 172.21.15.72:0/1033891168 >> [v2:172.21.15.92:6833/2045555979,v1:172.21.15.92:6835/2045555979] conn(0x55b1e47370c0 0x55b1e4758820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:12.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.163+0000 7f5e28882b80 4 client.4860 mds_command: new command op to 4285 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-25T14:36:12.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.163+0000 7f5e28882b80 1 -- 172.21.15.72:0/1033891168 --> [v2:172.21.15.92:6833/2045555979,v1:172.21.15.92:6835/2045555979] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b1e4699d40 con 0x55b1e47370c0 2023-07-25T14:36:12.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.164+0000 7f5e19c85700 1 --2- 172.21.15.72:0/1033891168 >> [v2:172.21.15.92:6833/2045555979,v1:172.21.15.92:6835/2045555979] conn(0x55b1e47370c0 0x55b1e4758820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:12.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.164+0000 7f5df57fa700 10 client.4860 ms_handle_connect on v2:172.21.15.92:6833/2045555979 2023-07-25T14:36:12.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.164+0000 7f5e19c85700 1 --2- 172.21.15.72:0/1033891168 >> [v2:172.21.15.92:6833/2045555979,v1:172.21.15.92:6835/2045555979] conn(0x55b1e47370c0 0x55b1e4758820 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cfd5ad40eb6fbd77 server_cookie=68e3853abef4b03 in_seq=0 out_seq=0 2023-07-25T14:36:12.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.165+0000 7f5df57fa700 1 -- 172.21.15.72:0/1033891168 <== mds.0 v2:172.21.15.92:6833/2045555979 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x55b1e4699d40 con 0x55b1e47370c0 2023-07-25T14:36:12.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.165+0000 7f5df57fa700 10 client.4860 handle_command_reply: tid=0 2023-07-25T14:36:12.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.165+0000 7f5e28882b80 1 client.4860 shutdown 2023-07-25T14:36:12.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.165+0000 7f5e28882b80 1 -- 172.21.15.72:0/1033891168 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55b1e4719c40 msgr2=0x55b1e475dc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:12.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.165+0000 7f5e28882b80 1 --2- 172.21.15.72:0/1033891168 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55b1e4719c40 0x55b1e475dc60 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f5e04008010 tx=0x7f5e04004750 comp rx=0 tx=0).stop 2023-07-25T14:36:12.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.165+0000 7f5e28882b80 1 -- 172.21.15.72:0/1033891168 shutdown_connections 2023-07-25T14:36:12.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.165+0000 7f5e28882b80 1 --2- 172.21.15.72:0/1033891168 >> [v2:172.21.15.92:6833/2045555979,v1:172.21.15.92:6835/2045555979] conn(0x55b1e47370c0 0x55b1e4758820 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:12.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.165+0000 7f5e28882b80 1 --2- 172.21.15.72:0/1033891168 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x55b1e471fc90 0x55b1e47369e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:12.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.165+0000 7f5df57fa700 0 client.4860 ms_handle_reset on v2:172.21.15.92:6833/2045555979 2023-07-25T14:36:12.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.165+0000 7f5e28882b80 1 --2- 172.21.15.72:0/1033891168 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55b1e4719c40 0x55b1e475dc60 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:12.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.165+0000 7f5e28882b80 1 --2- 172.21.15.72:0/1033891168 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b1e471e910 0x55b1e475a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:12.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.165+0000 7f5e28882b80 1 -- 172.21.15.72:0/1033891168 >> 172.21.15.72:0/1033891168 conn(0x55b1e467bc80 msgr2=0x55b1e4719130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:12.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.165+0000 7f5e28882b80 1 -- 172.21.15.72:0/1033891168 shutdown_connections 2023-07-25T14:36:12.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.165+0000 7f5e28882b80 1 -- 172.21.15.72:0/1033891168 wait complete. 2023-07-25T14:36:12.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.165+0000 7f5e28882b80 20 client.4860 trim_cache size 0 max 16384 2023-07-25T14:36:12.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.182+0000 7f5e28882b80 1 Processor -- start 2023-07-25T14:36:12.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.182+0000 7f5e28882b80 1 -- start start 2023-07-25T14:36:12.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.183+0000 7f5e28882b80 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x55b1e4719c40 0x55b1e4718ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:12.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.183+0000 7f5e28882b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55b1e471e910 0x55b1e4719530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:12.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.183+0000 7f5e28882b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b1e471fc90 0x55b1e475aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:12.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.183+0000 7f5e28882b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b1e44f28d0 con 0x55b1e471e910 2023-07-25T14:36:12.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.183+0000 7f5e28882b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b1e475e850 con 0x55b1e471fc90 2023-07-25T14:36:12.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.183+0000 7f5e28882b80 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b1e4719a70 con 0x55b1e4719c40 2023-07-25T14:36:12.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.183+0000 7f5e19c85700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55b1e471e910 0x55b1e4719530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:12.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.183+0000 7f5e19c85700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55b1e471e910 0x55b1e4719530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40666/0 (socket says 172.21.15.72:40666) 2023-07-25T14:36:12.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.183+0000 7f5e19c85700 1 -- 172.21.15.72:0/2498806627 learned_addr learned my addr 172.21.15.72:0/2498806627 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:12.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.183+0000 7f5e19c85700 1 -- 172.21.15.72:0/2498806627 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x55b1e4719c40 msgr2=0x55b1e4718ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:12.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.183+0000 7f5e1a486700 1 --2- 172.21.15.72:0/2498806627 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x55b1e4719c40 0x55b1e4718ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:12.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.183+0000 7f5e19c85700 1 --2- 172.21.15.72:0/2498806627 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x55b1e4719c40 0x55b1e4718ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:12.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.183+0000 7f5e19c85700 1 -- 172.21.15.72:0/2498806627 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b1e471fc90 msgr2=0x55b1e475aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:12.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.183+0000 7f5e1ac87700 1 --2- 172.21.15.72:0/2498806627 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b1e471fc90 0x55b1e475aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:12.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.183+0000 7f5e19c85700 1 --2- 172.21.15.72:0/2498806627 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b1e471fc90 0x55b1e475aaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:12.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.183+0000 7f5e19c85700 1 -- 172.21.15.72:0/2498806627 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b1e4485c10 con 0x55b1e471e910 2023-07-25T14:36:12.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.183+0000 7f5e19c85700 1 --2- 172.21.15.72:0/2498806627 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55b1e471e910 0x55b1e4719530 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f5e1406b0b0 tx=0x7f5e10001e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9ced65b2d7de6cc server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:12.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.184+0000 7f5e08ff9700 1 -- 172.21.15.72:0/2498806627 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e100180d0 con 0x55b1e471e910 2023-07-25T14:36:12.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.184+0000 7f5e08ff9700 1 -- 172.21.15.72:0/2498806627 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e10018230 con 0x55b1e471e910 2023-07-25T14:36:12.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.184+0000 7f5e08ff9700 1 -- 172.21.15.72:0/2498806627 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e10018aa0 con 0x55b1e471e910 2023-07-25T14:36:12.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.184+0000 7f5e28882b80 1 -- 172.21.15.72:0/2498806627 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55b1e471e910 msgr2=0x55b1e4719530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:12.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.184+0000 7f5e28882b80 1 --2- 172.21.15.72:0/2498806627 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55b1e471e910 0x55b1e4719530 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f5e1406b0b0 tx=0x7f5e10001e40 comp rx=0 tx=0).stop 2023-07-25T14:36:12.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.184+0000 7f5e28882b80 1 -- 172.21.15.72:0/2498806627 shutdown_connections 2023-07-25T14:36:12.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.184+0000 7f5e28882b80 1 --2- 172.21.15.72:0/2498806627 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x55b1e4719c40 0x55b1e4718ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:12.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.184+0000 7f5e28882b80 1 --2- 172.21.15.72:0/2498806627 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b1e471fc90 0x55b1e475aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:12.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.184+0000 7f5e28882b80 1 --2- 172.21.15.72:0/2498806627 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55b1e471e910 0x55b1e4719530 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:12.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.184+0000 7f5e28882b80 1 -- 172.21.15.72:0/2498806627 >> 172.21.15.72:0/2498806627 conn(0x55b1e467bc80 msgr2=0x55b1e475da70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:12.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.184+0000 7f5e28882b80 1 -- 172.21.15.72:0/2498806627 shutdown_connections 2023-07-25T14:36:12.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.184+0000 7f5e28882b80 1 -- 172.21.15.72:0/2498806627 wait complete. 2023-07-25T14:36:12.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.185+0000 7f5e28882b80 1 -- start start 2023-07-25T14:36:12.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.185+0000 7f5e28882b80 1 Processor -- start 2023-07-25T14:36:12.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.186+0000 7f5e28882b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b1e4719c40 0x55b1e4739f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:12.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.186+0000 7f5e28882b80 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x55b1e471e910 0x55b1e47c1830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:12.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.186+0000 7f5e28882b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55b1e471fc90 0x55b1e47c1d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:12.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.186+0000 7f5e28882b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b1e4757d50 con 0x55b1e471fc90 2023-07-25T14:36:12.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.186+0000 7f5e28882b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b1e4740c70 con 0x55b1e4719c40 2023-07-25T14:36:12.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.186+0000 7f5e28882b80 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b1e47c25c0 con 0x55b1e471e910 2023-07-25T14:36:12.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.186+0000 7f5e28882b80 10 client.0 _ll_register_callbacks cb 0x55b1e460c630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-25T14:36:12.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.186+0000 7f5e1ac87700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55b1e471fc90 0x55b1e47c1d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:12.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.186+0000 7f5e1ac87700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55b1e471fc90 0x55b1e47c1d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40674/0 (socket says 172.21.15.72:40674) 2023-07-25T14:36:12.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.186+0000 7f5e19c85700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x55b1e471e910 0x55b1e47c1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:12.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.186+0000 7f5e1ac87700 1 -- 172.21.15.72:0/2069717433 learned_addr learned my addr 172.21.15.72:0/2069717433 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:12.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.186+0000 7f5e1a486700 1 --2- 172.21.15.72:0/2069717433 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b1e4719c40 0x55b1e4739f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:12.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.186+0000 7f5e1ac87700 1 -- 172.21.15.72:0/2069717433 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x55b1e471e910 msgr2=0x55b1e47c1830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:12.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.186+0000 7f5e1ac87700 1 --2- 172.21.15.72:0/2069717433 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x55b1e471e910 0x55b1e47c1830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:12.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.186+0000 7f5e1ac87700 1 -- 172.21.15.72:0/2069717433 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b1e4719c40 msgr2=0x55b1e4739f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:12.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.186+0000 7f5e1ac87700 1 --2- 172.21.15.72:0/2069717433 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b1e4719c40 0x55b1e4739f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:12.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.186+0000 7f5e1ac87700 1 -- 172.21.15.72:0/2069717433 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e10004990 con 0x55b1e471fc90 2023-07-25T14:36:12.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.186+0000 7f5e1ac87700 1 --2- 172.21.15.72:0/2069717433 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55b1e471fc90 0x55b1e47c1d70 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f5e0c003fd0 tx=0x7f5e0c0623e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8710345055b0182 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:12.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.186+0000 7f5df57fa700 10 client.0 ms_handle_connect on v2:172.21.15.72:3300/0 2023-07-25T14:36:12.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.186+0000 7f5df57fa700 1 -- 172.21.15.72:0/2069717433 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e0c025e30 con 0x55b1e471fc90 2023-07-25T14:36:12.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.186+0000 7f5df57fa700 1 -- 172.21.15.72:0/2069717433 <== mon.0 v2:172.21.15.72:3300/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f5e0c059580 con 0x55b1e471fc90 2023-07-25T14:36:12.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.186+0000 7f5e28882b80 1 -- 172.21.15.72:0/2069717433 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b1e4710fe0 con 0x55b1e471fc90 2023-07-25T14:36:12.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.186+0000 7f5df57fa700 1 -- 172.21.15.72:0/2069717433 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5e0c08b2c0 con 0x55b1e471fc90 2023-07-25T14:36:12.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.186+0000 7f5e28882b80 10 client.4866 fetch_fsmap learned FSMap version 8 2023-07-25T14:36:12.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.187+0000 7f5e28882b80 1 -- 172.21.15.72:0/2069717433 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x55b1e44c3200 con 0x55b1e471fc90 2023-07-25T14:36:12.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.187+0000 7f5df57fa700 1 -- 172.21.15.72:0/2069717433 <== mon.0 v2:172.21.15.72:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55b1e4710fe0 con 0x55b1e471fc90 2023-07-25T14:36:12.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.187+0000 7f5df57fa700 1 -- 172.21.15.72:0/2069717433 <== mon.0 v2:172.21.15.72:3300/0 5 ==== fsmap(e 8) v1 ==== 3122+0+0 (secure 0 0 0) 0x7f5e0c061f50 con 0x55b1e471fc90 2023-07-25T14:36:12.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.187+0000 7f5e28882b80 10 client.4866 fetch_fsmap finished waiting for FSMap version 8 2023-07-25T14:36:12.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.187+0000 7f5e28882b80 10 client.4866 resolve_mds: resolved name 'b' to daemon mds.b 2023-07-25T14:36:12.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.187+0000 7f5e28882b80 20 client.4866 populate_metadata read hostname 'smithi072' 2023-07-25T14:36:12.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.187+0000 7f5e28882b80 1 --2- 172.21.15.72:0/2069717433 >> [v2:172.21.15.92:6833/2045555979,v1:172.21.15.92:6835/2045555979] conn(0x55b1e47beef0 0x55b1e475bd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:12.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.187+0000 7f5e28882b80 4 client.4866 mds_command: new command op to 4285 tid=0[{"prefix": "status"}] 2023-07-25T14:36:12.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.187+0000 7f5e28882b80 1 -- 172.21.15.72:0/2069717433 --> [v2:172.21.15.92:6833/2045555979,v1:172.21.15.92:6835/2045555979] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55b1e4668730 con 0x55b1e47beef0 2023-07-25T14:36:12.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.187+0000 7f5e1a486700 1 --2- 172.21.15.72:0/2069717433 >> [v2:172.21.15.92:6833/2045555979,v1:172.21.15.92:6835/2045555979] conn(0x55b1e47beef0 0x55b1e475bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:12.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.187+0000 7f5df57fa700 10 client.4866 ms_handle_connect on v2:172.21.15.92:6833/2045555979 2023-07-25T14:36:12.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.187+0000 7f5e1a486700 1 --2- 172.21.15.72:0/2069717433 >> [v2:172.21.15.92:6833/2045555979,v1:172.21.15.92:6835/2045555979] conn(0x55b1e47beef0 0x55b1e475bd80 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=85163ccd598cce50 server_cookie=9a0ec06794bafdfc in_seq=0 out_seq=0 2023-07-25T14:36:12.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.187+0000 7f5df57fa700 1 -- 172.21.15.72:0/2069717433 <== mds.0 v2:172.21.15.92:6833/2045555979 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x55b1e4668730 con 0x55b1e47beef0 2023-07-25T14:36:12.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.187+0000 7f5df57fa700 10 client.4866 handle_command_reply: tid=0 2023-07-25T14:36:12.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.187+0000 7f5e28882b80 1 client.4866 shutdown 2023-07-25T14:36:12.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.188+0000 7f5e28882b80 1 -- 172.21.15.72:0/2069717433 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55b1e471fc90 msgr2=0x55b1e47c1d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:12.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.188+0000 7f5e28882b80 1 --2- 172.21.15.72:0/2069717433 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55b1e471fc90 0x55b1e47c1d70 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f5e0c003fd0 tx=0x7f5e0c0623e0 comp rx=0 tx=0).stop 2023-07-25T14:36:12.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.188+0000 7f5e28882b80 1 -- 172.21.15.72:0/2069717433 shutdown_connections 2023-07-25T14:36:12.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.188+0000 7f5e28882b80 1 --2- 172.21.15.72:0/2069717433 >> [v2:172.21.15.92:6833/2045555979,v1:172.21.15.92:6835/2045555979] conn(0x55b1e47beef0 0x55b1e475bd80 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:12.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.188+0000 7f5e28882b80 1 --2- 172.21.15.72:0/2069717433 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x55b1e471fc90 0x55b1e47c1d70 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:12.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.188+0000 7f5df57fa700 0 client.4866 ms_handle_reset on v2:172.21.15.92:6833/2045555979 2023-07-25T14:36:12.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.188+0000 7f5e28882b80 1 --2- 172.21.15.72:0/2069717433 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b1e4719c40 0x55b1e4739f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:12.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.188+0000 7f5e28882b80 1 --2- 172.21.15.72:0/2069717433 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x55b1e471e910 0x55b1e47c1830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:12.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.188+0000 7f5e28882b80 1 -- 172.21.15.72:0/2069717433 >> 172.21.15.72:0/2069717433 conn(0x55b1e467bc80 msgr2=0x55b1e475d840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:12.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.188+0000 7f5e28882b80 1 -- 172.21.15.72:0/2069717433 shutdown_connections 2023-07-25T14:36:12.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.188+0000 7f5e28882b80 1 -- 172.21.15.72:0/2069717433 wait complete. 2023-07-25T14:36:12.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.188+0000 7f5e28882b80 20 client.4866 trim_cache size 0 max 16384 2023-07-25T14:36:12.211 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-07-25T14:36:12.211 INFO:teuthology.orchestra.run.smithi072.stdout: "cluster_fsid": "9170db48-9170-43e8-8ccb-9813e6240906", 2023-07-25T14:36:12.211 INFO:teuthology.orchestra.run.smithi072.stdout: "whoami": 0, 2023-07-25T14:36:12.211 INFO:teuthology.orchestra.run.smithi072.stdout: "id": 4285, 2023-07-25T14:36:12.211 INFO:teuthology.orchestra.run.smithi072.stdout: "want_state": "up:active", 2023-07-25T14:36:12.211 INFO:teuthology.orchestra.run.smithi072.stdout: "state": "up:active", 2023-07-25T14:36:12.211 INFO:teuthology.orchestra.run.smithi072.stdout: "fs_name": "cephfs", 2023-07-25T14:36:12.212 INFO:teuthology.orchestra.run.smithi072.stdout: "rank_uptime": 31.638823586000001, 2023-07-25T14:36:12.212 INFO:teuthology.orchestra.run.smithi072.stdout: "mdsmap_epoch": 8, 2023-07-25T14:36:12.212 INFO:teuthology.orchestra.run.smithi072.stdout: "osdmap_epoch": 25, 2023-07-25T14:36:12.212 INFO:teuthology.orchestra.run.smithi072.stdout: "osdmap_epoch_barrier": 25, 2023-07-25T14:36:12.212 INFO:teuthology.orchestra.run.smithi072.stdout: "uptime": 37.695936295999999 2023-07-25T14:36:12.212 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-07-25T14:36:12.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.188+0000 7f5e1c6ea700 1 -- 172.21.15.72:0/3738820844 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f5df806ace0 msgr2=0x7f5df806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:12.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.188+0000 7f5e1c6ea700 1 --2- 172.21.15.72:0/3738820844 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f5df806ace0 0x7f5df806d1a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f5e04009d00 tx=0x7f5e04008040 comp rx=0 tx=0).stop 2023-07-25T14:36:12.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.188+0000 7f5e1c6ea700 1 -- 172.21.15.72:0/3738820844 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5e14151980 msgr2=0x7f5e1414efe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:12.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.188+0000 7f5e1c6ea700 1 --2- 172.21.15.72:0/3738820844 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5e14151980 0x7f5e1414efe0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f5e0c00b680 tx=0x7f5e0c004ad0 comp rx=0 tx=0).stop 2023-07-25T14:36:12.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.188+0000 7f5e1c6ea700 1 -- 172.21.15.72:0/3738820844 shutdown_connections 2023-07-25T14:36:12.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.188+0000 7f5e1c6ea700 1 --2- 172.21.15.72:0/3738820844 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f5df806ace0 0x7f5df806d1a0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:12.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.188+0000 7f5e1c6ea700 1 --2- 172.21.15.72:0/3738820844 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5e1406e580 0x7f5e14156f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:12.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.188+0000 7f5e1c6ea700 1 --2- 172.21.15.72:0/3738820844 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5e14151980 0x7f5e1414efe0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:12.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.188+0000 7f5e1c6ea700 1 --2- 172.21.15.72:0/3738820844 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5e140c17f0 0x7f5e140bda00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:12.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.188+0000 7f5e1c6ea700 1 -- 172.21.15.72:0/3738820844 >> 172.21.15.72:0/3738820844 conn(0x7f5e140a8520 msgr2=0x7f5e14150c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:12.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.188+0000 7f5e1c6ea700 1 -- 172.21.15.72:0/3738820844 shutdown_connections 2023-07-25T14:36:12.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.188+0000 7f5e1c6ea700 1 -- 172.21.15.72:0/3738820844 wait complete. 2023-07-25T14:36:12.216 INFO:teuthology.run_tasks:Running task kclient... 2023-07-25T14:36:12.233 INFO:tasks.kclient:Mounting kernel clients... 2023-07-25T14:36:12.234 INFO:tasks.kclient:config is {'client.0': {}, 'client.1': {}} 2023-07-25T14:36:12.234 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-25T14:36:12.234 DEBUG:teuthology.orchestra.run.smithi072:> ip netns list 2023-07-25T14:36:12.251 INFO:teuthology.orchestra.run.smithi072.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2023-07-25T14:36:12.252 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-25T14:36:12.253 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-07-25T14:36:12.331 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-25T14:36:12.331 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip link delete ceph-brx 2023-07-25T14:36:12.433 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-25T14:36:12.434 DEBUG:teuthology.orchestra.run.smithi092:> ip netns list 2023-07-25T14:36:12.455 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-25T14:36:12.455 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip link delete ceph-brx 2023-07-25T14:36:12.530 INFO:teuthology.orchestra.run.smithi092.stderr:Cannot find device "ceph-brx" 2023-07-25T14:36:12.531 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-25T14:36:12.532 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2023-07-25T14:36:12.532 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-07-25T14:36:12.533 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-07-25T14:36:12.533 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-25T14:36:12.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.646+0000 7f2a7f894700 1 Processor -- start 2023-07-25T14:36:12.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.646+0000 7f2a7f894700 1 -- start start 2023-07-25T14:36:12.660 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.647+0000 7f2a7f894700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2a780c4ff0 0x7f2a7806e410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:12.660 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.647+0000 7f2a7f894700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2a78154c40 0x7f2a780c04e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:12.660 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.647+0000 7f2a7f894700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a78071bd0 con 0x7f2a78071740 2023-07-25T14:36:12.660 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.647+0000 7f2a7f894700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a7806da20 con 0x7f2a780c4ff0 2023-07-25T14:36:12.660 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.647+0000 7f2a7f894700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a7806e170 con 0x7f2a78154c40 2023-07-25T14:36:12.660 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.647+0000 7f2a7d630700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2a780c4ff0 0x7f2a7806e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:12.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.647+0000 7f2a7ce2f700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f2a78071740 0x7f2a78154530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:59646/0 (socket says 172.21.15.72:59646) 2023-07-25T14:36:12.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.647+0000 7f2a7ce2f700 1 -- 172.21.15.72:0/4021640091 learned_addr learned my addr 172.21.15.72:0/4021640091 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:36:12.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.647+0000 7f2a7de31700 1 --2- 172.21.15.72:0/4021640091 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2a78154c40 0x7f2a780c04e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:12.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.647+0000 7f2a7d630700 1 -- 172.21.15.72:0/4021640091 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2a78154c40 msgr2=0x7f2a780c04e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:12.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.647+0000 7f2a7d630700 1 --2- 172.21.15.72:0/4021640091 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2a78154c40 0x7f2a780c04e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:12.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.647+0000 7f2a7d630700 1 -- 172.21.15.72:0/4021640091 >> v1:172.21.15.72:6789/0 conn(0x7f2a78071740 legacy=0x7f2a78154530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:12.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.647+0000 7f2a7d630700 1 -- 172.21.15.72:0/4021640091 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a7806d0f0 con 0x7f2a780c4ff0 2023-07-25T14:36:12.662 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.647+0000 7f2a6ffff700 1 -- 172.21.15.72:0/4021640091 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1586497705 0 0) 0x7f2a78071bd0 con 0x7f2a78071740 2023-07-25T14:36:12.662 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.647+0000 7f2a7d630700 1 --2- 172.21.15.72:0/4021640091 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2a780c4ff0 0x7f2a7806e410 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f2a68009840 tx=0x7f2a68009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=408cf3b6c9761f10 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:12.662 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.648+0000 7f2a6ffff700 1 -- 172.21.15.72:0/4021640091 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a68011830 con 0x7f2a780c4ff0 2023-07-25T14:36:12.662 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.648+0000 7f2a6ffff700 1 -- 172.21.15.72:0/4021640091 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a68011990 con 0x7f2a780c4ff0 2023-07-25T14:36:12.662 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.648+0000 7f2a6ffff700 1 -- 172.21.15.72:0/4021640091 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a68011d20 con 0x7f2a780c4ff0 2023-07-25T14:36:12.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.648+0000 7f2a7f894700 1 -- 172.21.15.72:0/4021640091 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2a780c4ff0 msgr2=0x7f2a7806e410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:12.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.648+0000 7f2a7f894700 1 --2- 172.21.15.72:0/4021640091 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2a780c4ff0 0x7f2a7806e410 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f2a68009840 tx=0x7f2a68009b50 comp rx=0 tx=0).stop 2023-07-25T14:36:12.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.648+0000 7f2a7f894700 1 -- 172.21.15.72:0/4021640091 shutdown_connections 2023-07-25T14:36:12.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.648+0000 7f2a7f894700 1 --2- 172.21.15.72:0/4021640091 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2a78154c40 0x7f2a780c04e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:12.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.648+0000 7f2a7f894700 1 --2- 172.21.15.72:0/4021640091 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2a780c4ff0 0x7f2a7806e410 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:12.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.648+0000 7f2a7f894700 1 -- 172.21.15.72:0/4021640091 >> 172.21.15.72:0/4021640091 conn(0x7f2a780a7510 msgr2=0x7f2a780a78f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:12.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.648+0000 7f2a7f894700 1 -- 172.21.15.72:0/4021640091 shutdown_connections 2023-07-25T14:36:12.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.648+0000 7f2a7f894700 1 -- 172.21.15.72:0/4021640091 wait complete. 2023-07-25T14:36:12.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.649+0000 7f2a7f894700 1 Processor -- start 2023-07-25T14:36:12.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.649+0000 7f2a7f894700 1 -- start start 2023-07-25T14:36:12.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.650+0000 7f2a7f894700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2a78071740 0x7f2a781535b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:12.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.650+0000 7f2a7f894700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2a780c4ff0 0x7f2a781eadf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:12.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.650+0000 7f2a7f894700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2a78154c40 0x7f2a781eb330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:12.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.650+0000 7f2a7f894700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a78155370 con 0x7f2a780c4ff0 2023-07-25T14:36:12.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.650+0000 7f2a7f894700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a78155b80 con 0x7f2a78071740 2023-07-25T14:36:12.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.650+0000 7f2a7f894700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a781590f0 con 0x7f2a78154c40 2023-07-25T14:36:12.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.650+0000 7f2a7ce2f700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2a780c4ff0 0x7f2a781eadf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:12.666 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.650+0000 7f2a7ce2f700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2a780c4ff0 0x7f2a781eadf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40686/0 (socket says 172.21.15.72:40686) 2023-07-25T14:36:12.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.650+0000 7f2a7ce2f700 1 -- 172.21.15.72:0/3581305167 learned_addr learned my addr 172.21.15.72:0/3581305167 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:12.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.650+0000 7f2a7d630700 1 --2- 172.21.15.72:0/3581305167 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2a78071740 0x7f2a781535b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:12.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.650+0000 7f2a7de31700 1 --2- 172.21.15.72:0/3581305167 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2a78154c40 0x7f2a781eb330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:12.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.650+0000 7f2a7ce2f700 1 -- 172.21.15.72:0/3581305167 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2a78154c40 msgr2=0x7f2a781eb330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:12.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.650+0000 7f2a7ce2f700 1 --2- 172.21.15.72:0/3581305167 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2a78154c40 0x7f2a781eb330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:12.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.650+0000 7f2a7ce2f700 1 -- 172.21.15.72:0/3581305167 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2a78071740 msgr2=0x7f2a781535b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:12.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.650+0000 7f2a7ce2f700 1 --2- 172.21.15.72:0/3581305167 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2a78071740 0x7f2a781535b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:12.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.650+0000 7f2a7ce2f700 1 -- 172.21.15.72:0/3581305167 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a680094a0 con 0x7f2a780c4ff0 2023-07-25T14:36:12.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.650+0000 7f2a7d630700 1 --2- 172.21.15.72:0/3581305167 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2a78071740 0x7f2a781535b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-25T14:36:12.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.650+0000 7f2a7ce2f700 1 --2- 172.21.15.72:0/3581305167 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2a780c4ff0 0x7f2a781eadf0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f2a7400c580 tx=0x7f2a7400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:12.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.651+0000 7f2a6dffb700 1 -- 172.21.15.72:0/3581305167 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a74004c80 con 0x7f2a780c4ff0 2023-07-25T14:36:12.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.651+0000 7f2a6dffb700 1 -- 172.21.15.72:0/3581305167 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a74004e00 con 0x7f2a780c4ff0 2023-07-25T14:36:12.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.651+0000 7f2a7f894700 1 -- 172.21.15.72:0/3581305167 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a781555c0 con 0x7f2a780c4ff0 2023-07-25T14:36:12.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.651+0000 7f2a6dffb700 1 -- 172.21.15.72:0/3581305167 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a74007310 con 0x7f2a780c4ff0 2023-07-25T14:36:12.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.651+0000 7f2a7f894700 1 -- 172.21.15.72:0/3581305167 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a781ea8d0 con 0x7f2a780c4ff0 2023-07-25T14:36:12.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.652+0000 7f2a7f894700 1 -- 172.21.15.72:0/3581305167 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a7804e470 con 0x7f2a780c4ff0 2023-07-25T14:36:12.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.652+0000 7f2a6dffb700 1 -- 172.21.15.72:0/3581305167 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2a74007470 con 0x7f2a780c4ff0 2023-07-25T14:36:12.669 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.653+0000 7f2a6dffb700 1 --2- 172.21.15.72:0/3581305167 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f2a5c06ace0 0x7f2a5c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:12.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.653+0000 7f2a7d630700 1 --2- 172.21.15.72:0/3581305167 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f2a5c06ace0 0x7f2a5c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:12.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.653+0000 7f2a6dffb700 1 -- 172.21.15.72:0/3581305167 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f2a74089410 con 0x7f2a780c4ff0 2023-07-25T14:36:12.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.653+0000 7f2a7d630700 1 --2- 172.21.15.72:0/3581305167 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f2a5c06ace0 0x7f2a5c06d1a0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f2a680090b0 tx=0x7f2a68008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:12.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.657+0000 7f2a6dffb700 1 -- 172.21.15.72:0/3581305167 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f2a74054260 con 0x7f2a780c4ff0 2023-07-25T14:36:12.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.892+0000 7f2a7f894700 1 -- 172.21.15.72:0/3581305167 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f2a7806dca0 con 0x7f2a780c4ff0 2023-07-25T14:36:12.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.892+0000 7f2a6dffb700 1 -- 172.21.15.72:0/3581305167 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+88 (secure 0 0 0) 0x7f2a74057880 con 0x7f2a780c4ff0 2023-07-25T14:36:12.905 INFO:teuthology.orchestra.run.smithi072.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-07-25T14:36:12.907 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.894+0000 7f2a7f894700 1 -- 172.21.15.72:0/3581305167 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f2a5c06ace0 msgr2=0x7f2a5c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:12.907 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.894+0000 7f2a7f894700 1 --2- 172.21.15.72:0/3581305167 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f2a5c06ace0 0x7f2a5c06d1a0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f2a680090b0 tx=0x7f2a68008030 comp rx=0 tx=0).stop 2023-07-25T14:36:12.907 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.894+0000 7f2a7f894700 1 -- 172.21.15.72:0/3581305167 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2a780c4ff0 msgr2=0x7f2a781eadf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:12.907 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.894+0000 7f2a7f894700 1 --2- 172.21.15.72:0/3581305167 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2a780c4ff0 0x7f2a781eadf0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f2a7400c580 tx=0x7f2a7400c940 comp rx=0 tx=0).stop 2023-07-25T14:36:12.907 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.895+0000 7f2a7f894700 1 -- 172.21.15.72:0/3581305167 shutdown_connections 2023-07-25T14:36:12.907 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.895+0000 7f2a7f894700 1 --2- 172.21.15.72:0/3581305167 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f2a5c06ace0 0x7f2a5c06d1a0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:12.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.895+0000 7f2a7f894700 1 --2- 172.21.15.72:0/3581305167 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2a78154c40 0x7f2a781eb330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:12.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.895+0000 7f2a7f894700 1 --2- 172.21.15.72:0/3581305167 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2a78071740 0x7f2a781535b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:12.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.895+0000 7f2a7f894700 1 --2- 172.21.15.72:0/3581305167 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2a780c4ff0 0x7f2a781eadf0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:12.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.895+0000 7f2a7f894700 1 -- 172.21.15.72:0/3581305167 >> 172.21.15.72:0/3581305167 conn(0x7f2a780a7510 msgr2=0x7f2a780c58b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:12.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.895+0000 7f2a7f894700 1 -- 172.21.15.72:0/3581305167 shutdown_connections 2023-07-25T14:36:12.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:12.895+0000 7f2a7f894700 1 -- 172.21.15.72:0/3581305167 wait complete. 2023-07-25T14:36:12.918 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-07-25T14:36:12.919 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-25T14:36:12.919 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi072.front.sepia.ceph.com 2023-07-25T14:36:12.919 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-07-25T14:36:12.919 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-07-25T14:36:12.919 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-07-25T14:36:12.920 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-07-25T14:36:12.920 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-25T14:36:12.920 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-25T14:36:12.920 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-25T14:36:12.921 DEBUG:teuthology.orchestra.run.smithi072:> ip addr 2023-07-25T14:36:12.937 INFO:teuthology.orchestra.run.smithi072.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-25T14:36:12.937 INFO:teuthology.orchestra.run.smithi072.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-25T14:36:12.937 INFO:teuthology.orchestra.run.smithi072.stdout: inet 127.0.0.1/8 scope host lo 2023-07-25T14:36:12.938 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-07-25T14:36:12.938 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 ::1/128 scope host 2023-07-25T14:36:12.938 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-07-25T14:36:12.938 INFO:teuthology.orchestra.run.smithi072.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-25T14:36:12.938 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:d8:da:f4 brd ff:ff:ff:ff:ff:ff 2023-07-25T14:36:12.938 INFO:teuthology.orchestra.run.smithi072.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-25T14:36:12.938 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:d8:da:f5 brd ff:ff:ff:ff:ff:ff 2023-07-25T14:36:12.939 INFO:teuthology.orchestra.run.smithi072.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-25T14:36:12.939 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:8f:b7:64 brd ff:ff:ff:ff:ff:ff 2023-07-25T14:36:12.939 INFO:teuthology.orchestra.run.smithi072.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-25T14:36:12.939 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:8f:b7:65 brd ff:ff:ff:ff:ff:ff 2023-07-25T14:36:12.939 INFO:teuthology.orchestra.run.smithi072.stdout: inet 172.21.15.72/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-07-25T14:36:12.939 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft 42265sec preferred_lft 42265sec 2023-07-25T14:36:12.939 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 fe80::3ce1:9f7:ed06:b425/64 scope link noprefixroute 2023-07-25T14:36:12.939 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-07-25T14:36:12.940 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-07-25T14:36:12.940 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-25T14:36:12.940 DEBUG:teuthology.orchestra.run.smithi072:> (cd / && exec bash -c ' 2023-07-25T14:36:12.941 DEBUG:teuthology.orchestra.run.smithi072:> set -e 2023-07-25T14:36:12.941 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip link add name ceph-brx type bridge 2023-07-25T14:36:12.941 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip addr flush dev ceph-brx 2023-07-25T14:36:12.941 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip link set ceph-brx up 2023-07-25T14:36:12.941 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-07-25T14:36:12.942 DEBUG:teuthology.orchestra.run.smithi072:> ') 2023-07-25T14:36:13.051 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-25T14:36:13.051 DEBUG:teuthology.orchestra.run.smithi072:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-25T14:36:13.077 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-07-25T14:36:13.078 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-25T14:36:13.078 DEBUG:teuthology.orchestra.run.smithi072:> route 2023-07-25T14:36:13.137 INFO:teuthology.orchestra.run.smithi072.stdout:Kernel IP routing table 2023-07-25T14:36:13.137 INFO:teuthology.orchestra.run.smithi072.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-25T14:36:13.137 INFO:teuthology.orchestra.run.smithi072.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-07-25T14:36:13.137 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-07-25T14:36:13.138 INFO:teuthology.orchestra.run.smithi072.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-25T14:36:13.138 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-25T14:36:13.138 DEBUG:teuthology.orchestra.run.smithi072:> (cd / && exec bash -c ' 2023-07-25T14:36:13.138 DEBUG:teuthology.orchestra.run.smithi072:> set -e 2023-07-25T14:36:13.139 DEBUG:teuthology.orchestra.run.smithi072:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-07-25T14:36:13.139 DEBUG:teuthology.orchestra.run.smithi072:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-07-25T14:36:13.139 DEBUG:teuthology.orchestra.run.smithi072:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-07-25T14:36:13.139 DEBUG:teuthology.orchestra.run.smithi072:> ') 2023-07-25T14:36:13.241 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-25T14:36:13.241 DEBUG:teuthology.orchestra.run.smithi072:> ip netns list 2023-07-25T14:36:13.259 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-25T14:36:13.259 DEBUG:teuthology.orchestra.run.smithi072:> ip netns list-id 2023-07-25T14:36:13.315 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-25T14:36:13.316 DEBUG:teuthology.orchestra.run.smithi072:> (cd / && exec bash -c ' 2023-07-25T14:36:13.316 DEBUG:teuthology.orchestra.run.smithi072:> set -e 2023-07-25T14:36:13.316 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-07-25T14:36:13.316 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-07-25T14:36:13.317 DEBUG:teuthology.orchestra.run.smithi072:> ') 2023-07-25T14:36:13.409 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-07-25T14:36:13.409 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-25T14:36:13.409 DEBUG:teuthology.orchestra.run.smithi072:> (cd / && exec bash -c ' 2023-07-25T14:36:13.410 DEBUG:teuthology.orchestra.run.smithi072:> set -e 2023-07-25T14:36:13.410 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-07-25T14:36:13.410 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-07-25T14:36:13.410 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-07-25T14:36:13.411 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-07-25T14:36:13.411 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-07-25T14:36:13.411 DEBUG:teuthology.orchestra.run.smithi072:> ') 2023-07-25T14:36:13.608 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-25T14:36:13.609 DEBUG:teuthology.orchestra.run.smithi072:> (cd / && exec bash -c ' 2023-07-25T14:36:13.609 DEBUG:teuthology.orchestra.run.smithi072:> set -e 2023-07-25T14:36:13.609 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip link set brx.0 up 2023-07-25T14:36:13.609 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip link set dev brx.0 master ceph-brx 2023-07-25T14:36:13.610 DEBUG:teuthology.orchestra.run.smithi072:> ') 2023-07-25T14:36:13.720 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-25T14:36:13.720 DEBUG:teuthology.orchestra.run.smithi072:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-07-25T14:36:13.742 INFO:teuthology.orchestra.run.smithi072.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-07-25T14:36:13.743 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-25T14:36:13.743 DEBUG:teuthology.orchestra.run.smithi072:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-07-25T14:36:13.799 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-07-25T14:36:13.799 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-25T14:36:13.799 DEBUG:teuthology.orchestra.run.smithi072:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-25T14:36:13.885 INFO:teuthology.orchestra.run.smithi072.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-25T14:36:13.885 INFO:teuthology.orchestra.run.smithi072.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-07-25T14:36:13.885 INFO:teuthology.orchestra.run.smithi072.stdout:invalid new device string format 2023-07-25T14:36:14.022 INFO:teuthology.orchestra.run.smithi072.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-25T14:36:14.022 INFO:teuthology.orchestra.run.smithi072.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-07-25T14:36:14.022 INFO:teuthology.orchestra.run.smithi072.stdout:invalid new device string format 2023-07-25T14:36:14.022 INFO:teuthology.orchestra.run.smithi072.stdout:mount.ceph: resolved to: "172.21.15.72:3300,172.21.15.92:3300,172.21.15.92:3301" 2023-07-25T14:36:14.022 INFO:teuthology.orchestra.run.smithi072.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-25T14:36:14.097 INFO:teuthology.orchestra.run.smithi072.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-25T14:36:14.097 INFO:teuthology.orchestra.run.smithi072.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-07-25T14:36:14.097 INFO:teuthology.orchestra.run.smithi072.stdout:invalid new device string format 2023-07-25T14:36:14.098 INFO:teuthology.orchestra.run.smithi072.stdout:mount.ceph: resolved to: "172.21.15.72:3300,172.21.15.92:3300,172.21.15.92:3301" 2023-07-25T14:36:14.098 INFO:teuthology.orchestra.run.smithi072.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-25T14:36:14.098 INFO:teuthology.orchestra.run.smithi072.stdout:mount.ceph: resolved to: "172.21.15.72:6789,172.21.15.92:6789,172.21.15.92:6790" 2023-07-25T14:36:14.098 INFO:teuthology.orchestra.run.smithi072.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.72:6789,172.21.15.92:6789,172.21.15.92:6790:/ 2023-07-25T14:36:14.098 INFO:teuthology.orchestra.run.smithi072.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=9170db48-9170-43e8-8ccb-9813e6240906" will pass to kernel 2023-07-25T14:36:14.100 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-25T14:36:14.100 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-25T14:36:14.100 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-07-25T14:36:14.127 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-25T14:36:14.127 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-25T14:36:14.199 INFO:teuthology.orchestra.run.smithi072.stdout:client4625 2023-07-25T14:36:14.199 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-07-25T14:36:14.199 DEBUG:teuthology.orchestra.run.smithi072:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-25T14:36:14.256 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-25T14:36:14.257 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-25T14:36:14.328 INFO:teuthology.orchestra.run.smithi072.stdout:client4625 2023-07-25T14:36:14.328 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-25T14:36:14.329 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-25T14:36:14.400 INFO:teuthology.orchestra.run.smithi072.stdout:client4625 2023-07-25T14:36:14.401 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-25T14:36:14.401 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/9170db48-9170-43e8-8ccb-9813e6240906.client4625/status') 2023-07-25T14:36:14.480 INFO:teuthology.orchestra.run.smithi072.stdout:instance: client.4625 (3)172.21.15.72:0/2867767871 2023-07-25T14:36:14.480 INFO:teuthology.orchestra.run.smithi072.stdout:blocklisted: false 2023-07-25T14:36:14.481 INFO:teuthology.orchestra.run.smithi072.stderr:0+1 records in 2023-07-25T14:36:14.481 INFO:teuthology.orchestra.run.smithi072.stderr:0+1 records out 2023-07-25T14:36:14.481 INFO:teuthology.orchestra.run.smithi072.stderr:70 bytes copied, 2.4233e-05 s, 2.9 MB/s 2023-07-25T14:36:14.482 INFO:tasks.kclient:client.1 config is {'syntax': 'v1'} 2023-07-25T14:36:14.482 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-07-25T14:36:14.482 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-07-25T14:36:14.483 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-25T14:36:14.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:14.629+0000 7f1b44c33700 1 Processor -- start 2023-07-25T14:36:14.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:14.629+0000 7f1b44c33700 1 -- start start 2023-07-25T14:36:14.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:14.630+0000 7f1b44c33700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1b4014e590 0x7f1b40150ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:14.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:14.630+0000 7f1b44c33700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1b400c4a50 0x7f1b40154e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:14.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:14.630+0000 7f1b44c33700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b40151530 con 0x7f1b40071fc0 2023-07-25T14:36:14.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:14.630+0000 7f1b44c33700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b400c4f50 con 0x7f1b4014e590 2023-07-25T14:36:14.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:14.630+0000 7f1b44c33700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b400c5230 con 0x7f1b400c4a50 2023-07-25T14:36:14.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:14.630+0000 7f1b3e59c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1b4014e590 0x7f1b40150ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:14.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:14.630+0000 7f1b3ed9d700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f1b40071fc0 0x7f1b400c2220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:59664/0 (socket says 172.21.15.72:59664) 2023-07-25T14:36:14.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:14.630+0000 7f1b3ed9d700 1 -- 172.21.15.72:0/2098125050 learned_addr learned my addr 172.21.15.72:0/2098125050 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:36:14.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:14.630+0000 7f1b3dd9b700 1 --2- 172.21.15.72:0/2098125050 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1b400c4a50 0x7f1b40154e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:14.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:14.631+0000 7f1b3d59a700 1 -- 172.21.15.72:0/2098125050 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1513274599 0 0) 0x7f1b40151530 con 0x7f1b40071fc0 2023-07-25T14:36:14.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:14.631+0000 7f1b3d59a700 1 -- 172.21.15.72:0/2098125050 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1b280035b0 con 0x7f1b40071fc0 2023-07-25T14:36:14.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:14.631+0000 7f1b3e59c700 1 -- 172.21.15.72:0/2098125050 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1b400c4a50 msgr2=0x7f1b40154e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:14.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:14.631+0000 7f1b3e59c700 1 --2- 172.21.15.72:0/2098125050 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1b400c4a50 0x7f1b40154e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:14.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:14.631+0000 7f1b3e59c700 1 -- 172.21.15.72:0/2098125050 >> v1:172.21.15.72:6789/0 conn(0x7f1b40071fc0 legacy=0x7f1b400c2220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:14.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:14.631+0000 7f1b3e59c700 1 -- 172.21.15.72:0/2098125050 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b400c5510 con 0x7f1b4014e590 2023-07-25T14:36:14.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:14.631+0000 7f1b3dd9b700 1 --2- 172.21.15.72:0/2098125050 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1b400c4a50 0x7f1b40154e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-25T14:36:14.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:14.631+0000 7f1b3e59c700 1 --2- 172.21.15.72:0/2098125050 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1b4014e590 0x7f1b40150ff0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f1b34009840 tx=0x7f1b34009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96d6b4b5f88bc4e0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:14.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:14.631+0000 7f1b3d59a700 1 -- 172.21.15.72:0/2098125050 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b34011830 con 0x7f1b4014e590 2023-07-25T14:36:14.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:14.631+0000 7f1b3d59a700 1 -- 172.21.15.72:0/2098125050 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b34011990 con 0x7f1b4014e590 2023-07-25T14:36:14.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:14.631+0000 7f1b3d59a700 1 -- 172.21.15.72:0/2098125050 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b34011d20 con 0x7f1b4014e590 2023-07-25T14:36:14.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:14.631+0000 7f1b44c33700 1 -- 172.21.15.72:0/2098125050 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1b4014e590 msgr2=0x7f1b40150ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:14.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:14.631+0000 7f1b44c33700 1 --2- 172.21.15.72:0/2098125050 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1b4014e590 0x7f1b40150ff0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f1b34009840 tx=0x7f1b34009b50 comp rx=0 tx=0).stop 2023-07-25T14:36:14.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:14.632+0000 7f1b44c33700 1 -- 172.21.15.72:0/2098125050 shutdown_connections 2023-07-25T14:36:14.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:14.632+0000 7f1b44c33700 1 --2- 172.21.15.72:0/2098125050 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1b4014e590 0x7f1b40150ff0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:14.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:14.632+0000 7f1b44c33700 1 --2- 172.21.15.72:0/2098125050 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1b400c4a50 0x7f1b40154e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:14.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:14.632+0000 7f1b44c33700 1 -- 172.21.15.72:0/2098125050 >> 172.21.15.72:0/2098125050 conn(0x7f1b400a7510 msgr2=0x7f1b400a78f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:14.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:14.632+0000 7f1b44c33700 1 -- 172.21.15.72:0/2098125050 shutdown_connections 2023-07-25T14:36:14.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:14.632+0000 7f1b44c33700 1 -- 172.21.15.72:0/2098125050 wait complete. 2023-07-25T14:36:14.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:14.633+0000 7f1b44c33700 1 Processor -- start 2023-07-25T14:36:14.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:14.633+0000 7f1b44c33700 1 -- start start 2023-07-25T14:36:14.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:14.634+0000 7f1b44c33700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1b40071fc0 0x7f1b400c3d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:14.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:14.634+0000 7f1b44c33700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1b400c4a50 0x7f1b4006d240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:14.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:14.634+0000 7f1b44c33700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1b4014e590 0x7f1b4006d780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:14.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:14.634+0000 7f1b44c33700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b400a3c50 con 0x7f1b400c4a50 2023-07-25T14:36:14.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:14.634+0000 7f1b44c33700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b401ec970 con 0x7f1b4014e590 2023-07-25T14:36:14.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:14.634+0000 7f1b44c33700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b401ecc10 con 0x7f1b40071fc0 2023-07-25T14:36:14.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:14.634+0000 7f1b3dd9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1b400c4a50 0x7f1b4006d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:14.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:14.634+0000 7f1b3dd9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1b400c4a50 0x7f1b4006d240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40702/0 (socket says 172.21.15.72:40702) 2023-07-25T14:36:14.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:14.634+0000 7f1b3dd9b700 1 -- 172.21.15.72:0/3458033446 learned_addr learned my addr 172.21.15.72:0/3458033446 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:14.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:14.634+0000 7f1b3e59c700 1 --2- 172.21.15.72:0/3458033446 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1b40071fc0 0x7f1b400c3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:14.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:14.634+0000 7f1b3ed9d700 1 --2- 172.21.15.72:0/3458033446 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1b4014e590 0x7f1b4006d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:14.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:14.634+0000 7f1b3dd9b700 1 -- 172.21.15.72:0/3458033446 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1b40071fc0 msgr2=0x7f1b400c3d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:14.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:14.634+0000 7f1b3dd9b700 1 --2- 172.21.15.72:0/3458033446 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1b40071fc0 0x7f1b400c3d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:14.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:14.634+0000 7f1b3dd9b700 1 -- 172.21.15.72:0/3458033446 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1b4014e590 msgr2=0x7f1b4006d780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:14.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:14.634+0000 7f1b3dd9b700 1 --2- 172.21.15.72:0/3458033446 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1b4014e590 0x7f1b4006d780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:14.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:14.634+0000 7f1b3dd9b700 1 -- 172.21.15.72:0/3458033446 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b340094a0 con 0x7f1b400c4a50 2023-07-25T14:36:14.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:14.634+0000 7f1b3dd9b700 1 --2- 172.21.15.72:0/3458033446 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1b400c4a50 0x7f1b4006d240 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f1b3000e810 tx=0x7f1b3000ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:14.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:14.634+0000 7f1b2effd700 1 -- 172.21.15.72:0/3458033446 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b30013610 con 0x7f1b400c4a50 2023-07-25T14:36:14.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:14.634+0000 7f1b2effd700 1 -- 172.21.15.72:0/3458033446 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b30013770 con 0x7f1b400c4a50 2023-07-25T14:36:14.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:14.634+0000 7f1b44c33700 1 -- 172.21.15.72:0/3458033446 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b401ecef0 con 0x7f1b400c4a50 2023-07-25T14:36:14.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:14.634+0000 7f1b2effd700 1 -- 172.21.15.72:0/3458033446 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b30013b20 con 0x7f1b400c4a50 2023-07-25T14:36:14.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:14.634+0000 7f1b44c33700 1 -- 172.21.15.72:0/3458033446 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b401ed4b0 con 0x7f1b400c4a50 2023-07-25T14:36:14.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:14.635+0000 7f1b44c33700 1 -- 172.21.15.72:0/3458033446 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b4004e470 con 0x7f1b400c4a50 2023-07-25T14:36:14.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:14.636+0000 7f1b2effd700 1 -- 172.21.15.72:0/3458033446 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1b30013c80 con 0x7f1b400c4a50 2023-07-25T14:36:14.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:14.636+0000 7f1b2effd700 1 --2- 172.21.15.72:0/3458033446 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f1b2006ace0 0x7f1b2006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:14.653 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:14.636+0000 7f1b2effd700 1 -- 172.21.15.72:0/3458033446 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f1b300894e0 con 0x7f1b400c4a50 2023-07-25T14:36:14.653 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:14.636+0000 7f1b3e59c700 1 --2- 172.21.15.72:0/3458033446 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f1b2006ace0 0x7f1b2006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:14.653 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:14.637+0000 7f1b3e59c700 1 --2- 172.21.15.72:0/3458033446 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f1b2006ace0 0x7f1b2006d1a0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f1b34000c00 tx=0x7f1b3401c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:14.653 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:14.640+0000 7f1b2effd700 1 -- 172.21.15.72:0/3458033446 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f1b30057ca0 con 0x7f1b400c4a50 2023-07-25T14:36:14.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:14.875+0000 7f1b44c33700 1 -- 172.21.15.72:0/3458033446 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f1b400c1b70 con 0x7f1b400c4a50 2023-07-25T14:36:14.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:14.875+0000 7f1b2effd700 1 -- 172.21.15.72:0/3458033446 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+88 (secure 0 0 0) 0x7f1b30057830 con 0x7f1b400c4a50 2023-07-25T14:36:14.889 INFO:teuthology.orchestra.run.smithi072.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-07-25T14:36:14.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:14.877+0000 7f1b44c33700 1 -- 172.21.15.72:0/3458033446 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f1b2006ace0 msgr2=0x7f1b2006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:14.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:14.877+0000 7f1b44c33700 1 --2- 172.21.15.72:0/3458033446 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f1b2006ace0 0x7f1b2006d1a0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f1b34000c00 tx=0x7f1b3401c040 comp rx=0 tx=0).stop 2023-07-25T14:36:14.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:14.877+0000 7f1b44c33700 1 -- 172.21.15.72:0/3458033446 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1b400c4a50 msgr2=0x7f1b4006d240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:14.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:14.877+0000 7f1b44c33700 1 --2- 172.21.15.72:0/3458033446 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1b400c4a50 0x7f1b4006d240 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f1b3000e810 tx=0x7f1b3000ebd0 comp rx=0 tx=0).stop 2023-07-25T14:36:14.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:14.878+0000 7f1b44c33700 1 -- 172.21.15.72:0/3458033446 shutdown_connections 2023-07-25T14:36:14.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:14.878+0000 7f1b44c33700 1 --2- 172.21.15.72:0/3458033446 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f1b2006ace0 0x7f1b2006d1a0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:14.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:14.878+0000 7f1b44c33700 1 --2- 172.21.15.72:0/3458033446 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1b40071fc0 0x7f1b400c3d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:14.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:14.878+0000 7f1b44c33700 1 --2- 172.21.15.72:0/3458033446 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1b4014e590 0x7f1b4006d780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:14.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:14.878+0000 7f1b44c33700 1 --2- 172.21.15.72:0/3458033446 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1b400c4a50 0x7f1b4006d240 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:14.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:14.878+0000 7f1b44c33700 1 -- 172.21.15.72:0/3458033446 >> 172.21.15.72:0/3458033446 conn(0x7f1b400a7510 msgr2=0x7f1b400a78f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:14.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:14.878+0000 7f1b44c33700 1 -- 172.21.15.72:0/3458033446 shutdown_connections 2023-07-25T14:36:14.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:14.878+0000 7f1b44c33700 1 -- 172.21.15.72:0/3458033446 wait complete. 2023-07-25T14:36:14.902 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-07-25T14:36:14.902 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-25T14:36:14.903 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi092.front.sepia.ceph.com 2023-07-25T14:36:14.903 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-07-25T14:36:14.903 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-07-25T14:36:14.903 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-07-25T14:36:14.903 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-07-25T14:36:14.904 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-25T14:36:14.904 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-07-25T14:36:14.904 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-25T14:36:14.905 DEBUG:teuthology.orchestra.run.smithi092:> ip addr 2023-07-25T14:36:14.926 INFO:teuthology.orchestra.run.smithi092.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-25T14:36:14.927 INFO:teuthology.orchestra.run.smithi092.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-25T14:36:14.928 INFO:teuthology.orchestra.run.smithi092.stdout: inet 127.0.0.1/8 scope host lo 2023-07-25T14:36:14.928 INFO:teuthology.orchestra.run.smithi092.stdout: valid_lft forever preferred_lft forever 2023-07-25T14:36:14.928 INFO:teuthology.orchestra.run.smithi092.stdout: inet6 ::1/128 scope host 2023-07-25T14:36:14.928 INFO:teuthology.orchestra.run.smithi092.stdout: valid_lft forever preferred_lft forever 2023-07-25T14:36:14.928 INFO:teuthology.orchestra.run.smithi092.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-25T14:36:14.928 INFO:teuthology.orchestra.run.smithi092.stdout: link/ether 0c:c4:7a:d8:a1:b2 brd ff:ff:ff:ff:ff:ff 2023-07-25T14:36:14.929 INFO:teuthology.orchestra.run.smithi092.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-25T14:36:14.929 INFO:teuthology.orchestra.run.smithi092.stdout: link/ether 0c:c4:7a:d8:a1:b3 brd ff:ff:ff:ff:ff:ff 2023-07-25T14:36:14.929 INFO:teuthology.orchestra.run.smithi092.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-25T14:36:14.929 INFO:teuthology.orchestra.run.smithi092.stdout: link/ether 0c:c4:7a:8f:cd:44 brd ff:ff:ff:ff:ff:ff 2023-07-25T14:36:14.929 INFO:teuthology.orchestra.run.smithi092.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-25T14:36:14.929 INFO:teuthology.orchestra.run.smithi092.stdout: link/ether 0c:c4:7a:8f:cd:45 brd ff:ff:ff:ff:ff:ff 2023-07-25T14:36:14.929 INFO:teuthology.orchestra.run.smithi092.stdout: inet 172.21.15.92/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-07-25T14:36:14.930 INFO:teuthology.orchestra.run.smithi092.stdout: valid_lft 42219sec preferred_lft 42219sec 2023-07-25T14:36:14.930 INFO:teuthology.orchestra.run.smithi092.stdout: inet6 fe80::c8ab:79f5:f80b:16b/64 scope link noprefixroute 2023-07-25T14:36:14.930 INFO:teuthology.orchestra.run.smithi092.stdout: valid_lft forever preferred_lft forever 2023-07-25T14:36:14.930 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-07-25T14:36:14.930 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-25T14:36:14.931 DEBUG:teuthology.orchestra.run.smithi092:> (cd / && exec bash -c ' 2023-07-25T14:36:14.931 DEBUG:teuthology.orchestra.run.smithi092:> set -e 2023-07-25T14:36:14.931 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip link add name ceph-brx type bridge 2023-07-25T14:36:14.931 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip addr flush dev ceph-brx 2023-07-25T14:36:14.932 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip link set ceph-brx up 2023-07-25T14:36:14.932 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-07-25T14:36:14.932 DEBUG:teuthology.orchestra.run.smithi092:> ') 2023-07-25T14:36:15.119 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-25T14:36:15.119 DEBUG:teuthology.orchestra.run.smithi092:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-25T14:36:15.151 INFO:teuthology.orchestra.run.smithi092.stdout:1 2023-07-25T14:36:15.153 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-25T14:36:15.153 DEBUG:teuthology.orchestra.run.smithi092:> route 2023-07-25T14:36:15.225 INFO:teuthology.orchestra.run.smithi092.stdout:Kernel IP routing table 2023-07-25T14:36:15.226 INFO:teuthology.orchestra.run.smithi092.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-25T14:36:15.226 INFO:teuthology.orchestra.run.smithi092.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-07-25T14:36:15.226 INFO:teuthology.orchestra.run.smithi092.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-07-25T14:36:15.226 INFO:teuthology.orchestra.run.smithi092.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-25T14:36:15.227 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-25T14:36:15.227 DEBUG:teuthology.orchestra.run.smithi092:> (cd / && exec bash -c ' 2023-07-25T14:36:15.227 DEBUG:teuthology.orchestra.run.smithi092:> set -e 2023-07-25T14:36:15.228 DEBUG:teuthology.orchestra.run.smithi092:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-07-25T14:36:15.228 DEBUG:teuthology.orchestra.run.smithi092:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-07-25T14:36:15.228 DEBUG:teuthology.orchestra.run.smithi092:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-07-25T14:36:15.228 DEBUG:teuthology.orchestra.run.smithi092:> ') 2023-07-25T14:36:15.465 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-25T14:36:15.466 DEBUG:teuthology.orchestra.run.smithi092:> ip netns list 2023-07-25T14:36:15.484 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-25T14:36:15.484 DEBUG:teuthology.orchestra.run.smithi092:> ip netns list-id 2023-07-25T14:36:15.540 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-25T14:36:15.541 DEBUG:teuthology.orchestra.run.smithi092:> (cd / && exec bash -c ' 2023-07-25T14:36:15.541 DEBUG:teuthology.orchestra.run.smithi092:> set -e 2023-07-25T14:36:15.541 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-07-25T14:36:15.541 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-07-25T14:36:15.542 DEBUG:teuthology.orchestra.run.smithi092:> ') 2023-07-25T14:36:15.634 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-07-25T14:36:15.635 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-25T14:36:15.635 DEBUG:teuthology.orchestra.run.smithi092:> (cd / && exec bash -c ' 2023-07-25T14:36:15.635 DEBUG:teuthology.orchestra.run.smithi092:> set -e 2023-07-25T14:36:15.635 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-07-25T14:36:15.636 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-07-25T14:36:15.636 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-07-25T14:36:15.636 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-07-25T14:36:15.636 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-07-25T14:36:15.637 DEBUG:teuthology.orchestra.run.smithi092:> ') 2023-07-25T14:36:15.738 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T14:36:15.740 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T14:36:15.847 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-25T14:36:15.847 DEBUG:teuthology.orchestra.run.smithi092:> (cd / && exec bash -c ' 2023-07-25T14:36:15.847 DEBUG:teuthology.orchestra.run.smithi092:> set -e 2023-07-25T14:36:15.848 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip link set brx.0 up 2023-07-25T14:36:15.848 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip link set dev brx.0 master ceph-brx 2023-07-25T14:36:15.848 DEBUG:teuthology.orchestra.run.smithi092:> ') 2023-07-25T14:36:15.949 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-25T14:36:15.950 DEBUG:teuthology.orchestra.run.smithi092:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-07-25T14:36:15.969 INFO:teuthology.orchestra.run.smithi092.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-07-25T14:36:15.970 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-25T14:36:15.970 DEBUG:teuthology.orchestra.run.smithi092:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-07-25T14:36:16.026 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-07-25T14:36:16.026 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-25T14:36:16.026 DEBUG:teuthology.orchestra.run.smithi092:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-07-25T14:36:16.127 INFO:teuthology.orchestra.run.smithi092.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-07-25T14:36:16.128 INFO:teuthology.orchestra.run.smithi092.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-07-25T14:36:16.128 INFO:teuthology.orchestra.run.smithi092.stdout:invalid new device string format 2023-07-25T14:36:16.237 INFO:teuthology.orchestra.run.smithi092.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-07-25T14:36:16.237 INFO:teuthology.orchestra.run.smithi092.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-07-25T14:36:16.237 INFO:teuthology.orchestra.run.smithi092.stdout:invalid new device string format 2023-07-25T14:36:16.238 INFO:teuthology.orchestra.run.smithi092.stdout:mount.ceph: resolved to: "172.21.15.72:3300,172.21.15.92:3300,172.21.15.92:3301" 2023-07-25T14:36:16.238 INFO:teuthology.orchestra.run.smithi092.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-25T14:36:16.313 INFO:teuthology.orchestra.run.smithi092.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-07-25T14:36:16.313 INFO:teuthology.orchestra.run.smithi092.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-07-25T14:36:16.313 INFO:teuthology.orchestra.run.smithi092.stdout:invalid new device string format 2023-07-25T14:36:16.313 INFO:teuthology.orchestra.run.smithi092.stdout:mount.ceph: resolved to: "172.21.15.72:3300,172.21.15.92:3300,172.21.15.92:3301" 2023-07-25T14:36:16.313 INFO:teuthology.orchestra.run.smithi092.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-25T14:36:16.314 INFO:teuthology.orchestra.run.smithi092.stdout:mount.ceph: resolved to: "172.21.15.72:6789,172.21.15.92:6789,172.21.15.92:6790" 2023-07-25T14:36:16.314 INFO:teuthology.orchestra.run.smithi092.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.72:6789,172.21.15.92:6789,172.21.15.92:6790:/ 2023-07-25T14:36:16.314 INFO:teuthology.orchestra.run.smithi092.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=9170db48-9170-43e8-8ccb-9813e6240906" will pass to kernel 2023-07-25T14:36:16.315 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-25T14:36:16.315 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-25T14:36:16.315 DEBUG:teuthology.orchestra.run.smithi092:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-07-25T14:36:16.342 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-25T14:36:16.342 DEBUG:teuthology.orchestra.run.smithi092:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-25T14:36:16.413 INFO:teuthology.orchestra.run.smithi092.stdout:client4887 2023-07-25T14:36:16.413 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-07-25T14:36:16.414 DEBUG:teuthology.orchestra.run.smithi092:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-25T14:36:16.469 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-25T14:36:16.470 DEBUG:teuthology.orchestra.run.smithi092:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-25T14:36:16.542 INFO:teuthology.orchestra.run.smithi092.stdout:client4887 2023-07-25T14:36:16.542 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-25T14:36:16.542 DEBUG:teuthology.orchestra.run.smithi092:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-25T14:36:16.613 INFO:teuthology.orchestra.run.smithi092.stdout:client4887 2023-07-25T14:36:16.614 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-25T14:36:16.614 DEBUG:teuthology.orchestra.run.smithi092:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/9170db48-9170-43e8-8ccb-9813e6240906.client4887/status') 2023-07-25T14:36:16.693 INFO:teuthology.orchestra.run.smithi092.stdout:instance: client.4887 (3)172.21.15.92:0/1327220042 2023-07-25T14:36:16.693 INFO:teuthology.orchestra.run.smithi092.stdout:blocklisted: false 2023-07-25T14:36:16.693 INFO:teuthology.orchestra.run.smithi092.stderr:0+1 records in 2023-07-25T14:36:16.694 INFO:teuthology.orchestra.run.smithi092.stderr:0+1 records out 2023-07-25T14:36:16.694 INFO:teuthology.orchestra.run.smithi092.stderr:70 bytes copied, 2.1512e-05 s, 3.3 MB/s 2023-07-25T14:36:16.695 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-07-25T14:36:16.711 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-25T14:36:16.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:16.834+0000 7feb76dc4700 1 Processor -- start 2023-07-25T14:36:16.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:16.834+0000 7feb76dc4700 1 -- start start 2023-07-25T14:36:16.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:16.834+0000 7feb76dc4700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7feb70151950 0x7feb7006a190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:16.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:16.834+0000 7feb76dc4700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7feb7006a6d0 0x7feb700c3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:16.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:16.834+0000 7feb76dc4700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb700c2fe0 con 0x7feb700724c0 2023-07-25T14:36:16.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:16.834+0000 7feb76dc4700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb70071a60 con 0x7feb70151950 2023-07-25T14:36:16.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:16.834+0000 7feb76dc4700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb700c2a70 con 0x7feb7006a6d0 2023-07-25T14:36:16.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:16.835+0000 7feb74b60700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7feb70151950 0x7feb7006a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:16.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:16.835+0000 7feb74b60700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7feb70151950 0x7feb7006a190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40708/0 (socket says 172.21.15.72:40708) 2023-07-25T14:36:16.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:16.835+0000 7feb74b60700 1 -- 172.21.15.72:0/733794883 learned_addr learned my addr 172.21.15.72:0/733794883 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:16.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:16.835+0000 7feb75361700 1 --2- 172.21.15.72:0/733794883 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7feb7006a6d0 0x7feb700c3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:16.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:16.835+0000 7feb74b60700 1 -- 172.21.15.72:0/733794883 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7feb7006a6d0 msgr2=0x7feb700c3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:16.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:16.835+0000 7feb74b60700 1 --2- 172.21.15.72:0/733794883 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7feb7006a6d0 0x7feb700c3bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:16.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:16.835+0000 7feb74b60700 1 -- 172.21.15.72:0/733794883 >> v1:172.21.15.92:6789/0 conn(0x7feb700724c0 legacy=0x7feb700c34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:16.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:16.835+0000 7feb74b60700 1 -- 172.21.15.72:0/733794883 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb70155070 con 0x7feb70151950 2023-07-25T14:36:16.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:16.835+0000 7feb74b60700 1 --2- 172.21.15.72:0/733794883 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feb70151950 0x7feb7006a190 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7feb640098f0 tx=0x7feb64009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2957709d31e79216 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:16.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:16.835+0000 7feb6f7fe700 1 -- 172.21.15.72:0/733794883 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb64011830 con 0x7feb70151950 2023-07-25T14:36:16.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:16.835+0000 7feb6f7fe700 1 -- 172.21.15.72:0/733794883 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb64011990 con 0x7feb70151950 2023-07-25T14:36:16.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:16.835+0000 7feb6f7fe700 1 -- 172.21.15.72:0/733794883 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb64011d20 con 0x7feb70151950 2023-07-25T14:36:16.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:16.836+0000 7feb76dc4700 1 -- 172.21.15.72:0/733794883 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feb70151950 msgr2=0x7feb7006a190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:16.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:16.836+0000 7feb76dc4700 1 --2- 172.21.15.72:0/733794883 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feb70151950 0x7feb7006a190 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7feb640098f0 tx=0x7feb64009c00 comp rx=0 tx=0).stop 2023-07-25T14:36:16.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:16.836+0000 7feb76dc4700 1 -- 172.21.15.72:0/733794883 shutdown_connections 2023-07-25T14:36:16.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:16.836+0000 7feb76dc4700 1 --2- 172.21.15.72:0/733794883 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7feb7006a6d0 0x7feb700c3bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:16.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:16.836+0000 7feb76dc4700 1 --2- 172.21.15.72:0/733794883 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feb70151950 0x7feb7006a190 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:16.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:16.836+0000 7feb76dc4700 1 -- 172.21.15.72:0/733794883 >> 172.21.15.72:0/733794883 conn(0x7feb700a87e0 msgr2=0x7feb700a8bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:16.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:16.836+0000 7feb76dc4700 1 -- 172.21.15.72:0/733794883 shutdown_connections 2023-07-25T14:36:16.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:16.836+0000 7feb76dc4700 1 -- 172.21.15.72:0/733794883 wait complete. 2023-07-25T14:36:16.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:16.837+0000 7feb76dc4700 1 Processor -- start 2023-07-25T14:36:16.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:16.837+0000 7feb76dc4700 1 -- start start 2023-07-25T14:36:16.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:16.838+0000 7feb76dc4700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feb7006a6d0 0x7feb70152d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:16.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:16.838+0000 7feb76dc4700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7feb700724c0 0x7feb700ab910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:16.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:16.838+0000 7feb76dc4700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feb70151950 0x7feb700abe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:16.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:16.838+0000 7feb76dc4700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb700bdf80 con 0x7feb70151950 2023-07-25T14:36:16.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:16.838+0000 7feb76dc4700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb700be2a0 con 0x7feb7006a6d0 2023-07-25T14:36:16.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:16.838+0000 7feb76dc4700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb700bdca0 con 0x7feb700724c0 2023-07-25T14:36:16.856 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:16.838+0000 7feb75361700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feb70151950 0x7feb700abe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:16.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:16.838+0000 7feb75361700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feb70151950 0x7feb700abe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40718/0 (socket says 172.21.15.72:40718) 2023-07-25T14:36:16.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:16.838+0000 7feb75361700 1 -- 172.21.15.72:0/1514071448 learned_addr learned my addr 172.21.15.72:0/1514071448 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:16.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:16.838+0000 7feb74b60700 1 --2- 172.21.15.72:0/1514071448 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feb7006a6d0 0x7feb70152d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:16.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:16.838+0000 7feb6ffff700 1 --2- 172.21.15.72:0/1514071448 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7feb700724c0 0x7feb700ab910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:16.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:16.838+0000 7feb75361700 1 -- 172.21.15.72:0/1514071448 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7feb700724c0 msgr2=0x7feb700ab910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:16.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:16.838+0000 7feb75361700 1 --2- 172.21.15.72:0/1514071448 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7feb700724c0 0x7feb700ab910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:16.857 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:16.838+0000 7feb75361700 1 -- 172.21.15.72:0/1514071448 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feb7006a6d0 msgr2=0x7feb70152d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:16.858 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:16.838+0000 7feb75361700 1 --2- 172.21.15.72:0/1514071448 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feb7006a6d0 0x7feb70152d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:16.858 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:16.838+0000 7feb75361700 1 -- 172.21.15.72:0/1514071448 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb64009550 con 0x7feb70151950 2023-07-25T14:36:16.858 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:16.838+0000 7feb75361700 1 --2- 172.21.15.72:0/1514071448 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feb70151950 0x7feb700abe50 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7feb6800efc0 tx=0x7feb6800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:16.858 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:16.838+0000 7feb6d7fa700 1 -- 172.21.15.72:0/1514071448 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb68009ea0 con 0x7feb70151950 2023-07-25T14:36:16.858 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:16.838+0000 7feb6d7fa700 1 -- 172.21.15.72:0/1514071448 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb6800f040 con 0x7feb70151950 2023-07-25T14:36:16.858 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:16.838+0000 7feb76dc4700 1 -- 172.21.15.72:0/1514071448 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb701ecbc0 con 0x7feb70151950 2023-07-25T14:36:16.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:16.838+0000 7feb6d7fa700 1 -- 172.21.15.72:0/1514071448 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb6800ced0 con 0x7feb70151950 2023-07-25T14:36:16.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:16.838+0000 7feb76dc4700 1 -- 172.21.15.72:0/1514071448 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb70158220 con 0x7feb70151950 2023-07-25T14:36:16.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:16.839+0000 7feb76dc4700 1 -- 172.21.15.72:0/1514071448 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb70158470 con 0x7feb70151950 2023-07-25T14:36:16.859 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:16.840+0000 7feb6d7fa700 1 -- 172.21.15.72:0/1514071448 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7feb68014480 con 0x7feb70151950 2023-07-25T14:36:16.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:16.840+0000 7feb6d7fa700 1 --2- 172.21.15.72:0/1514071448 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7feb5406ace0 0x7feb5406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:16.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:16.840+0000 7feb74b60700 1 --2- 172.21.15.72:0/1514071448 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7feb5406ace0 0x7feb5406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:16.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:16.840+0000 7feb6d7fa700 1 -- 172.21.15.72:0/1514071448 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7feb68089f40 con 0x7feb70151950 2023-07-25T14:36:16.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:16.841+0000 7feb74b60700 1 --2- 172.21.15.72:0/1514071448 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7feb5406ace0 0x7feb5406d1a0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7feb64014040 tx=0x7feb64008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:16.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:16.845+0000 7feb6d7fa700 1 -- 172.21.15.72:0/1514071448 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7feb68054d90 con 0x7feb70151950 2023-07-25T14:36:17.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.033+0000 7feb76dc4700 1 -- 172.21.15.72:0/1514071448 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7feb700bdb00 con 0x7feb70151950 2023-07-25T14:36:17.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.034+0000 7feb6d7fa700 1 -- 172.21.15.72:0/1514071448 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+20014 (secure 0 0 0) 0x7feb700bdb00 con 0x7feb70151950 2023-07-25T14:36:17.046 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-25T14:36:17.047 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":25,"fsid":"9170db48-9170-43e8-8ccb-9813e6240906","created":"2023-07-25T14:35:21.733262+0000","modified":"2023-07-25T14:35:44.992669+0000","last_up_change":"2023-07-25T14:35:31.355010+0000","last_in_change":"2023-07-25T14:35:24.195785+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-25T14:35:32.983457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-25T14:35:33.326342+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-25T14:35:37.534158+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-25T14:35:38.891571+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-25T14:35:42.596923+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d517fdad-0bfe-49f0-89f2-9421c3761839","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6801","nonce":2475407414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6803","nonce":2475407414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6807","nonce":2475407414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6805","nonce":2475407414}]},"public_addr":"172.21.15.72:6801/2475407414","cluster_addr":"172.21.15.72:6803/2475407414","heartbeat_back_addr":"172.21.15.72:6807/2475407414","heartbeat_front_addr":"172.21.15.72:6805/2475407414","state":["exists","up"]},{"osd":1,"uuid":"e1564be3-f209-47e5-a8d0-32fc618a474f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6822","nonce":870954016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6825","nonce":870954016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6831","nonce":870954016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6827","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6829","nonce":870954016}]},"public_addr":"172.21.15.72:6822/870954016","cluster_addr":"172.21.15.72:6825/870954016","heartbeat_back_addr":"172.21.15.72:6831/870954016","heartbeat_front_addr":"172.21.15.72:6829/870954016","state":["exists","up"]},{"osd":2,"uuid":"c4647d30-ffa6-417a-9026-ef530c75910e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6809","nonce":2143129442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6811","nonce":2143129442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6815","nonce":2143129442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6813","nonce":2143129442}]},"public_addr":"172.21.15.72:6809/2143129442","cluster_addr":"172.21.15.72:6811/2143129442","heartbeat_back_addr":"172.21.15.72:6815/2143129442","heartbeat_front_addr":"172.21.15.72:6813/2143129442","state":["exists","up"]},{"osd":3,"uuid":"76c9d9a7-c2e2-4612-a58b-d6882dd76b58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6817","nonce":3404066311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6819","nonce":3404066311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6828","nonce":3404066311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6821","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6823","nonce":3404066311}]},"public_addr":"172.21.15.72:6817/3404066311","cluster_addr":"172.21.15.72:6819/3404066311","heartbeat_back_addr":"172.21.15.72:6828/3404066311","heartbeat_front_addr":"172.21.15.72:6823/3404066311","state":["exists","up"]},{"osd":4,"uuid":"7f8920dc-0ad4-4a73-ab40-65408f83eadd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6817","nonce":2381008739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6819","nonce":2381008739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6825","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6827","nonce":2381008739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6822","nonce":2381008739}]},"public_addr":"172.21.15.92:6817/2381008739","cluster_addr":"172.21.15.92:6819/2381008739","heartbeat_back_addr":"172.21.15.92:6827/2381008739","heartbeat_front_addr":"172.21.15.92:6822/2381008739","state":["exists","up"]},{"osd":5,"uuid":"56257e7c-31eb-44c5-9ec7-1318a4e0bb35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6801","nonce":2161935604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6803","nonce":2161935604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6807","nonce":2161935604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6805","nonce":2161935604}]},"public_addr":"172.21.15.92:6801/2161935604","cluster_addr":"172.21.15.92:6803/2161935604","heartbeat_back_addr":"172.21.15.92:6807/2161935604","heartbeat_front_addr":"172.21.15.92:6805/2161935604","state":["exists","up"]},{"osd":6,"uuid":"a150d3d8-a0c9-4955-968a-8d98eff4ffb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6809","nonce":3770163493}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6811","nonce":3770163493}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6815","nonce":3770163493}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6813","nonce":3770163493}]},"public_addr":"172.21.15.92:6809/3770163493","cluster_addr":"172.21.15.92:6811/3770163493","heartbeat_back_addr":"172.21.15.92:6815/3770163493","heartbeat_front_addr":"172.21.15.92:6813/3770163493","state":["exists","up"]},{"osd":7,"uuid":"07799c27-54ee-4591-a42d-a978d6b32065","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6821","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6823","nonce":2135777609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6826","nonce":2135777609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6831","nonce":2135777609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6829","nonce":2135777609}]},"public_addr":"172.21.15.92:6823/2135777609","cluster_addr":"172.21.15.92:6826/2135777609","heartbeat_back_addr":"172.21.15.92:6831/2135777609","heartbeat_front_addr":"172.21.15.92:6829/2135777609","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.345365+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.378150+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.146566+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.372172+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:30.398421+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.385632+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.465611+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.443583+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-25T14:36:17.048 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.036+0000 7feb76dc4700 1 -- 172.21.15.72:0/1514071448 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7feb5406ace0 msgr2=0x7feb5406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:17.048 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.036+0000 7feb76dc4700 1 --2- 172.21.15.72:0/1514071448 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7feb5406ace0 0x7feb5406d1a0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7feb64014040 tx=0x7feb64008030 comp rx=0 tx=0).stop 2023-07-25T14:36:17.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.036+0000 7feb76dc4700 1 -- 172.21.15.72:0/1514071448 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feb70151950 msgr2=0x7feb700abe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:17.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.036+0000 7feb76dc4700 1 --2- 172.21.15.72:0/1514071448 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feb70151950 0x7feb700abe50 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7feb6800efc0 tx=0x7feb6800c3a0 comp rx=0 tx=0).stop 2023-07-25T14:36:17.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.036+0000 7feb76dc4700 1 -- 172.21.15.72:0/1514071448 shutdown_connections 2023-07-25T14:36:17.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.036+0000 7feb76dc4700 1 --2- 172.21.15.72:0/1514071448 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7feb5406ace0 0x7feb5406d1a0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:17.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.036+0000 7feb76dc4700 1 --2- 172.21.15.72:0/1514071448 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feb70151950 0x7feb700abe50 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:17.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.036+0000 7feb76dc4700 1 --2- 172.21.15.72:0/1514071448 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feb7006a6d0 0x7feb70152d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:17.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.036+0000 7feb76dc4700 1 --2- 172.21.15.72:0/1514071448 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7feb700724c0 0x7feb700ab910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:17.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.036+0000 7feb76dc4700 1 -- 172.21.15.72:0/1514071448 >> 172.21.15.72:0/1514071448 conn(0x7feb700a87e0 msgr2=0x7feb7014e9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:17.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.036+0000 7feb76dc4700 1 -- 172.21.15.72:0/1514071448 shutdown_connections 2023-07-25T14:36:17.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.036+0000 7feb76dc4700 1 -- 172.21.15.72:0/1514071448 wait complete. 2023-07-25T14:36:17.062 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-07-25T14:35:32.983457+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-07-25T14:35:33.326342+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-25T14:35:37.534158+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-25T14:35:38.891571+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-07-25T14:35:42.596923+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-25T14:36:17.063 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-25T14:36:17.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.174+0000 7f333efe6700 1 Processor -- start 2023-07-25T14:36:17.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.175+0000 7f333efe6700 1 -- start start 2023-07-25T14:36:17.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.175+0000 7f333efe6700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f333806b2a0 0x7f3338154df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:17.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.175+0000 7f333efe6700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f33380c4370 0x7f33380c4750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:17.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.175+0000 7f333efe6700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3338157cd0 con 0x7f33381518c0 2023-07-25T14:36:17.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.175+0000 7f333efe6700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f333806b750 con 0x7f33380c4370 2023-07-25T14:36:17.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.175+0000 7f333efe6700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33380c2310 con 0x7f333806b2a0 2023-07-25T14:36:17.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.175+0000 7f333d583700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f33380c4370 0x7f33380c4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:17.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.175+0000 7f333cd82700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f33381518c0 0x7f3338158160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:59690/0 (socket says 172.21.15.72:59690) 2023-07-25T14:36:17.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.175+0000 7f333cd82700 1 -- 172.21.15.72:0/2236128493 learned_addr learned my addr 172.21.15.72:0/2236128493 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:36:17.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.175+0000 7f333d583700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f33380c4370 0x7f33380c4750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40726/0 (socket says 172.21.15.72:40726) 2023-07-25T14:36:17.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.176+0000 7f3337fff700 1 --2- 172.21.15.72:0/2236128493 >> v2:172.21.15.92:3300/0 conn(0x7f333806b2a0 0x7f3338154df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:17.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.176+0000 7f333d583700 1 -- 172.21.15.72:0/2236128493 >> v2:172.21.15.92:3300/0 conn(0x7f333806b2a0 msgr2=0x7f3338154df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:17.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.176+0000 7f333d583700 1 --2- 172.21.15.72:0/2236128493 >> v2:172.21.15.92:3300/0 conn(0x7f333806b2a0 0x7f3338154df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:17.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.176+0000 7f333d583700 1 -- 172.21.15.72:0/2236128493 >> v1:172.21.15.72:6789/0 conn(0x7f33381518c0 legacy=0x7f3338158160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:17.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.176+0000 7f33377fe700 1 -- 172.21.15.72:0/2236128493 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1458853835 0 0) 0x7f3338157cd0 con 0x7f33381518c0 2023-07-25T14:36:17.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.176+0000 7f333d583700 1 -- 172.21.15.72:0/2236128493 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3338158870 con 0x7f33380c4370 2023-07-25T14:36:17.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.176+0000 7f3337fff700 1 --2- 172.21.15.72:0/2236128493 >> v2:172.21.15.92:3300/0 conn(0x7f333806b2a0 0x7f3338154df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-25T14:36:17.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.176+0000 7f333d583700 1 --2- 172.21.15.72:0/2236128493 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f33380c4370 0x7f33380c4750 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f33380c7940 tx=0x7f333000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70c12605ee4bcba3 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:17.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.176+0000 7f33377fe700 1 -- 172.21.15.72:0/2236128493 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f333000e070 con 0x7f33380c4370 2023-07-25T14:36:17.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.176+0000 7f33377fe700 1 -- 172.21.15.72:0/2236128493 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f333000bbd0 con 0x7f33380c4370 2023-07-25T14:36:17.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.176+0000 7f33377fe700 1 -- 172.21.15.72:0/2236128493 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3330012430 con 0x7f33380c4370 2023-07-25T14:36:17.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.176+0000 7f333efe6700 1 -- 172.21.15.72:0/2236128493 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f33380c4370 msgr2=0x7f33380c4750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:17.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.176+0000 7f333efe6700 1 --2- 172.21.15.72:0/2236128493 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f33380c4370 0x7f33380c4750 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f33380c7940 tx=0x7f333000b330 comp rx=0 tx=0).stop 2023-07-25T14:36:17.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.176+0000 7f333efe6700 1 -- 172.21.15.72:0/2236128493 shutdown_connections 2023-07-25T14:36:17.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.176+0000 7f333efe6700 1 --2- 172.21.15.72:0/2236128493 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f33380c4370 0x7f33380c4750 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:17.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.176+0000 7f333efe6700 1 --2- 172.21.15.72:0/2236128493 >> v2:172.21.15.92:3300/0 conn(0x7f333806b2a0 0x7f3338154df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:17.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.176+0000 7f333efe6700 1 -- 172.21.15.72:0/2236128493 >> 172.21.15.72:0/2236128493 conn(0x7f333806a8d0 msgr2=0x7f33380a94e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:17.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.176+0000 7f333efe6700 1 -- 172.21.15.72:0/2236128493 shutdown_connections 2023-07-25T14:36:17.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.176+0000 7f333efe6700 1 -- 172.21.15.72:0/2236128493 wait complete. 2023-07-25T14:36:17.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.178+0000 7f333efe6700 1 Processor -- start 2023-07-25T14:36:17.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.178+0000 7f333efe6700 1 -- start start 2023-07-25T14:36:17.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.178+0000 7f333efe6700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f333806b2a0 0x7f33380aa650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:17.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.178+0000 7f333efe6700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f33380c4370 0x7f3338152f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:17.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.178+0000 7f333efe6700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f33381518c0 0x7f33380c12c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:17.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.178+0000 7f333efe6700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33380bf0a0 con 0x7f33381518c0 2023-07-25T14:36:17.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.178+0000 7f333efe6700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33380bfde0 con 0x7f333806b2a0 2023-07-25T14:36:17.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.178+0000 7f333efe6700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3338152a90 con 0x7f33380c4370 2023-07-25T14:36:17.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.178+0000 7f333d583700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f33381518c0 0x7f33380c12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:17.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.178+0000 7f333d583700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f33381518c0 0x7f33380c12c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40732/0 (socket says 172.21.15.72:40732) 2023-07-25T14:36:17.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.178+0000 7f333d583700 1 -- 172.21.15.72:0/2482368987 learned_addr learned my addr 172.21.15.72:0/2482368987 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:17.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.179+0000 7f333cd82700 1 --2- 172.21.15.72:0/2482368987 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f333806b2a0 0x7f33380aa650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:17.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.179+0000 7f3337fff700 1 --2- 172.21.15.72:0/2482368987 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f33380c4370 0x7f3338152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:17.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.179+0000 7f333d583700 1 -- 172.21.15.72:0/2482368987 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f33380c4370 msgr2=0x7f3338152f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:17.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.179+0000 7f333d583700 1 --2- 172.21.15.72:0/2482368987 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f33380c4370 0x7f3338152f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:17.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.179+0000 7f333d583700 1 -- 172.21.15.72:0/2482368987 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f333806b2a0 msgr2=0x7f33380aa650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:17.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.179+0000 7f333d583700 1 --2- 172.21.15.72:0/2482368987 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f333806b2a0 0x7f33380aa650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:17.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.179+0000 7f333d583700 1 -- 172.21.15.72:0/2482368987 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3330009a70 con 0x7f33381518c0 2023-07-25T14:36:17.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.179+0000 7f333cd82700 1 --2- 172.21.15.72:0/2482368987 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f333806b2a0 0x7f33380aa650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-25T14:36:17.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.179+0000 7f333d583700 1 --2- 172.21.15.72:0/2482368987 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f33381518c0 0x7f33380c12c0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f33380c5280 tx=0x7f3330004b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:17.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.179+0000 7f33357fa700 1 -- 172.21.15.72:0/2482368987 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3330012430 con 0x7f33381518c0 2023-07-25T14:36:17.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.179+0000 7f33357fa700 1 -- 172.21.15.72:0/2482368987 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3330020070 con 0x7f33381518c0 2023-07-25T14:36:17.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.179+0000 7f333efe6700 1 -- 172.21.15.72:0/2482368987 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3338151e80 con 0x7f33381518c0 2023-07-25T14:36:17.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.179+0000 7f33357fa700 1 -- 172.21.15.72:0/2482368987 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3330004040 con 0x7f33381518c0 2023-07-25T14:36:17.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.179+0000 7f333efe6700 1 -- 172.21.15.72:0/2482368987 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3338152440 con 0x7f33381518c0 2023-07-25T14:36:17.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.180+0000 7f333efe6700 1 -- 172.21.15.72:0/2482368987 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f333804e470 con 0x7f33381518c0 2023-07-25T14:36:17.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.180+0000 7f33357fa700 1 -- 172.21.15.72:0/2482368987 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f33300041a0 con 0x7f33381518c0 2023-07-25T14:36:17.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.181+0000 7f33357fa700 1 --2- 172.21.15.72:0/2482368987 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f331c06ace0 0x7f331c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:17.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.181+0000 7f333cd82700 1 --2- 172.21.15.72:0/2482368987 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f331c06ace0 0x7f331c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:17.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.181+0000 7f33357fa700 1 -- 172.21.15.72:0/2482368987 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f3330022070 con 0x7f33381518c0 2023-07-25T14:36:17.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.181+0000 7f333cd82700 1 --2- 172.21.15.72:0/2482368987 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f331c06ace0 0x7f331c06d1a0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f332c007fd0 tx=0x7f332c007de0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:17.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.185+0000 7f33357fa700 1 -- 172.21.15.72:0/2482368987 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f33300564c0 con 0x7f33381518c0 2023-07-25T14:36:17.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.374+0000 7f333efe6700 1 -- 172.21.15.72:0/2482368987 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f3338152bd0 con 0x7f33381518c0 2023-07-25T14:36:17.387 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.374+0000 7f33357fa700 1 -- 172.21.15.72:0/2482368987 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7f3330059ae0 con 0x7f33381518c0 2023-07-25T14:36:17.387 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 8 2023-07-25T14:36:17.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.376+0000 7f333efe6700 1 -- 172.21.15.72:0/2482368987 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f331c06ace0 msgr2=0x7f331c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:17.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.376+0000 7f333efe6700 1 --2- 172.21.15.72:0/2482368987 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f331c06ace0 0x7f331c06d1a0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f332c007fd0 tx=0x7f332c007de0 comp rx=0 tx=0).stop 2023-07-25T14:36:17.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.376+0000 7f333efe6700 1 -- 172.21.15.72:0/2482368987 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f33381518c0 msgr2=0x7f33380c12c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:17.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.376+0000 7f333efe6700 1 --2- 172.21.15.72:0/2482368987 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f33381518c0 0x7f33380c12c0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f33380c5280 tx=0x7f3330004b20 comp rx=0 tx=0).stop 2023-07-25T14:36:17.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.377+0000 7f333efe6700 1 -- 172.21.15.72:0/2482368987 shutdown_connections 2023-07-25T14:36:17.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.377+0000 7f333efe6700 1 --2- 172.21.15.72:0/2482368987 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f331c06ace0 0x7f331c06d1a0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:17.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.377+0000 7f333efe6700 1 --2- 172.21.15.72:0/2482368987 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f33381518c0 0x7f33380c12c0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:17.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.377+0000 7f333efe6700 1 --2- 172.21.15.72:0/2482368987 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f333806b2a0 0x7f33380aa650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:17.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.377+0000 7f333efe6700 1 --2- 172.21.15.72:0/2482368987 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f33380c4370 0x7f3338152f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:17.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.377+0000 7f333efe6700 1 -- 172.21.15.72:0/2482368987 >> 172.21.15.72:0/2482368987 conn(0x7f333806a8d0 msgr2=0x7f333806f6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:17.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.377+0000 7f333efe6700 1 -- 172.21.15.72:0/2482368987 shutdown_connections 2023-07-25T14:36:17.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.377+0000 7f333efe6700 1 -- 172.21.15.72:0/2482368987 wait complete. 2023-07-25T14:36:17.401 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-25T14:36:17.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.512+0000 7f7e7941e700 1 Processor -- start 2023-07-25T14:36:17.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.512+0000 7f7e7941e700 1 -- start start 2023-07-25T14:36:17.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.513+0000 7f7e7941e700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f7e74154c40 0x7f7e7406e410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:17.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.513+0000 7f7e7941e700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f7e74071740 0x7f7e740c04e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:17.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.513+0000 7f7e7941e700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e7406da20 con 0x7f7e740c4ff0 2023-07-25T14:36:17.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.513+0000 7f7e7941e700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e74071b90 con 0x7f7e74154c40 2023-07-25T14:36:17.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.513+0000 7f7e7941e700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e7406e170 con 0x7f7e74071740 2023-07-25T14:36:17.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.513+0000 7f7e727fc700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f7e74154c40 0x7f7e7406e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:17.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.513+0000 7f7e72ffd700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f7e740c4ff0 0x7f7e74154530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:59704/0 (socket says 172.21.15.72:59704) 2023-07-25T14:36:17.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.513+0000 7f7e72ffd700 1 -- 172.21.15.72:0/1263388231 learned_addr learned my addr 172.21.15.72:0/1263388231 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:36:17.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.513+0000 7f7e737fe700 1 --2- 172.21.15.72:0/1263388231 >> v2:172.21.15.92:3300/0 conn(0x7f7e74071740 0x7f7e740c04e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:17.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.513+0000 7f7e727fc700 1 -- 172.21.15.72:0/1263388231 >> v2:172.21.15.92:3300/0 conn(0x7f7e74071740 msgr2=0x7f7e740c04e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:17.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.513+0000 7f7e727fc700 1 --2- 172.21.15.72:0/1263388231 >> v2:172.21.15.92:3300/0 conn(0x7f7e74071740 0x7f7e740c04e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:17.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.513+0000 7f7e727fc700 1 -- 172.21.15.72:0/1263388231 >> v1:172.21.15.72:6789/0 conn(0x7f7e740c4ff0 legacy=0x7f7e74154530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:17.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.513+0000 7f7e727fc700 1 -- 172.21.15.72:0/1263388231 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e7406d0f0 con 0x7f7e74154c40 2023-07-25T14:36:17.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.513+0000 7f7e71ffb700 1 -- 172.21.15.72:0/1263388231 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4100480578 0 0) 0x7f7e7406da20 con 0x7f7e740c4ff0 2023-07-25T14:36:17.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.513+0000 7f7e727fc700 1 --2- 172.21.15.72:0/1263388231 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7e74154c40 0x7f7e7406e410 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f7e741550d0 tx=0x7f7e64009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c44e0119291f7613 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:17.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.513+0000 7f7e71ffb700 1 -- 172.21.15.72:0/1263388231 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e64011830 con 0x7f7e74154c40 2023-07-25T14:36:17.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.513+0000 7f7e71ffb700 1 -- 172.21.15.72:0/1263388231 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e64011990 con 0x7f7e74154c40 2023-07-25T14:36:17.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.513+0000 7f7e71ffb700 1 -- 172.21.15.72:0/1263388231 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e64011d20 con 0x7f7e74154c40 2023-07-25T14:36:17.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.514+0000 7f7e7941e700 1 -- 172.21.15.72:0/1263388231 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7e74154c40 msgr2=0x7f7e7406e410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:17.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.514+0000 7f7e7941e700 1 --2- 172.21.15.72:0/1263388231 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7e74154c40 0x7f7e7406e410 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f7e741550d0 tx=0x7f7e64009b20 comp rx=0 tx=0).stop 2023-07-25T14:36:17.531 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.514+0000 7f7e7941e700 1 -- 172.21.15.72:0/1263388231 shutdown_connections 2023-07-25T14:36:17.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.514+0000 7f7e7941e700 1 --2- 172.21.15.72:0/1263388231 >> v2:172.21.15.92:3300/0 conn(0x7f7e74071740 0x7f7e740c04e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:17.532 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.514+0000 7f7e7941e700 1 --2- 172.21.15.72:0/1263388231 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7e74154c40 0x7f7e7406e410 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:17.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.514+0000 7f7e7941e700 1 -- 172.21.15.72:0/1263388231 >> 172.21.15.72:0/1263388231 conn(0x7f7e740a7510 msgr2=0x7f7e740a78f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:17.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.514+0000 7f7e7941e700 1 -- 172.21.15.72:0/1263388231 shutdown_connections 2023-07-25T14:36:17.533 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.514+0000 7f7e7941e700 1 -- 172.21.15.72:0/1263388231 wait complete. 2023-07-25T14:36:17.538 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.516+0000 7f7e7941e700 1 Processor -- start 2023-07-25T14:36:17.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.516+0000 7f7e7941e700 1 -- start start 2023-07-25T14:36:17.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.516+0000 7f7e7941e700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7e74071740 0x7f7e740c6030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:17.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.517+0000 7f7e7941e700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7e740c4ff0 0x7f7e7414e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:17.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.517+0000 7f7e7941e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7e74154c40 0x7f7e7414d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:17.540 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.517+0000 7f7e7941e700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e741ebb10 con 0x7f7e74154c40 2023-07-25T14:36:17.540 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.517+0000 7f7e7941e700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e741eaed0 con 0x7f7e740c4ff0 2023-07-25T14:36:17.540 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.517+0000 7f7e7941e700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e740c27f0 con 0x7f7e74071740 2023-07-25T14:36:17.540 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.517+0000 7f7e737fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7e74154c40 0x7f7e7414d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:17.540 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.517+0000 7f7e737fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7e74154c40 0x7f7e7414d9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40746/0 (socket says 172.21.15.72:40746) 2023-07-25T14:36:17.540 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.517+0000 7f7e737fe700 1 -- 172.21.15.72:0/1163335200 learned_addr learned my addr 172.21.15.72:0/1163335200 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:17.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.517+0000 7f7e72ffd700 1 --2- 172.21.15.72:0/1163335200 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7e74071740 0x7f7e740c6030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:17.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.517+0000 7f7e727fc700 1 --2- 172.21.15.72:0/1163335200 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7e740c4ff0 0x7f7e7414e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:17.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.517+0000 7f7e737fe700 1 -- 172.21.15.72:0/1163335200 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7e74071740 msgr2=0x7f7e740c6030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:17.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.517+0000 7f7e737fe700 1 --2- 172.21.15.72:0/1163335200 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7e74071740 0x7f7e740c6030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:17.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.517+0000 7f7e737fe700 1 -- 172.21.15.72:0/1163335200 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7e740c4ff0 msgr2=0x7f7e7414e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:17.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.517+0000 7f7e737fe700 1 --2- 172.21.15.72:0/1163335200 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7e740c4ff0 0x7f7e7414e580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:17.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.517+0000 7f7e737fe700 1 -- 172.21.15.72:0/1163335200 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e640094a0 con 0x7f7e74154c40 2023-07-25T14:36:17.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.517+0000 7f7e727fc700 1 --2- 172.21.15.72:0/1163335200 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7e740c4ff0 0x7f7e7414e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-25T14:36:17.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.517+0000 7f7e737fe700 1 --2- 172.21.15.72:0/1163335200 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7e74154c40 0x7f7e7414d9f0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f7e6c007e60 tx=0x7f7e6c00e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:17.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.517+0000 7f7e5b7fe700 1 -- 172.21.15.72:0/1163335200 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e6c00ede0 con 0x7f7e74154c40 2023-07-25T14:36:17.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.517+0000 7f7e5b7fe700 1 -- 172.21.15.72:0/1163335200 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e6c014420 con 0x7f7e74154c40 2023-07-25T14:36:17.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.517+0000 7f7e7941e700 1 -- 172.21.15.72:0/1163335200 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e741eb170 con 0x7f7e74154c40 2023-07-25T14:36:17.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.517+0000 7f7e5b7fe700 1 -- 172.21.15.72:0/1163335200 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e6c0147d0 con 0x7f7e74154c40 2023-07-25T14:36:17.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.517+0000 7f7e7941e700 1 -- 172.21.15.72:0/1163335200 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e741eb730 con 0x7f7e74154c40 2023-07-25T14:36:17.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.518+0000 7f7e7941e700 1 -- 172.21.15.72:0/1163335200 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e741ebc50 con 0x7f7e74154c40 2023-07-25T14:36:17.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.519+0000 7f7e5b7fe700 1 -- 172.21.15.72:0/1163335200 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7e6c014930 con 0x7f7e74154c40 2023-07-25T14:36:17.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.519+0000 7f7e5b7fe700 1 --2- 172.21.15.72:0/1163335200 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f7e6006ace0 0x7f7e6006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:17.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.519+0000 7f7e5b7fe700 1 -- 172.21.15.72:0/1163335200 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f7e6c089ec0 con 0x7f7e74154c40 2023-07-25T14:36:17.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.519+0000 7f7e72ffd700 1 --2- 172.21.15.72:0/1163335200 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f7e6006ace0 0x7f7e6006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:17.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.519+0000 7f7e72ffd700 1 --2- 172.21.15.72:0/1163335200 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f7e6006ace0 0x7f7e6006d1a0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f7e68000f60 tx=0x7f7e68007c90 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:17.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.523+0000 7f7e5b7fe700 1 -- 172.21.15.72:0/1163335200 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f7e741ebc50 con 0x7f7e74154c40 2023-07-25T14:36:17.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.711+0000 7f7e7941e700 1 -- 172.21.15.72:0/1163335200 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7e741ebc50 con 0x7f7e74154c40 2023-07-25T14:36:17.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.711+0000 7f7e5b7fe700 1 -- 172.21.15.72:0/1163335200 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7e741ebc50 con 0x7f7e74154c40 2023-07-25T14:36:17.724 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 1 2023-07-25T14:36:17.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.713+0000 7f7e7941e700 1 -- 172.21.15.72:0/1163335200 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f7e6006ace0 msgr2=0x7f7e6006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:17.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.713+0000 7f7e7941e700 1 --2- 172.21.15.72:0/1163335200 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f7e6006ace0 0x7f7e6006d1a0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f7e68000f60 tx=0x7f7e68007c90 comp rx=0 tx=0).stop 2023-07-25T14:36:17.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.713+0000 7f7e7941e700 1 -- 172.21.15.72:0/1163335200 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7e74154c40 msgr2=0x7f7e7414d9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:17.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.713+0000 7f7e7941e700 1 --2- 172.21.15.72:0/1163335200 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7e74154c40 0x7f7e7414d9f0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f7e6c007e60 tx=0x7f7e6c00e3c0 comp rx=0 tx=0).stop 2023-07-25T14:36:17.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.713+0000 7f7e7941e700 1 -- 172.21.15.72:0/1163335200 shutdown_connections 2023-07-25T14:36:17.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.713+0000 7f7e7941e700 1 --2- 172.21.15.72:0/1163335200 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f7e6006ace0 0x7f7e6006d1a0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:17.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.713+0000 7f7e7941e700 1 --2- 172.21.15.72:0/1163335200 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7e74071740 0x7f7e740c6030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:17.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.713+0000 7f7e7941e700 1 --2- 172.21.15.72:0/1163335200 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7e74154c40 0x7f7e7414d9f0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:17.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.713+0000 7f7e7941e700 1 --2- 172.21.15.72:0/1163335200 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7e740c4ff0 0x7f7e7414e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:17.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.713+0000 7f7e7941e700 1 -- 172.21.15.72:0/1163335200 >> 172.21.15.72:0/1163335200 conn(0x7f7e740a7510 msgr2=0x7f7e740aae70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:17.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.713+0000 7f7e7941e700 1 -- 172.21.15.72:0/1163335200 shutdown_connections 2023-07-25T14:36:17.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.713+0000 7f7e7941e700 1 -- 172.21.15.72:0/1163335200 wait complete. 2023-07-25T14:36:17.737 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-25T14:36:17.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.848+0000 7f6aa0a92700 1 Processor -- start 2023-07-25T14:36:17.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.848+0000 7f6aa0a92700 1 -- start start 2023-07-25T14:36:17.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.849+0000 7f6aa0a92700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f6a9c0724c0 0x7f6a9c0c34c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:17.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.849+0000 7f6aa0a92700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a9c0c2fe0 con 0x7f6a9c151950 2023-07-25T14:36:17.864 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.849+0000 7f6aa0a92700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a9c155070 con 0x7f6a9c0c4930 2023-07-25T14:36:17.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.849+0000 7f6aa0a92700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a9c071a60 con 0x7f6a9c0724c0 2023-07-25T14:36:17.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.849+0000 7f6a99d9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f6a9c0724c0 0x7f6a9c0c34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:17.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.849+0000 7f6a9a59c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f6a9c151950 0x7f6a9c06a190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:59718/0 (socket says 172.21.15.72:59718) 2023-07-25T14:36:17.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.849+0000 7f6a9a59c700 1 -- 172.21.15.72:0/1643515672 learned_addr learned my addr 172.21.15.72:0/1643515672 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:36:17.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.850+0000 7f6a99d9b700 1 -- 172.21.15.72:0/1643515672 >> v1:172.21.15.92:6789/0 conn(0x7f6a9c0c4930 legacy=0x7f6a9c0c3a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:17.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.850+0000 7f6a99d9b700 1 -- 172.21.15.72:0/1643515672 >> v1:172.21.15.72:6789/0 conn(0x7f6a9c151950 legacy=0x7f6a9c06a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:17.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.850+0000 7f6a99d9b700 1 -- 172.21.15.72:0/1643515672 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a9c0c15c0 con 0x7f6a9c0724c0 2023-07-25T14:36:17.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.850+0000 7f6a99d9b700 1 --2- 172.21.15.72:0/1643515672 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6a9c0724c0 0x7f6a9c0c34c0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f6a8c009840 tx=0x7f6a8c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49e5781ec8cda6b6 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:17.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.850+0000 7f6a9959a700 1 -- 172.21.15.72:0/1643515672 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a8c004230 con 0x7f6a9c0724c0 2023-07-25T14:36:17.868 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.850+0000 7f6a9959a700 1 -- 172.21.15.72:0/1643515672 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a8c004390 con 0x7f6a9c0724c0 2023-07-25T14:36:17.868 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.850+0000 7f6a9959a700 1 -- 172.21.15.72:0/1643515672 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a8c0036a0 con 0x7f6a9c0724c0 2023-07-25T14:36:17.868 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.850+0000 7f6aa0a92700 1 -- 172.21.15.72:0/1643515672 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6a9c0724c0 msgr2=0x7f6a9c0c34c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:17.868 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.850+0000 7f6aa0a92700 1 --2- 172.21.15.72:0/1643515672 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6a9c0724c0 0x7f6a9c0c34c0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f6a8c009840 tx=0x7f6a8c009b50 comp rx=0 tx=0).stop 2023-07-25T14:36:17.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.850+0000 7f6aa0a92700 1 -- 172.21.15.72:0/1643515672 shutdown_connections 2023-07-25T14:36:17.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.851+0000 7f6aa0a92700 1 --2- 172.21.15.72:0/1643515672 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6a9c0724c0 0x7f6a9c0c34c0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:17.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.851+0000 7f6aa0a92700 1 -- 172.21.15.72:0/1643515672 >> 172.21.15.72:0/1643515672 conn(0x7f6a9c0a87e0 msgr2=0x7f6a9c0a8bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:17.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.851+0000 7f6aa0a92700 1 -- 172.21.15.72:0/1643515672 shutdown_connections 2023-07-25T14:36:17.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.851+0000 7f6aa0a92700 1 -- 172.21.15.72:0/1643515672 wait complete. 2023-07-25T14:36:17.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.852+0000 7f6aa0a92700 1 Processor -- start 2023-07-25T14:36:17.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.852+0000 7f6aa0a92700 1 -- start start 2023-07-25T14:36:17.872 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.852+0000 7f6aa0a92700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6a9c0724c0 0x7f6a9c14e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:17.872 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.852+0000 7f6aa0a92700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6a9c0c4930 0x7f6a9c14ea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:17.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.852+0000 7f6aa0a92700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6a9c151950 0x7f6a9c1ed280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:17.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.853+0000 7f6aa0a92700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a9c1561a0 con 0x7f6a9c0c4930 2023-07-25T14:36:17.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.853+0000 7f6aa0a92700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a9c0c0790 con 0x7f6a9c151950 2023-07-25T14:36:17.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.853+0000 7f6aa0a92700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a9c155ec0 con 0x7f6a9c0724c0 2023-07-25T14:36:17.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.853+0000 7f6a99d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6a9c0c4930 0x7f6a9c14ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:17.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.853+0000 7f6a99d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6a9c0c4930 0x7f6a9c14ea60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40758/0 (socket says 172.21.15.72:40758) 2023-07-25T14:36:17.874 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.853+0000 7f6a99d9b700 1 -- 172.21.15.72:0/1304232506 learned_addr learned my addr 172.21.15.72:0/1304232506 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:17.874 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.853+0000 7f6a9ad9d700 1 --2- 172.21.15.72:0/1304232506 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6a9c151950 0x7f6a9c1ed280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:17.874 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.853+0000 7f6a9a59c700 1 --2- 172.21.15.72:0/1304232506 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6a9c0724c0 0x7f6a9c14e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:17.874 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.853+0000 7f6a99d9b700 1 -- 172.21.15.72:0/1304232506 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6a9c0724c0 msgr2=0x7f6a9c14e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:17.874 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.853+0000 7f6a99d9b700 1 --2- 172.21.15.72:0/1304232506 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6a9c0724c0 0x7f6a9c14e520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:17.875 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.853+0000 7f6a99d9b700 1 -- 172.21.15.72:0/1304232506 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6a9c151950 msgr2=0x7f6a9c1ed280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:17.875 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.853+0000 7f6a99d9b700 1 --2- 172.21.15.72:0/1304232506 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6a9c151950 0x7f6a9c1ed280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:17.875 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.853+0000 7f6a99d9b700 1 -- 172.21.15.72:0/1304232506 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a8c0094a0 con 0x7f6a9c0c4930 2023-07-25T14:36:17.875 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.853+0000 7f6a99d9b700 1 --2- 172.21.15.72:0/1304232506 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6a9c0c4930 0x7f6a9c14ea60 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f6a8c0090b0 tx=0x7f6a8c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:17.875 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.853+0000 7f6a92ffd700 1 -- 172.21.15.72:0/1304232506 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a8c011830 con 0x7f6a9c0c4930 2023-07-25T14:36:17.875 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.853+0000 7f6a92ffd700 1 -- 172.21.15.72:0/1304232506 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a8c01f070 con 0x7f6a9c0c4930 2023-07-25T14:36:17.875 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.853+0000 7f6aa0a92700 1 -- 172.21.15.72:0/1304232506 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a9c1eb0c0 con 0x7f6a9c0c4930 2023-07-25T14:36:17.876 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.853+0000 7f6a92ffd700 1 -- 172.21.15.72:0/1304232506 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a8c011bd0 con 0x7f6a9c0c4930 2023-07-25T14:36:17.876 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.853+0000 7f6aa0a92700 1 -- 172.21.15.72:0/1304232506 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a9c1eb680 con 0x7f6a9c0c4930 2023-07-25T14:36:17.876 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.854+0000 7f6aa0a92700 1 -- 172.21.15.72:0/1304232506 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a9c04e470 con 0x7f6a9c0c4930 2023-07-25T14:36:17.876 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.855+0000 7f6a92ffd700 1 -- 172.21.15.72:0/1304232506 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6a8c011d30 con 0x7f6a9c0c4930 2023-07-25T14:36:17.876 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.855+0000 7f6a92ffd700 1 --2- 172.21.15.72:0/1304232506 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f6a7c06ace0 0x7f6a7c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:17.876 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.855+0000 7f6a92ffd700 1 -- 172.21.15.72:0/1304232506 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f6a8c021070 con 0x7f6a9c0c4930 2023-07-25T14:36:17.876 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.855+0000 7f6a9a59c700 1 --2- 172.21.15.72:0/1304232506 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f6a7c06ace0 0x7f6a7c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:17.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.855+0000 7f6a9a59c700 1 --2- 172.21.15.72:0/1304232506 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f6a7c06ace0 0x7f6a7c06d1a0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f6a84007c20 tx=0x7f6a84007d70 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:17.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:17.859+0000 7f6a92ffd700 1 -- 172.21.15.72:0/1304232506 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f6a8c056180 con 0x7f6a9c0c4930 2023-07-25T14:36:18.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.046+0000 7f6aa0a92700 1 -- 172.21.15.72:0/1304232506 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6a9c04e470 con 0x7f6a9c0c4930 2023-07-25T14:36:18.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.047+0000 7f6a92ffd700 1 -- 172.21.15.72:0/1304232506 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6a8c0597a0 con 0x7f6a9c0c4930 2023-07-25T14:36:18.059 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2023-07-25T14:36:18.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.049+0000 7f6aa0a92700 1 -- 172.21.15.72:0/1304232506 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f6a7c06ace0 msgr2=0x7f6a7c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:18.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.049+0000 7f6aa0a92700 1 --2- 172.21.15.72:0/1304232506 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f6a7c06ace0 0x7f6a7c06d1a0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f6a84007c20 tx=0x7f6a84007d70 comp rx=0 tx=0).stop 2023-07-25T14:36:18.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.049+0000 7f6aa0a92700 1 -- 172.21.15.72:0/1304232506 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6a9c0c4930 msgr2=0x7f6a9c14ea60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:18.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.049+0000 7f6aa0a92700 1 --2- 172.21.15.72:0/1304232506 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6a9c0c4930 0x7f6a9c14ea60 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f6a8c0090b0 tx=0x7f6a8c004750 comp rx=0 tx=0).stop 2023-07-25T14:36:18.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.049+0000 7f6aa0a92700 1 -- 172.21.15.72:0/1304232506 shutdown_connections 2023-07-25T14:36:18.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.049+0000 7f6aa0a92700 1 --2- 172.21.15.72:0/1304232506 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f6a7c06ace0 0x7f6a7c06d1a0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:18.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.049+0000 7f6aa0a92700 1 --2- 172.21.15.72:0/1304232506 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6a9c0724c0 0x7f6a9c14e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:18.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.049+0000 7f6aa0a92700 1 --2- 172.21.15.72:0/1304232506 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6a9c151950 0x7f6a9c1ed280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:18.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.049+0000 7f6aa0a92700 1 --2- 172.21.15.72:0/1304232506 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6a9c0c4930 0x7f6a9c14ea60 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:18.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.049+0000 7f6aa0a92700 1 -- 172.21.15.72:0/1304232506 >> 172.21.15.72:0/1304232506 conn(0x7f6a9c0a87e0 msgr2=0x7f6a9c06e720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:18.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.049+0000 7f6aa0a92700 1 -- 172.21.15.72:0/1304232506 shutdown_connections 2023-07-25T14:36:18.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.049+0000 7f6aa0a92700 1 -- 172.21.15.72:0/1304232506 wait complete. 2023-07-25T14:36:18.074 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-25T14:36:18.199 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.184+0000 7f6160186700 1 Processor -- start 2023-07-25T14:36:18.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.184+0000 7f6160186700 1 -- start start 2023-07-25T14:36:18.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.185+0000 7f6160186700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f615814e6f0 0x7f61580c67d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:18.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.185+0000 7f6160186700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f615806f280 0x7f61580a8170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:18.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.185+0000 7f6160186700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61580ba1c0 con 0x7f61580c11f0 2023-07-25T14:36:18.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.185+0000 7f6160186700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61580a7920 con 0x7f615806f280 2023-07-25T14:36:18.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.185+0000 7f6160186700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6158154640 con 0x7f615814e6f0 2023-07-25T14:36:18.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.185+0000 7f615d721700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f615806f280 0x7f61580a8170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:18.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.185+0000 7f615d721700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f615806f280 0x7f61580a8170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40766/0 (socket says 172.21.15.72:40766) 2023-07-25T14:36:18.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.185+0000 7f615e723700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f61580c11f0 0x7f61580a86b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:59734/0 (socket says 172.21.15.72:59734) 2023-07-25T14:36:18.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.185+0000 7f615d721700 1 -- 172.21.15.72:0/360529118 learned_addr learned my addr 172.21.15.72:0/360529118 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:18.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.185+0000 7f615df22700 1 --2- 172.21.15.72:0/360529118 >> v2:172.21.15.92:3300/0 conn(0x7f615814e6f0 0x7f61580c67d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:18.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.185+0000 7f615d721700 1 -- 172.21.15.72:0/360529118 >> v2:172.21.15.92:3300/0 conn(0x7f615814e6f0 msgr2=0x7f61580c67d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:18.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.185+0000 7f615d721700 1 --2- 172.21.15.72:0/360529118 >> v2:172.21.15.92:3300/0 conn(0x7f615814e6f0 0x7f61580c67d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:18.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.185+0000 7f615d721700 1 -- 172.21.15.72:0/360529118 >> v1:172.21.15.72:6789/0 conn(0x7f61580c11f0 legacy=0x7f61580a86b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:18.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.185+0000 7f615d721700 1 -- 172.21.15.72:0/360529118 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6158154900 con 0x7f615806f280 2023-07-25T14:36:18.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.185+0000 7f615cf20700 1 -- 172.21.15.72:0/360529118 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1936116783 0 0) 0x7f61580ba1c0 con 0x7f61580c11f0 2023-07-25T14:36:18.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.185+0000 7f615d721700 1 --2- 172.21.15.72:0/360529118 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f615806f280 0x7f61580a8170 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f61580c73e0 tx=0x7f614800be70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f46ea127447d4a4 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:18.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.185+0000 7f615cf20700 1 -- 172.21.15.72:0/360529118 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f614800dd30 con 0x7f615806f280 2023-07-25T14:36:18.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.185+0000 7f615cf20700 1 -- 172.21.15.72:0/360529118 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f614800de90 con 0x7f615806f280 2023-07-25T14:36:18.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.185+0000 7f615cf20700 1 -- 172.21.15.72:0/360529118 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6148010690 con 0x7f615806f280 2023-07-25T14:36:18.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.186+0000 7f6160186700 1 -- 172.21.15.72:0/360529118 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f615806f280 msgr2=0x7f61580a8170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:18.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.186+0000 7f6160186700 1 --2- 172.21.15.72:0/360529118 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f615806f280 0x7f61580a8170 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f61580c73e0 tx=0x7f614800be70 comp rx=0 tx=0).stop 2023-07-25T14:36:18.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.186+0000 7f6160186700 1 -- 172.21.15.72:0/360529118 shutdown_connections 2023-07-25T14:36:18.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.186+0000 7f6160186700 1 --2- 172.21.15.72:0/360529118 >> v2:172.21.15.92:3300/0 conn(0x7f615814e6f0 0x7f61580c67d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:18.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.186+0000 7f6160186700 1 --2- 172.21.15.72:0/360529118 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f615806f280 0x7f61580a8170 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:18.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.186+0000 7f6160186700 1 -- 172.21.15.72:0/360529118 >> 172.21.15.72:0/360529118 conn(0x7f61580714f0 msgr2=0x7f6158071900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:18.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.186+0000 7f6160186700 1 -- 172.21.15.72:0/360529118 shutdown_connections 2023-07-25T14:36:18.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.186+0000 7f6160186700 1 -- 172.21.15.72:0/360529118 wait complete. 2023-07-25T14:36:18.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.187+0000 7f6160186700 1 Processor -- start 2023-07-25T14:36:18.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.187+0000 7f6160186700 1 -- start start 2023-07-25T14:36:18.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.188+0000 7f6160186700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f615806f280 0x7f61580bcdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:18.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.188+0000 7f6160186700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f61580c11f0 0x7f61580c61b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:18.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.188+0000 7f6160186700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f615814e6f0 0x7f61580b8b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:18.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.188+0000 7f6160186700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61580c5400 con 0x7f615806f280 2023-07-25T14:36:18.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.188+0000 7f6160186700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61580ba540 con 0x7f61580c11f0 2023-07-25T14:36:18.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.188+0000 7f6160186700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61580c4ed0 con 0x7f615814e6f0 2023-07-25T14:36:18.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.188+0000 7f615df22700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f615806f280 0x7f61580bcdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:18.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.188+0000 7f615df22700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f615806f280 0x7f61580bcdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40768/0 (socket says 172.21.15.72:40768) 2023-07-25T14:36:18.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.188+0000 7f615df22700 1 -- 172.21.15.72:0/3985451576 learned_addr learned my addr 172.21.15.72:0/3985451576 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:18.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.188+0000 7f615d721700 1 --2- 172.21.15.72:0/3985451576 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f61580c11f0 0x7f61580c61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:18.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.188+0000 7f615e723700 1 --2- 172.21.15.72:0/3985451576 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f615814e6f0 0x7f61580b8b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:18.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.188+0000 7f615df22700 1 -- 172.21.15.72:0/3985451576 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f615814e6f0 msgr2=0x7f61580b8b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:18.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.188+0000 7f615df22700 1 --2- 172.21.15.72:0/3985451576 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f615814e6f0 0x7f61580b8b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:18.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.188+0000 7f615df22700 1 -- 172.21.15.72:0/3985451576 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f61580c11f0 msgr2=0x7f61580c61b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:18.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.188+0000 7f615df22700 1 --2- 172.21.15.72:0/3985451576 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f61580c11f0 0x7f61580c61b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:18.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.188+0000 7f615df22700 1 -- 172.21.15.72:0/3985451576 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f614800b7f0 con 0x7f615806f280 2023-07-25T14:36:18.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.188+0000 7f615df22700 1 --2- 172.21.15.72:0/3985451576 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f615806f280 0x7f61580bcdb0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f615400d800 tx=0x7f615400dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:18.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.188+0000 7f614e7fc700 1 -- 172.21.15.72:0/3985451576 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61540125f0 con 0x7f615806f280 2023-07-25T14:36:18.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.188+0000 7f614e7fc700 1 -- 172.21.15.72:0/3985451576 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6154012750 con 0x7f615806f280 2023-07-25T14:36:18.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.188+0000 7f6160186700 1 -- 172.21.15.72:0/3985451576 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61580c5120 con 0x7f615806f280 2023-07-25T14:36:18.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.189+0000 7f614e7fc700 1 -- 172.21.15.72:0/3985451576 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6154012b00 con 0x7f615806f280 2023-07-25T14:36:18.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.189+0000 7f6160186700 1 -- 172.21.15.72:0/3985451576 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61581e9330 con 0x7f615806f280 2023-07-25T14:36:18.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.190+0000 7f6160186700 1 -- 172.21.15.72:0/3985451576 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61580ba7b0 con 0x7f615806f280 2023-07-25T14:36:18.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.190+0000 7f614e7fc700 1 -- 172.21.15.72:0/3985451576 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6154012c60 con 0x7f615806f280 2023-07-25T14:36:18.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.190+0000 7f614e7fc700 1 --2- 172.21.15.72:0/3985451576 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f613c06ace0 0x7f613c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:18.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.190+0000 7f614e7fc700 1 -- 172.21.15.72:0/3985451576 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f6154089a70 con 0x7f615806f280 2023-07-25T14:36:18.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.190+0000 7f615d721700 1 --2- 172.21.15.72:0/3985451576 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f613c06ace0 0x7f613c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:18.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.191+0000 7f615d721700 1 --2- 172.21.15.72:0/3985451576 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f613c06ace0 0x7f613c06d1a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f615806f6c0 tx=0x7f6148012000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:18.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.195+0000 7f614e7fc700 1 -- 172.21.15.72:0/3985451576 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f61540548c0 con 0x7f615806f280 2023-07-25T14:36:18.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.383+0000 7f6160186700 1 -- 172.21.15.72:0/3985451576 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f61581e8eb0 con 0x7f615806f280 2023-07-25T14:36:18.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.383+0000 7f614e7fc700 1 -- 172.21.15.72:0/3985451576 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7f61581e8eb0 con 0x7f615806f280 2023-07-25T14:36:18.396 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 64 2023-07-25T14:36:18.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.386+0000 7f6160186700 1 -- 172.21.15.72:0/3985451576 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f613c06ace0 msgr2=0x7f613c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:18.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.386+0000 7f6160186700 1 --2- 172.21.15.72:0/3985451576 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f613c06ace0 0x7f613c06d1a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f615806f6c0 tx=0x7f6148012000 comp rx=0 tx=0).stop 2023-07-25T14:36:18.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.386+0000 7f6160186700 1 -- 172.21.15.72:0/3985451576 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f615806f280 msgr2=0x7f61580bcdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:18.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.386+0000 7f6160186700 1 --2- 172.21.15.72:0/3985451576 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f615806f280 0x7f61580bcdb0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f615400d800 tx=0x7f615400dbc0 comp rx=0 tx=0).stop 2023-07-25T14:36:18.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.386+0000 7f6160186700 1 -- 172.21.15.72:0/3985451576 shutdown_connections 2023-07-25T14:36:18.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.386+0000 7f6160186700 1 --2- 172.21.15.72:0/3985451576 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f613c06ace0 0x7f613c06d1a0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:18.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.386+0000 7f6160186700 1 --2- 172.21.15.72:0/3985451576 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f615814e6f0 0x7f61580b8b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:18.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.386+0000 7f6160186700 1 --2- 172.21.15.72:0/3985451576 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f615806f280 0x7f61580bcdb0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:18.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.386+0000 7f6160186700 1 --2- 172.21.15.72:0/3985451576 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f61580c11f0 0x7f61580c61b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:18.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.386+0000 7f6160186700 1 -- 172.21.15.72:0/3985451576 >> 172.21.15.72:0/3985451576 conn(0x7f61580714f0 msgr2=0x7f615814ec50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:18.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.386+0000 7f6160186700 1 -- 172.21.15.72:0/3985451576 shutdown_connections 2023-07-25T14:36:18.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.386+0000 7f6160186700 1 -- 172.21.15.72:0/3985451576 wait complete. 2023-07-25T14:36:18.410 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-07-25T14:36:18.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.521+0000 7f9388e91700 1 Processor -- start 2023-07-25T14:36:18.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.521+0000 7f9388e91700 1 -- start start 2023-07-25T14:36:18.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.522+0000 7f9388e91700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f938414faf0 0x7f93840c5e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:18.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.522+0000 7f9388e91700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f93840c3f10 0x7f9384071960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:18.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.522+0000 7f9388e91700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93840c4930 con 0x7f93840ba0e0 2023-07-25T14:36:18.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.522+0000 7f9388e91700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93840c5670 con 0x7f93840c3f10 2023-07-25T14:36:18.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.522+0000 7f9388e91700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93840726e0 con 0x7f938414faf0 2023-07-25T14:36:18.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.522+0000 7f9382d9d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f93840c3f10 0x7f9384071960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:18.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.522+0000 7f9382d9d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f93840c3f10 0x7f9384071960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40776/0 (socket says 172.21.15.72:40776) 2023-07-25T14:36:18.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.522+0000 7f9382d9d700 1 -- 172.21.15.72:0/3115504387 learned_addr learned my addr 172.21.15.72:0/3115504387 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:18.538 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.522+0000 7f938259c700 1 --2- 172.21.15.72:0/3115504387 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f938414faf0 0x7f93840c5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:18.538 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.522+0000 7f9382d9d700 1 -- 172.21.15.72:0/3115504387 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f938414faf0 msgr2=0x7f93840c5e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:18.538 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.522+0000 7f9382d9d700 1 --2- 172.21.15.72:0/3115504387 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f938414faf0 0x7f93840c5e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:18.538 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.522+0000 7f9382d9d700 1 -- 172.21.15.72:0/3115504387 >> v1:172.21.15.92:6789/0 conn(0x7f93840ba0e0 legacy=0x7f93841558a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:18.538 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.522+0000 7f9382d9d700 1 -- 172.21.15.72:0/3115504387 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93840c4b80 con 0x7f93840c3f10 2023-07-25T14:36:18.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.523+0000 7f9382d9d700 1 --2- 172.21.15.72:0/3115504387 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f93840c3f10 0x7f9384071960 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f937c009e50 tx=0x7f937c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4cfe44de5ef5354 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:18.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.523+0000 7f938159a700 1 -- 172.21.15.72:0/3115504387 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f937c00e070 con 0x7f93840c3f10 2023-07-25T14:36:18.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.523+0000 7f938159a700 1 -- 172.21.15.72:0/3115504387 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f937c00b910 con 0x7f93840c3f10 2023-07-25T14:36:18.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.523+0000 7f938159a700 1 -- 172.21.15.72:0/3115504387 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f937c00bcc0 con 0x7f93840c3f10 2023-07-25T14:36:18.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.523+0000 7f9388e91700 1 -- 172.21.15.72:0/3115504387 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f93840c3f10 msgr2=0x7f9384071960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:18.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.523+0000 7f9388e91700 1 --2- 172.21.15.72:0/3115504387 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f93840c3f10 0x7f9384071960 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f937c009e50 tx=0x7f937c00b330 comp rx=0 tx=0).stop 2023-07-25T14:36:18.540 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.523+0000 7f9388e91700 1 -- 172.21.15.72:0/3115504387 shutdown_connections 2023-07-25T14:36:18.540 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.523+0000 7f9388e91700 1 --2- 172.21.15.72:0/3115504387 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f93840c3f10 0x7f9384071960 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:18.540 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.523+0000 7f9388e91700 1 --2- 172.21.15.72:0/3115504387 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f938414faf0 0x7f93840c5e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:18.540 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.523+0000 7f9388e91700 1 -- 172.21.15.72:0/3115504387 >> 172.21.15.72:0/3115504387 conn(0x7f93840a87e0 msgr2=0x7f93840a8bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:18.540 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.523+0000 7f9388e91700 1 -- 172.21.15.72:0/3115504387 shutdown_connections 2023-07-25T14:36:18.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.523+0000 7f9388e91700 1 -- 172.21.15.72:0/3115504387 wait complete. 2023-07-25T14:36:18.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.525+0000 7f9388e91700 1 Processor -- start 2023-07-25T14:36:18.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.525+0000 7f9388e91700 1 -- start start 2023-07-25T14:36:18.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.525+0000 7f9388e91700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f93840ba0e0 0x7f938414eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:18.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.525+0000 7f9388e91700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f93840c3f10 0x7f93840bfba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:18.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.525+0000 7f9388e91700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f938414faf0 0x7f93841e9980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:18.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.525+0000 7f9388e91700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93841e9530 con 0x7f938414faf0 2023-07-25T14:36:18.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.525+0000 7f9388e91700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93840c0de0 con 0x7f93840ba0e0 2023-07-25T14:36:18.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.525+0000 7f9388e91700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93840bdb00 con 0x7f93840c3f10 2023-07-25T14:36:18.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.525+0000 7f9382d9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f938414faf0 0x7f93841e9980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:18.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.525+0000 7f9382d9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f938414faf0 0x7f93841e9980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40784/0 (socket says 172.21.15.72:40784) 2023-07-25T14:36:18.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.525+0000 7f9382d9d700 1 -- 172.21.15.72:0/1873375667 learned_addr learned my addr 172.21.15.72:0/1873375667 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:18.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.526+0000 7f938259c700 1 --2- 172.21.15.72:0/1873375667 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f93840ba0e0 0x7f938414eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:18.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.526+0000 7f9381d9b700 1 --2- 172.21.15.72:0/1873375667 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f93840c3f10 0x7f93840bfba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:18.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.526+0000 7f9382d9d700 1 -- 172.21.15.72:0/1873375667 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f93840c3f10 msgr2=0x7f93840bfba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:18.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.526+0000 7f9382d9d700 1 --2- 172.21.15.72:0/1873375667 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f93840c3f10 0x7f93840bfba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:18.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.526+0000 7f9382d9d700 1 -- 172.21.15.72:0/1873375667 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f93840ba0e0 msgr2=0x7f938414eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:18.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.526+0000 7f9382d9d700 1 --2- 172.21.15.72:0/1873375667 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f93840ba0e0 0x7f938414eae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:18.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.526+0000 7f9382d9d700 1 -- 172.21.15.72:0/1873375667 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f937c009b30 con 0x7f938414faf0 2023-07-25T14:36:18.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.526+0000 7f9382d9d700 1 --2- 172.21.15.72:0/1873375667 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f938414faf0 0x7f93841e9980 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f937c00b680 tx=0x7f937c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:18.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.526+0000 7f9372ffd700 1 -- 172.21.15.72:0/1873375667 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f937c004830 con 0x7f938414faf0 2023-07-25T14:36:18.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.526+0000 7f9372ffd700 1 -- 172.21.15.72:0/1873375667 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f937c0099b0 con 0x7f938414faf0 2023-07-25T14:36:18.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.526+0000 7f9388e91700 1 -- 172.21.15.72:0/1873375667 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93841ece80 con 0x7f938414faf0 2023-07-25T14:36:18.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.526+0000 7f9372ffd700 1 -- 172.21.15.72:0/1873375667 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f937c01b670 con 0x7f938414faf0 2023-07-25T14:36:18.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.526+0000 7f9388e91700 1 -- 172.21.15.72:0/1873375667 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93841ed440 con 0x7f938414faf0 2023-07-25T14:36:18.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.527+0000 7f9388e91700 1 -- 172.21.15.72:0/1873375667 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f938404e470 con 0x7f938414faf0 2023-07-25T14:36:18.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.527+0000 7f9372ffd700 1 -- 172.21.15.72:0/1873375667 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f937c01b7d0 con 0x7f938414faf0 2023-07-25T14:36:18.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.528+0000 7f9372ffd700 1 --2- 172.21.15.72:0/1873375667 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f936406ace0 0x7f936406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:18.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.528+0000 7f9372ffd700 1 -- 172.21.15.72:0/1873375667 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f937c08af60 con 0x7f938414faf0 2023-07-25T14:36:18.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.528+0000 7f938259c700 1 --2- 172.21.15.72:0/1873375667 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f936406ace0 0x7f936406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:18.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.528+0000 7f938259c700 1 --2- 172.21.15.72:0/1873375667 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f936406ace0 0x7f936406d1a0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f9378009be0 tx=0x7f9378009210 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:18.552 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.532+0000 7f9372ffd700 1 -- 172.21.15.72:0/1873375667 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f937c055db0 con 0x7f938414faf0 2023-07-25T14:36:18.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.719+0000 7f9388e91700 1 -- 172.21.15.72:0/1873375667 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f93840c5110 con 0x7f938414faf0 2023-07-25T14:36:18.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.719+0000 7f9372ffd700 1 -- 172.21.15.72:0/1873375667 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+11 (secure 0 0 0) 0x7f937c01f0a0 con 0x7f938414faf0 2023-07-25T14:36:18.732 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2023-07-25T14:36:18.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.721+0000 7f9388e91700 1 -- 172.21.15.72:0/1873375667 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f936406ace0 msgr2=0x7f936406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:18.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.721+0000 7f9388e91700 1 --2- 172.21.15.72:0/1873375667 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f936406ace0 0x7f936406d1a0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f9378009be0 tx=0x7f9378009210 comp rx=0 tx=0).stop 2023-07-25T14:36:18.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.721+0000 7f9388e91700 1 -- 172.21.15.72:0/1873375667 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f938414faf0 msgr2=0x7f93841e9980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:18.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.721+0000 7f9388e91700 1 --2- 172.21.15.72:0/1873375667 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f938414faf0 0x7f93841e9980 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f937c00b680 tx=0x7f937c004ad0 comp rx=0 tx=0).stop 2023-07-25T14:36:18.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.721+0000 7f9388e91700 1 -- 172.21.15.72:0/1873375667 shutdown_connections 2023-07-25T14:36:18.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.721+0000 7f9388e91700 1 --2- 172.21.15.72:0/1873375667 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f936406ace0 0x7f936406d1a0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:18.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.721+0000 7f9388e91700 1 --2- 172.21.15.72:0/1873375667 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f938414faf0 0x7f93841e9980 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:18.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.721+0000 7f9388e91700 1 --2- 172.21.15.72:0/1873375667 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f93840ba0e0 0x7f938414eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:18.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.721+0000 7f9388e91700 1 --2- 172.21.15.72:0/1873375667 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f93840c3f10 0x7f93840bfba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:18.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.721+0000 7f9388e91700 1 -- 172.21.15.72:0/1873375667 >> 172.21.15.72:0/1873375667 conn(0x7f93840a87e0 msgr2=0x7f93840abf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:18.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.721+0000 7f9388e91700 1 -- 172.21.15.72:0/1873375667 shutdown_connections 2023-07-25T14:36:18.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.721+0000 7f9388e91700 1 -- 172.21.15.72:0/1873375667 wait complete. 2023-07-25T14:36:18.745 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-25T14:36:18.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.853+0000 7f71f0146700 1 Processor -- start 2023-07-25T14:36:18.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.853+0000 7f71f0146700 1 -- start start 2023-07-25T14:36:18.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.854+0000 7f71f0146700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f71e80bfaa0 0x7f71e815fac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:18.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.854+0000 7f71f0146700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71e80c68f0 con 0x7f71e80c7340 2023-07-25T14:36:18.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.854+0000 7f71f0146700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71e80bfff0 con 0x7f71e81518d0 2023-07-25T14:36:18.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.854+0000 7f71f0146700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71e80c0940 con 0x7f71e80bfaa0 2023-07-25T14:36:18.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.854+0000 7f71ed6e1700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f71e80c7340 0x7f71e8071e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:59758/0 (socket says 172.21.15.72:59758) 2023-07-25T14:36:18.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.854+0000 7f71ed6e1700 1 -- 172.21.15.72:0/308154488 learned_addr learned my addr 172.21.15.72:0/308154488 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:36:18.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.854+0000 7f71ee6e3700 1 --2- 172.21.15.72:0/308154488 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f71e80bfaa0 0x7f71e815fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:18.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.854+0000 7f71ecee0700 1 -- 172.21.15.72:0/308154488 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1278013231 0 0) 0x7f71e80c68f0 con 0x7f71e80c7340 2023-07-25T14:36:18.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.854+0000 7f71ecee0700 1 -- 172.21.15.72:0/308154488 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f71d40035b0 con 0x7f71e80c7340 2023-07-25T14:36:18.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.854+0000 7f71ecee0700 1 -- 172.21.15.72:0/308154488 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 299516487 0 0) 0x7f71d40035b0 con 0x7f71e80c7340 2023-07-25T14:36:18.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.854+0000 7f71ecee0700 1 -- 172.21.15.72:0/308154488 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f71e80bfaa0 msgr2=0x7f71e815fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:18.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.854+0000 7f71ecee0700 1 --2- 172.21.15.72:0/308154488 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f71e80bfaa0 0x7f71e815fac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:18.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.854+0000 7f71ecee0700 1 -- 172.21.15.72:0/308154488 >> v1:172.21.15.92:6789/0 conn(0x7f71e81518d0 legacy=0x7f71e8157720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:18.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.854+0000 7f71ecee0700 1 -- 172.21.15.72:0/308154488 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71e80c02d0 con 0x7f71e80c7340 2023-07-25T14:36:18.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.854+0000 7f71ecee0700 1 -- 172.21.15.72:0/308154488 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2559588315 0 0) 0x7f71d8001670 con 0x7f71e80c7340 2023-07-25T14:36:18.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.854+0000 7f71ecee0700 1 -- 172.21.15.72:0/308154488 >> v1:172.21.15.72:6789/0 conn(0x7f71e80c7340 legacy=0x7f71e8071e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:18.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.854+0000 7f71ecee0700 1 --2- 172.21.15.72:0/308154488 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f71d4003a30 0x7f71d4003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:18.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.854+0000 7f71ecee0700 1 --2- 172.21.15.72:0/308154488 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f71e80bfaa0 0x7f71d4004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:18.872 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.854+0000 7f71ecee0700 1 --2- 172.21.15.72:0/308154488 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f71d4004d90 0x7f71d4005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:18.872 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.854+0000 7f71ecee0700 1 -- 172.21.15.72:0/308154488 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71e80c0940 con 0x7f71d4004d90 2023-07-25T14:36:18.872 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.854+0000 7f71ecee0700 1 -- 172.21.15.72:0/308154488 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71d400bb70 con 0x7f71d4003a30 2023-07-25T14:36:18.872 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.854+0000 7f71ecee0700 1 -- 172.21.15.72:0/308154488 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71d400bd30 con 0x7f71e80bfaa0 2023-07-25T14:36:18.872 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.855+0000 7f71ee6e3700 1 --2- 172.21.15.72:0/308154488 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f71d4004d90 0x7f71d4005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:18.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.855+0000 7f71edee2700 1 --2- 172.21.15.72:0/308154488 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f71d4003a30 0x7f71d4003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:18.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.855+0000 7f71ed6e1700 1 --2- 172.21.15.72:0/308154488 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f71e80bfaa0 0x7f71d4004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:18.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.855+0000 7f71ee6e3700 1 -- 172.21.15.72:0/308154488 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f71e80bfaa0 msgr2=0x7f71d4004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:18.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.855+0000 7f71ee6e3700 1 --2- 172.21.15.72:0/308154488 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f71e80bfaa0 0x7f71d4004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:18.874 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.855+0000 7f71ee6e3700 1 -- 172.21.15.72:0/308154488 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f71d4003a30 msgr2=0x7f71d4003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:18.874 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.855+0000 7f71ee6e3700 1 --2- 172.21.15.72:0/308154488 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f71d4003a30 0x7f71d4003e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:18.874 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.855+0000 7f71ee6e3700 1 -- 172.21.15.72:0/308154488 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71d40035b0 con 0x7f71d4004d90 2023-07-25T14:36:18.874 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.855+0000 7f71ee6e3700 1 --2- 172.21.15.72:0/308154488 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f71d4004d90 0x7f71d4005210 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f71e0009fc0 tx=0x7f71d4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4290de015fa68bd server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:18.875 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.855+0000 7f71ecee0700 1 -- 172.21.15.72:0/308154488 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71e000ec30 con 0x7f71d4004d90 2023-07-25T14:36:18.875 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.855+0000 7f71ecee0700 1 -- 172.21.15.72:0/308154488 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71e000f040 con 0x7f71d4004d90 2023-07-25T14:36:18.875 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.855+0000 7f71ecee0700 1 -- 172.21.15.72:0/308154488 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71e0014480 con 0x7f71d4004d90 2023-07-25T14:36:18.876 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.856+0000 7f71f0146700 1 -- 172.21.15.72:0/308154488 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f71d4004d90 msgr2=0x7f71d4005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:18.876 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.856+0000 7f71f0146700 1 --2- 172.21.15.72:0/308154488 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f71d4004d90 0x7f71d4005210 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f71e0009fc0 tx=0x7f71d4005880 comp rx=0 tx=0).stop 2023-07-25T14:36:18.876 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.856+0000 7f71ee6e3700 1 -- 172.21.15.72:0/308154488 reap_dead start 2023-07-25T14:36:18.876 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.856+0000 7f71f0146700 1 -- 172.21.15.72:0/308154488 shutdown_connections 2023-07-25T14:36:18.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.856+0000 7f71f0146700 1 -- 172.21.15.72:0/308154488 >> 172.21.15.72:0/308154488 conn(0x7f71e80a7490 msgr2=0x7f71e80a7870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:18.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.856+0000 7f71f0146700 1 -- 172.21.15.72:0/308154488 shutdown_connections 2023-07-25T14:36:18.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.856+0000 7f71f0146700 1 -- 172.21.15.72:0/308154488 wait complete. 2023-07-25T14:36:18.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.857+0000 7f71f0146700 1 Processor -- start 2023-07-25T14:36:18.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.857+0000 7f71f0146700 1 -- start start 2023-07-25T14:36:18.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.858+0000 7f71f0146700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f71d4004d90 0x7f71e80aae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:18.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.858+0000 7f71f0146700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f71e8157320 0x7f71e80ab390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:18.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.858+0000 7f71f0146700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f71e813ff70 0x7f71e81403f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:18.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.858+0000 7f71f0146700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71e814dd70 con 0x7f71e813ff70 2023-07-25T14:36:18.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.858+0000 7f71f0146700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71e814c870 con 0x7f71e8157320 2023-07-25T14:36:18.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.858+0000 7f71f0146700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71e814cd00 con 0x7f71d4004d90 2023-07-25T14:36:18.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.858+0000 7f71ee6e3700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f71e813ff70 0x7f71e81403f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:18.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.858+0000 7f71ee6e3700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f71e813ff70 0x7f71e81403f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40804/0 (socket says 172.21.15.72:40804) 2023-07-25T14:36:18.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.858+0000 7f71ee6e3700 1 -- 172.21.15.72:0/3082670212 learned_addr learned my addr 172.21.15.72:0/3082670212 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:18.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.858+0000 7f71ed6e1700 1 --2- 172.21.15.72:0/3082670212 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f71e8157320 0x7f71e80ab390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:18.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.858+0000 7f71edee2700 1 --2- 172.21.15.72:0/3082670212 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f71d4004d90 0x7f71e80aae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:18.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.858+0000 7f71ee6e3700 1 -- 172.21.15.72:0/3082670212 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f71d4004d90 msgr2=0x7f71e80aae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:18.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.858+0000 7f71ee6e3700 1 --2- 172.21.15.72:0/3082670212 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f71d4004d90 0x7f71e80aae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:18.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.858+0000 7f71ee6e3700 1 -- 172.21.15.72:0/3082670212 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f71e8157320 msgr2=0x7f71e80ab390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:18.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.858+0000 7f71ee6e3700 1 --2- 172.21.15.72:0/3082670212 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f71e8157320 0x7f71e80ab390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:18.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.858+0000 7f71ee6e3700 1 -- 172.21.15.72:0/3082670212 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71e80aa340 con 0x7f71e813ff70 2023-07-25T14:36:18.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.858+0000 7f71ee6e3700 1 --2- 172.21.15.72:0/3082670212 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f71e813ff70 0x7f71e81403f0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f71e0016000 tx=0x7f71e0009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:18.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.858+0000 7f71de7fc700 1 -- 172.21.15.72:0/3082670212 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71e0007000 con 0x7f71e813ff70 2023-07-25T14:36:18.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.858+0000 7f71de7fc700 1 -- 172.21.15.72:0/3082670212 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71e0022070 con 0x7f71e813ff70 2023-07-25T14:36:18.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.858+0000 7f71de7fc700 1 -- 172.21.15.72:0/3082670212 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71e0015e70 con 0x7f71e813ff70 2023-07-25T14:36:18.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.858+0000 7f71f0146700 1 -- 172.21.15.72:0/3082670212 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71e80aa620 con 0x7f71e813ff70 2023-07-25T14:36:18.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.859+0000 7f71f0146700 1 -- 172.21.15.72:0/3082670212 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71e8140930 con 0x7f71e813ff70 2023-07-25T14:36:18.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.859+0000 7f71f0146700 1 -- 172.21.15.72:0/3082670212 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71e814c9e0 con 0x7f71e813ff70 2023-07-25T14:36:18.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.860+0000 7f71de7fc700 1 -- 172.21.15.72:0/3082670212 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f71e001e430 con 0x7f71e813ff70 2023-07-25T14:36:18.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.860+0000 7f71de7fc700 1 --2- 172.21.15.72:0/3082670212 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f71cc06ace0 0x7f71cc06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:18.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.860+0000 7f71de7fc700 1 -- 172.21.15.72:0/3082670212 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f71e0024070 con 0x7f71e813ff70 2023-07-25T14:36:18.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.860+0000 7f71edee2700 1 --2- 172.21.15.72:0/3082670212 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f71cc06ace0 0x7f71cc06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:18.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.861+0000 7f71edee2700 1 --2- 172.21.15.72:0/3082670212 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f71cc06ace0 0x7f71cc06d1a0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f71e814bcd0 tx=0x7f71e4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:18.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:18.864+0000 7f71de7fc700 1 -- 172.21.15.72:0/3082670212 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f71e0056240 con 0x7f71e813ff70 2023-07-25T14:36:19.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.055+0000 7f71f0146700 1 -- 172.21.15.72:0/3082670212 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f71e804e470 con 0x7f71e813ff70 2023-07-25T14:36:19.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.056+0000 7f71de7fc700 1 -- 172.21.15.72:0/3082670212 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+20014 (secure 0 0 0) 0x7f71e0059860 con 0x7f71e813ff70 2023-07-25T14:36:19.068 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-25T14:36:19.069 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":25,"fsid":"9170db48-9170-43e8-8ccb-9813e6240906","created":"2023-07-25T14:35:21.733262+0000","modified":"2023-07-25T14:35:44.992669+0000","last_up_change":"2023-07-25T14:35:31.355010+0000","last_in_change":"2023-07-25T14:35:24.195785+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-25T14:35:32.983457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-25T14:35:33.326342+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-25T14:35:37.534158+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-25T14:35:38.891571+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-25T14:35:42.596923+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d517fdad-0bfe-49f0-89f2-9421c3761839","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6801","nonce":2475407414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6803","nonce":2475407414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6807","nonce":2475407414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6805","nonce":2475407414}]},"public_addr":"172.21.15.72:6801/2475407414","cluster_addr":"172.21.15.72:6803/2475407414","heartbeat_back_addr":"172.21.15.72:6807/2475407414","heartbeat_front_addr":"172.21.15.72:6805/2475407414","state":["exists","up"]},{"osd":1,"uuid":"e1564be3-f209-47e5-a8d0-32fc618a474f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6822","nonce":870954016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6825","nonce":870954016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6831","nonce":870954016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6827","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6829","nonce":870954016}]},"public_addr":"172.21.15.72:6822/870954016","cluster_addr":"172.21.15.72:6825/870954016","heartbeat_back_addr":"172.21.15.72:6831/870954016","heartbeat_front_addr":"172.21.15.72:6829/870954016","state":["exists","up"]},{"osd":2,"uuid":"c4647d30-ffa6-417a-9026-ef530c75910e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6809","nonce":2143129442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6811","nonce":2143129442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6815","nonce":2143129442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6813","nonce":2143129442}]},"public_addr":"172.21.15.72:6809/2143129442","cluster_addr":"172.21.15.72:6811/2143129442","heartbeat_back_addr":"172.21.15.72:6815/2143129442","heartbeat_front_addr":"172.21.15.72:6813/2143129442","state":["exists","up"]},{"osd":3,"uuid":"76c9d9a7-c2e2-4612-a58b-d6882dd76b58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6817","nonce":3404066311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6819","nonce":3404066311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6828","nonce":3404066311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6821","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6823","nonce":3404066311}]},"public_addr":"172.21.15.72:6817/3404066311","cluster_addr":"172.21.15.72:6819/3404066311","heartbeat_back_addr":"172.21.15.72:6828/3404066311","heartbeat_front_addr":"172.21.15.72:6823/3404066311","state":["exists","up"]},{"osd":4,"uuid":"7f8920dc-0ad4-4a73-ab40-65408f83eadd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6817","nonce":2381008739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6819","nonce":2381008739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6825","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6827","nonce":2381008739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6822","nonce":2381008739}]},"public_addr":"172.21.15.92:6817/2381008739","cluster_addr":"172.21.15.92:6819/2381008739","heartbeat_back_addr":"172.21.15.92:6827/2381008739","heartbeat_front_addr":"172.21.15.92:6822/2381008739","state":["exists","up"]},{"osd":5,"uuid":"56257e7c-31eb-44c5-9ec7-1318a4e0bb35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6801","nonce":2161935604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6803","nonce":2161935604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6807","nonce":2161935604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6805","nonce":2161935604}]},"public_addr":"172.21.15.92:6801/2161935604","cluster_addr":"172.21.15.92:6803/2161935604","heartbeat_back_addr":"172.21.15.92:6807/2161935604","heartbeat_front_addr":"172.21.15.92:6805/2161935604","state":["exists","up"]},{"osd":6,"uuid":"a150d3d8-a0c9-4955-968a-8d98eff4ffb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6809","nonce":3770163493}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6811","nonce":3770163493}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6815","nonce":3770163493}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6813","nonce":3770163493}]},"public_addr":"172.21.15.92:6809/3770163493","cluster_addr":"172.21.15.92:6811/3770163493","heartbeat_back_addr":"172.21.15.92:6815/3770163493","heartbeat_front_addr":"172.21.15.92:6813/3770163493","state":["exists","up"]},{"osd":7,"uuid":"07799c27-54ee-4591-a42d-a978d6b32065","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6821","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6823","nonce":2135777609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6826","nonce":2135777609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6831","nonce":2135777609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6829","nonce":2135777609}]},"public_addr":"172.21.15.92:6823/2135777609","cluster_addr":"172.21.15.92:6826/2135777609","heartbeat_back_addr":"172.21.15.92:6831/2135777609","heartbeat_front_addr":"172.21.15.92:6829/2135777609","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.345365+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.378150+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.146566+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.372172+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:30.398421+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.385632+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.465611+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.443583+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-25T14:36:19.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.058+0000 7f71f0146700 1 -- 172.21.15.72:0/3082670212 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f71cc06ace0 msgr2=0x7f71cc06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:19.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.058+0000 7f71f0146700 1 --2- 172.21.15.72:0/3082670212 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f71cc06ace0 0x7f71cc06d1a0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f71e814bcd0 tx=0x7f71e4009040 comp rx=0 tx=0).stop 2023-07-25T14:36:19.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.058+0000 7f71f0146700 1 -- 172.21.15.72:0/3082670212 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f71e813ff70 msgr2=0x7f71e81403f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:19.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.058+0000 7f71f0146700 1 --2- 172.21.15.72:0/3082670212 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f71e813ff70 0x7f71e81403f0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f71e0016000 tx=0x7f71e0009750 comp rx=0 tx=0).stop 2023-07-25T14:36:19.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.058+0000 7f71f0146700 1 -- 172.21.15.72:0/3082670212 shutdown_connections 2023-07-25T14:36:19.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.058+0000 7f71f0146700 1 --2- 172.21.15.72:0/3082670212 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f71cc06ace0 0x7f71cc06d1a0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:19.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.058+0000 7f71f0146700 1 --2- 172.21.15.72:0/3082670212 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f71d4004d90 0x7f71e80aae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:19.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.058+0000 7f71f0146700 1 --2- 172.21.15.72:0/3082670212 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f71e813ff70 0x7f71e81403f0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:19.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.058+0000 7f71f0146700 1 --2- 172.21.15.72:0/3082670212 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f71e8157320 0x7f71e80ab390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:19.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.058+0000 7f71f0146700 1 -- 172.21.15.72:0/3082670212 >> 172.21.15.72:0/3082670212 conn(0x7f71e80a7490 msgr2=0x7f71e814e930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:19.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.058+0000 7f71f0146700 1 -- 172.21.15.72:0/3082670212 shutdown_connections 2023-07-25T14:36:19.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.058+0000 7f71f0146700 1 -- 172.21.15.72:0/3082670212 wait complete. 2023-07-25T14:36:19.082 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-07-25T14:35:32.983457+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-07-25T14:35:33.326342+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-25T14:35:37.534158+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-25T14:35:38.891571+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-07-25T14:35:42.596923+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-25T14:36:19.083 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-25T14:36:19.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.194+0000 7f0a98833700 1 Processor -- start 2023-07-25T14:36:19.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.194+0000 7f0a98833700 1 -- start start 2023-07-25T14:36:19.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.195+0000 7f0a98833700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f0a94151950 0x7f0a9406a190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:19.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.195+0000 7f0a98833700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0a9406a6d0 0x7f0a940c3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:19.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.195+0000 7f0a98833700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a940c2fe0 con 0x7f0a940724c0 2023-07-25T14:36:19.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.195+0000 7f0a98833700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a94071a60 con 0x7f0a94151950 2023-07-25T14:36:19.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.195+0000 7f0a98833700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a940c2a70 con 0x7f0a9406a6d0 2023-07-25T14:36:19.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.195+0000 7f0a9259c700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f0a94151950 0x7f0a9406a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:19.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.195+0000 7f0a92d9d700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0a9406a6d0 0x7f0a940c3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:19.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.195+0000 7f0a91d9b700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f0a940724c0 0x7f0a940c34c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.72:55118/0 (socket says 172.21.15.72:55118) 2023-07-25T14:36:19.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.195+0000 7f0a9259c700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f0a94151950 0x7f0a9406a190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.72:36380/0 (socket says 172.21.15.72:36380) 2023-07-25T14:36:19.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.195+0000 7f0a91d9b700 1 -- 172.21.15.72:0/2966819990 learned_addr learned my addr 172.21.15.72:0/2966819990 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:36:19.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.195+0000 7f0a9159a700 1 -- 172.21.15.72:0/2966819990 <== mon.1 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2702632156 0 0) 0x7f0a940c2fe0 con 0x7f0a940724c0 2023-07-25T14:36:19.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.195+0000 7f0a9159a700 1 -- 172.21.15.72:0/2966819990 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0a7c0035b0 con 0x7f0a940724c0 2023-07-25T14:36:19.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.195+0000 7f0a92d9d700 1 -- 172.21.15.72:0/2966819990 >> v2:172.21.15.92:3300/0 conn(0x7f0a94151950 msgr2=0x7f0a9406a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:19.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.195+0000 7f0a92d9d700 1 --2- 172.21.15.72:0/2966819990 >> v2:172.21.15.92:3300/0 conn(0x7f0a94151950 0x7f0a9406a190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:19.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.195+0000 7f0a92d9d700 1 -- 172.21.15.72:0/2966819990 >> v1:172.21.15.92:6789/0 conn(0x7f0a940724c0 legacy=0x7f0a940c34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:19.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.195+0000 7f0a92d9d700 1 -- 172.21.15.72:0/2966819990 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a94155070 con 0x7f0a9406a6d0 2023-07-25T14:36:19.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.196+0000 7f0a9259c700 1 --2- 172.21.15.72:0/2966819990 >> v2:172.21.15.92:3300/0 conn(0x7f0a94151950 0x7f0a9406a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-25T14:36:19.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.196+0000 7f0a92d9d700 1 --2- 172.21.15.72:0/2966819990 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0a9406a6d0 0x7f0a940c3bd0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f0a8c009d90 tx=0x7f0a8c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b99497ef2eb64548 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:19.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.196+0000 7f0a9159a700 1 -- 172.21.15.72:0/2966819990 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a8c00e070 con 0x7f0a9406a6d0 2023-07-25T14:36:19.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.196+0000 7f0a9159a700 1 -- 172.21.15.72:0/2966819990 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a8c00bb20 con 0x7f0a9406a6d0 2023-07-25T14:36:19.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.196+0000 7f0a9159a700 1 -- 172.21.15.72:0/2966819990 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a8c012430 con 0x7f0a9406a6d0 2023-07-25T14:36:19.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.196+0000 7f0a98833700 1 -- 172.21.15.72:0/2966819990 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0a9406a6d0 msgr2=0x7f0a940c3bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:19.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.196+0000 7f0a98833700 1 --2- 172.21.15.72:0/2966819990 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0a9406a6d0 0x7f0a940c3bd0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f0a8c009d90 tx=0x7f0a8c00b330 comp rx=0 tx=0).stop 2023-07-25T14:36:19.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.197+0000 7f0a98833700 1 -- 172.21.15.72:0/2966819990 shutdown_connections 2023-07-25T14:36:19.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.197+0000 7f0a98833700 1 --2- 172.21.15.72:0/2966819990 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0a9406a6d0 0x7f0a940c3bd0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:19.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.197+0000 7f0a98833700 1 --2- 172.21.15.72:0/2966819990 >> v2:172.21.15.92:3300/0 conn(0x7f0a94151950 0x7f0a9406a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:19.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.197+0000 7f0a98833700 1 -- 172.21.15.72:0/2966819990 >> 172.21.15.72:0/2966819990 conn(0x7f0a940a87e0 msgr2=0x7f0a940a8bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:19.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.197+0000 7f0a98833700 1 -- 172.21.15.72:0/2966819990 shutdown_connections 2023-07-25T14:36:19.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.197+0000 7f0a98833700 1 -- 172.21.15.72:0/2966819990 wait complete. 2023-07-25T14:36:19.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.198+0000 7f0a98833700 1 Processor -- start 2023-07-25T14:36:19.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.198+0000 7f0a98833700 1 -- start start 2023-07-25T14:36:19.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.199+0000 7f0a98833700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0a9406a6d0 0x7f0a9414ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:19.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.199+0000 7f0a98833700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0a940724c0 0x7f0a941ec8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:19.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.199+0000 7f0a98833700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0a94151950 0x7f0a941ecde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:19.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.199+0000 7f0a98833700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a941ed320 con 0x7f0a9406a6d0 2023-07-25T14:36:19.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.199+0000 7f0a98833700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a941507a0 con 0x7f0a940724c0 2023-07-25T14:36:19.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.199+0000 7f0a98833700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a94156e00 con 0x7f0a94151950 2023-07-25T14:36:19.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.199+0000 7f0a9259c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0a9406a6d0 0x7f0a9414ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:19.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.199+0000 7f0a9259c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0a9406a6d0 0x7f0a9414ab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40814/0 (socket says 172.21.15.72:40814) 2023-07-25T14:36:19.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.199+0000 7f0a9259c700 1 -- 172.21.15.72:0/2993104048 learned_addr learned my addr 172.21.15.72:0/2993104048 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:19.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.199+0000 7f0a91d9b700 1 --2- 172.21.15.72:0/2993104048 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0a940724c0 0x7f0a941ec8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:19.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.199+0000 7f0a92d9d700 1 --2- 172.21.15.72:0/2993104048 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0a94151950 0x7f0a941ecde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:19.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.199+0000 7f0a9259c700 1 -- 172.21.15.72:0/2993104048 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0a94151950 msgr2=0x7f0a941ecde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:19.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.199+0000 7f0a9259c700 1 --2- 172.21.15.72:0/2993104048 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0a94151950 0x7f0a941ecde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:19.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.199+0000 7f0a9259c700 1 -- 172.21.15.72:0/2993104048 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0a940724c0 msgr2=0x7f0a941ec8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:19.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.199+0000 7f0a9259c700 1 --2- 172.21.15.72:0/2993104048 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0a940724c0 0x7f0a941ec8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:19.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.199+0000 7f0a9259c700 1 -- 172.21.15.72:0/2993104048 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a880094a0 con 0x7f0a9406a6d0 2023-07-25T14:36:19.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.199+0000 7f0a91d9b700 1 --2- 172.21.15.72:0/2993104048 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0a940724c0 0x7f0a941ec8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-25T14:36:19.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.199+0000 7f0a9259c700 1 --2- 172.21.15.72:0/2993104048 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0a9406a6d0 0x7f0a9414ab30 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f0a8800ebe0 tx=0x7f0a88009e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:19.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.199+0000 7f0a82ffd700 1 -- 172.21.15.72:0/2993104048 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a8800c8b0 con 0x7f0a9406a6d0 2023-07-25T14:36:19.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.199+0000 7f0a82ffd700 1 -- 172.21.15.72:0/2993104048 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a8800ca10 con 0x7f0a9406a6d0 2023-07-25T14:36:19.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.199+0000 7f0a98833700 1 -- 172.21.15.72:0/2993104048 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a8c009a70 con 0x7f0a9406a6d0 2023-07-25T14:36:19.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.199+0000 7f0a82ffd700 1 -- 172.21.15.72:0/2993104048 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a8800cda0 con 0x7f0a9406a6d0 2023-07-25T14:36:19.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.199+0000 7f0a98833700 1 -- 172.21.15.72:0/2993104048 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a9414e040 con 0x7f0a9406a6d0 2023-07-25T14:36:19.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.200+0000 7f0a98833700 1 -- 172.21.15.72:0/2993104048 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a94156680 con 0x7f0a9406a6d0 2023-07-25T14:36:19.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.201+0000 7f0a82ffd700 1 -- 172.21.15.72:0/2993104048 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0a88013470 con 0x7f0a9406a6d0 2023-07-25T14:36:19.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.201+0000 7f0a82ffd700 1 --2- 172.21.15.72:0/2993104048 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f0a7406ace0 0x7f0a7406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:19.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.202+0000 7f0a82ffd700 1 -- 172.21.15.72:0/2993104048 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f0a8808a010 con 0x7f0a9406a6d0 2023-07-25T14:36:19.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.202+0000 7f0a91d9b700 1 --2- 172.21.15.72:0/2993104048 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f0a7406ace0 0x7f0a7406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:19.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.202+0000 7f0a91d9b700 1 --2- 172.21.15.72:0/2993104048 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f0a7406ace0 0x7f0a7406d1a0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f0a940c4da0 tx=0x7f0a84009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:19.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.205+0000 7f0a82ffd700 1 -- 172.21.15.72:0/2993104048 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f0a88054e60 con 0x7f0a9406a6d0 2023-07-25T14:36:19.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.390+0000 7f0a98833700 1 -- 172.21.15.72:0/2993104048 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f0a9404e470 con 0x7f0a9406a6d0 2023-07-25T14:36:19.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.391+0000 7f0a82ffd700 1 -- 172.21.15.72:0/2993104048 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7f0a88058480 con 0x7f0a9406a6d0 2023-07-25T14:36:19.403 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 8 2023-07-25T14:36:19.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.393+0000 7f0a98833700 1 -- 172.21.15.72:0/2993104048 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f0a7406ace0 msgr2=0x7f0a7406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:19.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.393+0000 7f0a98833700 1 --2- 172.21.15.72:0/2993104048 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f0a7406ace0 0x7f0a7406d1a0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f0a940c4da0 tx=0x7f0a84009040 comp rx=0 tx=0).stop 2023-07-25T14:36:19.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.393+0000 7f0a98833700 1 -- 172.21.15.72:0/2993104048 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0a9406a6d0 msgr2=0x7f0a9414ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:19.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.393+0000 7f0a98833700 1 --2- 172.21.15.72:0/2993104048 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0a9406a6d0 0x7f0a9414ab30 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f0a8800ebe0 tx=0x7f0a88009e20 comp rx=0 tx=0).stop 2023-07-25T14:36:19.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.393+0000 7f0a98833700 1 -- 172.21.15.72:0/2993104048 shutdown_connections 2023-07-25T14:36:19.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.393+0000 7f0a98833700 1 --2- 172.21.15.72:0/2993104048 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f0a7406ace0 0x7f0a7406d1a0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:19.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.393+0000 7f0a98833700 1 --2- 172.21.15.72:0/2993104048 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0a94151950 0x7f0a941ecde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:19.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.393+0000 7f0a98833700 1 --2- 172.21.15.72:0/2993104048 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0a9406a6d0 0x7f0a9414ab30 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:19.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.393+0000 7f0a98833700 1 --2- 172.21.15.72:0/2993104048 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0a940724c0 0x7f0a941ec8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:19.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.393+0000 7f0a98833700 1 -- 172.21.15.72:0/2993104048 >> 172.21.15.72:0/2993104048 conn(0x7f0a940a87e0 msgr2=0x7f0a940c45e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:19.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.393+0000 7f0a98833700 1 -- 172.21.15.72:0/2993104048 shutdown_connections 2023-07-25T14:36:19.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.393+0000 7f0a98833700 1 -- 172.21.15.72:0/2993104048 wait complete. 2023-07-25T14:36:19.417 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-25T14:36:19.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.527+0000 7fd191d07700 1 Processor -- start 2023-07-25T14:36:19.540 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.527+0000 7fd191d07700 1 -- start start 2023-07-25T14:36:19.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.528+0000 7fd191d07700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd18c0a8910 0x7fd18c14f420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:19.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.528+0000 7fd191d07700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd18c14f960 0x7fd18c155c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:19.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.528+0000 7fd191d07700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd18c0c74b0 con 0x7fd18c0a5d10 2023-07-25T14:36:19.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.528+0000 7fd191d07700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd18c0c1c90 con 0x7fd18c0a8910 2023-07-25T14:36:19.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.528+0000 7fd191d07700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd18c1557e0 con 0x7fd18c14f960 2023-07-25T14:36:19.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.528+0000 7fd18b7fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd18c0a8910 0x7fd18c14f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:19.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.528+0000 7fd18b7fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd18c0a8910 0x7fd18c14f420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40822/0 (socket says 172.21.15.72:40822) 2023-07-25T14:36:19.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.528+0000 7fd18b7fe700 1 -- 172.21.15.72:0/4001270581 learned_addr learned my addr 172.21.15.72:0/4001270581 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:19.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.528+0000 7fd18affd700 1 --2- 172.21.15.72:0/4001270581 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd18c14f960 0x7fd18c155c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:19.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.528+0000 7fd18b7fe700 1 -- 172.21.15.72:0/4001270581 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd18c14f960 msgr2=0x7fd18c155c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:19.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.528+0000 7fd18b7fe700 1 --2- 172.21.15.72:0/4001270581 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd18c14f960 0x7fd18c155c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:19.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.528+0000 7fd18b7fe700 1 -- 172.21.15.72:0/4001270581 >> v1:172.21.15.92:6789/0 conn(0x7fd18c0a5d10 legacy=0x7fd18c06a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:19.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.528+0000 7fd18b7fe700 1 -- 172.21.15.72:0/4001270581 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd18c0c35b0 con 0x7fd18c0a8910 2023-07-25T14:36:19.552 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.528+0000 7fd18b7fe700 1 --2- 172.21.15.72:0/4001270581 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd18c0a8910 0x7fd18c14f420 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fd1740098f0 tx=0x7fd174009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=576b292d9b0d8feb server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:19.552 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.528+0000 7fd18a7fc700 1 -- 172.21.15.72:0/4001270581 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd174011830 con 0x7fd18c0a8910 2023-07-25T14:36:19.552 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.528+0000 7fd18a7fc700 1 -- 172.21.15.72:0/4001270581 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd174011990 con 0x7fd18c0a8910 2023-07-25T14:36:19.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.528+0000 7fd18a7fc700 1 -- 172.21.15.72:0/4001270581 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd174011d20 con 0x7fd18c0a8910 2023-07-25T14:36:19.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.529+0000 7fd191d07700 1 -- 172.21.15.72:0/4001270581 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd18c0a8910 msgr2=0x7fd18c14f420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:19.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.529+0000 7fd191d07700 1 --2- 172.21.15.72:0/4001270581 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd18c0a8910 0x7fd18c14f420 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fd1740098f0 tx=0x7fd174009c00 comp rx=0 tx=0).stop 2023-07-25T14:36:19.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.529+0000 7fd191d07700 1 -- 172.21.15.72:0/4001270581 shutdown_connections 2023-07-25T14:36:19.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.529+0000 7fd191d07700 1 --2- 172.21.15.72:0/4001270581 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd18c0a8910 0x7fd18c14f420 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:19.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.529+0000 7fd191d07700 1 --2- 172.21.15.72:0/4001270581 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd18c14f960 0x7fd18c155c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:19.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.529+0000 7fd191d07700 1 -- 172.21.15.72:0/4001270581 >> 172.21.15.72:0/4001270581 conn(0x7fd18c0714f0 msgr2=0x7fd18c071900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:19.555 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.529+0000 7fd191d07700 1 -- 172.21.15.72:0/4001270581 shutdown_connections 2023-07-25T14:36:19.555 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.529+0000 7fd191d07700 1 -- 172.21.15.72:0/4001270581 wait complete. 2023-07-25T14:36:19.555 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.530+0000 7fd191d07700 1 Processor -- start 2023-07-25T14:36:19.555 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.530+0000 7fd191d07700 1 -- start start 2023-07-25T14:36:19.555 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.531+0000 7fd191d07700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd18c0a5d10 0x7fd18c1ea410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:19.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.531+0000 7fd191d07700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd18c0a8910 0x7fd18c0a6c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:19.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.531+0000 7fd191d07700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd18c14f960 0x7fd18c1543e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:19.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.531+0000 7fd191d07700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd18c1ea950 con 0x7fd18c0a8910 2023-07-25T14:36:19.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.531+0000 7fd191d07700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd18c0a6490 con 0x7fd18c14f960 2023-07-25T14:36:19.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.531+0000 7fd191d07700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd18c0a6770 con 0x7fd18c0a5d10 2023-07-25T14:36:19.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.531+0000 7fd18affd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd18c0a8910 0x7fd18c0a6c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:19.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.531+0000 7fd18affd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd18c0a8910 0x7fd18c0a6c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40830/0 (socket says 172.21.15.72:40830) 2023-07-25T14:36:19.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.531+0000 7fd18affd700 1 -- 172.21.15.72:0/678212649 learned_addr learned my addr 172.21.15.72:0/678212649 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:19.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.531+0000 7fd18b7fe700 1 --2- 172.21.15.72:0/678212649 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd18c0a5d10 0x7fd18c1ea410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:19.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.531+0000 7fd18bfff700 1 --2- 172.21.15.72:0/678212649 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd18c14f960 0x7fd18c1543e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:19.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.531+0000 7fd18affd700 1 -- 172.21.15.72:0/678212649 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd18c0a5d10 msgr2=0x7fd18c1ea410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:19.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.531+0000 7fd18affd700 1 --2- 172.21.15.72:0/678212649 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd18c0a5d10 0x7fd18c1ea410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:19.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.531+0000 7fd18affd700 1 -- 172.21.15.72:0/678212649 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd18c14f960 msgr2=0x7fd18c1543e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:19.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.531+0000 7fd18affd700 1 --2- 172.21.15.72:0/678212649 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd18c14f960 0x7fd18c1543e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:19.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.531+0000 7fd18affd700 1 -- 172.21.15.72:0/678212649 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd174009550 con 0x7fd18c0a8910 2023-07-25T14:36:19.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.531+0000 7fd18affd700 1 --2- 172.21.15.72:0/678212649 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd18c0a8910 0x7fd18c0a6c00 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fd17c00e870 tx=0x7fd17c00eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:19.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.532+0000 7fd183fff700 1 -- 172.21.15.72:0/678212649 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd17c009590 con 0x7fd18c0a8910 2023-07-25T14:36:19.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.532+0000 7fd183fff700 1 -- 172.21.15.72:0/678212649 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd17c013680 con 0x7fd18c0a8910 2023-07-25T14:36:19.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.532+0000 7fd183fff700 1 -- 172.21.15.72:0/678212649 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd17c0139f0 con 0x7fd18c0a8910 2023-07-25T14:36:19.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.532+0000 7fd191d07700 1 -- 172.21.15.72:0/678212649 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd18c0a76d0 con 0x7fd18c0a8910 2023-07-25T14:36:19.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.532+0000 7fd191d07700 1 -- 172.21.15.72:0/678212649 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd18c0a7c70 con 0x7fd18c0a8910 2023-07-25T14:36:19.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.533+0000 7fd191d07700 1 -- 172.21.15.72:0/678212649 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd18c0a68e0 con 0x7fd18c0a8910 2023-07-25T14:36:19.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.533+0000 7fd183fff700 1 -- 172.21.15.72:0/678212649 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd17c013b50 con 0x7fd18c0a8910 2023-07-25T14:36:19.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.533+0000 7fd183fff700 1 --2- 172.21.15.72:0/678212649 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fd16c06ad10 0x7fd16c06d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:19.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.534+0000 7fd183fff700 1 -- 172.21.15.72:0/678212649 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fd17c0894e0 con 0x7fd18c0a8910 2023-07-25T14:36:19.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.534+0000 7fd18b7fe700 1 --2- 172.21.15.72:0/678212649 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fd16c06ad10 0x7fd16c06d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:19.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.534+0000 7fd18b7fe700 1 --2- 172.21.15.72:0/678212649 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fd16c06ad10 0x7fd16c06d1d0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fd174000c00 tx=0x7fd174008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:19.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.538+0000 7fd183fff700 1 -- 172.21.15.72:0/678212649 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fd17c054330 con 0x7fd18c0a8910 2023-07-25T14:36:19.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.726+0000 7fd191d07700 1 -- 172.21.15.72:0/678212649 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd18c04e470 con 0x7fd18c0a8910 2023-07-25T14:36:19.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.727+0000 7fd183fff700 1 -- 172.21.15.72:0/678212649 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd17c057950 con 0x7fd18c0a8910 2023-07-25T14:36:19.740 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 1 2023-07-25T14:36:19.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.729+0000 7fd191d07700 1 -- 172.21.15.72:0/678212649 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fd16c06ad10 msgr2=0x7fd16c06d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:19.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.729+0000 7fd191d07700 1 --2- 172.21.15.72:0/678212649 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fd16c06ad10 0x7fd16c06d1d0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fd174000c00 tx=0x7fd174008030 comp rx=0 tx=0).stop 2023-07-25T14:36:19.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.729+0000 7fd191d07700 1 -- 172.21.15.72:0/678212649 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd18c0a8910 msgr2=0x7fd18c0a6c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:19.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.729+0000 7fd191d07700 1 --2- 172.21.15.72:0/678212649 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd18c0a8910 0x7fd18c0a6c00 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fd17c00e870 tx=0x7fd17c00eb80 comp rx=0 tx=0).stop 2023-07-25T14:36:19.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.729+0000 7fd191d07700 1 -- 172.21.15.72:0/678212649 shutdown_connections 2023-07-25T14:36:19.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.729+0000 7fd191d07700 1 --2- 172.21.15.72:0/678212649 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fd16c06ad10 0x7fd16c06d1d0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:19.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.729+0000 7fd191d07700 1 --2- 172.21.15.72:0/678212649 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd18c0a5d10 0x7fd18c1ea410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:19.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.729+0000 7fd191d07700 1 --2- 172.21.15.72:0/678212649 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd18c14f960 0x7fd18c1543e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:19.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.729+0000 7fd191d07700 1 --2- 172.21.15.72:0/678212649 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd18c0a8910 0x7fd18c0a6c00 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:19.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.729+0000 7fd191d07700 1 -- 172.21.15.72:0/678212649 >> 172.21.15.72:0/678212649 conn(0x7fd18c0714f0 msgr2=0x7fd18c0c10f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:19.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.729+0000 7fd191d07700 1 -- 172.21.15.72:0/678212649 shutdown_connections 2023-07-25T14:36:19.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.729+0000 7fd191d07700 1 -- 172.21.15.72:0/678212649 wait complete. 2023-07-25T14:36:19.753 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-25T14:36:19.875 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.863+0000 7f1bad3d3700 1 Processor -- start 2023-07-25T14:36:19.876 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.863+0000 7f1bad3d3700 1 -- start start 2023-07-25T14:36:19.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.864+0000 7f1bad3d3700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f1ba814f810 0x7f1ba80c4370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:19.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.864+0000 7f1bad3d3700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1ba80a9cc0 0x7f1ba81525e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:19.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.864+0000 7f1bad3d3700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ba80c5890 con 0x7f1ba80bb0b0 2023-07-25T14:36:19.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.864+0000 7f1bad3d3700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ba8152150 con 0x7f1ba80a9cc0 2023-07-25T14:36:19.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.864+0000 7f1bad3d3700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ba814fbf0 con 0x7f1ba814f810 2023-07-25T14:36:19.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.864+0000 7f1ba67fc700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1ba80a9cc0 0x7f1ba81525e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:19.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.864+0000 7f1ba67fc700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1ba80a9cc0 0x7f1ba81525e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40836/0 (socket says 172.21.15.72:40836) 2023-07-25T14:36:19.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.864+0000 7f1ba67fc700 1 -- 172.21.15.72:0/2091286394 learned_addr learned my addr 172.21.15.72:0/2091286394 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:19.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.864+0000 7f1ba67fc700 1 -- 172.21.15.72:0/2091286394 >> v2:172.21.15.92:3300/0 conn(0x7f1ba814f810 msgr2=0x7f1ba80c4370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:19.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.864+0000 7f1ba67fc700 1 --2- 172.21.15.72:0/2091286394 >> v2:172.21.15.92:3300/0 conn(0x7f1ba814f810 0x7f1ba80c4370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:19.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.864+0000 7f1ba67fc700 1 -- 172.21.15.72:0/2091286394 >> v1:172.21.15.92:6789/0 conn(0x7f1ba80bb0b0 legacy=0x7f1ba8152b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:19.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.864+0000 7f1ba67fc700 1 -- 172.21.15.72:0/2091286394 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ba81566a0 con 0x7f1ba80a9cc0 2023-07-25T14:36:19.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.865+0000 7f1ba67fc700 1 --2- 172.21.15.72:0/2091286394 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1ba80a9cc0 0x7f1ba81525e0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f1ba80aa300 tx=0x7f1b98009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e234ca2266d6a2b server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:19.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.865+0000 7f1ba5ffb700 1 -- 172.21.15.72:0/2091286394 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b98004230 con 0x7f1ba80a9cc0 2023-07-25T14:36:19.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.865+0000 7f1ba5ffb700 1 -- 172.21.15.72:0/2091286394 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b98004390 con 0x7f1ba80a9cc0 2023-07-25T14:36:19.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.865+0000 7f1ba5ffb700 1 -- 172.21.15.72:0/2091286394 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b980036a0 con 0x7f1ba80a9cc0 2023-07-25T14:36:19.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.865+0000 7f1bad3d3700 1 -- 172.21.15.72:0/2091286394 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1ba80a9cc0 msgr2=0x7f1ba81525e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:19.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.865+0000 7f1bad3d3700 1 --2- 172.21.15.72:0/2091286394 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1ba80a9cc0 0x7f1ba81525e0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f1ba80aa300 tx=0x7f1b98009bd0 comp rx=0 tx=0).stop 2023-07-25T14:36:19.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.865+0000 7f1bad3d3700 1 -- 172.21.15.72:0/2091286394 shutdown_connections 2023-07-25T14:36:19.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.865+0000 7f1bad3d3700 1 --2- 172.21.15.72:0/2091286394 >> v2:172.21.15.92:3300/0 conn(0x7f1ba814f810 0x7f1ba80c4370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:19.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.865+0000 7f1bad3d3700 1 --2- 172.21.15.72:0/2091286394 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1ba80a9cc0 0x7f1ba81525e0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:19.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.865+0000 7f1bad3d3700 1 -- 172.21.15.72:0/2091286394 >> 172.21.15.72:0/2091286394 conn(0x7f1ba806a8d0 msgr2=0x7f1ba80a94e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:19.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.865+0000 7f1bad3d3700 1 -- 172.21.15.72:0/2091286394 shutdown_connections 2023-07-25T14:36:19.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.865+0000 7f1bad3d3700 1 -- 172.21.15.72:0/2091286394 wait complete. 2023-07-25T14:36:19.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.867+0000 7f1bad3d3700 1 Processor -- start 2023-07-25T14:36:19.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.867+0000 7f1bad3d3700 1 -- start start 2023-07-25T14:36:19.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.867+0000 7f1bad3d3700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1ba80a9cc0 0x7f1ba806cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:19.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.867+0000 7f1bad3d3700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1ba80bb0b0 0x7f1ba80a6b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:19.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.867+0000 7f1bad3d3700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1ba814f810 0x7f1ba81dcaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:19.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.867+0000 7f1bad3d3700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ba806b2a0 con 0x7f1ba814f810 2023-07-25T14:36:19.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.867+0000 7f1bad3d3700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ba81491d0 con 0x7f1ba80a9cc0 2023-07-25T14:36:19.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.867+0000 7f1bad3d3700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ba81db790 con 0x7f1ba80bb0b0 2023-07-25T14:36:19.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.867+0000 7f1ba77fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1ba814f810 0x7f1ba81dcaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:19.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.867+0000 7f1ba77fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1ba814f810 0x7f1ba81dcaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40844/0 (socket says 172.21.15.72:40844) 2023-07-25T14:36:19.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.867+0000 7f1ba77fe700 1 -- 172.21.15.72:0/443196331 learned_addr learned my addr 172.21.15.72:0/443196331 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:19.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.867+0000 7f1ba6ffd700 1 --2- 172.21.15.72:0/443196331 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1ba80a9cc0 0x7f1ba806cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:19.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.867+0000 7f1ba67fc700 1 --2- 172.21.15.72:0/443196331 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1ba80bb0b0 0x7f1ba80a6b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:19.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.868+0000 7f1ba77fe700 1 -- 172.21.15.72:0/443196331 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1ba80bb0b0 msgr2=0x7f1ba80a6b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:19.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.868+0000 7f1ba77fe700 1 --2- 172.21.15.72:0/443196331 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1ba80bb0b0 0x7f1ba80a6b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:19.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.868+0000 7f1ba77fe700 1 -- 172.21.15.72:0/443196331 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1ba80a9cc0 msgr2=0x7f1ba806cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:19.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.868+0000 7f1ba77fe700 1 --2- 172.21.15.72:0/443196331 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1ba80a9cc0 0x7f1ba806cf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:19.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.868+0000 7f1ba77fe700 1 -- 172.21.15.72:0/443196331 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b98009550 con 0x7f1ba814f810 2023-07-25T14:36:19.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.868+0000 7f1ba77fe700 1 --2- 172.21.15.72:0/443196331 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1ba814f810 0x7f1ba81dcaa0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f1ba000cbc0 tx=0x7f1ba000ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:19.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.868+0000 7f1b8f7fe700 1 -- 172.21.15.72:0/443196331 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ba0003e60 con 0x7f1ba814f810 2023-07-25T14:36:19.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.868+0000 7f1b8f7fe700 1 -- 172.21.15.72:0/443196331 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ba000a650 con 0x7f1ba814f810 2023-07-25T14:36:19.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.868+0000 7f1bad3d3700 1 -- 172.21.15.72:0/443196331 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ba81ea4c0 con 0x7f1ba814f810 2023-07-25T14:36:19.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.868+0000 7f1b8f7fe700 1 -- 172.21.15.72:0/443196331 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ba000a9e0 con 0x7f1ba814f810 2023-07-25T14:36:19.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.868+0000 7f1bad3d3700 1 -- 172.21.15.72:0/443196331 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ba81eaa80 con 0x7f1ba814f810 2023-07-25T14:36:19.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.869+0000 7f1bad3d3700 1 -- 172.21.15.72:0/443196331 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ba81db920 con 0x7f1ba814f810 2023-07-25T14:36:19.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.869+0000 7f1b8f7fe700 1 -- 172.21.15.72:0/443196331 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1ba000ab40 con 0x7f1ba814f810 2023-07-25T14:36:19.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.870+0000 7f1b8f7fe700 1 --2- 172.21.15.72:0/443196331 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f1b9406ace0 0x7f1b9406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:19.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.870+0000 7f1b8f7fe700 1 -- 172.21.15.72:0/443196331 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f1ba0089090 con 0x7f1ba814f810 2023-07-25T14:36:19.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.870+0000 7f1ba6ffd700 1 --2- 172.21.15.72:0/443196331 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f1b9406ace0 0x7f1b9406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:19.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.870+0000 7f1ba6ffd700 1 --2- 172.21.15.72:0/443196331 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f1b9406ace0 0x7f1b9406d1a0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f1b9c009a10 tx=0x7f1b9c009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:19.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:19.874+0000 7f1b8f7fe700 1 -- 172.21.15.72:0/443196331 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f1ba0053ee0 con 0x7f1ba814f810 2023-07-25T14:36:20.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.060+0000 7f1bad3d3700 1 -- 172.21.15.72:0/443196331 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1ba8151a70 con 0x7f1ba814f810 2023-07-25T14:36:20.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.060+0000 7f1b8f7fe700 1 -- 172.21.15.72:0/443196331 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1ba0057500 con 0x7f1ba814f810 2023-07-25T14:36:20.073 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2023-07-25T14:36:20.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.062+0000 7f1bad3d3700 1 -- 172.21.15.72:0/443196331 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f1b9406ace0 msgr2=0x7f1b9406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:20.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.062+0000 7f1bad3d3700 1 --2- 172.21.15.72:0/443196331 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f1b9406ace0 0x7f1b9406d1a0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f1b9c009a10 tx=0x7f1b9c009190 comp rx=0 tx=0).stop 2023-07-25T14:36:20.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.062+0000 7f1bad3d3700 1 -- 172.21.15.72:0/443196331 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1ba814f810 msgr2=0x7f1ba81dcaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:20.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.062+0000 7f1bad3d3700 1 --2- 172.21.15.72:0/443196331 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1ba814f810 0x7f1ba81dcaa0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f1ba000cbc0 tx=0x7f1ba000ced0 comp rx=0 tx=0).stop 2023-07-25T14:36:20.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.063+0000 7f1bad3d3700 1 -- 172.21.15.72:0/443196331 shutdown_connections 2023-07-25T14:36:20.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.063+0000 7f1bad3d3700 1 --2- 172.21.15.72:0/443196331 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f1b9406ace0 0x7f1b9406d1a0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:20.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.063+0000 7f1bad3d3700 1 --2- 172.21.15.72:0/443196331 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1ba814f810 0x7f1ba81dcaa0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:20.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.063+0000 7f1bad3d3700 1 --2- 172.21.15.72:0/443196331 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1ba80a9cc0 0x7f1ba806cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:20.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.063+0000 7f1bad3d3700 1 --2- 172.21.15.72:0/443196331 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1ba80bb0b0 0x7f1ba80a6b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:20.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.063+0000 7f1bad3d3700 1 -- 172.21.15.72:0/443196331 >> 172.21.15.72:0/443196331 conn(0x7f1ba806a8d0 msgr2=0x7f1ba80c5d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:20.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.063+0000 7f1bad3d3700 1 -- 172.21.15.72:0/443196331 shutdown_connections 2023-07-25T14:36:20.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.063+0000 7f1bad3d3700 1 -- 172.21.15.72:0/443196331 wait complete. 2023-07-25T14:36:20.087 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-25T14:36:20.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.197+0000 7f67f7597700 1 Processor -- start 2023-07-25T14:36:20.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.197+0000 7f67f7597700 1 -- start start 2023-07-25T14:36:20.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.198+0000 7f67f7597700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f67f0154320 0x7f67f006a570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:20.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.198+0000 7f67f7597700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67f0157910 con 0x7f67f006a190 2023-07-25T14:36:20.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.198+0000 7f67f7597700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67f0157bf0 con 0x7f67f015cc90 2023-07-25T14:36:20.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.198+0000 7f67f7597700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67f01547a0 con 0x7f67f0154320 2023-07-25T14:36:20.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.198+0000 7f67f5333700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f67f006a190 0x7f67f0158080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:59816/0 (socket says 172.21.15.72:59816) 2023-07-25T14:36:20.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.198+0000 7f67f5333700 1 -- 172.21.15.72:0/2180647240 learned_addr learned my addr 172.21.15.72:0/2180647240 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:36:20.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.198+0000 7f67e7fff700 1 -- 172.21.15.72:0/2180647240 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3428407000 0 0) 0x7f67f0157910 con 0x7f67f006a190 2023-07-25T14:36:20.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.198+0000 7f67f4b32700 1 --2- 172.21.15.72:0/2180647240 >> v2:172.21.15.92:3300/0 conn(0x7f67f0154320 0x7f67f006a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:20.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.198+0000 7f67e7fff700 1 -- 172.21.15.72:0/2180647240 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f67dc0035b0 con 0x7f67f006a190 2023-07-25T14:36:20.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.199+0000 7f67e7fff700 1 -- 172.21.15.72:0/2180647240 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 781847988 0 0) 0x7f67dc0035b0 con 0x7f67f006a190 2023-07-25T14:36:20.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.199+0000 7f67e7fff700 1 -- 172.21.15.72:0/2180647240 >> v2:172.21.15.92:3300/0 conn(0x7f67f0154320 msgr2=0x7f67f006a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:20.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.199+0000 7f67e7fff700 1 --2- 172.21.15.72:0/2180647240 >> v2:172.21.15.92:3300/0 conn(0x7f67f0154320 0x7f67f006a570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:20.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.199+0000 7f67e7fff700 1 -- 172.21.15.72:0/2180647240 >> v1:172.21.15.92:6789/0 conn(0x7f67f015cc90 legacy=0x7f67f015f080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:20.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.199+0000 7f67e7fff700 1 -- 172.21.15.72:0/2180647240 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67f0158790 con 0x7f67f006a190 2023-07-25T14:36:20.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.199+0000 7f67e7fff700 1 -- 172.21.15.72:0/2180647240 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2559588315 0 0) 0x7f67e0001670 con 0x7f67f006a190 2023-07-25T14:36:20.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.199+0000 7f67e7fff700 1 -- 172.21.15.72:0/2180647240 >> v1:172.21.15.72:6789/0 conn(0x7f67f006a190 legacy=0x7f67f0158080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:20.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.199+0000 7f67e7fff700 1 --2- 172.21.15.72:0/2180647240 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f67dc003a00 0x7f67dc003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:20.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.199+0000 7f67e7fff700 1 --2- 172.21.15.72:0/2180647240 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f67dc004850 0x7f67dc004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:20.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.199+0000 7f67e7fff700 1 --2- 172.21.15.72:0/2180647240 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f67dc005210 0x7f67dc00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:20.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.199+0000 7f67e7fff700 1 -- 172.21.15.72:0/2180647240 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67f01547a0 con 0x7f67dc005210 2023-07-25T14:36:20.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.199+0000 7f67e7fff700 1 -- 172.21.15.72:0/2180647240 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67dc00c160 con 0x7f67dc004850 2023-07-25T14:36:20.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.199+0000 7f67e7fff700 1 -- 172.21.15.72:0/2180647240 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67dc00c320 con 0x7f67dc003a00 2023-07-25T14:36:20.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.199+0000 7f67f5b34700 1 --2- 172.21.15.72:0/2180647240 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f67dc005210 0x7f67dc00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:20.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.199+0000 7f67f5333700 1 --2- 172.21.15.72:0/2180647240 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f67dc003a00 0x7f67dc003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:20.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.199+0000 7f67f4b32700 1 --2- 172.21.15.72:0/2180647240 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f67dc004850 0x7f67dc004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:20.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.199+0000 7f67f5b34700 1 -- 172.21.15.72:0/2180647240 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f67dc003a00 msgr2=0x7f67dc003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:20.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.199+0000 7f67f5b34700 1 --2- 172.21.15.72:0/2180647240 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f67dc003a00 0x7f67dc003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:20.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.199+0000 7f67f5b34700 1 -- 172.21.15.72:0/2180647240 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f67dc004850 msgr2=0x7f67dc004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:20.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.199+0000 7f67f5b34700 1 --2- 172.21.15.72:0/2180647240 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f67dc004850 0x7f67dc004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:20.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.199+0000 7f67f5b34700 1 -- 172.21.15.72:0/2180647240 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67dc0035b0 con 0x7f67dc005210 2023-07-25T14:36:20.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.199+0000 7f67f5b34700 1 -- 172.21.15.72:0/2180647240 reap_dead start 2023-07-25T14:36:20.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.199+0000 7f67f5b34700 1 --2- 172.21.15.72:0/2180647240 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f67dc005210 0x7f67dc00ba10 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f67f006b180 tx=0x7f67dc005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f1c8606d6d61da7 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:20.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.199+0000 7f67e7fff700 1 -- 172.21.15.72:0/2180647240 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67e8016070 con 0x7f67dc005210 2023-07-25T14:36:20.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.199+0000 7f67e7fff700 1 -- 172.21.15.72:0/2180647240 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67e800cb70 con 0x7f67dc005210 2023-07-25T14:36:20.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.199+0000 7f67e7fff700 1 -- 172.21.15.72:0/2180647240 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67e8001e60 con 0x7f67dc005210 2023-07-25T14:36:20.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.200+0000 7f67f7597700 1 -- 172.21.15.72:0/2180647240 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f67dc005210 msgr2=0x7f67dc00ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:20.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.200+0000 7f67f7597700 1 --2- 172.21.15.72:0/2180647240 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f67dc005210 0x7f67dc00ba10 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f67f006b180 tx=0x7f67dc005880 comp rx=0 tx=0).stop 2023-07-25T14:36:20.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.200+0000 7f67f7597700 1 -- 172.21.15.72:0/2180647240 shutdown_connections 2023-07-25T14:36:20.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.200+0000 7f67f7597700 1 --2- 172.21.15.72:0/2180647240 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f67dc005210 0x7f67dc00ba10 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:20.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.200+0000 7f67f7597700 1 -- 172.21.15.72:0/2180647240 >> 172.21.15.72:0/2180647240 conn(0x7f67f0066460 msgr2=0x7f67f006b2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:20.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.200+0000 7f67f7597700 1 -- 172.21.15.72:0/2180647240 shutdown_connections 2023-07-25T14:36:20.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.200+0000 7f67f7597700 1 -- 172.21.15.72:0/2180647240 wait complete. 2023-07-25T14:36:20.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.201+0000 7f67f7597700 1 Processor -- start 2023-07-25T14:36:20.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.201+0000 7f67f7597700 1 -- start start 2023-07-25T14:36:20.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.202+0000 7f67f7597700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f67dc005210 0x7f67f0145180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:20.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.202+0000 7f67f7597700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f67f015a800 0x7f67f0156ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:20.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.202+0000 7f67f7597700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f67f015ac80 0x7f67f0157220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:20.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.202+0000 7f67f7597700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67f0156850 con 0x7f67dc005210 2023-07-25T14:36:20.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.202+0000 7f67f7597700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67f00ab6e0 con 0x7f67f015ac80 2023-07-25T14:36:20.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.202+0000 7f67f7597700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67f015b5d0 con 0x7f67f015a800 2023-07-25T14:36:20.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.202+0000 7f67f5333700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f67dc005210 0x7f67f0145180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:20.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.202+0000 7f67f5333700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f67dc005210 0x7f67f0145180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40860/0 (socket says 172.21.15.72:40860) 2023-07-25T14:36:20.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.202+0000 7f67f5333700 1 -- 172.21.15.72:0/4219444467 learned_addr learned my addr 172.21.15.72:0/4219444467 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:20.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.202+0000 7f67f4b32700 1 --2- 172.21.15.72:0/4219444467 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f67f015a800 0x7f67f0156ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:20.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.202+0000 7f67f5b34700 1 --2- 172.21.15.72:0/4219444467 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f67f015ac80 0x7f67f0157220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:20.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.202+0000 7f67f5333700 1 -- 172.21.15.72:0/4219444467 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f67f015a800 msgr2=0x7f67f0156ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:20.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.202+0000 7f67f5333700 1 --2- 172.21.15.72:0/4219444467 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f67f015a800 0x7f67f0156ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:20.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.202+0000 7f67f5333700 1 -- 172.21.15.72:0/4219444467 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f67f015ac80 msgr2=0x7f67f0157220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:20.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.202+0000 7f67f5333700 1 --2- 172.21.15.72:0/4219444467 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f67f015ac80 0x7f67f0157220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:20.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.202+0000 7f67f5333700 1 -- 172.21.15.72:0/4219444467 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67f0156200 con 0x7f67dc005210 2023-07-25T14:36:20.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.202+0000 7f67f4b32700 1 --2- 172.21.15.72:0/4219444467 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f67f015a800 0x7f67f0156ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-25T14:36:20.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.202+0000 7f67f5333700 1 --2- 172.21.15.72:0/4219444467 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f67dc005210 0x7f67f0145180 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f67e00072c0 tx=0x7f67e00075d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:20.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.202+0000 7f67e5ffb700 1 -- 172.21.15.72:0/4219444467 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67e000f6c0 con 0x7f67dc005210 2023-07-25T14:36:20.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.202+0000 7f67e5ffb700 1 -- 172.21.15.72:0/4219444467 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67e000f860 con 0x7f67dc005210 2023-07-25T14:36:20.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.202+0000 7f67f7597700 1 -- 172.21.15.72:0/4219444467 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67f01564e0 con 0x7f67dc005210 2023-07-25T14:36:20.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.202+0000 7f67e5ffb700 1 -- 172.21.15.72:0/4219444467 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67e000fc10 con 0x7f67dc005210 2023-07-25T14:36:20.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.203+0000 7f67f7597700 1 -- 172.21.15.72:0/4219444467 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67f015b8b0 con 0x7f67dc005210 2023-07-25T14:36:20.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.204+0000 7f67f7597700 1 -- 172.21.15.72:0/4219444467 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67f00abc20 con 0x7f67dc005210 2023-07-25T14:36:20.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.204+0000 7f67e5ffb700 1 -- 172.21.15.72:0/4219444467 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f67e000fd70 con 0x7f67dc005210 2023-07-25T14:36:20.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.204+0000 7f67e5ffb700 1 --2- 172.21.15.72:0/4219444467 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f67d406ace0 0x7f67d406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:20.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.204+0000 7f67e5ffb700 1 -- 172.21.15.72:0/4219444467 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f67e0089620 con 0x7f67dc005210 2023-07-25T14:36:20.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.204+0000 7f67f4b32700 1 --2- 172.21.15.72:0/4219444467 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f67d406ace0 0x7f67d406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:20.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.205+0000 7f67f4b32700 1 --2- 172.21.15.72:0/4219444467 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f67d406ace0 0x7f67d406d1a0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f67f0155e00 tx=0x7f67ec008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:20.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.208+0000 7f67e5ffb700 1 -- 172.21.15.72:0/4219444467 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f67e0054520 con 0x7f67dc005210 2023-07-25T14:36:20.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.394+0000 7f67f7597700 1 -- 172.21.15.72:0/4219444467 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f67f004e470 con 0x7f67dc005210 2023-07-25T14:36:20.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.394+0000 7f67e5ffb700 1 -- 172.21.15.72:0/4219444467 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7f67e0057b40 con 0x7f67dc005210 2023-07-25T14:36:20.407 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 64 2023-07-25T14:36:20.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.396+0000 7f67f7597700 1 -- 172.21.15.72:0/4219444467 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f67d406ace0 msgr2=0x7f67d406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:20.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.396+0000 7f67f7597700 1 --2- 172.21.15.72:0/4219444467 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f67d406ace0 0x7f67d406d1a0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f67f0155e00 tx=0x7f67ec008040 comp rx=0 tx=0).stop 2023-07-25T14:36:20.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.396+0000 7f67f7597700 1 -- 172.21.15.72:0/4219444467 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f67dc005210 msgr2=0x7f67f0145180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:20.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.396+0000 7f67f7597700 1 --2- 172.21.15.72:0/4219444467 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f67dc005210 0x7f67f0145180 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f67e00072c0 tx=0x7f67e00075d0 comp rx=0 tx=0).stop 2023-07-25T14:36:20.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.396+0000 7f67f7597700 1 -- 172.21.15.72:0/4219444467 shutdown_connections 2023-07-25T14:36:20.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.396+0000 7f67f7597700 1 --2- 172.21.15.72:0/4219444467 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f67d406ace0 0x7f67d406d1a0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:20.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.396+0000 7f67f7597700 1 --2- 172.21.15.72:0/4219444467 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f67f015ac80 0x7f67f0157220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:20.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.396+0000 7f67f7597700 1 --2- 172.21.15.72:0/4219444467 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f67dc005210 0x7f67f0145180 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:20.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.396+0000 7f67f7597700 1 --2- 172.21.15.72:0/4219444467 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f67f015a800 0x7f67f0156ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:20.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.396+0000 7f67f7597700 1 -- 172.21.15.72:0/4219444467 >> 172.21.15.72:0/4219444467 conn(0x7f67f0066460 msgr2=0x7f67f006b2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:20.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.396+0000 7f67f7597700 1 -- 172.21.15.72:0/4219444467 shutdown_connections 2023-07-25T14:36:20.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.396+0000 7f67f7597700 1 -- 172.21.15.72:0/4219444467 wait complete. 2023-07-25T14:36:20.420 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-07-25T14:36:20.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.532+0000 7f76b49bb700 1 Processor -- start 2023-07-25T14:36:20.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.532+0000 7f76b49bb700 1 -- start start 2023-07-25T14:36:20.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.533+0000 7f76b49bb700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f76b014f810 0x7f76b00c4370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:20.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.533+0000 7f76b49bb700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f76b00a9cc0 0x7f76b01525e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:20.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.533+0000 7f76b49bb700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76b00c5890 con 0x7f76b00bb0b0 2023-07-25T14:36:20.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.533+0000 7f76b49bb700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76b0152150 con 0x7f76b014f810 2023-07-25T14:36:20.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.533+0000 7f76b49bb700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76b014fbf0 con 0x7f76b00a9cc0 2023-07-25T14:36:20.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.533+0000 7f76ae59c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f76b014f810 0x7f76b00c4370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:20.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.533+0000 7f76aed9d700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f76b00bb0b0 0x7f76b0152b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:59838/0 (socket says 172.21.15.72:59838) 2023-07-25T14:36:20.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.533+0000 7f76ae59c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f76b014f810 0x7f76b00c4370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40868/0 (socket says 172.21.15.72:40868) 2023-07-25T14:36:20.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.533+0000 7f76aed9d700 1 -- 172.21.15.72:0/616264995 learned_addr learned my addr 172.21.15.72:0/616264995 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:36:20.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.534+0000 7f76add9b700 1 --2- 172.21.15.72:0/616264995 >> v2:172.21.15.92:3300/0 conn(0x7f76b00a9cc0 0x7f76b01525e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:20.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.534+0000 7f76ae59c700 1 -- 172.21.15.72:0/616264995 >> v2:172.21.15.92:3300/0 conn(0x7f76b00a9cc0 msgr2=0x7f76b01525e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:20.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.534+0000 7f76ae59c700 1 --2- 172.21.15.72:0/616264995 >> v2:172.21.15.92:3300/0 conn(0x7f76b00a9cc0 0x7f76b01525e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:20.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.534+0000 7f76ae59c700 1 -- 172.21.15.72:0/616264995 >> v1:172.21.15.72:6789/0 conn(0x7f76b00bb0b0 legacy=0x7f76b0152b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:20.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.534+0000 7f76ae59c700 1 -- 172.21.15.72:0/616264995 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76b01566a0 con 0x7f76b014f810 2023-07-25T14:36:20.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.534+0000 7f76ad59a700 1 -- 172.21.15.72:0/616264995 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 917827569 0 0) 0x7f76b00c5890 con 0x7f76b00bb0b0 2023-07-25T14:36:20.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.534+0000 7f76add9b700 1 --2- 172.21.15.72:0/616264995 >> v2:172.21.15.92:3300/0 conn(0x7f76b00a9cc0 0x7f76b01525e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-25T14:36:20.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.534+0000 7f76ae59c700 1 --2- 172.21.15.72:0/616264995 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f76b014f810 0x7f76b00c4370 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f76b00c1f90 tx=0x7f76a4009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45fc42d0511d0e82 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:20.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.534+0000 7f76ad59a700 1 -- 172.21.15.72:0/616264995 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76a4011830 con 0x7f76b014f810 2023-07-25T14:36:20.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.534+0000 7f76ad59a700 1 -- 172.21.15.72:0/616264995 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76a4011990 con 0x7f76b014f810 2023-07-25T14:36:20.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.534+0000 7f76ad59a700 1 -- 172.21.15.72:0/616264995 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76a4011d20 con 0x7f76b014f810 2023-07-25T14:36:20.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.534+0000 7f76b49bb700 1 -- 172.21.15.72:0/616264995 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f76b014f810 msgr2=0x7f76b00c4370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:20.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.534+0000 7f76b49bb700 1 --2- 172.21.15.72:0/616264995 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f76b014f810 0x7f76b00c4370 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f76b00c1f90 tx=0x7f76a4009b20 comp rx=0 tx=0).stop 2023-07-25T14:36:20.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.535+0000 7f76b49bb700 1 -- 172.21.15.72:0/616264995 shutdown_connections 2023-07-25T14:36:20.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.535+0000 7f76b49bb700 1 --2- 172.21.15.72:0/616264995 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f76b014f810 0x7f76b00c4370 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:20.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.535+0000 7f76b49bb700 1 --2- 172.21.15.72:0/616264995 >> v2:172.21.15.92:3300/0 conn(0x7f76b00a9cc0 0x7f76b01525e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:20.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.535+0000 7f76b49bb700 1 -- 172.21.15.72:0/616264995 >> 172.21.15.72:0/616264995 conn(0x7f76b006a8d0 msgr2=0x7f76b00a94e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:20.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.535+0000 7f76b49bb700 1 -- 172.21.15.72:0/616264995 shutdown_connections 2023-07-25T14:36:20.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.535+0000 7f76b49bb700 1 -- 172.21.15.72:0/616264995 wait complete. 2023-07-25T14:36:20.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.536+0000 7f76b49bb700 1 Processor -- start 2023-07-25T14:36:20.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.536+0000 7f76b49bb700 1 -- start start 2023-07-25T14:36:20.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.537+0000 7f76b49bb700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f76b00a9cc0 0x7f76b00c0b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:20.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.537+0000 7f76b49bb700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f76b00bb0b0 0x7f76b01e8230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:20.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.537+0000 7f76b49bb700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f76b014f810 0x7f76b01eb550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:20.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.537+0000 7f76b49bb700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76b01e8770 con 0x7f76b00a9cc0 2023-07-25T14:36:20.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.537+0000 7f76b49bb700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76b01eadc0 con 0x7f76b014f810 2023-07-25T14:36:20.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.537+0000 7f76b49bb700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76b00ace70 con 0x7f76b00bb0b0 2023-07-25T14:36:20.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.537+0000 7f76ae59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f76b00a9cc0 0x7f76b00c0b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:20.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.537+0000 7f76ae59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f76b00a9cc0 0x7f76b00c0b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40872/0 (socket says 172.21.15.72:40872) 2023-07-25T14:36:20.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.537+0000 7f76ae59c700 1 -- 172.21.15.72:0/3657961059 learned_addr learned my addr 172.21.15.72:0/3657961059 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:20.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.537+0000 7f76aed9d700 1 --2- 172.21.15.72:0/3657961059 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f76b014f810 0x7f76b01eb550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:20.555 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.537+0000 7f76add9b700 1 --2- 172.21.15.72:0/3657961059 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f76b00bb0b0 0x7f76b01e8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:20.555 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.538+0000 7f76ae59c700 1 -- 172.21.15.72:0/3657961059 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f76b00bb0b0 msgr2=0x7f76b01e8230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:20.555 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.538+0000 7f76ae59c700 1 --2- 172.21.15.72:0/3657961059 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f76b00bb0b0 0x7f76b01e8230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:20.555 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.538+0000 7f76ae59c700 1 -- 172.21.15.72:0/3657961059 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f76b014f810 msgr2=0x7f76b01eb550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:20.555 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.538+0000 7f76ae59c700 1 --2- 172.21.15.72:0/3657961059 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f76b014f810 0x7f76b01eb550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:20.555 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.538+0000 7f76ae59c700 1 -- 172.21.15.72:0/3657961059 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76a40094a0 con 0x7f76b00a9cc0 2023-07-25T14:36:20.555 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.538+0000 7f76add9b700 1 --2- 172.21.15.72:0/3657961059 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f76b00bb0b0 0x7f76b01e8230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-25T14:36:20.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.538+0000 7f76aed9d700 1 --2- 172.21.15.72:0/3657961059 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f76b014f810 0x7f76b01eb550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-25T14:36:20.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.538+0000 7f76ae59c700 1 --2- 172.21.15.72:0/3657961059 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f76b00a9cc0 0x7f76b00c0b70 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f76a40090b0 tx=0x7f76a4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:20.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.538+0000 7f769effd700 1 -- 172.21.15.72:0/3657961059 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76a40038a0 con 0x7f76b00a9cc0 2023-07-25T14:36:20.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.538+0000 7f769effd700 1 -- 172.21.15.72:0/3657961059 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76a401f070 con 0x7f76b00a9cc0 2023-07-25T14:36:20.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.538+0000 7f76b49bb700 1 -- 172.21.15.72:0/3657961059 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76b00ad150 con 0x7f76b00a9cc0 2023-07-25T14:36:20.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.538+0000 7f769effd700 1 -- 172.21.15.72:0/3657961059 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76a4003c20 con 0x7f76b00a9cc0 2023-07-25T14:36:20.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.538+0000 7f76b49bb700 1 -- 172.21.15.72:0/3657961059 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76b00ad430 con 0x7f76b00a9cc0 2023-07-25T14:36:20.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.539+0000 7f76b49bb700 1 -- 172.21.15.72:0/3657961059 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76b01eb270 con 0x7f76b00a9cc0 2023-07-25T14:36:20.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.539+0000 7f769effd700 1 -- 172.21.15.72:0/3657961059 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f76a401a430 con 0x7f76b00a9cc0 2023-07-25T14:36:20.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.539+0000 7f769effd700 1 --2- 172.21.15.72:0/3657961059 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f769006ace0 0x7f769006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:20.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.540+0000 7f769effd700 1 -- 172.21.15.72:0/3657961059 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f76a4021070 con 0x7f76b00a9cc0 2023-07-25T14:36:20.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.540+0000 7f76add9b700 1 --2- 172.21.15.72:0/3657961059 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f769006ace0 0x7f769006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:20.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.540+0000 7f76add9b700 1 --2- 172.21.15.72:0/3657961059 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f769006ace0 0x7f769006d1a0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f76b0151ff0 tx=0x7f76a0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:20.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.544+0000 7f769effd700 1 -- 172.21.15.72:0/3657961059 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f76a4055f30 con 0x7f76b00a9cc0 2023-07-25T14:36:20.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.737+0000 7f76b49bb700 1 -- 172.21.15.72:0/3657961059 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f76b00c1c40 con 0x7f76b00a9cc0 2023-07-25T14:36:20.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.737+0000 7f769effd700 1 -- 172.21.15.72:0/3657961059 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+11 (secure 0 0 0) 0x7f76a4059550 con 0x7f76b00a9cc0 2023-07-25T14:36:20.750 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2023-07-25T14:36:20.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.739+0000 7f76b49bb700 1 -- 172.21.15.72:0/3657961059 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f769006ace0 msgr2=0x7f769006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:20.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.739+0000 7f76b49bb700 1 --2- 172.21.15.72:0/3657961059 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f769006ace0 0x7f769006d1a0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f76b0151ff0 tx=0x7f76a0008040 comp rx=0 tx=0).stop 2023-07-25T14:36:20.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.739+0000 7f76b49bb700 1 -- 172.21.15.72:0/3657961059 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f76b00a9cc0 msgr2=0x7f76b00c0b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:20.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.739+0000 7f76b49bb700 1 --2- 172.21.15.72:0/3657961059 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f76b00a9cc0 0x7f76b00c0b70 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f76a40090b0 tx=0x7f76a4004750 comp rx=0 tx=0).stop 2023-07-25T14:36:20.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.739+0000 7f76b49bb700 1 -- 172.21.15.72:0/3657961059 shutdown_connections 2023-07-25T14:36:20.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.739+0000 7f76b49bb700 1 --2- 172.21.15.72:0/3657961059 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f769006ace0 0x7f769006d1a0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:20.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.739+0000 7f76b49bb700 1 --2- 172.21.15.72:0/3657961059 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f76b014f810 0x7f76b01eb550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:20.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.739+0000 7f76b49bb700 1 --2- 172.21.15.72:0/3657961059 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f76b00a9cc0 0x7f76b00c0b70 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:20.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.739+0000 7f76b49bb700 1 --2- 172.21.15.72:0/3657961059 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f76b00bb0b0 0x7f76b01e8230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:20.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.739+0000 7f76b49bb700 1 -- 172.21.15.72:0/3657961059 >> 172.21.15.72:0/3657961059 conn(0x7f76b006a8d0 msgr2=0x7f76b01525e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:20.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.739+0000 7f76b49bb700 1 -- 172.21.15.72:0/3657961059 shutdown_connections 2023-07-25T14:36:20.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.739+0000 7f76b49bb700 1 -- 172.21.15.72:0/3657961059 wait complete. 2023-07-25T14:36:20.764 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-25T14:36:20.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.872+0000 7fd1659c8700 1 Processor -- start 2023-07-25T14:36:20.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.872+0000 7fd1659c8700 1 -- start start 2023-07-25T14:36:20.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.872+0000 7fd1659c8700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd1601518c0 0x7fd16006b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:20.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.872+0000 7fd1659c8700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd1600c4370 0x7fd1600c47e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:20.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.873+0000 7fd1659c8700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd160157cd0 con 0x7fd160154df0 2023-07-25T14:36:20.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.873+0000 7fd1659c8700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1600c2310 con 0x7fd1601518c0 2023-07-25T14:36:20.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.873+0000 7fd1659c8700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd160158870 con 0x7fd1600c4370 2023-07-25T14:36:20.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.873+0000 7fd15effd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd1601518c0 0x7fd16006b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:20.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.873+0000 7fd15e7fc700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fd160154df0 0x7fd160158160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:59848/0 (socket says 172.21.15.72:59848) 2023-07-25T14:36:20.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.873+0000 7fd15e7fc700 1 -- 172.21.15.72:0/1104023855 learned_addr learned my addr 172.21.15.72:0/1104023855 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:36:20.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.873+0000 7fd15effd700 1 --2- 172.21.15.72:0/1104023855 >> v2:172.21.15.72:3300/0 conn(0x7fd1601518c0 0x7fd16006b2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40880/0 (socket says 172.21.15.72:40880) 2023-07-25T14:36:20.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.873+0000 7fd15f7fe700 1 --2- 172.21.15.72:0/1104023855 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd1600c4370 0x7fd1600c47e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:20.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.873+0000 7fd15effd700 1 -- 172.21.15.72:0/1104023855 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd1600c4370 msgr2=0x7fd1600c47e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:20.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.873+0000 7fd15effd700 1 --2- 172.21.15.72:0/1104023855 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd1600c4370 0x7fd1600c47e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:20.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.873+0000 7fd15effd700 1 -- 172.21.15.72:0/1104023855 >> v1:172.21.15.72:6789/0 conn(0x7fd160154df0 legacy=0x7fd160158160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:20.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.873+0000 7fd15dffb700 1 -- 172.21.15.72:0/1104023855 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 677185413 0 0) 0x7fd160157cd0 con 0x7fd160154df0 2023-07-25T14:36:20.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.873+0000 7fd15effd700 1 -- 172.21.15.72:0/1104023855 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd160155280 con 0x7fd1601518c0 2023-07-25T14:36:20.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.873+0000 7fd15f7fe700 1 --2- 172.21.15.72:0/1104023855 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd1600c4370 0x7fd1600c47e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-25T14:36:20.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.873+0000 7fd15effd700 1 --2- 172.21.15.72:0/1104023855 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd1601518c0 0x7fd16006b2a0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fd150009840 tx=0x7fd150009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=178348fc7a4ca842 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:20.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.873+0000 7fd15dffb700 1 -- 172.21.15.72:0/1104023855 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd150011830 con 0x7fd1601518c0 2023-07-25T14:36:20.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.873+0000 7fd15dffb700 1 -- 172.21.15.72:0/1104023855 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd150011990 con 0x7fd1601518c0 2023-07-25T14:36:20.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.873+0000 7fd15dffb700 1 -- 172.21.15.72:0/1104023855 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd150011d20 con 0x7fd1601518c0 2023-07-25T14:36:20.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.874+0000 7fd1659c8700 1 -- 172.21.15.72:0/1104023855 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd1601518c0 msgr2=0x7fd16006b2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:20.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.874+0000 7fd1659c8700 1 --2- 172.21.15.72:0/1104023855 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd1601518c0 0x7fd16006b2a0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fd150009840 tx=0x7fd150009b50 comp rx=0 tx=0).stop 2023-07-25T14:36:20.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.874+0000 7fd1659c8700 1 -- 172.21.15.72:0/1104023855 shutdown_connections 2023-07-25T14:36:20.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.874+0000 7fd1659c8700 1 --2- 172.21.15.72:0/1104023855 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd1600c4370 0x7fd1600c47e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:20.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.874+0000 7fd1659c8700 1 --2- 172.21.15.72:0/1104023855 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd1601518c0 0x7fd16006b2a0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:20.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.874+0000 7fd1659c8700 1 -- 172.21.15.72:0/1104023855 >> 172.21.15.72:0/1104023855 conn(0x7fd16006a8d0 msgr2=0x7fd1600a94e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:20.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.874+0000 7fd1659c8700 1 -- 172.21.15.72:0/1104023855 shutdown_connections 2023-07-25T14:36:20.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.874+0000 7fd1659c8700 1 -- 172.21.15.72:0/1104023855 wait complete. 2023-07-25T14:36:20.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.875+0000 7fd1659c8700 1 Processor -- start 2023-07-25T14:36:20.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.876+0000 7fd1659c8700 1 -- start start 2023-07-25T14:36:20.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.876+0000 7fd1659c8700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd1600c4370 0x7fd1601ed0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:20.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.876+0000 7fd1659c8700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd1601518c0 0x7fd1600a67d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:20.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.876+0000 7fd1659c8700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd160154df0 0x7fd1600a6d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:20.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.876+0000 7fd1659c8700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1600ac4d0 con 0x7fd160154df0 2023-07-25T14:36:20.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.876+0000 7fd1659c8700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1600acea0 con 0x7fd1601518c0 2023-07-25T14:36:20.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.876+0000 7fd1659c8700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1600ac180 con 0x7fd1600c4370 2023-07-25T14:36:20.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.876+0000 7fd15f7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd160154df0 0x7fd1600a6d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:20.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.876+0000 7fd15f7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd160154df0 0x7fd1600a6d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40890/0 (socket says 172.21.15.72:40890) 2023-07-25T14:36:20.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.877+0000 7fd15f7fe700 1 -- 172.21.15.72:0/3962984491 learned_addr learned my addr 172.21.15.72:0/3962984491 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:20.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.877+0000 7fd15effd700 1 --2- 172.21.15.72:0/3962984491 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd1600c4370 0x7fd1601ed0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:20.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.877+0000 7fd15e7fc700 1 --2- 172.21.15.72:0/3962984491 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd1601518c0 0x7fd1600a67d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:20.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.877+0000 7fd15f7fe700 1 -- 172.21.15.72:0/3962984491 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd1600c4370 msgr2=0x7fd1601ed0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:20.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.877+0000 7fd15f7fe700 1 --2- 172.21.15.72:0/3962984491 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd1600c4370 0x7fd1601ed0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:20.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.877+0000 7fd15f7fe700 1 -- 172.21.15.72:0/3962984491 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd1601518c0 msgr2=0x7fd1600a67d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:20.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.877+0000 7fd15f7fe700 1 --2- 172.21.15.72:0/3962984491 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd1601518c0 0x7fd1600a67d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:20.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.877+0000 7fd15f7fe700 1 -- 172.21.15.72:0/3962984491 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1500094a0 con 0x7fd160154df0 2023-07-25T14:36:20.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.877+0000 7fd15f7fe700 1 --2- 172.21.15.72:0/3962984491 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd160154df0 0x7fd1600a6d10 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fd15800cf20 tx=0x7fd15800cf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:20.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.877+0000 7fd147fff700 1 -- 172.21.15.72:0/3962984491 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd15800ad60 con 0x7fd160154df0 2023-07-25T14:36:20.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.877+0000 7fd147fff700 1 -- 172.21.15.72:0/3962984491 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd158015440 con 0x7fd160154df0 2023-07-25T14:36:20.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.877+0000 7fd1659c8700 1 -- 172.21.15.72:0/3962984491 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd160154210 con 0x7fd160154df0 2023-07-25T14:36:20.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.877+0000 7fd147fff700 1 -- 172.21.15.72:0/3962984491 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1580157f0 con 0x7fd160154df0 2023-07-25T14:36:20.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.877+0000 7fd1659c8700 1 -- 172.21.15.72:0/3962984491 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1601edbf0 con 0x7fd160154df0 2023-07-25T14:36:20.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.878+0000 7fd1659c8700 1 -- 172.21.15.72:0/3962984491 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1600ac610 con 0x7fd160154df0 2023-07-25T14:36:20.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.879+0000 7fd147fff700 1 -- 172.21.15.72:0/3962984491 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd15800d430 con 0x7fd160154df0 2023-07-25T14:36:20.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.879+0000 7fd147fff700 1 --2- 172.21.15.72:0/3962984491 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fd14c06ace0 0x7fd14c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:20.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.879+0000 7fd147fff700 1 -- 172.21.15.72:0/3962984491 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fd158089b50 con 0x7fd160154df0 2023-07-25T14:36:20.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.879+0000 7fd15effd700 1 --2- 172.21.15.72:0/3962984491 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fd14c06ace0 0x7fd14c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:20.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.879+0000 7fd15effd700 1 --2- 172.21.15.72:0/3962984491 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fd14c06ace0 0x7fd14c06d1a0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fd1500090b0 tx=0x7fd150008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:20.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:20.883+0000 7fd147fff700 1 -- 172.21.15.72:0/3962984491 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fd1600ac610 con 0x7fd160154df0 2023-07-25T14:36:21.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.071+0000 7fd1659c8700 1 -- 172.21.15.72:0/3962984491 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd1600ac610 con 0x7fd160154df0 2023-07-25T14:36:21.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.072+0000 7fd147fff700 1 -- 172.21.15.72:0/3962984491 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+20014 (secure 0 0 0) 0x7fd15801a020 con 0x7fd160154df0 2023-07-25T14:36:21.085 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-25T14:36:21.085 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":25,"fsid":"9170db48-9170-43e8-8ccb-9813e6240906","created":"2023-07-25T14:35:21.733262+0000","modified":"2023-07-25T14:35:44.992669+0000","last_up_change":"2023-07-25T14:35:31.355010+0000","last_in_change":"2023-07-25T14:35:24.195785+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-25T14:35:32.983457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-25T14:35:33.326342+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-25T14:35:37.534158+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-25T14:35:38.891571+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-25T14:35:42.596923+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d517fdad-0bfe-49f0-89f2-9421c3761839","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6801","nonce":2475407414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6803","nonce":2475407414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6807","nonce":2475407414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6805","nonce":2475407414}]},"public_addr":"172.21.15.72:6801/2475407414","cluster_addr":"172.21.15.72:6803/2475407414","heartbeat_back_addr":"172.21.15.72:6807/2475407414","heartbeat_front_addr":"172.21.15.72:6805/2475407414","state":["exists","up"]},{"osd":1,"uuid":"e1564be3-f209-47e5-a8d0-32fc618a474f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6822","nonce":870954016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6825","nonce":870954016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6831","nonce":870954016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6827","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6829","nonce":870954016}]},"public_addr":"172.21.15.72:6822/870954016","cluster_addr":"172.21.15.72:6825/870954016","heartbeat_back_addr":"172.21.15.72:6831/870954016","heartbeat_front_addr":"172.21.15.72:6829/870954016","state":["exists","up"]},{"osd":2,"uuid":"c4647d30-ffa6-417a-9026-ef530c75910e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6809","nonce":2143129442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6811","nonce":2143129442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6815","nonce":2143129442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6813","nonce":2143129442}]},"public_addr":"172.21.15.72:6809/2143129442","cluster_addr":"172.21.15.72:6811/2143129442","heartbeat_back_addr":"172.21.15.72:6815/2143129442","heartbeat_front_addr":"172.21.15.72:6813/2143129442","state":["exists","up"]},{"osd":3,"uuid":"76c9d9a7-c2e2-4612-a58b-d6882dd76b58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6817","nonce":3404066311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6819","nonce":3404066311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6828","nonce":3404066311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6821","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6823","nonce":3404066311}]},"public_addr":"172.21.15.72:6817/3404066311","cluster_addr":"172.21.15.72:6819/3404066311","heartbeat_back_addr":"172.21.15.72:6828/3404066311","heartbeat_front_addr":"172.21.15.72:6823/3404066311","state":["exists","up"]},{"osd":4,"uuid":"7f8920dc-0ad4-4a73-ab40-65408f83eadd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6817","nonce":2381008739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6819","nonce":2381008739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6825","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6827","nonce":2381008739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6822","nonce":2381008739}]},"public_addr":"172.21.15.92:6817/2381008739","cluster_addr":"172.21.15.92:6819/2381008739","heartbeat_back_addr":"172.21.15.92:6827/2381008739","heartbeat_front_addr":"172.21.15.92:6822/2381008739","state":["exists","up"]},{"osd":5,"uuid":"56257e7c-31eb-44c5-9ec7-1318a4e0bb35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6801","nonce":2161935604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6803","nonce":2161935604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6807","nonce":2161935604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6805","nonce":2161935604}]},"public_addr":"172.21.15.92:6801/2161935604","cluster_addr":"172.21.15.92:6803/2161935604","heartbeat_back_addr":"172.21.15.92:6807/2161935604","heartbeat_front_addr":"172.21.15.92:6805/2161935604","state":["exists","up"]},{"osd":6,"uuid":"a150d3d8-a0c9-4955-968a-8d98eff4ffb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6809","nonce":3770163493}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6811","nonce":3770163493}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6815","nonce":3770163493}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6813","nonce":3770163493}]},"public_addr":"172.21.15.92:6809/3770163493","cluster_addr":"172.21.15.92:6811/3770163493","heartbeat_back_addr":"172.21.15.92:6815/3770163493","heartbeat_front_addr":"172.21.15.92:6813/3770163493","state":["exists","up"]},{"osd":7,"uuid":"07799c27-54ee-4591-a42d-a978d6b32065","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6821","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6823","nonce":2135777609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6826","nonce":2135777609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6831","nonce":2135777609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6829","nonce":2135777609}]},"public_addr":"172.21.15.92:6823/2135777609","cluster_addr":"172.21.15.92:6826/2135777609","heartbeat_back_addr":"172.21.15.92:6831/2135777609","heartbeat_front_addr":"172.21.15.92:6829/2135777609","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.345365+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.378150+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.146566+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.372172+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:30.398421+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.385632+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.465611+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.443583+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-25T14:36:21.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.075+0000 7fd1659c8700 1 -- 172.21.15.72:0/3962984491 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fd14c06ace0 msgr2=0x7fd14c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:21.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.075+0000 7fd1659c8700 1 --2- 172.21.15.72:0/3962984491 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fd14c06ace0 0x7fd14c06d1a0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fd1500090b0 tx=0x7fd150008030 comp rx=0 tx=0).stop 2023-07-25T14:36:21.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.075+0000 7fd1659c8700 1 -- 172.21.15.72:0/3962984491 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd160154df0 msgr2=0x7fd1600a6d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:21.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.075+0000 7fd1659c8700 1 --2- 172.21.15.72:0/3962984491 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd160154df0 0x7fd1600a6d10 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fd15800cf20 tx=0x7fd15800cf50 comp rx=0 tx=0).stop 2023-07-25T14:36:21.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.075+0000 7fd1659c8700 1 -- 172.21.15.72:0/3962984491 shutdown_connections 2023-07-25T14:36:21.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.075+0000 7fd1659c8700 1 --2- 172.21.15.72:0/3962984491 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fd14c06ace0 0x7fd14c06d1a0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:21.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.075+0000 7fd1659c8700 1 --2- 172.21.15.72:0/3962984491 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd1600c4370 0x7fd1601ed0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:21.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.075+0000 7fd1659c8700 1 --2- 172.21.15.72:0/3962984491 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd160154df0 0x7fd1600a6d10 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:21.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.075+0000 7fd1659c8700 1 --2- 172.21.15.72:0/3962984491 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd1601518c0 0x7fd1600a67d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:21.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.075+0000 7fd1659c8700 1 -- 172.21.15.72:0/3962984491 >> 172.21.15.72:0/3962984491 conn(0x7fd16006a8d0 msgr2=0x7fd1601509d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:21.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.075+0000 7fd1659c8700 1 -- 172.21.15.72:0/3962984491 shutdown_connections 2023-07-25T14:36:21.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.075+0000 7fd1659c8700 1 -- 172.21.15.72:0/3962984491 wait complete. 2023-07-25T14:36:21.099 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-07-25T14:35:32.983457+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-07-25T14:35:33.326342+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-25T14:35:37.534158+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-25T14:35:38.891571+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-07-25T14:35:42.596923+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-25T14:36:21.100 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-25T14:36:21.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.210+0000 7f0a36501700 1 Processor -- start 2023-07-25T14:36:21.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.210+0000 7f0a36501700 1 -- start start 2023-07-25T14:36:21.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.211+0000 7f0a36501700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f0a3014faf0 0x7f0a300c5e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:21.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.211+0000 7f0a36501700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a300c4930 con 0x7f0a300ba0e0 2023-07-25T14:36:21.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.211+0000 7f0a36501700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a300c5670 con 0x7f0a300c3f10 2023-07-25T14:36:21.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.211+0000 7f0a36501700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a300726e0 con 0x7f0a3014faf0 2023-07-25T14:36:21.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.211+0000 7f0a2f7fe700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f0a300ba0e0 0x7f0a301558a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:59862/0 (socket says 172.21.15.72:59862) 2023-07-25T14:36:21.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.211+0000 7f0a2f7fe700 1 -- 172.21.15.72:0/615252306 learned_addr learned my addr 172.21.15.72:0/615252306 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:36:21.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.211+0000 7f0a2ffff700 1 --2- 172.21.15.72:0/615252306 >> v2:172.21.15.92:3300/0 conn(0x7f0a3014faf0 0x7f0a300c5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:21.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.211+0000 7f0a2effd700 1 -- 172.21.15.72:0/615252306 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3850146091 0 0) 0x7f0a300c4930 con 0x7f0a300ba0e0 2023-07-25T14:36:21.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.211+0000 7f0a2effd700 1 -- 172.21.15.72:0/615252306 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0a180035b0 con 0x7f0a300ba0e0 2023-07-25T14:36:21.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.212+0000 7f0a2effd700 1 -- 172.21.15.72:0/615252306 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1730636854 0 0) 0x7f0a180035b0 con 0x7f0a300ba0e0 2023-07-25T14:36:21.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.212+0000 7f0a2effd700 1 -- 172.21.15.72:0/615252306 >> v2:172.21.15.92:3300/0 conn(0x7f0a3014faf0 msgr2=0x7f0a300c5e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:21.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.212+0000 7f0a2effd700 1 --2- 172.21.15.72:0/615252306 >> v2:172.21.15.92:3300/0 conn(0x7f0a3014faf0 0x7f0a300c5e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:21.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.212+0000 7f0a2effd700 1 -- 172.21.15.72:0/615252306 >> v1:172.21.15.92:6789/0 conn(0x7f0a300c3f10 legacy=0x7f0a30071960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:21.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.212+0000 7f0a2effd700 1 -- 172.21.15.72:0/615252306 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a300c4b80 con 0x7f0a300ba0e0 2023-07-25T14:36:21.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.212+0000 7f0a2effd700 1 -- 172.21.15.72:0/615252306 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2559588315 0 0) 0x7f0a24001670 con 0x7f0a300ba0e0 2023-07-25T14:36:21.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.212+0000 7f0a2effd700 1 -- 172.21.15.72:0/615252306 >> v1:172.21.15.72:6789/0 conn(0x7f0a300ba0e0 legacy=0x7f0a301558a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:21.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.212+0000 7f0a2effd700 1 --2- 172.21.15.72:0/615252306 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0a18003a00 0x7f0a18003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:21.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.212+0000 7f0a2effd700 1 --2- 172.21.15.72:0/615252306 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0a18004850 0x7f0a18004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:21.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.212+0000 7f0a2effd700 1 --2- 172.21.15.72:0/615252306 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0a18005210 0x7f0a1800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:21.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.212+0000 7f0a2effd700 1 -- 172.21.15.72:0/615252306 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a300726e0 con 0x7f0a18003a00 2023-07-25T14:36:21.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.212+0000 7f0a2effd700 1 -- 172.21.15.72:0/615252306 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a1800c1b0 con 0x7f0a18005210 2023-07-25T14:36:21.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.212+0000 7f0a2effd700 1 -- 172.21.15.72:0/615252306 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a1800c370 con 0x7f0a18004850 2023-07-25T14:36:21.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.212+0000 7f0a2ffff700 1 --2- 172.21.15.72:0/615252306 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0a18003a00 0x7f0a18003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:21.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.212+0000 7f0a34a9e700 1 --2- 172.21.15.72:0/615252306 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0a18005210 0x7f0a1800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:21.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.212+0000 7f0a2f7fe700 1 --2- 172.21.15.72:0/615252306 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0a18004850 0x7f0a18004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:21.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.212+0000 7f0a2ffff700 1 -- 172.21.15.72:0/615252306 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0a18004850 msgr2=0x7f0a18004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:21.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.212+0000 7f0a2ffff700 1 --2- 172.21.15.72:0/615252306 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0a18004850 0x7f0a18004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:21.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.212+0000 7f0a2ffff700 1 -- 172.21.15.72:0/615252306 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0a18005210 msgr2=0x7f0a1800ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:21.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.212+0000 7f0a2ffff700 1 --2- 172.21.15.72:0/615252306 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0a18005210 0x7f0a1800ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:21.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.212+0000 7f0a2ffff700 1 -- 172.21.15.72:0/615252306 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a180035b0 con 0x7f0a18003a00 2023-07-25T14:36:21.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.212+0000 7f0a34a9e700 1 -- 172.21.15.72:0/615252306 reap_dead start 2023-07-25T14:36:21.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.212+0000 7f0a2f7fe700 1 --2- 172.21.15.72:0/615252306 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0a18004850 0x7f0a18004cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-25T14:36:21.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.212+0000 7f0a2ffff700 1 --2- 172.21.15.72:0/615252306 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0a18003a00 0x7f0a18003e20 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f0a20009b60 tx=0x7f0a18005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2013ae0b57f3de2 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:21.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.212+0000 7f0a2effd700 1 -- 172.21.15.72:0/615252306 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a2000e6c0 con 0x7f0a18003a00 2023-07-25T14:36:21.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.212+0000 7f0a2effd700 1 -- 172.21.15.72:0/615252306 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a2000e820 con 0x7f0a18003a00 2023-07-25T14:36:21.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.212+0000 7f0a2effd700 1 -- 172.21.15.72:0/615252306 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a2000eb90 con 0x7f0a18003a00 2023-07-25T14:36:21.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.213+0000 7f0a36501700 1 -- 172.21.15.72:0/615252306 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0a18003a00 msgr2=0x7f0a18003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:21.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.213+0000 7f0a36501700 1 --2- 172.21.15.72:0/615252306 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0a18003a00 0x7f0a18003e20 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f0a20009b60 tx=0x7f0a18005880 comp rx=0 tx=0).stop 2023-07-25T14:36:21.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.213+0000 7f0a36501700 1 -- 172.21.15.72:0/615252306 shutdown_connections 2023-07-25T14:36:21.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.213+0000 7f0a36501700 1 --2- 172.21.15.72:0/615252306 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0a18003a00 0x7f0a18003e20 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:21.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.213+0000 7f0a36501700 1 -- 172.21.15.72:0/615252306 >> 172.21.15.72:0/615252306 conn(0x7f0a300a87e0 msgr2=0x7f0a300a8bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:21.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.213+0000 7f0a36501700 1 -- 172.21.15.72:0/615252306 shutdown_connections 2023-07-25T14:36:21.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.213+0000 7f0a36501700 1 -- 172.21.15.72:0/615252306 wait complete. 2023-07-25T14:36:21.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.214+0000 7f0a36501700 1 Processor -- start 2023-07-25T14:36:21.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.215+0000 7f0a36501700 1 -- start start 2023-07-25T14:36:21.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.215+0000 7f0a36501700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0a18003a00 0x7f0a3014c590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:21.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.215+0000 7f0a36501700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0a3014a5f0 0x7f0a301468f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:21.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.215+0000 7f0a36501700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0a300a4fd0 0x7f0a300a5450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:21.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.215+0000 7f0a36501700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a300a5990 con 0x7f0a3014a5f0 2023-07-25T14:36:21.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.215+0000 7f0a36501700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a301484f0 con 0x7f0a18003a00 2023-07-25T14:36:21.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.215+0000 7f0a36501700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a30150ce0 con 0x7f0a300a4fd0 2023-07-25T14:36:21.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.215+0000 7f0a2f7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0a3014a5f0 0x7f0a301468f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:21.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.215+0000 7f0a2f7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0a3014a5f0 0x7f0a301468f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40908/0 (socket says 172.21.15.72:40908) 2023-07-25T14:36:21.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.215+0000 7f0a2f7fe700 1 -- 172.21.15.72:0/1535988544 learned_addr learned my addr 172.21.15.72:0/1535988544 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:21.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.215+0000 7f0a2ffff700 1 --2- 172.21.15.72:0/1535988544 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0a18003a00 0x7f0a3014c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:21.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.215+0000 7f0a34a9e700 1 --2- 172.21.15.72:0/1535988544 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0a300a4fd0 0x7f0a300a5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:21.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.216+0000 7f0a2f7fe700 1 -- 172.21.15.72:0/1535988544 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0a300a4fd0 msgr2=0x7f0a300a5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:21.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.216+0000 7f0a2f7fe700 1 --2- 172.21.15.72:0/1535988544 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0a300a4fd0 0x7f0a300a5450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:21.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.216+0000 7f0a2f7fe700 1 -- 172.21.15.72:0/1535988544 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0a18003a00 msgr2=0x7f0a3014c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:21.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.216+0000 7f0a2f7fe700 1 --2- 172.21.15.72:0/1535988544 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0a18003a00 0x7f0a3014c590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:21.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.216+0000 7f0a2f7fe700 1 -- 172.21.15.72:0/1535988544 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a301e9950 con 0x7f0a3014a5f0 2023-07-25T14:36:21.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.216+0000 7f0a2f7fe700 1 --2- 172.21.15.72:0/1535988544 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0a3014a5f0 0x7f0a301468f0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f0a2400edb0 tx=0x7f0a240123b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:21.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.216+0000 7f0a2cff9700 1 -- 172.21.15.72:0/1535988544 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a2400e0d0 con 0x7f0a3014a5f0 2023-07-25T14:36:21.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.216+0000 7f0a2cff9700 1 -- 172.21.15.72:0/1535988544 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a24014040 con 0x7f0a3014a5f0 2023-07-25T14:36:21.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.216+0000 7f0a36501700 1 -- 172.21.15.72:0/1535988544 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a300b9770 con 0x7f0a3014a5f0 2023-07-25T14:36:21.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.216+0000 7f0a2cff9700 1 -- 172.21.15.72:0/1535988544 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a240128b0 con 0x7f0a3014a5f0 2023-07-25T14:36:21.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.216+0000 7f0a36501700 1 -- 172.21.15.72:0/1535988544 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a300c2d10 con 0x7f0a3014a5f0 2023-07-25T14:36:21.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.217+0000 7f0a36501700 1 -- 172.21.15.72:0/1535988544 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a3004e470 con 0x7f0a3014a5f0 2023-07-25T14:36:21.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.217+0000 7f0a2cff9700 1 -- 172.21.15.72:0/1535988544 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0a24012c20 con 0x7f0a3014a5f0 2023-07-25T14:36:21.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.218+0000 7f0a2cff9700 1 --2- 172.21.15.72:0/1535988544 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f0a1c06ace0 0x7f0a1c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:21.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.218+0000 7f0a2cff9700 1 -- 172.21.15.72:0/1535988544 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f0a2408ce40 con 0x7f0a3014a5f0 2023-07-25T14:36:21.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.218+0000 7f0a2ffff700 1 --2- 172.21.15.72:0/1535988544 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f0a1c06ace0 0x7f0a1c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:21.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.218+0000 7f0a2ffff700 1 --2- 172.21.15.72:0/1535988544 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f0a1c06ace0 0x7f0a1c06d1a0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f0a200090b0 tx=0x7f0a2001e040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:21.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.222+0000 7f0a2cff9700 1 -- 172.21.15.72:0/1535988544 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f0a24057e00 con 0x7f0a3014a5f0 2023-07-25T14:36:21.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.408+0000 7f0a36501700 1 -- 172.21.15.72:0/1535988544 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f0a30150890 con 0x7f0a3014a5f0 2023-07-25T14:36:21.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.408+0000 7f0a2cff9700 1 -- 172.21.15.72:0/1535988544 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7f0a2401d0a0 con 0x7f0a3014a5f0 2023-07-25T14:36:21.423 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 8 2023-07-25T14:36:21.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.410+0000 7f0a36501700 1 -- 172.21.15.72:0/1535988544 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f0a1c06ace0 msgr2=0x7f0a1c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:21.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.410+0000 7f0a36501700 1 --2- 172.21.15.72:0/1535988544 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f0a1c06ace0 0x7f0a1c06d1a0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f0a200090b0 tx=0x7f0a2001e040 comp rx=0 tx=0).stop 2023-07-25T14:36:21.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.410+0000 7f0a36501700 1 -- 172.21.15.72:0/1535988544 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0a3014a5f0 msgr2=0x7f0a301468f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:21.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.410+0000 7f0a36501700 1 --2- 172.21.15.72:0/1535988544 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0a3014a5f0 0x7f0a301468f0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f0a2400edb0 tx=0x7f0a240123b0 comp rx=0 tx=0).stop 2023-07-25T14:36:21.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.410+0000 7f0a36501700 1 -- 172.21.15.72:0/1535988544 shutdown_connections 2023-07-25T14:36:21.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.410+0000 7f0a36501700 1 --2- 172.21.15.72:0/1535988544 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f0a1c06ace0 0x7f0a1c06d1a0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:21.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.410+0000 7f0a36501700 1 --2- 172.21.15.72:0/1535988544 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0a300a4fd0 0x7f0a300a5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:21.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.410+0000 7f0a36501700 1 --2- 172.21.15.72:0/1535988544 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0a18003a00 0x7f0a3014c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:21.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.410+0000 7f0a36501700 1 --2- 172.21.15.72:0/1535988544 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0a3014a5f0 0x7f0a301468f0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:21.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.410+0000 7f0a36501700 1 -- 172.21.15.72:0/1535988544 >> 172.21.15.72:0/1535988544 conn(0x7f0a300a87e0 msgr2=0x7f0a300c20e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:21.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.411+0000 7f0a36501700 1 -- 172.21.15.72:0/1535988544 shutdown_connections 2023-07-25T14:36:21.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.411+0000 7f0a36501700 1 -- 172.21.15.72:0/1535988544 wait complete. 2023-07-25T14:36:21.435 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-25T14:36:21.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.548+0000 7f6d3ab7b700 1 Processor -- start 2023-07-25T14:36:21.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.548+0000 7f6d3ab7b700 1 -- start start 2023-07-25T14:36:21.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.549+0000 7f6d3ab7b700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6d34151950 0x7f6d3406a190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:21.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.549+0000 7f6d3ab7b700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d340c2fe0 con 0x7f6d3406a6d0 2023-07-25T14:36:21.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.549+0000 7f6d3ab7b700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d34155070 con 0x7f6d340724c0 2023-07-25T14:36:21.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.549+0000 7f6d3ab7b700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d34071a60 con 0x7f6d34151950 2023-07-25T14:36:21.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.549+0000 7f6d39118700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f6d3406a6d0 0x7f6d340c3bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:59884/0 (socket says 172.21.15.72:59884) 2023-07-25T14:36:21.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.549+0000 7f6d39118700 1 -- 172.21.15.72:0/60962429 learned_addr learned my addr 172.21.15.72:0/60962429 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:36:21.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.549+0000 7f6d337fe700 1 -- 172.21.15.72:0/60962429 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 494734455 0 0) 0x7f6d340c2fe0 con 0x7f6d3406a6d0 2023-07-25T14:36:21.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.549+0000 7f6d337fe700 1 -- 172.21.15.72:0/60962429 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6d240035b0 con 0x7f6d3406a6d0 2023-07-25T14:36:21.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.549+0000 7f6d38917700 1 --2- 172.21.15.72:0/60962429 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6d34151950 0x7f6d3406a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:21.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.549+0000 7f6d337fe700 1 -- 172.21.15.72:0/60962429 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1159930487 0 0) 0x7f6d240035b0 con 0x7f6d3406a6d0 2023-07-25T14:36:21.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.549+0000 7f6d337fe700 1 -- 172.21.15.72:0/60962429 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6d34151950 msgr2=0x7f6d3406a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:21.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.549+0000 7f6d337fe700 1 --2- 172.21.15.72:0/60962429 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6d34151950 0x7f6d3406a190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:21.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.549+0000 7f6d337fe700 1 -- 172.21.15.72:0/60962429 >> v1:172.21.15.92:6789/0 conn(0x7f6d340724c0 legacy=0x7f6d340c34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:21.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.549+0000 7f6d337fe700 1 -- 172.21.15.72:0/60962429 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d340c15c0 con 0x7f6d3406a6d0 2023-07-25T14:36:21.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.550+0000 7f6d337fe700 1 -- 172.21.15.72:0/60962429 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2559588315 0 0) 0x7f6d2c0019f0 con 0x7f6d3406a6d0 2023-07-25T14:36:21.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.550+0000 7f6d337fe700 1 -- 172.21.15.72:0/60962429 >> v1:172.21.15.72:6789/0 conn(0x7f6d3406a6d0 legacy=0x7f6d340c3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:21.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.550+0000 7f6d337fe700 1 --2- 172.21.15.72:0/60962429 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6d24003a30 0x7f6d24003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:21.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.550+0000 7f6d337fe700 1 --2- 172.21.15.72:0/60962429 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6d24004850 0x7f6d24004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:21.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.550+0000 7f6d337fe700 1 --2- 172.21.15.72:0/60962429 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6d34151950 0x7f6d2400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:21.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.550+0000 7f6d337fe700 1 -- 172.21.15.72:0/60962429 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d34071a60 con 0x7f6d24004850 2023-07-25T14:36:21.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.550+0000 7f6d337fe700 1 -- 172.21.15.72:0/60962429 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d24005570 con 0x7f6d24003a30 2023-07-25T14:36:21.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.550+0000 7f6d337fe700 1 -- 172.21.15.72:0/60962429 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d2400bf50 con 0x7f6d34151950 2023-07-25T14:36:21.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.550+0000 7f6d33fff700 1 --2- 172.21.15.72:0/60962429 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6d24004850 0x7f6d24004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:21.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.550+0000 7f6d38917700 1 --2- 172.21.15.72:0/60962429 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6d24003a30 0x7f6d24003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:21.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.550+0000 7f6d39118700 1 --2- 172.21.15.72:0/60962429 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6d34151950 0x7f6d2400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:21.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.550+0000 7f6d33fff700 1 -- 172.21.15.72:0/60962429 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6d34151950 msgr2=0x7f6d2400ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:21.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.550+0000 7f6d33fff700 1 --2- 172.21.15.72:0/60962429 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6d34151950 0x7f6d2400ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:21.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.550+0000 7f6d33fff700 1 -- 172.21.15.72:0/60962429 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6d24003a30 msgr2=0x7f6d24003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:21.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.550+0000 7f6d33fff700 1 --2- 172.21.15.72:0/60962429 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6d24003a30 0x7f6d24003e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:21.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.550+0000 7f6d33fff700 1 -- 172.21.15.72:0/60962429 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d240035b0 con 0x7f6d24004850 2023-07-25T14:36:21.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.550+0000 7f6d39118700 1 --2- 172.21.15.72:0/60962429 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6d34151950 0x7f6d2400ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-25T14:36:21.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.550+0000 7f6d33fff700 1 --2- 172.21.15.72:0/60962429 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6d24004850 0x7f6d24004cd0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f6d340728c0 tx=0x7f6d24005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d451770c8f7b3963 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:21.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.550+0000 7f6d337fe700 1 -- 172.21.15.72:0/60962429 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d200052d0 con 0x7f6d24004850 2023-07-25T14:36:21.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.550+0000 7f6d337fe700 1 -- 172.21.15.72:0/60962429 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d20005470 con 0x7f6d24004850 2023-07-25T14:36:21.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.550+0000 7f6d337fe700 1 -- 172.21.15.72:0/60962429 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d200038c0 con 0x7f6d24004850 2023-07-25T14:36:21.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.551+0000 7f6d3ab7b700 1 -- 172.21.15.72:0/60962429 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6d24004850 msgr2=0x7f6d24004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:21.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.551+0000 7f6d3ab7b700 1 --2- 172.21.15.72:0/60962429 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6d24004850 0x7f6d24004cd0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f6d340728c0 tx=0x7f6d24005880 comp rx=0 tx=0).stop 2023-07-25T14:36:21.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.551+0000 7f6d39118700 1 -- 172.21.15.72:0/60962429 reap_dead start 2023-07-25T14:36:21.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.551+0000 7f6d3ab7b700 1 -- 172.21.15.72:0/60962429 shutdown_connections 2023-07-25T14:36:21.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.551+0000 7f6d3ab7b700 1 -- 172.21.15.72:0/60962429 >> 172.21.15.72:0/60962429 conn(0x7f6d340a87e0 msgr2=0x7f6d340a8bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:21.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.551+0000 7f6d3ab7b700 1 -- 172.21.15.72:0/60962429 shutdown_connections 2023-07-25T14:36:21.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.551+0000 7f6d3ab7b700 1 -- 172.21.15.72:0/60962429 wait complete. 2023-07-25T14:36:21.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.552+0000 7f6d3ab7b700 1 Processor -- start 2023-07-25T14:36:21.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.552+0000 7f6d3ab7b700 1 -- start start 2023-07-25T14:36:21.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.553+0000 7f6d3ab7b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6d24004850 0x7f6d3414b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:21.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.553+0000 7f6d3ab7b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6d341508e0 0x7f6d341538c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:21.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.553+0000 7f6d3ab7b700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6d341e9d90 0x7f6d3414bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:21.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.553+0000 7f6d3ab7b700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d341eca70 con 0x7f6d24004850 2023-07-25T14:36:21.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.553+0000 7f6d3ab7b700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d340c5050 con 0x7f6d341508e0 2023-07-25T14:36:21.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.553+0000 7f6d3ab7b700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d341e9590 con 0x7f6d341e9d90 2023-07-25T14:36:21.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.553+0000 7f6d38917700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6d24004850 0x7f6d3414b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:21.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.553+0000 7f6d38917700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6d24004850 0x7f6d3414b2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40924/0 (socket says 172.21.15.72:40924) 2023-07-25T14:36:21.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.553+0000 7f6d38917700 1 -- 172.21.15.72:0/2208279410 learned_addr learned my addr 172.21.15.72:0/2208279410 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:21.574 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.553+0000 7f6d39118700 1 --2- 172.21.15.72:0/2208279410 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6d341e9d90 0x7f6d3414bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:21.574 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.553+0000 7f6d33fff700 1 --2- 172.21.15.72:0/2208279410 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6d341508e0 0x7f6d341538c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:21.574 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.553+0000 7f6d38917700 1 -- 172.21.15.72:0/2208279410 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6d341e9d90 msgr2=0x7f6d3414bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:21.574 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.553+0000 7f6d38917700 1 --2- 172.21.15.72:0/2208279410 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6d341e9d90 0x7f6d3414bb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:21.575 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.553+0000 7f6d38917700 1 -- 172.21.15.72:0/2208279410 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6d341508e0 msgr2=0x7f6d341538c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:21.575 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.553+0000 7f6d38917700 1 --2- 172.21.15.72:0/2208279410 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6d341508e0 0x7f6d341538c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:21.575 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.553+0000 7f6d38917700 1 -- 172.21.15.72:0/2208279410 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d341e9870 con 0x7f6d24004850 2023-07-25T14:36:21.575 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.553+0000 7f6d33fff700 1 --2- 172.21.15.72:0/2208279410 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6d341508e0 0x7f6d341538c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-25T14:36:21.575 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.553+0000 7f6d39118700 1 --2- 172.21.15.72:0/2208279410 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6d341e9d90 0x7f6d3414bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-25T14:36:21.575 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.553+0000 7f6d38917700 1 --2- 172.21.15.72:0/2208279410 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6d24004850 0x7f6d3414b2c0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f6d280116c0 tx=0x7f6d28011a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:21.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.553+0000 7f6d317fa700 1 -- 172.21.15.72:0/2208279410 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d2800c070 con 0x7f6d24004850 2023-07-25T14:36:21.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.554+0000 7f6d317fa700 1 -- 172.21.15.72:0/2208279410 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d28015870 con 0x7f6d24004850 2023-07-25T14:36:21.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.554+0000 7f6d3ab7b700 1 -- 172.21.15.72:0/2208279410 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d34153e00 con 0x7f6d24004850 2023-07-25T14:36:21.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.554+0000 7f6d317fa700 1 -- 172.21.15.72:0/2208279410 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d28015c20 con 0x7f6d24004850 2023-07-25T14:36:21.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.554+0000 7f6d3ab7b700 1 -- 172.21.15.72:0/2208279410 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d34154220 con 0x7f6d24004850 2023-07-25T14:36:21.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.555+0000 7f6d3ab7b700 1 -- 172.21.15.72:0/2208279410 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d341e9be0 con 0x7f6d24004850 2023-07-25T14:36:21.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.555+0000 7f6d317fa700 1 -- 172.21.15.72:0/2208279410 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6d28013400 con 0x7f6d24004850 2023-07-25T14:36:21.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.555+0000 7f6d317fa700 1 --2- 172.21.15.72:0/2208279410 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f6d1806ace0 0x7f6d1806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:21.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.555+0000 7f6d33fff700 1 --2- 172.21.15.72:0/2208279410 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f6d1806ace0 0x7f6d1806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:21.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.555+0000 7f6d317fa700 1 -- 172.21.15.72:0/2208279410 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f6d280899f0 con 0x7f6d24004850 2023-07-25T14:36:21.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.556+0000 7f6d33fff700 1 --2- 172.21.15.72:0/2208279410 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f6d1806ace0 0x7f6d1806d1a0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f6d340728c0 tx=0x7f6d20009030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:21.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.560+0000 7f6d317fa700 1 -- 172.21.15.72:0/2208279410 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f6d28054840 con 0x7f6d24004850 2023-07-25T14:36:21.759 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.747+0000 7f6d3ab7b700 1 -- 172.21.15.72:0/2208279410 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6d341e9a00 con 0x7f6d24004850 2023-07-25T14:36:21.759 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.747+0000 7f6d317fa700 1 -- 172.21.15.72:0/2208279410 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6d28057e60 con 0x7f6d24004850 2023-07-25T14:36:21.759 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 1 2023-07-25T14:36:21.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.749+0000 7f6d3ab7b700 1 -- 172.21.15.72:0/2208279410 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f6d1806ace0 msgr2=0x7f6d1806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:21.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.749+0000 7f6d3ab7b700 1 --2- 172.21.15.72:0/2208279410 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f6d1806ace0 0x7f6d1806d1a0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f6d340728c0 tx=0x7f6d20009030 comp rx=0 tx=0).stop 2023-07-25T14:36:21.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.749+0000 7f6d3ab7b700 1 -- 172.21.15.72:0/2208279410 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6d24004850 msgr2=0x7f6d3414b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:21.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.749+0000 7f6d3ab7b700 1 --2- 172.21.15.72:0/2208279410 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6d24004850 0x7f6d3414b2c0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f6d280116c0 tx=0x7f6d28011a80 comp rx=0 tx=0).stop 2023-07-25T14:36:21.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.749+0000 7f6d3ab7b700 1 -- 172.21.15.72:0/2208279410 shutdown_connections 2023-07-25T14:36:21.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.749+0000 7f6d3ab7b700 1 --2- 172.21.15.72:0/2208279410 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f6d1806ace0 0x7f6d1806d1a0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:21.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.749+0000 7f6d3ab7b700 1 --2- 172.21.15.72:0/2208279410 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6d341e9d90 0x7f6d3414bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:21.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.749+0000 7f6d3ab7b700 1 --2- 172.21.15.72:0/2208279410 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6d24004850 0x7f6d3414b2c0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:21.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.749+0000 7f6d3ab7b700 1 --2- 172.21.15.72:0/2208279410 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6d341508e0 0x7f6d341538c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:21.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.749+0000 7f6d3ab7b700 1 -- 172.21.15.72:0/2208279410 >> 172.21.15.72:0/2208279410 conn(0x7f6d340a87e0 msgr2=0x7f6d340a6f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:21.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.749+0000 7f6d3ab7b700 1 -- 172.21.15.72:0/2208279410 shutdown_connections 2023-07-25T14:36:21.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.749+0000 7f6d3ab7b700 1 -- 172.21.15.72:0/2208279410 wait complete. 2023-07-25T14:36:21.773 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-25T14:36:21.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.884+0000 7eff45440700 1 Processor -- start 2023-07-25T14:36:21.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.884+0000 7eff45440700 1 -- start start 2023-07-25T14:36:21.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.885+0000 7eff45440700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7eff40151950 0x7eff4006a190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:21.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.885+0000 7eff45440700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7eff4006a6d0 0x7eff400c3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:21.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.885+0000 7eff45440700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff400c2fe0 con 0x7eff400724c0 2023-07-25T14:36:21.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.885+0000 7eff45440700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff40071a60 con 0x7eff40151950 2023-07-25T14:36:21.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.885+0000 7eff45440700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff400c2a70 con 0x7eff4006a6d0 2023-07-25T14:36:21.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.885+0000 7eff3effd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7eff40151950 0x7eff4006a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:21.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.885+0000 7eff3effd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7eff40151950 0x7eff4006a190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40932/0 (socket says 172.21.15.72:40932) 2023-07-25T14:36:21.902 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.885+0000 7eff3effd700 1 -- 172.21.15.72:0/2947617982 learned_addr learned my addr 172.21.15.72:0/2947617982 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:21.902 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.885+0000 7eff3f7fe700 1 --2- 172.21.15.72:0/2947617982 >> v2:172.21.15.92:3300/0 conn(0x7eff4006a6d0 0x7eff400c3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:21.902 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.885+0000 7eff3effd700 1 -- 172.21.15.72:0/2947617982 >> v2:172.21.15.92:3300/0 conn(0x7eff4006a6d0 msgr2=0x7eff400c3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:21.902 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.885+0000 7eff3effd700 1 --2- 172.21.15.72:0/2947617982 >> v2:172.21.15.92:3300/0 conn(0x7eff4006a6d0 0x7eff400c3bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:21.903 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.885+0000 7eff3effd700 1 -- 172.21.15.72:0/2947617982 >> v1:172.21.15.92:6789/0 conn(0x7eff400724c0 legacy=0x7eff400c34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:21.903 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.885+0000 7eff3effd700 1 -- 172.21.15.72:0/2947617982 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff40155070 con 0x7eff40151950 2023-07-25T14:36:21.903 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.886+0000 7eff3effd700 1 --2- 172.21.15.72:0/2947617982 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7eff40151950 0x7eff4006a190 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7eff400728a0 tx=0x7eff34009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=542e293ff4750972 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:21.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.886+0000 7eff3dffb700 1 -- 172.21.15.72:0/2947617982 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff34004230 con 0x7eff40151950 2023-07-25T14:36:21.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.886+0000 7eff3dffb700 1 -- 172.21.15.72:0/2947617982 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff34004390 con 0x7eff40151950 2023-07-25T14:36:21.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.886+0000 7eff3dffb700 1 -- 172.21.15.72:0/2947617982 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff340036a0 con 0x7eff40151950 2023-07-25T14:36:21.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.886+0000 7eff45440700 1 -- 172.21.15.72:0/2947617982 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7eff40151950 msgr2=0x7eff4006a190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:21.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.886+0000 7eff45440700 1 --2- 172.21.15.72:0/2947617982 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7eff40151950 0x7eff4006a190 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7eff400728a0 tx=0x7eff34009bd0 comp rx=0 tx=0).stop 2023-07-25T14:36:21.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.886+0000 7eff45440700 1 -- 172.21.15.72:0/2947617982 shutdown_connections 2023-07-25T14:36:21.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.886+0000 7eff45440700 1 --2- 172.21.15.72:0/2947617982 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7eff40151950 0x7eff4006a190 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:21.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.886+0000 7eff45440700 1 --2- 172.21.15.72:0/2947617982 >> v2:172.21.15.92:3300/0 conn(0x7eff4006a6d0 0x7eff400c3bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:21.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.886+0000 7eff45440700 1 -- 172.21.15.72:0/2947617982 >> 172.21.15.72:0/2947617982 conn(0x7eff400a87e0 msgr2=0x7eff400a8bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:21.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.886+0000 7eff45440700 1 -- 172.21.15.72:0/2947617982 shutdown_connections 2023-07-25T14:36:21.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.887+0000 7eff45440700 1 -- 172.21.15.72:0/2947617982 wait complete. 2023-07-25T14:36:21.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.888+0000 7eff45440700 1 Processor -- start 2023-07-25T14:36:21.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.888+0000 7eff45440700 1 -- start start 2023-07-25T14:36:21.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.888+0000 7eff45440700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7eff4006a6d0 0x7eff400ac4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:21.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.888+0000 7eff45440700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7eff400724c0 0x7eff4006f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:21.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.888+0000 7eff45440700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7eff40151950 0x7eff401ea940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:21.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.888+0000 7eff45440700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff40152a80 con 0x7eff40151950 2023-07-25T14:36:21.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.888+0000 7eff45440700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff4014d4a0 con 0x7eff400724c0 2023-07-25T14:36:21.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.888+0000 7eff45440700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff40150180 con 0x7eff4006a6d0 2023-07-25T14:36:21.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.889+0000 7eff3f7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7eff40151950 0x7eff401ea940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:21.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.889+0000 7eff3f7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7eff40151950 0x7eff401ea940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40942/0 (socket says 172.21.15.72:40942) 2023-07-25T14:36:21.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.889+0000 7eff3f7fe700 1 -- 172.21.15.72:0/898741539 learned_addr learned my addr 172.21.15.72:0/898741539 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:21.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.889+0000 7eff3effd700 1 --2- 172.21.15.72:0/898741539 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7eff4006a6d0 0x7eff400ac4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:21.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.889+0000 7eff3e7fc700 1 --2- 172.21.15.72:0/898741539 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7eff400724c0 0x7eff4006f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:21.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.889+0000 7eff3f7fe700 1 -- 172.21.15.72:0/898741539 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7eff4006a6d0 msgr2=0x7eff400ac4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:21.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.889+0000 7eff3f7fe700 1 --2- 172.21.15.72:0/898741539 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7eff4006a6d0 0x7eff400ac4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:21.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.889+0000 7eff3f7fe700 1 -- 172.21.15.72:0/898741539 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7eff400724c0 msgr2=0x7eff4006f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:21.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.889+0000 7eff3f7fe700 1 --2- 172.21.15.72:0/898741539 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7eff400724c0 0x7eff4006f1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:21.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.889+0000 7eff3f7fe700 1 -- 172.21.15.72:0/898741539 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff34009550 con 0x7eff40151950 2023-07-25T14:36:21.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.889+0000 7eff3f7fe700 1 --2- 172.21.15.72:0/898741539 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7eff40151950 0x7eff401ea940 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7eff3800cd70 tx=0x7eff3800a570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:21.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.889+0000 7eff277fe700 1 -- 172.21.15.72:0/898741539 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff38003a20 con 0x7eff40151950 2023-07-25T14:36:21.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.889+0000 7eff277fe700 1 -- 172.21.15.72:0/898741539 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff38003b80 con 0x7eff40151950 2023-07-25T14:36:21.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.889+0000 7eff45440700 1 -- 172.21.15.72:0/898741539 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff400aca30 con 0x7eff40151950 2023-07-25T14:36:21.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.889+0000 7eff277fe700 1 -- 172.21.15.72:0/898741539 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff38004020 con 0x7eff40151950 2023-07-25T14:36:21.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.889+0000 7eff45440700 1 -- 172.21.15.72:0/898741539 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff401ea0f0 con 0x7eff40151950 2023-07-25T14:36:21.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.890+0000 7eff45440700 1 -- 172.21.15.72:0/898741539 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff4014d5e0 con 0x7eff40151950 2023-07-25T14:36:21.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.890+0000 7eff277fe700 1 -- 172.21.15.72:0/898741539 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7eff38004180 con 0x7eff40151950 2023-07-25T14:36:21.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.891+0000 7eff277fe700 1 --2- 172.21.15.72:0/898741539 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7eff2c06ad10 0x7eff2c06d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:21.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.891+0000 7eff277fe700 1 -- 172.21.15.72:0/898741539 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7eff38012070 con 0x7eff40151950 2023-07-25T14:36:21.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.891+0000 7eff3effd700 1 --2- 172.21.15.72:0/898741539 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7eff2c06ad10 0x7eff2c06d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:21.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.891+0000 7eff3effd700 1 --2- 172.21.15.72:0/898741539 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7eff2c06ad10 0x7eff2c06d1d0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7eff34009840 tx=0x7eff34008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:21.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:21.895+0000 7eff277fe700 1 -- 172.21.15.72:0/898741539 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7eff4014d5e0 con 0x7eff40151950 2023-07-25T14:36:22.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.080+0000 7eff45440700 1 -- 172.21.15.72:0/898741539 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7eff4014d7c0 con 0x7eff40151950 2023-07-25T14:36:22.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.080+0000 7eff277fe700 1 -- 172.21.15.72:0/898741539 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7eff4014d7c0 con 0x7eff40151950 2023-07-25T14:36:22.093 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2023-07-25T14:36:22.095 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.082+0000 7eff45440700 1 -- 172.21.15.72:0/898741539 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7eff2c06ad10 msgr2=0x7eff2c06d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:22.095 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.082+0000 7eff45440700 1 --2- 172.21.15.72:0/898741539 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7eff2c06ad10 0x7eff2c06d1d0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7eff34009840 tx=0x7eff34008030 comp rx=0 tx=0).stop 2023-07-25T14:36:22.095 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.082+0000 7eff45440700 1 -- 172.21.15.72:0/898741539 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7eff40151950 msgr2=0x7eff401ea940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:22.095 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.082+0000 7eff45440700 1 --2- 172.21.15.72:0/898741539 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7eff40151950 0x7eff401ea940 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7eff3800cd70 tx=0x7eff3800a570 comp rx=0 tx=0).stop 2023-07-25T14:36:22.095 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.082+0000 7eff45440700 1 -- 172.21.15.72:0/898741539 shutdown_connections 2023-07-25T14:36:22.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.082+0000 7eff45440700 1 --2- 172.21.15.72:0/898741539 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7eff2c06ad10 0x7eff2c06d1d0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:22.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.082+0000 7eff45440700 1 --2- 172.21.15.72:0/898741539 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7eff4006a6d0 0x7eff400ac4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:22.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.082+0000 7eff45440700 1 --2- 172.21.15.72:0/898741539 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7eff40151950 0x7eff401ea940 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:22.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.082+0000 7eff45440700 1 --2- 172.21.15.72:0/898741539 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7eff400724c0 0x7eff4006f1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:22.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.082+0000 7eff45440700 1 -- 172.21.15.72:0/898741539 >> 172.21.15.72:0/898741539 conn(0x7eff400a87e0 msgr2=0x7eff400c45e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:22.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.082+0000 7eff45440700 1 -- 172.21.15.72:0/898741539 shutdown_connections 2023-07-25T14:36:22.097 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.082+0000 7eff45440700 1 -- 172.21.15.72:0/898741539 wait complete. 2023-07-25T14:36:22.106 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-25T14:36:22.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.216+0000 7f3bd07bf700 1 Processor -- start 2023-07-25T14:36:22.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.216+0000 7f3bd07bf700 1 -- start start 2023-07-25T14:36:22.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.217+0000 7f3bd07bf700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f3bc8151950 0x7f3bc806a190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:22.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.217+0000 7f3bd07bf700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f3bc80724c0 0x7f3bc80c34c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:22.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.217+0000 7f3bd07bf700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bc80c2fe0 con 0x7f3bc806a6d0 2023-07-25T14:36:22.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.217+0000 7f3bd07bf700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bc8071a60 con 0x7f3bc8151950 2023-07-25T14:36:22.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.217+0000 7f3bd07bf700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bc80c2a70 con 0x7f3bc80724c0 2023-07-25T14:36:22.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.217+0000 7f3bce55b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f3bc8151950 0x7f3bc806a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:22.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.217+0000 7f3bced5c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f3bc806a6d0 0x7f3bc80c3a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:59918/0 (socket says 172.21.15.72:59918) 2023-07-25T14:36:22.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.217+0000 7f3bced5c700 1 -- 172.21.15.72:0/4207217951 learned_addr learned my addr 172.21.15.72:0/4207217951 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:36:22.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.217+0000 7f3bce55b700 1 -- 172.21.15.72:0/4207217951 >> v2:172.21.15.92:3300/0 conn(0x7f3bc80724c0 msgr2=0x7f3bc80c34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:22.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.217+0000 7f3bce55b700 1 --2- 172.21.15.72:0/4207217951 >> v2:172.21.15.92:3300/0 conn(0x7f3bc80724c0 0x7f3bc80c34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:22.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.217+0000 7f3bce55b700 1 -- 172.21.15.72:0/4207217951 >> v1:172.21.15.72:6789/0 conn(0x7f3bc806a6d0 legacy=0x7f3bc80c3a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:22.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.217+0000 7f3bce55b700 1 -- 172.21.15.72:0/4207217951 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bc8155070 con 0x7f3bc8151950 2023-07-25T14:36:22.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.217+0000 7f3bcd559700 1 -- 172.21.15.72:0/4207217951 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4164215133 0 0) 0x7f3bc80c2fe0 con 0x7f3bc806a6d0 2023-07-25T14:36:22.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.217+0000 7f3bce55b700 1 --2- 172.21.15.72:0/4207217951 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3bc8151950 0x7f3bc806a190 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f3bc80acbc0 tx=0x7f3bb8009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d653869d320aee5d server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:22.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.218+0000 7f3bcd559700 1 -- 172.21.15.72:0/4207217951 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bb8011830 con 0x7f3bc8151950 2023-07-25T14:36:22.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.218+0000 7f3bcd559700 1 -- 172.21.15.72:0/4207217951 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bb8011990 con 0x7f3bc8151950 2023-07-25T14:36:22.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.218+0000 7f3bcd559700 1 -- 172.21.15.72:0/4207217951 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bb8011d20 con 0x7f3bc8151950 2023-07-25T14:36:22.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.218+0000 7f3bd07bf700 1 -- 172.21.15.72:0/4207217951 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3bc8151950 msgr2=0x7f3bc806a190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:22.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.218+0000 7f3bd07bf700 1 --2- 172.21.15.72:0/4207217951 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3bc8151950 0x7f3bc806a190 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f3bc80acbc0 tx=0x7f3bb8009b20 comp rx=0 tx=0).stop 2023-07-25T14:36:22.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.218+0000 7f3bd07bf700 1 -- 172.21.15.72:0/4207217951 shutdown_connections 2023-07-25T14:36:22.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.218+0000 7f3bd07bf700 1 --2- 172.21.15.72:0/4207217951 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3bc8151950 0x7f3bc806a190 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:22.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.218+0000 7f3bd07bf700 1 --2- 172.21.15.72:0/4207217951 >> v2:172.21.15.92:3300/0 conn(0x7f3bc80724c0 0x7f3bc80c34c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:22.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.218+0000 7f3bd07bf700 1 -- 172.21.15.72:0/4207217951 >> 172.21.15.72:0/4207217951 conn(0x7f3bc80a87e0 msgr2=0x7f3bc80a8bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:22.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.218+0000 7f3bd07bf700 1 -- 172.21.15.72:0/4207217951 shutdown_connections 2023-07-25T14:36:22.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.218+0000 7f3bd07bf700 1 -- 172.21.15.72:0/4207217951 wait complete. 2023-07-25T14:36:22.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.219+0000 7f3bd07bf700 1 Processor -- start 2023-07-25T14:36:22.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.219+0000 7f3bd07bf700 1 -- start start 2023-07-25T14:36:22.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.220+0000 7f3bd07bf700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3bc806a6d0 0x7f3bc80a7c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:22.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.220+0000 7f3bd07bf700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3bc80724c0 0x7f3bc80be2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:22.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.220+0000 7f3bd07bf700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3bc8151950 0x7f3bc80bf560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:22.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.220+0000 7f3bd07bf700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bc80a71d0 con 0x7f3bc80724c0 2023-07-25T14:36:22.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.220+0000 7f3bd07bf700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bc8153550 con 0x7f3bc806a6d0 2023-07-25T14:36:22.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.220+0000 7f3bd07bf700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bc80a7470 con 0x7f3bc8151950 2023-07-25T14:36:22.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.220+0000 7f3bcdd5a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3bc80724c0 0x7f3bc80be2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:22.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.220+0000 7f3bcdd5a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3bc80724c0 0x7f3bc80be2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40954/0 (socket says 172.21.15.72:40954) 2023-07-25T14:36:22.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.220+0000 7f3bcdd5a700 1 -- 172.21.15.72:0/2310698170 learned_addr learned my addr 172.21.15.72:0/2310698170 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:22.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.220+0000 7f3bced5c700 1 --2- 172.21.15.72:0/2310698170 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3bc8151950 0x7f3bc80bf560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:22.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.220+0000 7f3bce55b700 1 --2- 172.21.15.72:0/2310698170 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3bc806a6d0 0x7f3bc80a7c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:22.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.220+0000 7f3bcdd5a700 1 -- 172.21.15.72:0/2310698170 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3bc8151950 msgr2=0x7f3bc80bf560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:22.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.220+0000 7f3bcdd5a700 1 --2- 172.21.15.72:0/2310698170 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3bc8151950 0x7f3bc80bf560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:22.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.220+0000 7f3bcdd5a700 1 -- 172.21.15.72:0/2310698170 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3bc806a6d0 msgr2=0x7f3bc80a7c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:22.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.220+0000 7f3bcdd5a700 1 --2- 172.21.15.72:0/2310698170 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3bc806a6d0 0x7f3bc80a7c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:22.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.220+0000 7f3bcdd5a700 1 -- 172.21.15.72:0/2310698170 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bb80094a0 con 0x7f3bc80724c0 2023-07-25T14:36:22.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.221+0000 7f3bced5c700 1 --2- 172.21.15.72:0/2310698170 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3bc8151950 0x7f3bc80bf560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-25T14:36:22.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.221+0000 7f3bce55b700 1 --2- 172.21.15.72:0/2310698170 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3bc806a6d0 0x7f3bc80a7c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-25T14:36:22.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.221+0000 7f3bcdd5a700 1 --2- 172.21.15.72:0/2310698170 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3bc80724c0 0x7f3bc80be2e0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f3bc400b530 tx=0x7f3bc400b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:22.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.221+0000 7f3bbeffd700 1 -- 172.21.15.72:0/2310698170 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bc4011830 con 0x7f3bc80724c0 2023-07-25T14:36:22.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.221+0000 7f3bbeffd700 1 -- 172.21.15.72:0/2310698170 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bc40119b0 con 0x7f3bc80724c0 2023-07-25T14:36:22.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.221+0000 7f3bbeffd700 1 -- 172.21.15.72:0/2310698170 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bc4011d60 con 0x7f3bc80724c0 2023-07-25T14:36:22.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.221+0000 7f3bd07bf700 1 -- 172.21.15.72:0/2310698170 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bc80a7750 con 0x7f3bc80724c0 2023-07-25T14:36:22.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.221+0000 7f3bd07bf700 1 -- 172.21.15.72:0/2310698170 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bc814b250 con 0x7f3bc80724c0 2023-07-25T14:36:22.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.222+0000 7f3bd07bf700 1 -- 172.21.15.72:0/2310698170 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bc80a7970 con 0x7f3bc80724c0 2023-07-25T14:36:22.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.222+0000 7f3bbeffd700 1 -- 172.21.15.72:0/2310698170 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3bc401a400 con 0x7f3bc80724c0 2023-07-25T14:36:22.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.223+0000 7f3bbeffd700 1 --2- 172.21.15.72:0/2310698170 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f3bac06ad10 0x7f3bac06d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:22.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.223+0000 7f3bce55b700 1 --2- 172.21.15.72:0/2310698170 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f3bac06ad10 0x7f3bac06d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:22.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.223+0000 7f3bbeffd700 1 -- 172.21.15.72:0/2310698170 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f3bc4089850 con 0x7f3bc80724c0 2023-07-25T14:36:22.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.223+0000 7f3bce55b700 1 --2- 172.21.15.72:0/2310698170 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f3bac06ad10 0x7f3bac06d1d0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f3bb80090b0 tx=0x7f3bb801c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:22.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.227+0000 7f3bbeffd700 1 -- 172.21.15.72:0/2310698170 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f3bc4054610 con 0x7f3bc80724c0 2023-07-25T14:36:22.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.413+0000 7f3bd07bf700 1 -- 172.21.15.72:0/2310698170 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3bc804e470 con 0x7f3bc80724c0 2023-07-25T14:36:22.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.413+0000 7f3bbeffd700 1 -- 172.21.15.72:0/2310698170 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3bc4057c30 con 0x7f3bc80724c0 2023-07-25T14:36:22.426 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 64 2023-07-25T14:36:22.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.416+0000 7f3bd07bf700 1 -- 172.21.15.72:0/2310698170 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f3bac06ad10 msgr2=0x7f3bac06d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:22.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.416+0000 7f3bd07bf700 1 --2- 172.21.15.72:0/2310698170 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f3bac06ad10 0x7f3bac06d1d0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f3bb80090b0 tx=0x7f3bb801c040 comp rx=0 tx=0).stop 2023-07-25T14:36:22.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.416+0000 7f3bd07bf700 1 -- 172.21.15.72:0/2310698170 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3bc80724c0 msgr2=0x7f3bc80be2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:22.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.416+0000 7f3bd07bf700 1 --2- 172.21.15.72:0/2310698170 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3bc80724c0 0x7f3bc80be2e0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f3bc400b530 tx=0x7f3bc400b8f0 comp rx=0 tx=0).stop 2023-07-25T14:36:22.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.416+0000 7f3bd07bf700 1 -- 172.21.15.72:0/2310698170 shutdown_connections 2023-07-25T14:36:22.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.416+0000 7f3bd07bf700 1 --2- 172.21.15.72:0/2310698170 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f3bac06ad10 0x7f3bac06d1d0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:22.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.416+0000 7f3bd07bf700 1 --2- 172.21.15.72:0/2310698170 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3bc8151950 0x7f3bc80bf560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:22.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.416+0000 7f3bd07bf700 1 --2- 172.21.15.72:0/2310698170 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3bc806a6d0 0x7f3bc80a7c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:22.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.416+0000 7f3bd07bf700 1 --2- 172.21.15.72:0/2310698170 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3bc80724c0 0x7f3bc80be2e0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:22.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.416+0000 7f3bd07bf700 1 -- 172.21.15.72:0/2310698170 >> 172.21.15.72:0/2310698170 conn(0x7f3bc80a87e0 msgr2=0x7f3bc80c45e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:22.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.416+0000 7f3bd07bf700 1 -- 172.21.15.72:0/2310698170 shutdown_connections 2023-07-25T14:36:22.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.416+0000 7f3bd07bf700 1 -- 172.21.15.72:0/2310698170 wait complete. 2023-07-25T14:36:22.439 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-07-25T14:36:22.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.551+0000 7f264303c700 1 Processor -- start 2023-07-25T14:36:22.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.551+0000 7f264303c700 1 -- start start 2023-07-25T14:36:22.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.552+0000 7f264303c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f263c06a190 0x7f263c15fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:22.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.552+0000 7f264303c700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f263c066050 con 0x7f263c06ed70 2023-07-25T14:36:22.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.552+0000 7f264303c700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f263c06b560 con 0x7f263c0bf5d0 2023-07-25T14:36:22.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.552+0000 7f264303c700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f263c151be0 con 0x7f263c06a190 2023-07-25T14:36:22.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.552+0000 7f263bfff700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f263c06ed70 0x7f263c0bf9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:59930/0 (socket says 172.21.15.72:59930) 2023-07-25T14:36:22.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.552+0000 7f263bfff700 1 -- 172.21.15.72:0/3253956289 learned_addr learned my addr 172.21.15.72:0/3253956289 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:36:22.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.552+0000 7f26415d9700 1 --2- 172.21.15.72:0/3253956289 >> v2:172.21.15.72:3300/0 conn(0x7f263c06a190 0x7f263c15fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:22.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.552+0000 7f263b7fe700 1 -- 172.21.15.72:0/3253956289 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 9491316 0 0) 0x7f263c066050 con 0x7f263c06ed70 2023-07-25T14:36:22.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.552+0000 7f263b7fe700 1 -- 172.21.15.72:0/3253956289 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f262c0035b0 con 0x7f263c06ed70 2023-07-25T14:36:22.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.552+0000 7f26415d9700 1 -- 172.21.15.72:0/3253956289 >> v1:172.21.15.92:6789/0 conn(0x7f263c0bf5d0 legacy=0x7f263c0a7490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:22.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.552+0000 7f26415d9700 1 -- 172.21.15.72:0/3253956289 >> v1:172.21.15.72:6789/0 conn(0x7f263c06ed70 legacy=0x7f263c0bf9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:22.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.552+0000 7f26415d9700 1 -- 172.21.15.72:0/3253956289 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f263c154d60 con 0x7f263c06a190 2023-07-25T14:36:22.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.553+0000 7f26415d9700 1 --2- 172.21.15.72:0/3253956289 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f263c06a190 0x7f263c15fbd0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f2634009d90 tx=0x7f263400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4474aa9b7d3ab6 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:22.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.553+0000 7f263b7fe700 1 -- 172.21.15.72:0/3253956289 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f263400e070 con 0x7f263c06a190 2023-07-25T14:36:22.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.553+0000 7f263b7fe700 1 -- 172.21.15.72:0/3253956289 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f263400bb20 con 0x7f263c06a190 2023-07-25T14:36:22.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.553+0000 7f263b7fe700 1 -- 172.21.15.72:0/3253956289 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2634012430 con 0x7f263c06a190 2023-07-25T14:36:22.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.553+0000 7f264303c700 1 -- 172.21.15.72:0/3253956289 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f263c06a190 msgr2=0x7f263c15fbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:22.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.553+0000 7f264303c700 1 --2- 172.21.15.72:0/3253956289 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f263c06a190 0x7f263c15fbd0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f2634009d90 tx=0x7f263400b330 comp rx=0 tx=0).stop 2023-07-25T14:36:22.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.553+0000 7f264303c700 1 -- 172.21.15.72:0/3253956289 shutdown_connections 2023-07-25T14:36:22.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.553+0000 7f264303c700 1 --2- 172.21.15.72:0/3253956289 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f263c06a190 0x7f263c15fbd0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:22.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.553+0000 7f264303c700 1 -- 172.21.15.72:0/3253956289 >> 172.21.15.72:0/3253956289 conn(0x7f263c06def0 msgr2=0x7f263c06e300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:22.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.553+0000 7f264303c700 1 -- 172.21.15.72:0/3253956289 shutdown_connections 2023-07-25T14:36:22.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.553+0000 7f264303c700 1 -- 172.21.15.72:0/3253956289 wait complete. 2023-07-25T14:36:22.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.554+0000 7f264303c700 1 Processor -- start 2023-07-25T14:36:22.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.554+0000 7f264303c700 1 -- start start 2023-07-25T14:36:22.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.555+0000 7f264303c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f263c06a190 0x7f263c1e00f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:22.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.555+0000 7f264303c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f263c06ed70 0x7f263c1580b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:22.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.555+0000 7f264303c700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f263c0bf5d0 0x7f263c1ed7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:22.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.555+0000 7f264303c700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f263c157230 con 0x7f263c06ed70 2023-07-25T14:36:22.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.555+0000 7f264303c700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f263c1ed330 con 0x7f263c06a190 2023-07-25T14:36:22.574 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.555+0000 7f264303c700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f263c1deeb0 con 0x7f263c0bf5d0 2023-07-25T14:36:22.574 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.555+0000 7f263bfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f263c06ed70 0x7f263c1580b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:22.574 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.555+0000 7f263bfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f263c06ed70 0x7f263c1580b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40968/0 (socket says 172.21.15.72:40968) 2023-07-25T14:36:22.574 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.555+0000 7f263bfff700 1 -- 172.21.15.72:0/1293529124 learned_addr learned my addr 172.21.15.72:0/1293529124 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:22.574 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.555+0000 7f2640dd8700 1 --2- 172.21.15.72:0/1293529124 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f263c06a190 0x7f263c1e00f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:22.574 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.555+0000 7f26415d9700 1 --2- 172.21.15.72:0/1293529124 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f263c0bf5d0 0x7f263c1ed7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:22.574 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.556+0000 7f263bfff700 1 -- 172.21.15.72:0/1293529124 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f263c0bf5d0 msgr2=0x7f263c1ed7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:22.574 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.556+0000 7f263bfff700 1 --2- 172.21.15.72:0/1293529124 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f263c0bf5d0 0x7f263c1ed7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:22.575 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.556+0000 7f263bfff700 1 -- 172.21.15.72:0/1293529124 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f263c06a190 msgr2=0x7f263c1e00f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:22.575 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.556+0000 7f263bfff700 1 --2- 172.21.15.72:0/1293529124 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f263c06a190 0x7f263c1e00f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:22.575 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.556+0000 7f263bfff700 1 -- 172.21.15.72:0/1293529124 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2634009a70 con 0x7f263c06ed70 2023-07-25T14:36:22.575 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.556+0000 7f26415d9700 1 --2- 172.21.15.72:0/1293529124 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f263c0bf5d0 0x7f263c1ed7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-25T14:36:22.575 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.556+0000 7f263bfff700 1 --2- 172.21.15.72:0/1293529124 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f263c06ed70 0x7f263c1580b0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f262800c730 tx=0x7f262800ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:22.575 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.556+0000 7f26397fa700 1 -- 172.21.15.72:0/1293529124 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2628005d70 con 0x7f263c06ed70 2023-07-25T14:36:22.575 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.556+0000 7f26397fa700 1 -- 172.21.15.72:0/1293529124 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26280070d0 con 0x7f263c06ed70 2023-07-25T14:36:22.575 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.556+0000 7f264303c700 1 -- 172.21.15.72:0/1293529124 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f263c1df120 con 0x7f263c06ed70 2023-07-25T14:36:22.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.556+0000 7f26397fa700 1 -- 172.21.15.72:0/1293529124 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2628007460 con 0x7f263c06ed70 2023-07-25T14:36:22.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.556+0000 7f264303c700 1 -- 172.21.15.72:0/1293529124 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f263c1df6e0 con 0x7f263c06ed70 2023-07-25T14:36:22.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.557+0000 7f264303c700 1 -- 172.21.15.72:0/1293529124 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f263c04e470 con 0x7f263c06ed70 2023-07-25T14:36:22.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.557+0000 7f26397fa700 1 -- 172.21.15.72:0/1293529124 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f26280075c0 con 0x7f263c06ed70 2023-07-25T14:36:22.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.558+0000 7f26397fa700 1 --2- 172.21.15.72:0/1293529124 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f262006ace0 0x7f262006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:22.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.558+0000 7f2640dd8700 1 --2- 172.21.15.72:0/1293529124 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f262006ace0 0x7f262006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:22.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.558+0000 7f26397fa700 1 -- 172.21.15.72:0/1293529124 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f2628088d60 con 0x7f263c06ed70 2023-07-25T14:36:22.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.558+0000 7f2640dd8700 1 --2- 172.21.15.72:0/1293529124 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f262006ace0 0x7f262006d1a0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f2630000f60 tx=0x7f2630009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:22.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.562+0000 7f26397fa700 1 -- 172.21.15.72:0/1293529124 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f2628053a80 con 0x7f263c06ed70 2023-07-25T14:36:22.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.748+0000 7f264303c700 1 -- 172.21.15.72:0/1293529124 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f263c0a8d80 con 0x7f263c06ed70 2023-07-25T14:36:22.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.749+0000 7f26397fa700 1 -- 172.21.15.72:0/1293529124 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+11 (secure 0 0 0) 0x7f26280570a0 con 0x7f263c06ed70 2023-07-25T14:36:22.761 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2023-07-25T14:36:22.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.751+0000 7f264303c700 1 -- 172.21.15.72:0/1293529124 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f262006ace0 msgr2=0x7f262006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:22.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.751+0000 7f264303c700 1 --2- 172.21.15.72:0/1293529124 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f262006ace0 0x7f262006d1a0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f2630000f60 tx=0x7f2630009040 comp rx=0 tx=0).stop 2023-07-25T14:36:22.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.751+0000 7f264303c700 1 -- 172.21.15.72:0/1293529124 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f263c06ed70 msgr2=0x7f263c1580b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:22.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.751+0000 7f264303c700 1 --2- 172.21.15.72:0/1293529124 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f263c06ed70 0x7f263c1580b0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f262800c730 tx=0x7f262800ca40 comp rx=0 tx=0).stop 2023-07-25T14:36:22.764 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.751+0000 7f264303c700 1 -- 172.21.15.72:0/1293529124 shutdown_connections 2023-07-25T14:36:22.764 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.751+0000 7f264303c700 1 --2- 172.21.15.72:0/1293529124 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f262006ace0 0x7f262006d1a0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:22.764 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.751+0000 7f264303c700 1 --2- 172.21.15.72:0/1293529124 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f263c0bf5d0 0x7f263c1ed7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:22.764 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.751+0000 7f264303c700 1 --2- 172.21.15.72:0/1293529124 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f263c06a190 0x7f263c1e00f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:22.764 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.751+0000 7f264303c700 1 --2- 172.21.15.72:0/1293529124 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f263c06ed70 0x7f263c1580b0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:22.764 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.751+0000 7f264303c700 1 -- 172.21.15.72:0/1293529124 >> 172.21.15.72:0/1293529124 conn(0x7f263c06def0 msgr2=0x7f263c0c4300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:22.764 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.751+0000 7f264303c700 1 -- 172.21.15.72:0/1293529124 shutdown_connections 2023-07-25T14:36:22.765 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.751+0000 7f264303c700 1 -- 172.21.15.72:0/1293529124 wait complete. 2023-07-25T14:36:22.775 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-25T14:36:22.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.882+0000 7fbba50a6700 1 Processor -- start 2023-07-25T14:36:22.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.882+0000 7fbba50a6700 1 -- start start 2023-07-25T14:36:22.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.883+0000 7fbba50a6700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fbba00c41b0 0x7fbba00c23b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:22.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.883+0000 7fbba50a6700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fbba006b2a0 0x7fbba006f540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:22.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.883+0000 7fbba50a6700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbba00c4690 con 0x7fbba00a6d80 2023-07-25T14:36:22.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.883+0000 7fbba50a6700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbba00c4f30 con 0x7fbba006b2a0 2023-07-25T14:36:22.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.883+0000 7fbba50a6700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbba00c4970 con 0x7fbba00c41b0 2023-07-25T14:36:22.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.883+0000 7fbb9ed9d700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fbba00a6d80 0x7fbba0154d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:59942/0 (socket says 172.21.15.72:59942) 2023-07-25T14:36:22.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.883+0000 7fbb9ed9d700 1 -- 172.21.15.72:0/3321486644 learned_addr learned my addr 172.21.15.72:0/3321486644 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:36:22.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.883+0000 7fbb9f59e700 1 --2- 172.21.15.72:0/3321486644 >> v2:172.21.15.72:3300/0 conn(0x7fbba006b2a0 0x7fbba006f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:22.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.883+0000 7fbb9e59c700 1 --2- 172.21.15.72:0/3321486644 >> v2:172.21.15.92:3300/0 conn(0x7fbba00c41b0 0x7fbba00c23b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:22.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.884+0000 7fbb9f59e700 1 -- 172.21.15.72:0/3321486644 >> v2:172.21.15.92:3300/0 conn(0x7fbba00c41b0 msgr2=0x7fbba00c23b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:22.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.884+0000 7fbb9f59e700 1 --2- 172.21.15.72:0/3321486644 >> v2:172.21.15.92:3300/0 conn(0x7fbba00c41b0 0x7fbba00c23b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:22.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.884+0000 7fbb9f59e700 1 -- 172.21.15.72:0/3321486644 >> v1:172.21.15.72:6789/0 conn(0x7fbba00a6d80 legacy=0x7fbba0154d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:22.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.884+0000 7fbb9f59e700 1 -- 172.21.15.72:0/3321486644 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbba00c4c50 con 0x7fbba006b2a0 2023-07-25T14:36:22.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.884+0000 7fbb9dd9b700 1 -- 172.21.15.72:0/3321486644 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 659753911 0 0) 0x7fbba00c4690 con 0x7fbba00a6d80 2023-07-25T14:36:22.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.884+0000 7fbb9f59e700 1 --2- 172.21.15.72:0/3321486644 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbba006b2a0 0x7fbba006f540 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fbba0072810 tx=0x7fbb9800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=376f88e099492e8e server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:22.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.884+0000 7fbb9dd9b700 1 -- 172.21.15.72:0/3321486644 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb9800e070 con 0x7fbba006b2a0 2023-07-25T14:36:22.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.884+0000 7fbb9dd9b700 1 -- 172.21.15.72:0/3321486644 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb9800bbd0 con 0x7fbba006b2a0 2023-07-25T14:36:22.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.884+0000 7fbb9dd9b700 1 -- 172.21.15.72:0/3321486644 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb98012430 con 0x7fbba006b2a0 2023-07-25T14:36:22.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.884+0000 7fbba50a6700 1 -- 172.21.15.72:0/3321486644 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbba006b2a0 msgr2=0x7fbba006f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:22.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.884+0000 7fbba50a6700 1 --2- 172.21.15.72:0/3321486644 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbba006b2a0 0x7fbba006f540 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fbba0072810 tx=0x7fbb9800b330 comp rx=0 tx=0).stop 2023-07-25T14:36:22.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.884+0000 7fbba50a6700 1 -- 172.21.15.72:0/3321486644 shutdown_connections 2023-07-25T14:36:22.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.884+0000 7fbba50a6700 1 --2- 172.21.15.72:0/3321486644 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbba006b2a0 0x7fbba006f540 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:22.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.884+0000 7fbba50a6700 1 --2- 172.21.15.72:0/3321486644 >> v2:172.21.15.92:3300/0 conn(0x7fbba00c41b0 0x7fbba00c23b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:22.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.884+0000 7fbba50a6700 1 -- 172.21.15.72:0/3321486644 >> 172.21.15.72:0/3321486644 conn(0x7fbba00a95a0 msgr2=0x7fbba00a9980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:22.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.884+0000 7fbba50a6700 1 -- 172.21.15.72:0/3321486644 shutdown_connections 2023-07-25T14:36:22.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.885+0000 7fbba50a6700 1 -- 172.21.15.72:0/3321486644 wait complete. 2023-07-25T14:36:22.903 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.886+0000 7fbba50a6700 1 Processor -- start 2023-07-25T14:36:22.903 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.886+0000 7fbba50a6700 1 -- start start 2023-07-25T14:36:22.903 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.887+0000 7fbba50a6700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbba006b2a0 0x7fbba01ea930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:22.903 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.887+0000 7fbba50a6700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbba00a6d80 0x7fbba01580d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:22.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.887+0000 7fbba50a6700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fbba00c41b0 0x7fbba01ecca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:22.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.887+0000 7fbba50a6700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbba01ed7c0 con 0x7fbba00a6d80 2023-07-25T14:36:22.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.887+0000 7fbba50a6700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbba00ac610 con 0x7fbba006b2a0 2023-07-25T14:36:22.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.887+0000 7fbba50a6700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbba0152280 con 0x7fbba00c41b0 2023-07-25T14:36:22.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.887+0000 7fbb9e59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbba00a6d80 0x7fbba01580d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:22.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.887+0000 7fbb9e59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbba00a6d80 0x7fbba01580d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40982/0 (socket says 172.21.15.72:40982) 2023-07-25T14:36:22.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.887+0000 7fbb9e59c700 1 -- 172.21.15.72:0/3686014975 learned_addr learned my addr 172.21.15.72:0/3686014975 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:22.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.887+0000 7fbb9f59e700 1 --2- 172.21.15.72:0/3686014975 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fbba00c41b0 0x7fbba01ecca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:22.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.887+0000 7fbb9e59c700 1 -- 172.21.15.72:0/3686014975 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fbba00c41b0 msgr2=0x7fbba01ecca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:22.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.887+0000 7fbb9e59c700 1 --2- 172.21.15.72:0/3686014975 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fbba00c41b0 0x7fbba01ecca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:22.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.887+0000 7fbb9ed9d700 1 --2- 172.21.15.72:0/3686014975 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbba006b2a0 0x7fbba01ea930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:22.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.887+0000 7fbb9e59c700 1 -- 172.21.15.72:0/3686014975 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbba006b2a0 msgr2=0x7fbba01ea930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:22.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.887+0000 7fbb9e59c700 1 --2- 172.21.15.72:0/3686014975 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbba006b2a0 0x7fbba01ea930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:22.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.887+0000 7fbb9e59c700 1 -- 172.21.15.72:0/3686014975 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb98009a70 con 0x7fbba00a6d80 2023-07-25T14:36:22.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.887+0000 7fbb9f59e700 1 --2- 172.21.15.72:0/3686014975 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fbba00c41b0 0x7fbba01ecca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-25T14:36:22.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.887+0000 7fbb9ed9d700 1 --2- 172.21.15.72:0/3686014975 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbba006b2a0 0x7fbba01ea930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-25T14:36:22.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.887+0000 7fbb9e59c700 1 --2- 172.21.15.72:0/3686014975 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbba00a6d80 0x7fbba01580d0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fbb9000d800 tx=0x7fbb9000dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:22.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.887+0000 7fbb877fe700 1 -- 172.21.15.72:0/3686014975 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb900125f0 con 0x7fbba00a6d80 2023-07-25T14:36:22.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.887+0000 7fbb877fe700 1 -- 172.21.15.72:0/3686014975 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb90012750 con 0x7fbba00a6d80 2023-07-25T14:36:22.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.887+0000 7fbba50a6700 1 -- 172.21.15.72:0/3686014975 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbba006f6b0 con 0x7fbba00a6d80 2023-07-25T14:36:22.907 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.887+0000 7fbb877fe700 1 -- 172.21.15.72:0/3686014975 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb90012b00 con 0x7fbba00a6d80 2023-07-25T14:36:22.907 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.887+0000 7fbba50a6700 1 -- 172.21.15.72:0/3686014975 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbba0158660 con 0x7fbba00a6d80 2023-07-25T14:36:22.907 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.888+0000 7fbba50a6700 1 -- 172.21.15.72:0/3686014975 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbba00ac750 con 0x7fbba00a6d80 2023-07-25T14:36:22.907 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.889+0000 7fbb877fe700 1 -- 172.21.15.72:0/3686014975 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fbb90012c60 con 0x7fbba00a6d80 2023-07-25T14:36:22.907 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.889+0000 7fbb877fe700 1 --2- 172.21.15.72:0/3686014975 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fbb8c06ace0 0x7fbb8c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:22.907 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.889+0000 7fbb877fe700 1 -- 172.21.15.72:0/3686014975 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fbb90089ad0 con 0x7fbba00a6d80 2023-07-25T14:36:22.907 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.889+0000 7fbb9ed9d700 1 --2- 172.21.15.72:0/3686014975 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fbb8c06ace0 0x7fbb8c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:22.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.889+0000 7fbb9ed9d700 1 --2- 172.21.15.72:0/3686014975 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fbb8c06ace0 0x7fbb8c06d1a0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fbb94000f60 tx=0x7fbb94009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:22.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:22.893+0000 7fbb877fe700 1 -- 172.21.15.72:0/3686014975 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fbba00ac750 con 0x7fbba00a6d80 2023-07-25T14:36:23.093 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.081+0000 7fbba50a6700 1 -- 172.21.15.72:0/3686014975 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbba00ac750 con 0x7fbba00a6d80 2023-07-25T14:36:23.094 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.082+0000 7fbb877fe700 1 -- 172.21.15.72:0/3686014975 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+20014 (secure 0 0 0) 0x7fbba00ac750 con 0x7fbba00a6d80 2023-07-25T14:36:23.095 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-25T14:36:23.095 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":25,"fsid":"9170db48-9170-43e8-8ccb-9813e6240906","created":"2023-07-25T14:35:21.733262+0000","modified":"2023-07-25T14:35:44.992669+0000","last_up_change":"2023-07-25T14:35:31.355010+0000","last_in_change":"2023-07-25T14:35:24.195785+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-25T14:35:32.983457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-25T14:35:33.326342+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-25T14:35:37.534158+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-25T14:35:38.891571+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-25T14:35:42.596923+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d517fdad-0bfe-49f0-89f2-9421c3761839","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6801","nonce":2475407414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6803","nonce":2475407414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6807","nonce":2475407414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6805","nonce":2475407414}]},"public_addr":"172.21.15.72:6801/2475407414","cluster_addr":"172.21.15.72:6803/2475407414","heartbeat_back_addr":"172.21.15.72:6807/2475407414","heartbeat_front_addr":"172.21.15.72:6805/2475407414","state":["exists","up"]},{"osd":1,"uuid":"e1564be3-f209-47e5-a8d0-32fc618a474f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6822","nonce":870954016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6825","nonce":870954016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6831","nonce":870954016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6827","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6829","nonce":870954016}]},"public_addr":"172.21.15.72:6822/870954016","cluster_addr":"172.21.15.72:6825/870954016","heartbeat_back_addr":"172.21.15.72:6831/870954016","heartbeat_front_addr":"172.21.15.72:6829/870954016","state":["exists","up"]},{"osd":2,"uuid":"c4647d30-ffa6-417a-9026-ef530c75910e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6809","nonce":2143129442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6811","nonce":2143129442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6815","nonce":2143129442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6813","nonce":2143129442}]},"public_addr":"172.21.15.72:6809/2143129442","cluster_addr":"172.21.15.72:6811/2143129442","heartbeat_back_addr":"172.21.15.72:6815/2143129442","heartbeat_front_addr":"172.21.15.72:6813/2143129442","state":["exists","up"]},{"osd":3,"uuid":"76c9d9a7-c2e2-4612-a58b-d6882dd76b58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6817","nonce":3404066311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6819","nonce":3404066311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6828","nonce":3404066311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6821","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6823","nonce":3404066311}]},"public_addr":"172.21.15.72:6817/3404066311","cluster_addr":"172.21.15.72:6819/3404066311","heartbeat_back_addr":"172.21.15.72:6828/3404066311","heartbeat_front_addr":"172.21.15.72:6823/3404066311","state":["exists","up"]},{"osd":4,"uuid":"7f8920dc-0ad4-4a73-ab40-65408f83eadd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6817","nonce":2381008739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6819","nonce":2381008739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6825","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6827","nonce":2381008739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6822","nonce":2381008739}]},"public_addr":"172.21.15.92:6817/2381008739","cluster_addr":"172.21.15.92:6819/2381008739","heartbeat_back_addr":"172.21.15.92:6827/2381008739","heartbeat_front_addr":"172.21.15.92:6822/2381008739","state":["exists","up"]},{"osd":5,"uuid":"56257e7c-31eb-44c5-9ec7-1318a4e0bb35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6801","nonce":2161935604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6803","nonce":2161935604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6807","nonce":2161935604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6805","nonce":2161935604}]},"public_addr":"172.21.15.92:6801/2161935604","cluster_addr":"172.21.15.92:6803/2161935604","heartbeat_back_addr":"172.21.15.92:6807/2161935604","heartbeat_front_addr":"172.21.15.92:6805/2161935604","state":["exists","up"]},{"osd":6,"uuid":"a150d3d8-a0c9-4955-968a-8d98eff4ffb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6809","nonce":3770163493}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6811","nonce":3770163493}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6815","nonce":3770163493}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6813","nonce":3770163493}]},"public_addr":"172.21.15.92:6809/3770163493","cluster_addr":"172.21.15.92:6811/3770163493","heartbeat_back_addr":"172.21.15.92:6815/3770163493","heartbeat_front_addr":"172.21.15.92:6813/3770163493","state":["exists","up"]},{"osd":7,"uuid":"07799c27-54ee-4591-a42d-a978d6b32065","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6821","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6823","nonce":2135777609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6826","nonce":2135777609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6831","nonce":2135777609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6829","nonce":2135777609}]},"public_addr":"172.21.15.92:6823/2135777609","cluster_addr":"172.21.15.92:6826/2135777609","heartbeat_back_addr":"172.21.15.92:6831/2135777609","heartbeat_front_addr":"172.21.15.92:6829/2135777609","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.345365+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.378150+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.146566+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.372172+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:30.398421+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.385632+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.465611+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.443583+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-25T14:36:23.097 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.084+0000 7fbba50a6700 1 -- 172.21.15.72:0/3686014975 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fbb8c06ace0 msgr2=0x7fbb8c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:23.097 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.084+0000 7fbba50a6700 1 --2- 172.21.15.72:0/3686014975 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fbb8c06ace0 0x7fbb8c06d1a0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fbb94000f60 tx=0x7fbb94009040 comp rx=0 tx=0).stop 2023-07-25T14:36:23.097 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.084+0000 7fbba50a6700 1 -- 172.21.15.72:0/3686014975 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbba00a6d80 msgr2=0x7fbba01580d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:23.097 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.084+0000 7fbba50a6700 1 --2- 172.21.15.72:0/3686014975 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbba00a6d80 0x7fbba01580d0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fbb9000d800 tx=0x7fbb9000dbc0 comp rx=0 tx=0).stop 2023-07-25T14:36:23.097 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.084+0000 7fbba50a6700 1 -- 172.21.15.72:0/3686014975 shutdown_connections 2023-07-25T14:36:23.097 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.084+0000 7fbba50a6700 1 --2- 172.21.15.72:0/3686014975 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fbb8c06ace0 0x7fbb8c06d1a0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:23.097 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.084+0000 7fbba50a6700 1 --2- 172.21.15.72:0/3686014975 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fbba00c41b0 0x7fbba01ecca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:23.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.084+0000 7fbba50a6700 1 --2- 172.21.15.72:0/3686014975 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbba006b2a0 0x7fbba01ea930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:23.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.084+0000 7fbba50a6700 1 --2- 172.21.15.72:0/3686014975 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbba00a6d80 0x7fbba01580d0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:23.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.084+0000 7fbba50a6700 1 -- 172.21.15.72:0/3686014975 >> 172.21.15.72:0/3686014975 conn(0x7fbba00a95a0 msgr2=0x7fbba00c5b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:23.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.084+0000 7fbba50a6700 1 -- 172.21.15.72:0/3686014975 shutdown_connections 2023-07-25T14:36:23.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.084+0000 7fbba50a6700 1 -- 172.21.15.72:0/3686014975 wait complete. 2023-07-25T14:36:23.109 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-07-25T14:35:32.983457+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-07-25T14:35:33.326342+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-25T14:35:37.534158+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-25T14:35:38.891571+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-07-25T14:35:42.596923+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-25T14:36:23.110 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-25T14:36:23.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.220+0000 7f8f99de0700 1 Processor -- start 2023-07-25T14:36:23.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.220+0000 7f8f99de0700 1 -- start start 2023-07-25T14:36:23.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.221+0000 7f8f99de0700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8f940724c0 0x7f8f940c34c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:23.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.221+0000 7f8f99de0700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8f940c4930 0x7f8f940c3a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:23.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.221+0000 7f8f99de0700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f940c2fe0 con 0x7f8f94151950 2023-07-25T14:36:23.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.221+0000 7f8f99de0700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f94071a60 con 0x7f8f940c4930 2023-07-25T14:36:23.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.221+0000 7f8f99de0700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f940c2a70 con 0x7f8f940724c0 2023-07-25T14:36:23.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.221+0000 7f8f93fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8f940c4930 0x7f8f940c3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:23.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.221+0000 7f8f93fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8f940c4930 0x7f8f940c3a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40992/0 (socket says 172.21.15.72:40992) 2023-07-25T14:36:23.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.221+0000 7f8f937fe700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f8f94151950 0x7f8f9406a190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:59956/0 (socket says 172.21.15.72:59956) 2023-07-25T14:36:23.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.221+0000 7f8f93fff700 1 -- 172.21.15.72:0/2353508765 learned_addr learned my addr 172.21.15.72:0/2353508765 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:23.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.221+0000 7f8f92ffd700 1 --2- 172.21.15.72:0/2353508765 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8f940724c0 0x7f8f940c34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:23.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.221+0000 7f8f93fff700 1 -- 172.21.15.72:0/2353508765 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8f940724c0 msgr2=0x7f8f940c34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:23.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.221+0000 7f8f93fff700 1 --2- 172.21.15.72:0/2353508765 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8f940724c0 0x7f8f940c34c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:23.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.221+0000 7f8f93fff700 1 -- 172.21.15.72:0/2353508765 >> v1:172.21.15.72:6789/0 conn(0x7f8f94151950 legacy=0x7f8f9406a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:23.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.222+0000 7f8f927fc700 1 -- 172.21.15.72:0/2353508765 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3235140255 0 0) 0x7f8f940c2fe0 con 0x7f8f94151950 2023-07-25T14:36:23.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.222+0000 7f8f93fff700 1 -- 172.21.15.72:0/2353508765 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f94155070 con 0x7f8f940c4930 2023-07-25T14:36:23.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.222+0000 7f8f93fff700 1 --2- 172.21.15.72:0/2353508765 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8f940c4930 0x7f8f940c3a00 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f8f8c009e50 tx=0x7f8f8c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1e30848f8e179f1 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:23.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.222+0000 7f8f927fc700 1 -- 172.21.15.72:0/2353508765 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f8c00e070 con 0x7f8f940c4930 2023-07-25T14:36:23.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.222+0000 7f8f927fc700 1 -- 172.21.15.72:0/2353508765 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f8c00b9c0 con 0x7f8f940c4930 2023-07-25T14:36:23.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.222+0000 7f8f927fc700 1 -- 172.21.15.72:0/2353508765 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f8c00bd70 con 0x7f8f940c4930 2023-07-25T14:36:23.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.222+0000 7f8f99de0700 1 -- 172.21.15.72:0/2353508765 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8f940c4930 msgr2=0x7f8f940c3a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:23.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.222+0000 7f8f99de0700 1 --2- 172.21.15.72:0/2353508765 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8f940c4930 0x7f8f940c3a00 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f8f8c009e50 tx=0x7f8f8c00b330 comp rx=0 tx=0).stop 2023-07-25T14:36:23.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.222+0000 7f8f99de0700 1 -- 172.21.15.72:0/2353508765 shutdown_connections 2023-07-25T14:36:23.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.222+0000 7f8f99de0700 1 --2- 172.21.15.72:0/2353508765 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8f940c4930 0x7f8f940c3a00 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:23.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.222+0000 7f8f99de0700 1 --2- 172.21.15.72:0/2353508765 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8f940724c0 0x7f8f940c34c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:23.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.222+0000 7f8f99de0700 1 -- 172.21.15.72:0/2353508765 >> 172.21.15.72:0/2353508765 conn(0x7f8f940a87e0 msgr2=0x7f8f940a8bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:23.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.222+0000 7f8f99de0700 1 -- 172.21.15.72:0/2353508765 shutdown_connections 2023-07-25T14:36:23.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.222+0000 7f8f99de0700 1 -- 172.21.15.72:0/2353508765 wait complete. 2023-07-25T14:36:23.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.223+0000 7f8f99de0700 1 Processor -- start 2023-07-25T14:36:23.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.224+0000 7f8f99de0700 1 -- start start 2023-07-25T14:36:23.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.224+0000 7f8f99de0700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8f940724c0 0x7f8f9414e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:23.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.224+0000 7f8f99de0700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8f940c4930 0x7f8f941557d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:23.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.224+0000 7f8f99de0700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8f94151950 0x7f8f941eadd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:23.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.224+0000 7f8f99de0700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f940a9770 con 0x7f8f94151950 2023-07-25T14:36:23.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.224+0000 7f8f99de0700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f940bfb00 con 0x7f8f940724c0 2023-07-25T14:36:23.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.224+0000 7f8f99de0700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f940c0360 con 0x7f8f940c4930 2023-07-25T14:36:23.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.224+0000 7f8f93fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8f94151950 0x7f8f941eadd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:23.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.224+0000 7f8f93fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8f94151950 0x7f8f941eadd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:40998/0 (socket says 172.21.15.72:40998) 2023-07-25T14:36:23.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.224+0000 7f8f93fff700 1 -- 172.21.15.72:0/2385009342 learned_addr learned my addr 172.21.15.72:0/2385009342 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:23.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.225+0000 7f8f92ffd700 1 --2- 172.21.15.72:0/2385009342 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8f940c4930 0x7f8f941557d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:23.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.225+0000 7f8f937fe700 1 --2- 172.21.15.72:0/2385009342 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8f940724c0 0x7f8f9414e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:23.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.225+0000 7f8f93fff700 1 -- 172.21.15.72:0/2385009342 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8f940c4930 msgr2=0x7f8f941557d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:23.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.225+0000 7f8f93fff700 1 --2- 172.21.15.72:0/2385009342 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8f940c4930 0x7f8f941557d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:23.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.225+0000 7f8f93fff700 1 -- 172.21.15.72:0/2385009342 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8f940724c0 msgr2=0x7f8f9414e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:23.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.225+0000 7f8f93fff700 1 --2- 172.21.15.72:0/2385009342 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8f940724c0 0x7f8f9414e5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:23.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.225+0000 7f8f93fff700 1 -- 172.21.15.72:0/2385009342 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f8c009b30 con 0x7f8f94151950 2023-07-25T14:36:23.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.225+0000 7f8f937fe700 1 --2- 172.21.15.72:0/2385009342 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8f940724c0 0x7f8f9414e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-25T14:36:23.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.225+0000 7f8f93fff700 1 --2- 172.21.15.72:0/2385009342 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8f94151950 0x7f8f941eadd0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f8f8c00b730 tx=0x7f8f8c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:23.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.225+0000 7f8f7bfff700 1 -- 172.21.15.72:0/2385009342 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f8c003ea0 con 0x7f8f94151950 2023-07-25T14:36:23.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.225+0000 7f8f7bfff700 1 -- 172.21.15.72:0/2385009342 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f8c0099b0 con 0x7f8f94151950 2023-07-25T14:36:23.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.225+0000 7f8f99de0700 1 -- 172.21.15.72:0/2385009342 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f9414e2e0 con 0x7f8f94151950 2023-07-25T14:36:23.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.225+0000 7f8f7bfff700 1 -- 172.21.15.72:0/2385009342 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f8c01c680 con 0x7f8f94151950 2023-07-25T14:36:23.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.225+0000 7f8f99de0700 1 -- 172.21.15.72:0/2385009342 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f940bfff0 con 0x7f8f94151950 2023-07-25T14:36:23.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.226+0000 7f8f99de0700 1 -- 172.21.15.72:0/2385009342 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f940c0180 con 0x7f8f94151950 2023-07-25T14:36:23.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.226+0000 7f8f7bfff700 1 -- 172.21.15.72:0/2385009342 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8f8c01c7e0 con 0x7f8f94151950 2023-07-25T14:36:23.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.227+0000 7f8f7bfff700 1 --2- 172.21.15.72:0/2385009342 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f8f8006ace0 0x7f8f8006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:23.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.227+0000 7f8f7bfff700 1 -- 172.21.15.72:0/2385009342 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f8f8c08b190 con 0x7f8f94151950 2023-07-25T14:36:23.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.227+0000 7f8f937fe700 1 --2- 172.21.15.72:0/2385009342 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f8f8006ace0 0x7f8f8006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:23.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.227+0000 7f8f937fe700 1 --2- 172.21.15.72:0/2385009342 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f8f8006ace0 0x7f8f8006d1a0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f8f88007fd0 tx=0x7f8f88009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:23.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.231+0000 7f8f7bfff700 1 -- 172.21.15.72:0/2385009342 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f8f8c055fe0 con 0x7f8f94151950 2023-07-25T14:36:23.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.417+0000 7f8f99de0700 1 -- 172.21.15.72:0/2385009342 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f8f940a81c0 con 0x7f8f94151950 2023-07-25T14:36:23.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.418+0000 7f8f7bfff700 1 -- 172.21.15.72:0/2385009342 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7f8f8c059600 con 0x7f8f94151950 2023-07-25T14:36:23.431 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 8 2023-07-25T14:36:23.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.420+0000 7f8f99de0700 1 -- 172.21.15.72:0/2385009342 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f8f8006ace0 msgr2=0x7f8f8006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:23.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.420+0000 7f8f99de0700 1 --2- 172.21.15.72:0/2385009342 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f8f8006ace0 0x7f8f8006d1a0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f8f88007fd0 tx=0x7f8f88009040 comp rx=0 tx=0).stop 2023-07-25T14:36:23.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.420+0000 7f8f99de0700 1 -- 172.21.15.72:0/2385009342 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8f94151950 msgr2=0x7f8f941eadd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:23.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.420+0000 7f8f99de0700 1 --2- 172.21.15.72:0/2385009342 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8f94151950 0x7f8f941eadd0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f8f8c00b730 tx=0x7f8f8c004ad0 comp rx=0 tx=0).stop 2023-07-25T14:36:23.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.420+0000 7f8f99de0700 1 -- 172.21.15.72:0/2385009342 shutdown_connections 2023-07-25T14:36:23.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.420+0000 7f8f99de0700 1 --2- 172.21.15.72:0/2385009342 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f8f8006ace0 0x7f8f8006d1a0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:23.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.420+0000 7f8f99de0700 1 --2- 172.21.15.72:0/2385009342 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8f94151950 0x7f8f941eadd0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:23.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.420+0000 7f8f99de0700 1 --2- 172.21.15.72:0/2385009342 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8f940724c0 0x7f8f9414e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:23.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.420+0000 7f8f99de0700 1 --2- 172.21.15.72:0/2385009342 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8f940c4930 0x7f8f941557d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:23.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.420+0000 7f8f99de0700 1 -- 172.21.15.72:0/2385009342 >> 172.21.15.72:0/2385009342 conn(0x7f8f940a87e0 msgr2=0x7f8f9414f510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:23.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.420+0000 7f8f99de0700 1 -- 172.21.15.72:0/2385009342 shutdown_connections 2023-07-25T14:36:23.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.420+0000 7f8f99de0700 1 -- 172.21.15.72:0/2385009342 wait complete. 2023-07-25T14:36:23.445 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-25T14:36:23.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.556+0000 7fcf7b214700 1 Processor -- start 2023-07-25T14:36:23.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.556+0000 7fcf7b214700 1 -- start start 2023-07-25T14:36:23.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.557+0000 7fcf7b214700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fcf740c5f40 0x7fcf74154640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:23.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.558+0000 7fcf7b214700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fcf740ba0e0 0x7fcf74154b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:23.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.558+0000 7fcf7b214700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf740c54f0 con 0x7fcf74151ba0 2023-07-25T14:36:23.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.558+0000 7fcf7b214700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf740c6670 con 0x7fcf740ba0e0 2023-07-25T14:36:23.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.558+0000 7fcf7b214700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf740c5740 con 0x7fcf740c5f40 2023-07-25T14:36:23.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.558+0000 7fcf797b1700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fcf740ba0e0 0x7fcf74154b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:23.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.558+0000 7fcf797b1700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fcf740ba0e0 0x7fcf74154b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41006/0 (socket says 172.21.15.72:41006) 2023-07-25T14:36:23.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.558+0000 7fcf797b1700 1 -- 172.21.15.72:0/1645212409 learned_addr learned my addr 172.21.15.72:0/1645212409 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:23.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.558+0000 7fcf73fff700 1 --2- 172.21.15.72:0/1645212409 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fcf740c5f40 0x7fcf74154640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:23.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.558+0000 7fcf797b1700 1 -- 172.21.15.72:0/1645212409 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fcf740c5f40 msgr2=0x7fcf74154640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:23.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.558+0000 7fcf797b1700 1 --2- 172.21.15.72:0/1645212409 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fcf740c5f40 0x7fcf74154640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:23.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.558+0000 7fcf797b1700 1 -- 172.21.15.72:0/1645212409 >> v1:172.21.15.92:6789/0 conn(0x7fcf74151ba0 legacy=0x7fcf740c2230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:23.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.558+0000 7fcf797b1700 1 -- 172.21.15.72:0/1645212409 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf740c5a20 con 0x7fcf740ba0e0 2023-07-25T14:36:23.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.558+0000 7fcf797b1700 1 --2- 172.21.15.72:0/1645212409 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcf740ba0e0 0x7fcf74154b80 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fcf6c009e50 tx=0x7fcf6c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c702d19e78180ff1 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:23.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.558+0000 7fcf737fe700 1 -- 172.21.15.72:0/1645212409 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf6c00e070 con 0x7fcf740ba0e0 2023-07-25T14:36:23.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.558+0000 7fcf737fe700 1 -- 172.21.15.72:0/1645212409 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf6c00b9c0 con 0x7fcf740ba0e0 2023-07-25T14:36:23.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.558+0000 7fcf737fe700 1 -- 172.21.15.72:0/1645212409 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf6c00bd70 con 0x7fcf740ba0e0 2023-07-25T14:36:23.575 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.559+0000 7fcf7b214700 1 -- 172.21.15.72:0/1645212409 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcf740ba0e0 msgr2=0x7fcf74154b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:23.575 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.559+0000 7fcf7b214700 1 --2- 172.21.15.72:0/1645212409 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcf740ba0e0 0x7fcf74154b80 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fcf6c009e50 tx=0x7fcf6c00b330 comp rx=0 tx=0).stop 2023-07-25T14:36:23.575 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.559+0000 7fcf7b214700 1 -- 172.21.15.72:0/1645212409 shutdown_connections 2023-07-25T14:36:23.575 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.559+0000 7fcf7b214700 1 --2- 172.21.15.72:0/1645212409 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcf740ba0e0 0x7fcf74154b80 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:23.575 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.559+0000 7fcf7b214700 1 --2- 172.21.15.72:0/1645212409 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fcf740c5f40 0x7fcf74154640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:23.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.559+0000 7fcf7b214700 1 -- 172.21.15.72:0/1645212409 >> 172.21.15.72:0/1645212409 conn(0x7fcf740a87e0 msgr2=0x7fcf740a8bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:23.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.559+0000 7fcf7b214700 1 -- 172.21.15.72:0/1645212409 shutdown_connections 2023-07-25T14:36:23.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.559+0000 7fcf7b214700 1 -- 172.21.15.72:0/1645212409 wait complete. 2023-07-25T14:36:23.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.560+0000 7fcf7b214700 1 Processor -- start 2023-07-25T14:36:23.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.560+0000 7fcf7b214700 1 -- start start 2023-07-25T14:36:23.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.561+0000 7fcf7b214700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcf740ba0e0 0x7fcf74071b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:23.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.561+0000 7fcf7b214700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcf740c5f40 0x7fcf740bc2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:23.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.561+0000 7fcf7b214700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fcf74151ba0 0x7fcf740bc810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:23.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.561+0000 7fcf7b214700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf740b98c0 con 0x7fcf740ba0e0 2023-07-25T14:36:23.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.561+0000 7fcf7b214700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf741dba50 con 0x7fcf740c5f40 2023-07-25T14:36:23.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.561+0000 7fcf7b214700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf740ac040 con 0x7fcf74151ba0 2023-07-25T14:36:23.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.561+0000 7fcf78fb0700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcf740ba0e0 0x7fcf74071b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:23.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.561+0000 7fcf78fb0700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcf740ba0e0 0x7fcf74071b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41008/0 (socket says 172.21.15.72:41008) 2023-07-25T14:36:23.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.561+0000 7fcf78fb0700 1 -- 172.21.15.72:0/3443887697 learned_addr learned my addr 172.21.15.72:0/3443887697 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:23.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.561+0000 7fcf797b1700 1 --2- 172.21.15.72:0/3443887697 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fcf74151ba0 0x7fcf740bc810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:23.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.561+0000 7fcf73fff700 1 --2- 172.21.15.72:0/3443887697 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcf740c5f40 0x7fcf740bc2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:23.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.561+0000 7fcf78fb0700 1 -- 172.21.15.72:0/3443887697 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fcf74151ba0 msgr2=0x7fcf740bc810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:23.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.561+0000 7fcf78fb0700 1 --2- 172.21.15.72:0/3443887697 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fcf74151ba0 0x7fcf740bc810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:23.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.561+0000 7fcf78fb0700 1 -- 172.21.15.72:0/3443887697 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcf740c5f40 msgr2=0x7fcf740bc2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:23.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.561+0000 7fcf78fb0700 1 --2- 172.21.15.72:0/3443887697 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcf740c5f40 0x7fcf740bc2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:23.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.561+0000 7fcf78fb0700 1 -- 172.21.15.72:0/3443887697 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf6c009b30 con 0x7fcf740ba0e0 2023-07-25T14:36:23.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.561+0000 7fcf78fb0700 1 --2- 172.21.15.72:0/3443887697 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcf740ba0e0 0x7fcf74071b50 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fcf6800c450 tx=0x7fcf6800c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:23.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.562+0000 7fcf717fa700 1 -- 172.21.15.72:0/3443887697 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf680052d0 con 0x7fcf740ba0e0 2023-07-25T14:36:23.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.562+0000 7fcf717fa700 1 -- 172.21.15.72:0/3443887697 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf68005430 con 0x7fcf740ba0e0 2023-07-25T14:36:23.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.562+0000 7fcf7b214700 1 -- 172.21.15.72:0/3443887697 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf740b95e0 con 0x7fcf740ba0e0 2023-07-25T14:36:23.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.562+0000 7fcf717fa700 1 -- 172.21.15.72:0/3443887697 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf680038c0 con 0x7fcf740ba0e0 2023-07-25T14:36:23.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.562+0000 7fcf7b214700 1 -- 172.21.15.72:0/3443887697 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf7406f790 con 0x7fcf740ba0e0 2023-07-25T14:36:23.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.562+0000 7fcf7b214700 1 -- 172.21.15.72:0/3443887697 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf740bbc10 con 0x7fcf740ba0e0 2023-07-25T14:36:23.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.563+0000 7fcf717fa700 1 -- 172.21.15.72:0/3443887697 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fcf68003a20 con 0x7fcf740ba0e0 2023-07-25T14:36:23.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.563+0000 7fcf717fa700 1 --2- 172.21.15.72:0/3443887697 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fcf5806ace0 0x7fcf5806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:23.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.564+0000 7fcf73fff700 1 --2- 172.21.15.72:0/3443887697 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fcf5806ace0 0x7fcf5806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:23.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.564+0000 7fcf717fa700 1 -- 172.21.15.72:0/3443887697 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fcf68088b50 con 0x7fcf740ba0e0 2023-07-25T14:36:23.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.564+0000 7fcf73fff700 1 --2- 172.21.15.72:0/3443887697 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fcf5806ace0 0x7fcf5806d1a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fcf740c6320 tx=0x7fcf60008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:23.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.568+0000 7fcf717fa700 1 -- 172.21.15.72:0/3443887697 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fcf740bbc10 con 0x7fcf740ba0e0 2023-07-25T14:36:23.766 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.754+0000 7fcf7b214700 1 -- 172.21.15.72:0/3443887697 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fcf740bbff0 con 0x7fcf740ba0e0 2023-07-25T14:36:23.766 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.754+0000 7fcf717fa700 1 -- 172.21.15.72:0/3443887697 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7fcf68017020 con 0x7fcf740ba0e0 2023-07-25T14:36:23.766 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 1 2023-07-25T14:36:23.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.756+0000 7fcf7b214700 1 -- 172.21.15.72:0/3443887697 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fcf5806ace0 msgr2=0x7fcf5806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:23.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.756+0000 7fcf7b214700 1 --2- 172.21.15.72:0/3443887697 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fcf5806ace0 0x7fcf5806d1a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fcf740c6320 tx=0x7fcf60008040 comp rx=0 tx=0).stop 2023-07-25T14:36:23.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.756+0000 7fcf7b214700 1 -- 172.21.15.72:0/3443887697 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcf740ba0e0 msgr2=0x7fcf74071b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:23.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.756+0000 7fcf7b214700 1 --2- 172.21.15.72:0/3443887697 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcf740ba0e0 0x7fcf74071b50 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fcf6800c450 tx=0x7fcf6800c810 comp rx=0 tx=0).stop 2023-07-25T14:36:23.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.756+0000 7fcf7b214700 1 -- 172.21.15.72:0/3443887697 shutdown_connections 2023-07-25T14:36:23.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.756+0000 7fcf7b214700 1 --2- 172.21.15.72:0/3443887697 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fcf5806ace0 0x7fcf5806d1a0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:23.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.756+0000 7fcf7b214700 1 --2- 172.21.15.72:0/3443887697 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fcf74151ba0 0x7fcf740bc810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:23.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.756+0000 7fcf7b214700 1 --2- 172.21.15.72:0/3443887697 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcf740ba0e0 0x7fcf74071b50 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:23.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.756+0000 7fcf7b214700 1 --2- 172.21.15.72:0/3443887697 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcf740c5f40 0x7fcf740bc2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:23.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.756+0000 7fcf7b214700 1 -- 172.21.15.72:0/3443887697 >> 172.21.15.72:0/3443887697 conn(0x7fcf740a87e0 msgr2=0x7fcf74150130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:23.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.756+0000 7fcf7b214700 1 -- 172.21.15.72:0/3443887697 shutdown_connections 2023-07-25T14:36:23.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.756+0000 7fcf7b214700 1 -- 172.21.15.72:0/3443887697 wait complete. 2023-07-25T14:36:23.780 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-25T14:36:23.902 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.890+0000 7f3b208d8700 1 Processor -- start 2023-07-25T14:36:23.902 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.890+0000 7f3b208d8700 1 -- start start 2023-07-25T14:36:23.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.891+0000 7f3b208d8700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3b1c151a50 0x7f3b1c0c3110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:23.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.891+0000 7f3b208d8700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f3b1c0c1850 0x7f3b1c06a190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:23.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.891+0000 7f3b208d8700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b1c0c2410 con 0x7f3b1c06a6d0 2023-07-25T14:36:23.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.891+0000 7f3b208d8700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b1c0c20e0 con 0x7f3b1c0c1850 2023-07-25T14:36:23.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.891+0000 7f3b208d8700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b1c151e30 con 0x7f3b1c151a50 2023-07-25T14:36:23.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.891+0000 7f3b19d9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f3b1c0c1850 0x7f3b1c06a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:23.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.891+0000 7f3b19d9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f3b1c0c1850 0x7f3b1c06a190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41016/0 (socket says 172.21.15.72:41016) 2023-07-25T14:36:23.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.891+0000 7f3b1ad9d700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f3b1c06a6d0 0x7f3b1c157980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:59984/0 (socket says 172.21.15.72:59984) 2023-07-25T14:36:23.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.891+0000 7f3b19d9b700 1 -- 172.21.15.72:0/2309079664 learned_addr learned my addr 172.21.15.72:0/2309079664 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:23.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.891+0000 7f3b1a59c700 1 --2- 172.21.15.72:0/2309079664 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3b1c151a50 0x7f3b1c0c3110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:23.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.891+0000 7f3b19d9b700 1 -- 172.21.15.72:0/2309079664 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3b1c151a50 msgr2=0x7f3b1c0c3110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:23.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.891+0000 7f3b19d9b700 1 --2- 172.21.15.72:0/2309079664 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3b1c151a50 0x7f3b1c0c3110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:23.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.891+0000 7f3b19d9b700 1 -- 172.21.15.72:0/2309079664 >> v1:172.21.15.72:6789/0 conn(0x7f3b1c06a6d0 legacy=0x7f3b1c157980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:23.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.891+0000 7f3b19d9b700 1 -- 172.21.15.72:0/2309079664 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b1c0c1290 con 0x7f3b1c0c1850 2023-07-25T14:36:23.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.891+0000 7f3b1959a700 1 -- 172.21.15.72:0/2309079664 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2820161467 0 0) 0x7f3b1c0c2410 con 0x7f3b1c06a6d0 2023-07-25T14:36:23.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.892+0000 7f3b19d9b700 1 --2- 172.21.15.72:0/2309079664 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3b1c0c1850 0x7f3b1c06a190 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f3b0c0098f0 tx=0x7f3b0c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afbcebbc79405b71 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:23.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.892+0000 7f3b1959a700 1 -- 172.21.15.72:0/2309079664 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b0c00b8a0 con 0x7f3b1c0c1850 2023-07-25T14:36:23.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.892+0000 7f3b1959a700 1 -- 172.21.15.72:0/2309079664 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b0c00ba00 con 0x7f3b1c0c1850 2023-07-25T14:36:23.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.892+0000 7f3b1959a700 1 -- 172.21.15.72:0/2309079664 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b0c00bd90 con 0x7f3b1c0c1850 2023-07-25T14:36:23.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.892+0000 7f3b208d8700 1 -- 172.21.15.72:0/2309079664 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3b1c0c1850 msgr2=0x7f3b1c06a190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:23.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.892+0000 7f3b208d8700 1 --2- 172.21.15.72:0/2309079664 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3b1c0c1850 0x7f3b1c06a190 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f3b0c0098f0 tx=0x7f3b0c009c00 comp rx=0 tx=0).stop 2023-07-25T14:36:23.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.892+0000 7f3b208d8700 1 -- 172.21.15.72:0/2309079664 shutdown_connections 2023-07-25T14:36:23.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.892+0000 7f3b208d8700 1 --2- 172.21.15.72:0/2309079664 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3b1c151a50 0x7f3b1c0c3110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:23.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.892+0000 7f3b208d8700 1 --2- 172.21.15.72:0/2309079664 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3b1c0c1850 0x7f3b1c06a190 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:23.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.892+0000 7f3b208d8700 1 -- 172.21.15.72:0/2309079664 >> 172.21.15.72:0/2309079664 conn(0x7f3b1c0714f0 msgr2=0x7f3b1c071900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:23.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.892+0000 7f3b208d8700 1 -- 172.21.15.72:0/2309079664 shutdown_connections 2023-07-25T14:36:23.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.892+0000 7f3b208d8700 1 -- 172.21.15.72:0/2309079664 wait complete. 2023-07-25T14:36:23.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.894+0000 7f3b208d8700 1 Processor -- start 2023-07-25T14:36:23.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.894+0000 7f3b208d8700 1 -- start start 2023-07-25T14:36:23.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.894+0000 7f3b208d8700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3b1c06a6d0 0x7f3b1c1ed080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:23.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.894+0000 7f3b208d8700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3b1c0c1850 0x7f3b1c1532d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:23.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.894+0000 7f3b208d8700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3b1c151a50 0x7f3b1c153810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:23.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.894+0000 7f3b208d8700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b1c1e7510 con 0x7f3b1c0c1850 2023-07-25T14:36:23.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.894+0000 7f3b208d8700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b1c0bfe20 con 0x7f3b1c06a6d0 2023-07-25T14:36:23.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.894+0000 7f3b208d8700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b1c1edb00 con 0x7f3b1c151a50 2023-07-25T14:36:23.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.895+0000 7f3b19d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3b1c0c1850 0x7f3b1c1532d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:23.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.895+0000 7f3b19d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3b1c0c1850 0x7f3b1c1532d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41024/0 (socket says 172.21.15.72:41024) 2023-07-25T14:36:23.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.895+0000 7f3b19d9b700 1 -- 172.21.15.72:0/2483863854 learned_addr learned my addr 172.21.15.72:0/2483863854 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:23.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.895+0000 7f3b1ad9d700 1 --2- 172.21.15.72:0/2483863854 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3b1c151a50 0x7f3b1c153810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:23.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.895+0000 7f3b1a59c700 1 --2- 172.21.15.72:0/2483863854 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3b1c06a6d0 0x7f3b1c1ed080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:23.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.895+0000 7f3b19d9b700 1 -- 172.21.15.72:0/2483863854 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3b1c151a50 msgr2=0x7f3b1c153810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:23.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.895+0000 7f3b19d9b700 1 --2- 172.21.15.72:0/2483863854 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3b1c151a50 0x7f3b1c153810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:23.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.895+0000 7f3b19d9b700 1 -- 172.21.15.72:0/2483863854 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3b1c06a6d0 msgr2=0x7f3b1c1ed080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:23.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.895+0000 7f3b19d9b700 1 --2- 172.21.15.72:0/2483863854 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3b1c06a6d0 0x7f3b1c1ed080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:23.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.895+0000 7f3b19d9b700 1 -- 172.21.15.72:0/2483863854 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b0c009550 con 0x7f3b1c0c1850 2023-07-25T14:36:23.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.895+0000 7f3b19d9b700 1 --2- 172.21.15.72:0/2483863854 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3b1c0c1850 0x7f3b1c1532d0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f3b1c06ae70 tx=0x7f3b0c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:23.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.895+0000 7f3b0affd700 1 -- 172.21.15.72:0/2483863854 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b0c004470 con 0x7f3b1c0c1850 2023-07-25T14:36:23.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.895+0000 7f3b0affd700 1 -- 172.21.15.72:0/2483863854 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b0c01f070 con 0x7f3b1c0c1850 2023-07-25T14:36:23.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.895+0000 7f3b208d8700 1 -- 172.21.15.72:0/2483863854 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b1c0c0850 con 0x7f3b1c0c1850 2023-07-25T14:36:23.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.895+0000 7f3b0affd700 1 -- 172.21.15.72:0/2483863854 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b0c0045f0 con 0x7f3b1c0c1850 2023-07-25T14:36:23.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.895+0000 7f3b208d8700 1 -- 172.21.15.72:0/2483863854 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b1c0bd940 con 0x7f3b1c0c1850 2023-07-25T14:36:23.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.896+0000 7f3b208d8700 1 -- 172.21.15.72:0/2483863854 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b1c04e470 con 0x7f3b1c0c1850 2023-07-25T14:36:23.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.897+0000 7f3b0affd700 1 -- 172.21.15.72:0/2483863854 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3b0c021030 con 0x7f3b1c0c1850 2023-07-25T14:36:23.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.897+0000 7f3b0affd700 1 --2- 172.21.15.72:0/2483863854 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f3afc06ace0 0x7f3afc06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:23.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.897+0000 7f3b0affd700 1 -- 172.21.15.72:0/2483863854 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f3b0c08ab10 con 0x7f3b1c0c1850 2023-07-25T14:36:23.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.897+0000 7f3b1a59c700 1 --2- 172.21.15.72:0/2483863854 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f3afc06ace0 0x7f3afc06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:23.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.897+0000 7f3b1a59c700 1 --2- 172.21.15.72:0/2483863854 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f3afc06ace0 0x7f3afc06d1a0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f3b1000b9b0 tx=0x7f3b10008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:23.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:23.901+0000 7f3b0affd700 1 -- 172.21.15.72:0/2483863854 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f3b0c055a80 con 0x7f3b1c0c1850 2023-07-25T14:36:24.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.086+0000 7f3b208d8700 1 -- 172.21.15.72:0/2483863854 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3b1c155560 con 0x7f3b1c0c1850 2023-07-25T14:36:24.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.087+0000 7f3b0affd700 1 -- 172.21.15.72:0/2483863854 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3b0c0590a0 con 0x7f3b1c0c1850 2023-07-25T14:36:24.099 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2023-07-25T14:36:24.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.088+0000 7f3b208d8700 1 -- 172.21.15.72:0/2483863854 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f3afc06ace0 msgr2=0x7f3afc06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:24.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.088+0000 7f3b208d8700 1 --2- 172.21.15.72:0/2483863854 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f3afc06ace0 0x7f3afc06d1a0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f3b1000b9b0 tx=0x7f3b10008040 comp rx=0 tx=0).stop 2023-07-25T14:36:24.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.088+0000 7f3b208d8700 1 -- 172.21.15.72:0/2483863854 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3b1c0c1850 msgr2=0x7f3b1c1532d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:24.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.088+0000 7f3b208d8700 1 --2- 172.21.15.72:0/2483863854 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3b1c0c1850 0x7f3b1c1532d0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f3b1c06ae70 tx=0x7f3b0c004750 comp rx=0 tx=0).stop 2023-07-25T14:36:24.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.088+0000 7f3b208d8700 1 -- 172.21.15.72:0/2483863854 shutdown_connections 2023-07-25T14:36:24.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.089+0000 7f3b208d8700 1 --2- 172.21.15.72:0/2483863854 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f3afc06ace0 0x7f3afc06d1a0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:24.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.089+0000 7f3b208d8700 1 --2- 172.21.15.72:0/2483863854 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3b1c151a50 0x7f3b1c153810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:24.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.089+0000 7f3b208d8700 1 --2- 172.21.15.72:0/2483863854 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3b1c06a6d0 0x7f3b1c1ed080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:24.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.089+0000 7f3b208d8700 1 --2- 172.21.15.72:0/2483863854 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3b1c0c1850 0x7f3b1c1532d0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:24.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.089+0000 7f3b208d8700 1 -- 172.21.15.72:0/2483863854 >> 172.21.15.72:0/2483863854 conn(0x7f3b1c0714f0 msgr2=0x7f3b1c14e240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:24.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.089+0000 7f3b208d8700 1 -- 172.21.15.72:0/2483863854 shutdown_connections 2023-07-25T14:36:24.103 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.089+0000 7f3b208d8700 1 -- 172.21.15.72:0/2483863854 wait complete. 2023-07-25T14:36:24.113 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-25T14:36:24.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.223+0000 7f76e0cdd700 1 Processor -- start 2023-07-25T14:36:24.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.223+0000 7f76e0cdd700 1 -- start start 2023-07-25T14:36:24.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.224+0000 7f76e0cdd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f76dc06ea10 0x7f76dc151c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:24.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.224+0000 7f76e0cdd700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f76dc0a7490 0x7f76dc0a7940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:24.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.224+0000 7f76e0cdd700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76dc152190 con 0x7f76dc06b510 2023-07-25T14:36:24.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.224+0000 7f76e0cdd700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76dc0ac350 con 0x7f76dc06ea10 2023-07-25T14:36:24.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.224+0000 7f76e0cdd700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76dc0c1670 con 0x7f76dc0a7490 2023-07-25T14:36:24.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.224+0000 7f76d9d9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f76dc06ea10 0x7f76dc151c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:24.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.224+0000 7f76d9d9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f76dc06ea10 0x7f76dc151c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41030/0 (socket says 172.21.15.72:41030) 2023-07-25T14:36:24.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.224+0000 7f76d9d9b700 1 -- 172.21.15.72:0/556985890 learned_addr learned my addr 172.21.15.72:0/556985890 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:24.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.224+0000 7f76d9d9b700 1 -- 172.21.15.72:0/556985890 >> v2:172.21.15.92:3300/0 conn(0x7f76dc0a7490 msgr2=0x7f76dc0a7940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:24.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.224+0000 7f76dad9d700 1 --2- 172.21.15.72:0/556985890 >> v2:172.21.15.92:3300/0 conn(0x7f76dc0a7490 0x7f76dc0a7940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:24.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.224+0000 7f76d9d9b700 1 --2- 172.21.15.72:0/556985890 >> v2:172.21.15.92:3300/0 conn(0x7f76dc0a7490 0x7f76dc0a7940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:24.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.224+0000 7f76d9d9b700 1 -- 172.21.15.72:0/556985890 >> v1:172.21.15.92:6789/0 conn(0x7f76dc06b510 legacy=0x7f76dc14e5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:24.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.224+0000 7f76d9d9b700 1 -- 172.21.15.72:0/556985890 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76dc066480 con 0x7f76dc06ea10 2023-07-25T14:36:24.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.225+0000 7f76d9d9b700 1 --2- 172.21.15.72:0/556985890 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f76dc06ea10 0x7f76dc151c50 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f76dc0c72a0 tx=0x7f76cc009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b171e04090ae9759 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:24.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.225+0000 7f76d959a700 1 -- 172.21.15.72:0/556985890 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76cc004230 con 0x7f76dc06ea10 2023-07-25T14:36:24.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.225+0000 7f76d959a700 1 -- 172.21.15.72:0/556985890 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76cc004390 con 0x7f76dc06ea10 2023-07-25T14:36:24.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.225+0000 7f76d959a700 1 -- 172.21.15.72:0/556985890 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76cc0036a0 con 0x7f76dc06ea10 2023-07-25T14:36:24.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.225+0000 7f76e0cdd700 1 -- 172.21.15.72:0/556985890 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f76dc06ea10 msgr2=0x7f76dc151c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:24.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.225+0000 7f76e0cdd700 1 --2- 172.21.15.72:0/556985890 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f76dc06ea10 0x7f76dc151c50 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f76dc0c72a0 tx=0x7f76cc009bd0 comp rx=0 tx=0).stop 2023-07-25T14:36:24.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.225+0000 7f76e0cdd700 1 -- 172.21.15.72:0/556985890 shutdown_connections 2023-07-25T14:36:24.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.225+0000 7f76e0cdd700 1 --2- 172.21.15.72:0/556985890 >> v2:172.21.15.92:3300/0 conn(0x7f76dc0a7490 0x7f76dc0a7940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:24.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.225+0000 7f76e0cdd700 1 --2- 172.21.15.72:0/556985890 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f76dc06ea10 0x7f76dc151c50 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:24.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.225+0000 7f76e0cdd700 1 -- 172.21.15.72:0/556985890 >> 172.21.15.72:0/556985890 conn(0x7f76dc06def0 msgr2=0x7f76dc06e300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:24.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.225+0000 7f76e0cdd700 1 -- 172.21.15.72:0/556985890 shutdown_connections 2023-07-25T14:36:24.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.225+0000 7f76e0cdd700 1 -- 172.21.15.72:0/556985890 wait complete. 2023-07-25T14:36:24.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.227+0000 7f76e0cdd700 1 Processor -- start 2023-07-25T14:36:24.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.227+0000 7f76e0cdd700 1 -- start start 2023-07-25T14:36:24.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.227+0000 7f76e0cdd700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f76dc06b510 0x7f76dc13de10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:24.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.227+0000 7f76e0cdd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f76dc06ea10 0x7f76dc13e350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:24.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.227+0000 7f76e0cdd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f76dc0a7490 0x7f76dc14d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:24.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.227+0000 7f76e0cdd700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76dc13eed0 con 0x7f76dc0a7490 2023-07-25T14:36:24.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.227+0000 7f76e0cdd700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76dc13e910 con 0x7f76dc06ea10 2023-07-25T14:36:24.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.227+0000 7f76e0cdd700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76dc13ebf0 con 0x7f76dc06b510 2023-07-25T14:36:24.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.228+0000 7f76dad9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f76dc0a7490 0x7f76dc14d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:24.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.228+0000 7f76dad9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f76dc0a7490 0x7f76dc14d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41038/0 (socket says 172.21.15.72:41038) 2023-07-25T14:36:24.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.228+0000 7f76dad9d700 1 -- 172.21.15.72:0/2300147051 learned_addr learned my addr 172.21.15.72:0/2300147051 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:24.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.228+0000 7f76da59c700 1 --2- 172.21.15.72:0/2300147051 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f76dc06b510 0x7f76dc13de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:24.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.228+0000 7f76d9d9b700 1 --2- 172.21.15.72:0/2300147051 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f76dc06ea10 0x7f76dc13e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:24.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.228+0000 7f76dad9d700 1 -- 172.21.15.72:0/2300147051 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f76dc06b510 msgr2=0x7f76dc13de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:24.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.228+0000 7f76dad9d700 1 --2- 172.21.15.72:0/2300147051 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f76dc06b510 0x7f76dc13de10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:24.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.228+0000 7f76dad9d700 1 -- 172.21.15.72:0/2300147051 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f76dc06ea10 msgr2=0x7f76dc13e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:24.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.228+0000 7f76dad9d700 1 --2- 172.21.15.72:0/2300147051 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f76dc06ea10 0x7f76dc13e350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:24.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.228+0000 7f76dad9d700 1 -- 172.21.15.72:0/2300147051 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76cc009550 con 0x7f76dc0a7490 2023-07-25T14:36:24.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.228+0000 7f76da59c700 1 --2- 172.21.15.72:0/2300147051 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f76dc06b510 0x7f76dc13de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-25T14:36:24.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.228+0000 7f76d9d9b700 1 --2- 172.21.15.72:0/2300147051 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f76dc06ea10 0x7f76dc13e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-25T14:36:24.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.228+0000 7f76dad9d700 1 --2- 172.21.15.72:0/2300147051 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f76dc0a7490 0x7f76dc14d6a0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f76d400cd70 tx=0x7f76d400a570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:24.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.228+0000 7f76caffd700 1 -- 172.21.15.72:0/2300147051 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76d4003a20 con 0x7f76dc0a7490 2023-07-25T14:36:24.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.228+0000 7f76caffd700 1 -- 172.21.15.72:0/2300147051 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76d4003b80 con 0x7f76dc0a7490 2023-07-25T14:36:24.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.228+0000 7f76e0cdd700 1 -- 172.21.15.72:0/2300147051 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76dc14cea0 con 0x7f76dc0a7490 2023-07-25T14:36:24.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.228+0000 7f76caffd700 1 -- 172.21.15.72:0/2300147051 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76d4004020 con 0x7f76dc0a7490 2023-07-25T14:36:24.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.228+0000 7f76e0cdd700 1 -- 172.21.15.72:0/2300147051 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76dc06a400 con 0x7f76dc0a7490 2023-07-25T14:36:24.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.229+0000 7f76e0cdd700 1 -- 172.21.15.72:0/2300147051 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76dc14d3c0 con 0x7f76dc0a7490 2023-07-25T14:36:24.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.230+0000 7f76caffd700 1 -- 172.21.15.72:0/2300147051 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f76d4004180 con 0x7f76dc0a7490 2023-07-25T14:36:24.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.230+0000 7f76caffd700 1 --2- 172.21.15.72:0/2300147051 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f76bc06ace0 0x7f76bc06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:24.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.230+0000 7f76caffd700 1 -- 172.21.15.72:0/2300147051 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f76d4012070 con 0x7f76dc0a7490 2023-07-25T14:36:24.247 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.230+0000 7f76da59c700 1 --2- 172.21.15.72:0/2300147051 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f76bc06ace0 0x7f76bc06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:24.247 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.230+0000 7f76da59c700 1 --2- 172.21.15.72:0/2300147051 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f76bc06ace0 0x7f76bc06d1a0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f76d0009930 tx=0x7f76d0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:24.247 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.234+0000 7f76caffd700 1 -- 172.21.15.72:0/2300147051 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f76dc14d3c0 con 0x7f76dc0a7490 2023-07-25T14:36:24.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.422+0000 7f76e0cdd700 1 -- 172.21.15.72:0/2300147051 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f76dc14d3c0 con 0x7f76dc0a7490 2023-07-25T14:36:24.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.423+0000 7f76caffd700 1 -- 172.21.15.72:0/2300147051 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7f76dc14d3c0 con 0x7f76dc0a7490 2023-07-25T14:36:24.435 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 64 2023-07-25T14:36:24.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.425+0000 7f76e0cdd700 1 -- 172.21.15.72:0/2300147051 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f76bc06ace0 msgr2=0x7f76bc06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:24.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.425+0000 7f76e0cdd700 1 --2- 172.21.15.72:0/2300147051 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f76bc06ace0 0x7f76bc06d1a0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f76d0009930 tx=0x7f76d0008040 comp rx=0 tx=0).stop 2023-07-25T14:36:24.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.425+0000 7f76e0cdd700 1 -- 172.21.15.72:0/2300147051 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f76dc0a7490 msgr2=0x7f76dc14d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:24.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.425+0000 7f76e0cdd700 1 --2- 172.21.15.72:0/2300147051 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f76dc0a7490 0x7f76dc14d6a0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f76d400cd70 tx=0x7f76d400a570 comp rx=0 tx=0).stop 2023-07-25T14:36:24.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.425+0000 7f76e0cdd700 1 -- 172.21.15.72:0/2300147051 shutdown_connections 2023-07-25T14:36:24.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.425+0000 7f76e0cdd700 1 --2- 172.21.15.72:0/2300147051 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f76bc06ace0 0x7f76bc06d1a0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:24.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.425+0000 7f76e0cdd700 1 --2- 172.21.15.72:0/2300147051 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f76dc06b510 0x7f76dc13de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:24.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.425+0000 7f76e0cdd700 1 --2- 172.21.15.72:0/2300147051 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f76dc0a7490 0x7f76dc14d6a0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:24.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.425+0000 7f76e0cdd700 1 --2- 172.21.15.72:0/2300147051 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f76dc06ea10 0x7f76dc13e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:24.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.425+0000 7f76e0cdd700 1 -- 172.21.15.72:0/2300147051 >> 172.21.15.72:0/2300147051 conn(0x7f76dc06def0 msgr2=0x7f76dc146910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:24.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.425+0000 7f76e0cdd700 1 -- 172.21.15.72:0/2300147051 shutdown_connections 2023-07-25T14:36:24.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.425+0000 7f76e0cdd700 1 -- 172.21.15.72:0/2300147051 wait complete. 2023-07-25T14:36:24.450 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-07-25T14:36:24.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.561+0000 7f75147c2700 1 Processor -- start 2023-07-25T14:36:24.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.561+0000 7f75147c2700 1 -- start start 2023-07-25T14:36:24.575 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.562+0000 7f75147c2700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f750c151950 0x7f750c06a190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:24.575 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.562+0000 7f75147c2700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f750c06a6d0 0x7f750c0c3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:24.575 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.562+0000 7f75147c2700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f750c0c2fe0 con 0x7f750c0724c0 2023-07-25T14:36:24.575 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.562+0000 7f75147c2700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f750c071a60 con 0x7f750c151950 2023-07-25T14:36:24.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.562+0000 7f75147c2700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f750c0c2a70 con 0x7f750c06a6d0 2023-07-25T14:36:24.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.562+0000 7f7512d5f700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f750c06a6d0 0x7f750c0c3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:24.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.562+0000 7f751255e700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f750c151950 0x7f750c06a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:24.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.562+0000 7f7512d5f700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f750c06a6d0 0x7f750c0c3bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3301/0 says I am v2:172.21.15.72:46274/0 (socket says 172.21.15.72:46274) 2023-07-25T14:36:24.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.562+0000 7f751255e700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f750c151950 0x7f750c06a190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.72:36614/0 (socket says 172.21.15.72:36614) 2023-07-25T14:36:24.576 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.562+0000 7f7511d5d700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f750c0724c0 0x7f750c0c34c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.72:55352/0 (socket says 172.21.15.72:55352) 2023-07-25T14:36:24.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.562+0000 7f7512d5f700 1 -- 172.21.15.72:0/2859477787 learned_addr learned my addr 172.21.15.72:0/2859477787 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:24.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.563+0000 7f751255e700 1 -- 172.21.15.72:0/2859477787 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f750c06a6d0 msgr2=0x7f750c0c3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:24.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.563+0000 7f751255e700 1 --2- 172.21.15.72:0/2859477787 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f750c06a6d0 0x7f750c0c3bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:24.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.563+0000 7f751255e700 1 -- 172.21.15.72:0/2859477787 >> v1:172.21.15.92:6789/0 conn(0x7f750c0724c0 legacy=0x7f750c0c34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:24.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.563+0000 7f751255e700 1 -- 172.21.15.72:0/2859477787 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f750c155070 con 0x7f750c151950 2023-07-25T14:36:24.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.563+0000 7f7512d5f700 1 --2- 172.21.15.72:0/2859477787 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f750c06a6d0 0x7f750c0c3bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-25T14:36:24.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.563+0000 7f751255e700 1 --2- 172.21.15.72:0/2859477787 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f750c151950 0x7f750c06a190 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f74fc009840 tx=0x7f74fc009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fd4e80656468e3ce server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:24.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.563+0000 7f751155c700 1 -- 172.21.15.72:0/2859477787 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74fc011830 con 0x7f750c151950 2023-07-25T14:36:24.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.563+0000 7f751155c700 1 -- 172.21.15.72:0/2859477787 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74fc011990 con 0x7f750c151950 2023-07-25T14:36:24.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.563+0000 7f751155c700 1 -- 172.21.15.72:0/2859477787 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74fc011d20 con 0x7f750c151950 2023-07-25T14:36:24.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.564+0000 7f75147c2700 1 -- 172.21.15.72:0/2859477787 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f750c151950 msgr2=0x7f750c06a190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:24.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.564+0000 7f75147c2700 1 --2- 172.21.15.72:0/2859477787 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f750c151950 0x7f750c06a190 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f74fc009840 tx=0x7f74fc009b50 comp rx=0 tx=0).stop 2023-07-25T14:36:24.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.564+0000 7f75147c2700 1 -- 172.21.15.72:0/2859477787 shutdown_connections 2023-07-25T14:36:24.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.564+0000 7f75147c2700 1 --2- 172.21.15.72:0/2859477787 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f750c06a6d0 0x7f750c0c3bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:24.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.564+0000 7f75147c2700 1 --2- 172.21.15.72:0/2859477787 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f750c151950 0x7f750c06a190 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:24.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.564+0000 7f75147c2700 1 -- 172.21.15.72:0/2859477787 >> 172.21.15.72:0/2859477787 conn(0x7f750c0a87e0 msgr2=0x7f750c0a8bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:24.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.564+0000 7f75147c2700 1 -- 172.21.15.72:0/2859477787 shutdown_connections 2023-07-25T14:36:24.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.564+0000 7f75147c2700 1 -- 172.21.15.72:0/2859477787 wait complete. 2023-07-25T14:36:24.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.565+0000 7f75147c2700 1 Processor -- start 2023-07-25T14:36:24.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.565+0000 7f75147c2700 1 -- start start 2023-07-25T14:36:24.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.565+0000 7f75147c2700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f750c06a6d0 0x7f750c1ecb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:24.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.565+0000 7f75147c2700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f750c0724c0 0x7f750c146170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:24.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.565+0000 7f75147c2700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f750c151950 0x7f750c1466b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:24.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.566+0000 7f75147c2700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f750c0a6af0 con 0x7f750c06a6d0 2023-07-25T14:36:24.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.566+0000 7f75147c2700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f750c1ed5d0 con 0x7f750c0724c0 2023-07-25T14:36:24.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.566+0000 7f75147c2700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f750c155600 con 0x7f750c151950 2023-07-25T14:36:24.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.566+0000 7f751255e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f750c06a6d0 0x7f750c1ecb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:24.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.566+0000 7f751255e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f750c06a6d0 0x7f750c1ecb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41048/0 (socket says 172.21.15.72:41048) 2023-07-25T14:36:24.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.566+0000 7f751255e700 1 -- 172.21.15.72:0/3148190511 learned_addr learned my addr 172.21.15.72:0/3148190511 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:24.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.566+0000 7f7512d5f700 1 --2- 172.21.15.72:0/3148190511 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f750c151950 0x7f750c1466b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:24.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.566+0000 7f751255e700 1 -- 172.21.15.72:0/3148190511 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f750c151950 msgr2=0x7f750c1466b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:24.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.566+0000 7f751255e700 1 --2- 172.21.15.72:0/3148190511 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f750c151950 0x7f750c1466b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:24.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.566+0000 7f7511d5d700 1 --2- 172.21.15.72:0/3148190511 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f750c0724c0 0x7f750c146170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:24.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.566+0000 7f751255e700 1 -- 172.21.15.72:0/3148190511 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f750c0724c0 msgr2=0x7f750c146170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:24.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.566+0000 7f751255e700 1 --2- 172.21.15.72:0/3148190511 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f750c0724c0 0x7f750c146170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:24.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.566+0000 7f751255e700 1 -- 172.21.15.72:0/3148190511 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7504009b30 con 0x7f750c06a6d0 2023-07-25T14:36:24.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.566+0000 7f7511d5d700 1 --2- 172.21.15.72:0/3148190511 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f750c0724c0 0x7f750c146170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-25T14:36:24.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.566+0000 7f751255e700 1 --2- 172.21.15.72:0/3148190511 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f750c06a6d0 0x7f750c1ecb20 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f74fc009fd0 tx=0x7f74fc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:24.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.566+0000 7f7502ffd700 1 -- 172.21.15.72:0/3148190511 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74fc0036a0 con 0x7f750c06a6d0 2023-07-25T14:36:24.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.566+0000 7f7502ffd700 1 -- 172.21.15.72:0/3148190511 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74fc01e070 con 0x7f750c06a6d0 2023-07-25T14:36:24.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.566+0000 7f75147c2700 1 -- 172.21.15.72:0/3148190511 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74fc0094a0 con 0x7f750c06a6d0 2023-07-25T14:36:24.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.566+0000 7f7502ffd700 1 -- 172.21.15.72:0/3148190511 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74fc003a60 con 0x7f750c06a6d0 2023-07-25T14:36:24.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.566+0000 7f75147c2700 1 -- 172.21.15.72:0/3148190511 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f750c1ed870 con 0x7f750c06a6d0 2023-07-25T14:36:24.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.567+0000 7f75147c2700 1 -- 172.21.15.72:0/3148190511 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f750c154d00 con 0x7f750c06a6d0 2023-07-25T14:36:24.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.568+0000 7f7502ffd700 1 -- 172.21.15.72:0/3148190511 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f74fc003bc0 con 0x7f750c06a6d0 2023-07-25T14:36:24.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.568+0000 7f7502ffd700 1 --2- 172.21.15.72:0/3148190511 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f74f006ace0 0x7f74f006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:24.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.568+0000 7f7511d5d700 1 --2- 172.21.15.72:0/3148190511 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f74f006ace0 0x7f74f006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:24.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.568+0000 7f7502ffd700 1 -- 172.21.15.72:0/3148190511 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f74fc08a690 con 0x7f750c06a6d0 2023-07-25T14:36:24.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.569+0000 7f7511d5d700 1 --2- 172.21.15.72:0/3148190511 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f74f006ace0 0x7f74f006d1a0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f750c150ec0 tx=0x7f7508009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:24.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.572+0000 7f7502ffd700 1 -- 172.21.15.72:0/3148190511 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f74fc0554e0 con 0x7f750c06a6d0 2023-07-25T14:36:24.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.760+0000 7f75147c2700 1 -- 172.21.15.72:0/3148190511 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f750c04e470 con 0x7f750c06a6d0 2023-07-25T14:36:24.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.760+0000 7f7502ffd700 1 -- 172.21.15.72:0/3148190511 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+11 (secure 0 0 0) 0x7f74fc058b00 con 0x7f750c06a6d0 2023-07-25T14:36:24.773 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2023-07-25T14:36:24.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.762+0000 7f75147c2700 1 -- 172.21.15.72:0/3148190511 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f74f006ace0 msgr2=0x7f74f006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:24.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.762+0000 7f75147c2700 1 --2- 172.21.15.72:0/3148190511 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f74f006ace0 0x7f74f006d1a0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f750c150ec0 tx=0x7f7508009040 comp rx=0 tx=0).stop 2023-07-25T14:36:24.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.762+0000 7f75147c2700 1 -- 172.21.15.72:0/3148190511 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f750c06a6d0 msgr2=0x7f750c1ecb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:24.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.762+0000 7f75147c2700 1 --2- 172.21.15.72:0/3148190511 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f750c06a6d0 0x7f750c1ecb20 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f74fc009fd0 tx=0x7f74fc004750 comp rx=0 tx=0).stop 2023-07-25T14:36:24.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.763+0000 7f75147c2700 1 -- 172.21.15.72:0/3148190511 shutdown_connections 2023-07-25T14:36:24.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.763+0000 7f75147c2700 1 --2- 172.21.15.72:0/3148190511 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f74f006ace0 0x7f74f006d1a0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:24.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.763+0000 7f75147c2700 1 --2- 172.21.15.72:0/3148190511 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f750c151950 0x7f750c1466b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:24.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.763+0000 7f75147c2700 1 --2- 172.21.15.72:0/3148190511 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f750c06a6d0 0x7f750c1ecb20 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:24.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.763+0000 7f75147c2700 1 --2- 172.21.15.72:0/3148190511 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f750c0724c0 0x7f750c146170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:24.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.763+0000 7f75147c2700 1 -- 172.21.15.72:0/3148190511 >> 172.21.15.72:0/3148190511 conn(0x7f750c0a87e0 msgr2=0x7f750c0c45e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:24.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.763+0000 7f75147c2700 1 -- 172.21.15.72:0/3148190511 shutdown_connections 2023-07-25T14:36:24.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.763+0000 7f75147c2700 1 -- 172.21.15.72:0/3148190511 wait complete. 2023-07-25T14:36:24.825 INFO:tasks.cephfs_test_runner:Starting test: test_mount_all_caps_absent (tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth) 2023-07-25T14:36:24.827 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_all_caps_absent' 2023-07-25T14:36:24.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.935+0000 7fd338812700 1 Processor -- start 2023-07-25T14:36:24.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.935+0000 7fd338812700 1 -- start start 2023-07-25T14:36:24.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.936+0000 7fd338812700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fd334151950 0x7fd33406a190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:24.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.936+0000 7fd338812700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd33406a6d0 0x7fd3340c3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:24.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.936+0000 7fd338812700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3340c2fe0 con 0x7fd3340724c0 2023-07-25T14:36:24.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.936+0000 7fd338812700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd334071a60 con 0x7fd33406a6d0 2023-07-25T14:36:24.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.936+0000 7fd338812700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3340c2a70 con 0x7fd334151950 2023-07-25T14:36:24.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.936+0000 7fd332d9d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd33406a6d0 0x7fd3340c3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:24.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.936+0000 7fd331d9b700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fd3340724c0 0x7fd3340c34c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:60024/0 (socket says 172.21.15.72:60024) 2023-07-25T14:36:24.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.936+0000 7fd331d9b700 1 -- 172.21.15.72:0/3957465869 learned_addr learned my addr 172.21.15.72:0/3957465869 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:36:24.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.937+0000 7fd33259c700 1 --2- 172.21.15.72:0/3957465869 >> v2:172.21.15.92:3300/0 conn(0x7fd334151950 0x7fd33406a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:24.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.937+0000 7fd332d9d700 1 -- 172.21.15.72:0/3957465869 >> v2:172.21.15.92:3300/0 conn(0x7fd334151950 msgr2=0x7fd33406a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:24.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.937+0000 7fd332d9d700 1 --2- 172.21.15.72:0/3957465869 >> v2:172.21.15.92:3300/0 conn(0x7fd334151950 0x7fd33406a190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:24.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.937+0000 7fd332d9d700 1 -- 172.21.15.72:0/3957465869 >> v1:172.21.15.72:6789/0 conn(0x7fd3340724c0 legacy=0x7fd3340c34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:24.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.937+0000 7fd332d9d700 1 -- 172.21.15.72:0/3957465869 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd334155070 con 0x7fd33406a6d0 2023-07-25T14:36:24.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.937+0000 7fd33159a700 1 -- 172.21.15.72:0/3957465869 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2637006898 0 0) 0x7fd3340c2fe0 con 0x7fd3340724c0 2023-07-25T14:36:24.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.937+0000 7fd332d9d700 1 --2- 172.21.15.72:0/3957465869 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd33406a6d0 0x7fd3340c3bd0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fd33406ad50 tx=0x7fd32c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c04dbe5ddee63545 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:24.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.937+0000 7fd33159a700 1 -- 172.21.15.72:0/3957465869 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd32c00e070 con 0x7fd33406a6d0 2023-07-25T14:36:24.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.937+0000 7fd33159a700 1 -- 172.21.15.72:0/3957465869 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd32c00bbd0 con 0x7fd33406a6d0 2023-07-25T14:36:24.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.937+0000 7fd33159a700 1 -- 172.21.15.72:0/3957465869 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd32c012430 con 0x7fd33406a6d0 2023-07-25T14:36:24.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.937+0000 7fd338812700 1 -- 172.21.15.72:0/3957465869 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd33406a6d0 msgr2=0x7fd3340c3bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:24.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.937+0000 7fd338812700 1 --2- 172.21.15.72:0/3957465869 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd33406a6d0 0x7fd3340c3bd0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fd33406ad50 tx=0x7fd32c00b330 comp rx=0 tx=0).stop 2023-07-25T14:36:24.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.938+0000 7fd338812700 1 -- 172.21.15.72:0/3957465869 shutdown_connections 2023-07-25T14:36:24.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.938+0000 7fd338812700 1 --2- 172.21.15.72:0/3957465869 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd33406a6d0 0x7fd3340c3bd0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:24.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.938+0000 7fd338812700 1 --2- 172.21.15.72:0/3957465869 >> v2:172.21.15.92:3300/0 conn(0x7fd334151950 0x7fd33406a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:24.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.938+0000 7fd338812700 1 -- 172.21.15.72:0/3957465869 >> 172.21.15.72:0/3957465869 conn(0x7fd3340a87e0 msgr2=0x7fd3340a8bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:24.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.938+0000 7fd338812700 1 -- 172.21.15.72:0/3957465869 shutdown_connections 2023-07-25T14:36:24.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.938+0000 7fd338812700 1 -- 172.21.15.72:0/3957465869 wait complete. 2023-07-25T14:36:24.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.939+0000 7fd338812700 1 Processor -- start 2023-07-25T14:36:24.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.939+0000 7fd338812700 1 -- start start 2023-07-25T14:36:24.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.939+0000 7fd338812700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd33406a6d0 0x7fd33414bc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:24.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.940+0000 7fd338812700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd3340724c0 0x7fd33414c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:24.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.940+0000 7fd338812700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd334151950 0x7fd3340bdd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:24.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.940+0000 7fd338812700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd334157210 con 0x7fd334151950 2023-07-25T14:36:24.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.940+0000 7fd338812700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3341558a0 con 0x7fd3340724c0 2023-07-25T14:36:24.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.940+0000 7fd338812700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3340a7b40 con 0x7fd33406a6d0 2023-07-25T14:36:24.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.940+0000 7fd332d9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd334151950 0x7fd3340bdd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:24.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.940+0000 7fd332d9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd334151950 0x7fd3340bdd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41064/0 (socket says 172.21.15.72:41064) 2023-07-25T14:36:24.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.940+0000 7fd332d9d700 1 -- 172.21.15.72:0/3720203839 learned_addr learned my addr 172.21.15.72:0/3720203839 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:24.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.940+0000 7fd332d9d700 1 -- 172.21.15.72:0/3720203839 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd33406a6d0 msgr2=0x7fd33414bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:24.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.940+0000 7fd332d9d700 1 --2- 172.21.15.72:0/3720203839 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd33406a6d0 0x7fd33414bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:24.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.940+0000 7fd332d9d700 1 -- 172.21.15.72:0/3720203839 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd3340724c0 msgr2=0x7fd33414c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:24.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.940+0000 7fd332d9d700 1 --2- 172.21.15.72:0/3720203839 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd3340724c0 0x7fd33414c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:24.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.940+0000 7fd332d9d700 1 -- 172.21.15.72:0/3720203839 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd32c009a70 con 0x7fd334151950 2023-07-25T14:36:24.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.940+0000 7fd332d9d700 1 --2- 172.21.15.72:0/3720203839 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd334151950 0x7fd3340bdd70 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fd33406aec0 tx=0x7fd32c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:24.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.940+0000 7fd32affd700 1 -- 172.21.15.72:0/3720203839 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd32c012430 con 0x7fd334151950 2023-07-25T14:36:24.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.940+0000 7fd32affd700 1 -- 172.21.15.72:0/3720203839 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd32c020070 con 0x7fd334151950 2023-07-25T14:36:24.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.940+0000 7fd338812700 1 -- 172.21.15.72:0/3720203839 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3340a8070 con 0x7fd334151950 2023-07-25T14:36:24.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.940+0000 7fd32affd700 1 -- 172.21.15.72:0/3720203839 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd32c004280 con 0x7fd334151950 2023-07-25T14:36:24.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.940+0000 7fd338812700 1 -- 172.21.15.72:0/3720203839 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd334156b50 con 0x7fd334151950 2023-07-25T14:36:24.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.941+0000 7fd338812700 1 -- 172.21.15.72:0/3720203839 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd334157350 con 0x7fd334151950 2023-07-25T14:36:24.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.942+0000 7fd32affd700 1 -- 172.21.15.72:0/3720203839 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd32c0043e0 con 0x7fd334151950 2023-07-25T14:36:24.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.942+0000 7fd32affd700 1 --2- 172.21.15.72:0/3720203839 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fd31406ace0 0x7fd31406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:24.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.942+0000 7fd32affd700 1 -- 172.21.15.72:0/3720203839 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fd32c022070 con 0x7fd334151950 2023-07-25T14:36:24.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.942+0000 7fd33259c700 1 --2- 172.21.15.72:0/3720203839 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fd31406ace0 0x7fd31406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:24.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.942+0000 7fd33259c700 1 --2- 172.21.15.72:0/3720203839 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fd31406ace0 0x7fd31406d1a0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fd3240098d0 tx=0x7fd324008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:24.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:24.946+0000 7fd32affd700 1 -- 172.21.15.72:0/3720203839 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fd334157350 con 0x7fd334151950 2023-07-25T14:36:25.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:25.210+0000 7fd338812700 1 -- 172.21.15.72:0/3720203839 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_all_caps_absent"]} v 0) v1 -- 0x7fd334157350 con 0x7fd334151950 2023-07-25T14:36:25.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:25.778+0000 7fd32affd700 1 -- 172.21.15.72:0/3720203839 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_all_caps_absent"]}]=0 v63) v1 ==== 162+0+0 (secure 0 0 0) 0x7fd334157350 con 0x7fd334151950 2023-07-25T14:36:25.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:25.780+0000 7fd338812700 1 -- 172.21.15.72:0/3720203839 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fd31406ace0 msgr2=0x7fd31406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:25.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:25.780+0000 7fd338812700 1 --2- 172.21.15.72:0/3720203839 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fd31406ace0 0x7fd31406d1a0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fd3240098d0 tx=0x7fd324008040 comp rx=0 tx=0).stop 2023-07-25T14:36:25.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:25.780+0000 7fd338812700 1 -- 172.21.15.72:0/3720203839 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd334151950 msgr2=0x7fd3340bdd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:25.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:25.780+0000 7fd338812700 1 --2- 172.21.15.72:0/3720203839 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd334151950 0x7fd3340bdd70 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fd33406aec0 tx=0x7fd32c004ad0 comp rx=0 tx=0).stop 2023-07-25T14:36:25.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:25.780+0000 7fd338812700 1 -- 172.21.15.72:0/3720203839 shutdown_connections 2023-07-25T14:36:25.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:25.780+0000 7fd338812700 1 --2- 172.21.15.72:0/3720203839 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fd31406ace0 0x7fd31406d1a0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:25.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:25.780+0000 7fd338812700 1 --2- 172.21.15.72:0/3720203839 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd33406a6d0 0x7fd33414bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:25.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:25.780+0000 7fd338812700 1 --2- 172.21.15.72:0/3720203839 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd334151950 0x7fd3340bdd70 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:25.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:25.780+0000 7fd338812700 1 --2- 172.21.15.72:0/3720203839 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd3340724c0 0x7fd33414c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:25.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:25.780+0000 7fd338812700 1 -- 172.21.15.72:0/3720203839 >> 172.21.15.72:0/3720203839 conn(0x7fd3340a87e0 msgr2=0x7fd3340c58c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:25.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:25.780+0000 7fd338812700 1 -- 172.21.15.72:0/3720203839 shutdown_connections 2023-07-25T14:36:25.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:25.780+0000 7fd338812700 1 -- 172.21.15.72:0/3720203839 wait complete. 2023-07-25T14:36:25.805 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-25T14:36:25.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:25.914+0000 7f41552b4700 1 Processor -- start 2023-07-25T14:36:25.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:25.915+0000 7f41552b4700 1 -- start start 2023-07-25T14:36:25.928 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:25.915+0000 7f41552b4700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f41500c4220 0x7f415006b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:25.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:25.915+0000 7f41552b4700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f415006b7e0 con 0x7f415014e5c0 2023-07-25T14:36:25.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:25.915+0000 7f41552b4700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41500c4670 con 0x7f415014e1e0 2023-07-25T14:36:25.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:25.915+0000 7f41552b4700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41500c4ef0 con 0x7f41500c4220 2023-07-25T14:36:25.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:25.915+0000 7f414f7fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f41500c4220 0x7f415006b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:25.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:25.915+0000 7f414f7fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f41500c4220 0x7f415006b2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41072/0 (socket says 172.21.15.72:41072) 2023-07-25T14:36:25.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:25.915+0000 7f414e7fc700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f415014e5c0 0x7f415006f830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:60036/0 (socket says 172.21.15.72:60036) 2023-07-25T14:36:25.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:25.915+0000 7f414f7fe700 1 -- 172.21.15.72:0/79368110 learned_addr learned my addr 172.21.15.72:0/79368110 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:25.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:25.916+0000 7f414f7fe700 1 -- 172.21.15.72:0/79368110 >> v1:172.21.15.92:6789/0 conn(0x7f415014e1e0 legacy=0x7f4150154e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:25.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:25.916+0000 7f414f7fe700 1 -- 172.21.15.72:0/79368110 >> v1:172.21.15.72:6789/0 conn(0x7f415014e5c0 legacy=0x7f415006f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:25.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:25.916+0000 7f414f7fe700 1 -- 172.21.15.72:0/79368110 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41500c4930 con 0x7f41500c4220 2023-07-25T14:36:25.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:25.916+0000 7f414dffb700 1 -- 172.21.15.72:0/79368110 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3260865578 0 0) 0x7f415006b7e0 con 0x7f415014e5c0 2023-07-25T14:36:25.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:25.916+0000 7f414f7fe700 1 --2- 172.21.15.72:0/79368110 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f41500c4220 0x7f415006b2a0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f4148009e50 tx=0x7f414800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eaa9cd2ab915d0a0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:25.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:25.916+0000 7f414dffb700 1 -- 172.21.15.72:0/79368110 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f414800e070 con 0x7f41500c4220 2023-07-25T14:36:25.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:25.916+0000 7f414dffb700 1 -- 172.21.15.72:0/79368110 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f414800b9c0 con 0x7f41500c4220 2023-07-25T14:36:25.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:25.916+0000 7f414dffb700 1 -- 172.21.15.72:0/79368110 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f414800bd70 con 0x7f41500c4220 2023-07-25T14:36:25.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:25.916+0000 7f41552b4700 1 -- 172.21.15.72:0/79368110 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f41500c4220 msgr2=0x7f415006b2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:25.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:25.916+0000 7f41552b4700 1 --2- 172.21.15.72:0/79368110 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f41500c4220 0x7f415006b2a0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f4148009e50 tx=0x7f414800b330 comp rx=0 tx=0).stop 2023-07-25T14:36:25.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:25.916+0000 7f41552b4700 1 -- 172.21.15.72:0/79368110 shutdown_connections 2023-07-25T14:36:25.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:25.916+0000 7f41552b4700 1 --2- 172.21.15.72:0/79368110 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f41500c4220 0x7f415006b2a0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:25.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:25.916+0000 7f41552b4700 1 -- 172.21.15.72:0/79368110 >> 172.21.15.72:0/79368110 conn(0x7f41500a95a0 msgr2=0x7f41500a9980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:25.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:25.917+0000 7f41552b4700 1 -- 172.21.15.72:0/79368110 shutdown_connections 2023-07-25T14:36:25.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:25.917+0000 7f41552b4700 1 -- 172.21.15.72:0/79368110 wait complete. 2023-07-25T14:36:25.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:25.918+0000 7f41552b4700 1 Processor -- start 2023-07-25T14:36:25.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:25.918+0000 7f41552b4700 1 -- start start 2023-07-25T14:36:25.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:25.918+0000 7f41552b4700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f41500c4220 0x7f41500ac3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:25.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:25.918+0000 7f41552b4700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f415014e1e0 0x7f41500c8220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:25.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:25.918+0000 7f41552b4700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f415014e5c0 0x7f41500c5a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:25.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:25.918+0000 7f41552b4700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f415014e020 con 0x7f415014e1e0 2023-07-25T14:36:25.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:25.918+0000 7f41552b4700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41500c5600 con 0x7f41500c4220 2023-07-25T14:36:25.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:25.918+0000 7f41552b4700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41501ea350 con 0x7f415014e5c0 2023-07-25T14:36:25.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:25.919+0000 7f414e7fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f415014e1e0 0x7f41500c8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:25.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:25.919+0000 7f414e7fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f415014e1e0 0x7f41500c8220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41076/0 (socket says 172.21.15.72:41076) 2023-07-25T14:36:25.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:25.919+0000 7f414e7fc700 1 -- 172.21.15.72:0/1610798129 learned_addr learned my addr 172.21.15.72:0/1610798129 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:25.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:25.919+0000 7f414effd700 1 --2- 172.21.15.72:0/1610798129 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f41500c4220 0x7f41500ac3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:25.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:25.919+0000 7f414f7fe700 1 --2- 172.21.15.72:0/1610798129 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f415014e5c0 0x7f41500c5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:25.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:25.919+0000 7f414e7fc700 1 -- 172.21.15.72:0/1610798129 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f415014e5c0 msgr2=0x7f41500c5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:25.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:25.919+0000 7f414e7fc700 1 --2- 172.21.15.72:0/1610798129 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f415014e5c0 0x7f41500c5a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:25.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:25.919+0000 7f414e7fc700 1 -- 172.21.15.72:0/1610798129 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f41500c4220 msgr2=0x7f41500ac3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:25.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:25.919+0000 7f414e7fc700 1 --2- 172.21.15.72:0/1610798129 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f41500c4220 0x7f41500ac3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:25.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:25.919+0000 7f414e7fc700 1 -- 172.21.15.72:0/1610798129 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4148009b30 con 0x7f415014e1e0 2023-07-25T14:36:25.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:25.919+0000 7f414effd700 1 --2- 172.21.15.72:0/1610798129 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f41500c4220 0x7f41500ac3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-25T14:36:25.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:25.919+0000 7f414e7fc700 1 --2- 172.21.15.72:0/1610798129 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f415014e1e0 0x7f41500c8220 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f414000c520 tx=0x7f414000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:25.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:25.919+0000 7f41377fe700 1 -- 172.21.15.72:0/1610798129 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4140004c80 con 0x7f415014e1e0 2023-07-25T14:36:25.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:25.919+0000 7f41377fe700 1 -- 172.21.15.72:0/1610798129 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4140004e20 con 0x7f415014e1e0 2023-07-25T14:36:25.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:25.919+0000 7f41552b4700 1 -- 172.21.15.72:0/1610798129 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41501ea630 con 0x7f415014e1e0 2023-07-25T14:36:25.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:25.919+0000 7f41377fe700 1 -- 172.21.15.72:0/1610798129 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4140007310 con 0x7f415014e1e0 2023-07-25T14:36:25.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:25.919+0000 7f41552b4700 1 -- 172.21.15.72:0/1610798129 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41501eabf0 con 0x7f415014e1e0 2023-07-25T14:36:25.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:25.920+0000 7f41552b4700 1 -- 172.21.15.72:0/1610798129 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41500c67a0 con 0x7f415014e1e0 2023-07-25T14:36:25.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:25.921+0000 7f41377fe700 1 -- 172.21.15.72:0/1610798129 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4140007470 con 0x7f415014e1e0 2023-07-25T14:36:25.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:25.921+0000 7f41377fe700 1 --2- 172.21.15.72:0/1610798129 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f413c06ad10 0x7f413c06d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:25.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:25.921+0000 7f41377fe700 1 -- 172.21.15.72:0/1610798129 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f4140089520 con 0x7f415014e1e0 2023-07-25T14:36:25.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:25.921+0000 7f414effd700 1 --2- 172.21.15.72:0/1610798129 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f413c06ad10 0x7f413c06d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:25.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:25.921+0000 7f414effd700 1 --2- 172.21.15.72:0/1610798129 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f413c06ad10 0x7f413c06d1d0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f4144000f60 tx=0x7f4144009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:25.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:25.925+0000 7f41377fe700 1 -- 172.21.15.72:0/1610798129 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f41500c67a0 con 0x7f415014e1e0 2023-07-25T14:36:26.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.116+0000 7f41552b4700 1 -- 172.21.15.72:0/1610798129 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f41500c67a0 con 0x7f415014e1e0 2023-07-25T14:36:26.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.118+0000 7f41377fe700 1 -- 172.21.15.72:0/1610798129 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+20014 (secure 0 0 0) 0x7f41500c67a0 con 0x7f415014e1e0 2023-07-25T14:36:26.130 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-25T14:36:26.131 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":25,"fsid":"9170db48-9170-43e8-8ccb-9813e6240906","created":"2023-07-25T14:35:21.733262+0000","modified":"2023-07-25T14:35:44.992669+0000","last_up_change":"2023-07-25T14:35:31.355010+0000","last_in_change":"2023-07-25T14:35:24.195785+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-25T14:35:32.983457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-25T14:35:33.326342+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-25T14:35:37.534158+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-25T14:35:38.891571+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-25T14:35:42.596923+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d517fdad-0bfe-49f0-89f2-9421c3761839","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6801","nonce":2475407414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6803","nonce":2475407414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6807","nonce":2475407414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6805","nonce":2475407414}]},"public_addr":"172.21.15.72:6801/2475407414","cluster_addr":"172.21.15.72:6803/2475407414","heartbeat_back_addr":"172.21.15.72:6807/2475407414","heartbeat_front_addr":"172.21.15.72:6805/2475407414","state":["exists","up"]},{"osd":1,"uuid":"e1564be3-f209-47e5-a8d0-32fc618a474f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6822","nonce":870954016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6825","nonce":870954016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6831","nonce":870954016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6827","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6829","nonce":870954016}]},"public_addr":"172.21.15.72:6822/870954016","cluster_addr":"172.21.15.72:6825/870954016","heartbeat_back_addr":"172.21.15.72:6831/870954016","heartbeat_front_addr":"172.21.15.72:6829/870954016","state":["exists","up"]},{"osd":2,"uuid":"c4647d30-ffa6-417a-9026-ef530c75910e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6809","nonce":2143129442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6811","nonce":2143129442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6815","nonce":2143129442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6813","nonce":2143129442}]},"public_addr":"172.21.15.72:6809/2143129442","cluster_addr":"172.21.15.72:6811/2143129442","heartbeat_back_addr":"172.21.15.72:6815/2143129442","heartbeat_front_addr":"172.21.15.72:6813/2143129442","state":["exists","up"]},{"osd":3,"uuid":"76c9d9a7-c2e2-4612-a58b-d6882dd76b58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6817","nonce":3404066311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6819","nonce":3404066311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6828","nonce":3404066311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6821","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6823","nonce":3404066311}]},"public_addr":"172.21.15.72:6817/3404066311","cluster_addr":"172.21.15.72:6819/3404066311","heartbeat_back_addr":"172.21.15.72:6828/3404066311","heartbeat_front_addr":"172.21.15.72:6823/3404066311","state":["exists","up"]},{"osd":4,"uuid":"7f8920dc-0ad4-4a73-ab40-65408f83eadd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6817","nonce":2381008739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6819","nonce":2381008739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6825","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6827","nonce":2381008739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6822","nonce":2381008739}]},"public_addr":"172.21.15.92:6817/2381008739","cluster_addr":"172.21.15.92:6819/2381008739","heartbeat_back_addr":"172.21.15.92:6827/2381008739","heartbeat_front_addr":"172.21.15.92:6822/2381008739","state":["exists","up"]},{"osd":5,"uuid":"56257e7c-31eb-44c5-9ec7-1318a4e0bb35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6801","nonce":2161935604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6803","nonce":2161935604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6807","nonce":2161935604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6805","nonce":2161935604}]},"public_addr":"172.21.15.92:6801/2161935604","cluster_addr":"172.21.15.92:6803/2161935604","heartbeat_back_addr":"172.21.15.92:6807/2161935604","heartbeat_front_addr":"172.21.15.92:6805/2161935604","state":["exists","up"]},{"osd":6,"uuid":"a150d3d8-a0c9-4955-968a-8d98eff4ffb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6809","nonce":3770163493}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6811","nonce":3770163493}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6815","nonce":3770163493}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6813","nonce":3770163493}]},"public_addr":"172.21.15.92:6809/3770163493","cluster_addr":"172.21.15.92:6811/3770163493","heartbeat_back_addr":"172.21.15.92:6815/3770163493","heartbeat_front_addr":"172.21.15.92:6813/3770163493","state":["exists","up"]},{"osd":7,"uuid":"07799c27-54ee-4591-a42d-a978d6b32065","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6821","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6823","nonce":2135777609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6826","nonce":2135777609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6831","nonce":2135777609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6829","nonce":2135777609}]},"public_addr":"172.21.15.92:6823/2135777609","cluster_addr":"172.21.15.92:6826/2135777609","heartbeat_back_addr":"172.21.15.92:6831/2135777609","heartbeat_front_addr":"172.21.15.92:6829/2135777609","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.345365+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.378150+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.146566+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.372172+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:30.398421+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.385632+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.465611+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.443583+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-25T14:36:26.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.120+0000 7f41552b4700 1 -- 172.21.15.72:0/1610798129 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f413c06ad10 msgr2=0x7f413c06d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:26.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.120+0000 7f41552b4700 1 --2- 172.21.15.72:0/1610798129 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f413c06ad10 0x7f413c06d1d0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f4144000f60 tx=0x7f4144009040 comp rx=0 tx=0).stop 2023-07-25T14:36:26.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.120+0000 7f41552b4700 1 -- 172.21.15.72:0/1610798129 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f415014e1e0 msgr2=0x7f41500c8220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:26.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.120+0000 7f41552b4700 1 --2- 172.21.15.72:0/1610798129 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f415014e1e0 0x7f41500c8220 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f414000c520 tx=0x7f414000c8e0 comp rx=0 tx=0).stop 2023-07-25T14:36:26.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.120+0000 7f41552b4700 1 -- 172.21.15.72:0/1610798129 shutdown_connections 2023-07-25T14:36:26.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.120+0000 7f41552b4700 1 --2- 172.21.15.72:0/1610798129 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f413c06ad10 0x7f413c06d1d0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:26.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.120+0000 7f41552b4700 1 --2- 172.21.15.72:0/1610798129 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f415014e5c0 0x7f41500c5a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:26.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.120+0000 7f41552b4700 1 --2- 172.21.15.72:0/1610798129 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f41500c4220 0x7f41500ac3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:26.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.120+0000 7f41552b4700 1 --2- 172.21.15.72:0/1610798129 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f415014e1e0 0x7f41500c8220 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:26.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.120+0000 7f41552b4700 1 -- 172.21.15.72:0/1610798129 >> 172.21.15.72:0/1610798129 conn(0x7f41500a95a0 msgr2=0x7f415014d670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:26.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.120+0000 7f41552b4700 1 -- 172.21.15.72:0/1610798129 shutdown_connections 2023-07-25T14:36:26.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.120+0000 7f41552b4700 1 -- 172.21.15.72:0/1610798129 wait complete. 2023-07-25T14:36:26.145 INFO:tasks.cephfs.cephfs_test_case.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-07-25T14:35:32.983457+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-07-25T14:35:33.326342+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-25T14:35:37.534158+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-25T14:35:38.891571+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-07-25T14:35:42.596923+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-25T14:36:26.146 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-25T14:36:26.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.256+0000 7fe112780700 1 Processor -- start 2023-07-25T14:36:26.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.256+0000 7fe112780700 1 -- start start 2023-07-25T14:36:26.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.257+0000 7fe112780700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe10c154320 0x7fe10c06a570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:26.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.257+0000 7fe112780700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe10c157910 con 0x7fe10c15cc90 2023-07-25T14:36:26.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.257+0000 7fe112780700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe10c157bf0 con 0x7fe10c06a190 2023-07-25T14:36:26.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.257+0000 7fe112780700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe10c1547a0 con 0x7fe10c154320 2023-07-25T14:36:26.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.257+0000 7fe110d1d700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fe10c15cc90 0x7fe10c15f080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:60054/0 (socket says 172.21.15.72:60054) 2023-07-25T14:36:26.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.257+0000 7fe110d1d700 1 -- 172.21.15.72:0/2730049576 learned_addr learned my addr 172.21.15.72:0/2730049576 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:36:26.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.257+0000 7fe10affd700 1 -- 172.21.15.72:0/2730049576 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 999576452 0 0) 0x7fe10c157910 con 0x7fe10c15cc90 2023-07-25T14:36:26.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.257+0000 7fe10b7fe700 1 --2- 172.21.15.72:0/2730049576 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe10c154320 0x7fe10c06a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:26.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.257+0000 7fe10affd700 1 -- 172.21.15.72:0/2730049576 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe0f80035b0 con 0x7fe10c15cc90 2023-07-25T14:36:26.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.257+0000 7fe10affd700 1 -- 172.21.15.72:0/2730049576 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2128392724 0 0) 0x7fe0f80035b0 con 0x7fe10c15cc90 2023-07-25T14:36:26.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.257+0000 7fe10affd700 1 -- 172.21.15.72:0/2730049576 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe10c154320 msgr2=0x7fe10c06a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:26.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.257+0000 7fe10affd700 1 --2- 172.21.15.72:0/2730049576 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe10c154320 0x7fe10c06a570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:26.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.257+0000 7fe10affd700 1 -- 172.21.15.72:0/2730049576 >> v1:172.21.15.92:6789/0 conn(0x7fe10c06a190 legacy=0x7fe10c158080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:26.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.257+0000 7fe10affd700 1 -- 172.21.15.72:0/2730049576 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe10c158790 con 0x7fe10c15cc90 2023-07-25T14:36:26.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.257+0000 7fe10affd700 1 -- 172.21.15.72:0/2730049576 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2559588315 0 0) 0x7fe104001a40 con 0x7fe10c15cc90 2023-07-25T14:36:26.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.257+0000 7fe10affd700 1 -- 172.21.15.72:0/2730049576 >> v1:172.21.15.72:6789/0 conn(0x7fe10c15cc90 legacy=0x7fe10c15f080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:26.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.257+0000 7fe10affd700 1 --2- 172.21.15.72:0/2730049576 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe0f8003a30 0x7fe0f8003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:26.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.257+0000 7fe10affd700 1 --2- 172.21.15.72:0/2730049576 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe0f8004850 0x7fe0f8004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:26.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.257+0000 7fe10affd700 1 --2- 172.21.15.72:0/2730049576 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe10c154320 0x7fe0f800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:26.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.257+0000 7fe10affd700 1 -- 172.21.15.72:0/2730049576 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe10c1547a0 con 0x7fe0f8003a30 2023-07-25T14:36:26.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.257+0000 7fe10affd700 1 -- 172.21.15.72:0/2730049576 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0f8005590 con 0x7fe0f8004850 2023-07-25T14:36:26.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.258+0000 7fe10affd700 1 -- 172.21.15.72:0/2730049576 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0f800bf50 con 0x7fe10c154320 2023-07-25T14:36:26.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.258+0000 7fe10bfff700 1 --2- 172.21.15.72:0/2730049576 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe0f8003a30 0x7fe0f8003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:26.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.258+0000 7fe10b7fe700 1 --2- 172.21.15.72:0/2730049576 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe0f8004850 0x7fe0f8004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:26.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.258+0000 7fe110d1d700 1 --2- 172.21.15.72:0/2730049576 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe10c154320 0x7fe0f800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:26.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.258+0000 7fe10bfff700 1 -- 172.21.15.72:0/2730049576 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe10c154320 msgr2=0x7fe0f800ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:26.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.258+0000 7fe10bfff700 1 --2- 172.21.15.72:0/2730049576 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe10c154320 0x7fe0f800ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:26.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.258+0000 7fe10bfff700 1 -- 172.21.15.72:0/2730049576 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe0f8004850 msgr2=0x7fe0f8004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:26.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.258+0000 7fe10bfff700 1 --2- 172.21.15.72:0/2730049576 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe0f8004850 0x7fe0f8004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:26.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.258+0000 7fe10bfff700 1 -- 172.21.15.72:0/2730049576 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0f80035b0 con 0x7fe0f8003a30 2023-07-25T14:36:26.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.258+0000 7fe10bfff700 1 --2- 172.21.15.72:0/2730049576 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe0f8003a30 0x7fe0f8003e50 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fe0f40017c0 tx=0x7fe0f8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e2b5c9b28ed1a85 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:26.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.258+0000 7fe10affd700 1 -- 172.21.15.72:0/2730049576 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0f40052d0 con 0x7fe0f8003a30 2023-07-25T14:36:26.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.258+0000 7fe10affd700 1 -- 172.21.15.72:0/2730049576 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0f4005430 con 0x7fe0f8003a30 2023-07-25T14:36:26.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.258+0000 7fe10affd700 1 -- 172.21.15.72:0/2730049576 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0f40038c0 con 0x7fe0f8003a30 2023-07-25T14:36:26.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.259+0000 7fe112780700 1 -- 172.21.15.72:0/2730049576 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe0f8003a30 msgr2=0x7fe0f8003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:26.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.259+0000 7fe112780700 1 --2- 172.21.15.72:0/2730049576 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe0f8003a30 0x7fe0f8003e50 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fe0f40017c0 tx=0x7fe0f8005880 comp rx=0 tx=0).stop 2023-07-25T14:36:26.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.259+0000 7fe110d1d700 1 -- 172.21.15.72:0/2730049576 reap_dead start 2023-07-25T14:36:26.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.259+0000 7fe112780700 1 -- 172.21.15.72:0/2730049576 shutdown_connections 2023-07-25T14:36:26.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.259+0000 7fe112780700 1 -- 172.21.15.72:0/2730049576 >> 172.21.15.72:0/2730049576 conn(0x7fe10c066460 msgr2=0x7fe10c06b2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:26.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.259+0000 7fe112780700 1 -- 172.21.15.72:0/2730049576 shutdown_connections 2023-07-25T14:36:26.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.259+0000 7fe112780700 1 -- 172.21.15.72:0/2730049576 wait complete. 2023-07-25T14:36:26.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.260+0000 7fe112780700 1 Processor -- start 2023-07-25T14:36:26.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.260+0000 7fe112780700 1 -- start start 2023-07-25T14:36:26.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.261+0000 7fe112780700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe0f8003a30 0x7fe10c1e96b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:26.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.261+0000 7fe112780700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe10c1575e0 0x7fe10c1ea140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:26.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.261+0000 7fe112780700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe10c1ed390 0x7fe10c145010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:26.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.261+0000 7fe112780700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe10c15b870 con 0x7fe10c1ed390 2023-07-25T14:36:26.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.261+0000 7fe112780700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe10c1ea680 con 0x7fe10c1575e0 2023-07-25T14:36:26.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.261+0000 7fe112780700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe10c1ecc20 con 0x7fe0f8003a30 2023-07-25T14:36:26.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.261+0000 7fe110d1d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe10c1ed390 0x7fe10c145010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:26.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.261+0000 7fe110d1d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe10c1ed390 0x7fe10c145010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41098/0 (socket says 172.21.15.72:41098) 2023-07-25T14:36:26.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.261+0000 7fe110d1d700 1 -- 172.21.15.72:0/461876250 learned_addr learned my addr 172.21.15.72:0/461876250 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:26.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.261+0000 7fe10b7fe700 1 --2- 172.21.15.72:0/461876250 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe10c1575e0 0x7fe10c1ea140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:26.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.261+0000 7fe10bfff700 1 --2- 172.21.15.72:0/461876250 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe0f8003a30 0x7fe10c1e96b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:26.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.261+0000 7fe110d1d700 1 -- 172.21.15.72:0/461876250 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe0f8003a30 msgr2=0x7fe10c1e96b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:26.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.261+0000 7fe110d1d700 1 --2- 172.21.15.72:0/461876250 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe0f8003a30 0x7fe10c1e96b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:26.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.261+0000 7fe110d1d700 1 -- 172.21.15.72:0/461876250 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe10c1575e0 msgr2=0x7fe10c1ea140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:26.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.261+0000 7fe110d1d700 1 --2- 172.21.15.72:0/461876250 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe10c1575e0 0x7fe10c1ea140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:26.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.261+0000 7fe110d1d700 1 -- 172.21.15.72:0/461876250 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe10c15b590 con 0x7fe10c1ed390 2023-07-25T14:36:26.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.261+0000 7fe10b7fe700 1 --2- 172.21.15.72:0/461876250 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe10c1575e0 0x7fe10c1ea140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-25T14:36:26.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.261+0000 7fe110d1d700 1 --2- 172.21.15.72:0/461876250 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe10c1ed390 0x7fe10c145010 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fe10c06ec10 tx=0x7fe10400a5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:26.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.261+0000 7fe108ff9700 1 -- 172.21.15.72:0/461876250 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe10400ad80 con 0x7fe10c1ed390 2023-07-25T14:36:26.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.261+0000 7fe108ff9700 1 -- 172.21.15.72:0/461876250 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1040133f0 con 0x7fe10c1ed390 2023-07-25T14:36:26.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.261+0000 7fe112780700 1 -- 172.21.15.72:0/461876250 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe10c156aa0 con 0x7fe10c1ed390 2023-07-25T14:36:26.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.261+0000 7fe108ff9700 1 -- 172.21.15.72:0/461876250 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1040137a0 con 0x7fe10c1ed390 2023-07-25T14:36:26.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.261+0000 7fe112780700 1 -- 172.21.15.72:0/461876250 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe10c156e60 con 0x7fe10c1ed390 2023-07-25T14:36:26.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.262+0000 7fe112780700 1 -- 172.21.15.72:0/461876250 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe10c0abc20 con 0x7fe10c1ed390 2023-07-25T14:36:26.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.263+0000 7fe108ff9700 1 -- 172.21.15.72:0/461876250 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe104007d50 con 0x7fe10c1ed390 2023-07-25T14:36:26.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.263+0000 7fe108ff9700 1 --2- 172.21.15.72:0/461876250 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fe0ec06ace0 0x7fe0ec06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:26.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.263+0000 7fe108ff9700 1 -- 172.21.15.72:0/461876250 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fe104089d40 con 0x7fe10c1ed390 2023-07-25T14:36:26.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.263+0000 7fe10bfff700 1 --2- 172.21.15.72:0/461876250 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fe0ec06ace0 0x7fe0ec06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:26.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.264+0000 7fe10bfff700 1 --2- 172.21.15.72:0/461876250 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fe0ec06ace0 0x7fe0ec06d1a0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fe10c151660 tx=0x7fe0f4009030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:26.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.267+0000 7fe108ff9700 1 -- 172.21.15.72:0/461876250 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fe104054b90 con 0x7fe10c1ed390 2023-07-25T14:36:26.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.453+0000 7fe112780700 1 -- 172.21.15.72:0/461876250 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fe10c156900 con 0x7fe10c1ed390 2023-07-25T14:36:26.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.454+0000 7fe108ff9700 1 -- 172.21.15.72:0/461876250 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7fe10c156900 con 0x7fe10c1ed390 2023-07-25T14:36:26.466 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 8 2023-07-25T14:36:26.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.456+0000 7fe112780700 1 -- 172.21.15.72:0/461876250 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fe0ec06ace0 msgr2=0x7fe0ec06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:26.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.456+0000 7fe112780700 1 --2- 172.21.15.72:0/461876250 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fe0ec06ace0 0x7fe0ec06d1a0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fe10c151660 tx=0x7fe0f4009030 comp rx=0 tx=0).stop 2023-07-25T14:36:26.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.456+0000 7fe112780700 1 -- 172.21.15.72:0/461876250 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe10c1ed390 msgr2=0x7fe10c145010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:26.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.456+0000 7fe112780700 1 --2- 172.21.15.72:0/461876250 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe10c1ed390 0x7fe10c145010 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fe10c06ec10 tx=0x7fe10400a5b0 comp rx=0 tx=0).stop 2023-07-25T14:36:26.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.456+0000 7fe112780700 1 -- 172.21.15.72:0/461876250 shutdown_connections 2023-07-25T14:36:26.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.456+0000 7fe112780700 1 --2- 172.21.15.72:0/461876250 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fe0ec06ace0 0x7fe0ec06d1a0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:26.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.456+0000 7fe112780700 1 --2- 172.21.15.72:0/461876250 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe0f8003a30 0x7fe10c1e96b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:26.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.456+0000 7fe112780700 1 --2- 172.21.15.72:0/461876250 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe10c1ed390 0x7fe10c145010 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:26.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.456+0000 7fe112780700 1 --2- 172.21.15.72:0/461876250 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe10c1575e0 0x7fe10c1ea140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:26.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.456+0000 7fe112780700 1 -- 172.21.15.72:0/461876250 >> 172.21.15.72:0/461876250 conn(0x7fe10c066460 msgr2=0x7fe10c06b2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:26.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.456+0000 7fe112780700 1 -- 172.21.15.72:0/461876250 shutdown_connections 2023-07-25T14:36:26.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.456+0000 7fe112780700 1 -- 172.21.15.72:0/461876250 wait complete. 2023-07-25T14:36:26.480 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-25T14:36:26.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.591+0000 7f1f1979b700 1 Processor -- start 2023-07-25T14:36:26.603 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.591+0000 7f1f1979b700 1 -- start start 2023-07-25T14:36:26.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.592+0000 7f1f1979b700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f1f140bead0 0x7f1f140c0350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:26.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.592+0000 7f1f1979b700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1f140c0890 0x7f1f140c44d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:26.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.592+0000 7f1f1979b700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f140bfeb0 con 0x7f1f14151a90 2023-07-25T14:36:26.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.592+0000 7f1f1979b700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f140c10b0 con 0x7f1f140bead0 2023-07-25T14:36:26.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.592+0000 7f1f1979b700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f140c1940 con 0x7f1f140c0890 2023-07-25T14:36:26.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.592+0000 7f1f12ffd700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f1f14151a90 0x7f1f14154d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:60070/0 (socket says 172.21.15.72:60070) 2023-07-25T14:36:26.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.592+0000 7f1f12ffd700 1 -- 172.21.15.72:0/3746407128 learned_addr learned my addr 172.21.15.72:0/3746407128 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:36:26.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.592+0000 7f1f137fe700 1 --2- 172.21.15.72:0/3746407128 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1f140c0890 0x7f1f140c44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:26.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.592+0000 7f1f127fc700 1 --2- 172.21.15.72:0/3746407128 >> v2:172.21.15.92:3300/0 conn(0x7f1f140bead0 0x7f1f140c0350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:26.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.592+0000 7f1f11ffb700 1 -- 172.21.15.72:0/3746407128 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 419217214 0 0) 0x7f1f140bfeb0 con 0x7f1f14151a90 2023-07-25T14:36:26.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.592+0000 7f1f11ffb700 1 -- 172.21.15.72:0/3746407128 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1efc0035b0 con 0x7f1f14151a90 2023-07-25T14:36:26.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.592+0000 7f1f11ffb700 1 -- 172.21.15.72:0/3746407128 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1727220782 0 0) 0x7f1efc0035b0 con 0x7f1f14151a90 2023-07-25T14:36:26.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.592+0000 7f1f11ffb700 1 -- 172.21.15.72:0/3746407128 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1f140c0890 msgr2=0x7f1f140c44d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:26.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.592+0000 7f1f11ffb700 1 --2- 172.21.15.72:0/3746407128 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1f140c0890 0x7f1f140c44d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:26.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.592+0000 7f1f11ffb700 1 -- 172.21.15.72:0/3746407128 >> v2:172.21.15.92:3300/0 conn(0x7f1f140bead0 msgr2=0x7f1f140c0350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:26.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.592+0000 7f1f11ffb700 1 --2- 172.21.15.72:0/3746407128 >> v2:172.21.15.92:3300/0 conn(0x7f1f140bead0 0x7f1f140c0350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:26.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.592+0000 7f1f11ffb700 1 -- 172.21.15.72:0/3746407128 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f140bf2e0 con 0x7f1f14151a90 2023-07-25T14:36:26.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.592+0000 7f1f11ffb700 1 -- 172.21.15.72:0/3746407128 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2559588315 0 0) 0x7f1f08001670 con 0x7f1f14151a90 2023-07-25T14:36:26.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.592+0000 7f1f11ffb700 1 -- 172.21.15.72:0/3746407128 >> v1:172.21.15.72:6789/0 conn(0x7f1f14151a90 legacy=0x7f1f14154d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:26.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.593+0000 7f1f11ffb700 1 --2- 172.21.15.72:0/3746407128 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1efc003a00 0x7f1efc003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:26.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.593+0000 7f1f11ffb700 1 --2- 172.21.15.72:0/3746407128 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1efc004850 0x7f1efc004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:26.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.593+0000 7f1f11ffb700 1 --2- 172.21.15.72:0/3746407128 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1f140c0890 0x7f1efc005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:26.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.593+0000 7f1f11ffb700 1 -- 172.21.15.72:0/3746407128 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f140c10b0 con 0x7f1efc003a00 2023-07-25T14:36:26.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.593+0000 7f1f11ffb700 1 -- 172.21.15.72:0/3746407128 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1efc00ba10 con 0x7f1efc004850 2023-07-25T14:36:26.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.593+0000 7f1f11ffb700 1 -- 172.21.15.72:0/3746407128 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1efc00bbd0 con 0x7f1f140c0890 2023-07-25T14:36:26.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.593+0000 7f1f12ffd700 1 --2- 172.21.15.72:0/3746407128 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1efc003a00 0x7f1efc003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:26.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.593+0000 7f1f127fc700 1 --2- 172.21.15.72:0/3746407128 >> v2:172.21.15.92:3300/0 conn(0x7f1f140bead0 0x7f1f140c0350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-25T14:36:26.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.593+0000 7f1f127fc700 1 --2- 172.21.15.72:0/3746407128 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1efc004850 0x7f1efc004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:26.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.593+0000 7f1f137fe700 1 --2- 172.21.15.72:0/3746407128 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1f140c0890 0x7f1efc005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:26.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.593+0000 7f1f12ffd700 1 -- 172.21.15.72:0/3746407128 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1f140c0890 msgr2=0x7f1efc005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:26.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.593+0000 7f1f12ffd700 1 --2- 172.21.15.72:0/3746407128 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1f140c0890 0x7f1efc005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:26.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.593+0000 7f1f12ffd700 1 -- 172.21.15.72:0/3746407128 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1efc004850 msgr2=0x7f1efc004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:26.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.593+0000 7f1f12ffd700 1 --2- 172.21.15.72:0/3746407128 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1efc004850 0x7f1efc004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:26.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.593+0000 7f1f12ffd700 1 -- 172.21.15.72:0/3746407128 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1efc0035b0 con 0x7f1efc003a00 2023-07-25T14:36:26.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.593+0000 7f1f137fe700 1 --2- 172.21.15.72:0/3746407128 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1f140c0890 0x7f1efc005210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-25T14:36:26.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.593+0000 7f1f127fc700 1 --2- 172.21.15.72:0/3746407128 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1efc004850 0x7f1efc004cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-25T14:36:26.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.593+0000 7f1f12ffd700 1 --2- 172.21.15.72:0/3746407128 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1efc003a00 0x7f1efc003e20 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f1f0800c320 tx=0x7f1efc005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93bc5ce317fd65b3 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:26.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.593+0000 7f1f11ffb700 1 -- 172.21.15.72:0/3746407128 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f0800ce60 con 0x7f1efc003a00 2023-07-25T14:36:26.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.593+0000 7f1f11ffb700 1 -- 172.21.15.72:0/3746407128 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f08005960 con 0x7f1efc003a00 2023-07-25T14:36:26.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.593+0000 7f1f11ffb700 1 -- 172.21.15.72:0/3746407128 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f08005d10 con 0x7f1efc003a00 2023-07-25T14:36:26.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.594+0000 7f1f1979b700 1 -- 172.21.15.72:0/3746407128 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1efc003a00 msgr2=0x7f1efc003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:26.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.594+0000 7f1f1979b700 1 --2- 172.21.15.72:0/3746407128 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1efc003a00 0x7f1efc003e20 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f1f0800c320 tx=0x7f1efc005880 comp rx=0 tx=0).stop 2023-07-25T14:36:26.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.594+0000 7f1f137fe700 1 -- 172.21.15.72:0/3746407128 reap_dead start 2023-07-25T14:36:26.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.594+0000 7f1f1979b700 1 -- 172.21.15.72:0/3746407128 shutdown_connections 2023-07-25T14:36:26.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.594+0000 7f1f1979b700 1 -- 172.21.15.72:0/3746407128 >> 172.21.15.72:0/3746407128 conn(0x7f1f1406c3a0 msgr2=0x7f1f1406c780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:26.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.594+0000 7f1f1979b700 1 -- 172.21.15.72:0/3746407128 shutdown_connections 2023-07-25T14:36:26.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.594+0000 7f1f1979b700 1 -- 172.21.15.72:0/3746407128 wait complete. 2023-07-25T14:36:26.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.595+0000 7f1f1979b700 1 Processor -- start 2023-07-25T14:36:26.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.595+0000 7f1f1979b700 1 -- start start 2023-07-25T14:36:26.617 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.596+0000 7f1f1979b700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1efc003a00 0x7f1f14152890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:26.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.596+0000 7f1f1979b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1f14152dd0 0x7f1f141ed070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:26.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.596+0000 7f1f1979b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1f140c8360 0x7f1f141ed5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:26.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.596+0000 7f1f1979b700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f141edaf0 con 0x7f1f140c8360 2023-07-25T14:36:26.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.596+0000 7f1f1979b700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f141edd10 con 0x7f1f14152dd0 2023-07-25T14:36:26.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.596+0000 7f1f1979b700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f14157f50 con 0x7f1efc003a00 2023-07-25T14:36:26.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.596+0000 7f1f137fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1f140c8360 0x7f1f141ed5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:26.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.596+0000 7f1f137fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1f140c8360 0x7f1f141ed5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41118/0 (socket says 172.21.15.72:41118) 2023-07-25T14:36:26.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.596+0000 7f1f137fe700 1 -- 172.21.15.72:0/3681969263 learned_addr learned my addr 172.21.15.72:0/3681969263 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:26.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.596+0000 7f1f12ffd700 1 --2- 172.21.15.72:0/3681969263 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1efc003a00 0x7f1f14152890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:26.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.596+0000 7f1f127fc700 1 --2- 172.21.15.72:0/3681969263 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1f14152dd0 0x7f1f141ed070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:26.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.596+0000 7f1f137fe700 1 -- 172.21.15.72:0/3681969263 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1efc003a00 msgr2=0x7f1f14152890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:26.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.596+0000 7f1f137fe700 1 --2- 172.21.15.72:0/3681969263 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1efc003a00 0x7f1f14152890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:26.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.596+0000 7f1f137fe700 1 -- 172.21.15.72:0/3681969263 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1f14152dd0 msgr2=0x7f1f141ed070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:26.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.596+0000 7f1f137fe700 1 --2- 172.21.15.72:0/3681969263 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1f14152dd0 0x7f1f141ed070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:26.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.596+0000 7f1f137fe700 1 -- 172.21.15.72:0/3681969263 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f14158230 con 0x7f1f140c8360 2023-07-25T14:36:26.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.596+0000 7f1f12ffd700 1 --2- 172.21.15.72:0/3681969263 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1efc003a00 0x7f1f14152890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-25T14:36:26.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.596+0000 7f1f127fc700 1 --2- 172.21.15.72:0/3681969263 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1f14152dd0 0x7f1f141ed070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-25T14:36:26.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.596+0000 7f1f137fe700 1 --2- 172.21.15.72:0/3681969263 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1f140c8360 0x7f1f141ed5b0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f1f1406c120 tx=0x7f1f0c00f3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:26.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.596+0000 7f1efb7fe700 1 -- 172.21.15.72:0/3681969263 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f0c009c40 con 0x7f1f140c8360 2023-07-25T14:36:26.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.596+0000 7f1efb7fe700 1 -- 172.21.15.72:0/3681969263 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f0c011040 con 0x7f1f140c8360 2023-07-25T14:36:26.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.596+0000 7f1f1979b700 1 -- 172.21.15.72:0/3681969263 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f14150210 con 0x7f1f140c8360 2023-07-25T14:36:26.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.596+0000 7f1efb7fe700 1 -- 172.21.15.72:0/3681969263 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f0c017400 con 0x7f1f140c8360 2023-07-25T14:36:26.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.596+0000 7f1f1979b700 1 -- 172.21.15.72:0/3681969263 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f14153930 con 0x7f1f140c8360 2023-07-25T14:36:26.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.597+0000 7f1f1979b700 1 -- 172.21.15.72:0/3681969263 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f14150400 con 0x7f1f140c8360 2023-07-25T14:36:26.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.598+0000 7f1efb7fe700 1 -- 172.21.15.72:0/3681969263 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1f0c0203b0 con 0x7f1f140c8360 2023-07-25T14:36:26.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.598+0000 7f1efb7fe700 1 --2- 172.21.15.72:0/3681969263 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f1f0006ace0 0x7f1f0006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:26.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.598+0000 7f1efb7fe700 1 -- 172.21.15.72:0/3681969263 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f1f0c0897f0 con 0x7f1f140c8360 2023-07-25T14:36:26.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.598+0000 7f1f12ffd700 1 --2- 172.21.15.72:0/3681969263 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f1f0006ace0 0x7f1f0006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:26.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.599+0000 7f1f12ffd700 1 --2- 172.21.15.72:0/3681969263 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f1f0006ace0 0x7f1f0006d1a0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f1f08008fd0 tx=0x7f1f0800a000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:26.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.603+0000 7f1efb7fe700 1 -- 172.21.15.72:0/3681969263 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f1f0c054640 con 0x7f1f140c8360 2023-07-25T14:36:26.801 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.789+0000 7f1f1979b700 1 -- 172.21.15.72:0/3681969263 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1f1404e470 con 0x7f1f140c8360 2023-07-25T14:36:26.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.790+0000 7f1efb7fe700 1 -- 172.21.15.72:0/3681969263 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1f0c057c60 con 0x7f1f140c8360 2023-07-25T14:36:26.802 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 1 2023-07-25T14:36:26.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.792+0000 7f1f1979b700 1 -- 172.21.15.72:0/3681969263 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f1f0006ace0 msgr2=0x7f1f0006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:26.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.792+0000 7f1f1979b700 1 --2- 172.21.15.72:0/3681969263 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f1f0006ace0 0x7f1f0006d1a0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f1f08008fd0 tx=0x7f1f0800a000 comp rx=0 tx=0).stop 2023-07-25T14:36:26.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.792+0000 7f1f1979b700 1 -- 172.21.15.72:0/3681969263 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1f140c8360 msgr2=0x7f1f141ed5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:26.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.792+0000 7f1f1979b700 1 --2- 172.21.15.72:0/3681969263 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1f140c8360 0x7f1f141ed5b0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f1f1406c120 tx=0x7f1f0c00f3b0 comp rx=0 tx=0).stop 2023-07-25T14:36:26.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.792+0000 7f1f1979b700 1 -- 172.21.15.72:0/3681969263 shutdown_connections 2023-07-25T14:36:26.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.792+0000 7f1f1979b700 1 --2- 172.21.15.72:0/3681969263 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f1f0006ace0 0x7f1f0006d1a0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:26.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.792+0000 7f1f1979b700 1 --2- 172.21.15.72:0/3681969263 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1efc003a00 0x7f1f14152890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:26.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.792+0000 7f1f1979b700 1 --2- 172.21.15.72:0/3681969263 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1f140c8360 0x7f1f141ed5b0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:26.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.792+0000 7f1f1979b700 1 --2- 172.21.15.72:0/3681969263 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1f14152dd0 0x7f1f141ed070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:26.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.792+0000 7f1f1979b700 1 -- 172.21.15.72:0/3681969263 >> 172.21.15.72:0/3681969263 conn(0x7f1f1406c3a0 msgr2=0x7f1f140c43d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:26.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.792+0000 7f1f1979b700 1 -- 172.21.15.72:0/3681969263 shutdown_connections 2023-07-25T14:36:26.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.792+0000 7f1f1979b700 1 -- 172.21.15.72:0/3681969263 wait complete. 2023-07-25T14:36:26.816 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-25T14:36:26.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.926+0000 7f86651be700 1 Processor -- start 2023-07-25T14:36:26.938 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.926+0000 7f86651be700 1 -- start start 2023-07-25T14:36:26.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.927+0000 7f86651be700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f866014f810 0x7f86600c4370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:26.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.927+0000 7f86651be700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f86600a9cc0 0x7f86601525e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:26.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.927+0000 7f86651be700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86600c5890 con 0x7f86600bb0b0 2023-07-25T14:36:26.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.927+0000 7f86651be700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8660152150 con 0x7f866014f810 2023-07-25T14:36:26.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.927+0000 7f86651be700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f866014fbf0 con 0x7f86600a9cc0 2023-07-25T14:36:26.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.927+0000 7f865e59c700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f86600a9cc0 0x7f86601525e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:26.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.927+0000 7f865ed9d700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f866014f810 0x7f86600c4370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:26.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.927+0000 7f865f59e700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f86600bb0b0 0x7f8660152b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.72:55434/0 (socket says 172.21.15.72:55434) 2023-07-25T14:36:26.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.927+0000 7f865f59e700 1 -- 172.21.15.72:0/502113606 learned_addr learned my addr 172.21.15.72:0/502113606 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:36:26.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.927+0000 7f865ed9d700 1 -- 172.21.15.72:0/502113606 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f86600a9cc0 msgr2=0x7f86601525e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:26.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.927+0000 7f865ed9d700 1 --2- 172.21.15.72:0/502113606 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f86600a9cc0 0x7f86601525e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:26.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.927+0000 7f865ed9d700 1 -- 172.21.15.72:0/502113606 >> v1:172.21.15.92:6789/0 conn(0x7f86600bb0b0 legacy=0x7f8660152b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:26.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.927+0000 7f865dd9b700 1 -- 172.21.15.72:0/502113606 <== mon.1 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3290932545 0 0) 0x7f86600c5890 con 0x7f86600bb0b0 2023-07-25T14:36:26.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.927+0000 7f865ed9d700 1 -- 172.21.15.72:0/502113606 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86601566a0 con 0x7f866014f810 2023-07-25T14:36:26.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.928+0000 7f865ed9d700 1 --2- 172.21.15.72:0/502113606 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f866014f810 0x7f86600c4370 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f8654009840 tx=0x7f8654009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6ccda6dcafd6c916 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:26.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.928+0000 7f865dd9b700 1 -- 172.21.15.72:0/502113606 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8654011830 con 0x7f866014f810 2023-07-25T14:36:26.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.928+0000 7f865dd9b700 1 -- 172.21.15.72:0/502113606 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8654011990 con 0x7f866014f810 2023-07-25T14:36:26.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.928+0000 7f865dd9b700 1 -- 172.21.15.72:0/502113606 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8654011d20 con 0x7f866014f810 2023-07-25T14:36:26.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.928+0000 7f86651be700 1 -- 172.21.15.72:0/502113606 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f866014f810 msgr2=0x7f86600c4370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:26.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.928+0000 7f86651be700 1 --2- 172.21.15.72:0/502113606 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f866014f810 0x7f86600c4370 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f8654009840 tx=0x7f8654009b50 comp rx=0 tx=0).stop 2023-07-25T14:36:26.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.928+0000 7f86651be700 1 -- 172.21.15.72:0/502113606 shutdown_connections 2023-07-25T14:36:26.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.928+0000 7f86651be700 1 --2- 172.21.15.72:0/502113606 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f866014f810 0x7f86600c4370 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:26.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.928+0000 7f86651be700 1 --2- 172.21.15.72:0/502113606 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f86600a9cc0 0x7f86601525e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:26.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.928+0000 7f86651be700 1 -- 172.21.15.72:0/502113606 >> 172.21.15.72:0/502113606 conn(0x7f866006a8d0 msgr2=0x7f86600a94e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:26.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.928+0000 7f86651be700 1 -- 172.21.15.72:0/502113606 shutdown_connections 2023-07-25T14:36:26.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.928+0000 7f86651be700 1 -- 172.21.15.72:0/502113606 wait complete. 2023-07-25T14:36:26.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.930+0000 7f86651be700 1 Processor -- start 2023-07-25T14:36:26.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.930+0000 7f86651be700 1 -- start start 2023-07-25T14:36:26.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.930+0000 7f86651be700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f86600a9cc0 0x7f8660153540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:26.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.930+0000 7f86651be700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f86600bb0b0 0x7f86601ed660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:26.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.930+0000 7f86651be700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f866014f810 0x7f86601edba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:26.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.930+0000 7f86651be700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86601eaca0 con 0x7f86600a9cc0 2023-07-25T14:36:26.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.930+0000 7f86651be700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f866006b580 con 0x7f86600bb0b0 2023-07-25T14:36:26.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.930+0000 7f86651be700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f866006b2a0 con 0x7f866014f810 2023-07-25T14:36:26.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.931+0000 7f865ed9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f86600a9cc0 0x7f8660153540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:26.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.931+0000 7f865ed9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f86600a9cc0 0x7f8660153540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41126/0 (socket says 172.21.15.72:41126) 2023-07-25T14:36:26.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.931+0000 7f865ed9d700 1 -- 172.21.15.72:0/3023678506 learned_addr learned my addr 172.21.15.72:0/3023678506 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:26.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.931+0000 7f865e59c700 1 --2- 172.21.15.72:0/3023678506 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f86600bb0b0 0x7f86601ed660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:26.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.931+0000 7f865f59e700 1 --2- 172.21.15.72:0/3023678506 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f866014f810 0x7f86601edba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:26.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.931+0000 7f865ed9d700 1 -- 172.21.15.72:0/3023678506 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f866014f810 msgr2=0x7f86601edba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:26.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.931+0000 7f865ed9d700 1 --2- 172.21.15.72:0/3023678506 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f866014f810 0x7f86601edba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:26.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.931+0000 7f865ed9d700 1 -- 172.21.15.72:0/3023678506 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f86600bb0b0 msgr2=0x7f86601ed660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:26.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.931+0000 7f865ed9d700 1 --2- 172.21.15.72:0/3023678506 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f86600bb0b0 0x7f86601ed660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:26.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.931+0000 7f865ed9d700 1 -- 172.21.15.72:0/3023678506 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86540094a0 con 0x7f86600a9cc0 2023-07-25T14:36:26.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.931+0000 7f865ed9d700 1 --2- 172.21.15.72:0/3023678506 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f86600a9cc0 0x7f8660153540 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f86540090b0 tx=0x7f8654004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:26.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.931+0000 7f86477fe700 1 -- 172.21.15.72:0/3023678506 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86540038a0 con 0x7f86600a9cc0 2023-07-25T14:36:26.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.931+0000 7f86477fe700 1 -- 172.21.15.72:0/3023678506 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f865401f070 con 0x7f86600a9cc0 2023-07-25T14:36:26.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.931+0000 7f86651be700 1 -- 172.21.15.72:0/3023678506 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86600be180 con 0x7f86600a9cc0 2023-07-25T14:36:26.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.931+0000 7f86477fe700 1 -- 172.21.15.72:0/3023678506 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8654003c20 con 0x7f86600a9cc0 2023-07-25T14:36:26.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.931+0000 7f86651be700 1 -- 172.21.15.72:0/3023678506 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8660153a80 con 0x7f86600a9cc0 2023-07-25T14:36:26.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.932+0000 7f86651be700 1 -- 172.21.15.72:0/3023678506 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f866004e470 con 0x7f86600a9cc0 2023-07-25T14:36:26.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.933+0000 7f86477fe700 1 -- 172.21.15.72:0/3023678506 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f865401a430 con 0x7f86600a9cc0 2023-07-25T14:36:26.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.933+0000 7f86477fe700 1 --2- 172.21.15.72:0/3023678506 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f864c06ace0 0x7f864c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:26.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.933+0000 7f86477fe700 1 -- 172.21.15.72:0/3023678506 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f8654021070 con 0x7f86600a9cc0 2023-07-25T14:36:26.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.933+0000 7f865e59c700 1 --2- 172.21.15.72:0/3023678506 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f864c06ace0 0x7f864c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:26.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.933+0000 7f865e59c700 1 --2- 172.21.15.72:0/3023678506 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f864c06ace0 0x7f864c06d1a0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f86600a72d0 tx=0x7f8650008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:26.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:26.937+0000 7f86477fe700 1 -- 172.21.15.72:0/3023678506 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f8654055fa0 con 0x7f86600a9cc0 2023-07-25T14:36:27.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.123+0000 7f86651be700 1 -- 172.21.15.72:0/3023678506 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f86600702b0 con 0x7f86600a9cc0 2023-07-25T14:36:27.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.124+0000 7f86477fe700 1 -- 172.21.15.72:0/3023678506 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7f865402b020 con 0x7f86600a9cc0 2023-07-25T14:36:27.137 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2023-07-25T14:36:27.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.126+0000 7f86651be700 1 -- 172.21.15.72:0/3023678506 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f864c06ace0 msgr2=0x7f864c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:27.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.126+0000 7f86651be700 1 --2- 172.21.15.72:0/3023678506 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f864c06ace0 0x7f864c06d1a0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f86600a72d0 tx=0x7f8650008040 comp rx=0 tx=0).stop 2023-07-25T14:36:27.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.126+0000 7f86651be700 1 -- 172.21.15.72:0/3023678506 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f86600a9cc0 msgr2=0x7f8660153540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:27.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.126+0000 7f86651be700 1 --2- 172.21.15.72:0/3023678506 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f86600a9cc0 0x7f8660153540 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f86540090b0 tx=0x7f8654004750 comp rx=0 tx=0).stop 2023-07-25T14:36:27.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.126+0000 7f86651be700 1 -- 172.21.15.72:0/3023678506 shutdown_connections 2023-07-25T14:36:27.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.126+0000 7f86651be700 1 --2- 172.21.15.72:0/3023678506 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f864c06ace0 0x7f864c06d1a0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:27.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.126+0000 7f86651be700 1 --2- 172.21.15.72:0/3023678506 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f866014f810 0x7f86601edba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:27.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.126+0000 7f86651be700 1 --2- 172.21.15.72:0/3023678506 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f86600a9cc0 0x7f8660153540 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:27.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.126+0000 7f86651be700 1 --2- 172.21.15.72:0/3023678506 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f86600bb0b0 0x7f86601ed660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:27.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.126+0000 7f86651be700 1 -- 172.21.15.72:0/3023678506 >> 172.21.15.72:0/3023678506 conn(0x7f866006a8d0 msgr2=0x7f8660151180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:27.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.126+0000 7f86651be700 1 -- 172.21.15.72:0/3023678506 shutdown_connections 2023-07-25T14:36:27.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.126+0000 7f86651be700 1 -- 172.21.15.72:0/3023678506 wait complete. 2023-07-25T14:36:27.150 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-25T14:36:27.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.261+0000 7f1a122d2700 1 Processor -- start 2023-07-25T14:36:27.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.261+0000 7f1a122d2700 1 -- start start 2023-07-25T14:36:27.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.262+0000 7f1a122d2700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f1a0c14f810 0x7f1a0c0c4370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:27.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.262+0000 7f1a122d2700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1a0c0a9cc0 0x7f1a0c1525e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:27.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.262+0000 7f1a122d2700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1a0c0bb0b0 0x7f1a0c152b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:27.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.262+0000 7f1a122d2700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a0c0c5890 con 0x7f1a0c0bb0b0 2023-07-25T14:36:27.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.262+0000 7f1a122d2700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a0c152150 con 0x7f1a0c14f810 2023-07-25T14:36:27.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.262+0000 7f1a122d2700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a0c14fbf0 con 0x7f1a0c0a9cc0 2023-07-25T14:36:27.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.262+0000 7f1a1086f700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1a0c0bb0b0 0x7f1a0c152b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:27.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.262+0000 7f1a1086f700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1a0c0bb0b0 0x7f1a0c152b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41138/0 (socket says 172.21.15.72:41138) 2023-07-25T14:36:27.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.262+0000 7f1a1086f700 1 -- 172.21.15.72:0/39987122 learned_addr learned my addr 172.21.15.72:0/39987122 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:27.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.263+0000 7f1a0bfff700 1 --2- 172.21.15.72:0/39987122 >> v2:172.21.15.92:3300/0 conn(0x7f1a0c14f810 0x7f1a0c0c4370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:27.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.263+0000 7f1a0b7fe700 1 --2- 172.21.15.72:0/39987122 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1a0c0a9cc0 0x7f1a0c1525e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:27.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.263+0000 7f1a1086f700 1 -- 172.21.15.72:0/39987122 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1a0c0a9cc0 msgr2=0x7f1a0c1525e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:27.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.263+0000 7f1a1086f700 1 --2- 172.21.15.72:0/39987122 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1a0c0a9cc0 0x7f1a0c1525e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:27.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.263+0000 7f1a1086f700 1 -- 172.21.15.72:0/39987122 >> v2:172.21.15.92:3300/0 conn(0x7f1a0c14f810 msgr2=0x7f1a0c0c4370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:27.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.263+0000 7f1a1086f700 1 --2- 172.21.15.72:0/39987122 >> v2:172.21.15.92:3300/0 conn(0x7f1a0c14f810 0x7f1a0c0c4370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:27.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.263+0000 7f1a1086f700 1 -- 172.21.15.72:0/39987122 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a0c1566a0 con 0x7f1a0c0bb0b0 2023-07-25T14:36:27.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.263+0000 7f1a0bfff700 1 --2- 172.21.15.72:0/39987122 >> v2:172.21.15.92:3300/0 conn(0x7f1a0c14f810 0x7f1a0c0c4370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-25T14:36:27.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.263+0000 7f1a1086f700 1 --2- 172.21.15.72:0/39987122 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1a0c0bb0b0 0x7f1a0c152b20 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f1a0c0aa300 tx=0x7f1a0400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f66939e1930cee93 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:27.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.263+0000 7f1a0affd700 1 -- 172.21.15.72:0/39987122 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a0400e070 con 0x7f1a0c0bb0b0 2023-07-25T14:36:27.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.263+0000 7f1a0affd700 1 -- 172.21.15.72:0/39987122 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a0400b9c0 con 0x7f1a0c0bb0b0 2023-07-25T14:36:27.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.263+0000 7f1a0affd700 1 -- 172.21.15.72:0/39987122 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a0400bd70 con 0x7f1a0c0bb0b0 2023-07-25T14:36:27.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.263+0000 7f1a122d2700 1 -- 172.21.15.72:0/39987122 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1a0c0bb0b0 msgr2=0x7f1a0c152b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:27.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.263+0000 7f1a122d2700 1 --2- 172.21.15.72:0/39987122 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1a0c0bb0b0 0x7f1a0c152b20 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f1a0c0aa300 tx=0x7f1a0400b330 comp rx=0 tx=0).stop 2023-07-25T14:36:27.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.264+0000 7f1a122d2700 1 -- 172.21.15.72:0/39987122 shutdown_connections 2023-07-25T14:36:27.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.264+0000 7f1a122d2700 1 --2- 172.21.15.72:0/39987122 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1a0c0bb0b0 0x7f1a0c152b20 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:27.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.264+0000 7f1a122d2700 1 --2- 172.21.15.72:0/39987122 >> v2:172.21.15.92:3300/0 conn(0x7f1a0c14f810 0x7f1a0c0c4370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:27.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.264+0000 7f1a122d2700 1 --2- 172.21.15.72:0/39987122 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1a0c0a9cc0 0x7f1a0c1525e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:27.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.264+0000 7f1a122d2700 1 -- 172.21.15.72:0/39987122 >> 172.21.15.72:0/39987122 conn(0x7f1a0c06a8d0 msgr2=0x7f1a0c0a94e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:27.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.264+0000 7f1a122d2700 1 -- 172.21.15.72:0/39987122 shutdown_connections 2023-07-25T14:36:27.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.264+0000 7f1a122d2700 1 -- 172.21.15.72:0/39987122 wait complete. 2023-07-25T14:36:27.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.265+0000 7f1a122d2700 1 Processor -- start 2023-07-25T14:36:27.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.265+0000 7f1a122d2700 1 -- start start 2023-07-25T14:36:27.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.266+0000 7f1a122d2700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1a0c0a9cc0 0x7f1a0c0ac960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:27.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.266+0000 7f1a122d2700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1a0c0bb0b0 0x7f1a0c14dad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:27.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.266+0000 7f1a122d2700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1a0c14f810 0x7f1a0c14e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:27.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.266+0000 7f1a122d2700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a0c0bc140 con 0x7f1a0c0a9cc0 2023-07-25T14:36:27.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.266+0000 7f1a122d2700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a0c0bbdf0 con 0x7f1a0c0bb0b0 2023-07-25T14:36:27.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.266+0000 7f1a122d2700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a0c0be420 con 0x7f1a0c14f810 2023-07-25T14:36:27.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.266+0000 7f1a0bfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1a0c0a9cc0 0x7f1a0c0ac960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:27.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.266+0000 7f1a0bfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1a0c0a9cc0 0x7f1a0c0ac960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41142/0 (socket says 172.21.15.72:41142) 2023-07-25T14:36:27.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.266+0000 7f1a0bfff700 1 -- 172.21.15.72:0/2841979754 learned_addr learned my addr 172.21.15.72:0/2841979754 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:27.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.266+0000 7f1a0b7fe700 1 --2- 172.21.15.72:0/2841979754 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1a0c0bb0b0 0x7f1a0c14dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:27.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.266+0000 7f1a1086f700 1 --2- 172.21.15.72:0/2841979754 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1a0c14f810 0x7f1a0c14e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:27.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.266+0000 7f1a0bfff700 1 -- 172.21.15.72:0/2841979754 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1a0c14f810 msgr2=0x7f1a0c14e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:27.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.266+0000 7f1a0bfff700 1 --2- 172.21.15.72:0/2841979754 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1a0c14f810 0x7f1a0c14e010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:27.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.266+0000 7f1a0bfff700 1 -- 172.21.15.72:0/2841979754 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1a0c0bb0b0 msgr2=0x7f1a0c14dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:27.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.266+0000 7f1a0bfff700 1 --2- 172.21.15.72:0/2841979754 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1a0c0bb0b0 0x7f1a0c14dad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:27.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.267+0000 7f1a0bfff700 1 -- 172.21.15.72:0/2841979754 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a04009b30 con 0x7f1a0c0a9cc0 2023-07-25T14:36:27.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.267+0000 7f1a0bfff700 1 --2- 172.21.15.72:0/2841979754 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1a0c0a9cc0 0x7f1a0c0ac960 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f19f400e810 tx=0x7f19f400eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:27.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.267+0000 7f1a08ff9700 1 -- 172.21.15.72:0/2841979754 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19f400c070 con 0x7f1a0c0a9cc0 2023-07-25T14:36:27.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.267+0000 7f1a08ff9700 1 -- 172.21.15.72:0/2841979754 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19f4004230 con 0x7f1a0c0a9cc0 2023-07-25T14:36:27.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.267+0000 7f1a122d2700 1 -- 172.21.15.72:0/2841979754 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a0c0be700 con 0x7f1a0c0a9cc0 2023-07-25T14:36:27.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.267+0000 7f1a08ff9700 1 -- 172.21.15.72:0/2841979754 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19f40036a0 con 0x7f1a0c0a9cc0 2023-07-25T14:36:27.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.267+0000 7f1a122d2700 1 -- 172.21.15.72:0/2841979754 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a0c14e970 con 0x7f1a0c0a9cc0 2023-07-25T14:36:27.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.268+0000 7f1a122d2700 1 -- 172.21.15.72:0/2841979754 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a0c0bc460 con 0x7f1a0c0a9cc0 2023-07-25T14:36:27.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.268+0000 7f1a08ff9700 1 -- 172.21.15.72:0/2841979754 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f19f4003800 con 0x7f1a0c0a9cc0 2023-07-25T14:36:27.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.269+0000 7f1a08ff9700 1 --2- 172.21.15.72:0/2841979754 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f19ec06ace0 0x7f19ec06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:27.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.269+0000 7f1a08ff9700 1 -- 172.21.15.72:0/2841979754 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f19f4089480 con 0x7f1a0c0a9cc0 2023-07-25T14:36:27.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.269+0000 7f1a0b7fe700 1 --2- 172.21.15.72:0/2841979754 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f19ec06ace0 0x7f19ec06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:27.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.269+0000 7f1a0b7fe700 1 --2- 172.21.15.72:0/2841979754 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f19ec06ace0 0x7f19ec06d1a0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f19fc004610 tx=0x7f19fc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:27.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.273+0000 7f1a08ff9700 1 -- 172.21.15.72:0/2841979754 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f19f4054230 con 0x7f1a0c0a9cc0 2023-07-25T14:36:27.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.462+0000 7f1a122d2700 1 -- 172.21.15.72:0/2841979754 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1a0c04e470 con 0x7f1a0c0a9cc0 2023-07-25T14:36:27.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.462+0000 7f1a08ff9700 1 -- 172.21.15.72:0/2841979754 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7f19f4057850 con 0x7f1a0c0a9cc0 2023-07-25T14:36:27.474 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 64 2023-07-25T14:36:27.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.464+0000 7f1a122d2700 1 -- 172.21.15.72:0/2841979754 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f19ec06ace0 msgr2=0x7f19ec06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:27.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.464+0000 7f1a122d2700 1 --2- 172.21.15.72:0/2841979754 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f19ec06ace0 0x7f19ec06d1a0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f19fc004610 tx=0x7f19fc008040 comp rx=0 tx=0).stop 2023-07-25T14:36:27.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.464+0000 7f1a122d2700 1 -- 172.21.15.72:0/2841979754 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1a0c0a9cc0 msgr2=0x7f1a0c0ac960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:27.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.464+0000 7f1a122d2700 1 --2- 172.21.15.72:0/2841979754 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1a0c0a9cc0 0x7f1a0c0ac960 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f19f400e810 tx=0x7f19f400eb20 comp rx=0 tx=0).stop 2023-07-25T14:36:27.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.464+0000 7f1a122d2700 1 -- 172.21.15.72:0/2841979754 shutdown_connections 2023-07-25T14:36:27.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.464+0000 7f1a122d2700 1 --2- 172.21.15.72:0/2841979754 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f19ec06ace0 0x7f19ec06d1a0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:27.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.464+0000 7f1a122d2700 1 --2- 172.21.15.72:0/2841979754 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1a0c14f810 0x7f1a0c14e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:27.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.464+0000 7f1a122d2700 1 --2- 172.21.15.72:0/2841979754 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1a0c0a9cc0 0x7f1a0c0ac960 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:27.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.464+0000 7f1a122d2700 1 --2- 172.21.15.72:0/2841979754 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1a0c0bb0b0 0x7f1a0c14dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:27.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.464+0000 7f1a122d2700 1 -- 172.21.15.72:0/2841979754 >> 172.21.15.72:0/2841979754 conn(0x7f1a0c06a8d0 msgr2=0x7f1a0c0c6b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:27.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.464+0000 7f1a122d2700 1 -- 172.21.15.72:0/2841979754 shutdown_connections 2023-07-25T14:36:27.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.464+0000 7f1a122d2700 1 -- 172.21.15.72:0/2841979754 wait complete. 2023-07-25T14:36:27.488 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-07-25T14:36:27.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.600+0000 7f6423562700 1 Processor -- start 2023-07-25T14:36:27.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.601+0000 7f6423562700 1 -- start start 2023-07-25T14:36:27.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.601+0000 7f6423562700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f641c14e6f0 0x7f641c0c67d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:27.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.601+0000 7f6423562700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f641c06f280 0x7f641c0a8170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:27.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.601+0000 7f6423562700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f641c0ba1c0 con 0x7f641c0c11f0 2023-07-25T14:36:27.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.601+0000 7f6423562700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f641c0a7920 con 0x7f641c14e6f0 2023-07-25T14:36:27.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.601+0000 7f6423562700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f641c154640 con 0x7f641c06f280 2023-07-25T14:36:27.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.601+0000 7f64212fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f641c14e6f0 0x7f641c0c67d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:27.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.601+0000 7f64212fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f641c14e6f0 0x7f641c0c67d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41152/0 (socket says 172.21.15.72:41152) 2023-07-25T14:36:27.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.601+0000 7f64212fe700 1 -- 172.21.15.72:0/901739547 learned_addr learned my addr 172.21.15.72:0/901739547 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:27.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.602+0000 7f64212fe700 1 -- 172.21.15.72:0/901739547 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f641c06f280 msgr2=0x7f641c0a8170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:27.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.602+0000 7f6420afd700 1 --2- 172.21.15.72:0/901739547 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f641c06f280 0x7f641c0a8170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:27.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.602+0000 7f64212fe700 1 --2- 172.21.15.72:0/901739547 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f641c06f280 0x7f641c0a8170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:27.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.602+0000 7f64212fe700 1 -- 172.21.15.72:0/901739547 >> v1:172.21.15.92:6789/0 conn(0x7f641c0c11f0 legacy=0x7f641c0a86b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:27.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.602+0000 7f64212fe700 1 -- 172.21.15.72:0/901739547 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f641c154900 con 0x7f641c14e6f0 2023-07-25T14:36:27.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.602+0000 7f64212fe700 1 --2- 172.21.15.72:0/901739547 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f641c14e6f0 0x7f641c0c67d0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f640c0098f0 tx=0x7f640c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30c43af002e28eb2 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:27.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.602+0000 7f6413fff700 1 -- 172.21.15.72:0/901739547 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f640c004230 con 0x7f641c14e6f0 2023-07-25T14:36:27.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.602+0000 7f6413fff700 1 -- 172.21.15.72:0/901739547 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f640c004390 con 0x7f641c14e6f0 2023-07-25T14:36:27.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.602+0000 7f6413fff700 1 -- 172.21.15.72:0/901739547 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f640c0036a0 con 0x7f641c14e6f0 2023-07-25T14:36:27.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.603+0000 7f6423562700 1 -- 172.21.15.72:0/901739547 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f641c14e6f0 msgr2=0x7f641c0c67d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:27.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.603+0000 7f6423562700 1 --2- 172.21.15.72:0/901739547 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f641c14e6f0 0x7f641c0c67d0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f640c0098f0 tx=0x7f640c009c00 comp rx=0 tx=0).stop 2023-07-25T14:36:27.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.603+0000 7f6423562700 1 -- 172.21.15.72:0/901739547 shutdown_connections 2023-07-25T14:36:27.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.603+0000 7f6423562700 1 --2- 172.21.15.72:0/901739547 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f641c14e6f0 0x7f641c0c67d0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:27.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.603+0000 7f6423562700 1 --2- 172.21.15.72:0/901739547 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f641c06f280 0x7f641c0a8170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:27.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.603+0000 7f6423562700 1 -- 172.21.15.72:0/901739547 >> 172.21.15.72:0/901739547 conn(0x7f641c0714f0 msgr2=0x7f641c071900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:27.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.603+0000 7f6423562700 1 -- 172.21.15.72:0/901739547 shutdown_connections 2023-07-25T14:36:27.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.603+0000 7f6423562700 1 -- 172.21.15.72:0/901739547 wait complete. 2023-07-25T14:36:27.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.604+0000 7f6423562700 1 Processor -- start 2023-07-25T14:36:27.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.604+0000 7f6423562700 1 -- start start 2023-07-25T14:36:27.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.604+0000 7f6423562700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f641c06f280 0x7f641c0bdd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:27.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.604+0000 7f6423562700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f641c0c11f0 0x7f641c14d230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:27.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.604+0000 7f6423562700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f641c14e6f0 0x7f641c14d770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:27.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.604+0000 7f6423562700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f641c1edbb0 con 0x7f641c06f280 2023-07-25T14:36:27.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.604+0000 7f6423562700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f641c0be260 con 0x7f641c0c11f0 2023-07-25T14:36:27.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.604+0000 7f6423562700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f641c0a9c90 con 0x7f641c14e6f0 2023-07-25T14:36:27.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.605+0000 7f64212fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f641c06f280 0x7f641c0bdd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:27.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.605+0000 7f64212fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f641c06f280 0x7f641c0bdd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41158/0 (socket says 172.21.15.72:41158) 2023-07-25T14:36:27.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.605+0000 7f64212fe700 1 -- 172.21.15.72:0/1364252906 learned_addr learned my addr 172.21.15.72:0/1364252906 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:27.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.605+0000 7f6420afd700 1 --2- 172.21.15.72:0/1364252906 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f641c0c11f0 0x7f641c14d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:27.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.605+0000 7f6421aff700 1 --2- 172.21.15.72:0/1364252906 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f641c14e6f0 0x7f641c14d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:27.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.605+0000 7f64212fe700 1 -- 172.21.15.72:0/1364252906 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f641c14e6f0 msgr2=0x7f641c14d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:27.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.605+0000 7f64212fe700 1 --2- 172.21.15.72:0/1364252906 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f641c14e6f0 0x7f641c14d770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:27.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.605+0000 7f64212fe700 1 -- 172.21.15.72:0/1364252906 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f641c0c11f0 msgr2=0x7f641c14d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:27.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.605+0000 7f64212fe700 1 --2- 172.21.15.72:0/1364252906 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f641c0c11f0 0x7f641c14d230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:27.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.605+0000 7f64212fe700 1 -- 172.21.15.72:0/1364252906 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f640c009550 con 0x7f641c06f280 2023-07-25T14:36:27.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.605+0000 7f6420afd700 1 --2- 172.21.15.72:0/1364252906 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f641c0c11f0 0x7f641c14d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-25T14:36:27.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.605+0000 7f6421aff700 1 --2- 172.21.15.72:0/1364252906 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f641c14e6f0 0x7f641c14d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-25T14:36:27.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.605+0000 7f64212fe700 1 --2- 172.21.15.72:0/1364252906 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f641c06f280 0x7f641c0bdd20 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f640c009130 tx=0x7f640c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:27.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.605+0000 7f6411ffb700 1 -- 172.21.15.72:0/1364252906 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f640c00b860 con 0x7f641c06f280 2023-07-25T14:36:27.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.605+0000 7f6411ffb700 1 -- 172.21.15.72:0/1364252906 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f640c00b9c0 con 0x7f641c06f280 2023-07-25T14:36:27.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.605+0000 7f6423562700 1 -- 172.21.15.72:0/1364252906 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f641c0a96d0 con 0x7f641c06f280 2023-07-25T14:36:27.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.605+0000 7f6411ffb700 1 -- 172.21.15.72:0/1364252906 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f640c00bd70 con 0x7f641c06f280 2023-07-25T14:36:27.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.605+0000 7f6423562700 1 -- 172.21.15.72:0/1364252906 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f641c0aa650 con 0x7f641c06f280 2023-07-25T14:36:27.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.606+0000 7f6423562700 1 -- 172.21.15.72:0/1364252906 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f641c04e470 con 0x7f641c06f280 2023-07-25T14:36:27.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.607+0000 7f6411ffb700 1 -- 172.21.15.72:0/1364252906 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f640c01b440 con 0x7f641c06f280 2023-07-25T14:36:27.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.607+0000 7f6411ffb700 1 --2- 172.21.15.72:0/1364252906 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f640006ace0 0x7f640006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:27.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.607+0000 7f6411ffb700 1 -- 172.21.15.72:0/1364252906 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f640c08b0d0 con 0x7f641c06f280 2023-07-25T14:36:27.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.607+0000 7f6420afd700 1 --2- 172.21.15.72:0/1364252906 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f640006ace0 0x7f640006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:27.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.607+0000 7f6420afd700 1 --2- 172.21.15.72:0/1364252906 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f640006ace0 0x7f640006d1a0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f6418006fd0 tx=0x7f6418008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:27.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.611+0000 7f6411ffb700 1 -- 172.21.15.72:0/1364252906 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f640c055f20 con 0x7f641c06f280 2023-07-25T14:36:27.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.798+0000 7f6423562700 1 -- 172.21.15.72:0/1364252906 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f641c151a70 con 0x7f641c06f280 2023-07-25T14:36:27.810 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.799+0000 7f6411ffb700 1 -- 172.21.15.72:0/1364252906 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f640c059540 con 0x7f641c06f280 2023-07-25T14:36:27.811 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2023-07-25T14:36:27.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.801+0000 7f6423562700 1 -- 172.21.15.72:0/1364252906 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f640006ace0 msgr2=0x7f640006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:27.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.801+0000 7f6423562700 1 --2- 172.21.15.72:0/1364252906 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f640006ace0 0x7f640006d1a0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f6418006fd0 tx=0x7f6418008040 comp rx=0 tx=0).stop 2023-07-25T14:36:27.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.801+0000 7f6423562700 1 -- 172.21.15.72:0/1364252906 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f641c06f280 msgr2=0x7f641c0bdd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:27.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.801+0000 7f6423562700 1 --2- 172.21.15.72:0/1364252906 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f641c06f280 0x7f641c0bdd20 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f640c009130 tx=0x7f640c004750 comp rx=0 tx=0).stop 2023-07-25T14:36:27.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.801+0000 7f6423562700 1 -- 172.21.15.72:0/1364252906 shutdown_connections 2023-07-25T14:36:27.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.801+0000 7f6423562700 1 --2- 172.21.15.72:0/1364252906 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f640006ace0 0x7f640006d1a0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:27.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.801+0000 7f6423562700 1 --2- 172.21.15.72:0/1364252906 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f641c14e6f0 0x7f641c14d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:27.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.801+0000 7f6423562700 1 --2- 172.21.15.72:0/1364252906 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f641c06f280 0x7f641c0bdd20 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:27.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.801+0000 7f6423562700 1 --2- 172.21.15.72:0/1364252906 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f641c0c11f0 0x7f641c14d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:27.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.801+0000 7f6423562700 1 -- 172.21.15.72:0/1364252906 >> 172.21.15.72:0/1364252906 conn(0x7f641c0714f0 msgr2=0x7f641c06ab10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:27.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.801+0000 7f6423562700 1 -- 172.21.15.72:0/1364252906 shutdown_connections 2023-07-25T14:36:27.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.801+0000 7f6423562700 1 -- 172.21.15.72:0/1364252906 wait complete. 2023-07-25T14:36:27.824 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-07-25T14:36:27.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.939+0000 7f5e79b00700 1 Processor -- start 2023-07-25T14:36:27.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.939+0000 7f5e79b00700 1 -- start start 2023-07-25T14:36:27.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.939+0000 7f5e79b00700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f5e741518c0 0x7f5e7406b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:27.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.939+0000 7f5e79b00700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f5e740c4370 0x7f5e740c47a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:27.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.939+0000 7f5e79b00700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e74157cd0 con 0x7f5e74154df0 2023-07-25T14:36:27.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.939+0000 7f5e79b00700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e740c2310 con 0x7f5e740c4370 2023-07-25T14:36:27.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.939+0000 7f5e79b00700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e74158870 con 0x7f5e741518c0 2023-07-25T14:36:27.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.939+0000 7f5e73fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f5e740c4370 0x7f5e740c47a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:27.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.939+0000 7f5e73fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f5e740c4370 0x7f5e740c47a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41170/0 (socket says 172.21.15.72:41170) 2023-07-25T14:36:27.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.939+0000 7f5e73fff700 1 -- 172.21.15.72:0/3750663187 learned_addr learned my addr 172.21.15.72:0/3750663187 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:27.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.939+0000 7f5e72ffd700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f5e74154df0 0x7f5e74158160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:60134/0 (socket says 172.21.15.72:60134) 2023-07-25T14:36:27.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.940+0000 7f5e737fe700 1 --2- 172.21.15.72:0/3750663187 >> v2:172.21.15.92:3300/0 conn(0x7f5e741518c0 0x7f5e7406b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:27.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.940+0000 7f5e73fff700 1 -- 172.21.15.72:0/3750663187 >> v2:172.21.15.92:3300/0 conn(0x7f5e741518c0 msgr2=0x7f5e7406b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:27.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.940+0000 7f5e73fff700 1 --2- 172.21.15.72:0/3750663187 >> v2:172.21.15.92:3300/0 conn(0x7f5e741518c0 0x7f5e7406b2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:27.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.940+0000 7f5e73fff700 1 -- 172.21.15.72:0/3750663187 >> v1:172.21.15.72:6789/0 conn(0x7f5e74154df0 legacy=0x7f5e74158160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:27.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.940+0000 7f5e73fff700 1 -- 172.21.15.72:0/3750663187 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e74155280 con 0x7f5e740c4370 2023-07-25T14:36:27.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.940+0000 7f5e727fc700 1 -- 172.21.15.72:0/3750663187 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2273138384 0 0) 0x7f5e74157cd0 con 0x7f5e74154df0 2023-07-25T14:36:27.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.940+0000 7f5e737fe700 1 --2- 172.21.15.72:0/3750663187 >> v2:172.21.15.92:3300/0 conn(0x7f5e741518c0 0x7f5e7406b2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-25T14:36:27.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.940+0000 7f5e73fff700 1 --2- 172.21.15.72:0/3750663187 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5e740c4370 0x7f5e740c47a0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f5e740c4eb0 tx=0x7f5e6c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb51106140d3c014 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:27.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.940+0000 7f5e727fc700 1 -- 172.21.15.72:0/3750663187 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e6c00e070 con 0x7f5e740c4370 2023-07-25T14:36:27.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.940+0000 7f5e727fc700 1 -- 172.21.15.72:0/3750663187 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e6c00b9c0 con 0x7f5e740c4370 2023-07-25T14:36:27.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.940+0000 7f5e727fc700 1 -- 172.21.15.72:0/3750663187 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e6c00bd70 con 0x7f5e740c4370 2023-07-25T14:36:27.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.941+0000 7f5e79b00700 1 -- 172.21.15.72:0/3750663187 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5e740c4370 msgr2=0x7f5e740c47a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:27.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.941+0000 7f5e79b00700 1 --2- 172.21.15.72:0/3750663187 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5e740c4370 0x7f5e740c47a0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f5e740c4eb0 tx=0x7f5e6c00b330 comp rx=0 tx=0).stop 2023-07-25T14:36:27.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.941+0000 7f5e79b00700 1 -- 172.21.15.72:0/3750663187 shutdown_connections 2023-07-25T14:36:27.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.941+0000 7f5e79b00700 1 --2- 172.21.15.72:0/3750663187 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5e740c4370 0x7f5e740c47a0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:27.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.941+0000 7f5e79b00700 1 --2- 172.21.15.72:0/3750663187 >> v2:172.21.15.92:3300/0 conn(0x7f5e741518c0 0x7f5e7406b2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:27.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.941+0000 7f5e79b00700 1 -- 172.21.15.72:0/3750663187 >> 172.21.15.72:0/3750663187 conn(0x7f5e7406a8d0 msgr2=0x7f5e740a94e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:27.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.941+0000 7f5e79b00700 1 -- 172.21.15.72:0/3750663187 shutdown_connections 2023-07-25T14:36:27.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.941+0000 7f5e79b00700 1 -- 172.21.15.72:0/3750663187 wait complete. 2023-07-25T14:36:27.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.942+0000 7f5e79b00700 1 Processor -- start 2023-07-25T14:36:27.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.942+0000 7f5e79b00700 1 -- start start 2023-07-25T14:36:27.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.943+0000 7f5e79b00700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5e740c4370 0x7f5e74155b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:27.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.943+0000 7f5e79b00700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5e741518c0 0x7f5e741eaec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:27.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.943+0000 7f5e79b00700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5e74154df0 0x7f5e741eb400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:27.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.943+0000 7f5e79b00700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e740c5f50 con 0x7f5e740c4370 2023-07-25T14:36:27.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.943+0000 7f5e79b00700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e740c7490 con 0x7f5e74154df0 2023-07-25T14:36:27.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.943+0000 7f5e79b00700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e741eddf0 con 0x7f5e741518c0 2023-07-25T14:36:27.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.943+0000 7f5e737fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5e740c4370 0x7f5e74155b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:27.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.943+0000 7f5e737fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5e740c4370 0x7f5e74155b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41172/0 (socket says 172.21.15.72:41172) 2023-07-25T14:36:27.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.943+0000 7f5e737fe700 1 -- 172.21.15.72:0/1173656971 learned_addr learned my addr 172.21.15.72:0/1173656971 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:27.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.944+0000 7f5e72ffd700 1 --2- 172.21.15.72:0/1173656971 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5e741518c0 0x7f5e741eaec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:27.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.944+0000 7f5e737fe700 1 -- 172.21.15.72:0/1173656971 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5e741518c0 msgr2=0x7f5e741eaec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:27.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.944+0000 7f5e737fe700 1 --2- 172.21.15.72:0/1173656971 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5e741518c0 0x7f5e741eaec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:27.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.944+0000 7f5e737fe700 1 -- 172.21.15.72:0/1173656971 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5e74154df0 msgr2=0x7f5e741eb400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:27.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.944+0000 7f5e737fe700 1 --2- 172.21.15.72:0/1173656971 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5e74154df0 0x7f5e741eb400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:27.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.944+0000 7f5e737fe700 1 -- 172.21.15.72:0/1173656971 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e6c009b30 con 0x7f5e740c4370 2023-07-25T14:36:27.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.944+0000 7f5e737fe700 1 --2- 172.21.15.72:0/1173656971 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5e740c4370 0x7f5e74155b60 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f5e6400c750 tx=0x7f5e6400cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:27.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.944+0000 7f5e6bfff700 1 -- 172.21.15.72:0/1173656971 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e64011800 con 0x7f5e740c4370 2023-07-25T14:36:27.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.944+0000 7f5e6bfff700 1 -- 172.21.15.72:0/1173656971 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e64011960 con 0x7f5e740c4370 2023-07-25T14:36:27.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.944+0000 7f5e79b00700 1 -- 172.21.15.72:0/1173656971 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e741eb940 con 0x7f5e740c4370 2023-07-25T14:36:27.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.944+0000 7f5e6bfff700 1 -- 172.21.15.72:0/1173656971 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e64011cd0 con 0x7f5e740c4370 2023-07-25T14:36:27.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.944+0000 7f5e79b00700 1 -- 172.21.15.72:0/1173656971 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e740c61a0 con 0x7f5e740c4370 2023-07-25T14:36:27.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.945+0000 7f5e79b00700 1 -- 172.21.15.72:0/1173656971 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e741ed960 con 0x7f5e740c4370 2023-07-25T14:36:27.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.945+0000 7f5e6bfff700 1 -- 172.21.15.72:0/1173656971 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5e64021350 con 0x7f5e740c4370 2023-07-25T14:36:27.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.946+0000 7f5e6bfff700 1 --2- 172.21.15.72:0/1173656971 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f5e5406ace0 0x7f5e5406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:27.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.946+0000 7f5e72ffd700 1 --2- 172.21.15.72:0/1173656971 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f5e5406ace0 0x7f5e5406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:27.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.946+0000 7f5e6bfff700 1 -- 172.21.15.72:0/1173656971 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f5e64089720 con 0x7f5e740c4370 2023-07-25T14:36:27.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.946+0000 7f5e72ffd700 1 --2- 172.21.15.72:0/1173656971 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f5e5406ace0 0x7f5e5406d1a0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f5e5c000f60 tx=0x7f5e5c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:27.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:27.950+0000 7f5e6bfff700 1 -- 172.21.15.72:0/1173656971 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f5e64054530 con 0x7f5e740c4370 2023-07-25T14:36:28.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:28.136+0000 7f5e79b00700 1 -- 172.21.15.72:0/1173656971 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f5e740c27d0 con 0x7f5e740c4370 2023-07-25T14:36:28.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:28.140+0000 7f5e6bfff700 1 -- 172.21.15.72:0/1173656971 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f5e64057b50 con 0x7f5e740c4370 2023-07-25T14:36:28.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:28.142+0000 7f5e79b00700 1 -- 172.21.15.72:0/1173656971 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f5e5406ace0 msgr2=0x7f5e5406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:28.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:28.142+0000 7f5e79b00700 1 --2- 172.21.15.72:0/1173656971 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f5e5406ace0 0x7f5e5406d1a0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f5e5c000f60 tx=0x7f5e5c009040 comp rx=0 tx=0).stop 2023-07-25T14:36:28.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:28.142+0000 7f5e79b00700 1 -- 172.21.15.72:0/1173656971 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5e740c4370 msgr2=0x7f5e74155b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:28.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:28.142+0000 7f5e79b00700 1 --2- 172.21.15.72:0/1173656971 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5e740c4370 0x7f5e74155b60 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f5e6400c750 tx=0x7f5e6400cb10 comp rx=0 tx=0).stop 2023-07-25T14:36:28.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:28.142+0000 7f5e79b00700 1 -- 172.21.15.72:0/1173656971 shutdown_connections 2023-07-25T14:36:28.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:28.142+0000 7f5e79b00700 1 --2- 172.21.15.72:0/1173656971 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f5e5406ace0 0x7f5e5406d1a0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:28.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:28.142+0000 7f5e79b00700 1 --2- 172.21.15.72:0/1173656971 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5e74154df0 0x7f5e741eb400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:28.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:28.142+0000 7f5e79b00700 1 --2- 172.21.15.72:0/1173656971 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5e740c4370 0x7f5e74155b60 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:28.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:28.142+0000 7f5e79b00700 1 --2- 172.21.15.72:0/1173656971 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5e741518c0 0x7f5e741eaec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:28.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:28.142+0000 7f5e79b00700 1 -- 172.21.15.72:0/1173656971 >> 172.21.15.72:0/1173656971 conn(0x7f5e7406a8d0 msgr2=0x7f5e741540d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:28.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:28.142+0000 7f5e79b00700 1 -- 172.21.15.72:0/1173656971 shutdown_connections 2023-07-25T14:36:28.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:28.142+0000 7f5e79b00700 1 -- 172.21.15.72:0/1173656971 wait complete. 2023-07-25T14:36:28.166 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-25T14:36:28.167 DEBUG:teuthology.orchestra.run.smithi072:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-25T14:36:28.202 DEBUG:teuthology.orchestra.run.smithi092:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-25T14:36:28.249 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-25T14:36:28.250 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-07-25T14:36:28.250 DEBUG:teuthology.orchestra.run.smithi072:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-25T14:36:28.266 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-07-25T14:36:28.267 DEBUG:teuthology.orchestra.run.smithi072:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-25T14:36:28.324 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-07-25T14:36:28.325 DEBUG:teuthology.orchestra.run.smithi072:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-25T14:36:28.382 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-25T14:36:28.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:28.529+0000 7fbd44e36700 1 Processor -- start 2023-07-25T14:36:28.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:28.529+0000 7fbd44e36700 1 -- start start 2023-07-25T14:36:28.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:28.530+0000 7fbd44e36700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fbd400a9cc0 0x7fbd401525e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:28.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:28.530+0000 7fbd44e36700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fbd400bb0b0 0x7fbd40152b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:28.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:28.530+0000 7fbd44e36700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd400c5890 con 0x7fbd4014f810 2023-07-25T14:36:28.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:28.530+0000 7fbd44e36700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd40152150 con 0x7fbd400bb0b0 2023-07-25T14:36:28.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:28.530+0000 7fbd44e36700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd4014fbf0 con 0x7fbd400a9cc0 2023-07-25T14:36:28.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:28.530+0000 7fbd3e59c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fbd4014f810 0x7fbd400c4370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:60148/0 (socket says 172.21.15.72:60148) 2023-07-25T14:36:28.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:28.530+0000 7fbd3e59c700 1 -- 172.21.15.72:0/2168899356 learned_addr learned my addr 172.21.15.72:0/2168899356 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:36:28.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:28.530+0000 7fbd3ed9d700 1 --2- 172.21.15.72:0/2168899356 >> v2:172.21.15.92:3300/0 conn(0x7fbd400bb0b0 0x7fbd40152b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:28.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:28.530+0000 7fbd3dd9b700 1 --2- 172.21.15.72:0/2168899356 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fbd400a9cc0 0x7fbd401525e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:28.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:28.530+0000 7fbd3d59a700 1 -- 172.21.15.72:0/2168899356 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3074601168 0 0) 0x7fbd400c5890 con 0x7fbd4014f810 2023-07-25T14:36:28.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:28.530+0000 7fbd3d59a700 1 -- 172.21.15.72:0/2168899356 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbd280035b0 con 0x7fbd4014f810 2023-07-25T14:36:28.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:28.530+0000 7fbd3d59a700 1 -- 172.21.15.72:0/2168899356 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2214515802 0 0) 0x7fbd280035b0 con 0x7fbd4014f810 2023-07-25T14:36:28.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:28.530+0000 7fbd3d59a700 1 -- 172.21.15.72:0/2168899356 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fbd400a9cc0 msgr2=0x7fbd401525e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:28.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:28.530+0000 7fbd3d59a700 1 --2- 172.21.15.72:0/2168899356 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fbd400a9cc0 0x7fbd401525e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:28.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:28.530+0000 7fbd3d59a700 1 -- 172.21.15.72:0/2168899356 >> v2:172.21.15.92:3300/0 conn(0x7fbd400bb0b0 msgr2=0x7fbd40152b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:28.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:28.530+0000 7fbd3d59a700 1 --2- 172.21.15.72:0/2168899356 >> v2:172.21.15.92:3300/0 conn(0x7fbd400bb0b0 0x7fbd40152b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:28.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:28.530+0000 7fbd3d59a700 1 -- 172.21.15.72:0/2168899356 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd401566a0 con 0x7fbd4014f810 2023-07-25T14:36:28.552 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:28.530+0000 7fbd3d59a700 1 -- 172.21.15.72:0/2168899356 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2559588315 0 0) 0x7fbd30001670 con 0x7fbd4014f810 2023-07-25T14:36:28.552 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:28.530+0000 7fbd3dd9b700 1 --2- 172.21.15.72:0/2168899356 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fbd400a9cc0 0x7fbd401525e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-25T14:36:28.552 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:28.530+0000 7fbd3d59a700 1 -- 172.21.15.72:0/2168899356 >> v1:172.21.15.72:6789/0 conn(0x7fbd4014f810 legacy=0x7fbd400c4370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:28.552 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:28.530+0000 7fbd3d59a700 1 --2- 172.21.15.72:0/2168899356 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbd28003a00 0x7fbd28003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:28.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:28.530+0000 7fbd3d59a700 1 --2- 172.21.15.72:0/2168899356 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbd28004850 0x7fbd28004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:28.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:28.530+0000 7fbd3d59a700 1 --2- 172.21.15.72:0/2168899356 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fbd400a9cc0 0x7fbd28005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:28.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:28.530+0000 7fbd3d59a700 1 -- 172.21.15.72:0/2168899356 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd40152150 con 0x7fbd28003a00 2023-07-25T14:36:28.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:28.530+0000 7fbd3d59a700 1 -- 172.21.15.72:0/2168899356 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd4014fbf0 con 0x7fbd28004850 2023-07-25T14:36:28.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:28.530+0000 7fbd3d59a700 1 -- 172.21.15.72:0/2168899356 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd2800ba90 con 0x7fbd400a9cc0 2023-07-25T14:36:28.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:28.530+0000 7fbd3e59c700 1 --2- 172.21.15.72:0/2168899356 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbd28003a00 0x7fbd28003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:28.555 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:28.531+0000 7fbd3dd9b700 1 --2- 172.21.15.72:0/2168899356 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbd28004850 0x7fbd28004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:28.555 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:28.531+0000 7fbd3ed9d700 1 --2- 172.21.15.72:0/2168899356 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fbd400a9cc0 0x7fbd28005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:28.555 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:28.531+0000 7fbd3e59c700 1 -- 172.21.15.72:0/2168899356 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fbd400a9cc0 msgr2=0x7fbd28005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:28.555 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:28.531+0000 7fbd3e59c700 1 --2- 172.21.15.72:0/2168899356 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fbd400a9cc0 0x7fbd28005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:28.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:28.531+0000 7fbd3e59c700 1 -- 172.21.15.72:0/2168899356 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbd28004850 msgr2=0x7fbd28004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:28.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:28.531+0000 7fbd3e59c700 1 --2- 172.21.15.72:0/2168899356 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbd28004850 0x7fbd28004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:28.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:28.531+0000 7fbd3e59c700 1 -- 172.21.15.72:0/2168899356 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd280035b0 con 0x7fbd28003a00 2023-07-25T14:36:28.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:28.531+0000 7fbd3e59c700 1 --2- 172.21.15.72:0/2168899356 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbd28003a00 0x7fbd28003e20 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fbd3000c240 tx=0x7fbd28005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d1f5a2f7636bfd server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:28.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:28.531+0000 7fbd3d59a700 1 -- 172.21.15.72:0/2168899356 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd3000cde0 con 0x7fbd28003a00 2023-07-25T14:36:28.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:28.531+0000 7fbd3d59a700 1 -- 172.21.15.72:0/2168899356 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd30007ba0 con 0x7fbd28003a00 2023-07-25T14:36:28.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:28.531+0000 7fbd3d59a700 1 -- 172.21.15.72:0/2168899356 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd30005ba0 con 0x7fbd28003a00 2023-07-25T14:36:28.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:28.531+0000 7fbd44e36700 1 -- 172.21.15.72:0/2168899356 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbd28003a00 msgr2=0x7fbd28003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:28.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:28.531+0000 7fbd44e36700 1 --2- 172.21.15.72:0/2168899356 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbd28003a00 0x7fbd28003e20 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fbd3000c240 tx=0x7fbd28005880 comp rx=0 tx=0).stop 2023-07-25T14:36:28.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:28.532+0000 7fbd3ed9d700 1 -- 172.21.15.72:0/2168899356 reap_dead start 2023-07-25T14:36:28.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:28.532+0000 7fbd44e36700 1 -- 172.21.15.72:0/2168899356 shutdown_connections 2023-07-25T14:36:28.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:28.532+0000 7fbd44e36700 1 -- 172.21.15.72:0/2168899356 >> 172.21.15.72:0/2168899356 conn(0x7fbd4006a8d0 msgr2=0x7fbd400a94e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:28.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:28.532+0000 7fbd44e36700 1 -- 172.21.15.72:0/2168899356 shutdown_connections 2023-07-25T14:36:28.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:28.532+0000 7fbd44e36700 1 -- 172.21.15.72:0/2168899356 wait complete. 2023-07-25T14:36:28.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:28.533+0000 7fbd44e36700 1 Processor -- start 2023-07-25T14:36:28.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:28.533+0000 7fbd44e36700 1 -- start start 2023-07-25T14:36:28.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:28.534+0000 7fbd44e36700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbd28003a00 0x7fbd4014e620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:28.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:28.534+0000 7fbd44e36700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fbd400bea60 0x7fbd400bd840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:28.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:28.534+0000 7fbd44e36700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbd400ab770 0x7fbd4014d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:28.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:28.534+0000 7fbd44e36700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd40156220 con 0x7fbd28003a00 2023-07-25T14:36:28.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:28.534+0000 7fbd44e36700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd400bf060 con 0x7fbd400ab770 2023-07-25T14:36:28.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:28.534+0000 7fbd44e36700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd400bf340 con 0x7fbd400bea60 2023-07-25T14:36:28.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:28.534+0000 7fbd3e59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbd28003a00 0x7fbd4014e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:28.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:28.534+0000 7fbd3e59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbd28003a00 0x7fbd4014e620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41192/0 (socket says 172.21.15.72:41192) 2023-07-25T14:36:28.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:28.534+0000 7fbd3e59c700 1 -- 172.21.15.72:0/306933080 learned_addr learned my addr 172.21.15.72:0/306933080 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:28.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:28.534+0000 7fbd3dd9b700 1 --2- 172.21.15.72:0/306933080 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fbd400bea60 0x7fbd400bd840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:28.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:28.534+0000 7fbd3ed9d700 1 --2- 172.21.15.72:0/306933080 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbd400ab770 0x7fbd4014d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:28.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:28.534+0000 7fbd3e59c700 1 -- 172.21.15.72:0/306933080 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fbd400bea60 msgr2=0x7fbd400bd840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:28.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:28.534+0000 7fbd3e59c700 1 --2- 172.21.15.72:0/306933080 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fbd400bea60 0x7fbd400bd840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:28.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:28.534+0000 7fbd3e59c700 1 -- 172.21.15.72:0/306933080 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbd400ab770 msgr2=0x7fbd4014d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:28.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:28.534+0000 7fbd3e59c700 1 --2- 172.21.15.72:0/306933080 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbd400ab770 0x7fbd4014d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:28.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:28.534+0000 7fbd3e59c700 1 -- 172.21.15.72:0/306933080 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd4014eb60 con 0x7fbd28003a00 2023-07-25T14:36:28.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:28.534+0000 7fbd3ed9d700 1 --2- 172.21.15.72:0/306933080 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbd400ab770 0x7fbd4014d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-25T14:36:28.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:28.534+0000 7fbd3e59c700 1 --2- 172.21.15.72:0/306933080 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbd28003a00 0x7fbd4014e620 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fbd3000c830 tx=0x7fbd400c2310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:28.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:28.534+0000 7fbd2effd700 1 -- 172.21.15.72:0/306933080 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd300070d0 con 0x7fbd28003a00 2023-07-25T14:36:28.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:28.534+0000 7fbd2effd700 1 -- 172.21.15.72:0/306933080 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd30007230 con 0x7fbd28003a00 2023-07-25T14:36:28.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:28.534+0000 7fbd2effd700 1 -- 172.21.15.72:0/306933080 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd300075c0 con 0x7fbd28003a00 2023-07-25T14:36:28.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:28.534+0000 7fbd44e36700 1 -- 172.21.15.72:0/306933080 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd4014e340 con 0x7fbd28003a00 2023-07-25T14:36:28.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:28.534+0000 7fbd44e36700 1 -- 172.21.15.72:0/306933080 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd400ab340 con 0x7fbd28003a00 2023-07-25T14:36:28.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:28.535+0000 7fbd44e36700 1 -- 172.21.15.72:0/306933080 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd4004e470 con 0x7fbd28003a00 2023-07-25T14:36:28.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:28.536+0000 7fbd2effd700 1 -- 172.21.15.72:0/306933080 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fbd30019030 con 0x7fbd28003a00 2023-07-25T14:36:28.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:28.536+0000 7fbd2effd700 1 --2- 172.21.15.72:0/306933080 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fbd2006ace0 0x7fbd2006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:28.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:28.536+0000 7fbd3dd9b700 1 --2- 172.21.15.72:0/306933080 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fbd2006ace0 0x7fbd2006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:28.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:28.536+0000 7fbd2effd700 1 -- 172.21.15.72:0/306933080 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fbd3008a6c0 con 0x7fbd28003a00 2023-07-25T14:36:28.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:28.537+0000 7fbd3dd9b700 1 --2- 172.21.15.72:0/306933080 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fbd2006ace0 0x7fbd2006d1a0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fbd400c0ae0 tx=0x7fbd34008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:28.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:28.541+0000 7fbd2effd700 1 -- 172.21.15.72:0/306933080 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fbd300554d0 con 0x7fbd28003a00 2023-07-25T14:36:28.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:28.733+0000 7fbd44e36700 1 -- 172.21.15.72:0/306933080 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbd400bae90 con 0x7fbd28003a00 2023-07-25T14:36:28.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:28.734+0000 7fbd2effd700 1 -- 172.21.15.72:0/306933080 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+20109 (secure 0 0 0) 0x7fbd30058af0 con 0x7fbd28003a00 2023-07-25T14:36:28.754 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-25T14:36:28.754 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":26,"fsid":"9170db48-9170-43e8-8ccb-9813e6240906","created":"2023-07-25T14:35:21.733262+0000","modified":"2023-07-25T14:36:27.778577+0000","last_up_change":"2023-07-25T14:35:31.355010+0000","last_in_change":"2023-07-25T14:35:24.195785+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-25T14:35:32.983457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-25T14:35:33.326342+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-25T14:35:37.534158+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-25T14:35:38.891571+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-25T14:35:42.596923+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d517fdad-0bfe-49f0-89f2-9421c3761839","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6801","nonce":2475407414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6803","nonce":2475407414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6807","nonce":2475407414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6805","nonce":2475407414}]},"public_addr":"172.21.15.72:6801/2475407414","cluster_addr":"172.21.15.72:6803/2475407414","heartbeat_back_addr":"172.21.15.72:6807/2475407414","heartbeat_front_addr":"172.21.15.72:6805/2475407414","state":["exists","up"]},{"osd":1,"uuid":"e1564be3-f209-47e5-a8d0-32fc618a474f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6822","nonce":870954016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6825","nonce":870954016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6831","nonce":870954016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6827","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6829","nonce":870954016}]},"public_addr":"172.21.15.72:6822/870954016","cluster_addr":"172.21.15.72:6825/870954016","heartbeat_back_addr":"172.21.15.72:6831/870954016","heartbeat_front_addr":"172.21.15.72:6829/870954016","state":["exists","up"]},{"osd":2,"uuid":"c4647d30-ffa6-417a-9026-ef530c75910e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6809","nonce":2143129442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6811","nonce":2143129442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6815","nonce":2143129442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6813","nonce":2143129442}]},"public_addr":"172.21.15.72:6809/2143129442","cluster_addr":"172.21.15.72:6811/2143129442","heartbeat_back_addr":"172.21.15.72:6815/2143129442","heartbeat_front_addr":"172.21.15.72:6813/2143129442","state":["exists","up"]},{"osd":3,"uuid":"76c9d9a7-c2e2-4612-a58b-d6882dd76b58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6817","nonce":3404066311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6819","nonce":3404066311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6828","nonce":3404066311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6821","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6823","nonce":3404066311}]},"public_addr":"172.21.15.72:6817/3404066311","cluster_addr":"172.21.15.72:6819/3404066311","heartbeat_back_addr":"172.21.15.72:6828/3404066311","heartbeat_front_addr":"172.21.15.72:6823/3404066311","state":["exists","up"]},{"osd":4,"uuid":"7f8920dc-0ad4-4a73-ab40-65408f83eadd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6817","nonce":2381008739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6819","nonce":2381008739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6825","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6827","nonce":2381008739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6822","nonce":2381008739}]},"public_addr":"172.21.15.92:6817/2381008739","cluster_addr":"172.21.15.92:6819/2381008739","heartbeat_back_addr":"172.21.15.92:6827/2381008739","heartbeat_front_addr":"172.21.15.92:6822/2381008739","state":["exists","up"]},{"osd":5,"uuid":"56257e7c-31eb-44c5-9ec7-1318a4e0bb35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6801","nonce":2161935604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6803","nonce":2161935604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6807","nonce":2161935604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6805","nonce":2161935604}]},"public_addr":"172.21.15.92:6801/2161935604","cluster_addr":"172.21.15.92:6803/2161935604","heartbeat_back_addr":"172.21.15.92:6807/2161935604","heartbeat_front_addr":"172.21.15.92:6805/2161935604","state":["exists","up"]},{"osd":6,"uuid":"a150d3d8-a0c9-4955-968a-8d98eff4ffb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6809","nonce":3770163493}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6811","nonce":3770163493}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6815","nonce":3770163493}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6813","nonce":3770163493}]},"public_addr":"172.21.15.92:6809/3770163493","cluster_addr":"172.21.15.92:6811/3770163493","heartbeat_back_addr":"172.21.15.92:6815/3770163493","heartbeat_front_addr":"172.21.15.92:6813/3770163493","state":["exists","up"]},{"osd":7,"uuid":"07799c27-54ee-4591-a42d-a978d6b32065","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6821","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6823","nonce":2135777609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6826","nonce":2135777609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6831","nonce":2135777609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6829","nonce":2135777609}]},"public_addr":"172.21.15.92:6823/2135777609","cluster_addr":"172.21.15.92:6826/2135777609","heartbeat_back_addr":"172.21.15.92:6831/2135777609","heartbeat_front_addr":"172.21.15.92:6829/2135777609","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.345365+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.378150+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.146566+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.372172+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:30.398421+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.385632+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.465611+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.443583+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.b","mappings":[{"from":1,"to":2}]},{"pgid":"4.3f","mappings":[{"from":3,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-25T14:36:28.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:28.736+0000 7fbd44e36700 1 -- 172.21.15.72:0/306933080 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fbd2006ace0 msgr2=0x7fbd2006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:28.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:28.736+0000 7fbd44e36700 1 --2- 172.21.15.72:0/306933080 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fbd2006ace0 0x7fbd2006d1a0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fbd400c0ae0 tx=0x7fbd34008040 comp rx=0 tx=0).stop 2023-07-25T14:36:28.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:28.736+0000 7fbd44e36700 1 -- 172.21.15.72:0/306933080 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbd28003a00 msgr2=0x7fbd4014e620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:28.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:28.736+0000 7fbd44e36700 1 --2- 172.21.15.72:0/306933080 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbd28003a00 0x7fbd4014e620 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fbd3000c830 tx=0x7fbd400c2310 comp rx=0 tx=0).stop 2023-07-25T14:36:28.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:28.736+0000 7fbd44e36700 1 -- 172.21.15.72:0/306933080 shutdown_connections 2023-07-25T14:36:28.756 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:28.736+0000 7fbd44e36700 1 --2- 172.21.15.72:0/306933080 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fbd2006ace0 0x7fbd2006d1a0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:28.756 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:28.736+0000 7fbd44e36700 1 --2- 172.21.15.72:0/306933080 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbd400ab770 0x7fbd4014d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:28.756 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:28.736+0000 7fbd44e36700 1 --2- 172.21.15.72:0/306933080 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbd28003a00 0x7fbd4014e620 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:28.756 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:28.736+0000 7fbd44e36700 1 --2- 172.21.15.72:0/306933080 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fbd400bea60 0x7fbd400bd840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:28.756 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:28.737+0000 7fbd44e36700 1 -- 172.21.15.72:0/306933080 >> 172.21.15.72:0/306933080 conn(0x7fbd4006a8d0 msgr2=0x7fbd400c5540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:28.756 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:28.737+0000 7fbd44e36700 1 -- 172.21.15.72:0/306933080 shutdown_connections 2023-07-25T14:36:28.756 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:28.737+0000 7fbd44e36700 1 -- 172.21.15.72:0/306933080 wait complete. 2023-07-25T14:36:28.761 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-07-25T14:35:32.983457+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-07-25T14:35:33.326342+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-25T14:35:37.534158+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-25T14:35:38.891571+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-07-25T14:35:42.596923+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-25T14:36:28.762 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-25T14:36:28.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:28.875+0000 7f676a5ca700 1 Processor -- start 2023-07-25T14:36:28.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:28.875+0000 7f676a5ca700 1 -- start start 2023-07-25T14:36:28.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:28.876+0000 7f676a5ca700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f6764151950 0x7f676406a190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:28.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:28.876+0000 7f676a5ca700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f67640724c0 0x7f67640c34c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:28.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:28.876+0000 7f676a5ca700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67640c2fe0 con 0x7f676406a6d0 2023-07-25T14:36:28.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:28.876+0000 7f676a5ca700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6764071a60 con 0x7f6764151950 2023-07-25T14:36:28.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:28.876+0000 7f676a5ca700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67640c2a70 con 0x7f67640724c0 2023-07-25T14:36:28.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:28.876+0000 7f6763fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f6764151950 0x7f676406a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:28.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:28.876+0000 7f6768b67700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f676406a6d0 0x7f67640c3a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:60172/0 (socket says 172.21.15.72:60172) 2023-07-25T14:36:28.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:28.876+0000 7f6763fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f6764151950 0x7f676406a190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41200/0 (socket says 172.21.15.72:41200) 2023-07-25T14:36:28.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:28.876+0000 7f6768b67700 1 -- 172.21.15.72:0/431671131 learned_addr learned my addr 172.21.15.72:0/431671131 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:36:28.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:28.877+0000 7f67637fe700 1 --2- 172.21.15.72:0/431671131 >> v2:172.21.15.92:3300/0 conn(0x7f67640724c0 0x7f67640c34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:28.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:28.877+0000 7f6763fff700 1 -- 172.21.15.72:0/431671131 >> v2:172.21.15.92:3300/0 conn(0x7f67640724c0 msgr2=0x7f67640c34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:28.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:28.877+0000 7f6763fff700 1 --2- 172.21.15.72:0/431671131 >> v2:172.21.15.92:3300/0 conn(0x7f67640724c0 0x7f67640c34c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:28.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:28.877+0000 7f6763fff700 1 -- 172.21.15.72:0/431671131 >> v1:172.21.15.72:6789/0 conn(0x7f676406a6d0 legacy=0x7f67640c3a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:28.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:28.877+0000 7f6762ffd700 1 -- 172.21.15.72:0/431671131 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1717468902 0 0) 0x7f67640c2fe0 con 0x7f676406a6d0 2023-07-25T14:36:28.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:28.877+0000 7f6763fff700 1 -- 172.21.15.72:0/431671131 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6764155070 con 0x7f6764151950 2023-07-25T14:36:28.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:28.877+0000 7f67637fe700 1 --2- 172.21.15.72:0/431671131 >> v2:172.21.15.92:3300/0 conn(0x7f67640724c0 0x7f67640c34c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-25T14:36:28.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:28.877+0000 7f6763fff700 1 --2- 172.21.15.72:0/431671131 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6764151950 0x7f676406a190 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f67640acbc0 tx=0x7f6754009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44b6ac50d6fc4dd9 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:28.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:28.877+0000 7f6762ffd700 1 -- 172.21.15.72:0/431671131 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6754011830 con 0x7f6764151950 2023-07-25T14:36:28.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:28.877+0000 7f6762ffd700 1 -- 172.21.15.72:0/431671131 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6754011990 con 0x7f6764151950 2023-07-25T14:36:28.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:28.877+0000 7f6762ffd700 1 -- 172.21.15.72:0/431671131 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6754011d20 con 0x7f6764151950 2023-07-25T14:36:28.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:28.877+0000 7f676a5ca700 1 -- 172.21.15.72:0/431671131 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6764151950 msgr2=0x7f676406a190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:28.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:28.877+0000 7f676a5ca700 1 --2- 172.21.15.72:0/431671131 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6764151950 0x7f676406a190 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f67640acbc0 tx=0x7f6754009b20 comp rx=0 tx=0).stop 2023-07-25T14:36:28.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:28.877+0000 7f676a5ca700 1 -- 172.21.15.72:0/431671131 shutdown_connections 2023-07-25T14:36:28.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:28.877+0000 7f676a5ca700 1 --2- 172.21.15.72:0/431671131 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6764151950 0x7f676406a190 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:28.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:28.877+0000 7f676a5ca700 1 --2- 172.21.15.72:0/431671131 >> v2:172.21.15.92:3300/0 conn(0x7f67640724c0 0x7f67640c34c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:28.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:28.877+0000 7f676a5ca700 1 -- 172.21.15.72:0/431671131 >> 172.21.15.72:0/431671131 conn(0x7f67640a87e0 msgr2=0x7f67640a8bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:28.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:28.877+0000 7f676a5ca700 1 -- 172.21.15.72:0/431671131 shutdown_connections 2023-07-25T14:36:28.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:28.878+0000 7f676a5ca700 1 -- 172.21.15.72:0/431671131 wait complete. 2023-07-25T14:36:28.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:28.879+0000 7f676a5ca700 1 Processor -- start 2023-07-25T14:36:28.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:28.879+0000 7f676a5ca700 1 -- start start 2023-07-25T14:36:28.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:28.879+0000 7f676a5ca700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f676406a6d0 0x7f67641ed030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:28.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:28.879+0000 7f676a5ca700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f67640724c0 0x7f67641eaff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:28.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:28.879+0000 7f676a5ca700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6764151950 0x7f67641eb530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:28.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:28.879+0000 7f676a5ca700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6764156140 con 0x7f676406a6d0 2023-07-25T14:36:28.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:28.879+0000 7f676a5ca700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67640a9f00 con 0x7f6764151950 2023-07-25T14:36:28.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:28.879+0000 7f676a5ca700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67640a9980 con 0x7f67640724c0 2023-07-25T14:36:28.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:28.880+0000 7f6763fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f676406a6d0 0x7f67641ed030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:28.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:28.880+0000 7f6763fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f676406a6d0 0x7f67641ed030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41206/0 (socket says 172.21.15.72:41206) 2023-07-25T14:36:28.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:28.880+0000 7f6763fff700 1 -- 172.21.15.72:0/1378090836 learned_addr learned my addr 172.21.15.72:0/1378090836 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:28.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:28.880+0000 7f6768b67700 1 --2- 172.21.15.72:0/1378090836 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6764151950 0x7f67641eb530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:28.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:28.880+0000 7f67637fe700 1 --2- 172.21.15.72:0/1378090836 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f67640724c0 0x7f67641eaff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:28.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:28.880+0000 7f6763fff700 1 -- 172.21.15.72:0/1378090836 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f67640724c0 msgr2=0x7f67641eaff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:28.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:28.880+0000 7f6763fff700 1 --2- 172.21.15.72:0/1378090836 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f67640724c0 0x7f67641eaff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:28.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:28.880+0000 7f6763fff700 1 -- 172.21.15.72:0/1378090836 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6764151950 msgr2=0x7f67641eb530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:28.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:28.880+0000 7f6763fff700 1 --2- 172.21.15.72:0/1378090836 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6764151950 0x7f67641eb530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:28.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:28.880+0000 7f6763fff700 1 -- 172.21.15.72:0/1378090836 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67540094a0 con 0x7f676406a6d0 2023-07-25T14:36:28.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:28.880+0000 7f6768b67700 1 --2- 172.21.15.72:0/1378090836 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6764151950 0x7f67641eb530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-25T14:36:28.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:28.880+0000 7f67637fe700 1 --2- 172.21.15.72:0/1378090836 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f67640724c0 0x7f67641eaff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-25T14:36:28.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:28.880+0000 7f6763fff700 1 --2- 172.21.15.72:0/1378090836 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f676406a6d0 0x7f67641ed030 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f6754014040 tx=0x7f6754004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:28.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:28.880+0000 7f6760ff9700 1 -- 172.21.15.72:0/1378090836 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67540038a0 con 0x7f676406a6d0 2023-07-25T14:36:28.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:28.880+0000 7f6760ff9700 1 -- 172.21.15.72:0/1378090836 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f675401e070 con 0x7f676406a6d0 2023-07-25T14:36:28.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:28.880+0000 7f6760ff9700 1 -- 172.21.15.72:0/1378090836 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6754003c40 con 0x7f676406a6d0 2023-07-25T14:36:28.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:28.880+0000 7f676a5ca700 1 -- 172.21.15.72:0/1378090836 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67641ed970 con 0x7f676406a6d0 2023-07-25T14:36:28.902 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:28.880+0000 7f676a5ca700 1 -- 172.21.15.72:0/1378090836 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67641edc50 con 0x7f676406a6d0 2023-07-25T14:36:28.902 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:28.881+0000 7f676a5ca700 1 -- 172.21.15.72:0/1378090836 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f676404e470 con 0x7f676406a6d0 2023-07-25T14:36:28.902 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:28.881+0000 7f6760ff9700 1 -- 172.21.15.72:0/1378090836 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f675402d450 con 0x7f676406a6d0 2023-07-25T14:36:28.902 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:28.882+0000 7f6760ff9700 1 --2- 172.21.15.72:0/1378090836 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f674406ace0 0x7f674406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:28.902 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:28.882+0000 7f6760ff9700 1 -- 172.21.15.72:0/1378090836 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f675408a8d0 con 0x7f676406a6d0 2023-07-25T14:36:28.903 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:28.882+0000 7f67637fe700 1 --2- 172.21.15.72:0/1378090836 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f674406ace0 0x7f674406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:28.903 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:28.882+0000 7f67637fe700 1 --2- 172.21.15.72:0/1378090836 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f674406ace0 0x7f674406d1a0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f6764150500 tx=0x7f674c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:28.903 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:28.886+0000 7f6760ff9700 1 -- 172.21.15.72:0/1378090836 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f6754055660 con 0x7f676406a6d0 2023-07-25T14:36:29.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.071+0000 7f676a5ca700 1 -- 172.21.15.72:0/1378090836 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f67640722a0 con 0x7f676406a6d0 2023-07-25T14:36:29.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.072+0000 7f6760ff9700 1 -- 172.21.15.72:0/1378090836 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v27) v1 ==== 92+0+10 (secure 0 0 0) 0x7f6754058c80 con 0x7f676406a6d0 2023-07-25T14:36:29.084 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 8 2023-07-25T14:36:29.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.074+0000 7f676a5ca700 1 -- 172.21.15.72:0/1378090836 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f674406ace0 msgr2=0x7f674406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:29.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.074+0000 7f676a5ca700 1 --2- 172.21.15.72:0/1378090836 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f674406ace0 0x7f674406d1a0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f6764150500 tx=0x7f674c008040 comp rx=0 tx=0).stop 2023-07-25T14:36:29.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.074+0000 7f676a5ca700 1 -- 172.21.15.72:0/1378090836 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f676406a6d0 msgr2=0x7f67641ed030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:29.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.074+0000 7f676a5ca700 1 --2- 172.21.15.72:0/1378090836 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f676406a6d0 0x7f67641ed030 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f6754014040 tx=0x7f6754004750 comp rx=0 tx=0).stop 2023-07-25T14:36:29.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.074+0000 7f676a5ca700 1 -- 172.21.15.72:0/1378090836 shutdown_connections 2023-07-25T14:36:29.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.074+0000 7f676a5ca700 1 --2- 172.21.15.72:0/1378090836 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f674406ace0 0x7f674406d1a0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:29.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.074+0000 7f676a5ca700 1 --2- 172.21.15.72:0/1378090836 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6764151950 0x7f67641eb530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:29.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.074+0000 7f676a5ca700 1 --2- 172.21.15.72:0/1378090836 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f676406a6d0 0x7f67641ed030 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:29.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.074+0000 7f676a5ca700 1 --2- 172.21.15.72:0/1378090836 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f67640724c0 0x7f67641eaff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:29.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.074+0000 7f676a5ca700 1 -- 172.21.15.72:0/1378090836 >> 172.21.15.72:0/1378090836 conn(0x7f67640a87e0 msgr2=0x7f676414f730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:29.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.074+0000 7f676a5ca700 1 -- 172.21.15.72:0/1378090836 shutdown_connections 2023-07-25T14:36:29.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.074+0000 7f676a5ca700 1 -- 172.21.15.72:0/1378090836 wait complete. 2023-07-25T14:36:29.098 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-25T14:36:29.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.208+0000 7f65a9407700 1 Processor -- start 2023-07-25T14:36:29.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.208+0000 7f65a9407700 1 -- start start 2023-07-25T14:36:29.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.209+0000 7f65a9407700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f65a40ba0e0 0x7f65a40c5e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:29.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.209+0000 7f65a9407700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f65a40c3f10 0x7f65a4071960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:29.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.209+0000 7f65a9407700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65a40c4930 con 0x7f65a414faf0 2023-07-25T14:36:29.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.209+0000 7f65a9407700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65a40c5670 con 0x7f65a40c3f10 2023-07-25T14:36:29.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.209+0000 7f65a9407700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65a40726e0 con 0x7f65a40ba0e0 2023-07-25T14:36:29.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.209+0000 7f65a37fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f65a40c3f10 0x7f65a4071960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:29.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.209+0000 7f65a37fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f65a40c3f10 0x7f65a4071960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41218/0 (socket says 172.21.15.72:41218) 2023-07-25T14:36:29.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.209+0000 7f65a37fe700 1 -- 172.21.15.72:0/3790188248 learned_addr learned my addr 172.21.15.72:0/3790188248 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:29.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.209+0000 7f65a37fe700 1 -- 172.21.15.72:0/3790188248 >> v2:172.21.15.92:3300/0 conn(0x7f65a40ba0e0 msgr2=0x7f65a40c5e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:29.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.209+0000 7f65a37fe700 1 --2- 172.21.15.72:0/3790188248 >> v2:172.21.15.92:3300/0 conn(0x7f65a40ba0e0 0x7f65a40c5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:29.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.209+0000 7f65a37fe700 1 -- 172.21.15.72:0/3790188248 >> v1:172.21.15.92:6789/0 conn(0x7f65a414faf0 legacy=0x7f65a41558a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:29.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.209+0000 7f65a37fe700 1 -- 172.21.15.72:0/3790188248 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65a40c4b80 con 0x7f65a40c3f10 2023-07-25T14:36:29.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.209+0000 7f65a37fe700 1 --2- 172.21.15.72:0/3790188248 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f65a40c3f10 0x7f65a4071960 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f65a40c4560 tx=0x7f659c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edf3a4ebf5d6366f server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:29.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.209+0000 7f65a1ffb700 1 -- 172.21.15.72:0/3790188248 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f659c00e070 con 0x7f65a40c3f10 2023-07-25T14:36:29.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.209+0000 7f65a1ffb700 1 -- 172.21.15.72:0/3790188248 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f659c003a20 con 0x7f65a40c3f10 2023-07-25T14:36:29.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.209+0000 7f65a1ffb700 1 -- 172.21.15.72:0/3790188248 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f659c003dd0 con 0x7f65a40c3f10 2023-07-25T14:36:29.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.210+0000 7f65a9407700 1 -- 172.21.15.72:0/3790188248 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f65a40c3f10 msgr2=0x7f65a4071960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:29.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.210+0000 7f65a9407700 1 --2- 172.21.15.72:0/3790188248 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f65a40c3f10 0x7f65a4071960 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f65a40c4560 tx=0x7f659c00b330 comp rx=0 tx=0).stop 2023-07-25T14:36:29.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.210+0000 7f65a9407700 1 -- 172.21.15.72:0/3790188248 shutdown_connections 2023-07-25T14:36:29.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.210+0000 7f65a9407700 1 --2- 172.21.15.72:0/3790188248 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f65a40c3f10 0x7f65a4071960 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:29.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.210+0000 7f65a9407700 1 --2- 172.21.15.72:0/3790188248 >> v2:172.21.15.92:3300/0 conn(0x7f65a40ba0e0 0x7f65a40c5e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:29.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.210+0000 7f65a9407700 1 -- 172.21.15.72:0/3790188248 >> 172.21.15.72:0/3790188248 conn(0x7f65a40a87e0 msgr2=0x7f65a40a8bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:29.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.210+0000 7f65a9407700 1 -- 172.21.15.72:0/3790188248 shutdown_connections 2023-07-25T14:36:29.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.210+0000 7f65a9407700 1 -- 172.21.15.72:0/3790188248 wait complete. 2023-07-25T14:36:29.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.211+0000 7f65a9407700 1 Processor -- start 2023-07-25T14:36:29.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.212+0000 7f65a9407700 1 -- start start 2023-07-25T14:36:29.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.212+0000 7f65a9407700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f65a40ba0e0 0x7f65a41eabf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:29.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.212+0000 7f65a9407700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f65a40c3f10 0x7f65a40b9410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:29.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.212+0000 7f65a9407700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f65a414faf0 0x7f65a40b9950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:29.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.212+0000 7f65a9407700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65a41dcda0 con 0x7f65a414faf0 2023-07-25T14:36:29.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.212+0000 7f65a9407700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65a41eb670 con 0x7f65a40c3f10 2023-07-25T14:36:29.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.212+0000 7f65a9407700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65a41db950 con 0x7f65a40ba0e0 2023-07-25T14:36:29.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.212+0000 7f65a37fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f65a414faf0 0x7f65a40b9950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:29.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.213+0000 7f65a37fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f65a414faf0 0x7f65a40b9950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41222/0 (socket says 172.21.15.72:41222) 2023-07-25T14:36:29.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.213+0000 7f65a37fe700 1 -- 172.21.15.72:0/4242973871 learned_addr learned my addr 172.21.15.72:0/4242973871 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:29.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.213+0000 7f65a2ffd700 1 --2- 172.21.15.72:0/4242973871 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f65a40ba0e0 0x7f65a41eabf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:29.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.213+0000 7f65a27fc700 1 --2- 172.21.15.72:0/4242973871 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f65a40c3f10 0x7f65a40b9410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:29.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.213+0000 7f65a37fe700 1 -- 172.21.15.72:0/4242973871 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f65a40ba0e0 msgr2=0x7f65a41eabf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:29.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.213+0000 7f65a37fe700 1 --2- 172.21.15.72:0/4242973871 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f65a40ba0e0 0x7f65a41eabf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:29.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.213+0000 7f65a37fe700 1 -- 172.21.15.72:0/4242973871 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f65a40c3f10 msgr2=0x7f65a40b9410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:29.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.213+0000 7f65a37fe700 1 --2- 172.21.15.72:0/4242973871 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f65a40c3f10 0x7f65a40b9410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:29.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.213+0000 7f65a37fe700 1 -- 172.21.15.72:0/4242973871 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f659c009b30 con 0x7f65a414faf0 2023-07-25T14:36:29.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.213+0000 7f65a2ffd700 1 --2- 172.21.15.72:0/4242973871 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f65a40ba0e0 0x7f65a41eabf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-25T14:36:29.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.213+0000 7f65a37fe700 1 --2- 172.21.15.72:0/4242973871 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f65a414faf0 0x7f65a40b9950 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f659c015040 tx=0x7f659c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:29.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.213+0000 7f658b7fe700 1 -- 172.21.15.72:0/4242973871 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f659c004240 con 0x7f65a414faf0 2023-07-25T14:36:29.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.213+0000 7f658b7fe700 1 -- 172.21.15.72:0/4242973871 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f659c0043c0 con 0x7f65a414faf0 2023-07-25T14:36:29.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.213+0000 7f658b7fe700 1 -- 172.21.15.72:0/4242973871 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f659c004770 con 0x7f65a414faf0 2023-07-25T14:36:29.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.213+0000 7f65a9407700 1 -- 172.21.15.72:0/4242973871 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65a41dbc30 con 0x7f65a414faf0 2023-07-25T14:36:29.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.213+0000 7f65a9407700 1 -- 172.21.15.72:0/4242973871 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65a40a7ae0 con 0x7f65a414faf0 2023-07-25T14:36:29.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.214+0000 7f65a9407700 1 -- 172.21.15.72:0/4242973871 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65a41dcf10 con 0x7f65a414faf0 2023-07-25T14:36:29.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.214+0000 7f658b7fe700 1 -- 172.21.15.72:0/4242973871 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f659c019070 con 0x7f65a414faf0 2023-07-25T14:36:29.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.215+0000 7f658b7fe700 1 --2- 172.21.15.72:0/4242973871 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f659006acb0 0x7f659006d170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:29.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.215+0000 7f65a2ffd700 1 --2- 172.21.15.72:0/4242973871 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f659006acb0 0x7f659006d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:29.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.215+0000 7f658b7fe700 1 -- 172.21.15.72:0/4242973871 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f659c08a7e0 con 0x7f65a414faf0 2023-07-25T14:36:29.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.215+0000 7f65a2ffd700 1 --2- 172.21.15.72:0/4242973871 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f659006acb0 0x7f659006d170 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f6598006fd0 tx=0x7f6598008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:29.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.220+0000 7f658b7fe700 1 -- 172.21.15.72:0/4242973871 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f659c0555f0 con 0x7f65a414faf0 2023-07-25T14:36:29.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.404+0000 7f65a9407700 1 -- 172.21.15.72:0/4242973871 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f65a404e470 con 0x7f65a414faf0 2023-07-25T14:36:29.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.404+0000 7f658b7fe700 1 -- 172.21.15.72:0/4242973871 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f659c020020 con 0x7f65a414faf0 2023-07-25T14:36:29.417 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 1 2023-07-25T14:36:29.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.407+0000 7f65a9407700 1 -- 172.21.15.72:0/4242973871 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f659006acb0 msgr2=0x7f659006d170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:29.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.407+0000 7f65a9407700 1 --2- 172.21.15.72:0/4242973871 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f659006acb0 0x7f659006d170 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f6598006fd0 tx=0x7f6598008040 comp rx=0 tx=0).stop 2023-07-25T14:36:29.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.407+0000 7f65a9407700 1 -- 172.21.15.72:0/4242973871 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f65a414faf0 msgr2=0x7f65a40b9950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:29.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.407+0000 7f65a9407700 1 --2- 172.21.15.72:0/4242973871 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f65a414faf0 0x7f65a40b9950 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f659c015040 tx=0x7f659c004ad0 comp rx=0 tx=0).stop 2023-07-25T14:36:29.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.407+0000 7f65a9407700 1 -- 172.21.15.72:0/4242973871 shutdown_connections 2023-07-25T14:36:29.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.407+0000 7f65a9407700 1 --2- 172.21.15.72:0/4242973871 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f659006acb0 0x7f659006d170 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:29.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.407+0000 7f65a9407700 1 --2- 172.21.15.72:0/4242973871 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f65a40ba0e0 0x7f65a41eabf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:29.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.407+0000 7f65a9407700 1 --2- 172.21.15.72:0/4242973871 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f65a414faf0 0x7f65a40b9950 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:29.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.407+0000 7f65a9407700 1 --2- 172.21.15.72:0/4242973871 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f65a40c3f10 0x7f65a40b9410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:29.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.407+0000 7f65a9407700 1 -- 172.21.15.72:0/4242973871 >> 172.21.15.72:0/4242973871 conn(0x7f65a40a87e0 msgr2=0x7f65a40c20e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:29.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.407+0000 7f65a9407700 1 -- 172.21.15.72:0/4242973871 shutdown_connections 2023-07-25T14:36:29.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.407+0000 7f65a9407700 1 -- 172.21.15.72:0/4242973871 wait complete. 2023-07-25T14:36:29.430 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-25T14:36:29.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.541+0000 7f8e541bb700 1 Processor -- start 2023-07-25T14:36:29.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.542+0000 7f8e541bb700 1 -- start start 2023-07-25T14:36:29.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.542+0000 7f8e541bb700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8e4c151b40 0x7f8e4c0c5c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:29.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.542+0000 7f8e541bb700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8e4c154490 0x7f8e4c0c0470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:29.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.543+0000 7f8e541bb700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e4c151f20 con 0x7f8e4c0c09b0 2023-07-25T14:36:29.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.543+0000 7f8e541bb700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e4c154950 con 0x7f8e4c151b40 2023-07-25T14:36:29.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.543+0000 7f8e541bb700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e4c154c30 con 0x7f8e4c154490 2023-07-25T14:36:29.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.543+0000 7f8e51f57700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8e4c151b40 0x7f8e4c0c5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:29.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.543+0000 7f8e52758700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f8e4c0c09b0 0x7f8e4c157e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:60200/0 (socket says 172.21.15.72:60200) 2023-07-25T14:36:29.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.543+0000 7f8e51f57700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8e4c151b40 0x7f8e4c0c5c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41228/0 (socket says 172.21.15.72:41228) 2023-07-25T14:36:29.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.543+0000 7f8e52758700 1 -- 172.21.15.72:0/3502089759 learned_addr learned my addr 172.21.15.72:0/3502089759 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:36:29.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.543+0000 7f8e51756700 1 --2- 172.21.15.72:0/3502089759 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8e4c154490 0x7f8e4c0c0470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:29.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.543+0000 7f8e51f57700 1 -- 172.21.15.72:0/3502089759 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8e4c154490 msgr2=0x7f8e4c0c0470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:29.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.543+0000 7f8e51f57700 1 --2- 172.21.15.72:0/3502089759 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8e4c154490 0x7f8e4c0c0470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:29.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.543+0000 7f8e51f57700 1 -- 172.21.15.72:0/3502089759 >> v1:172.21.15.72:6789/0 conn(0x7f8e4c0c09b0 legacy=0x7f8e4c157e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:29.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.543+0000 7f8e51f57700 1 -- 172.21.15.72:0/3502089759 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e4c0bebb0 con 0x7f8e4c151b40 2023-07-25T14:36:29.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.543+0000 7f8e50f55700 1 -- 172.21.15.72:0/3502089759 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3087316800 0 0) 0x7f8e4c151f20 con 0x7f8e4c0c09b0 2023-07-25T14:36:29.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.543+0000 7f8e51f57700 1 --2- 172.21.15.72:0/3502089759 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8e4c151b40 0x7f8e4c0c5c30 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f8e48009840 tx=0x7f8e48009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55b2eb24d40d4633 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:29.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.543+0000 7f8e50f55700 1 -- 172.21.15.72:0/3502089759 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e48011830 con 0x7f8e4c151b40 2023-07-25T14:36:29.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.543+0000 7f8e50f55700 1 -- 172.21.15.72:0/3502089759 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e48011990 con 0x7f8e4c151b40 2023-07-25T14:36:29.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.543+0000 7f8e50f55700 1 -- 172.21.15.72:0/3502089759 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e48011d20 con 0x7f8e4c151b40 2023-07-25T14:36:29.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.544+0000 7f8e541bb700 1 -- 172.21.15.72:0/3502089759 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8e4c151b40 msgr2=0x7f8e4c0c5c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:29.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.544+0000 7f8e541bb700 1 --2- 172.21.15.72:0/3502089759 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8e4c151b40 0x7f8e4c0c5c30 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f8e48009840 tx=0x7f8e48009b50 comp rx=0 tx=0).stop 2023-07-25T14:36:29.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.544+0000 7f8e541bb700 1 -- 172.21.15.72:0/3502089759 shutdown_connections 2023-07-25T14:36:29.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.544+0000 7f8e541bb700 1 --2- 172.21.15.72:0/3502089759 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8e4c151b40 0x7f8e4c0c5c30 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:29.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.544+0000 7f8e541bb700 1 --2- 172.21.15.72:0/3502089759 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8e4c154490 0x7f8e4c0c0470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:29.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.544+0000 7f8e541bb700 1 -- 172.21.15.72:0/3502089759 >> 172.21.15.72:0/3502089759 conn(0x7f8e4c06c410 msgr2=0x7f8e4c06c820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:29.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.544+0000 7f8e541bb700 1 -- 172.21.15.72:0/3502089759 shutdown_connections 2023-07-25T14:36:29.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.544+0000 7f8e541bb700 1 -- 172.21.15.72:0/3502089759 wait complete. 2023-07-25T14:36:29.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.545+0000 7f8e541bb700 1 Processor -- start 2023-07-25T14:36:29.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.545+0000 7f8e541bb700 1 -- start start 2023-07-25T14:36:29.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.547+0000 7f8e541bb700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8e4c0c09b0 0x7f8e4c145bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:29.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.547+0000 7f8e541bb700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8e4c151b40 0x7f8e4c1e6b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:29.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.547+0000 7f8e541bb700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8e4c154490 0x7f8e4c1e70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:29.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.547+0000 7f8e541bb700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e4c146650 con 0x7f8e4c0c09b0 2023-07-25T14:36:29.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.547+0000 7f8e541bb700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e4c1540e0 con 0x7f8e4c151b40 2023-07-25T14:36:29.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.547+0000 7f8e541bb700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e4c157450 con 0x7f8e4c154490 2023-07-25T14:36:29.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.547+0000 7f8e51f57700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8e4c0c09b0 0x7f8e4c145bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:29.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.547+0000 7f8e51f57700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8e4c0c09b0 0x7f8e4c145bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41234/0 (socket says 172.21.15.72:41234) 2023-07-25T14:36:29.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.547+0000 7f8e51f57700 1 -- 172.21.15.72:0/2601547334 learned_addr learned my addr 172.21.15.72:0/2601547334 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:29.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.547+0000 7f8e51f57700 1 -- 172.21.15.72:0/2601547334 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8e4c154490 msgr2=0x7f8e4c1e70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:29.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.547+0000 7f8e51f57700 1 --2- 172.21.15.72:0/2601547334 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8e4c154490 0x7f8e4c1e70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:29.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.547+0000 7f8e51f57700 1 -- 172.21.15.72:0/2601547334 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8e4c151b40 msgr2=0x7f8e4c1e6b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:29.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.547+0000 7f8e51756700 1 --2- 172.21.15.72:0/2601547334 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8e4c151b40 0x7f8e4c1e6b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:29.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.547+0000 7f8e51f57700 1 --2- 172.21.15.72:0/2601547334 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8e4c151b40 0x7f8e4c1e6b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:29.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.547+0000 7f8e51f57700 1 -- 172.21.15.72:0/2601547334 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e480094a0 con 0x7f8e4c0c09b0 2023-07-25T14:36:29.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.547+0000 7f8e51f57700 1 --2- 172.21.15.72:0/2601547334 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8e4c0c09b0 0x7f8e4c145bc0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f8e480090b0 tx=0x7f8e48004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:29.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.547+0000 7f8e427fc700 1 -- 172.21.15.72:0/2601547334 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e480038a0 con 0x7f8e4c0c09b0 2023-07-25T14:36:29.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.547+0000 7f8e427fc700 1 -- 172.21.15.72:0/2601547334 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e4801f070 con 0x7f8e4c0c09b0 2023-07-25T14:36:29.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.547+0000 7f8e541bb700 1 -- 172.21.15.72:0/2601547334 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e4c157730 con 0x7f8e4c0c09b0 2023-07-25T14:36:29.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.547+0000 7f8e427fc700 1 -- 172.21.15.72:0/2601547334 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e48003c20 con 0x7f8e4c0c09b0 2023-07-25T14:36:29.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.547+0000 7f8e541bb700 1 -- 172.21.15.72:0/2601547334 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e4c153d70 con 0x7f8e4c0c09b0 2023-07-25T14:36:29.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.547+0000 7f8e541bb700 1 -- 172.21.15.72:0/2601547334 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e4c04e470 con 0x7f8e4c0c09b0 2023-07-25T14:36:29.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.548+0000 7f8e427fc700 1 -- 172.21.15.72:0/2601547334 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8e4801a430 con 0x7f8e4c0c09b0 2023-07-25T14:36:29.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.548+0000 7f8e427fc700 1 --2- 172.21.15.72:0/2601547334 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f8e3006ace0 0x7f8e3006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:29.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.548+0000 7f8e427fc700 1 -- 172.21.15.72:0/2601547334 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f8e48021070 con 0x7f8e4c0c09b0 2023-07-25T14:36:29.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.548+0000 7f8e51756700 1 --2- 172.21.15.72:0/2601547334 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f8e3006ace0 0x7f8e3006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:29.574 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.548+0000 7f8e51756700 1 --2- 172.21.15.72:0/2601547334 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f8e3006ace0 0x7f8e3006d1a0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f8e4c1ee120 tx=0x7f8e3c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:29.574 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.552+0000 7f8e427fc700 1 -- 172.21.15.72:0/2601547334 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f8e48055ee0 con 0x7f8e4c0c09b0 2023-07-25T14:36:29.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.738+0000 7f8e541bb700 1 -- 172.21.15.72:0/2601547334 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8e4c0af380 con 0x7f8e4c0c09b0 2023-07-25T14:36:29.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.738+0000 7f8e427fc700 1 -- 172.21.15.72:0/2601547334 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8e48059500 con 0x7f8e4c0c09b0 2023-07-25T14:36:29.750 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2023-07-25T14:36:29.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.740+0000 7f8e541bb700 1 -- 172.21.15.72:0/2601547334 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f8e3006ace0 msgr2=0x7f8e3006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:29.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.740+0000 7f8e541bb700 1 --2- 172.21.15.72:0/2601547334 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f8e3006ace0 0x7f8e3006d1a0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f8e4c1ee120 tx=0x7f8e3c008040 comp rx=0 tx=0).stop 2023-07-25T14:36:29.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.740+0000 7f8e541bb700 1 -- 172.21.15.72:0/2601547334 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8e4c0c09b0 msgr2=0x7f8e4c145bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:29.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.740+0000 7f8e541bb700 1 --2- 172.21.15.72:0/2601547334 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8e4c0c09b0 0x7f8e4c145bc0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f8e480090b0 tx=0x7f8e48004750 comp rx=0 tx=0).stop 2023-07-25T14:36:29.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.740+0000 7f8e541bb700 1 -- 172.21.15.72:0/2601547334 shutdown_connections 2023-07-25T14:36:29.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.740+0000 7f8e541bb700 1 --2- 172.21.15.72:0/2601547334 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f8e3006ace0 0x7f8e3006d1a0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:29.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.740+0000 7f8e541bb700 1 --2- 172.21.15.72:0/2601547334 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8e4c154490 0x7f8e4c1e70c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:29.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.740+0000 7f8e541bb700 1 --2- 172.21.15.72:0/2601547334 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8e4c0c09b0 0x7f8e4c145bc0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:29.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.740+0000 7f8e541bb700 1 --2- 172.21.15.72:0/2601547334 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8e4c151b40 0x7f8e4c1e6b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:29.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.740+0000 7f8e541bb700 1 -- 172.21.15.72:0/2601547334 >> 172.21.15.72:0/2601547334 conn(0x7f8e4c06c410 msgr2=0x7f8e4c0c23e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:29.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.740+0000 7f8e541bb700 1 -- 172.21.15.72:0/2601547334 shutdown_connections 2023-07-25T14:36:29.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.740+0000 7f8e541bb700 1 -- 172.21.15.72:0/2601547334 wait complete. 2023-07-25T14:36:29.765 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-25T14:36:29.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.878+0000 7f247c352700 1 Processor -- start 2023-07-25T14:36:29.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.878+0000 7f247c352700 1 -- start start 2023-07-25T14:36:29.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.878+0000 7f247c352700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2474151950 0x7f247406a190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:29.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.878+0000 7f247c352700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f247406a6d0 0x7f24740c3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:29.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.878+0000 7f247c352700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24740c2fe0 con 0x7f24740724c0 2023-07-25T14:36:29.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.878+0000 7f247c352700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2474071a60 con 0x7f247406a6d0 2023-07-25T14:36:29.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.878+0000 7f247c352700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24740c2a70 con 0x7f2474151950 2023-07-25T14:36:29.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.878+0000 7f24798ed700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f24740724c0 0x7f24740c34c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:60210/0 (socket says 172.21.15.72:60210) 2023-07-25T14:36:29.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.878+0000 7f24798ed700 1 -- 172.21.15.72:0/1316631016 learned_addr learned my addr 172.21.15.72:0/1316631016 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:36:29.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.878+0000 7f247a8ef700 1 --2- 172.21.15.72:0/1316631016 >> v2:172.21.15.92:3300/0 conn(0x7f247406a6d0 0x7f24740c3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:29.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.878+0000 7f24790ec700 1 -- 172.21.15.72:0/1316631016 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1228223670 0 0) 0x7f24740c2fe0 con 0x7f24740724c0 2023-07-25T14:36:29.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.878+0000 7f247a0ee700 1 --2- 172.21.15.72:0/1316631016 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2474151950 0x7f247406a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:29.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.878+0000 7f24790ec700 1 -- 172.21.15.72:0/1316631016 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f24600035b0 con 0x7f24740724c0 2023-07-25T14:36:29.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.878+0000 7f24790ec700 1 -- 172.21.15.72:0/1316631016 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 854510796 0 0) 0x7f24600035b0 con 0x7f24740724c0 2023-07-25T14:36:29.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.878+0000 7f24790ec700 1 -- 172.21.15.72:0/1316631016 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2474151950 msgr2=0x7f247406a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:29.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.878+0000 7f24790ec700 1 --2- 172.21.15.72:0/1316631016 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2474151950 0x7f247406a190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:29.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.878+0000 7f24790ec700 1 -- 172.21.15.72:0/1316631016 >> v2:172.21.15.92:3300/0 conn(0x7f247406a6d0 msgr2=0x7f24740c3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:29.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.878+0000 7f24790ec700 1 --2- 172.21.15.72:0/1316631016 >> v2:172.21.15.92:3300/0 conn(0x7f247406a6d0 0x7f24740c3bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:29.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.878+0000 7f24790ec700 1 -- 172.21.15.72:0/1316631016 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2474155070 con 0x7f24740724c0 2023-07-25T14:36:29.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.878+0000 7f24790ec700 1 -- 172.21.15.72:0/1316631016 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2559588315 0 0) 0x7f2464001670 con 0x7f24740724c0 2023-07-25T14:36:29.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.878+0000 7f24790ec700 1 -- 172.21.15.72:0/1316631016 >> v1:172.21.15.72:6789/0 conn(0x7f24740724c0 legacy=0x7f24740c34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:29.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.878+0000 7f24790ec700 1 --2- 172.21.15.72:0/1316631016 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2460003a00 0x7f2460003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:29.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.878+0000 7f24790ec700 1 --2- 172.21.15.72:0/1316631016 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2460004850 0x7f2460004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:29.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.878+0000 7f24790ec700 1 --2- 172.21.15.72:0/1316631016 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2474151950 0x7f2460005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:29.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.878+0000 7f24790ec700 1 -- 172.21.15.72:0/1316631016 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2474071a60 con 0x7f2460003a00 2023-07-25T14:36:29.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.878+0000 7f24790ec700 1 -- 172.21.15.72:0/1316631016 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f246000ba10 con 0x7f2460004850 2023-07-25T14:36:29.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.878+0000 7f24790ec700 1 -- 172.21.15.72:0/1316631016 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f246000bb50 con 0x7f2474151950 2023-07-25T14:36:29.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.878+0000 7f247a0ee700 1 --2- 172.21.15.72:0/1316631016 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2460003a00 0x7f2460003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:29.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.878+0000 7f24798ed700 1 --2- 172.21.15.72:0/1316631016 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2460004850 0x7f2460004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:29.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.878+0000 7f247a8ef700 1 --2- 172.21.15.72:0/1316631016 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2474151950 0x7f2460005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:29.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.879+0000 7f247a0ee700 1 -- 172.21.15.72:0/1316631016 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2474151950 msgr2=0x7f2460005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:29.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.879+0000 7f247a0ee700 1 --2- 172.21.15.72:0/1316631016 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2474151950 0x7f2460005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:29.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.879+0000 7f247a0ee700 1 -- 172.21.15.72:0/1316631016 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2460004850 msgr2=0x7f2460004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:29.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.879+0000 7f247a0ee700 1 --2- 172.21.15.72:0/1316631016 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2460004850 0x7f2460004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:29.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.879+0000 7f247a0ee700 1 -- 172.21.15.72:0/1316631016 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24600035b0 con 0x7f2460003a00 2023-07-25T14:36:29.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.879+0000 7f247a0ee700 1 --2- 172.21.15.72:0/1316631016 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2460003a00 0x7f2460003e20 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f2470009b90 tx=0x7f2460005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2aae88c9a6ae92a server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:29.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.879+0000 7f24790ec700 1 -- 172.21.15.72:0/1316631016 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f247000e6c0 con 0x7f2460003a00 2023-07-25T14:36:29.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.879+0000 7f24790ec700 1 -- 172.21.15.72:0/1316631016 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f247000e820 con 0x7f2460003a00 2023-07-25T14:36:29.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.879+0000 7f24790ec700 1 -- 172.21.15.72:0/1316631016 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f247000eb90 con 0x7f2460003a00 2023-07-25T14:36:29.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.879+0000 7f247c352700 1 -- 172.21.15.72:0/1316631016 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2460003a00 msgr2=0x7f2460003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:29.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.879+0000 7f247c352700 1 --2- 172.21.15.72:0/1316631016 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2460003a00 0x7f2460003e20 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f2470009b90 tx=0x7f2460005880 comp rx=0 tx=0).stop 2023-07-25T14:36:29.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.879+0000 7f247a8ef700 1 -- 172.21.15.72:0/1316631016 reap_dead start 2023-07-25T14:36:29.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.880+0000 7f247c352700 1 -- 172.21.15.72:0/1316631016 shutdown_connections 2023-07-25T14:36:29.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.880+0000 7f247c352700 1 -- 172.21.15.72:0/1316631016 >> 172.21.15.72:0/1316631016 conn(0x7f24740a87e0 msgr2=0x7f24740a8bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:29.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.880+0000 7f247c352700 1 -- 172.21.15.72:0/1316631016 shutdown_connections 2023-07-25T14:36:29.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.880+0000 7f247c352700 1 -- 172.21.15.72:0/1316631016 wait complete. 2023-07-25T14:36:29.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.881+0000 7f247c352700 1 Processor -- start 2023-07-25T14:36:29.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.881+0000 7f247c352700 1 -- start start 2023-07-25T14:36:29.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.881+0000 7f247c352700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2460003a00 0x7f247414bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:29.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.881+0000 7f247c352700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f24740aa190 0x7f24740c0510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:29.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.881+0000 7f247c352700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f247414b1c0 0x7f247414b640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:29.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.881+0000 7f247c352700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f247414bb80 con 0x7f2460003a00 2023-07-25T14:36:29.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.881+0000 7f247c352700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2474153b50 con 0x7f247414b1c0 2023-07-25T14:36:29.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.881+0000 7f247c352700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2474153da0 con 0x7f24740aa190 2023-07-25T14:36:29.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.881+0000 7f247a0ee700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2460003a00 0x7f247414bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:29.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.881+0000 7f247a0ee700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2460003a00 0x7f247414bcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41254/0 (socket says 172.21.15.72:41254) 2023-07-25T14:36:29.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.881+0000 7f247a0ee700 1 -- 172.21.15.72:0/2190354073 learned_addr learned my addr 172.21.15.72:0/2190354073 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:29.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.882+0000 7f247a8ef700 1 --2- 172.21.15.72:0/2190354073 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f247414b1c0 0x7f247414b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:29.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.882+0000 7f24798ed700 1 --2- 172.21.15.72:0/2190354073 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f24740aa190 0x7f24740c0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:29.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.882+0000 7f247a0ee700 1 -- 172.21.15.72:0/2190354073 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f24740aa190 msgr2=0x7f24740c0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:29.907 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.882+0000 7f247a0ee700 1 --2- 172.21.15.72:0/2190354073 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f24740aa190 0x7f24740c0510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:29.907 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.882+0000 7f247a0ee700 1 -- 172.21.15.72:0/2190354073 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f247414b1c0 msgr2=0x7f247414b640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:29.907 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.882+0000 7f247a0ee700 1 --2- 172.21.15.72:0/2190354073 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f247414b1c0 0x7f247414b640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:29.907 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.882+0000 7f247a0ee700 1 -- 172.21.15.72:0/2190354073 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24741e94a0 con 0x7f2460003a00 2023-07-25T14:36:29.907 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.882+0000 7f247a0ee700 1 --2- 172.21.15.72:0/2190354073 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2460003a00 0x7f247414bcf0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f24700090b0 tx=0x7f24700047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:29.907 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.882+0000 7f246affd700 1 -- 172.21.15.72:0/2190354073 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f247000e6c0 con 0x7f2460003a00 2023-07-25T14:36:29.907 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.882+0000 7f246affd700 1 -- 172.21.15.72:0/2190354073 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24700038a0 con 0x7f2460003a00 2023-07-25T14:36:29.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.882+0000 7f247c352700 1 -- 172.21.15.72:0/2190354073 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24741e9780 con 0x7f2460003a00 2023-07-25T14:36:29.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.882+0000 7f246affd700 1 -- 172.21.15.72:0/2190354073 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2470003c50 con 0x7f2460003a00 2023-07-25T14:36:29.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.882+0000 7f247c352700 1 -- 172.21.15.72:0/2190354073 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24741e9170 con 0x7f2460003a00 2023-07-25T14:36:29.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.883+0000 7f247c352700 1 -- 172.21.15.72:0/2190354073 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24741e9ca0 con 0x7f2460003a00 2023-07-25T14:36:29.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.883+0000 7f246affd700 1 -- 172.21.15.72:0/2190354073 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2470013470 con 0x7f2460003a00 2023-07-25T14:36:29.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.884+0000 7f246affd700 1 --2- 172.21.15.72:0/2190354073 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f245806ad10 0x7f245806d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:29.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.884+0000 7f246affd700 1 -- 172.21.15.72:0/2190354073 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f247008ae30 con 0x7f2460003a00 2023-07-25T14:36:29.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.884+0000 7f24798ed700 1 --2- 172.21.15.72:0/2190354073 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f245806ad10 0x7f245806d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:29.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.884+0000 7f24798ed700 1 --2- 172.21.15.72:0/2190354073 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f245806ad10 0x7f245806d1d0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f247414f4c0 tx=0x7f2464007980 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:29.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:29.889+0000 7f246affd700 1 -- 172.21.15.72:0/2190354073 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f24741e9ca0 con 0x7f2460003a00 2023-07-25T14:36:30.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:30.076+0000 7f247c352700 1 -- 172.21.15.72:0/2190354073 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f24741e9ca0 con 0x7f2460003a00 2023-07-25T14:36:30.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:30.077+0000 7f246affd700 1 -- 172.21.15.72:0/2190354073 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f24741e9ca0 con 0x7f2460003a00 2023-07-25T14:36:30.089 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 64 2023-07-25T14:36:30.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:30.078+0000 7f247c352700 1 -- 172.21.15.72:0/2190354073 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f245806ad10 msgr2=0x7f245806d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:30.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:30.078+0000 7f247c352700 1 --2- 172.21.15.72:0/2190354073 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f245806ad10 0x7f245806d1d0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f247414f4c0 tx=0x7f2464007980 comp rx=0 tx=0).stop 2023-07-25T14:36:30.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:30.078+0000 7f247c352700 1 -- 172.21.15.72:0/2190354073 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2460003a00 msgr2=0x7f247414bcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:30.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:30.078+0000 7f247c352700 1 --2- 172.21.15.72:0/2190354073 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2460003a00 0x7f247414bcf0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f24700090b0 tx=0x7f24700047c0 comp rx=0 tx=0).stop 2023-07-25T14:36:30.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:30.078+0000 7f247c352700 1 -- 172.21.15.72:0/2190354073 shutdown_connections 2023-07-25T14:36:30.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:30.079+0000 7f247c352700 1 --2- 172.21.15.72:0/2190354073 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f245806ad10 0x7f245806d1d0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:30.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:30.079+0000 7f247c352700 1 --2- 172.21.15.72:0/2190354073 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f247414b1c0 0x7f247414b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:30.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:30.079+0000 7f247c352700 1 --2- 172.21.15.72:0/2190354073 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2460003a00 0x7f247414bcf0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:30.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:30.079+0000 7f247c352700 1 --2- 172.21.15.72:0/2190354073 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f24740aa190 0x7f24740c0510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:30.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:30.079+0000 7f247c352700 1 -- 172.21.15.72:0/2190354073 >> 172.21.15.72:0/2190354073 conn(0x7f24740a87e0 msgr2=0x7f2474150b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:30.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:30.079+0000 7f247c352700 1 -- 172.21.15.72:0/2190354073 shutdown_connections 2023-07-25T14:36:30.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:30.079+0000 7f247c352700 1 -- 172.21.15.72:0/2190354073 wait complete. 2023-07-25T14:36:30.103 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-07-25T14:36:30.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:30.214+0000 7f97d7753700 1 Processor -- start 2023-07-25T14:36:30.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:30.214+0000 7f97d7753700 1 -- start start 2023-07-25T14:36:30.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:30.214+0000 7f97d7753700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f97d014f810 0x7f97d00c4370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:30.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:30.214+0000 7f97d7753700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97d00c5890 con 0x7f97d00bb0b0 2023-07-25T14:36:30.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:30.214+0000 7f97d7753700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97d0152150 con 0x7f97d00a9cc0 2023-07-25T14:36:30.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:30.214+0000 7f97d7753700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97d014fbf0 con 0x7f97d014f810 2023-07-25T14:36:30.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:30.214+0000 7f97d5cf0700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f97d00bb0b0 0x7f97d015cab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:60234/0 (socket says 172.21.15.72:60234) 2023-07-25T14:36:30.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:30.214+0000 7f97d5cf0700 1 -- 172.21.15.72:0/2883663699 learned_addr learned my addr 172.21.15.72:0/2883663699 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:36:30.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:30.215+0000 7f97d54ef700 1 --2- 172.21.15.72:0/2883663699 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f97d014f810 0x7f97d00c4370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:30.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:30.215+0000 7f97c7fff700 1 -- 172.21.15.72:0/2883663699 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1418225019 0 0) 0x7f97d00c5890 con 0x7f97d00bb0b0 2023-07-25T14:36:30.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:30.215+0000 7f97c7fff700 1 -- 172.21.15.72:0/2883663699 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f97bc0035b0 con 0x7f97d00bb0b0 2023-07-25T14:36:30.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:30.215+0000 7f97c7fff700 1 -- 172.21.15.72:0/2883663699 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 42941160 0 0) 0x7f97bc0035b0 con 0x7f97d00bb0b0 2023-07-25T14:36:30.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:30.215+0000 7f97c7fff700 1 -- 172.21.15.72:0/2883663699 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f97d014f810 msgr2=0x7f97d00c4370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:30.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:30.215+0000 7f97c7fff700 1 --2- 172.21.15.72:0/2883663699 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f97d014f810 0x7f97d00c4370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:30.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:30.215+0000 7f97c7fff700 1 -- 172.21.15.72:0/2883663699 >> v1:172.21.15.92:6789/0 conn(0x7f97d00a9cc0 legacy=0x7f97d01525e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:30.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:30.215+0000 7f97c7fff700 1 -- 172.21.15.72:0/2883663699 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97d01566a0 con 0x7f97d00bb0b0 2023-07-25T14:36:30.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:30.215+0000 7f97c7fff700 1 -- 172.21.15.72:0/2883663699 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2559588315 0 0) 0x7f97c8001a40 con 0x7f97d00bb0b0 2023-07-25T14:36:30.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:30.215+0000 7f97c7fff700 1 -- 172.21.15.72:0/2883663699 >> v1:172.21.15.72:6789/0 conn(0x7f97d00bb0b0 legacy=0x7f97d015cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:30.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:30.215+0000 7f97c7fff700 1 --2- 172.21.15.72:0/2883663699 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f97bc003a30 0x7f97bc003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:30.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:30.215+0000 7f97c7fff700 1 --2- 172.21.15.72:0/2883663699 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f97bc0043e0 0x7f97bc0048b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:30.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:30.215+0000 7f97c7fff700 1 --2- 172.21.15.72:0/2883663699 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f97d014f810 0x7f97bc0051b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:30.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:30.215+0000 7f97c7fff700 1 -- 172.21.15.72:0/2883663699 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97d014fbf0 con 0x7f97bc003a30 2023-07-25T14:36:30.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:30.215+0000 7f97c7fff700 1 -- 172.21.15.72:0/2883663699 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97bc00bac0 con 0x7f97bc0043e0 2023-07-25T14:36:30.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:30.215+0000 7f97c7fff700 1 -- 172.21.15.72:0/2883663699 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97bc00bc80 con 0x7f97d014f810 2023-07-25T14:36:30.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:30.215+0000 7f97d54ef700 1 --2- 172.21.15.72:0/2883663699 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f97bc003a30 0x7f97bc003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:30.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:30.215+0000 7f97d4cee700 1 --2- 172.21.15.72:0/2883663699 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f97bc0043e0 0x7f97bc0048b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:30.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:30.215+0000 7f97d5cf0700 1 --2- 172.21.15.72:0/2883663699 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f97d014f810 0x7f97bc0051b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:30.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:30.215+0000 7f97d54ef700 1 -- 172.21.15.72:0/2883663699 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f97d014f810 msgr2=0x7f97bc0051b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:30.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:30.215+0000 7f97d54ef700 1 --2- 172.21.15.72:0/2883663699 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f97d014f810 0x7f97bc0051b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:30.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:30.215+0000 7f97d54ef700 1 -- 172.21.15.72:0/2883663699 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f97bc0043e0 msgr2=0x7f97bc0048b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:30.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:30.215+0000 7f97d54ef700 1 --2- 172.21.15.72:0/2883663699 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f97bc0043e0 0x7f97bc0048b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:30.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:30.215+0000 7f97d54ef700 1 -- 172.21.15.72:0/2883663699 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97bc0035b0 con 0x7f97bc003a30 2023-07-25T14:36:30.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:30.215+0000 7f97d54ef700 1 --2- 172.21.15.72:0/2883663699 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f97bc003a30 0x7f97bc003e10 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f97c0009b60 tx=0x7f97bc005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9e7ecf54b5273 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:30.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:30.216+0000 7f97c7fff700 1 -- 172.21.15.72:0/2883663699 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97c000e6c0 con 0x7f97bc003a30 2023-07-25T14:36:30.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:30.216+0000 7f97c7fff700 1 -- 172.21.15.72:0/2883663699 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97c000e820 con 0x7f97bc003a30 2023-07-25T14:36:30.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:30.216+0000 7f97c7fff700 1 -- 172.21.15.72:0/2883663699 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97c000eb90 con 0x7f97bc003a30 2023-07-25T14:36:30.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:30.216+0000 7f97d7753700 1 -- 172.21.15.72:0/2883663699 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f97bc003a30 msgr2=0x7f97bc003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:30.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:30.216+0000 7f97d7753700 1 --2- 172.21.15.72:0/2883663699 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f97bc003a30 0x7f97bc003e10 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f97c0009b60 tx=0x7f97bc005880 comp rx=0 tx=0).stop 2023-07-25T14:36:30.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:30.216+0000 7f97d5cf0700 1 -- 172.21.15.72:0/2883663699 reap_dead start 2023-07-25T14:36:30.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:30.216+0000 7f97d7753700 1 -- 172.21.15.72:0/2883663699 shutdown_connections 2023-07-25T14:36:30.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:30.216+0000 7f97d7753700 1 -- 172.21.15.72:0/2883663699 >> 172.21.15.72:0/2883663699 conn(0x7f97d006a8d0 msgr2=0x7f97d00a94e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:30.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:30.216+0000 7f97d7753700 1 -- 172.21.15.72:0/2883663699 shutdown_connections 2023-07-25T14:36:30.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:30.216+0000 7f97d7753700 1 -- 172.21.15.72:0/2883663699 wait complete. 2023-07-25T14:36:30.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:30.217+0000 7f97d7753700 1 Processor -- start 2023-07-25T14:36:30.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:30.217+0000 7f97d7753700 1 -- start start 2023-07-25T14:36:30.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:30.218+0000 7f97d7753700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f97bc003a30 0x7f97d00ac880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:30.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:30.218+0000 7f97d7753700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f97d00bbe50 0x7f97d00bca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:30.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:30.218+0000 7f97d7753700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f97d014c200 0x7f97d00aa5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:30.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:30.218+0000 7f97d7753700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97d00bc330 con 0x7f97d00bbe50 2023-07-25T14:36:30.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:30.218+0000 7f97d7753700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97d00ad0c0 con 0x7f97bc003a30 2023-07-25T14:36:30.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:30.218+0000 7f97d7753700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97d00ad3a0 con 0x7f97d014c200 2023-07-25T14:36:30.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:30.218+0000 7f97d4cee700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f97d00bbe50 0x7f97d00bca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:30.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:30.218+0000 7f97d4cee700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f97d00bbe50 0x7f97d00bca80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41274/0 (socket says 172.21.15.72:41274) 2023-07-25T14:36:30.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:30.218+0000 7f97d4cee700 1 -- 172.21.15.72:0/3927668338 learned_addr learned my addr 172.21.15.72:0/3927668338 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:30.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:30.218+0000 7f97d5cf0700 1 --2- 172.21.15.72:0/3927668338 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f97d014c200 0x7f97d00aa5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:30.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:30.218+0000 7f97d54ef700 1 --2- 172.21.15.72:0/3927668338 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f97bc003a30 0x7f97d00ac880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:30.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:30.218+0000 7f97d4cee700 1 -- 172.21.15.72:0/3927668338 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f97d014c200 msgr2=0x7f97d00aa5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:30.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:30.218+0000 7f97d4cee700 1 --2- 172.21.15.72:0/3927668338 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f97d014c200 0x7f97d00aa5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:30.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:30.218+0000 7f97d4cee700 1 -- 172.21.15.72:0/3927668338 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f97bc003a30 msgr2=0x7f97d00ac880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:30.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:30.218+0000 7f97d4cee700 1 --2- 172.21.15.72:0/3927668338 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f97bc003a30 0x7f97d00ac880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:30.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:30.218+0000 7f97d4cee700 1 -- 172.21.15.72:0/3927668338 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97d00bcfc0 con 0x7f97d00bbe50 2023-07-25T14:36:30.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:30.218+0000 7f97d54ef700 1 --2- 172.21.15.72:0/3927668338 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f97bc003a30 0x7f97d00ac880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-25T14:36:30.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:30.218+0000 7f97d5cf0700 1 --2- 172.21.15.72:0/3927668338 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f97d014c200 0x7f97d00aa5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-25T14:36:30.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:30.219+0000 7f97d4cee700 1 --2- 172.21.15.72:0/3927668338 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f97d00bbe50 0x7f97d00bca80 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f97cc00f810 tx=0x7f97cc00fbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:30.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:30.219+0000 7f97c5ffb700 1 -- 172.21.15.72:0/3927668338 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97cc0052e0 con 0x7f97d00bbe50 2023-07-25T14:36:30.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:30.219+0000 7f97c5ffb700 1 -- 172.21.15.72:0/3927668338 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97cc005440 con 0x7f97d00bbe50 2023-07-25T14:36:30.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:30.219+0000 7f97d7753700 1 -- 172.21.15.72:0/3927668338 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97d01513e0 con 0x7f97d00bbe50 2023-07-25T14:36:30.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:30.219+0000 7f97c5ffb700 1 -- 172.21.15.72:0/3927668338 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97cc0038c0 con 0x7f97d00bbe50 2023-07-25T14:36:30.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:30.219+0000 7f97d7753700 1 -- 172.21.15.72:0/3927668338 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97d00aacd0 con 0x7f97d00bbe50 2023-07-25T14:36:30.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:30.220+0000 7f97d7753700 1 -- 172.21.15.72:0/3927668338 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97d00ad560 con 0x7f97d00bbe50 2023-07-25T14:36:30.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:30.220+0000 7f97c5ffb700 1 -- 172.21.15.72:0/3927668338 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f97cc003a20 con 0x7f97d00bbe50 2023-07-25T14:36:30.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:30.220+0000 7f97c5ffb700 1 --2- 172.21.15.72:0/3927668338 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f97b406ad10 0x7f97b406d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:30.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:30.220+0000 7f97c5ffb700 1 -- 172.21.15.72:0/3927668338 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f97cc089760 con 0x7f97d00bbe50 2023-07-25T14:36:30.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:30.220+0000 7f97d54ef700 1 --2- 172.21.15.72:0/3927668338 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f97b406ad10 0x7f97b406d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:30.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:30.221+0000 7f97d54ef700 1 --2- 172.21.15.72:0/3927668338 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f97b406ad10 0x7f97b406d1d0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f97c00090b0 tx=0x7f97c0008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:30.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:30.226+0000 7f97c5ffb700 1 -- 172.21.15.72:0/3927668338 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f97cc054450 con 0x7f97d00bbe50 2023-07-25T14:36:30.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:30.410+0000 7f97d7753700 1 -- 172.21.15.72:0/3927668338 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f97d00acf20 con 0x7f97d00bbe50 2023-07-25T14:36:30.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:30.411+0000 7f97c5ffb700 1 -- 172.21.15.72:0/3927668338 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f97d00acf20 con 0x7f97d00bbe50 2023-07-25T14:36:30.423 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2023-07-25T14:36:30.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:30.413+0000 7f97d7753700 1 -- 172.21.15.72:0/3927668338 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f97b406ad10 msgr2=0x7f97b406d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:30.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:30.413+0000 7f97d7753700 1 --2- 172.21.15.72:0/3927668338 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f97b406ad10 0x7f97b406d1d0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f97c00090b0 tx=0x7f97c0008030 comp rx=0 tx=0).stop 2023-07-25T14:36:30.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:30.413+0000 7f97d7753700 1 -- 172.21.15.72:0/3927668338 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f97d00bbe50 msgr2=0x7f97d00bca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:30.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:30.413+0000 7f97d7753700 1 --2- 172.21.15.72:0/3927668338 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f97d00bbe50 0x7f97d00bca80 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f97cc00f810 tx=0x7f97cc00fbd0 comp rx=0 tx=0).stop 2023-07-25T14:36:30.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:30.413+0000 7f97d7753700 1 -- 172.21.15.72:0/3927668338 shutdown_connections 2023-07-25T14:36:30.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:30.413+0000 7f97d7753700 1 --2- 172.21.15.72:0/3927668338 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f97b406ad10 0x7f97b406d1d0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:30.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:30.413+0000 7f97d7753700 1 --2- 172.21.15.72:0/3927668338 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f97d014c200 0x7f97d00aa5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:30.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:30.413+0000 7f97d7753700 1 --2- 172.21.15.72:0/3927668338 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f97bc003a30 0x7f97d00ac880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:30.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:30.413+0000 7f97d7753700 1 --2- 172.21.15.72:0/3927668338 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f97d00bbe50 0x7f97d00bca80 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:30.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:30.413+0000 7f97d7753700 1 -- 172.21.15.72:0/3927668338 >> 172.21.15.72:0/3927668338 conn(0x7f97d006a8d0 msgr2=0x7f97d00c5540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:30.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:30.413+0000 7f97d7753700 1 -- 172.21.15.72:0/3927668338 shutdown_connections 2023-07-25T14:36:30.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:30.413+0000 7f97d7753700 1 -- 172.21.15.72:0/3927668338 wait complete. 2023-07-25T14:36:30.437 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-25T14:36:30.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:30.547+0000 7f4933f26700 1 Processor -- start 2023-07-25T14:36:30.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:30.547+0000 7f4933f26700 1 -- start start 2023-07-25T14:36:30.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:30.548+0000 7f4933f26700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f492c151820 0x7f492c154dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:30.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:30.548+0000 7f4933f26700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f492c06b2a0 0x7f492c06f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:30.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:30.548+0000 7f4933f26700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f492c06d2f0 con 0x7f492c070580 2023-07-25T14:36:30.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:30.548+0000 7f4933f26700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f492c0c3000 con 0x7f492c06b2a0 2023-07-25T14:36:30.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:30.548+0000 7f4933f26700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f492c06ee40 con 0x7f492c151820 2023-07-25T14:36:30.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:30.548+0000 7f49324c3700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f492c06b2a0 0x7f492c06f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:30.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:30.548+0000 7f49324c3700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f492c06b2a0 0x7f492c06f5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41282/0 (socket says 172.21.15.72:41282) 2023-07-25T14:36:30.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:30.548+0000 7f49314c1700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f492c070580 0x7f492c0c4420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:60250/0 (socket says 172.21.15.72:60250) 2023-07-25T14:36:30.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:30.548+0000 7f49324c3700 1 -- 172.21.15.72:0/3827085140 learned_addr learned my addr 172.21.15.72:0/3827085140 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:30.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:30.548+0000 7f4931cc2700 1 --2- 172.21.15.72:0/3827085140 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f492c151820 0x7f492c154dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:30.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:30.548+0000 7f49324c3700 1 -- 172.21.15.72:0/3827085140 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f492c151820 msgr2=0x7f492c154dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:30.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:30.548+0000 7f49324c3700 1 --2- 172.21.15.72:0/3827085140 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f492c151820 0x7f492c154dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:30.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:30.548+0000 7f49324c3700 1 -- 172.21.15.72:0/3827085140 >> v1:172.21.15.72:6789/0 conn(0x7f492c070580 legacy=0x7f492c0c4420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:30.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:30.549+0000 7f49324c3700 1 -- 172.21.15.72:0/3827085140 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f492c06f120 con 0x7f492c06b2a0 2023-07-25T14:36:30.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:30.548+0000 7f4930cc0700 1 -- 172.21.15.72:0/3827085140 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2824685120 0 0) 0x7f492c06d2f0 con 0x7f492c070580 2023-07-25T14:36:30.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:30.549+0000 7f49324c3700 1 --2- 172.21.15.72:0/3827085140 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f492c06b2a0 0x7f492c06f5b0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f4924009e50 tx=0x7f492400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2109d70795e1a3db server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:30.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:30.549+0000 7f4930cc0700 1 -- 172.21.15.72:0/3827085140 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f492400e070 con 0x7f492c06b2a0 2023-07-25T14:36:30.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:30.549+0000 7f4930cc0700 1 -- 172.21.15.72:0/3827085140 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f492400b910 con 0x7f492c06b2a0 2023-07-25T14:36:30.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:30.549+0000 7f4930cc0700 1 -- 172.21.15.72:0/3827085140 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f492400bcc0 con 0x7f492c06b2a0 2023-07-25T14:36:30.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:30.549+0000 7f4933f26700 1 -- 172.21.15.72:0/3827085140 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f492c06b2a0 msgr2=0x7f492c06f5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:30.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:30.549+0000 7f4933f26700 1 --2- 172.21.15.72:0/3827085140 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f492c06b2a0 0x7f492c06f5b0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f4924009e50 tx=0x7f492400b330 comp rx=0 tx=0).stop 2023-07-25T14:36:30.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:30.549+0000 7f4933f26700 1 -- 172.21.15.72:0/3827085140 shutdown_connections 2023-07-25T14:36:30.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:30.549+0000 7f4933f26700 1 --2- 172.21.15.72:0/3827085140 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f492c06b2a0 0x7f492c06f5b0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:30.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:30.549+0000 7f4933f26700 1 --2- 172.21.15.72:0/3827085140 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f492c151820 0x7f492c154dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:30.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:30.549+0000 7f4933f26700 1 -- 172.21.15.72:0/3827085140 >> 172.21.15.72:0/3827085140 conn(0x7f492c06a980 msgr2=0x7f492c0a9540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:30.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:30.549+0000 7f4933f26700 1 -- 172.21.15.72:0/3827085140 shutdown_connections 2023-07-25T14:36:30.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:30.549+0000 7f4933f26700 1 -- 172.21.15.72:0/3827085140 wait complete. 2023-07-25T14:36:30.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:30.551+0000 7f4933f26700 1 Processor -- start 2023-07-25T14:36:30.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:30.551+0000 7f4933f26700 1 -- start start 2023-07-25T14:36:30.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:30.551+0000 7f4933f26700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f492c06b2a0 0x7f492c0ad2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:30.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:30.551+0000 7f4933f26700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f492c070580 0x7f492c14fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:30.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:30.551+0000 7f4933f26700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f492c151820 0x7f492c1ece30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:30.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:30.551+0000 7f4933f26700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f492c1defb0 con 0x7f492c070580 2023-07-25T14:36:30.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:30.551+0000 7f4933f26700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f492c156350 con 0x7f492c06b2a0 2023-07-25T14:36:30.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:30.551+0000 7f4933f26700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f492c0ad7f0 con 0x7f492c151820 2023-07-25T14:36:30.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:30.551+0000 7f49314c1700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f492c070580 0x7f492c14fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:30.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:30.551+0000 7f49314c1700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f492c070580 0x7f492c14fd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41288/0 (socket says 172.21.15.72:41288) 2023-07-25T14:36:30.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:30.551+0000 7f49314c1700 1 -- 172.21.15.72:0/4173514252 learned_addr learned my addr 172.21.15.72:0/4173514252 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:30.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:30.551+0000 7f4931cc2700 1 --2- 172.21.15.72:0/4173514252 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f492c06b2a0 0x7f492c0ad2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:30.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:30.551+0000 7f49324c3700 1 --2- 172.21.15.72:0/4173514252 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f492c151820 0x7f492c1ece30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:30.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:30.552+0000 7f49314c1700 1 -- 172.21.15.72:0/4173514252 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f492c151820 msgr2=0x7f492c1ece30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:30.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:30.552+0000 7f49314c1700 1 --2- 172.21.15.72:0/4173514252 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f492c151820 0x7f492c1ece30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:30.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:30.552+0000 7f49314c1700 1 -- 172.21.15.72:0/4173514252 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f492c06b2a0 msgr2=0x7f492c0ad2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:30.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:30.552+0000 7f49314c1700 1 --2- 172.21.15.72:0/4173514252 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f492c06b2a0 0x7f492c0ad2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:30.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:30.552+0000 7f49314c1700 1 -- 172.21.15.72:0/4173514252 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4924009b30 con 0x7f492c070580 2023-07-25T14:36:30.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:30.552+0000 7f4931cc2700 1 --2- 172.21.15.72:0/4173514252 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f492c06b2a0 0x7f492c0ad2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-25T14:36:30.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:30.552+0000 7f49314c1700 1 --2- 172.21.15.72:0/4173514252 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f492c070580 0x7f492c14fd50 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f492800c750 tx=0x7f492800ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:30.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:30.552+0000 7f49227fc700 1 -- 172.21.15.72:0/4173514252 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4928004c80 con 0x7f492c070580 2023-07-25T14:36:30.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:30.552+0000 7f49227fc700 1 -- 172.21.15.72:0/4173514252 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4928004de0 con 0x7f492c070580 2023-07-25T14:36:30.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:30.552+0000 7f49227fc700 1 -- 172.21.15.72:0/4173514252 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4928007310 con 0x7f492c070580 2023-07-25T14:36:30.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:30.552+0000 7f4933f26700 1 -- 172.21.15.72:0/4173514252 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f492c1ea150 con 0x7f492c070580 2023-07-25T14:36:30.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:30.552+0000 7f4933f26700 1 -- 172.21.15.72:0/4173514252 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f492c156840 con 0x7f492c070580 2023-07-25T14:36:30.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:30.553+0000 7f4933f26700 1 -- 172.21.15.72:0/4173514252 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f492c04e470 con 0x7f492c070580 2023-07-25T14:36:30.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:30.553+0000 7f49227fc700 1 -- 172.21.15.72:0/4173514252 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4928007470 con 0x7f492c070580 2023-07-25T14:36:30.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:30.554+0000 7f49227fc700 1 --2- 172.21.15.72:0/4173514252 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f491006ace0 0x7f491006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:30.571 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:30.554+0000 7f49227fc700 1 -- 172.21.15.72:0/4173514252 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f4928089430 con 0x7f492c070580 2023-07-25T14:36:30.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:30.554+0000 7f4931cc2700 1 --2- 172.21.15.72:0/4173514252 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f491006ace0 0x7f491006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:30.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:30.554+0000 7f4931cc2700 1 --2- 172.21.15.72:0/4173514252 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f491006ace0 0x7f491006d1a0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f492c1df9d0 tx=0x7f491c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:30.572 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:30.558+0000 7f49227fc700 1 -- 172.21.15.72:0/4173514252 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f49280541a0 con 0x7f492c070580 2023-07-25T14:36:30.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:30.761+0000 7f4933f26700 1 -- 172.21.15.72:0/4173514252 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f492c0a8f60 con 0x7f492c070580 2023-07-25T14:36:30.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:30.762+0000 7f49227fc700 1 -- 172.21.15.72:0/4173514252 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) v1 ==== 80+0+0 (secure 0 0 0) 0x7f49280577c0 con 0x7f492c070580 2023-07-25T14:36:30.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:30.764+0000 7f4933f26700 1 -- 172.21.15.72:0/4173514252 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f491006ace0 msgr2=0x7f491006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:30.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:30.764+0000 7f4933f26700 1 --2- 172.21.15.72:0/4173514252 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f491006ace0 0x7f491006d1a0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f492c1df9d0 tx=0x7f491c008040 comp rx=0 tx=0).stop 2023-07-25T14:36:30.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:30.764+0000 7f4933f26700 1 -- 172.21.15.72:0/4173514252 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f492c070580 msgr2=0x7f492c14fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:30.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:30.764+0000 7f4933f26700 1 --2- 172.21.15.72:0/4173514252 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f492c070580 0x7f492c14fd50 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f492800c750 tx=0x7f492800ca60 comp rx=0 tx=0).stop 2023-07-25T14:36:30.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:30.764+0000 7f4933f26700 1 -- 172.21.15.72:0/4173514252 shutdown_connections 2023-07-25T14:36:30.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:30.764+0000 7f4933f26700 1 --2- 172.21.15.72:0/4173514252 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f491006ace0 0x7f491006d1a0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:30.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:30.764+0000 7f4933f26700 1 --2- 172.21.15.72:0/4173514252 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f492c151820 0x7f492c1ece30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:30.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:30.764+0000 7f4933f26700 1 --2- 172.21.15.72:0/4173514252 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f492c06b2a0 0x7f492c0ad2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:30.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:30.764+0000 7f4933f26700 1 --2- 172.21.15.72:0/4173514252 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f492c070580 0x7f492c14fd50 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:30.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:30.764+0000 7f4933f26700 1 -- 172.21.15.72:0/4173514252 >> 172.21.15.72:0/4173514252 conn(0x7f492c06a980 msgr2=0x7f492c0c6810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:30.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:30.764+0000 7f4933f26700 1 -- 172.21.15.72:0/4173514252 shutdown_connections 2023-07-25T14:36:30.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:30.764+0000 7f4933f26700 1 -- 172.21.15.72:0/4173514252 wait complete. 2023-07-25T14:36:30.779 INFO:teuthology.orchestra.run.smithi072.stderr:listed 0 entries 2023-07-25T14:36:30.789 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-07-25T14:36:30.789 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-25T14:36:30.790 DEBUG:teuthology.orchestra.run.smithi072:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2023-07-25T14:36:30.838 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi072.front.sepia.ceph.com 2023-07-25T14:36:30.838 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-25T14:36:30.839 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-07-25T14:36:30.856 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-07-25T14:36:30.856 DEBUG:teuthology.orchestra.run.smithi092:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-25T14:36:30.878 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-07-25T14:36:30.879 DEBUG:teuthology.orchestra.run.smithi092:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-25T14:36:30.938 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-07-25T14:36:30.939 DEBUG:teuthology.orchestra.run.smithi092:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-25T14:36:30.998 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-25T14:36:31.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.110+0000 7f75be271700 1 Processor -- start 2023-07-25T14:36:31.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.110+0000 7f75be271700 1 -- start start 2023-07-25T14:36:31.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.110+0000 7f75be271700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f75b8151ba0 0x7f75b80c2230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:31.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.110+0000 7f75be271700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f75b8154d50 0x7f75b815b970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:31.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.110+0000 7f75be271700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75b80c54f0 con 0x7f75b80c5f40 2023-07-25T14:36:31.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.110+0000 7f75be271700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75b80c6670 con 0x7f75b8151ba0 2023-07-25T14:36:31.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.110+0000 7f75be271700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75b80c5740 con 0x7f75b8154d50 2023-07-25T14:36:31.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.111+0000 7f75bc80e700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f75b8154d50 0x7f75b815b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:31.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.111+0000 7f75b7fff700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f75b8151ba0 0x7f75b80c2230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:31.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.111+0000 7f75b77fe700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f75b80c5f40 0x7f75b8154640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.72:55604/0 (socket says 172.21.15.72:55604) 2023-07-25T14:36:31.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.111+0000 7f75bc80e700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f75b8154d50 0x7f75b815b970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3301/0 says I am v2:172.21.15.72:46524/0 (socket says 172.21.15.72:46524) 2023-07-25T14:36:31.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.111+0000 7f75b77fe700 1 -- 172.21.15.72:0/3783768349 learned_addr learned my addr 172.21.15.72:0/3783768349 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:36:31.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.111+0000 7f75b7fff700 1 -- 172.21.15.72:0/3783768349 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f75b8154d50 msgr2=0x7f75b815b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:31.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.111+0000 7f75b7fff700 1 --2- 172.21.15.72:0/3783768349 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f75b8154d50 0x7f75b815b970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:31.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.111+0000 7f75b7fff700 1 -- 172.21.15.72:0/3783768349 >> v1:172.21.15.92:6789/0 conn(0x7f75b80c5f40 legacy=0x7f75b8154640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:31.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.111+0000 7f75b7fff700 1 -- 172.21.15.72:0/3783768349 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75b80c5a20 con 0x7f75b8151ba0 2023-07-25T14:36:31.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.111+0000 7f75bc80e700 1 --2- 172.21.15.72:0/3783768349 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f75b8154d50 0x7f75b815b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-25T14:36:31.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.111+0000 7f75b7fff700 1 --2- 172.21.15.72:0/3783768349 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f75b8151ba0 0x7f75b80c2230 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f75a8009840 tx=0x7f75a8009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2bf30c5d93961be8 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:31.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.111+0000 7f75b6ffd700 1 -- 172.21.15.72:0/3783768349 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75a8011830 con 0x7f75b8151ba0 2023-07-25T14:36:31.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.111+0000 7f75b6ffd700 1 -- 172.21.15.72:0/3783768349 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75a8011990 con 0x7f75b8151ba0 2023-07-25T14:36:31.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.112+0000 7f75b6ffd700 1 -- 172.21.15.72:0/3783768349 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75a8011d20 con 0x7f75b8151ba0 2023-07-25T14:36:31.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.112+0000 7f75be271700 1 -- 172.21.15.72:0/3783768349 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f75b8151ba0 msgr2=0x7f75b80c2230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:31.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.112+0000 7f75be271700 1 --2- 172.21.15.72:0/3783768349 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f75b8151ba0 0x7f75b80c2230 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f75a8009840 tx=0x7f75a8009b50 comp rx=0 tx=0).stop 2023-07-25T14:36:31.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.112+0000 7f75be271700 1 -- 172.21.15.72:0/3783768349 shutdown_connections 2023-07-25T14:36:31.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.112+0000 7f75be271700 1 --2- 172.21.15.72:0/3783768349 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f75b8154d50 0x7f75b815b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:31.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.112+0000 7f75be271700 1 --2- 172.21.15.72:0/3783768349 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f75b8151ba0 0x7f75b80c2230 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:31.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.112+0000 7f75be271700 1 -- 172.21.15.72:0/3783768349 >> 172.21.15.72:0/3783768349 conn(0x7f75b80a87e0 msgr2=0x7f75b80a8bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:31.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.112+0000 7f75be271700 1 -- 172.21.15.72:0/3783768349 shutdown_connections 2023-07-25T14:36:31.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.112+0000 7f75be271700 1 -- 172.21.15.72:0/3783768349 wait complete. 2023-07-25T14:36:31.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.113+0000 7f75be271700 1 Processor -- start 2023-07-25T14:36:31.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.113+0000 7f75be271700 1 -- start start 2023-07-25T14:36:31.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.114+0000 7f75be271700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f75b80c5f40 0x7f75b80bdb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:31.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.114+0000 7f75be271700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f75b8151ba0 0x7f75b80a9990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:31.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.114+0000 7f75be271700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f75b80a9ed0 0x7f75b814e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:31.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.114+0000 7f75be271700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75b80beb10 con 0x7f75b80a9ed0 2023-07-25T14:36:31.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.114+0000 7f75be271700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75b80bcf70 con 0x7f75b80c5f40 2023-07-25T14:36:31.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.114+0000 7f75be271700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75b80bd1c0 con 0x7f75b8151ba0 2023-07-25T14:36:31.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.114+0000 7f75bc80e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f75b80a9ed0 0x7f75b814e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:31.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.114+0000 7f75bc80e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f75b80a9ed0 0x7f75b814e1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41302/0 (socket says 172.21.15.72:41302) 2023-07-25T14:36:31.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.114+0000 7f75bc80e700 1 -- 172.21.15.72:0/4083355792 learned_addr learned my addr 172.21.15.72:0/4083355792 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:31.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.114+0000 7f75b77fe700 1 --2- 172.21.15.72:0/4083355792 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f75b8151ba0 0x7f75b80a9990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:31.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.114+0000 7f75b7fff700 1 --2- 172.21.15.72:0/4083355792 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f75b80c5f40 0x7f75b80bdb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:31.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.115+0000 7f75bc80e700 1 -- 172.21.15.72:0/4083355792 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f75b8151ba0 msgr2=0x7f75b80a9990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:31.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.115+0000 7f75bc80e700 1 --2- 172.21.15.72:0/4083355792 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f75b8151ba0 0x7f75b80a9990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:31.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.115+0000 7f75bc80e700 1 -- 172.21.15.72:0/4083355792 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f75b80c5f40 msgr2=0x7f75b80bdb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:31.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.115+0000 7f75bc80e700 1 --2- 172.21.15.72:0/4083355792 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f75b80c5f40 0x7f75b80bdb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:31.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.115+0000 7f75bc80e700 1 -- 172.21.15.72:0/4083355792 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75b0009a70 con 0x7f75b80a9ed0 2023-07-25T14:36:31.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.115+0000 7f75bc80e700 1 --2- 172.21.15.72:0/4083355792 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f75b80a9ed0 0x7f75b814e1f0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f75b000ef90 tx=0x7f75b000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:31.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.115+0000 7f75b4ff9700 1 -- 172.21.15.72:0/4083355792 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75b0009cd0 con 0x7f75b80a9ed0 2023-07-25T14:36:31.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.115+0000 7f75b4ff9700 1 -- 172.21.15.72:0/4083355792 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75b000f040 con 0x7f75b80a9ed0 2023-07-25T14:36:31.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.115+0000 7f75b4ff9700 1 -- 172.21.15.72:0/4083355792 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75b0014480 con 0x7f75b80a9ed0 2023-07-25T14:36:31.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.115+0000 7f75be271700 1 -- 172.21.15.72:0/4083355792 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75a80094a0 con 0x7f75b80a9ed0 2023-07-25T14:36:31.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.115+0000 7f75be271700 1 -- 172.21.15.72:0/4083355792 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75b81e6880 con 0x7f75b80a9ed0 2023-07-25T14:36:31.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.116+0000 7f75be271700 1 -- 172.21.15.72:0/4083355792 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75b804e470 con 0x7f75b80a9ed0 2023-07-25T14:36:31.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.116+0000 7f75b4ff9700 1 -- 172.21.15.72:0/4083355792 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f75b00145e0 con 0x7f75b80a9ed0 2023-07-25T14:36:31.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.117+0000 7f75b4ff9700 1 --2- 172.21.15.72:0/4083355792 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f75a406ace0 0x7f75a406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:31.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.117+0000 7f75b4ff9700 1 -- 172.21.15.72:0/4083355792 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f75b008a420 con 0x7f75b80a9ed0 2023-07-25T14:36:31.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.117+0000 7f75b7fff700 1 --2- 172.21.15.72:0/4083355792 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f75a406ace0 0x7f75a406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:31.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.117+0000 7f75b7fff700 1 --2- 172.21.15.72:0/4083355792 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f75a406ace0 0x7f75a406d1a0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f75a8000c00 tx=0x7f75a8008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:31.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.121+0000 7f75b4ff9700 1 -- 172.21.15.72:0/4083355792 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f75b0058cc0 con 0x7f75b80a9ed0 2023-07-25T14:36:31.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.310+0000 7f75be271700 1 -- 172.21.15.72:0/4083355792 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f75b80c52d0 con 0x7f75b80a9ed0 2023-07-25T14:36:31.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.312+0000 7f75b4ff9700 1 -- 172.21.15.72:0/4083355792 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+20109 (secure 0 0 0) 0x7f75b0058850 con 0x7f75b80a9ed0 2023-07-25T14:36:31.324 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-25T14:36:31.324 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":27,"fsid":"9170db48-9170-43e8-8ccb-9813e6240906","created":"2023-07-25T14:35:21.733262+0000","modified":"2023-07-25T14:36:28.782640+0000","last_up_change":"2023-07-25T14:35:31.355010+0000","last_in_change":"2023-07-25T14:35:24.195785+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-25T14:35:32.983457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-25T14:35:33.326342+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-25T14:35:37.534158+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-25T14:35:38.891571+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-25T14:35:42.596923+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d517fdad-0bfe-49f0-89f2-9421c3761839","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6801","nonce":2475407414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6803","nonce":2475407414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6807","nonce":2475407414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6805","nonce":2475407414}]},"public_addr":"172.21.15.72:6801/2475407414","cluster_addr":"172.21.15.72:6803/2475407414","heartbeat_back_addr":"172.21.15.72:6807/2475407414","heartbeat_front_addr":"172.21.15.72:6805/2475407414","state":["exists","up"]},{"osd":1,"uuid":"e1564be3-f209-47e5-a8d0-32fc618a474f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6822","nonce":870954016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6825","nonce":870954016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6831","nonce":870954016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6827","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6829","nonce":870954016}]},"public_addr":"172.21.15.72:6822/870954016","cluster_addr":"172.21.15.72:6825/870954016","heartbeat_back_addr":"172.21.15.72:6831/870954016","heartbeat_front_addr":"172.21.15.72:6829/870954016","state":["exists","up"]},{"osd":2,"uuid":"c4647d30-ffa6-417a-9026-ef530c75910e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6809","nonce":2143129442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6811","nonce":2143129442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6815","nonce":2143129442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6813","nonce":2143129442}]},"public_addr":"172.21.15.72:6809/2143129442","cluster_addr":"172.21.15.72:6811/2143129442","heartbeat_back_addr":"172.21.15.72:6815/2143129442","heartbeat_front_addr":"172.21.15.72:6813/2143129442","state":["exists","up"]},{"osd":3,"uuid":"76c9d9a7-c2e2-4612-a58b-d6882dd76b58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6817","nonce":3404066311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6819","nonce":3404066311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6828","nonce":3404066311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6821","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6823","nonce":3404066311}]},"public_addr":"172.21.15.72:6817/3404066311","cluster_addr":"172.21.15.72:6819/3404066311","heartbeat_back_addr":"172.21.15.72:6828/3404066311","heartbeat_front_addr":"172.21.15.72:6823/3404066311","state":["exists","up"]},{"osd":4,"uuid":"7f8920dc-0ad4-4a73-ab40-65408f83eadd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6817","nonce":2381008739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6819","nonce":2381008739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6825","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6827","nonce":2381008739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6822","nonce":2381008739}]},"public_addr":"172.21.15.92:6817/2381008739","cluster_addr":"172.21.15.92:6819/2381008739","heartbeat_back_addr":"172.21.15.92:6827/2381008739","heartbeat_front_addr":"172.21.15.92:6822/2381008739","state":["exists","up"]},{"osd":5,"uuid":"56257e7c-31eb-44c5-9ec7-1318a4e0bb35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6801","nonce":2161935604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6803","nonce":2161935604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6807","nonce":2161935604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6805","nonce":2161935604}]},"public_addr":"172.21.15.92:6801/2161935604","cluster_addr":"172.21.15.92:6803/2161935604","heartbeat_back_addr":"172.21.15.92:6807/2161935604","heartbeat_front_addr":"172.21.15.92:6805/2161935604","state":["exists","up"]},{"osd":6,"uuid":"a150d3d8-a0c9-4955-968a-8d98eff4ffb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6809","nonce":3770163493}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6811","nonce":3770163493}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6815","nonce":3770163493}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6813","nonce":3770163493}]},"public_addr":"172.21.15.92:6809/3770163493","cluster_addr":"172.21.15.92:6811/3770163493","heartbeat_back_addr":"172.21.15.92:6815/3770163493","heartbeat_front_addr":"172.21.15.92:6813/3770163493","state":["exists","up"]},{"osd":7,"uuid":"07799c27-54ee-4591-a42d-a978d6b32065","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6821","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6823","nonce":2135777609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6826","nonce":2135777609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6831","nonce":2135777609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6829","nonce":2135777609}]},"public_addr":"172.21.15.92:6823/2135777609","cluster_addr":"172.21.15.92:6826/2135777609","heartbeat_back_addr":"172.21.15.92:6831/2135777609","heartbeat_front_addr":"172.21.15.92:6829/2135777609","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.345365+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.378150+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.146566+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.372172+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:30.398421+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.385632+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.465611+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.443583+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.b","mappings":[{"from":1,"to":2}]},{"pgid":"4.3f","mappings":[{"from":3,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-25T14:36:31.325 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.314+0000 7f75be271700 1 -- 172.21.15.72:0/4083355792 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f75a406ace0 msgr2=0x7f75a406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:31.326 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.314+0000 7f75be271700 1 --2- 172.21.15.72:0/4083355792 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f75a406ace0 0x7f75a406d1a0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f75a8000c00 tx=0x7f75a8008030 comp rx=0 tx=0).stop 2023-07-25T14:36:31.326 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.314+0000 7f75be271700 1 -- 172.21.15.72:0/4083355792 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f75b80a9ed0 msgr2=0x7f75b814e1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:31.326 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.314+0000 7f75be271700 1 --2- 172.21.15.72:0/4083355792 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f75b80a9ed0 0x7f75b814e1f0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f75b000ef90 tx=0x7f75b000c3a0 comp rx=0 tx=0).stop 2023-07-25T14:36:31.326 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.314+0000 7f75be271700 1 -- 172.21.15.72:0/4083355792 shutdown_connections 2023-07-25T14:36:31.326 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.314+0000 7f75be271700 1 --2- 172.21.15.72:0/4083355792 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f75a406ace0 0x7f75a406d1a0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:31.326 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.314+0000 7f75be271700 1 --2- 172.21.15.72:0/4083355792 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f75b80a9ed0 0x7f75b814e1f0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:31.327 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.314+0000 7f75be271700 1 --2- 172.21.15.72:0/4083355792 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f75b80c5f40 0x7f75b80bdb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:31.327 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.314+0000 7f75be271700 1 --2- 172.21.15.72:0/4083355792 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f75b8151ba0 0x7f75b80a9990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:31.328 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.314+0000 7f75be271700 1 -- 172.21.15.72:0/4083355792 >> 172.21.15.72:0/4083355792 conn(0x7f75b80a87e0 msgr2=0x7f75b8154450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:31.328 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.314+0000 7f75be271700 1 -- 172.21.15.72:0/4083355792 shutdown_connections 2023-07-25T14:36:31.328 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.314+0000 7f75be271700 1 -- 172.21.15.72:0/4083355792 wait complete. 2023-07-25T14:36:31.337 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-07-25T14:35:32.983457+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-07-25T14:35:33.326342+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-25T14:35:37.534158+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-25T14:35:38.891571+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-07-25T14:35:42.596923+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-25T14:36:31.339 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-25T14:36:31.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.450+0000 7fc3017c1700 1 Processor -- start 2023-07-25T14:36:31.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.450+0000 7fc3017c1700 1 -- start start 2023-07-25T14:36:31.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.451+0000 7fc3017c1700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc2fc0bead0 0x7fc2fc0c0350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:31.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.451+0000 7fc3017c1700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fc2fc0c0890 0x7fc2fc0c44d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:31.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.451+0000 7fc3017c1700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2fc0bfeb0 con 0x7fc2fc151a90 2023-07-25T14:36:31.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.451+0000 7fc3017c1700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2fc0c10b0 con 0x7fc2fc0bead0 2023-07-25T14:36:31.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.451+0000 7fc3017c1700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2fc0c1940 con 0x7fc2fc0c0890 2023-07-25T14:36:31.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.451+0000 7fc2fa7fc700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc2fc0bead0 0x7fc2fc0c0350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:31.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.451+0000 7fc2faffd700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fc2fc151a90 0x7fc2fc154d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:60274/0 (socket says 172.21.15.72:60274) 2023-07-25T14:36:31.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.451+0000 7fc2fa7fc700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc2fc0bead0 0x7fc2fc0c0350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41308/0 (socket says 172.21.15.72:41308) 2023-07-25T14:36:31.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.451+0000 7fc2faffd700 1 -- 172.21.15.72:0/3772842450 learned_addr learned my addr 172.21.15.72:0/3772842450 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:36:31.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.451+0000 7fc2fb7fe700 1 --2- 172.21.15.72:0/3772842450 >> v2:172.21.15.92:3300/0 conn(0x7fc2fc0c0890 0x7fc2fc0c44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:31.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.451+0000 7fc2fa7fc700 1 -- 172.21.15.72:0/3772842450 >> v2:172.21.15.92:3300/0 conn(0x7fc2fc0c0890 msgr2=0x7fc2fc0c44d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:31.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.451+0000 7fc2fa7fc700 1 --2- 172.21.15.72:0/3772842450 >> v2:172.21.15.92:3300/0 conn(0x7fc2fc0c0890 0x7fc2fc0c44d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:31.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.451+0000 7fc2fa7fc700 1 -- 172.21.15.72:0/3772842450 >> v1:172.21.15.72:6789/0 conn(0x7fc2fc151a90 legacy=0x7fc2fc154d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:31.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.451+0000 7fc2f9ffb700 1 -- 172.21.15.72:0/3772842450 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3817796403 0 0) 0x7fc2fc0bfeb0 con 0x7fc2fc151a90 2023-07-25T14:36:31.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.451+0000 7fc2fa7fc700 1 -- 172.21.15.72:0/3772842450 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2fc0bf2e0 con 0x7fc2fc0bead0 2023-07-25T14:36:31.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.452+0000 7fc2fa7fc700 1 --2- 172.21.15.72:0/3772842450 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc2fc0bead0 0x7fc2fc0c0350 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fc2fc06d3e0 tx=0x7fc2ec009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80fad2ca22609c3c server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:31.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.452+0000 7fc2f9ffb700 1 -- 172.21.15.72:0/3772842450 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2ec011830 con 0x7fc2fc0bead0 2023-07-25T14:36:31.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.452+0000 7fc2f9ffb700 1 -- 172.21.15.72:0/3772842450 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2ec011990 con 0x7fc2fc0bead0 2023-07-25T14:36:31.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.452+0000 7fc2f9ffb700 1 -- 172.21.15.72:0/3772842450 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2ec011d20 con 0x7fc2fc0bead0 2023-07-25T14:36:31.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.452+0000 7fc3017c1700 1 -- 172.21.15.72:0/3772842450 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc2fc0bead0 msgr2=0x7fc2fc0c0350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:31.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.452+0000 7fc3017c1700 1 --2- 172.21.15.72:0/3772842450 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc2fc0bead0 0x7fc2fc0c0350 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fc2fc06d3e0 tx=0x7fc2ec009b20 comp rx=0 tx=0).stop 2023-07-25T14:36:31.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.452+0000 7fc3017c1700 1 -- 172.21.15.72:0/3772842450 shutdown_connections 2023-07-25T14:36:31.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.452+0000 7fc3017c1700 1 --2- 172.21.15.72:0/3772842450 >> v2:172.21.15.92:3300/0 conn(0x7fc2fc0c0890 0x7fc2fc0c44d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:31.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.452+0000 7fc3017c1700 1 --2- 172.21.15.72:0/3772842450 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc2fc0bead0 0x7fc2fc0c0350 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:31.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.452+0000 7fc3017c1700 1 -- 172.21.15.72:0/3772842450 >> 172.21.15.72:0/3772842450 conn(0x7fc2fc06c3a0 msgr2=0x7fc2fc06c780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:31.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.452+0000 7fc3017c1700 1 -- 172.21.15.72:0/3772842450 shutdown_connections 2023-07-25T14:36:31.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.452+0000 7fc3017c1700 1 -- 172.21.15.72:0/3772842450 wait complete. 2023-07-25T14:36:31.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.454+0000 7fc3017c1700 1 Processor -- start 2023-07-25T14:36:31.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.454+0000 7fc3017c1700 1 -- start start 2023-07-25T14:36:31.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.454+0000 7fc3017c1700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc2fc0bead0 0x7fc2fc1ed5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:31.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.454+0000 7fc3017c1700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc2fc0c0890 0x7fc2fc156ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:31.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.454+0000 7fc3017c1700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc2fc151a90 0x7fc2fc157410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:31.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.454+0000 7fc3017c1700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2fc157d70 con 0x7fc2fc151a90 2023-07-25T14:36:31.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.454+0000 7fc3017c1700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2fc0ca8c0 con 0x7fc2fc0c0890 2023-07-25T14:36:31.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.454+0000 7fc3017c1700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2fc1433a0 con 0x7fc2fc0bead0 2023-07-25T14:36:31.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.454+0000 7fc2fb7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc2fc151a90 0x7fc2fc157410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:31.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.454+0000 7fc2fb7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc2fc151a90 0x7fc2fc157410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41316/0 (socket says 172.21.15.72:41316) 2023-07-25T14:36:31.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.454+0000 7fc2fb7fe700 1 -- 172.21.15.72:0/1528342627 learned_addr learned my addr 172.21.15.72:0/1528342627 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:31.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.454+0000 7fc2fa7fc700 1 --2- 172.21.15.72:0/1528342627 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc2fc0c0890 0x7fc2fc156ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:31.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.454+0000 7fc2faffd700 1 --2- 172.21.15.72:0/1528342627 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc2fc0bead0 0x7fc2fc1ed5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:31.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.455+0000 7fc2fb7fe700 1 -- 172.21.15.72:0/1528342627 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc2fc0bead0 msgr2=0x7fc2fc1ed5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:31.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.455+0000 7fc2fb7fe700 1 --2- 172.21.15.72:0/1528342627 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc2fc0bead0 0x7fc2fc1ed5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:31.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.455+0000 7fc2fb7fe700 1 -- 172.21.15.72:0/1528342627 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc2fc0c0890 msgr2=0x7fc2fc156ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:31.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.455+0000 7fc2fb7fe700 1 --2- 172.21.15.72:0/1528342627 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc2fc0c0890 0x7fc2fc156ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:31.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.455+0000 7fc2fb7fe700 1 -- 172.21.15.72:0/1528342627 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2ec0094a0 con 0x7fc2fc151a90 2023-07-25T14:36:31.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.455+0000 7fc2fb7fe700 1 --2- 172.21.15.72:0/1528342627 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc2fc151a90 0x7fc2fc157410 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fc2f4009dd0 tx=0x7fc2f400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:31.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.455+0000 7fc2e37fe700 1 -- 172.21.15.72:0/1528342627 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2f4009c40 con 0x7fc2fc151a90 2023-07-25T14:36:31.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.455+0000 7fc2e37fe700 1 -- 172.21.15.72:0/1528342627 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2f400f040 con 0x7fc2fc151a90 2023-07-25T14:36:31.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.455+0000 7fc3017c1700 1 -- 172.21.15.72:0/1528342627 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2fc0ca430 con 0x7fc2fc151a90 2023-07-25T14:36:31.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.455+0000 7fc2e37fe700 1 -- 172.21.15.72:0/1528342627 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2f400ceb0 con 0x7fc2fc151a90 2023-07-25T14:36:31.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.455+0000 7fc3017c1700 1 -- 172.21.15.72:0/1528342627 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2fc157950 con 0x7fc2fc151a90 2023-07-25T14:36:31.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.456+0000 7fc3017c1700 1 -- 172.21.15.72:0/1528342627 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2fc0ca5c0 con 0x7fc2fc151a90 2023-07-25T14:36:31.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.456+0000 7fc2e37fe700 1 -- 172.21.15.72:0/1528342627 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc2f4014480 con 0x7fc2fc151a90 2023-07-25T14:36:31.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.457+0000 7fc2e37fe700 1 --2- 172.21.15.72:0/1528342627 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fc2e806ace0 0x7fc2e806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:31.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.457+0000 7fc2e37fe700 1 -- 172.21.15.72:0/1528342627 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fc2f4089ee0 con 0x7fc2fc151a90 2023-07-25T14:36:31.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.457+0000 7fc2faffd700 1 --2- 172.21.15.72:0/1528342627 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fc2e806ace0 0x7fc2e806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:31.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.457+0000 7fc2faffd700 1 --2- 172.21.15.72:0/1528342627 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fc2e806ace0 0x7fc2e806d1a0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fc2f0007fd0 tx=0x7fc2f0007de0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:31.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.461+0000 7fc2e37fe700 1 -- 172.21.15.72:0/1528342627 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fc2f4058780 con 0x7fc2fc151a90 2023-07-25T14:36:31.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.647+0000 7fc3017c1700 1 -- 172.21.15.72:0/1528342627 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fc2fc04e470 con 0x7fc2fc151a90 2023-07-25T14:36:31.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.648+0000 7fc2e37fe700 1 -- 172.21.15.72:0/1528342627 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v27) v1 ==== 92+0+10 (secure 0 0 0) 0x7fc2f40180a0 con 0x7fc2fc151a90 2023-07-25T14:36:31.659 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 8 2023-07-25T14:36:31.660 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.649+0000 7fc3017c1700 1 -- 172.21.15.72:0/1528342627 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fc2e806ace0 msgr2=0x7fc2e806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:31.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.649+0000 7fc3017c1700 1 --2- 172.21.15.72:0/1528342627 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fc2e806ace0 0x7fc2e806d1a0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fc2f0007fd0 tx=0x7fc2f0007de0 comp rx=0 tx=0).stop 2023-07-25T14:36:31.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.649+0000 7fc3017c1700 1 -- 172.21.15.72:0/1528342627 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc2fc151a90 msgr2=0x7fc2fc157410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:31.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.649+0000 7fc3017c1700 1 --2- 172.21.15.72:0/1528342627 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc2fc151a90 0x7fc2fc157410 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fc2f4009dd0 tx=0x7fc2f400c3a0 comp rx=0 tx=0).stop 2023-07-25T14:36:31.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.649+0000 7fc3017c1700 1 -- 172.21.15.72:0/1528342627 shutdown_connections 2023-07-25T14:36:31.662 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.649+0000 7fc3017c1700 1 --2- 172.21.15.72:0/1528342627 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fc2e806ace0 0x7fc2e806d1a0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:31.662 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.649+0000 7fc3017c1700 1 --2- 172.21.15.72:0/1528342627 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc2fc0bead0 0x7fc2fc1ed5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:31.662 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.649+0000 7fc3017c1700 1 --2- 172.21.15.72:0/1528342627 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc2fc151a90 0x7fc2fc157410 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:31.662 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.649+0000 7fc3017c1700 1 --2- 172.21.15.72:0/1528342627 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc2fc0c0890 0x7fc2fc156ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:31.662 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.650+0000 7fc3017c1700 1 -- 172.21.15.72:0/1528342627 >> 172.21.15.72:0/1528342627 conn(0x7fc2fc06c3a0 msgr2=0x7fc2fc152130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:31.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.650+0000 7fc3017c1700 1 -- 172.21.15.72:0/1528342627 shutdown_connections 2023-07-25T14:36:31.663 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.650+0000 7fc3017c1700 1 -- 172.21.15.72:0/1528342627 wait complete. 2023-07-25T14:36:31.673 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-25T14:36:31.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.785+0000 7f33d6a77700 1 Processor -- start 2023-07-25T14:36:31.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.785+0000 7f33d6a77700 1 -- start start 2023-07-25T14:36:31.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.786+0000 7f33d6a77700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f33d00724c0 0x7f33d00c34c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:31.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.786+0000 7f33d6a77700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f33d00c4930 0x7f33d00c3a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:31.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.786+0000 7f33d6a77700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33d00c2fe0 con 0x7f33d0151950 2023-07-25T14:36:31.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.786+0000 7f33d6a77700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33d0071a60 con 0x7f33d00c4930 2023-07-25T14:36:31.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.786+0000 7f33d6a77700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33d00c2a70 con 0x7f33d00724c0 2023-07-25T14:36:31.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.786+0000 7f33cffff700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f33d00724c0 0x7f33d00c34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:31.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.786+0000 7f33d5014700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f33d00c4930 0x7f33d00c3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:31.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.786+0000 7f33cffff700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f33d00724c0 0x7f33d00c34c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3301/0 says I am v2:172.21.15.72:46550/0 (socket says 172.21.15.72:46550) 2023-07-25T14:36:31.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.786+0000 7f33cffff700 1 -- 172.21.15.72:0/2148656228 learned_addr learned my addr 172.21.15.72:0/2148656228 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:31.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.786+0000 7f33d4813700 1 --1- 172.21.15.72:0/2148656228 >> v1:172.21.15.92:6789/0 conn(0x7f33d0151950 0x7f33d006a190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.72:55630/0 (socket says 172.21.15.72:55630) 2023-07-25T14:36:31.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.786+0000 7f33d5014700 1 -- 172.21.15.72:0/2148656228 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f33d00724c0 msgr2=0x7f33d00c34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:31.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.786+0000 7f33d5014700 1 --2- 172.21.15.72:0/2148656228 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f33d00724c0 0x7f33d00c34c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:31.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.786+0000 7f33d5014700 1 -- 172.21.15.72:0/2148656228 >> v1:172.21.15.92:6789/0 conn(0x7f33d0151950 legacy=0x7f33d006a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:31.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.786+0000 7f33d5014700 1 -- 172.21.15.72:0/2148656228 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33d0155070 con 0x7f33d00c4930 2023-07-25T14:36:31.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.787+0000 7f33d5014700 1 --2- 172.21.15.72:0/2148656228 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f33d00c4930 0x7f33d00c3a00 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f33c8009d90 tx=0x7f33c800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2d2220a98294df17 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:31.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.787+0000 7f33cf7fe700 1 -- 172.21.15.72:0/2148656228 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33c800e070 con 0x7f33d00c4930 2023-07-25T14:36:31.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.787+0000 7f33cf7fe700 1 -- 172.21.15.72:0/2148656228 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33c800bb20 con 0x7f33d00c4930 2023-07-25T14:36:31.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.787+0000 7f33cf7fe700 1 -- 172.21.15.72:0/2148656228 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33c8012430 con 0x7f33d00c4930 2023-07-25T14:36:31.802 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.787+0000 7f33d6a77700 1 -- 172.21.15.72:0/2148656228 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f33d00c4930 msgr2=0x7f33d00c3a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:31.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.787+0000 7f33d6a77700 1 --2- 172.21.15.72:0/2148656228 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f33d00c4930 0x7f33d00c3a00 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f33c8009d90 tx=0x7f33c800b330 comp rx=0 tx=0).stop 2023-07-25T14:36:31.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.787+0000 7f33d6a77700 1 -- 172.21.15.72:0/2148656228 shutdown_connections 2023-07-25T14:36:31.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.787+0000 7f33d6a77700 1 --2- 172.21.15.72:0/2148656228 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f33d00c4930 0x7f33d00c3a00 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:31.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.787+0000 7f33d6a77700 1 --2- 172.21.15.72:0/2148656228 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f33d00724c0 0x7f33d00c34c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:31.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.787+0000 7f33d6a77700 1 -- 172.21.15.72:0/2148656228 >> 172.21.15.72:0/2148656228 conn(0x7f33d00a87e0 msgr2=0x7f33d00a8bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:31.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.787+0000 7f33d6a77700 1 -- 172.21.15.72:0/2148656228 shutdown_connections 2023-07-25T14:36:31.803 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.787+0000 7f33d6a77700 1 -- 172.21.15.72:0/2148656228 wait complete. 2023-07-25T14:36:31.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.789+0000 7f33d6a77700 1 Processor -- start 2023-07-25T14:36:31.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.789+0000 7f33d6a77700 1 -- start start 2023-07-25T14:36:31.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.790+0000 7f33d6a77700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f33d00724c0 0x7f33d00ac0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:31.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.790+0000 7f33d6a77700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f33d00c4930 0x7f33d00ac600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:31.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.790+0000 7f33d6a77700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f33d0151950 0x7f33d00bdd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:31.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.790+0000 7f33d6a77700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33d00bf370 con 0x7f33d00724c0 2023-07-25T14:36:31.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.790+0000 7f33d6a77700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33d0153120 con 0x7f33d00c4930 2023-07-25T14:36:31.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.790+0000 7f33d6a77700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33d014b250 con 0x7f33d0151950 2023-07-25T14:36:31.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.790+0000 7f33d4813700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f33d00724c0 0x7f33d00ac0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:31.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.790+0000 7f33d4813700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f33d00724c0 0x7f33d00ac0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41326/0 (socket says 172.21.15.72:41326) 2023-07-25T14:36:31.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.790+0000 7f33d4813700 1 -- 172.21.15.72:0/1907505698 learned_addr learned my addr 172.21.15.72:0/1907505698 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:31.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.790+0000 7f33cffff700 1 --2- 172.21.15.72:0/1907505698 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f33d00c4930 0x7f33d00ac600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:31.805 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.790+0000 7f33d5014700 1 --2- 172.21.15.72:0/1907505698 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f33d0151950 0x7f33d00bdd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:31.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.790+0000 7f33d4813700 1 -- 172.21.15.72:0/1907505698 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f33d0151950 msgr2=0x7f33d00bdd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:31.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.790+0000 7f33d4813700 1 --2- 172.21.15.72:0/1907505698 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f33d0151950 0x7f33d00bdd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:31.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.790+0000 7f33d4813700 1 -- 172.21.15.72:0/1907505698 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f33d00c4930 msgr2=0x7f33d00ac600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:31.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.790+0000 7f33d4813700 1 --2- 172.21.15.72:0/1907505698 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f33d00c4930 0x7f33d00ac600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:31.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.790+0000 7f33d4813700 1 -- 172.21.15.72:0/1907505698 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33c8009a70 con 0x7f33d00724c0 2023-07-25T14:36:31.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.790+0000 7f33cffff700 1 --2- 172.21.15.72:0/1907505698 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f33d00c4930 0x7f33d00ac600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-25T14:36:31.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.791+0000 7f33d4813700 1 --2- 172.21.15.72:0/1907505698 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f33d00724c0 0x7f33d00ac0c0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f33c400c530 tx=0x7f33c400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:31.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.791+0000 7f33cd7fa700 1 -- 172.21.15.72:0/1907505698 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33c4005cb0 con 0x7f33d00724c0 2023-07-25T14:36:31.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.791+0000 7f33cd7fa700 1 -- 172.21.15.72:0/1907505698 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33c4005e10 con 0x7f33d00724c0 2023-07-25T14:36:31.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.791+0000 7f33d6a77700 1 -- 172.21.15.72:0/1907505698 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33d00bee40 con 0x7f33d00724c0 2023-07-25T14:36:31.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.791+0000 7f33cd7fa700 1 -- 172.21.15.72:0/1907505698 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33c40072d0 con 0x7f33d00724c0 2023-07-25T14:36:31.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.791+0000 7f33d6a77700 1 -- 172.21.15.72:0/1907505698 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33d01ea1d0 con 0x7f33d00724c0 2023-07-25T14:36:31.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.792+0000 7f33d6a77700 1 -- 172.21.15.72:0/1907505698 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33d01ea030 con 0x7f33d00724c0 2023-07-25T14:36:31.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.792+0000 7f33cd7fa700 1 -- 172.21.15.72:0/1907505698 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f33c4007430 con 0x7f33d00724c0 2023-07-25T14:36:31.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.792+0000 7f33cd7fa700 1 --2- 172.21.15.72:0/1907505698 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f33b406ad10 0x7f33b406d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:31.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.793+0000 7f33cd7fa700 1 -- 172.21.15.72:0/1907505698 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f33c4088a50 con 0x7f33d00724c0 2023-07-25T14:36:31.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.793+0000 7f33cffff700 1 --2- 172.21.15.72:0/1907505698 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f33b406ad10 0x7f33b406d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:31.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.793+0000 7f33cffff700 1 --2- 172.21.15.72:0/1907505698 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f33b406ad10 0x7f33b406d1d0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f33d01501d0 tx=0x7f33bc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:31.809 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.797+0000 7f33cd7fa700 1 -- 172.21.15.72:0/1907505698 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f33d01ea030 con 0x7f33d00724c0 2023-07-25T14:36:31.996 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.985+0000 7f33d6a77700 1 -- 172.21.15.72:0/1907505698 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f33d01ea030 con 0x7f33d00724c0 2023-07-25T14:36:31.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.986+0000 7f33cd7fa700 1 -- 172.21.15.72:0/1907505698 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f33c4017020 con 0x7f33d00724c0 2023-07-25T14:36:31.997 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 1 2023-07-25T14:36:31.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.988+0000 7f33d6a77700 1 -- 172.21.15.72:0/1907505698 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f33b406ad10 msgr2=0x7f33b406d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:31.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.988+0000 7f33d6a77700 1 --2- 172.21.15.72:0/1907505698 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f33b406ad10 0x7f33b406d1d0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f33d01501d0 tx=0x7f33bc008040 comp rx=0 tx=0).stop 2023-07-25T14:36:31.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.988+0000 7f33d6a77700 1 -- 172.21.15.72:0/1907505698 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f33d00724c0 msgr2=0x7f33d00ac0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:31.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.988+0000 7f33d6a77700 1 --2- 172.21.15.72:0/1907505698 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f33d00724c0 0x7f33d00ac0c0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f33c400c530 tx=0x7f33c400c8f0 comp rx=0 tx=0).stop 2023-07-25T14:36:31.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.988+0000 7f33d6a77700 1 -- 172.21.15.72:0/1907505698 shutdown_connections 2023-07-25T14:36:31.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.988+0000 7f33d6a77700 1 --2- 172.21.15.72:0/1907505698 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f33b406ad10 0x7f33b406d1d0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:31.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.988+0000 7f33d6a77700 1 --2- 172.21.15.72:0/1907505698 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f33d0151950 0x7f33d00bdd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:32.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.988+0000 7f33d6a77700 1 --2- 172.21.15.72:0/1907505698 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f33d00724c0 0x7f33d00ac0c0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:32.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.988+0000 7f33d6a77700 1 --2- 172.21.15.72:0/1907505698 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f33d00c4930 0x7f33d00ac600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:32.000 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.988+0000 7f33d6a77700 1 -- 172.21.15.72:0/1907505698 >> 172.21.15.72:0/1907505698 conn(0x7f33d00a87e0 msgr2=0x7f33d014f5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:32.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.988+0000 7f33d6a77700 1 -- 172.21.15.72:0/1907505698 shutdown_connections 2023-07-25T14:36:32.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:31.988+0000 7f33d6a77700 1 -- 172.21.15.72:0/1907505698 wait complete. 2023-07-25T14:36:32.010 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-25T14:36:32.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.122+0000 7fb7675a0700 1 Processor -- start 2023-07-25T14:36:32.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.122+0000 7fb7675a0700 1 -- start start 2023-07-25T14:36:32.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.123+0000 7fb7675a0700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fb76006b510 0x7fb760151c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:32.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.123+0000 7fb7675a0700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb7600a7490 0x7fb7600a7940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:32.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.123+0000 7fb7675a0700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb760152190 con 0x7fb76006ea10 2023-07-25T14:36:32.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.123+0000 7fb7675a0700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7600ac350 con 0x7fb7600a7490 2023-07-25T14:36:32.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.123+0000 7fb7675a0700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7600c1670 con 0x7fb76006b510 2023-07-25T14:36:32.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.123+0000 7fb765b3d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb7600a7490 0x7fb7600a7940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:32.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.123+0000 7fb765b3d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb7600a7490 0x7fb7600a7940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41338/0 (socket says 172.21.15.72:41338) 2023-07-25T14:36:32.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.123+0000 7fb765b3d700 1 -- 172.21.15.72:0/3689650155 learned_addr learned my addr 172.21.15.72:0/3689650155 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:32.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.123+0000 7fb765b3d700 1 -- 172.21.15.72:0/3689650155 >> v2:172.21.15.92:3300/0 conn(0x7fb76006b510 msgr2=0x7fb760151c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:32.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.123+0000 7fb76533c700 1 --2- 172.21.15.72:0/3689650155 >> v2:172.21.15.92:3300/0 conn(0x7fb76006b510 0x7fb760151c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:32.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.123+0000 7fb765b3d700 1 --2- 172.21.15.72:0/3689650155 >> v2:172.21.15.92:3300/0 conn(0x7fb76006b510 0x7fb760151c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:32.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.123+0000 7fb765b3d700 1 -- 172.21.15.72:0/3689650155 >> v1:172.21.15.92:6789/0 conn(0x7fb76006ea10 legacy=0x7fb76014e5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:32.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.123+0000 7fb765b3d700 1 -- 172.21.15.72:0/3689650155 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb760066480 con 0x7fb7600a7490 2023-07-25T14:36:32.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.124+0000 7fb765b3d700 1 --2- 172.21.15.72:0/3689650155 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb7600a7490 0x7fb7600a7940 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fb7600c2c20 tx=0x7fb75800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b35346ce7350e853 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:32.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.124+0000 7fb757fff700 1 -- 172.21.15.72:0/3689650155 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb75800e070 con 0x7fb7600a7490 2023-07-25T14:36:32.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.124+0000 7fb757fff700 1 -- 172.21.15.72:0/3689650155 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb758003a20 con 0x7fb7600a7490 2023-07-25T14:36:32.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.124+0000 7fb757fff700 1 -- 172.21.15.72:0/3689650155 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb758003dd0 con 0x7fb7600a7490 2023-07-25T14:36:32.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.124+0000 7fb7675a0700 1 -- 172.21.15.72:0/3689650155 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb7600a7490 msgr2=0x7fb7600a7940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:32.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.124+0000 7fb7675a0700 1 --2- 172.21.15.72:0/3689650155 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb7600a7490 0x7fb7600a7940 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fb7600c2c20 tx=0x7fb75800b330 comp rx=0 tx=0).stop 2023-07-25T14:36:32.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.124+0000 7fb7675a0700 1 -- 172.21.15.72:0/3689650155 shutdown_connections 2023-07-25T14:36:32.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.124+0000 7fb7675a0700 1 --2- 172.21.15.72:0/3689650155 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb7600a7490 0x7fb7600a7940 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:32.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.124+0000 7fb7675a0700 1 --2- 172.21.15.72:0/3689650155 >> v2:172.21.15.92:3300/0 conn(0x7fb76006b510 0x7fb760151c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:32.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.124+0000 7fb7675a0700 1 -- 172.21.15.72:0/3689650155 >> 172.21.15.72:0/3689650155 conn(0x7fb76006def0 msgr2=0x7fb76006e300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:32.140 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.124+0000 7fb7675a0700 1 -- 172.21.15.72:0/3689650155 shutdown_connections 2023-07-25T14:36:32.140 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.124+0000 7fb7675a0700 1 -- 172.21.15.72:0/3689650155 wait complete. 2023-07-25T14:36:32.140 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.125+0000 7fb7675a0700 1 Processor -- start 2023-07-25T14:36:32.140 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.125+0000 7fb7675a0700 1 -- start start 2023-07-25T14:36:32.140 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.126+0000 7fb7675a0700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb76006b510 0x7fb7601ea080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:32.140 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.126+0000 7fb7675a0700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb76006ea10 0x7fb760153830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:32.140 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.126+0000 7fb7675a0700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb7600a7490 0x7fb7600c5430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:32.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.126+0000 7fb7675a0700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7601502a0 con 0x7fb7600a7490 2023-07-25T14:36:32.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.126+0000 7fb7675a0700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb76014f690 con 0x7fb76006ea10 2023-07-25T14:36:32.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.126+0000 7fb7675a0700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7601e9670 con 0x7fb76006b510 2023-07-25T14:36:32.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.126+0000 7fb765b3d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb7600a7490 0x7fb7600c5430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:32.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.126+0000 7fb765b3d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb7600a7490 0x7fb7600c5430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41344/0 (socket says 172.21.15.72:41344) 2023-07-25T14:36:32.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.126+0000 7fb765b3d700 1 -- 172.21.15.72:0/2433760407 learned_addr learned my addr 172.21.15.72:0/2433760407 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:32.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.126+0000 7fb76533c700 1 --2- 172.21.15.72:0/2433760407 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb76006b510 0x7fb7601ea080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:32.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.126+0000 7fb764b3b700 1 --2- 172.21.15.72:0/2433760407 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb76006ea10 0x7fb760153830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:32.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.127+0000 7fb765b3d700 1 -- 172.21.15.72:0/2433760407 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb76006b510 msgr2=0x7fb7601ea080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:32.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.127+0000 7fb765b3d700 1 --2- 172.21.15.72:0/2433760407 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb76006b510 0x7fb7601ea080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:32.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.127+0000 7fb765b3d700 1 -- 172.21.15.72:0/2433760407 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb76006ea10 msgr2=0x7fb760153830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:32.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.127+0000 7fb765b3d700 1 --2- 172.21.15.72:0/2433760407 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb76006ea10 0x7fb760153830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:32.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.127+0000 7fb765b3d700 1 -- 172.21.15.72:0/2433760407 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb758009b30 con 0x7fb7600a7490 2023-07-25T14:36:32.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.127+0000 7fb765b3d700 1 --2- 172.21.15.72:0/2433760407 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb7600a7490 0x7fb7600c5430 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fb758015040 tx=0x7fb758004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:32.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.127+0000 7fb755ffb700 1 -- 172.21.15.72:0/2433760407 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7580092e0 con 0x7fb7600a7490 2023-07-25T14:36:32.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.127+0000 7fb755ffb700 1 -- 172.21.15.72:0/2433760407 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb758004240 con 0x7fb7600a7490 2023-07-25T14:36:32.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.127+0000 7fb7675a0700 1 -- 172.21.15.72:0/2433760407 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb76014ee80 con 0x7fb7600a7490 2023-07-25T14:36:32.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.127+0000 7fb755ffb700 1 -- 172.21.15.72:0/2433760407 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7580045f0 con 0x7fb7600a7490 2023-07-25T14:36:32.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.127+0000 7fb7675a0700 1 -- 172.21.15.72:0/2433760407 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb76014f0d0 con 0x7fb7600a7490 2023-07-25T14:36:32.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.128+0000 7fb7675a0700 1 -- 172.21.15.72:0/2433760407 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb76004e470 con 0x7fb7600a7490 2023-07-25T14:36:32.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.129+0000 7fb755ffb700 1 -- 172.21.15.72:0/2433760407 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb758019070 con 0x7fb7600a7490 2023-07-25T14:36:32.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.129+0000 7fb755ffb700 1 --2- 172.21.15.72:0/2433760407 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fb74406ace0 0x7fb74406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:32.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.129+0000 7fb755ffb700 1 -- 172.21.15.72:0/2433760407 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fb75808a500 con 0x7fb7600a7490 2023-07-25T14:36:32.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.129+0000 7fb76533c700 1 --2- 172.21.15.72:0/2433760407 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fb74406ace0 0x7fb74406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:32.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.130+0000 7fb76533c700 1 --2- 172.21.15.72:0/2433760407 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fb74406ace0 0x7fb74406d1a0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fb750006fd0 tx=0x7fb750008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:32.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.134+0000 7fb755ffb700 1 -- 172.21.15.72:0/2433760407 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fb758058d00 con 0x7fb7600a7490 2023-07-25T14:36:32.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.319+0000 7fb7675a0700 1 -- 172.21.15.72:0/2433760407 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb760152190 con 0x7fb7600a7490 2023-07-25T14:36:32.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.319+0000 7fb755ffb700 1 -- 172.21.15.72:0/2433760407 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb760152190 con 0x7fb7600a7490 2023-07-25T14:36:32.330 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2023-07-25T14:36:32.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.321+0000 7fb7675a0700 1 -- 172.21.15.72:0/2433760407 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fb74406ace0 msgr2=0x7fb74406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:32.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.321+0000 7fb7675a0700 1 --2- 172.21.15.72:0/2433760407 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fb74406ace0 0x7fb74406d1a0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fb750006fd0 tx=0x7fb750008040 comp rx=0 tx=0).stop 2023-07-25T14:36:32.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.321+0000 7fb7675a0700 1 -- 172.21.15.72:0/2433760407 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb7600a7490 msgr2=0x7fb7600c5430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:32.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.321+0000 7fb7675a0700 1 --2- 172.21.15.72:0/2433760407 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb7600a7490 0x7fb7600c5430 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fb758015040 tx=0x7fb758004ad0 comp rx=0 tx=0).stop 2023-07-25T14:36:32.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.321+0000 7fb7675a0700 1 -- 172.21.15.72:0/2433760407 shutdown_connections 2023-07-25T14:36:32.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.321+0000 7fb7675a0700 1 --2- 172.21.15.72:0/2433760407 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fb74406ace0 0x7fb74406d1a0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:32.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.321+0000 7fb7675a0700 1 --2- 172.21.15.72:0/2433760407 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb76006b510 0x7fb7601ea080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:32.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.321+0000 7fb7675a0700 1 --2- 172.21.15.72:0/2433760407 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb7600a7490 0x7fb7600c5430 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:32.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.321+0000 7fb7675a0700 1 --2- 172.21.15.72:0/2433760407 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb76006ea10 0x7fb760153830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:32.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.321+0000 7fb7675a0700 1 -- 172.21.15.72:0/2433760407 >> 172.21.15.72:0/2433760407 conn(0x7fb76006def0 msgr2=0x7fb76006e2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:32.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.321+0000 7fb7675a0700 1 -- 172.21.15.72:0/2433760407 shutdown_connections 2023-07-25T14:36:32.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.321+0000 7fb7675a0700 1 -- 172.21.15.72:0/2433760407 wait complete. 2023-07-25T14:36:32.344 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-25T14:36:32.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.456+0000 7fd1e4192700 1 Processor -- start 2023-07-25T14:36:32.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.456+0000 7fd1e4192700 1 -- start start 2023-07-25T14:36:32.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.457+0000 7fd1e4192700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd1dc151ba0 0x7fd1dc0c2230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:32.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.457+0000 7fd1e4192700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd1dc0c5f40 0x7fd1dc154640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:32.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.457+0000 7fd1e4192700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1dc0c54f0 con 0x7fd1dc0ba0e0 2023-07-25T14:36:32.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.457+0000 7fd1e4192700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1dc0c6670 con 0x7fd1dc151ba0 2023-07-25T14:36:32.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.457+0000 7fd1e4192700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1dc0c5740 con 0x7fd1dc0c5f40 2023-07-25T14:36:32.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.457+0000 7fd1e1f2e700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd1dc151ba0 0x7fd1dc0c2230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:32.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.457+0000 7fd1e272f700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fd1dc0ba0e0 0x7fd1dc071740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:60320/0 (socket says 172.21.15.72:60320) 2023-07-25T14:36:32.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.457+0000 7fd1e272f700 1 -- 172.21.15.72:0/2142010979 learned_addr learned my addr 172.21.15.72:0/2142010979 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:36:32.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.457+0000 7fd1e1f2e700 1 -- 172.21.15.72:0/2142010979 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd1dc0c5f40 msgr2=0x7fd1dc154640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:32.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.457+0000 7fd1e172d700 1 --2- 172.21.15.72:0/2142010979 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd1dc0c5f40 0x7fd1dc154640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:32.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.457+0000 7fd1e1f2e700 1 --2- 172.21.15.72:0/2142010979 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd1dc0c5f40 0x7fd1dc154640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:32.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.457+0000 7fd1e1f2e700 1 -- 172.21.15.72:0/2142010979 >> v1:172.21.15.72:6789/0 conn(0x7fd1dc0ba0e0 legacy=0x7fd1dc071740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:32.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.457+0000 7fd1e1f2e700 1 -- 172.21.15.72:0/2142010979 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1dc0c5a20 con 0x7fd1dc151ba0 2023-07-25T14:36:32.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.457+0000 7fd1e0f2c700 1 -- 172.21.15.72:0/2142010979 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3022757944 0 0) 0x7fd1dc0c54f0 con 0x7fd1dc0ba0e0 2023-07-25T14:36:32.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.457+0000 7fd1e1f2e700 1 --2- 172.21.15.72:0/2142010979 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd1dc151ba0 0x7fd1dc0c2230 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fd1cc009840 tx=0x7fd1cc009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=171c32451be0304d server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:32.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.458+0000 7fd1e0f2c700 1 -- 172.21.15.72:0/2142010979 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1cc011830 con 0x7fd1dc151ba0 2023-07-25T14:36:32.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.458+0000 7fd1e0f2c700 1 -- 172.21.15.72:0/2142010979 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1cc011990 con 0x7fd1dc151ba0 2023-07-25T14:36:32.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.458+0000 7fd1e0f2c700 1 -- 172.21.15.72:0/2142010979 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1cc011d20 con 0x7fd1dc151ba0 2023-07-25T14:36:32.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.458+0000 7fd1e4192700 1 -- 172.21.15.72:0/2142010979 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd1dc151ba0 msgr2=0x7fd1dc0c2230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:32.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.458+0000 7fd1e4192700 1 --2- 172.21.15.72:0/2142010979 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd1dc151ba0 0x7fd1dc0c2230 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fd1cc009840 tx=0x7fd1cc009b50 comp rx=0 tx=0).stop 2023-07-25T14:36:32.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.458+0000 7fd1e4192700 1 -- 172.21.15.72:0/2142010979 shutdown_connections 2023-07-25T14:36:32.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.458+0000 7fd1e4192700 1 --2- 172.21.15.72:0/2142010979 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd1dc151ba0 0x7fd1dc0c2230 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:32.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.458+0000 7fd1e4192700 1 --2- 172.21.15.72:0/2142010979 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd1dc0c5f40 0x7fd1dc154640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:32.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.458+0000 7fd1e4192700 1 -- 172.21.15.72:0/2142010979 >> 172.21.15.72:0/2142010979 conn(0x7fd1dc0a87e0 msgr2=0x7fd1dc0a8bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:32.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.458+0000 7fd1e4192700 1 -- 172.21.15.72:0/2142010979 shutdown_connections 2023-07-25T14:36:32.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.458+0000 7fd1e4192700 1 -- 172.21.15.72:0/2142010979 wait complete. 2023-07-25T14:36:32.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.459+0000 7fd1e4192700 1 Processor -- start 2023-07-25T14:36:32.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.459+0000 7fd1e4192700 1 -- start start 2023-07-25T14:36:32.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.460+0000 7fd1e4192700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd1dc0ba0e0 0x7fd1dc1db360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:32.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.460+0000 7fd1e4192700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd1dc0c5f40 0x7fd1dc153d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:32.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.460+0000 7fd1e4192700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd1dc151ba0 0x7fd1dc154270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:32.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.460+0000 7fd1e4192700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1dc1dc920 con 0x7fd1dc0c5f40 2023-07-25T14:36:32.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.460+0000 7fd1e4192700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1dc153350 con 0x7fd1dc0ba0e0 2023-07-25T14:36:32.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.460+0000 7fd1e4192700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1dc0bfd70 con 0x7fd1dc151ba0 2023-07-25T14:36:32.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.460+0000 7fd1e172d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd1dc0c5f40 0x7fd1dc153d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:32.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.460+0000 7fd1e172d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd1dc0c5f40 0x7fd1dc153d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41358/0 (socket says 172.21.15.72:41358) 2023-07-25T14:36:32.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.460+0000 7fd1e172d700 1 -- 172.21.15.72:0/707863655 learned_addr learned my addr 172.21.15.72:0/707863655 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:32.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.460+0000 7fd1e1f2e700 1 --2- 172.21.15.72:0/707863655 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd1dc0ba0e0 0x7fd1dc1db360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:32.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.460+0000 7fd1e272f700 1 --2- 172.21.15.72:0/707863655 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd1dc151ba0 0x7fd1dc154270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:32.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.460+0000 7fd1e172d700 1 -- 172.21.15.72:0/707863655 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd1dc151ba0 msgr2=0x7fd1dc154270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:32.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.460+0000 7fd1e172d700 1 --2- 172.21.15.72:0/707863655 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd1dc151ba0 0x7fd1dc154270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:32.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.460+0000 7fd1e172d700 1 -- 172.21.15.72:0/707863655 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd1dc0ba0e0 msgr2=0x7fd1dc1db360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:32.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.460+0000 7fd1e172d700 1 --2- 172.21.15.72:0/707863655 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd1dc0ba0e0 0x7fd1dc1db360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:32.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.460+0000 7fd1e172d700 1 -- 172.21.15.72:0/707863655 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1cc0094a0 con 0x7fd1dc0c5f40 2023-07-25T14:36:32.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.460+0000 7fd1e172d700 1 --2- 172.21.15.72:0/707863655 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd1dc0c5f40 0x7fd1dc153d30 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fd1d800c7f0 tx=0x7fd1d800cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:32.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.461+0000 7fd1d27fc700 1 -- 172.21.15.72:0/707863655 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1d8011800 con 0x7fd1dc0c5f40 2023-07-25T14:36:32.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.461+0000 7fd1d27fc700 1 -- 172.21.15.72:0/707863655 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1d8011960 con 0x7fd1dc0c5f40 2023-07-25T14:36:32.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.461+0000 7fd1e4192700 1 -- 172.21.15.72:0/707863655 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1dc0c0050 con 0x7fd1dc0c5f40 2023-07-25T14:36:32.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.461+0000 7fd1d27fc700 1 -- 172.21.15.72:0/707863655 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1d8011cf0 con 0x7fd1dc0c5f40 2023-07-25T14:36:32.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.461+0000 7fd1e4192700 1 -- 172.21.15.72:0/707863655 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1dc0c0610 con 0x7fd1dc0c5f40 2023-07-25T14:36:32.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.462+0000 7fd1e4192700 1 -- 172.21.15.72:0/707863655 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1dc0c07a0 con 0x7fd1dc0c5f40 2023-07-25T14:36:32.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.463+0000 7fd1d27fc700 1 -- 172.21.15.72:0/707863655 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd1d8024480 con 0x7fd1dc0c5f40 2023-07-25T14:36:32.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.463+0000 7fd1d27fc700 1 --2- 172.21.15.72:0/707863655 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fd1c006ad10 0x7fd1c006d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:32.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.463+0000 7fd1d27fc700 1 -- 172.21.15.72:0/707863655 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fd1d8089ae0 con 0x7fd1dc0c5f40 2023-07-25T14:36:32.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.463+0000 7fd1e1f2e700 1 --2- 172.21.15.72:0/707863655 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fd1c006ad10 0x7fd1c006d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:32.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.464+0000 7fd1e1f2e700 1 --2- 172.21.15.72:0/707863655 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fd1c006ad10 0x7fd1c006d1d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fd1cc0090b0 tx=0x7fd1cc01c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:32.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.467+0000 7fd1d27fc700 1 -- 172.21.15.72:0/707863655 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fd1d80583d0 con 0x7fd1dc0c5f40 2023-07-25T14:36:32.667 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.657+0000 7fd1e4192700 1 -- 172.21.15.72:0/707863655 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd1dc04e470 con 0x7fd1dc0c5f40 2023-07-25T14:36:32.668 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.657+0000 7fd1d27fc700 1 -- 172.21.15.72:0/707863655 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd1d8057f60 con 0x7fd1dc0c5f40 2023-07-25T14:36:32.668 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 64 2023-07-25T14:36:32.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.659+0000 7fd1e4192700 1 -- 172.21.15.72:0/707863655 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fd1c006ad10 msgr2=0x7fd1c006d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:32.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.659+0000 7fd1e4192700 1 --2- 172.21.15.72:0/707863655 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fd1c006ad10 0x7fd1c006d1d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fd1cc0090b0 tx=0x7fd1cc01c040 comp rx=0 tx=0).stop 2023-07-25T14:36:32.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.659+0000 7fd1e4192700 1 -- 172.21.15.72:0/707863655 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd1dc0c5f40 msgr2=0x7fd1dc153d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:32.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.659+0000 7fd1e4192700 1 --2- 172.21.15.72:0/707863655 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd1dc0c5f40 0x7fd1dc153d30 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fd1d800c7f0 tx=0x7fd1d800cbb0 comp rx=0 tx=0).stop 2023-07-25T14:36:32.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.659+0000 7fd1e4192700 1 -- 172.21.15.72:0/707863655 shutdown_connections 2023-07-25T14:36:32.670 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.659+0000 7fd1e4192700 1 --2- 172.21.15.72:0/707863655 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fd1c006ad10 0x7fd1c006d1d0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:32.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.659+0000 7fd1e4192700 1 --2- 172.21.15.72:0/707863655 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd1dc151ba0 0x7fd1dc154270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:32.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.659+0000 7fd1e4192700 1 --2- 172.21.15.72:0/707863655 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd1dc0ba0e0 0x7fd1dc1db360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:32.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.659+0000 7fd1e4192700 1 --2- 172.21.15.72:0/707863655 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd1dc0c5f40 0x7fd1dc153d30 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:32.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.659+0000 7fd1e4192700 1 -- 172.21.15.72:0/707863655 >> 172.21.15.72:0/707863655 conn(0x7fd1dc0a87e0 msgr2=0x7fd1dc0a8bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:32.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.659+0000 7fd1e4192700 1 -- 172.21.15.72:0/707863655 shutdown_connections 2023-07-25T14:36:32.671 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.659+0000 7fd1e4192700 1 -- 172.21.15.72:0/707863655 wait complete. 2023-07-25T14:36:32.682 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-07-25T14:36:32.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.793+0000 7fc397f61700 1 Processor -- start 2023-07-25T14:36:32.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.793+0000 7fc397f61700 1 -- start start 2023-07-25T14:36:32.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.794+0000 7fc397f61700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fc390151950 0x7fc39006a190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:32.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.794+0000 7fc397f61700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3900c2fe0 con 0x7fc3900724c0 2023-07-25T14:36:32.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.794+0000 7fc397f61700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc390155070 con 0x7fc39006a6d0 2023-07-25T14:36:32.806 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.794+0000 7fc397f61700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc390071a60 con 0x7fc390151950 2023-07-25T14:36:32.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.794+0000 7fc3954fc700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fc3900724c0 0x7fc3900c34c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:60330/0 (socket says 172.21.15.72:60330) 2023-07-25T14:36:32.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.794+0000 7fc3954fc700 1 -- 172.21.15.72:0/945704724 learned_addr learned my addr 172.21.15.72:0/945704724 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:36:32.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.795+0000 7fc395cfd700 1 --2- 172.21.15.72:0/945704724 >> v2:172.21.15.92:3300/0 conn(0x7fc390151950 0x7fc39006a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:32.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.795+0000 7fc394cfb700 1 -- 172.21.15.72:0/945704724 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1910320351 0 0) 0x7fc3900c2fe0 con 0x7fc3900724c0 2023-07-25T14:36:32.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.795+0000 7fc394cfb700 1 -- 172.21.15.72:0/945704724 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc37c0035b0 con 0x7fc3900724c0 2023-07-25T14:36:32.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.795+0000 7fc394cfb700 1 -- 172.21.15.72:0/945704724 <== mon.1 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 373621595 0 0) 0x7fc390155070 con 0x7fc39006a6d0 2023-07-25T14:36:32.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.795+0000 7fc394cfb700 1 -- 172.21.15.72:0/945704724 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc3900c2fe0 con 0x7fc39006a6d0 2023-07-25T14:36:32.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.795+0000 7fc395cfd700 1 -- 172.21.15.72:0/945704724 >> v1:172.21.15.92:6789/0 conn(0x7fc39006a6d0 legacy=0x7fc3900c3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:32.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.795+0000 7fc394cfb700 1 -- 172.21.15.72:0/945704724 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 764202789 0 0) 0x7fc37c0035b0 con 0x7fc3900724c0 2023-07-25T14:36:32.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.795+0000 7fc395cfd700 1 -- 172.21.15.72:0/945704724 >> v1:172.21.15.72:6789/0 conn(0x7fc3900724c0 legacy=0x7fc3900c34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:32.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.795+0000 7fc395cfd700 1 -- 172.21.15.72:0/945704724 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3900c15c0 con 0x7fc390151950 2023-07-25T14:36:32.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.795+0000 7fc395cfd700 1 --2- 172.21.15.72:0/945704724 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc390151950 0x7fc39006a190 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fc380009840 tx=0x7fc380009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=75789bd1ac9b4172 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:32.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.795+0000 7fc394cfb700 1 -- 172.21.15.72:0/945704724 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc38c001670 con 0x7fc390151950 2023-07-25T14:36:32.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.795+0000 7fc394cfb700 1 -- 172.21.15.72:0/945704724 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc380004030 con 0x7fc390151950 2023-07-25T14:36:32.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.795+0000 7fc394cfb700 1 -- 172.21.15.72:0/945704724 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3800043a0 con 0x7fc390151950 2023-07-25T14:36:32.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.796+0000 7fc397f61700 1 -- 172.21.15.72:0/945704724 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc390151950 msgr2=0x7fc39006a190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:32.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.796+0000 7fc397f61700 1 --2- 172.21.15.72:0/945704724 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc390151950 0x7fc39006a190 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fc380009840 tx=0x7fc380009b50 comp rx=0 tx=0).stop 2023-07-25T14:36:32.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.796+0000 7fc397f61700 1 -- 172.21.15.72:0/945704724 shutdown_connections 2023-07-25T14:36:32.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.796+0000 7fc397f61700 1 --2- 172.21.15.72:0/945704724 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc390151950 0x7fc39006a190 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:32.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.796+0000 7fc397f61700 1 -- 172.21.15.72:0/945704724 >> 172.21.15.72:0/945704724 conn(0x7fc3900a87e0 msgr2=0x7fc3900a8bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:32.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.796+0000 7fc397f61700 1 -- 172.21.15.72:0/945704724 shutdown_connections 2023-07-25T14:36:32.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.796+0000 7fc397f61700 1 -- 172.21.15.72:0/945704724 wait complete. 2023-07-25T14:36:32.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.797+0000 7fc397f61700 1 Processor -- start 2023-07-25T14:36:32.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.797+0000 7fc397f61700 1 -- start start 2023-07-25T14:36:32.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.798+0000 7fc397f61700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc39006a6d0 0x7fc390155820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:32.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.798+0000 7fc397f61700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc3900724c0 0x7fc3901568a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:32.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.798+0000 7fc397f61700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc390151950 0x7fc3901dfb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:32.812 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.798+0000 7fc397f61700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3901dee40 con 0x7fc39006a6d0 2023-07-25T14:36:32.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.798+0000 7fc397f61700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3901eaf20 con 0x7fc3900724c0 2023-07-25T14:36:32.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.798+0000 7fc397f61700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc390150390 con 0x7fc390151950 2023-07-25T14:36:32.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.798+0000 7fc395cfd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc39006a6d0 0x7fc390155820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:32.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.798+0000 7fc395cfd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc39006a6d0 0x7fc390155820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41368/0 (socket says 172.21.15.72:41368) 2023-07-25T14:36:32.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.798+0000 7fc395cfd700 1 -- 172.21.15.72:0/2508635276 learned_addr learned my addr 172.21.15.72:0/2508635276 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:32.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.798+0000 7fc3954fc700 1 --2- 172.21.15.72:0/2508635276 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc3900724c0 0x7fc3901568a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:32.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.798+0000 7fc3964fe700 1 --2- 172.21.15.72:0/2508635276 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc390151950 0x7fc3901dfb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:32.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.798+0000 7fc395cfd700 1 -- 172.21.15.72:0/2508635276 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc390151950 msgr2=0x7fc3901dfb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:32.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.798+0000 7fc395cfd700 1 --2- 172.21.15.72:0/2508635276 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc390151950 0x7fc3901dfb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:32.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.798+0000 7fc395cfd700 1 -- 172.21.15.72:0/2508635276 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc3900724c0 msgr2=0x7fc3901568a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:32.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.798+0000 7fc395cfd700 1 --2- 172.21.15.72:0/2508635276 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc3900724c0 0x7fc3901568a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:32.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.798+0000 7fc395cfd700 1 -- 172.21.15.72:0/2508635276 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3800094a0 con 0x7fc39006a6d0 2023-07-25T14:36:32.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.798+0000 7fc3954fc700 1 --2- 172.21.15.72:0/2508635276 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc3900724c0 0x7fc3901568a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-25T14:36:32.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.798+0000 7fc3964fe700 1 --2- 172.21.15.72:0/2508635276 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc390151950 0x7fc3901dfb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-25T14:36:32.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.798+0000 7fc395cfd700 1 --2- 172.21.15.72:0/2508635276 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc39006a6d0 0x7fc390155820 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fc380000c00 tx=0x7fc380004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:32.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.798+0000 7fc3867fc700 1 -- 172.21.15.72:0/2508635276 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc380003df0 con 0x7fc39006a6d0 2023-07-25T14:36:32.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.798+0000 7fc3867fc700 1 -- 172.21.15.72:0/2508635276 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc38001f070 con 0x7fc39006a6d0 2023-07-25T14:36:32.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.798+0000 7fc397f61700 1 -- 172.21.15.72:0/2508635276 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3901df090 con 0x7fc39006a6d0 2023-07-25T14:36:32.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.798+0000 7fc3867fc700 1 -- 172.21.15.72:0/2508635276 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc380011870 con 0x7fc39006a6d0 2023-07-25T14:36:32.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.798+0000 7fc397f61700 1 -- 172.21.15.72:0/2508635276 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3901df650 con 0x7fc39006a6d0 2023-07-25T14:36:32.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.799+0000 7fc397f61700 1 -- 172.21.15.72:0/2508635276 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc39004e470 con 0x7fc39006a6d0 2023-07-25T14:36:32.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.800+0000 7fc3867fc700 1 -- 172.21.15.72:0/2508635276 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc380021030 con 0x7fc39006a6d0 2023-07-25T14:36:32.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.800+0000 7fc3867fc700 1 --2- 172.21.15.72:0/2508635276 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fc37406ace0 0x7fc37406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:32.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.800+0000 7fc3867fc700 1 -- 172.21.15.72:0/2508635276 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fc38008aac0 con 0x7fc39006a6d0 2023-07-25T14:36:32.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.800+0000 7fc3954fc700 1 --2- 172.21.15.72:0/2508635276 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fc37406ace0 0x7fc37406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:32.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.801+0000 7fc3954fc700 1 --2- 172.21.15.72:0/2508635276 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fc37406ace0 0x7fc37406d1a0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fc38c001eb0 tx=0x7fc38c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:32.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.804+0000 7fc3867fc700 1 -- 172.21.15.72:0/2508635276 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fc3800592e0 con 0x7fc39006a6d0 2023-07-25T14:36:33.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.992+0000 7fc397f61700 1 -- 172.21.15.72:0/2508635276 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fc3900a8370 con 0x7fc39006a6d0 2023-07-25T14:36:33.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.992+0000 7fc3867fc700 1 -- 172.21.15.72:0/2508635276 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7fc380058e70 con 0x7fc39006a6d0 2023-07-25T14:36:33.004 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2023-07-25T14:36:33.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.994+0000 7fc397f61700 1 -- 172.21.15.72:0/2508635276 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fc37406ace0 msgr2=0x7fc37406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:33.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.994+0000 7fc397f61700 1 --2- 172.21.15.72:0/2508635276 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fc37406ace0 0x7fc37406d1a0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fc38c001eb0 tx=0x7fc38c009040 comp rx=0 tx=0).stop 2023-07-25T14:36:33.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.994+0000 7fc397f61700 1 -- 172.21.15.72:0/2508635276 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc39006a6d0 msgr2=0x7fc390155820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:33.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.994+0000 7fc397f61700 1 --2- 172.21.15.72:0/2508635276 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc39006a6d0 0x7fc390155820 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fc380000c00 tx=0x7fc380004750 comp rx=0 tx=0).stop 2023-07-25T14:36:33.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.994+0000 7fc397f61700 1 -- 172.21.15.72:0/2508635276 shutdown_connections 2023-07-25T14:36:33.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.994+0000 7fc397f61700 1 --2- 172.21.15.72:0/2508635276 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fc37406ace0 0x7fc37406d1a0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:33.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.994+0000 7fc397f61700 1 --2- 172.21.15.72:0/2508635276 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc390151950 0x7fc3901dfb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:33.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.994+0000 7fc397f61700 1 --2- 172.21.15.72:0/2508635276 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc39006a6d0 0x7fc390155820 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:33.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.994+0000 7fc397f61700 1 --2- 172.21.15.72:0/2508635276 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc3900724c0 0x7fc3901568a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:33.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.994+0000 7fc397f61700 1 -- 172.21.15.72:0/2508635276 >> 172.21.15.72:0/2508635276 conn(0x7fc3900a87e0 msgr2=0x7fc39006fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:33.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.994+0000 7fc397f61700 1 -- 172.21.15.72:0/2508635276 shutdown_connections 2023-07-25T14:36:33.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:32.995+0000 7fc397f61700 1 -- 172.21.15.72:0/2508635276 wait complete. 2023-07-25T14:36:33.017 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-25T14:36:33.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.127+0000 7f1b22028700 1 Processor -- start 2023-07-25T14:36:33.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.127+0000 7f1b22028700 1 -- start start 2023-07-25T14:36:33.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.127+0000 7f1b22028700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f1b1c0beba0 0x7f1b1c0bf150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:33.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.127+0000 7f1b22028700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1b1c154af0 0x7f1b1c0c5bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:33.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.127+0000 7f1b22028700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b1c1580d0 con 0x7f1b1c151950 2023-07-25T14:36:33.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.127+0000 7f1b22028700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b1c1546d0 con 0x7f1b1c0beba0 2023-07-25T14:36:33.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.127+0000 7f1b22028700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b1c157ee0 con 0x7f1b1c154af0 2023-07-25T14:36:33.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.128+0000 7f1b1bfff700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1b1c154af0 0x7f1b1c0c5bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:33.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.128+0000 7f1b1affd700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f1b1c0beba0 0x7f1b1c0bf150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:33.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.128+0000 7f1b1b7fe700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f1b1c151950 0x7f1b1c1577d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.72:55686/0 (socket says 172.21.15.72:55686) 2023-07-25T14:36:33.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.128+0000 7f1b1b7fe700 1 -- 172.21.15.72:0/3851290561 learned_addr learned my addr 172.21.15.72:0/3851290561 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:36:33.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.128+0000 7f1b1affd700 1 -- 172.21.15.72:0/3851290561 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1b1c154af0 msgr2=0x7f1b1c0c5bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:33.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.128+0000 7f1b1affd700 1 --2- 172.21.15.72:0/3851290561 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1b1c154af0 0x7f1b1c0c5bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:33.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.128+0000 7f1b1affd700 1 -- 172.21.15.72:0/3851290561 >> v1:172.21.15.92:6789/0 conn(0x7f1b1c151950 legacy=0x7f1b1c1577d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:33.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.128+0000 7f1b1affd700 1 -- 172.21.15.72:0/3851290561 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b1c1583b0 con 0x7f1b1c0beba0 2023-07-25T14:36:33.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.128+0000 7f1b1bfff700 1 --2- 172.21.15.72:0/3851290561 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1b1c154af0 0x7f1b1c0c5bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-25T14:36:33.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.128+0000 7f1b1affd700 1 --2- 172.21.15.72:0/3851290561 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1b1c0beba0 0x7f1b1c0bf150 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f1b10009840 tx=0x7f1b10009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=62202d4354780b43 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:33.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.128+0000 7f1b1a7fc700 1 -- 172.21.15.72:0/3851290561 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b10011830 con 0x7f1b1c0beba0 2023-07-25T14:36:33.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.128+0000 7f1b1a7fc700 1 -- 172.21.15.72:0/3851290561 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b10011990 con 0x7f1b1c0beba0 2023-07-25T14:36:33.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.128+0000 7f1b1a7fc700 1 -- 172.21.15.72:0/3851290561 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b10011d20 con 0x7f1b1c0beba0 2023-07-25T14:36:33.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.129+0000 7f1b22028700 1 -- 172.21.15.72:0/3851290561 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1b1c0beba0 msgr2=0x7f1b1c0bf150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:33.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.129+0000 7f1b22028700 1 --2- 172.21.15.72:0/3851290561 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1b1c0beba0 0x7f1b1c0bf150 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f1b10009840 tx=0x7f1b10009b50 comp rx=0 tx=0).stop 2023-07-25T14:36:33.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.129+0000 7f1b22028700 1 -- 172.21.15.72:0/3851290561 shutdown_connections 2023-07-25T14:36:33.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.129+0000 7f1b22028700 1 --2- 172.21.15.72:0/3851290561 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1b1c154af0 0x7f1b1c0c5bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:33.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.129+0000 7f1b22028700 1 --2- 172.21.15.72:0/3851290561 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1b1c0beba0 0x7f1b1c0bf150 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:33.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.129+0000 7f1b22028700 1 -- 172.21.15.72:0/3851290561 >> 172.21.15.72:0/3851290561 conn(0x7f1b1c072110 msgr2=0x7f1b1c0c6610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:33.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.129+0000 7f1b22028700 1 -- 172.21.15.72:0/3851290561 shutdown_connections 2023-07-25T14:36:33.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.129+0000 7f1b22028700 1 -- 172.21.15.72:0/3851290561 wait complete. 2023-07-25T14:36:33.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.130+0000 7f1b22028700 1 Processor -- start 2023-07-25T14:36:33.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.130+0000 7f1b22028700 1 -- start start 2023-07-25T14:36:33.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.131+0000 7f1b22028700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1b1c0beba0 0x7f1b1c14a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:33.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.131+0000 7f1b22028700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1b1c151950 0x7f1b1c0c9f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:33.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.131+0000 7f1b22028700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1b1c154af0 0x7f1b1c14c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:33.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.131+0000 7f1b22028700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b1c156a90 con 0x7f1b1c0beba0 2023-07-25T14:36:33.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.131+0000 7f1b22028700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b1c1ed470 con 0x7f1b1c154af0 2023-07-25T14:36:33.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.131+0000 7f1b22028700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b1c153d70 con 0x7f1b1c151950 2023-07-25T14:36:33.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.131+0000 7f1b1b7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1b1c0beba0 0x7f1b1c14a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:33.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.131+0000 7f1b1b7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1b1c0beba0 0x7f1b1c14a5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41384/0 (socket says 172.21.15.72:41384) 2023-07-25T14:36:33.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.131+0000 7f1b1b7fe700 1 -- 172.21.15.72:0/260726236 learned_addr learned my addr 172.21.15.72:0/260726236 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:33.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.131+0000 7f1b1affd700 1 --2- 172.21.15.72:0/260726236 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1b1c151950 0x7f1b1c0c9f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:33.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.131+0000 7f1b1bfff700 1 --2- 172.21.15.72:0/260726236 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1b1c154af0 0x7f1b1c14c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:33.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.131+0000 7f1b1b7fe700 1 -- 172.21.15.72:0/260726236 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1b1c151950 msgr2=0x7f1b1c0c9f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:33.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.131+0000 7f1b1b7fe700 1 --2- 172.21.15.72:0/260726236 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1b1c151950 0x7f1b1c0c9f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:33.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.131+0000 7f1b1b7fe700 1 -- 172.21.15.72:0/260726236 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1b1c154af0 msgr2=0x7f1b1c14c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:33.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.131+0000 7f1b1b7fe700 1 --2- 172.21.15.72:0/260726236 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1b1c154af0 0x7f1b1c14c4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:33.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.131+0000 7f1b1b7fe700 1 -- 172.21.15.72:0/260726236 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b14009a70 con 0x7f1b1c0beba0 2023-07-25T14:36:33.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.131+0000 7f1b1bfff700 1 --2- 172.21.15.72:0/260726236 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1b1c154af0 0x7f1b1c14c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-25T14:36:33.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.131+0000 7f1b1affd700 1 --2- 172.21.15.72:0/260726236 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1b1c151950 0x7f1b1c0c9f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-25T14:36:33.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.132+0000 7f1b1b7fe700 1 --2- 172.21.15.72:0/260726236 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1b1c0beba0 0x7f1b1c14a5b0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f1b0c00c480 tx=0x7f1b0c00c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:33.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.132+0000 7f1b03fff700 1 -- 172.21.15.72:0/260726236 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b0c005d70 con 0x7f1b1c0beba0 2023-07-25T14:36:33.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.132+0000 7f1b03fff700 1 -- 172.21.15.72:0/260726236 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b0c0070d0 con 0x7f1b1c0beba0 2023-07-25T14:36:33.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.132+0000 7f1b22028700 1 -- 172.21.15.72:0/260726236 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b100094a0 con 0x7f1b1c0beba0 2023-07-25T14:36:33.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.132+0000 7f1b03fff700 1 -- 172.21.15.72:0/260726236 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b0c007440 con 0x7f1b1c0beba0 2023-07-25T14:36:33.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.132+0000 7f1b22028700 1 -- 172.21.15.72:0/260726236 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b1c157c10 con 0x7f1b1c0beba0 2023-07-25T14:36:33.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.133+0000 7f1b22028700 1 -- 172.21.15.72:0/260726236 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b1c04e470 con 0x7f1b1c0beba0 2023-07-25T14:36:33.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.133+0000 7f1b03fff700 1 -- 172.21.15.72:0/260726236 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1b0c0075a0 con 0x7f1b1c0beba0 2023-07-25T14:36:33.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.133+0000 7f1b03fff700 1 --2- 172.21.15.72:0/260726236 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f1b0806ace0 0x7f1b0806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:33.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.134+0000 7f1b03fff700 1 -- 172.21.15.72:0/260726236 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f1b0c088b80 con 0x7f1b1c0beba0 2023-07-25T14:36:33.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.134+0000 7f1b1affd700 1 --2- 172.21.15.72:0/260726236 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f1b0806ace0 0x7f1b0806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:33.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.134+0000 7f1b1affd700 1 --2- 172.21.15.72:0/260726236 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f1b0806ace0 0x7f1b0806d1a0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f1b1c0befe0 tx=0x7f1b10008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:33.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.138+0000 7f1b03fff700 1 -- 172.21.15.72:0/260726236 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f1b0c053a40 con 0x7f1b1c0beba0 2023-07-25T14:36:33.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.342+0000 7f1b22028700 1 -- 172.21.15.72:0/260726236 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f1b1c0c0790 con 0x7f1b1c0beba0 2023-07-25T14:36:33.354 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.343+0000 7f1b03fff700 1 -- 172.21.15.72:0/260726236 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) v1 ==== 80+0+0 (secure 0 0 0) 0x7f1b0c057060 con 0x7f1b1c0beba0 2023-07-25T14:36:33.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.345+0000 7f1b22028700 1 -- 172.21.15.72:0/260726236 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f1b0806ace0 msgr2=0x7f1b0806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:33.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.345+0000 7f1b22028700 1 --2- 172.21.15.72:0/260726236 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f1b0806ace0 0x7f1b0806d1a0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f1b1c0befe0 tx=0x7f1b10008030 comp rx=0 tx=0).stop 2023-07-25T14:36:33.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.345+0000 7f1b22028700 1 -- 172.21.15.72:0/260726236 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1b1c0beba0 msgr2=0x7f1b1c14a5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:33.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.345+0000 7f1b22028700 1 --2- 172.21.15.72:0/260726236 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1b1c0beba0 0x7f1b1c14a5b0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f1b0c00c480 tx=0x7f1b0c00c840 comp rx=0 tx=0).stop 2023-07-25T14:36:33.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.345+0000 7f1b22028700 1 -- 172.21.15.72:0/260726236 shutdown_connections 2023-07-25T14:36:33.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.345+0000 7f1b22028700 1 --2- 172.21.15.72:0/260726236 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f1b0806ace0 0x7f1b0806d1a0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:33.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.345+0000 7f1b22028700 1 --2- 172.21.15.72:0/260726236 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1b1c154af0 0x7f1b1c14c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:33.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.345+0000 7f1b22028700 1 --2- 172.21.15.72:0/260726236 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1b1c0beba0 0x7f1b1c14a5b0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:33.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.345+0000 7f1b22028700 1 --2- 172.21.15.72:0/260726236 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1b1c151950 0x7f1b1c0c9f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:33.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.345+0000 7f1b22028700 1 -- 172.21.15.72:0/260726236 >> 172.21.15.72:0/260726236 conn(0x7f1b1c072110 msgr2=0x7f1b1c06ca90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:33.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.345+0000 7f1b22028700 1 -- 172.21.15.72:0/260726236 shutdown_connections 2023-07-25T14:36:33.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.345+0000 7f1b22028700 1 -- 172.21.15.72:0/260726236 wait complete. 2023-07-25T14:36:33.358 INFO:teuthology.orchestra.run.smithi072.stderr:listed 0 entries 2023-07-25T14:36:33.368 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-07-25T14:36:33.368 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-25T14:36:33.369 DEBUG:teuthology.orchestra.run.smithi092:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2023-07-25T14:36:33.417 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi092.front.sepia.ceph.com 2023-07-25T14:36:33.418 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-25T14:36:33.419 DEBUG:teuthology.orchestra.run.smithi092:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-07-25T14:36:33.452 INFO:tasks.cephfs.cephfs_test_case:[, ] 2023-07-25T14:36:33.453 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-25T14:36:33.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.562+0000 7fb6c3d8f700 1 Processor -- start 2023-07-25T14:36:33.573 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.562+0000 7fb6c3d8f700 1 -- start start 2023-07-25T14:36:33.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.563+0000 7fb6c3d8f700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb6bc0724c0 0x7fb6bc0c34c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:33.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.563+0000 7fb6c3d8f700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6bc0c2fe0 con 0x7fb6bc151950 2023-07-25T14:36:33.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.563+0000 7fb6c3d8f700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6bc155070 con 0x7fb6bc0c4930 2023-07-25T14:36:33.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.563+0000 7fb6c3d8f700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6bc071a60 con 0x7fb6bc0724c0 2023-07-25T14:36:33.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.563+0000 7fb6c1b2b700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fb6bc151950 0x7fb6bc06a190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:60358/0 (socket says 172.21.15.72:60358) 2023-07-25T14:36:33.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.563+0000 7fb6c1b2b700 1 -- 172.21.15.72:0/422046357 learned_addr learned my addr 172.21.15.72:0/422046357 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:36:33.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.563+0000 7fb6c0b29700 1 -- 172.21.15.72:0/422046357 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1342772003 0 0) 0x7fb6bc0c2fe0 con 0x7fb6bc151950 2023-07-25T14:36:33.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.563+0000 7fb6c0b29700 1 -- 172.21.15.72:0/422046357 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb6a80035b0 con 0x7fb6bc151950 2023-07-25T14:36:33.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.563+0000 7fb6c0b29700 1 -- 172.21.15.72:0/422046357 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 809374448 0 0) 0x7fb6a80035b0 con 0x7fb6bc151950 2023-07-25T14:36:33.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.563+0000 7fb6c0b29700 1 -- 172.21.15.72:0/422046357 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb6bc0724c0 msgr2=0x7fb6bc0c34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:33.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.563+0000 7fb6c0b29700 1 --2- 172.21.15.72:0/422046357 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb6bc0724c0 0x7fb6bc0c34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:33.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.563+0000 7fb6c0b29700 1 -- 172.21.15.72:0/422046357 >> v1:172.21.15.92:6789/0 conn(0x7fb6bc0c4930 legacy=0x7fb6bc0c3a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:33.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.563+0000 7fb6c0b29700 1 -- 172.21.15.72:0/422046357 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6bc0c15c0 con 0x7fb6bc151950 2023-07-25T14:36:33.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.563+0000 7fb6c0b29700 1 -- 172.21.15.72:0/422046357 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2559588315 0 0) 0x7fb6b8001670 con 0x7fb6bc151950 2023-07-25T14:36:33.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.563+0000 7fb6c0b29700 1 -- 172.21.15.72:0/422046357 >> v1:172.21.15.72:6789/0 conn(0x7fb6bc151950 legacy=0x7fb6bc06a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:33.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.563+0000 7fb6c0b29700 1 --2- 172.21.15.72:0/422046357 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb6a8003a30 0x7fb6a8003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:33.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.563+0000 7fb6c0b29700 1 --2- 172.21.15.72:0/422046357 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb6bc0724c0 0x7fb6a8004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:33.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.563+0000 7fb6c0b29700 1 --2- 172.21.15.72:0/422046357 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb6a8004e00 0x7fb6a8005280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:33.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.563+0000 7fb6c0b29700 1 -- 172.21.15.72:0/422046357 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6bc071a60 con 0x7fb6a8003a30 2023-07-25T14:36:33.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.563+0000 7fb6c0b29700 1 -- 172.21.15.72:0/422046357 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6a800bcb0 con 0x7fb6a8004e00 2023-07-25T14:36:33.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.563+0000 7fb6c0b29700 1 -- 172.21.15.72:0/422046357 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6a800be70 con 0x7fb6bc0724c0 2023-07-25T14:36:33.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.564+0000 7fb6c1b2b700 1 --2- 172.21.15.72:0/422046357 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb6a8003a30 0x7fb6a8003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:33.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.564+0000 7fb6c132a700 1 --2- 172.21.15.72:0/422046357 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb6bc0724c0 0x7fb6a8004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:33.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.564+0000 7fb6c232c700 1 --2- 172.21.15.72:0/422046357 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb6a8004e00 0x7fb6a8005280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:33.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.564+0000 7fb6c1b2b700 1 -- 172.21.15.72:0/422046357 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb6bc0724c0 msgr2=0x7fb6a8004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:33.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.564+0000 7fb6c1b2b700 1 --2- 172.21.15.72:0/422046357 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb6bc0724c0 0x7fb6a8004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:33.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.564+0000 7fb6c1b2b700 1 -- 172.21.15.72:0/422046357 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb6a8004e00 msgr2=0x7fb6a8005280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:33.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.564+0000 7fb6c1b2b700 1 --2- 172.21.15.72:0/422046357 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb6a8004e00 0x7fb6a8005280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:33.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.564+0000 7fb6c1b2b700 1 -- 172.21.15.72:0/422046357 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6a80035b0 con 0x7fb6a8003a30 2023-07-25T14:36:33.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.564+0000 7fb6c232c700 1 --2- 172.21.15.72:0/422046357 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb6a8004e00 0x7fb6a8005280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-25T14:36:33.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.564+0000 7fb6c132a700 1 --2- 172.21.15.72:0/422046357 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb6bc0724c0 0x7fb6a8004850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-25T14:36:33.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.564+0000 7fb6c1b2b700 1 --2- 172.21.15.72:0/422046357 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb6a8003a30 0x7fb6a8003e30 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fb6b800c2f0 tx=0x7fb6a8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0fb1518e4634b14 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:33.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.564+0000 7fb6c0b29700 1 -- 172.21.15.72:0/422046357 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6b800cd70 con 0x7fb6a8003a30 2023-07-25T14:36:33.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.564+0000 7fb6c0b29700 1 -- 172.21.15.72:0/422046357 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6b8005960 con 0x7fb6a8003a30 2023-07-25T14:36:33.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.564+0000 7fb6c0b29700 1 -- 172.21.15.72:0/422046357 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6b8005cf0 con 0x7fb6a8003a30 2023-07-25T14:36:33.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.564+0000 7fb6c3d8f700 1 -- 172.21.15.72:0/422046357 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb6a8003a30 msgr2=0x7fb6a8003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:33.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.564+0000 7fb6c3d8f700 1 --2- 172.21.15.72:0/422046357 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb6a8003a30 0x7fb6a8003e30 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fb6b800c2f0 tx=0x7fb6a8005880 comp rx=0 tx=0).stop 2023-07-25T14:36:33.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.565+0000 7fb6c232c700 1 -- 172.21.15.72:0/422046357 reap_dead start 2023-07-25T14:36:33.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.565+0000 7fb6c3d8f700 1 -- 172.21.15.72:0/422046357 shutdown_connections 2023-07-25T14:36:33.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.565+0000 7fb6c3d8f700 1 -- 172.21.15.72:0/422046357 >> 172.21.15.72:0/422046357 conn(0x7fb6bc0a87e0 msgr2=0x7fb6bc0a8bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:33.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.565+0000 7fb6c3d8f700 1 -- 172.21.15.72:0/422046357 shutdown_connections 2023-07-25T14:36:33.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.565+0000 7fb6c3d8f700 1 -- 172.21.15.72:0/422046357 wait complete. 2023-07-25T14:36:33.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.566+0000 7fb6c3d8f700 1 Processor -- start 2023-07-25T14:36:33.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.566+0000 7fb6c3d8f700 1 -- start start 2023-07-25T14:36:33.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.566+0000 7fb6c3d8f700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb6a8003a30 0x7fb6bc153320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:33.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.566+0000 7fb6c3d8f700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb6bc158550 0x7fb6bc0bfd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:33.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.566+0000 7fb6c3d8f700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb6bc0c0270 0x7fb6bc1ecf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:33.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.566+0000 7fb6c3d8f700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6bc155cf0 con 0x7fb6a8003a30 2023-07-25T14:36:33.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.566+0000 7fb6c3d8f700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6bc155400 con 0x7fb6bc0c0270 2023-07-25T14:36:33.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.566+0000 7fb6c3d8f700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6bc155ed0 con 0x7fb6bc158550 2023-07-25T14:36:33.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.566+0000 7fb6c1b2b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb6a8003a30 0x7fb6bc153320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:33.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.567+0000 7fb6c1b2b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb6a8003a30 0x7fb6bc153320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41402/0 (socket says 172.21.15.72:41402) 2023-07-25T14:36:33.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.567+0000 7fb6c1b2b700 1 -- 172.21.15.72:0/1684053266 learned_addr learned my addr 172.21.15.72:0/1684053266 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:33.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.567+0000 7fb6c1b2b700 1 -- 172.21.15.72:0/1684053266 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb6bc158550 msgr2=0x7fb6bc0bfd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:33.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.567+0000 7fb6c1b2b700 1 --2- 172.21.15.72:0/1684053266 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb6bc158550 0x7fb6bc0bfd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:33.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.567+0000 7fb6c1b2b700 1 -- 172.21.15.72:0/1684053266 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb6bc0c0270 msgr2=0x7fb6bc1ecf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:33.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.567+0000 7fb6c1b2b700 1 --2- 172.21.15.72:0/1684053266 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb6bc0c0270 0x7fb6bc1ecf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:33.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.567+0000 7fb6c1b2b700 1 -- 172.21.15.72:0/1684053266 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6bc156ec0 con 0x7fb6a8003a30 2023-07-25T14:36:33.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.567+0000 7fb6c1b2b700 1 --2- 172.21.15.72:0/1684053266 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb6a8003a30 0x7fb6bc153320 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fb6b8008fd0 tx=0x7fb6b8001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:33.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.567+0000 7fb6b27fc700 1 -- 172.21.15.72:0/1684053266 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6b8004a80 con 0x7fb6a8003a30 2023-07-25T14:36:33.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.567+0000 7fb6b27fc700 1 -- 172.21.15.72:0/1684053266 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6b8004be0 con 0x7fb6a8003a30 2023-07-25T14:36:33.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.567+0000 7fb6c3d8f700 1 -- 172.21.15.72:0/1684053266 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6bc157e90 con 0x7fb6a8003a30 2023-07-25T14:36:33.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.567+0000 7fb6b27fc700 1 -- 172.21.15.72:0/1684053266 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6b80070d0 con 0x7fb6a8003a30 2023-07-25T14:36:33.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.567+0000 7fb6c3d8f700 1 -- 172.21.15.72:0/1684053266 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6bc155910 con 0x7fb6a8003a30 2023-07-25T14:36:33.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.568+0000 7fb6c3d8f700 1 -- 172.21.15.72:0/1684053266 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6bc156cb0 con 0x7fb6a8003a30 2023-07-25T14:36:33.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.568+0000 7fb6b27fc700 1 -- 172.21.15.72:0/1684053266 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb6b8007230 con 0x7fb6a8003a30 2023-07-25T14:36:33.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.569+0000 7fb6b27fc700 1 --2- 172.21.15.72:0/1684053266 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fb6a006ace0 0x7fb6a006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:33.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.569+0000 7fb6b27fc700 1 -- 172.21.15.72:0/1684053266 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fb6b808aa50 con 0x7fb6a8003a30 2023-07-25T14:36:33.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.569+0000 7fb6c132a700 1 --2- 172.21.15.72:0/1684053266 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fb6a006ace0 0x7fb6a006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:33.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.569+0000 7fb6c132a700 1 --2- 172.21.15.72:0/1684053266 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fb6a006ace0 0x7fb6a006d1a0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fb6bc158990 tx=0x7fb6ac008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:33.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.573+0000 7fb6b27fc700 1 -- 172.21.15.72:0/1684053266 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fb6bc156cb0 con 0x7fb6a8003a30 2023-07-25T14:36:33.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.803+0000 7fb6c3d8f700 1 -- 172.21.15.72:0/1684053266 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb6bc156cb0 con 0x7fb6a8003a30 2023-07-25T14:36:33.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.803+0000 7fb6b27fc700 1 -- 172.21.15.72:0/1684053266 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4664 (secure 0 0 0) 0x7fb6bc156cb0 con 0x7fb6a8003a30 2023-07-25T14:36:33.815 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-25T14:36:33.815 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4220,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6836/4293785067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":4293785067},{"type":"v1","addr":"172.21.15.72:6836","nonce":4293785067}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4229,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6834/681290755","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":681290755},{"type":"v1","addr":"172.21.15.92:6834","nonce":681290755}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6837/3376375642","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6835","nonce":3376375642},{"type":"v1","addr":"172.21.15.72:6837","nonce":3376375642}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-25T14:35:39.939860+0000","modified":"2023-07-25T14:35:59.629155+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.92:6835/2045555979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6833","nonce":2045555979},{"type":"v1","addr":"172.21.15.92:6835","nonce":2045555979}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-25T14:36:33.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.805+0000 7fb6c3d8f700 1 -- 172.21.15.72:0/1684053266 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fb6a006ace0 msgr2=0x7fb6a006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:33.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.805+0000 7fb6c3d8f700 1 --2- 172.21.15.72:0/1684053266 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fb6a006ace0 0x7fb6a006d1a0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fb6bc158990 tx=0x7fb6ac008040 comp rx=0 tx=0).stop 2023-07-25T14:36:33.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.805+0000 7fb6c3d8f700 1 -- 172.21.15.72:0/1684053266 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb6a8003a30 msgr2=0x7fb6bc153320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:33.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.805+0000 7fb6c3d8f700 1 --2- 172.21.15.72:0/1684053266 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb6a8003a30 0x7fb6bc153320 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fb6b8008fd0 tx=0x7fb6b8001a00 comp rx=0 tx=0).stop 2023-07-25T14:36:33.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.805+0000 7fb6c3d8f700 1 -- 172.21.15.72:0/1684053266 shutdown_connections 2023-07-25T14:36:33.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.805+0000 7fb6c3d8f700 1 --2- 172.21.15.72:0/1684053266 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fb6a006ace0 0x7fb6a006d1a0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:33.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.805+0000 7fb6c3d8f700 1 --2- 172.21.15.72:0/1684053266 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb6bc0c0270 0x7fb6bc1ecf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:33.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.805+0000 7fb6c3d8f700 1 --2- 172.21.15.72:0/1684053266 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb6a8003a30 0x7fb6bc153320 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:33.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.805+0000 7fb6c3d8f700 1 --2- 172.21.15.72:0/1684053266 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb6bc158550 0x7fb6bc0bfd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:33.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.805+0000 7fb6c3d8f700 1 -- 172.21.15.72:0/1684053266 >> 172.21.15.72:0/1684053266 conn(0x7fb6bc0a87e0 msgr2=0x7fb6bc0c53e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:33.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.806+0000 7fb6c3d8f700 1 -- 172.21.15.72:0/1684053266 shutdown_connections 2023-07-25T14:36:33.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.806+0000 7fb6c3d8f700 1 -- 172.21.15.72:0/1684053266 wait complete. 2023-07-25T14:36:33.819 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 8 2023-07-25T14:36:33.829 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-25T14:36:33.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.940+0000 7f19475b5700 1 Processor -- start 2023-07-25T14:36:33.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.940+0000 7f19475b5700 1 -- start start 2023-07-25T14:36:33.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.941+0000 7f19475b5700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1940151ba0 0x7f19400c2230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:33.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.941+0000 7f19475b5700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f19400c5f40 0x7f1940154640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:33.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.941+0000 7f19475b5700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f19400ba0e0 0x7f1940154b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:33.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.941+0000 7f19475b5700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19400c54f0 con 0x7f1940151ba0 2023-07-25T14:36:33.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.941+0000 7f19475b5700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19400c6670 con 0x7f19400c5f40 2023-07-25T14:36:33.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.941+0000 7f19475b5700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19400c5740 con 0x7f19400ba0e0 2023-07-25T14:36:33.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.941+0000 7f1945351700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1940151ba0 0x7f19400c2230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:33.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.941+0000 7f1945351700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1940151ba0 0x7f19400c2230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41410/0 (socket says 172.21.15.72:41410) 2023-07-25T14:36:33.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.941+0000 7f1945351700 1 -- 172.21.15.72:0/2762047250 learned_addr learned my addr 172.21.15.72:0/2762047250 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:33.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.942+0000 7f1945b52700 1 --2- 172.21.15.72:0/2762047250 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f19400ba0e0 0x7f1940154b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:33.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.942+0000 7f1944b50700 1 --2- 172.21.15.72:0/2762047250 >> v2:172.21.15.92:3300/0 conn(0x7f19400c5f40 0x7f1940154640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:33.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.942+0000 7f1945351700 1 -- 172.21.15.72:0/2762047250 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f19400ba0e0 msgr2=0x7f1940154b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:33.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.942+0000 7f1945351700 1 --2- 172.21.15.72:0/2762047250 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f19400ba0e0 0x7f1940154b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:33.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.942+0000 7f1945351700 1 -- 172.21.15.72:0/2762047250 >> v2:172.21.15.92:3300/0 conn(0x7f19400c5f40 msgr2=0x7f1940154640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:33.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.942+0000 7f1945351700 1 --2- 172.21.15.72:0/2762047250 >> v2:172.21.15.92:3300/0 conn(0x7f19400c5f40 0x7f1940154640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:33.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.942+0000 7f1945351700 1 -- 172.21.15.72:0/2762047250 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19400c5a20 con 0x7f1940151ba0 2023-07-25T14:36:33.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.942+0000 7f1945351700 1 --2- 172.21.15.72:0/2762047250 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1940151ba0 0x7f19400c2230 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f19400727e0 tx=0x7f193c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d91d7b42589c17eb server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:33.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.942+0000 7f1937fff700 1 -- 172.21.15.72:0/2762047250 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f193c00b870 con 0x7f1940151ba0 2023-07-25T14:36:33.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.942+0000 7f1937fff700 1 -- 172.21.15.72:0/2762047250 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f193c00b9d0 con 0x7f1940151ba0 2023-07-25T14:36:33.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.942+0000 7f1937fff700 1 -- 172.21.15.72:0/2762047250 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f193c00bd60 con 0x7f1940151ba0 2023-07-25T14:36:33.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.942+0000 7f19475b5700 1 -- 172.21.15.72:0/2762047250 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1940151ba0 msgr2=0x7f19400c2230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:33.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.942+0000 7f19475b5700 1 --2- 172.21.15.72:0/2762047250 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1940151ba0 0x7f19400c2230 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f19400727e0 tx=0x7f193c009bd0 comp rx=0 tx=0).stop 2023-07-25T14:36:33.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.943+0000 7f19475b5700 1 -- 172.21.15.72:0/2762047250 shutdown_connections 2023-07-25T14:36:33.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.943+0000 7f19475b5700 1 --2- 172.21.15.72:0/2762047250 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f19400ba0e0 0x7f1940154b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:33.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.943+0000 7f19475b5700 1 --2- 172.21.15.72:0/2762047250 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1940151ba0 0x7f19400c2230 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:33.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.943+0000 7f19475b5700 1 --2- 172.21.15.72:0/2762047250 >> v2:172.21.15.92:3300/0 conn(0x7f19400c5f40 0x7f1940154640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:33.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.943+0000 7f19475b5700 1 -- 172.21.15.72:0/2762047250 >> 172.21.15.72:0/2762047250 conn(0x7f19400a87e0 msgr2=0x7f19400a8bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:33.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.943+0000 7f19475b5700 1 -- 172.21.15.72:0/2762047250 shutdown_connections 2023-07-25T14:36:33.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.943+0000 7f19475b5700 1 -- 172.21.15.72:0/2762047250 wait complete. 2023-07-25T14:36:33.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.944+0000 7f19475b5700 1 Processor -- start 2023-07-25T14:36:33.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.944+0000 7f19475b5700 1 -- start start 2023-07-25T14:36:33.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.944+0000 7f19475b5700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f19400ba0e0 0x7f19400bb3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:33.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.944+0000 7f19475b5700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f19400c5f40 0x7f194006f230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:33.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.944+0000 7f19475b5700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1940151ba0 0x7f19400bdb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:33.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.944+0000 7f19475b5700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19400baf30 con 0x7f1940151ba0 2023-07-25T14:36:33.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.944+0000 7f19475b5700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19400bd380 con 0x7f19400ba0e0 2023-07-25T14:36:33.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.944+0000 7f19475b5700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19400ba600 con 0x7f19400c5f40 2023-07-25T14:36:33.961 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.944+0000 7f1945b52700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1940151ba0 0x7f19400bdb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:33.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.945+0000 7f1945b52700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1940151ba0 0x7f19400bdb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41420/0 (socket says 172.21.15.72:41420) 2023-07-25T14:36:33.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.945+0000 7f1945b52700 1 -- 172.21.15.72:0/4123331088 learned_addr learned my addr 172.21.15.72:0/4123331088 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:33.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.945+0000 7f1944b50700 1 --2- 172.21.15.72:0/4123331088 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f19400c5f40 0x7f194006f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:33.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.945+0000 7f1945351700 1 --2- 172.21.15.72:0/4123331088 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f19400ba0e0 0x7f19400bb3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:33.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.945+0000 7f1945b52700 1 -- 172.21.15.72:0/4123331088 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f19400c5f40 msgr2=0x7f194006f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:33.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.945+0000 7f1945b52700 1 --2- 172.21.15.72:0/4123331088 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f19400c5f40 0x7f194006f230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:33.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.945+0000 7f1945b52700 1 -- 172.21.15.72:0/4123331088 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f19400ba0e0 msgr2=0x7f19400bb3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:33.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.945+0000 7f1945b52700 1 --2- 172.21.15.72:0/4123331088 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f19400ba0e0 0x7f19400bb3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:33.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.945+0000 7f1945b52700 1 -- 172.21.15.72:0/4123331088 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f193c009550 con 0x7f1940151ba0 2023-07-25T14:36:33.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.945+0000 7f1945351700 1 --2- 172.21.15.72:0/4123331088 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f19400ba0e0 0x7f19400bb3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-25T14:36:33.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.945+0000 7f1945b52700 1 --2- 172.21.15.72:0/4123331088 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1940151ba0 0x7f19400bdb00 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f1938007e30 tx=0x7f193800e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:33.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.945+0000 7f1935ffb700 1 -- 172.21.15.72:0/4123331088 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f193800eea0 con 0x7f1940151ba0 2023-07-25T14:36:33.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.945+0000 7f1935ffb700 1 -- 172.21.15.72:0/4123331088 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1938014420 con 0x7f1940151ba0 2023-07-25T14:36:33.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.945+0000 7f19475b5700 1 -- 172.21.15.72:0/4123331088 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19400ba8e0 con 0x7f1940151ba0 2023-07-25T14:36:33.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.945+0000 7f1935ffb700 1 -- 172.21.15.72:0/4123331088 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19380147d0 con 0x7f1940151ba0 2023-07-25T14:36:33.963 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.945+0000 7f19475b5700 1 -- 172.21.15.72:0/4123331088 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f194006f770 con 0x7f1940151ba0 2023-07-25T14:36:33.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.946+0000 7f19475b5700 1 -- 172.21.15.72:0/4123331088 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f194004e470 con 0x7f1940151ba0 2023-07-25T14:36:33.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.947+0000 7f1935ffb700 1 -- 172.21.15.72:0/4123331088 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1938014930 con 0x7f1940151ba0 2023-07-25T14:36:33.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.947+0000 7f1935ffb700 1 --2- 172.21.15.72:0/4123331088 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f192406ace0 0x7f192406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:33.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.947+0000 7f1935ffb700 1 -- 172.21.15.72:0/4123331088 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f193808a030 con 0x7f1940151ba0 2023-07-25T14:36:33.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.947+0000 7f1945351700 1 --2- 172.21.15.72:0/4123331088 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f192406ace0 0x7f192406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:33.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.947+0000 7f1945351700 1 --2- 172.21.15.72:0/4123331088 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f192406ace0 0x7f192406d1a0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f193c014040 tx=0x7f193c008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:33.965 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:33.951+0000 7f1935ffb700 1 -- 172.21.15.72:0/4123331088 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f1938058840 con 0x7f1940151ba0 2023-07-25T14:36:34.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.137+0000 7f19475b5700 1 -- 172.21.15.72:0/4123331088 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f19400bb070 con 0x7f1940151ba0 2023-07-25T14:36:34.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.138+0000 7f1935ffb700 1 -- 172.21.15.72:0/4123331088 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+20109 (secure 0 0 0) 0x7f19380583d0 con 0x7f1940151ba0 2023-07-25T14:36:34.150 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-25T14:36:34.150 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":27,"fsid":"9170db48-9170-43e8-8ccb-9813e6240906","created":"2023-07-25T14:35:21.733262+0000","modified":"2023-07-25T14:36:28.782640+0000","last_up_change":"2023-07-25T14:35:31.355010+0000","last_in_change":"2023-07-25T14:35:24.195785+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-25T14:35:32.983457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-25T14:35:33.326342+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-25T14:35:37.534158+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-25T14:35:38.891571+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-25T14:35:42.596923+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d517fdad-0bfe-49f0-89f2-9421c3761839","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6801","nonce":2475407414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6803","nonce":2475407414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6807","nonce":2475407414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6805","nonce":2475407414}]},"public_addr":"172.21.15.72:6801/2475407414","cluster_addr":"172.21.15.72:6803/2475407414","heartbeat_back_addr":"172.21.15.72:6807/2475407414","heartbeat_front_addr":"172.21.15.72:6805/2475407414","state":["exists","up"]},{"osd":1,"uuid":"e1564be3-f209-47e5-a8d0-32fc618a474f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6822","nonce":870954016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6825","nonce":870954016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6831","nonce":870954016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6827","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6829","nonce":870954016}]},"public_addr":"172.21.15.72:6822/870954016","cluster_addr":"172.21.15.72:6825/870954016","heartbeat_back_addr":"172.21.15.72:6831/870954016","heartbeat_front_addr":"172.21.15.72:6829/870954016","state":["exists","up"]},{"osd":2,"uuid":"c4647d30-ffa6-417a-9026-ef530c75910e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6809","nonce":2143129442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6811","nonce":2143129442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6815","nonce":2143129442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6813","nonce":2143129442}]},"public_addr":"172.21.15.72:6809/2143129442","cluster_addr":"172.21.15.72:6811/2143129442","heartbeat_back_addr":"172.21.15.72:6815/2143129442","heartbeat_front_addr":"172.21.15.72:6813/2143129442","state":["exists","up"]},{"osd":3,"uuid":"76c9d9a7-c2e2-4612-a58b-d6882dd76b58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6817","nonce":3404066311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6819","nonce":3404066311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6828","nonce":3404066311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6821","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6823","nonce":3404066311}]},"public_addr":"172.21.15.72:6817/3404066311","cluster_addr":"172.21.15.72:6819/3404066311","heartbeat_back_addr":"172.21.15.72:6828/3404066311","heartbeat_front_addr":"172.21.15.72:6823/3404066311","state":["exists","up"]},{"osd":4,"uuid":"7f8920dc-0ad4-4a73-ab40-65408f83eadd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6817","nonce":2381008739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6819","nonce":2381008739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6825","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6827","nonce":2381008739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6822","nonce":2381008739}]},"public_addr":"172.21.15.92:6817/2381008739","cluster_addr":"172.21.15.92:6819/2381008739","heartbeat_back_addr":"172.21.15.92:6827/2381008739","heartbeat_front_addr":"172.21.15.92:6822/2381008739","state":["exists","up"]},{"osd":5,"uuid":"56257e7c-31eb-44c5-9ec7-1318a4e0bb35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6801","nonce":2161935604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6803","nonce":2161935604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6807","nonce":2161935604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6805","nonce":2161935604}]},"public_addr":"172.21.15.92:6801/2161935604","cluster_addr":"172.21.15.92:6803/2161935604","heartbeat_back_addr":"172.21.15.92:6807/2161935604","heartbeat_front_addr":"172.21.15.92:6805/2161935604","state":["exists","up"]},{"osd":6,"uuid":"a150d3d8-a0c9-4955-968a-8d98eff4ffb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6809","nonce":3770163493}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6811","nonce":3770163493}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6815","nonce":3770163493}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6813","nonce":3770163493}]},"public_addr":"172.21.15.92:6809/3770163493","cluster_addr":"172.21.15.92:6811/3770163493","heartbeat_back_addr":"172.21.15.92:6815/3770163493","heartbeat_front_addr":"172.21.15.92:6813/3770163493","state":["exists","up"]},{"osd":7,"uuid":"07799c27-54ee-4591-a42d-a978d6b32065","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6821","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6823","nonce":2135777609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6826","nonce":2135777609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6831","nonce":2135777609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6829","nonce":2135777609}]},"public_addr":"172.21.15.92:6823/2135777609","cluster_addr":"172.21.15.92:6826/2135777609","heartbeat_back_addr":"172.21.15.92:6831/2135777609","heartbeat_front_addr":"172.21.15.92:6829/2135777609","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.345365+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.378150+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.146566+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.372172+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:30.398421+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.385632+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.465611+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.443583+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.b","mappings":[{"from":1,"to":2}]},{"pgid":"4.3f","mappings":[{"from":3,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-25T14:36:34.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.140+0000 7f19475b5700 1 -- 172.21.15.72:0/4123331088 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f192406ace0 msgr2=0x7f192406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:34.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.140+0000 7f19475b5700 1 --2- 172.21.15.72:0/4123331088 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f192406ace0 0x7f192406d1a0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f193c014040 tx=0x7f193c008030 comp rx=0 tx=0).stop 2023-07-25T14:36:34.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.140+0000 7f19475b5700 1 -- 172.21.15.72:0/4123331088 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1940151ba0 msgr2=0x7f19400bdb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:34.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.140+0000 7f19475b5700 1 --2- 172.21.15.72:0/4123331088 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1940151ba0 0x7f19400bdb00 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f1938007e30 tx=0x7f193800e3c0 comp rx=0 tx=0).stop 2023-07-25T14:36:34.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.140+0000 7f19475b5700 1 -- 172.21.15.72:0/4123331088 shutdown_connections 2023-07-25T14:36:34.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.140+0000 7f19475b5700 1 --2- 172.21.15.72:0/4123331088 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f192406ace0 0x7f192406d1a0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:34.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.140+0000 7f19475b5700 1 --2- 172.21.15.72:0/4123331088 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1940151ba0 0x7f19400bdb00 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:34.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.140+0000 7f19475b5700 1 --2- 172.21.15.72:0/4123331088 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f19400ba0e0 0x7f19400bb3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:34.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.140+0000 7f19475b5700 1 --2- 172.21.15.72:0/4123331088 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f19400c5f40 0x7f194006f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:34.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.140+0000 7f19475b5700 1 -- 172.21.15.72:0/4123331088 >> 172.21.15.72:0/4123331088 conn(0x7f19400a87e0 msgr2=0x7f19400ab8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:34.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.140+0000 7f19475b5700 1 -- 172.21.15.72:0/4123331088 shutdown_connections 2023-07-25T14:36:34.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.140+0000 7f19475b5700 1 -- 172.21.15.72:0/4123331088 wait complete. 2023-07-25T14:36:34.164 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-07-25T14:35:32.983457+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-07-25T14:35:33.326342+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-25T14:35:37.534158+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-25T14:35:38.891571+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-07-25T14:35:42.596923+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-25T14:36:34.166 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-25T14:36:34.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.278+0000 7f883a062700 1 Processor -- start 2023-07-25T14:36:34.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.278+0000 7f883a062700 1 -- start start 2023-07-25T14:36:34.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.278+0000 7f883a062700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f88340bead0 0x7f88340c0350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:34.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.278+0000 7f883a062700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88340bfeb0 con 0x7f88340c0890 2023-07-25T14:36:34.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.278+0000 7f883a062700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88340bf2e0 con 0x7f8834151a90 2023-07-25T14:36:34.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.278+0000 7f883a062700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88340c10b0 con 0x7f88340bead0 2023-07-25T14:36:34.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.279+0000 7f8832ffd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f88340bead0 0x7f88340c0350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:34.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.279+0000 7f8832ffd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f88340bead0 0x7f88340c0350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41428/0 (socket says 172.21.15.72:41428) 2023-07-25T14:36:34.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.279+0000 7f8832ffd700 1 -- 172.21.15.72:0/3245757609 learned_addr learned my addr 172.21.15.72:0/3245757609 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:34.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.279+0000 7f8832ffd700 1 -- 172.21.15.72:0/3245757609 >> v1:172.21.15.92:6789/0 conn(0x7f8834151a90 legacy=0x7f8834154d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:34.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.279+0000 7f8832ffd700 1 -- 172.21.15.72:0/3245757609 >> v1:172.21.15.72:6789/0 conn(0x7f88340c0890 legacy=0x7f88340c44d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:34.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.279+0000 7f88327fc700 1 -- 172.21.15.72:0/3245757609 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2739684319 0 0) 0x7f88340bfeb0 con 0x7f88340c0890 2023-07-25T14:36:34.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.279+0000 7f8832ffd700 1 -- 172.21.15.72:0/3245757609 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88340bf580 con 0x7f88340bead0 2023-07-25T14:36:34.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.279+0000 7f8832ffd700 1 --2- 172.21.15.72:0/3245757609 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f88340bead0 0x7f88340c0350 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f88280098f0 tx=0x7f8828009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6acae2c1b0b04638 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:34.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.279+0000 7f88327fc700 1 -- 172.21.15.72:0/3245757609 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8828004230 con 0x7f88340bead0 2023-07-25T14:36:34.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.279+0000 7f88327fc700 1 -- 172.21.15.72:0/3245757609 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8828004390 con 0x7f88340bead0 2023-07-25T14:36:34.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.279+0000 7f88327fc700 1 -- 172.21.15.72:0/3245757609 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88280036a0 con 0x7f88340bead0 2023-07-25T14:36:34.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.280+0000 7f883a062700 1 -- 172.21.15.72:0/3245757609 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f88340bead0 msgr2=0x7f88340c0350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:34.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.280+0000 7f883a062700 1 --2- 172.21.15.72:0/3245757609 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f88340bead0 0x7f88340c0350 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f88280098f0 tx=0x7f8828009c00 comp rx=0 tx=0).stop 2023-07-25T14:36:34.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.280+0000 7f883a062700 1 -- 172.21.15.72:0/3245757609 shutdown_connections 2023-07-25T14:36:34.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.280+0000 7f883a062700 1 --2- 172.21.15.72:0/3245757609 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f88340bead0 0x7f88340c0350 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:34.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.280+0000 7f883a062700 1 -- 172.21.15.72:0/3245757609 >> 172.21.15.72:0/3245757609 conn(0x7f883406c3a0 msgr2=0x7f883406c780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:34.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.280+0000 7f883a062700 1 -- 172.21.15.72:0/3245757609 shutdown_connections 2023-07-25T14:36:34.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.280+0000 7f883a062700 1 -- 172.21.15.72:0/3245757609 wait complete. 2023-07-25T14:36:34.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.281+0000 7f883a062700 1 Processor -- start 2023-07-25T14:36:34.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.281+0000 7f883a062700 1 -- start start 2023-07-25T14:36:34.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.282+0000 7f883a062700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f88340bead0 0x7f88340c9ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:34.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.282+0000 7f883a062700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f88340c0890 0x7f8834147580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:34.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.282+0000 7f883a062700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8834151a90 0x7f8834147ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:34.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.282+0000 7f883a062700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8834150550 con 0x7f8834151a90 2023-07-25T14:36:34.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.282+0000 7f883a062700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88341edb20 con 0x7f88340c0890 2023-07-25T14:36:34.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.282+0000 7f883a062700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88341ecc30 con 0x7f88340bead0 2023-07-25T14:36:34.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.282+0000 7f8833fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8834151a90 0x7f8834147ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:34.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.282+0000 7f8833fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8834151a90 0x7f8834147ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41434/0 (socket says 172.21.15.72:41434) 2023-07-25T14:36:34.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.282+0000 7f8833fff700 1 -- 172.21.15.72:0/819895827 learned_addr learned my addr 172.21.15.72:0/819895827 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:34.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.283+0000 7f88337fe700 1 --2- 172.21.15.72:0/819895827 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f88340bead0 0x7f88340c9ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:34.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.283+0000 7f8832ffd700 1 --2- 172.21.15.72:0/819895827 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f88340c0890 0x7f8834147580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:34.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.283+0000 7f8833fff700 1 -- 172.21.15.72:0/819895827 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f88340bead0 msgr2=0x7f88340c9ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:34.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.283+0000 7f8833fff700 1 --2- 172.21.15.72:0/819895827 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f88340bead0 0x7f88340c9ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:34.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.283+0000 7f8833fff700 1 -- 172.21.15.72:0/819895827 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f88340c0890 msgr2=0x7f8834147580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:34.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.283+0000 7f8833fff700 1 --2- 172.21.15.72:0/819895827 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f88340c0890 0x7f8834147580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:34.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.283+0000 7f8833fff700 1 -- 172.21.15.72:0/819895827 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8828009550 con 0x7f8834151a90 2023-07-25T14:36:34.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.283+0000 7f8833fff700 1 --2- 172.21.15.72:0/819895827 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8834151a90 0x7f8834147ac0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f882c00c810 tx=0x7f882c00cb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:34.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.283+0000 7f881bfff700 1 -- 172.21.15.72:0/819895827 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f882c003e30 con 0x7f8834151a90 2023-07-25T14:36:34.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.283+0000 7f881bfff700 1 -- 172.21.15.72:0/819895827 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f882c005070 con 0x7f8834151a90 2023-07-25T14:36:34.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.283+0000 7f883a062700 1 -- 172.21.15.72:0/819895827 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88341ecf10 con 0x7f8834151a90 2023-07-25T14:36:34.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.283+0000 7f881bfff700 1 -- 172.21.15.72:0/819895827 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f882c005420 con 0x7f8834151a90 2023-07-25T14:36:34.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.283+0000 7f883a062700 1 -- 172.21.15.72:0/819895827 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88341ed4d0 con 0x7f8834151a90 2023-07-25T14:36:34.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.284+0000 7f883a062700 1 -- 172.21.15.72:0/819895827 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f883404e470 con 0x7f8834151a90 2023-07-25T14:36:34.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.284+0000 7f881bfff700 1 -- 172.21.15.72:0/819895827 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f882c005580 con 0x7f8834151a90 2023-07-25T14:36:34.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.285+0000 7f881bfff700 1 --2- 172.21.15.72:0/819895827 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f882006ace0 0x7f882006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:34.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.285+0000 7f881bfff700 1 -- 172.21.15.72:0/819895827 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f882c0893a0 con 0x7f8834151a90 2023-07-25T14:36:34.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.285+0000 7f88337fe700 1 --2- 172.21.15.72:0/819895827 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f882006ace0 0x7f882006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:34.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.285+0000 7f88337fe700 1 --2- 172.21.15.72:0/819895827 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f882006ace0 0x7f882006d1a0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f8824009960 tx=0x7f88240090e0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:34.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.289+0000 7f881bfff700 1 -- 172.21.15.72:0/819895827 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f882c054130 con 0x7f8834151a90 2023-07-25T14:36:34.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.476+0000 7f883a062700 1 -- 172.21.15.72:0/819895827 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f88340c6270 con 0x7f8834151a90 2023-07-25T14:36:34.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.477+0000 7f881bfff700 1 -- 172.21.15.72:0/819895827 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v27) v1 ==== 92+0+10 (secure 0 0 0) 0x7f882c057750 con 0x7f8834151a90 2023-07-25T14:36:34.488 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 8 2023-07-25T14:36:34.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.479+0000 7f883a062700 1 -- 172.21.15.72:0/819895827 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f882006ace0 msgr2=0x7f882006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:34.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.479+0000 7f883a062700 1 --2- 172.21.15.72:0/819895827 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f882006ace0 0x7f882006d1a0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f8824009960 tx=0x7f88240090e0 comp rx=0 tx=0).stop 2023-07-25T14:36:34.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.479+0000 7f883a062700 1 -- 172.21.15.72:0/819895827 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8834151a90 msgr2=0x7f8834147ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:34.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.479+0000 7f883a062700 1 --2- 172.21.15.72:0/819895827 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8834151a90 0x7f8834147ac0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f882c00c810 tx=0x7f882c00cb20 comp rx=0 tx=0).stop 2023-07-25T14:36:34.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.479+0000 7f883a062700 1 -- 172.21.15.72:0/819895827 shutdown_connections 2023-07-25T14:36:34.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.479+0000 7f883a062700 1 --2- 172.21.15.72:0/819895827 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f882006ace0 0x7f882006d1a0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:34.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.479+0000 7f883a062700 1 --2- 172.21.15.72:0/819895827 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f88340bead0 0x7f88340c9ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:34.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.479+0000 7f883a062700 1 --2- 172.21.15.72:0/819895827 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8834151a90 0x7f8834147ac0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:34.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.479+0000 7f883a062700 1 --2- 172.21.15.72:0/819895827 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f88340c0890 0x7f8834147580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:34.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.479+0000 7f883a062700 1 -- 172.21.15.72:0/819895827 >> 172.21.15.72:0/819895827 conn(0x7f883406c3a0 msgr2=0x7f883406c780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:34.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.479+0000 7f883a062700 1 -- 172.21.15.72:0/819895827 shutdown_connections 2023-07-25T14:36:34.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.479+0000 7f883a062700 1 -- 172.21.15.72:0/819895827 wait complete. 2023-07-25T14:36:34.502 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-25T14:36:34.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.613+0000 7f4d71f6d700 1 Processor -- start 2023-07-25T14:36:34.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.614+0000 7f4d71f6d700 1 -- start start 2023-07-25T14:36:34.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.614+0000 7f4d71f6d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f4d6c151950 0x7f4d6c06a190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:34.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.614+0000 7f4d71f6d700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d6c0c2fe0 con 0x7f4d6c06a6d0 2023-07-25T14:36:34.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.614+0000 7f4d71f6d700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d6c155070 con 0x7f4d6c0724c0 2023-07-25T14:36:34.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.614+0000 7f4d71f6d700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d6c071a60 con 0x7f4d6c151950 2023-07-25T14:36:34.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.614+0000 7f4d6b7fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f4d6c151950 0x7f4d6c06a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:34.626 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.614+0000 7f4d6b7fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f4d6c151950 0x7f4d6c06a190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41438/0 (socket says 172.21.15.72:41438) 2023-07-25T14:36:34.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.614+0000 7f4d6bfff700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f4d6c06a6d0 0x7f4d6c0c3bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:60410/0 (socket says 172.21.15.72:60410) 2023-07-25T14:36:34.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.614+0000 7f4d6b7fe700 1 -- 172.21.15.72:0/2752513999 learned_addr learned my addr 172.21.15.72:0/2752513999 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:34.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.615+0000 7f4d6b7fe700 1 -- 172.21.15.72:0/2752513999 >> v1:172.21.15.92:6789/0 conn(0x7f4d6c0724c0 legacy=0x7f4d6c0c34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:34.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.615+0000 7f4d6b7fe700 1 -- 172.21.15.72:0/2752513999 >> v1:172.21.15.72:6789/0 conn(0x7f4d6c06a6d0 legacy=0x7f4d6c0c3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:34.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.615+0000 7f4d6b7fe700 1 -- 172.21.15.72:0/2752513999 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d6c0c15c0 con 0x7f4d6c151950 2023-07-25T14:36:34.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.615+0000 7f4d6b7fe700 1 --2- 172.21.15.72:0/2752513999 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4d6c151950 0x7f4d6c06a190 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f4d5c0098f0 tx=0x7f4d5c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a561aff44b496f5c server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:34.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.615+0000 7f4d6affd700 1 -- 172.21.15.72:0/2752513999 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d5c00b8a0 con 0x7f4d6c151950 2023-07-25T14:36:34.627 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.615+0000 7f4d6affd700 1 -- 172.21.15.72:0/2752513999 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d5c00ba00 con 0x7f4d6c151950 2023-07-25T14:36:34.628 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.615+0000 7f4d6affd700 1 -- 172.21.15.72:0/2752513999 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d5c00bd90 con 0x7f4d6c151950 2023-07-25T14:36:34.629 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.616+0000 7f4d71f6d700 1 -- 172.21.15.72:0/2752513999 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4d6c151950 msgr2=0x7f4d6c06a190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:34.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.616+0000 7f4d71f6d700 1 --2- 172.21.15.72:0/2752513999 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4d6c151950 0x7f4d6c06a190 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f4d5c0098f0 tx=0x7f4d5c009c00 comp rx=0 tx=0).stop 2023-07-25T14:36:34.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.616+0000 7f4d71f6d700 1 -- 172.21.15.72:0/2752513999 shutdown_connections 2023-07-25T14:36:34.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.616+0000 7f4d71f6d700 1 --2- 172.21.15.72:0/2752513999 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4d6c151950 0x7f4d6c06a190 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:34.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.616+0000 7f4d71f6d700 1 -- 172.21.15.72:0/2752513999 >> 172.21.15.72:0/2752513999 conn(0x7f4d6c0a87e0 msgr2=0x7f4d6c0a8bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:34.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.616+0000 7f4d71f6d700 1 -- 172.21.15.72:0/2752513999 shutdown_connections 2023-07-25T14:36:34.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.616+0000 7f4d71f6d700 1 -- 172.21.15.72:0/2752513999 wait complete. 2023-07-25T14:36:34.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.617+0000 7f4d71f6d700 1 Processor -- start 2023-07-25T14:36:34.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.617+0000 7f4d71f6d700 1 -- start start 2023-07-25T14:36:34.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.618+0000 7f4d71f6d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4d6c06a6d0 0x7f4d6c0c71d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:34.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.618+0000 7f4d71f6d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4d6c0724c0 0x7f4d6c150400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:34.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.618+0000 7f4d71f6d700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4d6c151950 0x7f4d6c0a96c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:34.631 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.618+0000 7f4d71f6d700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d6c0ab9f0 con 0x7f4d6c06a6d0 2023-07-25T14:36:34.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.618+0000 7f4d71f6d700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d6c0c77b0 con 0x7f4d6c0724c0 2023-07-25T14:36:34.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.618+0000 7f4d71f6d700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d6c0c5580 con 0x7f4d6c151950 2023-07-25T14:36:34.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.618+0000 7f4d6b7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4d6c06a6d0 0x7f4d6c0c71d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:34.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.618+0000 7f4d6b7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4d6c06a6d0 0x7f4d6c0c71d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41444/0 (socket says 172.21.15.72:41444) 2023-07-25T14:36:34.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.618+0000 7f4d6b7fe700 1 -- 172.21.15.72:0/2133461663 learned_addr learned my addr 172.21.15.72:0/2133461663 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:34.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.618+0000 7f4d6b7fe700 1 -- 172.21.15.72:0/2133461663 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4d6c151950 msgr2=0x7f4d6c0a96c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:34.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.618+0000 7f4d6b7fe700 1 --2- 172.21.15.72:0/2133461663 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4d6c151950 0x7f4d6c0a96c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:34.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.618+0000 7f4d6b7fe700 1 -- 172.21.15.72:0/2133461663 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4d6c0724c0 msgr2=0x7f4d6c150400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:34.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.618+0000 7f4d6b7fe700 1 --2- 172.21.15.72:0/2133461663 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4d6c0724c0 0x7f4d6c150400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:34.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.618+0000 7f4d6b7fe700 1 -- 172.21.15.72:0/2133461663 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d5c009550 con 0x7f4d6c06a6d0 2023-07-25T14:36:34.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.618+0000 7f4d6b7fe700 1 --2- 172.21.15.72:0/2133461663 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4d6c06a6d0 0x7f4d6c0c71d0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f4d5c014040 tx=0x7f4d5c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:34.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.618+0000 7f4d68ff9700 1 -- 172.21.15.72:0/2133461663 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d5c0036a0 con 0x7f4d6c06a6d0 2023-07-25T14:36:34.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.618+0000 7f4d68ff9700 1 -- 172.21.15.72:0/2133461663 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d5c01e070 con 0x7f4d6c06a6d0 2023-07-25T14:36:34.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.618+0000 7f4d71f6d700 1 -- 172.21.15.72:0/2133461663 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d6c0c5820 con 0x7f4d6c06a6d0 2023-07-25T14:36:34.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.618+0000 7f4d68ff9700 1 -- 172.21.15.72:0/2133461663 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d5c003a60 con 0x7f4d6c06a6d0 2023-07-25T14:36:34.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.618+0000 7f4d71f6d700 1 -- 172.21.15.72:0/2133461663 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d6c0c5de0 con 0x7f4d6c06a6d0 2023-07-25T14:36:34.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.619+0000 7f4d71f6d700 1 -- 172.21.15.72:0/2133461663 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d6c0c78f0 con 0x7f4d6c06a6d0 2023-07-25T14:36:34.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.620+0000 7f4d68ff9700 1 -- 172.21.15.72:0/2133461663 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4d5c003bc0 con 0x7f4d6c06a6d0 2023-07-25T14:36:34.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.620+0000 7f4d68ff9700 1 --2- 172.21.15.72:0/2133461663 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f4d4c06ace0 0x7f4d4c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:34.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.620+0000 7f4d68ff9700 1 -- 172.21.15.72:0/2133461663 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f4d5c020070 con 0x7f4d6c06a6d0 2023-07-25T14:36:34.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.620+0000 7f4d62ffd700 1 --2- 172.21.15.72:0/2133461663 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f4d4c06ace0 0x7f4d4c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:34.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.620+0000 7f4d62ffd700 1 --2- 172.21.15.72:0/2133461663 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f4d4c06ace0 0x7f4d4c06d1a0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f4d54000f60 tx=0x7f4d54007a40 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:34.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.624+0000 7f4d68ff9700 1 -- 172.21.15.72:0/2133461663 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f4d5c055c50 con 0x7f4d6c06a6d0 2023-07-25T14:36:34.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.813+0000 7f4d71f6d700 1 -- 172.21.15.72:0/2133461663 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4d6c154cd0 con 0x7f4d6c06a6d0 2023-07-25T14:36:34.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.814+0000 7f4d68ff9700 1 -- 172.21.15.72:0/2133461663 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4d5c0150a0 con 0x7f4d6c06a6d0 2023-07-25T14:36:34.825 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 1 2023-07-25T14:36:34.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.816+0000 7f4d71f6d700 1 -- 172.21.15.72:0/2133461663 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f4d4c06ace0 msgr2=0x7f4d4c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:34.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.816+0000 7f4d71f6d700 1 --2- 172.21.15.72:0/2133461663 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f4d4c06ace0 0x7f4d4c06d1a0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f4d54000f60 tx=0x7f4d54007a40 comp rx=0 tx=0).stop 2023-07-25T14:36:34.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.816+0000 7f4d71f6d700 1 -- 172.21.15.72:0/2133461663 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4d6c06a6d0 msgr2=0x7f4d6c0c71d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:34.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.816+0000 7f4d71f6d700 1 --2- 172.21.15.72:0/2133461663 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4d6c06a6d0 0x7f4d6c0c71d0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f4d5c014040 tx=0x7f4d5c004750 comp rx=0 tx=0).stop 2023-07-25T14:36:34.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.816+0000 7f4d71f6d700 1 -- 172.21.15.72:0/2133461663 shutdown_connections 2023-07-25T14:36:34.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.816+0000 7f4d71f6d700 1 --2- 172.21.15.72:0/2133461663 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f4d4c06ace0 0x7f4d4c06d1a0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:34.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.816+0000 7f4d71f6d700 1 --2- 172.21.15.72:0/2133461663 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4d6c151950 0x7f4d6c0a96c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:34.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.816+0000 7f4d71f6d700 1 --2- 172.21.15.72:0/2133461663 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4d6c06a6d0 0x7f4d6c0c71d0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:34.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.816+0000 7f4d71f6d700 1 --2- 172.21.15.72:0/2133461663 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4d6c0724c0 0x7f4d6c150400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:34.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.816+0000 7f4d71f6d700 1 -- 172.21.15.72:0/2133461663 >> 172.21.15.72:0/2133461663 conn(0x7f4d6c0a87e0 msgr2=0x7f4d6c152950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:34.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.816+0000 7f4d71f6d700 1 -- 172.21.15.72:0/2133461663 shutdown_connections 2023-07-25T14:36:34.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.816+0000 7f4d71f6d700 1 -- 172.21.15.72:0/2133461663 wait complete. 2023-07-25T14:36:34.839 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-25T14:36:34.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.951+0000 7f8bb2cf0700 1 Processor -- start 2023-07-25T14:36:34.962 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.951+0000 7f8bb2cf0700 1 -- start start 2023-07-25T14:36:34.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.951+0000 7f8bb2cf0700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8bac072300 0x7f8bac06a190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:34.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.951+0000 7f8bb2cf0700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f8bac0a86c0 0x7f8bac0c0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:34.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.951+0000 7f8bb2cf0700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bac0a8230 con 0x7f8bac14dea0 2023-07-25T14:36:34.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.951+0000 7f8bb2cf0700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bac0c18d0 con 0x7f8bac0a86c0 2023-07-25T14:36:34.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.951+0000 7f8bb2cf0700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bac06ea10 con 0x7f8bac072300 2023-07-25T14:36:34.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.952+0000 7f8bb0a8c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f8bac14dea0 0x7f8bac151200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:60420/0 (socket says 172.21.15.72:60420) 2023-07-25T14:36:34.970 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.952+0000 7f8bb0a8c700 1 -- 172.21.15.72:0/947142495 learned_addr learned my addr 172.21.15.72:0/947142495 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:36:34.970 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.952+0000 7f8babfff700 1 --2- 172.21.15.72:0/947142495 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8bac072300 0x7f8bac06a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:34.970 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.952+0000 7f8bb128d700 1 --2- 172.21.15.72:0/947142495 >> v2:172.21.15.92:3300/0 conn(0x7f8bac0a86c0 0x7f8bac0c0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:34.970 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.952+0000 7f8bab7fe700 1 -- 172.21.15.72:0/947142495 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 556046451 0 0) 0x7f8bac0a8230 con 0x7f8bac14dea0 2023-07-25T14:36:34.970 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.952+0000 7f8bab7fe700 1 -- 172.21.15.72:0/947142495 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8b9c0035b0 con 0x7f8bac14dea0 2023-07-25T14:36:34.970 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.952+0000 7f8bab7fe700 1 -- 172.21.15.72:0/947142495 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 507281688 0 0) 0x7f8b9c0035b0 con 0x7f8bac14dea0 2023-07-25T14:36:34.970 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.952+0000 7f8bab7fe700 1 -- 172.21.15.72:0/947142495 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8bac072300 msgr2=0x7f8bac06a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:34.971 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.952+0000 7f8bab7fe700 1 --2- 172.21.15.72:0/947142495 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8bac072300 0x7f8bac06a190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:34.971 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.952+0000 7f8bab7fe700 1 -- 172.21.15.72:0/947142495 >> v2:172.21.15.92:3300/0 conn(0x7f8bac0a86c0 msgr2=0x7f8bac0c0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:34.971 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.952+0000 7f8bab7fe700 1 --2- 172.21.15.72:0/947142495 >> v2:172.21.15.92:3300/0 conn(0x7f8bac0a86c0 0x7f8bac0c0bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:34.971 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.952+0000 7f8bab7fe700 1 -- 172.21.15.72:0/947142495 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bac0a7c20 con 0x7f8bac14dea0 2023-07-25T14:36:34.972 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.952+0000 7f8bab7fe700 1 -- 172.21.15.72:0/947142495 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2559588315 0 0) 0x7f8ba0001670 con 0x7f8bac14dea0 2023-07-25T14:36:34.972 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.952+0000 7f8bab7fe700 1 -- 172.21.15.72:0/947142495 >> v1:172.21.15.72:6789/0 conn(0x7f8bac14dea0 legacy=0x7f8bac151200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:34.972 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.952+0000 7f8bab7fe700 1 --2- 172.21.15.72:0/947142495 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8b9c003a00 0x7f8b9c003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:34.973 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.952+0000 7f8bab7fe700 1 --2- 172.21.15.72:0/947142495 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8b9c004850 0x7f8b9c004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:34.973 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.952+0000 7f8bab7fe700 1 --2- 172.21.15.72:0/947142495 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8bac072300 0x7f8b9c005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:34.973 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.952+0000 7f8bab7fe700 1 -- 172.21.15.72:0/947142495 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bac0c18d0 con 0x7f8b9c003a00 2023-07-25T14:36:34.974 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.952+0000 7f8bab7fe700 1 -- 172.21.15.72:0/947142495 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bac06ea10 con 0x7f8b9c004850 2023-07-25T14:36:34.974 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.952+0000 7f8bab7fe700 1 -- 172.21.15.72:0/947142495 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b9c00ba90 con 0x7f8bac072300 2023-07-25T14:36:34.974 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.952+0000 7f8bb0a8c700 1 --2- 172.21.15.72:0/947142495 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8b9c003a00 0x7f8b9c003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:34.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.952+0000 7f8bb128d700 1 --2- 172.21.15.72:0/947142495 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8bac072300 0x7f8b9c005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:34.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.952+0000 7f8babfff700 1 --2- 172.21.15.72:0/947142495 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8b9c004850 0x7f8b9c004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:34.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.953+0000 7f8bb0a8c700 1 -- 172.21.15.72:0/947142495 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8bac072300 msgr2=0x7f8b9c005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:34.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.953+0000 7f8bb0a8c700 1 --2- 172.21.15.72:0/947142495 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8bac072300 0x7f8b9c005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:34.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.953+0000 7f8bb0a8c700 1 -- 172.21.15.72:0/947142495 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8b9c004850 msgr2=0x7f8b9c004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:34.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.953+0000 7f8bb0a8c700 1 --2- 172.21.15.72:0/947142495 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8b9c004850 0x7f8b9c004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:34.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.953+0000 7f8bb0a8c700 1 -- 172.21.15.72:0/947142495 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b9c0035b0 con 0x7f8b9c003a00 2023-07-25T14:36:34.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.953+0000 7f8bb0a8c700 1 --2- 172.21.15.72:0/947142495 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8b9c003a00 0x7f8b9c003e20 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f8ba000c370 tx=0x7f8b9c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa49d5760195d1f9 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:34.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.953+0000 7f8bab7fe700 1 -- 172.21.15.72:0/947142495 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ba0007c60 con 0x7f8b9c003a00 2023-07-25T14:36:34.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.953+0000 7f8bab7fe700 1 -- 172.21.15.72:0/947142495 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ba0005960 con 0x7f8b9c003a00 2023-07-25T14:36:34.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.953+0000 7f8bab7fe700 1 -- 172.21.15.72:0/947142495 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ba0005d10 con 0x7f8b9c003a00 2023-07-25T14:36:34.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.953+0000 7f8bb2cf0700 1 -- 172.21.15.72:0/947142495 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8b9c003a00 msgr2=0x7f8b9c003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:34.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.953+0000 7f8bb2cf0700 1 --2- 172.21.15.72:0/947142495 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8b9c003a00 0x7f8b9c003e20 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f8ba000c370 tx=0x7f8b9c005880 comp rx=0 tx=0).stop 2023-07-25T14:36:34.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.953+0000 7f8bb128d700 1 -- 172.21.15.72:0/947142495 reap_dead start 2023-07-25T14:36:34.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.953+0000 7f8bb2cf0700 1 -- 172.21.15.72:0/947142495 shutdown_connections 2023-07-25T14:36:34.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.953+0000 7f8bb2cf0700 1 -- 172.21.15.72:0/947142495 >> 172.21.15.72:0/947142495 conn(0x7f8bac06def0 msgr2=0x7f8bac06e300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:34.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.953+0000 7f8bb2cf0700 1 -- 172.21.15.72:0/947142495 shutdown_connections 2023-07-25T14:36:34.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.953+0000 7f8bb2cf0700 1 -- 172.21.15.72:0/947142495 wait complete. 2023-07-25T14:36:34.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.954+0000 7f8bb2cf0700 1 Processor -- start 2023-07-25T14:36:34.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.955+0000 7f8bb2cf0700 1 -- start start 2023-07-25T14:36:34.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.955+0000 7f8bb2cf0700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8b9c003a00 0x7f8bac0c5330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:34.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.955+0000 7f8bb2cf0700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8bac0abfb0 0x7f8bac0c0d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:34.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.955+0000 7f8bb2cf0700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8bac1e97e0 0x7f8bac0a9770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:34.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.955+0000 7f8bb2cf0700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bac0c4ea0 con 0x7f8b9c003a00 2023-07-25T14:36:34.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.955+0000 7f8bb2cf0700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bac0c4040 con 0x7f8bac1e97e0 2023-07-25T14:36:34.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.955+0000 7f8bb2cf0700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bac0c4290 con 0x7f8bac0abfb0 2023-07-25T14:36:34.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.955+0000 7f8bb0a8c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8b9c003a00 0x7f8bac0c5330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:34.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.955+0000 7f8bb0a8c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8b9c003a00 0x7f8bac0c5330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41464/0 (socket says 172.21.15.72:41464) 2023-07-25T14:36:34.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.955+0000 7f8bb0a8c700 1 -- 172.21.15.72:0/3073660757 learned_addr learned my addr 172.21.15.72:0/3073660757 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:34.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.956+0000 7f8babfff700 1 --2- 172.21.15.72:0/3073660757 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8bac0abfb0 0x7f8bac0c0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:34.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.956+0000 7f8bb128d700 1 --2- 172.21.15.72:0/3073660757 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8bac1e97e0 0x7f8bac0a9770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:34.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.956+0000 7f8bb0a8c700 1 -- 172.21.15.72:0/3073660757 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8bac0abfb0 msgr2=0x7f8bac0c0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:34.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.956+0000 7f8bb0a8c700 1 --2- 172.21.15.72:0/3073660757 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8bac0abfb0 0x7f8bac0c0d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:34.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.956+0000 7f8bb0a8c700 1 -- 172.21.15.72:0/3073660757 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8bac1e97e0 msgr2=0x7f8bac0a9770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:34.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.956+0000 7f8bb0a8c700 1 --2- 172.21.15.72:0/3073660757 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8bac1e97e0 0x7f8bac0a9770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:34.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.956+0000 7f8bb0a8c700 1 -- 172.21.15.72:0/3073660757 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bac0c4570 con 0x7f8b9c003a00 2023-07-25T14:36:34.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.956+0000 7f8babfff700 1 --2- 172.21.15.72:0/3073660757 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8bac0abfb0 0x7f8bac0c0d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-25T14:36:34.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.956+0000 7f8bb0a8c700 1 --2- 172.21.15.72:0/3073660757 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8b9c003a00 0x7f8bac0c5330 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f8ba000c960 tx=0x7f8ba0000fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:34.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.956+0000 7f8ba97fa700 1 -- 172.21.15.72:0/3073660757 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ba0004870 con 0x7f8b9c003a00 2023-07-25T14:36:34.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.956+0000 7f8ba97fa700 1 -- 172.21.15.72:0/3073660757 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ba00049d0 con 0x7f8b9c003a00 2023-07-25T14:36:34.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.956+0000 7f8bb2cf0700 1 -- 172.21.15.72:0/3073660757 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bac0c4850 con 0x7f8b9c003a00 2023-07-25T14:36:34.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.956+0000 7f8ba97fa700 1 -- 172.21.15.72:0/3073660757 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ba0004d80 con 0x7f8b9c003a00 2023-07-25T14:36:34.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.956+0000 7f8bb2cf0700 1 -- 172.21.15.72:0/3073660757 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bac0c1270 con 0x7f8b9c003a00 2023-07-25T14:36:34.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.957+0000 7f8bb2cf0700 1 -- 172.21.15.72:0/3073660757 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bac06bcf0 con 0x7f8b9c003a00 2023-07-25T14:36:34.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.957+0000 7f8ba97fa700 1 -- 172.21.15.72:0/3073660757 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8ba00070d0 con 0x7f8b9c003a00 2023-07-25T14:36:34.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.958+0000 7f8ba97fa700 1 --2- 172.21.15.72:0/3073660757 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f8b9006acd0 0x7f8b9006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:34.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.958+0000 7f8babfff700 1 --2- 172.21.15.72:0/3073660757 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f8b9006acd0 0x7f8b9006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:34.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.958+0000 7f8ba97fa700 1 -- 172.21.15.72:0/3073660757 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f8ba008ae60 con 0x7f8b9c003a00 2023-07-25T14:36:34.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.958+0000 7f8babfff700 1 --2- 172.21.15.72:0/3073660757 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f8b9006acd0 0x7f8b9006d190 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f8b98009470 tx=0x7f8b98008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:34.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:34.962+0000 7f8ba97fa700 1 -- 172.21.15.72:0/3073660757 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f8ba0055d10 con 0x7f8b9c003a00 2023-07-25T14:36:35.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.148+0000 7f8bb2cf0700 1 -- 172.21.15.72:0/3073660757 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8bac04e470 con 0x7f8b9c003a00 2023-07-25T14:36:35.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.148+0000 7f8ba97fa700 1 -- 172.21.15.72:0/3073660757 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8ba0007dc0 con 0x7f8b9c003a00 2023-07-25T14:36:35.159 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2023-07-25T14:36:35.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.150+0000 7f8bb2cf0700 1 -- 172.21.15.72:0/3073660757 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f8b9006acd0 msgr2=0x7f8b9006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:35.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.150+0000 7f8bb2cf0700 1 --2- 172.21.15.72:0/3073660757 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f8b9006acd0 0x7f8b9006d190 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f8b98009470 tx=0x7f8b98008040 comp rx=0 tx=0).stop 2023-07-25T14:36:35.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.150+0000 7f8bb2cf0700 1 -- 172.21.15.72:0/3073660757 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8b9c003a00 msgr2=0x7f8bac0c5330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:35.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.150+0000 7f8bb2cf0700 1 --2- 172.21.15.72:0/3073660757 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8b9c003a00 0x7f8bac0c5330 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f8ba000c960 tx=0x7f8ba0000fe0 comp rx=0 tx=0).stop 2023-07-25T14:36:35.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.150+0000 7f8bb2cf0700 1 -- 172.21.15.72:0/3073660757 shutdown_connections 2023-07-25T14:36:35.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.150+0000 7f8bb2cf0700 1 --2- 172.21.15.72:0/3073660757 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f8b9006acd0 0x7f8b9006d190 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:35.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.150+0000 7f8bb2cf0700 1 --2- 172.21.15.72:0/3073660757 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8bac1e97e0 0x7f8bac0a9770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:35.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.150+0000 7f8bb2cf0700 1 --2- 172.21.15.72:0/3073660757 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8b9c003a00 0x7f8bac0c5330 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:35.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.150+0000 7f8bb2cf0700 1 --2- 172.21.15.72:0/3073660757 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8bac0abfb0 0x7f8bac0c0d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:35.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.150+0000 7f8bb2cf0700 1 -- 172.21.15.72:0/3073660757 >> 172.21.15.72:0/3073660757 conn(0x7f8bac06def0 msgr2=0x7f8bac1469c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:35.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.150+0000 7f8bb2cf0700 1 -- 172.21.15.72:0/3073660757 shutdown_connections 2023-07-25T14:36:35.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.150+0000 7f8bb2cf0700 1 -- 172.21.15.72:0/3073660757 wait complete. 2023-07-25T14:36:35.173 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-25T14:36:35.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.285+0000 7f6c35ea0700 1 Processor -- start 2023-07-25T14:36:35.296 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.285+0000 7f6c35ea0700 1 -- start start 2023-07-25T14:36:35.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.285+0000 7f6c35ea0700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f6c3014faf0 0x7f6c300c5e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:35.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.285+0000 7f6c35ea0700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f6c300c3f10 0x7f6c30071960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:35.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.285+0000 7f6c35ea0700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c300c4930 con 0x7f6c300ba0e0 2023-07-25T14:36:35.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.285+0000 7f6c35ea0700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c300c5670 con 0x7f6c300c3f10 2023-07-25T14:36:35.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.285+0000 7f6c35ea0700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c300726e0 con 0x7f6c3014faf0 2023-07-25T14:36:35.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.286+0000 7f6c2ffff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f6c300c3f10 0x7f6c30071960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:35.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.286+0000 7f6c2effd700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f6c300ba0e0 0x7f6c301558a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:60440/0 (socket says 172.21.15.72:60440) 2023-07-25T14:36:35.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.286+0000 7f6c2effd700 1 -- 172.21.15.72:0/1537979097 learned_addr learned my addr 172.21.15.72:0/1537979097 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:36:35.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.286+0000 7f6c2ffff700 1 --2- 172.21.15.72:0/1537979097 >> v2:172.21.15.72:3300/0 conn(0x7f6c300c3f10 0x7f6c30071960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41476/0 (socket says 172.21.15.72:41476) 2023-07-25T14:36:35.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.286+0000 7f6c2ffff700 1 -- 172.21.15.72:0/1537979097 >> v2:172.21.15.92:3300/0 conn(0x7f6c3014faf0 msgr2=0x7f6c300c5e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:35.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.286+0000 7f6c2f7fe700 1 --2- 172.21.15.72:0/1537979097 >> v2:172.21.15.92:3300/0 conn(0x7f6c3014faf0 0x7f6c300c5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:35.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.286+0000 7f6c2ffff700 1 --2- 172.21.15.72:0/1537979097 >> v2:172.21.15.92:3300/0 conn(0x7f6c3014faf0 0x7f6c300c5e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:35.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.286+0000 7f6c2ffff700 1 -- 172.21.15.72:0/1537979097 >> v1:172.21.15.72:6789/0 conn(0x7f6c300ba0e0 legacy=0x7f6c301558a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:35.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.286+0000 7f6c2e7fc700 1 -- 172.21.15.72:0/1537979097 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3061207315 0 0) 0x7f6c300c4930 con 0x7f6c300ba0e0 2023-07-25T14:36:35.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.286+0000 7f6c2ffff700 1 -- 172.21.15.72:0/1537979097 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c300c4b80 con 0x7f6c300c3f10 2023-07-25T14:36:35.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.286+0000 7f6c2ffff700 1 --2- 172.21.15.72:0/1537979097 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6c300c3f10 0x7f6c30071960 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f6c300ac850 tx=0x7f6c2800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef7020b097278c42 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:35.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.286+0000 7f6c2e7fc700 1 -- 172.21.15.72:0/1537979097 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c2800e070 con 0x7f6c300c3f10 2023-07-25T14:36:35.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.286+0000 7f6c2e7fc700 1 -- 172.21.15.72:0/1537979097 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c2800bbd0 con 0x7f6c300c3f10 2023-07-25T14:36:35.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.286+0000 7f6c2e7fc700 1 -- 172.21.15.72:0/1537979097 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c28012430 con 0x7f6c300c3f10 2023-07-25T14:36:35.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.287+0000 7f6c35ea0700 1 -- 172.21.15.72:0/1537979097 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6c300c3f10 msgr2=0x7f6c30071960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:35.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.287+0000 7f6c35ea0700 1 --2- 172.21.15.72:0/1537979097 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6c300c3f10 0x7f6c30071960 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f6c300ac850 tx=0x7f6c2800b330 comp rx=0 tx=0).stop 2023-07-25T14:36:35.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.287+0000 7f6c35ea0700 1 -- 172.21.15.72:0/1537979097 shutdown_connections 2023-07-25T14:36:35.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.287+0000 7f6c35ea0700 1 --2- 172.21.15.72:0/1537979097 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6c300c3f10 0x7f6c30071960 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:35.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.287+0000 7f6c35ea0700 1 --2- 172.21.15.72:0/1537979097 >> v2:172.21.15.92:3300/0 conn(0x7f6c3014faf0 0x7f6c300c5e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:35.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.287+0000 7f6c35ea0700 1 -- 172.21.15.72:0/1537979097 >> 172.21.15.72:0/1537979097 conn(0x7f6c300a87e0 msgr2=0x7f6c300a8bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:35.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.287+0000 7f6c35ea0700 1 -- 172.21.15.72:0/1537979097 shutdown_connections 2023-07-25T14:36:35.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.287+0000 7f6c35ea0700 1 -- 172.21.15.72:0/1537979097 wait complete. 2023-07-25T14:36:35.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.288+0000 7f6c35ea0700 1 Processor -- start 2023-07-25T14:36:35.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.288+0000 7f6c35ea0700 1 -- start start 2023-07-25T14:36:35.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.289+0000 7f6c35ea0700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6c300ba0e0 0x7f6c300bde20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:35.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.289+0000 7f6c35ea0700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6c300c3f10 0x7f6c300c02f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:35.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.289+0000 7f6c35ea0700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6c3014faf0 0x7f6c30152380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:35.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.289+0000 7f6c35ea0700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c3014b350 con 0x7f6c3014faf0 2023-07-25T14:36:35.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.289+0000 7f6c35ea0700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c301e7ef0 con 0x7f6c300ba0e0 2023-07-25T14:36:35.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.289+0000 7f6c35ea0700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c301e8420 con 0x7f6c300c3f10 2023-07-25T14:36:35.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.289+0000 7f6c2ffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6c3014faf0 0x7f6c30152380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:35.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.289+0000 7f6c2ffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6c3014faf0 0x7f6c30152380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41482/0 (socket says 172.21.15.72:41482) 2023-07-25T14:36:35.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.289+0000 7f6c2ffff700 1 -- 172.21.15.72:0/3305915248 learned_addr learned my addr 172.21.15.72:0/3305915248 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:35.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.289+0000 7f6c2f7fe700 1 --2- 172.21.15.72:0/3305915248 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6c300ba0e0 0x7f6c300bde20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:35.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.289+0000 7f6c2effd700 1 --2- 172.21.15.72:0/3305915248 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6c300c3f10 0x7f6c300c02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:35.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.289+0000 7f6c2ffff700 1 -- 172.21.15.72:0/3305915248 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6c300c3f10 msgr2=0x7f6c300c02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:35.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.289+0000 7f6c2ffff700 1 --2- 172.21.15.72:0/3305915248 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6c300c3f10 0x7f6c300c02f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:35.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.289+0000 7f6c2ffff700 1 -- 172.21.15.72:0/3305915248 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6c300ba0e0 msgr2=0x7f6c300bde20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:35.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.289+0000 7f6c2ffff700 1 --2- 172.21.15.72:0/3305915248 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6c300ba0e0 0x7f6c300bde20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:35.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.289+0000 7f6c2ffff700 1 -- 172.21.15.72:0/3305915248 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c28009a70 con 0x7f6c3014faf0 2023-07-25T14:36:35.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.289+0000 7f6c2f7fe700 1 --2- 172.21.15.72:0/3305915248 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6c300ba0e0 0x7f6c300bde20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-25T14:36:35.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.289+0000 7f6c2effd700 1 --2- 172.21.15.72:0/3305915248 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6c300c3f10 0x7f6c300c02f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-25T14:36:35.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.289+0000 7f6c2ffff700 1 --2- 172.21.15.72:0/3305915248 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6c3014faf0 0x7f6c30152380 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f6c2800b730 tx=0x7f6c28004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:35.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.289+0000 7f6c17fff700 1 -- 172.21.15.72:0/3305915248 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c28012430 con 0x7f6c3014faf0 2023-07-25T14:36:35.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.289+0000 7f6c35ea0700 1 -- 172.21.15.72:0/3305915248 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c30151ef0 con 0x7f6c3014faf0 2023-07-25T14:36:35.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.290+0000 7f6c35ea0700 1 -- 172.21.15.72:0/3305915248 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c301518a0 con 0x7f6c3014faf0 2023-07-25T14:36:35.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.290+0000 7f6c17fff700 1 -- 172.21.15.72:0/3305915248 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c28020070 con 0x7f6c3014faf0 2023-07-25T14:36:35.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.290+0000 7f6c17fff700 1 -- 172.21.15.72:0/3305915248 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c28003ea0 con 0x7f6c3014faf0 2023-07-25T14:36:35.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.290+0000 7f6c35ea0700 1 -- 172.21.15.72:0/3305915248 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c30152080 con 0x7f6c3014faf0 2023-07-25T14:36:35.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.291+0000 7f6c17fff700 1 -- 172.21.15.72:0/3305915248 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6c28004240 con 0x7f6c3014faf0 2023-07-25T14:36:35.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.291+0000 7f6c17fff700 1 --2- 172.21.15.72:0/3305915248 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f6c1c06ace0 0x7f6c1c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:35.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.291+0000 7f6c17fff700 1 -- 172.21.15.72:0/3305915248 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f6c28022070 con 0x7f6c3014faf0 2023-07-25T14:36:35.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.291+0000 7f6c2f7fe700 1 --2- 172.21.15.72:0/3305915248 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f6c1c06ace0 0x7f6c1c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:35.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.292+0000 7f6c2f7fe700 1 --2- 172.21.15.72:0/3305915248 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f6c1c06ace0 0x7f6c1c06d1a0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f6c24006fd0 tx=0x7f6c24008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:35.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.296+0000 7f6c17fff700 1 -- 172.21.15.72:0/3305915248 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f6c28056bc0 con 0x7f6c3014faf0 2023-07-25T14:36:35.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.481+0000 7f6c35ea0700 1 -- 172.21.15.72:0/3305915248 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f6c3004e470 con 0x7f6c3014faf0 2023-07-25T14:36:35.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.482+0000 7f6c17fff700 1 -- 172.21.15.72:0/3305915248 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6c2805a1e0 con 0x7f6c3014faf0 2023-07-25T14:36:35.493 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 64 2023-07-25T14:36:35.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.484+0000 7f6c35ea0700 1 -- 172.21.15.72:0/3305915248 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f6c1c06ace0 msgr2=0x7f6c1c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:35.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.484+0000 7f6c35ea0700 1 --2- 172.21.15.72:0/3305915248 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f6c1c06ace0 0x7f6c1c06d1a0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f6c24006fd0 tx=0x7f6c24008040 comp rx=0 tx=0).stop 2023-07-25T14:36:35.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.484+0000 7f6c35ea0700 1 -- 172.21.15.72:0/3305915248 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6c3014faf0 msgr2=0x7f6c30152380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:35.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.484+0000 7f6c35ea0700 1 --2- 172.21.15.72:0/3305915248 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6c3014faf0 0x7f6c30152380 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f6c2800b730 tx=0x7f6c28004ad0 comp rx=0 tx=0).stop 2023-07-25T14:36:35.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.484+0000 7f6c35ea0700 1 -- 172.21.15.72:0/3305915248 shutdown_connections 2023-07-25T14:36:35.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.484+0000 7f6c35ea0700 1 --2- 172.21.15.72:0/3305915248 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f6c1c06ace0 0x7f6c1c06d1a0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:35.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.484+0000 7f6c35ea0700 1 --2- 172.21.15.72:0/3305915248 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6c3014faf0 0x7f6c30152380 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:35.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.484+0000 7f6c35ea0700 1 --2- 172.21.15.72:0/3305915248 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6c300ba0e0 0x7f6c300bde20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:35.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.484+0000 7f6c35ea0700 1 --2- 172.21.15.72:0/3305915248 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6c300c3f10 0x7f6c300c02f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:35.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.484+0000 7f6c35ea0700 1 -- 172.21.15.72:0/3305915248 >> 172.21.15.72:0/3305915248 conn(0x7f6c300a87e0 msgr2=0x7f6c300c20e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:35.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.484+0000 7f6c35ea0700 1 -- 172.21.15.72:0/3305915248 shutdown_connections 2023-07-25T14:36:35.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.484+0000 7f6c35ea0700 1 -- 172.21.15.72:0/3305915248 wait complete. 2023-07-25T14:36:35.507 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-07-25T14:36:35.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.619+0000 7f0dd238d700 1 Processor -- start 2023-07-25T14:36:35.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.619+0000 7f0dd238d700 1 -- start start 2023-07-25T14:36:35.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.620+0000 7f0dd238d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0dcc14f810 0x7f0dcc0c4370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:35.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.620+0000 7f0dd238d700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f0dcc0a9cc0 0x7f0dcc1525e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:35.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.620+0000 7f0dd238d700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0dcc0c5890 con 0x7f0dcc0bb0b0 2023-07-25T14:36:35.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.620+0000 7f0dd238d700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0dcc152150 con 0x7f0dcc14f810 2023-07-25T14:36:35.632 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.620+0000 7f0dd238d700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0dcc14fbf0 con 0x7f0dcc0a9cc0 2023-07-25T14:36:35.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.620+0000 7f0dcbfff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0dcc14f810 0x7f0dcc0c4370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:35.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.620+0000 7f0dcbfff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0dcc14f810 0x7f0dcc0c4370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41486/0 (socket says 172.21.15.72:41486) 2023-07-25T14:36:35.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.620+0000 7f0dcbfff700 1 -- 172.21.15.72:0/1429514514 learned_addr learned my addr 172.21.15.72:0/1429514514 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:35.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.620+0000 7f0dd092a700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f0dcc0bb0b0 0x7f0dcc152b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:60454/0 (socket says 172.21.15.72:60454) 2023-07-25T14:36:35.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.620+0000 7f0dcb7fe700 1 --2- 172.21.15.72:0/1429514514 >> v2:172.21.15.92:3300/0 conn(0x7f0dcc0a9cc0 0x7f0dcc1525e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:35.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.620+0000 7f0dcbfff700 1 -- 172.21.15.72:0/1429514514 >> v2:172.21.15.92:3300/0 conn(0x7f0dcc0a9cc0 msgr2=0x7f0dcc1525e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:35.633 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.620+0000 7f0dcbfff700 1 --2- 172.21.15.72:0/1429514514 >> v2:172.21.15.92:3300/0 conn(0x7f0dcc0a9cc0 0x7f0dcc1525e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:35.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.620+0000 7f0dcbfff700 1 -- 172.21.15.72:0/1429514514 >> v1:172.21.15.72:6789/0 conn(0x7f0dcc0bb0b0 legacy=0x7f0dcc152b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:35.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.620+0000 7f0dcbfff700 1 -- 172.21.15.72:0/1429514514 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dcc1566a0 con 0x7f0dcc14f810 2023-07-25T14:36:35.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.620+0000 7f0dcaffd700 1 -- 172.21.15.72:0/1429514514 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1101039093 0 0) 0x7f0dcc0c5890 con 0x7f0dcc0bb0b0 2023-07-25T14:36:35.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.620+0000 7f0dcb7fe700 1 --2- 172.21.15.72:0/1429514514 >> v2:172.21.15.92:3300/0 conn(0x7f0dcc0a9cc0 0x7f0dcc1525e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-25T14:36:35.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.621+0000 7f0dcbfff700 1 --2- 172.21.15.72:0/1429514514 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0dcc14f810 0x7f0dcc0c4370 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f0dcc0c1f90 tx=0x7f0dc0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96a0349a053c6890 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:35.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.621+0000 7f0dcaffd700 1 -- 172.21.15.72:0/1429514514 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dc000b870 con 0x7f0dcc14f810 2023-07-25T14:36:35.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.621+0000 7f0dcaffd700 1 -- 172.21.15.72:0/1429514514 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dc000b9d0 con 0x7f0dcc14f810 2023-07-25T14:36:35.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.621+0000 7f0dcaffd700 1 -- 172.21.15.72:0/1429514514 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dc000bd60 con 0x7f0dcc14f810 2023-07-25T14:36:35.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.621+0000 7f0dd238d700 1 -- 172.21.15.72:0/1429514514 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0dcc14f810 msgr2=0x7f0dcc0c4370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:35.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.621+0000 7f0dd238d700 1 --2- 172.21.15.72:0/1429514514 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0dcc14f810 0x7f0dcc0c4370 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f0dcc0c1f90 tx=0x7f0dc0009bd0 comp rx=0 tx=0).stop 2023-07-25T14:36:35.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.621+0000 7f0dd238d700 1 -- 172.21.15.72:0/1429514514 shutdown_connections 2023-07-25T14:36:35.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.621+0000 7f0dd238d700 1 --2- 172.21.15.72:0/1429514514 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0dcc14f810 0x7f0dcc0c4370 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:35.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.621+0000 7f0dd238d700 1 --2- 172.21.15.72:0/1429514514 >> v2:172.21.15.92:3300/0 conn(0x7f0dcc0a9cc0 0x7f0dcc1525e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:35.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.621+0000 7f0dd238d700 1 -- 172.21.15.72:0/1429514514 >> 172.21.15.72:0/1429514514 conn(0x7f0dcc06a8d0 msgr2=0x7f0dcc0a94e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:35.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.621+0000 7f0dd238d700 1 -- 172.21.15.72:0/1429514514 shutdown_connections 2023-07-25T14:36:35.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.621+0000 7f0dd238d700 1 -- 172.21.15.72:0/1429514514 wait complete. 2023-07-25T14:36:35.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.622+0000 7f0dd238d700 1 Processor -- start 2023-07-25T14:36:35.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.622+0000 7f0dd238d700 1 -- start start 2023-07-25T14:36:35.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.623+0000 7f0dd238d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0dcc0a9cc0 0x7f0dcc0c0b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:35.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.623+0000 7f0dd238d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0dcc0bb0b0 0x7f0dcc1e8230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:35.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.623+0000 7f0dd238d700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0dcc14f810 0x7f0dcc1eb550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:35.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.623+0000 7f0dd238d700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dcc1e8770 con 0x7f0dcc0a9cc0 2023-07-25T14:36:35.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.623+0000 7f0dd238d700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dcc1eadc0 con 0x7f0dcc0bb0b0 2023-07-25T14:36:35.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.623+0000 7f0dd238d700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0dcc0ace70 con 0x7f0dcc14f810 2023-07-25T14:36:35.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.623+0000 7f0dcbfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0dcc0a9cc0 0x7f0dcc0c0b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:35.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.623+0000 7f0dcbfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0dcc0a9cc0 0x7f0dcc0c0b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41492/0 (socket says 172.21.15.72:41492) 2023-07-25T14:36:35.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.623+0000 7f0dcbfff700 1 -- 172.21.15.72:0/810445549 learned_addr learned my addr 172.21.15.72:0/810445549 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:35.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.623+0000 7f0dcb7fe700 1 --2- 172.21.15.72:0/810445549 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0dcc0bb0b0 0x7f0dcc1e8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:35.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.624+0000 7f0dd092a700 1 --2- 172.21.15.72:0/810445549 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0dcc14f810 0x7f0dcc1eb550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:35.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.624+0000 7f0dcbfff700 1 -- 172.21.15.72:0/810445549 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0dcc14f810 msgr2=0x7f0dcc1eb550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:35.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.624+0000 7f0dcbfff700 1 --2- 172.21.15.72:0/810445549 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0dcc14f810 0x7f0dcc1eb550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:35.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.624+0000 7f0dcbfff700 1 -- 172.21.15.72:0/810445549 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0dcc0bb0b0 msgr2=0x7f0dcc1e8230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:35.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.624+0000 7f0dcbfff700 1 --2- 172.21.15.72:0/810445549 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0dcc0bb0b0 0x7f0dcc1e8230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:35.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.624+0000 7f0dcbfff700 1 -- 172.21.15.72:0/810445549 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dc0009550 con 0x7f0dcc0a9cc0 2023-07-25T14:36:35.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.624+0000 7f0dd092a700 1 --2- 172.21.15.72:0/810445549 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0dcc14f810 0x7f0dcc1eb550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-25T14:36:35.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.624+0000 7f0dcbfff700 1 --2- 172.21.15.72:0/810445549 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0dcc0a9cc0 0x7f0dcc0c0b70 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f0dc0009c10 tx=0x7f0dc0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:35.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.624+0000 7f0dc8ff9700 1 -- 172.21.15.72:0/810445549 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dc0004310 con 0x7f0dcc0a9cc0 2023-07-25T14:36:35.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.624+0000 7f0dc8ff9700 1 -- 172.21.15.72:0/810445549 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dc001f070 con 0x7f0dcc0a9cc0 2023-07-25T14:36:35.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.624+0000 7f0dd238d700 1 -- 172.21.15.72:0/810445549 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0dcc0ad150 con 0x7f0dcc0a9cc0 2023-07-25T14:36:35.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.624+0000 7f0dc8ff9700 1 -- 172.21.15.72:0/810445549 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dc00036a0 con 0x7f0dcc0a9cc0 2023-07-25T14:36:35.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.624+0000 7f0dd238d700 1 -- 172.21.15.72:0/810445549 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0dcc0ad430 con 0x7f0dcc0a9cc0 2023-07-25T14:36:35.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.625+0000 7f0dd238d700 1 -- 172.21.15.72:0/810445549 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0dcc1eb270 con 0x7f0dcc0a9cc0 2023-07-25T14:36:35.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.625+0000 7f0dc8ff9700 1 -- 172.21.15.72:0/810445549 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0dc0021030 con 0x7f0dcc0a9cc0 2023-07-25T14:36:35.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.626+0000 7f0dc8ff9700 1 --2- 172.21.15.72:0/810445549 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f0db806ace0 0x7f0db806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:35.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.626+0000 7f0dc8ff9700 1 -- 172.21.15.72:0/810445549 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f0dc008aad0 con 0x7f0dcc0a9cc0 2023-07-25T14:36:35.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.626+0000 7f0dcb7fe700 1 --2- 172.21.15.72:0/810445549 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f0db806ace0 0x7f0db806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:35.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.626+0000 7f0dcb7fe700 1 --2- 172.21.15.72:0/810445549 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f0db806ace0 0x7f0db806d1a0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f0dcc151ff0 tx=0x7f0dbc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:35.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.630+0000 7f0dc8ff9700 1 -- 172.21.15.72:0/810445549 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f0dc0055840 con 0x7f0dcc0a9cc0 2023-07-25T14:36:35.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.819+0000 7f0dd238d700 1 -- 172.21.15.72:0/810445549 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f0dcc0c1c40 con 0x7f0dcc0a9cc0 2023-07-25T14:36:35.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.820+0000 7f0dc8ff9700 1 -- 172.21.15.72:0/810445549 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f0dc0015020 con 0x7f0dcc0a9cc0 2023-07-25T14:36:35.831 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2023-07-25T14:36:35.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.822+0000 7f0dd238d700 1 -- 172.21.15.72:0/810445549 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f0db806ace0 msgr2=0x7f0db806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:35.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.822+0000 7f0dd238d700 1 --2- 172.21.15.72:0/810445549 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f0db806ace0 0x7f0db806d1a0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f0dcc151ff0 tx=0x7f0dbc008040 comp rx=0 tx=0).stop 2023-07-25T14:36:35.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.822+0000 7f0dd238d700 1 -- 172.21.15.72:0/810445549 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0dcc0a9cc0 msgr2=0x7f0dcc0c0b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:35.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.822+0000 7f0dd238d700 1 --2- 172.21.15.72:0/810445549 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0dcc0a9cc0 0x7f0dcc0c0b70 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f0dc0009c10 tx=0x7f0dc0004750 comp rx=0 tx=0).stop 2023-07-25T14:36:35.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.822+0000 7f0dd238d700 1 -- 172.21.15.72:0/810445549 shutdown_connections 2023-07-25T14:36:35.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.822+0000 7f0dd238d700 1 --2- 172.21.15.72:0/810445549 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f0db806ace0 0x7f0db806d1a0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:35.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.822+0000 7f0dd238d700 1 --2- 172.21.15.72:0/810445549 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0dcc14f810 0x7f0dcc1eb550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:35.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.822+0000 7f0dd238d700 1 --2- 172.21.15.72:0/810445549 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0dcc0a9cc0 0x7f0dcc0c0b70 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:35.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.822+0000 7f0dd238d700 1 --2- 172.21.15.72:0/810445549 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0dcc0bb0b0 0x7f0dcc1e8230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:35.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.822+0000 7f0dd238d700 1 -- 172.21.15.72:0/810445549 >> 172.21.15.72:0/810445549 conn(0x7f0dcc06a8d0 msgr2=0x7f0dcc1525e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:35.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.823+0000 7f0dd238d700 1 -- 172.21.15.72:0/810445549 shutdown_connections 2023-07-25T14:36:35.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.823+0000 7f0dd238d700 1 -- 172.21.15.72:0/810445549 wait complete. 2023-07-25T14:36:35.847 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-25T14:36:35.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.956+0000 7f33a4f56700 1 Processor -- start 2023-07-25T14:36:35.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.956+0000 7f33a4f56700 1 -- start start 2023-07-25T14:36:35.968 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.957+0000 7f33a4f56700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f33a0151ba0 0x7f33a00c2230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:35.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.957+0000 7f33a4f56700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f33a0154d50 0x7f33a015b970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:35.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.957+0000 7f33a4f56700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33a00c54f0 con 0x7f33a00c5f40 2023-07-25T14:36:35.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.957+0000 7f33a4f56700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33a00c6670 con 0x7f33a0154d50 2023-07-25T14:36:35.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.957+0000 7f33a4f56700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33a00c5740 con 0x7f33a0151ba0 2023-07-25T14:36:35.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.957+0000 7f339ed9d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f33a0154d50 0x7f33a015b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:35.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.957+0000 7f339ed9d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f33a0154d50 0x7f33a015b970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41502/0 (socket says 172.21.15.72:41502) 2023-07-25T14:36:35.970 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.957+0000 7f339ed9d700 1 -- 172.21.15.72:0/1599287273 learned_addr learned my addr 172.21.15.72:0/1599287273 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:35.970 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.957+0000 7f339e59c700 1 --2- 172.21.15.72:0/1599287273 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f33a0151ba0 0x7f33a00c2230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:35.970 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.958+0000 7f339ed9d700 1 -- 172.21.15.72:0/1599287273 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f33a0151ba0 msgr2=0x7f33a00c2230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:35.970 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.958+0000 7f339ed9d700 1 --2- 172.21.15.72:0/1599287273 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f33a0151ba0 0x7f33a00c2230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:35.970 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.958+0000 7f339ed9d700 1 -- 172.21.15.72:0/1599287273 >> v1:172.21.15.92:6789/0 conn(0x7f33a00c5f40 legacy=0x7f33a0154640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:35.970 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.958+0000 7f339ed9d700 1 -- 172.21.15.72:0/1599287273 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33a00c5a20 con 0x7f33a0154d50 2023-07-25T14:36:35.970 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.958+0000 7f339ed9d700 1 --2- 172.21.15.72:0/1599287273 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f33a0154d50 0x7f33a015b970 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f3398009e50 tx=0x7f339800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a85b4c6de2831bae server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:35.970 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.958+0000 7f339d59a700 1 -- 172.21.15.72:0/1599287273 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f339800e070 con 0x7f33a0154d50 2023-07-25T14:36:35.971 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.958+0000 7f339d59a700 1 -- 172.21.15.72:0/1599287273 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f339800b9c0 con 0x7f33a0154d50 2023-07-25T14:36:35.971 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.958+0000 7f339d59a700 1 -- 172.21.15.72:0/1599287273 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f339800bd70 con 0x7f33a0154d50 2023-07-25T14:36:35.973 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.958+0000 7f33a4f56700 1 -- 172.21.15.72:0/1599287273 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f33a0154d50 msgr2=0x7f33a015b970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:35.973 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.958+0000 7f33a4f56700 1 --2- 172.21.15.72:0/1599287273 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f33a0154d50 0x7f33a015b970 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f3398009e50 tx=0x7f339800b330 comp rx=0 tx=0).stop 2023-07-25T14:36:35.973 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.959+0000 7f33a4f56700 1 -- 172.21.15.72:0/1599287273 shutdown_connections 2023-07-25T14:36:35.973 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.959+0000 7f33a4f56700 1 --2- 172.21.15.72:0/1599287273 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f33a0154d50 0x7f33a015b970 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:35.974 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.959+0000 7f33a4f56700 1 --2- 172.21.15.72:0/1599287273 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f33a0151ba0 0x7f33a00c2230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:35.974 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.959+0000 7f33a4f56700 1 -- 172.21.15.72:0/1599287273 >> 172.21.15.72:0/1599287273 conn(0x7f33a00a87e0 msgr2=0x7f33a00a8bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:35.974 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.959+0000 7f33a4f56700 1 -- 172.21.15.72:0/1599287273 shutdown_connections 2023-07-25T14:36:35.974 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.959+0000 7f33a4f56700 1 -- 172.21.15.72:0/1599287273 wait complete. 2023-07-25T14:36:35.974 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.960+0000 7f33a4f56700 1 Processor -- start 2023-07-25T14:36:35.974 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.960+0000 7f33a4f56700 1 -- start start 2023-07-25T14:36:35.974 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.961+0000 7f33a4f56700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f33a00c5f40 0x7f33a01e7430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:35.974 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.961+0000 7f33a4f56700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f33a0151ba0 0x7f33a014da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:35.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.961+0000 7f33a4f56700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f33a014df70 0x7f33a00bbef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:35.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.961+0000 7f33a4f56700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33a00c0bf0 con 0x7f33a00c5f40 2023-07-25T14:36:35.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.961+0000 7f33a4f56700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33a01eaa00 con 0x7f33a0151ba0 2023-07-25T14:36:35.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.961+0000 7f33a4f56700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33a01eacc0 con 0x7f33a014df70 2023-07-25T14:36:35.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.961+0000 7f339e59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f33a00c5f40 0x7f33a01e7430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:35.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.961+0000 7f339e59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f33a00c5f40 0x7f33a01e7430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41504/0 (socket says 172.21.15.72:41504) 2023-07-25T14:36:35.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.961+0000 7f339e59c700 1 -- 172.21.15.72:0/3048469986 learned_addr learned my addr 172.21.15.72:0/3048469986 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:35.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.961+0000 7f339dd9b700 1 --2- 172.21.15.72:0/3048469986 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f33a0151ba0 0x7f33a014da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:35.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.961+0000 7f339ed9d700 1 --2- 172.21.15.72:0/3048469986 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f33a014df70 0x7f33a00bbef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:35.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.961+0000 7f339e59c700 1 -- 172.21.15.72:0/3048469986 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f33a014df70 msgr2=0x7f33a00bbef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:35.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.961+0000 7f339e59c700 1 --2- 172.21.15.72:0/3048469986 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f33a014df70 0x7f33a00bbef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:35.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.961+0000 7f339e59c700 1 -- 172.21.15.72:0/3048469986 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f33a0151ba0 msgr2=0x7f33a014da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:35.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.961+0000 7f339e59c700 1 --2- 172.21.15.72:0/3048469986 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f33a0151ba0 0x7f33a014da30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:35.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.961+0000 7f339e59c700 1 -- 172.21.15.72:0/3048469986 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3398009b30 con 0x7f33a00c5f40 2023-07-25T14:36:35.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.961+0000 7f339dd9b700 1 --2- 172.21.15.72:0/3048469986 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f33a0151ba0 0x7f33a014da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-25T14:36:35.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.961+0000 7f339e59c700 1 --2- 172.21.15.72:0/3048469986 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f33a00c5f40 0x7f33a01e7430 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f338800e810 tx=0x7f338800eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:35.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.961+0000 7f3396ffd700 1 -- 172.21.15.72:0/3048469986 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3388013610 con 0x7f33a00c5f40 2023-07-25T14:36:35.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.961+0000 7f3396ffd700 1 -- 172.21.15.72:0/3048469986 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33880137b0 con 0x7f33a00c5f40 2023-07-25T14:36:35.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.961+0000 7f3396ffd700 1 -- 172.21.15.72:0/3048469986 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3388013b60 con 0x7f33a00c5f40 2023-07-25T14:36:35.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.961+0000 7f33a4f56700 1 -- 172.21.15.72:0/3048469986 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33a01eafa0 con 0x7f33a00c5f40 2023-07-25T14:36:35.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.961+0000 7f33a4f56700 1 -- 172.21.15.72:0/3048469986 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33a01eb560 con 0x7f33a00c5f40 2023-07-25T14:36:35.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.962+0000 7f33a4f56700 1 -- 172.21.15.72:0/3048469986 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33a004e470 con 0x7f33a00c5f40 2023-07-25T14:36:35.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.963+0000 7f3396ffd700 1 -- 172.21.15.72:0/3048469986 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3388013cc0 con 0x7f33a00c5f40 2023-07-25T14:36:35.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.963+0000 7f3396ffd700 1 --2- 172.21.15.72:0/3048469986 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f338006ace0 0x7f338006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:35.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.963+0000 7f3396ffd700 1 -- 172.21.15.72:0/3048469986 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f3388089400 con 0x7f33a00c5f40 2023-07-25T14:36:35.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.963+0000 7f339dd9b700 1 --2- 172.21.15.72:0/3048469986 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f338006ace0 0x7f338006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:35.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.964+0000 7f339dd9b700 1 --2- 172.21.15.72:0/3048469986 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f338006ace0 0x7f338006d1a0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f33a00bd790 tx=0x7f3390009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:35.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:35.967+0000 7f3396ffd700 1 -- 172.21.15.72:0/3048469986 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f3388057ca0 con 0x7f33a00c5f40 2023-07-25T14:36:36.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:36.194+0000 7f33a4f56700 1 -- 172.21.15.72:0/3048469986 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f33a00a61b0 con 0x7f33a00c5f40 2023-07-25T14:36:36.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:36.194+0000 7f3396ffd700 1 -- 172.21.15.72:0/3048469986 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4664 (secure 0 0 0) 0x7f3388057830 con 0x7f33a00c5f40 2023-07-25T14:36:36.205 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-25T14:36:36.205 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4220,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6836/4293785067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":4293785067},{"type":"v1","addr":"172.21.15.72:6836","nonce":4293785067}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4229,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6834/681290755","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":681290755},{"type":"v1","addr":"172.21.15.92:6834","nonce":681290755}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6837/3376375642","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6835","nonce":3376375642},{"type":"v1","addr":"172.21.15.72:6837","nonce":3376375642}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-25T14:35:39.939860+0000","modified":"2023-07-25T14:35:59.629155+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.92:6835/2045555979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6833","nonce":2045555979},{"type":"v1","addr":"172.21.15.92:6835","nonce":2045555979}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-25T14:36:36.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:36.196+0000 7f33a4f56700 1 -- 172.21.15.72:0/3048469986 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f338006ace0 msgr2=0x7f338006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:36.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:36.196+0000 7f33a4f56700 1 --2- 172.21.15.72:0/3048469986 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f338006ace0 0x7f338006d1a0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f33a00bd790 tx=0x7f3390009040 comp rx=0 tx=0).stop 2023-07-25T14:36:36.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:36.196+0000 7f33a4f56700 1 -- 172.21.15.72:0/3048469986 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f33a00c5f40 msgr2=0x7f33a01e7430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:36.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:36.196+0000 7f33a4f56700 1 --2- 172.21.15.72:0/3048469986 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f33a00c5f40 0x7f33a01e7430 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f338800e810 tx=0x7f338800eb20 comp rx=0 tx=0).stop 2023-07-25T14:36:36.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:36.196+0000 7f33a4f56700 1 -- 172.21.15.72:0/3048469986 shutdown_connections 2023-07-25T14:36:36.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:36.196+0000 7f33a4f56700 1 --2- 172.21.15.72:0/3048469986 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f338006ace0 0x7f338006d1a0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:36.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:36.196+0000 7f33a4f56700 1 --2- 172.21.15.72:0/3048469986 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f33a014df70 0x7f33a00bbef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:36.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:36.196+0000 7f33a4f56700 1 --2- 172.21.15.72:0/3048469986 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f33a00c5f40 0x7f33a01e7430 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:36.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:36.196+0000 7f33a4f56700 1 --2- 172.21.15.72:0/3048469986 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f33a0151ba0 0x7f33a014da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:36.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:36.196+0000 7f33a4f56700 1 -- 172.21.15.72:0/3048469986 >> 172.21.15.72:0/3048469986 conn(0x7f33a00a87e0 msgr2=0x7f33a00c4600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:36.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:36.196+0000 7f33a4f56700 1 -- 172.21.15.72:0/3048469986 shutdown_connections 2023-07-25T14:36:36.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:36.196+0000 7f33a4f56700 1 -- 172.21.15.72:0/3048469986 wait complete. 2023-07-25T14:36:36.209 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 8 2023-07-25T14:36:36.219 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-25T14:36:36.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:36.328+0000 7fe1a5da1700 1 Processor -- start 2023-07-25T14:36:36.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:36.328+0000 7fe1a5da1700 1 -- start start 2023-07-25T14:36:36.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:36.329+0000 7fe1a5da1700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe1a00c6250 0x7fe1a00c2d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:36.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:36.329+0000 7fe1a5da1700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe1a0154c50 0x7fe1a0157f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:36.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:36.329+0000 7fe1a5da1700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1a01551c0 con 0x7fe1a0158470 2023-07-25T14:36:36.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:36.329+0000 7fe1a5da1700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1a01577c0 con 0x7fe1a0154c50 2023-07-25T14:36:36.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:36.329+0000 7fe1a5da1700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1a00c1380 con 0x7fe1a00c6250 2023-07-25T14:36:36.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:36.329+0000 7fe19ffff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe1a0154c50 0x7fe1a0157f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:36.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:36.329+0000 7fe19ffff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe1a0154c50 0x7fe1a0157f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41514/0 (socket says 172.21.15.72:41514) 2023-07-25T14:36:36.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:36.329+0000 7fe19ffff700 1 -- 172.21.15.72:0/2212118767 learned_addr learned my addr 172.21.15.72:0/2212118767 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:36.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:36.329+0000 7fe19ffff700 1 -- 172.21.15.72:0/2212118767 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe1a00c6250 msgr2=0x7fe1a00c2d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:36.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:36.329+0000 7fe19ffff700 1 --2- 172.21.15.72:0/2212118767 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe1a00c6250 0x7fe1a00c2d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:36.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:36.329+0000 7fe19ffff700 1 -- 172.21.15.72:0/2212118767 >> v1:172.21.15.92:6789/0 conn(0x7fe1a0158470 legacy=0x7fe1a0071410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:36.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:36.329+0000 7fe19ffff700 1 -- 172.21.15.72:0/2212118767 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1a00c1660 con 0x7fe1a0154c50 2023-07-25T14:36:36.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:36.330+0000 7fe19ffff700 1 --2- 172.21.15.72:0/2212118767 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe1a0154c50 0x7fe1a0157f30 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fe18c0098f0 tx=0x7fe18c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f5a7723bb1ff959 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:36.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:36.330+0000 7fe19f7fe700 1 -- 172.21.15.72:0/2212118767 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe18c004230 con 0x7fe1a0154c50 2023-07-25T14:36:36.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:36.330+0000 7fe19f7fe700 1 -- 172.21.15.72:0/2212118767 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe18c004390 con 0x7fe1a0154c50 2023-07-25T14:36:36.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:36.330+0000 7fe19f7fe700 1 -- 172.21.15.72:0/2212118767 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe18c0036a0 con 0x7fe1a0154c50 2023-07-25T14:36:36.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:36.330+0000 7fe1a5da1700 1 -- 172.21.15.72:0/2212118767 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe1a0154c50 msgr2=0x7fe1a0157f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:36.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:36.330+0000 7fe1a5da1700 1 --2- 172.21.15.72:0/2212118767 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe1a0154c50 0x7fe1a0157f30 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fe18c0098f0 tx=0x7fe18c009c00 comp rx=0 tx=0).stop 2023-07-25T14:36:36.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:36.330+0000 7fe1a5da1700 1 -- 172.21.15.72:0/2212118767 shutdown_connections 2023-07-25T14:36:36.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:36.330+0000 7fe1a5da1700 1 --2- 172.21.15.72:0/2212118767 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe1a00c6250 0x7fe1a00c2d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:36.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:36.330+0000 7fe1a5da1700 1 --2- 172.21.15.72:0/2212118767 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe1a0154c50 0x7fe1a0157f30 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:36.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:36.330+0000 7fe1a5da1700 1 -- 172.21.15.72:0/2212118767 >> 172.21.15.72:0/2212118767 conn(0x7fe1a00c7150 msgr2=0x7fe1a00c3350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:36.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:36.330+0000 7fe1a5da1700 1 -- 172.21.15.72:0/2212118767 shutdown_connections 2023-07-25T14:36:36.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:36.330+0000 7fe1a5da1700 1 -- 172.21.15.72:0/2212118767 wait complete. 2023-07-25T14:36:36.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:36.331+0000 7fe1a5da1700 1 Processor -- start 2023-07-25T14:36:36.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:36.331+0000 7fe1a5da1700 1 -- start start 2023-07-25T14:36:36.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:36.332+0000 7fe1a5da1700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe1a00c6250 0x7fe1a0153210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:36.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:36.332+0000 7fe1a5da1700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe1a0154c50 0x7fe1a00bdac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:36.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:36.332+0000 7fe1a5da1700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe1a00be000 0x7fe1a01ed170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:36.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:36.332+0000 7fe1a5da1700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1a01e9c00 con 0x7fe1a00c6250 2023-07-25T14:36:36.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:36.332+0000 7fe1a5da1700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1a01eaa20 con 0x7fe1a0154c50 2023-07-25T14:36:36.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:36.332+0000 7fe1a5da1700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1a01e9e10 con 0x7fe1a00be000 2023-07-25T14:36:36.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:36.332+0000 7fe1a4d9f700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe1a00c6250 0x7fe1a0153210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:36.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:36.332+0000 7fe1a4d9f700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe1a00c6250 0x7fe1a0153210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41518/0 (socket says 172.21.15.72:41518) 2023-07-25T14:36:36.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:36.332+0000 7fe1a4d9f700 1 -- 172.21.15.72:0/2835296952 learned_addr learned my addr 172.21.15.72:0/2835296952 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:36.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:36.332+0000 7fe19ffff700 1 --2- 172.21.15.72:0/2835296952 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe1a0154c50 0x7fe1a00bdac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:36.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:36.332+0000 7fe1a55a0700 1 --2- 172.21.15.72:0/2835296952 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe1a00be000 0x7fe1a01ed170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:36.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:36.333+0000 7fe1a4d9f700 1 -- 172.21.15.72:0/2835296952 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe1a00be000 msgr2=0x7fe1a01ed170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:36.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:36.333+0000 7fe1a4d9f700 1 --2- 172.21.15.72:0/2835296952 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe1a00be000 0x7fe1a01ed170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:36.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:36.333+0000 7fe1a4d9f700 1 -- 172.21.15.72:0/2835296952 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe1a0154c50 msgr2=0x7fe1a00bdac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:36.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:36.333+0000 7fe1a4d9f700 1 --2- 172.21.15.72:0/2835296952 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe1a0154c50 0x7fe1a00bdac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:36.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:36.333+0000 7fe1a4d9f700 1 -- 172.21.15.72:0/2835296952 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe18c009550 con 0x7fe1a00c6250 2023-07-25T14:36:36.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:36.333+0000 7fe1a4d9f700 1 --2- 172.21.15.72:0/2835296952 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe1a00c6250 0x7fe1a0153210 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fe19400b4a0 tx=0x7fe19400b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:36.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:36.333+0000 7fe19d7fa700 1 -- 172.21.15.72:0/2835296952 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe194011830 con 0x7fe1a00c6250 2023-07-25T14:36:36.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:36.333+0000 7fe19d7fa700 1 -- 172.21.15.72:0/2835296952 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe194011990 con 0x7fe1a00c6250 2023-07-25T14:36:36.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:36.333+0000 7fe19d7fa700 1 -- 172.21.15.72:0/2835296952 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe194011d40 con 0x7fe1a00c6250 2023-07-25T14:36:36.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:36.333+0000 7fe1a5da1700 1 -- 172.21.15.72:0/2835296952 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1a01ea0f0 con 0x7fe1a00c6250 2023-07-25T14:36:36.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:36.333+0000 7fe1a5da1700 1 -- 172.21.15.72:0/2835296952 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1a01ea6b0 con 0x7fe1a00c6250 2023-07-25T14:36:36.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:36.334+0000 7fe1a5da1700 1 -- 172.21.15.72:0/2835296952 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1a01ea840 con 0x7fe1a00c6250 2023-07-25T14:36:36.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:36.334+0000 7fe19d7fa700 1 -- 172.21.15.72:0/2835296952 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe19401a400 con 0x7fe1a00c6250 2023-07-25T14:36:36.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:36.335+0000 7fe19d7fa700 1 --2- 172.21.15.72:0/2835296952 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fe18406ace0 0x7fe18406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:36.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:36.335+0000 7fe19d7fa700 1 -- 172.21.15.72:0/2835296952 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fe194089680 con 0x7fe1a00c6250 2023-07-25T14:36:36.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:36.335+0000 7fe19ffff700 1 --2- 172.21.15.72:0/2835296952 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fe18406ace0 0x7fe18406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:36.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:36.335+0000 7fe19ffff700 1 --2- 172.21.15.72:0/2835296952 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fe18406ace0 0x7fe18406d1a0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fe18c009130 tx=0x7fe18c008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:36.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:36.339+0000 7fe19d7fa700 1 -- 172.21.15.72:0/2835296952 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fe194054410 con 0x7fe1a00c6250 2023-07-25T14:36:36.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:36.531+0000 7fe1a5da1700 1 -- 172.21.15.72:0/2835296952 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe1a004e470 con 0x7fe1a00c6250 2023-07-25T14:36:36.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:36.532+0000 7fe19d7fa700 1 -- 172.21.15.72:0/2835296952 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+20109 (secure 0 0 0) 0x7fe194057a30 con 0x7fe1a00c6250 2023-07-25T14:36:36.544 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-25T14:36:36.544 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":27,"fsid":"9170db48-9170-43e8-8ccb-9813e6240906","created":"2023-07-25T14:35:21.733262+0000","modified":"2023-07-25T14:36:28.782640+0000","last_up_change":"2023-07-25T14:35:31.355010+0000","last_in_change":"2023-07-25T14:35:24.195785+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-25T14:35:32.983457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-25T14:35:33.326342+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-25T14:35:37.534158+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-25T14:35:38.891571+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-25T14:35:42.596923+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d517fdad-0bfe-49f0-89f2-9421c3761839","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6801","nonce":2475407414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6803","nonce":2475407414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6807","nonce":2475407414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6805","nonce":2475407414}]},"public_addr":"172.21.15.72:6801/2475407414","cluster_addr":"172.21.15.72:6803/2475407414","heartbeat_back_addr":"172.21.15.72:6807/2475407414","heartbeat_front_addr":"172.21.15.72:6805/2475407414","state":["exists","up"]},{"osd":1,"uuid":"e1564be3-f209-47e5-a8d0-32fc618a474f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6822","nonce":870954016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6825","nonce":870954016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6831","nonce":870954016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6827","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6829","nonce":870954016}]},"public_addr":"172.21.15.72:6822/870954016","cluster_addr":"172.21.15.72:6825/870954016","heartbeat_back_addr":"172.21.15.72:6831/870954016","heartbeat_front_addr":"172.21.15.72:6829/870954016","state":["exists","up"]},{"osd":2,"uuid":"c4647d30-ffa6-417a-9026-ef530c75910e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6809","nonce":2143129442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6811","nonce":2143129442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6815","nonce":2143129442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6813","nonce":2143129442}]},"public_addr":"172.21.15.72:6809/2143129442","cluster_addr":"172.21.15.72:6811/2143129442","heartbeat_back_addr":"172.21.15.72:6815/2143129442","heartbeat_front_addr":"172.21.15.72:6813/2143129442","state":["exists","up"]},{"osd":3,"uuid":"76c9d9a7-c2e2-4612-a58b-d6882dd76b58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6817","nonce":3404066311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6819","nonce":3404066311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6828","nonce":3404066311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6821","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6823","nonce":3404066311}]},"public_addr":"172.21.15.72:6817/3404066311","cluster_addr":"172.21.15.72:6819/3404066311","heartbeat_back_addr":"172.21.15.72:6828/3404066311","heartbeat_front_addr":"172.21.15.72:6823/3404066311","state":["exists","up"]},{"osd":4,"uuid":"7f8920dc-0ad4-4a73-ab40-65408f83eadd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6817","nonce":2381008739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6819","nonce":2381008739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6825","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6827","nonce":2381008739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6822","nonce":2381008739}]},"public_addr":"172.21.15.92:6817/2381008739","cluster_addr":"172.21.15.92:6819/2381008739","heartbeat_back_addr":"172.21.15.92:6827/2381008739","heartbeat_front_addr":"172.21.15.92:6822/2381008739","state":["exists","up"]},{"osd":5,"uuid":"56257e7c-31eb-44c5-9ec7-1318a4e0bb35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6801","nonce":2161935604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6803","nonce":2161935604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6807","nonce":2161935604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6805","nonce":2161935604}]},"public_addr":"172.21.15.92:6801/2161935604","cluster_addr":"172.21.15.92:6803/2161935604","heartbeat_back_addr":"172.21.15.92:6807/2161935604","heartbeat_front_addr":"172.21.15.92:6805/2161935604","state":["exists","up"]},{"osd":6,"uuid":"a150d3d8-a0c9-4955-968a-8d98eff4ffb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6809","nonce":3770163493}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6811","nonce":3770163493}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6815","nonce":3770163493}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6813","nonce":3770163493}]},"public_addr":"172.21.15.92:6809/3770163493","cluster_addr":"172.21.15.92:6811/3770163493","heartbeat_back_addr":"172.21.15.92:6815/3770163493","heartbeat_front_addr":"172.21.15.92:6813/3770163493","state":["exists","up"]},{"osd":7,"uuid":"07799c27-54ee-4591-a42d-a978d6b32065","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6821","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6823","nonce":2135777609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6826","nonce":2135777609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6831","nonce":2135777609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6829","nonce":2135777609}]},"public_addr":"172.21.15.92:6823/2135777609","cluster_addr":"172.21.15.92:6826/2135777609","heartbeat_back_addr":"172.21.15.92:6831/2135777609","heartbeat_front_addr":"172.21.15.92:6829/2135777609","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.345365+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.378150+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.146566+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.372172+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:30.398421+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.385632+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.465611+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.443583+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.b","mappings":[{"from":1,"to":2}]},{"pgid":"4.3f","mappings":[{"from":3,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-25T14:36:36.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:36.534+0000 7fe1a5da1700 1 -- 172.21.15.72:0/2835296952 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fe18406ace0 msgr2=0x7fe18406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:36.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:36.534+0000 7fe1a5da1700 1 --2- 172.21.15.72:0/2835296952 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fe18406ace0 0x7fe18406d1a0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fe18c009130 tx=0x7fe18c008030 comp rx=0 tx=0).stop 2023-07-25T14:36:36.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:36.534+0000 7fe1a5da1700 1 -- 172.21.15.72:0/2835296952 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe1a00c6250 msgr2=0x7fe1a0153210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:36.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:36.534+0000 7fe1a5da1700 1 --2- 172.21.15.72:0/2835296952 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe1a00c6250 0x7fe1a0153210 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fe19400b4a0 tx=0x7fe19400b7b0 comp rx=0 tx=0).stop 2023-07-25T14:36:36.548 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:36.534+0000 7fe1a5da1700 1 -- 172.21.15.72:0/2835296952 shutdown_connections 2023-07-25T14:36:36.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:36.534+0000 7fe1a5da1700 1 --2- 172.21.15.72:0/2835296952 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fe18406ace0 0x7fe18406d1a0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:36.549 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:36.534+0000 7fe1a5da1700 1 --2- 172.21.15.72:0/2835296952 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe1a00be000 0x7fe1a01ed170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:36.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:36.534+0000 7fe1a5da1700 1 --2- 172.21.15.72:0/2835296952 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe1a00c6250 0x7fe1a0153210 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:36.550 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:36.534+0000 7fe1a5da1700 1 --2- 172.21.15.72:0/2835296952 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe1a0154c50 0x7fe1a00bdac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:36.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:36.535+0000 7fe1a5da1700 1 -- 172.21.15.72:0/2835296952 >> 172.21.15.72:0/2835296952 conn(0x7fe1a00c7150 msgr2=0x7fe1a006bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:36.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:36.535+0000 7fe1a5da1700 1 -- 172.21.15.72:0/2835296952 shutdown_connections 2023-07-25T14:36:36.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:36.535+0000 7fe1a5da1700 1 -- 172.21.15.72:0/2835296952 wait complete. 2023-07-25T14:36:36.559 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-07-25T14:36:36.560 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-25T14:36:36.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:36.672+0000 7f24d643b700 1 Processor -- start 2023-07-25T14:36:36.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:36.672+0000 7f24d643b700 1 -- start start 2023-07-25T14:36:36.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:36.673+0000 7f24d643b700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f24d00a7ba0 0x7f24d0151c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:36.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:36.673+0000 7f24d643b700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24d0152190 con 0x7f24d006ea10 2023-07-25T14:36:36.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:36.673+0000 7f24d643b700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24d00ac350 con 0x7f24d006b510 2023-07-25T14:36:36.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:36.673+0000 7f24d643b700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24d00c1670 con 0x7f24d00a7ba0 2023-07-25T14:36:36.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:36.673+0000 7f24cf7fe700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f24d006ea10 0x7f24d00a7490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:60496/0 (socket says 172.21.15.72:60496) 2023-07-25T14:36:36.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:36.673+0000 7f24cf7fe700 1 -- 172.21.15.72:0/4264326617 learned_addr learned my addr 172.21.15.72:0/4264326617 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:36:36.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:36.673+0000 7f24d49d8700 1 --2- 172.21.15.72:0/4264326617 >> v2:172.21.15.92:3300/0 conn(0x7f24d00a7ba0 0x7f24d0151c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:36.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:36.673+0000 7f24ceffd700 1 -- 172.21.15.72:0/4264326617 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1844597253 0 0) 0x7f24c0001110 con 0x7f24d006ea10 2023-07-25T14:36:36.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:36.673+0000 7f24ceffd700 1 -- 172.21.15.72:0/4264326617 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f24b80035b0 con 0x7f24d006ea10 2023-07-25T14:36:36.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:36.673+0000 7f24ceffd700 1 -- 172.21.15.72:0/4264326617 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1408808982 0 0) 0x7f24b80035b0 con 0x7f24d006ea10 2023-07-25T14:36:36.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:36.673+0000 7f24ceffd700 1 -- 172.21.15.72:0/4264326617 >> v2:172.21.15.92:3300/0 conn(0x7f24d00a7ba0 msgr2=0x7f24d0151c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:36.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:36.673+0000 7f24ceffd700 1 --2- 172.21.15.72:0/4264326617 >> v2:172.21.15.92:3300/0 conn(0x7f24d00a7ba0 0x7f24d0151c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:36.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:36.673+0000 7f24ceffd700 1 -- 172.21.15.72:0/4264326617 >> v1:172.21.15.92:6789/0 conn(0x7f24d006b510 legacy=0x7f24d014e5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:36.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:36.673+0000 7f24ceffd700 1 -- 172.21.15.72:0/4264326617 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24d0066480 con 0x7f24d006ea10 2023-07-25T14:36:36.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:36.673+0000 7f24ceffd700 1 -- 172.21.15.72:0/4264326617 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2559588315 0 0) 0x7f24c0001800 con 0x7f24d006ea10 2023-07-25T14:36:36.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:36.673+0000 7f24ceffd700 1 -- 172.21.15.72:0/4264326617 >> v1:172.21.15.72:6789/0 conn(0x7f24d006ea10 legacy=0x7f24d00a7490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:36.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:36.673+0000 7f24ceffd700 1 --2- 172.21.15.72:0/4264326617 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f24b8003a00 0x7f24b8003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:36.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:36.673+0000 7f24ceffd700 1 --2- 172.21.15.72:0/4264326617 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f24b8004850 0x7f24b8004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:36.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:36.673+0000 7f24ceffd700 1 --2- 172.21.15.72:0/4264326617 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f24b8005210 0x7f24b800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:36.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:36.674+0000 7f24ceffd700 1 -- 172.21.15.72:0/4264326617 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24d00c1670 con 0x7f24b8003a00 2023-07-25T14:36:36.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:36.674+0000 7f24ceffd700 1 -- 172.21.15.72:0/4264326617 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24b800c1b0 con 0x7f24b8005210 2023-07-25T14:36:36.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:36.674+0000 7f24ceffd700 1 -- 172.21.15.72:0/4264326617 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24b800e580 con 0x7f24b8004850 2023-07-25T14:36:36.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:36.674+0000 7f24d49d8700 1 --2- 172.21.15.72:0/4264326617 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f24b8005210 0x7f24b800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:36.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:36.674+0000 7f24cffff700 1 --2- 172.21.15.72:0/4264326617 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f24b8003a00 0x7f24b8003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:36.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:36.674+0000 7f24cf7fe700 1 --2- 172.21.15.72:0/4264326617 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f24b8004850 0x7f24b8004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:36.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:36.674+0000 7f24cffff700 1 -- 172.21.15.72:0/4264326617 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f24b8004850 msgr2=0x7f24b8004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:36.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:36.674+0000 7f24cffff700 1 --2- 172.21.15.72:0/4264326617 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f24b8004850 0x7f24b8004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:36.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:36.674+0000 7f24cffff700 1 -- 172.21.15.72:0/4264326617 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f24b8005210 msgr2=0x7f24b800ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:36.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:36.674+0000 7f24cffff700 1 --2- 172.21.15.72:0/4264326617 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f24b8005210 0x7f24b800ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:36.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:36.674+0000 7f24d49d8700 1 -- 172.21.15.72:0/4264326617 reap_dead start 2023-07-25T14:36:36.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:36.674+0000 7f24cffff700 1 -- 172.21.15.72:0/4264326617 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24b80035b0 con 0x7f24b8003a00 2023-07-25T14:36:36.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:36.674+0000 7f24cffff700 1 --2- 172.21.15.72:0/4264326617 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f24b8003a00 0x7f24b8003e20 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f24c40017c0 tx=0x7f24b8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3aea4d12ed65318 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:36.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:36.674+0000 7f24ceffd700 1 -- 172.21.15.72:0/4264326617 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24c40052d0 con 0x7f24b8003a00 2023-07-25T14:36:36.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:36.674+0000 7f24ceffd700 1 -- 172.21.15.72:0/4264326617 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24c4005450 con 0x7f24b8003a00 2023-07-25T14:36:36.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:36.674+0000 7f24ceffd700 1 -- 172.21.15.72:0/4264326617 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24c40038c0 con 0x7f24b8003a00 2023-07-25T14:36:36.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:36.675+0000 7f24d643b700 1 -- 172.21.15.72:0/4264326617 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f24b8003a00 msgr2=0x7f24b8003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:36.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:36.675+0000 7f24d643b700 1 --2- 172.21.15.72:0/4264326617 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f24b8003a00 0x7f24b8003e20 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f24c40017c0 tx=0x7f24b8005880 comp rx=0 tx=0).stop 2023-07-25T14:36:36.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:36.675+0000 7f24d643b700 1 -- 172.21.15.72:0/4264326617 shutdown_connections 2023-07-25T14:36:36.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:36.675+0000 7f24d643b700 1 --2- 172.21.15.72:0/4264326617 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f24b8003a00 0x7f24b8003e20 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:36.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:36.675+0000 7f24d643b700 1 -- 172.21.15.72:0/4264326617 >> 172.21.15.72:0/4264326617 conn(0x7f24d006def0 msgr2=0x7f24d006e300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:36.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:36.675+0000 7f24d643b700 1 -- 172.21.15.72:0/4264326617 shutdown_connections 2023-07-25T14:36:36.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:36.675+0000 7f24d643b700 1 -- 172.21.15.72:0/4264326617 wait complete. 2023-07-25T14:36:36.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:36.676+0000 7f24d643b700 1 Processor -- start 2023-07-25T14:36:36.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:36.676+0000 7f24d643b700 1 -- start start 2023-07-25T14:36:36.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:36.677+0000 7f24d643b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f24b8003a00 0x7f24d00c5800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:36.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:36.677+0000 7f24d643b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f24d0142a70 0x7f24d0146b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:36.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:36.677+0000 7f24d643b700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f24d0147090 0x7f24d013ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:36.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:36.677+0000 7f24d643b700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24d0141e70 con 0x7f24d0142a70 2023-07-25T14:36:36.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:36.677+0000 7f24d643b700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24d0147530 con 0x7f24b8003a00 2023-07-25T14:36:36.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:36.677+0000 7f24d643b700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24d0141390 con 0x7f24d0147090 2023-07-25T14:36:36.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:36.677+0000 7f24cf7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f24d0142a70 0x7f24d0146b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:36.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:36.677+0000 7f24cf7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f24d0142a70 0x7f24d0146b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41540/0 (socket says 172.21.15.72:41540) 2023-07-25T14:36:36.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:36.677+0000 7f24cf7fe700 1 -- 172.21.15.72:0/153507538 learned_addr learned my addr 172.21.15.72:0/153507538 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:36.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:36.677+0000 7f24cffff700 1 --2- 172.21.15.72:0/153507538 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f24b8003a00 0x7f24d00c5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:36.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:36.677+0000 7f24d49d8700 1 --2- 172.21.15.72:0/153507538 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f24d0147090 0x7f24d013ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:36.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:36.677+0000 7f24cf7fe700 1 -- 172.21.15.72:0/153507538 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f24d0147090 msgr2=0x7f24d013ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:36.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:36.677+0000 7f24cf7fe700 1 --2- 172.21.15.72:0/153507538 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f24d0147090 0x7f24d013ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:36.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:36.677+0000 7f24cf7fe700 1 -- 172.21.15.72:0/153507538 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f24b8003a00 msgr2=0x7f24d00c5800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:36.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:36.677+0000 7f24cf7fe700 1 --2- 172.21.15.72:0/153507538 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f24b8003a00 0x7f24d00c5800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:36.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:36.677+0000 7f24cf7fe700 1 -- 172.21.15.72:0/153507538 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24d0141670 con 0x7f24d0142a70 2023-07-25T14:36:36.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:36.677+0000 7f24cf7fe700 1 --2- 172.21.15.72:0/153507538 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f24d0142a70 0x7f24d0146b50 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f24c0007290 tx=0x7f24c00075a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:36.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:36.677+0000 7f24ccff9700 1 -- 172.21.15.72:0/153507538 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24c0001250 con 0x7f24d0142a70 2023-07-25T14:36:36.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:36.678+0000 7f24ccff9700 1 -- 172.21.15.72:0/153507538 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24c000f6c0 con 0x7f24d0142a70 2023-07-25T14:36:36.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:36.678+0000 7f24ccff9700 1 -- 172.21.15.72:0/153507538 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24c000fa70 con 0x7f24d0142a70 2023-07-25T14:36:36.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:36.678+0000 7f24d643b700 1 -- 172.21.15.72:0/153507538 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24d0141950 con 0x7f24d0142a70 2023-07-25T14:36:36.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:36.678+0000 7f24d643b700 1 -- 172.21.15.72:0/153507538 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24d0141020 con 0x7f24d0142a70 2023-07-25T14:36:36.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:36.678+0000 7f24d643b700 1 -- 172.21.15.72:0/153507538 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24d004e470 con 0x7f24d0142a70 2023-07-25T14:36:36.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:36.679+0000 7f24ccff9700 1 -- 172.21.15.72:0/153507538 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f24c000fbd0 con 0x7f24d0142a70 2023-07-25T14:36:36.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:36.679+0000 7f24ccff9700 1 --2- 172.21.15.72:0/153507538 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f24bc06ace0 0x7f24bc06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:36.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:36.679+0000 7f24ccff9700 1 -- 172.21.15.72:0/153507538 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f24c0089520 con 0x7f24d0142a70 2023-07-25T14:36:36.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:36.679+0000 7f24cffff700 1 --2- 172.21.15.72:0/153507538 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f24bc06ace0 0x7f24bc06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:36.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:36.680+0000 7f24cffff700 1 --2- 172.21.15.72:0/153507538 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f24bc06ace0 0x7f24bc06d1a0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f24c4005040 tx=0x7f24c4009030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:36.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:36.684+0000 7f24ccff9700 1 -- 172.21.15.72:0/153507538 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f24c00542a0 con 0x7f24d0142a70 2023-07-25T14:36:36.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:36.914+0000 7f24d643b700 1 -- 172.21.15.72:0/153507538 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f24d0147670 con 0x7f24d0142a70 2023-07-25T14:36:36.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:36.914+0000 7f24ccff9700 1 -- 172.21.15.72:0/153507538 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4664 (secure 0 0 0) 0x7f24c00578c0 con 0x7f24d0142a70 2023-07-25T14:36:36.927 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-25T14:36:36.927 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4220,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6836/4293785067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":4293785067},{"type":"v1","addr":"172.21.15.72:6836","nonce":4293785067}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4229,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6834/681290755","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":681290755},{"type":"v1","addr":"172.21.15.92:6834","nonce":681290755}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6837/3376375642","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6835","nonce":3376375642},{"type":"v1","addr":"172.21.15.72:6837","nonce":3376375642}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-25T14:35:39.939860+0000","modified":"2023-07-25T14:35:59.629155+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.92:6835/2045555979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6833","nonce":2045555979},{"type":"v1","addr":"172.21.15.92:6835","nonce":2045555979}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-25T14:36:36.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:36.917+0000 7f24d643b700 1 -- 172.21.15.72:0/153507538 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f24bc06ace0 msgr2=0x7f24bc06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:36.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:36.917+0000 7f24d643b700 1 --2- 172.21.15.72:0/153507538 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f24bc06ace0 0x7f24bc06d1a0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f24c4005040 tx=0x7f24c4009030 comp rx=0 tx=0).stop 2023-07-25T14:36:36.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:36.917+0000 7f24d643b700 1 -- 172.21.15.72:0/153507538 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f24d0142a70 msgr2=0x7f24d0146b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:36.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:36.917+0000 7f24d643b700 1 --2- 172.21.15.72:0/153507538 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f24d0142a70 0x7f24d0146b50 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f24c0007290 tx=0x7f24c00075a0 comp rx=0 tx=0).stop 2023-07-25T14:36:36.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:36.917+0000 7f24d643b700 1 -- 172.21.15.72:0/153507538 shutdown_connections 2023-07-25T14:36:36.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:36.917+0000 7f24d643b700 1 --2- 172.21.15.72:0/153507538 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f24bc06ace0 0x7f24bc06d1a0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:36.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:36.917+0000 7f24d643b700 1 --2- 172.21.15.72:0/153507538 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f24d0147090 0x7f24d013ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:36.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:36.917+0000 7f24d643b700 1 --2- 172.21.15.72:0/153507538 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f24b8003a00 0x7f24d00c5800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:36.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:36.917+0000 7f24d643b700 1 --2- 172.21.15.72:0/153507538 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f24d0142a70 0x7f24d0146b50 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:36.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:36.917+0000 7f24d643b700 1 -- 172.21.15.72:0/153507538 >> 172.21.15.72:0/153507538 conn(0x7f24d006def0 msgr2=0x7f24d0148090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:36.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:36.917+0000 7f24d643b700 1 -- 172.21.15.72:0/153507538 shutdown_connections 2023-07-25T14:36:36.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:36.917+0000 7f24d643b700 1 -- 172.21.15.72:0/153507538 wait complete. 2023-07-25T14:36:36.933 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 8 2023-07-25T14:36:36.941 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-25T14:36:37.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.049+0000 7f91c138f700 1 Processor -- start 2023-07-25T14:36:37.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.049+0000 7f91c138f700 1 -- start start 2023-07-25T14:36:37.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.050+0000 7f91c138f700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f91bc1518c0 0x7f91bc06b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:37.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.050+0000 7f91c138f700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f91bc154df0 0x7f91bc158160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:37.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.050+0000 7f91c138f700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91bc157cd0 con 0x7f91bc0c4370 2023-07-25T14:36:37.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.050+0000 7f91c138f700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91bc0c2310 con 0x7f91bc1518c0 2023-07-25T14:36:37.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.050+0000 7f91c138f700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91bc1552a0 con 0x7f91bc154df0 2023-07-25T14:36:37.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.050+0000 7f91bb7fe700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f91bc0c4370 0x7f91bc06ee10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:60514/0 (socket says 172.21.15.72:60514) 2023-07-25T14:36:37.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.050+0000 7f91bb7fe700 1 -- 172.21.15.72:0/3032883677 learned_addr learned my addr 172.21.15.72:0/3032883677 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:36:37.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.051+0000 7f91ba7fc700 1 --2- 172.21.15.72:0/3032883677 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f91bc154df0 0x7f91bc158160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:37.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.051+0000 7f91baffd700 1 --2- 172.21.15.72:0/3032883677 >> v2:172.21.15.92:3300/0 conn(0x7f91bc1518c0 0x7f91bc06b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:37.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.051+0000 7f91b9ffb700 1 -- 172.21.15.72:0/3032883677 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2354332592 0 0) 0x7f91bc157cd0 con 0x7f91bc0c4370 2023-07-25T14:36:37.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.051+0000 7f91b9ffb700 1 -- 172.21.15.72:0/3032883677 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f91a40035b0 con 0x7f91bc0c4370 2023-07-25T14:36:37.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.051+0000 7f91b9ffb700 1 -- 172.21.15.72:0/3032883677 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 410317472 0 0) 0x7f91a40035b0 con 0x7f91bc0c4370 2023-07-25T14:36:37.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.051+0000 7f91b9ffb700 1 -- 172.21.15.72:0/3032883677 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f91bc154df0 msgr2=0x7f91bc158160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:37.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.051+0000 7f91b9ffb700 1 --2- 172.21.15.72:0/3032883677 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f91bc154df0 0x7f91bc158160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:37.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.051+0000 7f91b9ffb700 1 -- 172.21.15.72:0/3032883677 >> v2:172.21.15.92:3300/0 conn(0x7f91bc1518c0 msgr2=0x7f91bc06b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:37.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.051+0000 7f91b9ffb700 1 --2- 172.21.15.72:0/3032883677 >> v2:172.21.15.92:3300/0 conn(0x7f91bc1518c0 0x7f91bc06b2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:37.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.051+0000 7f91b9ffb700 1 -- 172.21.15.72:0/3032883677 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91bc0c2520 con 0x7f91bc0c4370 2023-07-25T14:36:37.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.051+0000 7f91b9ffb700 1 -- 172.21.15.72:0/3032883677 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2559588315 0 0) 0x7f91b4001a40 con 0x7f91bc0c4370 2023-07-25T14:36:37.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.051+0000 7f91b9ffb700 1 -- 172.21.15.72:0/3032883677 >> v1:172.21.15.72:6789/0 conn(0x7f91bc0c4370 legacy=0x7f91bc06ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:37.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.051+0000 7f91b9ffb700 1 --2- 172.21.15.72:0/3032883677 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f91a4003a00 0x7f91a4003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:37.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.051+0000 7f91b9ffb700 1 --2- 172.21.15.72:0/3032883677 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f91bc154df0 0x7f91a4004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:37.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.051+0000 7f91b9ffb700 1 --2- 172.21.15.72:0/3032883677 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f91a4004d90 0x7f91a4005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:37.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.051+0000 7f91b9ffb700 1 -- 172.21.15.72:0/3032883677 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91bc0c2310 con 0x7f91a4003a00 2023-07-25T14:36:37.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.051+0000 7f91b9ffb700 1 -- 172.21.15.72:0/3032883677 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91bc1552a0 con 0x7f91a4004d90 2023-07-25T14:36:37.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.051+0000 7f91b9ffb700 1 -- 172.21.15.72:0/3032883677 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91a400ba10 con 0x7f91bc154df0 2023-07-25T14:36:37.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.051+0000 7f91baffd700 1 --2- 172.21.15.72:0/3032883677 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f91a4003a00 0x7f91a4003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:37.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.051+0000 7f91ba7fc700 1 --2- 172.21.15.72:0/3032883677 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f91bc154df0 0x7f91a4004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:37.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.051+0000 7f91bb7fe700 1 --2- 172.21.15.72:0/3032883677 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f91a4004d90 0x7f91a4005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:37.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.051+0000 7f91baffd700 1 -- 172.21.15.72:0/3032883677 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f91bc154df0 msgr2=0x7f91a4004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:37.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.051+0000 7f91baffd700 1 --2- 172.21.15.72:0/3032883677 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f91bc154df0 0x7f91a4004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:37.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.051+0000 7f91baffd700 1 -- 172.21.15.72:0/3032883677 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f91a4004d90 msgr2=0x7f91a4005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:37.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.051+0000 7f91baffd700 1 --2- 172.21.15.72:0/3032883677 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f91a4004d90 0x7f91a4005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:37.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.051+0000 7f91baffd700 1 -- 172.21.15.72:0/3032883677 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91a40035b0 con 0x7f91a4003a00 2023-07-25T14:36:37.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.051+0000 7f91baffd700 1 --2- 172.21.15.72:0/3032883677 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f91a4003a00 0x7f91a4003e20 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f91b0009b60 tx=0x7f91a4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ec644213a2ef288 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:37.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.052+0000 7f91b9ffb700 1 -- 172.21.15.72:0/3032883677 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91b000e6c0 con 0x7f91a4003a00 2023-07-25T14:36:37.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.052+0000 7f91b9ffb700 1 -- 172.21.15.72:0/3032883677 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91b000e820 con 0x7f91a4003a00 2023-07-25T14:36:37.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.052+0000 7f91b9ffb700 1 -- 172.21.15.72:0/3032883677 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91b000eb90 con 0x7f91a4003a00 2023-07-25T14:36:37.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.052+0000 7f91c138f700 1 -- 172.21.15.72:0/3032883677 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f91a4003a00 msgr2=0x7f91a4003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:37.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.052+0000 7f91c138f700 1 --2- 172.21.15.72:0/3032883677 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f91a4003a00 0x7f91a4003e20 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f91b0009b60 tx=0x7f91a4005880 comp rx=0 tx=0).stop 2023-07-25T14:36:37.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.052+0000 7f91bb7fe700 1 -- 172.21.15.72:0/3032883677 reap_dead start 2023-07-25T14:36:37.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.052+0000 7f91c138f700 1 -- 172.21.15.72:0/3032883677 shutdown_connections 2023-07-25T14:36:37.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.052+0000 7f91c138f700 1 -- 172.21.15.72:0/3032883677 >> 172.21.15.72:0/3032883677 conn(0x7f91bc06a8d0 msgr2=0x7f91bc0a94e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:37.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.052+0000 7f91c138f700 1 -- 172.21.15.72:0/3032883677 shutdown_connections 2023-07-25T14:36:37.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.052+0000 7f91c138f700 1 -- 172.21.15.72:0/3032883677 wait complete. 2023-07-25T14:36:37.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.053+0000 7f91c138f700 1 Processor -- start 2023-07-25T14:36:37.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.054+0000 7f91c138f700 1 -- start start 2023-07-25T14:36:37.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.054+0000 7f91c138f700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f91a4003a00 0x7f91bc0a9ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:37.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.054+0000 7f91c138f700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f91bc153730 0x7f91bc1ecdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:37.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.054+0000 7f91c138f700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f91bc1eaa80 0x7f91bc14e830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:37.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.054+0000 7f91c138f700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91bc1ed730 con 0x7f91bc153730 2023-07-25T14:36:37.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.054+0000 7f91c138f700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91bc152c50 con 0x7f91bc1eaa80 2023-07-25T14:36:37.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.054+0000 7f91c138f700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91bc152f30 con 0x7f91a4003a00 2023-07-25T14:36:37.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.054+0000 7f91ba7fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f91bc153730 0x7f91bc1ecdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:37.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.054+0000 7f91ba7fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f91bc153730 0x7f91bc1ecdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41558/0 (socket says 172.21.15.72:41558) 2023-07-25T14:36:37.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.054+0000 7f91ba7fc700 1 -- 172.21.15.72:0/920049520 learned_addr learned my addr 172.21.15.72:0/920049520 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:37.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.054+0000 7f91baffd700 1 --2- 172.21.15.72:0/920049520 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f91a4003a00 0x7f91bc0a9ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:37.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.054+0000 7f91bb7fe700 1 --2- 172.21.15.72:0/920049520 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f91bc1eaa80 0x7f91bc14e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:37.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.055+0000 7f91ba7fc700 1 -- 172.21.15.72:0/920049520 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f91a4003a00 msgr2=0x7f91bc0a9ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:37.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.055+0000 7f91ba7fc700 1 --2- 172.21.15.72:0/920049520 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f91a4003a00 0x7f91bc0a9ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:37.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.055+0000 7f91ba7fc700 1 -- 172.21.15.72:0/920049520 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f91bc1eaa80 msgr2=0x7f91bc14e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:37.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.055+0000 7f91ba7fc700 1 --2- 172.21.15.72:0/920049520 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f91bc1eaa80 0x7f91bc14e830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:37.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.055+0000 7f91ba7fc700 1 -- 172.21.15.72:0/920049520 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91bc153210 con 0x7f91bc153730 2023-07-25T14:36:37.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.055+0000 7f91ba7fc700 1 --2- 172.21.15.72:0/920049520 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f91bc153730 0x7f91bc1ecdf0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f91ac011660 tx=0x7f91ac011970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:37.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.055+0000 7f91a37fe700 1 -- 172.21.15.72:0/920049520 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91ac015930 con 0x7f91bc153730 2023-07-25T14:36:37.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.055+0000 7f91a37fe700 1 -- 172.21.15.72:0/920049520 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91ac015a90 con 0x7f91bc153730 2023-07-25T14:36:37.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.055+0000 7f91c138f700 1 -- 172.21.15.72:0/920049520 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91bc157190 con 0x7f91bc153730 2023-07-25T14:36:37.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.055+0000 7f91a37fe700 1 -- 172.21.15.72:0/920049520 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91ac015e00 con 0x7f91bc153730 2023-07-25T14:36:37.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.055+0000 7f91c138f700 1 -- 172.21.15.72:0/920049520 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91bc1ed330 con 0x7f91bc153730 2023-07-25T14:36:37.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.056+0000 7f91c138f700 1 -- 172.21.15.72:0/920049520 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91bc153580 con 0x7f91bc153730 2023-07-25T14:36:37.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.056+0000 7f91a37fe700 1 -- 172.21.15.72:0/920049520 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f91ac0143e0 con 0x7f91bc153730 2023-07-25T14:36:37.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.057+0000 7f91a37fe700 1 --2- 172.21.15.72:0/920049520 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f91a806ace0 0x7f91a806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:37.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.057+0000 7f91baffd700 1 --2- 172.21.15.72:0/920049520 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f91a806ace0 0x7f91a806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:37.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.057+0000 7f91a37fe700 1 -- 172.21.15.72:0/920049520 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f91ac089bb0 con 0x7f91bc153730 2023-07-25T14:36:37.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.057+0000 7f91baffd700 1 --2- 172.21.15.72:0/920049520 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f91a806ace0 0x7f91a806d1a0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f91b00090b0 tx=0x7f91b001f040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:37.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.061+0000 7f91a37fe700 1 -- 172.21.15.72:0/920049520 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f91ac0583b0 con 0x7f91bc153730 2023-07-25T14:36:37.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.292+0000 7f91c138f700 1 -- 172.21.15.72:0/920049520 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f91bc1533a0 con 0x7f91bc153730 2023-07-25T14:36:37.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.292+0000 7f91a37fe700 1 -- 172.21.15.72:0/920049520 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4664 (secure 0 0 0) 0x7f91ac057f40 con 0x7f91bc153730 2023-07-25T14:36:37.303 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-25T14:36:37.304 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4220,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6836/4293785067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":4293785067},{"type":"v1","addr":"172.21.15.72:6836","nonce":4293785067}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4229,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6834/681290755","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":681290755},{"type":"v1","addr":"172.21.15.92:6834","nonce":681290755}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6837/3376375642","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6835","nonce":3376375642},{"type":"v1","addr":"172.21.15.72:6837","nonce":3376375642}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-25T14:35:39.939860+0000","modified":"2023-07-25T14:35:59.629155+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.92:6835/2045555979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6833","nonce":2045555979},{"type":"v1","addr":"172.21.15.92:6835","nonce":2045555979}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-25T14:36:37.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.294+0000 7f91c138f700 1 -- 172.21.15.72:0/920049520 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f91a806ace0 msgr2=0x7f91a806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:37.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.294+0000 7f91c138f700 1 --2- 172.21.15.72:0/920049520 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f91a806ace0 0x7f91a806d1a0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f91b00090b0 tx=0x7f91b001f040 comp rx=0 tx=0).stop 2023-07-25T14:36:37.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.294+0000 7f91c138f700 1 -- 172.21.15.72:0/920049520 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f91bc153730 msgr2=0x7f91bc1ecdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:37.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.294+0000 7f91c138f700 1 --2- 172.21.15.72:0/920049520 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f91bc153730 0x7f91bc1ecdf0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f91ac011660 tx=0x7f91ac011970 comp rx=0 tx=0).stop 2023-07-25T14:36:37.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.294+0000 7f91c138f700 1 -- 172.21.15.72:0/920049520 shutdown_connections 2023-07-25T14:36:37.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.294+0000 7f91c138f700 1 --2- 172.21.15.72:0/920049520 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f91a806ace0 0x7f91a806d1a0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:37.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.294+0000 7f91c138f700 1 --2- 172.21.15.72:0/920049520 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f91a4003a00 0x7f91bc0a9ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:37.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.294+0000 7f91c138f700 1 --2- 172.21.15.72:0/920049520 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f91bc1eaa80 0x7f91bc14e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:37.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.294+0000 7f91c138f700 1 --2- 172.21.15.72:0/920049520 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f91bc153730 0x7f91bc1ecdf0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:37.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.294+0000 7f91c138f700 1 -- 172.21.15.72:0/920049520 >> 172.21.15.72:0/920049520 conn(0x7f91bc06a8d0 msgr2=0x7f91bc155eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:37.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.294+0000 7f91c138f700 1 -- 172.21.15.72:0/920049520 shutdown_connections 2023-07-25T14:36:37.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.294+0000 7f91c138f700 1 -- 172.21.15.72:0/920049520 wait complete. 2023-07-25T14:36:37.307 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 8 2023-07-25T14:36:37.317 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-25T14:36:37.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.426+0000 7fc04c496700 1 Processor -- start 2023-07-25T14:36:37.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.427+0000 7fc04c496700 1 -- start start 2023-07-25T14:36:37.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.427+0000 7fc04c496700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc04414dea0 0x7fc04406a190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:37.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.427+0000 7fc04c496700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0440a8230 con 0x7fc0440a86c0 2023-07-25T14:36:37.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.427+0000 7fc04c496700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0440a7c20 con 0x7fc044072300 2023-07-25T14:36:37.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.427+0000 7fc04c496700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0440c18d0 con 0x7fc04414dea0 2023-07-25T14:36:37.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.428+0000 7fc04aa33700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fc0440a86c0 0x7fc0440c0bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:60536/0 (socket says 172.21.15.72:60536) 2023-07-25T14:36:37.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.428+0000 7fc04aa33700 1 -- 172.21.15.72:0/1215280666 learned_addr learned my addr 172.21.15.72:0/1215280666 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:36:37.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.428+0000 7fc04a232700 1 --2- 172.21.15.72:0/1215280666 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc04414dea0 0x7fc04406a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:37.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.428+0000 7fc049230700 1 -- 172.21.15.72:0/1215280666 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3877530575 0 0) 0x7fc0440a8230 con 0x7fc0440a86c0 2023-07-25T14:36:37.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.428+0000 7fc049230700 1 -- 172.21.15.72:0/1215280666 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc0300035b0 con 0x7fc0440a86c0 2023-07-25T14:36:37.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.428+0000 7fc04a232700 1 -- 172.21.15.72:0/1215280666 >> v1:172.21.15.92:6789/0 conn(0x7fc044072300 legacy=0x7fc044151200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:37.450 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.428+0000 7fc04a232700 1 -- 172.21.15.72:0/1215280666 >> v1:172.21.15.72:6789/0 conn(0x7fc0440a86c0 legacy=0x7fc0440c0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:37.450 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.428+0000 7fc049230700 1 -- 172.21.15.72:0/1215280666 <== mon.1 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3072591189 0 0) 0x7fc0440a7c20 con 0x7fc044072300 2023-07-25T14:36:37.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.428+0000 7fc04a232700 1 -- 172.21.15.72:0/1215280666 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc04406ec20 con 0x7fc04414dea0 2023-07-25T14:36:37.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.428+0000 7fc04a232700 1 --2- 172.21.15.72:0/1215280666 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc04414dea0 0x7fc04406a190 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fc038009870 tx=0x7fc038009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a33746e6f7456862 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:37.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.428+0000 7fc049230700 1 -- 172.21.15.72:0/1215280666 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc038011830 con 0x7fc04414dea0 2023-07-25T14:36:37.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.428+0000 7fc049230700 1 -- 172.21.15.72:0/1215280666 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc038011990 con 0x7fc04414dea0 2023-07-25T14:36:37.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.428+0000 7fc049230700 1 -- 172.21.15.72:0/1215280666 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc038011d20 con 0x7fc04414dea0 2023-07-25T14:36:37.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.429+0000 7fc04c496700 1 -- 172.21.15.72:0/1215280666 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc04414dea0 msgr2=0x7fc04406a190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:37.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.429+0000 7fc04c496700 1 --2- 172.21.15.72:0/1215280666 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc04414dea0 0x7fc04406a190 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fc038009870 tx=0x7fc038009b80 comp rx=0 tx=0).stop 2023-07-25T14:36:37.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.429+0000 7fc04c496700 1 -- 172.21.15.72:0/1215280666 shutdown_connections 2023-07-25T14:36:37.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.429+0000 7fc04c496700 1 --2- 172.21.15.72:0/1215280666 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc04414dea0 0x7fc04406a190 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:37.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.429+0000 7fc04c496700 1 -- 172.21.15.72:0/1215280666 >> 172.21.15.72:0/1215280666 conn(0x7fc04406def0 msgr2=0x7fc04406e300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:37.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.429+0000 7fc04c496700 1 -- 172.21.15.72:0/1215280666 shutdown_connections 2023-07-25T14:36:37.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.429+0000 7fc04c496700 1 -- 172.21.15.72:0/1215280666 wait complete. 2023-07-25T14:36:37.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.430+0000 7fc04c496700 1 Processor -- start 2023-07-25T14:36:37.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.430+0000 7fc04c496700 1 -- start start 2023-07-25T14:36:37.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.431+0000 7fc04c496700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc044072300 0x7fc0441e4c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:37.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.431+0000 7fc04c496700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc0440a86c0 0x7fc04413a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:37.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.431+0000 7fc04c496700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc04414dea0 0x7fc0441eaa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:37.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.431+0000 7fc04c496700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc04413b580 con 0x7fc0440a86c0 2023-07-25T14:36:37.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.431+0000 7fc04c496700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0441eb790 con 0x7fc04414dea0 2023-07-25T14:36:37.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.431+0000 7fc04c496700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc044133c60 con 0x7fc044072300 2023-07-25T14:36:37.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.431+0000 7fc049a31700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc0440a86c0 0x7fc04413a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:37.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.431+0000 7fc049a31700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc0440a86c0 0x7fc04413a160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41572/0 (socket says 172.21.15.72:41572) 2023-07-25T14:36:37.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.431+0000 7fc049a31700 1 -- 172.21.15.72:0/1362087338 learned_addr learned my addr 172.21.15.72:0/1362087338 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:37.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.431+0000 7fc04a232700 1 --2- 172.21.15.72:0/1362087338 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc044072300 0x7fc0441e4c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:37.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.431+0000 7fc04aa33700 1 --2- 172.21.15.72:0/1362087338 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc04414dea0 0x7fc0441eaa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:37.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.431+0000 7fc049a31700 1 -- 172.21.15.72:0/1362087338 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc044072300 msgr2=0x7fc0441e4c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:37.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.431+0000 7fc049a31700 1 --2- 172.21.15.72:0/1362087338 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc044072300 0x7fc0441e4c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:37.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.431+0000 7fc049a31700 1 -- 172.21.15.72:0/1362087338 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc04414dea0 msgr2=0x7fc0441eaa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:37.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.431+0000 7fc049a31700 1 --2- 172.21.15.72:0/1362087338 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc04414dea0 0x7fc0441eaa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:37.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.431+0000 7fc049a31700 1 -- 172.21.15.72:0/1362087338 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0380094a0 con 0x7fc0440a86c0 2023-07-25T14:36:37.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.431+0000 7fc04aa33700 1 --2- 172.21.15.72:0/1362087338 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc04414dea0 0x7fc0441eaa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-25T14:36:37.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.431+0000 7fc049a31700 1 --2- 172.21.15.72:0/1362087338 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc0440a86c0 0x7fc04413a160 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fc04000c450 tx=0x7fc04000c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:37.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.431+0000 7fc036ffd700 1 -- 172.21.15.72:0/1362087338 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0400054e0 con 0x7fc0440a86c0 2023-07-25T14:36:37.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.432+0000 7fc036ffd700 1 -- 172.21.15.72:0/1362087338 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc040003680 con 0x7fc0440a86c0 2023-07-25T14:36:37.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.432+0000 7fc04c496700 1 -- 172.21.15.72:0/1362087338 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0441eb4b0 con 0x7fc0440a86c0 2023-07-25T14:36:37.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.432+0000 7fc036ffd700 1 -- 172.21.15.72:0/1362087338 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc040003a30 con 0x7fc0440a86c0 2023-07-25T14:36:37.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.432+0000 7fc04c496700 1 -- 172.21.15.72:0/1362087338 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc04413a6a0 con 0x7fc0440a86c0 2023-07-25T14:36:37.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.432+0000 7fc04c496700 1 -- 172.21.15.72:0/1362087338 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc04413a860 con 0x7fc0440a86c0 2023-07-25T14:36:37.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.433+0000 7fc036ffd700 1 -- 172.21.15.72:0/1362087338 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc040003b90 con 0x7fc0440a86c0 2023-07-25T14:36:37.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.433+0000 7fc036ffd700 1 --2- 172.21.15.72:0/1362087338 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fc02806ace0 0x7fc02806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:37.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.433+0000 7fc036ffd700 1 -- 172.21.15.72:0/1362087338 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fc040088c40 con 0x7fc0440a86c0 2023-07-25T14:36:37.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.433+0000 7fc04a232700 1 --2- 172.21.15.72:0/1362087338 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fc02806ace0 0x7fc02806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:37.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.434+0000 7fc04a232700 1 --2- 172.21.15.72:0/1362087338 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fc02806ace0 0x7fc02806d1a0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fc0380097c0 tx=0x7fc03801c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:37.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.438+0000 7fc036ffd700 1 -- 172.21.15.72:0/1362087338 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fc0400539d0 con 0x7fc0440a86c0 2023-07-25T14:36:37.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.625+0000 7fc04c496700 1 -- 172.21.15.72:0/1362087338 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc044133750 con 0x7fc0440a86c0 2023-07-25T14:36:37.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.626+0000 7fc036ffd700 1 -- 172.21.15.72:0/1362087338 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+20109 (secure 0 0 0) 0x7fc044133750 con 0x7fc0440a86c0 2023-07-25T14:36:37.638 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-25T14:36:37.638 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":27,"fsid":"9170db48-9170-43e8-8ccb-9813e6240906","created":"2023-07-25T14:35:21.733262+0000","modified":"2023-07-25T14:36:28.782640+0000","last_up_change":"2023-07-25T14:35:31.355010+0000","last_in_change":"2023-07-25T14:35:24.195785+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-25T14:35:32.983457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-25T14:35:33.326342+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-25T14:35:37.534158+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-25T14:35:38.891571+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-25T14:35:42.596923+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d517fdad-0bfe-49f0-89f2-9421c3761839","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6801","nonce":2475407414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6803","nonce":2475407414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6807","nonce":2475407414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6805","nonce":2475407414}]},"public_addr":"172.21.15.72:6801/2475407414","cluster_addr":"172.21.15.72:6803/2475407414","heartbeat_back_addr":"172.21.15.72:6807/2475407414","heartbeat_front_addr":"172.21.15.72:6805/2475407414","state":["exists","up"]},{"osd":1,"uuid":"e1564be3-f209-47e5-a8d0-32fc618a474f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6822","nonce":870954016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6825","nonce":870954016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6831","nonce":870954016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6827","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6829","nonce":870954016}]},"public_addr":"172.21.15.72:6822/870954016","cluster_addr":"172.21.15.72:6825/870954016","heartbeat_back_addr":"172.21.15.72:6831/870954016","heartbeat_front_addr":"172.21.15.72:6829/870954016","state":["exists","up"]},{"osd":2,"uuid":"c4647d30-ffa6-417a-9026-ef530c75910e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6809","nonce":2143129442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6811","nonce":2143129442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6815","nonce":2143129442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6813","nonce":2143129442}]},"public_addr":"172.21.15.72:6809/2143129442","cluster_addr":"172.21.15.72:6811/2143129442","heartbeat_back_addr":"172.21.15.72:6815/2143129442","heartbeat_front_addr":"172.21.15.72:6813/2143129442","state":["exists","up"]},{"osd":3,"uuid":"76c9d9a7-c2e2-4612-a58b-d6882dd76b58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6817","nonce":3404066311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6819","nonce":3404066311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6828","nonce":3404066311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6821","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6823","nonce":3404066311}]},"public_addr":"172.21.15.72:6817/3404066311","cluster_addr":"172.21.15.72:6819/3404066311","heartbeat_back_addr":"172.21.15.72:6828/3404066311","heartbeat_front_addr":"172.21.15.72:6823/3404066311","state":["exists","up"]},{"osd":4,"uuid":"7f8920dc-0ad4-4a73-ab40-65408f83eadd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6817","nonce":2381008739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6819","nonce":2381008739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6825","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6827","nonce":2381008739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6822","nonce":2381008739}]},"public_addr":"172.21.15.92:6817/2381008739","cluster_addr":"172.21.15.92:6819/2381008739","heartbeat_back_addr":"172.21.15.92:6827/2381008739","heartbeat_front_addr":"172.21.15.92:6822/2381008739","state":["exists","up"]},{"osd":5,"uuid":"56257e7c-31eb-44c5-9ec7-1318a4e0bb35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6801","nonce":2161935604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6803","nonce":2161935604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6807","nonce":2161935604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6805","nonce":2161935604}]},"public_addr":"172.21.15.92:6801/2161935604","cluster_addr":"172.21.15.92:6803/2161935604","heartbeat_back_addr":"172.21.15.92:6807/2161935604","heartbeat_front_addr":"172.21.15.92:6805/2161935604","state":["exists","up"]},{"osd":6,"uuid":"a150d3d8-a0c9-4955-968a-8d98eff4ffb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6809","nonce":3770163493}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6811","nonce":3770163493}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6815","nonce":3770163493}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6813","nonce":3770163493}]},"public_addr":"172.21.15.92:6809/3770163493","cluster_addr":"172.21.15.92:6811/3770163493","heartbeat_back_addr":"172.21.15.92:6815/3770163493","heartbeat_front_addr":"172.21.15.92:6813/3770163493","state":["exists","up"]},{"osd":7,"uuid":"07799c27-54ee-4591-a42d-a978d6b32065","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6821","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6823","nonce":2135777609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6826","nonce":2135777609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6831","nonce":2135777609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6829","nonce":2135777609}]},"public_addr":"172.21.15.92:6823/2135777609","cluster_addr":"172.21.15.92:6826/2135777609","heartbeat_back_addr":"172.21.15.92:6831/2135777609","heartbeat_front_addr":"172.21.15.92:6829/2135777609","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.345365+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.378150+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.146566+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.372172+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:30.398421+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.385632+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.465611+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.443583+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.b","mappings":[{"from":1,"to":2}]},{"pgid":"4.3f","mappings":[{"from":3,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-25T14:36:37.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.629+0000 7fc04c496700 1 -- 172.21.15.72:0/1362087338 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fc02806ace0 msgr2=0x7fc02806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:37.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.629+0000 7fc04c496700 1 --2- 172.21.15.72:0/1362087338 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fc02806ace0 0x7fc02806d1a0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fc0380097c0 tx=0x7fc03801c040 comp rx=0 tx=0).stop 2023-07-25T14:36:37.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.629+0000 7fc04c496700 1 -- 172.21.15.72:0/1362087338 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc0440a86c0 msgr2=0x7fc04413a160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:37.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.629+0000 7fc04c496700 1 --2- 172.21.15.72:0/1362087338 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc0440a86c0 0x7fc04413a160 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fc04000c450 tx=0x7fc04000c810 comp rx=0 tx=0).stop 2023-07-25T14:36:37.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.629+0000 7fc04c496700 1 -- 172.21.15.72:0/1362087338 shutdown_connections 2023-07-25T14:36:37.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.629+0000 7fc04c496700 1 --2- 172.21.15.72:0/1362087338 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fc02806ace0 0x7fc02806d1a0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:37.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.629+0000 7fc04c496700 1 --2- 172.21.15.72:0/1362087338 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc044072300 0x7fc0441e4c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:37.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.629+0000 7fc04c496700 1 --2- 172.21.15.72:0/1362087338 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc04414dea0 0x7fc0441eaa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:37.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.629+0000 7fc04c496700 1 --2- 172.21.15.72:0/1362087338 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc0440a86c0 0x7fc04413a160 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:37.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.629+0000 7fc04c496700 1 -- 172.21.15.72:0/1362087338 >> 172.21.15.72:0/1362087338 conn(0x7fc04406def0 msgr2=0x7fc04413f800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:37.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.629+0000 7fc04c496700 1 -- 172.21.15.72:0/1362087338 shutdown_connections 2023-07-25T14:36:37.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.629+0000 7fc04c496700 1 -- 172.21.15.72:0/1362087338 wait complete. 2023-07-25T14:36:37.652 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-07-25T14:36:37.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.762+0000 7f8b66064700 1 Processor -- start 2023-07-25T14:36:37.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.762+0000 7f8b66064700 1 -- start start 2023-07-25T14:36:37.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.763+0000 7f8b66064700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8b60151980 0x7f8b600c12b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:37.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.763+0000 7f8b66064700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b6006eaf0 con 0x7f8b6006e580 2023-07-25T14:36:37.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.763+0000 7f8b66064700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b6006edd0 con 0x7f8b600c17f0 2023-07-25T14:36:37.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.763+0000 7f8b66064700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b6006f770 con 0x7f8b60151980 2023-07-25T14:36:37.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.763+0000 7f8b5ffff700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f8b6006e580 0x7f8b600c5380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:60550/0 (socket says 172.21.15.72:60550) 2023-07-25T14:36:37.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.763+0000 7f8b5ffff700 1 -- 172.21.15.72:0/415511478 learned_addr learned my addr 172.21.15.72:0/415511478 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:36:37.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.763+0000 7f8b5f7fe700 1 --2- 172.21.15.72:0/415511478 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8b60151980 0x7f8b600c12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:37.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.763+0000 7f8b5e7fc700 1 -- 172.21.15.72:0/415511478 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4238049120 0 0) 0x7f8b6006eaf0 con 0x7f8b6006e580 2023-07-25T14:36:37.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.763+0000 7f8b5e7fc700 1 -- 172.21.15.72:0/415511478 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8b480035b0 con 0x7f8b6006e580 2023-07-25T14:36:37.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.764+0000 7f8b5e7fc700 1 -- 172.21.15.72:0/415511478 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1702803510 0 0) 0x7f8b480035b0 con 0x7f8b6006e580 2023-07-25T14:36:37.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.764+0000 7f8b5e7fc700 1 -- 172.21.15.72:0/415511478 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8b60151980 msgr2=0x7f8b600c12b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:37.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.764+0000 7f8b5e7fc700 1 --2- 172.21.15.72:0/415511478 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8b60151980 0x7f8b600c12b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:37.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.764+0000 7f8b5e7fc700 1 -- 172.21.15.72:0/415511478 >> v1:172.21.15.92:6789/0 conn(0x7f8b600c17f0 legacy=0x7f8b600c4c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:37.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.764+0000 7f8b5e7fc700 1 -- 172.21.15.72:0/415511478 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b6006f0b0 con 0x7f8b6006e580 2023-07-25T14:36:37.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.764+0000 7f8b5e7fc700 1 -- 172.21.15.72:0/415511478 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2559588315 0 0) 0x7f8b580019f0 con 0x7f8b6006e580 2023-07-25T14:36:37.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.764+0000 7f8b5e7fc700 1 -- 172.21.15.72:0/415511478 >> v1:172.21.15.72:6789/0 conn(0x7f8b6006e580 legacy=0x7f8b600c5380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:37.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.764+0000 7f8b5e7fc700 1 --2- 172.21.15.72:0/415511478 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8b60151980 0x7f8b48003a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:37.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.764+0000 7f8b5e7fc700 1 --2- 172.21.15.72:0/415511478 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8b48003fb0 0x7f8b48004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:37.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.764+0000 7f8b5e7fc700 1 --2- 172.21.15.72:0/415511478 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8b48004d90 0x7f8b48005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:37.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.764+0000 7f8b5e7fc700 1 -- 172.21.15.72:0/415511478 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b6006f770 con 0x7f8b48003fb0 2023-07-25T14:36:37.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.764+0000 7f8b5e7fc700 1 -- 172.21.15.72:0/415511478 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b4800bc50 con 0x7f8b48004d90 2023-07-25T14:36:37.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.764+0000 7f8b5e7fc700 1 -- 172.21.15.72:0/415511478 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b4800be10 con 0x7f8b60151980 2023-07-25T14:36:37.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.764+0000 7f8b5effd700 1 --2- 172.21.15.72:0/415511478 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8b48003fb0 0x7f8b48004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:37.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.764+0000 7f8b5f7fe700 1 --2- 172.21.15.72:0/415511478 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8b60151980 0x7f8b48003a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:37.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.764+0000 7f8b5ffff700 1 --2- 172.21.15.72:0/415511478 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8b48004d90 0x7f8b48005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:37.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.764+0000 7f8b5effd700 1 -- 172.21.15.72:0/415511478 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8b60151980 msgr2=0x7f8b48003a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:37.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.764+0000 7f8b5effd700 1 --2- 172.21.15.72:0/415511478 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8b60151980 0x7f8b48003a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:37.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.764+0000 7f8b5effd700 1 -- 172.21.15.72:0/415511478 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8b48004d90 msgr2=0x7f8b48005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:37.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.764+0000 7f8b5effd700 1 --2- 172.21.15.72:0/415511478 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8b48004d90 0x7f8b48005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:37.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.764+0000 7f8b5effd700 1 -- 172.21.15.72:0/415511478 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b480035b0 con 0x7f8b48003fb0 2023-07-25T14:36:37.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.764+0000 7f8b5effd700 1 --2- 172.21.15.72:0/415511478 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8b48003fb0 0x7f8b48004850 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f8b500017c0 tx=0x7f8b48005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1640d8839dbe895 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:37.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.764+0000 7f8b5e7fc700 1 -- 172.21.15.72:0/415511478 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b500052d0 con 0x7f8b48003fb0 2023-07-25T14:36:37.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.764+0000 7f8b5e7fc700 1 -- 172.21.15.72:0/415511478 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b50005430 con 0x7f8b48003fb0 2023-07-25T14:36:37.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.764+0000 7f8b5e7fc700 1 -- 172.21.15.72:0/415511478 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b500038c0 con 0x7f8b48003fb0 2023-07-25T14:36:37.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.765+0000 7f8b66064700 1 -- 172.21.15.72:0/415511478 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8b48003fb0 msgr2=0x7f8b48004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:37.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.765+0000 7f8b66064700 1 --2- 172.21.15.72:0/415511478 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8b48003fb0 0x7f8b48004850 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f8b500017c0 tx=0x7f8b48005880 comp rx=0 tx=0).stop 2023-07-25T14:36:37.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.765+0000 7f8b5ffff700 1 -- 172.21.15.72:0/415511478 reap_dead start 2023-07-25T14:36:37.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.765+0000 7f8b66064700 1 -- 172.21.15.72:0/415511478 shutdown_connections 2023-07-25T14:36:37.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.765+0000 7f8b66064700 1 -- 172.21.15.72:0/415511478 >> 172.21.15.72:0/415511478 conn(0x7f8b600a8520 msgr2=0x7f8b600a8900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:37.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.765+0000 7f8b66064700 1 -- 172.21.15.72:0/415511478 shutdown_connections 2023-07-25T14:36:37.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.765+0000 7f8b66064700 1 -- 172.21.15.72:0/415511478 wait complete. 2023-07-25T14:36:37.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.766+0000 7f8b66064700 1 Processor -- start 2023-07-25T14:36:37.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.766+0000 7f8b66064700 1 -- start start 2023-07-25T14:36:37.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.767+0000 7f8b66064700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8b48003fb0 0x7f8b600a9fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:37.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.767+0000 7f8b66064700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8b600bff90 0x7f8b600c03f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:37.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.767+0000 7f8b66064700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8b601ecd20 0x7f8b601ed1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:37.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.767+0000 7f8b66064700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b600c0930 con 0x7f8b48003fb0 2023-07-25T14:36:37.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.767+0000 7f8b66064700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b600aa510 con 0x7f8b600bff90 2023-07-25T14:36:37.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.767+0000 7f8b66064700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b600c5640 con 0x7f8b601ecd20 2023-07-25T14:36:37.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.767+0000 7f8b5ffff700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8b601ecd20 0x7f8b601ed1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:37.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.767+0000 7f8b5ffff700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8b601ecd20 0x7f8b601ed1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3301/0 says I am v2:172.21.15.72:46820/0 (socket says 172.21.15.72:46820) 2023-07-25T14:36:37.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.767+0000 7f8b5effd700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8b600bff90 0x7f8b600c03f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:37.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.767+0000 7f8b5ffff700 1 -- 172.21.15.72:0/1974471531 learned_addr learned my addr 172.21.15.72:0/1974471531 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:37.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.767+0000 7f8b5f7fe700 1 --2- 172.21.15.72:0/1974471531 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8b48003fb0 0x7f8b600a9fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:37.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.767+0000 7f8b5ffff700 1 -- 172.21.15.72:0/1974471531 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8b600bff90 msgr2=0x7f8b600c03f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:37.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.767+0000 7f8b5ffff700 1 --2- 172.21.15.72:0/1974471531 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8b600bff90 0x7f8b600c03f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:37.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.768+0000 7f8b5ffff700 1 -- 172.21.15.72:0/1974471531 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8b48003fb0 msgr2=0x7f8b600a9fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:37.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.768+0000 7f8b5ffff700 1 --2- 172.21.15.72:0/1974471531 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8b48003fb0 0x7f8b600a9fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:37.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.768+0000 7f8b5ffff700 1 -- 172.21.15.72:0/1974471531 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b601ea9b0 con 0x7f8b601ecd20 2023-07-25T14:36:37.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.768+0000 7f8b5f7fe700 1 --2- 172.21.15.72:0/1974471531 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8b48003fb0 0x7f8b600a9fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-25T14:36:37.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.768+0000 7f8b5ffff700 1 --2- 172.21.15.72:0/1974471531 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8b601ecd20 0x7f8b601ed1a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f8b58000f80 tx=0x7f8b5800a5f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:37.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.768+0000 7f8b47fff700 1 -- 172.21.15.72:0/1974471531 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b5800ad60 con 0x7f8b601ecd20 2023-07-25T14:36:37.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.768+0000 7f8b47fff700 1 -- 172.21.15.72:0/1974471531 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b580133f0 con 0x7f8b601ecd20 2023-07-25T14:36:37.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.768+0000 7f8b66064700 1 -- 172.21.15.72:0/1974471531 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b600aa720 con 0x7f8b601ecd20 2023-07-25T14:36:37.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.768+0000 7f8b47fff700 1 -- 172.21.15.72:0/1974471531 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b580137a0 con 0x7f8b601ecd20 2023-07-25T14:36:37.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.768+0000 7f8b66064700 1 -- 172.21.15.72:0/1974471531 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b600aace0 con 0x7f8b601ecd20 2023-07-25T14:36:37.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.769+0000 7f8b66064700 1 -- 172.21.15.72:0/1974471531 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b600aae70 con 0x7f8b601ecd20 2023-07-25T14:36:37.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.769+0000 7f8b47fff700 1 -- 172.21.15.72:0/1974471531 <== mon.2 v2:172.21.15.92:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8b58013900 con 0x7f8b601ecd20 2023-07-25T14:36:37.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.770+0000 7f8b47fff700 1 --2- 172.21.15.72:0/1974471531 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f8b4c06ace0 0x7f8b4c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:37.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.770+0000 7f8b47fff700 1 -- 172.21.15.72:0/1974471531 <== mon.2 v2:172.21.15.92:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f8b5808a090 con 0x7f8b601ecd20 2023-07-25T14:36:37.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.770+0000 7f8b5f7fe700 1 --2- 172.21.15.72:0/1974471531 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f8b4c06ace0 0x7f8b4c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:37.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.770+0000 7f8b5f7fe700 1 --2- 172.21.15.72:0/1974471531 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f8b4c06ace0 0x7f8b4c06d1a0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f8b54009b30 tx=0x7f8b54008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:37.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:37.775+0000 7f8b47fff700 1 -- 172.21.15.72:0/1974471531 <== mon.2 v2:172.21.15.92:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f8b58054d80 con 0x7f8b601ecd20 2023-07-25T14:36:38.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:38.005+0000 7f8b66064700 1 -- 172.21.15.72:0/1974471531 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f8b600a6920 con 0x7f8b601ecd20 2023-07-25T14:36:38.016 INFO:tasks.ceph.mon.a.smithi072.stderr:2023-07-25T14:36:38.006+0000 7f5fcfeea700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-07-25T14:36:38.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:38.011+0000 7f8b47fff700 1 -- 172.21.15.72:0/1974471531 <== mon.2 v2:172.21.15.92:3301/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) v1 ==== 161+0+0 (secure 0 0 0) 0x7f8b580583a0 con 0x7f8b601ecd20 2023-07-25T14:36:38.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:38.014+0000 7f8b66064700 1 -- 172.21.15.72:0/1974471531 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f8b4c06ace0 msgr2=0x7f8b4c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:38.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:38.014+0000 7f8b66064700 1 --2- 172.21.15.72:0/1974471531 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f8b4c06ace0 0x7f8b4c06d1a0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f8b54009b30 tx=0x7f8b54008040 comp rx=0 tx=0).stop 2023-07-25T14:36:38.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:38.014+0000 7f8b66064700 1 -- 172.21.15.72:0/1974471531 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8b601ecd20 msgr2=0x7f8b601ed1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:38.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:38.014+0000 7f8b66064700 1 --2- 172.21.15.72:0/1974471531 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8b601ecd20 0x7f8b601ed1a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f8b58000f80 tx=0x7f8b5800a5f0 comp rx=0 tx=0).stop 2023-07-25T14:36:38.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:38.014+0000 7f8b66064700 1 -- 172.21.15.72:0/1974471531 shutdown_connections 2023-07-25T14:36:38.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:38.014+0000 7f8b66064700 1 --2- 172.21.15.72:0/1974471531 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f8b4c06ace0 0x7f8b4c06d1a0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:38.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:38.014+0000 7f8b66064700 1 --2- 172.21.15.72:0/1974471531 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8b601ecd20 0x7f8b601ed1a0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:38.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:38.014+0000 7f8b66064700 1 --2- 172.21.15.72:0/1974471531 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8b48003fb0 0x7f8b600a9fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:38.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:38.014+0000 7f8b66064700 1 --2- 172.21.15.72:0/1974471531 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8b600bff90 0x7f8b600c03f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:38.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:38.014+0000 7f8b66064700 1 -- 172.21.15.72:0/1974471531 >> 172.21.15.72:0/1974471531 conn(0x7f8b600a8520 msgr2=0x7f8b600a7940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:38.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:38.014+0000 7f8b66064700 1 -- 172.21.15.72:0/1974471531 shutdown_connections 2023-07-25T14:36:38.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:38.014+0000 7f8b66064700 1 -- 172.21.15.72:0/1974471531 wait complete. 2023-07-25T14:36:38.027 INFO:tasks.ceph.mds.b.smithi092.stderr: -4381> 2023-07-25T14:35:45.512+0000 7f4851d49700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-25T14:36:38.027 INFO:teuthology.orchestra.run.smithi072.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-07-25T14:36:38.036 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-07-25T14:36:38.054 INFO:tasks.ceph.mds.b.smithi092.stdout:starting mds.b at 2023-07-25T14:36:38.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:38.147+0000 7fac25707700 1 Processor -- start 2023-07-25T14:36:38.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:38.147+0000 7fac25707700 1 -- start start 2023-07-25T14:36:38.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:38.148+0000 7fac25707700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fac2014f810 0x7fac200c4370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:38.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:38.148+0000 7fac25707700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fac200a9cc0 0x7fac201525e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:38.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:38.148+0000 7fac25707700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fac200bb0b0 0x7fac20152b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:38.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:38.148+0000 7fac25707700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac200c5890 con 0x7fac200a9cc0 2023-07-25T14:36:38.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:38.148+0000 7fac25707700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac20152150 con 0x7fac200bb0b0 2023-07-25T14:36:38.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:38.148+0000 7fac25707700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac2014fbf0 con 0x7fac2014f810 2023-07-25T14:36:38.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:38.148+0000 7fac1e7fc700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fac200a9cc0 0x7fac201525e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:38.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:38.148+0000 7fac1e7fc700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fac200a9cc0 0x7fac201525e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41598/0 (socket says 172.21.15.72:41598) 2023-07-25T14:36:38.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:38.148+0000 7fac1e7fc700 1 -- 172.21.15.72:0/3856848782 learned_addr learned my addr 172.21.15.72:0/3856848782 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:38.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:38.148+0000 7fac1effd700 1 --2- 172.21.15.72:0/3856848782 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fac2014f810 0x7fac200c4370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:38.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:38.148+0000 7fac1f7fe700 1 --2- 172.21.15.72:0/3856848782 >> v2:172.21.15.92:3300/0 conn(0x7fac200bb0b0 0x7fac20152b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:38.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:38.148+0000 7fac1e7fc700 1 -- 172.21.15.72:0/3856848782 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fac2014f810 msgr2=0x7fac200c4370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:38.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:38.148+0000 7fac1e7fc700 1 --2- 172.21.15.72:0/3856848782 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fac2014f810 0x7fac200c4370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:38.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:38.148+0000 7fac1e7fc700 1 -- 172.21.15.72:0/3856848782 >> v2:172.21.15.92:3300/0 conn(0x7fac200bb0b0 msgr2=0x7fac20152b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:38.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:38.148+0000 7fac1e7fc700 1 --2- 172.21.15.72:0/3856848782 >> v2:172.21.15.92:3300/0 conn(0x7fac200bb0b0 0x7fac20152b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:38.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:38.148+0000 7fac1e7fc700 1 -- 172.21.15.72:0/3856848782 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac201566a0 con 0x7fac200a9cc0 2023-07-25T14:36:38.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:38.148+0000 7fac1f7fe700 1 --2- 172.21.15.72:0/3856848782 >> v2:172.21.15.92:3300/0 conn(0x7fac200bb0b0 0x7fac20152b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-25T14:36:38.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:38.148+0000 7fac1e7fc700 1 --2- 172.21.15.72:0/3856848782 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fac200a9cc0 0x7fac201525e0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fac2006e350 tx=0x7fac14009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f80f9681aec8ad server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:38.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:38.149+0000 7fac1dffb700 1 -- 172.21.15.72:0/3856848782 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac14011830 con 0x7fac200a9cc0 2023-07-25T14:36:38.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:38.149+0000 7fac1dffb700 1 -- 172.21.15.72:0/3856848782 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac14011990 con 0x7fac200a9cc0 2023-07-25T14:36:38.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:38.149+0000 7fac1dffb700 1 -- 172.21.15.72:0/3856848782 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac14011d20 con 0x7fac200a9cc0 2023-07-25T14:36:38.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:38.149+0000 7fac25707700 1 -- 172.21.15.72:0/3856848782 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fac200a9cc0 msgr2=0x7fac201525e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:38.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:38.149+0000 7fac25707700 1 --2- 172.21.15.72:0/3856848782 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fac200a9cc0 0x7fac201525e0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fac2006e350 tx=0x7fac14009bd0 comp rx=0 tx=0).stop 2023-07-25T14:36:38.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:38.149+0000 7fac25707700 1 -- 172.21.15.72:0/3856848782 shutdown_connections 2023-07-25T14:36:38.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:38.149+0000 7fac25707700 1 --2- 172.21.15.72:0/3856848782 >> v2:172.21.15.92:3300/0 conn(0x7fac200bb0b0 0x7fac20152b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:38.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:38.149+0000 7fac25707700 1 --2- 172.21.15.72:0/3856848782 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fac2014f810 0x7fac200c4370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:38.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:38.149+0000 7fac25707700 1 --2- 172.21.15.72:0/3856848782 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fac200a9cc0 0x7fac201525e0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:38.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:38.149+0000 7fac25707700 1 -- 172.21.15.72:0/3856848782 >> 172.21.15.72:0/3856848782 conn(0x7fac2006a8d0 msgr2=0x7fac200a94e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:38.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:38.149+0000 7fac25707700 1 -- 172.21.15.72:0/3856848782 shutdown_connections 2023-07-25T14:36:38.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:38.149+0000 7fac25707700 1 -- 172.21.15.72:0/3856848782 wait complete. 2023-07-25T14:36:38.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:38.150+0000 7fac25707700 1 Processor -- start 2023-07-25T14:36:38.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:38.150+0000 7fac25707700 1 -- start start 2023-07-25T14:36:38.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:38.151+0000 7fac25707700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fac200a9cc0 0x7fac201e9020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:38.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:38.151+0000 7fac25707700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fac200bb0b0 0x7fac20154d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:38.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:38.151+0000 7fac25707700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fac2014f810 0x7fac201ddd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:38.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:38.151+0000 7fac25707700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac200a61e0 con 0x7fac2014f810 2023-07-25T14:36:38.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:38.151+0000 7fac25707700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac200a74e0 con 0x7fac200bb0b0 2023-07-25T14:36:38.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:38.151+0000 7fac25707700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac200a68d0 con 0x7fac200a9cc0 2023-07-25T14:36:38.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:38.151+0000 7fac1f7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fac2014f810 0x7fac201ddd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:38.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:38.151+0000 7fac1f7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fac2014f810 0x7fac201ddd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41606/0 (socket says 172.21.15.72:41606) 2023-07-25T14:36:38.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:38.151+0000 7fac1f7fe700 1 -- 172.21.15.72:0/2725098610 learned_addr learned my addr 172.21.15.72:0/2725098610 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:38.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:38.151+0000 7fac1effd700 1 --2- 172.21.15.72:0/2725098610 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fac200a9cc0 0x7fac201e9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:38.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:38.151+0000 7fac1e7fc700 1 --2- 172.21.15.72:0/2725098610 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fac200bb0b0 0x7fac20154d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:38.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:38.152+0000 7fac1f7fe700 1 -- 172.21.15.72:0/2725098610 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fac200a9cc0 msgr2=0x7fac201e9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:38.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:38.152+0000 7fac1f7fe700 1 --2- 172.21.15.72:0/2725098610 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fac200a9cc0 0x7fac201e9020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:38.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:38.152+0000 7fac1f7fe700 1 -- 172.21.15.72:0/2725098610 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fac200bb0b0 msgr2=0x7fac20154d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:38.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:38.152+0000 7fac1f7fe700 1 --2- 172.21.15.72:0/2725098610 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fac200bb0b0 0x7fac20154d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:38.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:38.152+0000 7fac1f7fe700 1 -- 172.21.15.72:0/2725098610 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac14009550 con 0x7fac2014f810 2023-07-25T14:36:38.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:38.152+0000 7fac1f7fe700 1 --2- 172.21.15.72:0/2725098610 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fac2014f810 0x7fac201ddd00 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fac18007df0 tx=0x7fac1800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:38.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:38.152+0000 7fac077fe700 1 -- 172.21.15.72:0/2725098610 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac1800dd20 con 0x7fac2014f810 2023-07-25T14:36:38.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:38.152+0000 7fac077fe700 1 -- 172.21.15.72:0/2725098610 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac1800f040 con 0x7fac2014f810 2023-07-25T14:36:38.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:38.152+0000 7fac25707700 1 -- 172.21.15.72:0/2725098610 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac200a6430 con 0x7fac2014f810 2023-07-25T14:36:38.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:38.152+0000 7fac077fe700 1 -- 172.21.15.72:0/2725098610 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac18015640 con 0x7fac2014f810 2023-07-25T14:36:38.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:38.152+0000 7fac25707700 1 -- 172.21.15.72:0/2725098610 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac20154850 con 0x7fac2014f810 2023-07-25T14:36:38.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:38.153+0000 7fac25707700 1 -- 172.21.15.72:0/2725098610 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac20154a40 con 0x7fac2014f810 2023-07-25T14:36:38.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:38.153+0000 7fac077fe700 1 -- 172.21.15.72:0/2725098610 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fac1801e3b0 con 0x7fac2014f810 2023-07-25T14:36:38.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:38.154+0000 7fac077fe700 1 --2- 172.21.15.72:0/2725098610 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fac0c06ace0 0x7fac0c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:38.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:38.154+0000 7fac077fe700 1 -- 172.21.15.72:0/2725098610 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6957+0+0 (secure 0 0 0) 0x7fac18089780 con 0x7fac2014f810 2023-07-25T14:36:38.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:38.154+0000 7fac1effd700 1 --2- 172.21.15.72:0/2725098610 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fac0c06ace0 0x7fac0c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:38.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:38.154+0000 7fac1effd700 1 --2- 172.21.15.72:0/2725098610 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fac0c06ace0 0x7fac0c06d1a0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fac10009be0 tx=0x7fac10009210 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:38.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:38.158+0000 7fac077fe700 1 -- 172.21.15.72:0/2725098610 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fac18054540 con 0x7fac2014f810 2023-07-25T14:36:38.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:38.391+0000 7fac25707700 1 -- 172.21.15.72:0/2725098610 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fac2004e470 con 0x7fac2014f810 2023-07-25T14:36:39.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:39.010+0000 7fac077fe700 1 -- 172.21.15.72:0/2725098610 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) v1 ==== 104+0+0 (secure 0 0 0) 0x7fac1800dea0 con 0x7fac2014f810 2023-07-25T14:36:39.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:39.013+0000 7fac25707700 1 -- 172.21.15.72:0/2725098610 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fac0c06ace0 msgr2=0x7fac0c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:39.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:39.013+0000 7fac25707700 1 --2- 172.21.15.72:0/2725098610 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fac0c06ace0 0x7fac0c06d1a0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fac10009be0 tx=0x7fac10009210 comp rx=0 tx=0).stop 2023-07-25T14:36:39.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:39.013+0000 7fac25707700 1 -- 172.21.15.72:0/2725098610 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fac2014f810 msgr2=0x7fac201ddd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:39.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:39.013+0000 7fac25707700 1 --2- 172.21.15.72:0/2725098610 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fac2014f810 0x7fac201ddd00 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fac18007df0 tx=0x7fac1800d3b0 comp rx=0 tx=0).stop 2023-07-25T14:36:39.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:39.013+0000 7fac25707700 1 -- 172.21.15.72:0/2725098610 shutdown_connections 2023-07-25T14:36:39.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:39.013+0000 7fac25707700 1 --2- 172.21.15.72:0/2725098610 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fac0c06ace0 0x7fac0c06d1a0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:39.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:39.013+0000 7fac25707700 1 --2- 172.21.15.72:0/2725098610 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fac200a9cc0 0x7fac201e9020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:39.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:39.013+0000 7fac25707700 1 --2- 172.21.15.72:0/2725098610 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fac2014f810 0x7fac201ddd00 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:39.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:39.013+0000 7fac25707700 1 --2- 172.21.15.72:0/2725098610 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fac200bb0b0 0x7fac20154d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:39.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:39.013+0000 7fac25707700 1 -- 172.21.15.72:0/2725098610 >> 172.21.15.72:0/2725098610 conn(0x7fac2006a8d0 msgr2=0x7fac201558e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:39.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:39.013+0000 7fac25707700 1 -- 172.21.15.72:0/2725098610 shutdown_connections 2023-07-25T14:36:39.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:39.013+0000 7fac25707700 1 -- 172.21.15.72:0/2725098610 wait complete. 2023-07-25T14:36:39.037 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-07-25T14:36:39.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:39.151+0000 7feb30759700 1 Processor -- start 2023-07-25T14:36:39.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:39.151+0000 7feb30759700 1 -- start start 2023-07-25T14:36:39.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:39.152+0000 7feb30759700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7feb280c7200 0x7feb280c1fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:39.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:39.152+0000 7feb30759700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7feb28071480 0x7feb281514d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:39.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:39.152+0000 7feb30759700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb280bd0d0 con 0x7feb28151a10 2023-07-25T14:36:39.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:39.152+0000 7feb30759700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb280c2a50 con 0x7feb28071480 2023-07-25T14:36:39.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:39.152+0000 7feb30759700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb280c2510 con 0x7feb280c7200 2023-07-25T14:36:39.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:39.152+0000 7feb2dcf4700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7feb28071480 0x7feb281514d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:39.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:39.152+0000 7feb2dcf4700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7feb28071480 0x7feb281514d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41612/0 (socket says 172.21.15.72:41612) 2023-07-25T14:36:39.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:39.152+0000 7feb2dcf4700 1 -- 172.21.15.72:0/2973610134 learned_addr learned my addr 172.21.15.72:0/2973610134 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:39.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:39.152+0000 7feb2ecf6700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7feb28151a10 0x7feb280719f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:60582/0 (socket says 172.21.15.72:60582) 2023-07-25T14:36:39.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:39.152+0000 7feb2e4f5700 1 --2- 172.21.15.72:0/2973610134 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7feb280c7200 0x7feb280c1fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:39.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:39.153+0000 7feb2dcf4700 1 -- 172.21.15.72:0/2973610134 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7feb280c7200 msgr2=0x7feb280c1fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:39.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:39.153+0000 7feb2dcf4700 1 --2- 172.21.15.72:0/2973610134 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7feb280c7200 0x7feb280c1fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:39.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:39.153+0000 7feb2dcf4700 1 -- 172.21.15.72:0/2973610134 >> v1:172.21.15.72:6789/0 conn(0x7feb28151a10 legacy=0x7feb280719f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:39.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:39.153+0000 7feb2dcf4700 1 -- 172.21.15.72:0/2973610134 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb2806f600 con 0x7feb28071480 2023-07-25T14:36:39.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:39.153+0000 7feb2d4f3700 1 -- 172.21.15.72:0/2973610134 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4027465946 0 0) 0x7feb280bd0d0 con 0x7feb28151a10 2023-07-25T14:36:39.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:39.153+0000 7feb2dcf4700 1 --2- 172.21.15.72:0/2973610134 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feb28071480 0x7feb281514d0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7feb240098f0 tx=0x7feb24009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f160d2d051fe25 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:39.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:39.153+0000 7feb2d4f3700 1 -- 172.21.15.72:0/2973610134 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb2400b8a0 con 0x7feb28071480 2023-07-25T14:36:39.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:39.153+0000 7feb2d4f3700 1 -- 172.21.15.72:0/2973610134 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb2400ba00 con 0x7feb28071480 2023-07-25T14:36:39.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:39.153+0000 7feb2d4f3700 1 -- 172.21.15.72:0/2973610134 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb2400bd90 con 0x7feb28071480 2023-07-25T14:36:39.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:39.153+0000 7feb30759700 1 -- 172.21.15.72:0/2973610134 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feb28071480 msgr2=0x7feb281514d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:39.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:39.153+0000 7feb30759700 1 --2- 172.21.15.72:0/2973610134 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feb28071480 0x7feb281514d0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7feb240098f0 tx=0x7feb24009c00 comp rx=0 tx=0).stop 2023-07-25T14:36:39.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:39.153+0000 7feb30759700 1 -- 172.21.15.72:0/2973610134 shutdown_connections 2023-07-25T14:36:39.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:39.153+0000 7feb30759700 1 --2- 172.21.15.72:0/2973610134 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7feb280c7200 0x7feb280c1fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:39.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:39.153+0000 7feb30759700 1 --2- 172.21.15.72:0/2973610134 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feb28071480 0x7feb281514d0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:39.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:39.153+0000 7feb30759700 1 -- 172.21.15.72:0/2973610134 >> 172.21.15.72:0/2973610134 conn(0x7feb2806b8d0 msgr2=0x7feb280c6880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:39.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:39.154+0000 7feb30759700 1 -- 172.21.15.72:0/2973610134 shutdown_connections 2023-07-25T14:36:39.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:39.154+0000 7feb30759700 1 -- 172.21.15.72:0/2973610134 wait complete. 2023-07-25T14:36:39.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:39.155+0000 7feb30759700 1 Processor -- start 2023-07-25T14:36:39.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:39.155+0000 7feb30759700 1 -- start start 2023-07-25T14:36:39.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:39.155+0000 7feb30759700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feb28071480 0x7feb280bdf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:39.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:39.155+0000 7feb30759700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feb280c7200 0x7feb280bff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:39.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:39.155+0000 7feb30759700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7feb28151a10 0x7feb280ab620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:39.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:39.155+0000 7feb30759700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb281e7310 con 0x7feb280c7200 2023-07-25T14:36:39.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:39.155+0000 7feb30759700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb280be920 con 0x7feb28071480 2023-07-25T14:36:39.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:39.155+0000 7feb30759700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb281ed700 con 0x7feb28151a10 2023-07-25T14:36:39.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:39.155+0000 7feb2dcf4700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feb280c7200 0x7feb280bff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:39.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:39.155+0000 7feb2dcf4700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feb280c7200 0x7feb280bff70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41618/0 (socket says 172.21.15.72:41618) 2023-07-25T14:36:39.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:39.155+0000 7feb2dcf4700 1 -- 172.21.15.72:0/1776898218 learned_addr learned my addr 172.21.15.72:0/1776898218 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:39.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:39.155+0000 7feb2ecf6700 1 --2- 172.21.15.72:0/1776898218 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7feb28151a10 0x7feb280ab620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:39.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:39.155+0000 7feb2e4f5700 1 --2- 172.21.15.72:0/1776898218 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feb28071480 0x7feb280bdf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:39.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:39.156+0000 7feb2dcf4700 1 -- 172.21.15.72:0/1776898218 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7feb28151a10 msgr2=0x7feb280ab620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:39.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:39.156+0000 7feb2dcf4700 1 --2- 172.21.15.72:0/1776898218 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7feb28151a10 0x7feb280ab620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:39.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:39.156+0000 7feb2dcf4700 1 -- 172.21.15.72:0/1776898218 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feb28071480 msgr2=0x7feb280bdf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:39.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:39.156+0000 7feb2dcf4700 1 --2- 172.21.15.72:0/1776898218 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feb28071480 0x7feb280bdf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:39.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:39.156+0000 7feb2dcf4700 1 -- 172.21.15.72:0/1776898218 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb24009550 con 0x7feb280c7200 2023-07-25T14:36:39.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:39.156+0000 7feb2e4f5700 1 --2- 172.21.15.72:0/1776898218 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feb28071480 0x7feb280bdf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-25T14:36:39.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:39.156+0000 7feb2dcf4700 1 --2- 172.21.15.72:0/1776898218 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feb280c7200 0x7feb280bff70 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7feb24009c40 tx=0x7feb24004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:39.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:39.156+0000 7feb1effd700 1 -- 172.21.15.72:0/1776898218 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb24004300 con 0x7feb280c7200 2023-07-25T14:36:39.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:39.156+0000 7feb1effd700 1 -- 172.21.15.72:0/1776898218 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb2401f070 con 0x7feb280c7200 2023-07-25T14:36:39.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:39.156+0000 7feb30759700 1 -- 172.21.15.72:0/1776898218 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb281ed9e0 con 0x7feb280c7200 2023-07-25T14:36:39.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:39.156+0000 7feb1effd700 1 -- 172.21.15.72:0/1776898218 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb240036a0 con 0x7feb280c7200 2023-07-25T14:36:39.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:39.156+0000 7feb30759700 1 -- 172.21.15.72:0/1776898218 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb280ab070 con 0x7feb280c7200 2023-07-25T14:36:39.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:39.157+0000 7feb30759700 1 -- 172.21.15.72:0/1776898218 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb281ed560 con 0x7feb280c7200 2023-07-25T14:36:39.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:39.157+0000 7feb1effd700 1 -- 172.21.15.72:0/1776898218 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7feb24021030 con 0x7feb280c7200 2023-07-25T14:36:39.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:39.158+0000 7feb1effd700 1 --2- 172.21.15.72:0/1776898218 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7feb0c06ace0 0x7feb0c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:39.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:39.158+0000 7feb1effd700 1 -- 172.21.15.72:0/1776898218 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6957+0+0 (secure 0 0 0) 0x7feb2408ac70 con 0x7feb280c7200 2023-07-25T14:36:39.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:39.158+0000 7feb2e4f5700 1 --2- 172.21.15.72:0/1776898218 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7feb0c06ace0 0x7feb0c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:39.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:39.158+0000 7feb2e4f5700 1 --2- 172.21.15.72:0/1776898218 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7feb0c06ace0 0x7feb0c06d1a0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7feb180099f0 tx=0x7feb18008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:39.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:39.162+0000 7feb1effd700 1 -- 172.21.15.72:0/1776898218 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7feb281ed560 con 0x7feb280c7200 2023-07-25T14:36:39.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:39.350+0000 7feb30759700 1 -- 172.21.15.72:0/1776898218 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7feb281ed560 con 0x7feb280c7200 2023-07-25T14:36:40.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:40.018+0000 7feb1effd700 1 -- 172.21.15.72:0/1776898218 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v29) v1 ==== 181+0+0 (secure 0 0 0) 0x7feb281ed560 con 0x7feb280c7200 2023-07-25T14:36:40.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:40.022+0000 7feb30759700 1 -- 172.21.15.72:0/1776898218 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7feb0c06ace0 msgr2=0x7feb0c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:40.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:40.022+0000 7feb30759700 1 --2- 172.21.15.72:0/1776898218 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7feb0c06ace0 0x7feb0c06d1a0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7feb180099f0 tx=0x7feb18008040 comp rx=0 tx=0).stop 2023-07-25T14:36:40.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:40.022+0000 7feb30759700 1 -- 172.21.15.72:0/1776898218 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feb280c7200 msgr2=0x7feb280bff70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:40.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:40.022+0000 7feb30759700 1 --2- 172.21.15.72:0/1776898218 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feb280c7200 0x7feb280bff70 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7feb24009c40 tx=0x7feb24004750 comp rx=0 tx=0).stop 2023-07-25T14:36:40.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:40.022+0000 7feb30759700 1 -- 172.21.15.72:0/1776898218 shutdown_connections 2023-07-25T14:36:40.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:40.022+0000 7feb30759700 1 --2- 172.21.15.72:0/1776898218 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7feb0c06ace0 0x7feb0c06d1a0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:40.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:40.022+0000 7feb30759700 1 --2- 172.21.15.72:0/1776898218 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7feb28151a10 0x7feb280ab620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:40.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:40.022+0000 7feb30759700 1 --2- 172.21.15.72:0/1776898218 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feb28071480 0x7feb280bdf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:40.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:40.022+0000 7feb30759700 1 --2- 172.21.15.72:0/1776898218 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feb280c7200 0x7feb280bff70 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:40.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:40.022+0000 7feb30759700 1 -- 172.21.15.72:0/1776898218 >> 172.21.15.72:0/1776898218 conn(0x7feb2806b8d0 msgr2=0x7feb280c1490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:40.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:40.022+0000 7feb30759700 1 -- 172.21.15.72:0/1776898218 shutdown_connections 2023-07-25T14:36:40.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:40.022+0000 7feb30759700 1 -- 172.21.15.72:0/1776898218 wait complete. 2023-07-25T14:36:40.034 INFO:teuthology.orchestra.run.smithi072.stderr:pool 'cephfs_metadata' removed 2023-07-25T14:36:40.047 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-07-25T14:36:40.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:40.169+0000 7f0bd3e50700 1 Processor -- start 2023-07-25T14:36:40.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:40.170+0000 7f0bd3e50700 1 -- start start 2023-07-25T14:36:40.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:40.170+0000 7f0bd3e50700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0bcc0c5b90 0x7f0bcc0c6d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:40.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:40.170+0000 7f0bd3e50700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bcc0c5250 con 0x7f0bcc0c49d0 2023-07-25T14:36:40.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:40.170+0000 7f0bd3e50700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bcc0c5530 con 0x7f0bcc0c5f70 2023-07-25T14:36:40.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:40.170+0000 7f0bd3e50700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bcc0c6520 con 0x7f0bcc0c5b90 2023-07-25T14:36:40.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:40.170+0000 7f0bd13eb700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f0bcc0c49d0 0x7f0bcc06db00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:60592/0 (socket says 172.21.15.72:60592) 2023-07-25T14:36:40.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:40.170+0000 7f0bd13eb700 1 -- 172.21.15.72:0/2268621317 learned_addr learned my addr 172.21.15.72:0/2268621317 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:36:40.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:40.171+0000 7f0bd0bea700 1 -- 172.21.15.72:0/2268621317 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2558758393 0 0) 0x7f0bcc0c5250 con 0x7f0bcc0c49d0 2023-07-25T14:36:40.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:40.171+0000 7f0bd1bec700 1 --2- 172.21.15.72:0/2268621317 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0bcc0c5b90 0x7f0bcc0c6d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:40.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:40.171+0000 7f0bd0bea700 1 -- 172.21.15.72:0/2268621317 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0bb80035b0 con 0x7f0bcc0c49d0 2023-07-25T14:36:40.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:40.171+0000 7f0bd0bea700 1 -- 172.21.15.72:0/2268621317 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2084633573 0 0) 0x7f0bb80035b0 con 0x7f0bcc0c49d0 2023-07-25T14:36:40.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:40.171+0000 7f0bd0bea700 1 -- 172.21.15.72:0/2268621317 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0bcc0c5b90 msgr2=0x7f0bcc0c6d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:40.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:40.171+0000 7f0bd0bea700 1 --2- 172.21.15.72:0/2268621317 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0bcc0c5b90 0x7f0bcc0c6d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:40.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:40.171+0000 7f0bd0bea700 1 -- 172.21.15.72:0/2268621317 >> v1:172.21.15.92:6789/0 conn(0x7f0bcc0c5f70 legacy=0x7f0bcc154c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:40.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:40.171+0000 7f0bd0bea700 1 -- 172.21.15.72:0/2268621317 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bcc0c6800 con 0x7f0bcc0c49d0 2023-07-25T14:36:40.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:40.171+0000 7f0bd0bea700 1 -- 172.21.15.72:0/2268621317 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2559588315 0 0) 0x7f0bc8001670 con 0x7f0bcc0c49d0 2023-07-25T14:36:40.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:40.171+0000 7f0bd0bea700 1 -- 172.21.15.72:0/2268621317 >> v1:172.21.15.72:6789/0 conn(0x7f0bcc0c49d0 legacy=0x7f0bcc06db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:40.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:40.171+0000 7f0bd0bea700 1 --2- 172.21.15.72:0/2268621317 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0bb8003a30 0x7f0bb8003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:40.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:40.171+0000 7f0bd0bea700 1 --2- 172.21.15.72:0/2268621317 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0bb8004850 0x7f0bb8004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:40.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:40.171+0000 7f0bd0bea700 1 --2- 172.21.15.72:0/2268621317 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0bcc0c5b90 0x7f0bb8005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:40.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:40.171+0000 7f0bd0bea700 1 -- 172.21.15.72:0/2268621317 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bcc0c6520 con 0x7f0bb8004850 2023-07-25T14:36:40.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:40.171+0000 7f0bd0bea700 1 -- 172.21.15.72:0/2268621317 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bb800bac0 con 0x7f0bb8003a30 2023-07-25T14:36:40.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:40.171+0000 7f0bd0bea700 1 -- 172.21.15.72:0/2268621317 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bb800de90 con 0x7f0bcc0c5b90 2023-07-25T14:36:40.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:40.171+0000 7f0bd13eb700 1 --2- 172.21.15.72:0/2268621317 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0bb8004850 0x7f0bb8004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:40.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:40.171+0000 7f0bd1bec700 1 --2- 172.21.15.72:0/2268621317 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0bb8003a30 0x7f0bb8003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:40.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:40.171+0000 7f0bd23ed700 1 --2- 172.21.15.72:0/2268621317 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0bcc0c5b90 0x7f0bb8005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:40.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:40.171+0000 7f0bd13eb700 1 -- 172.21.15.72:0/2268621317 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0bcc0c5b90 msgr2=0x7f0bb8005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:40.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:40.171+0000 7f0bd13eb700 1 --2- 172.21.15.72:0/2268621317 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0bcc0c5b90 0x7f0bb8005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:40.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:40.171+0000 7f0bd13eb700 1 -- 172.21.15.72:0/2268621317 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0bb8003a30 msgr2=0x7f0bb8003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:40.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:40.171+0000 7f0bd13eb700 1 --2- 172.21.15.72:0/2268621317 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0bb8003a30 0x7f0bb8003e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:40.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:40.171+0000 7f0bd13eb700 1 -- 172.21.15.72:0/2268621317 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bb80035b0 con 0x7f0bb8004850 2023-07-25T14:36:40.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:40.171+0000 7f0bd1bec700 1 --2- 172.21.15.72:0/2268621317 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0bb8003a30 0x7f0bb8003e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-25T14:36:40.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:40.172+0000 7f0bd13eb700 1 --2- 172.21.15.72:0/2268621317 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0bb8004850 0x7f0bb8004cd0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f0bc800c270 tx=0x7f0bb8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcdd7b5e2e2a77dc server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:40.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:40.172+0000 7f0bd0bea700 1 -- 172.21.15.72:0/2268621317 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bc8007c10 con 0x7f0bb8004850 2023-07-25T14:36:40.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:40.172+0000 7f0bd0bea700 1 -- 172.21.15.72:0/2268621317 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bc800cd90 con 0x7f0bb8004850 2023-07-25T14:36:40.188 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:40.172+0000 7f0bd0bea700 1 -- 172.21.15.72:0/2268621317 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bc8005ba0 con 0x7f0bb8004850 2023-07-25T14:36:40.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:40.172+0000 7f0bd3e50700 1 -- 172.21.15.72:0/2268621317 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0bb8004850 msgr2=0x7f0bb8004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:40.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:40.172+0000 7f0bd3e50700 1 --2- 172.21.15.72:0/2268621317 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0bb8004850 0x7f0bb8004cd0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f0bc800c270 tx=0x7f0bb8005880 comp rx=0 tx=0).stop 2023-07-25T14:36:40.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:40.172+0000 7f0bd23ed700 1 -- 172.21.15.72:0/2268621317 reap_dead start 2023-07-25T14:36:40.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:40.172+0000 7f0bd3e50700 1 -- 172.21.15.72:0/2268621317 shutdown_connections 2023-07-25T14:36:40.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:40.172+0000 7f0bd3e50700 1 -- 172.21.15.72:0/2268621317 >> 172.21.15.72:0/2268621317 conn(0x7f0bcc06bbc0 msgr2=0x7f0bcc0a8590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:40.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:40.172+0000 7f0bd3e50700 1 -- 172.21.15.72:0/2268621317 shutdown_connections 2023-07-25T14:36:40.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:40.172+0000 7f0bd3e50700 1 -- 172.21.15.72:0/2268621317 wait complete. 2023-07-25T14:36:40.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:40.173+0000 7f0bd3e50700 1 Processor -- start 2023-07-25T14:36:40.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:40.173+0000 7f0bd3e50700 1 -- start start 2023-07-25T14:36:40.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:40.174+0000 7f0bd3e50700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0bb8004850 0x7f0bcc0bfe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:40.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:40.174+0000 7f0bd3e50700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0bcc0aa030 0x7f0bcc0a4fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:40.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:40.174+0000 7f0bd3e50700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0bcc14e7d0 0x7f0bcc0a5510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:40.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:40.174+0000 7f0bd3e50700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bcc1dcbf0 con 0x7f0bcc14e7d0 2023-07-25T14:36:40.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:40.174+0000 7f0bd3e50700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bcc1edc30 con 0x7f0bcc0aa030 2023-07-25T14:36:40.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:40.174+0000 7f0bd3e50700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bcc1ed300 con 0x7f0bb8004850 2023-07-25T14:36:40.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:40.174+0000 7f0bd23ed700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0bcc14e7d0 0x7f0bcc0a5510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:40.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:40.174+0000 7f0bd23ed700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0bcc14e7d0 0x7f0bcc0a5510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41640/0 (socket says 172.21.15.72:41640) 2023-07-25T14:36:40.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:40.174+0000 7f0bd23ed700 1 -- 172.21.15.72:0/1367246326 learned_addr learned my addr 172.21.15.72:0/1367246326 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:40.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:40.174+0000 7f0bd13eb700 1 --2- 172.21.15.72:0/1367246326 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0bcc0aa030 0x7f0bcc0a4fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:40.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:40.174+0000 7f0bd1bec700 1 --2- 172.21.15.72:0/1367246326 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0bb8004850 0x7f0bcc0bfe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:40.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:40.174+0000 7f0bd23ed700 1 -- 172.21.15.72:0/1367246326 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0bb8004850 msgr2=0x7f0bcc0bfe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:40.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:40.174+0000 7f0bd23ed700 1 --2- 172.21.15.72:0/1367246326 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0bb8004850 0x7f0bcc0bfe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:40.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:40.174+0000 7f0bd23ed700 1 -- 172.21.15.72:0/1367246326 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0bcc0aa030 msgr2=0x7f0bcc0a4fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:40.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:40.174+0000 7f0bd23ed700 1 --2- 172.21.15.72:0/1367246326 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0bcc0aa030 0x7f0bcc0a4fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:40.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:40.174+0000 7f0bd23ed700 1 -- 172.21.15.72:0/1367246326 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bcc1ed5e0 con 0x7f0bcc14e7d0 2023-07-25T14:36:40.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:40.174+0000 7f0bd13eb700 1 --2- 172.21.15.72:0/1367246326 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0bcc0aa030 0x7f0bcc0a4fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-25T14:36:40.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:40.174+0000 7f0bd1bec700 1 --2- 172.21.15.72:0/1367246326 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0bb8004850 0x7f0bcc0bfe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-25T14:36:40.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:40.175+0000 7f0bd23ed700 1 --2- 172.21.15.72:0/1367246326 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0bcc14e7d0 0x7f0bcc0a5510 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f0bcc0a64b0 tx=0x7f0bc400d430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:40.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:40.175+0000 7f0bc27fc700 1 -- 172.21.15.72:0/1367246326 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bc4003c10 con 0x7f0bcc14e7d0 2023-07-25T14:36:40.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:40.175+0000 7f0bc27fc700 1 -- 172.21.15.72:0/1367246326 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bc4003d90 con 0x7f0bcc14e7d0 2023-07-25T14:36:40.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:40.175+0000 7f0bd3e50700 1 -- 172.21.15.72:0/1367246326 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bcc1ed8c0 con 0x7f0bcc14e7d0 2023-07-25T14:36:40.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:40.175+0000 7f0bc27fc700 1 -- 172.21.15.72:0/1367246326 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bc400db70 con 0x7f0bcc14e7d0 2023-07-25T14:36:40.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:40.175+0000 7f0bd3e50700 1 -- 172.21.15.72:0/1367246326 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bcc0c03c0 con 0x7f0bcc14e7d0 2023-07-25T14:36:40.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:40.176+0000 7f0bd3e50700 1 -- 172.21.15.72:0/1367246326 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bcc0abe00 con 0x7f0bcc14e7d0 2023-07-25T14:36:40.195 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:40.176+0000 7f0bc27fc700 1 -- 172.21.15.72:0/1367246326 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0bc400dcd0 con 0x7f0bcc14e7d0 2023-07-25T14:36:40.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:40.177+0000 7f0bc27fc700 1 --2- 172.21.15.72:0/1367246326 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f0bb006ace0 0x7f0bb006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:40.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:40.177+0000 7f0bc27fc700 1 -- 172.21.15.72:0/1367246326 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6519+0+0 (secure 0 0 0) 0x7f0bc4089920 con 0x7f0bcc14e7d0 2023-07-25T14:36:40.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:40.177+0000 7f0bd1bec700 1 --2- 172.21.15.72:0/1367246326 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f0bb006ace0 0x7f0bb006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:40.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:40.177+0000 7f0bd1bec700 1 --2- 172.21.15.72:0/1367246326 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f0bb006ace0 0x7f0bb006d1a0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f0bbc009bd0 tx=0x7f0bbc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:40.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:40.181+0000 7f0bc27fc700 1 -- 172.21.15.72:0/1367246326 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f0bc40547f0 con 0x7f0bcc14e7d0 2023-07-25T14:36:40.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:40.370+0000 7f0bd3e50700 1 -- 172.21.15.72:0/1367246326 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f0bcc0a5ec0 con 0x7f0bcc14e7d0 2023-07-25T14:36:41.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:41.023+0000 7f0bc27fc700 1 -- 172.21.15.72:0/1367246326 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v30) v1 ==== 169+0+0 (secure 0 0 0) 0x7f0bc4057e10 con 0x7f0bcc14e7d0 2023-07-25T14:36:41.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:41.026+0000 7f0bd3e50700 1 -- 172.21.15.72:0/1367246326 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f0bb006ace0 msgr2=0x7f0bb006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:41.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:41.026+0000 7f0bd3e50700 1 --2- 172.21.15.72:0/1367246326 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f0bb006ace0 0x7f0bb006d1a0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f0bbc009bd0 tx=0x7f0bbc008040 comp rx=0 tx=0).stop 2023-07-25T14:36:41.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:41.026+0000 7f0bd3e50700 1 -- 172.21.15.72:0/1367246326 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0bcc14e7d0 msgr2=0x7f0bcc0a5510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:41.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:41.026+0000 7f0bd3e50700 1 --2- 172.21.15.72:0/1367246326 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0bcc14e7d0 0x7f0bcc0a5510 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f0bcc0a64b0 tx=0x7f0bc400d430 comp rx=0 tx=0).stop 2023-07-25T14:36:41.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:41.027+0000 7f0bd3e50700 1 -- 172.21.15.72:0/1367246326 shutdown_connections 2023-07-25T14:36:41.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:41.027+0000 7f0bd3e50700 1 --2- 172.21.15.72:0/1367246326 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f0bb006ace0 0x7f0bb006d1a0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:41.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:41.027+0000 7f0bd3e50700 1 --2- 172.21.15.72:0/1367246326 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0bb8004850 0x7f0bcc0bfe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:41.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:41.027+0000 7f0bd3e50700 1 --2- 172.21.15.72:0/1367246326 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0bcc14e7d0 0x7f0bcc0a5510 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:41.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:41.027+0000 7f0bd3e50700 1 --2- 172.21.15.72:0/1367246326 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0bcc0aa030 0x7f0bcc0a4fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:41.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:41.027+0000 7f0bd3e50700 1 -- 172.21.15.72:0/1367246326 >> 172.21.15.72:0/1367246326 conn(0x7f0bcc06bbc0 msgr2=0x7f0bcc0c3760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:41.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:41.027+0000 7f0bd3e50700 1 -- 172.21.15.72:0/1367246326 shutdown_connections 2023-07-25T14:36:41.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:41.027+0000 7f0bd3e50700 1 -- 172.21.15.72:0/1367246326 wait complete. 2023-07-25T14:36:41.040 INFO:teuthology.orchestra.run.smithi072.stderr:pool 'cephfs_data' removed 2023-07-25T14:36:41.052 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2023-07-25T14:36:41.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:41.166+0000 7f2d13933700 1 Processor -- start 2023-07-25T14:36:41.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:41.166+0000 7f2d13933700 1 -- start start 2023-07-25T14:36:41.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:41.167+0000 7f2d13933700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2d0c0a99a0 0x7f2d0c0ab3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:41.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:41.167+0000 7f2d13933700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d0c151940 con 0x7f2d0c0c1b10 2023-07-25T14:36:41.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:41.167+0000 7f2d13933700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d0c071da0 con 0x7f2d0c14af40 2023-07-25T14:36:41.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:41.167+0000 7f2d13933700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d0c0a81a0 con 0x7f2d0c0a99a0 2023-07-25T14:36:41.181 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:41.167+0000 7f2d10ece700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f2d0c0c1b10 0x7f2d0c0a9290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:60614/0 (socket says 172.21.15.72:60614) 2023-07-25T14:36:41.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:41.167+0000 7f2d10ece700 1 -- 172.21.15.72:0/2218949089 learned_addr learned my addr 172.21.15.72:0/2218949089 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:36:41.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:41.167+0000 7f2d03fff700 1 -- 172.21.15.72:0/2218949089 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3397481594 0 0) 0x7f2d0c151940 con 0x7f2d0c0c1b10 2023-07-25T14:36:41.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:41.167+0000 7f2d03fff700 1 -- 172.21.15.72:0/2218949089 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2cf80035b0 con 0x7f2d0c0c1b10 2023-07-25T14:36:41.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:41.167+0000 7f2d11ed0700 1 --2- 172.21.15.72:0/2218949089 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2d0c0a99a0 0x7f2d0c0ab3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:41.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:41.168+0000 7f2d03fff700 1 -- 172.21.15.72:0/2218949089 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2695830667 0 0) 0x7f2cf80035b0 con 0x7f2d0c0c1b10 2023-07-25T14:36:41.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:41.168+0000 7f2d03fff700 1 -- 172.21.15.72:0/2218949089 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2d0c0a99a0 msgr2=0x7f2d0c0ab3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:41.182 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:41.168+0000 7f2d03fff700 1 --2- 172.21.15.72:0/2218949089 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2d0c0a99a0 0x7f2d0c0ab3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:41.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:41.168+0000 7f2d03fff700 1 -- 172.21.15.72:0/2218949089 >> v1:172.21.15.92:6789/0 conn(0x7f2d0c14af40 legacy=0x7f2d0c06b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:41.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:41.168+0000 7f2d03fff700 1 -- 172.21.15.72:0/2218949089 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d0c0ab9d0 con 0x7f2d0c0c1b10 2023-07-25T14:36:41.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:41.168+0000 7f2d03fff700 1 -- 172.21.15.72:0/2218949089 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2559588315 0 0) 0x7f2d08001670 con 0x7f2d0c0c1b10 2023-07-25T14:36:41.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:41.168+0000 7f2d03fff700 1 -- 172.21.15.72:0/2218949089 >> v1:172.21.15.72:6789/0 conn(0x7f2d0c0c1b10 legacy=0x7f2d0c0a9290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:41.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:41.168+0000 7f2d03fff700 1 --2- 172.21.15.72:0/2218949089 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2cf8003a30 0x7f2cf8003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:41.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:41.168+0000 7f2d03fff700 1 --2- 172.21.15.72:0/2218949089 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2d0c0a99a0 0x7f2cf8004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:41.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:41.168+0000 7f2d03fff700 1 --2- 172.21.15.72:0/2218949089 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2cf8004d90 0x7f2cf8005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:41.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:41.168+0000 7f2d03fff700 1 -- 172.21.15.72:0/2218949089 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cf800bac0 con 0x7f2cf8003a30 2023-07-25T14:36:41.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:41.168+0000 7f2d03fff700 1 -- 172.21.15.72:0/2218949089 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cf800bc00 con 0x7f2cf8004d90 2023-07-25T14:36:41.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:41.168+0000 7f2d03fff700 1 -- 172.21.15.72:0/2218949089 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cf800bdc0 con 0x7f2d0c0a99a0 2023-07-25T14:36:41.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:41.168+0000 7f2d116cf700 1 --2- 172.21.15.72:0/2218949089 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2cf8003a30 0x7f2cf8003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:41.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:41.168+0000 7f2d11ed0700 1 --2- 172.21.15.72:0/2218949089 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2cf8004d90 0x7f2cf8005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:41.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:41.168+0000 7f2d10ece700 1 --2- 172.21.15.72:0/2218949089 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2d0c0a99a0 0x7f2cf8004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:41.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:41.168+0000 7f2d116cf700 1 -- 172.21.15.72:0/2218949089 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2d0c0a99a0 msgr2=0x7f2cf8004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:41.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:41.168+0000 7f2d116cf700 1 --2- 172.21.15.72:0/2218949089 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2d0c0a99a0 0x7f2cf8004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:41.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:41.168+0000 7f2d116cf700 1 -- 172.21.15.72:0/2218949089 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2cf8004d90 msgr2=0x7f2cf8005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:41.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:41.168+0000 7f2d116cf700 1 --2- 172.21.15.72:0/2218949089 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2cf8004d90 0x7f2cf8005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:41.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:41.168+0000 7f2d116cf700 1 -- 172.21.15.72:0/2218949089 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cf80035b0 con 0x7f2cf8003a30 2023-07-25T14:36:41.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:41.168+0000 7f2d116cf700 1 --2- 172.21.15.72:0/2218949089 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2cf8003a30 0x7f2cf8003e50 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f2cfc007fd0 tx=0x7f2cf8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bac8b06cb073040 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:41.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:41.168+0000 7f2d03fff700 1 -- 172.21.15.72:0/2218949089 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cfc0052d0 con 0x7f2cf8003a30 2023-07-25T14:36:41.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:41.168+0000 7f2d03fff700 1 -- 172.21.15.72:0/2218949089 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cfc005470 con 0x7f2cf8003a30 2023-07-25T14:36:41.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:41.168+0000 7f2d03fff700 1 -- 172.21.15.72:0/2218949089 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cfc0038c0 con 0x7f2cf8003a30 2023-07-25T14:36:41.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:41.169+0000 7f2d13933700 1 -- 172.21.15.72:0/2218949089 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2cf8003a30 msgr2=0x7f2cf8003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:41.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:41.169+0000 7f2d13933700 1 --2- 172.21.15.72:0/2218949089 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2cf8003a30 0x7f2cf8003e50 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f2cfc007fd0 tx=0x7f2cf8005880 comp rx=0 tx=0).stop 2023-07-25T14:36:41.186 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:41.169+0000 7f2d11ed0700 1 -- 172.21.15.72:0/2218949089 reap_dead start 2023-07-25T14:36:41.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:41.169+0000 7f2d13933700 1 -- 172.21.15.72:0/2218949089 shutdown_connections 2023-07-25T14:36:41.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:41.169+0000 7f2d13933700 1 -- 172.21.15.72:0/2218949089 >> 172.21.15.72:0/2218949089 conn(0x7f2d0c070c90 msgr2=0x7f2d0c0710a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:41.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:41.169+0000 7f2d13933700 1 -- 172.21.15.72:0/2218949089 shutdown_connections 2023-07-25T14:36:41.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:41.169+0000 7f2d13933700 1 -- 172.21.15.72:0/2218949089 wait complete. 2023-07-25T14:36:41.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:41.170+0000 7f2d13933700 1 Processor -- start 2023-07-25T14:36:41.187 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:41.170+0000 7f2d13933700 1 -- start start 2023-07-25T14:36:41.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:41.171+0000 7f2d13933700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2cf8003a30 0x7f2d0c1eaeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:41.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:41.171+0000 7f2d13933700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2d0c1eb3f0 0x7f2d0c148940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:41.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:41.171+0000 7f2d13933700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2d0c148e80 0x7f2d0c14c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:41.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:41.171+0000 7f2d13933700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d0c14c2c0 con 0x7f2cf8003a30 2023-07-25T14:36:41.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:41.171+0000 7f2d13933700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d0c154b60 con 0x7f2d0c148e80 2023-07-25T14:36:41.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:41.171+0000 7f2d13933700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d0c155090 con 0x7f2d0c1eb3f0 2023-07-25T14:36:41.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:41.171+0000 7f2d116cf700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2cf8003a30 0x7f2d0c1eaeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:41.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:41.171+0000 7f2d116cf700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2cf8003a30 0x7f2d0c1eaeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41656/0 (socket says 172.21.15.72:41656) 2023-07-25T14:36:41.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:41.171+0000 7f2d116cf700 1 -- 172.21.15.72:0/2183050092 learned_addr learned my addr 172.21.15.72:0/2183050092 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:41.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:41.171+0000 7f2d10ece700 1 --2- 172.21.15.72:0/2183050092 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2d0c1eb3f0 0x7f2d0c148940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:41.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:41.171+0000 7f2d11ed0700 1 --2- 172.21.15.72:0/2183050092 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2d0c148e80 0x7f2d0c14c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:41.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:41.171+0000 7f2d116cf700 1 -- 172.21.15.72:0/2183050092 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2d0c1eb3f0 msgr2=0x7f2d0c148940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:41.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:41.171+0000 7f2d116cf700 1 --2- 172.21.15.72:0/2183050092 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2d0c1eb3f0 0x7f2d0c148940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:41.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:41.171+0000 7f2d116cf700 1 -- 172.21.15.72:0/2183050092 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2d0c148e80 msgr2=0x7f2d0c14c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:41.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:41.171+0000 7f2d116cf700 1 --2- 172.21.15.72:0/2183050092 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2d0c148e80 0x7f2d0c14c6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:41.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:41.171+0000 7f2d116cf700 1 -- 172.21.15.72:0/2183050092 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d0c1eb870 con 0x7f2cf8003a30 2023-07-25T14:36:41.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:41.171+0000 7f2d11ed0700 1 --2- 172.21.15.72:0/2183050092 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2d0c148e80 0x7f2d0c14c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-25T14:36:41.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:41.171+0000 7f2d116cf700 1 --2- 172.21.15.72:0/2183050092 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2cf8003a30 0x7f2d0c1eaeb0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f2cfc004000 tx=0x7f2cfc001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:41.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:41.171+0000 7f2d01ffb700 1 -- 172.21.15.72:0/2183050092 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cfc007240 con 0x7f2cf8003a30 2023-07-25T14:36:41.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:41.171+0000 7f2d01ffb700 1 -- 172.21.15.72:0/2183050092 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cfc0073a0 con 0x7f2cf8003a30 2023-07-25T14:36:41.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:41.171+0000 7f2d13933700 1 -- 172.21.15.72:0/2183050092 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d0c154db0 con 0x7f2cf8003a30 2023-07-25T14:36:41.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:41.171+0000 7f2d01ffb700 1 -- 172.21.15.72:0/2183050092 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cfc001290 con 0x7f2cf8003a30 2023-07-25T14:36:41.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:41.172+0000 7f2d13933700 1 -- 172.21.15.72:0/2183050092 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d0c1497d0 con 0x7f2cf8003a30 2023-07-25T14:36:41.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:41.172+0000 7f2d13933700 1 -- 172.21.15.72:0/2183050092 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d0c04e470 con 0x7f2cf8003a30 2023-07-25T14:36:41.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:41.173+0000 7f2d01ffb700 1 -- 172.21.15.72:0/2183050092 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2cfc003680 con 0x7f2cf8003a30 2023-07-25T14:36:41.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:41.173+0000 7f2d01ffb700 1 --2- 172.21.15.72:0/2183050092 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f2cf006ace0 0x7f2cf006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:41.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:41.173+0000 7f2d01ffb700 1 -- 172.21.15.72:0/2183050092 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6047+0+0 (secure 0 0 0) 0x7f2cfc08a040 con 0x7f2cf8003a30 2023-07-25T14:36:41.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:41.174+0000 7f2d10ece700 1 --2- 172.21.15.72:0/2183050092 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f2cf006ace0 0x7f2cf006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:41.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:41.174+0000 7f2d10ece700 1 --2- 172.21.15.72:0/2183050092 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f2cf006ace0 0x7f2cf006d1a0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f2d08000fb0 tx=0x7f2d08007980 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:41.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:41.178+0000 7f2d01ffb700 1 -- 172.21.15.72:0/2183050092 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f2cfc055190 con 0x7f2cf8003a30 2023-07-25T14:36:41.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:41.367+0000 7f2d13933700 1 -- 172.21.15.72:0/2183050092 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f2d0c072000 con 0x7f2cf8003a30 2023-07-25T14:36:42.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:42.026+0000 7f2d01ffb700 1 -- 172.21.15.72:0/2183050092 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v31) v1 ==== 178+0+0 (secure 0 0 0) 0x7f2cfc0587b0 con 0x7f2cf8003a30 2023-07-25T14:36:42.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:42.032+0000 7f2d13933700 1 -- 172.21.15.72:0/2183050092 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f2cf006ace0 msgr2=0x7f2cf006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:42.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:42.032+0000 7f2d13933700 1 --2- 172.21.15.72:0/2183050092 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f2cf006ace0 0x7f2cf006d1a0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f2d08000fb0 tx=0x7f2d08007980 comp rx=0 tx=0).stop 2023-07-25T14:36:42.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:42.032+0000 7f2d13933700 1 -- 172.21.15.72:0/2183050092 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2cf8003a30 msgr2=0x7f2d0c1eaeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:42.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:42.032+0000 7f2d13933700 1 --2- 172.21.15.72:0/2183050092 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2cf8003a30 0x7f2d0c1eaeb0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f2cfc004000 tx=0x7f2cfc001120 comp rx=0 tx=0).stop 2023-07-25T14:36:42.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:42.032+0000 7f2d13933700 1 -- 172.21.15.72:0/2183050092 shutdown_connections 2023-07-25T14:36:42.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:42.032+0000 7f2d13933700 1 --2- 172.21.15.72:0/2183050092 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f2cf006ace0 0x7f2cf006d1a0 secure :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f2d08000fb0 tx=0x7f2d08007980 comp rx=0 tx=0).stop 2023-07-25T14:36:42.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:42.032+0000 7f2d13933700 1 --2- 172.21.15.72:0/2183050092 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2d0c148e80 0x7f2d0c14c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:42.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:42.032+0000 7f2d13933700 1 --2- 172.21.15.72:0/2183050092 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2cf8003a30 0x7f2d0c1eaeb0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:42.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:42.032+0000 7f2d13933700 1 --2- 172.21.15.72:0/2183050092 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2d0c1eb3f0 0x7f2d0c148940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:42.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:42.032+0000 7f2d13933700 1 -- 172.21.15.72:0/2183050092 >> 172.21.15.72:0/2183050092 conn(0x7f2d0c070c90 msgr2=0x7f2d0c0710a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:42.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:42.035+0000 7f2d13933700 1 -- 172.21.15.72:0/2183050092 shutdown_connections 2023-07-25T14:36:42.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:42.035+0000 7f2d13933700 1 -- 172.21.15.72:0/2183050092 wait complete. 2023-07-25T14:36:42.047 INFO:teuthology.orchestra.run.smithi072.stderr:pool 'cephfs_data_ec' removed 2023-07-25T14:36:42.063 INFO:tasks.ceph.mds.a:Restarting daemon 2023-07-25T14:36:42.063 INFO:tasks.ceph.mds.a:Stopping old one... 2023-07-25T14:36:42.064 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-07-25T14:36:42.064 INFO:teuthology.orchestra.run:waiting for 300 2023-07-25T14:36:42.064 INFO:tasks.ceph.mds.c:Restarting daemon 2023-07-25T14:36:42.064 INFO:tasks.ceph.mds.c:Stopping old one... 2023-07-25T14:36:42.065 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-07-25T14:36:42.065 INFO:teuthology.orchestra.run:waiting for 300 2023-07-25T14:36:42.065 INFO:tasks.ceph.mds.b:Restarting daemon 2023-07-25T14:36:42.065 INFO:tasks.ceph.mds.b:Stopping old one... 2023-07-25T14:36:42.066 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-07-25T14:36:42.066 INFO:teuthology.orchestra.run:waiting for 300 2023-07-25T14:36:42.066 INFO:tasks.ceph.mds.d:Restarting daemon 2023-07-25T14:36:42.066 INFO:tasks.ceph.mds.d:Stopping old one... 2023-07-25T14:36:42.067 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-07-25T14:36:42.067 INFO:teuthology.orchestra.run:waiting for 300 2023-07-25T14:36:42.073 INFO:tasks.ceph.mds.a:Stopped 2023-07-25T14:36:42.073 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-07-25T14:36:42.074 INFO:tasks.ceph.mds.c:Stopped 2023-07-25T14:36:42.075 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-07-25T14:36:42.076 INFO:tasks.ceph.mds.d:Stopped 2023-07-25T14:36:42.076 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-07-25T14:36:42.077 INFO:tasks.ceph.mds.b:Stopped 2023-07-25T14:36:42.077 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-07-25T14:36:42.116 INFO:tasks.ceph.mds.a:Started 2023-07-25T14:36:42.117 DEBUG:teuthology.parallel:result is None 2023-07-25T14:36:42.118 INFO:tasks.ceph.mds.c:Started 2023-07-25T14:36:42.118 DEBUG:teuthology.parallel:result is None 2023-07-25T14:36:42.119 INFO:tasks.ceph.mds.d:Started 2023-07-25T14:36:42.120 DEBUG:teuthology.parallel:result is None 2023-07-25T14:36:42.120 INFO:tasks.ceph.mds.b:Started 2023-07-25T14:36:42.121 DEBUG:teuthology.parallel:result is None 2023-07-25T14:36:42.121 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-07-25T14:36:42.199 INFO:tasks.ceph.mds.a.smithi072.stdout:starting mds.a at 2023-07-25T14:36:42.200 INFO:tasks.ceph.mds.c.smithi072.stdout:starting mds.c at 2023-07-25T14:36:42.214 INFO:tasks.ceph.mds.b.smithi092.stdout:starting mds.b at 2023-07-25T14:36:42.214 INFO:tasks.ceph.mds.d.smithi092.stdout:starting mds.d at 2023-07-25T14:36:42.251 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:42.241+0000 7f69fcd33700 1 Processor -- start 2023-07-25T14:36:42.252 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:42.241+0000 7f69fcd33700 1 -- start start 2023-07-25T14:36:42.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:42.242+0000 7f69fcd33700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f69f814ec50 0x7f69f8155440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:42.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:42.242+0000 7f69fcd33700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69f8151d70 con 0x7f69f80c4830 2023-07-25T14:36:42.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:42.242+0000 7f69fcd33700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69f80c4da0 con 0x7f69f80c58d0 2023-07-25T14:36:42.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:42.242+0000 7f69fcd33700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69f8151440 con 0x7f69f814ec50 2023-07-25T14:36:42.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:42.242+0000 7f69f6d9d700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f69f80c4830 0x7f69f806ec80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:60656/0 (socket says 172.21.15.72:60656) 2023-07-25T14:36:42.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:42.242+0000 7f69f6d9d700 1 -- 172.21.15.72:0/2482458434 learned_addr learned my addr 172.21.15.72:0/2482458434 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:36:42.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:42.242+0000 7f69f5d9b700 1 --2- 172.21.15.72:0/2482458434 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f69f814ec50 0x7f69f8155440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:42.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:42.242+0000 7f69f559a700 1 -- 172.21.15.72:0/2482458434 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3242584086 0 0) 0x7f69f8151d70 con 0x7f69f80c4830 2023-07-25T14:36:42.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:42.242+0000 7f69f559a700 1 -- 172.21.15.72:0/2482458434 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f69e40035b0 con 0x7f69f80c4830 2023-07-25T14:36:42.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:42.242+0000 7f69f559a700 1 -- 172.21.15.72:0/2482458434 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1884646083 0 0) 0x7f69e40035b0 con 0x7f69f80c4830 2023-07-25T14:36:42.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:42.242+0000 7f69f559a700 1 -- 172.21.15.72:0/2482458434 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f69f814ec50 msgr2=0x7f69f8155440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:42.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:42.242+0000 7f69f559a700 1 --2- 172.21.15.72:0/2482458434 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f69f814ec50 0x7f69f8155440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:42.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:42.242+0000 7f69f559a700 1 -- 172.21.15.72:0/2482458434 >> v1:172.21.15.92:6789/0 conn(0x7f69f80c58d0 legacy=0x7f69f814e540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:42.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:42.242+0000 7f69f559a700 1 -- 172.21.15.72:0/2482458434 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69f8151720 con 0x7f69f80c4830 2023-07-25T14:36:42.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:42.242+0000 7f69f559a700 1 -- 172.21.15.72:0/2482458434 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2559588315 0 0) 0x7f69f00019f0 con 0x7f69f80c4830 2023-07-25T14:36:42.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:42.243+0000 7f69f559a700 1 -- 172.21.15.72:0/2482458434 >> v1:172.21.15.72:6789/0 conn(0x7f69f80c4830 legacy=0x7f69f806ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:42.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:42.243+0000 7f69f559a700 1 --2- 172.21.15.72:0/2482458434 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f69e4003a30 0x7f69e4003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:42.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:42.243+0000 7f69f559a700 1 --2- 172.21.15.72:0/2482458434 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f69e40043e0 0x7f69e40048b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:42.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:42.243+0000 7f69f559a700 1 --2- 172.21.15.72:0/2482458434 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f69f814ec50 0x7f69e40051b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:42.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:42.243+0000 7f69f559a700 1 -- 172.21.15.72:0/2482458434 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69f8151440 con 0x7f69e4003a30 2023-07-25T14:36:42.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:42.243+0000 7f69f559a700 1 -- 172.21.15.72:0/2482458434 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69e400bac0 con 0x7f69e40043e0 2023-07-25T14:36:42.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:42.243+0000 7f69f559a700 1 -- 172.21.15.72:0/2482458434 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69e400bc80 con 0x7f69f814ec50 2023-07-25T14:36:42.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:42.243+0000 7f69f659c700 1 --2- 172.21.15.72:0/2482458434 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f69e4003a30 0x7f69e4003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:42.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:42.243+0000 7f69f5d9b700 1 --2- 172.21.15.72:0/2482458434 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f69e40043e0 0x7f69e40048b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:42.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:42.243+0000 7f69f6d9d700 1 --2- 172.21.15.72:0/2482458434 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f69f814ec50 0x7f69e40051b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:42.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:42.243+0000 7f69f659c700 1 -- 172.21.15.72:0/2482458434 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f69f814ec50 msgr2=0x7f69e40051b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:42.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:42.243+0000 7f69f659c700 1 --2- 172.21.15.72:0/2482458434 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f69f814ec50 0x7f69e40051b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:42.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:42.243+0000 7f69f659c700 1 -- 172.21.15.72:0/2482458434 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f69e40043e0 msgr2=0x7f69e40048b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:42.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:42.243+0000 7f69f659c700 1 --2- 172.21.15.72:0/2482458434 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f69e40043e0 0x7f69e40048b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:42.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:42.243+0000 7f69f659c700 1 -- 172.21.15.72:0/2482458434 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69e40035b0 con 0x7f69e4003a30 2023-07-25T14:36:42.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:42.243+0000 7f69f6d9d700 1 --2- 172.21.15.72:0/2482458434 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f69f814ec50 0x7f69e40051b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-25T14:36:42.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:42.243+0000 7f69f659c700 1 --2- 172.21.15.72:0/2482458434 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f69e4003a30 0x7f69e4003e10 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f69e8001820 tx=0x7f69e4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84351195df58e8de server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:42.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:42.243+0000 7f69f559a700 1 -- 172.21.15.72:0/2482458434 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69e80012e0 con 0x7f69e4003a30 2023-07-25T14:36:42.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:42.243+0000 7f69f559a700 1 -- 172.21.15.72:0/2482458434 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69e80052d0 con 0x7f69e4003a30 2023-07-25T14:36:42.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:42.243+0000 7f69f559a700 1 -- 172.21.15.72:0/2482458434 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69e80036d0 con 0x7f69e4003a30 2023-07-25T14:36:42.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:42.244+0000 7f69fcd33700 1 -- 172.21.15.72:0/2482458434 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f69e4003a30 msgr2=0x7f69e4003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:42.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:42.244+0000 7f69fcd33700 1 --2- 172.21.15.72:0/2482458434 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f69e4003a30 0x7f69e4003e10 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f69e8001820 tx=0x7f69e4005880 comp rx=0 tx=0).stop 2023-07-25T14:36:42.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:42.244+0000 7f69f6d9d700 1 -- 172.21.15.72:0/2482458434 reap_dead start 2023-07-25T14:36:42.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:42.244+0000 7f69fcd33700 1 -- 172.21.15.72:0/2482458434 shutdown_connections 2023-07-25T14:36:42.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:42.244+0000 7f69fcd33700 1 -- 172.21.15.72:0/2482458434 >> 172.21.15.72:0/2482458434 conn(0x7f69f80a8520 msgr2=0x7f69f80a8900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:42.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:42.244+0000 7f69fcd33700 1 -- 172.21.15.72:0/2482458434 shutdown_connections 2023-07-25T14:36:42.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:42.244+0000 7f69fcd33700 1 -- 172.21.15.72:0/2482458434 wait complete. 2023-07-25T14:36:42.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:42.245+0000 7f69fcd33700 1 Processor -- start 2023-07-25T14:36:42.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:42.245+0000 7f69fcd33700 1 -- start start 2023-07-25T14:36:42.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:42.246+0000 7f69fcd33700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f69e4003a30 0x7f69f80ba340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:42.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:42.246+0000 7f69fcd33700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f69f814c570 0x7f69f8153fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:42.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:42.246+0000 7f69fcd33700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f69f80bd4a0 0x7f69f80bfa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:42.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:42.246+0000 7f69fcd33700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69f80bc3b0 con 0x7f69e4003a30 2023-07-25T14:36:42.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:42.246+0000 7f69fcd33700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69f80bf590 con 0x7f69f814c570 2023-07-25T14:36:42.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:42.246+0000 7f69fcd33700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69f80c04e0 con 0x7f69f80bd4a0 2023-07-25T14:36:42.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:42.246+0000 7f69f659c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f69e4003a30 0x7f69f80ba340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:42.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:42.246+0000 7f69f659c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f69e4003a30 0x7f69f80ba340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41698/0 (socket says 172.21.15.72:41698) 2023-07-25T14:36:42.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:42.246+0000 7f69f659c700 1 -- 172.21.15.72:0/2796655951 learned_addr learned my addr 172.21.15.72:0/2796655951 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:42.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:42.246+0000 7f69f5d9b700 1 --2- 172.21.15.72:0/2796655951 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f69f814c570 0x7f69f8153fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:42.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:42.246+0000 7f69f6d9d700 1 --2- 172.21.15.72:0/2796655951 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f69f80bd4a0 0x7f69f80bfa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:42.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:42.246+0000 7f69f659c700 1 -- 172.21.15.72:0/2796655951 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f69f80bd4a0 msgr2=0x7f69f80bfa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:42.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:42.246+0000 7f69f659c700 1 --2- 172.21.15.72:0/2796655951 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f69f80bd4a0 0x7f69f80bfa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:42.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:42.246+0000 7f69f659c700 1 -- 172.21.15.72:0/2796655951 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f69f814c570 msgr2=0x7f69f8153fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:42.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:42.246+0000 7f69f659c700 1 --2- 172.21.15.72:0/2796655951 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f69f814c570 0x7f69f8153fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:42.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:42.246+0000 7f69f659c700 1 -- 172.21.15.72:0/2796655951 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69f814f780 con 0x7f69e4003a30 2023-07-25T14:36:42.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:42.246+0000 7f69f6d9d700 1 --2- 172.21.15.72:0/2796655951 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f69f80bd4a0 0x7f69f80bfa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-25T14:36:42.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:42.246+0000 7f69f659c700 1 --2- 172.21.15.72:0/2796655951 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f69e4003a30 0x7f69f80ba340 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f69e4005810 tx=0x7f69e8001170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:42.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:42.246+0000 7f69eeffd700 1 -- 172.21.15.72:0/2796655951 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69e8006e90 con 0x7f69e4003a30 2023-07-25T14:36:42.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:42.246+0000 7f69eeffd700 1 -- 172.21.15.72:0/2796655951 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69e8001280 con 0x7f69e4003a30 2023-07-25T14:36:42.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:42.247+0000 7f69eeffd700 1 -- 172.21.15.72:0/2796655951 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69e8007250 con 0x7f69e4003a30 2023-07-25T14:36:42.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:42.247+0000 7f69fcd33700 1 -- 172.21.15.72:0/2796655951 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69f80c0730 con 0x7f69e4003a30 2023-07-25T14:36:42.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:42.247+0000 7f69fcd33700 1 -- 172.21.15.72:0/2796655951 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69f81544e0 con 0x7f69e4003a30 2023-07-25T14:36:42.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:42.247+0000 7f69fcd33700 1 -- 172.21.15.72:0/2796655951 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69f804e470 con 0x7f69e4003a30 2023-07-25T14:36:42.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:42.248+0000 7f69eeffd700 1 -- 172.21.15.72:0/2796655951 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f69e80073b0 con 0x7f69e4003a30 2023-07-25T14:36:42.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:42.248+0000 7f69eeffd700 1 --2- 172.21.15.72:0/2796655951 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f69d806ace0 0x7f69d806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:42.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:42.248+0000 7f69eeffd700 1 -- 172.21.15.72:0/2796655951 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f69e8089d60 con 0x7f69e4003a30 2023-07-25T14:36:42.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:42.248+0000 7f69f5d9b700 1 --2- 172.21.15.72:0/2796655951 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f69d806ace0 0x7f69d806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:42.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:42.249+0000 7f69f5d9b700 1 --2- 172.21.15.72:0/2796655951 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f69d806ace0 0x7f69d806d1a0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f69f80a6c70 tx=0x7f69e0009210 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:42.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:42.253+0000 7f69eeffd700 1 -- 172.21.15.72:0/2796655951 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f69e8055180 con 0x7f69e4003a30 2023-07-25T14:36:42.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:42.455+0000 7f69fcd33700 1 -- 172.21.15.72:0/2796655951 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f69f80a6270 con 0x7f69e4003a30 2023-07-25T14:36:43.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:43.053+0000 7f69eeffd700 1 -- 172.21.15.72:0/2796655951 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v33) v1 ==== 97+0+0 (secure 0 0 0) 0x7f69e8017080 con 0x7f69e4003a30 2023-07-25T14:36:43.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:43.056+0000 7f69fcd33700 1 -- 172.21.15.72:0/2796655951 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f69d806ace0 msgr2=0x7f69d806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:43.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:43.056+0000 7f69fcd33700 1 --2- 172.21.15.72:0/2796655951 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f69d806ace0 0x7f69d806d1a0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f69f80a6c70 tx=0x7f69e0009210 comp rx=0 tx=0).stop 2023-07-25T14:36:43.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:43.056+0000 7f69fcd33700 1 -- 172.21.15.72:0/2796655951 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f69e4003a30 msgr2=0x7f69f80ba340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:43.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:43.056+0000 7f69fcd33700 1 --2- 172.21.15.72:0/2796655951 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f69e4003a30 0x7f69f80ba340 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f69e4005810 tx=0x7f69e8001170 comp rx=0 tx=0).stop 2023-07-25T14:36:43.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:43.056+0000 7f69fcd33700 1 -- 172.21.15.72:0/2796655951 shutdown_connections 2023-07-25T14:36:43.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:43.056+0000 7f69fcd33700 1 --2- 172.21.15.72:0/2796655951 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f69d806ace0 0x7f69d806d1a0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:43.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:43.056+0000 7f69fcd33700 1 --2- 172.21.15.72:0/2796655951 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f69f80bd4a0 0x7f69f80bfa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:43.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:43.056+0000 7f69fcd33700 1 --2- 172.21.15.72:0/2796655951 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f69e4003a30 0x7f69f80ba340 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:43.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:43.056+0000 7f69fcd33700 1 --2- 172.21.15.72:0/2796655951 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f69f814c570 0x7f69f8153fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:43.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:43.056+0000 7f69fcd33700 1 -- 172.21.15.72:0/2796655951 >> 172.21.15.72:0/2796655951 conn(0x7f69f80a8520 msgr2=0x7f69f80c6910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:43.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:43.056+0000 7f69fcd33700 1 -- 172.21.15.72:0/2796655951 shutdown_connections 2023-07-25T14:36:43.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:43.056+0000 7f69fcd33700 1 -- 172.21.15.72:0/2796655951 wait complete. 2023-07-25T14:36:43.069 INFO:teuthology.orchestra.run.smithi072.stderr: removed all blocklist entries 2023-07-25T14:36:43.082 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-07-25T14:36:43.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:43.195+0000 7fe7124aa700 1 Processor -- start 2023-07-25T14:36:43.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:43.195+0000 7fe7124aa700 1 -- start start 2023-07-25T14:36:43.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:43.196+0000 7fe7124aa700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe70c14f810 0x7fe70c0c4370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:43.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:43.196+0000 7fe7124aa700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe70c0c5890 con 0x7fe70c0bb0b0 2023-07-25T14:36:43.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:43.196+0000 7fe7124aa700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe70c152150 con 0x7fe70c0a9cc0 2023-07-25T14:36:43.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:43.196+0000 7fe7124aa700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe70c14fbf0 con 0x7fe70c14f810 2023-07-25T14:36:43.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:43.196+0000 7fe70bfff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe70c14f810 0x7fe70c0c4370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:43.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:43.196+0000 7fe70bfff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe70c14f810 0x7fe70c0c4370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41708/0 (socket says 172.21.15.72:41708) 2023-07-25T14:36:43.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:43.196+0000 7fe70bfff700 1 -- 172.21.15.72:0/4235586391 learned_addr learned my addr 172.21.15.72:0/4235586391 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:43.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:43.196+0000 7fe710a47700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fe70c0bb0b0 0x7fe70c15cab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:60680/0 (socket says 172.21.15.72:60680) 2023-07-25T14:36:43.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:43.196+0000 7fe70bfff700 1 -- 172.21.15.72:0/4235586391 >> v1:172.21.15.92:6789/0 conn(0x7fe70c0a9cc0 legacy=0x7fe70c1525e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:43.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:43.196+0000 7fe70bfff700 1 -- 172.21.15.72:0/4235586391 >> v1:172.21.15.72:6789/0 conn(0x7fe70c0bb0b0 legacy=0x7fe70c15cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:43.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:43.197+0000 7fe70bfff700 1 -- 172.21.15.72:0/4235586391 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe70c1566a0 con 0x7fe70c14f810 2023-07-25T14:36:43.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:43.196+0000 7fe70affd700 1 -- 172.21.15.72:0/4235586391 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1127242808 0 0) 0x7fe70c0c5890 con 0x7fe70c0bb0b0 2023-07-25T14:36:43.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:43.197+0000 7fe70bfff700 1 --2- 172.21.15.72:0/4235586391 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe70c14f810 0x7fe70c0c4370 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fe7000098f0 tx=0x7fe700009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77cbfe40041401a0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:43.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:43.197+0000 7fe70affd700 1 -- 172.21.15.72:0/4235586391 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe700004230 con 0x7fe70c14f810 2023-07-25T14:36:43.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:43.197+0000 7fe70affd700 1 -- 172.21.15.72:0/4235586391 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe700004390 con 0x7fe70c14f810 2023-07-25T14:36:43.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:43.197+0000 7fe70affd700 1 -- 172.21.15.72:0/4235586391 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7000036a0 con 0x7fe70c14f810 2023-07-25T14:36:43.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:43.197+0000 7fe7124aa700 1 -- 172.21.15.72:0/4235586391 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe70c14f810 msgr2=0x7fe70c0c4370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:43.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:43.197+0000 7fe7124aa700 1 --2- 172.21.15.72:0/4235586391 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe70c14f810 0x7fe70c0c4370 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fe7000098f0 tx=0x7fe700009c00 comp rx=0 tx=0).stop 2023-07-25T14:36:43.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:43.197+0000 7fe7124aa700 1 -- 172.21.15.72:0/4235586391 shutdown_connections 2023-07-25T14:36:43.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:43.197+0000 7fe7124aa700 1 --2- 172.21.15.72:0/4235586391 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe70c14f810 0x7fe70c0c4370 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:43.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:43.197+0000 7fe7124aa700 1 -- 172.21.15.72:0/4235586391 >> 172.21.15.72:0/4235586391 conn(0x7fe70c06a8d0 msgr2=0x7fe70c0a94e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:43.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:43.197+0000 7fe7124aa700 1 -- 172.21.15.72:0/4235586391 shutdown_connections 2023-07-25T14:36:43.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:43.197+0000 7fe7124aa700 1 -- 172.21.15.72:0/4235586391 wait complete. 2023-07-25T14:36:43.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:43.199+0000 7fe7124aa700 1 Processor -- start 2023-07-25T14:36:43.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:43.199+0000 7fe7124aa700 1 -- start start 2023-07-25T14:36:43.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:43.200+0000 7fe7124aa700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe70c0a9cc0 0x7fe70c0bdbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:43.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:43.200+0000 7fe7124aa700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe70c0bb0b0 0x7fe70c0bf420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:43.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:43.200+0000 7fe7124aa700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe70c14f810 0x7fe70c0bf960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:43.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:43.200+0000 7fe7124aa700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe70c0bef90 con 0x7fe70c14f810 2023-07-25T14:36:43.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:43.200+0000 7fe7124aa700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe70c0c12e0 con 0x7fe70c0bb0b0 2023-07-25T14:36:43.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:43.200+0000 7fe7124aa700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe70c0c15c0 con 0x7fe70c0a9cc0 2023-07-25T14:36:43.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:43.200+0000 7fe710a47700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe70c14f810 0x7fe70c0bf960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:43.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:43.200+0000 7fe710a47700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe70c14f810 0x7fe70c0bf960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41718/0 (socket says 172.21.15.72:41718) 2023-07-25T14:36:43.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:43.200+0000 7fe710a47700 1 -- 172.21.15.72:0/788589779 learned_addr learned my addr 172.21.15.72:0/788589779 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:43.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:43.200+0000 7fe70b7fe700 1 --2- 172.21.15.72:0/788589779 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe70c0bb0b0 0x7fe70c0bf420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:43.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:43.200+0000 7fe710a47700 1 -- 172.21.15.72:0/788589779 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe70c0a9cc0 msgr2=0x7fe70c0bdbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:43.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:43.200+0000 7fe70bfff700 1 --2- 172.21.15.72:0/788589779 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe70c0a9cc0 0x7fe70c0bdbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:43.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:43.200+0000 7fe710a47700 1 --2- 172.21.15.72:0/788589779 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe70c0a9cc0 0x7fe70c0bdbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:43.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:43.200+0000 7fe710a47700 1 -- 172.21.15.72:0/788589779 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe70c0bb0b0 msgr2=0x7fe70c0bf420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:43.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:43.200+0000 7fe710a47700 1 --2- 172.21.15.72:0/788589779 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe70c0bb0b0 0x7fe70c0bf420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:43.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:43.200+0000 7fe710a47700 1 -- 172.21.15.72:0/788589779 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe700009550 con 0x7fe70c14f810 2023-07-25T14:36:43.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:43.201+0000 7fe710a47700 1 --2- 172.21.15.72:0/788589779 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe70c14f810 0x7fe70c0bf960 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fe70400cc10 tx=0x7fe704002210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:43.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:43.201+0000 7fe708ff9700 1 -- 172.21.15.72:0/788589779 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe70400ab80 con 0x7fe70c14f810 2023-07-25T14:36:43.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:43.201+0000 7fe708ff9700 1 -- 172.21.15.72:0/788589779 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe70400ace0 con 0x7fe70c14f810 2023-07-25T14:36:43.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:43.201+0000 7fe7124aa700 1 -- 172.21.15.72:0/788589779 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe70c0bec20 con 0x7fe70c14f810 2023-07-25T14:36:43.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:43.201+0000 7fe708ff9700 1 -- 172.21.15.72:0/788589779 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe704007310 con 0x7fe70c14f810 2023-07-25T14:36:43.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:43.201+0000 7fe7124aa700 1 -- 172.21.15.72:0/788589779 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe70c0ad090 con 0x7fe70c14f810 2023-07-25T14:36:43.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:43.202+0000 7fe7124aa700 1 -- 172.21.15.72:0/788589779 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe70c0bea60 con 0x7fe70c14f810 2023-07-25T14:36:43.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:43.202+0000 7fe708ff9700 1 -- 172.21.15.72:0/788589779 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe704007470 con 0x7fe70c14f810 2023-07-25T14:36:43.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:43.203+0000 7fe708ff9700 1 --2- 172.21.15.72:0/788589779 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fe6f806ace0 0x7fe6f806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:43.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:43.203+0000 7fe708ff9700 1 -- 172.21.15.72:0/788589779 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5530+0+0 (secure 0 0 0) 0x7fe704088f90 con 0x7fe70c14f810 2023-07-25T14:36:43.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:43.203+0000 7fe70bfff700 1 --2- 172.21.15.72:0/788589779 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fe6f806ace0 0x7fe6f806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:43.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:43.203+0000 7fe70bfff700 1 --2- 172.21.15.72:0/788589779 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fe6f806ace0 0x7fe6f806d1a0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fe700009c40 tx=0x7fe700008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:43.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:43.207+0000 7fe708ff9700 1 -- 172.21.15.72:0/788589779 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fe7040542e0 con 0x7fe70c14f810 2023-07-25T14:36:43.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:43.468+0000 7fe7124aa700 1 -- 172.21.15.72:0/788589779 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fe70c0ac1f0 con 0x7fe70c14f810 2023-07-25T14:36:43.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:43.468+0000 7fe708ff9700 1 -- 172.21.15.72:0/788589779 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v6) v1 ==== 80+0+6065 (secure 0 0 0) 0x7fe704018020 con 0x7fe70c14f810 2023-07-25T14:36:43.480 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-25T14:36:43.480 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-07-25T14:36:43.480 INFO:teuthology.orchestra.run.smithi072.stdout: "auth_dump": [ 2023-07-25T14:36:43.481 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-07-25T14:36:43.481 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "mds.a", 2023-07-25T14:36:43.481 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQCI3b9kxN0HEBAAnEgyrSmMgSmqg52QCBBAXg==", 2023-07-25T14:36:43.482 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-07-25T14:36:43.482 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": "allow", 2023-07-25T14:36:43.482 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow *", 2023-07-25T14:36:43.483 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow *", 2023-07-25T14:36:43.483 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-07-25T14:36:43.483 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-07-25T14:36:43.483 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-07-25T14:36:43.484 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-07-25T14:36:43.484 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "mds.b", 2023-07-25T14:36:43.484 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQCI3b9k9E1QHBAAtQ3+KQ2iWS4MWp8ydNmXwg==", 2023-07-25T14:36:43.485 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-07-25T14:36:43.485 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": "allow", 2023-07-25T14:36:43.485 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow *", 2023-07-25T14:36:43.485 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow *", 2023-07-25T14:36:43.486 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-07-25T14:36:43.486 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-07-25T14:36:43.486 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-07-25T14:36:43.486 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-07-25T14:36:43.486 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "mds.c", 2023-07-25T14:36:43.487 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQCI3b9kKrguFxAAIA8EagIfMcMVROAL3rEetg==", 2023-07-25T14:36:43.487 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-07-25T14:36:43.487 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": "allow", 2023-07-25T14:36:43.489 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow *", 2023-07-25T14:36:43.489 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow *", 2023-07-25T14:36:43.489 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-07-25T14:36:43.489 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-07-25T14:36:43.489 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-07-25T14:36:43.489 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-07-25T14:36:43.490 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "mds.d", 2023-07-25T14:36:43.490 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQCI3b9k0n2mIxAA+ga0Z55EygoBenB3JZfndQ==", 2023-07-25T14:36:43.490 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-07-25T14:36:43.490 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": "allow", 2023-07-25T14:36:43.490 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow *", 2023-07-25T14:36:43.491 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow *", 2023-07-25T14:36:43.491 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-07-25T14:36:43.491 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-07-25T14:36:43.491 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-07-25T14:36:43.491 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-07-25T14:36:43.491 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "osd.0", 2023-07-25T14:36:43.491 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQCL3b9kt8KrNhAATMANux0x8pqETvHcwfe+jA==", 2023-07-25T14:36:43.491 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-07-25T14:36:43.492 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow profile osd", 2023-07-25T14:36:43.492 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile osd", 2023-07-25T14:36:43.492 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-07-25T14:36:43.492 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-07-25T14:36:43.492 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-07-25T14:36:43.492 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-07-25T14:36:43.492 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "osd.1", 2023-07-25T14:36:43.493 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQCO3b9kKZqoNRAAPhEAV8i8LjCRlsHUWWzgGg==", 2023-07-25T14:36:43.493 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-07-25T14:36:43.493 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow profile osd", 2023-07-25T14:36:43.493 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile osd", 2023-07-25T14:36:43.493 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-07-25T14:36:43.493 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-07-25T14:36:43.493 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-07-25T14:36:43.494 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-07-25T14:36:43.494 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "osd.2", 2023-07-25T14:36:43.494 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQCR3b9kOgUONRAA05jvcIlbYBtNnlMryBUsEw==", 2023-07-25T14:36:43.494 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-07-25T14:36:43.494 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow profile osd", 2023-07-25T14:36:43.494 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile osd", 2023-07-25T14:36:43.494 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-07-25T14:36:43.494 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-07-25T14:36:43.495 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-07-25T14:36:43.495 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-07-25T14:36:43.495 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "osd.3", 2023-07-25T14:36:43.495 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQCU3b9kiCNMNBAAIGnnWPs/tzjDMMViNWOgpg==", 2023-07-25T14:36:43.495 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-07-25T14:36:43.495 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow profile osd", 2023-07-25T14:36:43.496 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile osd", 2023-07-25T14:36:43.496 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-07-25T14:36:43.496 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-07-25T14:36:43.496 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-07-25T14:36:43.496 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-07-25T14:36:43.496 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "osd.4", 2023-07-25T14:36:43.496 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQCa3b9kOuNDORAAhqs3jZIKDxp08d/R0MbnrQ==", 2023-07-25T14:36:43.497 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-07-25T14:36:43.497 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow profile osd", 2023-07-25T14:36:43.497 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile osd", 2023-07-25T14:36:43.497 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-07-25T14:36:43.497 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-07-25T14:36:43.497 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-07-25T14:36:43.497 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-07-25T14:36:43.498 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "osd.5", 2023-07-25T14:36:43.498 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQCd3b9kMvn/OBAAj8R00HLAH23ld0/0A6e5XA==", 2023-07-25T14:36:43.498 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-07-25T14:36:43.498 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow profile osd", 2023-07-25T14:36:43.498 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile osd", 2023-07-25T14:36:43.498 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-07-25T14:36:43.498 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-07-25T14:36:43.499 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-07-25T14:36:43.499 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-07-25T14:36:43.499 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "osd.6", 2023-07-25T14:36:43.499 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQCg3b9kXWwUOBAAKyB6jtX1TMOe4daeeVH67A==", 2023-07-25T14:36:43.499 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-07-25T14:36:43.499 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow profile osd", 2023-07-25T14:36:43.499 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile osd", 2023-07-25T14:36:43.500 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-07-25T14:36:43.500 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-07-25T14:36:43.500 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-07-25T14:36:43.500 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-07-25T14:36:43.500 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "osd.7", 2023-07-25T14:36:43.500 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQCj3b9kp0GXNxAAMZEzI57maI7h3DJpHtlGyg==", 2023-07-25T14:36:43.500 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-07-25T14:36:43.501 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow profile osd", 2023-07-25T14:36:43.501 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile osd", 2023-07-25T14:36:43.501 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-07-25T14:36:43.501 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-07-25T14:36:43.501 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-07-25T14:36:43.501 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-07-25T14:36:43.502 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "client.0", 2023-07-25T14:36:43.502 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQCI3b9k9P3nJxAAF+MNeILdw3WF8ZQhKpISew==", 2023-07-25T14:36:43.502 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-07-25T14:36:43.502 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": "allow", 2023-07-25T14:36:43.502 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow r", 2023-07-25T14:36:43.502 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow rw", 2023-07-25T14:36:43.503 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow rwx" 2023-07-25T14:36:43.503 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-07-25T14:36:43.503 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-07-25T14:36:43.503 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-07-25T14:36:43.503 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "client.1", 2023-07-25T14:36:43.503 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQCI3b9kRPMxKxAAACbj386PGidKwcHoe2J57A==", 2023-07-25T14:36:43.503 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-07-25T14:36:43.503 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": "allow", 2023-07-25T14:36:43.504 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow r", 2023-07-25T14:36:43.504 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow rw", 2023-07-25T14:36:43.504 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow rwx" 2023-07-25T14:36:43.504 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-07-25T14:36:43.504 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-07-25T14:36:43.504 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-07-25T14:36:43.504 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "client.admin", 2023-07-25T14:36:43.505 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQCH3b9kWMr/LBAA5l6Yw5McXUOEpgcrhT86RQ==", 2023-07-25T14:36:43.505 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-07-25T14:36:43.505 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": "allow *", 2023-07-25T14:36:43.505 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow *", 2023-07-25T14:36:43.505 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow *", 2023-07-25T14:36:43.505 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-07-25T14:36:43.505 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-07-25T14:36:43.506 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-07-25T14:36:43.506 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-07-25T14:36:43.506 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "client.bootstrap-mds", 2023-07-25T14:36:43.506 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQCp3b9kDRa8KxAAxGxg/2i1zNLvv8mL1QTa6w==", 2023-07-25T14:36:43.506 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-07-25T14:36:43.506 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile bootstrap-mds" 2023-07-25T14:36:43.506 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-07-25T14:36:43.506 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-07-25T14:36:43.507 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-07-25T14:36:43.507 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "client.bootstrap-mgr", 2023-07-25T14:36:43.507 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQCp3b9kViq8KxAArnefGUBdy+BRNX1uFqi0eQ==", 2023-07-25T14:36:43.507 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-07-25T14:36:43.507 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile bootstrap-mgr" 2023-07-25T14:36:43.507 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-07-25T14:36:43.507 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-07-25T14:36:43.508 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-07-25T14:36:43.508 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "client.bootstrap-osd", 2023-07-25T14:36:43.508 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQCp3b9k4DG8KxAAnFIUykRoN5slG+uH+K+KKw==", 2023-07-25T14:36:43.508 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-07-25T14:36:43.508 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile bootstrap-osd" 2023-07-25T14:36:43.508 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-07-25T14:36:43.508 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-07-25T14:36:43.509 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-07-25T14:36:43.509 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "client.bootstrap-rbd", 2023-07-25T14:36:43.509 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQCp3b9kzji8KxAA5eqd/JD0UE0HOsbx1eliGg==", 2023-07-25T14:36:43.509 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-07-25T14:36:43.509 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile bootstrap-rbd" 2023-07-25T14:36:43.509 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-07-25T14:36:43.509 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-07-25T14:36:43.509 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-07-25T14:36:43.510 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-07-25T14:36:43.510 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQCp3b9k0j+8KxAAawUcKTGwfgHBGqfGqOwfUw==", 2023-07-25T14:36:43.510 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-07-25T14:36:43.510 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-07-25T14:36:43.510 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-07-25T14:36:43.510 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-07-25T14:36:43.510 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-07-25T14:36:43.510 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "client.bootstrap-rgw", 2023-07-25T14:36:43.511 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQCp3b9koEi8KxAAKq+FKwKBOQjT1PflDyQpOQ==", 2023-07-25T14:36:43.511 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-07-25T14:36:43.511 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile bootstrap-rgw" 2023-07-25T14:36:43.511 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-07-25T14:36:43.511 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-07-25T14:36:43.511 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-07-25T14:36:43.512 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "mgr.x", 2023-07-25T14:36:43.512 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQCI3b9kGgynDBAA7I0mBcwS0zmXAN9uxn4LCQ==", 2023-07-25T14:36:43.512 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-07-25T14:36:43.512 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": "allow *", 2023-07-25T14:36:43.512 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile mgr", 2023-07-25T14:36:43.512 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-07-25T14:36:43.512 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-07-25T14:36:43.513 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-07-25T14:36:43.513 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-07-25T14:36:43.513 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "mgr.y", 2023-07-25T14:36:43.513 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQCI3b9k5aWABxAAzNuS36Orii6Hxg/6h9cx8Q==", 2023-07-25T14:36:43.513 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-07-25T14:36:43.513 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": "allow *", 2023-07-25T14:36:43.513 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile mgr", 2023-07-25T14:36:43.514 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-07-25T14:36:43.514 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-07-25T14:36:43.514 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-07-25T14:36:43.514 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-07-25T14:36:43.514 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-07-25T14:36:43.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:43.470+0000 7fe7124aa700 1 -- 172.21.15.72:0/788589779 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fe6f806ace0 msgr2=0x7fe6f806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:43.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:43.470+0000 7fe7124aa700 1 --2- 172.21.15.72:0/788589779 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fe6f806ace0 0x7fe6f806d1a0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fe700009c40 tx=0x7fe700008030 comp rx=0 tx=0).stop 2023-07-25T14:36:43.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:43.470+0000 7fe7124aa700 1 -- 172.21.15.72:0/788589779 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe70c14f810 msgr2=0x7fe70c0bf960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:43.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:43.470+0000 7fe7124aa700 1 --2- 172.21.15.72:0/788589779 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe70c14f810 0x7fe70c0bf960 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fe70400cc10 tx=0x7fe704002210 comp rx=0 tx=0).stop 2023-07-25T14:36:43.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:43.470+0000 7fe7124aa700 1 -- 172.21.15.72:0/788589779 shutdown_connections 2023-07-25T14:36:43.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:43.471+0000 7fe7124aa700 1 --2- 172.21.15.72:0/788589779 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fe6f806ace0 0x7fe6f806d1a0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:43.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:43.471+0000 7fe7124aa700 1 --2- 172.21.15.72:0/788589779 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe70c0a9cc0 0x7fe70c0bdbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:43.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:43.471+0000 7fe7124aa700 1 --2- 172.21.15.72:0/788589779 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe70c14f810 0x7fe70c0bf960 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:43.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:43.471+0000 7fe7124aa700 1 --2- 172.21.15.72:0/788589779 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe70c0bb0b0 0x7fe70c0bf420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:43.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:43.471+0000 7fe7124aa700 1 -- 172.21.15.72:0/788589779 >> 172.21.15.72:0/788589779 conn(0x7fe70c06a8d0 msgr2=0x7fe70c0c5540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:43.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:43.471+0000 7fe7124aa700 1 -- 172.21.15.72:0/788589779 shutdown_connections 2023-07-25T14:36:43.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:43.471+0000 7fe7124aa700 1 -- 172.21.15.72:0/788589779 wait complete. 2023-07-25T14:36:43.519 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-07-25T14:36:43.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:43.629+0000 7f027fb39700 1 Processor -- start 2023-07-25T14:36:43.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:43.629+0000 7f027fb39700 1 -- start start 2023-07-25T14:36:43.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:43.630+0000 7f027fb39700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f02780bb0a0 0x7f027806f120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:43.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:43.630+0000 7f027fb39700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f02780c5910 0x7f027806f660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:43.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:43.630+0000 7f027fb39700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02780c4cc0 con 0x7f027814f820 2023-07-25T14:36:43.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:43.630+0000 7f027fb39700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0278152f30 con 0x7f02780bb0a0 2023-07-25T14:36:43.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:43.630+0000 7f027fb39700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02780c4420 con 0x7f02780c5910 2023-07-25T14:36:43.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:43.630+0000 7f027d0d4700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f02780bb0a0 0x7f027806f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:43.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:43.630+0000 7f027d0d4700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f02780bb0a0 0x7f027806f120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41724/0 (socket says 172.21.15.72:41724) 2023-07-25T14:36:43.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:43.630+0000 7f027d0d4700 1 -- 172.21.15.72:0/3124155863 learned_addr learned my addr 172.21.15.72:0/3124155863 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:43.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:43.630+0000 7f027e0d6700 1 --2- 172.21.15.72:0/3124155863 >> v2:172.21.15.92:3300/0 conn(0x7f02780c5910 0x7f027806f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:43.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:43.631+0000 7f027d0d4700 1 -- 172.21.15.72:0/3124155863 >> v2:172.21.15.92:3300/0 conn(0x7f02780c5910 msgr2=0x7f027806f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:43.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:43.631+0000 7f027d0d4700 1 --2- 172.21.15.72:0/3124155863 >> v2:172.21.15.92:3300/0 conn(0x7f02780c5910 0x7f027806f660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:43.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:43.631+0000 7f027d0d4700 1 -- 172.21.15.72:0/3124155863 >> v1:172.21.15.92:6789/0 conn(0x7f027814f820 legacy=0x7f02780c2390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:43.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:43.631+0000 7f027d0d4700 1 -- 172.21.15.72:0/3124155863 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02780c4700 con 0x7f02780bb0a0 2023-07-25T14:36:43.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:43.631+0000 7f027e0d6700 1 --2- 172.21.15.72:0/3124155863 >> v2:172.21.15.92:3300/0 conn(0x7f02780c5910 0x7f027806f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-25T14:36:43.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:43.631+0000 7f027d0d4700 1 --2- 172.21.15.72:0/3124155863 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f02780bb0a0 0x7f027806f120 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f02780a7440 tx=0x7f0274009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39a680075da5971a server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:43.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:43.631+0000 7f027c8d3700 1 -- 172.21.15.72:0/3124155863 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f027400b870 con 0x7f02780bb0a0 2023-07-25T14:36:43.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:43.631+0000 7f027c8d3700 1 -- 172.21.15.72:0/3124155863 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f027400b9d0 con 0x7f02780bb0a0 2023-07-25T14:36:43.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:43.631+0000 7f027c8d3700 1 -- 172.21.15.72:0/3124155863 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f027400bd60 con 0x7f02780bb0a0 2023-07-25T14:36:43.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:43.631+0000 7f027fb39700 1 -- 172.21.15.72:0/3124155863 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f02780bb0a0 msgr2=0x7f027806f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:43.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:43.631+0000 7f027fb39700 1 --2- 172.21.15.72:0/3124155863 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f02780bb0a0 0x7f027806f120 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f02780a7440 tx=0x7f0274009bd0 comp rx=0 tx=0).stop 2023-07-25T14:36:43.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:43.631+0000 7f027fb39700 1 -- 172.21.15.72:0/3124155863 shutdown_connections 2023-07-25T14:36:43.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:43.631+0000 7f027fb39700 1 --2- 172.21.15.72:0/3124155863 >> v2:172.21.15.92:3300/0 conn(0x7f02780c5910 0x7f027806f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:43.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:43.631+0000 7f027fb39700 1 --2- 172.21.15.72:0/3124155863 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f02780bb0a0 0x7f027806f120 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:43.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:43.631+0000 7f027fb39700 1 -- 172.21.15.72:0/3124155863 >> 172.21.15.72:0/3124155863 conn(0x7f027806a980 msgr2=0x7f02780a9540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:43.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:43.632+0000 7f027fb39700 1 -- 172.21.15.72:0/3124155863 shutdown_connections 2023-07-25T14:36:43.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:43.632+0000 7f027fb39700 1 -- 172.21.15.72:0/3124155863 wait complete. 2023-07-25T14:36:43.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:43.633+0000 7f027fb39700 1 Processor -- start 2023-07-25T14:36:43.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:43.633+0000 7f027fb39700 1 -- start start 2023-07-25T14:36:43.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:43.633+0000 7f027fb39700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f02780bb0a0 0x7f02780bed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:43.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:43.633+0000 7f027fb39700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f02780c5910 0x7f027806c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:43.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:43.633+0000 7f027fb39700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f027814f820 0x7f02781ecdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:43.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:43.633+0000 7f027fb39700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f027806bd50 con 0x7f02780bb0a0 2023-07-25T14:36:43.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:43.633+0000 7f027fb39700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02781ed980 con 0x7f02780c5910 2023-07-25T14:36:43.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:43.633+0000 7f027fb39700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f027806bff0 con 0x7f027814f820 2023-07-25T14:36:43.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:43.633+0000 7f027d8d5700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f02780bb0a0 0x7f02780bed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:43.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:43.633+0000 7f027d8d5700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f02780bb0a0 0x7f02780bed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41728/0 (socket says 172.21.15.72:41728) 2023-07-25T14:36:43.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:43.633+0000 7f027d8d5700 1 -- 172.21.15.72:0/4066397445 learned_addr learned my addr 172.21.15.72:0/4066397445 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:43.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:43.634+0000 7f027d0d4700 1 --2- 172.21.15.72:0/4066397445 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f02780c5910 0x7f027806c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:43.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:43.634+0000 7f027e0d6700 1 --2- 172.21.15.72:0/4066397445 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f027814f820 0x7f02781ecdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:43.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:43.634+0000 7f027d8d5700 1 -- 172.21.15.72:0/4066397445 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f027814f820 msgr2=0x7f02781ecdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:43.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:43.634+0000 7f027d8d5700 1 --2- 172.21.15.72:0/4066397445 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f027814f820 0x7f02781ecdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:43.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:43.634+0000 7f027d8d5700 1 -- 172.21.15.72:0/4066397445 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f02780c5910 msgr2=0x7f027806c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:43.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:43.634+0000 7f027d8d5700 1 --2- 172.21.15.72:0/4066397445 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f02780c5910 0x7f027806c4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:43.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:43.634+0000 7f027d8d5700 1 -- 172.21.15.72:0/4066397445 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0274009550 con 0x7f02780bb0a0 2023-07-25T14:36:43.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:43.634+0000 7f027e0d6700 1 --2- 172.21.15.72:0/4066397445 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f027814f820 0x7f02781ecdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-25T14:36:43.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:43.634+0000 7f027d8d5700 1 --2- 172.21.15.72:0/4066397445 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f02780bb0a0 0x7f02780bed60 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f026c00c4d0 tx=0x7f026c00c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:43.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:43.634+0000 7f026a7fc700 1 -- 172.21.15.72:0/4066397445 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f026c0052d0 con 0x7f02780bb0a0 2023-07-25T14:36:43.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:43.634+0000 7f026a7fc700 1 -- 172.21.15.72:0/4066397445 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f026c005430 con 0x7f02780bb0a0 2023-07-25T14:36:43.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:43.634+0000 7f027fb39700 1 -- 172.21.15.72:0/4066397445 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02781521a0 con 0x7f02780bb0a0 2023-07-25T14:36:43.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:43.634+0000 7f026a7fc700 1 -- 172.21.15.72:0/4066397445 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f026c0038f0 con 0x7f02780bb0a0 2023-07-25T14:36:43.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:43.634+0000 7f027fb39700 1 -- 172.21.15.72:0/4066397445 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f027814c2a0 con 0x7f02780bb0a0 2023-07-25T14:36:43.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:43.635+0000 7f027fb39700 1 -- 172.21.15.72:0/4066397445 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f027806c1b0 con 0x7f02780bb0a0 2023-07-25T14:36:43.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:43.635+0000 7f026a7fc700 1 -- 172.21.15.72:0/4066397445 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f026c003a50 con 0x7f02780bb0a0 2023-07-25T14:36:43.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:43.636+0000 7f026a7fc700 1 --2- 172.21.15.72:0/4066397445 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f025c06ace0 0x7f025c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:43.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:43.636+0000 7f026a7fc700 1 -- 172.21.15.72:0/4066397445 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f026c088620 con 0x7f02780bb0a0 2023-07-25T14:36:43.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:43.636+0000 7f027d0d4700 1 --2- 172.21.15.72:0/4066397445 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f025c06ace0 0x7f025c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:43.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:43.636+0000 7f027d0d4700 1 --2- 172.21.15.72:0/4066397445 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f025c06ace0 0x7f025c06d1a0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f0274000c00 tx=0x7f0274008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:43.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:43.640+0000 7f026a7fc700 1 -- 172.21.15.72:0/4066397445 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f026c053970 con 0x7f02780bb0a0 2023-07-25T14:36:43.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:43.908+0000 7f027fb39700 1 -- 172.21.15.72:0/4066397445 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f027804e470 con 0x7f02780bb0a0 2023-07-25T14:36:43.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:43.911+0000 7f026a7fc700 1 -- 172.21.15.72:0/4066397445 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7f026c056f90 con 0x7f02780bb0a0 2023-07-25T14:36:43.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:43.913+0000 7f027fb39700 1 -- 172.21.15.72:0/4066397445 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f025c06ace0 msgr2=0x7f025c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:43.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:43.913+0000 7f027fb39700 1 --2- 172.21.15.72:0/4066397445 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f025c06ace0 0x7f025c06d1a0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f0274000c00 tx=0x7f0274008030 comp rx=0 tx=0).stop 2023-07-25T14:36:43.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:43.913+0000 7f027fb39700 1 -- 172.21.15.72:0/4066397445 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f02780bb0a0 msgr2=0x7f02780bed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:43.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:43.913+0000 7f027fb39700 1 --2- 172.21.15.72:0/4066397445 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f02780bb0a0 0x7f02780bed60 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f026c00c4d0 tx=0x7f026c00c7e0 comp rx=0 tx=0).stop 2023-07-25T14:36:43.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:43.913+0000 7f027fb39700 1 -- 172.21.15.72:0/4066397445 shutdown_connections 2023-07-25T14:36:43.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:43.913+0000 7f027fb39700 1 --2- 172.21.15.72:0/4066397445 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f025c06ace0 0x7f025c06d1a0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:43.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:43.913+0000 7f027fb39700 1 --2- 172.21.15.72:0/4066397445 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f027814f820 0x7f02781ecdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:43.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:43.913+0000 7f027fb39700 1 --2- 172.21.15.72:0/4066397445 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f02780bb0a0 0x7f02780bed60 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:43.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:43.913+0000 7f027fb39700 1 --2- 172.21.15.72:0/4066397445 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f02780c5910 0x7f027806c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:43.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:43.913+0000 7f027fb39700 1 -- 172.21.15.72:0/4066397445 >> 172.21.15.72:0/4066397445 conn(0x7f027806a980 msgr2=0x7f02780c8110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:43.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:43.913+0000 7f027fb39700 1 -- 172.21.15.72:0/4066397445 shutdown_connections 2023-07-25T14:36:43.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:43.913+0000 7f027fb39700 1 -- 172.21.15.72:0/4066397445 wait complete. 2023-07-25T14:36:43.936 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-07-25T14:36:44.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.046+0000 7f7a40a81700 1 Processor -- start 2023-07-25T14:36:44.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.046+0000 7f7a40a81700 1 -- start start 2023-07-25T14:36:44.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.047+0000 7f7a40a81700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7a3c0c58d0 0x7f7a3c155440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:44.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.047+0000 7f7a40a81700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f7a3c14ec50 0x7f7a3c06ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:44.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.047+0000 7f7a40a81700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a3c151d70 con 0x7f7a3c0c4830 2023-07-25T14:36:44.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.047+0000 7f7a40a81700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a3c0c4da0 con 0x7f7a3c14ec50 2023-07-25T14:36:44.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.047+0000 7f7a40a81700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a3c151440 con 0x7f7a3c0c58d0 2023-07-25T14:36:44.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.047+0000 7f7a3ad9d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f7a3c14ec50 0x7f7a3c06ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:44.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.047+0000 7f7a39d9b700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f7a3c0c4830 0x7f7a3c14e540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:60706/0 (socket says 172.21.15.72:60706) 2023-07-25T14:36:44.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.047+0000 7f7a39d9b700 1 -- 172.21.15.72:0/732900606 learned_addr learned my addr 172.21.15.72:0/732900606 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:36:44.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.047+0000 7f7a3ad9d700 1 --2- 172.21.15.72:0/732900606 >> v2:172.21.15.72:3300/0 conn(0x7f7a3c14ec50 0x7f7a3c06ec80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41740/0 (socket says 172.21.15.72:41740) 2023-07-25T14:36:44.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.047+0000 7f7a3a59c700 1 --2- 172.21.15.72:0/732900606 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7a3c0c58d0 0x7f7a3c155440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:44.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.047+0000 7f7a3ad9d700 1 -- 172.21.15.72:0/732900606 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7a3c0c58d0 msgr2=0x7f7a3c155440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:44.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.047+0000 7f7a3ad9d700 1 --2- 172.21.15.72:0/732900606 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7a3c0c58d0 0x7f7a3c155440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:44.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.047+0000 7f7a3ad9d700 1 -- 172.21.15.72:0/732900606 >> v1:172.21.15.72:6789/0 conn(0x7f7a3c0c4830 legacy=0x7f7a3c14e540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:44.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.047+0000 7f7a3ad9d700 1 -- 172.21.15.72:0/732900606 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a3c151720 con 0x7f7a3c14ec50 2023-07-25T14:36:44.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.048+0000 7f7a3ad9d700 1 --2- 172.21.15.72:0/732900606 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7a3c14ec50 0x7f7a3c06ec80 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f7a34009d90 tx=0x7f7a3400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbe51294a8bcbe0f server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:44.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.049+0000 7f7a3959a700 1 -- 172.21.15.72:0/732900606 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a3400e070 con 0x7f7a3c14ec50 2023-07-25T14:36:44.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.049+0000 7f7a3959a700 1 -- 172.21.15.72:0/732900606 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a3400bb20 con 0x7f7a3c14ec50 2023-07-25T14:36:44.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.049+0000 7f7a3959a700 1 -- 172.21.15.72:0/732900606 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a34012430 con 0x7f7a3c14ec50 2023-07-25T14:36:44.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.050+0000 7f7a40a81700 1 -- 172.21.15.72:0/732900606 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7a3c14ec50 msgr2=0x7f7a3c06ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:44.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.050+0000 7f7a40a81700 1 --2- 172.21.15.72:0/732900606 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7a3c14ec50 0x7f7a3c06ec80 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f7a34009d90 tx=0x7f7a3400b330 comp rx=0 tx=0).stop 2023-07-25T14:36:44.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.050+0000 7f7a40a81700 1 -- 172.21.15.72:0/732900606 shutdown_connections 2023-07-25T14:36:44.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.050+0000 7f7a40a81700 1 --2- 172.21.15.72:0/732900606 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7a3c14ec50 0x7f7a3c06ec80 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:44.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.050+0000 7f7a40a81700 1 --2- 172.21.15.72:0/732900606 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7a3c0c58d0 0x7f7a3c155440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:44.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.050+0000 7f7a40a81700 1 -- 172.21.15.72:0/732900606 >> 172.21.15.72:0/732900606 conn(0x7f7a3c0a8520 msgr2=0x7f7a3c0a8900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:44.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.050+0000 7f7a40a81700 1 -- 172.21.15.72:0/732900606 shutdown_connections 2023-07-25T14:36:44.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.050+0000 7f7a40a81700 1 -- 172.21.15.72:0/732900606 wait complete. 2023-07-25T14:36:44.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.052+0000 7f7a40a81700 1 Processor -- start 2023-07-25T14:36:44.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.052+0000 7f7a40a81700 1 -- start start 2023-07-25T14:36:44.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.052+0000 7f7a40a81700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7a3c0c4830 0x7f7a3c0ac090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:44.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.052+0000 7f7a40a81700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7a3c0c58d0 0x7f7a3c0aa450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:44.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.053+0000 7f7a40a81700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7a3c14ec50 0x7f7a3c0bb7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:44.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.053+0000 7f7a40a81700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a3c0ac5d0 con 0x7f7a3c0c58d0 2023-07-25T14:36:44.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.053+0000 7f7a40a81700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a3c0a9620 con 0x7f7a3c0c4830 2023-07-25T14:36:44.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.053+0000 7f7a40a81700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a3c0a9900 con 0x7f7a3c14ec50 2023-07-25T14:36:44.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.053+0000 7f7a39d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7a3c0c58d0 0x7f7a3c0aa450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:44.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.053+0000 7f7a39d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7a3c0c58d0 0x7f7a3c0aa450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41746/0 (socket says 172.21.15.72:41746) 2023-07-25T14:36:44.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.053+0000 7f7a39d9b700 1 -- 172.21.15.72:0/3645532529 learned_addr learned my addr 172.21.15.72:0/3645532529 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:44.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.053+0000 7f7a3a59c700 1 --2- 172.21.15.72:0/3645532529 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7a3c0c4830 0x7f7a3c0ac090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:44.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.053+0000 7f7a3ad9d700 1 --2- 172.21.15.72:0/3645532529 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7a3c14ec50 0x7f7a3c0bb7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:44.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.053+0000 7f7a39d9b700 1 -- 172.21.15.72:0/3645532529 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7a3c14ec50 msgr2=0x7f7a3c0bb7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:44.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.053+0000 7f7a39d9b700 1 --2- 172.21.15.72:0/3645532529 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7a3c14ec50 0x7f7a3c0bb7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:44.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.053+0000 7f7a39d9b700 1 -- 172.21.15.72:0/3645532529 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7a3c0c4830 msgr2=0x7f7a3c0ac090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:44.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.053+0000 7f7a39d9b700 1 --2- 172.21.15.72:0/3645532529 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7a3c0c4830 0x7f7a3c0ac090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:44.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.053+0000 7f7a39d9b700 1 -- 172.21.15.72:0/3645532529 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a34009a70 con 0x7f7a3c0c58d0 2023-07-25T14:36:44.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.053+0000 7f7a39d9b700 1 --2- 172.21.15.72:0/3645532529 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7a3c0c58d0 0x7f7a3c0aa450 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f7a3000c430 tx=0x7f7a3000c740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:44.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.053+0000 7f7a2affd700 1 -- 172.21.15.72:0/3645532529 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a30005b70 con 0x7f7a3c0c58d0 2023-07-25T14:36:44.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.053+0000 7f7a2affd700 1 -- 172.21.15.72:0/3645532529 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a30005cd0 con 0x7f7a3c0c58d0 2023-07-25T14:36:44.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.053+0000 7f7a40a81700 1 -- 172.21.15.72:0/3645532529 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a3c0a9be0 con 0x7f7a3c0c58d0 2023-07-25T14:36:44.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.053+0000 7f7a2affd700 1 -- 172.21.15.72:0/3645532529 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a300072f0 con 0x7f7a3c0c58d0 2023-07-25T14:36:44.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.053+0000 7f7a40a81700 1 -- 172.21.15.72:0/3645532529 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a3c0aa990 con 0x7f7a3c0c58d0 2023-07-25T14:36:44.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.054+0000 7f7a40a81700 1 -- 172.21.15.72:0/3645532529 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a3c04e470 con 0x7f7a3c0c58d0 2023-07-25T14:36:44.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.055+0000 7f7a2affd700 1 -- 172.21.15.72:0/3645532529 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7a30007450 con 0x7f7a3c0c58d0 2023-07-25T14:36:44.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.055+0000 7f7a2affd700 1 --2- 172.21.15.72:0/3645532529 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f7a1c06ace0 0x7f7a1c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:44.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.055+0000 7f7a2affd700 1 -- 172.21.15.72:0/3645532529 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f7a30088570 con 0x7f7a3c0c58d0 2023-07-25T14:36:44.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.055+0000 7f7a3a59c700 1 --2- 172.21.15.72:0/3645532529 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f7a1c06ace0 0x7f7a1c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:44.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.055+0000 7f7a3a59c700 1 --2- 172.21.15.72:0/3645532529 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f7a1c06ace0 0x7f7a1c06d1a0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f7a3c0bc620 tx=0x7f7a2c0091c0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:44.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.059+0000 7f7a2affd700 1 -- 172.21.15.72:0/3645532529 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f7a30053840 con 0x7f7a3c0c58d0 2023-07-25T14:36:44.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.325+0000 7f7a40a81700 1 -- 172.21.15.72:0/3645532529 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7f7a3c0a6270 con 0x7f7a3c0c58d0 2023-07-25T14:36:44.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.328+0000 7f7a2affd700 1 -- 172.21.15.72:0/3645532529 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7f7a30056e60 con 0x7f7a3c0c58d0 2023-07-25T14:36:44.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.330+0000 7f7a40a81700 1 -- 172.21.15.72:0/3645532529 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f7a1c06ace0 msgr2=0x7f7a1c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:44.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.330+0000 7f7a40a81700 1 --2- 172.21.15.72:0/3645532529 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f7a1c06ace0 0x7f7a1c06d1a0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f7a3c0bc620 tx=0x7f7a2c0091c0 comp rx=0 tx=0).stop 2023-07-25T14:36:44.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.330+0000 7f7a40a81700 1 -- 172.21.15.72:0/3645532529 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7a3c0c58d0 msgr2=0x7f7a3c0aa450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:44.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.330+0000 7f7a40a81700 1 --2- 172.21.15.72:0/3645532529 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7a3c0c58d0 0x7f7a3c0aa450 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f7a3000c430 tx=0x7f7a3000c740 comp rx=0 tx=0).stop 2023-07-25T14:36:44.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.330+0000 7f7a40a81700 1 -- 172.21.15.72:0/3645532529 shutdown_connections 2023-07-25T14:36:44.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.330+0000 7f7a40a81700 1 --2- 172.21.15.72:0/3645532529 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f7a1c06ace0 0x7f7a1c06d1a0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:44.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.330+0000 7f7a40a81700 1 --2- 172.21.15.72:0/3645532529 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7a3c14ec50 0x7f7a3c0bb7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:44.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.330+0000 7f7a40a81700 1 --2- 172.21.15.72:0/3645532529 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7a3c0c4830 0x7f7a3c0ac090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:44.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.330+0000 7f7a40a81700 1 --2- 172.21.15.72:0/3645532529 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7a3c0c58d0 0x7f7a3c0aa450 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:44.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.330+0000 7f7a40a81700 1 -- 172.21.15.72:0/3645532529 >> 172.21.15.72:0/3645532529 conn(0x7f7a3c0a8520 msgr2=0x7f7a3c06f8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:44.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.330+0000 7f7a40a81700 1 -- 172.21.15.72:0/3645532529 shutdown_connections 2023-07-25T14:36:44.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.330+0000 7f7a40a81700 1 -- 172.21.15.72:0/3645532529 wait complete. 2023-07-25T14:36:44.354 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-07-25T14:36:44.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.466+0000 7f03ea5a6700 1 Processor -- start 2023-07-25T14:36:44.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.466+0000 7f03ea5a6700 1 -- start start 2023-07-25T14:36:44.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.467+0000 7f03ea5a6700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f03e4151970 0x7f03e4154d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:44.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.467+0000 7f03ea5a6700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f03e40c47b0 0x7f03e4071540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:44.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.467+0000 7f03ea5a6700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f03e4071a80 0x7f03e406ec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:44.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.467+0000 7f03ea5a6700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03e40c1fc0 con 0x7f03e4151970 2023-07-25T14:36:44.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.467+0000 7f03ea5a6700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03e4151d50 con 0x7f03e4071a80 2023-07-25T14:36:44.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.467+0000 7f03ea5a6700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03e4155280 con 0x7f03e40c47b0 2023-07-25T14:36:44.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.467+0000 7f03e3fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f03e4151970 0x7f03e4154d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:44.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.467+0000 7f03e3fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f03e4151970 0x7f03e4154d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41752/0 (socket says 172.21.15.72:41752) 2023-07-25T14:36:44.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.467+0000 7f03e3fff700 1 -- 172.21.15.72:0/1228180313 learned_addr learned my addr 172.21.15.72:0/1228180313 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:44.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.467+0000 7f03e37fe700 1 --2- 172.21.15.72:0/1228180313 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f03e40c47b0 0x7f03e4071540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:44.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.467+0000 7f03e3fff700 1 -- 172.21.15.72:0/1228180313 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f03e40c47b0 msgr2=0x7f03e4071540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:44.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.467+0000 7f03e3fff700 1 --2- 172.21.15.72:0/1228180313 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f03e40c47b0 0x7f03e4071540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:44.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.467+0000 7f03e8b43700 1 --2- 172.21.15.72:0/1228180313 >> v2:172.21.15.92:3300/0 conn(0x7f03e4071a80 0x7f03e406ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:44.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.467+0000 7f03e3fff700 1 -- 172.21.15.72:0/1228180313 >> v2:172.21.15.92:3300/0 conn(0x7f03e4071a80 msgr2=0x7f03e406ec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:44.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.467+0000 7f03e3fff700 1 --2- 172.21.15.72:0/1228180313 >> v2:172.21.15.92:3300/0 conn(0x7f03e4071a80 0x7f03e406ec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:44.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.467+0000 7f03e3fff700 1 -- 172.21.15.72:0/1228180313 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03e40c12d0 con 0x7f03e4151970 2023-07-25T14:36:44.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.467+0000 7f03e37fe700 1 --2- 172.21.15.72:0/1228180313 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f03e40c47b0 0x7f03e4071540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-25T14:36:44.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.467+0000 7f03e8b43700 1 --2- 172.21.15.72:0/1228180313 >> v2:172.21.15.92:3300/0 conn(0x7f03e4071a80 0x7f03e406ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-25T14:36:44.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.467+0000 7f03e3fff700 1 --2- 172.21.15.72:0/1228180313 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f03e4151970 0x7f03e4154d40 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f03e406d270 tx=0x7f03d8009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=977a322150fc091b server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:44.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.468+0000 7f03e2ffd700 1 -- 172.21.15.72:0/1228180313 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03d8005e30 con 0x7f03e4151970 2023-07-25T14:36:44.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.468+0000 7f03e2ffd700 1 -- 172.21.15.72:0/1228180313 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03d8004030 con 0x7f03e4151970 2023-07-25T14:36:44.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.468+0000 7f03e2ffd700 1 -- 172.21.15.72:0/1228180313 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03d80043e0 con 0x7f03e4151970 2023-07-25T14:36:44.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.468+0000 7f03ea5a6700 1 -- 172.21.15.72:0/1228180313 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f03e4151970 msgr2=0x7f03e4154d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:44.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.468+0000 7f03ea5a6700 1 --2- 172.21.15.72:0/1228180313 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f03e4151970 0x7f03e4154d40 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f03e406d270 tx=0x7f03d8009bd0 comp rx=0 tx=0).stop 2023-07-25T14:36:44.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.468+0000 7f03ea5a6700 1 -- 172.21.15.72:0/1228180313 shutdown_connections 2023-07-25T14:36:44.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.468+0000 7f03ea5a6700 1 --2- 172.21.15.72:0/1228180313 >> v2:172.21.15.92:3300/0 conn(0x7f03e4071a80 0x7f03e406ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:44.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.468+0000 7f03ea5a6700 1 --2- 172.21.15.72:0/1228180313 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f03e4151970 0x7f03e4154d40 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:44.483 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.468+0000 7f03ea5a6700 1 --2- 172.21.15.72:0/1228180313 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f03e40c47b0 0x7f03e4071540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:44.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.468+0000 7f03ea5a6700 1 -- 172.21.15.72:0/1228180313 >> 172.21.15.72:0/1228180313 conn(0x7f03e40c68b0 msgr2=0x7f03e40c6cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:44.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.468+0000 7f03ea5a6700 1 -- 172.21.15.72:0/1228180313 shutdown_connections 2023-07-25T14:36:44.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.468+0000 7f03ea5a6700 1 -- 172.21.15.72:0/1228180313 wait complete. 2023-07-25T14:36:44.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.469+0000 7f03ea5a6700 1 Processor -- start 2023-07-25T14:36:44.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.470+0000 7f03ea5a6700 1 -- start start 2023-07-25T14:36:44.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.470+0000 7f03ea5a6700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f03e4071a80 0x7f03e4155690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:44.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.470+0000 7f03ea5a6700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f03e40c47b0 0x7f03e406b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:44.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.470+0000 7f03ea5a6700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f03e4151970 0x7f03e41e6be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:44.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.470+0000 7f03ea5a6700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03e41edd10 con 0x7f03e4071a80 2023-07-25T14:36:44.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.470+0000 7f03ea5a6700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03e41ed880 con 0x7f03e40c47b0 2023-07-25T14:36:44.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.470+0000 7f03ea5a6700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03e414ec40 con 0x7f03e4151970 2023-07-25T14:36:44.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.470+0000 7f03e3fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f03e4071a80 0x7f03e4155690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:44.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.470+0000 7f03e3fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f03e4071a80 0x7f03e4155690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41756/0 (socket says 172.21.15.72:41756) 2023-07-25T14:36:44.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.470+0000 7f03e3fff700 1 -- 172.21.15.72:0/3402322398 learned_addr learned my addr 172.21.15.72:0/3402322398 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:44.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.470+0000 7f03e37fe700 1 --2- 172.21.15.72:0/3402322398 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f03e40c47b0 0x7f03e406b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:44.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.470+0000 7f03e8b43700 1 --2- 172.21.15.72:0/3402322398 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f03e4151970 0x7f03e41e6be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:44.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.471+0000 7f03e3fff700 1 -- 172.21.15.72:0/3402322398 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f03e4151970 msgr2=0x7f03e41e6be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:44.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.471+0000 7f03e3fff700 1 --2- 172.21.15.72:0/3402322398 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f03e4151970 0x7f03e41e6be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:44.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.471+0000 7f03e3fff700 1 -- 172.21.15.72:0/3402322398 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f03e40c47b0 msgr2=0x7f03e406b580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:44.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.471+0000 7f03e3fff700 1 --2- 172.21.15.72:0/3402322398 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f03e40c47b0 0x7f03e406b580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:44.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.471+0000 7f03e3fff700 1 -- 172.21.15.72:0/3402322398 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03d8009500 con 0x7f03e4071a80 2023-07-25T14:36:44.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.471+0000 7f03e3fff700 1 --2- 172.21.15.72:0/3402322398 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f03e4071a80 0x7f03e4155690 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f03d8009c10 tx=0x7f03d8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:44.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.471+0000 7f03e0ff9700 1 -- 172.21.15.72:0/3402322398 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03d801d430 con 0x7f03e4071a80 2023-07-25T14:36:44.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.471+0000 7f03e0ff9700 1 -- 172.21.15.72:0/3402322398 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03d801d590 con 0x7f03e4071a80 2023-07-25T14:36:44.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.471+0000 7f03ea5a6700 1 -- 172.21.15.72:0/3402322398 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03e41ecf50 con 0x7f03e4071a80 2023-07-25T14:36:44.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.471+0000 7f03e0ff9700 1 -- 172.21.15.72:0/3402322398 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03d801d940 con 0x7f03e4071a80 2023-07-25T14:36:44.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.471+0000 7f03ea5a6700 1 -- 172.21.15.72:0/3402322398 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03e41ed510 con 0x7f03e4071a80 2023-07-25T14:36:44.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.472+0000 7f03ea5a6700 1 -- 172.21.15.72:0/3402322398 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03e404e470 con 0x7f03e4071a80 2023-07-25T14:36:44.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.473+0000 7f03e0ff9700 1 -- 172.21.15.72:0/3402322398 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f03d801daa0 con 0x7f03e4071a80 2023-07-25T14:36:44.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.474+0000 7f03e0ff9700 1 --2- 172.21.15.72:0/3402322398 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f03d006ace0 0x7f03d006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:44.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.474+0000 7f03e0ff9700 1 -- 172.21.15.72:0/3402322398 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f03d808aaa0 con 0x7f03e4071a80 2023-07-25T14:36:44.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.474+0000 7f03e37fe700 1 --2- 172.21.15.72:0/3402322398 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f03d006ace0 0x7f03d006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:44.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.474+0000 7f03e37fe700 1 --2- 172.21.15.72:0/3402322398 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f03d006ace0 0x7f03d006d1a0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f03d4006fd0 tx=0x7f03d4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:44.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.477+0000 7f03e0ff9700 1 -- 172.21.15.72:0/3402322398 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f03d8055dd0 con 0x7f03e4071a80 2023-07-25T14:36:44.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.743+0000 7f03ea5a6700 1 -- 172.21.15.72:0/3402322398 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7f03e40c0ce0 con 0x7f03e4071a80 2023-07-25T14:36:44.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.747+0000 7f03e0ff9700 1 -- 172.21.15.72:0/3402322398 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v9) v1 ==== 90+0+0 (secure 0 0 0) 0x7f03d808a070 con 0x7f03e4071a80 2023-07-25T14:36:44.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.749+0000 7f03ea5a6700 1 -- 172.21.15.72:0/3402322398 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f03d006ace0 msgr2=0x7f03d006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:44.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.749+0000 7f03ea5a6700 1 --2- 172.21.15.72:0/3402322398 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f03d006ace0 0x7f03d006d1a0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f03d4006fd0 tx=0x7f03d4008040 comp rx=0 tx=0).stop 2023-07-25T14:36:44.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.749+0000 7f03ea5a6700 1 -- 172.21.15.72:0/3402322398 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f03e4071a80 msgr2=0x7f03e4155690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:44.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.749+0000 7f03ea5a6700 1 --2- 172.21.15.72:0/3402322398 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f03e4071a80 0x7f03e4155690 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f03d8009c10 tx=0x7f03d8004750 comp rx=0 tx=0).stop 2023-07-25T14:36:44.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.749+0000 7f03ea5a6700 1 -- 172.21.15.72:0/3402322398 shutdown_connections 2023-07-25T14:36:44.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.749+0000 7f03ea5a6700 1 --2- 172.21.15.72:0/3402322398 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f03d006ace0 0x7f03d006d1a0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:44.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.749+0000 7f03ea5a6700 1 --2- 172.21.15.72:0/3402322398 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f03e4151970 0x7f03e41e6be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:44.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.749+0000 7f03ea5a6700 1 --2- 172.21.15.72:0/3402322398 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f03e4071a80 0x7f03e4155690 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:44.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.749+0000 7f03ea5a6700 1 --2- 172.21.15.72:0/3402322398 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f03e40c47b0 0x7f03e406b580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:44.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.749+0000 7f03ea5a6700 1 -- 172.21.15.72:0/3402322398 >> 172.21.15.72:0/3402322398 conn(0x7f03e40c68b0 msgr2=0x7f03e40c51a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:44.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.749+0000 7f03ea5a6700 1 -- 172.21.15.72:0/3402322398 shutdown_connections 2023-07-25T14:36:44.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.749+0000 7f03ea5a6700 1 -- 172.21.15.72:0/3402322398 wait complete. 2023-07-25T14:36:44.772 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-07-25T14:36:44.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.882+0000 7f757e5fc700 1 Processor -- start 2023-07-25T14:36:44.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.882+0000 7f757e5fc700 1 -- start start 2023-07-25T14:36:44.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.883+0000 7f757e5fc700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f75780c4830 0x7f7578155440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:44.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.883+0000 7f757e5fc700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7578151d70 con 0x7f757814ec50 2023-07-25T14:36:44.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.883+0000 7f757e5fc700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75780c4da0 con 0x7f75780c58d0 2023-07-25T14:36:44.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.883+0000 7f757e5fc700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7578151440 con 0x7f75780c4830 2023-07-25T14:36:44.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.883+0000 7f75777fe700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f757814ec50 0x7f757806ec80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:60732/0 (socket says 172.21.15.72:60732) 2023-07-25T14:36:44.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.883+0000 7f75777fe700 1 -- 172.21.15.72:0/2467749522 learned_addr learned my addr 172.21.15.72:0/2467749522 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:36:44.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.883+0000 7f757cb99700 1 --2- 172.21.15.72:0/2467749522 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f75780c4830 0x7f7578155440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:44.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.883+0000 7f7576ffd700 1 -- 172.21.15.72:0/2467749522 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1968871123 0 0) 0x7f7578151d70 con 0x7f757814ec50 2023-07-25T14:36:44.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.883+0000 7f7576ffd700 1 -- 172.21.15.72:0/2467749522 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f75640057c0 con 0x7f757814ec50 2023-07-25T14:36:44.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.883+0000 7f7576ffd700 1 -- 172.21.15.72:0/2467749522 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3647850507 0 0) 0x7f75640057c0 con 0x7f757814ec50 2023-07-25T14:36:44.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.883+0000 7f7576ffd700 1 -- 172.21.15.72:0/2467749522 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f75780c4830 msgr2=0x7f7578155440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:44.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.883+0000 7f7576ffd700 1 --2- 172.21.15.72:0/2467749522 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f75780c4830 0x7f7578155440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:44.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.883+0000 7f7576ffd700 1 -- 172.21.15.72:0/2467749522 >> v1:172.21.15.92:6789/0 conn(0x7f75780c58d0 legacy=0x7f757814e540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:44.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.884+0000 7f7576ffd700 1 -- 172.21.15.72:0/2467749522 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7578151720 con 0x7f757814ec50 2023-07-25T14:36:44.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.884+0000 7f7576ffd700 1 -- 172.21.15.72:0/2467749522 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2559588315 0 0) 0x7f7560001670 con 0x7f757814ec50 2023-07-25T14:36:44.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.884+0000 7f7576ffd700 1 -- 172.21.15.72:0/2467749522 >> v1:172.21.15.72:6789/0 conn(0x7f757814ec50 legacy=0x7f757806ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:44.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.884+0000 7f7576ffd700 1 --2- 172.21.15.72:0/2467749522 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f75780c4830 0x7f7564005c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:44.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.884+0000 7f7576ffd700 1 --2- 172.21.15.72:0/2467749522 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7564006180 0x7f7564006a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:44.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.884+0000 7f7576ffd700 1 --2- 172.21.15.72:0/2467749522 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7564006fa0 0x7f7564007420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:44.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.884+0000 7f7576ffd700 1 -- 172.21.15.72:0/2467749522 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7578151440 con 0x7f7564006180 2023-07-25T14:36:44.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.884+0000 7f7576ffd700 1 -- 172.21.15.72:0/2467749522 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f756400dd30 con 0x7f7564006fa0 2023-07-25T14:36:44.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.884+0000 7f7576ffd700 1 -- 172.21.15.72:0/2467749522 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f756400def0 con 0x7f75780c4830 2023-07-25T14:36:44.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.884+0000 7f75777fe700 1 --2- 172.21.15.72:0/2467749522 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7564006180 0x7f7564006a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:44.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.884+0000 7f7577fff700 1 --2- 172.21.15.72:0/2467749522 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f75780c4830 0x7f7564005c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:44.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.884+0000 7f757cb99700 1 --2- 172.21.15.72:0/2467749522 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7564006fa0 0x7f7564007420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:44.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.884+0000 7f75777fe700 1 -- 172.21.15.72:0/2467749522 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f75780c4830 msgr2=0x7f7564005c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:44.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.884+0000 7f75777fe700 1 --2- 172.21.15.72:0/2467749522 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f75780c4830 0x7f7564005c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:44.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.884+0000 7f75777fe700 1 -- 172.21.15.72:0/2467749522 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7564006fa0 msgr2=0x7f7564007420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:44.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.884+0000 7f75777fe700 1 --2- 172.21.15.72:0/2467749522 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7564006fa0 0x7f7564007420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:44.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.884+0000 7f75777fe700 1 -- 172.21.15.72:0/2467749522 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75640057c0 con 0x7f7564006180 2023-07-25T14:36:44.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.884+0000 7f75777fe700 1 --2- 172.21.15.72:0/2467749522 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7564006180 0x7f7564006a60 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f756000c2f0 tx=0x7f7564007a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a6c869c6c42c48f server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:44.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.884+0000 7f7576ffd700 1 -- 172.21.15.72:0/2467749522 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f756000ce30 con 0x7f7564006180 2023-07-25T14:36:44.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.884+0000 7f7576ffd700 1 -- 172.21.15.72:0/2467749522 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7560005960 con 0x7f7564006180 2023-07-25T14:36:44.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.884+0000 7f7576ffd700 1 -- 172.21.15.72:0/2467749522 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7560005d10 con 0x7f7564006180 2023-07-25T14:36:44.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.885+0000 7f757e5fc700 1 -- 172.21.15.72:0/2467749522 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7564006180 msgr2=0x7f7564006a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:44.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.885+0000 7f757e5fc700 1 --2- 172.21.15.72:0/2467749522 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7564006180 0x7f7564006a60 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f756000c2f0 tx=0x7f7564007a90 comp rx=0 tx=0).stop 2023-07-25T14:36:44.902 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.885+0000 7f757cb99700 1 -- 172.21.15.72:0/2467749522 reap_dead start 2023-07-25T14:36:44.902 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.885+0000 7f757e5fc700 1 -- 172.21.15.72:0/2467749522 shutdown_connections 2023-07-25T14:36:44.902 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.885+0000 7f757e5fc700 1 -- 172.21.15.72:0/2467749522 >> 172.21.15.72:0/2467749522 conn(0x7f75780a8520 msgr2=0x7f75780a8900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:44.902 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.885+0000 7f757e5fc700 1 -- 172.21.15.72:0/2467749522 shutdown_connections 2023-07-25T14:36:44.902 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.885+0000 7f757e5fc700 1 -- 172.21.15.72:0/2467749522 wait complete. 2023-07-25T14:36:44.902 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.886+0000 7f757e5fc700 1 Processor -- start 2023-07-25T14:36:44.902 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.886+0000 7f757e5fc700 1 -- start start 2023-07-25T14:36:44.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.887+0000 7f757e5fc700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7564006180 0x7f75780bcf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:44.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.887+0000 7f757e5fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7578150df0 0x7f757814d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:44.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.887+0000 7f757e5fc700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f75780c3c60 0x7f757814dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:44.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.887+0000 7f757e5fc700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75780c26b0 con 0x7f7578150df0 2023-07-25T14:36:44.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.887+0000 7f757e5fc700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7578150690 con 0x7f7564006180 2023-07-25T14:36:44.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.887+0000 7f757e5fc700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75780b5ef0 con 0x7f75780c3c60 2023-07-25T14:36:44.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.887+0000 7f75777fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7578150df0 0x7f757814d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:44.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.887+0000 7f75777fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7578150df0 0x7f757814d6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41774/0 (socket says 172.21.15.72:41774) 2023-07-25T14:36:44.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.887+0000 7f75777fe700 1 -- 172.21.15.72:0/3388222581 learned_addr learned my addr 172.21.15.72:0/3388222581 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:44.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.887+0000 7f7577fff700 1 --2- 172.21.15.72:0/3388222581 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7564006180 0x7f75780bcf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:44.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.887+0000 7f757cb99700 1 --2- 172.21.15.72:0/3388222581 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f75780c3c60 0x7f757814dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:44.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.887+0000 7f75777fe700 1 -- 172.21.15.72:0/3388222581 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f75780c3c60 msgr2=0x7f757814dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:44.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.887+0000 7f75777fe700 1 --2- 172.21.15.72:0/3388222581 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f75780c3c60 0x7f757814dc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:44.907 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.887+0000 7f75777fe700 1 -- 172.21.15.72:0/3388222581 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7564006180 msgr2=0x7f75780bcf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:44.907 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.887+0000 7f75777fe700 1 --2- 172.21.15.72:0/3388222581 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7564006180 0x7f75780bcf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:44.907 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.887+0000 7f75777fe700 1 -- 172.21.15.72:0/3388222581 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75780b61d0 con 0x7f7578150df0 2023-07-25T14:36:44.907 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.887+0000 7f75777fe700 1 --2- 172.21.15.72:0/3388222581 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7578150df0 0x7f757814d6d0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f756400dd00 tx=0x7f7560001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:44.907 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.888+0000 7f7574ff9700 1 -- 172.21.15.72:0/3388222581 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7560005ce0 con 0x7f7578150df0 2023-07-25T14:36:44.907 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.888+0000 7f7574ff9700 1 -- 172.21.15.72:0/3388222581 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7560005e60 con 0x7f7578150df0 2023-07-25T14:36:44.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.888+0000 7f757e5fc700 1 -- 172.21.15.72:0/3388222581 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7578150320 con 0x7f7578150df0 2023-07-25T14:36:44.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.888+0000 7f7574ff9700 1 -- 172.21.15.72:0/3388222581 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7560004ab0 con 0x7f7578150df0 2023-07-25T14:36:44.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.888+0000 7f757e5fc700 1 -- 172.21.15.72:0/3388222581 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75780b64b0 con 0x7f7578150df0 2023-07-25T14:36:44.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.888+0000 7f757e5fc700 1 -- 172.21.15.72:0/3388222581 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f757804e470 con 0x7f7578150df0 2023-07-25T14:36:44.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.889+0000 7f7574ff9700 1 -- 172.21.15.72:0/3388222581 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7560004c10 con 0x7f7578150df0 2023-07-25T14:36:44.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.889+0000 7f7574ff9700 1 --2- 172.21.15.72:0/3388222581 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f755806ace0 0x7f755806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:44.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.889+0000 7f7574ff9700 1 -- 172.21.15.72:0/3388222581 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f756008a700 con 0x7f7578150df0 2023-07-25T14:36:44.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.889+0000 7f7577fff700 1 --2- 172.21.15.72:0/3388222581 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f755806ace0 0x7f755806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:44.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.890+0000 7f7577fff700 1 --2- 172.21.15.72:0/3388222581 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f755806ace0 0x7f755806d1a0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f7568000f80 tx=0x7f7568009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:44.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:44.893+0000 7f7574ff9700 1 -- 172.21.15.72:0/3388222581 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f7560055b10 con 0x7f7578150df0 2023-07-25T14:36:45.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:45.158+0000 7f757e5fc700 1 -- 172.21.15.72:0/3388222581 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f7578155770 con 0x7f7578150df0 2023-07-25T14:36:45.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:45.162+0000 7f7574ff9700 1 -- 172.21.15.72:0/3388222581 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7f7560007da0 con 0x7f7578150df0 2023-07-25T14:36:45.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:45.164+0000 7f757e5fc700 1 -- 172.21.15.72:0/3388222581 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f755806ace0 msgr2=0x7f755806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:45.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:45.164+0000 7f757e5fc700 1 --2- 172.21.15.72:0/3388222581 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f755806ace0 0x7f755806d1a0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f7568000f80 tx=0x7f7568009040 comp rx=0 tx=0).stop 2023-07-25T14:36:45.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:45.164+0000 7f757e5fc700 1 -- 172.21.15.72:0/3388222581 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7578150df0 msgr2=0x7f757814d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:45.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:45.164+0000 7f757e5fc700 1 --2- 172.21.15.72:0/3388222581 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7578150df0 0x7f757814d6d0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f756400dd00 tx=0x7f7560001a00 comp rx=0 tx=0).stop 2023-07-25T14:36:45.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:45.164+0000 7f757e5fc700 1 -- 172.21.15.72:0/3388222581 shutdown_connections 2023-07-25T14:36:45.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:45.164+0000 7f757e5fc700 1 --2- 172.21.15.72:0/3388222581 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f755806ace0 0x7f755806d1a0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:45.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:45.164+0000 7f757e5fc700 1 --2- 172.21.15.72:0/3388222581 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f75780c3c60 0x7f757814dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:45.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:45.164+0000 7f757e5fc700 1 --2- 172.21.15.72:0/3388222581 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7564006180 0x7f75780bcf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:45.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:45.164+0000 7f757e5fc700 1 --2- 172.21.15.72:0/3388222581 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7578150df0 0x7f757814d6d0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:45.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:45.164+0000 7f757e5fc700 1 -- 172.21.15.72:0/3388222581 >> 172.21.15.72:0/3388222581 conn(0x7f75780a8520 msgr2=0x7f75781db140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:45.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:45.164+0000 7f757e5fc700 1 -- 172.21.15.72:0/3388222581 shutdown_connections 2023-07-25T14:36:45.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:45.164+0000 7f757e5fc700 1 -- 172.21.15.72:0/3388222581 wait complete. 2023-07-25T14:36:45.186 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-07-25T14:36:45.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:45.295+0000 7f0ed51c5700 1 Processor -- start 2023-07-25T14:36:45.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:45.295+0000 7f0ed51c5700 1 -- start start 2023-07-25T14:36:45.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:45.296+0000 7f0ed51c5700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0ed014f820 0x7f0ed00c2390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:45.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:45.296+0000 7f0ed51c5700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f0ed00c5910 0x7f0ed006f830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:45.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:45.296+0000 7f0ed51c5700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ed00c4cc0 con 0x7f0ed00bb0a0 2023-07-25T14:36:45.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:45.296+0000 7f0ed51c5700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ed0152f30 con 0x7f0ed00c5910 2023-07-25T14:36:45.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:45.296+0000 7f0ed51c5700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ed00c4420 con 0x7f0ed014f820 2023-07-25T14:36:45.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:45.296+0000 7f0eced9d700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0ed014f820 0x7f0ed00c2390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:45.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:45.296+0000 7f0eced9d700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0ed014f820 0x7f0ed00c2390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3301/0 says I am v2:172.21.15.72:47010/0 (socket says 172.21.15.72:47010) 2023-07-25T14:36:45.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:45.296+0000 7f0ece59c700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f0ed00bb0a0 0x7f0ed006f120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.72:56092/0 (socket says 172.21.15.72:56092) 2023-07-25T14:36:45.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:45.296+0000 7f0eced9d700 1 -- 172.21.15.72:0/4254771070 learned_addr learned my addr 172.21.15.72:0/4254771070 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:45.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:45.296+0000 7f0ecf59e700 1 --2- 172.21.15.72:0/4254771070 >> v2:172.21.15.92:3300/0 conn(0x7f0ed00c5910 0x7f0ed006f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:45.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:45.297+0000 7f0eced9d700 1 -- 172.21.15.72:0/4254771070 >> v2:172.21.15.92:3300/0 conn(0x7f0ed00c5910 msgr2=0x7f0ed006f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:45.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:45.297+0000 7f0eced9d700 1 --2- 172.21.15.72:0/4254771070 >> v2:172.21.15.92:3300/0 conn(0x7f0ed00c5910 0x7f0ed006f830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:45.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:45.297+0000 7f0eced9d700 1 -- 172.21.15.72:0/4254771070 >> v1:172.21.15.92:6789/0 conn(0x7f0ed00bb0a0 legacy=0x7f0ed006f120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:45.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:45.297+0000 7f0eced9d700 1 -- 172.21.15.72:0/4254771070 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ed00c4700 con 0x7f0ed014f820 2023-07-25T14:36:45.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:45.297+0000 7f0ecf59e700 1 --2- 172.21.15.72:0/4254771070 >> v2:172.21.15.92:3300/0 conn(0x7f0ed00c5910 0x7f0ed006f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-25T14:36:45.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:45.297+0000 7f0eced9d700 1 --2- 172.21.15.72:0/4254771070 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0ed014f820 0x7f0ed00c2390 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f0ec4006fd0 tx=0x7f0ec4009bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eac8dabda601f63e server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:45.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:45.297+0000 7f0ecdd9b700 1 -- 172.21.15.72:0/4254771070 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ec4005e30 con 0x7f0ed014f820 2023-07-25T14:36:45.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:45.297+0000 7f0ecdd9b700 1 -- 172.21.15.72:0/4254771070 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ec4004030 con 0x7f0ed014f820 2023-07-25T14:36:45.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:45.297+0000 7f0ecdd9b700 1 -- 172.21.15.72:0/4254771070 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ec40043e0 con 0x7f0ed014f820 2023-07-25T14:36:45.313 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:45.298+0000 7f0ed51c5700 1 -- 172.21.15.72:0/4254771070 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0ed014f820 msgr2=0x7f0ed00c2390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:45.313 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:45.298+0000 7f0ed51c5700 1 --2- 172.21.15.72:0/4254771070 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0ed014f820 0x7f0ed00c2390 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f0ec4006fd0 tx=0x7f0ec4009bd0 comp rx=0 tx=0).stop 2023-07-25T14:36:45.313 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:45.298+0000 7f0ed51c5700 1 -- 172.21.15.72:0/4254771070 shutdown_connections 2023-07-25T14:36:45.313 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:45.298+0000 7f0ed51c5700 1 --2- 172.21.15.72:0/4254771070 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0ed014f820 0x7f0ed00c2390 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:45.313 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:45.298+0000 7f0ed51c5700 1 --2- 172.21.15.72:0/4254771070 >> v2:172.21.15.92:3300/0 conn(0x7f0ed00c5910 0x7f0ed006f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:45.313 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:45.298+0000 7f0ed51c5700 1 -- 172.21.15.72:0/4254771070 >> 172.21.15.72:0/4254771070 conn(0x7f0ed006a980 msgr2=0x7f0ed00a9540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:45.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:45.298+0000 7f0ed51c5700 1 -- 172.21.15.72:0/4254771070 shutdown_connections 2023-07-25T14:36:45.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:45.298+0000 7f0ed51c5700 1 -- 172.21.15.72:0/4254771070 wait complete. 2023-07-25T14:36:45.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:45.299+0000 7f0ed51c5700 1 Processor -- start 2023-07-25T14:36:45.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:45.299+0000 7f0ed51c5700 1 -- start start 2023-07-25T14:36:45.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:45.300+0000 7f0ed51c5700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0ed00bb0a0 0x7f0ed01544f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:45.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:45.300+0000 7f0ed51c5700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0ed00c5910 0x7f0ed01eb4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:45.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:45.300+0000 7f0ed51c5700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0ed014f820 0x7f0ed01e7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:45.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:45.300+0000 7f0ed51c5700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ed00aaf20 con 0x7f0ed014f820 2023-07-25T14:36:45.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:45.300+0000 7f0ed51c5700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ed00aab80 con 0x7f0ed00bb0a0 2023-07-25T14:36:45.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:45.300+0000 7f0ed51c5700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ed01ec1a0 con 0x7f0ed00c5910 2023-07-25T14:36:45.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:45.300+0000 7f0ecf59e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0ed014f820 0x7f0ed01e7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:45.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:45.300+0000 7f0ecf59e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0ed014f820 0x7f0ed01e7cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41792/0 (socket says 172.21.15.72:41792) 2023-07-25T14:36:45.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:45.300+0000 7f0ecf59e700 1 -- 172.21.15.72:0/313945808 learned_addr learned my addr 172.21.15.72:0/313945808 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:45.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:45.300+0000 7f0eced9d700 1 --2- 172.21.15.72:0/313945808 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0ed00bb0a0 0x7f0ed01544f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:45.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:45.300+0000 7f0ece59c700 1 --2- 172.21.15.72:0/313945808 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0ed00c5910 0x7f0ed01eb4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:45.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:45.300+0000 7f0ecf59e700 1 -- 172.21.15.72:0/313945808 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0ed00c5910 msgr2=0x7f0ed01eb4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:45.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:45.300+0000 7f0ecf59e700 1 --2- 172.21.15.72:0/313945808 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0ed00c5910 0x7f0ed01eb4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:45.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:45.300+0000 7f0ecf59e700 1 -- 172.21.15.72:0/313945808 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0ed00bb0a0 msgr2=0x7f0ed01544f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:45.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:45.300+0000 7f0ecf59e700 1 --2- 172.21.15.72:0/313945808 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0ed00bb0a0 0x7f0ed01544f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:45.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:45.300+0000 7f0ecf59e700 1 -- 172.21.15.72:0/313945808 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ec8009a70 con 0x7f0ed014f820 2023-07-25T14:36:45.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:45.300+0000 7f0ece59c700 1 --2- 172.21.15.72:0/313945808 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0ed00c5910 0x7f0ed01eb4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-25T14:36:45.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:45.300+0000 7f0ecf59e700 1 --2- 172.21.15.72:0/313945808 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0ed014f820 0x7f0ed01e7cf0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f0ec8009f00 tx=0x7f0ec800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:45.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:45.301+0000 7f0eb77fe700 1 -- 172.21.15.72:0/313945808 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ec8009d70 con 0x7f0ed014f820 2023-07-25T14:36:45.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:45.301+0000 7f0eb77fe700 1 -- 172.21.15.72:0/313945808 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ec800f040 con 0x7f0ed014f820 2023-07-25T14:36:45.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:45.301+0000 7f0ed51c5700 1 -- 172.21.15.72:0/313945808 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ec4009500 con 0x7f0ed014f820 2023-07-25T14:36:45.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:45.301+0000 7f0eb77fe700 1 -- 172.21.15.72:0/313945808 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ec8014680 con 0x7f0ed014f820 2023-07-25T14:36:45.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:45.301+0000 7f0ed51c5700 1 -- 172.21.15.72:0/313945808 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ed00a6e50 con 0x7f0ed014f820 2023-07-25T14:36:45.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:45.302+0000 7f0ed51c5700 1 -- 172.21.15.72:0/313945808 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ed00acaa0 con 0x7f0ed014f820 2023-07-25T14:36:45.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:45.302+0000 7f0eb77fe700 1 -- 172.21.15.72:0/313945808 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0ec80147e0 con 0x7f0ed014f820 2023-07-25T14:36:45.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:45.302+0000 7f0eb77fe700 1 --2- 172.21.15.72:0/313945808 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f0ebc06ace0 0x7f0ebc06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:45.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:45.302+0000 7f0eb77fe700 1 -- 172.21.15.72:0/313945808 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f0ec8089fd0 con 0x7f0ed014f820 2023-07-25T14:36:45.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:45.303+0000 7f0eced9d700 1 --2- 172.21.15.72:0/313945808 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f0ebc06ace0 0x7f0ebc06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:45.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:45.303+0000 7f0eced9d700 1 --2- 172.21.15.72:0/313945808 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f0ebc06ace0 0x7f0ebc06d1a0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f0ec4006fd0 tx=0x7f0ec4008070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:45.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:45.307+0000 7f0eb77fe700 1 -- 172.21.15.72:0/313945808 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f0ed00acaa0 con 0x7f0ed014f820 2023-07-25T14:36:45.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:45.571+0000 7f0ed51c5700 1 -- 172.21.15.72:0/313945808 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f0ed00acaa0 con 0x7f0ed014f820 2023-07-25T14:36:45.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:45.574+0000 7f0eb77fe700 1 -- 172.21.15.72:0/313945808 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v11) v1 ==== 97+0+0 (secure 0 0 0) 0x7f0ed00acaa0 con 0x7f0ed014f820 2023-07-25T14:36:45.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:45.576+0000 7f0ed51c5700 1 -- 172.21.15.72:0/313945808 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f0ebc06ace0 msgr2=0x7f0ebc06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:45.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:45.576+0000 7f0ed51c5700 1 --2- 172.21.15.72:0/313945808 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f0ebc06ace0 0x7f0ebc06d1a0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f0ec4006fd0 tx=0x7f0ec4008070 comp rx=0 tx=0).stop 2023-07-25T14:36:45.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:45.576+0000 7f0ed51c5700 1 -- 172.21.15.72:0/313945808 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0ed014f820 msgr2=0x7f0ed01e7cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:45.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:45.576+0000 7f0ed51c5700 1 --2- 172.21.15.72:0/313945808 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0ed014f820 0x7f0ed01e7cf0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f0ec8009f00 tx=0x7f0ec800c3a0 comp rx=0 tx=0).stop 2023-07-25T14:36:45.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:45.576+0000 7f0ed51c5700 1 -- 172.21.15.72:0/313945808 shutdown_connections 2023-07-25T14:36:45.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:45.576+0000 7f0ed51c5700 1 --2- 172.21.15.72:0/313945808 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f0ebc06ace0 0x7f0ebc06d1a0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:45.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:45.576+0000 7f0ed51c5700 1 --2- 172.21.15.72:0/313945808 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0ed014f820 0x7f0ed01e7cf0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:45.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:45.576+0000 7f0ed51c5700 1 --2- 172.21.15.72:0/313945808 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0ed00bb0a0 0x7f0ed01544f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:45.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:45.576+0000 7f0ed51c5700 1 --2- 172.21.15.72:0/313945808 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0ed00c5910 0x7f0ed01eb4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:45.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:45.577+0000 7f0ed51c5700 1 -- 172.21.15.72:0/313945808 >> 172.21.15.72:0/313945808 conn(0x7f0ed006a980 msgr2=0x7f0ed0150a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:45.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:45.577+0000 7f0ed51c5700 1 -- 172.21.15.72:0/313945808 shutdown_connections 2023-07-25T14:36:45.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:45.577+0000 7f0ed51c5700 1 -- 172.21.15.72:0/313945808 wait complete. 2023-07-25T14:36:45.600 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-07-25T14:36:45.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:45.709+0000 7fd38dbd8700 1 Processor -- start 2023-07-25T14:36:45.722 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:45.709+0000 7fd38dbd8700 1 -- start start 2023-07-25T14:36:45.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:45.710+0000 7fd38dbd8700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fd38806f9b0 0x7fd3880c5380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:45.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:45.710+0000 7fd38dbd8700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd38806eaf0 con 0x7fd38806e580 2023-07-25T14:36:45.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:45.710+0000 7fd38dbd8700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd38806edd0 con 0x7fd388151980 2023-07-25T14:36:45.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:45.710+0000 7fd38dbd8700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd38806f770 con 0x7fd38806f9b0 2023-07-25T14:36:45.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:45.710+0000 7fd37effd700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fd38806e580 0x7fd3880c4c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:60766/0 (socket says 172.21.15.72:60766) 2023-07-25T14:36:45.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:45.710+0000 7fd37effd700 1 -- 172.21.15.72:0/1903898671 learned_addr learned my addr 172.21.15.72:0/1903898671 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:36:45.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:45.710+0000 7fd387fff700 1 --2- 172.21.15.72:0/1903898671 >> v2:172.21.15.92:3300/0 conn(0x7fd38806f9b0 0x7fd3880c5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:45.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:45.710+0000 7fd386ffd700 1 -- 172.21.15.72:0/1903898671 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1824648820 0 0) 0x7fd38806eaf0 con 0x7fd38806e580 2023-07-25T14:36:45.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:45.710+0000 7fd386ffd700 1 -- 172.21.15.72:0/1903898671 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd3740035b0 con 0x7fd38806e580 2023-07-25T14:36:45.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:45.710+0000 7fd386ffd700 1 -- 172.21.15.72:0/1903898671 <== mon.1 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 767482072 0 0) 0x7fd38806edd0 con 0x7fd388151980 2023-07-25T14:36:45.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:45.710+0000 7fd386ffd700 1 -- 172.21.15.72:0/1903898671 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd38806eaf0 con 0x7fd388151980 2023-07-25T14:36:45.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:45.711+0000 7fd387fff700 1 -- 172.21.15.72:0/1903898671 >> v1:172.21.15.92:6789/0 conn(0x7fd388151980 legacy=0x7fd3880c12b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:45.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:45.711+0000 7fd386ffd700 1 -- 172.21.15.72:0/1903898671 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4005188682 0 0) 0x7fd3740035b0 con 0x7fd38806e580 2023-07-25T14:36:45.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:45.711+0000 7fd387fff700 1 -- 172.21.15.72:0/1903898671 >> v1:172.21.15.72:6789/0 conn(0x7fd38806e580 legacy=0x7fd3880c4c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:45.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:45.711+0000 7fd387fff700 1 -- 172.21.15.72:0/1903898671 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd38806f0b0 con 0x7fd38806f9b0 2023-07-25T14:36:45.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:45.711+0000 7fd387fff700 1 --2- 172.21.15.72:0/1903898671 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd38806f9b0 0x7fd3880c5380 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fd380009d90 tx=0x7fd38000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=633c16946eeeb5d server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:45.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:45.711+0000 7fd386ffd700 1 -- 172.21.15.72:0/1903898671 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd38000e070 con 0x7fd38806f9b0 2023-07-25T14:36:45.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:45.711+0000 7fd386ffd700 1 -- 172.21.15.72:0/1903898671 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd380003a20 con 0x7fd38806f9b0 2023-07-25T14:36:45.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:45.711+0000 7fd386ffd700 1 -- 172.21.15.72:0/1903898671 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd370001670 con 0x7fd38806f9b0 2023-07-25T14:36:45.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:45.711+0000 7fd38dbd8700 1 -- 172.21.15.72:0/1903898671 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd38806f9b0 msgr2=0x7fd3880c5380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:45.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:45.711+0000 7fd38dbd8700 1 --2- 172.21.15.72:0/1903898671 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd38806f9b0 0x7fd3880c5380 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fd380009d90 tx=0x7fd38000b330 comp rx=0 tx=0).stop 2023-07-25T14:36:45.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:45.711+0000 7fd38dbd8700 1 -- 172.21.15.72:0/1903898671 shutdown_connections 2023-07-25T14:36:45.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:45.711+0000 7fd38dbd8700 1 --2- 172.21.15.72:0/1903898671 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd38806f9b0 0x7fd3880c5380 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:45.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:45.711+0000 7fd38dbd8700 1 -- 172.21.15.72:0/1903898671 >> 172.21.15.72:0/1903898671 conn(0x7fd3880a8520 msgr2=0x7fd3880a8900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:45.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:45.712+0000 7fd38dbd8700 1 -- 172.21.15.72:0/1903898671 shutdown_connections 2023-07-25T14:36:45.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:45.712+0000 7fd38dbd8700 1 -- 172.21.15.72:0/1903898671 wait complete. 2023-07-25T14:36:45.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:45.713+0000 7fd38dbd8700 1 Processor -- start 2023-07-25T14:36:45.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:45.713+0000 7fd38dbd8700 1 -- start start 2023-07-25T14:36:45.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:45.713+0000 7fd38dbd8700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd38806e580 0x7fd3880c4fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:45.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:45.713+0000 7fd38dbd8700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd38806f9b0 0x7fd3880bc490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:45.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:45.713+0000 7fd38dbd8700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd388151980 0x7fd3880aaae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:45.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:45.713+0000 7fd38dbd8700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3880bb940 con 0x7fd38806e580 2023-07-25T14:36:45.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:45.713+0000 7fd38dbd8700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3881ed980 con 0x7fd388151980 2023-07-25T14:36:45.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:45.713+0000 7fd38dbd8700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3881e9cc0 con 0x7fd38806f9b0 2023-07-25T14:36:45.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:45.714+0000 7fd3877fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd38806e580 0x7fd3880c4fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:45.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:45.714+0000 7fd3877fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd38806e580 0x7fd3880c4fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41802/0 (socket says 172.21.15.72:41802) 2023-07-25T14:36:45.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:45.714+0000 7fd3877fe700 1 -- 172.21.15.72:0/2039301920 learned_addr learned my addr 172.21.15.72:0/2039301920 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:45.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:45.714+0000 7fd387fff700 1 --2- 172.21.15.72:0/2039301920 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd388151980 0x7fd3880aaae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:45.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:45.714+0000 7fd3877fe700 1 -- 172.21.15.72:0/2039301920 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd38806f9b0 msgr2=0x7fd3880bc490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:45.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:45.714+0000 7fd3877fe700 1 --2- 172.21.15.72:0/2039301920 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd38806f9b0 0x7fd3880bc490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:45.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:45.714+0000 7fd3877fe700 1 -- 172.21.15.72:0/2039301920 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd388151980 msgr2=0x7fd3880aaae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:45.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:45.714+0000 7fd3877fe700 1 --2- 172.21.15.72:0/2039301920 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd388151980 0x7fd3880aaae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:45.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:45.714+0000 7fd3877fe700 1 -- 172.21.15.72:0/2039301920 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd380009a70 con 0x7fd38806e580 2023-07-25T14:36:45.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:45.714+0000 7fd3877fe700 1 --2- 172.21.15.72:0/2039301920 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd38806e580 0x7fd3880c4fc0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fd37800c530 tx=0x7fd37800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:45.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:45.714+0000 7fd384ff9700 1 -- 172.21.15.72:0/2039301920 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3780052d0 con 0x7fd38806e580 2023-07-25T14:36:45.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:45.714+0000 7fd384ff9700 1 -- 172.21.15.72:0/2039301920 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd378005430 con 0x7fd38806e580 2023-07-25T14:36:45.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:45.714+0000 7fd38dbd8700 1 -- 172.21.15.72:0/2039301920 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3881ed400 con 0x7fd38806e580 2023-07-25T14:36:45.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:45.714+0000 7fd384ff9700 1 -- 172.21.15.72:0/2039301920 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd378003910 con 0x7fd38806e580 2023-07-25T14:36:45.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:45.714+0000 7fd38dbd8700 1 -- 172.21.15.72:0/2039301920 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3881e9670 con 0x7fd38806e580 2023-07-25T14:36:45.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:45.715+0000 7fd38dbd8700 1 -- 172.21.15.72:0/2039301920 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3881e94d0 con 0x7fd38806e580 2023-07-25T14:36:45.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:45.716+0000 7fd384ff9700 1 -- 172.21.15.72:0/2039301920 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd378003a70 con 0x7fd38806e580 2023-07-25T14:36:45.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:45.716+0000 7fd384ff9700 1 --2- 172.21.15.72:0/2039301920 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fd36806ace0 0x7fd36806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:45.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:45.717+0000 7fd384ff9700 1 -- 172.21.15.72:0/2039301920 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5530+0+0 (secure 0 0 0) 0x7fd3780889a0 con 0x7fd38806e580 2023-07-25T14:36:45.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:45.717+0000 7fd37effd700 1 --2- 172.21.15.72:0/2039301920 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fd36806ace0 0x7fd36806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:45.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:45.717+0000 7fd37effd700 1 --2- 172.21.15.72:0/2039301920 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fd36806ace0 0x7fd36806d1a0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fd3880c1bd0 tx=0x7fd370001250 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:45.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:45.720+0000 7fd384ff9700 1 -- 172.21.15.72:0/2039301920 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fd378053e90 con 0x7fd38806e580 2023-07-25T14:36:45.800 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T14:36:45.802 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T14:36:46.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:45.990+0000 7fd38dbd8700 1 -- 172.21.15.72:0/2039301920 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7fd3881e94d0 con 0x7fd38806e580 2023-07-25T14:36:46.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:45.994+0000 7fd384ff9700 1 -- 172.21.15.72:0/2039301920 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v12) v1 ==== 90+0+0 (secure 0 0 0) 0x7fd3881e94d0 con 0x7fd38806e580 2023-07-25T14:36:46.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:45.996+0000 7fd38dbd8700 1 -- 172.21.15.72:0/2039301920 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fd36806ace0 msgr2=0x7fd36806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:46.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:45.996+0000 7fd38dbd8700 1 --2- 172.21.15.72:0/2039301920 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fd36806ace0 0x7fd36806d1a0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fd3880c1bd0 tx=0x7fd370001250 comp rx=0 tx=0).stop 2023-07-25T14:36:46.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:45.996+0000 7fd38dbd8700 1 -- 172.21.15.72:0/2039301920 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd38806e580 msgr2=0x7fd3880c4fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:46.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:45.996+0000 7fd38dbd8700 1 --2- 172.21.15.72:0/2039301920 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd38806e580 0x7fd3880c4fc0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fd37800c530 tx=0x7fd37800c8f0 comp rx=0 tx=0).stop 2023-07-25T14:36:46.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:45.996+0000 7fd38dbd8700 1 -- 172.21.15.72:0/2039301920 shutdown_connections 2023-07-25T14:36:46.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:45.996+0000 7fd38dbd8700 1 --2- 172.21.15.72:0/2039301920 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fd36806ace0 0x7fd36806d1a0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:46.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:45.996+0000 7fd38dbd8700 1 --2- 172.21.15.72:0/2039301920 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd388151980 0x7fd3880aaae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:46.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:45.996+0000 7fd38dbd8700 1 --2- 172.21.15.72:0/2039301920 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd38806e580 0x7fd3880c4fc0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:46.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:45.996+0000 7fd38dbd8700 1 --2- 172.21.15.72:0/2039301920 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd38806f9b0 0x7fd3880bc490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:46.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:45.996+0000 7fd38dbd8700 1 -- 172.21.15.72:0/2039301920 >> 172.21.15.72:0/2039301920 conn(0x7fd3880a8520 msgr2=0x7fd38806a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:46.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:45.996+0000 7fd38dbd8700 1 -- 172.21.15.72:0/2039301920 shutdown_connections 2023-07-25T14:36:46.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:45.996+0000 7fd38dbd8700 1 -- 172.21.15.72:0/2039301920 wait complete. 2023-07-25T14:36:46.020 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-25T14:36:46.140 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.128+0000 7f9a40f1e700 1 Processor -- start 2023-07-25T14:36:46.140 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.128+0000 7f9a40f1e700 1 -- start start 2023-07-25T14:36:46.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.129+0000 7f9a40f1e700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9a3c0724c0 0x7f9a3c0c34c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:46.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.129+0000 7f9a40f1e700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f9a3c0c4930 0x7f9a3c0c3a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:46.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.129+0000 7f9a40f1e700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a3c0c2fe0 con 0x7f9a3c151950 2023-07-25T14:36:46.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.129+0000 7f9a40f1e700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a3c071a60 con 0x7f9a3c0c4930 2023-07-25T14:36:46.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.129+0000 7f9a40f1e700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a3c0c2a70 con 0x7f9a3c0724c0 2023-07-25T14:36:46.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.129+0000 7f9a3ad9d700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f9a3c0c4930 0x7f9a3c0c3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:46.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.129+0000 7f9a39d9b700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9a3c0724c0 0x7f9a3c0c34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:46.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.129+0000 7f9a3a59c700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f9a3c151950 0x7f9a3c06a190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.72:56120/0 (socket says 172.21.15.72:56120) 2023-07-25T14:36:46.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.129+0000 7f9a3a59c700 1 -- 172.21.15.72:0/2132209408 learned_addr learned my addr 172.21.15.72:0/2132209408 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:36:46.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.130+0000 7f9a39d9b700 1 -- 172.21.15.72:0/2132209408 >> v2:172.21.15.92:3300/0 conn(0x7f9a3c0c4930 msgr2=0x7f9a3c0c3a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:46.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.130+0000 7f9a39d9b700 1 --2- 172.21.15.72:0/2132209408 >> v2:172.21.15.92:3300/0 conn(0x7f9a3c0c4930 0x7f9a3c0c3a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:46.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.130+0000 7f9a39d9b700 1 -- 172.21.15.72:0/2132209408 >> v1:172.21.15.92:6789/0 conn(0x7f9a3c151950 legacy=0x7f9a3c06a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:46.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.130+0000 7f9a39d9b700 1 -- 172.21.15.72:0/2132209408 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a3c155070 con 0x7f9a3c0724c0 2023-07-25T14:36:46.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.130+0000 7f9a39d9b700 1 --2- 172.21.15.72:0/2132209408 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9a3c0724c0 0x7f9a3c0c34c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f9a2c009840 tx=0x7f9a2c009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=987236d7831688b5 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:46.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.130+0000 7f9a3959a700 1 -- 172.21.15.72:0/2132209408 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a2c011830 con 0x7f9a3c0724c0 2023-07-25T14:36:46.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.130+0000 7f9a3959a700 1 -- 172.21.15.72:0/2132209408 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a2c011990 con 0x7f9a3c0724c0 2023-07-25T14:36:46.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.130+0000 7f9a3959a700 1 -- 172.21.15.72:0/2132209408 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a2c011d20 con 0x7f9a3c0724c0 2023-07-25T14:36:46.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.131+0000 7f9a40f1e700 1 -- 172.21.15.72:0/2132209408 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9a3c0724c0 msgr2=0x7f9a3c0c34c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:46.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.131+0000 7f9a40f1e700 1 --2- 172.21.15.72:0/2132209408 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9a3c0724c0 0x7f9a3c0c34c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f9a2c009840 tx=0x7f9a2c009b50 comp rx=0 tx=0).stop 2023-07-25T14:36:46.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.131+0000 7f9a40f1e700 1 -- 172.21.15.72:0/2132209408 shutdown_connections 2023-07-25T14:36:46.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.131+0000 7f9a40f1e700 1 --2- 172.21.15.72:0/2132209408 >> v2:172.21.15.92:3300/0 conn(0x7f9a3c0c4930 0x7f9a3c0c3a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:46.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.131+0000 7f9a40f1e700 1 --2- 172.21.15.72:0/2132209408 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9a3c0724c0 0x7f9a3c0c34c0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:46.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.131+0000 7f9a40f1e700 1 -- 172.21.15.72:0/2132209408 >> 172.21.15.72:0/2132209408 conn(0x7f9a3c0a87e0 msgr2=0x7f9a3c0a8bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:46.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.131+0000 7f9a40f1e700 1 -- 172.21.15.72:0/2132209408 shutdown_connections 2023-07-25T14:36:46.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.131+0000 7f9a40f1e700 1 -- 172.21.15.72:0/2132209408 wait complete. 2023-07-25T14:36:46.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.132+0000 7f9a40f1e700 1 Processor -- start 2023-07-25T14:36:46.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.132+0000 7f9a40f1e700 1 -- start start 2023-07-25T14:36:46.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.133+0000 7f9a40f1e700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9a3c0724c0 0x7f9a3c14ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:46.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.133+0000 7f9a40f1e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9a3c0c4930 0x7f9a3c14cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:46.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.133+0000 7f9a40f1e700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9a3c151950 0x7f9a3c14d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:46.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.133+0000 7f9a40f1e700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a3c0bfb70 con 0x7f9a3c0c4930 2023-07-25T14:36:46.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.133+0000 7f9a40f1e700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a3c0a98d0 con 0x7f9a3c0724c0 2023-07-25T14:36:46.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.133+0000 7f9a40f1e700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a3c0abf40 con 0x7f9a3c151950 2023-07-25T14:36:46.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.133+0000 7f9a39d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9a3c0c4930 0x7f9a3c14cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:46.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.133+0000 7f9a39d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9a3c0c4930 0x7f9a3c14cc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41818/0 (socket says 172.21.15.72:41818) 2023-07-25T14:36:46.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.133+0000 7f9a39d9b700 1 -- 172.21.15.72:0/3022502736 learned_addr learned my addr 172.21.15.72:0/3022502736 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:46.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.133+0000 7f9a3a59c700 1 --2- 172.21.15.72:0/3022502736 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9a3c0724c0 0x7f9a3c14ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:46.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.133+0000 7f9a3ad9d700 1 --2- 172.21.15.72:0/3022502736 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9a3c151950 0x7f9a3c14d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:46.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.133+0000 7f9a39d9b700 1 -- 172.21.15.72:0/3022502736 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9a3c151950 msgr2=0x7f9a3c14d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:46.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.133+0000 7f9a39d9b700 1 --2- 172.21.15.72:0/3022502736 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9a3c151950 0x7f9a3c14d1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:46.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.133+0000 7f9a39d9b700 1 -- 172.21.15.72:0/3022502736 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9a3c0724c0 msgr2=0x7f9a3c14ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:46.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.133+0000 7f9a39d9b700 1 --2- 172.21.15.72:0/3022502736 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9a3c0724c0 0x7f9a3c14ec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:46.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.133+0000 7f9a39d9b700 1 -- 172.21.15.72:0/3022502736 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a2c0094a0 con 0x7f9a3c0c4930 2023-07-25T14:36:46.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.133+0000 7f9a3ad9d700 1 --2- 172.21.15.72:0/3022502736 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9a3c151950 0x7f9a3c14d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-25T14:36:46.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.133+0000 7f9a39d9b700 1 --2- 172.21.15.72:0/3022502736 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9a3c0c4930 0x7f9a3c14cc70 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f9a2c0090b0 tx=0x7f9a2c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:46.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.134+0000 7f9a2affd700 1 -- 172.21.15.72:0/3022502736 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a2c0036a0 con 0x7f9a3c0c4930 2023-07-25T14:36:46.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.134+0000 7f9a2affd700 1 -- 172.21.15.72:0/3022502736 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a2c01f070 con 0x7f9a3c0c4930 2023-07-25T14:36:46.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.134+0000 7f9a40f1e700 1 -- 172.21.15.72:0/3022502736 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a3c0ac220 con 0x7f9a3c0c4930 2023-07-25T14:36:46.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.134+0000 7f9a2affd700 1 -- 172.21.15.72:0/3022502736 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a2c003a60 con 0x7f9a3c0c4930 2023-07-25T14:36:46.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.134+0000 7f9a40f1e700 1 -- 172.21.15.72:0/3022502736 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a3c14f190 con 0x7f9a3c0c4930 2023-07-25T14:36:46.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.135+0000 7f9a40f1e700 1 -- 172.21.15.72:0/3022502736 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a3c0ac740 con 0x7f9a3c0c4930 2023-07-25T14:36:46.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.135+0000 7f9a2affd700 1 -- 172.21.15.72:0/3022502736 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9a2c003bc0 con 0x7f9a3c0c4930 2023-07-25T14:36:46.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.135+0000 7f9a2affd700 1 --2- 172.21.15.72:0/3022502736 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f9a1c06ace0 0x7f9a1c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:46.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.135+0000 7f9a3a59c700 1 --2- 172.21.15.72:0/3022502736 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f9a1c06ace0 0x7f9a1c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:46.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.135+0000 7f9a2affd700 1 -- 172.21.15.72:0/3022502736 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f9a2c021070 con 0x7f9a3c0c4930 2023-07-25T14:36:46.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.136+0000 7f9a3a59c700 1 --2- 172.21.15.72:0/3022502736 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f9a1c06ace0 0x7f9a1c06d1a0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f9a30005910 tx=0x7f9a30009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:46.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.140+0000 7f9a2affd700 1 -- 172.21.15.72:0/3022502736 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f9a2c055dd0 con 0x7f9a3c0c4930 2023-07-25T14:36:46.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.331+0000 7f9a40f1e700 1 -- 172.21.15.72:0/3022502736 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9a3c0a9690 con 0x7f9a3c0c4930 2023-07-25T14:36:46.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.332+0000 7f9a2affd700 1 -- 172.21.15.72:0/3022502736 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+14738 (secure 0 0 0) 0x7f9a2c015090 con 0x7f9a3c0c4930 2023-07-25T14:36:46.344 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-25T14:36:46.344 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":35,"fsid":"9170db48-9170-43e8-8ccb-9813e6240906","created":"2023-07-25T14:35:21.733262+0000","modified":"2023-07-25T14:36:43.058866+0000","last_up_change":"2023-07-25T14:35:31.355010+0000","last_in_change":"2023-07-25T14:35:24.195785+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-25T14:35:32.983457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-25T14:35:33.326342+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d517fdad-0bfe-49f0-89f2-9421c3761839","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6801","nonce":2475407414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6803","nonce":2475407414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6807","nonce":2475407414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6805","nonce":2475407414}]},"public_addr":"172.21.15.72:6801/2475407414","cluster_addr":"172.21.15.72:6803/2475407414","heartbeat_back_addr":"172.21.15.72:6807/2475407414","heartbeat_front_addr":"172.21.15.72:6805/2475407414","state":["exists","up"]},{"osd":1,"uuid":"e1564be3-f209-47e5-a8d0-32fc618a474f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6822","nonce":870954016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6825","nonce":870954016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6831","nonce":870954016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6827","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6829","nonce":870954016}]},"public_addr":"172.21.15.72:6822/870954016","cluster_addr":"172.21.15.72:6825/870954016","heartbeat_back_addr":"172.21.15.72:6831/870954016","heartbeat_front_addr":"172.21.15.72:6829/870954016","state":["exists","up"]},{"osd":2,"uuid":"c4647d30-ffa6-417a-9026-ef530c75910e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6809","nonce":2143129442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6811","nonce":2143129442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6815","nonce":2143129442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6813","nonce":2143129442}]},"public_addr":"172.21.15.72:6809/2143129442","cluster_addr":"172.21.15.72:6811/2143129442","heartbeat_back_addr":"172.21.15.72:6815/2143129442","heartbeat_front_addr":"172.21.15.72:6813/2143129442","state":["exists","up"]},{"osd":3,"uuid":"76c9d9a7-c2e2-4612-a58b-d6882dd76b58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6817","nonce":3404066311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6819","nonce":3404066311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6828","nonce":3404066311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6821","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6823","nonce":3404066311}]},"public_addr":"172.21.15.72:6817/3404066311","cluster_addr":"172.21.15.72:6819/3404066311","heartbeat_back_addr":"172.21.15.72:6828/3404066311","heartbeat_front_addr":"172.21.15.72:6823/3404066311","state":["exists","up"]},{"osd":4,"uuid":"7f8920dc-0ad4-4a73-ab40-65408f83eadd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6817","nonce":2381008739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6819","nonce":2381008739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6825","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6827","nonce":2381008739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6822","nonce":2381008739}]},"public_addr":"172.21.15.92:6817/2381008739","cluster_addr":"172.21.15.92:6819/2381008739","heartbeat_back_addr":"172.21.15.92:6827/2381008739","heartbeat_front_addr":"172.21.15.92:6822/2381008739","state":["exists","up"]},{"osd":5,"uuid":"56257e7c-31eb-44c5-9ec7-1318a4e0bb35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6801","nonce":2161935604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6803","nonce":2161935604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6807","nonce":2161935604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6805","nonce":2161935604}]},"public_addr":"172.21.15.92:6801/2161935604","cluster_addr":"172.21.15.92:6803/2161935604","heartbeat_back_addr":"172.21.15.92:6807/2161935604","heartbeat_front_addr":"172.21.15.92:6805/2161935604","state":["exists","up"]},{"osd":6,"uuid":"a150d3d8-a0c9-4955-968a-8d98eff4ffb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6809","nonce":3770163493}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6811","nonce":3770163493}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6815","nonce":3770163493}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6813","nonce":3770163493}]},"public_addr":"172.21.15.92:6809/3770163493","cluster_addr":"172.21.15.92:6811/3770163493","heartbeat_back_addr":"172.21.15.92:6815/3770163493","heartbeat_front_addr":"172.21.15.92:6813/3770163493","state":["exists","up"]},{"osd":7,"uuid":"07799c27-54ee-4591-a42d-a978d6b32065","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6821","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6823","nonce":2135777609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6826","nonce":2135777609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6831","nonce":2135777609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6829","nonce":2135777609}]},"public_addr":"172.21.15.92:6823/2135777609","cluster_addr":"172.21.15.92:6826/2135777609","heartbeat_back_addr":"172.21.15.92:6831/2135777609","heartbeat_front_addr":"172.21.15.92:6829/2135777609","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.345365+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.378150+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.146566+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.372172+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:30.398421+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.385632+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.465611+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.443583+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-25T14:36:46.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.334+0000 7f9a40f1e700 1 -- 172.21.15.72:0/3022502736 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f9a1c06ace0 msgr2=0x7f9a1c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:46.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.334+0000 7f9a40f1e700 1 --2- 172.21.15.72:0/3022502736 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f9a1c06ace0 0x7f9a1c06d1a0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f9a30005910 tx=0x7f9a30009040 comp rx=0 tx=0).stop 2023-07-25T14:36:46.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.334+0000 7f9a40f1e700 1 -- 172.21.15.72:0/3022502736 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9a3c0c4930 msgr2=0x7f9a3c14cc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:46.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.334+0000 7f9a40f1e700 1 --2- 172.21.15.72:0/3022502736 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9a3c0c4930 0x7f9a3c14cc70 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f9a2c0090b0 tx=0x7f9a2c004750 comp rx=0 tx=0).stop 2023-07-25T14:36:46.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.334+0000 7f9a40f1e700 1 -- 172.21.15.72:0/3022502736 shutdown_connections 2023-07-25T14:36:46.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.334+0000 7f9a40f1e700 1 --2- 172.21.15.72:0/3022502736 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f9a1c06ace0 0x7f9a1c06d1a0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:46.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.334+0000 7f9a40f1e700 1 --2- 172.21.15.72:0/3022502736 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9a3c151950 0x7f9a3c14d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:46.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.334+0000 7f9a40f1e700 1 --2- 172.21.15.72:0/3022502736 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9a3c0724c0 0x7f9a3c14ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:46.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.334+0000 7f9a40f1e700 1 --2- 172.21.15.72:0/3022502736 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9a3c0c4930 0x7f9a3c14cc70 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:46.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.334+0000 7f9a40f1e700 1 -- 172.21.15.72:0/3022502736 >> 172.21.15.72:0/3022502736 conn(0x7f9a3c0a87e0 msgr2=0x7f9a3c06fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:46.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.334+0000 7f9a40f1e700 1 -- 172.21.15.72:0/3022502736 shutdown_connections 2023-07-25T14:36:46.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.334+0000 7f9a40f1e700 1 -- 172.21.15.72:0/3022502736 wait complete. 2023-07-25T14:36:46.358 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-07-25T14:35:32.983457+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-07-25T14:35:33.326342+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-25T14:36:46.360 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-25T14:36:46.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.472+0000 7f0df0998700 1 Processor -- start 2023-07-25T14:36:46.484 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.472+0000 7f0df0998700 1 -- start start 2023-07-25T14:36:46.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.473+0000 7f0df0998700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0dec151ba0 0x7f0dec0c2230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:46.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.473+0000 7f0df0998700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0dec0c54f0 con 0x7f0dec0c5f40 2023-07-25T14:36:46.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.473+0000 7f0df0998700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0dec0c6670 con 0x7f0dec154d50 2023-07-25T14:36:46.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.473+0000 7f0df0998700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0dec0c5740 con 0x7f0dec151ba0 2023-07-25T14:36:46.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.473+0000 7f0dea59c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0dec151ba0 0x7f0dec0c2230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:46.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.473+0000 7f0de9d9b700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f0dec0c5f40 0x7f0dec154640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:60792/0 (socket says 172.21.15.72:60792) 2023-07-25T14:36:46.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.473+0000 7f0de9d9b700 1 -- 172.21.15.72:0/3820852325 learned_addr learned my addr 172.21.15.72:0/3820852325 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:36:46.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.473+0000 7f0dea59c700 1 -- 172.21.15.72:0/3820852325 >> v1:172.21.15.92:6789/0 conn(0x7f0dec154d50 legacy=0x7f0dec15b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:46.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.473+0000 7f0dea59c700 1 -- 172.21.15.72:0/3820852325 >> v1:172.21.15.72:6789/0 conn(0x7f0dec0c5f40 legacy=0x7f0dec154640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:46.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.473+0000 7f0dea59c700 1 -- 172.21.15.72:0/3820852325 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dec0c5a20 con 0x7f0dec151ba0 2023-07-25T14:36:46.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.473+0000 7f0de959a700 1 -- 172.21.15.72:0/3820852325 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1990412970 0 0) 0x7f0dec0c54f0 con 0x7f0dec0c5f40 2023-07-25T14:36:46.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.474+0000 7f0dea59c700 1 --2- 172.21.15.72:0/3820852325 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0dec151ba0 0x7f0dec0c2230 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f0ddc009840 tx=0x7f0ddc009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76286a40d6120a2 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:46.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.474+0000 7f0de959a700 1 -- 172.21.15.72:0/3820852325 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ddc011830 con 0x7f0dec151ba0 2023-07-25T14:36:46.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.474+0000 7f0de959a700 1 -- 172.21.15.72:0/3820852325 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ddc011990 con 0x7f0dec151ba0 2023-07-25T14:36:46.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.474+0000 7f0de959a700 1 -- 172.21.15.72:0/3820852325 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ddc011d20 con 0x7f0dec151ba0 2023-07-25T14:36:46.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.474+0000 7f0df0998700 1 -- 172.21.15.72:0/3820852325 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0dec151ba0 msgr2=0x7f0dec0c2230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:46.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.474+0000 7f0df0998700 1 --2- 172.21.15.72:0/3820852325 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0dec151ba0 0x7f0dec0c2230 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f0ddc009840 tx=0x7f0ddc009b50 comp rx=0 tx=0).stop 2023-07-25T14:36:46.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.474+0000 7f0df0998700 1 -- 172.21.15.72:0/3820852325 shutdown_connections 2023-07-25T14:36:46.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.474+0000 7f0df0998700 1 --2- 172.21.15.72:0/3820852325 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0dec151ba0 0x7f0dec0c2230 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:46.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.474+0000 7f0df0998700 1 -- 172.21.15.72:0/3820852325 >> 172.21.15.72:0/3820852325 conn(0x7f0dec0a87e0 msgr2=0x7f0dec0a8bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:46.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.474+0000 7f0df0998700 1 -- 172.21.15.72:0/3820852325 shutdown_connections 2023-07-25T14:36:46.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.474+0000 7f0df0998700 1 -- 172.21.15.72:0/3820852325 wait complete. 2023-07-25T14:36:46.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.476+0000 7f0df0998700 1 Processor -- start 2023-07-25T14:36:46.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.476+0000 7f0df0998700 1 -- start start 2023-07-25T14:36:46.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.476+0000 7f0df0998700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0dec0c5f40 0x7f0dec0ac020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:46.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.476+0000 7f0df0998700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0dec151ba0 0x7f0dec150650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:46.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.476+0000 7f0df0998700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0dec0aa840 0x7f0dec1ecfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:46.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.476+0000 7f0df0998700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dec0ac600 con 0x7f0dec0c5f40 2023-07-25T14:36:46.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.476+0000 7f0df0998700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dec0ab530 con 0x7f0dec151ba0 2023-07-25T14:36:46.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.476+0000 7f0df0998700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0dec0ab810 con 0x7f0dec0aa840 2023-07-25T14:36:46.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.476+0000 7f0dea59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0dec0c5f40 0x7f0dec0ac020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:46.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.476+0000 7f0dea59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0dec0c5f40 0x7f0dec0ac020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41830/0 (socket says 172.21.15.72:41830) 2023-07-25T14:36:46.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.476+0000 7f0dea59c700 1 -- 172.21.15.72:0/147844636 learned_addr learned my addr 172.21.15.72:0/147844636 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:46.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.477+0000 7f0de9d9b700 1 --2- 172.21.15.72:0/147844636 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0dec151ba0 0x7f0dec150650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:46.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.477+0000 7f0dead9d700 1 --2- 172.21.15.72:0/147844636 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0dec0aa840 0x7f0dec1ecfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:46.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.477+0000 7f0dea59c700 1 -- 172.21.15.72:0/147844636 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0dec0aa840 msgr2=0x7f0dec1ecfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:46.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.477+0000 7f0dea59c700 1 --2- 172.21.15.72:0/147844636 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0dec0aa840 0x7f0dec1ecfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:46.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.477+0000 7f0dea59c700 1 -- 172.21.15.72:0/147844636 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0dec151ba0 msgr2=0x7f0dec150650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:46.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.477+0000 7f0dea59c700 1 --2- 172.21.15.72:0/147844636 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0dec151ba0 0x7f0dec150650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:46.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.477+0000 7f0dea59c700 1 -- 172.21.15.72:0/147844636 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ddc0094a0 con 0x7f0dec0c5f40 2023-07-25T14:36:46.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.477+0000 7f0de9d9b700 1 --2- 172.21.15.72:0/147844636 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0dec151ba0 0x7f0dec150650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-25T14:36:46.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.477+0000 7f0dead9d700 1 --2- 172.21.15.72:0/147844636 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0dec0aa840 0x7f0dec1ecfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-25T14:36:46.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.477+0000 7f0dea59c700 1 --2- 172.21.15.72:0/147844636 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0dec0c5f40 0x7f0dec0ac020 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f0ddc0090b0 tx=0x7f0ddc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:46.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.477+0000 7f0ddaffd700 1 -- 172.21.15.72:0/147844636 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ddc01a980 con 0x7f0dec0c5f40 2023-07-25T14:36:46.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.477+0000 7f0ddaffd700 1 -- 172.21.15.72:0/147844636 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ddc01ab00 con 0x7f0dec0c5f40 2023-07-25T14:36:46.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.477+0000 7f0df0998700 1 -- 172.21.15.72:0/147844636 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0dec0abaf0 con 0x7f0dec0c5f40 2023-07-25T14:36:46.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.477+0000 7f0ddaffd700 1 -- 172.21.15.72:0/147844636 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ddc024420 con 0x7f0dec0c5f40 2023-07-25T14:36:46.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.477+0000 7f0df0998700 1 -- 172.21.15.72:0/147844636 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0dec1e94a0 con 0x7f0dec0c5f40 2023-07-25T14:36:46.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.478+0000 7f0df0998700 1 -- 172.21.15.72:0/147844636 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0dec04e470 con 0x7f0dec0c5f40 2023-07-25T14:36:46.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.478+0000 7f0ddaffd700 1 -- 172.21.15.72:0/147844636 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0ddc022070 con 0x7f0dec0c5f40 2023-07-25T14:36:46.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.479+0000 7f0ddaffd700 1 --2- 172.21.15.72:0/147844636 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f0dcc06ace0 0x7f0dcc06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:46.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.479+0000 7f0ddaffd700 1 -- 172.21.15.72:0/147844636 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f0ddc08a610 con 0x7f0dec0c5f40 2023-07-25T14:36:46.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.479+0000 7f0de9d9b700 1 --2- 172.21.15.72:0/147844636 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f0dcc06ace0 0x7f0dcc06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:46.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.479+0000 7f0de9d9b700 1 --2- 172.21.15.72:0/147844636 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f0dcc06ace0 0x7f0dcc06d1a0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f0de0000f60 tx=0x7f0de0007ce0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:46.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.483+0000 7f0ddaffd700 1 -- 172.21.15.72:0/147844636 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f0ddc055960 con 0x7f0dec0c5f40 2023-07-25T14:36:46.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.669+0000 7f0df0998700 1 -- 172.21.15.72:0/147844636 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f0dec0c52d0 con 0x7f0dec0c5f40 2023-07-25T14:36:46.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.669+0000 7f0ddaffd700 1 -- 172.21.15.72:0/147844636 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v35) v1 ==== 92+0+10 (secure 0 0 0) 0x7f0ddc0150a0 con 0x7f0dec0c5f40 2023-07-25T14:36:46.681 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 8 2023-07-25T14:36:46.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.671+0000 7f0df0998700 1 -- 172.21.15.72:0/147844636 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f0dcc06ace0 msgr2=0x7f0dcc06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:46.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.671+0000 7f0df0998700 1 --2- 172.21.15.72:0/147844636 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f0dcc06ace0 0x7f0dcc06d1a0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f0de0000f60 tx=0x7f0de0007ce0 comp rx=0 tx=0).stop 2023-07-25T14:36:46.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.671+0000 7f0df0998700 1 -- 172.21.15.72:0/147844636 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0dec0c5f40 msgr2=0x7f0dec0ac020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:46.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.671+0000 7f0df0998700 1 --2- 172.21.15.72:0/147844636 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0dec0c5f40 0x7f0dec0ac020 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f0ddc0090b0 tx=0x7f0ddc004750 comp rx=0 tx=0).stop 2023-07-25T14:36:46.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.671+0000 7f0df0998700 1 -- 172.21.15.72:0/147844636 shutdown_connections 2023-07-25T14:36:46.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.671+0000 7f0df0998700 1 --2- 172.21.15.72:0/147844636 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f0dcc06ace0 0x7f0dcc06d1a0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:46.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.671+0000 7f0df0998700 1 --2- 172.21.15.72:0/147844636 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0dec0aa840 0x7f0dec1ecfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:46.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.671+0000 7f0df0998700 1 --2- 172.21.15.72:0/147844636 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0dec0c5f40 0x7f0dec0ac020 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:46.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.671+0000 7f0df0998700 1 --2- 172.21.15.72:0/147844636 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0dec151ba0 0x7f0dec150650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:46.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.671+0000 7f0df0998700 1 -- 172.21.15.72:0/147844636 >> 172.21.15.72:0/147844636 conn(0x7f0dec0a87e0 msgr2=0x7f0dec071ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:46.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.671+0000 7f0df0998700 1 -- 172.21.15.72:0/147844636 shutdown_connections 2023-07-25T14:36:46.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.671+0000 7f0df0998700 1 -- 172.21.15.72:0/147844636 wait complete. 2023-07-25T14:36:46.695 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-25T14:36:46.817 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.806+0000 7f4e352c1700 1 Processor -- start 2023-07-25T14:36:46.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.806+0000 7f4e352c1700 1 -- start start 2023-07-25T14:36:46.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.807+0000 7f4e352c1700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4e300c44d0 0x7f4e300c4940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:46.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.807+0000 7f4e352c1700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e300bfeb0 con 0x7f4e300bead0 2023-07-25T14:36:46.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.807+0000 7f4e352c1700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e300bf2e0 con 0x7f4e30151a90 2023-07-25T14:36:46.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.807+0000 7f4e352c1700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e300c10b0 con 0x7f4e300c44d0 2023-07-25T14:36:46.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.807+0000 7f4e2e7fc700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f4e300bead0 0x7f4e300c0350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:60806/0 (socket says 172.21.15.72:60806) 2023-07-25T14:36:46.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.807+0000 7f4e2e7fc700 1 -- 172.21.15.72:0/2848263263 learned_addr learned my addr 172.21.15.72:0/2848263263 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:36:46.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.807+0000 7f4e2f7fe700 1 --2- 172.21.15.72:0/2848263263 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4e300c44d0 0x7f4e300c4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:46.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.807+0000 7f4e2dffb700 1 -- 172.21.15.72:0/2848263263 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1012473960 0 0) 0x7f4e300bfeb0 con 0x7f4e300bead0 2023-07-25T14:36:46.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.807+0000 7f4e2dffb700 1 -- 172.21.15.72:0/2848263263 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4e180035b0 con 0x7f4e300bead0 2023-07-25T14:36:46.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.807+0000 7f4e2dffb700 1 -- 172.21.15.72:0/2848263263 <== mon.1 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 107737061 0 0) 0x7f4e300bf2e0 con 0x7f4e30151a90 2023-07-25T14:36:46.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.807+0000 7f4e2dffb700 1 -- 172.21.15.72:0/2848263263 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4e300bfeb0 con 0x7f4e30151a90 2023-07-25T14:36:46.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.807+0000 7f4e2dffb700 1 -- 172.21.15.72:0/2848263263 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 677336730 0 0) 0x7f4e180035b0 con 0x7f4e300bead0 2023-07-25T14:36:46.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.807+0000 7f4e2dffb700 1 -- 172.21.15.72:0/2848263263 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4e300c44d0 msgr2=0x7f4e300c4940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:46.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.807+0000 7f4e2dffb700 1 --2- 172.21.15.72:0/2848263263 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4e300c44d0 0x7f4e300c4940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:46.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.807+0000 7f4e2dffb700 1 -- 172.21.15.72:0/2848263263 >> v1:172.21.15.92:6789/0 conn(0x7f4e30151a90 legacy=0x7f4e30154d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:46.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.807+0000 7f4e2dffb700 1 -- 172.21.15.72:0/2848263263 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e300bf580 con 0x7f4e300bead0 2023-07-25T14:36:46.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.807+0000 7f4e2dffb700 1 -- 172.21.15.72:0/2848263263 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2559588315 0 0) 0x7f4e24001670 con 0x7f4e300bead0 2023-07-25T14:36:46.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.807+0000 7f4e2dffb700 1 -- 172.21.15.72:0/2848263263 >> v1:172.21.15.72:6789/0 conn(0x7f4e300bead0 legacy=0x7f4e300c0350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:46.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.807+0000 7f4e2dffb700 1 --2- 172.21.15.72:0/2848263263 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4e18003bc0 0x7f4e18003fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:46.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.807+0000 7f4e2dffb700 1 --2- 172.21.15.72:0/2848263263 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4e300c44d0 0x7f4e18004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:46.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.807+0000 7f4e2dffb700 1 --2- 172.21.15.72:0/2848263263 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4e18004d90 0x7f4e18005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:46.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.807+0000 7f4e2dffb700 1 -- 172.21.15.72:0/2848263263 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e300c10b0 con 0x7f4e18004d90 2023-07-25T14:36:46.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.807+0000 7f4e2dffb700 1 -- 172.21.15.72:0/2848263263 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e1800bbd0 con 0x7f4e18003bc0 2023-07-25T14:36:46.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.807+0000 7f4e2dffb700 1 -- 172.21.15.72:0/2848263263 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e1800bd90 con 0x7f4e300c44d0 2023-07-25T14:36:46.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.808+0000 7f4e2f7fe700 1 --2- 172.21.15.72:0/2848263263 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4e18004d90 0x7f4e18005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:46.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.808+0000 7f4e2e7fc700 1 --2- 172.21.15.72:0/2848263263 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4e300c44d0 0x7f4e18004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:46.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.808+0000 7f4e2effd700 1 --2- 172.21.15.72:0/2848263263 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4e18003bc0 0x7f4e18003fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:46.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.808+0000 7f4e2f7fe700 1 -- 172.21.15.72:0/2848263263 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4e300c44d0 msgr2=0x7f4e18004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:46.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.808+0000 7f4e2f7fe700 1 --2- 172.21.15.72:0/2848263263 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4e300c44d0 0x7f4e18004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:46.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.808+0000 7f4e2f7fe700 1 -- 172.21.15.72:0/2848263263 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4e18003bc0 msgr2=0x7f4e18003fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:46.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.808+0000 7f4e2f7fe700 1 --2- 172.21.15.72:0/2848263263 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4e18003bc0 0x7f4e18003fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:46.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.808+0000 7f4e2f7fe700 1 -- 172.21.15.72:0/2848263263 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e180035b0 con 0x7f4e18004d90 2023-07-25T14:36:46.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.808+0000 7f4e2f7fe700 1 --2- 172.21.15.72:0/2848263263 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4e18004d90 0x7f4e18005210 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f4e28009fc0 tx=0x7f4e18005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7c59a84bd3489bc server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:46.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.808+0000 7f4e2dffb700 1 -- 172.21.15.72:0/2848263263 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e2800ec30 con 0x7f4e18004d90 2023-07-25T14:36:46.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.808+0000 7f4e2dffb700 1 -- 172.21.15.72:0/2848263263 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e2800f040 con 0x7f4e18004d90 2023-07-25T14:36:46.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.808+0000 7f4e2dffb700 1 -- 172.21.15.72:0/2848263263 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e28014480 con 0x7f4e18004d90 2023-07-25T14:36:46.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.809+0000 7f4e352c1700 1 -- 172.21.15.72:0/2848263263 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4e18004d90 msgr2=0x7f4e18005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:46.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.809+0000 7f4e352c1700 1 --2- 172.21.15.72:0/2848263263 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4e18004d90 0x7f4e18005210 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f4e28009fc0 tx=0x7f4e18005880 comp rx=0 tx=0).stop 2023-07-25T14:36:46.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.809+0000 7f4e2f7fe700 1 -- 172.21.15.72:0/2848263263 reap_dead start 2023-07-25T14:36:46.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.809+0000 7f4e352c1700 1 -- 172.21.15.72:0/2848263263 shutdown_connections 2023-07-25T14:36:46.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.809+0000 7f4e352c1700 1 -- 172.21.15.72:0/2848263263 >> 172.21.15.72:0/2848263263 conn(0x7f4e3006c3a0 msgr2=0x7f4e3006c780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:46.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.809+0000 7f4e352c1700 1 -- 172.21.15.72:0/2848263263 shutdown_connections 2023-07-25T14:36:46.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.809+0000 7f4e352c1700 1 -- 172.21.15.72:0/2848263263 wait complete. 2023-07-25T14:36:46.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.810+0000 7f4e352c1700 1 Processor -- start 2023-07-25T14:36:46.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.810+0000 7f4e352c1700 1 -- start start 2023-07-25T14:36:46.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.811+0000 7f4e352c1700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4e300c8d40 0x7f4e301ea0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:46.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.811+0000 7f4e352c1700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4e3014f430 0x7f4e301e0950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:46.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.811+0000 7f4e352c1700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4e3014f8b0 0x7f4e301e0e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:46.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.811+0000 7f4e352c1700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e3014f010 con 0x7f4e3014f8b0 2023-07-25T14:36:46.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.811+0000 7f4e352c1700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e301ea620 con 0x7f4e3014f430 2023-07-25T14:36:46.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.811+0000 7f4e352c1700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e30150370 con 0x7f4e300c8d40 2023-07-25T14:36:46.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.811+0000 7f4e2f7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4e3014f8b0 0x7f4e301e0e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:46.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.811+0000 7f4e2f7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4e3014f8b0 0x7f4e301e0e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41852/0 (socket says 172.21.15.72:41852) 2023-07-25T14:36:46.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.811+0000 7f4e2f7fe700 1 -- 172.21.15.72:0/1412773518 learned_addr learned my addr 172.21.15.72:0/1412773518 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:46.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.811+0000 7f4e2f7fe700 1 -- 172.21.15.72:0/1412773518 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4e300c8d40 msgr2=0x7f4e301ea0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:46.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.811+0000 7f4e2f7fe700 1 --2- 172.21.15.72:0/1412773518 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4e300c8d40 0x7f4e301ea0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:46.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.811+0000 7f4e2e7fc700 1 --2- 172.21.15.72:0/1412773518 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4e3014f430 0x7f4e301e0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:46.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.811+0000 7f4e2f7fe700 1 -- 172.21.15.72:0/1412773518 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4e3014f430 msgr2=0x7f4e301e0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:46.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.811+0000 7f4e2f7fe700 1 --2- 172.21.15.72:0/1412773518 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4e3014f430 0x7f4e301e0950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:46.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.811+0000 7f4e2f7fe700 1 -- 172.21.15.72:0/1412773518 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e30150650 con 0x7f4e3014f8b0 2023-07-25T14:36:46.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.811+0000 7f4e2f7fe700 1 --2- 172.21.15.72:0/1412773518 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4e3014f8b0 0x7f4e301e0e90 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f4e1800bba0 tx=0x7f4e28009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:46.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.811+0000 7f4e177fe700 1 -- 172.21.15.72:0/1412773518 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e28007000 con 0x7f4e3014f8b0 2023-07-25T14:36:46.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.811+0000 7f4e177fe700 1 -- 172.21.15.72:0/1412773518 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e28022070 con 0x7f4e3014f8b0 2023-07-25T14:36:46.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.811+0000 7f4e352c1700 1 -- 172.21.15.72:0/1412773518 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e30150930 con 0x7f4e3014f8b0 2023-07-25T14:36:46.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.811+0000 7f4e177fe700 1 -- 172.21.15.72:0/1412773518 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e28029480 con 0x7f4e3014f8b0 2023-07-25T14:36:46.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.811+0000 7f4e352c1700 1 -- 172.21.15.72:0/1412773518 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e30150000 con 0x7f4e3014f8b0 2023-07-25T14:36:46.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.812+0000 7f4e352c1700 1 -- 172.21.15.72:0/1412773518 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e300c09e0 con 0x7f4e3014f8b0 2023-07-25T14:36:46.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.813+0000 7f4e177fe700 1 -- 172.21.15.72:0/1412773518 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4e2801e430 con 0x7f4e3014f8b0 2023-07-25T14:36:46.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.813+0000 7f4e177fe700 1 --2- 172.21.15.72:0/1412773518 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f4e1c06ace0 0x7f4e1c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:46.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.813+0000 7f4e2effd700 1 --2- 172.21.15.72:0/1412773518 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f4e1c06ace0 0x7f4e1c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:46.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.813+0000 7f4e177fe700 1 -- 172.21.15.72:0/1412773518 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f4e28024070 con 0x7f4e3014f8b0 2023-07-25T14:36:46.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.813+0000 7f4e2effd700 1 --2- 172.21.15.72:0/1412773518 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f4e1c06ace0 0x7f4e1c06d1a0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f4e200010e0 tx=0x7f4e20009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:46.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:46.817+0000 7f4e177fe700 1 -- 172.21.15.72:0/1412773518 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f4e28056610 con 0x7f4e3014f8b0 2023-07-25T14:36:47.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:47.003+0000 7f4e352c1700 1 -- 172.21.15.72:0/1412773518 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4e3014f150 con 0x7f4e3014f8b0 2023-07-25T14:36:47.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:47.004+0000 7f4e177fe700 1 -- 172.21.15.72:0/1412773518 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v35) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4e3014f150 con 0x7f4e3014f8b0 2023-07-25T14:36:47.016 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 1 2023-07-25T14:36:47.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:47.005+0000 7f4e352c1700 1 -- 172.21.15.72:0/1412773518 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f4e1c06ace0 msgr2=0x7f4e1c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:47.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:47.005+0000 7f4e352c1700 1 --2- 172.21.15.72:0/1412773518 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f4e1c06ace0 0x7f4e1c06d1a0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f4e200010e0 tx=0x7f4e20009040 comp rx=0 tx=0).stop 2023-07-25T14:36:47.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:47.005+0000 7f4e352c1700 1 -- 172.21.15.72:0/1412773518 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4e3014f8b0 msgr2=0x7f4e301e0e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:47.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:47.005+0000 7f4e352c1700 1 --2- 172.21.15.72:0/1412773518 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4e3014f8b0 0x7f4e301e0e90 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f4e1800bba0 tx=0x7f4e28009750 comp rx=0 tx=0).stop 2023-07-25T14:36:47.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:47.005+0000 7f4e352c1700 1 -- 172.21.15.72:0/1412773518 shutdown_connections 2023-07-25T14:36:47.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:47.005+0000 7f4e352c1700 1 --2- 172.21.15.72:0/1412773518 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f4e1c06ace0 0x7f4e1c06d1a0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:47.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:47.005+0000 7f4e352c1700 1 --2- 172.21.15.72:0/1412773518 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4e300c8d40 0x7f4e301ea0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:47.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:47.005+0000 7f4e352c1700 1 --2- 172.21.15.72:0/1412773518 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4e3014f8b0 0x7f4e301e0e90 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:47.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:47.005+0000 7f4e352c1700 1 --2- 172.21.15.72:0/1412773518 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4e3014f430 0x7f4e301e0950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:47.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:47.005+0000 7f4e352c1700 1 -- 172.21.15.72:0/1412773518 >> 172.21.15.72:0/1412773518 conn(0x7f4e3006c3a0 msgr2=0x7f4e3006c780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:47.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:47.006+0000 7f4e352c1700 1 -- 172.21.15.72:0/1412773518 shutdown_connections 2023-07-25T14:36:47.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:47.006+0000 7f4e352c1700 1 -- 172.21.15.72:0/1412773518 wait complete. 2023-07-25T14:36:47.029 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-07-25T14:36:47.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:47.136+0000 7f43c96f9700 1 Processor -- start 2023-07-25T14:36:47.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:47.136+0000 7f43c96f9700 1 -- start start 2023-07-25T14:36:47.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:47.137+0000 7f43c96f9700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f43c4151a90 0x7f43c4154d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:47.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:47.137+0000 7f43c96f9700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f43c40c44d0 0x7f43c40c4960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:47.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:47.137+0000 7f43c96f9700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43c40bfeb0 con 0x7f43c40bead0 2023-07-25T14:36:47.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:47.137+0000 7f43c96f9700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43c40c10b0 con 0x7f43c40c44d0 2023-07-25T14:36:47.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:47.137+0000 7f43c96f9700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43c40c1940 con 0x7f43c4151a90 2023-07-25T14:36:47.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:47.137+0000 7f43c37fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f43c40c44d0 0x7f43c40c4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:47.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:47.137+0000 7f43c37fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f43c40c44d0 0x7f43c40c4960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41860/0 (socket says 172.21.15.72:41860) 2023-07-25T14:36:47.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:47.137+0000 7f43c37fe700 1 -- 172.21.15.72:0/3861871996 learned_addr learned my addr 172.21.15.72:0/3861871996 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:47.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:47.137+0000 7f43c2ffd700 1 --2- 172.21.15.72:0/3861871996 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f43c4151a90 0x7f43c4154d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:47.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:47.137+0000 7f43c37fe700 1 -- 172.21.15.72:0/3861871996 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f43c4151a90 msgr2=0x7f43c4154d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:47.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:47.137+0000 7f43c37fe700 1 --2- 172.21.15.72:0/3861871996 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f43c4151a90 0x7f43c4154d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:47.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:47.137+0000 7f43c37fe700 1 -- 172.21.15.72:0/3861871996 >> v1:172.21.15.92:6789/0 conn(0x7f43c40bead0 legacy=0x7f43c40c0350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:47.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:47.137+0000 7f43c37fe700 1 -- 172.21.15.72:0/3861871996 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43c40bf2e0 con 0x7f43c40c44d0 2023-07-25T14:36:47.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:47.137+0000 7f43c37fe700 1 --2- 172.21.15.72:0/3861871996 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f43c40c44d0 0x7f43c40c4960 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f43bc009e50 tx=0x7f43bc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1b4437c9ca8018d server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:47.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:47.138+0000 7f43c1ffb700 1 -- 172.21.15.72:0/3861871996 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43bc00e070 con 0x7f43c40c44d0 2023-07-25T14:36:47.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:47.138+0000 7f43c1ffb700 1 -- 172.21.15.72:0/3861871996 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43bc00b9c0 con 0x7f43c40c44d0 2023-07-25T14:36:47.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:47.138+0000 7f43c1ffb700 1 -- 172.21.15.72:0/3861871996 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43bc00bd70 con 0x7f43c40c44d0 2023-07-25T14:36:47.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:47.138+0000 7f43c96f9700 1 -- 172.21.15.72:0/3861871996 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f43c40c44d0 msgr2=0x7f43c40c4960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:47.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:47.138+0000 7f43c96f9700 1 --2- 172.21.15.72:0/3861871996 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f43c40c44d0 0x7f43c40c4960 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f43bc009e50 tx=0x7f43bc00b330 comp rx=0 tx=0).stop 2023-07-25T14:36:47.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:47.138+0000 7f43c96f9700 1 -- 172.21.15.72:0/3861871996 shutdown_connections 2023-07-25T14:36:47.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:47.138+0000 7f43c96f9700 1 --2- 172.21.15.72:0/3861871996 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f43c40c44d0 0x7f43c40c4960 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:47.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:47.138+0000 7f43c96f9700 1 --2- 172.21.15.72:0/3861871996 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f43c4151a90 0x7f43c4154d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:47.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:47.138+0000 7f43c96f9700 1 -- 172.21.15.72:0/3861871996 >> 172.21.15.72:0/3861871996 conn(0x7f43c406c3a0 msgr2=0x7f43c406c780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:47.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:47.138+0000 7f43c96f9700 1 -- 172.21.15.72:0/3861871996 shutdown_connections 2023-07-25T14:36:47.154 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:47.138+0000 7f43c96f9700 1 -- 172.21.15.72:0/3861871996 wait complete. 2023-07-25T14:36:47.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:47.139+0000 7f43c96f9700 1 Processor -- start 2023-07-25T14:36:47.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:47.139+0000 7f43c96f9700 1 -- start start 2023-07-25T14:36:47.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:47.140+0000 7f43c96f9700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f43c40bead0 0x7f43c40ca190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:47.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:47.140+0000 7f43c96f9700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f43c40c44d0 0x7f43c4156220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:47.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:47.140+0000 7f43c96f9700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f43c4151a90 0x7f43c4156760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:47.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:47.140+0000 7f43c96f9700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43c40c7950 con 0x7f43c4151a90 2023-07-25T14:36:47.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:47.140+0000 7f43c96f9700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43c41eaef0 con 0x7f43c40bead0 2023-07-25T14:36:47.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:47.140+0000 7f43c96f9700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43c4157110 con 0x7f43c40c44d0 2023-07-25T14:36:47.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:47.140+0000 7f43c37fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f43c4151a90 0x7f43c4156760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:47.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:47.140+0000 7f43c37fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f43c4151a90 0x7f43c4156760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41866/0 (socket says 172.21.15.72:41866) 2023-07-25T14:36:47.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:47.140+0000 7f43c37fe700 1 -- 172.21.15.72:0/3701984608 learned_addr learned my addr 172.21.15.72:0/3701984608 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:47.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:47.140+0000 7f43c2ffd700 1 --2- 172.21.15.72:0/3701984608 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f43c40bead0 0x7f43c40ca190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:47.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:47.140+0000 7f43c27fc700 1 --2- 172.21.15.72:0/3701984608 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f43c40c44d0 0x7f43c4156220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:47.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:47.140+0000 7f43c37fe700 1 -- 172.21.15.72:0/3701984608 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f43c40c44d0 msgr2=0x7f43c4156220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:47.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:47.140+0000 7f43c37fe700 1 --2- 172.21.15.72:0/3701984608 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f43c40c44d0 0x7f43c4156220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:47.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:47.140+0000 7f43c37fe700 1 -- 172.21.15.72:0/3701984608 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f43c40bead0 msgr2=0x7f43c40ca190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:47.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:47.140+0000 7f43c37fe700 1 --2- 172.21.15.72:0/3701984608 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f43c40bead0 0x7f43c40ca190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:47.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:47.140+0000 7f43c37fe700 1 -- 172.21.15.72:0/3701984608 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43bc009b30 con 0x7f43c4151a90 2023-07-25T14:36:47.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:47.141+0000 7f43c2ffd700 1 --2- 172.21.15.72:0/3701984608 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f43c40bead0 0x7f43c40ca190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-25T14:36:47.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:47.141+0000 7f43c37fe700 1 --2- 172.21.15.72:0/3701984608 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f43c4151a90 0x7f43c4156760 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f43c406d1b0 tx=0x7f43bc004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:47.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:47.141+0000 7f43ab7fe700 1 -- 172.21.15.72:0/3701984608 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43bc0046e0 con 0x7f43c4151a90 2023-07-25T14:36:47.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:47.141+0000 7f43ab7fe700 1 -- 172.21.15.72:0/3701984608 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43bc004840 con 0x7f43c4151a90 2023-07-25T14:36:47.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:47.141+0000 7f43c96f9700 1 -- 172.21.15.72:0/3701984608 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43c41573f0 con 0x7f43c4151a90 2023-07-25T14:36:47.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:47.141+0000 7f43ab7fe700 1 -- 172.21.15.72:0/3701984608 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43bc01c680 con 0x7f43c4151a90 2023-07-25T14:36:47.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:47.141+0000 7f43c96f9700 1 -- 172.21.15.72:0/3701984608 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43c4155d00 con 0x7f43c4151a90 2023-07-25T14:36:47.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:47.142+0000 7f43c96f9700 1 -- 172.21.15.72:0/3701984608 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43c4155f20 con 0x7f43c4151a90 2023-07-25T14:36:47.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:47.142+0000 7f43ab7fe700 1 -- 172.21.15.72:0/3701984608 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f43bc01c7e0 con 0x7f43c4151a90 2023-07-25T14:36:47.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:47.142+0000 7f43ab7fe700 1 --2- 172.21.15.72:0/3701984608 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f43b006ace0 0x7f43b006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:47.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:47.143+0000 7f43ab7fe700 1 -- 172.21.15.72:0/3701984608 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f43bc08ae50 con 0x7f43c4151a90 2023-07-25T14:36:47.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:47.143+0000 7f43c2ffd700 1 --2- 172.21.15.72:0/3701984608 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f43b006ace0 0x7f43b006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:47.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:47.143+0000 7f43c2ffd700 1 --2- 172.21.15.72:0/3701984608 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f43b006ace0 0x7f43b006d1a0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f43c4147400 tx=0x7f43b8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:47.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:47.147+0000 7f43ab7fe700 1 -- 172.21.15.72:0/3701984608 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f43bc056120 con 0x7f43c4151a90 2023-07-25T14:36:47.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:47.338+0000 7f43c96f9700 1 -- 172.21.15.72:0/3701984608 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f43c404e470 con 0x7f43c4151a90 2023-07-25T14:36:47.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:47.338+0000 7f43ab7fe700 1 -- 172.21.15.72:0/3701984608 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v35) v1 ==== 84+0+126 (secure 0 0 0) 0x7f43bc059740 con 0x7f43c4151a90 2023-07-25T14:36:47.351 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-25T14:36:47.351 INFO:teuthology.orchestra.run.smithi072.stdout:[ 2023-07-25T14:36:47.351 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-07-25T14:36:47.351 INFO:teuthology.orchestra.run.smithi072.stdout: "poolnum": 1, 2023-07-25T14:36:47.351 INFO:teuthology.orchestra.run.smithi072.stdout: "poolname": "rbd" 2023-07-25T14:36:47.351 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-07-25T14:36:47.351 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-07-25T14:36:47.352 INFO:teuthology.orchestra.run.smithi072.stdout: "poolnum": 2, 2023-07-25T14:36:47.352 INFO:teuthology.orchestra.run.smithi072.stdout: "poolname": ".mgr" 2023-07-25T14:36:47.352 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-07-25T14:36:47.352 INFO:teuthology.orchestra.run.smithi072.stdout:] 2023-07-25T14:36:47.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:47.340+0000 7f43c96f9700 1 -- 172.21.15.72:0/3701984608 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f43b006ace0 msgr2=0x7f43b006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:47.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:47.340+0000 7f43c96f9700 1 --2- 172.21.15.72:0/3701984608 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f43b006ace0 0x7f43b006d1a0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f43c4147400 tx=0x7f43b8008040 comp rx=0 tx=0).stop 2023-07-25T14:36:47.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:47.340+0000 7f43c96f9700 1 -- 172.21.15.72:0/3701984608 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f43c4151a90 msgr2=0x7f43c4156760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:47.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:47.340+0000 7f43c96f9700 1 --2- 172.21.15.72:0/3701984608 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f43c4151a90 0x7f43c4156760 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f43c406d1b0 tx=0x7f43bc004ad0 comp rx=0 tx=0).stop 2023-07-25T14:36:47.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:47.340+0000 7f43c96f9700 1 -- 172.21.15.72:0/3701984608 shutdown_connections 2023-07-25T14:36:47.354 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:47.340+0000 7f43c96f9700 1 --2- 172.21.15.72:0/3701984608 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f43b006ace0 0x7f43b006d1a0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:47.354 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:47.340+0000 7f43c96f9700 1 --2- 172.21.15.72:0/3701984608 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f43c4151a90 0x7f43c4156760 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:47.354 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:47.340+0000 7f43c96f9700 1 --2- 172.21.15.72:0/3701984608 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f43c40bead0 0x7f43c40ca190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:47.354 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:47.340+0000 7f43c96f9700 1 --2- 172.21.15.72:0/3701984608 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f43c40c44d0 0x7f43c4156220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:47.354 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:47.340+0000 7f43c96f9700 1 -- 172.21.15.72:0/3701984608 >> 172.21.15.72:0/3701984608 conn(0x7f43c406c3a0 msgr2=0x7f43c41535b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:47.354 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:47.340+0000 7f43c96f9700 1 -- 172.21.15.72:0/3701984608 shutdown_connections 2023-07-25T14:36:47.354 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:47.341+0000 7f43c96f9700 1 -- 172.21.15.72:0/3701984608 wait complete. 2023-07-25T14:36:47.364 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-07-25T14:36:47.364 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-07-25T14:36:47.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:47.477+0000 7f4325d66700 1 Processor -- start 2023-07-25T14:36:47.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:47.477+0000 7f4325d66700 1 -- start start 2023-07-25T14:36:47.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:47.477+0000 7f4325d66700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f43200c09f0 0x7f4320157f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:47.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:47.477+0000 7f4325d66700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f432014e5e0 con 0x7f43200c02c0 2023-07-25T14:36:47.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:47.477+0000 7f4325d66700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4320154350 con 0x7f432014e200 2023-07-25T14:36:47.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:47.477+0000 7f4325d66700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4320154fd0 con 0x7f43200c09f0 2023-07-25T14:36:47.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:47.477+0000 7f431effd700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f43200c02c0 0x7f4320157880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:60840/0 (socket says 172.21.15.72:60840) 2023-07-25T14:36:47.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:47.477+0000 7f431effd700 1 -- 172.21.15.72:0/424999034 learned_addr learned my addr 172.21.15.72:0/424999034 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:36:47.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:47.478+0000 7f431e7fc700 1 -- 172.21.15.72:0/424999034 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2099864778 0 0) 0x7f432014e5e0 con 0x7f43200c02c0 2023-07-25T14:36:47.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:47.478+0000 7f431ffff700 1 --2- 172.21.15.72:0/424999034 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f43200c09f0 0x7f4320157f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:47.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:47.478+0000 7f431e7fc700 1 -- 172.21.15.72:0/424999034 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f43080035b0 con 0x7f43200c02c0 2023-07-25T14:36:47.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:47.478+0000 7f431e7fc700 1 -- 172.21.15.72:0/424999034 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1769129740 0 0) 0x7f43080035b0 con 0x7f43200c02c0 2023-07-25T14:36:47.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:47.478+0000 7f431e7fc700 1 -- 172.21.15.72:0/424999034 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f43200c09f0 msgr2=0x7f4320157f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:47.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:47.478+0000 7f431e7fc700 1 --2- 172.21.15.72:0/424999034 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f43200c09f0 0x7f4320157f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:47.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:47.478+0000 7f431e7fc700 1 -- 172.21.15.72:0/424999034 >> v1:172.21.15.92:6789/0 conn(0x7f432014e200 legacy=0x7f432006a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:47.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:47.478+0000 7f431e7fc700 1 -- 172.21.15.72:0/424999034 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4320154630 con 0x7f43200c02c0 2023-07-25T14:36:47.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:47.478+0000 7f431e7fc700 1 -- 172.21.15.72:0/424999034 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2559588315 0 0) 0x7f4310001670 con 0x7f43200c02c0 2023-07-25T14:36:47.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:47.478+0000 7f431e7fc700 1 -- 172.21.15.72:0/424999034 >> v1:172.21.15.72:6789/0 conn(0x7f43200c02c0 legacy=0x7f4320157880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:47.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:47.478+0000 7f431e7fc700 1 --2- 172.21.15.72:0/424999034 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4308003a30 0x7f4308003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:47.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:47.478+0000 7f431e7fc700 1 --2- 172.21.15.72:0/424999034 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4308004850 0x7f4308004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:47.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:47.478+0000 7f431e7fc700 1 --2- 172.21.15.72:0/424999034 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f43200c09f0 0x7f4308005250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:47.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:47.478+0000 7f431e7fc700 1 -- 172.21.15.72:0/424999034 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4320154fd0 con 0x7f4308003a30 2023-07-25T14:36:47.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:47.478+0000 7f431e7fc700 1 -- 172.21.15.72:0/424999034 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f430800bb40 con 0x7f4308004850 2023-07-25T14:36:47.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:47.478+0000 7f431e7fc700 1 -- 172.21.15.72:0/424999034 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f430800bd00 con 0x7f43200c09f0 2023-07-25T14:36:47.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:47.478+0000 7f431f7fe700 1 --2- 172.21.15.72:0/424999034 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4308003a30 0x7f4308003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:47.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:47.478+0000 7f431effd700 1 --2- 172.21.15.72:0/424999034 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4308004850 0x7f4308004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:47.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:47.478+0000 7f431ffff700 1 --2- 172.21.15.72:0/424999034 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f43200c09f0 0x7f4308005250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:47.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:47.478+0000 7f431f7fe700 1 -- 172.21.15.72:0/424999034 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f43200c09f0 msgr2=0x7f4308005250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:47.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:47.478+0000 7f431f7fe700 1 --2- 172.21.15.72:0/424999034 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f43200c09f0 0x7f4308005250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:47.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:47.478+0000 7f431f7fe700 1 -- 172.21.15.72:0/424999034 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4308004850 msgr2=0x7f4308004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:47.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:47.478+0000 7f431f7fe700 1 --2- 172.21.15.72:0/424999034 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4308004850 0x7f4308004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:47.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:47.478+0000 7f431f7fe700 1 -- 172.21.15.72:0/424999034 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43080035b0 con 0x7f4308003a30 2023-07-25T14:36:47.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:47.478+0000 7f431effd700 1 --2- 172.21.15.72:0/424999034 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4308004850 0x7f4308004cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-25T14:36:47.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:47.479+0000 7f431f7fe700 1 --2- 172.21.15.72:0/424999034 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4308003a30 0x7f4308003e10 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f43140018d0 tx=0x7f4308005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a825254f1cd6ef80 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:47.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:47.479+0000 7f431e7fc700 1 -- 172.21.15.72:0/424999034 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f431400c690 con 0x7f4308003a30 2023-07-25T14:36:47.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:47.479+0000 7f431e7fc700 1 -- 172.21.15.72:0/424999034 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f431400c810 con 0x7f4308003a30 2023-07-25T14:36:47.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:47.479+0000 7f431e7fc700 1 -- 172.21.15.72:0/424999034 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f431400cbc0 con 0x7f4308003a30 2023-07-25T14:36:47.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:47.479+0000 7f4325d66700 1 -- 172.21.15.72:0/424999034 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4308003a30 msgr2=0x7f4308003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:47.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:47.479+0000 7f4325d66700 1 --2- 172.21.15.72:0/424999034 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4308003a30 0x7f4308003e10 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f43140018d0 tx=0x7f4308005880 comp rx=0 tx=0).stop 2023-07-25T14:36:47.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:47.479+0000 7f431ffff700 1 -- 172.21.15.72:0/424999034 reap_dead start 2023-07-25T14:36:47.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:47.479+0000 7f4325d66700 1 -- 172.21.15.72:0/424999034 shutdown_connections 2023-07-25T14:36:47.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:47.479+0000 7f4325d66700 1 -- 172.21.15.72:0/424999034 >> 172.21.15.72:0/424999034 conn(0x7f432006bbc0 msgr2=0x7f43200a8590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:47.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:47.479+0000 7f4325d66700 1 -- 172.21.15.72:0/424999034 shutdown_connections 2023-07-25T14:36:47.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:47.479+0000 7f4325d66700 1 -- 172.21.15.72:0/424999034 wait complete. 2023-07-25T14:36:47.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:47.480+0000 7f4325d66700 1 Processor -- start 2023-07-25T14:36:47.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:47.481+0000 7f4325d66700 1 -- start start 2023-07-25T14:36:47.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:47.481+0000 7f4325d66700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4308003a30 0x7f4320149b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:47.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:47.481+0000 7f4325d66700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f43201ea140 0x7f432014a040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:47.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:47.481+0000 7f4325d66700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f43200c3760 0x7f43200c3c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:47.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:47.481+0000 7f4325d66700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43200c1ff0 con 0x7f4308003a30 2023-07-25T14:36:47.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:47.481+0000 7f4325d66700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43200c30d0 con 0x7f43200c3760 2023-07-25T14:36:47.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:47.481+0000 7f4325d66700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43200c4150 con 0x7f43201ea140 2023-07-25T14:36:47.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:47.481+0000 7f431f7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4308003a30 0x7f4320149b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:47.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:47.481+0000 7f431f7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4308003a30 0x7f4320149b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41882/0 (socket says 172.21.15.72:41882) 2023-07-25T14:36:47.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:47.481+0000 7f431f7fe700 1 -- 172.21.15.72:0/3236123084 learned_addr learned my addr 172.21.15.72:0/3236123084 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:47.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:47.481+0000 7f431effd700 1 --2- 172.21.15.72:0/3236123084 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f43201ea140 0x7f432014a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:47.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:47.481+0000 7f431ffff700 1 --2- 172.21.15.72:0/3236123084 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f43200c3760 0x7f43200c3c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:47.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:47.482+0000 7f431f7fe700 1 -- 172.21.15.72:0/3236123084 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f43201ea140 msgr2=0x7f432014a040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:47.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:47.482+0000 7f431f7fe700 1 --2- 172.21.15.72:0/3236123084 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f43201ea140 0x7f432014a040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:47.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:47.482+0000 7f431f7fe700 1 -- 172.21.15.72:0/3236123084 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f43200c3760 msgr2=0x7f43200c3c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:47.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:47.482+0000 7f431f7fe700 1 --2- 172.21.15.72:0/3236123084 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f43200c3760 0x7f43200c3c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:47.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:47.482+0000 7f431f7fe700 1 -- 172.21.15.72:0/3236123084 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43200c1a70 con 0x7f4308003a30 2023-07-25T14:36:47.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:47.482+0000 7f431f7fe700 1 --2- 172.21.15.72:0/3236123084 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4308003a30 0x7f4320149b00 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f430800bb10 tx=0x7f4314001230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:47.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:47.482+0000 7f4307fff700 1 -- 172.21.15.72:0/3236123084 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4314001330 con 0x7f4308003a30 2023-07-25T14:36:47.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:47.482+0000 7f4307fff700 1 -- 172.21.15.72:0/3236123084 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4314021070 con 0x7f4308003a30 2023-07-25T14:36:47.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:47.482+0000 7f4307fff700 1 -- 172.21.15.72:0/3236123084 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f431400cb80 con 0x7f4308003a30 2023-07-25T14:36:47.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:47.482+0000 7f4325d66700 1 -- 172.21.15.72:0/3236123084 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43200c1d10 con 0x7f4308003a30 2023-07-25T14:36:47.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:47.482+0000 7f4325d66700 1 -- 172.21.15.72:0/3236123084 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43201ea5e0 con 0x7f4308003a30 2023-07-25T14:36:47.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:47.483+0000 7f4325d66700 1 -- 172.21.15.72:0/3236123084 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4320152020 con 0x7f4308003a30 2023-07-25T14:36:47.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:47.483+0000 7f4307fff700 1 -- 172.21.15.72:0/3236123084 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4314023030 con 0x7f4308003a30 2023-07-25T14:36:47.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:47.484+0000 7f4307fff700 1 --2- 172.21.15.72:0/3236123084 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f430c06ace0 0x7f430c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:47.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:47.484+0000 7f431effd700 1 --2- 172.21.15.72:0/3236123084 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f430c06ace0 0x7f430c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:47.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:47.484+0000 7f4307fff700 1 -- 172.21.15.72:0/3236123084 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f431408a4b0 con 0x7f4308003a30 2023-07-25T14:36:47.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:47.484+0000 7f431effd700 1 --2- 172.21.15.72:0/3236123084 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f430c06ace0 0x7f430c06d1a0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f432006f2d0 tx=0x7f4310007040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:47.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:47.488+0000 7f4307fff700 1 -- 172.21.15.72:0/3236123084 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f4320152020 con 0x7f4308003a30 2023-07-25T14:36:47.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:47.675+0000 7f4325d66700 1 -- 172.21.15.72:0/3236123084 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f4320152020 con 0x7f4308003a30 2023-07-25T14:36:48.180 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:48.168+0000 7f4307fff700 1 -- 172.21.15.72:0/3236123084 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v36) v1 ==== 138+0+0 (secure 0 0 0) 0x7f4320152020 con 0x7f4308003a30 2023-07-25T14:36:48.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:48.172+0000 7f4325d66700 1 -- 172.21.15.72:0/3236123084 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f430c06ace0 msgr2=0x7f430c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:48.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:48.172+0000 7f4325d66700 1 --2- 172.21.15.72:0/3236123084 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f430c06ace0 0x7f430c06d1a0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f432006f2d0 tx=0x7f4310007040 comp rx=0 tx=0).stop 2023-07-25T14:36:48.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:48.172+0000 7f4325d66700 1 -- 172.21.15.72:0/3236123084 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4308003a30 msgr2=0x7f4320149b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:48.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:48.172+0000 7f4325d66700 1 --2- 172.21.15.72:0/3236123084 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4308003a30 0x7f4320149b00 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f430800bb10 tx=0x7f4314001230 comp rx=0 tx=0).stop 2023-07-25T14:36:48.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:48.172+0000 7f4325d66700 1 -- 172.21.15.72:0/3236123084 shutdown_connections 2023-07-25T14:36:48.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:48.172+0000 7f4325d66700 1 --2- 172.21.15.72:0/3236123084 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f430c06ace0 0x7f430c06d1a0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:48.184 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:48.172+0000 7f4325d66700 1 --2- 172.21.15.72:0/3236123084 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f43200c3760 0x7f43200c3c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:48.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:48.172+0000 7f4325d66700 1 --2- 172.21.15.72:0/3236123084 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4308003a30 0x7f4320149b00 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:48.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:48.172+0000 7f4325d66700 1 --2- 172.21.15.72:0/3236123084 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f43201ea140 0x7f432014a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:48.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:48.172+0000 7f4325d66700 1 -- 172.21.15.72:0/3236123084 >> 172.21.15.72:0/3236123084 conn(0x7f432006bbc0 msgr2=0x7f4320071700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:48.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:48.172+0000 7f4325d66700 1 -- 172.21.15.72:0/3236123084 shutdown_connections 2023-07-25T14:36:48.185 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:48.173+0000 7f4325d66700 1 -- 172.21.15.72:0/3236123084 wait complete. 2023-07-25T14:36:48.187 INFO:teuthology.orchestra.run.smithi072.stderr:pool 'cephfs_metadata' created 2023-07-25T14:36:48.199 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-07-25T14:36:48.327 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:48.315+0000 7f5de185d700 1 Processor -- start 2023-07-25T14:36:48.327 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:48.315+0000 7f5de185d700 1 -- start start 2023-07-25T14:36:48.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:48.316+0000 7f5de185d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f5ddc151a90 0x7f5ddc154d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:48.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:48.316+0000 7f5de185d700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5ddc0bead0 0x7f5ddc0c0350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:48.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:48.316+0000 7f5de185d700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f5ddc0c0890 0x7f5ddc0c44d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:48.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:48.316+0000 7f5de185d700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ddc0c10b0 con 0x7f5ddc151a90 2023-07-25T14:36:48.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:48.316+0000 7f5de185d700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ddc0c1940 con 0x7f5ddc0c0890 2023-07-25T14:36:48.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:48.316+0000 7f5de185d700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ddc0bfeb0 con 0x7f5ddc0bead0 2023-07-25T14:36:48.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:48.316+0000 7f5ddaffd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f5ddc151a90 0x7f5ddc154d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:48.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:48.316+0000 7f5ddaffd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f5ddc151a90 0x7f5ddc154d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41890/0 (socket says 172.21.15.72:41890) 2023-07-25T14:36:48.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:48.316+0000 7f5ddaffd700 1 -- 172.21.15.72:0/3966887504 learned_addr learned my addr 172.21.15.72:0/3966887504 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:48.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:48.316+0000 7f5ddb7fe700 1 --2- 172.21.15.72:0/3966887504 >> v2:172.21.15.92:3300/0 conn(0x7f5ddc0c0890 0x7f5ddc0c44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:48.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:48.316+0000 7f5dda7fc700 1 --2- 172.21.15.72:0/3966887504 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5ddc0bead0 0x7f5ddc0c0350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:48.331 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:48.316+0000 7f5ddaffd700 1 -- 172.21.15.72:0/3966887504 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5ddc0bead0 msgr2=0x7f5ddc0c0350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:48.331 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:48.316+0000 7f5ddaffd700 1 --2- 172.21.15.72:0/3966887504 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5ddc0bead0 0x7f5ddc0c0350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:48.331 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:48.317+0000 7f5ddaffd700 1 -- 172.21.15.72:0/3966887504 >> v2:172.21.15.92:3300/0 conn(0x7f5ddc0c0890 msgr2=0x7f5ddc0c44d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:48.331 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:48.317+0000 7f5ddaffd700 1 --2- 172.21.15.72:0/3966887504 >> v2:172.21.15.92:3300/0 conn(0x7f5ddc0c0890 0x7f5ddc0c44d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:48.331 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:48.317+0000 7f5ddaffd700 1 -- 172.21.15.72:0/3966887504 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ddc0bf2e0 con 0x7f5ddc151a90 2023-07-25T14:36:48.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:48.317+0000 7f5ddb7fe700 1 --2- 172.21.15.72:0/3966887504 >> v2:172.21.15.92:3300/0 conn(0x7f5ddc0c0890 0x7f5ddc0c44d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-25T14:36:48.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:48.317+0000 7f5ddaffd700 1 --2- 172.21.15.72:0/3966887504 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5ddc151a90 0x7f5ddc154d10 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f5ddc06b490 tx=0x7f5dd0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a1f7df4aa902add server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:48.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:48.317+0000 7f5dd9ffb700 1 -- 172.21.15.72:0/3966887504 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dd000b870 con 0x7f5ddc151a90 2023-07-25T14:36:48.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:48.317+0000 7f5dd9ffb700 1 -- 172.21.15.72:0/3966887504 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5dd000b9d0 con 0x7f5ddc151a90 2023-07-25T14:36:48.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:48.317+0000 7f5dd9ffb700 1 -- 172.21.15.72:0/3966887504 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dd000bd60 con 0x7f5ddc151a90 2023-07-25T14:36:48.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:48.317+0000 7f5de185d700 1 -- 172.21.15.72:0/3966887504 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5ddc151a90 msgr2=0x7f5ddc154d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:48.332 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:48.317+0000 7f5de185d700 1 --2- 172.21.15.72:0/3966887504 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5ddc151a90 0x7f5ddc154d10 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f5ddc06b490 tx=0x7f5dd0009bd0 comp rx=0 tx=0).stop 2023-07-25T14:36:48.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:48.317+0000 7f5de185d700 1 -- 172.21.15.72:0/3966887504 shutdown_connections 2023-07-25T14:36:48.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:48.317+0000 7f5de185d700 1 --2- 172.21.15.72:0/3966887504 >> v2:172.21.15.92:3300/0 conn(0x7f5ddc0c0890 0x7f5ddc0c44d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:48.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:48.317+0000 7f5de185d700 1 --2- 172.21.15.72:0/3966887504 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5ddc151a90 0x7f5ddc154d10 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:48.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:48.317+0000 7f5de185d700 1 --2- 172.21.15.72:0/3966887504 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5ddc0bead0 0x7f5ddc0c0350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:48.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:48.317+0000 7f5de185d700 1 -- 172.21.15.72:0/3966887504 >> 172.21.15.72:0/3966887504 conn(0x7f5ddc06c3a0 msgr2=0x7f5ddc06c780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:48.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:48.318+0000 7f5de185d700 1 -- 172.21.15.72:0/3966887504 shutdown_connections 2023-07-25T14:36:48.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:48.318+0000 7f5de185d700 1 -- 172.21.15.72:0/3966887504 wait complete. 2023-07-25T14:36:48.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:48.319+0000 7f5de185d700 1 Processor -- start 2023-07-25T14:36:48.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:48.319+0000 7f5de185d700 1 -- start start 2023-07-25T14:36:48.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:48.320+0000 7f5de185d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5ddc0bead0 0x7f5ddc1ed4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:48.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:48.320+0000 7f5de185d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5ddc0c0890 0x7f5ddc153910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:48.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:48.320+0000 7f5de185d700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5ddc151a90 0x7f5ddc14a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:48.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:48.320+0000 7f5de185d700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ddc0c4bf0 con 0x7f5ddc0c0890 2023-07-25T14:36:48.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:48.320+0000 7f5de185d700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ddc1ed9f0 con 0x7f5ddc0bead0 2023-07-25T14:36:48.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:48.320+0000 7f5de185d700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ddc0ca960 con 0x7f5ddc151a90 2023-07-25T14:36:48.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:48.320+0000 7f5dda7fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5ddc0c0890 0x7f5ddc153910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:48.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:48.320+0000 7f5dda7fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5ddc0c0890 0x7f5ddc153910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41898/0 (socket says 172.21.15.72:41898) 2023-07-25T14:36:48.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:48.320+0000 7f5dda7fc700 1 -- 172.21.15.72:0/654027308 learned_addr learned my addr 172.21.15.72:0/654027308 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:48.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:48.320+0000 7f5ddaffd700 1 --2- 172.21.15.72:0/654027308 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5ddc0bead0 0x7f5ddc1ed4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:48.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:48.320+0000 7f5ddb7fe700 1 --2- 172.21.15.72:0/654027308 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5ddc151a90 0x7f5ddc14a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:48.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:48.320+0000 7f5dda7fc700 1 -- 172.21.15.72:0/654027308 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5ddc151a90 msgr2=0x7f5ddc14a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:48.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:48.320+0000 7f5dda7fc700 1 --2- 172.21.15.72:0/654027308 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5ddc151a90 0x7f5ddc14a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:48.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:48.320+0000 7f5dda7fc700 1 -- 172.21.15.72:0/654027308 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5ddc0bead0 msgr2=0x7f5ddc1ed4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:48.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:48.320+0000 7f5dda7fc700 1 --2- 172.21.15.72:0/654027308 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5ddc0bead0 0x7f5ddc1ed4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:48.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:48.320+0000 7f5dda7fc700 1 -- 172.21.15.72:0/654027308 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dd0009550 con 0x7f5ddc0c0890 2023-07-25T14:36:48.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:48.320+0000 7f5ddaffd700 1 --2- 172.21.15.72:0/654027308 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5ddc0bead0 0x7f5ddc1ed4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-25T14:36:48.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:48.320+0000 7f5ddb7fe700 1 --2- 172.21.15.72:0/654027308 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5ddc151a90 0x7f5ddc14a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-25T14:36:48.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:48.321+0000 7f5dda7fc700 1 --2- 172.21.15.72:0/654027308 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5ddc0c0890 0x7f5ddc153910 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f5dcc00c7f0 tx=0x7f5dcc00cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:48.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:48.321+0000 7f5dc3fff700 1 -- 172.21.15.72:0/654027308 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dcc011800 con 0x7f5ddc0c0890 2023-07-25T14:36:48.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:48.321+0000 7f5dc3fff700 1 -- 172.21.15.72:0/654027308 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5dcc011960 con 0x7f5ddc0c0890 2023-07-25T14:36:48.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:48.321+0000 7f5de185d700 1 -- 172.21.15.72:0/654027308 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ddc0ca680 con 0x7f5ddc0c0890 2023-07-25T14:36:48.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:48.321+0000 7f5dc3fff700 1 -- 172.21.15.72:0/654027308 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dcc011d10 con 0x7f5ddc0c0890 2023-07-25T14:36:48.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:48.321+0000 7f5de185d700 1 -- 172.21.15.72:0/654027308 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ddc1ead70 con 0x7f5ddc0c0890 2023-07-25T14:36:48.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:48.322+0000 7f5de185d700 1 -- 172.21.15.72:0/654027308 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ddc04e470 con 0x7f5ddc0c0890 2023-07-25T14:36:48.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:48.322+0000 7f5dc3fff700 1 -- 172.21.15.72:0/654027308 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5dcc018360 con 0x7f5ddc0c0890 2023-07-25T14:36:48.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:48.322+0000 7f5dc3fff700 1 --2- 172.21.15.72:0/654027308 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f5dc806ad10 0x7f5dc806d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:48.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:48.323+0000 7f5dc3fff700 1 -- 172.21.15.72:0/654027308 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5900+0+0 (secure 0 0 0) 0x7f5dcc088ea0 con 0x7f5ddc0c0890 2023-07-25T14:36:48.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:48.323+0000 7f5ddaffd700 1 --2- 172.21.15.72:0/654027308 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f5dc806ad10 0x7f5dc806d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:48.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:48.323+0000 7f5ddaffd700 1 --2- 172.21.15.72:0/654027308 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f5dc806ad10 0x7f5dc806d1d0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f5dd0009130 tx=0x7f5dd0008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:48.343 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:48.327+0000 7f5dc3fff700 1 -- 172.21.15.72:0/654027308 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f5dcc054080 con 0x7f5ddc0c0890 2023-07-25T14:36:48.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:48.517+0000 7f5de185d700 1 -- 172.21.15.72:0/654027308 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f5ddc0c5aa0 con 0x7f5ddc0c0890 2023-07-25T14:36:49.183 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:49.171+0000 7f5dc3fff700 1 -- 172.21.15.72:0/654027308 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v37) v1 ==== 170+0+0 (secure 0 0 0) 0x7f5dcc0576a0 con 0x7f5ddc0c0890 2023-07-25T14:36:49.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:49.177+0000 7f5de185d700 1 -- 172.21.15.72:0/654027308 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f5dc806ad10 msgr2=0x7f5dc806d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:49.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:49.177+0000 7f5de185d700 1 --2- 172.21.15.72:0/654027308 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f5dc806ad10 0x7f5dc806d1d0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f5dd0009130 tx=0x7f5dd0008030 comp rx=0 tx=0).stop 2023-07-25T14:36:49.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:49.177+0000 7f5de185d700 1 -- 172.21.15.72:0/654027308 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5ddc0c0890 msgr2=0x7f5ddc153910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:49.189 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:49.177+0000 7f5de185d700 1 --2- 172.21.15.72:0/654027308 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5ddc0c0890 0x7f5ddc153910 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f5dcc00c7f0 tx=0x7f5dcc00cbb0 comp rx=0 tx=0).stop 2023-07-25T14:36:49.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:49.177+0000 7f5de185d700 1 -- 172.21.15.72:0/654027308 shutdown_connections 2023-07-25T14:36:49.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:49.177+0000 7f5de185d700 1 --2- 172.21.15.72:0/654027308 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f5dc806ad10 0x7f5dc806d1d0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:49.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:49.177+0000 7f5de185d700 1 --2- 172.21.15.72:0/654027308 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5ddc151a90 0x7f5ddc14a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:49.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:49.177+0000 7f5de185d700 1 --2- 172.21.15.72:0/654027308 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5ddc0bead0 0x7f5ddc1ed4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:49.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:49.177+0000 7f5de185d700 1 --2- 172.21.15.72:0/654027308 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5ddc0c0890 0x7f5ddc153910 secure :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f5dcc00c7f0 tx=0x7f5dcc00cbb0 comp rx=0 tx=0).stop 2023-07-25T14:36:49.190 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:49.177+0000 7f5de185d700 1 -- 172.21.15.72:0/654027308 >> 172.21.15.72:0/654027308 conn(0x7f5ddc06c3a0 msgr2=0x7f5ddc0c4ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:49.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:49.178+0000 7f5de185d700 1 -- 172.21.15.72:0/654027308 shutdown_connections 2023-07-25T14:36:49.191 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:49.178+0000 7f5de185d700 1 -- 172.21.15.72:0/654027308 wait complete. 2023-07-25T14:36:49.193 INFO:teuthology.orchestra.run.smithi072.stderr:pool 'cephfs_data' created 2023-07-25T14:36:49.211 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-07-25T14:36:49.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:49.324+0000 7f78d75a5700 1 Processor -- start 2023-07-25T14:36:49.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:49.324+0000 7f78d75a5700 1 -- start start 2023-07-25T14:36:49.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:49.325+0000 7f78d75a5700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f78d00a9cc0 0x7f78d01525e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:49.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:49.325+0000 7f78d75a5700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f78d00bb0b0 0x7f78d0152b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:49.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:49.325+0000 7f78d75a5700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78d00c5890 con 0x7f78d014f810 2023-07-25T14:36:49.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:49.325+0000 7f78d75a5700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78d0152150 con 0x7f78d00bb0b0 2023-07-25T14:36:49.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:49.325+0000 7f78d75a5700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78d014fbf0 con 0x7f78d00a9cc0 2023-07-25T14:36:49.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:49.325+0000 7f78d5b42700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f78d00bb0b0 0x7f78d0152b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:49.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:49.325+0000 7f78d5b42700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f78d00bb0b0 0x7f78d0152b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41908/0 (socket says 172.21.15.72:41908) 2023-07-25T14:36:49.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:49.325+0000 7f78d5b42700 1 -- 172.21.15.72:0/3890543344 learned_addr learned my addr 172.21.15.72:0/3890543344 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:49.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:49.325+0000 7f78d4b40700 1 --2- 172.21.15.72:0/3890543344 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f78d00a9cc0 0x7f78d01525e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:49.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:49.325+0000 7f78d5b42700 1 -- 172.21.15.72:0/3890543344 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f78d00a9cc0 msgr2=0x7f78d01525e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:49.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:49.325+0000 7f78d5b42700 1 --2- 172.21.15.72:0/3890543344 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f78d00a9cc0 0x7f78d01525e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:49.339 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:49.325+0000 7f78d5b42700 1 -- 172.21.15.72:0/3890543344 >> v1:172.21.15.92:6789/0 conn(0x7f78d014f810 legacy=0x7f78d00c4370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:49.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:49.325+0000 7f78d5b42700 1 -- 172.21.15.72:0/3890543344 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78d01566a0 con 0x7f78d00bb0b0 2023-07-25T14:36:49.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:49.326+0000 7f78d5b42700 1 --2- 172.21.15.72:0/3890543344 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f78d00bb0b0 0x7f78d0152b20 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f78c8009e50 tx=0x7f78c800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d644aa8d1347cd7 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:49.340 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:49.326+0000 7f78c7fff700 1 -- 172.21.15.72:0/3890543344 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78c800e070 con 0x7f78d00bb0b0 2023-07-25T14:36:49.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:49.326+0000 7f78c7fff700 1 -- 172.21.15.72:0/3890543344 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78c800b9c0 con 0x7f78d00bb0b0 2023-07-25T14:36:49.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:49.326+0000 7f78c7fff700 1 -- 172.21.15.72:0/3890543344 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78c800bd70 con 0x7f78d00bb0b0 2023-07-25T14:36:49.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:49.326+0000 7f78d75a5700 1 -- 172.21.15.72:0/3890543344 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f78d00bb0b0 msgr2=0x7f78d0152b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:49.341 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:49.326+0000 7f78d75a5700 1 --2- 172.21.15.72:0/3890543344 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f78d00bb0b0 0x7f78d0152b20 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f78c8009e50 tx=0x7f78c800b330 comp rx=0 tx=0).stop 2023-07-25T14:36:49.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:49.326+0000 7f78d75a5700 1 -- 172.21.15.72:0/3890543344 shutdown_connections 2023-07-25T14:36:49.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:49.326+0000 7f78d75a5700 1 --2- 172.21.15.72:0/3890543344 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f78d00bb0b0 0x7f78d0152b20 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:49.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:49.326+0000 7f78d75a5700 1 --2- 172.21.15.72:0/3890543344 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f78d00a9cc0 0x7f78d01525e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:49.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:49.326+0000 7f78d75a5700 1 -- 172.21.15.72:0/3890543344 >> 172.21.15.72:0/3890543344 conn(0x7f78d006a8d0 msgr2=0x7f78d00a94e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:49.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:49.326+0000 7f78d75a5700 1 -- 172.21.15.72:0/3890543344 shutdown_connections 2023-07-25T14:36:49.342 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:49.326+0000 7f78d75a5700 1 -- 172.21.15.72:0/3890543344 wait complete. 2023-07-25T14:36:49.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:49.327+0000 7f78d75a5700 1 Processor -- start 2023-07-25T14:36:49.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:49.327+0000 7f78d75a5700 1 -- start start 2023-07-25T14:36:49.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:49.328+0000 7f78d75a5700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f78d00a9cc0 0x7f78d00bc8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:49.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:49.328+0000 7f78d75a5700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f78d00bb0b0 0x7f78d00bbea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:49.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:49.328+0000 7f78d75a5700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f78d014f810 0x7f78d0154a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:49.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:49.328+0000 7f78d75a5700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78d0149c10 con 0x7f78d00bb0b0 2023-07-25T14:36:49.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:49.328+0000 7f78d75a5700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78d01553b0 con 0x7f78d014f810 2023-07-25T14:36:49.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:49.328+0000 7f78d75a5700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78d014c0b0 con 0x7f78d00a9cc0 2023-07-25T14:36:49.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:49.328+0000 7f78d4b40700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f78d00bb0b0 0x7f78d00bbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:49.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:49.328+0000 7f78d4b40700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f78d00bb0b0 0x7f78d00bbea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41912/0 (socket says 172.21.15.72:41912) 2023-07-25T14:36:49.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:49.328+0000 7f78d4b40700 1 -- 172.21.15.72:0/4009731738 learned_addr learned my addr 172.21.15.72:0/4009731738 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:49.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:49.328+0000 7f78d5b42700 1 --2- 172.21.15.72:0/4009731738 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f78d014f810 0x7f78d0154a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:49.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:49.328+0000 7f78d5341700 1 --2- 172.21.15.72:0/4009731738 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f78d00a9cc0 0x7f78d00bc8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:49.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:49.328+0000 7f78d4b40700 1 -- 172.21.15.72:0/4009731738 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f78d00a9cc0 msgr2=0x7f78d00bc8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:49.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:49.328+0000 7f78d4b40700 1 --2- 172.21.15.72:0/4009731738 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f78d00a9cc0 0x7f78d00bc8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:49.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:49.328+0000 7f78d4b40700 1 -- 172.21.15.72:0/4009731738 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f78d014f810 msgr2=0x7f78d0154a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:49.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:49.328+0000 7f78d4b40700 1 --2- 172.21.15.72:0/4009731738 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f78d014f810 0x7f78d0154a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:49.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:49.328+0000 7f78d4b40700 1 -- 172.21.15.72:0/4009731738 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78c8009b30 con 0x7f78d00bb0b0 2023-07-25T14:36:49.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:49.328+0000 7f78d5341700 1 --2- 172.21.15.72:0/4009731738 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f78d00a9cc0 0x7f78d00bc8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-25T14:36:49.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:49.329+0000 7f78d4b40700 1 --2- 172.21.15.72:0/4009731738 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f78d00bb0b0 0x7f78d00bbea0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f78cc00d800 tx=0x7f78cc00db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:49.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:49.329+0000 7f78c5ffb700 1 -- 172.21.15.72:0/4009731738 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78cc0125f0 con 0x7f78d00bb0b0 2023-07-25T14:36:49.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:49.329+0000 7f78c5ffb700 1 -- 172.21.15.72:0/4009731738 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78cc012750 con 0x7f78d00bb0b0 2023-07-25T14:36:49.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:49.329+0000 7f78d75a5700 1 -- 172.21.15.72:0/4009731738 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78d01495c0 con 0x7f78d00bb0b0 2023-07-25T14:36:49.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:49.329+0000 7f78c5ffb700 1 -- 172.21.15.72:0/4009731738 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78cc012b00 con 0x7f78d00bb0b0 2023-07-25T14:36:49.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:49.329+0000 7f78d75a5700 1 -- 172.21.15.72:0/4009731738 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78d014c390 con 0x7f78d00bb0b0 2023-07-25T14:36:49.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:49.330+0000 7f78d75a5700 1 -- 172.21.15.72:0/4009731738 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78d0149d80 con 0x7f78d00bb0b0 2023-07-25T14:36:49.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:49.330+0000 7f78c5ffb700 1 -- 172.21.15.72:0/4009731738 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f78cc012c60 con 0x7f78d00bb0b0 2023-07-25T14:36:49.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:49.331+0000 7f78c5ffb700 1 --2- 172.21.15.72:0/4009731738 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f78b406ace0 0x7f78b406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:49.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:49.331+0000 7f78d5341700 1 --2- 172.21.15.72:0/4009731738 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f78b406ace0 0x7f78b406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:49.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:49.331+0000 7f78c5ffb700 1 -- 172.21.15.72:0/4009731738 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6282+0+0 (secure 0 0 0) 0x7f78cc0898a0 con 0x7f78d00bb0b0 2023-07-25T14:36:49.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:49.331+0000 7f78d5341700 1 --2- 172.21.15.72:0/4009731738 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f78b406ace0 0x7f78b406d1a0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f78c0000f60 tx=0x7f78c0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:49.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:49.335+0000 7f78c5ffb700 1 -- 172.21.15.72:0/4009731738 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f78cc054870 con 0x7f78d00bb0b0 2023-07-25T14:36:49.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:49.565+0000 7f78d75a5700 1 -- 172.21.15.72:0/4009731738 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f78d004e470 con 0x7f78d00bb0b0 2023-07-25T14:36:50.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:50.198+0000 7f78c5ffb700 1 -- 172.21.15.72:0/4009731738 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 6 and data pool 7 v13) v1 ==== 172+0+0 (secure 0 0 0) 0x7f78cc057e90 con 0x7f78d00bb0b0 2023-07-25T14:36:50.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:50.204+0000 7f78d75a5700 1 -- 172.21.15.72:0/4009731738 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f78b406ace0 msgr2=0x7f78b406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:50.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:50.204+0000 7f78d75a5700 1 --2- 172.21.15.72:0/4009731738 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f78b406ace0 0x7f78b406d1a0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f78c0000f60 tx=0x7f78c0009040 comp rx=0 tx=0).stop 2023-07-25T14:36:50.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:50.204+0000 7f78d75a5700 1 -- 172.21.15.72:0/4009731738 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f78d00bb0b0 msgr2=0x7f78d00bbea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:50.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:50.204+0000 7f78d75a5700 1 --2- 172.21.15.72:0/4009731738 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f78d00bb0b0 0x7f78d00bbea0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f78cc00d800 tx=0x7f78cc00db10 comp rx=0 tx=0).stop 2023-07-25T14:36:50.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:50.205+0000 7f78d75a5700 1 -- 172.21.15.72:0/4009731738 shutdown_connections 2023-07-25T14:36:50.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:50.205+0000 7f78d75a5700 1 --2- 172.21.15.72:0/4009731738 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f78b406ace0 0x7f78b406d1a0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:50.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:50.205+0000 7f78d75a5700 1 --2- 172.21.15.72:0/4009731738 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f78d00a9cc0 0x7f78d00bc8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:50.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:50.205+0000 7f78d75a5700 1 --2- 172.21.15.72:0/4009731738 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f78d014f810 0x7f78d0154a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:50.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:50.205+0000 7f78d75a5700 1 --2- 172.21.15.72:0/4009731738 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f78d00bb0b0 0x7f78d00bbea0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:50.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:50.205+0000 7f78d75a5700 1 -- 172.21.15.72:0/4009731738 >> 172.21.15.72:0/4009731738 conn(0x7f78d006a8d0 msgr2=0x7f78d006ee10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:50.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:50.205+0000 7f78d75a5700 1 -- 172.21.15.72:0/4009731738 shutdown_connections 2023-07-25T14:36:50.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:50.209+0000 7f78d75a5700 1 -- 172.21.15.72:0/4009731738 wait complete. 2023-07-25T14:36:50.224 INFO:teuthology.orchestra.run.smithi072.stderr:new fs with metadata pool 6 and data pool 7 2023-07-25T14:36:50.238 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-25T14:36:50.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:50.345+0000 7f1edb99f700 1 Processor -- start 2023-07-25T14:36:50.358 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:50.346+0000 7f1edb99f700 1 -- start start 2023-07-25T14:36:50.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:50.346+0000 7f1edb99f700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f1ed40c4930 0x7f1ed40c3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:50.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:50.346+0000 7f1edb99f700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ed40c2fe0 con 0x7f1ed4151950 2023-07-25T14:36:50.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:50.346+0000 7f1edb99f700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ed4155070 con 0x7f1ed40724c0 2023-07-25T14:36:50.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:50.346+0000 7f1edb99f700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ed4071a60 con 0x7f1ed40c4930 2023-07-25T14:36:50.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:50.346+0000 7f1ed973b700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f1ed4151950 0x7f1ed406a190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:60900/0 (socket says 172.21.15.72:60900) 2023-07-25T14:36:50.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:50.346+0000 7f1ed973b700 1 -- 172.21.15.72:0/1306745794 learned_addr learned my addr 172.21.15.72:0/1306745794 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:36:50.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:50.347+0000 7f1ed9f3c700 1 --2- 172.21.15.72:0/1306745794 >> v2:172.21.15.92:3300/0 conn(0x7f1ed40c4930 0x7f1ed40c3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:50.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:50.347+0000 7f1ecbfff700 1 -- 172.21.15.72:0/1306745794 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3487301570 0 0) 0x7f1ed40c2fe0 con 0x7f1ed4151950 2023-07-25T14:36:50.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:50.347+0000 7f1ecbfff700 1 -- 172.21.15.72:0/1306745794 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1ec00035b0 con 0x7f1ed4151950 2023-07-25T14:36:50.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:50.347+0000 7f1ecbfff700 1 -- 172.21.15.72:0/1306745794 <== mon.1 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 41326746 0 0) 0x7f1ed4155070 con 0x7f1ed40724c0 2023-07-25T14:36:50.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:50.347+0000 7f1ecbfff700 1 -- 172.21.15.72:0/1306745794 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1ed40c2fe0 con 0x7f1ed40724c0 2023-07-25T14:36:50.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:50.347+0000 7f1ecbfff700 1 -- 172.21.15.72:0/1306745794 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 325598586 0 0) 0x7f1ec00035b0 con 0x7f1ed4151950 2023-07-25T14:36:50.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:50.347+0000 7f1ecbfff700 1 -- 172.21.15.72:0/1306745794 >> v2:172.21.15.92:3300/0 conn(0x7f1ed40c4930 msgr2=0x7f1ed40c3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:50.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:50.347+0000 7f1ecbfff700 1 --2- 172.21.15.72:0/1306745794 >> v2:172.21.15.92:3300/0 conn(0x7f1ed40c4930 0x7f1ed40c3bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:50.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:50.347+0000 7f1ecbfff700 1 -- 172.21.15.72:0/1306745794 >> v1:172.21.15.92:6789/0 conn(0x7f1ed40724c0 legacy=0x7f1ed40c34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:50.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:50.347+0000 7f1ecbfff700 1 -- 172.21.15.72:0/1306745794 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ed40c15c0 con 0x7f1ed4151950 2023-07-25T14:36:50.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:50.347+0000 7f1ecbfff700 1 -- 172.21.15.72:0/1306745794 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2559588315 0 0) 0x7f1ec4001670 con 0x7f1ed4151950 2023-07-25T14:36:50.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:50.347+0000 7f1ecbfff700 1 -- 172.21.15.72:0/1306745794 >> v1:172.21.15.72:6789/0 conn(0x7f1ed4151950 legacy=0x7f1ed406a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:50.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:50.347+0000 7f1ecbfff700 1 --2- 172.21.15.72:0/1306745794 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1ec0003be0 0x7f1ec0003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:50.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:50.347+0000 7f1ecbfff700 1 --2- 172.21.15.72:0/1306745794 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1ec0004850 0x7f1ec0004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:50.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:50.347+0000 7f1ecbfff700 1 --2- 172.21.15.72:0/1306745794 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1ec0005260 0x7f1ec000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:50.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:50.347+0000 7f1ecbfff700 1 -- 172.21.15.72:0/1306745794 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ed4071a60 con 0x7f1ec0004850 2023-07-25T14:36:50.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:50.347+0000 7f1ecbfff700 1 -- 172.21.15.72:0/1306745794 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ec000c190 con 0x7f1ec0003be0 2023-07-25T14:36:50.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:50.347+0000 7f1ecbfff700 1 -- 172.21.15.72:0/1306745794 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ec000c350 con 0x7f1ec0005260 2023-07-25T14:36:50.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:50.347+0000 7f1ed9f3c700 1 --2- 172.21.15.72:0/1306745794 >> v2:172.21.15.92:3300/0 conn(0x7f1ed40c4930 0x7f1ed40c3bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-25T14:36:50.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:50.347+0000 7f1ed8f3a700 1 --2- 172.21.15.72:0/1306745794 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1ec0004850 0x7f1ec0004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:50.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:50.347+0000 7f1ed973b700 1 --2- 172.21.15.72:0/1306745794 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1ec0003be0 0x7f1ec0003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:50.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:50.347+0000 7f1ed9f3c700 1 --2- 172.21.15.72:0/1306745794 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1ec0005260 0x7f1ec000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:50.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:50.347+0000 7f1ed8f3a700 1 -- 172.21.15.72:0/1306745794 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1ec0005260 msgr2=0x7f1ec000ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:50.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:50.348+0000 7f1ed8f3a700 1 --2- 172.21.15.72:0/1306745794 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1ec0005260 0x7f1ec000ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:50.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:50.348+0000 7f1ed8f3a700 1 -- 172.21.15.72:0/1306745794 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1ec0003be0 msgr2=0x7f1ec0003fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:50.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:50.348+0000 7f1ed8f3a700 1 --2- 172.21.15.72:0/1306745794 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1ec0003be0 0x7f1ec0003fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:50.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:50.348+0000 7f1ed8f3a700 1 -- 172.21.15.72:0/1306745794 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ec00035b0 con 0x7f1ec0004850 2023-07-25T14:36:50.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:50.348+0000 7f1ed9f3c700 1 -- 172.21.15.72:0/1306745794 reap_dead start 2023-07-25T14:36:50.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:50.348+0000 7f1ed8f3a700 1 --2- 172.21.15.72:0/1306745794 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1ec0004850 0x7f1ec0004cd0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f1ed0001970 tx=0x7f1ec0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b642fe4ef78c76a server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:50.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:50.348+0000 7f1ecbfff700 1 -- 172.21.15.72:0/1306745794 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ed00052d0 con 0x7f1ec0004850 2023-07-25T14:36:50.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:50.348+0000 7f1ecbfff700 1 -- 172.21.15.72:0/1306745794 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ed0005450 con 0x7f1ec0004850 2023-07-25T14:36:50.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:50.348+0000 7f1ecbfff700 1 -- 172.21.15.72:0/1306745794 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ed00038c0 con 0x7f1ec0004850 2023-07-25T14:36:50.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:50.348+0000 7f1edb99f700 1 -- 172.21.15.72:0/1306745794 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1ec0004850 msgr2=0x7f1ec0004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:50.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:50.348+0000 7f1edb99f700 1 --2- 172.21.15.72:0/1306745794 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1ec0004850 0x7f1ec0004cd0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f1ed0001970 tx=0x7f1ec0005880 comp rx=0 tx=0).stop 2023-07-25T14:36:50.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:50.348+0000 7f1edb99f700 1 -- 172.21.15.72:0/1306745794 shutdown_connections 2023-07-25T14:36:50.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:50.348+0000 7f1edb99f700 1 --2- 172.21.15.72:0/1306745794 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1ec0004850 0x7f1ec0004cd0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:50.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:50.348+0000 7f1edb99f700 1 -- 172.21.15.72:0/1306745794 >> 172.21.15.72:0/1306745794 conn(0x7f1ed40a87e0 msgr2=0x7f1ed40a8bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:50.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:50.348+0000 7f1edb99f700 1 -- 172.21.15.72:0/1306745794 shutdown_connections 2023-07-25T14:36:50.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:50.348+0000 7f1edb99f700 1 -- 172.21.15.72:0/1306745794 wait complete. 2023-07-25T14:36:50.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:50.350+0000 7f1edb99f700 1 Processor -- start 2023-07-25T14:36:50.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:50.350+0000 7f1edb99f700 1 -- start start 2023-07-25T14:36:50.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:50.350+0000 7f1edb99f700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1ec0004850 0x7f1ed4153d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:50.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:50.350+0000 7f1edb99f700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1ed4150510 0x7f1ed41533b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:50.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:50.350+0000 7f1edb99f700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1ed40bf640 0x7f1ed414a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:50.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:50.350+0000 7f1edb99f700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ed40bf060 con 0x7f1ec0004850 2023-07-25T14:36:50.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:50.350+0000 7f1edb99f700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ed40bf2b0 con 0x7f1ed40bf640 2023-07-25T14:36:50.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:50.350+0000 7f1edb99f700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ed40acad0 con 0x7f1ed4150510 2023-07-25T14:36:50.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:50.350+0000 7f1ed973b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1ec0004850 0x7f1ed4153d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:50.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:50.350+0000 7f1ed973b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1ec0004850 0x7f1ed4153d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41944/0 (socket says 172.21.15.72:41944) 2023-07-25T14:36:50.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:50.350+0000 7f1ed973b700 1 -- 172.21.15.72:0/839056177 learned_addr learned my addr 172.21.15.72:0/839056177 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:50.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:50.351+0000 7f1ed9f3c700 1 --2- 172.21.15.72:0/839056177 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1ed40bf640 0x7f1ed414a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:50.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:50.351+0000 7f1ed8f3a700 1 --2- 172.21.15.72:0/839056177 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1ed4150510 0x7f1ed41533b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:50.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:50.351+0000 7f1ed973b700 1 -- 172.21.15.72:0/839056177 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1ed4150510 msgr2=0x7f1ed41533b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:50.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:50.351+0000 7f1ed973b700 1 --2- 172.21.15.72:0/839056177 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1ed4150510 0x7f1ed41533b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:50.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:50.351+0000 7f1ed973b700 1 -- 172.21.15.72:0/839056177 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1ed40bf640 msgr2=0x7f1ed414a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:50.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:50.351+0000 7f1ed973b700 1 --2- 172.21.15.72:0/839056177 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1ed40bf640 0x7f1ed414a6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:50.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:50.351+0000 7f1ed973b700 1 -- 172.21.15.72:0/839056177 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ed40c4e80 con 0x7f1ec0004850 2023-07-25T14:36:50.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:50.351+0000 7f1ed973b700 1 --2- 172.21.15.72:0/839056177 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1ec0004850 0x7f1ed4153d00 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f1ec4004f80 tx=0x7f1ec40073f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:50.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:50.351+0000 7f1ec9ffb700 1 -- 172.21.15.72:0/839056177 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ec4011580 con 0x7f1ec0004850 2023-07-25T14:36:50.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:50.351+0000 7f1ec9ffb700 1 -- 172.21.15.72:0/839056177 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ec4011700 con 0x7f1ec0004850 2023-07-25T14:36:50.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:50.351+0000 7f1ec9ffb700 1 -- 172.21.15.72:0/839056177 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ec4011ab0 con 0x7f1ec0004850 2023-07-25T14:36:50.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:50.351+0000 7f1edb99f700 1 -- 172.21.15.72:0/839056177 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ed414d330 con 0x7f1ec0004850 2023-07-25T14:36:50.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:50.351+0000 7f1edb99f700 1 -- 172.21.15.72:0/839056177 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ed414ce30 con 0x7f1ec0004850 2023-07-25T14:36:50.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:50.352+0000 7f1edb99f700 1 -- 172.21.15.72:0/839056177 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ed414d020 con 0x7f1ec0004850 2023-07-25T14:36:50.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:50.352+0000 7f1ec9ffb700 1 -- 172.21.15.72:0/839056177 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1ec4011c10 con 0x7f1ec0004850 2023-07-25T14:36:50.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:50.353+0000 7f1ec9ffb700 1 --2- 172.21.15.72:0/839056177 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f1eb806ace0 0x7f1eb806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:50.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:50.353+0000 7f1ec9ffb700 1 -- 172.21.15.72:0/839056177 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f1ec4089590 con 0x7f1ec0004850 2023-07-25T14:36:50.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:50.353+0000 7f1ed8f3a700 1 --2- 172.21.15.72:0/839056177 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f1eb806ace0 0x7f1eb806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:50.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:50.353+0000 7f1ed8f3a700 1 --2- 172.21.15.72:0/839056177 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f1eb806ace0 0x7f1eb806d1a0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f1ed0015040 tx=0x7f1ed0009030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:50.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:50.357+0000 7f1ec9ffb700 1 -- 172.21.15.72:0/839056177 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f1ec4054590 con 0x7f1ec0004850 2023-07-25T14:36:50.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:50.545+0000 7f1edb99f700 1 -- 172.21.15.72:0/839056177 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1ed414d520 con 0x7f1ec0004850 2023-07-25T14:36:50.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:50.546+0000 7f1ec9ffb700 1 -- 172.21.15.72:0/839056177 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+18407 (secure 0 0 0) 0x7f1ec4057bb0 con 0x7f1ec0004850 2023-07-25T14:36:50.559 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-25T14:36:50.559 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":38,"fsid":"9170db48-9170-43e8-8ccb-9813e6240906","created":"2023-07-25T14:35:21.733262+0000","modified":"2023-07-25T14:36:49.567501+0000","last_up_change":"2023-07-25T14:35:31.355010+0000","last_in_change":"2023-07-25T14:35:24.195785+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-25T14:35:32.983457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-25T14:35:33.326342+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-07-25T14:36:47.694223+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-07-25T14:36:48.536715+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d517fdad-0bfe-49f0-89f2-9421c3761839","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6801","nonce":2475407414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6803","nonce":2475407414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6807","nonce":2475407414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6805","nonce":2475407414}]},"public_addr":"172.21.15.72:6801/2475407414","cluster_addr":"172.21.15.72:6803/2475407414","heartbeat_back_addr":"172.21.15.72:6807/2475407414","heartbeat_front_addr":"172.21.15.72:6805/2475407414","state":["exists","up"]},{"osd":1,"uuid":"e1564be3-f209-47e5-a8d0-32fc618a474f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6822","nonce":870954016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6825","nonce":870954016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6831","nonce":870954016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6827","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6829","nonce":870954016}]},"public_addr":"172.21.15.72:6822/870954016","cluster_addr":"172.21.15.72:6825/870954016","heartbeat_back_addr":"172.21.15.72:6831/870954016","heartbeat_front_addr":"172.21.15.72:6829/870954016","state":["exists","up"]},{"osd":2,"uuid":"c4647d30-ffa6-417a-9026-ef530c75910e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6809","nonce":2143129442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6811","nonce":2143129442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6815","nonce":2143129442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6813","nonce":2143129442}]},"public_addr":"172.21.15.72:6809/2143129442","cluster_addr":"172.21.15.72:6811/2143129442","heartbeat_back_addr":"172.21.15.72:6815/2143129442","heartbeat_front_addr":"172.21.15.72:6813/2143129442","state":["exists","up"]},{"osd":3,"uuid":"76c9d9a7-c2e2-4612-a58b-d6882dd76b58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6817","nonce":3404066311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6819","nonce":3404066311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6828","nonce":3404066311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6821","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6823","nonce":3404066311}]},"public_addr":"172.21.15.72:6817/3404066311","cluster_addr":"172.21.15.72:6819/3404066311","heartbeat_back_addr":"172.21.15.72:6828/3404066311","heartbeat_front_addr":"172.21.15.72:6823/3404066311","state":["exists","up"]},{"osd":4,"uuid":"7f8920dc-0ad4-4a73-ab40-65408f83eadd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6817","nonce":2381008739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6819","nonce":2381008739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6825","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6827","nonce":2381008739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6822","nonce":2381008739}]},"public_addr":"172.21.15.92:6817/2381008739","cluster_addr":"172.21.15.92:6819/2381008739","heartbeat_back_addr":"172.21.15.92:6827/2381008739","heartbeat_front_addr":"172.21.15.92:6822/2381008739","state":["exists","up"]},{"osd":5,"uuid":"56257e7c-31eb-44c5-9ec7-1318a4e0bb35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6801","nonce":2161935604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6803","nonce":2161935604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6807","nonce":2161935604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6805","nonce":2161935604}]},"public_addr":"172.21.15.92:6801/2161935604","cluster_addr":"172.21.15.92:6803/2161935604","heartbeat_back_addr":"172.21.15.92:6807/2161935604","heartbeat_front_addr":"172.21.15.92:6805/2161935604","state":["exists","up"]},{"osd":6,"uuid":"a150d3d8-a0c9-4955-968a-8d98eff4ffb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6809","nonce":3770163493}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6811","nonce":3770163493}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6815","nonce":3770163493}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6813","nonce":3770163493}]},"public_addr":"172.21.15.92:6809/3770163493","cluster_addr":"172.21.15.92:6811/3770163493","heartbeat_back_addr":"172.21.15.92:6815/3770163493","heartbeat_front_addr":"172.21.15.92:6813/3770163493","state":["exists","up"]},{"osd":7,"uuid":"07799c27-54ee-4591-a42d-a978d6b32065","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6821","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6823","nonce":2135777609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6826","nonce":2135777609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6831","nonce":2135777609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6829","nonce":2135777609}]},"public_addr":"172.21.15.92:6823/2135777609","cluster_addr":"172.21.15.92:6826/2135777609","heartbeat_back_addr":"172.21.15.92:6831/2135777609","heartbeat_front_addr":"172.21.15.92:6829/2135777609","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.345365+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.378150+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.146566+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.372172+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:30.398421+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.385632+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.465611+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.443583+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-25T14:36:50.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:50.548+0000 7f1edb99f700 1 -- 172.21.15.72:0/839056177 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f1eb806ace0 msgr2=0x7f1eb806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:50.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:50.548+0000 7f1edb99f700 1 --2- 172.21.15.72:0/839056177 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f1eb806ace0 0x7f1eb806d1a0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f1ed0015040 tx=0x7f1ed0009030 comp rx=0 tx=0).stop 2023-07-25T14:36:50.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:50.549+0000 7f1edb99f700 1 -- 172.21.15.72:0/839056177 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1ec0004850 msgr2=0x7f1ed4153d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:50.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:50.549+0000 7f1edb99f700 1 --2- 172.21.15.72:0/839056177 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1ec0004850 0x7f1ed4153d00 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f1ec4004f80 tx=0x7f1ec40073f0 comp rx=0 tx=0).stop 2023-07-25T14:36:50.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:50.549+0000 7f1edb99f700 1 -- 172.21.15.72:0/839056177 shutdown_connections 2023-07-25T14:36:50.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:50.549+0000 7f1edb99f700 1 --2- 172.21.15.72:0/839056177 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f1eb806ace0 0x7f1eb806d1a0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:50.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:50.549+0000 7f1edb99f700 1 --2- 172.21.15.72:0/839056177 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1ed40bf640 0x7f1ed414a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:50.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:50.549+0000 7f1edb99f700 1 --2- 172.21.15.72:0/839056177 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1ec0004850 0x7f1ed4153d00 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:50.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:50.549+0000 7f1edb99f700 1 --2- 172.21.15.72:0/839056177 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1ed4150510 0x7f1ed41533b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:50.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:50.549+0000 7f1edb99f700 1 -- 172.21.15.72:0/839056177 >> 172.21.15.72:0/839056177 conn(0x7f1ed40a87e0 msgr2=0x7f1ed40c33c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:50.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:50.549+0000 7f1edb99f700 1 -- 172.21.15.72:0/839056177 shutdown_connections 2023-07-25T14:36:50.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:50.549+0000 7f1edb99f700 1 -- 172.21.15.72:0/839056177 wait complete. 2023-07-25T14:36:50.572 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-25T14:36:50.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:50.681+0000 7fe828bbc700 1 Processor -- start 2023-07-25T14:36:50.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:50.681+0000 7fe828bbc700 1 -- start start 2023-07-25T14:36:50.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:50.682+0000 7fe828bbc700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fe8240724c0 0x7fe8240c34c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:50.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:50.682+0000 7fe828bbc700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe8240c4930 0x7fe8240c3a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:50.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:50.682+0000 7fe828bbc700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8240c2fe0 con 0x7fe824151950 2023-07-25T14:36:50.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:50.682+0000 7fe828bbc700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe824071a60 con 0x7fe8240c4930 2023-07-25T14:36:50.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:50.682+0000 7fe828bbc700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8240c2a70 con 0x7fe8240724c0 2023-07-25T14:36:50.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:50.682+0000 7fe822d9d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe8240c4930 0x7fe8240c3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:50.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:50.682+0000 7fe82259c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fe824151950 0x7fe82406a190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:60920/0 (socket says 172.21.15.72:60920) 2023-07-25T14:36:50.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:50.682+0000 7fe822d9d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe8240c4930 0x7fe8240c3a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41956/0 (socket says 172.21.15.72:41956) 2023-07-25T14:36:50.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:50.682+0000 7fe82259c700 1 -- 172.21.15.72:0/2979251629 learned_addr learned my addr 172.21.15.72:0/2979251629 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:36:50.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:50.682+0000 7fe821d9b700 1 --2- 172.21.15.72:0/2979251629 >> v2:172.21.15.92:3300/0 conn(0x7fe8240724c0 0x7fe8240c34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:50.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:50.682+0000 7fe822d9d700 1 -- 172.21.15.72:0/2979251629 >> v2:172.21.15.92:3300/0 conn(0x7fe8240724c0 msgr2=0x7fe8240c34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:50.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:50.682+0000 7fe822d9d700 1 --2- 172.21.15.72:0/2979251629 >> v2:172.21.15.92:3300/0 conn(0x7fe8240724c0 0x7fe8240c34c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:50.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:50.682+0000 7fe822d9d700 1 -- 172.21.15.72:0/2979251629 >> v1:172.21.15.72:6789/0 conn(0x7fe824151950 legacy=0x7fe82406a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:50.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:50.682+0000 7fe822d9d700 1 -- 172.21.15.72:0/2979251629 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe824155070 con 0x7fe8240c4930 2023-07-25T14:36:50.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:50.682+0000 7fe822d9d700 1 --2- 172.21.15.72:0/2979251629 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe8240c4930 0x7fe8240c3a00 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fe8240acbc0 tx=0x7fe81c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6aecf7e82b922c4 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:50.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:50.682+0000 7fe82159a700 1 -- 172.21.15.72:0/2979251629 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe81c00e070 con 0x7fe8240c4930 2023-07-25T14:36:50.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:50.683+0000 7fe82159a700 1 -- 172.21.15.72:0/2979251629 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe81c00bbd0 con 0x7fe8240c4930 2023-07-25T14:36:50.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:50.683+0000 7fe82159a700 1 -- 172.21.15.72:0/2979251629 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe81c012430 con 0x7fe8240c4930 2023-07-25T14:36:50.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:50.683+0000 7fe828bbc700 1 -- 172.21.15.72:0/2979251629 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe8240c4930 msgr2=0x7fe8240c3a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:50.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:50.683+0000 7fe828bbc700 1 --2- 172.21.15.72:0/2979251629 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe8240c4930 0x7fe8240c3a00 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fe8240acbc0 tx=0x7fe81c00b330 comp rx=0 tx=0).stop 2023-07-25T14:36:50.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:50.683+0000 7fe828bbc700 1 -- 172.21.15.72:0/2979251629 shutdown_connections 2023-07-25T14:36:50.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:50.683+0000 7fe828bbc700 1 --2- 172.21.15.72:0/2979251629 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe8240c4930 0x7fe8240c3a00 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:50.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:50.683+0000 7fe828bbc700 1 --2- 172.21.15.72:0/2979251629 >> v2:172.21.15.92:3300/0 conn(0x7fe8240724c0 0x7fe8240c34c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:50.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:50.683+0000 7fe828bbc700 1 -- 172.21.15.72:0/2979251629 >> 172.21.15.72:0/2979251629 conn(0x7fe8240a87e0 msgr2=0x7fe8240a8bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:50.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:50.683+0000 7fe828bbc700 1 -- 172.21.15.72:0/2979251629 shutdown_connections 2023-07-25T14:36:50.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:50.683+0000 7fe828bbc700 1 -- 172.21.15.72:0/2979251629 wait complete. 2023-07-25T14:36:50.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:50.685+0000 7fe828bbc700 1 Processor -- start 2023-07-25T14:36:50.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:50.685+0000 7fe828bbc700 1 -- start start 2023-07-25T14:36:50.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:50.686+0000 7fe828bbc700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe8240724c0 0x7fe8240ab5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:50.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:50.686+0000 7fe828bbc700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe8240c4930 0x7fe8240abb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:50.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:50.686+0000 7fe828bbc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe824151950 0x7fe8240a6480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:50.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:50.686+0000 7fe828bbc700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8240a9eb0 con 0x7fe824151950 2023-07-25T14:36:50.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:50.686+0000 7fe828bbc700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8240ac710 con 0x7fe8240c4930 2023-07-25T14:36:50.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:50.686+0000 7fe828bbc700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8241ea240 con 0x7fe8240724c0 2023-07-25T14:36:50.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:50.686+0000 7fe822d9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe824151950 0x7fe8240a6480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:50.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:50.686+0000 7fe822d9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe824151950 0x7fe8240a6480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41962/0 (socket says 172.21.15.72:41962) 2023-07-25T14:36:50.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:50.686+0000 7fe822d9d700 1 -- 172.21.15.72:0/2877055111 learned_addr learned my addr 172.21.15.72:0/2877055111 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:50.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:50.686+0000 7fe821d9b700 1 --2- 172.21.15.72:0/2877055111 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe8240c4930 0x7fe8240abb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:50.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:50.686+0000 7fe822d9d700 1 -- 172.21.15.72:0/2877055111 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe8240724c0 msgr2=0x7fe8240ab5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:50.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:50.686+0000 7fe822d9d700 1 --2- 172.21.15.72:0/2877055111 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe8240724c0 0x7fe8240ab5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:50.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:50.686+0000 7fe822d9d700 1 -- 172.21.15.72:0/2877055111 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe8240c4930 msgr2=0x7fe8240abb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:50.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:50.686+0000 7fe822d9d700 1 --2- 172.21.15.72:0/2877055111 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe8240c4930 0x7fe8240abb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:50.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:50.686+0000 7fe822d9d700 1 -- 172.21.15.72:0/2877055111 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe81c009a70 con 0x7fe824151950 2023-07-25T14:36:50.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:50.686+0000 7fe821d9b700 1 --2- 172.21.15.72:0/2877055111 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe8240c4930 0x7fe8240abb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-25T14:36:50.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:50.686+0000 7fe822d9d700 1 --2- 172.21.15.72:0/2877055111 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe824151950 0x7fe8240a6480 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fe82406aec0 tx=0x7fe81c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:50.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:50.686+0000 7fe812ffd700 1 -- 172.21.15.72:0/2877055111 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe81c012430 con 0x7fe824151950 2023-07-25T14:36:50.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:50.686+0000 7fe812ffd700 1 -- 172.21.15.72:0/2877055111 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe81c020070 con 0x7fe824151950 2023-07-25T14:36:50.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:50.686+0000 7fe828bbc700 1 -- 172.21.15.72:0/2877055111 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8241ea770 con 0x7fe824151950 2023-07-25T14:36:50.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:50.686+0000 7fe812ffd700 1 -- 172.21.15.72:0/2877055111 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe81c004280 con 0x7fe824151950 2023-07-25T14:36:50.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:50.686+0000 7fe828bbc700 1 -- 172.21.15.72:0/2877055111 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8241ea490 con 0x7fe824151950 2023-07-25T14:36:50.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:50.687+0000 7fe828bbc700 1 -- 172.21.15.72:0/2877055111 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8240c15a0 con 0x7fe824151950 2023-07-25T14:36:50.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:50.688+0000 7fe812ffd700 1 -- 172.21.15.72:0/2877055111 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe81c0043e0 con 0x7fe824151950 2023-07-25T14:36:50.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:50.688+0000 7fe812ffd700 1 --2- 172.21.15.72:0/2877055111 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fe80406ace0 0x7fe80406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:50.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:50.688+0000 7fe812ffd700 1 -- 172.21.15.72:0/2877055111 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fe81c022070 con 0x7fe824151950 2023-07-25T14:36:50.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:50.688+0000 7fe82259c700 1 --2- 172.21.15.72:0/2877055111 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fe80406ace0 0x7fe80406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:50.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:50.689+0000 7fe82259c700 1 --2- 172.21.15.72:0/2877055111 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fe80406ace0 0x7fe80406d1a0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fe8180015d0 tx=0x7fe818007ad0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:50.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:50.692+0000 7fe812ffd700 1 -- 172.21.15.72:0/2877055111 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fe8240c15a0 con 0x7fe824151950 2023-07-25T14:36:50.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:50.879+0000 7fe828bbc700 1 -- 172.21.15.72:0/2877055111 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe8240c15a0 con 0x7fe824151950 2023-07-25T14:36:50.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:50.880+0000 7fe812ffd700 1 -- 172.21.15.72:0/2877055111 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+18407 (secure 0 0 0) 0x7fe8240c15a0 con 0x7fe824151950 2023-07-25T14:36:50.892 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-25T14:36:50.892 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":38,"fsid":"9170db48-9170-43e8-8ccb-9813e6240906","created":"2023-07-25T14:35:21.733262+0000","modified":"2023-07-25T14:36:49.567501+0000","last_up_change":"2023-07-25T14:35:31.355010+0000","last_in_change":"2023-07-25T14:35:24.195785+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-25T14:35:32.983457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-25T14:35:33.326342+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-07-25T14:36:47.694223+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-07-25T14:36:48.536715+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d517fdad-0bfe-49f0-89f2-9421c3761839","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6801","nonce":2475407414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6803","nonce":2475407414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6807","nonce":2475407414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6805","nonce":2475407414}]},"public_addr":"172.21.15.72:6801/2475407414","cluster_addr":"172.21.15.72:6803/2475407414","heartbeat_back_addr":"172.21.15.72:6807/2475407414","heartbeat_front_addr":"172.21.15.72:6805/2475407414","state":["exists","up"]},{"osd":1,"uuid":"e1564be3-f209-47e5-a8d0-32fc618a474f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6822","nonce":870954016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6825","nonce":870954016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6831","nonce":870954016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6827","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6829","nonce":870954016}]},"public_addr":"172.21.15.72:6822/870954016","cluster_addr":"172.21.15.72:6825/870954016","heartbeat_back_addr":"172.21.15.72:6831/870954016","heartbeat_front_addr":"172.21.15.72:6829/870954016","state":["exists","up"]},{"osd":2,"uuid":"c4647d30-ffa6-417a-9026-ef530c75910e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6809","nonce":2143129442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6811","nonce":2143129442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6815","nonce":2143129442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6813","nonce":2143129442}]},"public_addr":"172.21.15.72:6809/2143129442","cluster_addr":"172.21.15.72:6811/2143129442","heartbeat_back_addr":"172.21.15.72:6815/2143129442","heartbeat_front_addr":"172.21.15.72:6813/2143129442","state":["exists","up"]},{"osd":3,"uuid":"76c9d9a7-c2e2-4612-a58b-d6882dd76b58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6817","nonce":3404066311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6819","nonce":3404066311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6828","nonce":3404066311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6821","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6823","nonce":3404066311}]},"public_addr":"172.21.15.72:6817/3404066311","cluster_addr":"172.21.15.72:6819/3404066311","heartbeat_back_addr":"172.21.15.72:6828/3404066311","heartbeat_front_addr":"172.21.15.72:6823/3404066311","state":["exists","up"]},{"osd":4,"uuid":"7f8920dc-0ad4-4a73-ab40-65408f83eadd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6817","nonce":2381008739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6819","nonce":2381008739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6825","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6827","nonce":2381008739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6822","nonce":2381008739}]},"public_addr":"172.21.15.92:6817/2381008739","cluster_addr":"172.21.15.92:6819/2381008739","heartbeat_back_addr":"172.21.15.92:6827/2381008739","heartbeat_front_addr":"172.21.15.92:6822/2381008739","state":["exists","up"]},{"osd":5,"uuid":"56257e7c-31eb-44c5-9ec7-1318a4e0bb35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6801","nonce":2161935604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6803","nonce":2161935604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6807","nonce":2161935604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6805","nonce":2161935604}]},"public_addr":"172.21.15.92:6801/2161935604","cluster_addr":"172.21.15.92:6803/2161935604","heartbeat_back_addr":"172.21.15.92:6807/2161935604","heartbeat_front_addr":"172.21.15.92:6805/2161935604","state":["exists","up"]},{"osd":6,"uuid":"a150d3d8-a0c9-4955-968a-8d98eff4ffb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6809","nonce":3770163493}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6811","nonce":3770163493}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6815","nonce":3770163493}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6813","nonce":3770163493}]},"public_addr":"172.21.15.92:6809/3770163493","cluster_addr":"172.21.15.92:6811/3770163493","heartbeat_back_addr":"172.21.15.92:6815/3770163493","heartbeat_front_addr":"172.21.15.92:6813/3770163493","state":["exists","up"]},{"osd":7,"uuid":"07799c27-54ee-4591-a42d-a978d6b32065","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6821","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6823","nonce":2135777609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6826","nonce":2135777609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6831","nonce":2135777609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6829","nonce":2135777609}]},"public_addr":"172.21.15.92:6823/2135777609","cluster_addr":"172.21.15.92:6826/2135777609","heartbeat_back_addr":"172.21.15.92:6831/2135777609","heartbeat_front_addr":"172.21.15.92:6829/2135777609","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.345365+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.378150+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.146566+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.372172+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:30.398421+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.385632+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.465611+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.443583+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-25T14:36:50.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:50.882+0000 7fe828bbc700 1 -- 172.21.15.72:0/2877055111 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fe80406ace0 msgr2=0x7fe80406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:50.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:50.882+0000 7fe828bbc700 1 --2- 172.21.15.72:0/2877055111 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fe80406ace0 0x7fe80406d1a0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fe8180015d0 tx=0x7fe818007ad0 comp rx=0 tx=0).stop 2023-07-25T14:36:50.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:50.882+0000 7fe828bbc700 1 -- 172.21.15.72:0/2877055111 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe824151950 msgr2=0x7fe8240a6480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:50.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:50.882+0000 7fe828bbc700 1 --2- 172.21.15.72:0/2877055111 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe824151950 0x7fe8240a6480 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fe82406aec0 tx=0x7fe81c004ad0 comp rx=0 tx=0).stop 2023-07-25T14:36:50.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:50.882+0000 7fe828bbc700 1 -- 172.21.15.72:0/2877055111 shutdown_connections 2023-07-25T14:36:50.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:50.882+0000 7fe828bbc700 1 --2- 172.21.15.72:0/2877055111 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fe80406ace0 0x7fe80406d1a0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:50.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:50.883+0000 7fe828bbc700 1 --2- 172.21.15.72:0/2877055111 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe8240724c0 0x7fe8240ab5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:50.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:50.883+0000 7fe828bbc700 1 --2- 172.21.15.72:0/2877055111 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe824151950 0x7fe8240a6480 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:50.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:50.883+0000 7fe828bbc700 1 --2- 172.21.15.72:0/2877055111 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe8240c4930 0x7fe8240abb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:50.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:50.883+0000 7fe828bbc700 1 -- 172.21.15.72:0/2877055111 >> 172.21.15.72:0/2877055111 conn(0x7fe8240a87e0 msgr2=0x7fe8240a8bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:50.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:50.883+0000 7fe828bbc700 1 -- 172.21.15.72:0/2877055111 shutdown_connections 2023-07-25T14:36:50.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:50.883+0000 7fe828bbc700 1 -- 172.21.15.72:0/2877055111 wait complete. 2023-07-25T14:36:50.906 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-07-25T14:36:51.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:51.017+0000 7f2a531a5700 1 Processor -- start 2023-07-25T14:36:51.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:51.017+0000 7f2a531a5700 1 -- start start 2023-07-25T14:36:51.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:51.018+0000 7f2a531a5700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f2a4c14faf0 0x7f2a4c0c5e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:51.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:51.018+0000 7f2a531a5700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2a4c0c3f10 0x7f2a4c071960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:51.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:51.018+0000 7f2a531a5700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a4c0c4930 con 0x7f2a4c0ba0e0 2023-07-25T14:36:51.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:51.018+0000 7f2a531a5700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a4c0c5670 con 0x7f2a4c0c3f10 2023-07-25T14:36:51.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:51.018+0000 7f2a531a5700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a4c0726e0 con 0x7f2a4c14faf0 2023-07-25T14:36:51.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:51.018+0000 7f2a51742700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2a4c0c3f10 0x7f2a4c071960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:51.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:51.018+0000 7f2a4bfff700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f2a4c0ba0e0 0x7f2a4c1558a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:60934/0 (socket says 172.21.15.72:60934) 2023-07-25T14:36:51.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:51.018+0000 7f2a4bfff700 1 -- 172.21.15.72:0/1228913256 learned_addr learned my addr 172.21.15.72:0/1228913256 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:36:51.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:51.018+0000 7f2a50f41700 1 --2- 172.21.15.72:0/1228913256 >> v2:172.21.15.92:3300/0 conn(0x7f2a4c14faf0 0x7f2a4c0c5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:51.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:51.018+0000 7f2a51742700 1 -- 172.21.15.72:0/1228913256 >> v2:172.21.15.92:3300/0 conn(0x7f2a4c14faf0 msgr2=0x7f2a4c0c5e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:51.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:51.018+0000 7f2a51742700 1 --2- 172.21.15.72:0/1228913256 >> v2:172.21.15.92:3300/0 conn(0x7f2a4c14faf0 0x7f2a4c0c5e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:51.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:51.018+0000 7f2a51742700 1 -- 172.21.15.72:0/1228913256 >> v1:172.21.15.72:6789/0 conn(0x7f2a4c0ba0e0 legacy=0x7f2a4c1558a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:51.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:51.018+0000 7f2a51742700 1 -- 172.21.15.72:0/1228913256 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a4c0c4b80 con 0x7f2a4c0c3f10 2023-07-25T14:36:51.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:51.018+0000 7f2a4b7fe700 1 -- 172.21.15.72:0/1228913256 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3328738478 0 0) 0x7f2a4c0c4930 con 0x7f2a4c0ba0e0 2023-07-25T14:36:51.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:51.018+0000 7f2a50f41700 1 --2- 172.21.15.72:0/1228913256 >> v2:172.21.15.92:3300/0 conn(0x7f2a4c14faf0 0x7f2a4c0c5e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-25T14:36:51.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:51.018+0000 7f2a51742700 1 --2- 172.21.15.72:0/1228913256 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2a4c0c3f10 0x7f2a4c071960 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f2a4c0ac850 tx=0x7f2a4400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b9118d437a74f73 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:51.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:51.018+0000 7f2a4b7fe700 1 -- 172.21.15.72:0/1228913256 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a4400e070 con 0x7f2a4c0c3f10 2023-07-25T14:36:51.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:51.018+0000 7f2a4b7fe700 1 -- 172.21.15.72:0/1228913256 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a4400bbd0 con 0x7f2a4c0c3f10 2023-07-25T14:36:51.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:51.018+0000 7f2a4b7fe700 1 -- 172.21.15.72:0/1228913256 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a44012430 con 0x7f2a4c0c3f10 2023-07-25T14:36:51.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:51.019+0000 7f2a531a5700 1 -- 172.21.15.72:0/1228913256 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2a4c0c3f10 msgr2=0x7f2a4c071960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:51.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:51.019+0000 7f2a531a5700 1 --2- 172.21.15.72:0/1228913256 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2a4c0c3f10 0x7f2a4c071960 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f2a4c0ac850 tx=0x7f2a4400b330 comp rx=0 tx=0).stop 2023-07-25T14:36:51.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:51.019+0000 7f2a531a5700 1 -- 172.21.15.72:0/1228913256 shutdown_connections 2023-07-25T14:36:51.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:51.019+0000 7f2a531a5700 1 --2- 172.21.15.72:0/1228913256 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2a4c0c3f10 0x7f2a4c071960 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:51.042 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:51.019+0000 7f2a531a5700 1 --2- 172.21.15.72:0/1228913256 >> v2:172.21.15.92:3300/0 conn(0x7f2a4c14faf0 0x7f2a4c0c5e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:51.042 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:51.019+0000 7f2a531a5700 1 -- 172.21.15.72:0/1228913256 >> 172.21.15.72:0/1228913256 conn(0x7f2a4c0a87e0 msgr2=0x7f2a4c0a8bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:51.042 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:51.019+0000 7f2a531a5700 1 -- 172.21.15.72:0/1228913256 shutdown_connections 2023-07-25T14:36:51.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:51.019+0000 7f2a531a5700 1 -- 172.21.15.72:0/1228913256 wait complete. 2023-07-25T14:36:51.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:51.020+0000 7f2a531a5700 1 Processor -- start 2023-07-25T14:36:51.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:51.020+0000 7f2a531a5700 1 -- start start 2023-07-25T14:36:51.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:51.021+0000 7f2a531a5700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2a4c0ba0e0 0x7f2a4c1e8690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:51.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:51.021+0000 7f2a531a5700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2a4c0c3f10 0x7f2a4c1514c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:51.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:51.021+0000 7f2a531a5700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2a4c14faf0 0x7f2a4c1e7500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:51.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:51.021+0000 7f2a531a5700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a4c1e8bd0 con 0x7f2a4c0c3f10 2023-07-25T14:36:51.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:51.021+0000 7f2a531a5700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a4c1e8160 con 0x7f2a4c0ba0e0 2023-07-25T14:36:51.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:51.021+0000 7f2a531a5700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a4c1e7e80 con 0x7f2a4c14faf0 2023-07-25T14:36:51.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:51.021+0000 7f2a4bfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2a4c0c3f10 0x7f2a4c1514c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:51.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:51.021+0000 7f2a4bfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2a4c0c3f10 0x7f2a4c1514c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41974/0 (socket says 172.21.15.72:41974) 2023-07-25T14:36:51.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:51.021+0000 7f2a4bfff700 1 -- 172.21.15.72:0/3039865156 learned_addr learned my addr 172.21.15.72:0/3039865156 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:51.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:51.021+0000 7f2a50f41700 1 --2- 172.21.15.72:0/3039865156 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2a4c0ba0e0 0x7f2a4c1e8690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:51.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:51.021+0000 7f2a51742700 1 --2- 172.21.15.72:0/3039865156 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2a4c14faf0 0x7f2a4c1e7500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:51.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:51.021+0000 7f2a4bfff700 1 -- 172.21.15.72:0/3039865156 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2a4c14faf0 msgr2=0x7f2a4c1e7500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:51.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:51.021+0000 7f2a4bfff700 1 --2- 172.21.15.72:0/3039865156 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2a4c14faf0 0x7f2a4c1e7500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:51.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:51.021+0000 7f2a4bfff700 1 -- 172.21.15.72:0/3039865156 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2a4c0ba0e0 msgr2=0x7f2a4c1e8690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:51.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:51.021+0000 7f2a4bfff700 1 --2- 172.21.15.72:0/3039865156 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2a4c0ba0e0 0x7f2a4c1e8690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:51.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:51.021+0000 7f2a4bfff700 1 -- 172.21.15.72:0/3039865156 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a44009a70 con 0x7f2a4c0c3f10 2023-07-25T14:36:51.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:51.021+0000 7f2a51742700 1 --2- 172.21.15.72:0/3039865156 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2a4c14faf0 0x7f2a4c1e7500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-25T14:36:51.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:51.021+0000 7f2a4bfff700 1 --2- 172.21.15.72:0/3039865156 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2a4c0c3f10 0x7f2a4c1514c0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f2a3800c520 tx=0x7f2a3800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:51.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:51.022+0000 7f2a497fa700 1 -- 172.21.15.72:0/3039865156 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a38004c80 con 0x7f2a4c0c3f10 2023-07-25T14:36:51.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:51.022+0000 7f2a497fa700 1 -- 172.21.15.72:0/3039865156 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a38004de0 con 0x7f2a4c0c3f10 2023-07-25T14:36:51.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:51.022+0000 7f2a531a5700 1 -- 172.21.15.72:0/3039865156 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a4c150cc0 con 0x7f2a4c0c3f10 2023-07-25T14:36:51.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:51.022+0000 7f2a497fa700 1 -- 172.21.15.72:0/3039865156 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a380072d0 con 0x7f2a4c0c3f10 2023-07-25T14:36:51.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:51.022+0000 7f2a531a5700 1 -- 172.21.15.72:0/3039865156 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a4c151a00 con 0x7f2a4c0c3f10 2023-07-25T14:36:51.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:51.023+0000 7f2a531a5700 1 -- 172.21.15.72:0/3039865156 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a4c1511e0 con 0x7f2a4c0c3f10 2023-07-25T14:36:51.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:51.023+0000 7f2a497fa700 1 -- 172.21.15.72:0/3039865156 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2a38007430 con 0x7f2a4c0c3f10 2023-07-25T14:36:51.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:51.023+0000 7f2a497fa700 1 --2- 172.21.15.72:0/3039865156 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f2a3006ace0 0x7f2a3006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:51.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:51.023+0000 7f2a497fa700 1 -- 172.21.15.72:0/3039865156 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f2a38089210 con 0x7f2a4c0c3f10 2023-07-25T14:36:51.047 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:51.023+0000 7f2a50f41700 1 --2- 172.21.15.72:0/3039865156 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f2a3006ace0 0x7f2a3006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:51.047 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:51.024+0000 7f2a50f41700 1 --2- 172.21.15.72:0/3039865156 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f2a3006ace0 0x7f2a3006d1a0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f2a4000c900 tx=0x7f2a40008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:51.047 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:51.028+0000 7f2a497fa700 1 -- 172.21.15.72:0/3039865156 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f2a4c1511e0 con 0x7f2a4c0c3f10 2023-07-25T14:36:51.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:51.264+0000 7f2a531a5700 1 -- 172.21.15.72:0/3039865156 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f2a4c1511e0 con 0x7f2a4c0c3f10 2023-07-25T14:36:52.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:52.209+0000 7f2a497fa700 1 -- 172.21.15.72:0/3039865156 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v16) v1 ==== 118+0+0 (secure 0 0 0) 0x7f2a4c1511e0 con 0x7f2a4c0c3f10 2023-07-25T14:36:52.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:52.213+0000 7f2a531a5700 1 -- 172.21.15.72:0/3039865156 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f2a3006ace0 msgr2=0x7f2a3006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:52.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:52.213+0000 7f2a531a5700 1 --2- 172.21.15.72:0/3039865156 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f2a3006ace0 0x7f2a3006d1a0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f2a4000c900 tx=0x7f2a40008040 comp rx=0 tx=0).stop 2023-07-25T14:36:52.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:52.213+0000 7f2a531a5700 1 -- 172.21.15.72:0/3039865156 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2a4c0c3f10 msgr2=0x7f2a4c1514c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:52.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:52.213+0000 7f2a531a5700 1 --2- 172.21.15.72:0/3039865156 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2a4c0c3f10 0x7f2a4c1514c0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f2a3800c520 tx=0x7f2a3800c8e0 comp rx=0 tx=0).stop 2023-07-25T14:36:52.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:52.213+0000 7f2a531a5700 1 -- 172.21.15.72:0/3039865156 shutdown_connections 2023-07-25T14:36:52.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:52.213+0000 7f2a531a5700 1 --2- 172.21.15.72:0/3039865156 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f2a3006ace0 0x7f2a3006d1a0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:52.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:52.213+0000 7f2a531a5700 1 --2- 172.21.15.72:0/3039865156 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2a4c14faf0 0x7f2a4c1e7500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:52.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:52.213+0000 7f2a531a5700 1 --2- 172.21.15.72:0/3039865156 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2a4c0ba0e0 0x7f2a4c1e8690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:52.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:52.213+0000 7f2a531a5700 1 --2- 172.21.15.72:0/3039865156 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2a4c0c3f10 0x7f2a4c1514c0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:52.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:52.213+0000 7f2a531a5700 1 -- 172.21.15.72:0/3039865156 >> 172.21.15.72:0/3039865156 conn(0x7f2a4c0a87e0 msgr2=0x7f2a4c0a71d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:52.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:52.213+0000 7f2a531a5700 1 -- 172.21.15.72:0/3039865156 shutdown_connections 2023-07-25T14:36:52.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:52.214+0000 7f2a531a5700 1 -- 172.21.15.72:0/3039865156 wait complete. 2023-07-25T14:36:52.240 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-07-25T14:36:52.240 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-07-25T14:36:52.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:52.357+0000 7f5f0d6e3700 1 Processor -- start 2023-07-25T14:36:52.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:52.358+0000 7f5f0d6e3700 1 -- start start 2023-07-25T14:36:52.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:52.358+0000 7f5f0d6e3700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5f080c2330 0x7f5f08152ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:52.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:52.358+0000 7f5f0d6e3700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f080c02a0 con 0x7f5f080c2710 2023-07-25T14:36:52.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:52.358+0000 7f5f0d6e3700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f080c2b60 con 0x7f5f0806e080 2023-07-25T14:36:52.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:52.358+0000 7f5f0d6e3700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f080c2f10 con 0x7f5f080c2330 2023-07-25T14:36:52.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:52.358+0000 7f5f077fe700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f5f080c2710 0x7f5f0814f100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:60952/0 (socket says 172.21.15.72:60952) 2023-07-25T14:36:52.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:52.358+0000 7f5f077fe700 1 -- 172.21.15.72:0/1248219793 learned_addr learned my addr 172.21.15.72:0/1248219793 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:36:52.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:52.359+0000 7f5f05ffb700 1 -- 172.21.15.72:0/1248219793 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2013055554 0 0) 0x7f5f080c02a0 con 0x7f5f080c2710 2023-07-25T14:36:52.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:52.359+0000 7f5f05ffb700 1 -- 172.21.15.72:0/1248219793 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5ef00035b0 con 0x7f5f080c2710 2023-07-25T14:36:52.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:52.359+0000 7f5f06ffd700 1 --2- 172.21.15.72:0/1248219793 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5f080c2330 0x7f5f08152ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:52.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:52.359+0000 7f5f05ffb700 1 -- 172.21.15.72:0/1248219793 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2232488152 0 0) 0x7f5ef00035b0 con 0x7f5f080c2710 2023-07-25T14:36:52.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:52.359+0000 7f5f05ffb700 1 -- 172.21.15.72:0/1248219793 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5f080c2330 msgr2=0x7f5f08152ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:52.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:52.359+0000 7f5f05ffb700 1 --2- 172.21.15.72:0/1248219793 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5f080c2330 0x7f5f08152ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:52.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:52.359+0000 7f5f05ffb700 1 -- 172.21.15.72:0/1248219793 >> v1:172.21.15.92:6789/0 conn(0x7f5f0806e080 legacy=0x7f5f08155c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:52.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:52.359+0000 7f5f05ffb700 1 -- 172.21.15.72:0/1248219793 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f080c04f0 con 0x7f5f080c2710 2023-07-25T14:36:52.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:52.359+0000 7f5f05ffb700 1 -- 172.21.15.72:0/1248219793 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2559588315 0 0) 0x7f5f000019f0 con 0x7f5f080c2710 2023-07-25T14:36:52.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:52.359+0000 7f5f05ffb700 1 -- 172.21.15.72:0/1248219793 >> v1:172.21.15.72:6789/0 conn(0x7f5f080c2710 legacy=0x7f5f0814f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:52.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:52.359+0000 7f5f05ffb700 1 --2- 172.21.15.72:0/1248219793 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5ef0003a30 0x7f5ef0003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:52.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:52.359+0000 7f5f05ffb700 1 --2- 172.21.15.72:0/1248219793 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5f080c2330 0x7f5ef0004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:52.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:52.359+0000 7f5f05ffb700 1 --2- 172.21.15.72:0/1248219793 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5ef0004de0 0x7f5ef0005260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:52.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:52.359+0000 7f5f05ffb700 1 -- 172.21.15.72:0/1248219793 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f080c2f10 con 0x7f5ef0003a30 2023-07-25T14:36:52.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:52.359+0000 7f5f05ffb700 1 -- 172.21.15.72:0/1248219793 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ef000bc90 con 0x7f5ef0004de0 2023-07-25T14:36:52.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:52.359+0000 7f5f05ffb700 1 -- 172.21.15.72:0/1248219793 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ef000be50 con 0x7f5f080c2330 2023-07-25T14:36:52.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:52.359+0000 7f5f06ffd700 1 --2- 172.21.15.72:0/1248219793 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5ef0003a30 0x7f5ef0003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:52.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:52.359+0000 7f5f077fe700 1 --2- 172.21.15.72:0/1248219793 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5ef0004de0 0x7f5ef0005260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:52.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:52.359+0000 7f5f067fc700 1 --2- 172.21.15.72:0/1248219793 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5f080c2330 0x7f5ef0004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:52.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:52.359+0000 7f5f06ffd700 1 -- 172.21.15.72:0/1248219793 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5f080c2330 msgr2=0x7f5ef0004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:52.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:52.359+0000 7f5f06ffd700 1 --2- 172.21.15.72:0/1248219793 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5f080c2330 0x7f5ef0004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:52.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:52.359+0000 7f5f06ffd700 1 -- 172.21.15.72:0/1248219793 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5ef0004de0 msgr2=0x7f5ef0005260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:52.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:52.359+0000 7f5f06ffd700 1 --2- 172.21.15.72:0/1248219793 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5ef0004de0 0x7f5ef0005260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:52.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:52.359+0000 7f5f06ffd700 1 -- 172.21.15.72:0/1248219793 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ef00035b0 con 0x7f5ef0003a30 2023-07-25T14:36:52.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:52.359+0000 7f5f06ffd700 1 --2- 172.21.15.72:0/1248219793 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5ef0003a30 0x7f5ef0003e50 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f5efc009860 tx=0x7f5ef0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e42177c091f7db49 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:52.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:52.360+0000 7f5f05ffb700 1 -- 172.21.15.72:0/1248219793 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5efc00c070 con 0x7f5ef0003a30 2023-07-25T14:36:52.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:52.360+0000 7f5f05ffb700 1 -- 172.21.15.72:0/1248219793 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5efc013610 con 0x7f5ef0003a30 2023-07-25T14:36:52.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:52.360+0000 7f5f05ffb700 1 -- 172.21.15.72:0/1248219793 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5efc0139a0 con 0x7f5ef0003a30 2023-07-25T14:36:52.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:52.360+0000 7f5f0d6e3700 1 -- 172.21.15.72:0/1248219793 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5ef0003a30 msgr2=0x7f5ef0003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:52.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:52.360+0000 7f5f0d6e3700 1 --2- 172.21.15.72:0/1248219793 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5ef0003a30 0x7f5ef0003e50 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f5efc009860 tx=0x7f5ef0005880 comp rx=0 tx=0).stop 2023-07-25T14:36:52.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:52.360+0000 7f5f077fe700 1 -- 172.21.15.72:0/1248219793 reap_dead start 2023-07-25T14:36:52.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:52.360+0000 7f5f0d6e3700 1 -- 172.21.15.72:0/1248219793 shutdown_connections 2023-07-25T14:36:52.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:52.360+0000 7f5f0d6e3700 1 -- 172.21.15.72:0/1248219793 >> 172.21.15.72:0/1248219793 conn(0x7f5f080a7510 msgr2=0x7f5f080a78f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:52.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:52.360+0000 7f5f0d6e3700 1 -- 172.21.15.72:0/1248219793 shutdown_connections 2023-07-25T14:36:52.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:52.360+0000 7f5f0d6e3700 1 -- 172.21.15.72:0/1248219793 wait complete. 2023-07-25T14:36:52.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:52.361+0000 7f5f0d6e3700 1 Processor -- start 2023-07-25T14:36:52.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:52.362+0000 7f5f0d6e3700 1 -- start start 2023-07-25T14:36:52.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:52.362+0000 7f5f0d6e3700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5ef0003a30 0x7f5f080c3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:52.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:52.362+0000 7f5f0d6e3700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5f080c4360 0x7f5f0814e440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:52.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:52.362+0000 7f5f0d6e3700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5f0814e980 0x7f5f08070bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:52.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:52.362+0000 7f5f0d6e3700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f080c4ce0 con 0x7f5ef0003a30 2023-07-25T14:36:52.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:52.362+0000 7f5f0d6e3700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f08072580 con 0x7f5f080c4360 2023-07-25T14:36:52.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:52.362+0000 7f5f0d6e3700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f08070760 con 0x7f5f0814e980 2023-07-25T14:36:52.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:52.362+0000 7f5f06ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5ef0003a30 0x7f5f080c3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:52.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:52.362+0000 7f5f06ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5ef0003a30 0x7f5f080c3ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:41992/0 (socket says 172.21.15.72:41992) 2023-07-25T14:36:52.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:52.362+0000 7f5f06ffd700 1 -- 172.21.15.72:0/1876526273 learned_addr learned my addr 172.21.15.72:0/1876526273 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:52.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:52.363+0000 7f5f06ffd700 1 -- 172.21.15.72:0/1876526273 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5f0814e980 msgr2=0x7f5f08070bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:52.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:52.363+0000 7f5f06ffd700 1 --2- 172.21.15.72:0/1876526273 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5f0814e980 0x7f5f08070bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:52.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:52.363+0000 7f5f06ffd700 1 -- 172.21.15.72:0/1876526273 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5f080c4360 msgr2=0x7f5f0814e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:52.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:52.363+0000 7f5f067fc700 1 --2- 172.21.15.72:0/1876526273 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5f080c4360 0x7f5f0814e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:52.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:52.363+0000 7f5f06ffd700 1 --2- 172.21.15.72:0/1876526273 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5f080c4360 0x7f5f0814e440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:52.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:52.363+0000 7f5f06ffd700 1 -- 172.21.15.72:0/1876526273 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f080c4a00 con 0x7f5ef0003a30 2023-07-25T14:36:52.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:52.363+0000 7f5f06ffd700 1 --2- 172.21.15.72:0/1876526273 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5ef0003a30 0x7f5f080c3ac0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f5efc009e50 tx=0x7f5efc0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:52.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:52.363+0000 7f5eef7fe700 1 -- 172.21.15.72:0/1876526273 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5efc013b90 con 0x7f5ef0003a30 2023-07-25T14:36:52.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:52.363+0000 7f5eef7fe700 1 -- 172.21.15.72:0/1876526273 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5efc013d30 con 0x7f5ef0003a30 2023-07-25T14:36:52.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:52.363+0000 7f5f0d6e3700 1 -- 172.21.15.72:0/1876526273 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f081e9f20 con 0x7f5ef0003a30 2023-07-25T14:36:52.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:52.363+0000 7f5eef7fe700 1 -- 172.21.15.72:0/1876526273 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5efc013ea0 con 0x7f5ef0003a30 2023-07-25T14:36:52.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:52.363+0000 7f5f0d6e3700 1 -- 172.21.15.72:0/1876526273 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f080c4000 con 0x7f5ef0003a30 2023-07-25T14:36:52.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:52.364+0000 7f5f0d6e3700 1 -- 172.21.15.72:0/1876526273 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f0804e470 con 0x7f5ef0003a30 2023-07-25T14:36:52.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:52.364+0000 7f5eef7fe700 1 -- 172.21.15.72:0/1876526273 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5efc0038e0 con 0x7f5ef0003a30 2023-07-25T14:36:52.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:52.365+0000 7f5eef7fe700 1 --2- 172.21.15.72:0/1876526273 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f5ef406ace0 0x7f5ef406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:52.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:52.365+0000 7f5eef7fe700 1 -- 172.21.15.72:0/1876526273 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f5efc08a5d0 con 0x7f5ef0003a30 2023-07-25T14:36:52.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:52.365+0000 7f5f067fc700 1 --2- 172.21.15.72:0/1876526273 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f5ef406ace0 0x7f5ef406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:52.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:52.365+0000 7f5f067fc700 1 --2- 172.21.15.72:0/1876526273 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f5ef406ace0 0x7f5ef406d1a0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f5f080a7f80 tx=0x7f5ef8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:52.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:52.369+0000 7f5eef7fe700 1 -- 172.21.15.72:0/1876526273 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f5efc055680 con 0x7f5ef0003a30 2023-07-25T14:36:52.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:52.599+0000 7f5f0d6e3700 1 -- 172.21.15.72:0/1876526273 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f5f081e9d10 con 0x7f5ef0003a30 2023-07-25T14:36:53.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:53.214+0000 7f5eef7fe700 1 -- 172.21.15.72:0/1876526273 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v17) v1 ==== 122+0+0 (secure 0 0 0) 0x7f5efc058ca0 con 0x7f5ef0003a30 2023-07-25T14:36:53.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:53.216+0000 7f5f0d6e3700 1 -- 172.21.15.72:0/1876526273 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f5ef406ace0 msgr2=0x7f5ef406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:53.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:53.216+0000 7f5f0d6e3700 1 --2- 172.21.15.72:0/1876526273 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f5ef406ace0 0x7f5ef406d1a0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f5f080a7f80 tx=0x7f5ef8009040 comp rx=0 tx=0).stop 2023-07-25T14:36:53.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:53.216+0000 7f5f0d6e3700 1 -- 172.21.15.72:0/1876526273 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5ef0003a30 msgr2=0x7f5f080c3ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:53.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:53.216+0000 7f5f0d6e3700 1 --2- 172.21.15.72:0/1876526273 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5ef0003a30 0x7f5f080c3ac0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f5efc009e50 tx=0x7f5efc0047c0 comp rx=0 tx=0).stop 2023-07-25T14:36:53.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:53.216+0000 7f5f0d6e3700 1 -- 172.21.15.72:0/1876526273 shutdown_connections 2023-07-25T14:36:53.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:53.216+0000 7f5f0d6e3700 1 --2- 172.21.15.72:0/1876526273 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f5ef406ace0 0x7f5ef406d1a0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:53.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:53.216+0000 7f5f0d6e3700 1 --2- 172.21.15.72:0/1876526273 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5f0814e980 0x7f5f08070bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:53.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:53.216+0000 7f5f0d6e3700 1 --2- 172.21.15.72:0/1876526273 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5ef0003a30 0x7f5f080c3ac0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:53.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:53.216+0000 7f5f0d6e3700 1 --2- 172.21.15.72:0/1876526273 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5f080c4360 0x7f5f0814e440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:53.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:53.216+0000 7f5f0d6e3700 1 -- 172.21.15.72:0/1876526273 >> 172.21.15.72:0/1876526273 conn(0x7f5f080a7510 msgr2=0x7f5f080a5870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:53.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:53.216+0000 7f5f0d6e3700 1 -- 172.21.15.72:0/1876526273 shutdown_connections 2023-07-25T14:36:53.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:53.216+0000 7f5f0d6e3700 1 -- 172.21.15.72:0/1876526273 wait complete. 2023-07-25T14:36:53.241 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-07-25T14:36:53.242 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-25T14:36:53.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:53.352+0000 7fa4e455e700 1 Processor -- start 2023-07-25T14:36:53.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:53.352+0000 7fa4e455e700 1 -- start start 2023-07-25T14:36:53.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:53.353+0000 7fa4e455e700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa4dc151950 0x7fa4dc06a190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:53.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:53.353+0000 7fa4e455e700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fa4dc0724c0 0x7fa4dc0c34c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:53.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:53.353+0000 7fa4e455e700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4dc0c2fe0 con 0x7fa4dc06a6d0 2023-07-25T14:36:53.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:53.353+0000 7fa4e455e700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4dc071a60 con 0x7fa4dc0724c0 2023-07-25T14:36:53.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:53.353+0000 7fa4e455e700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4dc0c2a70 con 0x7fa4dc151950 2023-07-25T14:36:53.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:53.353+0000 7fa4e22fa700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa4dc151950 0x7fa4dc06a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:53.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:53.353+0000 7fa4e1af9700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fa4dc0724c0 0x7fa4dc0c34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:53.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:53.353+0000 7fa4e1af9700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fa4dc0724c0 0x7fa4dc0c34c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.72:37572/0 (socket says 172.21.15.72:37572) 2023-07-25T14:36:53.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:53.353+0000 7fa4e22fa700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa4dc151950 0x7fa4dc06a190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3301/0 says I am v2:172.21.15.72:47228/0 (socket says 172.21.15.72:47228) 2023-07-25T14:36:53.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:53.353+0000 7fa4e1af9700 1 -- 172.21.15.72:0/2924854057 learned_addr learned my addr 172.21.15.72:0/2924854057 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:53.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:53.353+0000 7fa4e2afb700 1 --1- 172.21.15.72:0/2924854057 >> v1:172.21.15.92:6789/0 conn(0x7fa4dc06a6d0 0x7fa4dc0c3a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.72:56312/0 (socket says 172.21.15.72:56312) 2023-07-25T14:36:53.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:53.354+0000 7fa4e22fa700 1 -- 172.21.15.72:0/2924854057 >> v2:172.21.15.92:3300/0 conn(0x7fa4dc0724c0 msgr2=0x7fa4dc0c34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:53.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:53.354+0000 7fa4e22fa700 1 --2- 172.21.15.72:0/2924854057 >> v2:172.21.15.92:3300/0 conn(0x7fa4dc0724c0 0x7fa4dc0c34c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:53.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:53.354+0000 7fa4e22fa700 1 -- 172.21.15.72:0/2924854057 >> v1:172.21.15.92:6789/0 conn(0x7fa4dc06a6d0 legacy=0x7fa4dc0c3a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:53.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:53.354+0000 7fa4e22fa700 1 -- 172.21.15.72:0/2924854057 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4dc155070 con 0x7fa4dc151950 2023-07-25T14:36:53.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:53.354+0000 7fa4e1af9700 1 --2- 172.21.15.72:0/2924854057 >> v2:172.21.15.92:3300/0 conn(0x7fa4dc0724c0 0x7fa4dc0c34c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-25T14:36:53.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:53.354+0000 7fa4e22fa700 1 --2- 172.21.15.72:0/2924854057 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa4dc151950 0x7fa4dc06a190 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fa4d0009840 tx=0x7fa4d0009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=669f30b49ff2232f server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:53.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:53.354+0000 7fa4e12f8700 1 -- 172.21.15.72:0/2924854057 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4d0011830 con 0x7fa4dc151950 2023-07-25T14:36:53.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:53.354+0000 7fa4e12f8700 1 -- 172.21.15.72:0/2924854057 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4d0011990 con 0x7fa4dc151950 2023-07-25T14:36:53.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:53.354+0000 7fa4e12f8700 1 -- 172.21.15.72:0/2924854057 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4d0011d20 con 0x7fa4dc151950 2023-07-25T14:36:53.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:53.355+0000 7fa4e455e700 1 -- 172.21.15.72:0/2924854057 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa4dc151950 msgr2=0x7fa4dc06a190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:53.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:53.355+0000 7fa4e455e700 1 --2- 172.21.15.72:0/2924854057 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa4dc151950 0x7fa4dc06a190 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fa4d0009840 tx=0x7fa4d0009b50 comp rx=0 tx=0).stop 2023-07-25T14:36:53.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:53.355+0000 7fa4e455e700 1 -- 172.21.15.72:0/2924854057 shutdown_connections 2023-07-25T14:36:53.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:53.355+0000 7fa4e455e700 1 --2- 172.21.15.72:0/2924854057 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa4dc151950 0x7fa4dc06a190 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:53.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:53.355+0000 7fa4e455e700 1 --2- 172.21.15.72:0/2924854057 >> v2:172.21.15.92:3300/0 conn(0x7fa4dc0724c0 0x7fa4dc0c34c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:53.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:53.355+0000 7fa4e455e700 1 -- 172.21.15.72:0/2924854057 >> 172.21.15.72:0/2924854057 conn(0x7fa4dc0a87e0 msgr2=0x7fa4dc0a8bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:53.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:53.355+0000 7fa4e455e700 1 -- 172.21.15.72:0/2924854057 shutdown_connections 2023-07-25T14:36:53.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:53.355+0000 7fa4e455e700 1 -- 172.21.15.72:0/2924854057 wait complete. 2023-07-25T14:36:53.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:53.356+0000 7fa4e455e700 1 Processor -- start 2023-07-25T14:36:53.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:53.356+0000 7fa4e455e700 1 -- start start 2023-07-25T14:36:53.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:53.356+0000 7fa4e455e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa4dc06a6d0 0x7fa4dc0a6be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:53.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:53.356+0000 7fa4e455e700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa4dc0724c0 0x7fa4dc1568b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:53.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:53.356+0000 7fa4e455e700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa4dc151950 0x7fa4dc156df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:53.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:53.356+0000 7fa4e455e700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4dc0bf770 con 0x7fa4dc06a6d0 2023-07-25T14:36:53.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:53.356+0000 7fa4e455e700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4dc1580c0 con 0x7fa4dc151950 2023-07-25T14:36:53.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:53.356+0000 7fa4e455e700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4dc157330 con 0x7fa4dc0724c0 2023-07-25T14:36:53.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:53.357+0000 7fa4e22fa700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa4dc06a6d0 0x7fa4dc0a6be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:53.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:53.357+0000 7fa4e22fa700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa4dc06a6d0 0x7fa4dc0a6be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42004/0 (socket says 172.21.15.72:42004) 2023-07-25T14:36:53.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:53.357+0000 7fa4e22fa700 1 -- 172.21.15.72:0/3820062556 learned_addr learned my addr 172.21.15.72:0/3820062556 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:53.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:53.357+0000 7fa4e2afb700 1 --2- 172.21.15.72:0/3820062556 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa4dc151950 0x7fa4dc156df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:53.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:53.357+0000 7fa4e1af9700 1 --2- 172.21.15.72:0/3820062556 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa4dc0724c0 0x7fa4dc1568b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:53.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:53.357+0000 7fa4e22fa700 1 -- 172.21.15.72:0/3820062556 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa4dc0724c0 msgr2=0x7fa4dc1568b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:53.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:53.357+0000 7fa4e22fa700 1 --2- 172.21.15.72:0/3820062556 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa4dc0724c0 0x7fa4dc1568b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:53.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:53.357+0000 7fa4e22fa700 1 -- 172.21.15.72:0/3820062556 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa4dc151950 msgr2=0x7fa4dc156df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:53.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:53.357+0000 7fa4e22fa700 1 --2- 172.21.15.72:0/3820062556 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa4dc151950 0x7fa4dc156df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:53.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:53.357+0000 7fa4e22fa700 1 -- 172.21.15.72:0/3820062556 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4d8009550 con 0x7fa4dc06a6d0 2023-07-25T14:36:53.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:53.357+0000 7fa4e22fa700 1 --2- 172.21.15.72:0/3820062556 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa4dc06a6d0 0x7fa4dc0a6be0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fa4d0009fd0 tx=0x7fa4d0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:53.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:53.357+0000 7fa4ceffd700 1 -- 172.21.15.72:0/3820062556 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4d00036a0 con 0x7fa4dc06a6d0 2023-07-25T14:36:53.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:53.357+0000 7fa4ceffd700 1 -- 172.21.15.72:0/3820062556 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4d001e070 con 0x7fa4dc06a6d0 2023-07-25T14:36:53.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:53.357+0000 7fa4ceffd700 1 -- 172.21.15.72:0/3820062556 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4d0003a40 con 0x7fa4dc06a6d0 2023-07-25T14:36:53.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:53.357+0000 7fa4e455e700 1 -- 172.21.15.72:0/3820062556 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4d00094a0 con 0x7fa4dc06a6d0 2023-07-25T14:36:53.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:53.357+0000 7fa4e455e700 1 -- 172.21.15.72:0/3820062556 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4dc1e9cb0 con 0x7fa4dc06a6d0 2023-07-25T14:36:53.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:53.358+0000 7fa4e455e700 1 -- 172.21.15.72:0/3820062556 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4dc0bf8b0 con 0x7fa4dc06a6d0 2023-07-25T14:36:53.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:53.359+0000 7fa4ceffd700 1 -- 172.21.15.72:0/3820062556 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa4d0003ba0 con 0x7fa4dc06a6d0 2023-07-25T14:36:53.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:53.359+0000 7fa4ceffd700 1 --2- 172.21.15.72:0/3820062556 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fa4c006ace0 0x7fa4c006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:53.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:53.359+0000 7fa4ceffd700 1 -- 172.21.15.72:0/3820062556 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fa4d008a440 con 0x7fa4dc06a6d0 2023-07-25T14:36:53.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:53.359+0000 7fa4e1af9700 1 --2- 172.21.15.72:0/3820062556 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fa4c006ace0 0x7fa4c006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:53.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:53.359+0000 7fa4e1af9700 1 --2- 172.21.15.72:0/3820062556 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fa4c006ace0 0x7fa4c006d1a0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fa4dc14fe60 tx=0x7fa4d80092c0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:53.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:53.363+0000 7fa4ceffd700 1 -- 172.21.15.72:0/3820062556 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fa4d0055440 con 0x7fa4dc06a6d0 2023-07-25T14:36:53.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:53.594+0000 7fa4e455e700 1 -- 172.21.15.72:0/3820062556 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa4dc04e470 con 0x7fa4dc06a6d0 2023-07-25T14:36:53.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:53.595+0000 7fa4ceffd700 1 -- 172.21.15.72:0/3820062556 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4668 (secure 0 0 0) 0x7fa4d0020090 con 0x7fa4dc06a6d0 2023-07-25T14:36:53.607 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-25T14:36:53.607 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5092,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6834/3640355071","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":3640355071},{"type":"v1","addr":"172.21.15.92:6834","nonce":3640355071}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5095,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/936080292","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6833","nonce":936080292},{"type":"v1","addr":"172.21.15.92:6835","nonce":936080292}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5328,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6836/2944832990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":2944832990},{"type":"v1","addr":"172.21.15.72:6836","nonce":2944832990}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-25T14:36:49.567868+0000","modified":"2023-07-25T14:36:53.213193+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5331},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5331":{"gid":5331,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.72:6837/1193027887","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6835","nonce":1193027887},{"type":"v1","addr":"172.21.15.72:6837","nonce":1193027887}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-07-25T14:36:53.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:53.597+0000 7fa4e455e700 1 -- 172.21.15.72:0/3820062556 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fa4c006ace0 msgr2=0x7fa4c006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:53.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:53.597+0000 7fa4e455e700 1 --2- 172.21.15.72:0/3820062556 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fa4c006ace0 0x7fa4c006d1a0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fa4dc14fe60 tx=0x7fa4d80092c0 comp rx=0 tx=0).stop 2023-07-25T14:36:53.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:53.597+0000 7fa4e455e700 1 -- 172.21.15.72:0/3820062556 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa4dc06a6d0 msgr2=0x7fa4dc0a6be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:53.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:53.597+0000 7fa4e455e700 1 --2- 172.21.15.72:0/3820062556 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa4dc06a6d0 0x7fa4dc0a6be0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fa4d0009fd0 tx=0x7fa4d0004750 comp rx=0 tx=0).stop 2023-07-25T14:36:53.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:53.597+0000 7fa4e455e700 1 -- 172.21.15.72:0/3820062556 shutdown_connections 2023-07-25T14:36:53.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:53.597+0000 7fa4e455e700 1 --2- 172.21.15.72:0/3820062556 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fa4c006ace0 0x7fa4c006d1a0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:53.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:53.597+0000 7fa4e455e700 1 --2- 172.21.15.72:0/3820062556 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa4dc151950 0x7fa4dc156df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:53.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:53.597+0000 7fa4e455e700 1 --2- 172.21.15.72:0/3820062556 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa4dc06a6d0 0x7fa4dc0a6be0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:53.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:53.597+0000 7fa4e455e700 1 --2- 172.21.15.72:0/3820062556 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa4dc0724c0 0x7fa4dc1568b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:53.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:53.597+0000 7fa4e455e700 1 -- 172.21.15.72:0/3820062556 >> 172.21.15.72:0/3820062556 conn(0x7fa4dc0a87e0 msgr2=0x7fa4dc14ecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:53.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:53.597+0000 7fa4e455e700 1 -- 172.21.15.72:0/3820062556 shutdown_connections 2023-07-25T14:36:53.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:53.597+0000 7fa4e455e700 1 -- 172.21.15.72:0/3820062556 wait complete. 2023-07-25T14:36:53.610 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 17 2023-07-25T14:36:53.620 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-25T14:36:53.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:53.728+0000 7f35411c5700 1 Processor -- start 2023-07-25T14:36:53.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:53.728+0000 7f35411c5700 1 -- start start 2023-07-25T14:36:53.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:53.729+0000 7f35411c5700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f353c151950 0x7f353c06a190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:53.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:53.729+0000 7f35411c5700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f353c0c2fe0 con 0x7f353c0724c0 2023-07-25T14:36:53.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:53.729+0000 7f35411c5700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f353c155070 con 0x7f353c06a6d0 2023-07-25T14:36:53.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:53.729+0000 7f35411c5700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f353c071a60 con 0x7f353c151950 2023-07-25T14:36:53.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:53.729+0000 7f353ad9d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f353c151950 0x7f353c06a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:53.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:53.729+0000 7f353ad9d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f353c151950 0x7f353c06a190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42012/0 (socket says 172.21.15.72:42012) 2023-07-25T14:36:53.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:53.729+0000 7f353a59c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f353c0724c0 0x7f353c0c34c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:60982/0 (socket says 172.21.15.72:60982) 2023-07-25T14:36:53.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:53.729+0000 7f353ad9d700 1 -- 172.21.15.72:0/2377577792 learned_addr learned my addr 172.21.15.72:0/2377577792 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:53.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:53.729+0000 7f353ad9d700 1 -- 172.21.15.72:0/2377577792 >> v1:172.21.15.92:6789/0 conn(0x7f353c06a6d0 legacy=0x7f353c0c3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:53.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:53.729+0000 7f353ad9d700 1 -- 172.21.15.72:0/2377577792 >> v1:172.21.15.72:6789/0 conn(0x7f353c0724c0 legacy=0x7f353c0c34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:53.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:53.729+0000 7f353ad9d700 1 -- 172.21.15.72:0/2377577792 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f353c0c15c0 con 0x7f353c151950 2023-07-25T14:36:53.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:53.730+0000 7f353ad9d700 1 --2- 172.21.15.72:0/2377577792 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f353c151950 0x7f353c06a190 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f35300098f0 tx=0x7f3530009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b311c1bdd95c7d2 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:53.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:53.730+0000 7f3539d9b700 1 -- 172.21.15.72:0/2377577792 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f353000b8a0 con 0x7f353c151950 2023-07-25T14:36:53.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:53.730+0000 7f3539d9b700 1 -- 172.21.15.72:0/2377577792 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f353000ba00 con 0x7f353c151950 2023-07-25T14:36:53.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:53.730+0000 7f3539d9b700 1 -- 172.21.15.72:0/2377577792 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f353000bd90 con 0x7f353c151950 2023-07-25T14:36:53.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:53.730+0000 7f35411c5700 1 -- 172.21.15.72:0/2377577792 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f353c151950 msgr2=0x7f353c06a190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:53.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:53.730+0000 7f35411c5700 1 --2- 172.21.15.72:0/2377577792 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f353c151950 0x7f353c06a190 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f35300098f0 tx=0x7f3530009c00 comp rx=0 tx=0).stop 2023-07-25T14:36:53.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:53.730+0000 7f35411c5700 1 -- 172.21.15.72:0/2377577792 shutdown_connections 2023-07-25T14:36:53.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:53.730+0000 7f35411c5700 1 --2- 172.21.15.72:0/2377577792 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f353c151950 0x7f353c06a190 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:53.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:53.730+0000 7f35411c5700 1 -- 172.21.15.72:0/2377577792 >> 172.21.15.72:0/2377577792 conn(0x7f353c0a87e0 msgr2=0x7f353c0a8bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:53.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:53.730+0000 7f35411c5700 1 -- 172.21.15.72:0/2377577792 shutdown_connections 2023-07-25T14:36:53.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:53.730+0000 7f35411c5700 1 -- 172.21.15.72:0/2377577792 wait complete. 2023-07-25T14:36:53.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:53.732+0000 7f35411c5700 1 Processor -- start 2023-07-25T14:36:53.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:53.732+0000 7f35411c5700 1 -- start start 2023-07-25T14:36:53.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:53.732+0000 7f35411c5700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f353c06a6d0 0x7f353c14e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:53.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:53.732+0000 7f35411c5700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f353c0724c0 0x7f353c0a7310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:53.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:53.732+0000 7f35411c5700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f353c151950 0x7f353c1ed650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:53.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:53.732+0000 7f35411c5700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f353c1e9e00 con 0x7f353c06a6d0 2023-07-25T14:36:53.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:53.732+0000 7f35411c5700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f353c14ed30 con 0x7f353c0724c0 2023-07-25T14:36:53.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:53.732+0000 7f35411c5700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f353c0c7620 con 0x7f353c151950 2023-07-25T14:36:53.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:53.733+0000 7f353ad9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f353c06a6d0 0x7f353c14e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:53.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:53.733+0000 7f353ad9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f353c06a6d0 0x7f353c14e7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42018/0 (socket says 172.21.15.72:42018) 2023-07-25T14:36:53.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:53.733+0000 7f353ad9d700 1 -- 172.21.15.72:0/2221107469 learned_addr learned my addr 172.21.15.72:0/2221107469 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:53.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:53.733+0000 7f353b59e700 1 --2- 172.21.15.72:0/2221107469 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f353c151950 0x7f353c1ed650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:53.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:53.733+0000 7f353a59c700 1 --2- 172.21.15.72:0/2221107469 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f353c0724c0 0x7f353c0a7310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:53.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:53.733+0000 7f353ad9d700 1 -- 172.21.15.72:0/2221107469 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f353c151950 msgr2=0x7f353c1ed650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:53.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:53.733+0000 7f353ad9d700 1 --2- 172.21.15.72:0/2221107469 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f353c151950 0x7f353c1ed650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:53.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:53.733+0000 7f353ad9d700 1 -- 172.21.15.72:0/2221107469 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f353c0724c0 msgr2=0x7f353c0a7310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:53.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:53.733+0000 7f353ad9d700 1 --2- 172.21.15.72:0/2221107469 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f353c0724c0 0x7f353c0a7310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:53.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:53.733+0000 7f353ad9d700 1 -- 172.21.15.72:0/2221107469 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3530009550 con 0x7f353c06a6d0 2023-07-25T14:36:53.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:53.733+0000 7f353ad9d700 1 --2- 172.21.15.72:0/2221107469 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f353c06a6d0 0x7f353c14e7f0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f3530014040 tx=0x7f3530004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:53.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:53.733+0000 7f35237fe700 1 -- 172.21.15.72:0/2221107469 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35300036a0 con 0x7f353c06a6d0 2023-07-25T14:36:53.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:53.733+0000 7f35237fe700 1 -- 172.21.15.72:0/2221107469 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f353001e070 con 0x7f353c06a6d0 2023-07-25T14:36:53.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:53.733+0000 7f35237fe700 1 -- 172.21.15.72:0/2221107469 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3530003a60 con 0x7f353c06a6d0 2023-07-25T14:36:53.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:53.733+0000 7f35411c5700 1 -- 172.21.15.72:0/2221107469 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f353c0a9980 con 0x7f353c06a6d0 2023-07-25T14:36:53.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:53.733+0000 7f35411c5700 1 -- 172.21.15.72:0/2221107469 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f353c0c6fd0 con 0x7f353c06a6d0 2023-07-25T14:36:53.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:53.734+0000 7f35411c5700 1 -- 172.21.15.72:0/2221107469 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f353c1ed4a0 con 0x7f353c06a6d0 2023-07-25T14:36:53.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:53.734+0000 7f35237fe700 1 -- 172.21.15.72:0/2221107469 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3530003bc0 con 0x7f353c06a6d0 2023-07-25T14:36:53.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:53.735+0000 7f35237fe700 1 --2- 172.21.15.72:0/2221107469 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f352806ace0 0x7f352806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:53.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:53.735+0000 7f35237fe700 1 -- 172.21.15.72:0/2221107469 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f3530020070 con 0x7f353c06a6d0 2023-07-25T14:36:53.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:53.735+0000 7f353a59c700 1 --2- 172.21.15.72:0/2221107469 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f352806ace0 0x7f352806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:53.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:53.735+0000 7f353a59c700 1 --2- 172.21.15.72:0/2221107469 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f352806ace0 0x7f352806d1a0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f353c153e70 tx=0x7f352c007d30 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:53.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:53.739+0000 7f35237fe700 1 -- 172.21.15.72:0/2221107469 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f3530055b30 con 0x7f353c06a6d0 2023-07-25T14:36:53.939 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:53.927+0000 7f35411c5700 1 -- 172.21.15.72:0/2221107469 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f353c154cd0 con 0x7f353c06a6d0 2023-07-25T14:36:53.940 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:53.928+0000 7f35237fe700 1 -- 172.21.15.72:0/2221107469 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+18394 (secure 0 0 0) 0x7f353002a090 con 0x7f353c06a6d0 2023-07-25T14:36:53.940 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-25T14:36:53.941 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":39,"fsid":"9170db48-9170-43e8-8ccb-9813e6240906","created":"2023-07-25T14:35:21.733262+0000","modified":"2023-07-25T14:36:51.193587+0000","last_up_change":"2023-07-25T14:35:31.355010+0000","last_in_change":"2023-07-25T14:35:24.195785+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-25T14:35:32.983457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-25T14:35:33.326342+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-07-25T14:36:47.694223+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-07-25T14:36:48.536715+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d517fdad-0bfe-49f0-89f2-9421c3761839","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6801","nonce":2475407414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6803","nonce":2475407414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6807","nonce":2475407414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6805","nonce":2475407414}]},"public_addr":"172.21.15.72:6801/2475407414","cluster_addr":"172.21.15.72:6803/2475407414","heartbeat_back_addr":"172.21.15.72:6807/2475407414","heartbeat_front_addr":"172.21.15.72:6805/2475407414","state":["exists","up"]},{"osd":1,"uuid":"e1564be3-f209-47e5-a8d0-32fc618a474f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6822","nonce":870954016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6825","nonce":870954016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6831","nonce":870954016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6827","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6829","nonce":870954016}]},"public_addr":"172.21.15.72:6822/870954016","cluster_addr":"172.21.15.72:6825/870954016","heartbeat_back_addr":"172.21.15.72:6831/870954016","heartbeat_front_addr":"172.21.15.72:6829/870954016","state":["exists","up"]},{"osd":2,"uuid":"c4647d30-ffa6-417a-9026-ef530c75910e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6809","nonce":2143129442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6811","nonce":2143129442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6815","nonce":2143129442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6813","nonce":2143129442}]},"public_addr":"172.21.15.72:6809/2143129442","cluster_addr":"172.21.15.72:6811/2143129442","heartbeat_back_addr":"172.21.15.72:6815/2143129442","heartbeat_front_addr":"172.21.15.72:6813/2143129442","state":["exists","up"]},{"osd":3,"uuid":"76c9d9a7-c2e2-4612-a58b-d6882dd76b58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6817","nonce":3404066311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6819","nonce":3404066311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6828","nonce":3404066311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6821","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6823","nonce":3404066311}]},"public_addr":"172.21.15.72:6817/3404066311","cluster_addr":"172.21.15.72:6819/3404066311","heartbeat_back_addr":"172.21.15.72:6828/3404066311","heartbeat_front_addr":"172.21.15.72:6823/3404066311","state":["exists","up"]},{"osd":4,"uuid":"7f8920dc-0ad4-4a73-ab40-65408f83eadd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6817","nonce":2381008739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6819","nonce":2381008739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6825","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6827","nonce":2381008739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6822","nonce":2381008739}]},"public_addr":"172.21.15.92:6817/2381008739","cluster_addr":"172.21.15.92:6819/2381008739","heartbeat_back_addr":"172.21.15.92:6827/2381008739","heartbeat_front_addr":"172.21.15.92:6822/2381008739","state":["exists","up"]},{"osd":5,"uuid":"56257e7c-31eb-44c5-9ec7-1318a4e0bb35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6801","nonce":2161935604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6803","nonce":2161935604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6807","nonce":2161935604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6805","nonce":2161935604}]},"public_addr":"172.21.15.92:6801/2161935604","cluster_addr":"172.21.15.92:6803/2161935604","heartbeat_back_addr":"172.21.15.92:6807/2161935604","heartbeat_front_addr":"172.21.15.92:6805/2161935604","state":["exists","up"]},{"osd":6,"uuid":"a150d3d8-a0c9-4955-968a-8d98eff4ffb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6809","nonce":3770163493}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6811","nonce":3770163493}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6815","nonce":3770163493}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6813","nonce":3770163493}]},"public_addr":"172.21.15.92:6809/3770163493","cluster_addr":"172.21.15.92:6811/3770163493","heartbeat_back_addr":"172.21.15.92:6815/3770163493","heartbeat_front_addr":"172.21.15.92:6813/3770163493","state":["exists","up"]},{"osd":7,"uuid":"07799c27-54ee-4591-a42d-a978d6b32065","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6821","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6823","nonce":2135777609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6826","nonce":2135777609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6831","nonce":2135777609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6829","nonce":2135777609}]},"public_addr":"172.21.15.92:6823/2135777609","cluster_addr":"172.21.15.92:6826/2135777609","heartbeat_back_addr":"172.21.15.92:6831/2135777609","heartbeat_front_addr":"172.21.15.92:6829/2135777609","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.345365+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.378150+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.146566+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.372172+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:30.398421+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.385632+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.465611+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.443583+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-25T14:36:53.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:53.930+0000 7f35411c5700 1 -- 172.21.15.72:0/2221107469 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f352806ace0 msgr2=0x7f352806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:53.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:53.930+0000 7f35411c5700 1 --2- 172.21.15.72:0/2221107469 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f352806ace0 0x7f352806d1a0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f353c153e70 tx=0x7f352c007d30 comp rx=0 tx=0).stop 2023-07-25T14:36:53.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:53.930+0000 7f35411c5700 1 -- 172.21.15.72:0/2221107469 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f353c06a6d0 msgr2=0x7f353c14e7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:53.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:53.930+0000 7f35411c5700 1 --2- 172.21.15.72:0/2221107469 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f353c06a6d0 0x7f353c14e7f0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f3530014040 tx=0x7f3530004750 comp rx=0 tx=0).stop 2023-07-25T14:36:53.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:53.930+0000 7f35411c5700 1 -- 172.21.15.72:0/2221107469 shutdown_connections 2023-07-25T14:36:53.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:53.930+0000 7f35411c5700 1 --2- 172.21.15.72:0/2221107469 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f352806ace0 0x7f352806d1a0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:53.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:53.931+0000 7f35411c5700 1 --2- 172.21.15.72:0/2221107469 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f353c151950 0x7f353c1ed650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:53.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:53.931+0000 7f35411c5700 1 --2- 172.21.15.72:0/2221107469 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f353c06a6d0 0x7f353c14e7f0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:53.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:53.931+0000 7f35411c5700 1 --2- 172.21.15.72:0/2221107469 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f353c0724c0 0x7f353c0a7310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:53.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:53.931+0000 7f35411c5700 1 -- 172.21.15.72:0/2221107469 >> 172.21.15.72:0/2221107469 conn(0x7f353c0a87e0 msgr2=0x7f353c150190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:53.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:53.931+0000 7f35411c5700 1 -- 172.21.15.72:0/2221107469 shutdown_connections 2023-07-25T14:36:53.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:53.931+0000 7f35411c5700 1 -- 172.21.15.72:0/2221107469 wait complete. 2023-07-25T14:36:53.955 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-07-25T14:36:53.955 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-25T14:36:54.063 INFO:tasks.ceph.mds.a.smithi072.stderr:2023-07-25T14:36:54.051+0000 7f9af66c0700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-25T14:36:54.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.064+0000 7fe1649d9700 1 Processor -- start 2023-07-25T14:36:54.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.064+0000 7fe1649d9700 1 -- start start 2023-07-25T14:36:54.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.065+0000 7fe1649d9700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe160151950 0x7fe16006a190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:54.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.065+0000 7fe1649d9700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fe1600724c0 0x7fe1600c34c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:54.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.065+0000 7fe1649d9700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1600c2fe0 con 0x7fe16006a6d0 2023-07-25T14:36:54.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.065+0000 7fe1649d9700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe160071a60 con 0x7fe1600724c0 2023-07-25T14:36:54.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.065+0000 7fe1649d9700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1600c2a70 con 0x7fe160151950 2023-07-25T14:36:54.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.065+0000 7fe15ed9d700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fe16006a6d0 0x7fe1600c3a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:60998/0 (socket says 172.21.15.72:60998) 2023-07-25T14:36:54.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.065+0000 7fe15ed9d700 1 -- 172.21.15.72:0/1125069928 learned_addr learned my addr 172.21.15.72:0/1125069928 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:36:54.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.065+0000 7fe15dd9b700 1 --2- 172.21.15.72:0/1125069928 >> v2:172.21.15.92:3300/0 conn(0x7fe1600724c0 0x7fe1600c34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:54.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.065+0000 7fe15d59a700 1 -- 172.21.15.72:0/1125069928 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2778794316 0 0) 0x7fe1600c2fe0 con 0x7fe16006a6d0 2023-07-25T14:36:54.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.065+0000 7fe15e59c700 1 --2- 172.21.15.72:0/1125069928 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe160151950 0x7fe16006a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:54.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.065+0000 7fe15d59a700 1 -- 172.21.15.72:0/1125069928 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe1480035b0 con 0x7fe16006a6d0 2023-07-25T14:36:54.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.066+0000 7fe15d59a700 1 -- 172.21.15.72:0/1125069928 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2509968609 0 0) 0x7fe1480035b0 con 0x7fe16006a6d0 2023-07-25T14:36:54.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.066+0000 7fe15d59a700 1 -- 172.21.15.72:0/1125069928 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe160151950 msgr2=0x7fe16006a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:54.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.066+0000 7fe15d59a700 1 --2- 172.21.15.72:0/1125069928 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe160151950 0x7fe16006a190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:54.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.066+0000 7fe15d59a700 1 -- 172.21.15.72:0/1125069928 >> v2:172.21.15.92:3300/0 conn(0x7fe1600724c0 msgr2=0x7fe1600c34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:54.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.066+0000 7fe15d59a700 1 --2- 172.21.15.72:0/1125069928 >> v2:172.21.15.92:3300/0 conn(0x7fe1600724c0 0x7fe1600c34c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:54.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.066+0000 7fe15d59a700 1 -- 172.21.15.72:0/1125069928 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe160155070 con 0x7fe16006a6d0 2023-07-25T14:36:54.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.066+0000 7fe15d59a700 1 -- 172.21.15.72:0/1125069928 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2559588315 0 0) 0x7fe1580019f0 con 0x7fe16006a6d0 2023-07-25T14:36:54.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.066+0000 7fe15d59a700 1 -- 172.21.15.72:0/1125069928 >> v1:172.21.15.72:6789/0 conn(0x7fe16006a6d0 legacy=0x7fe1600c3a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:54.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.066+0000 7fe15d59a700 1 --2- 172.21.15.72:0/1125069928 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe148003a00 0x7fe148003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:54.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.066+0000 7fe15d59a700 1 --2- 172.21.15.72:0/1125069928 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe148004850 0x7fe148004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:54.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.066+0000 7fe15d59a700 1 --2- 172.21.15.72:0/1125069928 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe160151950 0x7fe148005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:54.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.066+0000 7fe15d59a700 1 -- 172.21.15.72:0/1125069928 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe160071a60 con 0x7fe148003a00 2023-07-25T14:36:54.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.066+0000 7fe15d59a700 1 -- 172.21.15.72:0/1125069928 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe14800ba10 con 0x7fe148004850 2023-07-25T14:36:54.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.066+0000 7fe15d59a700 1 -- 172.21.15.72:0/1125069928 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe14800bb50 con 0x7fe160151950 2023-07-25T14:36:54.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.066+0000 7fe15e59c700 1 --2- 172.21.15.72:0/1125069928 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe148003a00 0x7fe148003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:54.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.066+0000 7fe15dd9b700 1 --2- 172.21.15.72:0/1125069928 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe148004850 0x7fe148004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:54.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.066+0000 7fe15ed9d700 1 --2- 172.21.15.72:0/1125069928 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe160151950 0x7fe148005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:54.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.066+0000 7fe15e59c700 1 -- 172.21.15.72:0/1125069928 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe160151950 msgr2=0x7fe148005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:54.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.066+0000 7fe15e59c700 1 --2- 172.21.15.72:0/1125069928 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe160151950 0x7fe148005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:54.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.066+0000 7fe15e59c700 1 -- 172.21.15.72:0/1125069928 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe148004850 msgr2=0x7fe148004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:54.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.066+0000 7fe15e59c700 1 --2- 172.21.15.72:0/1125069928 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe148004850 0x7fe148004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:54.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.066+0000 7fe15e59c700 1 -- 172.21.15.72:0/1125069928 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1480035b0 con 0x7fe148003a00 2023-07-25T14:36:54.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.066+0000 7fe15dd9b700 1 --2- 172.21.15.72:0/1125069928 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe148004850 0x7fe148004cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-25T14:36:54.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.066+0000 7fe15e59c700 1 --2- 172.21.15.72:0/1125069928 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe148003a00 0x7fe148003e20 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fe154009b90 tx=0x7fe148005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f00cdc1e785f04af server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:54.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.066+0000 7fe15d59a700 1 -- 172.21.15.72:0/1125069928 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe15400e6c0 con 0x7fe148003a00 2023-07-25T14:36:54.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.066+0000 7fe15d59a700 1 -- 172.21.15.72:0/1125069928 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe15400e820 con 0x7fe148003a00 2023-07-25T14:36:54.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.066+0000 7fe15d59a700 1 -- 172.21.15.72:0/1125069928 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe15400eb90 con 0x7fe148003a00 2023-07-25T14:36:54.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.067+0000 7fe1649d9700 1 -- 172.21.15.72:0/1125069928 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe148003a00 msgr2=0x7fe148003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:54.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.067+0000 7fe1649d9700 1 --2- 172.21.15.72:0/1125069928 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe148003a00 0x7fe148003e20 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fe154009b90 tx=0x7fe148005880 comp rx=0 tx=0).stop 2023-07-25T14:36:54.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.067+0000 7fe15ed9d700 1 -- 172.21.15.72:0/1125069928 reap_dead start 2023-07-25T14:36:54.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.067+0000 7fe1649d9700 1 -- 172.21.15.72:0/1125069928 shutdown_connections 2023-07-25T14:36:54.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.067+0000 7fe1649d9700 1 -- 172.21.15.72:0/1125069928 >> 172.21.15.72:0/1125069928 conn(0x7fe1600a87e0 msgr2=0x7fe1600a8bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:54.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.067+0000 7fe1649d9700 1 -- 172.21.15.72:0/1125069928 shutdown_connections 2023-07-25T14:36:54.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.067+0000 7fe1649d9700 1 -- 172.21.15.72:0/1125069928 wait complete. 2023-07-25T14:36:54.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.069+0000 7fe1649d9700 1 Processor -- start 2023-07-25T14:36:54.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.069+0000 7fe1649d9700 1 -- start start 2023-07-25T14:36:54.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.070+0000 7fe1649d9700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe148003a00 0x7fe16006fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:54.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.070+0000 7fe1649d9700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe1601508a0 0x7fe160157e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:54.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.070+0000 7fe1649d9700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe1600aa7e0 0x7fe160158390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:54.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.070+0000 7fe1649d9700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe16014c590 con 0x7fe1601508a0 2023-07-25T14:36:54.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.070+0000 7fe1649d9700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1601e98b0 con 0x7fe1600aa7e0 2023-07-25T14:36:54.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.070+0000 7fe1649d9700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1601e9b90 con 0x7fe148003a00 2023-07-25T14:36:54.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.070+0000 7fe15dd9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe1601508a0 0x7fe160157e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:54.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.070+0000 7fe15dd9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe1601508a0 0x7fe160157e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42040/0 (socket says 172.21.15.72:42040) 2023-07-25T14:36:54.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.070+0000 7fe15dd9b700 1 -- 172.21.15.72:0/320287702 learned_addr learned my addr 172.21.15.72:0/320287702 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:54.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.070+0000 7fe15ed9d700 1 --2- 172.21.15.72:0/320287702 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe1600aa7e0 0x7fe160158390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:54.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.070+0000 7fe15e59c700 1 --2- 172.21.15.72:0/320287702 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe148003a00 0x7fe16006fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:54.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.070+0000 7fe15dd9b700 1 -- 172.21.15.72:0/320287702 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe148003a00 msgr2=0x7fe16006fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:54.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.070+0000 7fe15dd9b700 1 --2- 172.21.15.72:0/320287702 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe148003a00 0x7fe16006fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:54.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.070+0000 7fe15dd9b700 1 -- 172.21.15.72:0/320287702 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe1600aa7e0 msgr2=0x7fe160158390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:54.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.070+0000 7fe15dd9b700 1 --2- 172.21.15.72:0/320287702 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe1600aa7e0 0x7fe160158390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:54.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.070+0000 7fe15dd9b700 1 -- 172.21.15.72:0/320287702 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1601e9e70 con 0x7fe1601508a0 2023-07-25T14:36:54.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.070+0000 7fe15dd9b700 1 --2- 172.21.15.72:0/320287702 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe1601508a0 0x7fe160157e50 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fe1500118d0 tx=0x7fe150011be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:54.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.070+0000 7fe14effd700 1 -- 172.21.15.72:0/320287702 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe150004220 con 0x7fe1601508a0 2023-07-25T14:36:54.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.070+0000 7fe14effd700 1 -- 172.21.15.72:0/320287702 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe150004380 con 0x7fe1601508a0 2023-07-25T14:36:54.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.070+0000 7fe1649d9700 1 -- 172.21.15.72:0/320287702 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1601ea150 con 0x7fe1601508a0 2023-07-25T14:36:54.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.070+0000 7fe14effd700 1 -- 172.21.15.72:0/320287702 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1500036a0 con 0x7fe1601508a0 2023-07-25T14:36:54.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.070+0000 7fe1649d9700 1 -- 172.21.15.72:0/320287702 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe16006ffa0 con 0x7fe1601508a0 2023-07-25T14:36:54.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.071+0000 7fe1649d9700 1 -- 172.21.15.72:0/320287702 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe16004e470 con 0x7fe1601508a0 2023-07-25T14:36:54.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.072+0000 7fe14effd700 1 -- 172.21.15.72:0/320287702 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe150003800 con 0x7fe1601508a0 2023-07-25T14:36:54.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.072+0000 7fe14effd700 1 --2- 172.21.15.72:0/320287702 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fe14006ace0 0x7fe14006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:54.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.072+0000 7fe14effd700 1 -- 172.21.15.72:0/320287702 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fe150089530 con 0x7fe1601508a0 2023-07-25T14:36:54.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.072+0000 7fe15e59c700 1 --2- 172.21.15.72:0/320287702 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fe14006ace0 0x7fe14006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:54.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.073+0000 7fe15e59c700 1 --2- 172.21.15.72:0/320287702 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fe14006ace0 0x7fe14006d1a0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fe1540090b0 tx=0x7fe15401f040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:54.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.077+0000 7fe14effd700 1 -- 172.21.15.72:0/320287702 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fe150054490 con 0x7fe1601508a0 2023-07-25T14:36:54.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.263+0000 7fe1649d9700 1 -- 172.21.15.72:0/320287702 --> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe1601e9d00 con 0x7fe14006ace0 2023-07-25T14:36:54.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.271+0000 7fe14effd700 1 -- 172.21.15.72:0/320287702 <== mgr.4104 v2:172.21.15.72:6832/1171220306 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311175 (secure 0 0 0) 0x7fe1601e9d00 con 0x7fe14006ace0 2023-07-25T14:36:54.286 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-25T14:36:54.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.275+0000 7fe1649d9700 1 -- 172.21.15.72:0/320287702 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fe14006ace0 msgr2=0x7fe14006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:54.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.275+0000 7fe1649d9700 1 --2- 172.21.15.72:0/320287702 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fe14006ace0 0x7fe14006d1a0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fe1540090b0 tx=0x7fe15401f040 comp rx=0 tx=0).stop 2023-07-25T14:36:54.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.275+0000 7fe1649d9700 1 -- 172.21.15.72:0/320287702 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe1601508a0 msgr2=0x7fe160157e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:54.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.275+0000 7fe1649d9700 1 --2- 172.21.15.72:0/320287702 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe1601508a0 0x7fe160157e50 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fe1500118d0 tx=0x7fe150011be0 comp rx=0 tx=0).stop 2023-07-25T14:36:54.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.275+0000 7fe1649d9700 1 -- 172.21.15.72:0/320287702 shutdown_connections 2023-07-25T14:36:54.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.275+0000 7fe1649d9700 1 --2- 172.21.15.72:0/320287702 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fe14006ace0 0x7fe14006d1a0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:54.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.275+0000 7fe1649d9700 1 --2- 172.21.15.72:0/320287702 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe148003a00 0x7fe16006fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:54.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.275+0000 7fe1649d9700 1 --2- 172.21.15.72:0/320287702 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe1600aa7e0 0x7fe160158390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:54.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.275+0000 7fe1649d9700 1 --2- 172.21.15.72:0/320287702 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe1601508a0 0x7fe160157e50 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:54.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.275+0000 7fe1649d9700 1 -- 172.21.15.72:0/320287702 >> 172.21.15.72:0/320287702 conn(0x7fe1600a87e0 msgr2=0x7fe16014f510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:54.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.275+0000 7fe1649d9700 1 -- 172.21.15.72:0/320287702 shutdown_connections 2023-07-25T14:36:54.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.275+0000 7fe1649d9700 1 -- 172.21.15.72:0/320287702 wait complete. 2023-07-25T14:36:54.289 INFO:teuthology.orchestra.run.smithi072.stderr:dumped all 2023-07-25T14:36:54.298 INFO:teuthology.orchestra.run.smithi072.stdout:{"pg_ready":true,"pg_map":{"version":73,"stamp":"2023-07-25T14:36:53.300473+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":86,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219804,"kb_used_data":3604,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754754916,"statfs":{"total":773094113280,"available":772869033984,"internally_reserved":0,"allocated":3690496,"data_stored":2744797,"data_compressed":64510,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":33,"apply_latency_ms":33,"commit_latency_ns":33000000,"apply_latency_ns":33000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.132507"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-25T14:36:50.203083+0000","last_change":"2023-07-25T14:36:50.199855+0000","last_active":"2023-07-25T14:36:50.203083+0000","last_peered":"2023-07-25T14:36:50.203083+0000","last_clean":"2023-07-25T14:36:50.203083+0000","last_became_active":"2023-07-25T14:36:50.199464+0000","last_became_peered":"2023-07-25T14:36:50.199464+0000","last_unstale":"2023-07-25T14:36:50.203083+0000","last_undegraded":"2023-07-25T14:36:50.203083+0000","last_fullsized":"2023-07-25T14:36:50.203083+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T16:14:20.244451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-25T14:36:51.201478+0000","last_change":"2023-07-25T14:36:50.210983+0000","last_active":"2023-07-25T14:36:51.201478+0000","last_peered":"2023-07-25T14:36:51.201478+0000","last_clean":"2023-07-25T14:36:51.201478+0000","last_became_active":"2023-07-25T14:36:50.210721+0000","last_became_peered":"2023-07-25T14:36:50.210721+0000","last_unstale":"2023-07-25T14:36:51.201478+0000","last_undegraded":"2023-07-25T14:36:51.201478+0000","last_fullsized":"2023-07-25T14:36:51.201478+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T16:35:42.941095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-25T14:36:51.200742+0000","last_change":"2023-07-25T14:36:50.211484+0000","last_active":"2023-07-25T14:36:51.200742+0000","last_peered":"2023-07-25T14:36:51.200742+0000","last_clean":"2023-07-25T14:36:51.200742+0000","last_became_active":"2023-07-25T14:36:50.211113+0000","last_became_peered":"2023-07-25T14:36:50.211113+0000","last_unstale":"2023-07-25T14:36:51.200742+0000","last_undegraded":"2023-07-25T14:36:51.200742+0000","last_fullsized":"2023-07-25T14:36:51.200742+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T16:49:45.309449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-25T14:36:50.211583+0000","last_change":"2023-07-25T14:36:50.204689+0000","last_active":"2023-07-25T14:36:50.211583+0000","last_peered":"2023-07-25T14:36:50.211583+0000","last_clean":"2023-07-25T14:36:50.211583+0000","last_became_active":"2023-07-25T14:36:50.204430+0000","last_became_peered":"2023-07-25T14:36:50.204430+0000","last_unstale":"2023-07-25T14:36:50.211583+0000","last_undegraded":"2023-07-25T14:36:50.211583+0000","last_fullsized":"2023-07-25T14:36:50.211583+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T23:25:45.551193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-25T14:36:51.201356+0000","last_change":"2023-07-25T14:36:50.209446+0000","last_active":"2023-07-25T14:36:51.201356+0000","last_peered":"2023-07-25T14:36:51.201356+0000","last_clean":"2023-07-25T14:36:51.201356+0000","last_became_active":"2023-07-25T14:36:50.209144+0000","last_became_peered":"2023-07-25T14:36:50.209144+0000","last_unstale":"2023-07-25T14:36:51.201356+0000","last_undegraded":"2023-07-25T14:36:51.201356+0000","last_fullsized":"2023-07-25T14:36:51.201356+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T20:37:06.160713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-25T14:36:50.211096+0000","last_change":"2023-07-25T14:36:50.200879+0000","last_active":"2023-07-25T14:36:50.211096+0000","last_peered":"2023-07-25T14:36:50.211096+0000","last_clean":"2023-07-25T14:36:50.211096+0000","last_became_active":"2023-07-25T14:36:50.199174+0000","last_became_peered":"2023-07-25T14:36:50.199174+0000","last_unstale":"2023-07-25T14:36:50.211096+0000","last_undegraded":"2023-07-25T14:36:50.211096+0000","last_fullsized":"2023-07-25T14:36:50.211096+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:06:05.103409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-25T14:36:50.209585+0000","last_change":"2023-07-25T14:36:50.205352+0000","last_active":"2023-07-25T14:36:50.209585+0000","last_peered":"2023-07-25T14:36:50.209585+0000","last_clean":"2023-07-25T14:36:50.209585+0000","last_became_active":"2023-07-25T14:36:50.205041+0000","last_became_peered":"2023-07-25T14:36:50.205041+0000","last_unstale":"2023-07-25T14:36:50.209585+0000","last_undegraded":"2023-07-25T14:36:50.209585+0000","last_fullsized":"2023-07-25T14:36:50.209585+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T20:37:06.160713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-25T14:36:50.215517+0000","last_change":"2023-07-25T14:36:50.208542+0000","last_active":"2023-07-25T14:36:50.215517+0000","last_peered":"2023-07-25T14:36:50.215517+0000","last_clean":"2023-07-25T14:36:50.215517+0000","last_became_active":"2023-07-25T14:36:50.208292+0000","last_became_peered":"2023-07-25T14:36:50.208292+0000","last_unstale":"2023-07-25T14:36:50.215517+0000","last_undegraded":"2023-07-25T14:36:50.215517+0000","last_fullsized":"2023-07-25T14:36:50.215517+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T22:07:12.412241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-25T14:36:50.215240+0000","last_change":"2023-07-25T14:36:50.207115+0000","last_active":"2023-07-25T14:36:50.215240+0000","last_peered":"2023-07-25T14:36:50.215240+0000","last_clean":"2023-07-25T14:36:50.215240+0000","last_became_active":"2023-07-25T14:36:50.206848+0000","last_became_peered":"2023-07-25T14:36:50.206848+0000","last_unstale":"2023-07-25T14:36:50.215240+0000","last_undegraded":"2023-07-25T14:36:50.215240+0000","last_fullsized":"2023-07-25T14:36:50.215240+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T18:08:24.432577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-25T14:36:50.211299+0000","last_change":"2023-07-25T14:36:50.202401+0000","last_active":"2023-07-25T14:36:50.211299+0000","last_peered":"2023-07-25T14:36:50.211299+0000","last_clean":"2023-07-25T14:36:50.211299+0000","last_became_active":"2023-07-25T14:36:50.202122+0000","last_became_peered":"2023-07-25T14:36:50.202122+0000","last_unstale":"2023-07-25T14:36:50.211299+0000","last_undegraded":"2023-07-25T14:36:50.211299+0000","last_fullsized":"2023-07-25T14:36:50.211299+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T21:15:48.481009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-25T14:36:50.215258+0000","last_change":"2023-07-25T14:36:50.206841+0000","last_active":"2023-07-25T14:36:50.215258+0000","last_peered":"2023-07-25T14:36:50.215258+0000","last_clean":"2023-07-25T14:36:50.215258+0000","last_became_active":"2023-07-25T14:36:50.206563+0000","last_became_peered":"2023-07-25T14:36:50.206563+0000","last_unstale":"2023-07-25T14:36:50.215258+0000","last_undegraded":"2023-07-25T14:36:50.215258+0000","last_fullsized":"2023-07-25T14:36:50.215258+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T15:11:51.480312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-25T14:36:51.201898+0000","last_change":"2023-07-25T14:36:50.199364+0000","last_active":"2023-07-25T14:36:51.201898+0000","last_peered":"2023-07-25T14:36:51.201898+0000","last_clean":"2023-07-25T14:36:51.201898+0000","last_became_active":"2023-07-25T14:36:50.198943+0000","last_became_peered":"2023-07-25T14:36:50.198943+0000","last_unstale":"2023-07-25T14:36:51.201898+0000","last_undegraded":"2023-07-25T14:36:51.201898+0000","last_fullsized":"2023-07-25T14:36:51.201898+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T22:11:04.890662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-25T14:36:50.210206+0000","last_change":"2023-07-25T14:36:50.200453+0000","last_active":"2023-07-25T14:36:50.210206+0000","last_peered":"2023-07-25T14:36:50.210206+0000","last_clean":"2023-07-25T14:36:50.210206+0000","last_became_active":"2023-07-25T14:36:50.200070+0000","last_became_peered":"2023-07-25T14:36:50.200070+0000","last_unstale":"2023-07-25T14:36:50.210206+0000","last_undegraded":"2023-07-25T14:36:50.210206+0000","last_fullsized":"2023-07-25T14:36:50.210206+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T15:28:17.702544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-25T14:36:50.215198+0000","last_change":"2023-07-25T14:36:50.206731+0000","last_active":"2023-07-25T14:36:50.215198+0000","last_peered":"2023-07-25T14:36:50.215198+0000","last_clean":"2023-07-25T14:36:50.215198+0000","last_became_active":"2023-07-25T14:36:50.206426+0000","last_became_peered":"2023-07-25T14:36:50.206426+0000","last_unstale":"2023-07-25T14:36:50.215198+0000","last_undegraded":"2023-07-25T14:36:50.215198+0000","last_fullsized":"2023-07-25T14:36:50.215198+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T19:25:03.342839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-25T14:36:50.209555+0000","last_change":"2023-07-25T14:36:50.204379+0000","last_active":"2023-07-25T14:36:50.209555+0000","last_peered":"2023-07-25T14:36:50.209555+0000","last_clean":"2023-07-25T14:36:50.209555+0000","last_became_active":"2023-07-25T14:36:50.203202+0000","last_became_peered":"2023-07-25T14:36:50.203202+0000","last_unstale":"2023-07-25T14:36:50.209555+0000","last_undegraded":"2023-07-25T14:36:50.209555+0000","last_fullsized":"2023-07-25T14:36:50.209555+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T01:49:00.736541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-25T14:36:51.199366+0000","last_change":"2023-07-25T14:36:50.212013+0000","last_active":"2023-07-25T14:36:51.199366+0000","last_peered":"2023-07-25T14:36:51.199366+0000","last_clean":"2023-07-25T14:36:51.199366+0000","last_became_active":"2023-07-25T14:36:50.211722+0000","last_became_peered":"2023-07-25T14:36:50.211722+0000","last_unstale":"2023-07-25T14:36:51.199366+0000","last_undegraded":"2023-07-25T14:36:51.199366+0000","last_fullsized":"2023-07-25T14:36:51.199366+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T18:01:50.006754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-25T14:36:51.201842+0000","last_change":"2023-07-25T14:36:50.206017+0000","last_active":"2023-07-25T14:36:51.201842+0000","last_peered":"2023-07-25T14:36:51.201842+0000","last_clean":"2023-07-25T14:36:51.201842+0000","last_became_active":"2023-07-25T14:36:50.205693+0000","last_became_peered":"2023-07-25T14:36:50.205693+0000","last_unstale":"2023-07-25T14:36:51.201842+0000","last_undegraded":"2023-07-25T14:36:51.201842+0000","last_fullsized":"2023-07-25T14:36:51.201842+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T17:07:11.661931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-25T14:36:51.201174+0000","last_change":"2023-07-25T14:36:50.212257+0000","last_active":"2023-07-25T14:36:51.201174+0000","last_peered":"2023-07-25T14:36:51.201174+0000","last_clean":"2023-07-25T14:36:51.201174+0000","last_became_active":"2023-07-25T14:36:50.211850+0000","last_became_peered":"2023-07-25T14:36:50.211850+0000","last_unstale":"2023-07-25T14:36:51.201174+0000","last_undegraded":"2023-07-25T14:36:51.201174+0000","last_fullsized":"2023-07-25T14:36:51.201174+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T20:07:10.476668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-25T14:36:51.199630+0000","last_change":"2023-07-25T14:36:50.212251+0000","last_active":"2023-07-25T14:36:51.199630+0000","last_peered":"2023-07-25T14:36:51.199630+0000","last_clean":"2023-07-25T14:36:51.199630+0000","last_became_active":"2023-07-25T14:36:50.211890+0000","last_became_peered":"2023-07-25T14:36:50.211890+0000","last_unstale":"2023-07-25T14:36:51.199630+0000","last_undegraded":"2023-07-25T14:36:51.199630+0000","last_fullsized":"2023-07-25T14:36:51.199630+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T19:12:45.741770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-25T14:36:50.216917+0000","last_change":"2023-07-25T14:36:50.213055+0000","last_active":"2023-07-25T14:36:50.216917+0000","last_peered":"2023-07-25T14:36:50.216917+0000","last_clean":"2023-07-25T14:36:50.216917+0000","last_became_active":"2023-07-25T14:36:50.211933+0000","last_became_peered":"2023-07-25T14:36:50.211933+0000","last_unstale":"2023-07-25T14:36:50.216917+0000","last_undegraded":"2023-07-25T14:36:50.216917+0000","last_fullsized":"2023-07-25T14:36:50.216917+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T16:35:14.255795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-25T14:36:50.214961+0000","last_change":"2023-07-25T14:36:50.211635+0000","last_active":"2023-07-25T14:36:50.214961+0000","last_peered":"2023-07-25T14:36:50.214961+0000","last_clean":"2023-07-25T14:36:50.214961+0000","last_became_active":"2023-07-25T14:36:50.211036+0000","last_became_peered":"2023-07-25T14:36:50.211036+0000","last_unstale":"2023-07-25T14:36:50.214961+0000","last_undegraded":"2023-07-25T14:36:50.214961+0000","last_fullsized":"2023-07-25T14:36:50.214961+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T15:46:46.132983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-25T14:36:50.211371+0000","last_change":"2023-07-25T14:36:50.202547+0000","last_active":"2023-07-25T14:36:50.211371+0000","last_peered":"2023-07-25T14:36:50.211371+0000","last_clean":"2023-07-25T14:36:50.211371+0000","last_became_active":"2023-07-25T14:36:50.202242+0000","last_became_peered":"2023-07-25T14:36:50.202242+0000","last_unstale":"2023-07-25T14:36:50.211371+0000","last_undegraded":"2023-07-25T14:36:50.211371+0000","last_fullsized":"2023-07-25T14:36:50.211371+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T18:33:35.069385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-25T14:36:51.220397+0000","last_change":"2023-07-25T14:36:50.204317+0000","last_active":"2023-07-25T14:36:51.220397+0000","last_peered":"2023-07-25T14:36:51.220397+0000","last_clean":"2023-07-25T14:36:51.220397+0000","last_became_active":"2023-07-25T14:36:50.203984+0000","last_became_peered":"2023-07-25T14:36:50.203984+0000","last_unstale":"2023-07-25T14:36:51.220397+0000","last_undegraded":"2023-07-25T14:36:51.220397+0000","last_fullsized":"2023-07-25T14:36:51.220397+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T15:14:03.864607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-25T14:36:51.199767+0000","last_change":"2023-07-25T14:36:50.201691+0000","last_active":"2023-07-25T14:36:51.199767+0000","last_peered":"2023-07-25T14:36:51.199767+0000","last_clean":"2023-07-25T14:36:51.199767+0000","last_became_active":"2023-07-25T14:36:50.201277+0000","last_became_peered":"2023-07-25T14:36:50.201277+0000","last_unstale":"2023-07-25T14:36:51.199767+0000","last_undegraded":"2023-07-25T14:36:51.199767+0000","last_fullsized":"2023-07-25T14:36:51.199767+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T01:26:01.711894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-25T14:36:51.199631+0000","last_change":"2023-07-25T14:36:50.206676+0000","last_active":"2023-07-25T14:36:51.199631+0000","last_peered":"2023-07-25T14:36:51.199631+0000","last_clean":"2023-07-25T14:36:51.199631+0000","last_became_active":"2023-07-25T14:36:50.206388+0000","last_became_peered":"2023-07-25T14:36:50.206388+0000","last_unstale":"2023-07-25T14:36:51.199631+0000","last_undegraded":"2023-07-25T14:36:51.199631+0000","last_fullsized":"2023-07-25T14:36:51.199631+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T14:53:01.095214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-25T14:36:50.207694+0000","last_change":"2023-07-25T14:36:50.193509+0000","last_active":"2023-07-25T14:36:50.207694+0000","last_peered":"2023-07-25T14:36:50.207694+0000","last_clean":"2023-07-25T14:36:50.207694+0000","last_became_active":"2023-07-25T14:36:50.193223+0000","last_became_peered":"2023-07-25T14:36:50.193223+0000","last_unstale":"2023-07-25T14:36:50.207694+0000","last_undegraded":"2023-07-25T14:36:50.207694+0000","last_fullsized":"2023-07-25T14:36:50.207694+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T14:57:43.754353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-25T14:36:51.201306+0000","last_change":"2023-07-25T14:36:50.201315+0000","last_active":"2023-07-25T14:36:51.201306+0000","last_peered":"2023-07-25T14:36:51.201306+0000","last_clean":"2023-07-25T14:36:51.201306+0000","last_became_active":"2023-07-25T14:36:50.201043+0000","last_became_peered":"2023-07-25T14:36:50.201043+0000","last_unstale":"2023-07-25T14:36:51.201306+0000","last_undegraded":"2023-07-25T14:36:51.201306+0000","last_fullsized":"2023-07-25T14:36:51.201306+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T19:50:27.066319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-25T14:36:51.201652+0000","last_change":"2023-07-25T14:36:50.214125+0000","last_active":"2023-07-25T14:36:51.201652+0000","last_peered":"2023-07-25T14:36:51.201652+0000","last_clean":"2023-07-25T14:36:51.201652+0000","last_became_active":"2023-07-25T14:36:50.213810+0000","last_became_peered":"2023-07-25T14:36:50.213810+0000","last_unstale":"2023-07-25T14:36:51.201652+0000","last_undegraded":"2023-07-25T14:36:51.201652+0000","last_fullsized":"2023-07-25T14:36:51.201652+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T19:31:51.818032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-25T14:36:51.199475+0000","last_change":"2023-07-25T14:36:50.206158+0000","last_active":"2023-07-25T14:36:51.199475+0000","last_peered":"2023-07-25T14:36:51.199475+0000","last_clean":"2023-07-25T14:36:51.199475+0000","last_became_active":"2023-07-25T14:36:50.205826+0000","last_became_peered":"2023-07-25T14:36:50.205826+0000","last_unstale":"2023-07-25T14:36:51.199475+0000","last_undegraded":"2023-07-25T14:36:51.199475+0000","last_fullsized":"2023-07-25T14:36:51.199475+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T19:49:15.867389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-25T14:36:51.200811+0000","last_change":"2023-07-25T14:36:50.206009+0000","last_active":"2023-07-25T14:36:51.200811+0000","last_peered":"2023-07-25T14:36:51.200811+0000","last_clean":"2023-07-25T14:36:51.200811+0000","last_became_active":"2023-07-25T14:36:50.205731+0000","last_became_peered":"2023-07-25T14:36:50.205731+0000","last_unstale":"2023-07-25T14:36:51.200811+0000","last_undegraded":"2023-07-25T14:36:51.200811+0000","last_fullsized":"2023-07-25T14:36:51.200811+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T17:57:50.118234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-25T14:36:50.205495+0000","last_change":"2023-07-25T14:36:50.198090+0000","last_active":"2023-07-25T14:36:50.205495+0000","last_peered":"2023-07-25T14:36:50.205495+0000","last_clean":"2023-07-25T14:36:50.205495+0000","last_became_active":"2023-07-25T14:36:50.197854+0000","last_became_peered":"2023-07-25T14:36:50.197854+0000","last_unstale":"2023-07-25T14:36:50.205495+0000","last_undegraded":"2023-07-25T14:36:50.205495+0000","last_fullsized":"2023-07-25T14:36:50.205495+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T19:24:34.282767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-25T14:36:50.210277+0000","last_change":"2023-07-25T14:36:50.203988+0000","last_active":"2023-07-25T14:36:50.210277+0000","last_peered":"2023-07-25T14:36:50.210277+0000","last_clean":"2023-07-25T14:36:50.210277+0000","last_became_active":"2023-07-25T14:36:50.203732+0000","last_became_peered":"2023-07-25T14:36:50.203732+0000","last_unstale":"2023-07-25T14:36:50.210277+0000","last_undegraded":"2023-07-25T14:36:50.210277+0000","last_fullsized":"2023-07-25T14:36:50.210277+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T14:57:56.722579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-25T14:36:50.218155+0000","last_change":"2023-07-25T14:36:50.213941+0000","last_active":"2023-07-25T14:36:50.218155+0000","last_peered":"2023-07-25T14:36:50.218155+0000","last_clean":"2023-07-25T14:36:50.218155+0000","last_became_active":"2023-07-25T14:36:50.213697+0000","last_became_peered":"2023-07-25T14:36:50.213697+0000","last_unstale":"2023-07-25T14:36:50.218155+0000","last_undegraded":"2023-07-25T14:36:50.218155+0000","last_fullsized":"2023-07-25T14:36:50.218155+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T22:06:59.374190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"38'4","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-25T14:36:50.216406+0000","last_change":"2023-07-25T14:36:49.189633+0000","last_active":"2023-07-25T14:36:50.216406+0000","last_peered":"2023-07-25T14:36:50.216406+0000","last_clean":"2023-07-25T14:36:50.216406+0000","last_became_active":"2023-07-25T14:36:49.189347+0000","last_became_peered":"2023-07-25T14:36:49.189347+0000","last_unstale":"2023-07-25T14:36:50.216406+0000","last_undegraded":"2023-07-25T14:36:50.216406+0000","last_fullsized":"2023-07-25T14:36:50.216406+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_clean_scrub_stamp":"2023-07-25T14:36:48.163149+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T16:06:34.321404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-25T14:36:51.220354+0000","last_change":"2023-07-25T14:36:50.202196+0000","last_active":"2023-07-25T14:36:51.220354+0000","last_peered":"2023-07-25T14:36:51.220354+0000","last_clean":"2023-07-25T14:36:51.220354+0000","last_became_active":"2023-07-25T14:36:50.201924+0000","last_became_peered":"2023-07-25T14:36:50.201924+0000","last_unstale":"2023-07-25T14:36:51.220354+0000","last_undegraded":"2023-07-25T14:36:51.220354+0000","last_fullsized":"2023-07-25T14:36:51.220354+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T01:05:55.734046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"38'1","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-25T14:36:51.201593+0000","last_change":"2023-07-25T14:36:49.182497+0000","last_active":"2023-07-25T14:36:51.201593+0000","last_peered":"2023-07-25T14:36:51.201593+0000","last_clean":"2023-07-25T14:36:51.201593+0000","last_became_active":"2023-07-25T14:36:49.182166+0000","last_became_peered":"2023-07-25T14:36:49.182166+0000","last_unstale":"2023-07-25T14:36:51.201593+0000","last_undegraded":"2023-07-25T14:36:51.201593+0000","last_fullsized":"2023-07-25T14:36:51.201593+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_clean_scrub_stamp":"2023-07-25T14:36:48.163149+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T15:01:23.259132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-25T14:36:51.201795+0000","last_change":"2023-07-25T14:36:50.210856+0000","last_active":"2023-07-25T14:36:51.201795+0000","last_peered":"2023-07-25T14:36:51.201795+0000","last_clean":"2023-07-25T14:36:51.201795+0000","last_became_active":"2023-07-25T14:36:50.210524+0000","last_became_peered":"2023-07-25T14:36:50.210524+0000","last_unstale":"2023-07-25T14:36:51.201795+0000","last_undegraded":"2023-07-25T14:36:51.201795+0000","last_fullsized":"2023-07-25T14:36:51.201795+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:34:20.886125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"38'2","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-25T14:36:50.215999+0000","last_change":"2023-07-25T14:36:49.188711+0000","last_active":"2023-07-25T14:36:50.215999+0000","last_peered":"2023-07-25T14:36:50.215999+0000","last_clean":"2023-07-25T14:36:50.215999+0000","last_became_active":"2023-07-25T14:36:49.188454+0000","last_became_peered":"2023-07-25T14:36:49.188454+0000","last_unstale":"2023-07-25T14:36:50.215999+0000","last_undegraded":"2023-07-25T14:36:50.215999+0000","last_fullsized":"2023-07-25T14:36:50.215999+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_clean_scrub_stamp":"2023-07-25T14:36:48.163149+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T02:09:39.697992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-25T14:36:50.211734+0000","last_change":"2023-07-25T14:36:50.205852+0000","last_active":"2023-07-25T14:36:50.211734+0000","last_peered":"2023-07-25T14:36:50.211734+0000","last_clean":"2023-07-25T14:36:50.211734+0000","last_became_active":"2023-07-25T14:36:50.205542+0000","last_became_peered":"2023-07-25T14:36:50.205542+0000","last_unstale":"2023-07-25T14:36:50.211734+0000","last_undegraded":"2023-07-25T14:36:50.211734+0000","last_fullsized":"2023-07-25T14:36:50.211734+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T20:34:40.704873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"38'2","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-25T14:36:50.210341+0000","last_change":"2023-07-25T14:36:49.188456+0000","last_active":"2023-07-25T14:36:50.210341+0000","last_peered":"2023-07-25T14:36:50.210341+0000","last_clean":"2023-07-25T14:36:50.210341+0000","last_became_active":"2023-07-25T14:36:49.188176+0000","last_became_peered":"2023-07-25T14:36:49.188176+0000","last_unstale":"2023-07-25T14:36:50.210341+0000","last_undegraded":"2023-07-25T14:36:50.210341+0000","last_fullsized":"2023-07-25T14:36:50.210341+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_clean_scrub_stamp":"2023-07-25T14:36:48.163149+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T15:09:56.130862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-25T14:36:51.201946+0000","last_change":"2023-07-25T14:36:50.206176+0000","last_active":"2023-07-25T14:36:51.201946+0000","last_peered":"2023-07-25T14:36:51.201946+0000","last_clean":"2023-07-25T14:36:51.201946+0000","last_became_active":"2023-07-25T14:36:50.205387+0000","last_became_peered":"2023-07-25T14:36:50.205387+0000","last_unstale":"2023-07-25T14:36:51.201946+0000","last_undegraded":"2023-07-25T14:36:51.201946+0000","last_fullsized":"2023-07-25T14:36:51.201946+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T15:37:10.027578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"38'1","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-25T14:36:50.215911+0000","last_change":"2023-07-25T14:36:49.193129+0000","last_active":"2023-07-25T14:36:50.215911+0000","last_peered":"2023-07-25T14:36:50.215911+0000","last_clean":"2023-07-25T14:36:50.215911+0000","last_became_active":"2023-07-25T14:36:49.192313+0000","last_became_peered":"2023-07-25T14:36:49.192313+0000","last_unstale":"2023-07-25T14:36:50.215911+0000","last_undegraded":"2023-07-25T14:36:50.215911+0000","last_fullsized":"2023-07-25T14:36:50.215911+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_clean_scrub_stamp":"2023-07-25T14:36:48.163149+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T16:28:13.540791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-25T14:36:50.211404+0000","last_change":"2023-07-25T14:36:50.197978+0000","last_active":"2023-07-25T14:36:50.211404+0000","last_peered":"2023-07-25T14:36:50.211404+0000","last_clean":"2023-07-25T14:36:50.211404+0000","last_became_active":"2023-07-25T14:36:50.197726+0000","last_became_peered":"2023-07-25T14:36:50.197726+0000","last_unstale":"2023-07-25T14:36:50.211404+0000","last_undegraded":"2023-07-25T14:36:50.211404+0000","last_fullsized":"2023-07-25T14:36:50.211404+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T20:12:11.116659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"38'1","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-25T14:36:51.201100+0000","last_change":"2023-07-25T14:36:49.186416+0000","last_active":"2023-07-25T14:36:51.201100+0000","last_peered":"2023-07-25T14:36:51.201100+0000","last_clean":"2023-07-25T14:36:51.201100+0000","last_became_active":"2023-07-25T14:36:49.186112+0000","last_became_peered":"2023-07-25T14:36:49.186112+0000","last_unstale":"2023-07-25T14:36:51.201100+0000","last_undegraded":"2023-07-25T14:36:51.201100+0000","last_fullsized":"2023-07-25T14:36:51.201100+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_clean_scrub_stamp":"2023-07-25T14:36:48.163149+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T01:49:25.831512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-25T14:36:50.211947+0000","last_change":"2023-07-25T14:36:50.202710+0000","last_active":"2023-07-25T14:36:50.211947+0000","last_peered":"2023-07-25T14:36:50.211947+0000","last_clean":"2023-07-25T14:36:50.211947+0000","last_became_active":"2023-07-25T14:36:50.202435+0000","last_became_peered":"2023-07-25T14:36:50.202435+0000","last_unstale":"2023-07-25T14:36:50.211947+0000","last_undegraded":"2023-07-25T14:36:50.211947+0000","last_fullsized":"2023-07-25T14:36:50.211947+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T18:16:48.525417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-25T14:36:51.201197+0000","last_change":"2023-07-25T14:36:49.188625+0000","last_active":"2023-07-25T14:36:51.201197+0000","last_peered":"2023-07-25T14:36:51.201197+0000","last_clean":"2023-07-25T14:36:51.201197+0000","last_became_active":"2023-07-25T14:36:49.188284+0000","last_became_peered":"2023-07-25T14:36:49.188284+0000","last_unstale":"2023-07-25T14:36:51.201197+0000","last_undegraded":"2023-07-25T14:36:51.201197+0000","last_fullsized":"2023-07-25T14:36:51.201197+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_clean_scrub_stamp":"2023-07-25T14:36:48.163149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T23:17:59.723720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-25T14:36:51.220321+0000","last_change":"2023-07-25T14:36:50.203758+0000","last_active":"2023-07-25T14:36:51.220321+0000","last_peered":"2023-07-25T14:36:51.220321+0000","last_clean":"2023-07-25T14:36:51.220321+0000","last_became_active":"2023-07-25T14:36:50.203473+0000","last_became_peered":"2023-07-25T14:36:50.203473+0000","last_unstale":"2023-07-25T14:36:51.220321+0000","last_undegraded":"2023-07-25T14:36:51.220321+0000","last_fullsized":"2023-07-25T14:36:51.220321+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T20:34:40.704873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-25T14:36:50.190490+0000","last_change":"2023-07-25T14:36:49.187292+0000","last_active":"2023-07-25T14:36:50.190490+0000","last_peered":"2023-07-25T14:36:50.190490+0000","last_clean":"2023-07-25T14:36:50.190490+0000","last_became_active":"2023-07-25T14:36:49.186847+0000","last_became_peered":"2023-07-25T14:36:49.186847+0000","last_unstale":"2023-07-25T14:36:50.190490+0000","last_undegraded":"2023-07-25T14:36:50.190490+0000","last_fullsized":"2023-07-25T14:36:50.190490+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_clean_scrub_stamp":"2023-07-25T14:36:48.163149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T22:44:20.003312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-25T14:36:51.201477+0000","last_change":"2023-07-25T14:36:50.212104+0000","last_active":"2023-07-25T14:36:51.201477+0000","last_peered":"2023-07-25T14:36:51.201477+0000","last_clean":"2023-07-25T14:36:51.201477+0000","last_became_active":"2023-07-25T14:36:50.211493+0000","last_became_peered":"2023-07-25T14:36:50.211493+0000","last_unstale":"2023-07-25T14:36:51.201477+0000","last_undegraded":"2023-07-25T14:36:51.201477+0000","last_fullsized":"2023-07-25T14:36:51.201477+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T20:06:11.124144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-25T14:36:51.201998+0000","last_change":"2023-07-25T14:36:49.179031+0000","last_active":"2023-07-25T14:36:51.201998+0000","last_peered":"2023-07-25T14:36:51.201998+0000","last_clean":"2023-07-25T14:36:51.201998+0000","last_became_active":"2023-07-25T14:36:49.178709+0000","last_became_peered":"2023-07-25T14:36:49.178709+0000","last_unstale":"2023-07-25T14:36:51.201998+0000","last_undegraded":"2023-07-25T14:36:51.201998+0000","last_fullsized":"2023-07-25T14:36:51.201998+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_clean_scrub_stamp":"2023-07-25T14:36:48.163149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T16:00:17.186535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-25T14:36:50.203104+0000","last_change":"2023-07-25T14:36:50.200137+0000","last_active":"2023-07-25T14:36:50.203104+0000","last_peered":"2023-07-25T14:36:50.203104+0000","last_clean":"2023-07-25T14:36:50.203104+0000","last_became_active":"2023-07-25T14:36:50.199771+0000","last_became_peered":"2023-07-25T14:36:50.199771+0000","last_unstale":"2023-07-25T14:36:50.203104+0000","last_undegraded":"2023-07-25T14:36:50.203104+0000","last_fullsized":"2023-07-25T14:36:50.203104+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T02:07:49.432592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-25T14:36:50.187672+0000","last_change":"2023-07-25T14:36:49.190277+0000","last_active":"2023-07-25T14:36:50.187672+0000","last_peered":"2023-07-25T14:36:50.187672+0000","last_clean":"2023-07-25T14:36:50.187672+0000","last_became_active":"2023-07-25T14:36:49.189911+0000","last_became_peered":"2023-07-25T14:36:49.189911+0000","last_unstale":"2023-07-25T14:36:50.187672+0000","last_undegraded":"2023-07-25T14:36:50.187672+0000","last_fullsized":"2023-07-25T14:36:50.187672+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_clean_scrub_stamp":"2023-07-25T14:36:48.163149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T18:55:12.434844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-25T14:36:50.209895+0000","last_change":"2023-07-25T14:36:50.201912+0000","last_active":"2023-07-25T14:36:50.209895+0000","last_peered":"2023-07-25T14:36:50.209895+0000","last_clean":"2023-07-25T14:36:50.209895+0000","last_became_active":"2023-07-25T14:36:50.201362+0000","last_became_peered":"2023-07-25T14:36:50.201362+0000","last_unstale":"2023-07-25T14:36:50.209895+0000","last_undegraded":"2023-07-25T14:36:50.209895+0000","last_fullsized":"2023-07-25T14:36:50.209895+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:46:12.680756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"38'3","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-25T14:36:50.214689+0000","last_change":"2023-07-25T14:36:49.189087+0000","last_active":"2023-07-25T14:36:50.214689+0000","last_peered":"2023-07-25T14:36:50.214689+0000","last_clean":"2023-07-25T14:36:50.214689+0000","last_became_active":"2023-07-25T14:36:49.188727+0000","last_became_peered":"2023-07-25T14:36:49.188727+0000","last_unstale":"2023-07-25T14:36:50.214689+0000","last_undegraded":"2023-07-25T14:36:50.214689+0000","last_fullsized":"2023-07-25T14:36:50.214689+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_clean_scrub_stamp":"2023-07-25T14:36:48.163149+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T22:11:03.886719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-25T14:36:50.214278+0000","last_change":"2023-07-25T14:36:50.206981+0000","last_active":"2023-07-25T14:36:50.214278+0000","last_peered":"2023-07-25T14:36:50.214278+0000","last_clean":"2023-07-25T14:36:50.214278+0000","last_became_active":"2023-07-25T14:36:50.206684+0000","last_became_peered":"2023-07-25T14:36:50.206684+0000","last_unstale":"2023-07-25T14:36:50.214278+0000","last_undegraded":"2023-07-25T14:36:50.214278+0000","last_fullsized":"2023-07-25T14:36:50.214278+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T19:31:51.818032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"38'6","reported_seq":17,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-25T14:36:50.220888+0000","last_change":"2023-07-25T14:36:49.178494+0000","last_active":"2023-07-25T14:36:50.220888+0000","last_peered":"2023-07-25T14:36:50.220888+0000","last_clean":"2023-07-25T14:36:50.220888+0000","last_became_active":"2023-07-25T14:36:49.178170+0000","last_became_peered":"2023-07-25T14:36:49.178170+0000","last_unstale":"2023-07-25T14:36:50.220888+0000","last_undegraded":"2023-07-25T14:36:50.220888+0000","last_fullsized":"2023-07-25T14:36:50.220888+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_clean_scrub_stamp":"2023-07-25T14:36:48.163149+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T23:30:50.676227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-25T14:36:51.220548+0000","last_change":"2023-07-25T14:36:50.211789+0000","last_active":"2023-07-25T14:36:51.220548+0000","last_peered":"2023-07-25T14:36:51.220548+0000","last_clean":"2023-07-25T14:36:51.220548+0000","last_became_active":"2023-07-25T14:36:50.211520+0000","last_became_peered":"2023-07-25T14:36:50.211520+0000","last_unstale":"2023-07-25T14:36:51.220548+0000","last_undegraded":"2023-07-25T14:36:51.220548+0000","last_fullsized":"2023-07-25T14:36:51.220548+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T20:21:52.024854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"38'2","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-25T14:36:50.217516+0000","last_change":"2023-07-25T14:36:49.193327+0000","last_active":"2023-07-25T14:36:50.217516+0000","last_peered":"2023-07-25T14:36:50.217516+0000","last_clean":"2023-07-25T14:36:50.217516+0000","last_became_active":"2023-07-25T14:36:49.192656+0000","last_became_peered":"2023-07-25T14:36:49.192656+0000","last_unstale":"2023-07-25T14:36:50.217516+0000","last_undegraded":"2023-07-25T14:36:50.217516+0000","last_fullsized":"2023-07-25T14:36:50.217516+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_clean_scrub_stamp":"2023-07-25T14:36:48.163149+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T17:07:48.172028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-25T14:36:50.211385+0000","last_change":"2023-07-25T14:36:50.196519+0000","last_active":"2023-07-25T14:36:50.211385+0000","last_peered":"2023-07-25T14:36:50.211385+0000","last_clean":"2023-07-25T14:36:50.211385+0000","last_became_active":"2023-07-25T14:36:50.196242+0000","last_became_peered":"2023-07-25T14:36:50.196242+0000","last_unstale":"2023-07-25T14:36:50.211385+0000","last_undegraded":"2023-07-25T14:36:50.211385+0000","last_fullsized":"2023-07-25T14:36:50.211385+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T18:33:33.709002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-25T14:36:50.191687+0000","last_change":"2023-07-25T14:36:49.188746+0000","last_active":"2023-07-25T14:36:50.191687+0000","last_peered":"2023-07-25T14:36:50.191687+0000","last_clean":"2023-07-25T14:36:50.191687+0000","last_became_active":"2023-07-25T14:36:49.188445+0000","last_became_peered":"2023-07-25T14:36:49.188445+0000","last_unstale":"2023-07-25T14:36:50.191687+0000","last_undegraded":"2023-07-25T14:36:50.191687+0000","last_fullsized":"2023-07-25T14:36:50.191687+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_clean_scrub_stamp":"2023-07-25T14:36:48.163149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T17:55:20.568265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-25T14:36:50.205626+0000","last_change":"2023-07-25T14:36:50.199005+0000","last_active":"2023-07-25T14:36:50.205626+0000","last_peered":"2023-07-25T14:36:50.205626+0000","last_clean":"2023-07-25T14:36:50.205626+0000","last_became_active":"2023-07-25T14:36:50.198743+0000","last_became_peered":"2023-07-25T14:36:50.198743+0000","last_unstale":"2023-07-25T14:36:50.205626+0000","last_undegraded":"2023-07-25T14:36:50.205626+0000","last_fullsized":"2023-07-25T14:36:50.205626+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T17:15:49.435607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-25T14:36:50.189285+0000","last_change":"2023-07-25T14:36:49.191960+0000","last_active":"2023-07-25T14:36:50.189285+0000","last_peered":"2023-07-25T14:36:50.189285+0000","last_clean":"2023-07-25T14:36:50.189285+0000","last_became_active":"2023-07-25T14:36:49.191688+0000","last_became_peered":"2023-07-25T14:36:49.191688+0000","last_unstale":"2023-07-25T14:36:50.189285+0000","last_undegraded":"2023-07-25T14:36:50.189285+0000","last_fullsized":"2023-07-25T14:36:50.189285+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_clean_scrub_stamp":"2023-07-25T14:36:48.163149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T22:30:04.157240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-25T14:36:50.214114+0000","last_change":"2023-07-25T14:36:50.207141+0000","last_active":"2023-07-25T14:36:50.214114+0000","last_peered":"2023-07-25T14:36:50.214114+0000","last_clean":"2023-07-25T14:36:50.214114+0000","last_became_active":"2023-07-25T14:36:50.206727+0000","last_became_peered":"2023-07-25T14:36:50.206727+0000","last_unstale":"2023-07-25T14:36:50.214114+0000","last_undegraded":"2023-07-25T14:36:50.214114+0000","last_fullsized":"2023-07-25T14:36:50.214114+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T23:18:00.727663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"38'8","reported_seq":19,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-25T14:36:50.215473+0000","last_change":"2023-07-25T14:36:49.187460+0000","last_active":"2023-07-25T14:36:50.215473+0000","last_peered":"2023-07-25T14:36:50.215473+0000","last_clean":"2023-07-25T14:36:50.215473+0000","last_became_active":"2023-07-25T14:36:49.187132+0000","last_became_peered":"2023-07-25T14:36:49.187132+0000","last_unstale":"2023-07-25T14:36:50.215473+0000","last_undegraded":"2023-07-25T14:36:50.215473+0000","last_fullsized":"2023-07-25T14:36:50.215473+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_clean_scrub_stamp":"2023-07-25T14:36:48.163149+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T22:31:09.020175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-25T14:36:50.207716+0000","last_change":"2023-07-25T14:36:50.197939+0000","last_active":"2023-07-25T14:36:50.207716+0000","last_peered":"2023-07-25T14:36:50.207716+0000","last_clean":"2023-07-25T14:36:50.207716+0000","last_became_active":"2023-07-25T14:36:50.197093+0000","last_became_peered":"2023-07-25T14:36:50.197093+0000","last_unstale":"2023-07-25T14:36:50.207716+0000","last_undegraded":"2023-07-25T14:36:50.207716+0000","last_fullsized":"2023-07-25T14:36:50.207716+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T22:06:46.487437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"38'1","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-25T14:36:50.215146+0000","last_change":"2023-07-25T14:36:49.191240+0000","last_active":"2023-07-25T14:36:50.215146+0000","last_peered":"2023-07-25T14:36:50.215146+0000","last_clean":"2023-07-25T14:36:50.215146+0000","last_became_active":"2023-07-25T14:36:49.190922+0000","last_became_peered":"2023-07-25T14:36:49.190922+0000","last_unstale":"2023-07-25T14:36:50.215146+0000","last_undegraded":"2023-07-25T14:36:50.215146+0000","last_fullsized":"2023-07-25T14:36:50.215146+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_clean_scrub_stamp":"2023-07-25T14:36:48.163149+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T17:27:38.492227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-25T14:36:50.211041+0000","last_change":"2023-07-25T14:36:50.196466+0000","last_active":"2023-07-25T14:36:50.211041+0000","last_peered":"2023-07-25T14:36:50.211041+0000","last_clean":"2023-07-25T14:36:50.211041+0000","last_became_active":"2023-07-25T14:36:50.196192+0000","last_became_peered":"2023-07-25T14:36:50.196192+0000","last_unstale":"2023-07-25T14:36:50.211041+0000","last_undegraded":"2023-07-25T14:36:50.211041+0000","last_fullsized":"2023-07-25T14:36:50.211041+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:55:57.732280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"38'2","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-25T14:36:51.201318+0000","last_change":"2023-07-25T14:36:49.188196+0000","last_active":"2023-07-25T14:36:51.201318+0000","last_peered":"2023-07-25T14:36:51.201318+0000","last_clean":"2023-07-25T14:36:51.201318+0000","last_became_active":"2023-07-25T14:36:49.187926+0000","last_became_peered":"2023-07-25T14:36:49.187926+0000","last_unstale":"2023-07-25T14:36:51.201318+0000","last_undegraded":"2023-07-25T14:36:51.201318+0000","last_fullsized":"2023-07-25T14:36:51.201318+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_clean_scrub_stamp":"2023-07-25T14:36:48.163149+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T21:44:18.591624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-25T14:36:51.199623+0000","last_change":"2023-07-25T14:36:50.212960+0000","last_active":"2023-07-25T14:36:51.199623+0000","last_peered":"2023-07-25T14:36:51.199623+0000","last_clean":"2023-07-25T14:36:51.199623+0000","last_became_active":"2023-07-25T14:36:50.212690+0000","last_became_peered":"2023-07-25T14:36:50.212690+0000","last_unstale":"2023-07-25T14:36:51.199623+0000","last_undegraded":"2023-07-25T14:36:51.199623+0000","last_fullsized":"2023-07-25T14:36:51.199623+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T01:53:57.396852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"38'1","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-25T14:36:51.201434+0000","last_change":"2023-07-25T14:36:49.188916+0000","last_active":"2023-07-25T14:36:51.201434+0000","last_peered":"2023-07-25T14:36:51.201434+0000","last_clean":"2023-07-25T14:36:51.201434+0000","last_became_active":"2023-07-25T14:36:49.188691+0000","last_became_peered":"2023-07-25T14:36:49.188691+0000","last_unstale":"2023-07-25T14:36:51.201434+0000","last_undegraded":"2023-07-25T14:36:51.201434+0000","last_fullsized":"2023-07-25T14:36:51.201434+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_clean_scrub_stamp":"2023-07-25T14:36:48.163149+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T17:55:20.568265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-25T14:36:51.220313+0000","last_change":"2023-07-25T14:36:50.208734+0000","last_active":"2023-07-25T14:36:51.220313+0000","last_peered":"2023-07-25T14:36:51.220313+0000","last_clean":"2023-07-25T14:36:51.220313+0000","last_became_active":"2023-07-25T14:36:50.208472+0000","last_became_peered":"2023-07-25T14:36:50.208472+0000","last_unstale":"2023-07-25T14:36:51.220313+0000","last_undegraded":"2023-07-25T14:36:51.220313+0000","last_fullsized":"2023-07-25T14:36:51.220313+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T22:06:59.374190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-25T14:36:50.187289+0000","last_change":"2023-07-25T14:36:49.189168+0000","last_active":"2023-07-25T14:36:50.187289+0000","last_peered":"2023-07-25T14:36:50.187289+0000","last_clean":"2023-07-25T14:36:50.187289+0000","last_became_active":"2023-07-25T14:36:49.188894+0000","last_became_peered":"2023-07-25T14:36:49.188894+0000","last_unstale":"2023-07-25T14:36:50.187289+0000","last_undegraded":"2023-07-25T14:36:50.187289+0000","last_fullsized":"2023-07-25T14:36:50.187289+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_clean_scrub_stamp":"2023-07-25T14:36:48.163149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T16:08:27.158068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-25T14:36:50.205704+0000","last_change":"2023-07-25T14:36:50.199234+0000","last_active":"2023-07-25T14:36:50.205704+0000","last_peered":"2023-07-25T14:36:50.205704+0000","last_clean":"2023-07-25T14:36:50.205704+0000","last_became_active":"2023-07-25T14:36:50.198957+0000","last_became_peered":"2023-07-25T14:36:50.198957+0000","last_unstale":"2023-07-25T14:36:50.205704+0000","last_undegraded":"2023-07-25T14:36:50.205704+0000","last_fullsized":"2023-07-25T14:36:50.205704+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T22:31:55.585971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"38'2","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-25T14:36:50.216023+0000","last_change":"2023-07-25T14:36:49.192944+0000","last_active":"2023-07-25T14:36:50.216023+0000","last_peered":"2023-07-25T14:36:50.216023+0000","last_clean":"2023-07-25T14:36:50.216023+0000","last_became_active":"2023-07-25T14:36:49.191983+0000","last_became_peered":"2023-07-25T14:36:49.191983+0000","last_unstale":"2023-07-25T14:36:50.216023+0000","last_undegraded":"2023-07-25T14:36:50.216023+0000","last_fullsized":"2023-07-25T14:36:50.216023+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_clean_scrub_stamp":"2023-07-25T14:36:48.163149+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T16:29:47.163618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-25T14:36:50.207112+0000","last_change":"2023-07-25T14:36:50.203783+0000","last_active":"2023-07-25T14:36:50.207112+0000","last_peered":"2023-07-25T14:36:50.207112+0000","last_clean":"2023-07-25T14:36:50.207112+0000","last_became_active":"2023-07-25T14:36:50.203485+0000","last_became_peered":"2023-07-25T14:36:50.203485+0000","last_unstale":"2023-07-25T14:36:50.207112+0000","last_undegraded":"2023-07-25T14:36:50.207112+0000","last_fullsized":"2023-07-25T14:36:50.207112+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T01:05:55.734046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-25T14:36:51.202042+0000","last_change":"2023-07-25T14:36:49.182153+0000","last_active":"2023-07-25T14:36:51.202042+0000","last_peered":"2023-07-25T14:36:51.202042+0000","last_clean":"2023-07-25T14:36:51.202042+0000","last_became_active":"2023-07-25T14:36:49.181886+0000","last_became_peered":"2023-07-25T14:36:49.181886+0000","last_unstale":"2023-07-25T14:36:51.202042+0000","last_undegraded":"2023-07-25T14:36:51.202042+0000","last_fullsized":"2023-07-25T14:36:51.202042+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_clean_scrub_stamp":"2023-07-25T14:36:48.163149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T23:50:15.085784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-25T14:36:50.209836+0000","last_change":"2023-07-25T14:36:50.198991+0000","last_active":"2023-07-25T14:36:50.209836+0000","last_peered":"2023-07-25T14:36:50.209836+0000","last_clean":"2023-07-25T14:36:50.209836+0000","last_became_active":"2023-07-25T14:36:50.198737+0000","last_became_peered":"2023-07-25T14:36:50.198737+0000","last_unstale":"2023-07-25T14:36:50.209836+0000","last_undegraded":"2023-07-25T14:36:50.209836+0000","last_fullsized":"2023-07-25T14:36:50.209836+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T23:22:44.422583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-25T14:36:50.190071+0000","last_change":"2023-07-25T14:36:49.189641+0000","last_active":"2023-07-25T14:36:50.190071+0000","last_peered":"2023-07-25T14:36:50.190071+0000","last_clean":"2023-07-25T14:36:50.190071+0000","last_became_active":"2023-07-25T14:36:49.189365+0000","last_became_peered":"2023-07-25T14:36:49.189365+0000","last_unstale":"2023-07-25T14:36:50.190071+0000","last_undegraded":"2023-07-25T14:36:50.190071+0000","last_fullsized":"2023-07-25T14:36:50.190071+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_clean_scrub_stamp":"2023-07-25T14:36:48.163149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T22:14:57.092053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-25T14:36:50.215201+0000","last_change":"2023-07-25T14:36:50.206937+0000","last_active":"2023-07-25T14:36:50.215201+0000","last_peered":"2023-07-25T14:36:50.215201+0000","last_clean":"2023-07-25T14:36:50.215201+0000","last_became_active":"2023-07-25T14:36:50.206661+0000","last_became_peered":"2023-07-25T14:36:50.206661+0000","last_unstale":"2023-07-25T14:36:50.215201+0000","last_undegraded":"2023-07-25T14:36:50.215201+0000","last_fullsized":"2023-07-25T14:36:50.215201+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T22:50:04.182501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-25T14:36:50.189733+0000","last_change":"2023-07-25T14:36:49.189655+0000","last_active":"2023-07-25T14:36:50.189733+0000","last_peered":"2023-07-25T14:36:50.189733+0000","last_clean":"2023-07-25T14:36:50.189733+0000","last_became_active":"2023-07-25T14:36:49.189391+0000","last_became_peered":"2023-07-25T14:36:49.189391+0000","last_unstale":"2023-07-25T14:36:50.189733+0000","last_undegraded":"2023-07-25T14:36:50.189733+0000","last_fullsized":"2023-07-25T14:36:50.189733+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_clean_scrub_stamp":"2023-07-25T14:36:48.163149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:20:03.056373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-25T14:36:50.208677+0000","last_change":"2023-07-25T14:36:50.194211+0000","last_active":"2023-07-25T14:36:50.208677+0000","last_peered":"2023-07-25T14:36:50.208677+0000","last_clean":"2023-07-25T14:36:50.208677+0000","last_became_active":"2023-07-25T14:36:50.193907+0000","last_became_peered":"2023-07-25T14:36:50.193907+0000","last_unstale":"2023-07-25T14:36:50.208677+0000","last_undegraded":"2023-07-25T14:36:50.208677+0000","last_fullsized":"2023-07-25T14:36:50.208677+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:28:06.895576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-25T14:36:51.200964+0000","last_change":"2023-07-25T14:36:49.191235+0000","last_active":"2023-07-25T14:36:51.200964+0000","last_peered":"2023-07-25T14:36:51.200964+0000","last_clean":"2023-07-25T14:36:51.200964+0000","last_became_active":"2023-07-25T14:36:49.190894+0000","last_became_peered":"2023-07-25T14:36:49.190894+0000","last_unstale":"2023-07-25T14:36:51.200964+0000","last_undegraded":"2023-07-25T14:36:51.200964+0000","last_fullsized":"2023-07-25T14:36:51.200964+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_clean_scrub_stamp":"2023-07-25T14:36:48.163149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T21:39:47.820169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":53,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-25T14:36:51.201111+0000","last_change":"2023-07-25T14:35:34.371347+0000","last_active":"2023-07-25T14:36:51.201111+0000","last_peered":"2023-07-25T14:36:51.201111+0000","last_clean":"2023-07-25T14:36:51.201111+0000","last_became_active":"2023-07-25T14:35:34.371044+0000","last_became_peered":"2023-07-25T14:35:34.371044+0000","last_unstale":"2023-07-25T14:36:51.201111+0000","last_undegraded":"2023-07-25T14:36:51.201111+0000","last_fullsized":"2023-07-25T14:36:51.201111+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_clean_scrub_stamp":"2023-07-25T14:35:33.358525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T01:54:51.034857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-25T14:36:50.214972+0000","last_change":"2023-07-25T14:36:50.212966+0000","last_active":"2023-07-25T14:36:50.214972+0000","last_peered":"2023-07-25T14:36:50.214972+0000","last_clean":"2023-07-25T14:36:50.214972+0000","last_became_active":"2023-07-25T14:36:50.212728+0000","last_became_peered":"2023-07-25T14:36:50.212728+0000","last_unstale":"2023-07-25T14:36:50.214972+0000","last_undegraded":"2023-07-25T14:36:50.214972+0000","last_fullsized":"2023-07-25T14:36:50.214972+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T20:14:07.305005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-25T14:36:50.191623+0000","last_change":"2023-07-25T14:36:49.190255+0000","last_active":"2023-07-25T14:36:50.191623+0000","last_peered":"2023-07-25T14:36:50.191623+0000","last_clean":"2023-07-25T14:36:50.191623+0000","last_became_active":"2023-07-25T14:36:49.189883+0000","last_became_peered":"2023-07-25T14:36:49.189883+0000","last_unstale":"2023-07-25T14:36:50.191623+0000","last_undegraded":"2023-07-25T14:36:50.191623+0000","last_fullsized":"2023-07-25T14:36:50.191623+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_clean_scrub_stamp":"2023-07-25T14:36:48.163149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T18:56:48.500869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":49,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-25T14:36:50.187372+0000","last_change":"2023-07-25T14:35:34.371737+0000","last_active":"2023-07-25T14:36:50.187372+0000","last_peered":"2023-07-25T14:36:50.187372+0000","last_clean":"2023-07-25T14:36:50.187372+0000","last_became_active":"2023-07-25T14:35:34.371411+0000","last_became_peered":"2023-07-25T14:35:34.371411+0000","last_unstale":"2023-07-25T14:36:50.187372+0000","last_undegraded":"2023-07-25T14:36:50.187372+0000","last_fullsized":"2023-07-25T14:36:50.187372+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_clean_scrub_stamp":"2023-07-25T14:35:33.358525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T02:10:12.672768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-25T14:36:50.214296+0000","last_change":"2023-07-25T14:36:50.207537+0000","last_active":"2023-07-25T14:36:50.214296+0000","last_peered":"2023-07-25T14:36:50.214296+0000","last_clean":"2023-07-25T14:36:50.214296+0000","last_became_active":"2023-07-25T14:36:50.207278+0000","last_became_peered":"2023-07-25T14:36:50.207278+0000","last_unstale":"2023-07-25T14:36:50.214296+0000","last_undegraded":"2023-07-25T14:36:50.214296+0000","last_fullsized":"2023-07-25T14:36:50.214296+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:34:20.886125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-25T14:36:50.196834+0000","last_change":"2023-07-25T14:36:49.188513+0000","last_active":"2023-07-25T14:36:50.196834+0000","last_peered":"2023-07-25T14:36:50.196834+0000","last_clean":"2023-07-25T14:36:50.196834+0000","last_became_active":"2023-07-25T14:36:49.188212+0000","last_became_peered":"2023-07-25T14:36:49.188212+0000","last_unstale":"2023-07-25T14:36:50.196834+0000","last_undegraded":"2023-07-25T14:36:50.196834+0000","last_fullsized":"2023-07-25T14:36:50.196834+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_clean_scrub_stamp":"2023-07-25T14:36:48.163149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T15:14:02.860665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":47,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-25T14:36:50.197611+0000","last_change":"2023-07-25T14:35:34.370121+0000","last_active":"2023-07-25T14:36:50.197611+0000","last_peered":"2023-07-25T14:36:50.197611+0000","last_clean":"2023-07-25T14:36:50.197611+0000","last_became_active":"2023-07-25T14:35:34.369795+0000","last_became_peered":"2023-07-25T14:35:34.369795+0000","last_unstale":"2023-07-25T14:36:50.197611+0000","last_undegraded":"2023-07-25T14:36:50.197611+0000","last_fullsized":"2023-07-25T14:36:50.197611+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_clean_scrub_stamp":"2023-07-25T14:35:33.358525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T20:41:00.101965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":199,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-25T14:36:50.189990+0000","last_change":"2023-07-25T14:35:34.372381+0000","last_active":"2023-07-25T14:36:50.189990+0000","last_peered":"2023-07-25T14:36:50.189990+0000","last_clean":"2023-07-25T14:36:50.189990+0000","last_became_active":"2023-07-25T14:35:34.371110+0000","last_became_peered":"2023-07-25T14:35:34.371110+0000","last_unstale":"2023-07-25T14:36:50.189990+0000","last_undegraded":"2023-07-25T14:36:50.189990+0000","last_fullsized":"2023-07-25T14:36:50.189990+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_clean_scrub_stamp":"2023-07-25T14:35:33.358525+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T02:13:54.139158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-25T14:36:50.211564+0000","last_change":"2023-07-25T14:36:50.198441+0000","last_active":"2023-07-25T14:36:50.211564+0000","last_peered":"2023-07-25T14:36:50.211564+0000","last_clean":"2023-07-25T14:36:50.211564+0000","last_became_active":"2023-07-25T14:36:50.198177+0000","last_became_peered":"2023-07-25T14:36:50.198177+0000","last_unstale":"2023-07-25T14:36:50.211564+0000","last_undegraded":"2023-07-25T14:36:50.211564+0000","last_fullsized":"2023-07-25T14:36:50.211564+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T16:02:34.973381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-25T14:36:50.192417+0000","last_change":"2023-07-25T14:36:49.189278+0000","last_active":"2023-07-25T14:36:50.192417+0000","last_peered":"2023-07-25T14:36:50.192417+0000","last_clean":"2023-07-25T14:36:50.192417+0000","last_became_active":"2023-07-25T14:36:49.189011+0000","last_became_peered":"2023-07-25T14:36:49.189011+0000","last_unstale":"2023-07-25T14:36:50.192417+0000","last_undegraded":"2023-07-25T14:36:50.192417+0000","last_fullsized":"2023-07-25T14:36:50.192417+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_clean_scrub_stamp":"2023-07-25T14:36:48.163149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T23:50:15.085784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":49,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-25T14:36:50.191669+0000","last_change":"2023-07-25T14:35:35.321448+0000","last_active":"2023-07-25T14:36:50.191669+0000","last_peered":"2023-07-25T14:36:50.191669+0000","last_clean":"2023-07-25T14:36:50.191669+0000","last_became_active":"2023-07-25T14:35:35.320830+0000","last_became_peered":"2023-07-25T14:35:35.320830+0000","last_unstale":"2023-07-25T14:36:50.191669+0000","last_undegraded":"2023-07-25T14:36:50.191669+0000","last_fullsized":"2023-07-25T14:36:50.191669+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_clean_scrub_stamp":"2023-07-25T14:35:33.358525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T16:34:27.132528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-25T14:36:50.211081+0000","last_change":"2023-07-25T14:36:50.196768+0000","last_active":"2023-07-25T14:36:50.211081+0000","last_peered":"2023-07-25T14:36:50.211081+0000","last_clean":"2023-07-25T14:36:50.211081+0000","last_became_active":"2023-07-25T14:36:50.195596+0000","last_became_peered":"2023-07-25T14:36:50.195596+0000","last_unstale":"2023-07-25T14:36:50.211081+0000","last_undegraded":"2023-07-25T14:36:50.211081+0000","last_fullsized":"2023-07-25T14:36:50.211081+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T23:55:04.578607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"38'2","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-25T14:36:51.201413+0000","last_change":"2023-07-25T14:36:49.190402+0000","last_active":"2023-07-25T14:36:51.201413+0000","last_peered":"2023-07-25T14:36:51.201413+0000","last_clean":"2023-07-25T14:36:51.201413+0000","last_became_active":"2023-07-25T14:36:49.190103+0000","last_became_peered":"2023-07-25T14:36:49.190103+0000","last_unstale":"2023-07-25T14:36:51.201413+0000","last_undegraded":"2023-07-25T14:36:51.201413+0000","last_fullsized":"2023-07-25T14:36:51.201413+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_clean_scrub_stamp":"2023-07-25T14:36:48.163149+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T18:56:48.500869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":49,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-25T14:36:50.189830+0000","last_change":"2023-07-25T14:35:35.321201+0000","last_active":"2023-07-25T14:36:50.189830+0000","last_peered":"2023-07-25T14:36:50.189830+0000","last_clean":"2023-07-25T14:36:50.189830+0000","last_became_active":"2023-07-25T14:35:35.320728+0000","last_became_peered":"2023-07-25T14:35:35.320728+0000","last_unstale":"2023-07-25T14:36:50.189830+0000","last_undegraded":"2023-07-25T14:36:50.189830+0000","last_fullsized":"2023-07-25T14:36:50.189830+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_clean_scrub_stamp":"2023-07-25T14:35:33.358525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T18:37:14.630530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-25T14:36:51.220489+0000","last_change":"2023-07-25T14:36:50.211993+0000","last_active":"2023-07-25T14:36:51.220489+0000","last_peered":"2023-07-25T14:36:51.220489+0000","last_clean":"2023-07-25T14:36:51.220489+0000","last_became_active":"2023-07-25T14:36:50.211594+0000","last_became_peered":"2023-07-25T14:36:50.211594+0000","last_unstale":"2023-07-25T14:36:51.220489+0000","last_undegraded":"2023-07-25T14:36:51.220489+0000","last_fullsized":"2023-07-25T14:36:51.220489+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T22:48:04.203409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-25T14:36:50.186841+0000","last_change":"2023-07-25T14:36:49.189206+0000","last_active":"2023-07-25T14:36:50.186841+0000","last_peered":"2023-07-25T14:36:50.186841+0000","last_clean":"2023-07-25T14:36:50.186841+0000","last_became_active":"2023-07-25T14:36:49.188939+0000","last_became_peered":"2023-07-25T14:36:49.188939+0000","last_unstale":"2023-07-25T14:36:50.186841+0000","last_undegraded":"2023-07-25T14:36:50.186841+0000","last_fullsized":"2023-07-25T14:36:50.186841+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_clean_scrub_stamp":"2023-07-25T14:36:48.163149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T15:58:32.259283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":55,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-25T14:36:51.201301+0000","last_change":"2023-07-25T14:35:35.321057+0000","last_active":"2023-07-25T14:36:51.201301+0000","last_peered":"2023-07-25T14:36:51.201301+0000","last_clean":"2023-07-25T14:36:51.201301+0000","last_became_active":"2023-07-25T14:35:35.320751+0000","last_became_peered":"2023-07-25T14:35:35.320751+0000","last_unstale":"2023-07-25T14:36:51.201301+0000","last_undegraded":"2023-07-25T14:36:51.201301+0000","last_fullsized":"2023-07-25T14:36:51.201301+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_clean_scrub_stamp":"2023-07-25T14:35:33.358525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T15:08:41.326239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-25T14:36:51.201084+0000","last_change":"2023-07-25T14:36:50.207719+0000","last_active":"2023-07-25T14:36:51.201084+0000","last_peered":"2023-07-25T14:36:51.201084+0000","last_clean":"2023-07-25T14:36:51.201084+0000","last_became_active":"2023-07-25T14:36:50.207251+0000","last_became_peered":"2023-07-25T14:36:50.207251+0000","last_unstale":"2023-07-25T14:36:51.201084+0000","last_undegraded":"2023-07-25T14:36:51.201084+0000","last_fullsized":"2023-07-25T14:36:51.201084+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T02:15:09.947725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-25T14:36:50.197183+0000","last_change":"2023-07-25T14:36:49.188367+0000","last_active":"2023-07-25T14:36:50.197183+0000","last_peered":"2023-07-25T14:36:50.197183+0000","last_clean":"2023-07-25T14:36:50.197183+0000","last_became_active":"2023-07-25T14:36:49.188073+0000","last_became_peered":"2023-07-25T14:36:49.188073+0000","last_unstale":"2023-07-25T14:36:50.197183+0000","last_undegraded":"2023-07-25T14:36:50.197183+0000","last_fullsized":"2023-07-25T14:36:50.197183+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_clean_scrub_stamp":"2023-07-25T14:36:48.163149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T22:48:03.199466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":51,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-25T14:36:51.220498+0000","last_change":"2023-07-25T14:35:35.321055+0000","last_active":"2023-07-25T14:36:51.220498+0000","last_peered":"2023-07-25T14:36:51.220498+0000","last_clean":"2023-07-25T14:36:51.220498+0000","last_became_active":"2023-07-25T14:35:35.320739+0000","last_became_peered":"2023-07-25T14:35:35.320739+0000","last_unstale":"2023-07-25T14:36:51.220498+0000","last_undegraded":"2023-07-25T14:36:51.220498+0000","last_fullsized":"2023-07-25T14:36:51.220498+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_clean_scrub_stamp":"2023-07-25T14:35:33.358525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T20:41:00.101965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-25T14:36:51.200696+0000","last_change":"2023-07-25T14:36:50.213458+0000","last_active":"2023-07-25T14:36:51.200696+0000","last_peered":"2023-07-25T14:36:51.200696+0000","last_clean":"2023-07-25T14:36:51.200696+0000","last_became_active":"2023-07-25T14:36:50.213138+0000","last_became_peered":"2023-07-25T14:36:50.213138+0000","last_unstale":"2023-07-25T14:36:51.200696+0000","last_undegraded":"2023-07-25T14:36:51.200696+0000","last_fullsized":"2023-07-25T14:36:51.200696+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T18:39:57.307887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-25T14:36:50.190639+0000","last_change":"2023-07-25T14:36:49.189178+0000","last_active":"2023-07-25T14:36:50.190639+0000","last_peered":"2023-07-25T14:36:50.190639+0000","last_clean":"2023-07-25T14:36:50.190639+0000","last_became_active":"2023-07-25T14:36:49.188876+0000","last_became_peered":"2023-07-25T14:36:49.188876+0000","last_unstale":"2023-07-25T14:36:50.190639+0000","last_undegraded":"2023-07-25T14:36:50.190639+0000","last_fullsized":"2023-07-25T14:36:50.190639+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_clean_scrub_stamp":"2023-07-25T14:36:48.163149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T17:37:21.615397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":51,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-25T14:36:51.220453+0000","last_change":"2023-07-25T14:35:34.370772+0000","last_active":"2023-07-25T14:36:51.220453+0000","last_peered":"2023-07-25T14:36:51.220453+0000","last_clean":"2023-07-25T14:36:51.220453+0000","last_became_active":"2023-07-25T14:35:34.370549+0000","last_became_peered":"2023-07-25T14:35:34.370549+0000","last_unstale":"2023-07-25T14:36:51.220453+0000","last_undegraded":"2023-07-25T14:36:51.220453+0000","last_fullsized":"2023-07-25T14:36:51.220453+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_clean_scrub_stamp":"2023-07-25T14:35:33.358525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T02:08:24.893368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64510,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574868,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27524,"kb_used_data":496,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344316,"statfs":{"total":96636764160,"available":96608579584,"internally_reserved":0,"allocated":507904,"data_stored":785773,"data_compressed":32255,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jul 25 14:36:37 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":9.1600000000000001,"5min":9.1600000000000001,"15min":9.1600000000000001},"last":0.56999999999999995}]},{"osd":1,"last update":"Tue Jul 25 14:36:37 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.5009999999999999,"5min":1.5009999999999999,"15min":1.5009999999999999},"last":0.623},{"interface":"front","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.526,"5min":1.526,"15min":1.526},"last":0.63300000000000001}]},{"osd":2,"last update":"Tue Jul 25 14:36:37 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":8.1739999999999995,"5min":8.1739999999999995,"15min":8.1739999999999995},"last":0.52500000000000002}]},{"osd":3,"last update":"Tue Jul 25 14:36:37 2023","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":7.2279999999999998,"5min":7.2279999999999998,"15min":7.2279999999999998},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":7.1870000000000003,"5min":7.1870000000000003,"15min":7.1870000000000003},"last":0.59899999999999998}]},{"osd":4,"last update":"Tue Jul 25 14:36:37 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.40000000000000002}]},{"osd":5,"last update":"Tue Jul 25 14:36:37 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.53800000000000003}]},{"osd":6,"last update":"Tue Jul 25 14:36:37 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.286,"5min":1.286,"15min":1.286},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.50600000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574867,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27460,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344380,"statfs":{"total":96636764160,"available":96608645120,"internally_reserved":0,"allocated":446464,"data_stored":195987,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jul 25 14:36:32 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":1.9370000000000001,"5min":1.9370000000000001,"15min":1.9370000000000001},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":2.6779999999999999,"5min":2.6779999999999999,"15min":2.6779999999999999},"last":0.60999999999999999}]},{"osd":1,"last update":"Tue Jul 25 14:36:32 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":2.5720000000000001,"5min":2.5720000000000001,"15min":2.5720000000000001},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":1.6259999999999999,"5min":1.6259999999999999,"15min":1.6259999999999999},"last":0.623}]},{"osd":2,"last update":"Tue Jul 25 14:36:32 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.59199999999999997}]},{"osd":3,"last update":"Tue Jul 25 14:36:32 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":3.5750000000000002,"5min":3.5750000000000002,"15min":3.5750000000000002},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":4.7190000000000003,"5min":4.7190000000000003,"15min":4.7190000000000003},"last":0.66500000000000004}]},{"osd":4,"last update":"Tue Jul 25 14:36:32 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":4.694,"5min":4.694,"15min":4.694},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":2.7839999999999998,"5min":2.7839999999999998,"15min":2.7839999999999998},"last":0.63700000000000001}]},{"osd":5,"last update":"Tue Jul 25 14:36:32 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.7310000000000001,"5min":1.7310000000000001,"15min":1.7310000000000001},"last":0.54500000000000004}]},{"osd":7,"last update":"Tue Jul 25 14:36:32 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":2.7290000000000001,"5min":2.7290000000000001,"15min":2.7290000000000001},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.65100000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574867,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27524,"kb_used_data":496,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344316,"statfs":{"total":96636764160,"available":96608579584,"internally_reserved":0,"allocated":507904,"data_stored":785753,"data_compressed":32255,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jul 25 14:36:34 2023","interfaces":[{"interface":"back","average":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"last":0.28100000000000003},{"interface":"front","average":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"last":0.29599999999999999}]},{"osd":2,"last update":"Tue Jul 25 14:36:34 2023","interfaces":[{"interface":"back","average":{"1min":0.309,"5min":0.309,"15min":0.309},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"last":0.245},{"interface":"front","average":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"last":0.36599999999999999}]},{"osd":3,"last update":"Tue Jul 25 14:36:34 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.374,"15min":0.374},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.496,"5min":0.496,"15min":0.496},"last":0.34899999999999998}]},{"osd":4,"last update":"Tue Jul 25 14:36:34 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.44700000000000001}]},{"osd":5,"last update":"Tue Jul 25 14:36:34 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.502},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.52300000000000002}]},{"osd":6,"last update":"Tue Jul 25 14:36:34 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.57799999999999996}]},{"osd":7,"last update":"Tue Jul 25 14:36:34 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.54500000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574867,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27452,"kb_used_data":428,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":438272,"data_stored":194288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Jul 25 14:36:32 2023","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"min":{"1min":0.19600000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":6.5369999999999999,"5min":6.5369999999999999,"15min":6.5369999999999999},"last":0.27200000000000002}]},{"osd":2,"last update":"Tue Jul 25 14:36:32 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.374,"15min":0.374},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.24199999999999999},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":6.5659999999999998,"5min":6.5659999999999998,"15min":6.5659999999999998},"last":0.36499999999999999}]},{"osd":3,"last update":"Tue Jul 25 14:36:32 2023","interfaces":[{"interface":"back","average":{"1min":1.026,"5min":1.026,"15min":1.026},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":12.449,"5min":12.449,"15min":12.449},"last":0.309},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":1.079,"5min":1.079,"15min":1.079},"last":0.38800000000000001}]},{"osd":4,"last update":"Tue Jul 25 14:36:32 2023","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":6.5099999999999998,"5min":6.5099999999999998,"15min":6.5099999999999998},"last":0.57399999999999995},{"interface":"front","average":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":12.35,"5min":12.35,"15min":12.35},"last":0.438}]},{"osd":5,"last update":"Tue Jul 25 14:36:32 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.107,"5min":1.107,"15min":1.107},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":6.4349999999999996,"5min":6.4349999999999996,"15min":6.4349999999999996},"last":0.55600000000000005}]},{"osd":6,"last update":"Tue Jul 25 14:36:32 2023","interfaces":[{"interface":"back","average":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":12.417,"5min":12.417,"15min":12.417},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.45000000000000001}]},{"osd":7,"last update":"Tue Jul 25 14:36:32 2023","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":6.4809999999999999,"5min":6.4809999999999999,"15min":6.4809999999999999},"last":0.53100000000000003},{"interface":"front","average":{"1min":1.22,"5min":1.22,"15min":1.22},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":12.388999999999999,"5min":12.388999999999999,"15min":12.388999999999999},"last":0.46300000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574867,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":440,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":450560,"data_stored":195840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jul 25 14:36:31 2023","interfaces":[{"interface":"back","average":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":2.1030000000000002,"5min":2.1030000000000002,"15min":2.1030000000000002},"last":0.37},{"interface":"front","average":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":16.969000000000001,"5min":16.969000000000001,"15min":16.969000000000001},"last":0.28199999999999997}]},{"osd":1,"last update":"Tue Jul 25 14:36:31 2023","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"last":0.31},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":1.111,"5min":1.111,"15min":1.111},"last":0.35399999999999998}]},{"osd":3,"last update":"Tue Jul 25 14:36:31 2023","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":13.035,"5min":13.035,"15min":13.035},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.40000000000000002}]},{"osd":4,"last update":"Tue Jul 25 14:36:31 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":6.165,"5min":6.165,"15min":6.165},"last":0.50800000000000001},{"interface":"front","average":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":13.004,"5min":13.004,"15min":13.004},"last":0.61799999999999999}]},{"osd":5,"last update":"Tue Jul 25 14:36:31 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":6.226,"5min":6.226,"15min":6.226},"last":0.63}]},{"osd":6,"last update":"Tue Jul 25 14:36:31 2023","interfaces":[{"interface":"back","average":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":12.974,"5min":12.974,"15min":12.974},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.57899999999999996}]},{"osd":7,"last update":"Tue Jul 25 14:36:31 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":6.1989999999999998,"5min":6.1989999999999998,"15min":6.1989999999999998},"last":0.54000000000000004},{"interface":"front","average":{"1min":1.141,"5min":1.141,"15min":1.141},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":12.936999999999999,"5min":12.936999999999999,"15min":12.936999999999999},"last":0.52800000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574867,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27460,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344380,"statfs":{"total":96636764160,"available":96608645120,"internally_reserved":0,"allocated":446464,"data_stored":194892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jul 25 14:36:34 2023","interfaces":[{"interface":"back","average":{"1min":0.316,"5min":0.316,"15min":0.316},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"last":0.29299999999999998}]},{"osd":1,"last update":"Tue Jul 25 14:36:34 2023","interfaces":[{"interface":"back","average":{"1min":0.307,"5min":0.307,"15min":0.307},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.378,"5min":0.378,"15min":0.378},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.376,"5min":0.376,"15min":0.376},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"last":0.26300000000000001}]},{"osd":2,"last update":"Tue Jul 25 14:36:34 2023","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.377,"15min":0.377},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.502,"5min":0.502,"15min":0.502},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.315}]},{"osd":4,"last update":"Tue Jul 25 14:36:34 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.67800000000000005}]},{"osd":5,"last update":"Tue Jul 25 14:36:34 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.622},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.72499999999999998}]},{"osd":6,"last update":"Tue Jul 25 14:36:34 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.68400000000000005}]},{"osd":7,"last update":"Tue Jul 25 14:36:34 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.64400000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574867,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":440,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":450560,"data_stored":196879,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jul 25 14:36:33 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.501}]},{"osd":1,"last update":"Tue Jul 25 14:36:33 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.38900000000000001}]},{"osd":2,"last update":"Tue Jul 25 14:36:33 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.46800000000000003}]},{"osd":3,"last update":"Tue Jul 25 14:36:33 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.8720000000000001,"5min":1.8720000000000001,"15min":1.8720000000000001},"last":0.53800000000000003}]},{"osd":5,"last update":"Tue Jul 25 14:36:33 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.44600000000000001}]},{"osd":6,"last update":"Tue Jul 25 14:36:33 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.59199999999999997}]},{"osd":7,"last update":"Tue Jul 25 14:36:33 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.63}]}]},{"osd":5,"up_from":13,"seq":55834574867,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27456,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344384,"statfs":{"total":96636764160,"available":96608649216,"internally_reserved":0,"allocated":442368,"data_stored":195385,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jul 25 14:36:31 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":2.548,"5min":2.548,"15min":2.548},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.61099999999999999}]},{"osd":1,"last update":"Tue Jul 25 14:36:31 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.657,"5min":1.657,"15min":1.657},"last":0.753},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.752,"5min":1.752,"15min":1.752},"last":0.629}]},{"osd":2,"last update":"Tue Jul 25 14:36:31 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.70299999999999996}]},{"osd":3,"last update":"Tue Jul 25 14:36:31 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.73999999999999999}]},{"osd":4,"last update":"Tue Jul 25 14:36:31 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.66700000000000004}]},{"osd":6,"last update":"Tue Jul 25 14:36:31 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.64400000000000002}]},{"osd":7,"last update":"Tue Jul 25 14:36:31 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.68300000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32255,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32255,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-25T14:36:54.306 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-25T14:36:54.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.446+0000 7f1ef3625700 1 Processor -- start 2023-07-25T14:36:54.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.446+0000 7f1ef3625700 1 -- start start 2023-07-25T14:36:54.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.447+0000 7f1ef3625700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f1eec0724c0 0x7f1eec0c34c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:54.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.447+0000 7f1ef3625700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1eec0c2fe0 con 0x7f1eec151950 2023-07-25T14:36:54.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.447+0000 7f1ef3625700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1eec155070 con 0x7f1eec0c4930 2023-07-25T14:36:54.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.447+0000 7f1ef3625700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1eec071a60 con 0x7f1eec0724c0 2023-07-25T14:36:54.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.447+0000 7f1ef13c1700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f1eec151950 0x7f1eec06a190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:32782/0 (socket says 172.21.15.72:32782) 2023-07-25T14:36:54.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.447+0000 7f1ef13c1700 1 -- 172.21.15.72:0/1253095702 learned_addr learned my addr 172.21.15.72:0/1253095702 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:36:54.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.447+0000 7f1ef0bc0700 1 --2- 172.21.15.72:0/1253095702 >> v2:172.21.15.92:3300/0 conn(0x7f1eec0724c0 0x7f1eec0c34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:54.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.447+0000 7f1ee3fff700 1 -- 172.21.15.72:0/1253095702 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1100037934 0 0) 0x7f1eec0c2fe0 con 0x7f1eec151950 2023-07-25T14:36:54.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.447+0000 7f1ee3fff700 1 -- 172.21.15.72:0/1253095702 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1ed80035b0 con 0x7f1eec151950 2023-07-25T14:36:54.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.447+0000 7f1ee3fff700 1 -- 172.21.15.72:0/1253095702 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1388357940 0 0) 0x7f1ed80035b0 con 0x7f1eec151950 2023-07-25T14:36:54.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.447+0000 7f1ee3fff700 1 -- 172.21.15.72:0/1253095702 >> v2:172.21.15.92:3300/0 conn(0x7f1eec0724c0 msgr2=0x7f1eec0c34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:54.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.447+0000 7f1ee3fff700 1 --2- 172.21.15.72:0/1253095702 >> v2:172.21.15.92:3300/0 conn(0x7f1eec0724c0 0x7f1eec0c34c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:54.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.447+0000 7f1ee3fff700 1 -- 172.21.15.72:0/1253095702 >> v1:172.21.15.92:6789/0 conn(0x7f1eec0c4930 legacy=0x7f1eec0c3a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:54.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.447+0000 7f1ee3fff700 1 -- 172.21.15.72:0/1253095702 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1eec0c15c0 con 0x7f1eec151950 2023-07-25T14:36:54.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.447+0000 7f1ee3fff700 1 -- 172.21.15.72:0/1253095702 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2559588315 0 0) 0x7f1ee8001670 con 0x7f1eec151950 2023-07-25T14:36:54.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.447+0000 7f1ee3fff700 1 -- 172.21.15.72:0/1253095702 >> v1:172.21.15.72:6789/0 conn(0x7f1eec151950 legacy=0x7f1eec06a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:54.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.447+0000 7f1ee3fff700 1 --2- 172.21.15.72:0/1253095702 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1ed8003a00 0x7f1ed8003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:54.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.447+0000 7f1ee3fff700 1 --2- 172.21.15.72:0/1253095702 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1ed8004850 0x7f1ed8004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:54.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.447+0000 7f1ee3fff700 1 --2- 172.21.15.72:0/1253095702 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1ed8005210 0x7f1ed800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:54.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.448+0000 7f1ee3fff700 1 -- 172.21.15.72:0/1253095702 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1eec071a60 con 0x7f1ed8003a00 2023-07-25T14:36:54.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.448+0000 7f1ee3fff700 1 -- 172.21.15.72:0/1253095702 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ed800c1b0 con 0x7f1ed8005210 2023-07-25T14:36:54.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.448+0000 7f1ee3fff700 1 -- 172.21.15.72:0/1253095702 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ed800c370 con 0x7f1ed8004850 2023-07-25T14:36:54.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.448+0000 7f1ef0bc0700 1 --2- 172.21.15.72:0/1253095702 >> v2:172.21.15.92:3300/0 conn(0x7f1eec0724c0 0x7f1eec0c34c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-25T14:36:54.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.448+0000 7f1ef13c1700 1 --2- 172.21.15.72:0/1253095702 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1ed8003a00 0x7f1ed8003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:54.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.448+0000 7f1ef1bc2700 1 --2- 172.21.15.72:0/1253095702 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1ed8005210 0x7f1ed800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:54.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.448+0000 7f1ef0bc0700 1 --2- 172.21.15.72:0/1253095702 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1ed8004850 0x7f1ed8004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:54.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.448+0000 7f1ef13c1700 1 -- 172.21.15.72:0/1253095702 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1ed8004850 msgr2=0x7f1ed8004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:54.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.448+0000 7f1ef13c1700 1 --2- 172.21.15.72:0/1253095702 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1ed8004850 0x7f1ed8004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:54.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.448+0000 7f1ef13c1700 1 -- 172.21.15.72:0/1253095702 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1ed8005210 msgr2=0x7f1ed800ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:54.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.448+0000 7f1ef13c1700 1 --2- 172.21.15.72:0/1253095702 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1ed8005210 0x7f1ed800ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:54.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.448+0000 7f1ef1bc2700 1 -- 172.21.15.72:0/1253095702 reap_dead start 2023-07-25T14:36:54.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.448+0000 7f1ef13c1700 1 -- 172.21.15.72:0/1253095702 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ed80035b0 con 0x7f1ed8003a00 2023-07-25T14:36:54.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.448+0000 7f1ef13c1700 1 --2- 172.21.15.72:0/1253095702 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1ed8003a00 0x7f1ed8003e20 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f1ee800c240 tx=0x7f1ed8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e82e3a15c5198b02 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:54.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.448+0000 7f1ee3fff700 1 -- 172.21.15.72:0/1253095702 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ee8007c10 con 0x7f1ed8003a00 2023-07-25T14:36:54.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.448+0000 7f1ee3fff700 1 -- 172.21.15.72:0/1253095702 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ee800ce00 con 0x7f1ed8003a00 2023-07-25T14:36:54.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.448+0000 7f1ee3fff700 1 -- 172.21.15.72:0/1253095702 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ee8005ba0 con 0x7f1ed8003a00 2023-07-25T14:36:54.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.449+0000 7f1ef3625700 1 -- 172.21.15.72:0/1253095702 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1ed8003a00 msgr2=0x7f1ed8003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:54.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.449+0000 7f1ef3625700 1 --2- 172.21.15.72:0/1253095702 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1ed8003a00 0x7f1ed8003e20 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f1ee800c240 tx=0x7f1ed8005880 comp rx=0 tx=0).stop 2023-07-25T14:36:54.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.449+0000 7f1ef3625700 1 -- 172.21.15.72:0/1253095702 shutdown_connections 2023-07-25T14:36:54.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.449+0000 7f1ef3625700 1 --2- 172.21.15.72:0/1253095702 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1ed8003a00 0x7f1ed8003e20 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:54.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.449+0000 7f1ef3625700 1 -- 172.21.15.72:0/1253095702 >> 172.21.15.72:0/1253095702 conn(0x7f1eec0a87e0 msgr2=0x7f1eec0a8bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:54.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.449+0000 7f1ef3625700 1 -- 172.21.15.72:0/1253095702 shutdown_connections 2023-07-25T14:36:54.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.449+0000 7f1ef3625700 1 -- 172.21.15.72:0/1253095702 wait complete. 2023-07-25T14:36:54.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.450+0000 7f1ef3625700 1 Processor -- start 2023-07-25T14:36:54.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.450+0000 7f1ef3625700 1 -- start start 2023-07-25T14:36:54.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.451+0000 7f1ef3625700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1ed8003a00 0x7f1eec1ea940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:54.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.451+0000 7f1ef3625700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1eec0a76f0 0x7f1eec1e9f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:54.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.451+0000 7f1ef3625700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1eec14ca40 0x7f1eec0a6a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:54.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.451+0000 7f1ef3625700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1eec0a81b0 con 0x7f1ed8003a00 2023-07-25T14:36:54.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.451+0000 7f1ef3625700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1eec14d4b0 con 0x7f1eec14ca40 2023-07-25T14:36:54.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.451+0000 7f1ef3625700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1eec1ea490 con 0x7f1eec0a76f0 2023-07-25T14:36:54.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.451+0000 7f1ef13c1700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1ed8003a00 0x7f1eec1ea940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:54.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.451+0000 7f1ef13c1700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1ed8003a00 0x7f1eec1ea940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42058/0 (socket says 172.21.15.72:42058) 2023-07-25T14:36:54.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.451+0000 7f1ef13c1700 1 -- 172.21.15.72:0/2876044967 learned_addr learned my addr 172.21.15.72:0/2876044967 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:54.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.451+0000 7f1ef1bc2700 1 --2- 172.21.15.72:0/2876044967 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1eec14ca40 0x7f1eec0a6a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:54.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.451+0000 7f1ef0bc0700 1 --2- 172.21.15.72:0/2876044967 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1eec0a76f0 0x7f1eec1e9f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:54.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.451+0000 7f1ef13c1700 1 -- 172.21.15.72:0/2876044967 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1eec0a76f0 msgr2=0x7f1eec1e9f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:54.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.451+0000 7f1ef13c1700 1 --2- 172.21.15.72:0/2876044967 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1eec0a76f0 0x7f1eec1e9f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:54.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.451+0000 7f1ef13c1700 1 -- 172.21.15.72:0/2876044967 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1eec14ca40 msgr2=0x7f1eec0a6a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:54.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.451+0000 7f1ef13c1700 1 --2- 172.21.15.72:0/2876044967 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1eec14ca40 0x7f1eec0a6a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:54.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.451+0000 7f1ef13c1700 1 -- 172.21.15.72:0/2876044967 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1eec0a6280 con 0x7f1ed8003a00 2023-07-25T14:36:54.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.451+0000 7f1ef13c1700 1 --2- 172.21.15.72:0/2876044967 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1ed8003a00 0x7f1eec1ea940 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f1ee8000c00 tx=0x7f1ee8001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:54.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.451+0000 7f1ee1ffb700 1 -- 172.21.15.72:0/2876044967 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ee8005d90 con 0x7f1ed8003a00 2023-07-25T14:36:54.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.451+0000 7f1ee1ffb700 1 -- 172.21.15.72:0/2876044967 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ee80070d0 con 0x7f1ed8003a00 2023-07-25T14:36:54.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.451+0000 7f1ef3625700 1 -- 172.21.15.72:0/2876044967 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1eec0a7bf0 con 0x7f1ed8003a00 2023-07-25T14:36:54.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.451+0000 7f1ee1ffb700 1 -- 172.21.15.72:0/2876044967 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ee8007480 con 0x7f1ed8003a00 2023-07-25T14:36:54.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.451+0000 7f1ef3625700 1 -- 172.21.15.72:0/2876044967 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1eec0a6520 con 0x7f1ed8003a00 2023-07-25T14:36:54.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.452+0000 7f1ef3625700 1 -- 172.21.15.72:0/2876044967 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1eec0a66e0 con 0x7f1ed8003a00 2023-07-25T14:36:54.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.453+0000 7f1ee1ffb700 1 -- 172.21.15.72:0/2876044967 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1ee80075e0 con 0x7f1ed8003a00 2023-07-25T14:36:54.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.453+0000 7f1ee1ffb700 1 --2- 172.21.15.72:0/2876044967 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f1ed006ace0 0x7f1ed006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:54.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.453+0000 7f1ee1ffb700 1 -- 172.21.15.72:0/2876044967 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f1ee808a610 con 0x7f1ed8003a00 2023-07-25T14:36:54.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.453+0000 7f1ef0bc0700 1 --2- 172.21.15.72:0/2876044967 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f1ed006ace0 0x7f1ed006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:54.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.454+0000 7f1ef0bc0700 1 --2- 172.21.15.72:0/2876044967 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f1ed006ace0 0x7f1ed006d1a0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f1eec1e7310 tx=0x7f1edc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:54.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.457+0000 7f1ee1ffb700 1 -- 172.21.15.72:0/2876044967 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f1ee8055610 con 0x7f1ed8003a00 2023-07-25T14:36:54.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.639+0000 7f1ef3625700 1 -- 172.21.15.72:0/2876044967 --> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1eec154d00 con 0x7f1ed006ace0 2023-07-25T14:36:54.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.647+0000 7f1ee1ffb700 1 -- 172.21.15.72:0/2876044967 <== mgr.4104 v2:172.21.15.72:6832/1171220306 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311175 (secure 0 0 0) 0x7f1edc013850 con 0x7f1ed006ace0 2023-07-25T14:36:54.662 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-25T14:36:54.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.650+0000 7f1ef3625700 1 -- 172.21.15.72:0/2876044967 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f1ed006ace0 msgr2=0x7f1ed006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:54.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.650+0000 7f1ef3625700 1 --2- 172.21.15.72:0/2876044967 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f1ed006ace0 0x7f1ed006d1a0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f1eec1e7310 tx=0x7f1edc008040 comp rx=0 tx=0).stop 2023-07-25T14:36:54.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.650+0000 7f1ef3625700 1 -- 172.21.15.72:0/2876044967 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1ed8003a00 msgr2=0x7f1eec1ea940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:54.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.650+0000 7f1ef3625700 1 --2- 172.21.15.72:0/2876044967 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1ed8003a00 0x7f1eec1ea940 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f1ee8000c00 tx=0x7f1ee8001a00 comp rx=0 tx=0).stop 2023-07-25T14:36:54.664 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.650+0000 7f1ef3625700 1 -- 172.21.15.72:0/2876044967 shutdown_connections 2023-07-25T14:36:54.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.650+0000 7f1ef3625700 1 --2- 172.21.15.72:0/2876044967 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f1ed006ace0 0x7f1ed006d1a0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:54.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.650+0000 7f1ef3625700 1 --2- 172.21.15.72:0/2876044967 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1eec14ca40 0x7f1eec0a6a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:54.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.650+0000 7f1ef3625700 1 --2- 172.21.15.72:0/2876044967 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1ed8003a00 0x7f1eec1ea940 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:54.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.650+0000 7f1ef3625700 1 --2- 172.21.15.72:0/2876044967 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1eec0a76f0 0x7f1eec1e9f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:54.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.650+0000 7f1ef3625700 1 -- 172.21.15.72:0/2876044967 >> 172.21.15.72:0/2876044967 conn(0x7f1eec0a87e0 msgr2=0x7f1eec1501e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:54.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.650+0000 7f1ef3625700 1 -- 172.21.15.72:0/2876044967 shutdown_connections 2023-07-25T14:36:54.665 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.650+0000 7f1ef3625700 1 -- 172.21.15.72:0/2876044967 wait complete. 2023-07-25T14:36:54.665 INFO:teuthology.orchestra.run.smithi072.stderr:dumped all 2023-07-25T14:36:54.674 INFO:teuthology.orchestra.run.smithi072.stdout:{"pg_ready":true,"pg_map":{"version":73,"stamp":"2023-07-25T14:36:53.300473+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":86,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219804,"kb_used_data":3604,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754754916,"statfs":{"total":773094113280,"available":772869033984,"internally_reserved":0,"allocated":3690496,"data_stored":2744797,"data_compressed":64510,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":33,"apply_latency_ms":33,"commit_latency_ns":33000000,"apply_latency_ns":33000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.132507"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-25T14:36:50.203083+0000","last_change":"2023-07-25T14:36:50.199855+0000","last_active":"2023-07-25T14:36:50.203083+0000","last_peered":"2023-07-25T14:36:50.203083+0000","last_clean":"2023-07-25T14:36:50.203083+0000","last_became_active":"2023-07-25T14:36:50.199464+0000","last_became_peered":"2023-07-25T14:36:50.199464+0000","last_unstale":"2023-07-25T14:36:50.203083+0000","last_undegraded":"2023-07-25T14:36:50.203083+0000","last_fullsized":"2023-07-25T14:36:50.203083+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T16:14:20.244451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-25T14:36:51.201478+0000","last_change":"2023-07-25T14:36:50.210983+0000","last_active":"2023-07-25T14:36:51.201478+0000","last_peered":"2023-07-25T14:36:51.201478+0000","last_clean":"2023-07-25T14:36:51.201478+0000","last_became_active":"2023-07-25T14:36:50.210721+0000","last_became_peered":"2023-07-25T14:36:50.210721+0000","last_unstale":"2023-07-25T14:36:51.201478+0000","last_undegraded":"2023-07-25T14:36:51.201478+0000","last_fullsized":"2023-07-25T14:36:51.201478+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T16:35:42.941095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-25T14:36:51.200742+0000","last_change":"2023-07-25T14:36:50.211484+0000","last_active":"2023-07-25T14:36:51.200742+0000","last_peered":"2023-07-25T14:36:51.200742+0000","last_clean":"2023-07-25T14:36:51.200742+0000","last_became_active":"2023-07-25T14:36:50.211113+0000","last_became_peered":"2023-07-25T14:36:50.211113+0000","last_unstale":"2023-07-25T14:36:51.200742+0000","last_undegraded":"2023-07-25T14:36:51.200742+0000","last_fullsized":"2023-07-25T14:36:51.200742+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T16:49:45.309449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-25T14:36:50.211583+0000","last_change":"2023-07-25T14:36:50.204689+0000","last_active":"2023-07-25T14:36:50.211583+0000","last_peered":"2023-07-25T14:36:50.211583+0000","last_clean":"2023-07-25T14:36:50.211583+0000","last_became_active":"2023-07-25T14:36:50.204430+0000","last_became_peered":"2023-07-25T14:36:50.204430+0000","last_unstale":"2023-07-25T14:36:50.211583+0000","last_undegraded":"2023-07-25T14:36:50.211583+0000","last_fullsized":"2023-07-25T14:36:50.211583+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T23:25:45.551193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-25T14:36:51.201356+0000","last_change":"2023-07-25T14:36:50.209446+0000","last_active":"2023-07-25T14:36:51.201356+0000","last_peered":"2023-07-25T14:36:51.201356+0000","last_clean":"2023-07-25T14:36:51.201356+0000","last_became_active":"2023-07-25T14:36:50.209144+0000","last_became_peered":"2023-07-25T14:36:50.209144+0000","last_unstale":"2023-07-25T14:36:51.201356+0000","last_undegraded":"2023-07-25T14:36:51.201356+0000","last_fullsized":"2023-07-25T14:36:51.201356+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T20:37:06.160713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-25T14:36:50.211096+0000","last_change":"2023-07-25T14:36:50.200879+0000","last_active":"2023-07-25T14:36:50.211096+0000","last_peered":"2023-07-25T14:36:50.211096+0000","last_clean":"2023-07-25T14:36:50.211096+0000","last_became_active":"2023-07-25T14:36:50.199174+0000","last_became_peered":"2023-07-25T14:36:50.199174+0000","last_unstale":"2023-07-25T14:36:50.211096+0000","last_undegraded":"2023-07-25T14:36:50.211096+0000","last_fullsized":"2023-07-25T14:36:50.211096+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:06:05.103409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-25T14:36:50.209585+0000","last_change":"2023-07-25T14:36:50.205352+0000","last_active":"2023-07-25T14:36:50.209585+0000","last_peered":"2023-07-25T14:36:50.209585+0000","last_clean":"2023-07-25T14:36:50.209585+0000","last_became_active":"2023-07-25T14:36:50.205041+0000","last_became_peered":"2023-07-25T14:36:50.205041+0000","last_unstale":"2023-07-25T14:36:50.209585+0000","last_undegraded":"2023-07-25T14:36:50.209585+0000","last_fullsized":"2023-07-25T14:36:50.209585+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T20:37:06.160713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-25T14:36:50.215517+0000","last_change":"2023-07-25T14:36:50.208542+0000","last_active":"2023-07-25T14:36:50.215517+0000","last_peered":"2023-07-25T14:36:50.215517+0000","last_clean":"2023-07-25T14:36:50.215517+0000","last_became_active":"2023-07-25T14:36:50.208292+0000","last_became_peered":"2023-07-25T14:36:50.208292+0000","last_unstale":"2023-07-25T14:36:50.215517+0000","last_undegraded":"2023-07-25T14:36:50.215517+0000","last_fullsized":"2023-07-25T14:36:50.215517+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T22:07:12.412241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-25T14:36:50.215240+0000","last_change":"2023-07-25T14:36:50.207115+0000","last_active":"2023-07-25T14:36:50.215240+0000","last_peered":"2023-07-25T14:36:50.215240+0000","last_clean":"2023-07-25T14:36:50.215240+0000","last_became_active":"2023-07-25T14:36:50.206848+0000","last_became_peered":"2023-07-25T14:36:50.206848+0000","last_unstale":"2023-07-25T14:36:50.215240+0000","last_undegraded":"2023-07-25T14:36:50.215240+0000","last_fullsized":"2023-07-25T14:36:50.215240+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T18:08:24.432577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-25T14:36:50.211299+0000","last_change":"2023-07-25T14:36:50.202401+0000","last_active":"2023-07-25T14:36:50.211299+0000","last_peered":"2023-07-25T14:36:50.211299+0000","last_clean":"2023-07-25T14:36:50.211299+0000","last_became_active":"2023-07-25T14:36:50.202122+0000","last_became_peered":"2023-07-25T14:36:50.202122+0000","last_unstale":"2023-07-25T14:36:50.211299+0000","last_undegraded":"2023-07-25T14:36:50.211299+0000","last_fullsized":"2023-07-25T14:36:50.211299+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T21:15:48.481009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-25T14:36:50.215258+0000","last_change":"2023-07-25T14:36:50.206841+0000","last_active":"2023-07-25T14:36:50.215258+0000","last_peered":"2023-07-25T14:36:50.215258+0000","last_clean":"2023-07-25T14:36:50.215258+0000","last_became_active":"2023-07-25T14:36:50.206563+0000","last_became_peered":"2023-07-25T14:36:50.206563+0000","last_unstale":"2023-07-25T14:36:50.215258+0000","last_undegraded":"2023-07-25T14:36:50.215258+0000","last_fullsized":"2023-07-25T14:36:50.215258+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T15:11:51.480312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-25T14:36:51.201898+0000","last_change":"2023-07-25T14:36:50.199364+0000","last_active":"2023-07-25T14:36:51.201898+0000","last_peered":"2023-07-25T14:36:51.201898+0000","last_clean":"2023-07-25T14:36:51.201898+0000","last_became_active":"2023-07-25T14:36:50.198943+0000","last_became_peered":"2023-07-25T14:36:50.198943+0000","last_unstale":"2023-07-25T14:36:51.201898+0000","last_undegraded":"2023-07-25T14:36:51.201898+0000","last_fullsized":"2023-07-25T14:36:51.201898+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T22:11:04.890662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-25T14:36:50.210206+0000","last_change":"2023-07-25T14:36:50.200453+0000","last_active":"2023-07-25T14:36:50.210206+0000","last_peered":"2023-07-25T14:36:50.210206+0000","last_clean":"2023-07-25T14:36:50.210206+0000","last_became_active":"2023-07-25T14:36:50.200070+0000","last_became_peered":"2023-07-25T14:36:50.200070+0000","last_unstale":"2023-07-25T14:36:50.210206+0000","last_undegraded":"2023-07-25T14:36:50.210206+0000","last_fullsized":"2023-07-25T14:36:50.210206+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T15:28:17.702544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-25T14:36:50.215198+0000","last_change":"2023-07-25T14:36:50.206731+0000","last_active":"2023-07-25T14:36:50.215198+0000","last_peered":"2023-07-25T14:36:50.215198+0000","last_clean":"2023-07-25T14:36:50.215198+0000","last_became_active":"2023-07-25T14:36:50.206426+0000","last_became_peered":"2023-07-25T14:36:50.206426+0000","last_unstale":"2023-07-25T14:36:50.215198+0000","last_undegraded":"2023-07-25T14:36:50.215198+0000","last_fullsized":"2023-07-25T14:36:50.215198+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T19:25:03.342839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-25T14:36:50.209555+0000","last_change":"2023-07-25T14:36:50.204379+0000","last_active":"2023-07-25T14:36:50.209555+0000","last_peered":"2023-07-25T14:36:50.209555+0000","last_clean":"2023-07-25T14:36:50.209555+0000","last_became_active":"2023-07-25T14:36:50.203202+0000","last_became_peered":"2023-07-25T14:36:50.203202+0000","last_unstale":"2023-07-25T14:36:50.209555+0000","last_undegraded":"2023-07-25T14:36:50.209555+0000","last_fullsized":"2023-07-25T14:36:50.209555+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T01:49:00.736541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-25T14:36:51.199366+0000","last_change":"2023-07-25T14:36:50.212013+0000","last_active":"2023-07-25T14:36:51.199366+0000","last_peered":"2023-07-25T14:36:51.199366+0000","last_clean":"2023-07-25T14:36:51.199366+0000","last_became_active":"2023-07-25T14:36:50.211722+0000","last_became_peered":"2023-07-25T14:36:50.211722+0000","last_unstale":"2023-07-25T14:36:51.199366+0000","last_undegraded":"2023-07-25T14:36:51.199366+0000","last_fullsized":"2023-07-25T14:36:51.199366+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T18:01:50.006754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-25T14:36:51.201842+0000","last_change":"2023-07-25T14:36:50.206017+0000","last_active":"2023-07-25T14:36:51.201842+0000","last_peered":"2023-07-25T14:36:51.201842+0000","last_clean":"2023-07-25T14:36:51.201842+0000","last_became_active":"2023-07-25T14:36:50.205693+0000","last_became_peered":"2023-07-25T14:36:50.205693+0000","last_unstale":"2023-07-25T14:36:51.201842+0000","last_undegraded":"2023-07-25T14:36:51.201842+0000","last_fullsized":"2023-07-25T14:36:51.201842+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T17:07:11.661931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-25T14:36:51.201174+0000","last_change":"2023-07-25T14:36:50.212257+0000","last_active":"2023-07-25T14:36:51.201174+0000","last_peered":"2023-07-25T14:36:51.201174+0000","last_clean":"2023-07-25T14:36:51.201174+0000","last_became_active":"2023-07-25T14:36:50.211850+0000","last_became_peered":"2023-07-25T14:36:50.211850+0000","last_unstale":"2023-07-25T14:36:51.201174+0000","last_undegraded":"2023-07-25T14:36:51.201174+0000","last_fullsized":"2023-07-25T14:36:51.201174+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T20:07:10.476668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-25T14:36:51.199630+0000","last_change":"2023-07-25T14:36:50.212251+0000","last_active":"2023-07-25T14:36:51.199630+0000","last_peered":"2023-07-25T14:36:51.199630+0000","last_clean":"2023-07-25T14:36:51.199630+0000","last_became_active":"2023-07-25T14:36:50.211890+0000","last_became_peered":"2023-07-25T14:36:50.211890+0000","last_unstale":"2023-07-25T14:36:51.199630+0000","last_undegraded":"2023-07-25T14:36:51.199630+0000","last_fullsized":"2023-07-25T14:36:51.199630+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T19:12:45.741770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-25T14:36:50.216917+0000","last_change":"2023-07-25T14:36:50.213055+0000","last_active":"2023-07-25T14:36:50.216917+0000","last_peered":"2023-07-25T14:36:50.216917+0000","last_clean":"2023-07-25T14:36:50.216917+0000","last_became_active":"2023-07-25T14:36:50.211933+0000","last_became_peered":"2023-07-25T14:36:50.211933+0000","last_unstale":"2023-07-25T14:36:50.216917+0000","last_undegraded":"2023-07-25T14:36:50.216917+0000","last_fullsized":"2023-07-25T14:36:50.216917+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T16:35:14.255795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-25T14:36:50.214961+0000","last_change":"2023-07-25T14:36:50.211635+0000","last_active":"2023-07-25T14:36:50.214961+0000","last_peered":"2023-07-25T14:36:50.214961+0000","last_clean":"2023-07-25T14:36:50.214961+0000","last_became_active":"2023-07-25T14:36:50.211036+0000","last_became_peered":"2023-07-25T14:36:50.211036+0000","last_unstale":"2023-07-25T14:36:50.214961+0000","last_undegraded":"2023-07-25T14:36:50.214961+0000","last_fullsized":"2023-07-25T14:36:50.214961+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T15:46:46.132983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-25T14:36:50.211371+0000","last_change":"2023-07-25T14:36:50.202547+0000","last_active":"2023-07-25T14:36:50.211371+0000","last_peered":"2023-07-25T14:36:50.211371+0000","last_clean":"2023-07-25T14:36:50.211371+0000","last_became_active":"2023-07-25T14:36:50.202242+0000","last_became_peered":"2023-07-25T14:36:50.202242+0000","last_unstale":"2023-07-25T14:36:50.211371+0000","last_undegraded":"2023-07-25T14:36:50.211371+0000","last_fullsized":"2023-07-25T14:36:50.211371+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T18:33:35.069385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-25T14:36:51.220397+0000","last_change":"2023-07-25T14:36:50.204317+0000","last_active":"2023-07-25T14:36:51.220397+0000","last_peered":"2023-07-25T14:36:51.220397+0000","last_clean":"2023-07-25T14:36:51.220397+0000","last_became_active":"2023-07-25T14:36:50.203984+0000","last_became_peered":"2023-07-25T14:36:50.203984+0000","last_unstale":"2023-07-25T14:36:51.220397+0000","last_undegraded":"2023-07-25T14:36:51.220397+0000","last_fullsized":"2023-07-25T14:36:51.220397+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T15:14:03.864607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-25T14:36:51.199767+0000","last_change":"2023-07-25T14:36:50.201691+0000","last_active":"2023-07-25T14:36:51.199767+0000","last_peered":"2023-07-25T14:36:51.199767+0000","last_clean":"2023-07-25T14:36:51.199767+0000","last_became_active":"2023-07-25T14:36:50.201277+0000","last_became_peered":"2023-07-25T14:36:50.201277+0000","last_unstale":"2023-07-25T14:36:51.199767+0000","last_undegraded":"2023-07-25T14:36:51.199767+0000","last_fullsized":"2023-07-25T14:36:51.199767+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T01:26:01.711894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-25T14:36:51.199631+0000","last_change":"2023-07-25T14:36:50.206676+0000","last_active":"2023-07-25T14:36:51.199631+0000","last_peered":"2023-07-25T14:36:51.199631+0000","last_clean":"2023-07-25T14:36:51.199631+0000","last_became_active":"2023-07-25T14:36:50.206388+0000","last_became_peered":"2023-07-25T14:36:50.206388+0000","last_unstale":"2023-07-25T14:36:51.199631+0000","last_undegraded":"2023-07-25T14:36:51.199631+0000","last_fullsized":"2023-07-25T14:36:51.199631+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T14:53:01.095214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-25T14:36:50.207694+0000","last_change":"2023-07-25T14:36:50.193509+0000","last_active":"2023-07-25T14:36:50.207694+0000","last_peered":"2023-07-25T14:36:50.207694+0000","last_clean":"2023-07-25T14:36:50.207694+0000","last_became_active":"2023-07-25T14:36:50.193223+0000","last_became_peered":"2023-07-25T14:36:50.193223+0000","last_unstale":"2023-07-25T14:36:50.207694+0000","last_undegraded":"2023-07-25T14:36:50.207694+0000","last_fullsized":"2023-07-25T14:36:50.207694+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T14:57:43.754353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-25T14:36:51.201306+0000","last_change":"2023-07-25T14:36:50.201315+0000","last_active":"2023-07-25T14:36:51.201306+0000","last_peered":"2023-07-25T14:36:51.201306+0000","last_clean":"2023-07-25T14:36:51.201306+0000","last_became_active":"2023-07-25T14:36:50.201043+0000","last_became_peered":"2023-07-25T14:36:50.201043+0000","last_unstale":"2023-07-25T14:36:51.201306+0000","last_undegraded":"2023-07-25T14:36:51.201306+0000","last_fullsized":"2023-07-25T14:36:51.201306+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T19:50:27.066319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-25T14:36:51.201652+0000","last_change":"2023-07-25T14:36:50.214125+0000","last_active":"2023-07-25T14:36:51.201652+0000","last_peered":"2023-07-25T14:36:51.201652+0000","last_clean":"2023-07-25T14:36:51.201652+0000","last_became_active":"2023-07-25T14:36:50.213810+0000","last_became_peered":"2023-07-25T14:36:50.213810+0000","last_unstale":"2023-07-25T14:36:51.201652+0000","last_undegraded":"2023-07-25T14:36:51.201652+0000","last_fullsized":"2023-07-25T14:36:51.201652+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T19:31:51.818032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-25T14:36:51.199475+0000","last_change":"2023-07-25T14:36:50.206158+0000","last_active":"2023-07-25T14:36:51.199475+0000","last_peered":"2023-07-25T14:36:51.199475+0000","last_clean":"2023-07-25T14:36:51.199475+0000","last_became_active":"2023-07-25T14:36:50.205826+0000","last_became_peered":"2023-07-25T14:36:50.205826+0000","last_unstale":"2023-07-25T14:36:51.199475+0000","last_undegraded":"2023-07-25T14:36:51.199475+0000","last_fullsized":"2023-07-25T14:36:51.199475+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T19:49:15.867389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-25T14:36:51.200811+0000","last_change":"2023-07-25T14:36:50.206009+0000","last_active":"2023-07-25T14:36:51.200811+0000","last_peered":"2023-07-25T14:36:51.200811+0000","last_clean":"2023-07-25T14:36:51.200811+0000","last_became_active":"2023-07-25T14:36:50.205731+0000","last_became_peered":"2023-07-25T14:36:50.205731+0000","last_unstale":"2023-07-25T14:36:51.200811+0000","last_undegraded":"2023-07-25T14:36:51.200811+0000","last_fullsized":"2023-07-25T14:36:51.200811+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T17:57:50.118234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-25T14:36:50.205495+0000","last_change":"2023-07-25T14:36:50.198090+0000","last_active":"2023-07-25T14:36:50.205495+0000","last_peered":"2023-07-25T14:36:50.205495+0000","last_clean":"2023-07-25T14:36:50.205495+0000","last_became_active":"2023-07-25T14:36:50.197854+0000","last_became_peered":"2023-07-25T14:36:50.197854+0000","last_unstale":"2023-07-25T14:36:50.205495+0000","last_undegraded":"2023-07-25T14:36:50.205495+0000","last_fullsized":"2023-07-25T14:36:50.205495+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T19:24:34.282767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-25T14:36:50.210277+0000","last_change":"2023-07-25T14:36:50.203988+0000","last_active":"2023-07-25T14:36:50.210277+0000","last_peered":"2023-07-25T14:36:50.210277+0000","last_clean":"2023-07-25T14:36:50.210277+0000","last_became_active":"2023-07-25T14:36:50.203732+0000","last_became_peered":"2023-07-25T14:36:50.203732+0000","last_unstale":"2023-07-25T14:36:50.210277+0000","last_undegraded":"2023-07-25T14:36:50.210277+0000","last_fullsized":"2023-07-25T14:36:50.210277+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T14:57:56.722579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-25T14:36:50.218155+0000","last_change":"2023-07-25T14:36:50.213941+0000","last_active":"2023-07-25T14:36:50.218155+0000","last_peered":"2023-07-25T14:36:50.218155+0000","last_clean":"2023-07-25T14:36:50.218155+0000","last_became_active":"2023-07-25T14:36:50.213697+0000","last_became_peered":"2023-07-25T14:36:50.213697+0000","last_unstale":"2023-07-25T14:36:50.218155+0000","last_undegraded":"2023-07-25T14:36:50.218155+0000","last_fullsized":"2023-07-25T14:36:50.218155+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T22:06:59.374190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"38'4","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-25T14:36:50.216406+0000","last_change":"2023-07-25T14:36:49.189633+0000","last_active":"2023-07-25T14:36:50.216406+0000","last_peered":"2023-07-25T14:36:50.216406+0000","last_clean":"2023-07-25T14:36:50.216406+0000","last_became_active":"2023-07-25T14:36:49.189347+0000","last_became_peered":"2023-07-25T14:36:49.189347+0000","last_unstale":"2023-07-25T14:36:50.216406+0000","last_undegraded":"2023-07-25T14:36:50.216406+0000","last_fullsized":"2023-07-25T14:36:50.216406+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_clean_scrub_stamp":"2023-07-25T14:36:48.163149+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T16:06:34.321404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-25T14:36:51.220354+0000","last_change":"2023-07-25T14:36:50.202196+0000","last_active":"2023-07-25T14:36:51.220354+0000","last_peered":"2023-07-25T14:36:51.220354+0000","last_clean":"2023-07-25T14:36:51.220354+0000","last_became_active":"2023-07-25T14:36:50.201924+0000","last_became_peered":"2023-07-25T14:36:50.201924+0000","last_unstale":"2023-07-25T14:36:51.220354+0000","last_undegraded":"2023-07-25T14:36:51.220354+0000","last_fullsized":"2023-07-25T14:36:51.220354+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T01:05:55.734046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"38'1","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-25T14:36:51.201593+0000","last_change":"2023-07-25T14:36:49.182497+0000","last_active":"2023-07-25T14:36:51.201593+0000","last_peered":"2023-07-25T14:36:51.201593+0000","last_clean":"2023-07-25T14:36:51.201593+0000","last_became_active":"2023-07-25T14:36:49.182166+0000","last_became_peered":"2023-07-25T14:36:49.182166+0000","last_unstale":"2023-07-25T14:36:51.201593+0000","last_undegraded":"2023-07-25T14:36:51.201593+0000","last_fullsized":"2023-07-25T14:36:51.201593+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_clean_scrub_stamp":"2023-07-25T14:36:48.163149+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T15:01:23.259132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-25T14:36:51.201795+0000","last_change":"2023-07-25T14:36:50.210856+0000","last_active":"2023-07-25T14:36:51.201795+0000","last_peered":"2023-07-25T14:36:51.201795+0000","last_clean":"2023-07-25T14:36:51.201795+0000","last_became_active":"2023-07-25T14:36:50.210524+0000","last_became_peered":"2023-07-25T14:36:50.210524+0000","last_unstale":"2023-07-25T14:36:51.201795+0000","last_undegraded":"2023-07-25T14:36:51.201795+0000","last_fullsized":"2023-07-25T14:36:51.201795+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:34:20.886125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"38'2","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-25T14:36:50.215999+0000","last_change":"2023-07-25T14:36:49.188711+0000","last_active":"2023-07-25T14:36:50.215999+0000","last_peered":"2023-07-25T14:36:50.215999+0000","last_clean":"2023-07-25T14:36:50.215999+0000","last_became_active":"2023-07-25T14:36:49.188454+0000","last_became_peered":"2023-07-25T14:36:49.188454+0000","last_unstale":"2023-07-25T14:36:50.215999+0000","last_undegraded":"2023-07-25T14:36:50.215999+0000","last_fullsized":"2023-07-25T14:36:50.215999+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_clean_scrub_stamp":"2023-07-25T14:36:48.163149+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T02:09:39.697992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-25T14:36:50.211734+0000","last_change":"2023-07-25T14:36:50.205852+0000","last_active":"2023-07-25T14:36:50.211734+0000","last_peered":"2023-07-25T14:36:50.211734+0000","last_clean":"2023-07-25T14:36:50.211734+0000","last_became_active":"2023-07-25T14:36:50.205542+0000","last_became_peered":"2023-07-25T14:36:50.205542+0000","last_unstale":"2023-07-25T14:36:50.211734+0000","last_undegraded":"2023-07-25T14:36:50.211734+0000","last_fullsized":"2023-07-25T14:36:50.211734+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T20:34:40.704873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"38'2","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-25T14:36:50.210341+0000","last_change":"2023-07-25T14:36:49.188456+0000","last_active":"2023-07-25T14:36:50.210341+0000","last_peered":"2023-07-25T14:36:50.210341+0000","last_clean":"2023-07-25T14:36:50.210341+0000","last_became_active":"2023-07-25T14:36:49.188176+0000","last_became_peered":"2023-07-25T14:36:49.188176+0000","last_unstale":"2023-07-25T14:36:50.210341+0000","last_undegraded":"2023-07-25T14:36:50.210341+0000","last_fullsized":"2023-07-25T14:36:50.210341+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_clean_scrub_stamp":"2023-07-25T14:36:48.163149+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T15:09:56.130862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-25T14:36:51.201946+0000","last_change":"2023-07-25T14:36:50.206176+0000","last_active":"2023-07-25T14:36:51.201946+0000","last_peered":"2023-07-25T14:36:51.201946+0000","last_clean":"2023-07-25T14:36:51.201946+0000","last_became_active":"2023-07-25T14:36:50.205387+0000","last_became_peered":"2023-07-25T14:36:50.205387+0000","last_unstale":"2023-07-25T14:36:51.201946+0000","last_undegraded":"2023-07-25T14:36:51.201946+0000","last_fullsized":"2023-07-25T14:36:51.201946+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T15:37:10.027578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"38'1","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-25T14:36:50.215911+0000","last_change":"2023-07-25T14:36:49.193129+0000","last_active":"2023-07-25T14:36:50.215911+0000","last_peered":"2023-07-25T14:36:50.215911+0000","last_clean":"2023-07-25T14:36:50.215911+0000","last_became_active":"2023-07-25T14:36:49.192313+0000","last_became_peered":"2023-07-25T14:36:49.192313+0000","last_unstale":"2023-07-25T14:36:50.215911+0000","last_undegraded":"2023-07-25T14:36:50.215911+0000","last_fullsized":"2023-07-25T14:36:50.215911+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_clean_scrub_stamp":"2023-07-25T14:36:48.163149+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T16:28:13.540791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-25T14:36:50.211404+0000","last_change":"2023-07-25T14:36:50.197978+0000","last_active":"2023-07-25T14:36:50.211404+0000","last_peered":"2023-07-25T14:36:50.211404+0000","last_clean":"2023-07-25T14:36:50.211404+0000","last_became_active":"2023-07-25T14:36:50.197726+0000","last_became_peered":"2023-07-25T14:36:50.197726+0000","last_unstale":"2023-07-25T14:36:50.211404+0000","last_undegraded":"2023-07-25T14:36:50.211404+0000","last_fullsized":"2023-07-25T14:36:50.211404+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T20:12:11.116659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"38'1","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-25T14:36:51.201100+0000","last_change":"2023-07-25T14:36:49.186416+0000","last_active":"2023-07-25T14:36:51.201100+0000","last_peered":"2023-07-25T14:36:51.201100+0000","last_clean":"2023-07-25T14:36:51.201100+0000","last_became_active":"2023-07-25T14:36:49.186112+0000","last_became_peered":"2023-07-25T14:36:49.186112+0000","last_unstale":"2023-07-25T14:36:51.201100+0000","last_undegraded":"2023-07-25T14:36:51.201100+0000","last_fullsized":"2023-07-25T14:36:51.201100+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_clean_scrub_stamp":"2023-07-25T14:36:48.163149+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T01:49:25.831512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-25T14:36:50.211947+0000","last_change":"2023-07-25T14:36:50.202710+0000","last_active":"2023-07-25T14:36:50.211947+0000","last_peered":"2023-07-25T14:36:50.211947+0000","last_clean":"2023-07-25T14:36:50.211947+0000","last_became_active":"2023-07-25T14:36:50.202435+0000","last_became_peered":"2023-07-25T14:36:50.202435+0000","last_unstale":"2023-07-25T14:36:50.211947+0000","last_undegraded":"2023-07-25T14:36:50.211947+0000","last_fullsized":"2023-07-25T14:36:50.211947+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T18:16:48.525417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-25T14:36:51.201197+0000","last_change":"2023-07-25T14:36:49.188625+0000","last_active":"2023-07-25T14:36:51.201197+0000","last_peered":"2023-07-25T14:36:51.201197+0000","last_clean":"2023-07-25T14:36:51.201197+0000","last_became_active":"2023-07-25T14:36:49.188284+0000","last_became_peered":"2023-07-25T14:36:49.188284+0000","last_unstale":"2023-07-25T14:36:51.201197+0000","last_undegraded":"2023-07-25T14:36:51.201197+0000","last_fullsized":"2023-07-25T14:36:51.201197+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_clean_scrub_stamp":"2023-07-25T14:36:48.163149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T23:17:59.723720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-25T14:36:51.220321+0000","last_change":"2023-07-25T14:36:50.203758+0000","last_active":"2023-07-25T14:36:51.220321+0000","last_peered":"2023-07-25T14:36:51.220321+0000","last_clean":"2023-07-25T14:36:51.220321+0000","last_became_active":"2023-07-25T14:36:50.203473+0000","last_became_peered":"2023-07-25T14:36:50.203473+0000","last_unstale":"2023-07-25T14:36:51.220321+0000","last_undegraded":"2023-07-25T14:36:51.220321+0000","last_fullsized":"2023-07-25T14:36:51.220321+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T20:34:40.704873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-25T14:36:50.190490+0000","last_change":"2023-07-25T14:36:49.187292+0000","last_active":"2023-07-25T14:36:50.190490+0000","last_peered":"2023-07-25T14:36:50.190490+0000","last_clean":"2023-07-25T14:36:50.190490+0000","last_became_active":"2023-07-25T14:36:49.186847+0000","last_became_peered":"2023-07-25T14:36:49.186847+0000","last_unstale":"2023-07-25T14:36:50.190490+0000","last_undegraded":"2023-07-25T14:36:50.190490+0000","last_fullsized":"2023-07-25T14:36:50.190490+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_clean_scrub_stamp":"2023-07-25T14:36:48.163149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T22:44:20.003312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-25T14:36:51.201477+0000","last_change":"2023-07-25T14:36:50.212104+0000","last_active":"2023-07-25T14:36:51.201477+0000","last_peered":"2023-07-25T14:36:51.201477+0000","last_clean":"2023-07-25T14:36:51.201477+0000","last_became_active":"2023-07-25T14:36:50.211493+0000","last_became_peered":"2023-07-25T14:36:50.211493+0000","last_unstale":"2023-07-25T14:36:51.201477+0000","last_undegraded":"2023-07-25T14:36:51.201477+0000","last_fullsized":"2023-07-25T14:36:51.201477+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T20:06:11.124144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-25T14:36:51.201998+0000","last_change":"2023-07-25T14:36:49.179031+0000","last_active":"2023-07-25T14:36:51.201998+0000","last_peered":"2023-07-25T14:36:51.201998+0000","last_clean":"2023-07-25T14:36:51.201998+0000","last_became_active":"2023-07-25T14:36:49.178709+0000","last_became_peered":"2023-07-25T14:36:49.178709+0000","last_unstale":"2023-07-25T14:36:51.201998+0000","last_undegraded":"2023-07-25T14:36:51.201998+0000","last_fullsized":"2023-07-25T14:36:51.201998+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_clean_scrub_stamp":"2023-07-25T14:36:48.163149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T16:00:17.186535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-25T14:36:50.203104+0000","last_change":"2023-07-25T14:36:50.200137+0000","last_active":"2023-07-25T14:36:50.203104+0000","last_peered":"2023-07-25T14:36:50.203104+0000","last_clean":"2023-07-25T14:36:50.203104+0000","last_became_active":"2023-07-25T14:36:50.199771+0000","last_became_peered":"2023-07-25T14:36:50.199771+0000","last_unstale":"2023-07-25T14:36:50.203104+0000","last_undegraded":"2023-07-25T14:36:50.203104+0000","last_fullsized":"2023-07-25T14:36:50.203104+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T02:07:49.432592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-25T14:36:50.187672+0000","last_change":"2023-07-25T14:36:49.190277+0000","last_active":"2023-07-25T14:36:50.187672+0000","last_peered":"2023-07-25T14:36:50.187672+0000","last_clean":"2023-07-25T14:36:50.187672+0000","last_became_active":"2023-07-25T14:36:49.189911+0000","last_became_peered":"2023-07-25T14:36:49.189911+0000","last_unstale":"2023-07-25T14:36:50.187672+0000","last_undegraded":"2023-07-25T14:36:50.187672+0000","last_fullsized":"2023-07-25T14:36:50.187672+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_clean_scrub_stamp":"2023-07-25T14:36:48.163149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T18:55:12.434844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-25T14:36:50.209895+0000","last_change":"2023-07-25T14:36:50.201912+0000","last_active":"2023-07-25T14:36:50.209895+0000","last_peered":"2023-07-25T14:36:50.209895+0000","last_clean":"2023-07-25T14:36:50.209895+0000","last_became_active":"2023-07-25T14:36:50.201362+0000","last_became_peered":"2023-07-25T14:36:50.201362+0000","last_unstale":"2023-07-25T14:36:50.209895+0000","last_undegraded":"2023-07-25T14:36:50.209895+0000","last_fullsized":"2023-07-25T14:36:50.209895+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:46:12.680756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"38'3","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-25T14:36:50.214689+0000","last_change":"2023-07-25T14:36:49.189087+0000","last_active":"2023-07-25T14:36:50.214689+0000","last_peered":"2023-07-25T14:36:50.214689+0000","last_clean":"2023-07-25T14:36:50.214689+0000","last_became_active":"2023-07-25T14:36:49.188727+0000","last_became_peered":"2023-07-25T14:36:49.188727+0000","last_unstale":"2023-07-25T14:36:50.214689+0000","last_undegraded":"2023-07-25T14:36:50.214689+0000","last_fullsized":"2023-07-25T14:36:50.214689+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_clean_scrub_stamp":"2023-07-25T14:36:48.163149+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T22:11:03.886719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-25T14:36:50.214278+0000","last_change":"2023-07-25T14:36:50.206981+0000","last_active":"2023-07-25T14:36:50.214278+0000","last_peered":"2023-07-25T14:36:50.214278+0000","last_clean":"2023-07-25T14:36:50.214278+0000","last_became_active":"2023-07-25T14:36:50.206684+0000","last_became_peered":"2023-07-25T14:36:50.206684+0000","last_unstale":"2023-07-25T14:36:50.214278+0000","last_undegraded":"2023-07-25T14:36:50.214278+0000","last_fullsized":"2023-07-25T14:36:50.214278+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T19:31:51.818032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"38'6","reported_seq":17,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-25T14:36:50.220888+0000","last_change":"2023-07-25T14:36:49.178494+0000","last_active":"2023-07-25T14:36:50.220888+0000","last_peered":"2023-07-25T14:36:50.220888+0000","last_clean":"2023-07-25T14:36:50.220888+0000","last_became_active":"2023-07-25T14:36:49.178170+0000","last_became_peered":"2023-07-25T14:36:49.178170+0000","last_unstale":"2023-07-25T14:36:50.220888+0000","last_undegraded":"2023-07-25T14:36:50.220888+0000","last_fullsized":"2023-07-25T14:36:50.220888+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_clean_scrub_stamp":"2023-07-25T14:36:48.163149+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T23:30:50.676227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-25T14:36:51.220548+0000","last_change":"2023-07-25T14:36:50.211789+0000","last_active":"2023-07-25T14:36:51.220548+0000","last_peered":"2023-07-25T14:36:51.220548+0000","last_clean":"2023-07-25T14:36:51.220548+0000","last_became_active":"2023-07-25T14:36:50.211520+0000","last_became_peered":"2023-07-25T14:36:50.211520+0000","last_unstale":"2023-07-25T14:36:51.220548+0000","last_undegraded":"2023-07-25T14:36:51.220548+0000","last_fullsized":"2023-07-25T14:36:51.220548+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T20:21:52.024854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"38'2","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-25T14:36:50.217516+0000","last_change":"2023-07-25T14:36:49.193327+0000","last_active":"2023-07-25T14:36:50.217516+0000","last_peered":"2023-07-25T14:36:50.217516+0000","last_clean":"2023-07-25T14:36:50.217516+0000","last_became_active":"2023-07-25T14:36:49.192656+0000","last_became_peered":"2023-07-25T14:36:49.192656+0000","last_unstale":"2023-07-25T14:36:50.217516+0000","last_undegraded":"2023-07-25T14:36:50.217516+0000","last_fullsized":"2023-07-25T14:36:50.217516+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_clean_scrub_stamp":"2023-07-25T14:36:48.163149+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T17:07:48.172028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-25T14:36:50.211385+0000","last_change":"2023-07-25T14:36:50.196519+0000","last_active":"2023-07-25T14:36:50.211385+0000","last_peered":"2023-07-25T14:36:50.211385+0000","last_clean":"2023-07-25T14:36:50.211385+0000","last_became_active":"2023-07-25T14:36:50.196242+0000","last_became_peered":"2023-07-25T14:36:50.196242+0000","last_unstale":"2023-07-25T14:36:50.211385+0000","last_undegraded":"2023-07-25T14:36:50.211385+0000","last_fullsized":"2023-07-25T14:36:50.211385+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T18:33:33.709002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-25T14:36:50.191687+0000","last_change":"2023-07-25T14:36:49.188746+0000","last_active":"2023-07-25T14:36:50.191687+0000","last_peered":"2023-07-25T14:36:50.191687+0000","last_clean":"2023-07-25T14:36:50.191687+0000","last_became_active":"2023-07-25T14:36:49.188445+0000","last_became_peered":"2023-07-25T14:36:49.188445+0000","last_unstale":"2023-07-25T14:36:50.191687+0000","last_undegraded":"2023-07-25T14:36:50.191687+0000","last_fullsized":"2023-07-25T14:36:50.191687+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_clean_scrub_stamp":"2023-07-25T14:36:48.163149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T17:55:20.568265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-25T14:36:50.205626+0000","last_change":"2023-07-25T14:36:50.199005+0000","last_active":"2023-07-25T14:36:50.205626+0000","last_peered":"2023-07-25T14:36:50.205626+0000","last_clean":"2023-07-25T14:36:50.205626+0000","last_became_active":"2023-07-25T14:36:50.198743+0000","last_became_peered":"2023-07-25T14:36:50.198743+0000","last_unstale":"2023-07-25T14:36:50.205626+0000","last_undegraded":"2023-07-25T14:36:50.205626+0000","last_fullsized":"2023-07-25T14:36:50.205626+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T17:15:49.435607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-25T14:36:50.189285+0000","last_change":"2023-07-25T14:36:49.191960+0000","last_active":"2023-07-25T14:36:50.189285+0000","last_peered":"2023-07-25T14:36:50.189285+0000","last_clean":"2023-07-25T14:36:50.189285+0000","last_became_active":"2023-07-25T14:36:49.191688+0000","last_became_peered":"2023-07-25T14:36:49.191688+0000","last_unstale":"2023-07-25T14:36:50.189285+0000","last_undegraded":"2023-07-25T14:36:50.189285+0000","last_fullsized":"2023-07-25T14:36:50.189285+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_clean_scrub_stamp":"2023-07-25T14:36:48.163149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T22:30:04.157240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-25T14:36:50.214114+0000","last_change":"2023-07-25T14:36:50.207141+0000","last_active":"2023-07-25T14:36:50.214114+0000","last_peered":"2023-07-25T14:36:50.214114+0000","last_clean":"2023-07-25T14:36:50.214114+0000","last_became_active":"2023-07-25T14:36:50.206727+0000","last_became_peered":"2023-07-25T14:36:50.206727+0000","last_unstale":"2023-07-25T14:36:50.214114+0000","last_undegraded":"2023-07-25T14:36:50.214114+0000","last_fullsized":"2023-07-25T14:36:50.214114+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T23:18:00.727663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"38'8","reported_seq":19,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-25T14:36:50.215473+0000","last_change":"2023-07-25T14:36:49.187460+0000","last_active":"2023-07-25T14:36:50.215473+0000","last_peered":"2023-07-25T14:36:50.215473+0000","last_clean":"2023-07-25T14:36:50.215473+0000","last_became_active":"2023-07-25T14:36:49.187132+0000","last_became_peered":"2023-07-25T14:36:49.187132+0000","last_unstale":"2023-07-25T14:36:50.215473+0000","last_undegraded":"2023-07-25T14:36:50.215473+0000","last_fullsized":"2023-07-25T14:36:50.215473+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_clean_scrub_stamp":"2023-07-25T14:36:48.163149+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T22:31:09.020175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-25T14:36:50.207716+0000","last_change":"2023-07-25T14:36:50.197939+0000","last_active":"2023-07-25T14:36:50.207716+0000","last_peered":"2023-07-25T14:36:50.207716+0000","last_clean":"2023-07-25T14:36:50.207716+0000","last_became_active":"2023-07-25T14:36:50.197093+0000","last_became_peered":"2023-07-25T14:36:50.197093+0000","last_unstale":"2023-07-25T14:36:50.207716+0000","last_undegraded":"2023-07-25T14:36:50.207716+0000","last_fullsized":"2023-07-25T14:36:50.207716+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T22:06:46.487437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"38'1","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-25T14:36:50.215146+0000","last_change":"2023-07-25T14:36:49.191240+0000","last_active":"2023-07-25T14:36:50.215146+0000","last_peered":"2023-07-25T14:36:50.215146+0000","last_clean":"2023-07-25T14:36:50.215146+0000","last_became_active":"2023-07-25T14:36:49.190922+0000","last_became_peered":"2023-07-25T14:36:49.190922+0000","last_unstale":"2023-07-25T14:36:50.215146+0000","last_undegraded":"2023-07-25T14:36:50.215146+0000","last_fullsized":"2023-07-25T14:36:50.215146+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_clean_scrub_stamp":"2023-07-25T14:36:48.163149+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T17:27:38.492227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-25T14:36:50.211041+0000","last_change":"2023-07-25T14:36:50.196466+0000","last_active":"2023-07-25T14:36:50.211041+0000","last_peered":"2023-07-25T14:36:50.211041+0000","last_clean":"2023-07-25T14:36:50.211041+0000","last_became_active":"2023-07-25T14:36:50.196192+0000","last_became_peered":"2023-07-25T14:36:50.196192+0000","last_unstale":"2023-07-25T14:36:50.211041+0000","last_undegraded":"2023-07-25T14:36:50.211041+0000","last_fullsized":"2023-07-25T14:36:50.211041+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:55:57.732280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"38'2","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-25T14:36:51.201318+0000","last_change":"2023-07-25T14:36:49.188196+0000","last_active":"2023-07-25T14:36:51.201318+0000","last_peered":"2023-07-25T14:36:51.201318+0000","last_clean":"2023-07-25T14:36:51.201318+0000","last_became_active":"2023-07-25T14:36:49.187926+0000","last_became_peered":"2023-07-25T14:36:49.187926+0000","last_unstale":"2023-07-25T14:36:51.201318+0000","last_undegraded":"2023-07-25T14:36:51.201318+0000","last_fullsized":"2023-07-25T14:36:51.201318+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_clean_scrub_stamp":"2023-07-25T14:36:48.163149+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T21:44:18.591624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-25T14:36:51.199623+0000","last_change":"2023-07-25T14:36:50.212960+0000","last_active":"2023-07-25T14:36:51.199623+0000","last_peered":"2023-07-25T14:36:51.199623+0000","last_clean":"2023-07-25T14:36:51.199623+0000","last_became_active":"2023-07-25T14:36:50.212690+0000","last_became_peered":"2023-07-25T14:36:50.212690+0000","last_unstale":"2023-07-25T14:36:51.199623+0000","last_undegraded":"2023-07-25T14:36:51.199623+0000","last_fullsized":"2023-07-25T14:36:51.199623+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T01:53:57.396852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"38'1","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-25T14:36:51.201434+0000","last_change":"2023-07-25T14:36:49.188916+0000","last_active":"2023-07-25T14:36:51.201434+0000","last_peered":"2023-07-25T14:36:51.201434+0000","last_clean":"2023-07-25T14:36:51.201434+0000","last_became_active":"2023-07-25T14:36:49.188691+0000","last_became_peered":"2023-07-25T14:36:49.188691+0000","last_unstale":"2023-07-25T14:36:51.201434+0000","last_undegraded":"2023-07-25T14:36:51.201434+0000","last_fullsized":"2023-07-25T14:36:51.201434+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_clean_scrub_stamp":"2023-07-25T14:36:48.163149+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T17:55:20.568265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-25T14:36:51.220313+0000","last_change":"2023-07-25T14:36:50.208734+0000","last_active":"2023-07-25T14:36:51.220313+0000","last_peered":"2023-07-25T14:36:51.220313+0000","last_clean":"2023-07-25T14:36:51.220313+0000","last_became_active":"2023-07-25T14:36:50.208472+0000","last_became_peered":"2023-07-25T14:36:50.208472+0000","last_unstale":"2023-07-25T14:36:51.220313+0000","last_undegraded":"2023-07-25T14:36:51.220313+0000","last_fullsized":"2023-07-25T14:36:51.220313+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T22:06:59.374190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-25T14:36:50.187289+0000","last_change":"2023-07-25T14:36:49.189168+0000","last_active":"2023-07-25T14:36:50.187289+0000","last_peered":"2023-07-25T14:36:50.187289+0000","last_clean":"2023-07-25T14:36:50.187289+0000","last_became_active":"2023-07-25T14:36:49.188894+0000","last_became_peered":"2023-07-25T14:36:49.188894+0000","last_unstale":"2023-07-25T14:36:50.187289+0000","last_undegraded":"2023-07-25T14:36:50.187289+0000","last_fullsized":"2023-07-25T14:36:50.187289+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_clean_scrub_stamp":"2023-07-25T14:36:48.163149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T16:08:27.158068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-25T14:36:50.205704+0000","last_change":"2023-07-25T14:36:50.199234+0000","last_active":"2023-07-25T14:36:50.205704+0000","last_peered":"2023-07-25T14:36:50.205704+0000","last_clean":"2023-07-25T14:36:50.205704+0000","last_became_active":"2023-07-25T14:36:50.198957+0000","last_became_peered":"2023-07-25T14:36:50.198957+0000","last_unstale":"2023-07-25T14:36:50.205704+0000","last_undegraded":"2023-07-25T14:36:50.205704+0000","last_fullsized":"2023-07-25T14:36:50.205704+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T22:31:55.585971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"38'2","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-25T14:36:50.216023+0000","last_change":"2023-07-25T14:36:49.192944+0000","last_active":"2023-07-25T14:36:50.216023+0000","last_peered":"2023-07-25T14:36:50.216023+0000","last_clean":"2023-07-25T14:36:50.216023+0000","last_became_active":"2023-07-25T14:36:49.191983+0000","last_became_peered":"2023-07-25T14:36:49.191983+0000","last_unstale":"2023-07-25T14:36:50.216023+0000","last_undegraded":"2023-07-25T14:36:50.216023+0000","last_fullsized":"2023-07-25T14:36:50.216023+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_clean_scrub_stamp":"2023-07-25T14:36:48.163149+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T16:29:47.163618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-25T14:36:50.207112+0000","last_change":"2023-07-25T14:36:50.203783+0000","last_active":"2023-07-25T14:36:50.207112+0000","last_peered":"2023-07-25T14:36:50.207112+0000","last_clean":"2023-07-25T14:36:50.207112+0000","last_became_active":"2023-07-25T14:36:50.203485+0000","last_became_peered":"2023-07-25T14:36:50.203485+0000","last_unstale":"2023-07-25T14:36:50.207112+0000","last_undegraded":"2023-07-25T14:36:50.207112+0000","last_fullsized":"2023-07-25T14:36:50.207112+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T01:05:55.734046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-25T14:36:51.202042+0000","last_change":"2023-07-25T14:36:49.182153+0000","last_active":"2023-07-25T14:36:51.202042+0000","last_peered":"2023-07-25T14:36:51.202042+0000","last_clean":"2023-07-25T14:36:51.202042+0000","last_became_active":"2023-07-25T14:36:49.181886+0000","last_became_peered":"2023-07-25T14:36:49.181886+0000","last_unstale":"2023-07-25T14:36:51.202042+0000","last_undegraded":"2023-07-25T14:36:51.202042+0000","last_fullsized":"2023-07-25T14:36:51.202042+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_clean_scrub_stamp":"2023-07-25T14:36:48.163149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T23:50:15.085784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-25T14:36:50.209836+0000","last_change":"2023-07-25T14:36:50.198991+0000","last_active":"2023-07-25T14:36:50.209836+0000","last_peered":"2023-07-25T14:36:50.209836+0000","last_clean":"2023-07-25T14:36:50.209836+0000","last_became_active":"2023-07-25T14:36:50.198737+0000","last_became_peered":"2023-07-25T14:36:50.198737+0000","last_unstale":"2023-07-25T14:36:50.209836+0000","last_undegraded":"2023-07-25T14:36:50.209836+0000","last_fullsized":"2023-07-25T14:36:50.209836+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T23:22:44.422583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-25T14:36:50.190071+0000","last_change":"2023-07-25T14:36:49.189641+0000","last_active":"2023-07-25T14:36:50.190071+0000","last_peered":"2023-07-25T14:36:50.190071+0000","last_clean":"2023-07-25T14:36:50.190071+0000","last_became_active":"2023-07-25T14:36:49.189365+0000","last_became_peered":"2023-07-25T14:36:49.189365+0000","last_unstale":"2023-07-25T14:36:50.190071+0000","last_undegraded":"2023-07-25T14:36:50.190071+0000","last_fullsized":"2023-07-25T14:36:50.190071+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_clean_scrub_stamp":"2023-07-25T14:36:48.163149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T22:14:57.092053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-25T14:36:50.215201+0000","last_change":"2023-07-25T14:36:50.206937+0000","last_active":"2023-07-25T14:36:50.215201+0000","last_peered":"2023-07-25T14:36:50.215201+0000","last_clean":"2023-07-25T14:36:50.215201+0000","last_became_active":"2023-07-25T14:36:50.206661+0000","last_became_peered":"2023-07-25T14:36:50.206661+0000","last_unstale":"2023-07-25T14:36:50.215201+0000","last_undegraded":"2023-07-25T14:36:50.215201+0000","last_fullsized":"2023-07-25T14:36:50.215201+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T22:50:04.182501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-25T14:36:50.189733+0000","last_change":"2023-07-25T14:36:49.189655+0000","last_active":"2023-07-25T14:36:50.189733+0000","last_peered":"2023-07-25T14:36:50.189733+0000","last_clean":"2023-07-25T14:36:50.189733+0000","last_became_active":"2023-07-25T14:36:49.189391+0000","last_became_peered":"2023-07-25T14:36:49.189391+0000","last_unstale":"2023-07-25T14:36:50.189733+0000","last_undegraded":"2023-07-25T14:36:50.189733+0000","last_fullsized":"2023-07-25T14:36:50.189733+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_clean_scrub_stamp":"2023-07-25T14:36:48.163149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:20:03.056373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-25T14:36:50.208677+0000","last_change":"2023-07-25T14:36:50.194211+0000","last_active":"2023-07-25T14:36:50.208677+0000","last_peered":"2023-07-25T14:36:50.208677+0000","last_clean":"2023-07-25T14:36:50.208677+0000","last_became_active":"2023-07-25T14:36:50.193907+0000","last_became_peered":"2023-07-25T14:36:50.193907+0000","last_unstale":"2023-07-25T14:36:50.208677+0000","last_undegraded":"2023-07-25T14:36:50.208677+0000","last_fullsized":"2023-07-25T14:36:50.208677+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:28:06.895576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-25T14:36:51.200964+0000","last_change":"2023-07-25T14:36:49.191235+0000","last_active":"2023-07-25T14:36:51.200964+0000","last_peered":"2023-07-25T14:36:51.200964+0000","last_clean":"2023-07-25T14:36:51.200964+0000","last_became_active":"2023-07-25T14:36:49.190894+0000","last_became_peered":"2023-07-25T14:36:49.190894+0000","last_unstale":"2023-07-25T14:36:51.200964+0000","last_undegraded":"2023-07-25T14:36:51.200964+0000","last_fullsized":"2023-07-25T14:36:51.200964+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_clean_scrub_stamp":"2023-07-25T14:36:48.163149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T21:39:47.820169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":53,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-25T14:36:51.201111+0000","last_change":"2023-07-25T14:35:34.371347+0000","last_active":"2023-07-25T14:36:51.201111+0000","last_peered":"2023-07-25T14:36:51.201111+0000","last_clean":"2023-07-25T14:36:51.201111+0000","last_became_active":"2023-07-25T14:35:34.371044+0000","last_became_peered":"2023-07-25T14:35:34.371044+0000","last_unstale":"2023-07-25T14:36:51.201111+0000","last_undegraded":"2023-07-25T14:36:51.201111+0000","last_fullsized":"2023-07-25T14:36:51.201111+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_clean_scrub_stamp":"2023-07-25T14:35:33.358525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T01:54:51.034857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-25T14:36:50.214972+0000","last_change":"2023-07-25T14:36:50.212966+0000","last_active":"2023-07-25T14:36:50.214972+0000","last_peered":"2023-07-25T14:36:50.214972+0000","last_clean":"2023-07-25T14:36:50.214972+0000","last_became_active":"2023-07-25T14:36:50.212728+0000","last_became_peered":"2023-07-25T14:36:50.212728+0000","last_unstale":"2023-07-25T14:36:50.214972+0000","last_undegraded":"2023-07-25T14:36:50.214972+0000","last_fullsized":"2023-07-25T14:36:50.214972+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T20:14:07.305005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-25T14:36:50.191623+0000","last_change":"2023-07-25T14:36:49.190255+0000","last_active":"2023-07-25T14:36:50.191623+0000","last_peered":"2023-07-25T14:36:50.191623+0000","last_clean":"2023-07-25T14:36:50.191623+0000","last_became_active":"2023-07-25T14:36:49.189883+0000","last_became_peered":"2023-07-25T14:36:49.189883+0000","last_unstale":"2023-07-25T14:36:50.191623+0000","last_undegraded":"2023-07-25T14:36:50.191623+0000","last_fullsized":"2023-07-25T14:36:50.191623+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_clean_scrub_stamp":"2023-07-25T14:36:48.163149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T18:56:48.500869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":49,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-25T14:36:50.187372+0000","last_change":"2023-07-25T14:35:34.371737+0000","last_active":"2023-07-25T14:36:50.187372+0000","last_peered":"2023-07-25T14:36:50.187372+0000","last_clean":"2023-07-25T14:36:50.187372+0000","last_became_active":"2023-07-25T14:35:34.371411+0000","last_became_peered":"2023-07-25T14:35:34.371411+0000","last_unstale":"2023-07-25T14:36:50.187372+0000","last_undegraded":"2023-07-25T14:36:50.187372+0000","last_fullsized":"2023-07-25T14:36:50.187372+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_clean_scrub_stamp":"2023-07-25T14:35:33.358525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T02:10:12.672768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-25T14:36:50.214296+0000","last_change":"2023-07-25T14:36:50.207537+0000","last_active":"2023-07-25T14:36:50.214296+0000","last_peered":"2023-07-25T14:36:50.214296+0000","last_clean":"2023-07-25T14:36:50.214296+0000","last_became_active":"2023-07-25T14:36:50.207278+0000","last_became_peered":"2023-07-25T14:36:50.207278+0000","last_unstale":"2023-07-25T14:36:50.214296+0000","last_undegraded":"2023-07-25T14:36:50.214296+0000","last_fullsized":"2023-07-25T14:36:50.214296+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:34:20.886125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-25T14:36:50.196834+0000","last_change":"2023-07-25T14:36:49.188513+0000","last_active":"2023-07-25T14:36:50.196834+0000","last_peered":"2023-07-25T14:36:50.196834+0000","last_clean":"2023-07-25T14:36:50.196834+0000","last_became_active":"2023-07-25T14:36:49.188212+0000","last_became_peered":"2023-07-25T14:36:49.188212+0000","last_unstale":"2023-07-25T14:36:50.196834+0000","last_undegraded":"2023-07-25T14:36:50.196834+0000","last_fullsized":"2023-07-25T14:36:50.196834+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_clean_scrub_stamp":"2023-07-25T14:36:48.163149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T15:14:02.860665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":47,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-25T14:36:50.197611+0000","last_change":"2023-07-25T14:35:34.370121+0000","last_active":"2023-07-25T14:36:50.197611+0000","last_peered":"2023-07-25T14:36:50.197611+0000","last_clean":"2023-07-25T14:36:50.197611+0000","last_became_active":"2023-07-25T14:35:34.369795+0000","last_became_peered":"2023-07-25T14:35:34.369795+0000","last_unstale":"2023-07-25T14:36:50.197611+0000","last_undegraded":"2023-07-25T14:36:50.197611+0000","last_fullsized":"2023-07-25T14:36:50.197611+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_clean_scrub_stamp":"2023-07-25T14:35:33.358525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T20:41:00.101965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":199,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-25T14:36:50.189990+0000","last_change":"2023-07-25T14:35:34.372381+0000","last_active":"2023-07-25T14:36:50.189990+0000","last_peered":"2023-07-25T14:36:50.189990+0000","last_clean":"2023-07-25T14:36:50.189990+0000","last_became_active":"2023-07-25T14:35:34.371110+0000","last_became_peered":"2023-07-25T14:35:34.371110+0000","last_unstale":"2023-07-25T14:36:50.189990+0000","last_undegraded":"2023-07-25T14:36:50.189990+0000","last_fullsized":"2023-07-25T14:36:50.189990+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_clean_scrub_stamp":"2023-07-25T14:35:33.358525+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T02:13:54.139158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-25T14:36:50.211564+0000","last_change":"2023-07-25T14:36:50.198441+0000","last_active":"2023-07-25T14:36:50.211564+0000","last_peered":"2023-07-25T14:36:50.211564+0000","last_clean":"2023-07-25T14:36:50.211564+0000","last_became_active":"2023-07-25T14:36:50.198177+0000","last_became_peered":"2023-07-25T14:36:50.198177+0000","last_unstale":"2023-07-25T14:36:50.211564+0000","last_undegraded":"2023-07-25T14:36:50.211564+0000","last_fullsized":"2023-07-25T14:36:50.211564+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T16:02:34.973381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-25T14:36:50.192417+0000","last_change":"2023-07-25T14:36:49.189278+0000","last_active":"2023-07-25T14:36:50.192417+0000","last_peered":"2023-07-25T14:36:50.192417+0000","last_clean":"2023-07-25T14:36:50.192417+0000","last_became_active":"2023-07-25T14:36:49.189011+0000","last_became_peered":"2023-07-25T14:36:49.189011+0000","last_unstale":"2023-07-25T14:36:50.192417+0000","last_undegraded":"2023-07-25T14:36:50.192417+0000","last_fullsized":"2023-07-25T14:36:50.192417+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_clean_scrub_stamp":"2023-07-25T14:36:48.163149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T23:50:15.085784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":49,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-25T14:36:50.191669+0000","last_change":"2023-07-25T14:35:35.321448+0000","last_active":"2023-07-25T14:36:50.191669+0000","last_peered":"2023-07-25T14:36:50.191669+0000","last_clean":"2023-07-25T14:36:50.191669+0000","last_became_active":"2023-07-25T14:35:35.320830+0000","last_became_peered":"2023-07-25T14:35:35.320830+0000","last_unstale":"2023-07-25T14:36:50.191669+0000","last_undegraded":"2023-07-25T14:36:50.191669+0000","last_fullsized":"2023-07-25T14:36:50.191669+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_clean_scrub_stamp":"2023-07-25T14:35:33.358525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T16:34:27.132528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-25T14:36:50.211081+0000","last_change":"2023-07-25T14:36:50.196768+0000","last_active":"2023-07-25T14:36:50.211081+0000","last_peered":"2023-07-25T14:36:50.211081+0000","last_clean":"2023-07-25T14:36:50.211081+0000","last_became_active":"2023-07-25T14:36:50.195596+0000","last_became_peered":"2023-07-25T14:36:50.195596+0000","last_unstale":"2023-07-25T14:36:50.211081+0000","last_undegraded":"2023-07-25T14:36:50.211081+0000","last_fullsized":"2023-07-25T14:36:50.211081+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T23:55:04.578607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"38'2","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-25T14:36:51.201413+0000","last_change":"2023-07-25T14:36:49.190402+0000","last_active":"2023-07-25T14:36:51.201413+0000","last_peered":"2023-07-25T14:36:51.201413+0000","last_clean":"2023-07-25T14:36:51.201413+0000","last_became_active":"2023-07-25T14:36:49.190103+0000","last_became_peered":"2023-07-25T14:36:49.190103+0000","last_unstale":"2023-07-25T14:36:51.201413+0000","last_undegraded":"2023-07-25T14:36:51.201413+0000","last_fullsized":"2023-07-25T14:36:51.201413+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_clean_scrub_stamp":"2023-07-25T14:36:48.163149+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T18:56:48.500869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":49,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-25T14:36:50.189830+0000","last_change":"2023-07-25T14:35:35.321201+0000","last_active":"2023-07-25T14:36:50.189830+0000","last_peered":"2023-07-25T14:36:50.189830+0000","last_clean":"2023-07-25T14:36:50.189830+0000","last_became_active":"2023-07-25T14:35:35.320728+0000","last_became_peered":"2023-07-25T14:35:35.320728+0000","last_unstale":"2023-07-25T14:36:50.189830+0000","last_undegraded":"2023-07-25T14:36:50.189830+0000","last_fullsized":"2023-07-25T14:36:50.189830+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_clean_scrub_stamp":"2023-07-25T14:35:33.358525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T18:37:14.630530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-25T14:36:51.220489+0000","last_change":"2023-07-25T14:36:50.211993+0000","last_active":"2023-07-25T14:36:51.220489+0000","last_peered":"2023-07-25T14:36:51.220489+0000","last_clean":"2023-07-25T14:36:51.220489+0000","last_became_active":"2023-07-25T14:36:50.211594+0000","last_became_peered":"2023-07-25T14:36:50.211594+0000","last_unstale":"2023-07-25T14:36:51.220489+0000","last_undegraded":"2023-07-25T14:36:51.220489+0000","last_fullsized":"2023-07-25T14:36:51.220489+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T22:48:04.203409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-25T14:36:50.186841+0000","last_change":"2023-07-25T14:36:49.189206+0000","last_active":"2023-07-25T14:36:50.186841+0000","last_peered":"2023-07-25T14:36:50.186841+0000","last_clean":"2023-07-25T14:36:50.186841+0000","last_became_active":"2023-07-25T14:36:49.188939+0000","last_became_peered":"2023-07-25T14:36:49.188939+0000","last_unstale":"2023-07-25T14:36:50.186841+0000","last_undegraded":"2023-07-25T14:36:50.186841+0000","last_fullsized":"2023-07-25T14:36:50.186841+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_clean_scrub_stamp":"2023-07-25T14:36:48.163149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T15:58:32.259283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":55,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-25T14:36:51.201301+0000","last_change":"2023-07-25T14:35:35.321057+0000","last_active":"2023-07-25T14:36:51.201301+0000","last_peered":"2023-07-25T14:36:51.201301+0000","last_clean":"2023-07-25T14:36:51.201301+0000","last_became_active":"2023-07-25T14:35:35.320751+0000","last_became_peered":"2023-07-25T14:35:35.320751+0000","last_unstale":"2023-07-25T14:36:51.201301+0000","last_undegraded":"2023-07-25T14:36:51.201301+0000","last_fullsized":"2023-07-25T14:36:51.201301+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_clean_scrub_stamp":"2023-07-25T14:35:33.358525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T15:08:41.326239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-25T14:36:51.201084+0000","last_change":"2023-07-25T14:36:50.207719+0000","last_active":"2023-07-25T14:36:51.201084+0000","last_peered":"2023-07-25T14:36:51.201084+0000","last_clean":"2023-07-25T14:36:51.201084+0000","last_became_active":"2023-07-25T14:36:50.207251+0000","last_became_peered":"2023-07-25T14:36:50.207251+0000","last_unstale":"2023-07-25T14:36:51.201084+0000","last_undegraded":"2023-07-25T14:36:51.201084+0000","last_fullsized":"2023-07-25T14:36:51.201084+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T02:15:09.947725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-25T14:36:50.197183+0000","last_change":"2023-07-25T14:36:49.188367+0000","last_active":"2023-07-25T14:36:50.197183+0000","last_peered":"2023-07-25T14:36:50.197183+0000","last_clean":"2023-07-25T14:36:50.197183+0000","last_became_active":"2023-07-25T14:36:49.188073+0000","last_became_peered":"2023-07-25T14:36:49.188073+0000","last_unstale":"2023-07-25T14:36:50.197183+0000","last_undegraded":"2023-07-25T14:36:50.197183+0000","last_fullsized":"2023-07-25T14:36:50.197183+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_clean_scrub_stamp":"2023-07-25T14:36:48.163149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T22:48:03.199466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":51,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-25T14:36:51.220498+0000","last_change":"2023-07-25T14:35:35.321055+0000","last_active":"2023-07-25T14:36:51.220498+0000","last_peered":"2023-07-25T14:36:51.220498+0000","last_clean":"2023-07-25T14:36:51.220498+0000","last_became_active":"2023-07-25T14:35:35.320739+0000","last_became_peered":"2023-07-25T14:35:35.320739+0000","last_unstale":"2023-07-25T14:36:51.220498+0000","last_undegraded":"2023-07-25T14:36:51.220498+0000","last_fullsized":"2023-07-25T14:36:51.220498+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_clean_scrub_stamp":"2023-07-25T14:35:33.358525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T20:41:00.101965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-25T14:36:51.200696+0000","last_change":"2023-07-25T14:36:50.213458+0000","last_active":"2023-07-25T14:36:51.200696+0000","last_peered":"2023-07-25T14:36:51.200696+0000","last_clean":"2023-07-25T14:36:51.200696+0000","last_became_active":"2023-07-25T14:36:50.213138+0000","last_became_peered":"2023-07-25T14:36:50.213138+0000","last_unstale":"2023-07-25T14:36:51.200696+0000","last_undegraded":"2023-07-25T14:36:51.200696+0000","last_fullsized":"2023-07-25T14:36:51.200696+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T18:39:57.307887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-25T14:36:50.190639+0000","last_change":"2023-07-25T14:36:49.189178+0000","last_active":"2023-07-25T14:36:50.190639+0000","last_peered":"2023-07-25T14:36:50.190639+0000","last_clean":"2023-07-25T14:36:50.190639+0000","last_became_active":"2023-07-25T14:36:49.188876+0000","last_became_peered":"2023-07-25T14:36:49.188876+0000","last_unstale":"2023-07-25T14:36:50.190639+0000","last_undegraded":"2023-07-25T14:36:50.190639+0000","last_fullsized":"2023-07-25T14:36:50.190639+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_clean_scrub_stamp":"2023-07-25T14:36:48.163149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T17:37:21.615397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":51,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-07-25T14:36:51.220453+0000","last_change":"2023-07-25T14:35:34.370772+0000","last_active":"2023-07-25T14:36:51.220453+0000","last_peered":"2023-07-25T14:36:51.220453+0000","last_clean":"2023-07-25T14:36:51.220453+0000","last_became_active":"2023-07-25T14:35:34.370549+0000","last_became_peered":"2023-07-25T14:35:34.370549+0000","last_unstale":"2023-07-25T14:36:51.220453+0000","last_undegraded":"2023-07-25T14:36:51.220453+0000","last_fullsized":"2023-07-25T14:36:51.220453+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_clean_scrub_stamp":"2023-07-25T14:35:33.358525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T02:08:24.893368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64510,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574868,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27524,"kb_used_data":496,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344316,"statfs":{"total":96636764160,"available":96608579584,"internally_reserved":0,"allocated":507904,"data_stored":785773,"data_compressed":32255,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jul 25 14:36:37 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":9.1600000000000001,"5min":9.1600000000000001,"15min":9.1600000000000001},"last":0.56999999999999995}]},{"osd":1,"last update":"Tue Jul 25 14:36:37 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.5009999999999999,"5min":1.5009999999999999,"15min":1.5009999999999999},"last":0.623},{"interface":"front","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.526,"5min":1.526,"15min":1.526},"last":0.63300000000000001}]},{"osd":2,"last update":"Tue Jul 25 14:36:37 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":8.1739999999999995,"5min":8.1739999999999995,"15min":8.1739999999999995},"last":0.52500000000000002}]},{"osd":3,"last update":"Tue Jul 25 14:36:37 2023","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":7.2279999999999998,"5min":7.2279999999999998,"15min":7.2279999999999998},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":7.1870000000000003,"5min":7.1870000000000003,"15min":7.1870000000000003},"last":0.59899999999999998}]},{"osd":4,"last update":"Tue Jul 25 14:36:37 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.40000000000000002}]},{"osd":5,"last update":"Tue Jul 25 14:36:37 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.53800000000000003}]},{"osd":6,"last update":"Tue Jul 25 14:36:37 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.286,"5min":1.286,"15min":1.286},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.50600000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574867,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27460,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344380,"statfs":{"total":96636764160,"available":96608645120,"internally_reserved":0,"allocated":446464,"data_stored":195987,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jul 25 14:36:32 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":1.9370000000000001,"5min":1.9370000000000001,"15min":1.9370000000000001},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":2.6779999999999999,"5min":2.6779999999999999,"15min":2.6779999999999999},"last":0.60999999999999999}]},{"osd":1,"last update":"Tue Jul 25 14:36:32 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":2.5720000000000001,"5min":2.5720000000000001,"15min":2.5720000000000001},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":1.6259999999999999,"5min":1.6259999999999999,"15min":1.6259999999999999},"last":0.623}]},{"osd":2,"last update":"Tue Jul 25 14:36:32 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.59199999999999997}]},{"osd":3,"last update":"Tue Jul 25 14:36:32 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":3.5750000000000002,"5min":3.5750000000000002,"15min":3.5750000000000002},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":4.7190000000000003,"5min":4.7190000000000003,"15min":4.7190000000000003},"last":0.66500000000000004}]},{"osd":4,"last update":"Tue Jul 25 14:36:32 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":4.694,"5min":4.694,"15min":4.694},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":2.7839999999999998,"5min":2.7839999999999998,"15min":2.7839999999999998},"last":0.63700000000000001}]},{"osd":5,"last update":"Tue Jul 25 14:36:32 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.7310000000000001,"5min":1.7310000000000001,"15min":1.7310000000000001},"last":0.54500000000000004}]},{"osd":7,"last update":"Tue Jul 25 14:36:32 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":2.7290000000000001,"5min":2.7290000000000001,"15min":2.7290000000000001},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.65100000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574867,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27524,"kb_used_data":496,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344316,"statfs":{"total":96636764160,"available":96608579584,"internally_reserved":0,"allocated":507904,"data_stored":785753,"data_compressed":32255,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jul 25 14:36:34 2023","interfaces":[{"interface":"back","average":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"last":0.28100000000000003},{"interface":"front","average":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"last":0.29599999999999999}]},{"osd":2,"last update":"Tue Jul 25 14:36:34 2023","interfaces":[{"interface":"back","average":{"1min":0.309,"5min":0.309,"15min":0.309},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"last":0.245},{"interface":"front","average":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"last":0.36599999999999999}]},{"osd":3,"last update":"Tue Jul 25 14:36:34 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.374,"15min":0.374},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.496,"5min":0.496,"15min":0.496},"last":0.34899999999999998}]},{"osd":4,"last update":"Tue Jul 25 14:36:34 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.44700000000000001}]},{"osd":5,"last update":"Tue Jul 25 14:36:34 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.502},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.52300000000000002}]},{"osd":6,"last update":"Tue Jul 25 14:36:34 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.57799999999999996}]},{"osd":7,"last update":"Tue Jul 25 14:36:34 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.54500000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574867,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27452,"kb_used_data":428,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":438272,"data_stored":194288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Jul 25 14:36:32 2023","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"min":{"1min":0.19600000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":6.5369999999999999,"5min":6.5369999999999999,"15min":6.5369999999999999},"last":0.27200000000000002}]},{"osd":2,"last update":"Tue Jul 25 14:36:32 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.374,"15min":0.374},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.24199999999999999},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":6.5659999999999998,"5min":6.5659999999999998,"15min":6.5659999999999998},"last":0.36499999999999999}]},{"osd":3,"last update":"Tue Jul 25 14:36:32 2023","interfaces":[{"interface":"back","average":{"1min":1.026,"5min":1.026,"15min":1.026},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":12.449,"5min":12.449,"15min":12.449},"last":0.309},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":1.079,"5min":1.079,"15min":1.079},"last":0.38800000000000001}]},{"osd":4,"last update":"Tue Jul 25 14:36:32 2023","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":6.5099999999999998,"5min":6.5099999999999998,"15min":6.5099999999999998},"last":0.57399999999999995},{"interface":"front","average":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":12.35,"5min":12.35,"15min":12.35},"last":0.438}]},{"osd":5,"last update":"Tue Jul 25 14:36:32 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.107,"5min":1.107,"15min":1.107},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":6.4349999999999996,"5min":6.4349999999999996,"15min":6.4349999999999996},"last":0.55600000000000005}]},{"osd":6,"last update":"Tue Jul 25 14:36:32 2023","interfaces":[{"interface":"back","average":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":12.417,"5min":12.417,"15min":12.417},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.45000000000000001}]},{"osd":7,"last update":"Tue Jul 25 14:36:32 2023","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":6.4809999999999999,"5min":6.4809999999999999,"15min":6.4809999999999999},"last":0.53100000000000003},{"interface":"front","average":{"1min":1.22,"5min":1.22,"15min":1.22},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":12.388999999999999,"5min":12.388999999999999,"15min":12.388999999999999},"last":0.46300000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574867,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":440,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":450560,"data_stored":195840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jul 25 14:36:31 2023","interfaces":[{"interface":"back","average":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":2.1030000000000002,"5min":2.1030000000000002,"15min":2.1030000000000002},"last":0.37},{"interface":"front","average":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":16.969000000000001,"5min":16.969000000000001,"15min":16.969000000000001},"last":0.28199999999999997}]},{"osd":1,"last update":"Tue Jul 25 14:36:31 2023","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"last":0.31},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":1.111,"5min":1.111,"15min":1.111},"last":0.35399999999999998}]},{"osd":3,"last update":"Tue Jul 25 14:36:31 2023","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":13.035,"5min":13.035,"15min":13.035},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.40000000000000002}]},{"osd":4,"last update":"Tue Jul 25 14:36:31 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":6.165,"5min":6.165,"15min":6.165},"last":0.50800000000000001},{"interface":"front","average":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":13.004,"5min":13.004,"15min":13.004},"last":0.61799999999999999}]},{"osd":5,"last update":"Tue Jul 25 14:36:31 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":6.226,"5min":6.226,"15min":6.226},"last":0.63}]},{"osd":6,"last update":"Tue Jul 25 14:36:31 2023","interfaces":[{"interface":"back","average":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":12.974,"5min":12.974,"15min":12.974},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.57899999999999996}]},{"osd":7,"last update":"Tue Jul 25 14:36:31 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":6.1989999999999998,"5min":6.1989999999999998,"15min":6.1989999999999998},"last":0.54000000000000004},{"interface":"front","average":{"1min":1.141,"5min":1.141,"15min":1.141},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":12.936999999999999,"5min":12.936999999999999,"15min":12.936999999999999},"last":0.52800000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574867,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27460,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344380,"statfs":{"total":96636764160,"available":96608645120,"internally_reserved":0,"allocated":446464,"data_stored":194892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jul 25 14:36:34 2023","interfaces":[{"interface":"back","average":{"1min":0.316,"5min":0.316,"15min":0.316},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"last":0.29299999999999998}]},{"osd":1,"last update":"Tue Jul 25 14:36:34 2023","interfaces":[{"interface":"back","average":{"1min":0.307,"5min":0.307,"15min":0.307},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.378,"5min":0.378,"15min":0.378},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.376,"5min":0.376,"15min":0.376},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"last":0.26300000000000001}]},{"osd":2,"last update":"Tue Jul 25 14:36:34 2023","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.377,"15min":0.377},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.502,"5min":0.502,"15min":0.502},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.315}]},{"osd":4,"last update":"Tue Jul 25 14:36:34 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.67800000000000005}]},{"osd":5,"last update":"Tue Jul 25 14:36:34 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.622},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.72499999999999998}]},{"osd":6,"last update":"Tue Jul 25 14:36:34 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.68400000000000005}]},{"osd":7,"last update":"Tue Jul 25 14:36:34 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.64400000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574867,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":440,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":450560,"data_stored":196879,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jul 25 14:36:33 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.501}]},{"osd":1,"last update":"Tue Jul 25 14:36:33 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.38900000000000001}]},{"osd":2,"last update":"Tue Jul 25 14:36:33 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.46800000000000003}]},{"osd":3,"last update":"Tue Jul 25 14:36:33 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.8720000000000001,"5min":1.8720000000000001,"15min":1.8720000000000001},"last":0.53800000000000003}]},{"osd":5,"last update":"Tue Jul 25 14:36:33 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.44600000000000001}]},{"osd":6,"last update":"Tue Jul 25 14:36:33 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.59199999999999997}]},{"osd":7,"last update":"Tue Jul 25 14:36:33 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.63}]}]},{"osd":5,"up_from":13,"seq":55834574867,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27456,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344384,"statfs":{"total":96636764160,"available":96608649216,"internally_reserved":0,"allocated":442368,"data_stored":195385,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jul 25 14:36:31 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":2.548,"5min":2.548,"15min":2.548},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.61099999999999999}]},{"osd":1,"last update":"Tue Jul 25 14:36:31 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.657,"5min":1.657,"15min":1.657},"last":0.753},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.752,"5min":1.752,"15min":1.752},"last":0.629}]},{"osd":2,"last update":"Tue Jul 25 14:36:31 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.70299999999999996}]},{"osd":3,"last update":"Tue Jul 25 14:36:31 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.73999999999999999}]},{"osd":4,"last update":"Tue Jul 25 14:36:31 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.66700000000000004}]},{"osd":6,"last update":"Tue Jul 25 14:36:31 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.64400000000000002}]},{"osd":7,"last update":"Tue Jul 25 14:36:31 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.68300000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32255,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32255,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-25T14:36:54.684 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-07-25T14:36:54.684 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-07-25T14:36:54.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.830+0000 7f12a0a88700 1 Processor -- start 2023-07-25T14:36:54.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.830+0000 7f12a0a88700 1 -- start start 2023-07-25T14:36:54.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.831+0000 7f12a0a88700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f129c0ba0e0 0x7f129c0c5e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:54.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.831+0000 7f12a0a88700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f129c0c3f10 0x7f129c071960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:54.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.831+0000 7f12a0a88700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f129c0c4930 con 0x7f129c14faf0 2023-07-25T14:36:54.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.831+0000 7f12a0a88700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f129c0c5670 con 0x7f129c0c3f10 2023-07-25T14:36:54.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.831+0000 7f12a0a88700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f129c0726e0 con 0x7f129c0ba0e0 2023-07-25T14:36:54.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.831+0000 7f129a59c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f129c14faf0 0x7f129c1558a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:32802/0 (socket says 172.21.15.72:32802) 2023-07-25T14:36:54.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.831+0000 7f129a59c700 1 -- 172.21.15.72:0/2820802220 learned_addr learned my addr 172.21.15.72:0/2820802220 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:36:54.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.831+0000 7f129ad9d700 1 --2- 172.21.15.72:0/2820802220 >> v2:172.21.15.72:3300/0 conn(0x7f129c0c3f10 0x7f129c071960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:54.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.831+0000 7f1299d9b700 1 --2- 172.21.15.72:0/2820802220 >> v2:172.21.15.92:3300/0 conn(0x7f129c0ba0e0 0x7f129c0c5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:54.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.831+0000 7f129ad9d700 1 -- 172.21.15.72:0/2820802220 >> v2:172.21.15.92:3300/0 conn(0x7f129c0ba0e0 msgr2=0x7f129c0c5e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:54.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.831+0000 7f129ad9d700 1 --2- 172.21.15.72:0/2820802220 >> v2:172.21.15.92:3300/0 conn(0x7f129c0ba0e0 0x7f129c0c5e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:54.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.831+0000 7f129ad9d700 1 -- 172.21.15.72:0/2820802220 >> v1:172.21.15.72:6789/0 conn(0x7f129c14faf0 legacy=0x7f129c1558a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:54.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.831+0000 7f129ad9d700 1 -- 172.21.15.72:0/2820802220 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f129c0c4b80 con 0x7f129c0c3f10 2023-07-25T14:36:54.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.831+0000 7f129959a700 1 -- 172.21.15.72:0/2820802220 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1243935767 0 0) 0x7f129c0c4930 con 0x7f129c14faf0 2023-07-25T14:36:54.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.831+0000 7f129ad9d700 1 --2- 172.21.15.72:0/2820802220 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f129c0c3f10 0x7f129c071960 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f129c0c4560 tx=0x7f129400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e1bce6aeeacd9a7 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:54.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.831+0000 7f129959a700 1 -- 172.21.15.72:0/2820802220 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f129400e070 con 0x7f129c0c3f10 2023-07-25T14:36:54.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.831+0000 7f129959a700 1 -- 172.21.15.72:0/2820802220 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f129400bbd0 con 0x7f129c0c3f10 2023-07-25T14:36:54.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.831+0000 7f129959a700 1 -- 172.21.15.72:0/2820802220 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1294012430 con 0x7f129c0c3f10 2023-07-25T14:36:54.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.832+0000 7f12a0a88700 1 -- 172.21.15.72:0/2820802220 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f129c0c3f10 msgr2=0x7f129c071960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:54.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.832+0000 7f12a0a88700 1 --2- 172.21.15.72:0/2820802220 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f129c0c3f10 0x7f129c071960 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f129c0c4560 tx=0x7f129400b330 comp rx=0 tx=0).stop 2023-07-25T14:36:54.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.832+0000 7f12a0a88700 1 -- 172.21.15.72:0/2820802220 shutdown_connections 2023-07-25T14:36:54.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.832+0000 7f12a0a88700 1 --2- 172.21.15.72:0/2820802220 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f129c0c3f10 0x7f129c071960 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:54.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.832+0000 7f12a0a88700 1 --2- 172.21.15.72:0/2820802220 >> v2:172.21.15.92:3300/0 conn(0x7f129c0ba0e0 0x7f129c0c5e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:54.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.832+0000 7f12a0a88700 1 -- 172.21.15.72:0/2820802220 >> 172.21.15.72:0/2820802220 conn(0x7f129c0a87e0 msgr2=0x7f129c0a8bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:54.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.832+0000 7f12a0a88700 1 -- 172.21.15.72:0/2820802220 shutdown_connections 2023-07-25T14:36:54.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.832+0000 7f12a0a88700 1 -- 172.21.15.72:0/2820802220 wait complete. 2023-07-25T14:36:54.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.833+0000 7f12a0a88700 1 Processor -- start 2023-07-25T14:36:54.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.833+0000 7f12a0a88700 1 -- start start 2023-07-25T14:36:54.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.834+0000 7f12a0a88700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f129c0ba0e0 0x7f129c1eb3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:54.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.834+0000 7f12a0a88700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f129c0c3f10 0x7f129c0bd210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:54.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.834+0000 7f12a0a88700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f129c14faf0 0x7f129c150420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:54.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.834+0000 7f12a0a88700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f129c14a360 con 0x7f129c0ba0e0 2023-07-25T14:36:54.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.834+0000 7f12a0a88700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f129c152b30 con 0x7f129c14faf0 2023-07-25T14:36:54.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.834+0000 7f12a0a88700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f129c1e7420 con 0x7f129c0c3f10 2023-07-25T14:36:54.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.834+0000 7f129a59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f129c0ba0e0 0x7f129c1eb3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:54.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.834+0000 7f129a59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f129c0ba0e0 0x7f129c1eb3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42072/0 (socket says 172.21.15.72:42072) 2023-07-25T14:36:54.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.834+0000 7f129a59c700 1 -- 172.21.15.72:0/3823281876 learned_addr learned my addr 172.21.15.72:0/3823281876 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:54.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.834+0000 7f129a59c700 1 -- 172.21.15.72:0/3823281876 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f129c0c3f10 msgr2=0x7f129c0bd210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:54.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.834+0000 7f129a59c700 1 --2- 172.21.15.72:0/3823281876 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f129c0c3f10 0x7f129c0bd210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:54.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.834+0000 7f129a59c700 1 -- 172.21.15.72:0/3823281876 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f129c14faf0 msgr2=0x7f129c150420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:54.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.834+0000 7f129a59c700 1 --2- 172.21.15.72:0/3823281876 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f129c14faf0 0x7f129c150420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:54.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.834+0000 7f129a59c700 1 -- 172.21.15.72:0/3823281876 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1294009a70 con 0x7f129c0ba0e0 2023-07-25T14:36:54.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.835+0000 7f129a59c700 1 --2- 172.21.15.72:0/3823281876 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f129c0ba0e0 0x7f129c1eb3c0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f129000c550 tx=0x7f129000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:54.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.835+0000 7f128affd700 1 -- 172.21.15.72:0/3823281876 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1290004c80 con 0x7f129c0ba0e0 2023-07-25T14:36:54.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.835+0000 7f128affd700 1 -- 172.21.15.72:0/3823281876 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1290004e00 con 0x7f129c0ba0e0 2023-07-25T14:36:54.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.835+0000 7f12a0a88700 1 -- 172.21.15.72:0/3823281876 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f129c0bd750 con 0x7f129c0ba0e0 2023-07-25T14:36:54.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.835+0000 7f128affd700 1 -- 172.21.15.72:0/3823281876 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1290007310 con 0x7f129c0ba0e0 2023-07-25T14:36:54.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.835+0000 7f12a0a88700 1 -- 172.21.15.72:0/3823281876 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f129c0c0080 con 0x7f129c0ba0e0 2023-07-25T14:36:54.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.836+0000 7f12a0a88700 1 -- 172.21.15.72:0/3823281876 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f129c04e470 con 0x7f129c0ba0e0 2023-07-25T14:36:54.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.836+0000 7f128affd700 1 -- 172.21.15.72:0/3823281876 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1290007470 con 0x7f129c0ba0e0 2023-07-25T14:36:54.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.837+0000 7f128affd700 1 --2- 172.21.15.72:0/3823281876 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f127c06ace0 0x7f127c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:54.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.837+0000 7f128affd700 1 -- 172.21.15.72:0/3823281876 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f1290089740 con 0x7f129c0ba0e0 2023-07-25T14:36:54.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.837+0000 7f1299d9b700 1 --2- 172.21.15.72:0/3823281876 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f127c06ace0 0x7f127c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:54.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.837+0000 7f1299d9b700 1 --2- 172.21.15.72:0/3823281876 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f127c06ace0 0x7f127c06d1a0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f129c0c69f0 tx=0x7f128c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:54.855 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:54.840+0000 7f128affd700 1 -- 172.21.15.72:0/3823281876 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f1290054820 con 0x7f129c0ba0e0 2023-07-25T14:36:55.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:55.106+0000 7f12a0a88700 1 -- 172.21.15.72:0/3823281876 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f129c0b9ec0 con 0x7f129c0ba0e0 2023-07-25T14:36:55.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:55.109+0000 7f128affd700 1 -- 172.21.15.72:0/3823281876 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) v1 ==== 190+0+147 (secure 0 0 0) 0x7f1290057e40 con 0x7f129c0ba0e0 2023-07-25T14:36:55.121 INFO:teuthology.orchestra.run.smithi072.stdout:[client.0] 2023-07-25T14:36:55.121 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQCI3b9k9P3nJxAAF+MNeILdw3WF8ZQhKpISew== 2023-07-25T14:36:55.121 INFO:teuthology.orchestra.run.smithi072.stdout: caps mds = "allow" 2023-07-25T14:36:55.121 INFO:teuthology.orchestra.run.smithi072.stdout: caps mon = "allow r" 2023-07-25T14:36:55.121 INFO:teuthology.orchestra.run.smithi072.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-07-25T14:36:55.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:55.111+0000 7f12a0a88700 1 -- 172.21.15.72:0/3823281876 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f127c06ace0 msgr2=0x7f127c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:55.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:55.111+0000 7f12a0a88700 1 --2- 172.21.15.72:0/3823281876 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f127c06ace0 0x7f127c06d1a0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f129c0c69f0 tx=0x7f128c008040 comp rx=0 tx=0).stop 2023-07-25T14:36:55.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:55.111+0000 7f12a0a88700 1 -- 172.21.15.72:0/3823281876 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f129c0ba0e0 msgr2=0x7f129c1eb3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:55.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:55.111+0000 7f12a0a88700 1 --2- 172.21.15.72:0/3823281876 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f129c0ba0e0 0x7f129c1eb3c0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f129000c550 tx=0x7f129000c910 comp rx=0 tx=0).stop 2023-07-25T14:36:55.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:55.111+0000 7f12a0a88700 1 -- 172.21.15.72:0/3823281876 shutdown_connections 2023-07-25T14:36:55.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:55.111+0000 7f12a0a88700 1 --2- 172.21.15.72:0/3823281876 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f127c06ace0 0x7f127c06d1a0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:55.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:55.111+0000 7f12a0a88700 1 --2- 172.21.15.72:0/3823281876 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f129c14faf0 0x7f129c150420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:55.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:55.111+0000 7f12a0a88700 1 --2- 172.21.15.72:0/3823281876 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f129c0ba0e0 0x7f129c1eb3c0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:55.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:55.111+0000 7f12a0a88700 1 --2- 172.21.15.72:0/3823281876 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f129c0c3f10 0x7f129c0bd210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:55.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:55.111+0000 7f12a0a88700 1 -- 172.21.15.72:0/3823281876 >> 172.21.15.72:0/3823281876 conn(0x7f129c0a87e0 msgr2=0x7f129c0c70d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:55.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:55.111+0000 7f12a0a88700 1 -- 172.21.15.72:0/3823281876 shutdown_connections 2023-07-25T14:36:55.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:55.111+0000 7f12a0a88700 1 -- 172.21.15.72:0/3823281876 wait complete. 2023-07-25T14:36:55.125 INFO:teuthology.orchestra.run.smithi072.stderr:updated caps for client.0 2023-07-25T14:36:55.135 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-25T14:36:55.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:55.244+0000 7f85f8254700 1 Processor -- start 2023-07-25T14:36:55.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:55.244+0000 7f85f8254700 1 -- start start 2023-07-25T14:36:55.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:55.245+0000 7f85f8254700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f85f0072300 0x7f85f006a190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:55.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:55.245+0000 7f85f8254700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85f00a8230 con 0x7f85f014dea0 2023-07-25T14:36:55.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:55.245+0000 7f85f8254700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85f00a7c20 con 0x7f85f00a86c0 2023-07-25T14:36:55.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:55.245+0000 7f85f8254700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85f00c18d0 con 0x7f85f0072300 2023-07-25T14:36:55.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:55.245+0000 7f85f57ef700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f85f0072300 0x7f85f006a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:55.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:55.245+0000 7f85f5ff0700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f85f014dea0 0x7f85f0151200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:32816/0 (socket says 172.21.15.72:32816) 2023-07-25T14:36:55.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:55.245+0000 7f85f5ff0700 1 -- 172.21.15.72:0/1449951575 learned_addr learned my addr 172.21.15.72:0/1449951575 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:36:55.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:55.245+0000 7f85f57ef700 1 -- 172.21.15.72:0/1449951575 >> v1:172.21.15.92:6789/0 conn(0x7f85f00a86c0 legacy=0x7f85f00c0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:55.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:55.245+0000 7f85f57ef700 1 -- 172.21.15.72:0/1449951575 >> v1:172.21.15.72:6789/0 conn(0x7f85f014dea0 legacy=0x7f85f0151200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:55.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:55.245+0000 7f85f57ef700 1 -- 172.21.15.72:0/1449951575 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85f006ec20 con 0x7f85f0072300 2023-07-25T14:36:55.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:55.245+0000 7f85f4fee700 1 -- 172.21.15.72:0/1449951575 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1839333181 0 0) 0x7f85f00a8230 con 0x7f85f014dea0 2023-07-25T14:36:55.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:55.245+0000 7f85f57ef700 1 --2- 172.21.15.72:0/1449951575 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f85f0072300 0x7f85f006a190 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f85e0009840 tx=0x7f85e0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=723c2494cc1c8f7e server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:55.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:55.245+0000 7f85f4fee700 1 -- 172.21.15.72:0/1449951575 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85e0004230 con 0x7f85f0072300 2023-07-25T14:36:55.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:55.245+0000 7f85f4fee700 1 -- 172.21.15.72:0/1449951575 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85e0004390 con 0x7f85f0072300 2023-07-25T14:36:55.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:55.245+0000 7f85f4fee700 1 -- 172.21.15.72:0/1449951575 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85e00036a0 con 0x7f85f0072300 2023-07-25T14:36:55.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:55.246+0000 7f85f8254700 1 -- 172.21.15.72:0/1449951575 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f85f0072300 msgr2=0x7f85f006a190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:55.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:55.246+0000 7f85f8254700 1 --2- 172.21.15.72:0/1449951575 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f85f0072300 0x7f85f006a190 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f85e0009840 tx=0x7f85e0009b50 comp rx=0 tx=0).stop 2023-07-25T14:36:55.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:55.246+0000 7f85f8254700 1 -- 172.21.15.72:0/1449951575 shutdown_connections 2023-07-25T14:36:55.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:55.246+0000 7f85f8254700 1 --2- 172.21.15.72:0/1449951575 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f85f0072300 0x7f85f006a190 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:55.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:55.246+0000 7f85f8254700 1 -- 172.21.15.72:0/1449951575 >> 172.21.15.72:0/1449951575 conn(0x7f85f006def0 msgr2=0x7f85f006e300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:55.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:55.246+0000 7f85f8254700 1 -- 172.21.15.72:0/1449951575 shutdown_connections 2023-07-25T14:36:55.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:55.246+0000 7f85f8254700 1 -- 172.21.15.72:0/1449951575 wait complete. 2023-07-25T14:36:55.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:55.247+0000 7f85f8254700 1 Processor -- start 2023-07-25T14:36:55.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:55.247+0000 7f85f8254700 1 -- start start 2023-07-25T14:36:55.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:55.248+0000 7f85f8254700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f85f0072300 0x7f85f00bf840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:55.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:55.248+0000 7f85f8254700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f85f00a86c0 0x7f85f0136a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:55.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:55.248+0000 7f85f8254700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f85f014dea0 0x7f85f0136fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:55.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:55.248+0000 7f85f8254700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85f00a9760 con 0x7f85f014dea0 2023-07-25T14:36:55.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:55.248+0000 7f85f8254700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85f00aa000 con 0x7f85f00a86c0 2023-07-25T14:36:55.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:55.248+0000 7f85f8254700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85f01ed5f0 con 0x7f85f0072300 2023-07-25T14:36:55.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:55.248+0000 7f85f67f1700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f85f014dea0 0x7f85f0136fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:55.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:55.248+0000 7f85f67f1700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f85f014dea0 0x7f85f0136fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42090/0 (socket says 172.21.15.72:42090) 2023-07-25T14:36:55.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:55.248+0000 7f85f67f1700 1 -- 172.21.15.72:0/3186565603 learned_addr learned my addr 172.21.15.72:0/3186565603 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:55.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:55.248+0000 7f85f57ef700 1 --2- 172.21.15.72:0/3186565603 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f85f00a86c0 0x7f85f0136a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:55.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:55.248+0000 7f85f5ff0700 1 --2- 172.21.15.72:0/3186565603 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f85f0072300 0x7f85f00bf840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:55.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:55.248+0000 7f85f67f1700 1 -- 172.21.15.72:0/3186565603 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f85f0072300 msgr2=0x7f85f00bf840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:55.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:55.248+0000 7f85f67f1700 1 --2- 172.21.15.72:0/3186565603 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f85f0072300 0x7f85f00bf840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:55.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:55.248+0000 7f85f67f1700 1 -- 172.21.15.72:0/3186565603 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f85f00a86c0 msgr2=0x7f85f0136a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:55.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:55.248+0000 7f85f67f1700 1 --2- 172.21.15.72:0/3186565603 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f85f00a86c0 0x7f85f0136a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:55.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:55.248+0000 7f85f67f1700 1 -- 172.21.15.72:0/3186565603 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85e00094a0 con 0x7f85f014dea0 2023-07-25T14:36:55.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:55.248+0000 7f85f67f1700 1 --2- 172.21.15.72:0/3186565603 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f85f014dea0 0x7f85f0136fb0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f85e800cc40 tx=0x7f85e800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:55.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:55.249+0000 7f85e67fc700 1 -- 172.21.15.72:0/3186565603 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85e800ab40 con 0x7f85f014dea0 2023-07-25T14:36:55.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:55.249+0000 7f85e67fc700 1 -- 172.21.15.72:0/3186565603 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85e800aca0 con 0x7f85f014dea0 2023-07-25T14:36:55.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:55.249+0000 7f85f8254700 1 -- 172.21.15.72:0/3186565603 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85f00a99b0 con 0x7f85f014dea0 2023-07-25T14:36:55.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:55.249+0000 7f85e67fc700 1 -- 172.21.15.72:0/3186565603 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85e8012660 con 0x7f85f014dea0 2023-07-25T14:36:55.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:55.249+0000 7f85f8254700 1 -- 172.21.15.72:0/3186565603 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85f00bfd80 con 0x7f85f014dea0 2023-07-25T14:36:55.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:55.250+0000 7f85f8254700 1 -- 172.21.15.72:0/3186565603 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85f00aa190 con 0x7f85f014dea0 2023-07-25T14:36:55.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:55.250+0000 7f85e67fc700 1 -- 172.21.15.72:0/3186565603 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f85e80127c0 con 0x7f85f014dea0 2023-07-25T14:36:55.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:55.250+0000 7f85e67fc700 1 --2- 172.21.15.72:0/3186565603 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f85d406ace0 0x7f85d406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:55.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:55.250+0000 7f85e67fc700 1 -- 172.21.15.72:0/3186565603 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f85e8089d70 con 0x7f85f014dea0 2023-07-25T14:36:55.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:55.251+0000 7f85f5ff0700 1 --2- 172.21.15.72:0/3186565603 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f85d406ace0 0x7f85d406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:55.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:55.251+0000 7f85f5ff0700 1 --2- 172.21.15.72:0/3186565603 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f85d406ace0 0x7f85d406d1a0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f85ec000f60 tx=0x7f85ec007c90 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:55.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:55.255+0000 7f85e67fc700 1 -- 172.21.15.72:0/3186565603 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f85e8054ce0 con 0x7f85f014dea0 2023-07-25T14:36:55.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:55.485+0000 7f85f8254700 1 -- 172.21.15.72:0/3186565603 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f85f006bcf0 con 0x7f85f014dea0 2023-07-25T14:36:55.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:55.486+0000 7f85e67fc700 1 -- 172.21.15.72:0/3186565603 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4668 (secure 0 0 0) 0x7f85e8016020 con 0x7f85f014dea0 2023-07-25T14:36:55.498 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-25T14:36:55.498 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5092,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6834/3640355071","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":3640355071},{"type":"v1","addr":"172.21.15.92:6834","nonce":3640355071}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5095,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/936080292","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6833","nonce":936080292},{"type":"v1","addr":"172.21.15.92:6835","nonce":936080292}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5328,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6836/2944832990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":2944832990},{"type":"v1","addr":"172.21.15.72:6836","nonce":2944832990}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-25T14:36:49.567868+0000","modified":"2023-07-25T14:36:53.213193+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5331},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5331":{"gid":5331,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.72:6837/1193027887","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6835","nonce":1193027887},{"type":"v1","addr":"172.21.15.72:6837","nonce":1193027887}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-07-25T14:36:55.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:55.488+0000 7f85f8254700 1 -- 172.21.15.72:0/3186565603 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f85d406ace0 msgr2=0x7f85d406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:55.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:55.488+0000 7f85f8254700 1 --2- 172.21.15.72:0/3186565603 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f85d406ace0 0x7f85d406d1a0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f85ec000f60 tx=0x7f85ec007c90 comp rx=0 tx=0).stop 2023-07-25T14:36:55.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:55.488+0000 7f85f8254700 1 -- 172.21.15.72:0/3186565603 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f85f014dea0 msgr2=0x7f85f0136fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:55.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:55.488+0000 7f85f8254700 1 --2- 172.21.15.72:0/3186565603 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f85f014dea0 0x7f85f0136fb0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f85e800cc40 tx=0x7f85e800a060 comp rx=0 tx=0).stop 2023-07-25T14:36:55.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:55.488+0000 7f85f8254700 1 -- 172.21.15.72:0/3186565603 shutdown_connections 2023-07-25T14:36:55.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:55.488+0000 7f85f8254700 1 --2- 172.21.15.72:0/3186565603 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f85d406ace0 0x7f85d406d1a0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:55.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:55.488+0000 7f85f8254700 1 --2- 172.21.15.72:0/3186565603 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f85f0072300 0x7f85f00bf840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:55.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:55.488+0000 7f85f8254700 1 --2- 172.21.15.72:0/3186565603 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f85f014dea0 0x7f85f0136fb0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:55.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:55.488+0000 7f85f8254700 1 --2- 172.21.15.72:0/3186565603 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f85f00a86c0 0x7f85f0136a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:55.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:55.488+0000 7f85f8254700 1 -- 172.21.15.72:0/3186565603 >> 172.21.15.72:0/3186565603 conn(0x7f85f006def0 msgr2=0x7f85f00c0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:55.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:55.488+0000 7f85f8254700 1 -- 172.21.15.72:0/3186565603 shutdown_connections 2023-07-25T14:36:55.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:55.488+0000 7f85f8254700 1 -- 172.21.15.72:0/3186565603 wait complete. 2023-07-25T14:36:55.502 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 17 2023-07-25T14:36:55.914 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-07-25T14:36:49.567868+0000', 'modified': '2023-07-25T14:36:53.213193+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5331}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5331': {'gid': 5331, 'name': 'a', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.72:6837/1193027887', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.72:6835', 'nonce': 1193027887}, {'type': 'v1', 'addr': '172.21.15.72:6837', 'nonce': 1193027887}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [7], 'metadata_pool': 6, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-07-25T14:36:55.915 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-07-25T14:36:55.915 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-07-25T14:36:56.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.025+0000 7f92b0d7c700 1 Processor -- start 2023-07-25T14:36:56.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.026+0000 7f92b0d7c700 1 -- start start 2023-07-25T14:36:56.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.026+0000 7f92b0d7c700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f92ac151980 0x7f92ac0c12b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:56.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.026+0000 7f92b0d7c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f92ac06e580 0x7f92ac0c5380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:56.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.026+0000 7f92b0d7c700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92ac06eaf0 con 0x7f92ac0c17f0 2023-07-25T14:36:56.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.026+0000 7f92b0d7c700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92ac06f770 con 0x7f92ac06e580 2023-07-25T14:36:56.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.026+0000 7f92b0d7c700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92ac0c29e0 con 0x7f92ac151980 2023-07-25T14:36:56.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.026+0000 7f92aad9d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f92ac06e580 0x7f92ac0c5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:56.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.027+0000 7f92a9d9b700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f92ac0c17f0 0x7f92ac0c4c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:32830/0 (socket says 172.21.15.72:32830) 2023-07-25T14:36:56.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.027+0000 7f92aad9d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f92ac06e580 0x7f92ac0c5380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42098/0 (socket says 172.21.15.72:42098) 2023-07-25T14:36:56.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.027+0000 7f92a9d9b700 1 -- 172.21.15.72:0/1684623502 learned_addr learned my addr 172.21.15.72:0/1684623502 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:36:56.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.027+0000 7f92aa59c700 1 --2- 172.21.15.72:0/1684623502 >> v2:172.21.15.92:3300/0 conn(0x7f92ac151980 0x7f92ac0c12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:56.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.027+0000 7f92aad9d700 1 -- 172.21.15.72:0/1684623502 >> v2:172.21.15.92:3300/0 conn(0x7f92ac151980 msgr2=0x7f92ac0c12b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:56.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.027+0000 7f92aad9d700 1 --2- 172.21.15.72:0/1684623502 >> v2:172.21.15.92:3300/0 conn(0x7f92ac151980 0x7f92ac0c12b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:56.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.027+0000 7f92aad9d700 1 -- 172.21.15.72:0/1684623502 >> v1:172.21.15.72:6789/0 conn(0x7f92ac0c17f0 legacy=0x7f92ac0c4c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:56.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.027+0000 7f92a959a700 1 -- 172.21.15.72:0/1684623502 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4055819513 0 0) 0x7f92ac06eaf0 con 0x7f92ac0c17f0 2023-07-25T14:36:56.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.027+0000 7f92aad9d700 1 -- 172.21.15.72:0/1684623502 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92ac06edd0 con 0x7f92ac06e580 2023-07-25T14:36:56.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.027+0000 7f92aad9d700 1 --2- 172.21.15.72:0/1684623502 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f92ac06e580 0x7f92ac0c5380 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f92ac0a90d0 tx=0x7f92a400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae66e1888f28cb0a server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:56.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.027+0000 7f92a959a700 1 -- 172.21.15.72:0/1684623502 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92a400e070 con 0x7f92ac06e580 2023-07-25T14:36:56.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.027+0000 7f92a959a700 1 -- 172.21.15.72:0/1684623502 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92a400bb20 con 0x7f92ac06e580 2023-07-25T14:36:56.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.027+0000 7f92a959a700 1 -- 172.21.15.72:0/1684623502 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92a4012430 con 0x7f92ac06e580 2023-07-25T14:36:56.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.028+0000 7f92b0d7c700 1 -- 172.21.15.72:0/1684623502 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f92ac06e580 msgr2=0x7f92ac0c5380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:56.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.028+0000 7f92b0d7c700 1 --2- 172.21.15.72:0/1684623502 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f92ac06e580 0x7f92ac0c5380 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f92ac0a90d0 tx=0x7f92a400b330 comp rx=0 tx=0).stop 2023-07-25T14:36:56.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.028+0000 7f92b0d7c700 1 -- 172.21.15.72:0/1684623502 shutdown_connections 2023-07-25T14:36:56.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.028+0000 7f92b0d7c700 1 --2- 172.21.15.72:0/1684623502 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f92ac06e580 0x7f92ac0c5380 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:56.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.028+0000 7f92b0d7c700 1 --2- 172.21.15.72:0/1684623502 >> v2:172.21.15.92:3300/0 conn(0x7f92ac151980 0x7f92ac0c12b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:56.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.028+0000 7f92b0d7c700 1 -- 172.21.15.72:0/1684623502 >> 172.21.15.72:0/1684623502 conn(0x7f92ac0a8520 msgr2=0x7f92ac0a8900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:56.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.028+0000 7f92b0d7c700 1 -- 172.21.15.72:0/1684623502 shutdown_connections 2023-07-25T14:36:56.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.028+0000 7f92b0d7c700 1 -- 172.21.15.72:0/1684623502 wait complete. 2023-07-25T14:36:56.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.029+0000 7f92b0d7c700 1 Processor -- start 2023-07-25T14:36:56.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.029+0000 7f92b0d7c700 1 -- start start 2023-07-25T14:36:56.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.030+0000 7f92b0d7c700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f92ac06e580 0x7f92ac1ea4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:56.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.030+0000 7f92b0d7c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f92ac0c17f0 0x7f92ac1546a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:56.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.030+0000 7f92b0d7c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f92ac151980 0x7f92ac0bfb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:56.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.030+0000 7f92b0d7c700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92ac0bdca0 con 0x7f92ac151980 2023-07-25T14:36:56.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.030+0000 7f92b0d7c700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92ac152fc0 con 0x7f92ac0c17f0 2023-07-25T14:36:56.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.030+0000 7f92b0d7c700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92ac152c90 con 0x7f92ac06e580 2023-07-25T14:36:56.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.030+0000 7f92aad9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f92ac151980 0x7f92ac0bfb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:56.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.030+0000 7f92aad9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f92ac151980 0x7f92ac0bfb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42104/0 (socket says 172.21.15.72:42104) 2023-07-25T14:36:56.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.030+0000 7f92aad9d700 1 -- 172.21.15.72:0/1443013169 learned_addr learned my addr 172.21.15.72:0/1443013169 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:56.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.030+0000 7f92a9d9b700 1 --2- 172.21.15.72:0/1443013169 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f92ac0c17f0 0x7f92ac1546a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:56.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.030+0000 7f92aa59c700 1 --2- 172.21.15.72:0/1443013169 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f92ac06e580 0x7f92ac1ea4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:56.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.030+0000 7f92aad9d700 1 -- 172.21.15.72:0/1443013169 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f92ac06e580 msgr2=0x7f92ac1ea4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:56.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.030+0000 7f92aad9d700 1 --2- 172.21.15.72:0/1443013169 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f92ac06e580 0x7f92ac1ea4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:56.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.030+0000 7f92aad9d700 1 -- 172.21.15.72:0/1443013169 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f92ac0c17f0 msgr2=0x7f92ac1546a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:56.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.030+0000 7f92aad9d700 1 --2- 172.21.15.72:0/1443013169 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f92ac0c17f0 0x7f92ac1546a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:56.047 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.030+0000 7f92aad9d700 1 -- 172.21.15.72:0/1443013169 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92a4009a70 con 0x7f92ac151980 2023-07-25T14:36:56.047 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.030+0000 7f92aad9d700 1 --2- 172.21.15.72:0/1443013169 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f92ac151980 0x7f92ac0bfb30 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f92a400b680 tx=0x7f92a4004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:56.047 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.030+0000 7f929affd700 1 -- 172.21.15.72:0/1443013169 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92a4012430 con 0x7f92ac151980 2023-07-25T14:36:56.047 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.030+0000 7f929affd700 1 -- 172.21.15.72:0/1443013169 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92a4020070 con 0x7f92ac151980 2023-07-25T14:36:56.047 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.030+0000 7f929affd700 1 -- 172.21.15.72:0/1443013169 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92a4004040 con 0x7f92ac151980 2023-07-25T14:36:56.047 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.031+0000 7f92b0d7c700 1 -- 172.21.15.72:0/1443013169 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92ac152480 con 0x7f92ac151980 2023-07-25T14:36:56.047 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.031+0000 7f92b0d7c700 1 -- 172.21.15.72:0/1443013169 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92ac152760 con 0x7f92ac151980 2023-07-25T14:36:56.047 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.032+0000 7f929affd700 1 -- 172.21.15.72:0/1443013169 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f92a40041a0 con 0x7f92ac151980 2023-07-25T14:36:56.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.032+0000 7f929affd700 1 --2- 172.21.15.72:0/1443013169 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f928c06ace0 0x7f928c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:56.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.032+0000 7f929affd700 1 -- 172.21.15.72:0/1443013169 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f92a4022070 con 0x7f92ac151980 2023-07-25T14:36:56.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.032+0000 7f92aa59c700 1 --2- 172.21.15.72:0/1443013169 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f928c06ace0 0x7f928c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:56.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.033+0000 7f92aa59c700 1 --2- 172.21.15.72:0/1443013169 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f928c06ace0 0x7f928c06d1a0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f92a0009b20 tx=0x7f92a00091c0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:56.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.034+0000 7f92bcf14b80 1 Processor -- start 2023-07-25T14:36:56.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.035+0000 7f92bcf14b80 1 -- start start 2023-07-25T14:36:56.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.035+0000 7f92bcf14b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5644429c3910 0x5644429be1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:56.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.035+0000 7f92bcf14b80 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x5644429c4c90 0x5644429be700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:56.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.035+0000 7f92bcf14b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5644429bec40 0x5644429e12c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:56.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.035+0000 7f92bcf14b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x5644428bbb80 con 0x5644429c3910 2023-07-25T14:36:56.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.035+0000 7f92bcf14b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x56444291b540 con 0x5644429bec40 2023-07-25T14:36:56.055 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.035+0000 7f92bcf14b80 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x564442918e60 con 0x5644429c4c90 2023-07-25T14:36:56.055 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.035+0000 7f92aa59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5644429c3910 0x5644429be1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:56.055 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.035+0000 7f92aa59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5644429c3910 0x5644429be1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42108/0 (socket says 172.21.15.72:42108) 2023-07-25T14:36:56.055 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.035+0000 7f92aa59c700 1 -- 172.21.15.72:0/1610072614 learned_addr learned my addr 172.21.15.72:0/1610072614 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:56.055 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.036+0000 7f92aad9d700 1 --2- 172.21.15.72:0/1610072614 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5644429bec40 0x5644429e12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:56.055 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.036+0000 7f92a9d9b700 1 --2- 172.21.15.72:0/1610072614 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x5644429c4c90 0x5644429be700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:56.056 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.036+0000 7f92aa59c700 1 -- 172.21.15.72:0/1610072614 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x5644429c4c90 msgr2=0x5644429be700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:56.056 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.036+0000 7f92aa59c700 1 --2- 172.21.15.72:0/1610072614 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x5644429c4c90 0x5644429be700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:56.056 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.036+0000 7f92aa59c700 1 -- 172.21.15.72:0/1610072614 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5644429bec40 msgr2=0x5644429e12c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:56.056 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.036+0000 7f92aa59c700 1 --2- 172.21.15.72:0/1610072614 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5644429bec40 0x5644429e12c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:56.056 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.036+0000 7f92aa59c700 1 -- 172.21.15.72:0/1610072614 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5644427955e0 con 0x5644429c3910 2023-07-25T14:36:56.056 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.036+0000 7f92a9d9b700 1 --2- 172.21.15.72:0/1610072614 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x5644429c4c90 0x5644429be700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-25T14:36:56.056 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.036+0000 7f92aad9d700 1 --2- 172.21.15.72:0/1610072614 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5644429bec40 0x5644429e12c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-25T14:36:56.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.036+0000 7f92aa59c700 1 --2- 172.21.15.72:0/1610072614 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5644429c3910 0x5644429be1c0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f92a00117b0 tx=0x7f92a0009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5622a59aa0c34d1c server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:56.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.036+0000 7f928bfff700 1 -- 172.21.15.72:0/1610072614 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92a0006050 con 0x5644429c3910 2023-07-25T14:36:56.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.036+0000 7f928bfff700 1 -- 172.21.15.72:0/1610072614 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92a00061b0 con 0x5644429c3910 2023-07-25T14:36:56.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.036+0000 7f928bfff700 1 -- 172.21.15.72:0/1610072614 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92a0006520 con 0x5644429c3910 2023-07-25T14:36:56.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.037+0000 7f92bcf14b80 1 -- 172.21.15.72:0/1610072614 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5644429c3910 msgr2=0x5644429be1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:56.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.037+0000 7f92bcf14b80 1 --2- 172.21.15.72:0/1610072614 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5644429c3910 0x5644429be1c0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f92a00117b0 tx=0x7f92a0009f90 comp rx=0 tx=0).stop 2023-07-25T14:36:56.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.037+0000 7f92bcf14b80 1 -- 172.21.15.72:0/1610072614 shutdown_connections 2023-07-25T14:36:56.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.037+0000 7f92bcf14b80 1 --2- 172.21.15.72:0/1610072614 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5644429bec40 0x5644429e12c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:56.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.037+0000 7f92bcf14b80 1 --2- 172.21.15.72:0/1610072614 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5644429c3910 0x5644429be1c0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:56.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.037+0000 7f92bcf14b80 1 --2- 172.21.15.72:0/1610072614 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x5644429c4c90 0x5644429be700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:56.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.037+0000 7f92bcf14b80 1 -- 172.21.15.72:0/1610072614 >> 172.21.15.72:0/1610072614 conn(0x564442920c80 msgr2=0x5644429c1570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:56.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.037+0000 7f92bcf14b80 1 -- 172.21.15.72:0/1610072614 shutdown_connections 2023-07-25T14:36:56.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.037+0000 7f92bcf14b80 1 -- 172.21.15.72:0/1610072614 wait complete. 2023-07-25T14:36:56.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.037+0000 7f92bcf14b80 1 -- start start 2023-07-25T14:36:56.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.037+0000 7f92bcf14b80 1 Processor -- start 2023-07-25T14:36:56.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.038+0000 7f92bcf14b80 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x5644429bec40 0x564442a02770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:56.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.038+0000 7f92bcf14b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5644429c3910 0x5644429fed20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:56.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.038+0000 7f92bcf14b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5644429c4c90 0x5644429ff260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:56.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.038+0000 7f92bcf14b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x564442914750 con 0x5644429c4c90 2023-07-25T14:36:56.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.038+0000 7f92bcf14b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5644428b3a70 con 0x5644429c3910 2023-07-25T14:36:56.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.038+0000 7f92bcf14b80 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x5644428b3770 con 0x5644429bec40 2023-07-25T14:36:56.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.038+0000 7f92bcf14b80 10 client.0 _ll_register_callbacks cb 0x5644428b1630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-25T14:36:56.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.038+0000 7f92aad9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5644429c4c90 0x5644429ff260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:56.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.038+0000 7f92aad9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5644429c4c90 0x5644429ff260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42118/0 (socket says 172.21.15.72:42118) 2023-07-25T14:36:56.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.038+0000 7f92aad9d700 1 -- 172.21.15.72:0/2034119759 learned_addr learned my addr 172.21.15.72:0/2034119759 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:56.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.038+0000 7f92aa59c700 1 --2- 172.21.15.72:0/2034119759 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x5644429bec40 0x564442a02770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:56.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.038+0000 7f92a9d9b700 1 --2- 172.21.15.72:0/2034119759 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5644429c3910 0x5644429fed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:56.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.039+0000 7f92aad9d700 1 -- 172.21.15.72:0/2034119759 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x5644429bec40 msgr2=0x564442a02770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:56.061 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.039+0000 7f92aad9d700 1 --2- 172.21.15.72:0/2034119759 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x5644429bec40 0x564442a02770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:56.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.039+0000 7f92aad9d700 1 -- 172.21.15.72:0/2034119759 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5644429c3910 msgr2=0x5644429fed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:56.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.039+0000 7f92aad9d700 1 --2- 172.21.15.72:0/2034119759 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5644429c3910 0x5644429fed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:56.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.039+0000 7f92aad9d700 1 -- 172.21.15.72:0/2034119759 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92a0005c30 con 0x5644429c4c90 2023-07-25T14:36:56.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.039+0000 7f92aad9d700 1 --2- 172.21.15.72:0/2034119759 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5644429c4c90 0x5644429ff260 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f92a400b370 tx=0x7f92a4059540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c76835aff7a3a36 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:56.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.039+0000 7f92897fa700 10 client.0 ms_handle_connect on v2:172.21.15.72:3300/0 2023-07-25T14:36:56.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.039+0000 7f92897fa700 1 -- 172.21.15.72:0/2034119759 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92a4055d60 con 0x5644429c4c90 2023-07-25T14:36:56.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.039+0000 7f92897fa700 1 -- 172.21.15.72:0/2034119759 <== mon.0 v2:172.21.15.72:3300/0 2 ==== osd_map(39..39 src has 1..39) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f92a4055ec0 con 0x5644429c4c90 2023-07-25T14:36:56.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.039+0000 7f92bcf14b80 1 -- 172.21.15.72:0/2034119759 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564442992b40 con 0x5644429c4c90 2023-07-25T14:36:56.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.039+0000 7f92897fa700 1 -- 172.21.15.72:0/2034119759 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f92a405dd30 con 0x5644429c4c90 2023-07-25T14:36:56.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.039+0000 7f92bcf14b80 10 client.5520 fetch_fsmap learned FSMap version 17 2023-07-25T14:36:56.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.039+0000 7f92bcf14b80 1 -- 172.21.15.72:0/2034119759 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x564442741d90 con 0x5644429c4c90 2023-07-25T14:36:56.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.039+0000 7f92897fa700 1 -- 172.21.15.72:0/2034119759 <== mon.0 v2:172.21.15.72:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92a4075020 con 0x5644429c4c90 2023-07-25T14:36:56.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.039+0000 7f92897fa700 1 -- 172.21.15.72:0/2034119759 <== mon.0 v2:172.21.15.72:3300/0 5 ==== fsmap(e 17) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f92a4058cd0 con 0x5644429c4c90 2023-07-25T14:36:56.063 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.039+0000 7f92bcf14b80 10 client.5520 fetch_fsmap finished waiting for FSMap version 17 2023-07-25T14:36:56.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.039+0000 7f92bcf14b80 10 client.5520 resolve_mds: resolved name 'a' to daemon mds.a 2023-07-25T14:36:56.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.039+0000 7f92bcf14b80 20 client.5520 populate_metadata read hostname 'smithi072' 2023-07-25T14:36:56.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.039+0000 7f92bcf14b80 1 --2- 172.21.15.72:0/2034119759 >> [v2:172.21.15.72:6835/1193027887,v1:172.21.15.72:6837/1193027887] conn(0x5644429fdeb0 0x5644429fe290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:56.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.039+0000 7f92bcf14b80 4 client.5520 mds_command: new command op to 5331 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-25T14:36:56.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.039+0000 7f92bcf14b80 1 -- 172.21.15.72:0/2034119759 --> [v2:172.21.15.72:6835/1193027887,v1:172.21.15.72:6837/1193027887] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56444293ed40 con 0x5644429fdeb0 2023-07-25T14:36:56.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.040+0000 7f92aa59c700 1 --2- 172.21.15.72:0/2034119759 >> [v2:172.21.15.72:6835/1193027887,v1:172.21.15.72:6837/1193027887] conn(0x5644429fdeb0 0x5644429fe290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:56.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.040+0000 7f92897fa700 10 client.5520 ms_handle_connect on v2:172.21.15.72:6835/1193027887 2023-07-25T14:36:56.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.040+0000 7f92aa59c700 1 --2- 172.21.15.72:0/2034119759 >> [v2:172.21.15.72:6835/1193027887,v1:172.21.15.72:6837/1193027887] conn(0x5644429fdeb0 0x5644429fe290 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=db46d74ca2aa14ac server_cookie=a1d9be7d356dba57 in_seq=0 out_seq=0 2023-07-25T14:36:56.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.040+0000 7f92897fa700 1 -- 172.21.15.72:0/2034119759 <== mds.0 v2:172.21.15.72:6835/1193027887 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x56444293ed40 con 0x5644429fdeb0 2023-07-25T14:36:56.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.040+0000 7f92897fa700 10 client.5520 handle_command_reply: tid=0 2023-07-25T14:36:56.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.040+0000 7f92bcf14b80 1 client.5520 shutdown 2023-07-25T14:36:56.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.041+0000 7f92bcf14b80 1 -- 172.21.15.72:0/2034119759 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5644429c4c90 msgr2=0x5644429ff260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:56.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.041+0000 7f92bcf14b80 1 --2- 172.21.15.72:0/2034119759 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5644429c4c90 0x5644429ff260 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f92a400b370 tx=0x7f92a4059540 comp rx=0 tx=0).stop 2023-07-25T14:36:56.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.041+0000 7f92bcf14b80 1 -- 172.21.15.72:0/2034119759 shutdown_connections 2023-07-25T14:36:56.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.041+0000 7f92bcf14b80 1 --2- 172.21.15.72:0/2034119759 >> [v2:172.21.15.72:6835/1193027887,v1:172.21.15.72:6837/1193027887] conn(0x5644429fdeb0 0x5644429fe290 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:56.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.041+0000 7f92bcf14b80 1 --2- 172.21.15.72:0/2034119759 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x5644429bec40 0x564442a02770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:56.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.041+0000 7f92bcf14b80 1 --2- 172.21.15.72:0/2034119759 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5644429c4c90 0x5644429ff260 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:56.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.041+0000 7f92bcf14b80 1 --2- 172.21.15.72:0/2034119759 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5644429c3910 0x5644429fed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:56.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.041+0000 7f92897fa700 0 client.5520 ms_handle_reset on v2:172.21.15.72:6835/1193027887 2023-07-25T14:36:56.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.041+0000 7f92bcf14b80 1 -- 172.21.15.72:0/2034119759 >> 172.21.15.72:0/2034119759 conn(0x564442920c80 msgr2=0x5644429be130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:56.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.041+0000 7f92bcf14b80 1 -- 172.21.15.72:0/2034119759 shutdown_connections 2023-07-25T14:36:56.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.041+0000 7f92bcf14b80 1 -- 172.21.15.72:0/2034119759 wait complete. 2023-07-25T14:36:56.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.041+0000 7f92bcf14b80 20 client.5520 trim_cache size 0 max 16384 2023-07-25T14:36:56.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.058+0000 7f92bcf14b80 1 Processor -- start 2023-07-25T14:36:56.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.058+0000 7f92bcf14b80 1 -- start start 2023-07-25T14:36:56.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.059+0000 7f92bcf14b80 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x5644429bec40 0x5644429fec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:56.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.059+0000 7f92bcf14b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5644429c3910 0x564442a00d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:56.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.059+0000 7f92bcf14b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5644429c4c90 0x564442a012c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:56.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.059+0000 7f92bcf14b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x5644427978d0 con 0x5644429c3910 2023-07-25T14:36:56.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.059+0000 7f92bcf14b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x5644429df450 con 0x5644429c4c90 2023-07-25T14:36:56.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.059+0000 7f92bcf14b80 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x5644429de7c0 con 0x5644429bec40 2023-07-25T14:36:56.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.059+0000 7f92a9d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5644429c3910 0x564442a00d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:56.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.059+0000 7f92a9d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5644429c3910 0x564442a00d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42122/0 (socket says 172.21.15.72:42122) 2023-07-25T14:36:56.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.059+0000 7f92a9d9b700 1 -- 172.21.15.72:0/2323642688 learned_addr learned my addr 172.21.15.72:0/2323642688 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:56.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.060+0000 7f92aa59c700 1 --2- 172.21.15.72:0/2323642688 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x5644429bec40 0x5644429fec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:56.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.060+0000 7f92aad9d700 1 --2- 172.21.15.72:0/2323642688 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5644429c4c90 0x564442a012c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:56.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.060+0000 7f92a9d9b700 1 -- 172.21.15.72:0/2323642688 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x5644429bec40 msgr2=0x5644429fec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:56.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.060+0000 7f92a9d9b700 1 --2- 172.21.15.72:0/2323642688 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x5644429bec40 0x5644429fec60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:56.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.060+0000 7f92a9d9b700 1 -- 172.21.15.72:0/2323642688 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5644429c4c90 msgr2=0x564442a012c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:56.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.060+0000 7f92a9d9b700 1 --2- 172.21.15.72:0/2323642688 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5644429c4c90 0x564442a012c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:56.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.060+0000 7f92a9d9b700 1 -- 172.21.15.72:0/2323642688 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56444272ac10 con 0x5644429c3910 2023-07-25T14:36:56.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.060+0000 7f92a9d9b700 1 --2- 172.21.15.72:0/2323642688 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5644429c3910 0x564442a00d80 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f929c000f60 tx=0x7f929c007de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1f91be54b4af287 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:56.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.060+0000 7f9298ff9700 1 -- 172.21.15.72:0/2323642688 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f929c001640 con 0x5644429c3910 2023-07-25T14:36:56.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.060+0000 7f9298ff9700 1 -- 172.21.15.72:0/2323642688 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f929c0017a0 con 0x5644429c3910 2023-07-25T14:36:56.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.060+0000 7f9298ff9700 1 -- 172.21.15.72:0/2323642688 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f929c001b30 con 0x5644429c3910 2023-07-25T14:36:56.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.060+0000 7f92bcf14b80 1 -- 172.21.15.72:0/2323642688 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5644429c3910 msgr2=0x564442a00d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:56.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.060+0000 7f92bcf14b80 1 --2- 172.21.15.72:0/2323642688 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5644429c3910 0x564442a00d80 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f929c000f60 tx=0x7f929c007de0 comp rx=0 tx=0).stop 2023-07-25T14:36:56.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.060+0000 7f92bcf14b80 1 -- 172.21.15.72:0/2323642688 shutdown_connections 2023-07-25T14:36:56.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.060+0000 7f92bcf14b80 1 --2- 172.21.15.72:0/2323642688 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x5644429bec40 0x5644429fec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:56.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.060+0000 7f92bcf14b80 1 --2- 172.21.15.72:0/2323642688 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5644429c4c90 0x564442a012c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:56.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.060+0000 7f92bcf14b80 1 --2- 172.21.15.72:0/2323642688 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5644429c3910 0x564442a00d80 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:56.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.060+0000 7f92bcf14b80 1 -- 172.21.15.72:0/2323642688 >> 172.21.15.72:0/2323642688 conn(0x564442920c80 msgr2=0x5644429fe290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:56.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.061+0000 7f92bcf14b80 1 -- 172.21.15.72:0/2323642688 shutdown_connections 2023-07-25T14:36:56.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.061+0000 7f92bcf14b80 1 -- 172.21.15.72:0/2323642688 wait complete. 2023-07-25T14:36:56.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.061+0000 7f92bcf14b80 1 -- start start 2023-07-25T14:36:56.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.061+0000 7f92bcf14b80 1 Processor -- start 2023-07-25T14:36:56.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.062+0000 7f92bcf14b80 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x5644429bec40 0x564442a699e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:56.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.062+0000 7f92bcf14b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5644429c3910 0x5644429c1f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:56.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.062+0000 7f92bcf14b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5644429c4c90 0x564442a63700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:56.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.062+0000 7f92bcf14b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x564442a1fd40 con 0x5644429c4c90 2023-07-25T14:36:56.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.062+0000 7f92bcf14b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x564442a02d90 con 0x5644429c3910 2023-07-25T14:36:56.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.062+0000 7f92bcf14b80 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x5644429bdaf0 con 0x5644429bec40 2023-07-25T14:36:56.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.062+0000 7f92bcf14b80 10 client.0 _ll_register_callbacks cb 0x5644428b1630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-25T14:36:56.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.062+0000 7f92aad9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5644429c4c90 0x564442a63700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:56.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.062+0000 7f92aad9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5644429c4c90 0x564442a63700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42132/0 (socket says 172.21.15.72:42132) 2023-07-25T14:36:56.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.062+0000 7f92aad9d700 1 -- 172.21.15.72:0/759991378 learned_addr learned my addr 172.21.15.72:0/759991378 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:56.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.062+0000 7f92a9d9b700 1 --2- 172.21.15.72:0/759991378 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5644429c3910 0x5644429c1f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:56.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.062+0000 7f92aa59c700 1 --2- 172.21.15.72:0/759991378 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x5644429bec40 0x564442a699e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:56.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.062+0000 7f92aad9d700 1 -- 172.21.15.72:0/759991378 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x5644429bec40 msgr2=0x564442a699e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:56.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.062+0000 7f92aad9d700 1 --2- 172.21.15.72:0/759991378 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x5644429bec40 0x564442a699e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:56.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.062+0000 7f92aad9d700 1 -- 172.21.15.72:0/759991378 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5644429c3910 msgr2=0x5644429c1f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:56.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.062+0000 7f92aad9d700 1 --2- 172.21.15.72:0/759991378 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5644429c3910 0x5644429c1f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:56.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.062+0000 7f92aad9d700 1 -- 172.21.15.72:0/759991378 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f929c004b90 con 0x5644429c4c90 2023-07-25T14:36:56.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.062+0000 7f92aad9d700 1 --2- 172.21.15.72:0/759991378 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5644429c4c90 0x564442a63700 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f92a40128b0 tx=0x7f92a40892a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e321a1e3ddb4412 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:56.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.062+0000 7f92897fa700 10 client.0 ms_handle_connect on v2:172.21.15.72:3300/0 2023-07-25T14:36:56.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.063+0000 7f92897fa700 1 -- 172.21.15.72:0/759991378 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92a407c070 con 0x5644429c4c90 2023-07-25T14:36:56.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.063+0000 7f92897fa700 1 -- 172.21.15.72:0/759991378 <== mon.0 v2:172.21.15.72:3300/0 2 ==== osd_map(39..39 src has 1..39) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f92a4076080 con 0x5644429c4c90 2023-07-25T14:36:56.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.063+0000 7f92bcf14b80 1 -- 172.21.15.72:0/759991378 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5644429b5fe0 con 0x5644429c4c90 2023-07-25T14:36:56.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.063+0000 7f92897fa700 1 -- 172.21.15.72:0/759991378 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f92a40598b0 con 0x5644429c4c90 2023-07-25T14:36:56.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.063+0000 7f92bcf14b80 10 client.5526 fetch_fsmap learned FSMap version 17 2023-07-25T14:36:56.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.063+0000 7f92bcf14b80 1 -- 172.21.15.72:0/759991378 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x564442768200 con 0x5644429c4c90 2023-07-25T14:36:56.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.063+0000 7f92897fa700 1 -- 172.21.15.72:0/759991378 <== mon.0 v2:172.21.15.72:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5644429b5fe0 con 0x5644429c4c90 2023-07-25T14:36:56.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.063+0000 7f92897fa700 1 -- 172.21.15.72:0/759991378 <== mon.0 v2:172.21.15.72:3300/0 5 ==== fsmap(e 17) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f92a4071180 con 0x5644429c4c90 2023-07-25T14:36:56.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.063+0000 7f92bcf14b80 10 client.5526 fetch_fsmap finished waiting for FSMap version 17 2023-07-25T14:36:56.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.063+0000 7f92bcf14b80 10 client.5526 resolve_mds: resolved name 'a' to daemon mds.a 2023-07-25T14:36:56.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.063+0000 7f92bcf14b80 20 client.5526 populate_metadata read hostname 'smithi072' 2023-07-25T14:36:56.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.063+0000 7f92bcf14b80 1 --2- 172.21.15.72:0/759991378 >> [v2:172.21.15.72:6835/1193027887,v1:172.21.15.72:6837/1193027887] conn(0x564442a1e8f0 0x564442a63c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:56.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.063+0000 7f92bcf14b80 4 client.5526 mds_command: new command op to 5331 tid=0[{"prefix": "status"}] 2023-07-25T14:36:56.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.063+0000 7f92bcf14b80 1 -- 172.21.15.72:0/759991378 --> [v2:172.21.15.72:6835/1193027887,v1:172.21.15.72:6837/1193027887] -- command(tid 0: {"prefix": "status"}) v1 -- 0x56444290d730 con 0x564442a1e8f0 2023-07-25T14:36:56.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.063+0000 7f92aa59c700 1 --2- 172.21.15.72:0/759991378 >> [v2:172.21.15.72:6835/1193027887,v1:172.21.15.72:6837/1193027887] conn(0x564442a1e8f0 0x564442a63c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:56.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.063+0000 7f92897fa700 10 client.5526 ms_handle_connect on v2:172.21.15.72:6835/1193027887 2023-07-25T14:36:56.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.063+0000 7f92aa59c700 1 --2- 172.21.15.72:0/759991378 >> [v2:172.21.15.72:6835/1193027887,v1:172.21.15.72:6837/1193027887] conn(0x564442a1e8f0 0x564442a63c40 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3169c383679f847f server_cookie=4613b615d7e0f131 in_seq=0 out_seq=0 2023-07-25T14:36:56.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.064+0000 7f92897fa700 1 -- 172.21.15.72:0/759991378 <== mds.0 v2:172.21.15.72:6835/1193027887 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x56444290d730 con 0x564442a1e8f0 2023-07-25T14:36:56.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.064+0000 7f92897fa700 10 client.5526 handle_command_reply: tid=0 2023-07-25T14:36:56.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.064+0000 7f92bcf14b80 1 client.5526 shutdown 2023-07-25T14:36:56.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.064+0000 7f92bcf14b80 1 -- 172.21.15.72:0/759991378 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5644429c4c90 msgr2=0x564442a63700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:56.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.064+0000 7f92bcf14b80 1 --2- 172.21.15.72:0/759991378 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5644429c4c90 0x564442a63700 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f92a40128b0 tx=0x7f92a40892a0 comp rx=0 tx=0).stop 2023-07-25T14:36:56.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.064+0000 7f92bcf14b80 1 -- 172.21.15.72:0/759991378 shutdown_connections 2023-07-25T14:36:56.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.064+0000 7f92bcf14b80 1 --2- 172.21.15.72:0/759991378 >> [v2:172.21.15.72:6835/1193027887,v1:172.21.15.72:6837/1193027887] conn(0x564442a1e8f0 0x564442a63c40 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:56.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.064+0000 7f92bcf14b80 1 --2- 172.21.15.72:0/759991378 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x5644429bec40 0x564442a699e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:56.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.064+0000 7f92bcf14b80 1 --2- 172.21.15.72:0/759991378 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x5644429c4c90 0x564442a63700 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:56.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.064+0000 7f92bcf14b80 1 --2- 172.21.15.72:0/759991378 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5644429c3910 0x5644429c1f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:56.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.064+0000 7f92897fa700 0 client.5526 ms_handle_reset on v2:172.21.15.72:6835/1193027887 2023-07-25T14:36:56.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.064+0000 7f92bcf14b80 1 -- 172.21.15.72:0/759991378 >> 172.21.15.72:0/759991378 conn(0x564442920c80 msgr2=0x5644429c2fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:56.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.064+0000 7f92bcf14b80 1 -- 172.21.15.72:0/759991378 shutdown_connections 2023-07-25T14:36:56.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.064+0000 7f92bcf14b80 1 -- 172.21.15.72:0/759991378 wait complete. 2023-07-25T14:36:56.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.064+0000 7f92bcf14b80 20 client.5526 trim_cache size 0 max 16384 2023-07-25T14:36:56.088 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-07-25T14:36:56.089 INFO:teuthology.orchestra.run.smithi072.stdout: "cluster_fsid": "9170db48-9170-43e8-8ccb-9813e6240906", 2023-07-25T14:36:56.089 INFO:teuthology.orchestra.run.smithi072.stdout: "whoami": 0, 2023-07-25T14:36:56.089 INFO:teuthology.orchestra.run.smithi072.stdout: "id": 5331, 2023-07-25T14:36:56.089 INFO:teuthology.orchestra.run.smithi072.stdout: "want_state": "up:active", 2023-07-25T14:36:56.090 INFO:teuthology.orchestra.run.smithi072.stdout: "state": "up:active", 2023-07-25T14:36:56.090 INFO:teuthology.orchestra.run.smithi072.stdout: "fs_name": "cephfs", 2023-07-25T14:36:56.090 INFO:teuthology.orchestra.run.smithi072.stdout: "rank_uptime": 5.8708611350000002, 2023-07-25T14:36:56.091 INFO:teuthology.orchestra.run.smithi072.stdout: "mdsmap_epoch": 17, 2023-07-25T14:36:56.091 INFO:teuthology.orchestra.run.smithi072.stdout: "osdmap_epoch": 39, 2023-07-25T14:36:56.091 INFO:teuthology.orchestra.run.smithi072.stdout: "osdmap_epoch_barrier": 39, 2023-07-25T14:36:56.091 INFO:teuthology.orchestra.run.smithi072.stdout: "uptime": 13.874093322 2023-07-25T14:36:56.092 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-07-25T14:36:56.093 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.064+0000 7f92b0d7c700 1 -- 172.21.15.72:0/1443013169 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f928c06ace0 msgr2=0x7f928c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:56.094 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.064+0000 7f92b0d7c700 1 --2- 172.21.15.72:0/1443013169 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f928c06ace0 0x7f928c06d1a0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f92a0009b20 tx=0x7f92a00091c0 comp rx=0 tx=0).stop 2023-07-25T14:36:56.094 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.064+0000 7f92b0d7c700 1 -- 172.21.15.72:0/1443013169 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f92ac151980 msgr2=0x7f92ac0bfb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:56.094 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.064+0000 7f92b0d7c700 1 --2- 172.21.15.72:0/1443013169 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f92ac151980 0x7f92ac0bfb30 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f92a400b680 tx=0x7f92a4004ad0 comp rx=0 tx=0).stop 2023-07-25T14:36:56.094 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.064+0000 7f92b0d7c700 1 -- 172.21.15.72:0/1443013169 shutdown_connections 2023-07-25T14:36:56.095 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.064+0000 7f92b0d7c700 1 --2- 172.21.15.72:0/1443013169 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f928c06ace0 0x7f928c06d1a0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:56.095 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.064+0000 7f92b0d7c700 1 --2- 172.21.15.72:0/1443013169 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f92ac06e580 0x7f92ac1ea4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:56.095 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.064+0000 7f92b0d7c700 1 --2- 172.21.15.72:0/1443013169 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f92ac151980 0x7f92ac0bfb30 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:56.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.064+0000 7f92b0d7c700 1 --2- 172.21.15.72:0/1443013169 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f92ac0c17f0 0x7f92ac1546a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:56.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.064+0000 7f92b0d7c700 1 -- 172.21.15.72:0/1443013169 >> 172.21.15.72:0/1443013169 conn(0x7f92ac0a8520 msgr2=0x7f92ac06a190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:56.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.065+0000 7f92b0d7c700 1 -- 172.21.15.72:0/1443013169 shutdown_connections 2023-07-25T14:36:56.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.065+0000 7f92b0d7c700 1 -- 172.21.15.72:0/1443013169 wait complete. 2023-07-25T14:36:56.097 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-25T14:36:56.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.206+0000 7ffab2089700 1 Processor -- start 2023-07-25T14:36:56.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.206+0000 7ffab2089700 1 -- start start 2023-07-25T14:36:56.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.207+0000 7ffab2089700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ffaac151950 0x7ffaac06a190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:56.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.207+0000 7ffab2089700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ffaac0724c0 0x7ffaac0c34c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:56.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.207+0000 7ffab2089700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffaac0c2fe0 con 0x7ffaac06a6d0 2023-07-25T14:36:56.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.207+0000 7ffab2089700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffaac071a60 con 0x7ffaac0724c0 2023-07-25T14:36:56.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.207+0000 7ffab2089700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffaac0c2a70 con 0x7ffaac151950 2023-07-25T14:36:56.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.207+0000 7ffaaaffd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ffaac0724c0 0x7ffaac0c34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:56.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.207+0000 7ffaaaffd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ffaac0724c0 0x7ffaac0c34c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42138/0 (socket says 172.21.15.72:42138) 2023-07-25T14:36:56.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.207+0000 7ffaaaffd700 1 -- 172.21.15.72:0/4056487069 learned_addr learned my addr 172.21.15.72:0/4056487069 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:56.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.207+0000 7ffaab7fe700 1 --2- 172.21.15.72:0/4056487069 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ffaac151950 0x7ffaac06a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:56.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.207+0000 7ffaaaffd700 1 -- 172.21.15.72:0/4056487069 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ffaac151950 msgr2=0x7ffaac06a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:56.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.207+0000 7ffaaaffd700 1 --2- 172.21.15.72:0/4056487069 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ffaac151950 0x7ffaac06a190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:56.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.207+0000 7ffaaaffd700 1 -- 172.21.15.72:0/4056487069 >> v1:172.21.15.92:6789/0 conn(0x7ffaac06a6d0 legacy=0x7ffaac0c3a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:56.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.208+0000 7ffaaaffd700 1 -- 172.21.15.72:0/4056487069 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaac155070 con 0x7ffaac0724c0 2023-07-25T14:36:56.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.208+0000 7ffaaaffd700 1 --2- 172.21.15.72:0/4056487069 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffaac0724c0 0x7ffaac0c34c0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7ffa9c0098f0 tx=0x7ffa9c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43ba8fb40b78f8c server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:56.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.208+0000 7ffaaa7fc700 1 -- 172.21.15.72:0/4056487069 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa9c00b8a0 con 0x7ffaac0724c0 2023-07-25T14:36:56.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.208+0000 7ffaaa7fc700 1 -- 172.21.15.72:0/4056487069 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa9c00ba00 con 0x7ffaac0724c0 2023-07-25T14:36:56.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.208+0000 7ffaaa7fc700 1 -- 172.21.15.72:0/4056487069 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa9c00bd90 con 0x7ffaac0724c0 2023-07-25T14:36:56.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.208+0000 7ffab2089700 1 -- 172.21.15.72:0/4056487069 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffaac0724c0 msgr2=0x7ffaac0c34c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:56.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.208+0000 7ffab2089700 1 --2- 172.21.15.72:0/4056487069 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffaac0724c0 0x7ffaac0c34c0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7ffa9c0098f0 tx=0x7ffa9c009c00 comp rx=0 tx=0).stop 2023-07-25T14:36:56.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.208+0000 7ffab2089700 1 -- 172.21.15.72:0/4056487069 shutdown_connections 2023-07-25T14:36:56.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.208+0000 7ffab2089700 1 --2- 172.21.15.72:0/4056487069 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ffaac151950 0x7ffaac06a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:56.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.208+0000 7ffab2089700 1 --2- 172.21.15.72:0/4056487069 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffaac0724c0 0x7ffaac0c34c0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:56.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.208+0000 7ffab2089700 1 -- 172.21.15.72:0/4056487069 >> 172.21.15.72:0/4056487069 conn(0x7ffaac0a87e0 msgr2=0x7ffaac0a8bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:56.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.208+0000 7ffab2089700 1 -- 172.21.15.72:0/4056487069 shutdown_connections 2023-07-25T14:36:56.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.208+0000 7ffab2089700 1 -- 172.21.15.72:0/4056487069 wait complete. 2023-07-25T14:36:56.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.209+0000 7ffab2089700 1 Processor -- start 2023-07-25T14:36:56.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.210+0000 7ffab2089700 1 -- start start 2023-07-25T14:36:56.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.210+0000 7ffab2089700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ffaac06a6d0 0x7ffaac06f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:56.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.210+0000 7ffab2089700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffaac0724c0 0x7ffaac1eb280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:56.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.210+0000 7ffab2089700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffaac151950 0x7ffaac1eb7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:56.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.210+0000 7ffab2089700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaac1edcd0 con 0x7ffaac0724c0 2023-07-25T14:36:56.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.210+0000 7ffab2089700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaac0aba00 con 0x7ffaac151950 2023-07-25T14:36:56.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.210+0000 7ffab2089700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffaac153540 con 0x7ffaac06a6d0 2023-07-25T14:36:56.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.210+0000 7ffaaaffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffaac0724c0 0x7ffaac1eb280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:56.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.210+0000 7ffaaaffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffaac0724c0 0x7ffaac1eb280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42144/0 (socket says 172.21.15.72:42144) 2023-07-25T14:36:56.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.210+0000 7ffaaaffd700 1 -- 172.21.15.72:0/2053231918 learned_addr learned my addr 172.21.15.72:0/2053231918 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:56.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.211+0000 7ffaab7fe700 1 --2- 172.21.15.72:0/2053231918 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ffaac06a6d0 0x7ffaac06f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:56.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.211+0000 7ffaabfff700 1 --2- 172.21.15.72:0/2053231918 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffaac151950 0x7ffaac1eb7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:56.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.211+0000 7ffaaaffd700 1 -- 172.21.15.72:0/2053231918 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ffaac06a6d0 msgr2=0x7ffaac06f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:56.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.211+0000 7ffaaaffd700 1 --2- 172.21.15.72:0/2053231918 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ffaac06a6d0 0x7ffaac06f1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:56.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.211+0000 7ffaaaffd700 1 -- 172.21.15.72:0/2053231918 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffaac151950 msgr2=0x7ffaac1eb7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:56.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.211+0000 7ffaaaffd700 1 --2- 172.21.15.72:0/2053231918 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffaac151950 0x7ffaac1eb7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:56.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.211+0000 7ffaaaffd700 1 -- 172.21.15.72:0/2053231918 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa9c009550 con 0x7ffaac0724c0 2023-07-25T14:36:56.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.211+0000 7ffaaaffd700 1 --2- 172.21.15.72:0/2053231918 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffaac0724c0 0x7ffaac1eb280 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7ffa9c000c00 tx=0x7ffa9c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:56.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.211+0000 7ffa93fff700 1 -- 172.21.15.72:0/2053231918 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa9c004300 con 0x7ffaac0724c0 2023-07-25T14:36:56.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.211+0000 7ffa93fff700 1 -- 172.21.15.72:0/2053231918 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa9c01f070 con 0x7ffaac0724c0 2023-07-25T14:36:56.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.211+0000 7ffab2089700 1 -- 172.21.15.72:0/2053231918 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffaac153820 con 0x7ffaac0724c0 2023-07-25T14:36:56.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.211+0000 7ffa93fff700 1 -- 172.21.15.72:0/2053231918 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa9c0036a0 con 0x7ffaac0724c0 2023-07-25T14:36:56.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.211+0000 7ffab2089700 1 -- 172.21.15.72:0/2053231918 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffaac1ead60 con 0x7ffaac0724c0 2023-07-25T14:36:56.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.212+0000 7ffab2089700 1 -- 172.21.15.72:0/2053231918 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffaac155450 con 0x7ffaac0724c0 2023-07-25T14:36:56.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.212+0000 7ffa93fff700 1 -- 172.21.15.72:0/2053231918 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ffa9c021030 con 0x7ffaac0724c0 2023-07-25T14:36:56.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.213+0000 7ffa93fff700 1 --2- 172.21.15.72:0/2053231918 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7ffa9806ace0 0x7ffa9806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:56.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.213+0000 7ffa93fff700 1 -- 172.21.15.72:0/2053231918 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6382+0+0 (secure 0 0 0) 0x7ffa9c08a8a0 con 0x7ffaac0724c0 2023-07-25T14:36:56.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.213+0000 7ffaab7fe700 1 --2- 172.21.15.72:0/2053231918 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7ffa9806ace0 0x7ffa9806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:56.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.213+0000 7ffaab7fe700 1 --2- 172.21.15.72:0/2053231918 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7ffa9806ace0 0x7ffa9806d1a0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7ffaac1532d0 tx=0x7ffaa0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:56.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.217+0000 7ffa93fff700 1 -- 172.21.15.72:0/2053231918 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7ffa9c0559c0 con 0x7ffaac0724c0 2023-07-25T14:36:56.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.446+0000 7ffab2089700 1 -- 172.21.15.72:0/2053231918 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7ffaac14ffb0 con 0x7ffaac0724c0 2023-07-25T14:36:56.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.447+0000 7ffa93fff700 1 -- 172.21.15.72:0/2053231918 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) v1 ==== 53+0+73 (secure 0 0 0) 0x7ffa9c015060 con 0x7ffaac0724c0 2023-07-25T14:36:56.459 INFO:teuthology.orchestra.run.smithi072.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-25T14:36:56.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.449+0000 7ffab2089700 1 -- 172.21.15.72:0/2053231918 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7ffa9806ace0 msgr2=0x7ffa9806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:56.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.449+0000 7ffab2089700 1 --2- 172.21.15.72:0/2053231918 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7ffa9806ace0 0x7ffa9806d1a0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7ffaac1532d0 tx=0x7ffaa0008040 comp rx=0 tx=0).stop 2023-07-25T14:36:56.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.449+0000 7ffab2089700 1 -- 172.21.15.72:0/2053231918 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffaac0724c0 msgr2=0x7ffaac1eb280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:56.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.449+0000 7ffab2089700 1 --2- 172.21.15.72:0/2053231918 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffaac0724c0 0x7ffaac1eb280 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7ffa9c000c00 tx=0x7ffa9c004750 comp rx=0 tx=0).stop 2023-07-25T14:36:56.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.449+0000 7ffab2089700 1 -- 172.21.15.72:0/2053231918 shutdown_connections 2023-07-25T14:36:56.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.449+0000 7ffab2089700 1 --2- 172.21.15.72:0/2053231918 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7ffa9806ace0 0x7ffa9806d1a0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:56.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.449+0000 7ffab2089700 1 --2- 172.21.15.72:0/2053231918 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ffaac06a6d0 0x7ffaac06f1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:56.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.449+0000 7ffab2089700 1 --2- 172.21.15.72:0/2053231918 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffaac151950 0x7ffaac1eb7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:56.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.449+0000 7ffab2089700 1 --2- 172.21.15.72:0/2053231918 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ffaac0724c0 0x7ffaac1eb280 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:56.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.449+0000 7ffab2089700 1 -- 172.21.15.72:0/2053231918 >> 172.21.15.72:0/2053231918 conn(0x7ffaac0a87e0 msgr2=0x7ffaac1503a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:56.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.449+0000 7ffab2089700 1 -- 172.21.15.72:0/2053231918 shutdown_connections 2023-07-25T14:36:56.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:56.449+0000 7ffab2089700 1 -- 172.21.15.72:0/2053231918 wait complete. 2023-07-25T14:36:56.472 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-07-25T14:36:56.473 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-25T14:36:56.473 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi072.front.sepia.ceph.com 2023-07-25T14:36:56.473 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-07-25T14:36:56.473 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-07-25T14:36:56.474 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-07-25T14:36:56.474 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-07-25T14:36:56.474 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-25T14:36:56.474 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-25T14:36:56.475 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-25T14:36:56.475 DEBUG:teuthology.orchestra.run.smithi072:> ip addr 2023-07-25T14:36:56.493 INFO:teuthology.orchestra.run.smithi072.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-25T14:36:56.493 INFO:teuthology.orchestra.run.smithi072.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-25T14:36:56.494 INFO:teuthology.orchestra.run.smithi072.stdout: inet 127.0.0.1/8 scope host lo 2023-07-25T14:36:56.494 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-07-25T14:36:56.494 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 ::1/128 scope host 2023-07-25T14:36:56.494 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-07-25T14:36:56.495 INFO:teuthology.orchestra.run.smithi072.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-25T14:36:56.495 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:d8:da:f4 brd ff:ff:ff:ff:ff:ff 2023-07-25T14:36:56.495 INFO:teuthology.orchestra.run.smithi072.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-25T14:36:56.495 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:d8:da:f5 brd ff:ff:ff:ff:ff:ff 2023-07-25T14:36:56.496 INFO:teuthology.orchestra.run.smithi072.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-25T14:36:56.496 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:8f:b7:64 brd ff:ff:ff:ff:ff:ff 2023-07-25T14:36:56.496 INFO:teuthology.orchestra.run.smithi072.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-25T14:36:56.497 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:8f:b7:65 brd ff:ff:ff:ff:ff:ff 2023-07-25T14:36:56.497 INFO:teuthology.orchestra.run.smithi072.stdout: inet 172.21.15.72/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-07-25T14:36:56.497 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft 42221sec preferred_lft 42221sec 2023-07-25T14:36:56.497 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 fe80::3ce1:9f7:ed06:b425/64 scope link noprefixroute 2023-07-25T14:36:56.498 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-07-25T14:36:56.498 INFO:teuthology.orchestra.run.smithi072.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-25T14:36:56.498 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 16:a9:d8:9c:48:e3 brd ff:ff:ff:ff:ff:ff 2023-07-25T14:36:56.499 INFO:teuthology.orchestra.run.smithi072.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-25T14:36:56.499 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-07-25T14:36:56.499 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 fe80::3892:87ff:fee8:8d42/64 scope link 2023-07-25T14:36:56.499 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-07-25T14:36:56.499 INFO:teuthology.orchestra.run.smithi072.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-25T14:36:56.499 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 16:a9:d8:9c:48:e3 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-07-25T14:36:56.499 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 fe80::14a9:d8ff:fe9c:48e3/64 scope link 2023-07-25T14:36:56.500 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-07-25T14:36:56.500 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-25T14:36:56.500 DEBUG:teuthology.orchestra.run.smithi072:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-25T14:36:56.558 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-07-25T14:36:56.559 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-25T14:36:56.560 DEBUG:teuthology.orchestra.run.smithi072:> route 2023-07-25T14:36:56.618 INFO:teuthology.orchestra.run.smithi072.stdout:Kernel IP routing table 2023-07-25T14:36:56.619 INFO:teuthology.orchestra.run.smithi072.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-25T14:36:56.619 INFO:teuthology.orchestra.run.smithi072.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-07-25T14:36:56.619 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-07-25T14:36:56.619 INFO:teuthology.orchestra.run.smithi072.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-25T14:36:56.620 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-25T14:36:56.620 DEBUG:teuthology.orchestra.run.smithi072:> (cd / && exec bash -c ' 2023-07-25T14:36:56.620 DEBUG:teuthology.orchestra.run.smithi072:> set -e 2023-07-25T14:36:56.621 DEBUG:teuthology.orchestra.run.smithi072:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-07-25T14:36:56.621 DEBUG:teuthology.orchestra.run.smithi072:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-07-25T14:36:56.621 DEBUG:teuthology.orchestra.run.smithi072:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-07-25T14:36:56.622 DEBUG:teuthology.orchestra.run.smithi072:> ') 2023-07-25T14:36:56.722 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-25T14:36:56.723 DEBUG:teuthology.orchestra.run.smithi072:> ip netns list 2023-07-25T14:36:56.739 INFO:teuthology.orchestra.run.smithi072.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-07-25T14:36:56.740 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-25T14:36:56.740 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-25T14:36:56.740 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip link set brx.0 up 2023-07-25T14:36:56.805 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-25T14:36:56.806 DEBUG:teuthology.orchestra.run.smithi072:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-07-25T14:36:56.861 INFO:teuthology.orchestra.run.smithi072.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-07-25T14:36:56.862 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-25T14:36:56.862 DEBUG:teuthology.orchestra.run.smithi072:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-07-25T14:36:56.918 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-07-25T14:36:56.918 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-25T14:36:56.919 DEBUG:teuthology.orchestra.run.smithi072:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-25T14:36:57.003 INFO:teuthology.orchestra.run.smithi072.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-25T14:36:57.003 INFO:teuthology.orchestra.run.smithi072.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-07-25T14:36:57.004 INFO:teuthology.orchestra.run.smithi072.stdout:invalid new device string format 2023-07-25T14:36:57.012 INFO:teuthology.orchestra.run.smithi072.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-25T14:36:57.012 INFO:teuthology.orchestra.run.smithi072.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-07-25T14:36:57.012 INFO:teuthology.orchestra.run.smithi072.stdout:invalid new device string format 2023-07-25T14:36:57.012 INFO:teuthology.orchestra.run.smithi072.stdout:mount.ceph: resolved to: "172.21.15.72:3300,172.21.15.92:3300,172.21.15.92:3301" 2023-07-25T14:36:57.013 INFO:teuthology.orchestra.run.smithi072.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-25T14:36:57.087 INFO:teuthology.orchestra.run.smithi072.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-25T14:36:57.087 INFO:teuthology.orchestra.run.smithi072.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-07-25T14:36:57.087 INFO:teuthology.orchestra.run.smithi072.stdout:invalid new device string format 2023-07-25T14:36:57.087 INFO:teuthology.orchestra.run.smithi072.stdout:mount.ceph: resolved to: "172.21.15.72:3300,172.21.15.92:3300,172.21.15.92:3301" 2023-07-25T14:36:57.088 INFO:teuthology.orchestra.run.smithi072.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-25T14:36:57.088 INFO:teuthology.orchestra.run.smithi072.stdout:mount.ceph: resolved to: "172.21.15.72:6789,172.21.15.92:6789,172.21.15.92:6790" 2023-07-25T14:36:57.088 INFO:teuthology.orchestra.run.smithi072.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.72:6789,172.21.15.92:6789,172.21.15.92:6790:/ 2023-07-25T14:36:57.088 INFO:teuthology.orchestra.run.smithi072.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=9170db48-9170-43e8-8ccb-9813e6240906" will pass to kernel 2023-07-25T14:36:57.089 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-25T14:36:57.090 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-25T14:36:57.090 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-07-25T14:36:57.116 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-25T14:36:57.117 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-25T14:36:57.197 INFO:teuthology.orchestra.run.smithi072.stdout:client5248 2023-07-25T14:36:57.198 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-07-25T14:36:57.198 DEBUG:teuthology.orchestra.run.smithi072:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-25T14:36:57.254 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-25T14:36:57.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:57.402+0000 7f22de013700 1 Processor -- start 2023-07-25T14:36:57.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:57.402+0000 7f22de013700 1 -- start start 2023-07-25T14:36:57.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:57.402+0000 7f22de013700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f22d80724c0 0x7f22d80c34c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:57.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:57.402+0000 7f22de013700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f22d80c4930 0x7f22d80c3a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:57.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:57.402+0000 7f22de013700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22d80c2fe0 con 0x7f22d8151950 2023-07-25T14:36:57.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:57.402+0000 7f22de013700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22d8071a60 con 0x7f22d80724c0 2023-07-25T14:36:57.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:57.403+0000 7f22de013700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22d80c2a70 con 0x7f22d80c4930 2023-07-25T14:36:57.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:57.403+0000 7f22d6ffd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f22d80724c0 0x7f22d80c34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:57.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:57.403+0000 7f22d6ffd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f22d80724c0 0x7f22d80c34c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42156/0 (socket says 172.21.15.72:42156) 2023-07-25T14:36:57.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:57.403+0000 7f22d77fe700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f22d8151950 0x7f22d806a190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:32890/0 (socket says 172.21.15.72:32890) 2023-07-25T14:36:57.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:57.403+0000 7f22d6ffd700 1 -- 172.21.15.72:0/1361535783 learned_addr learned my addr 172.21.15.72:0/1361535783 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:57.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:57.403+0000 7f22d7fff700 1 --2- 172.21.15.72:0/1361535783 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f22d80c4930 0x7f22d80c3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:57.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:57.403+0000 7f22d6ffd700 1 -- 172.21.15.72:0/1361535783 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f22d80c4930 msgr2=0x7f22d80c3a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:57.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:57.403+0000 7f22d6ffd700 1 --2- 172.21.15.72:0/1361535783 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f22d80c4930 0x7f22d80c3a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:57.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:57.403+0000 7f22d6ffd700 1 -- 172.21.15.72:0/1361535783 >> v1:172.21.15.72:6789/0 conn(0x7f22d8151950 legacy=0x7f22d806a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:57.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:57.403+0000 7f22d6ffd700 1 -- 172.21.15.72:0/1361535783 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22d8155070 con 0x7f22d80724c0 2023-07-25T14:36:57.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:57.403+0000 7f22d67fc700 1 -- 172.21.15.72:0/1361535783 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1420429670 0 0) 0x7f22d80c2fe0 con 0x7f22d8151950 2023-07-25T14:36:57.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:57.403+0000 7f22d6ffd700 1 --2- 172.21.15.72:0/1361535783 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f22d80724c0 0x7f22d80c34c0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f22cc0098f0 tx=0x7f22cc009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd58b1413e5ae2e9 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:57.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:57.403+0000 7f22d67fc700 1 -- 172.21.15.72:0/1361535783 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22cc00b8a0 con 0x7f22d80724c0 2023-07-25T14:36:57.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:57.403+0000 7f22d67fc700 1 -- 172.21.15.72:0/1361535783 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22cc00ba00 con 0x7f22d80724c0 2023-07-25T14:36:57.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:57.403+0000 7f22d67fc700 1 -- 172.21.15.72:0/1361535783 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22cc00bd90 con 0x7f22d80724c0 2023-07-25T14:36:57.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:57.404+0000 7f22de013700 1 -- 172.21.15.72:0/1361535783 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f22d80724c0 msgr2=0x7f22d80c34c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:57.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:57.404+0000 7f22de013700 1 --2- 172.21.15.72:0/1361535783 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f22d80724c0 0x7f22d80c34c0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f22cc0098f0 tx=0x7f22cc009c00 comp rx=0 tx=0).stop 2023-07-25T14:36:57.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:57.404+0000 7f22de013700 1 -- 172.21.15.72:0/1361535783 shutdown_connections 2023-07-25T14:36:57.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:57.404+0000 7f22de013700 1 --2- 172.21.15.72:0/1361535783 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f22d80c4930 0x7f22d80c3a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:57.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:57.404+0000 7f22de013700 1 --2- 172.21.15.72:0/1361535783 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f22d80724c0 0x7f22d80c34c0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:57.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:57.404+0000 7f22de013700 1 -- 172.21.15.72:0/1361535783 >> 172.21.15.72:0/1361535783 conn(0x7f22d80a87e0 msgr2=0x7f22d80a8bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:57.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:57.404+0000 7f22de013700 1 -- 172.21.15.72:0/1361535783 shutdown_connections 2023-07-25T14:36:57.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:57.404+0000 7f22de013700 1 -- 172.21.15.72:0/1361535783 wait complete. 2023-07-25T14:36:57.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:57.405+0000 7f22de013700 1 Processor -- start 2023-07-25T14:36:57.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:57.406+0000 7f22de013700 1 -- start start 2023-07-25T14:36:57.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:57.406+0000 7f22de013700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f22d80724c0 0x7f22d81e99b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:57.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:57.406+0000 7f22de013700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f22d80c4930 0x7f22d80abfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:57.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:57.406+0000 7f22de013700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f22d8151950 0x7f22d8156a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:57.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:57.406+0000 7f22de013700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22d80abb80 con 0x7f22d80724c0 2023-07-25T14:36:57.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:57.406+0000 7f22de013700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22d80be230 con 0x7f22d80c4930 2023-07-25T14:36:57.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:57.406+0000 7f22de013700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22d80aacb0 con 0x7f22d8151950 2023-07-25T14:36:57.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:57.406+0000 7f22d77fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f22d80724c0 0x7f22d81e99b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:57.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:57.407+0000 7f22d77fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f22d80724c0 0x7f22d81e99b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42160/0 (socket says 172.21.15.72:42160) 2023-07-25T14:36:57.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:57.407+0000 7f22d77fe700 1 -- 172.21.15.72:0/1036313761 learned_addr learned my addr 172.21.15.72:0/1036313761 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:57.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:57.407+0000 7f22d7fff700 1 --2- 172.21.15.72:0/1036313761 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f22d8151950 0x7f22d8156a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:57.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:57.407+0000 7f22d6ffd700 1 --2- 172.21.15.72:0/1036313761 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f22d80c4930 0x7f22d80abfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:57.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:57.407+0000 7f22d77fe700 1 -- 172.21.15.72:0/1036313761 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f22d8151950 msgr2=0x7f22d8156a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:57.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:57.407+0000 7f22d77fe700 1 --2- 172.21.15.72:0/1036313761 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f22d8151950 0x7f22d8156a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:57.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:57.407+0000 7f22d77fe700 1 -- 172.21.15.72:0/1036313761 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f22d80c4930 msgr2=0x7f22d80abfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:57.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:57.407+0000 7f22d77fe700 1 --2- 172.21.15.72:0/1036313761 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f22d80c4930 0x7f22d80abfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:57.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:57.407+0000 7f22d77fe700 1 -- 172.21.15.72:0/1036313761 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22cc009550 con 0x7f22d80724c0 2023-07-25T14:36:57.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:57.407+0000 7f22d7fff700 1 --2- 172.21.15.72:0/1036313761 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f22d8151950 0x7f22d8156a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-25T14:36:57.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:57.407+0000 7f22d77fe700 1 --2- 172.21.15.72:0/1036313761 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f22d80724c0 0x7f22d81e99b0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f22c800c580 tx=0x7f22c800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:57.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:57.407+0000 7f22bffff700 1 -- 172.21.15.72:0/1036313761 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22c8004c80 con 0x7f22d80724c0 2023-07-25T14:36:57.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:57.407+0000 7f22bffff700 1 -- 172.21.15.72:0/1036313761 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22c8004e00 con 0x7f22d80724c0 2023-07-25T14:36:57.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:57.407+0000 7f22de013700 1 -- 172.21.15.72:0/1036313761 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22d80ac4e0 con 0x7f22d80724c0 2023-07-25T14:36:57.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:57.407+0000 7f22bffff700 1 -- 172.21.15.72:0/1036313761 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22c8007310 con 0x7f22d80724c0 2023-07-25T14:36:57.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:57.407+0000 7f22de013700 1 -- 172.21.15.72:0/1036313761 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22d80aaf00 con 0x7f22d80724c0 2023-07-25T14:36:57.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:57.408+0000 7f22de013700 1 -- 172.21.15.72:0/1036313761 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22d80abdf0 con 0x7f22d80724c0 2023-07-25T14:36:57.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:57.408+0000 7f22bffff700 1 -- 172.21.15.72:0/1036313761 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f22c8007470 con 0x7f22d80724c0 2023-07-25T14:36:57.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:57.409+0000 7f22bffff700 1 --2- 172.21.15.72:0/1036313761 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f22c406ace0 0x7f22c406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:57.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:57.409+0000 7f22bffff700 1 -- 172.21.15.72:0/1036313761 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f22c8089290 con 0x7f22d80724c0 2023-07-25T14:36:57.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:57.409+0000 7f22d6ffd700 1 --2- 172.21.15.72:0/1036313761 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f22c406ace0 0x7f22c406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:57.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:57.409+0000 7f22d6ffd700 1 --2- 172.21.15.72:0/1036313761 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f22c406ace0 0x7f22c406d1a0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f22d80c5e60 tx=0x7f22cc008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:57.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:57.413+0000 7f22bffff700 1 -- 172.21.15.72:0/1036313761 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f22c8054290 con 0x7f22d80724c0 2023-07-25T14:36:57.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:57.646+0000 7f22de013700 1 -- 172.21.15.72:0/1036313761 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f22d804e470 con 0x7f22d80724c0 2023-07-25T14:36:57.658 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:57.646+0000 7f22bffff700 1 -- 172.21.15.72:0/1036313761 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) v1 ==== 53+0+73 (secure 0 0 0) 0x7f22c80578b0 con 0x7f22d80724c0 2023-07-25T14:36:57.659 INFO:teuthology.orchestra.run.smithi072.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-25T14:36:57.660 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:57.648+0000 7f22de013700 1 -- 172.21.15.72:0/1036313761 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f22c406ace0 msgr2=0x7f22c406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:57.660 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:57.648+0000 7f22de013700 1 --2- 172.21.15.72:0/1036313761 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f22c406ace0 0x7f22c406d1a0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f22d80c5e60 tx=0x7f22cc008030 comp rx=0 tx=0).stop 2023-07-25T14:36:57.660 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:57.648+0000 7f22de013700 1 -- 172.21.15.72:0/1036313761 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f22d80724c0 msgr2=0x7f22d81e99b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:57.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:57.648+0000 7f22de013700 1 --2- 172.21.15.72:0/1036313761 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f22d80724c0 0x7f22d81e99b0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f22c800c580 tx=0x7f22c800c940 comp rx=0 tx=0).stop 2023-07-25T14:36:57.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:57.649+0000 7f22de013700 1 -- 172.21.15.72:0/1036313761 shutdown_connections 2023-07-25T14:36:57.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:57.649+0000 7f22de013700 1 --2- 172.21.15.72:0/1036313761 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f22c406ace0 0x7f22c406d1a0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:57.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:57.649+0000 7f22de013700 1 --2- 172.21.15.72:0/1036313761 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f22d8151950 0x7f22d8156a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:57.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:57.649+0000 7f22de013700 1 --2- 172.21.15.72:0/1036313761 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f22d80724c0 0x7f22d81e99b0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:57.661 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:57.649+0000 7f22de013700 1 --2- 172.21.15.72:0/1036313761 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f22d80c4930 0x7f22d80abfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:57.662 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:57.649+0000 7f22de013700 1 -- 172.21.15.72:0/1036313761 >> 172.21.15.72:0/1036313761 conn(0x7f22d80a87e0 msgr2=0x7f22d806f930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:57.662 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:57.649+0000 7f22de013700 1 -- 172.21.15.72:0/1036313761 shutdown_connections 2023-07-25T14:36:57.662 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:57.649+0000 7f22de013700 1 -- 172.21.15.72:0/1036313761 wait complete. 2023-07-25T14:36:57.672 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-07-25T14:36:57.672 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-25T14:36:57.673 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi092.front.sepia.ceph.com 2023-07-25T14:36:57.673 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-07-25T14:36:57.673 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-07-25T14:36:57.674 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-07-25T14:36:57.674 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-07-25T14:36:57.674 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-25T14:36:57.674 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-07-25T14:36:57.675 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-25T14:36:57.676 DEBUG:teuthology.orchestra.run.smithi092:> ip addr 2023-07-25T14:36:57.697 INFO:teuthology.orchestra.run.smithi092.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-25T14:36:57.697 INFO:teuthology.orchestra.run.smithi092.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-25T14:36:57.697 INFO:teuthology.orchestra.run.smithi092.stdout: inet 127.0.0.1/8 scope host lo 2023-07-25T14:36:57.697 INFO:teuthology.orchestra.run.smithi092.stdout: valid_lft forever preferred_lft forever 2023-07-25T14:36:57.698 INFO:teuthology.orchestra.run.smithi092.stdout: inet6 ::1/128 scope host 2023-07-25T14:36:57.698 INFO:teuthology.orchestra.run.smithi092.stdout: valid_lft forever preferred_lft forever 2023-07-25T14:36:57.698 INFO:teuthology.orchestra.run.smithi092.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-25T14:36:57.698 INFO:teuthology.orchestra.run.smithi092.stdout: link/ether 0c:c4:7a:d8:a1:b2 brd ff:ff:ff:ff:ff:ff 2023-07-25T14:36:57.698 INFO:teuthology.orchestra.run.smithi092.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-25T14:36:57.698 INFO:teuthology.orchestra.run.smithi092.stdout: link/ether 0c:c4:7a:d8:a1:b3 brd ff:ff:ff:ff:ff:ff 2023-07-25T14:36:57.699 INFO:teuthology.orchestra.run.smithi092.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-25T14:36:57.699 INFO:teuthology.orchestra.run.smithi092.stdout: link/ether 0c:c4:7a:8f:cd:44 brd ff:ff:ff:ff:ff:ff 2023-07-25T14:36:57.699 INFO:teuthology.orchestra.run.smithi092.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-25T14:36:57.699 INFO:teuthology.orchestra.run.smithi092.stdout: link/ether 0c:c4:7a:8f:cd:45 brd ff:ff:ff:ff:ff:ff 2023-07-25T14:36:57.699 INFO:teuthology.orchestra.run.smithi092.stdout: inet 172.21.15.92/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-07-25T14:36:57.699 INFO:teuthology.orchestra.run.smithi092.stdout: valid_lft 42176sec preferred_lft 42176sec 2023-07-25T14:36:57.699 INFO:teuthology.orchestra.run.smithi092.stdout: inet6 fe80::c8ab:79f5:f80b:16b/64 scope link noprefixroute 2023-07-25T14:36:57.700 INFO:teuthology.orchestra.run.smithi092.stdout: valid_lft forever preferred_lft forever 2023-07-25T14:36:57.700 INFO:teuthology.orchestra.run.smithi092.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-25T14:36:57.700 INFO:teuthology.orchestra.run.smithi092.stdout: link/ether 0e:6e:1c:1c:77:0f brd ff:ff:ff:ff:ff:ff 2023-07-25T14:36:57.700 INFO:teuthology.orchestra.run.smithi092.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-25T14:36:57.700 INFO:teuthology.orchestra.run.smithi092.stdout: valid_lft forever preferred_lft forever 2023-07-25T14:36:57.701 INFO:teuthology.orchestra.run.smithi092.stdout: inet6 fe80::5099:6cff:fecf:8811/64 scope link 2023-07-25T14:36:57.701 INFO:teuthology.orchestra.run.smithi092.stdout: valid_lft forever preferred_lft forever 2023-07-25T14:36:57.701 INFO:teuthology.orchestra.run.smithi092.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-25T14:36:57.701 INFO:teuthology.orchestra.run.smithi092.stdout: link/ether 0e:6e:1c:1c:77:0f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-07-25T14:36:57.701 INFO:teuthology.orchestra.run.smithi092.stdout: inet6 fe80::c6e:1cff:fe1c:770f/64 scope link 2023-07-25T14:36:57.701 INFO:teuthology.orchestra.run.smithi092.stdout: valid_lft forever preferred_lft forever 2023-07-25T14:36:57.701 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-25T14:36:57.702 DEBUG:teuthology.orchestra.run.smithi092:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-25T14:36:57.768 INFO:teuthology.orchestra.run.smithi092.stdout:1 2023-07-25T14:36:57.769 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-25T14:36:57.770 DEBUG:teuthology.orchestra.run.smithi092:> route 2023-07-25T14:36:57.832 INFO:teuthology.orchestra.run.smithi092.stdout:Kernel IP routing table 2023-07-25T14:36:57.833 INFO:teuthology.orchestra.run.smithi092.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-25T14:36:57.833 INFO:teuthology.orchestra.run.smithi092.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-07-25T14:36:57.833 INFO:teuthology.orchestra.run.smithi092.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-07-25T14:36:57.833 INFO:teuthology.orchestra.run.smithi092.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-25T14:36:57.834 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-25T14:36:57.834 DEBUG:teuthology.orchestra.run.smithi092:> (cd / && exec bash -c ' 2023-07-25T14:36:57.834 DEBUG:teuthology.orchestra.run.smithi092:> set -e 2023-07-25T14:36:57.835 DEBUG:teuthology.orchestra.run.smithi092:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-07-25T14:36:57.835 DEBUG:teuthology.orchestra.run.smithi092:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-07-25T14:36:57.835 DEBUG:teuthology.orchestra.run.smithi092:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-07-25T14:36:57.836 DEBUG:teuthology.orchestra.run.smithi092:> ') 2023-07-25T14:36:57.952 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-25T14:36:57.953 DEBUG:teuthology.orchestra.run.smithi092:> ip netns list 2023-07-25T14:36:57.973 INFO:teuthology.orchestra.run.smithi092.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-07-25T14:36:57.973 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-07-25T14:36:57.974 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-25T14:36:57.974 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip link set brx.0 up 2023-07-25T14:36:58.045 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-25T14:36:58.045 DEBUG:teuthology.orchestra.run.smithi092:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-07-25T14:36:58.105 INFO:teuthology.orchestra.run.smithi092.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-07-25T14:36:58.105 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-25T14:36:58.107 DEBUG:teuthology.orchestra.run.smithi092:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-07-25T14:36:58.165 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-07-25T14:36:58.165 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-25T14:36:58.165 DEBUG:teuthology.orchestra.run.smithi092:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-07-25T14:36:58.260 INFO:teuthology.orchestra.run.smithi092.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-07-25T14:36:58.261 INFO:teuthology.orchestra.run.smithi092.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-07-25T14:36:58.261 INFO:teuthology.orchestra.run.smithi092.stdout:invalid new device string format 2023-07-25T14:36:58.270 INFO:teuthology.orchestra.run.smithi092.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-07-25T14:36:58.271 INFO:teuthology.orchestra.run.smithi092.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-07-25T14:36:58.271 INFO:teuthology.orchestra.run.smithi092.stdout:invalid new device string format 2023-07-25T14:36:58.271 INFO:teuthology.orchestra.run.smithi092.stdout:mount.ceph: resolved to: "172.21.15.72:3300,172.21.15.92:3300,172.21.15.92:3301" 2023-07-25T14:36:58.271 INFO:teuthology.orchestra.run.smithi092.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-25T14:36:58.302 INFO:teuthology.orchestra.run.smithi092.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-07-25T14:36:58.302 INFO:teuthology.orchestra.run.smithi092.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-07-25T14:36:58.302 INFO:teuthology.orchestra.run.smithi092.stdout:invalid new device string format 2023-07-25T14:36:58.302 INFO:teuthology.orchestra.run.smithi092.stdout:mount.ceph: resolved to: "172.21.15.72:3300,172.21.15.92:3300,172.21.15.92:3301" 2023-07-25T14:36:58.302 INFO:teuthology.orchestra.run.smithi092.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-25T14:36:58.303 INFO:teuthology.orchestra.run.smithi092.stdout:mount.ceph: resolved to: "172.21.15.72:6789,172.21.15.92:6789,172.21.15.92:6790" 2023-07-25T14:36:58.303 INFO:teuthology.orchestra.run.smithi092.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.72:6789,172.21.15.92:6789,172.21.15.92:6790:/ 2023-07-25T14:36:58.303 INFO:teuthology.orchestra.run.smithi092.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=9170db48-9170-43e8-8ccb-9813e6240906" will pass to kernel 2023-07-25T14:36:58.305 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-25T14:36:58.306 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-25T14:36:58.306 DEBUG:teuthology.orchestra.run.smithi092:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-07-25T14:36:58.341 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-25T14:36:58.341 DEBUG:teuthology.orchestra.run.smithi092:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-25T14:36:58.413 INFO:teuthology.orchestra.run.smithi092.stdout:client4979 2023-07-25T14:36:58.414 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-07-25T14:36:58.414 DEBUG:teuthology.orchestra.run.smithi092:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-25T14:36:58.472 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth rm client.testuser 2023-07-25T14:36:58.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:58.594+0000 7f1f5912f700 1 Processor -- start 2023-07-25T14:36:58.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:58.594+0000 7f1f5912f700 1 -- start start 2023-07-25T14:36:58.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:58.595+0000 7f1f5912f700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f1f5406f9b0 0x7f1f540c5380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:58.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:58.595+0000 7f1f5912f700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f5406eaf0 con 0x7f1f54151980 2023-07-25T14:36:58.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:58.595+0000 7f1f5912f700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f5406edd0 con 0x7f1f5406e580 2023-07-25T14:36:58.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:58.595+0000 7f1f5912f700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f5406f770 con 0x7f1f5406f9b0 2023-07-25T14:36:58.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:58.595+0000 7f1f52d9d700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f1f54151980 0x7f1f540c12b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:32904/0 (socket says 172.21.15.72:32904) 2023-07-25T14:36:58.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:58.595+0000 7f1f52d9d700 1 -- 172.21.15.72:0/3699921617 learned_addr learned my addr 172.21.15.72:0/3699921617 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:36:58.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:58.595+0000 7f1f5359e700 1 --2- 172.21.15.72:0/3699921617 >> v2:172.21.15.92:3300/0 conn(0x7f1f5406f9b0 0x7f1f540c5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:58.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:58.595+0000 7f1f51d9b700 1 -- 172.21.15.72:0/3699921617 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1982736363 0 0) 0x7f1f5406eaf0 con 0x7f1f54151980 2023-07-25T14:36:58.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:58.595+0000 7f1f51d9b700 1 -- 172.21.15.72:0/3699921617 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1f3c0035b0 con 0x7f1f54151980 2023-07-25T14:36:58.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:58.596+0000 7f1f5359e700 1 -- 172.21.15.72:0/3699921617 >> v1:172.21.15.92:6789/0 conn(0x7f1f5406e580 legacy=0x7f1f540c4c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:58.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:58.596+0000 7f1f51d9b700 1 -- 172.21.15.72:0/3699921617 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2765291542 0 0) 0x7f1f3c0035b0 con 0x7f1f54151980 2023-07-25T14:36:58.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:58.596+0000 7f1f5359e700 1 -- 172.21.15.72:0/3699921617 >> v1:172.21.15.72:6789/0 conn(0x7f1f54151980 legacy=0x7f1f540c12b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:58.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:58.596+0000 7f1f5359e700 1 -- 172.21.15.72:0/3699921617 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f5406f0b0 con 0x7f1f5406f9b0 2023-07-25T14:36:58.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:58.596+0000 7f1f5359e700 1 --2- 172.21.15.72:0/3699921617 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1f5406f9b0 0x7f1f540c5380 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f1f4c009d90 tx=0x7f1f4c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ac9d3046d52707c6 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:58.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:58.596+0000 7f1f51d9b700 1 -- 172.21.15.72:0/3699921617 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f4c00e070 con 0x7f1f5406f9b0 2023-07-25T14:36:58.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:58.596+0000 7f1f51d9b700 1 -- 172.21.15.72:0/3699921617 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f4c003a20 con 0x7f1f5406f9b0 2023-07-25T14:36:58.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:58.596+0000 7f1f51d9b700 1 -- 172.21.15.72:0/3699921617 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f480017f0 con 0x7f1f5406f9b0 2023-07-25T14:36:58.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:58.596+0000 7f1f5912f700 1 -- 172.21.15.72:0/3699921617 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1f5406f9b0 msgr2=0x7f1f540c5380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:58.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:58.596+0000 7f1f5912f700 1 --2- 172.21.15.72:0/3699921617 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1f5406f9b0 0x7f1f540c5380 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f1f4c009d90 tx=0x7f1f4c00b330 comp rx=0 tx=0).stop 2023-07-25T14:36:58.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:58.596+0000 7f1f5912f700 1 -- 172.21.15.72:0/3699921617 shutdown_connections 2023-07-25T14:36:58.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:58.596+0000 7f1f5912f700 1 --2- 172.21.15.72:0/3699921617 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1f5406f9b0 0x7f1f540c5380 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:58.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:58.596+0000 7f1f5912f700 1 -- 172.21.15.72:0/3699921617 >> 172.21.15.72:0/3699921617 conn(0x7f1f540a8520 msgr2=0x7f1f540a8900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:58.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:58.596+0000 7f1f5912f700 1 -- 172.21.15.72:0/3699921617 shutdown_connections 2023-07-25T14:36:58.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:58.597+0000 7f1f5912f700 1 -- 172.21.15.72:0/3699921617 wait complete. 2023-07-25T14:36:58.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:58.598+0000 7f1f5912f700 1 Processor -- start 2023-07-25T14:36:58.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:58.598+0000 7f1f5912f700 1 -- start start 2023-07-25T14:36:58.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:58.599+0000 7f1f5912f700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1f5406e580 0x7f1f54154e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:58.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:58.599+0000 7f1f5912f700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1f5406f9b0 0x7f1f541ed350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:58.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:58.599+0000 7f1f5912f700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1f54151980 0x7f1f540be8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:58.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:58.599+0000 7f1f5912f700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f540be410 con 0x7f1f54151980 2023-07-25T14:36:58.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:58.599+0000 7f1f5912f700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f54152640 con 0x7f1f5406e580 2023-07-25T14:36:58.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:58.599+0000 7f1f5912f700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f54150340 con 0x7f1f5406f9b0 2023-07-25T14:36:58.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:58.599+0000 7f1f5359e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1f54151980 0x7f1f540be8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:58.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:58.599+0000 7f1f5359e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1f54151980 0x7f1f540be8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42178/0 (socket says 172.21.15.72:42178) 2023-07-25T14:36:58.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:58.599+0000 7f1f5359e700 1 -- 172.21.15.72:0/3586762477 learned_addr learned my addr 172.21.15.72:0/3586762477 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:58.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:58.599+0000 7f1f5259c700 1 --2- 172.21.15.72:0/3586762477 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1f5406f9b0 0x7f1f541ed350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:58.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:58.599+0000 7f1f52d9d700 1 --2- 172.21.15.72:0/3586762477 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1f5406e580 0x7f1f54154e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:58.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:58.599+0000 7f1f5359e700 1 -- 172.21.15.72:0/3586762477 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1f5406f9b0 msgr2=0x7f1f541ed350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:58.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:58.599+0000 7f1f5359e700 1 --2- 172.21.15.72:0/3586762477 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1f5406f9b0 0x7f1f541ed350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:58.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:58.599+0000 7f1f5359e700 1 -- 172.21.15.72:0/3586762477 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1f5406e580 msgr2=0x7f1f54154e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:58.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:58.599+0000 7f1f5359e700 1 --2- 172.21.15.72:0/3586762477 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1f5406e580 0x7f1f54154e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:58.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:58.599+0000 7f1f5359e700 1 -- 172.21.15.72:0/3586762477 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f4c009a70 con 0x7f1f54151980 2023-07-25T14:36:58.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:58.599+0000 7f1f5259c700 1 --2- 172.21.15.72:0/3586762477 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1f5406f9b0 0x7f1f541ed350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-25T14:36:58.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:58.599+0000 7f1f52d9d700 1 --2- 172.21.15.72:0/3586762477 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1f5406e580 0x7f1f54154e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-25T14:36:58.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:58.599+0000 7f1f5359e700 1 --2- 172.21.15.72:0/3586762477 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1f54151980 0x7f1f540be8a0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f1f540c6810 tx=0x7f1f4c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:58.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:58.599+0000 7f1f3b7fe700 1 -- 172.21.15.72:0/3586762477 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f4c0046b0 con 0x7f1f54151980 2023-07-25T14:36:58.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:58.599+0000 7f1f3b7fe700 1 -- 172.21.15.72:0/3586762477 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f4c004830 con 0x7f1f54151980 2023-07-25T14:36:58.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:58.599+0000 7f1f5912f700 1 -- 172.21.15.72:0/3586762477 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f54150060 con 0x7f1f54151980 2023-07-25T14:36:58.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:58.599+0000 7f1f3b7fe700 1 -- 172.21.15.72:0/3586762477 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f4c012690 con 0x7f1f54151980 2023-07-25T14:36:58.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:58.600+0000 7f1f5912f700 1 -- 172.21.15.72:0/3586762477 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f541edf00 con 0x7f1f54151980 2023-07-25T14:36:58.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:58.600+0000 7f1f5912f700 1 -- 172.21.15.72:0/3586762477 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f541ee0c0 con 0x7f1f54151980 2023-07-25T14:36:58.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:58.601+0000 7f1f3b7fe700 1 -- 172.21.15.72:0/3586762477 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1f4c0127f0 con 0x7f1f54151980 2023-07-25T14:36:58.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:58.601+0000 7f1f3b7fe700 1 --2- 172.21.15.72:0/3586762477 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f1f4006ace0 0x7f1f4006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:58.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:58.601+0000 7f1f52d9d700 1 --2- 172.21.15.72:0/3586762477 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f1f4006ace0 0x7f1f4006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:58.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:58.601+0000 7f1f3b7fe700 1 -- 172.21.15.72:0/3586762477 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f1f4c08b140 con 0x7f1f54151980 2023-07-25T14:36:58.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:58.602+0000 7f1f52d9d700 1 --2- 172.21.15.72:0/3586762477 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f1f4006ace0 0x7f1f4006d1a0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f1f48001eb0 tx=0x7f1f48009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:58.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:58.606+0000 7f1f3b7fe700 1 -- 172.21.15.72:0/3586762477 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f1f541ee0c0 con 0x7f1f54151980 2023-07-25T14:36:58.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:58.873+0000 7f1f5912f700 1 -- 172.21.15.72:0/3586762477 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "auth rm", "entity": "client.testuser"} v 0) v1 -- 0x7f1f540be5c0 con 0x7f1f54151980 2023-07-25T14:36:58.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:58.873+0000 7f1f3b7fe700 1 -- 172.21.15.72:0/3586762477 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "auth rm", "entity": "client.testuser"}]=0 v13) v1 ==== 84+0+0 (secure 0 0 0) 0x7f1f540be5c0 con 0x7f1f54151980 2023-07-25T14:36:58.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:58.875+0000 7f1f5912f700 1 -- 172.21.15.72:0/3586762477 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f1f4006ace0 msgr2=0x7f1f4006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:58.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:58.875+0000 7f1f5912f700 1 --2- 172.21.15.72:0/3586762477 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f1f4006ace0 0x7f1f4006d1a0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f1f48001eb0 tx=0x7f1f48009040 comp rx=0 tx=0).stop 2023-07-25T14:36:58.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:58.875+0000 7f1f5912f700 1 -- 172.21.15.72:0/3586762477 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1f54151980 msgr2=0x7f1f540be8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:58.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:58.875+0000 7f1f5912f700 1 --2- 172.21.15.72:0/3586762477 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1f54151980 0x7f1f540be8a0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f1f540c6810 tx=0x7f1f4c004ad0 comp rx=0 tx=0).stop 2023-07-25T14:36:58.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:58.875+0000 7f1f5912f700 1 -- 172.21.15.72:0/3586762477 shutdown_connections 2023-07-25T14:36:58.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:58.875+0000 7f1f5912f700 1 --2- 172.21.15.72:0/3586762477 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f1f4006ace0 0x7f1f4006d1a0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:58.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:58.875+0000 7f1f5912f700 1 --2- 172.21.15.72:0/3586762477 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1f54151980 0x7f1f540be8a0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:58.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:58.875+0000 7f1f5912f700 1 --2- 172.21.15.72:0/3586762477 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1f5406e580 0x7f1f54154e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:58.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:58.875+0000 7f1f5912f700 1 --2- 172.21.15.72:0/3586762477 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1f5406f9b0 0x7f1f541ed350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:58.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:58.875+0000 7f1f5912f700 1 -- 172.21.15.72:0/3586762477 >> 172.21.15.72:0/3586762477 conn(0x7f1f540a8520 msgr2=0x7f1f54073650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:58.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:58.875+0000 7f1f5912f700 1 -- 172.21.15.72:0/3586762477 shutdown_connections 2023-07-25T14:36:58.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:58.875+0000 7f1f5912f700 1 -- 172.21.15.72:0/3586762477 wait complete. 2023-07-25T14:36:58.899 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-25T14:36:59.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.006+0000 7ff53b11f700 1 Processor -- start 2023-07-25T14:36:59.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.006+0000 7ff53b11f700 1 -- start start 2023-07-25T14:36:59.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.007+0000 7ff53b11f700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff5340724c0 0x7ff5340c34c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:59.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.007+0000 7ff53b11f700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7ff5340c4930 0x7ff5340c3a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:59.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.007+0000 7ff53b11f700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5340c2fe0 con 0x7ff534151950 2023-07-25T14:36:59.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.007+0000 7ff53b11f700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff534071a60 con 0x7ff5340724c0 2023-07-25T14:36:59.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.007+0000 7ff53b11f700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5340c2a70 con 0x7ff5340c4930 2023-07-25T14:36:59.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.007+0000 7ff533fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff5340724c0 0x7ff5340c34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:59.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.007+0000 7ff538ebb700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7ff534151950 0x7ff53406a190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:32918/0 (socket says 172.21.15.72:32918) 2023-07-25T14:36:59.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.007+0000 7ff538ebb700 1 -- 172.21.15.72:0/1398293 learned_addr learned my addr 172.21.15.72:0/1398293 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:36:59.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.007+0000 7ff5396bc700 1 --2- 172.21.15.72:0/1398293 >> v2:172.21.15.92:3300/0 conn(0x7ff5340c4930 0x7ff5340c3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:59.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.008+0000 7ff533fff700 1 -- 172.21.15.72:0/1398293 >> v2:172.21.15.92:3300/0 conn(0x7ff5340c4930 msgr2=0x7ff5340c3a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:59.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.008+0000 7ff533fff700 1 --2- 172.21.15.72:0/1398293 >> v2:172.21.15.92:3300/0 conn(0x7ff5340c4930 0x7ff5340c3a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:59.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.008+0000 7ff533fff700 1 -- 172.21.15.72:0/1398293 >> v1:172.21.15.72:6789/0 conn(0x7ff534151950 legacy=0x7ff53406a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:59.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.008+0000 7ff533fff700 1 -- 172.21.15.72:0/1398293 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff534155070 con 0x7ff5340724c0 2023-07-25T14:36:59.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.008+0000 7ff533fff700 1 --2- 172.21.15.72:0/1398293 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff5340724c0 0x7ff5340c34c0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7ff5340728a0 tx=0x7ff520009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fda279b1754ca3f server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:59.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.008+0000 7ff5337fe700 1 -- 172.21.15.72:0/1398293 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff520011830 con 0x7ff5340724c0 2023-07-25T14:36:59.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.008+0000 7ff5337fe700 1 -- 172.21.15.72:0/1398293 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff520011990 con 0x7ff5340724c0 2023-07-25T14:36:59.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.008+0000 7ff5337fe700 1 -- 172.21.15.72:0/1398293 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff520011d20 con 0x7ff5340724c0 2023-07-25T14:36:59.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.008+0000 7ff53b11f700 1 -- 172.21.15.72:0/1398293 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff5340724c0 msgr2=0x7ff5340c34c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:59.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.008+0000 7ff53b11f700 1 --2- 172.21.15.72:0/1398293 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff5340724c0 0x7ff5340c34c0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7ff5340728a0 tx=0x7ff520009b20 comp rx=0 tx=0).stop 2023-07-25T14:36:59.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.008+0000 7ff53b11f700 1 -- 172.21.15.72:0/1398293 shutdown_connections 2023-07-25T14:36:59.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.008+0000 7ff53b11f700 1 --2- 172.21.15.72:0/1398293 >> v2:172.21.15.92:3300/0 conn(0x7ff5340c4930 0x7ff5340c3a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:59.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.008+0000 7ff53b11f700 1 --2- 172.21.15.72:0/1398293 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff5340724c0 0x7ff5340c34c0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:59.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.008+0000 7ff53b11f700 1 -- 172.21.15.72:0/1398293 >> 172.21.15.72:0/1398293 conn(0x7ff5340a87e0 msgr2=0x7ff5340a8bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:59.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.008+0000 7ff53b11f700 1 -- 172.21.15.72:0/1398293 shutdown_connections 2023-07-25T14:36:59.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.009+0000 7ff53b11f700 1 -- 172.21.15.72:0/1398293 wait complete. 2023-07-25T14:36:59.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.010+0000 7ff53b11f700 1 Processor -- start 2023-07-25T14:36:59.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.010+0000 7ff53b11f700 1 -- start start 2023-07-25T14:36:59.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.010+0000 7ff53b11f700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff5340724c0 0x7ff5340aa430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:59.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.010+0000 7ff53b11f700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff5340c4930 0x7ff534156ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:59.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.010+0000 7ff53b11f700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff534151950 0x7ff534157420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:59.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.010+0000 7ff53b11f700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff534155e00 con 0x7ff534151950 2023-07-25T14:36:59.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.010+0000 7ff53b11f700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff534157960 con 0x7ff5340724c0 2023-07-25T14:36:59.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.010+0000 7ff53b11f700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5340ac410 con 0x7ff5340c4930 2023-07-25T14:36:59.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.011+0000 7ff5396bc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff534151950 0x7ff534157420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:59.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.011+0000 7ff5396bc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff534151950 0x7ff534157420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42192/0 (socket says 172.21.15.72:42192) 2023-07-25T14:36:59.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.011+0000 7ff5396bc700 1 -- 172.21.15.72:0/2503827513 learned_addr learned my addr 172.21.15.72:0/2503827513 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:59.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.011+0000 7ff538ebb700 1 --2- 172.21.15.72:0/2503827513 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff5340724c0 0x7ff5340aa430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:59.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.011+0000 7ff533fff700 1 --2- 172.21.15.72:0/2503827513 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff5340c4930 0x7ff534156ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:59.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.011+0000 7ff5396bc700 1 -- 172.21.15.72:0/2503827513 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff5340c4930 msgr2=0x7ff534156ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:59.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.011+0000 7ff5396bc700 1 --2- 172.21.15.72:0/2503827513 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff5340c4930 0x7ff534156ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:59.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.011+0000 7ff5396bc700 1 -- 172.21.15.72:0/2503827513 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff5340724c0 msgr2=0x7ff5340aa430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:59.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.011+0000 7ff5396bc700 1 --2- 172.21.15.72:0/2503827513 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff5340724c0 0x7ff5340aa430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:59.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.011+0000 7ff5396bc700 1 -- 172.21.15.72:0/2503827513 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5200094a0 con 0x7ff534151950 2023-07-25T14:36:59.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.011+0000 7ff5396bc700 1 --2- 172.21.15.72:0/2503827513 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff534151950 0x7ff534157420 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7ff52c007e70 tx=0x7ff52c00e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:59.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.011+0000 7ff5317fa700 1 -- 172.21.15.72:0/2503827513 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff52c00ed30 con 0x7ff534151950 2023-07-25T14:36:59.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.011+0000 7ff5317fa700 1 -- 172.21.15.72:0/2503827513 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff52c00eeb0 con 0x7ff534151950 2023-07-25T14:36:59.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.011+0000 7ff53b11f700 1 -- 172.21.15.72:0/2503827513 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5340abde0 con 0x7ff534151950 2023-07-25T14:36:59.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.011+0000 7ff5317fa700 1 -- 172.21.15.72:0/2503827513 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff52c014640 con 0x7ff534151950 2023-07-25T14:36:59.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.011+0000 7ff53b11f700 1 -- 172.21.15.72:0/2503827513 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5341557d0 con 0x7ff534151950 2023-07-25T14:36:59.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.012+0000 7ff53b11f700 1 -- 172.21.15.72:0/2503827513 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5340ac550 con 0x7ff534151950 2023-07-25T14:36:59.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.012+0000 7ff5317fa700 1 -- 172.21.15.72:0/2503827513 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff52c0147a0 con 0x7ff534151950 2023-07-25T14:36:59.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.013+0000 7ff5317fa700 1 --2- 172.21.15.72:0/2503827513 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7ff51806ace0 0x7ff51806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:59.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.013+0000 7ff5317fa700 1 -- 172.21.15.72:0/2503827513 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6382+0+0 (secure 0 0 0) 0x7ff52c089cd0 con 0x7ff534151950 2023-07-25T14:36:59.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.013+0000 7ff538ebb700 1 --2- 172.21.15.72:0/2503827513 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7ff51806ace0 0x7ff51806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:59.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.013+0000 7ff538ebb700 1 --2- 172.21.15.72:0/2503827513 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7ff51806ace0 0x7ff51806d1a0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7ff528005910 tx=0x7ff528009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:59.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.017+0000 7ff5317fa700 1 -- 172.21.15.72:0/2503827513 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7ff5340ac550 con 0x7ff534151950 2023-07-25T14:36:59.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.205+0000 7ff53b11f700 1 -- 172.21.15.72:0/2503827513 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff5340ac550 con 0x7ff534151950 2023-07-25T14:36:59.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.206+0000 7ff5317fa700 1 -- 172.21.15.72:0/2503827513 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+18394 (secure 0 0 0) 0x7ff5340ac550 con 0x7ff534151950 2023-07-25T14:36:59.218 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-25T14:36:59.219 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":39,"fsid":"9170db48-9170-43e8-8ccb-9813e6240906","created":"2023-07-25T14:35:21.733262+0000","modified":"2023-07-25T14:36:51.193587+0000","last_up_change":"2023-07-25T14:35:31.355010+0000","last_in_change":"2023-07-25T14:35:24.195785+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-25T14:35:32.983457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-25T14:35:33.326342+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-07-25T14:36:47.694223+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-07-25T14:36:48.536715+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d517fdad-0bfe-49f0-89f2-9421c3761839","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6801","nonce":2475407414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6803","nonce":2475407414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6807","nonce":2475407414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6805","nonce":2475407414}]},"public_addr":"172.21.15.72:6801/2475407414","cluster_addr":"172.21.15.72:6803/2475407414","heartbeat_back_addr":"172.21.15.72:6807/2475407414","heartbeat_front_addr":"172.21.15.72:6805/2475407414","state":["exists","up"]},{"osd":1,"uuid":"e1564be3-f209-47e5-a8d0-32fc618a474f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6822","nonce":870954016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6825","nonce":870954016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6831","nonce":870954016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6827","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6829","nonce":870954016}]},"public_addr":"172.21.15.72:6822/870954016","cluster_addr":"172.21.15.72:6825/870954016","heartbeat_back_addr":"172.21.15.72:6831/870954016","heartbeat_front_addr":"172.21.15.72:6829/870954016","state":["exists","up"]},{"osd":2,"uuid":"c4647d30-ffa6-417a-9026-ef530c75910e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6809","nonce":2143129442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6811","nonce":2143129442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6815","nonce":2143129442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6813","nonce":2143129442}]},"public_addr":"172.21.15.72:6809/2143129442","cluster_addr":"172.21.15.72:6811/2143129442","heartbeat_back_addr":"172.21.15.72:6815/2143129442","heartbeat_front_addr":"172.21.15.72:6813/2143129442","state":["exists","up"]},{"osd":3,"uuid":"76c9d9a7-c2e2-4612-a58b-d6882dd76b58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6817","nonce":3404066311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6819","nonce":3404066311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6828","nonce":3404066311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6821","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6823","nonce":3404066311}]},"public_addr":"172.21.15.72:6817/3404066311","cluster_addr":"172.21.15.72:6819/3404066311","heartbeat_back_addr":"172.21.15.72:6828/3404066311","heartbeat_front_addr":"172.21.15.72:6823/3404066311","state":["exists","up"]},{"osd":4,"uuid":"7f8920dc-0ad4-4a73-ab40-65408f83eadd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6817","nonce":2381008739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6819","nonce":2381008739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6825","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6827","nonce":2381008739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6822","nonce":2381008739}]},"public_addr":"172.21.15.92:6817/2381008739","cluster_addr":"172.21.15.92:6819/2381008739","heartbeat_back_addr":"172.21.15.92:6827/2381008739","heartbeat_front_addr":"172.21.15.92:6822/2381008739","state":["exists","up"]},{"osd":5,"uuid":"56257e7c-31eb-44c5-9ec7-1318a4e0bb35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6801","nonce":2161935604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6803","nonce":2161935604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6807","nonce":2161935604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6805","nonce":2161935604}]},"public_addr":"172.21.15.92:6801/2161935604","cluster_addr":"172.21.15.92:6803/2161935604","heartbeat_back_addr":"172.21.15.92:6807/2161935604","heartbeat_front_addr":"172.21.15.92:6805/2161935604","state":["exists","up"]},{"osd":6,"uuid":"a150d3d8-a0c9-4955-968a-8d98eff4ffb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6809","nonce":3770163493}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6811","nonce":3770163493}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6815","nonce":3770163493}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6813","nonce":3770163493}]},"public_addr":"172.21.15.92:6809/3770163493","cluster_addr":"172.21.15.92:6811/3770163493","heartbeat_back_addr":"172.21.15.92:6815/3770163493","heartbeat_front_addr":"172.21.15.92:6813/3770163493","state":["exists","up"]},{"osd":7,"uuid":"07799c27-54ee-4591-a42d-a978d6b32065","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6821","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6823","nonce":2135777609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6826","nonce":2135777609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6831","nonce":2135777609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6829","nonce":2135777609}]},"public_addr":"172.21.15.92:6823/2135777609","cluster_addr":"172.21.15.92:6826/2135777609","heartbeat_back_addr":"172.21.15.92:6831/2135777609","heartbeat_front_addr":"172.21.15.92:6829/2135777609","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.345365+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.378150+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.146566+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.372172+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:30.398421+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.385632+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.465611+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.443583+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-25T14:36:59.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.208+0000 7ff53b11f700 1 -- 172.21.15.72:0/2503827513 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7ff51806ace0 msgr2=0x7ff51806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:59.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.208+0000 7ff53b11f700 1 --2- 172.21.15.72:0/2503827513 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7ff51806ace0 0x7ff51806d1a0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7ff528005910 tx=0x7ff528009040 comp rx=0 tx=0).stop 2023-07-25T14:36:59.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.208+0000 7ff53b11f700 1 -- 172.21.15.72:0/2503827513 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff534151950 msgr2=0x7ff534157420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:59.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.208+0000 7ff53b11f700 1 --2- 172.21.15.72:0/2503827513 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff534151950 0x7ff534157420 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7ff52c007e70 tx=0x7ff52c00e3c0 comp rx=0 tx=0).stop 2023-07-25T14:36:59.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.208+0000 7ff53b11f700 1 -- 172.21.15.72:0/2503827513 shutdown_connections 2023-07-25T14:36:59.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.208+0000 7ff53b11f700 1 --2- 172.21.15.72:0/2503827513 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7ff51806ace0 0x7ff51806d1a0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:59.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.208+0000 7ff53b11f700 1 --2- 172.21.15.72:0/2503827513 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff534151950 0x7ff534157420 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:59.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.208+0000 7ff53b11f700 1 --2- 172.21.15.72:0/2503827513 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff5340724c0 0x7ff5340aa430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:59.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.208+0000 7ff53b11f700 1 --2- 172.21.15.72:0/2503827513 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff5340c4930 0x7ff534156ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:59.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.208+0000 7ff53b11f700 1 -- 172.21.15.72:0/2503827513 >> 172.21.15.72:0/2503827513 conn(0x7ff5340a87e0 msgr2=0x7ff53406f270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:59.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.208+0000 7ff53b11f700 1 -- 172.21.15.72:0/2503827513 shutdown_connections 2023-07-25T14:36:59.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.208+0000 7ff53b11f700 1 -- 172.21.15.72:0/2503827513 wait complete. 2023-07-25T14:36:59.232 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-07-25T14:35:32.983457+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-07-25T14:35:33.326342+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-25T14:36:47.694223+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2023-07-25T14:36:48.536715+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '39', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-25T14:36:59.233 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-25T14:36:59.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.345+0000 7f9c10d61700 1 Processor -- start 2023-07-25T14:36:59.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.345+0000 7f9c10d61700 1 -- start start 2023-07-25T14:36:59.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.346+0000 7f9c10d61700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9c0c157980 0x7f9c0c157e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:59.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.346+0000 7f9c10d61700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c0c0c2410 con 0x7f9c0c151a50 2023-07-25T14:36:59.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.346+0000 7f9c10d61700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c0c0c20e0 con 0x7f9c0c0c3110 2023-07-25T14:36:59.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.346+0000 7f9c10d61700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c0c151e30 con 0x7f9c0c157980 2023-07-25T14:36:59.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.346+0000 7f9c0a59c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f9c0c151a50 0x7f9c0c0c1850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:32932/0 (socket says 172.21.15.72:32932) 2023-07-25T14:36:59.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.346+0000 7f9c0a59c700 1 -- 172.21.15.72:0/410023133 learned_addr learned my addr 172.21.15.72:0/410023133 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:36:59.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.346+0000 7f9c0ad9d700 1 --2- 172.21.15.72:0/410023133 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9c0c157980 0x7f9c0c157e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:59.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.346+0000 7f9c0959a700 1 -- 172.21.15.72:0/410023133 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3928786214 0 0) 0x7f9c0c0c2410 con 0x7f9c0c151a50 2023-07-25T14:36:59.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.346+0000 7f9c0959a700 1 -- 172.21.15.72:0/410023133 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9bf40035b0 con 0x7f9c0c151a50 2023-07-25T14:36:59.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.347+0000 7f9c0959a700 1 -- 172.21.15.72:0/410023133 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1593299425 0 0) 0x7f9bf40035b0 con 0x7f9c0c151a50 2023-07-25T14:36:59.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.347+0000 7f9c0959a700 1 -- 172.21.15.72:0/410023133 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9c0c157980 msgr2=0x7f9c0c157e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:59.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.347+0000 7f9c0959a700 1 --2- 172.21.15.72:0/410023133 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9c0c157980 0x7f9c0c157e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:59.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.347+0000 7f9c0959a700 1 -- 172.21.15.72:0/410023133 >> v1:172.21.15.92:6789/0 conn(0x7f9c0c0c3110 legacy=0x7f9c0c06a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:59.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.347+0000 7f9c0959a700 1 -- 172.21.15.72:0/410023133 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c0c0c1290 con 0x7f9c0c151a50 2023-07-25T14:36:59.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.347+0000 7f9c0959a700 1 -- 172.21.15.72:0/410023133 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2559588315 0 0) 0x7f9c00001670 con 0x7f9c0c151a50 2023-07-25T14:36:59.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.347+0000 7f9c0959a700 1 -- 172.21.15.72:0/410023133 >> v1:172.21.15.72:6789/0 conn(0x7f9c0c151a50 legacy=0x7f9c0c0c1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:59.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.347+0000 7f9c0959a700 1 --2- 172.21.15.72:0/410023133 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9c0c157980 0x7f9bf4003a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:59.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.347+0000 7f9c0959a700 1 --2- 172.21.15.72:0/410023133 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9bf4003fb0 0x7f9bf4004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:59.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.347+0000 7f9c0959a700 1 --2- 172.21.15.72:0/410023133 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9bf4004d90 0x7f9bf4005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:59.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.347+0000 7f9c0959a700 1 -- 172.21.15.72:0/410023133 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c0c151e30 con 0x7f9bf4004d90 2023-07-25T14:36:59.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.347+0000 7f9c0959a700 1 -- 172.21.15.72:0/410023133 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bf400bc50 con 0x7f9bf4003fb0 2023-07-25T14:36:59.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.347+0000 7f9c0959a700 1 -- 172.21.15.72:0/410023133 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bf400be10 con 0x7f9c0c157980 2023-07-25T14:36:59.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.347+0000 7f9c0ad9d700 1 --2- 172.21.15.72:0/410023133 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9bf4004d90 0x7f9bf4005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:59.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.347+0000 7f9c0a59c700 1 --2- 172.21.15.72:0/410023133 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9c0c157980 0x7f9bf4003a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:59.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.347+0000 7f9c09d9b700 1 --2- 172.21.15.72:0/410023133 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9bf4003fb0 0x7f9bf4004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:59.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.347+0000 7f9c0ad9d700 1 -- 172.21.15.72:0/410023133 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9c0c157980 msgr2=0x7f9bf4003a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:59.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.347+0000 7f9c0ad9d700 1 --2- 172.21.15.72:0/410023133 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9c0c157980 0x7f9bf4003a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:59.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.347+0000 7f9c0ad9d700 1 -- 172.21.15.72:0/410023133 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9bf4003fb0 msgr2=0x7f9bf4004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:36:59.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.347+0000 7f9c0ad9d700 1 --2- 172.21.15.72:0/410023133 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9bf4003fb0 0x7f9bf4004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:59.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.347+0000 7f9c0ad9d700 1 -- 172.21.15.72:0/410023133 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bf40035b0 con 0x7f9bf4004d90 2023-07-25T14:36:59.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.347+0000 7f9c09d9b700 1 --2- 172.21.15.72:0/410023133 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9bf4003fb0 0x7f9bf4004850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-25T14:36:59.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.347+0000 7f9c0ad9d700 1 --2- 172.21.15.72:0/410023133 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9bf4004d90 0x7f9bf4005210 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f9c04009fc0 tx=0x7f9bf4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c29c8d525d9527d0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:59.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.347+0000 7f9c0959a700 1 -- 172.21.15.72:0/410023133 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c0400ec30 con 0x7f9bf4004d90 2023-07-25T14:36:59.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.347+0000 7f9c0959a700 1 -- 172.21.15.72:0/410023133 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c0400f040 con 0x7f9bf4004d90 2023-07-25T14:36:59.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.347+0000 7f9c0959a700 1 -- 172.21.15.72:0/410023133 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c04014480 con 0x7f9bf4004d90 2023-07-25T14:36:59.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.348+0000 7f9c10d61700 1 -- 172.21.15.72:0/410023133 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9bf4004d90 msgr2=0x7f9bf4005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:59.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.348+0000 7f9c10d61700 1 --2- 172.21.15.72:0/410023133 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9bf4004d90 0x7f9bf4005210 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f9c04009fc0 tx=0x7f9bf4005880 comp rx=0 tx=0).stop 2023-07-25T14:36:59.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.348+0000 7f9c0ad9d700 1 -- 172.21.15.72:0/410023133 reap_dead start 2023-07-25T14:36:59.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.348+0000 7f9c10d61700 1 -- 172.21.15.72:0/410023133 shutdown_connections 2023-07-25T14:36:59.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.348+0000 7f9c10d61700 1 -- 172.21.15.72:0/410023133 >> 172.21.15.72:0/410023133 conn(0x7f9c0c0714f0 msgr2=0x7f9c0c071900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:59.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.348+0000 7f9c10d61700 1 -- 172.21.15.72:0/410023133 shutdown_connections 2023-07-25T14:36:59.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.348+0000 7f9c10d61700 1 -- 172.21.15.72:0/410023133 wait complete. 2023-07-25T14:36:59.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.350+0000 7f9c10d61700 1 Processor -- start 2023-07-25T14:36:59.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.350+0000 7f9c10d61700 1 -- start start 2023-07-25T14:36:59.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.351+0000 7f9c10d61700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9bf4004d90 0x7f9c0c0c6840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:59.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.351+0000 7f9c10d61700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9c0c157d90 0x7f9c0c14b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:59.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.351+0000 7f9c10d61700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9c0c0c6d80 0x7f9c0c14b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:59.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.351+0000 7f9c10d61700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c0c1583e0 con 0x7f9c0c0c6d80 2023-07-25T14:36:59.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.351+0000 7f9c10d61700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c0c0bf0b0 con 0x7f9bf4004d90 2023-07-25T14:36:59.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.351+0000 7f9c10d61700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c0c14bb50 con 0x7f9c0c157d90 2023-07-25T14:36:59.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.351+0000 7f9c0ad9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9c0c0c6d80 0x7f9c0c14b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:59.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.351+0000 7f9c0ad9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9c0c0c6d80 0x7f9c0c14b540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42212/0 (socket says 172.21.15.72:42212) 2023-07-25T14:36:59.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.351+0000 7f9c0ad9d700 1 -- 172.21.15.72:0/4164845787 learned_addr learned my addr 172.21.15.72:0/4164845787 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:59.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.351+0000 7f9c0a59c700 1 --2- 172.21.15.72:0/4164845787 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9bf4004d90 0x7f9c0c0c6840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:59.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.351+0000 7f9c09d9b700 1 --2- 172.21.15.72:0/4164845787 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9c0c157d90 0x7f9c0c14b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:59.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.351+0000 7f9c0ad9d700 1 -- 172.21.15.72:0/4164845787 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9c0c157d90 msgr2=0x7f9c0c14b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:59.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.351+0000 7f9c0ad9d700 1 --2- 172.21.15.72:0/4164845787 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9c0c157d90 0x7f9c0c14b000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:59.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.351+0000 7f9c0ad9d700 1 -- 172.21.15.72:0/4164845787 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9bf4004d90 msgr2=0x7f9c0c0c6840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:59.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.351+0000 7f9c0ad9d700 1 --2- 172.21.15.72:0/4164845787 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9bf4004d90 0x7f9c0c0c6840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:59.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.351+0000 7f9c0ad9d700 1 -- 172.21.15.72:0/4164845787 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c0c152d30 con 0x7f9c0c0c6d80 2023-07-25T14:36:59.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.351+0000 7f9c0ad9d700 1 --2- 172.21.15.72:0/4164845787 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9c0c0c6d80 0x7f9c0c14b540 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f9c04016000 tx=0x7f9c04009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:59.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.351+0000 7f9bfaffd700 1 -- 172.21.15.72:0/4164845787 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c04007000 con 0x7f9c0c0c6d80 2023-07-25T14:36:59.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.351+0000 7f9bfaffd700 1 -- 172.21.15.72:0/4164845787 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c04003e50 con 0x7f9c0c0c6d80 2023-07-25T14:36:59.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.351+0000 7f9c10d61700 1 -- 172.21.15.72:0/4164845787 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c0c153010 con 0x7f9c0c0c6d80 2023-07-25T14:36:59.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.351+0000 7f9bfaffd700 1 -- 172.21.15.72:0/4164845787 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c04014b50 con 0x7f9c0c0c6d80 2023-07-25T14:36:59.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.351+0000 7f9c10d61700 1 -- 172.21.15.72:0/4164845787 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c0c0bd940 con 0x7f9c0c0c6d80 2023-07-25T14:36:59.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.352+0000 7f9c10d61700 1 -- 172.21.15.72:0/4164845787 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c0c1531d0 con 0x7f9c0c0c6d80 2023-07-25T14:36:59.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.353+0000 7f9bfaffd700 1 -- 172.21.15.72:0/4164845787 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9c04023020 con 0x7f9c0c0c6d80 2023-07-25T14:36:59.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.353+0000 7f9bfaffd700 1 --2- 172.21.15.72:0/4164845787 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f9bec06ace0 0x7f9bec06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:59.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.353+0000 7f9bfaffd700 1 -- 172.21.15.72:0/4164845787 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f9c0408ac00 con 0x7f9c0c0c6d80 2023-07-25T14:36:59.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.353+0000 7f9c0a59c700 1 --2- 172.21.15.72:0/4164845787 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f9bec06ace0 0x7f9bec06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:59.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.353+0000 7f9c0a59c700 1 --2- 172.21.15.72:0/4164845787 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f9bec06ace0 0x7f9bec06d1a0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f9c0c0ac9a0 tx=0x7f9c00009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:59.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.357+0000 7f9bfaffd700 1 -- 172.21.15.72:0/4164845787 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f9c04091080 con 0x7f9c0c0c6d80 2023-07-25T14:36:59.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.543+0000 7f9c10d61700 1 -- 172.21.15.72:0/4164845787 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f9c0c0bf1f0 con 0x7f9c0c0c6d80 2023-07-25T14:36:59.555 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.544+0000 7f9bfaffd700 1 -- 172.21.15.72:0/4164845787 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v39) v1 ==== 92+0+10 (secure 0 0 0) 0x7f9c04055d20 con 0x7f9c0c0c6d80 2023-07-25T14:36:59.555 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 8 2023-07-25T14:36:59.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.545+0000 7f9c10d61700 1 -- 172.21.15.72:0/4164845787 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f9bec06ace0 msgr2=0x7f9bec06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:59.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.545+0000 7f9c10d61700 1 --2- 172.21.15.72:0/4164845787 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f9bec06ace0 0x7f9bec06d1a0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f9c0c0ac9a0 tx=0x7f9c00009040 comp rx=0 tx=0).stop 2023-07-25T14:36:59.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.545+0000 7f9c10d61700 1 -- 172.21.15.72:0/4164845787 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9c0c0c6d80 msgr2=0x7f9c0c14b540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:59.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.545+0000 7f9c10d61700 1 --2- 172.21.15.72:0/4164845787 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9c0c0c6d80 0x7f9c0c14b540 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f9c04016000 tx=0x7f9c04009750 comp rx=0 tx=0).stop 2023-07-25T14:36:59.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.545+0000 7f9c10d61700 1 -- 172.21.15.72:0/4164845787 shutdown_connections 2023-07-25T14:36:59.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.545+0000 7f9c10d61700 1 --2- 172.21.15.72:0/4164845787 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f9bec06ace0 0x7f9bec06d1a0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:59.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.545+0000 7f9c10d61700 1 --2- 172.21.15.72:0/4164845787 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9c0c0c6d80 0x7f9c0c14b540 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:59.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.545+0000 7f9c10d61700 1 --2- 172.21.15.72:0/4164845787 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9bf4004d90 0x7f9c0c0c6840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:59.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.545+0000 7f9c10d61700 1 --2- 172.21.15.72:0/4164845787 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9c0c157d90 0x7f9c0c14b000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:59.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.546+0000 7f9c10d61700 1 -- 172.21.15.72:0/4164845787 >> 172.21.15.72:0/4164845787 conn(0x7f9c0c0714f0 msgr2=0x7f9c0c156090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:59.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.546+0000 7f9c10d61700 1 -- 172.21.15.72:0/4164845787 shutdown_connections 2023-07-25T14:36:59.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.546+0000 7f9c10d61700 1 -- 172.21.15.72:0/4164845787 wait complete. 2023-07-25T14:36:59.569 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-25T14:36:59.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.680+0000 7f86aba36700 1 Processor -- start 2023-07-25T14:36:59.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.680+0000 7f86aba36700 1 -- start start 2023-07-25T14:36:59.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.681+0000 7f86aba36700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f86a40c11f0 0x7f86a40a8880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:59.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.681+0000 7f86aba36700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86a40ba1c0 con 0x7f86a406f280 2023-07-25T14:36:59.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.681+0000 7f86aba36700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86a4154640 con 0x7f86a414e6f0 2023-07-25T14:36:59.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.681+0000 7f86aba36700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86a40a7920 con 0x7f86a40c11f0 2023-07-25T14:36:59.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.681+0000 7f86a8fd1700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f86a406f280 0x7f86a40a8170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:32954/0 (socket says 172.21.15.72:32954) 2023-07-25T14:36:59.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.681+0000 7f86a8fd1700 1 -- 172.21.15.72:0/1305279061 learned_addr learned my addr 172.21.15.72:0/1305279061 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:36:59.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.681+0000 7f86a9fd3700 1 --2- 172.21.15.72:0/1305279061 >> v2:172.21.15.92:3300/0 conn(0x7f86a40c11f0 0x7f86a40a8880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:59.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.681+0000 7f869bfff700 1 -- 172.21.15.72:0/1305279061 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1349154397 0 0) 0x7f86a40ba1c0 con 0x7f86a406f280 2023-07-25T14:36:59.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.681+0000 7f869bfff700 1 -- 172.21.15.72:0/1305279061 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f86900035b0 con 0x7f86a406f280 2023-07-25T14:36:59.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.681+0000 7f86a9fd3700 1 -- 172.21.15.72:0/1305279061 >> v1:172.21.15.92:6789/0 conn(0x7f86a414e6f0 legacy=0x7f86a40c67d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:59.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.681+0000 7f86a9fd3700 1 -- 172.21.15.72:0/1305279061 >> v1:172.21.15.72:6789/0 conn(0x7f86a406f280 legacy=0x7f86a40a8170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:59.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.681+0000 7f869bfff700 1 -- 172.21.15.72:0/1305279061 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 233902172 0 0) 0x7f86900035b0 con 0x7f86a406f280 2023-07-25T14:36:59.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.681+0000 7f86a9fd3700 1 -- 172.21.15.72:0/1305279061 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86a4154900 con 0x7f86a40c11f0 2023-07-25T14:36:59.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.682+0000 7f86a9fd3700 1 --2- 172.21.15.72:0/1305279061 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f86a40c11f0 0x7f86a40a8880 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f86a4154af0 tx=0x7f869c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=58a9bdad7d21fe32 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:59.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.682+0000 7f869bfff700 1 -- 172.21.15.72:0/1305279061 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f869c00e070 con 0x7f86a40c11f0 2023-07-25T14:36:59.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.682+0000 7f869bfff700 1 -- 172.21.15.72:0/1305279061 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f869c003a20 con 0x7f86a40c11f0 2023-07-25T14:36:59.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.682+0000 7f869bfff700 1 -- 172.21.15.72:0/1305279061 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86a0001670 con 0x7f86a40c11f0 2023-07-25T14:36:59.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.682+0000 7f86aba36700 1 -- 172.21.15.72:0/1305279061 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f86a40c11f0 msgr2=0x7f86a40a8880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:59.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.682+0000 7f86aba36700 1 --2- 172.21.15.72:0/1305279061 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f86a40c11f0 0x7f86a40a8880 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f86a4154af0 tx=0x7f869c00b330 comp rx=0 tx=0).stop 2023-07-25T14:36:59.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.682+0000 7f86aba36700 1 -- 172.21.15.72:0/1305279061 shutdown_connections 2023-07-25T14:36:59.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.682+0000 7f86aba36700 1 --2- 172.21.15.72:0/1305279061 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f86a40c11f0 0x7f86a40a8880 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:59.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.682+0000 7f86aba36700 1 -- 172.21.15.72:0/1305279061 >> 172.21.15.72:0/1305279061 conn(0x7f86a40714f0 msgr2=0x7f86a4071900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:59.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.682+0000 7f86aba36700 1 -- 172.21.15.72:0/1305279061 shutdown_connections 2023-07-25T14:36:59.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.682+0000 7f86aba36700 1 -- 172.21.15.72:0/1305279061 wait complete. 2023-07-25T14:36:59.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.684+0000 7f86aba36700 1 Processor -- start 2023-07-25T14:36:59.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.684+0000 7f86aba36700 1 -- start start 2023-07-25T14:36:59.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.684+0000 7f86aba36700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f86a406f280 0x7f86a40b8ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:59.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.684+0000 7f86aba36700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f86a40c11f0 0x7f86a40b91e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:59.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.684+0000 7f86aba36700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f86a414e6f0 0x7f86a414a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:59.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.684+0000 7f86aba36700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86a40bade0 con 0x7f86a40c11f0 2023-07-25T14:36:59.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.684+0000 7f86aba36700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86a40ba540 con 0x7f86a414e6f0 2023-07-25T14:36:59.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.684+0000 7f86aba36700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86a40ba820 con 0x7f86a406f280 2023-07-25T14:36:59.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.684+0000 7f86a8fd1700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f86a40c11f0 0x7f86a40b91e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:59.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.684+0000 7f86a8fd1700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f86a40c11f0 0x7f86a40b91e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42224/0 (socket says 172.21.15.72:42224) 2023-07-25T14:36:59.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.684+0000 7f86a8fd1700 1 -- 172.21.15.72:0/842877127 learned_addr learned my addr 172.21.15.72:0/842877127 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:36:59.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.684+0000 7f86a97d2700 1 --2- 172.21.15.72:0/842877127 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f86a406f280 0x7f86a40b8ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:59.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.684+0000 7f86a9fd3700 1 --2- 172.21.15.72:0/842877127 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f86a414e6f0 0x7f86a414a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:59.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.685+0000 7f86a8fd1700 1 -- 172.21.15.72:0/842877127 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f86a406f280 msgr2=0x7f86a40b8ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:59.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.685+0000 7f86a8fd1700 1 --2- 172.21.15.72:0/842877127 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f86a406f280 0x7f86a40b8ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:59.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.685+0000 7f86a8fd1700 1 -- 172.21.15.72:0/842877127 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f86a414e6f0 msgr2=0x7f86a414a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:59.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.685+0000 7f86a8fd1700 1 --2- 172.21.15.72:0/842877127 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f86a414e6f0 0x7f86a414a790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:59.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.685+0000 7f86a8fd1700 1 -- 172.21.15.72:0/842877127 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f869c009a70 con 0x7f86a40c11f0 2023-07-25T14:36:59.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.685+0000 7f86a9fd3700 1 --2- 172.21.15.72:0/842877127 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f86a414e6f0 0x7f86a414a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-25T14:36:59.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.685+0000 7f86a8fd1700 1 --2- 172.21.15.72:0/842877127 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f86a40c11f0 0x7f86a40b91e0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f86a000c750 tx=0x7f86a000ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:59.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.685+0000 7f8699ffb700 1 -- 172.21.15.72:0/842877127 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86a0004c80 con 0x7f86a40c11f0 2023-07-25T14:36:59.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.685+0000 7f8699ffb700 1 -- 172.21.15.72:0/842877127 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86a0004de0 con 0x7f86a40c11f0 2023-07-25T14:36:59.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.685+0000 7f86aba36700 1 -- 172.21.15.72:0/842877127 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86a40bab00 con 0x7f86a40c11f0 2023-07-25T14:36:59.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.685+0000 7f8699ffb700 1 -- 172.21.15.72:0/842877127 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86a0007310 con 0x7f86a40c11f0 2023-07-25T14:36:59.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.685+0000 7f86aba36700 1 -- 172.21.15.72:0/842877127 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86a41481b0 con 0x7f86a40c11f0 2023-07-25T14:36:59.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.686+0000 7f86aba36700 1 -- 172.21.15.72:0/842877127 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86a40ba680 con 0x7f86a40c11f0 2023-07-25T14:36:59.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.686+0000 7f8699ffb700 1 -- 172.21.15.72:0/842877127 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f86a0007470 con 0x7f86a40c11f0 2023-07-25T14:36:59.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.687+0000 7f8699ffb700 1 --2- 172.21.15.72:0/842877127 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f868806ad10 0x7f868806d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:36:59.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.687+0000 7f8699ffb700 1 -- 172.21.15.72:0/842877127 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f86a00892e0 con 0x7f86a40c11f0 2023-07-25T14:36:59.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.687+0000 7f86a97d2700 1 --2- 172.21.15.72:0/842877127 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f868806ad10 0x7f868806d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:36:59.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.687+0000 7f86a97d2700 1 --2- 172.21.15.72:0/842877127 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f868806ad10 0x7f868806d1d0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f8694007fd0 tx=0x7f8694009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:36:59.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.691+0000 7f8699ffb700 1 -- 172.21.15.72:0/842877127 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f86a40ba680 con 0x7f86a40c11f0 2023-07-25T14:36:59.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.878+0000 7f86aba36700 1 -- 172.21.15.72:0/842877127 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f86a40ba680 con 0x7f86a40c11f0 2023-07-25T14:36:59.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.879+0000 7f8699ffb700 1 -- 172.21.15.72:0/842877127 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v39) v1 ==== 93+0+10 (secure 0 0 0) 0x7f86a40ba680 con 0x7f86a40c11f0 2023-07-25T14:36:59.891 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 1 2023-07-25T14:36:59.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.881+0000 7f86aba36700 1 -- 172.21.15.72:0/842877127 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f868806ad10 msgr2=0x7f868806d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:59.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.881+0000 7f86aba36700 1 --2- 172.21.15.72:0/842877127 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f868806ad10 0x7f868806d1d0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f8694007fd0 tx=0x7f8694009040 comp rx=0 tx=0).stop 2023-07-25T14:36:59.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.881+0000 7f86aba36700 1 -- 172.21.15.72:0/842877127 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f86a40c11f0 msgr2=0x7f86a40b91e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:36:59.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.881+0000 7f86aba36700 1 --2- 172.21.15.72:0/842877127 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f86a40c11f0 0x7f86a40b91e0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f86a000c750 tx=0x7f86a000ca60 comp rx=0 tx=0).stop 2023-07-25T14:36:59.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.881+0000 7f86aba36700 1 -- 172.21.15.72:0/842877127 shutdown_connections 2023-07-25T14:36:59.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.881+0000 7f86aba36700 1 --2- 172.21.15.72:0/842877127 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f868806ad10 0x7f868806d1d0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:59.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.881+0000 7f86aba36700 1 --2- 172.21.15.72:0/842877127 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f86a406f280 0x7f86a40b8ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:59.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.881+0000 7f86aba36700 1 --2- 172.21.15.72:0/842877127 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f86a414e6f0 0x7f86a414a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:59.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.881+0000 7f86aba36700 1 --2- 172.21.15.72:0/842877127 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f86a40c11f0 0x7f86a40b91e0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:36:59.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.881+0000 7f86aba36700 1 -- 172.21.15.72:0/842877127 >> 172.21.15.72:0/842877127 conn(0x7f86a40714f0 msgr2=0x7f86a4152190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:36:59.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.881+0000 7f86aba36700 1 -- 172.21.15.72:0/842877127 shutdown_connections 2023-07-25T14:36:59.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:36:59.881+0000 7f86aba36700 1 -- 172.21.15.72:0/842877127 wait complete. 2023-07-25T14:36:59.904 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-25T14:37:00.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.015+0000 7f3539d23700 1 Processor -- start 2023-07-25T14:37:00.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.015+0000 7f3539d23700 1 -- start start 2023-07-25T14:37:00.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.015+0000 7f3539d23700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f353406e080 0x7f3534152ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:00.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.015+0000 7f3539d23700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f35340c2710 0x7f353414f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:00.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.015+0000 7f3539d23700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35340c02a0 con 0x7f35340c2330 2023-07-25T14:37:00.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.015+0000 7f3539d23700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35340c2b40 con 0x7f353406e080 2023-07-25T14:37:00.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.015+0000 7f3539d23700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35340c2f10 con 0x7f35340c2710 2023-07-25T14:37:00.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.016+0000 7f3532ffd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f353406e080 0x7f3534152ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:00.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.016+0000 7f35337fe700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f35340c2330 0x7f3534155c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:32966/0 (socket says 172.21.15.72:32966) 2023-07-25T14:37:00.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.016+0000 7f35337fe700 1 -- 172.21.15.72:0/1860912653 learned_addr learned my addr 172.21.15.72:0/1860912653 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:37:00.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.016+0000 7f3533fff700 1 --2- 172.21.15.72:0/1860912653 >> v2:172.21.15.92:3300/0 conn(0x7f35340c2710 0x7f353414f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:00.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.016+0000 7f3532ffd700 1 -- 172.21.15.72:0/1860912653 >> v2:172.21.15.92:3300/0 conn(0x7f35340c2710 msgr2=0x7f353414f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:00.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.016+0000 7f3532ffd700 1 --2- 172.21.15.72:0/1860912653 >> v2:172.21.15.92:3300/0 conn(0x7f35340c2710 0x7f353414f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:00.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.016+0000 7f35327fc700 1 -- 172.21.15.72:0/1860912653 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3836598325 0 0) 0x7f35340c02a0 con 0x7f35340c2330 2023-07-25T14:37:00.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.016+0000 7f3532ffd700 1 -- 172.21.15.72:0/1860912653 >> v1:172.21.15.72:6789/0 conn(0x7f35340c2330 legacy=0x7f3534155c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:00.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.016+0000 7f3532ffd700 1 -- 172.21.15.72:0/1860912653 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35340c04f0 con 0x7f353406e080 2023-07-25T14:37:00.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.016+0000 7f3533fff700 1 --2- 172.21.15.72:0/1860912653 >> v2:172.21.15.92:3300/0 conn(0x7f35340c2710 0x7f353414f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-25T14:37:00.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.016+0000 7f3532ffd700 1 --2- 172.21.15.72:0/1860912653 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f353406e080 0x7f3534152ab0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f353406e560 tx=0x7f3528009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6472036460b2d62e server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:00.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.016+0000 7f35327fc700 1 -- 172.21.15.72:0/1860912653 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3528011830 con 0x7f353406e080 2023-07-25T14:37:00.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.016+0000 7f35327fc700 1 -- 172.21.15.72:0/1860912653 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3528011990 con 0x7f353406e080 2023-07-25T14:37:00.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.016+0000 7f35327fc700 1 -- 172.21.15.72:0/1860912653 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3528011d20 con 0x7f353406e080 2023-07-25T14:37:00.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.017+0000 7f3539d23700 1 -- 172.21.15.72:0/1860912653 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f353406e080 msgr2=0x7f3534152ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:00.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.017+0000 7f3539d23700 1 --2- 172.21.15.72:0/1860912653 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f353406e080 0x7f3534152ab0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f353406e560 tx=0x7f3528009b20 comp rx=0 tx=0).stop 2023-07-25T14:37:00.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.017+0000 7f3539d23700 1 -- 172.21.15.72:0/1860912653 shutdown_connections 2023-07-25T14:37:00.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.017+0000 7f3539d23700 1 --2- 172.21.15.72:0/1860912653 >> v2:172.21.15.92:3300/0 conn(0x7f35340c2710 0x7f353414f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:00.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.017+0000 7f3539d23700 1 --2- 172.21.15.72:0/1860912653 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f353406e080 0x7f3534152ab0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:00.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.017+0000 7f3539d23700 1 -- 172.21.15.72:0/1860912653 >> 172.21.15.72:0/1860912653 conn(0x7f35340a7510 msgr2=0x7f35340a78f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:00.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.017+0000 7f3539d23700 1 -- 172.21.15.72:0/1860912653 shutdown_connections 2023-07-25T14:37:00.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.017+0000 7f3539d23700 1 -- 172.21.15.72:0/1860912653 wait complete. 2023-07-25T14:37:00.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.018+0000 7f3539d23700 1 Processor -- start 2023-07-25T14:37:00.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.018+0000 7f3539d23700 1 -- start start 2023-07-25T14:37:00.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.019+0000 7f3539d23700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f353406e080 0x7f35340bb220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:00.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.019+0000 7f3539d23700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f35340c2330 0x7f353406d760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:00.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.019+0000 7f3539d23700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f35340c2710 0x7f3534070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:00.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.019+0000 7f3539d23700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3534072640 con 0x7f35340c2710 2023-07-25T14:37:00.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.019+0000 7f3539d23700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35340720c0 con 0x7f353406e080 2023-07-25T14:37:00.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.019+0000 7f3539d23700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35340bd130 con 0x7f35340c2330 2023-07-25T14:37:00.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.019+0000 7f3533fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f35340c2710 0x7f3534070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:00.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.019+0000 7f3533fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f35340c2710 0x7f3534070630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42240/0 (socket says 172.21.15.72:42240) 2023-07-25T14:37:00.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.019+0000 7f3533fff700 1 -- 172.21.15.72:0/2653577739 learned_addr learned my addr 172.21.15.72:0/2653577739 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:37:00.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.019+0000 7f3532ffd700 1 --2- 172.21.15.72:0/2653577739 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f35340c2330 0x7f353406d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:00.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.019+0000 7f35337fe700 1 --2- 172.21.15.72:0/2653577739 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f353406e080 0x7f35340bb220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:00.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.019+0000 7f3533fff700 1 -- 172.21.15.72:0/2653577739 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f35340c2330 msgr2=0x7f353406d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:00.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.019+0000 7f3533fff700 1 --2- 172.21.15.72:0/2653577739 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f35340c2330 0x7f353406d760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:00.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.019+0000 7f3533fff700 1 -- 172.21.15.72:0/2653577739 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f353406e080 msgr2=0x7f35340bb220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:00.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.019+0000 7f3533fff700 1 --2- 172.21.15.72:0/2653577739 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f353406e080 0x7f35340bb220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:00.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.019+0000 7f3533fff700 1 -- 172.21.15.72:0/2653577739 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35280094a0 con 0x7f35340c2710 2023-07-25T14:37:00.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.019+0000 7f3532ffd700 1 --2- 172.21.15.72:0/2653577739 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f35340c2330 0x7f353406d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-25T14:37:00.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.019+0000 7f3533fff700 1 --2- 172.21.15.72:0/2653577739 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f35340c2710 0x7f3534070630 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f352c00c7f0 tx=0x7f352c00cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:00.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.019+0000 7f351bfff700 1 -- 172.21.15.72:0/2653577739 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f352c011800 con 0x7f35340c2710 2023-07-25T14:37:00.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.019+0000 7f351bfff700 1 -- 172.21.15.72:0/2653577739 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f352c011960 con 0x7f35340c2710 2023-07-25T14:37:00.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.019+0000 7f3539d23700 1 -- 172.21.15.72:0/2653577739 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3534072360 con 0x7f35340c2710 2023-07-25T14:37:00.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.019+0000 7f351bfff700 1 -- 172.21.15.72:0/2653577739 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f352c011d10 con 0x7f35340c2710 2023-07-25T14:37:00.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.020+0000 7f3539d23700 1 -- 172.21.15.72:0/2653577739 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35340bce20 con 0x7f35340c2710 2023-07-25T14:37:00.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.020+0000 7f3539d23700 1 -- 172.21.15.72:0/2653577739 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f353404e470 con 0x7f35340c2710 2023-07-25T14:37:00.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.021+0000 7f351bfff700 1 -- 172.21.15.72:0/2653577739 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f352c022350 con 0x7f35340c2710 2023-07-25T14:37:00.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.021+0000 7f351bfff700 1 --2- 172.21.15.72:0/2653577739 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f352006ace0 0x7f352006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:00.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.021+0000 7f351bfff700 1 -- 172.21.15.72:0/2653577739 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f352c089660 con 0x7f35340c2710 2023-07-25T14:37:00.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.021+0000 7f35337fe700 1 --2- 172.21.15.72:0/2653577739 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f352006ace0 0x7f352006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:00.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.022+0000 7f35337fe700 1 --2- 172.21.15.72:0/2653577739 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f352006ace0 0x7f352006d1a0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f35240012e0 tx=0x7f3524001970 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:00.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.025+0000 7f351bfff700 1 -- 172.21.15.72:0/2653577739 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f352c0545e0 con 0x7f35340c2710 2023-07-25T14:37:00.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.212+0000 7f3539d23700 1 -- 172.21.15.72:0/2653577739 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f35340c0a80 con 0x7f35340c2710 2023-07-25T14:37:00.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.212+0000 7f351bfff700 1 -- 172.21.15.72:0/2653577739 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v39) v1 ==== 104+0+11 (secure 0 0 0) 0x7f352c057c00 con 0x7f35340c2710 2023-07-25T14:37:00.224 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2023-07-25T14:37:00.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.215+0000 7f3539d23700 1 -- 172.21.15.72:0/2653577739 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f352006ace0 msgr2=0x7f352006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:00.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.215+0000 7f3539d23700 1 --2- 172.21.15.72:0/2653577739 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f352006ace0 0x7f352006d1a0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f35240012e0 tx=0x7f3524001970 comp rx=0 tx=0).stop 2023-07-25T14:37:00.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.215+0000 7f3539d23700 1 -- 172.21.15.72:0/2653577739 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f35340c2710 msgr2=0x7f3534070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:00.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.215+0000 7f3539d23700 1 --2- 172.21.15.72:0/2653577739 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f35340c2710 0x7f3534070630 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f352c00c7f0 tx=0x7f352c00cbb0 comp rx=0 tx=0).stop 2023-07-25T14:37:00.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.215+0000 7f3539d23700 1 -- 172.21.15.72:0/2653577739 shutdown_connections 2023-07-25T14:37:00.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.215+0000 7f3539d23700 1 --2- 172.21.15.72:0/2653577739 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f352006ace0 0x7f352006d1a0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:00.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.215+0000 7f3539d23700 1 --2- 172.21.15.72:0/2653577739 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f35340c2710 0x7f3534070630 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:00.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.215+0000 7f3539d23700 1 --2- 172.21.15.72:0/2653577739 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f353406e080 0x7f35340bb220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:00.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.215+0000 7f3539d23700 1 --2- 172.21.15.72:0/2653577739 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f35340c2330 0x7f353406d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:00.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.215+0000 7f3539d23700 1 -- 172.21.15.72:0/2653577739 >> 172.21.15.72:0/2653577739 conn(0x7f35340a7510 msgr2=0x7f35341513f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:00.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.215+0000 7f3539d23700 1 -- 172.21.15.72:0/2653577739 shutdown_connections 2023-07-25T14:37:00.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.215+0000 7f3539d23700 1 -- 172.21.15.72:0/2653577739 wait complete. 2023-07-25T14:37:00.238 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-25T14:37:00.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.349+0000 7f8a7e56a700 1 Processor -- start 2023-07-25T14:37:00.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.349+0000 7f8a7e56a700 1 -- start start 2023-07-25T14:37:00.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.350+0000 7f8a7e56a700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8a780a9cc0 0x7f8a781525e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:00.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.350+0000 7f8a7e56a700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f8a780bb0b0 0x7f8a78152b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:00.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.350+0000 7f8a7e56a700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a780c5890 con 0x7f8a7814f810 2023-07-25T14:37:00.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.350+0000 7f8a7e56a700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a78152150 con 0x7f8a780bb0b0 2023-07-25T14:37:00.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.350+0000 7f8a7e56a700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a7814fbf0 con 0x7f8a780a9cc0 2023-07-25T14:37:00.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.350+0000 7f8a777fe700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8a780a9cc0 0x7f8a781525e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:00.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.350+0000 7f8a7cb07700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f8a780bb0b0 0x7f8a78152b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:00.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.350+0000 7f8a777fe700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8a780a9cc0 0x7f8a781525e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3301/0 says I am v2:172.21.15.72:47474/0 (socket says 172.21.15.72:47474) 2023-07-25T14:37:00.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.350+0000 7f8a77fff700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f8a7814f810 0x7f8a780c4370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.72:56554/0 (socket says 172.21.15.72:56554) 2023-07-25T14:37:00.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.350+0000 7f8a777fe700 1 -- 172.21.15.72:0/3710896132 learned_addr learned my addr 172.21.15.72:0/3710896132 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:37:00.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.350+0000 7f8a777fe700 1 -- 172.21.15.72:0/3710896132 >> v2:172.21.15.92:3300/0 conn(0x7f8a780bb0b0 msgr2=0x7f8a78152b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:00.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.351+0000 7f8a777fe700 1 --2- 172.21.15.72:0/3710896132 >> v2:172.21.15.92:3300/0 conn(0x7f8a780bb0b0 0x7f8a78152b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:00.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.351+0000 7f8a777fe700 1 -- 172.21.15.72:0/3710896132 >> v1:172.21.15.92:6789/0 conn(0x7f8a7814f810 legacy=0x7f8a780c4370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:00.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.351+0000 7f8a777fe700 1 -- 172.21.15.72:0/3710896132 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a781566a0 con 0x7f8a780a9cc0 2023-07-25T14:37:00.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.351+0000 7f8a7cb07700 1 --2- 172.21.15.72:0/3710896132 >> v2:172.21.15.92:3300/0 conn(0x7f8a780bb0b0 0x7f8a78152b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-25T14:37:00.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.351+0000 7f8a777fe700 1 --2- 172.21.15.72:0/3710896132 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8a780a9cc0 0x7f8a781525e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f8a680098f0 tx=0x7f8a68009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6e1b08dca95b1e6c server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:00.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.351+0000 7f8a76ffd700 1 -- 172.21.15.72:0/3710896132 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a68011830 con 0x7f8a780a9cc0 2023-07-25T14:37:00.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.351+0000 7f8a76ffd700 1 -- 172.21.15.72:0/3710896132 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a68011990 con 0x7f8a780a9cc0 2023-07-25T14:37:00.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.351+0000 7f8a76ffd700 1 -- 172.21.15.72:0/3710896132 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a68011d20 con 0x7f8a780a9cc0 2023-07-25T14:37:00.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.351+0000 7f8a7e56a700 1 -- 172.21.15.72:0/3710896132 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8a780a9cc0 msgr2=0x7f8a781525e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:00.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.351+0000 7f8a7e56a700 1 --2- 172.21.15.72:0/3710896132 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8a780a9cc0 0x7f8a781525e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f8a680098f0 tx=0x7f8a68009c00 comp rx=0 tx=0).stop 2023-07-25T14:37:00.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.351+0000 7f8a7e56a700 1 -- 172.21.15.72:0/3710896132 shutdown_connections 2023-07-25T14:37:00.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.351+0000 7f8a7e56a700 1 --2- 172.21.15.72:0/3710896132 >> v2:172.21.15.92:3300/0 conn(0x7f8a780bb0b0 0x7f8a78152b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:00.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.351+0000 7f8a7e56a700 1 --2- 172.21.15.72:0/3710896132 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8a780a9cc0 0x7f8a781525e0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:00.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.351+0000 7f8a7e56a700 1 -- 172.21.15.72:0/3710896132 >> 172.21.15.72:0/3710896132 conn(0x7f8a7806a8d0 msgr2=0x7f8a780a94e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:00.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.351+0000 7f8a7e56a700 1 -- 172.21.15.72:0/3710896132 shutdown_connections 2023-07-25T14:37:00.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.351+0000 7f8a7e56a700 1 -- 172.21.15.72:0/3710896132 wait complete. 2023-07-25T14:37:00.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.353+0000 7f8a7e56a700 1 Processor -- start 2023-07-25T14:37:00.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.353+0000 7f8a7e56a700 1 -- start start 2023-07-25T14:37:00.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.353+0000 7f8a7e56a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8a780a9cc0 0x7f8a780c0e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:00.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.353+0000 7f8a7e56a700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8a780bb0b0 0x7f8a7814d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:00.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.353+0000 7f8a7e56a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8a7814f810 0x7f8a7814de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:00.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.353+0000 7f8a7e56a700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a7814e960 con 0x7f8a780a9cc0 2023-07-25T14:37:00.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.353+0000 7f8a7e56a700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a780ab460 con 0x7f8a7814f810 2023-07-25T14:37:00.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.353+0000 7f8a7e56a700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a780ad830 con 0x7f8a780bb0b0 2023-07-25T14:37:00.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.353+0000 7f8a77fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8a780a9cc0 0x7f8a780c0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:00.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.354+0000 7f8a77fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8a780a9cc0 0x7f8a780c0e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42250/0 (socket says 172.21.15.72:42250) 2023-07-25T14:37:00.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.354+0000 7f8a77fff700 1 -- 172.21.15.72:0/659291549 learned_addr learned my addr 172.21.15.72:0/659291549 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:37:00.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.354+0000 7f8a777fe700 1 --2- 172.21.15.72:0/659291549 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8a780bb0b0 0x7f8a7814d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:00.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.354+0000 7f8a7cb07700 1 --2- 172.21.15.72:0/659291549 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8a7814f810 0x7f8a7814de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:00.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.354+0000 7f8a77fff700 1 -- 172.21.15.72:0/659291549 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8a780bb0b0 msgr2=0x7f8a7814d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:00.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.354+0000 7f8a77fff700 1 --2- 172.21.15.72:0/659291549 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8a780bb0b0 0x7f8a7814d940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:00.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.354+0000 7f8a77fff700 1 -- 172.21.15.72:0/659291549 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8a7814f810 msgr2=0x7f8a7814de80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:00.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.354+0000 7f8a77fff700 1 --2- 172.21.15.72:0/659291549 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8a7814f810 0x7f8a7814de80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:00.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.354+0000 7f8a77fff700 1 -- 172.21.15.72:0/659291549 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a70009a70 con 0x7f8a780a9cc0 2023-07-25T14:37:00.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.354+0000 7f8a77fff700 1 --2- 172.21.15.72:0/659291549 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8a780a9cc0 0x7f8a780c0e10 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f8a6c00c550 tx=0x7f8a6c00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:00.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.354+0000 7f8a74ff9700 1 -- 172.21.15.72:0/659291549 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a6c005cb0 con 0x7f8a780a9cc0 2023-07-25T14:37:00.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.354+0000 7f8a74ff9700 1 -- 172.21.15.72:0/659291549 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a6c005e10 con 0x7f8a780a9cc0 2023-07-25T14:37:00.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.354+0000 7f8a74ff9700 1 -- 172.21.15.72:0/659291549 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a6c0072d0 con 0x7f8a780a9cc0 2023-07-25T14:37:00.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.354+0000 7f8a7e56a700 1 -- 172.21.15.72:0/659291549 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a68009550 con 0x7f8a780a9cc0 2023-07-25T14:37:00.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.354+0000 7f8a7e56a700 1 -- 172.21.15.72:0/659291549 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a780ad550 con 0x7f8a780a9cc0 2023-07-25T14:37:00.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.355+0000 7f8a7e56a700 1 -- 172.21.15.72:0/659291549 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a7804e470 con 0x7f8a780a9cc0 2023-07-25T14:37:00.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.356+0000 7f8a74ff9700 1 -- 172.21.15.72:0/659291549 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8a6c007430 con 0x7f8a780a9cc0 2023-07-25T14:37:00.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.356+0000 7f8a74ff9700 1 --2- 172.21.15.72:0/659291549 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f8a6406ace0 0x7f8a6406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:00.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.356+0000 7f8a74ff9700 1 -- 172.21.15.72:0/659291549 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f8a6c0887b0 con 0x7f8a780a9cc0 2023-07-25T14:37:00.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.356+0000 7f8a777fe700 1 --2- 172.21.15.72:0/659291549 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f8a6406ace0 0x7f8a6406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:00.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.356+0000 7f8a777fe700 1 --2- 172.21.15.72:0/659291549 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f8a6406ace0 0x7f8a6406d1a0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f8a68014040 tx=0x7f8a68008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:00.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.360+0000 7f8a74ff9700 1 -- 172.21.15.72:0/659291549 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f8a6c053860 con 0x7f8a780a9cc0 2023-07-25T14:37:00.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.548+0000 7f8a7e56a700 1 -- 172.21.15.72:0/659291549 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8a780ad9a0 con 0x7f8a780a9cc0 2023-07-25T14:37:00.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.548+0000 7f8a74ff9700 1 -- 172.21.15.72:0/659291549 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v39) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8a6c086e60 con 0x7f8a780a9cc0 2023-07-25T14:37:00.560 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 64 2023-07-25T14:37:00.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.550+0000 7f8a7e56a700 1 -- 172.21.15.72:0/659291549 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f8a6406ace0 msgr2=0x7f8a6406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:00.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.550+0000 7f8a7e56a700 1 --2- 172.21.15.72:0/659291549 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f8a6406ace0 0x7f8a6406d1a0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f8a68014040 tx=0x7f8a68008030 comp rx=0 tx=0).stop 2023-07-25T14:37:00.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.550+0000 7f8a7e56a700 1 -- 172.21.15.72:0/659291549 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8a780a9cc0 msgr2=0x7f8a780c0e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:00.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.550+0000 7f8a7e56a700 1 --2- 172.21.15.72:0/659291549 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8a780a9cc0 0x7f8a780c0e10 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f8a6c00c550 tx=0x7f8a6c00c860 comp rx=0 tx=0).stop 2023-07-25T14:37:00.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.550+0000 7f8a7e56a700 1 -- 172.21.15.72:0/659291549 shutdown_connections 2023-07-25T14:37:00.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.550+0000 7f8a7e56a700 1 --2- 172.21.15.72:0/659291549 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f8a6406ace0 0x7f8a6406d1a0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:00.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.550+0000 7f8a7e56a700 1 --2- 172.21.15.72:0/659291549 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8a7814f810 0x7f8a7814de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:00.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.550+0000 7f8a7e56a700 1 --2- 172.21.15.72:0/659291549 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8a780a9cc0 0x7f8a780c0e10 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:00.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.550+0000 7f8a7e56a700 1 --2- 172.21.15.72:0/659291549 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8a780bb0b0 0x7f8a7814d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:00.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.550+0000 7f8a7e56a700 1 -- 172.21.15.72:0/659291549 >> 172.21.15.72:0/659291549 conn(0x7f8a7806a8d0 msgr2=0x7f8a780c67e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:00.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.550+0000 7f8a7e56a700 1 -- 172.21.15.72:0/659291549 shutdown_connections 2023-07-25T14:37:00.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.550+0000 7f8a7e56a700 1 -- 172.21.15.72:0/659291549 wait complete. 2023-07-25T14:37:00.574 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-07-25T14:37:00.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.682+0000 7f60c696e700 1 Processor -- start 2023-07-25T14:37:00.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.682+0000 7f60c696e700 1 -- start start 2023-07-25T14:37:00.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.683+0000 7f60c696e700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f60c0151ba0 0x7f60c00c2230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:00.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.683+0000 7f60c696e700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f60c00c5f40 0x7f60c0154640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:00.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.683+0000 7f60c696e700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60c00c54f0 con 0x7f60c00ba0e0 2023-07-25T14:37:00.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.683+0000 7f60c696e700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60c00c6670 con 0x7f60c0151ba0 2023-07-25T14:37:00.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.683+0000 7f60c696e700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60c00c5740 con 0x7f60c00c5f40 2023-07-25T14:37:00.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.683+0000 7f60bffff700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f60c0151ba0 0x7f60c00c2230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:00.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.683+0000 7f60bf7fe700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f60c00c5f40 0x7f60c0154640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:00.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.683+0000 7f60bffff700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f60c0151ba0 0x7f60c00c2230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.72:37830/0 (socket says 172.21.15.72:37830) 2023-07-25T14:37:00.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.683+0000 7f60bf7fe700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f60c00c5f40 0x7f60c0154640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3301/0 says I am v2:172.21.15.72:47486/0 (socket says 172.21.15.72:47486) 2023-07-25T14:37:00.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.683+0000 7f60c4f0b700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f60c00ba0e0 0x7f60c0071740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.72:56572/0 (socket says 172.21.15.72:56572) 2023-07-25T14:37:00.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.683+0000 7f60bffff700 1 -- 172.21.15.72:0/3556586386 learned_addr learned my addr 172.21.15.72:0/3556586386 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:37:00.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.684+0000 7f60bf7fe700 1 -- 172.21.15.72:0/3556586386 >> v2:172.21.15.92:3300/0 conn(0x7f60c0151ba0 msgr2=0x7f60c00c2230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:00.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.684+0000 7f60bf7fe700 1 --2- 172.21.15.72:0/3556586386 >> v2:172.21.15.92:3300/0 conn(0x7f60c0151ba0 0x7f60c00c2230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:00.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.684+0000 7f60bf7fe700 1 -- 172.21.15.72:0/3556586386 >> v1:172.21.15.92:6789/0 conn(0x7f60c00ba0e0 legacy=0x7f60c0071740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:00.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.684+0000 7f60bf7fe700 1 -- 172.21.15.72:0/3556586386 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60c00c5a20 con 0x7f60c00c5f40 2023-07-25T14:37:00.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.684+0000 7f60bffff700 1 --2- 172.21.15.72:0/3556586386 >> v2:172.21.15.92:3300/0 conn(0x7f60c0151ba0 0x7f60c00c2230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-25T14:37:00.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.684+0000 7f60bf7fe700 1 --2- 172.21.15.72:0/3556586386 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f60c00c5f40 0x7f60c0154640 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f60b0009840 tx=0x7f60b0009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=579018770c2d57d0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:00.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.684+0000 7f60beffd700 1 -- 172.21.15.72:0/3556586386 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60b0011830 con 0x7f60c00c5f40 2023-07-25T14:37:00.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.684+0000 7f60beffd700 1 -- 172.21.15.72:0/3556586386 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60b0011990 con 0x7f60c00c5f40 2023-07-25T14:37:00.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.684+0000 7f60beffd700 1 -- 172.21.15.72:0/3556586386 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60b0011d20 con 0x7f60c00c5f40 2023-07-25T14:37:00.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.685+0000 7f60c696e700 1 -- 172.21.15.72:0/3556586386 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f60c00c5f40 msgr2=0x7f60c0154640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:00.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.685+0000 7f60c696e700 1 --2- 172.21.15.72:0/3556586386 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f60c00c5f40 0x7f60c0154640 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f60b0009840 tx=0x7f60b0009b50 comp rx=0 tx=0).stop 2023-07-25T14:37:00.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.685+0000 7f60c696e700 1 -- 172.21.15.72:0/3556586386 shutdown_connections 2023-07-25T14:37:00.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.685+0000 7f60c696e700 1 --2- 172.21.15.72:0/3556586386 >> v2:172.21.15.92:3300/0 conn(0x7f60c0151ba0 0x7f60c00c2230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:00.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.685+0000 7f60c696e700 1 --2- 172.21.15.72:0/3556586386 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f60c00c5f40 0x7f60c0154640 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:00.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.685+0000 7f60c696e700 1 -- 172.21.15.72:0/3556586386 >> 172.21.15.72:0/3556586386 conn(0x7f60c00a87e0 msgr2=0x7f60c00a8bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:00.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.685+0000 7f60c696e700 1 -- 172.21.15.72:0/3556586386 shutdown_connections 2023-07-25T14:37:00.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.685+0000 7f60c696e700 1 -- 172.21.15.72:0/3556586386 wait complete. 2023-07-25T14:37:00.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.686+0000 7f60c696e700 1 Processor -- start 2023-07-25T14:37:00.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.686+0000 7f60c696e700 1 -- start start 2023-07-25T14:37:00.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.687+0000 7f60c696e700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f60c00ba0e0 0x7f60c01ea830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:00.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.687+0000 7f60c696e700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f60c00c5f40 0x7f60c0154d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:00.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.687+0000 7f60c696e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f60c0151ba0 0x7f60c00bf040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:00.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.687+0000 7f60c696e700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60c01e72b0 con 0x7f60c0151ba0 2023-07-25T14:37:00.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.687+0000 7f60c696e700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60c01e7590 con 0x7f60c00c5f40 2023-07-25T14:37:00.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.687+0000 7f60c696e700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60c01e9d50 con 0x7f60c00ba0e0 2023-07-25T14:37:00.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.687+0000 7f60c4f0b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f60c0151ba0 0x7f60c00bf040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:00.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.687+0000 7f60c4f0b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f60c0151ba0 0x7f60c00bf040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42268/0 (socket says 172.21.15.72:42268) 2023-07-25T14:37:00.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.687+0000 7f60c4f0b700 1 -- 172.21.15.72:0/183776339 learned_addr learned my addr 172.21.15.72:0/183776339 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:37:00.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.687+0000 7f60bffff700 1 --2- 172.21.15.72:0/183776339 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f60c00ba0e0 0x7f60c01ea830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:00.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.687+0000 7f60bf7fe700 1 --2- 172.21.15.72:0/183776339 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f60c00c5f40 0x7f60c0154d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:00.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.687+0000 7f60c4f0b700 1 -- 172.21.15.72:0/183776339 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f60c00ba0e0 msgr2=0x7f60c01ea830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:00.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.687+0000 7f60c4f0b700 1 --2- 172.21.15.72:0/183776339 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f60c00ba0e0 0x7f60c01ea830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:00.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.687+0000 7f60c4f0b700 1 -- 172.21.15.72:0/183776339 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f60c00c5f40 msgr2=0x7f60c0154d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:00.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.687+0000 7f60c4f0b700 1 --2- 172.21.15.72:0/183776339 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f60c00c5f40 0x7f60c0154d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:00.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.687+0000 7f60c4f0b700 1 -- 172.21.15.72:0/183776339 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60b4009550 con 0x7f60c0151ba0 2023-07-25T14:37:00.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.687+0000 7f60bf7fe700 1 --2- 172.21.15.72:0/183776339 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f60c00c5f40 0x7f60c0154d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-25T14:37:00.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.687+0000 7f60c4f0b700 1 --2- 172.21.15.72:0/183776339 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f60c0151ba0 0x7f60c00bf040 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f60b800cba0 tx=0x7f60b800cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:00.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.687+0000 7f60bcff9700 1 -- 172.21.15.72:0/183776339 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60b800ab80 con 0x7f60c0151ba0 2023-07-25T14:37:00.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.687+0000 7f60bcff9700 1 -- 172.21.15.72:0/183776339 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60b800ace0 con 0x7f60c0151ba0 2023-07-25T14:37:00.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.687+0000 7f60bcff9700 1 -- 172.21.15.72:0/183776339 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60b8007270 con 0x7f60c0151ba0 2023-07-25T14:37:00.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.687+0000 7f60c696e700 1 -- 172.21.15.72:0/183776339 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60b00094a0 con 0x7f60c0151ba0 2023-07-25T14:37:00.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.687+0000 7f60c696e700 1 -- 172.21.15.72:0/183776339 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60c01ea310 con 0x7f60c0151ba0 2023-07-25T14:37:00.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.688+0000 7f60c696e700 1 -- 172.21.15.72:0/183776339 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60c014f650 con 0x7f60c0151ba0 2023-07-25T14:37:00.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.689+0000 7f60bcff9700 1 -- 172.21.15.72:0/183776339 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f60b80073d0 con 0x7f60c0151ba0 2023-07-25T14:37:00.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.689+0000 7f60bcff9700 1 --2- 172.21.15.72:0/183776339 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f60ac06ace0 0x7f60ac06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:00.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.689+0000 7f60bcff9700 1 -- 172.21.15.72:0/183776339 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f60b8089310 con 0x7f60c0151ba0 2023-07-25T14:37:00.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.689+0000 7f60bffff700 1 --2- 172.21.15.72:0/183776339 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f60ac06ace0 0x7f60ac06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:00.706 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.690+0000 7f60bffff700 1 --2- 172.21.15.72:0/183776339 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f60ac06ace0 0x7f60ac06d1a0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f60b4009c50 tx=0x7f60b4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:00.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.694+0000 7f60bcff9700 1 -- 172.21.15.72:0/183776339 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f60b8054330 con 0x7f60c0151ba0 2023-07-25T14:37:00.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.882+0000 7f60c696e700 1 -- 172.21.15.72:0/183776339 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f60c01e7030 con 0x7f60c0151ba0 2023-07-25T14:37:00.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.882+0000 7f60bcff9700 1 -- 172.21.15.72:0/183776339 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v39) v1 ==== 84+0+268 (secure 0 0 0) 0x7f60b8017090 con 0x7f60c0151ba0 2023-07-25T14:37:00.894 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-25T14:37:00.894 INFO:teuthology.orchestra.run.smithi072.stdout:[ 2023-07-25T14:37:00.894 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-07-25T14:37:00.894 INFO:teuthology.orchestra.run.smithi072.stdout: "poolnum": 1, 2023-07-25T14:37:00.895 INFO:teuthology.orchestra.run.smithi072.stdout: "poolname": "rbd" 2023-07-25T14:37:00.895 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-07-25T14:37:00.895 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-07-25T14:37:00.895 INFO:teuthology.orchestra.run.smithi072.stdout: "poolnum": 2, 2023-07-25T14:37:00.895 INFO:teuthology.orchestra.run.smithi072.stdout: "poolname": ".mgr" 2023-07-25T14:37:00.895 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-07-25T14:37:00.895 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-07-25T14:37:00.895 INFO:teuthology.orchestra.run.smithi072.stdout: "poolnum": 6, 2023-07-25T14:37:00.896 INFO:teuthology.orchestra.run.smithi072.stdout: "poolname": "cephfs_metadata" 2023-07-25T14:37:00.896 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-07-25T14:37:00.896 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-07-25T14:37:00.896 INFO:teuthology.orchestra.run.smithi072.stdout: "poolnum": 7, 2023-07-25T14:37:00.896 INFO:teuthology.orchestra.run.smithi072.stdout: "poolname": "cephfs_data" 2023-07-25T14:37:00.896 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-07-25T14:37:00.896 INFO:teuthology.orchestra.run.smithi072.stdout:] 2023-07-25T14:37:00.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.884+0000 7f60c696e700 1 -- 172.21.15.72:0/183776339 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f60ac06ace0 msgr2=0x7f60ac06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:00.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.884+0000 7f60c696e700 1 --2- 172.21.15.72:0/183776339 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f60ac06ace0 0x7f60ac06d1a0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f60b4009c50 tx=0x7f60b4008040 comp rx=0 tx=0).stop 2023-07-25T14:37:00.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.884+0000 7f60c696e700 1 -- 172.21.15.72:0/183776339 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f60c0151ba0 msgr2=0x7f60c00bf040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:00.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.884+0000 7f60c696e700 1 --2- 172.21.15.72:0/183776339 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f60c0151ba0 0x7f60c00bf040 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f60b800cba0 tx=0x7f60b800cf60 comp rx=0 tx=0).stop 2023-07-25T14:37:00.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.884+0000 7f60c696e700 1 -- 172.21.15.72:0/183776339 shutdown_connections 2023-07-25T14:37:00.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.884+0000 7f60c696e700 1 --2- 172.21.15.72:0/183776339 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f60ac06ace0 0x7f60ac06d1a0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:00.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.884+0000 7f60c696e700 1 --2- 172.21.15.72:0/183776339 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f60c00ba0e0 0x7f60c01ea830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:00.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.884+0000 7f60c696e700 1 --2- 172.21.15.72:0/183776339 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f60c0151ba0 0x7f60c00bf040 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:00.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.884+0000 7f60c696e700 1 --2- 172.21.15.72:0/183776339 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f60c00c5f40 0x7f60c0154d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:00.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.884+0000 7f60c696e700 1 -- 172.21.15.72:0/183776339 >> 172.21.15.72:0/183776339 conn(0x7f60c00a87e0 msgr2=0x7f60c0071640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:00.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.884+0000 7f60c696e700 1 -- 172.21.15.72:0/183776339 shutdown_connections 2023-07-25T14:37:00.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:00.884+0000 7f60c696e700 1 -- 172.21.15.72:0/183776339 wait complete. 2023-07-25T14:37:00.908 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs2' 2023-07-25T14:37:00.908 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs2_metadata --pg_num_min 64 2023-07-25T14:37:01.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:01.021+0000 7f055c244700 1 Processor -- start 2023-07-25T14:37:01.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:01.021+0000 7f055c244700 1 -- start start 2023-07-25T14:37:01.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:01.022+0000 7f055c244700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f05540c5b90 0x7f05540c6d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:01.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:01.022+0000 7f055c244700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05540c5250 con 0x7f05540c49d0 2023-07-25T14:37:01.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:01.022+0000 7f055c244700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05540c5530 con 0x7f05540c5f70 2023-07-25T14:37:01.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:01.022+0000 7f055c244700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05540c6520 con 0x7f05540c5b90 2023-07-25T14:37:01.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:01.022+0000 7f05597df700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f05540c49d0 0x7f055406db00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:33010/0 (socket says 172.21.15.72:33010) 2023-07-25T14:37:01.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:01.022+0000 7f05597df700 1 -- 172.21.15.72:0/2104772293 learned_addr learned my addr 172.21.15.72:0/2104772293 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:37:01.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:01.022+0000 7f0559fe0700 1 --2- 172.21.15.72:0/2104772293 >> v2:172.21.15.92:3300/0 conn(0x7f05540c5b90 0x7f05540c6d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:01.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:01.022+0000 7f0558fde700 1 -- 172.21.15.72:0/2104772293 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3700706742 0 0) 0x7f05540c5250 con 0x7f05540c49d0 2023-07-25T14:37:01.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:01.022+0000 7f0558fde700 1 -- 172.21.15.72:0/2104772293 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f05400035b0 con 0x7f05540c49d0 2023-07-25T14:37:01.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:01.022+0000 7f0558fde700 1 -- 172.21.15.72:0/2104772293 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2544154668 0 0) 0x7f05400035b0 con 0x7f05540c49d0 2023-07-25T14:37:01.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:01.022+0000 7f0558fde700 1 -- 172.21.15.72:0/2104772293 >> v2:172.21.15.92:3300/0 conn(0x7f05540c5b90 msgr2=0x7f05540c6d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:01.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:01.022+0000 7f0558fde700 1 --2- 172.21.15.72:0/2104772293 >> v2:172.21.15.92:3300/0 conn(0x7f05540c5b90 0x7f05540c6d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:01.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:01.022+0000 7f0558fde700 1 -- 172.21.15.72:0/2104772293 >> v1:172.21.15.92:6789/0 conn(0x7f05540c5f70 legacy=0x7f0554154c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:01.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:01.022+0000 7f0558fde700 1 -- 172.21.15.72:0/2104772293 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05540c6800 con 0x7f05540c49d0 2023-07-25T14:37:01.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:01.022+0000 7f0558fde700 1 -- 172.21.15.72:0/2104772293 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2559588315 0 0) 0x7f0544001670 con 0x7f05540c49d0 2023-07-25T14:37:01.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:01.022+0000 7f0558fde700 1 -- 172.21.15.72:0/2104772293 >> v1:172.21.15.72:6789/0 conn(0x7f05540c49d0 legacy=0x7f055406db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:01.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:01.022+0000 7f0558fde700 1 --2- 172.21.15.72:0/2104772293 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0540003a00 0x7f0540003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:01.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:01.022+0000 7f0558fde700 1 --2- 172.21.15.72:0/2104772293 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0540004850 0x7f0540004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:01.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:01.022+0000 7f0558fde700 1 --2- 172.21.15.72:0/2104772293 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0540005210 0x7f054000dc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:01.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:01.022+0000 7f0558fde700 1 -- 172.21.15.72:0/2104772293 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05540c6520 con 0x7f0540003a00 2023-07-25T14:37:01.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:01.022+0000 7f0558fde700 1 -- 172.21.15.72:0/2104772293 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f054000e2c0 con 0x7f0540005210 2023-07-25T14:37:01.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:01.022+0000 7f0558fde700 1 -- 172.21.15.72:0/2104772293 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f054000e480 con 0x7f0540004850 2023-07-25T14:37:01.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:01.023+0000 7f0559fe0700 1 --2- 172.21.15.72:0/2104772293 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0540003a00 0x7f0540003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:01.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:01.023+0000 7f055a7e1700 1 --2- 172.21.15.72:0/2104772293 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0540005210 0x7f054000dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:01.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:01.023+0000 7f05597df700 1 --2- 172.21.15.72:0/2104772293 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0540004850 0x7f0540004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:01.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:01.023+0000 7f0559fe0700 1 -- 172.21.15.72:0/2104772293 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0540004850 msgr2=0x7f0540004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:01.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:01.023+0000 7f0559fe0700 1 --2- 172.21.15.72:0/2104772293 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0540004850 0x7f0540004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:01.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:01.023+0000 7f0559fe0700 1 -- 172.21.15.72:0/2104772293 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0540005210 msgr2=0x7f054000dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:01.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:01.023+0000 7f0559fe0700 1 --2- 172.21.15.72:0/2104772293 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0540005210 0x7f054000dc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:01.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:01.023+0000 7f0559fe0700 1 -- 172.21.15.72:0/2104772293 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05400035b0 con 0x7f0540003a00 2023-07-25T14:37:01.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:01.023+0000 7f055a7e1700 1 --2- 172.21.15.72:0/2104772293 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0540005210 0x7f054000dc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-25T14:37:01.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:01.023+0000 7f05597df700 1 --2- 172.21.15.72:0/2104772293 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0540004850 0x7f0540004cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-25T14:37:01.042 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:01.023+0000 7f055a7e1700 1 -- 172.21.15.72:0/2104772293 reap_dead start 2023-07-25T14:37:01.042 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:01.023+0000 7f0559fe0700 1 --2- 172.21.15.72:0/2104772293 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0540003a00 0x7f0540003e20 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f0550009b60 tx=0x7f0540005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95893db8f443e768 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:01.042 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:01.023+0000 7f0558fde700 1 -- 172.21.15.72:0/2104772293 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f055000e6c0 con 0x7f0540003a00 2023-07-25T14:37:01.042 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:01.023+0000 7f0558fde700 1 -- 172.21.15.72:0/2104772293 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f055000e820 con 0x7f0540003a00 2023-07-25T14:37:01.042 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:01.023+0000 7f0558fde700 1 -- 172.21.15.72:0/2104772293 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f055000eb90 con 0x7f0540003a00 2023-07-25T14:37:01.042 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:01.024+0000 7f055c244700 1 -- 172.21.15.72:0/2104772293 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0540003a00 msgr2=0x7f0540003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:01.042 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:01.024+0000 7f055c244700 1 --2- 172.21.15.72:0/2104772293 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0540003a00 0x7f0540003e20 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f0550009b60 tx=0x7f0540005880 comp rx=0 tx=0).stop 2023-07-25T14:37:01.042 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:01.024+0000 7f055c244700 1 -- 172.21.15.72:0/2104772293 shutdown_connections 2023-07-25T14:37:01.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:01.024+0000 7f055c244700 1 --2- 172.21.15.72:0/2104772293 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0540003a00 0x7f0540003e20 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:01.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:01.024+0000 7f055c244700 1 -- 172.21.15.72:0/2104772293 >> 172.21.15.72:0/2104772293 conn(0x7f055406bbc0 msgr2=0x7f05540a8590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:01.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:01.024+0000 7f055c244700 1 -- 172.21.15.72:0/2104772293 shutdown_connections 2023-07-25T14:37:01.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:01.024+0000 7f055c244700 1 -- 172.21.15.72:0/2104772293 wait complete. 2023-07-25T14:37:01.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:01.025+0000 7f055c244700 1 Processor -- start 2023-07-25T14:37:01.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:01.025+0000 7f055c244700 1 -- start start 2023-07-25T14:37:01.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:01.026+0000 7f055c244700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0540003a00 0x7f055414d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:01.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:01.026+0000 7f055c244700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f055414eb50 0x7f05541db9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:01.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:01.026+0000 7f055c244700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f05541dbf20 0x7f05541471c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:01.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:01.026+0000 7f055c244700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05541daec0 con 0x7f055414eb50 2023-07-25T14:37:01.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:01.026+0000 7f055c244700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05540a6c20 con 0x7f05541dbf20 2023-07-25T14:37:01.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:01.026+0000 7f055c244700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05540a66f0 con 0x7f0540003a00 2023-07-25T14:37:01.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:01.026+0000 7f05597df700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f055414eb50 0x7f05541db9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:01.047 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:01.026+0000 7f05597df700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f055414eb50 0x7f05541db9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42286/0 (socket says 172.21.15.72:42286) 2023-07-25T14:37:01.047 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:01.026+0000 7f05597df700 1 -- 172.21.15.72:0/618014305 learned_addr learned my addr 172.21.15.72:0/618014305 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:37:01.047 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:01.026+0000 7f05597df700 1 -- 172.21.15.72:0/618014305 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0540003a00 msgr2=0x7f055414d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:01.047 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:01.026+0000 7f05597df700 1 --2- 172.21.15.72:0/618014305 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0540003a00 0x7f055414d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:01.047 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:01.026+0000 7f05597df700 1 -- 172.21.15.72:0/618014305 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f05541dbf20 msgr2=0x7f05541471c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:01.047 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:01.026+0000 7f05597df700 1 --2- 172.21.15.72:0/618014305 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f05541dbf20 0x7f05541471c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:01.047 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:01.026+0000 7f05597df700 1 -- 172.21.15.72:0/618014305 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f055414e6c0 con 0x7f055414eb50 2023-07-25T14:37:01.048 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:01.026+0000 7f05597df700 1 --2- 172.21.15.72:0/618014305 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f055414eb50 0x7f05541db9e0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f054400eb20 tx=0x7f054400eee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:01.048 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:01.026+0000 7f054a7fc700 1 -- 172.21.15.72:0/618014305 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f054400c5d0 con 0x7f055414eb50 2023-07-25T14:37:01.048 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:01.026+0000 7f054a7fc700 1 -- 172.21.15.72:0/618014305 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f054400c730 con 0x7f055414eb50 2023-07-25T14:37:01.048 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:01.026+0000 7f055c244700 1 -- 172.21.15.72:0/618014305 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05540a6940 con 0x7f055414eb50 2023-07-25T14:37:01.048 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:01.026+0000 7f054a7fc700 1 -- 172.21.15.72:0/618014305 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f054400caa0 con 0x7f055414eb50 2023-07-25T14:37:01.048 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:01.026+0000 7f055c244700 1 -- 172.21.15.72:0/618014305 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f055414e350 con 0x7f055414eb50 2023-07-25T14:37:01.048 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:01.027+0000 7f055c244700 1 -- 172.21.15.72:0/618014305 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f055414ded0 con 0x7f055414eb50 2023-07-25T14:37:01.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:01.028+0000 7f054a7fc700 1 -- 172.21.15.72:0/618014305 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f054400cc00 con 0x7f055414eb50 2023-07-25T14:37:01.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:01.028+0000 7f054a7fc700 1 --2- 172.21.15.72:0/618014305 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f053806ace0 0x7f053806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:01.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:01.028+0000 7f054a7fc700 1 -- 172.21.15.72:0/618014305 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f05440893a0 con 0x7f055414eb50 2023-07-25T14:37:01.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:01.028+0000 7f0559fe0700 1 --2- 172.21.15.72:0/618014305 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f053806ace0 0x7f053806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:01.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:01.029+0000 7f0559fe0700 1 --2- 172.21.15.72:0/618014305 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f053806ace0 0x7f053806d1a0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f055414b8f0 tx=0x7f0550013000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:01.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:01.032+0000 7f054a7fc700 1 -- 172.21.15.72:0/618014305 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f055414ded0 con 0x7f055414eb50 2023-07-25T14:37:01.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:01.219+0000 7f055c244700 1 -- 172.21.15.72:0/618014305 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs2_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f055414ded0 con 0x7f055414eb50 2023-07-25T14:37:01.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:01.242+0000 7f054a7fc700 1 -- 172.21.15.72:0/618014305 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs2_metadata", "pg_num_min": 64}]=0 pool 'cephfs2_metadata' created v40) v1 ==== 140+0+0 (secure 0 0 0) 0x7f055414ded0 con 0x7f055414eb50 2023-07-25T14:37:01.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:01.247+0000 7f055c244700 1 -- 172.21.15.72:0/618014305 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f053806ace0 msgr2=0x7f053806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:01.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:01.247+0000 7f055c244700 1 --2- 172.21.15.72:0/618014305 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f053806ace0 0x7f053806d1a0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f055414b8f0 tx=0x7f0550013000 comp rx=0 tx=0).stop 2023-07-25T14:37:01.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:01.247+0000 7f055c244700 1 -- 172.21.15.72:0/618014305 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f055414eb50 msgr2=0x7f05541db9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:01.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:01.247+0000 7f055c244700 1 --2- 172.21.15.72:0/618014305 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f055414eb50 0x7f05541db9e0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f054400eb20 tx=0x7f054400eee0 comp rx=0 tx=0).stop 2023-07-25T14:37:01.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:01.247+0000 7f055c244700 1 -- 172.21.15.72:0/618014305 shutdown_connections 2023-07-25T14:37:01.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:01.247+0000 7f055c244700 1 --2- 172.21.15.72:0/618014305 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f053806ace0 0x7f053806d1a0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:01.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:01.247+0000 7f055c244700 1 --2- 172.21.15.72:0/618014305 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0540003a00 0x7f055414d2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:01.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:01.247+0000 7f055c244700 1 --2- 172.21.15.72:0/618014305 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f05541dbf20 0x7f05541471c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:01.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:01.247+0000 7f055c244700 1 --2- 172.21.15.72:0/618014305 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f055414eb50 0x7f05541db9e0 secure :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f054400eb20 tx=0x7f054400eee0 comp rx=0 tx=0).stop 2023-07-25T14:37:01.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:01.247+0000 7f055c244700 1 -- 172.21.15.72:0/618014305 >> 172.21.15.72:0/618014305 conn(0x7f055406bbc0 msgr2=0x7f0554154a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:01.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:01.248+0000 7f055c244700 1 -- 172.21.15.72:0/618014305 shutdown_connections 2023-07-25T14:37:01.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:01.249+0000 7f055c244700 1 -- 172.21.15.72:0/618014305 wait complete. 2023-07-25T14:37:01.263 INFO:teuthology.orchestra.run.smithi072.stderr:pool 'cephfs2_metadata' created 2023-07-25T14:37:01.273 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs2_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-07-25T14:37:01.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:01.388+0000 7f19dfb1a700 1 Processor -- start 2023-07-25T14:37:01.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:01.388+0000 7f19dfb1a700 1 -- start start 2023-07-25T14:37:01.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:01.389+0000 7f19dfb1a700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f19d80724c0 0x7f19d80c34c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:01.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:01.389+0000 7f19dfb1a700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19d80c2fe0 con 0x7f19d8151950 2023-07-25T14:37:01.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:01.389+0000 7f19dfb1a700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19d8155070 con 0x7f19d80c4930 2023-07-25T14:37:01.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:01.389+0000 7f19dfb1a700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19d8071a60 con 0x7f19d80724c0 2023-07-25T14:37:01.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:01.389+0000 7f19dd8b6700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f19d8151950 0x7f19d806a190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:33028/0 (socket says 172.21.15.72:33028) 2023-07-25T14:37:01.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:01.389+0000 7f19dd8b6700 1 -- 172.21.15.72:0/882532318 learned_addr learned my addr 172.21.15.72:0/882532318 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:37:01.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:01.389+0000 7f19dd0b5700 1 --2- 172.21.15.72:0/882532318 >> v2:172.21.15.92:3300/0 conn(0x7f19d80724c0 0x7f19d80c34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:01.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:01.389+0000 7f19dc8b4700 1 -- 172.21.15.72:0/882532318 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3522703173 0 0) 0x7f19d80c2fe0 con 0x7f19d8151950 2023-07-25T14:37:01.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:01.389+0000 7f19dc8b4700 1 -- 172.21.15.72:0/882532318 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f19c40035b0 con 0x7f19d8151950 2023-07-25T14:37:01.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:01.390+0000 7f19dc8b4700 1 -- 172.21.15.72:0/882532318 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 505676165 0 0) 0x7f19c40035b0 con 0x7f19d8151950 2023-07-25T14:37:01.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:01.390+0000 7f19dc8b4700 1 -- 172.21.15.72:0/882532318 >> v2:172.21.15.92:3300/0 conn(0x7f19d80724c0 msgr2=0x7f19d80c34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:01.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:01.390+0000 7f19dc8b4700 1 --2- 172.21.15.72:0/882532318 >> v2:172.21.15.92:3300/0 conn(0x7f19d80724c0 0x7f19d80c34c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:01.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:01.390+0000 7f19dc8b4700 1 -- 172.21.15.72:0/882532318 >> v1:172.21.15.92:6789/0 conn(0x7f19d80c4930 legacy=0x7f19d80c3a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:01.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:01.390+0000 7f19dc8b4700 1 -- 172.21.15.72:0/882532318 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19d80c15c0 con 0x7f19d8151950 2023-07-25T14:37:01.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:01.390+0000 7f19dc8b4700 1 -- 172.21.15.72:0/882532318 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2559588315 0 0) 0x7f19c8001670 con 0x7f19d8151950 2023-07-25T14:37:01.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:01.390+0000 7f19dc8b4700 1 -- 172.21.15.72:0/882532318 >> v1:172.21.15.72:6789/0 conn(0x7f19d8151950 legacy=0x7f19d806a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:01.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:01.390+0000 7f19dc8b4700 1 --2- 172.21.15.72:0/882532318 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f19c4003a00 0x7f19c4003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:01.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:01.390+0000 7f19dc8b4700 1 --2- 172.21.15.72:0/882532318 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f19c4004850 0x7f19c4004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:01.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:01.390+0000 7f19dc8b4700 1 --2- 172.21.15.72:0/882532318 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f19c4005210 0x7f19c400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:01.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:01.390+0000 7f19dc8b4700 1 -- 172.21.15.72:0/882532318 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19d8071a60 con 0x7f19c4004850 2023-07-25T14:37:01.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:01.390+0000 7f19dc8b4700 1 -- 172.21.15.72:0/882532318 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19c400c1b0 con 0x7f19c4005210 2023-07-25T14:37:01.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:01.390+0000 7f19dc8b4700 1 -- 172.21.15.72:0/882532318 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19c400c370 con 0x7f19c4003a00 2023-07-25T14:37:01.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:01.390+0000 7f19dd0b5700 1 --2- 172.21.15.72:0/882532318 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f19c4004850 0x7f19c4004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:01.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:01.390+0000 7f19dd8b6700 1 --2- 172.21.15.72:0/882532318 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f19c4003a00 0x7f19c4003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:01.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:01.390+0000 7f19de0b7700 1 --2- 172.21.15.72:0/882532318 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f19c4005210 0x7f19c400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:01.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:01.390+0000 7f19dd0b5700 1 -- 172.21.15.72:0/882532318 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f19c4003a00 msgr2=0x7f19c4003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:01.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:01.390+0000 7f19dd0b5700 1 --2- 172.21.15.72:0/882532318 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f19c4003a00 0x7f19c4003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:01.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:01.390+0000 7f19dd0b5700 1 -- 172.21.15.72:0/882532318 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f19c4005210 msgr2=0x7f19c400ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:01.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:01.390+0000 7f19dd0b5700 1 --2- 172.21.15.72:0/882532318 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f19c4005210 0x7f19c400ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:01.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:01.390+0000 7f19dd0b5700 1 -- 172.21.15.72:0/882532318 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19c40035b0 con 0x7f19c4004850 2023-07-25T14:37:01.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:01.390+0000 7f19de0b7700 1 --2- 172.21.15.72:0/882532318 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f19c4005210 0x7f19c400ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-25T14:37:01.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:01.390+0000 7f19dd8b6700 1 --2- 172.21.15.72:0/882532318 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f19c4003a00 0x7f19c4003e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-25T14:37:01.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:01.390+0000 7f19de0b7700 1 -- 172.21.15.72:0/882532318 reap_dead start 2023-07-25T14:37:01.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:01.390+0000 7f19dd0b5700 1 --2- 172.21.15.72:0/882532318 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f19c4004850 0x7f19c4004cd0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f19d4009b60 tx=0x7f19c4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ad25ff8e7ee9354 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:01.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:01.390+0000 7f19dc8b4700 1 -- 172.21.15.72:0/882532318 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19d400e6c0 con 0x7f19c4004850 2023-07-25T14:37:01.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:01.390+0000 7f19dc8b4700 1 -- 172.21.15.72:0/882532318 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19d400e820 con 0x7f19c4004850 2023-07-25T14:37:01.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:01.390+0000 7f19dc8b4700 1 -- 172.21.15.72:0/882532318 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19d400eb90 con 0x7f19c4004850 2023-07-25T14:37:01.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:01.391+0000 7f19dfb1a700 1 -- 172.21.15.72:0/882532318 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f19c4004850 msgr2=0x7f19c4004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:01.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:01.391+0000 7f19dfb1a700 1 --2- 172.21.15.72:0/882532318 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f19c4004850 0x7f19c4004cd0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f19d4009b60 tx=0x7f19c4005880 comp rx=0 tx=0).stop 2023-07-25T14:37:01.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:01.391+0000 7f19dfb1a700 1 -- 172.21.15.72:0/882532318 shutdown_connections 2023-07-25T14:37:01.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:01.391+0000 7f19dfb1a700 1 --2- 172.21.15.72:0/882532318 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f19c4004850 0x7f19c4004cd0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:01.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:01.391+0000 7f19dfb1a700 1 -- 172.21.15.72:0/882532318 >> 172.21.15.72:0/882532318 conn(0x7f19d80a87e0 msgr2=0x7f19d80a8bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:01.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:01.391+0000 7f19dfb1a700 1 -- 172.21.15.72:0/882532318 shutdown_connections 2023-07-25T14:37:01.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:01.391+0000 7f19dfb1a700 1 -- 172.21.15.72:0/882532318 wait complete. 2023-07-25T14:37:01.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:01.392+0000 7f19dfb1a700 1 Processor -- start 2023-07-25T14:37:01.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:01.392+0000 7f19dfb1a700 1 -- start start 2023-07-25T14:37:01.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:01.393+0000 7f19dfb1a700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f19c4004850 0x7f19d80ac330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:01.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:01.393+0000 7f19dfb1a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f19d81e9460 0x7f19d814d030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:01.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:01.393+0000 7f19dfb1a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f19d814d570 0x7f19d8152560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:01.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:01.393+0000 7f19dfb1a700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19d814b7f0 con 0x7f19d81e9460 2023-07-25T14:37:01.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:01.393+0000 7f19dfb1a700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19d81520d0 con 0x7f19d814d570 2023-07-25T14:37:01.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:01.393+0000 7f19dfb1a700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19d8155dc0 con 0x7f19c4004850 2023-07-25T14:37:01.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:01.393+0000 7f19dd0b5700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f19d81e9460 0x7f19d814d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:01.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:01.393+0000 7f19dd0b5700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f19d81e9460 0x7f19d814d030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42306/0 (socket says 172.21.15.72:42306) 2023-07-25T14:37:01.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:01.393+0000 7f19dd0b5700 1 -- 172.21.15.72:0/2005462610 learned_addr learned my addr 172.21.15.72:0/2005462610 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:37:01.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:01.393+0000 7f19de0b7700 1 --2- 172.21.15.72:0/2005462610 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f19d814d570 0x7f19d8152560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:01.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:01.393+0000 7f19dd8b6700 1 --2- 172.21.15.72:0/2005462610 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f19c4004850 0x7f19d80ac330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:01.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:01.393+0000 7f19dd0b5700 1 -- 172.21.15.72:0/2005462610 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f19c4004850 msgr2=0x7f19d80ac330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:01.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:01.393+0000 7f19dd0b5700 1 --2- 172.21.15.72:0/2005462610 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f19c4004850 0x7f19d80ac330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:01.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:01.393+0000 7f19dd0b5700 1 -- 172.21.15.72:0/2005462610 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f19d814d570 msgr2=0x7f19d8152560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:01.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:01.393+0000 7f19dd0b5700 1 --2- 172.21.15.72:0/2005462610 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f19d814d570 0x7f19d8152560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:01.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:01.393+0000 7f19dd0b5700 1 -- 172.21.15.72:0/2005462610 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19d81e9960 con 0x7f19d81e9460 2023-07-25T14:37:01.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:01.393+0000 7f19de0b7700 1 --2- 172.21.15.72:0/2005462610 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f19d814d570 0x7f19d8152560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-25T14:37:01.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:01.393+0000 7f19dd0b5700 1 --2- 172.21.15.72:0/2005462610 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f19d81e9460 0x7f19d814d030 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f19d400e4b0 tx=0x7f19d40047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:01.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:01.393+0000 7f19ce7fc700 1 -- 172.21.15.72:0/2005462610 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19d400e6c0 con 0x7f19d81e9460 2023-07-25T14:37:01.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:01.394+0000 7f19ce7fc700 1 -- 172.21.15.72:0/2005462610 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19d4003ad0 con 0x7f19d81e9460 2023-07-25T14:37:01.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:01.394+0000 7f19dfb1a700 1 -- 172.21.15.72:0/2005462610 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19d81e9c40 con 0x7f19d81e9460 2023-07-25T14:37:01.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:01.394+0000 7f19ce7fc700 1 -- 172.21.15.72:0/2005462610 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19d4003e80 con 0x7f19d81e9460 2023-07-25T14:37:01.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:01.394+0000 7f19dfb1a700 1 -- 172.21.15.72:0/2005462610 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19d81ea200 con 0x7f19d81e9460 2023-07-25T14:37:01.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:01.394+0000 7f19dfb1a700 1 -- 172.21.15.72:0/2005462610 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19d81ea390 con 0x7f19d81e9460 2023-07-25T14:37:01.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:01.395+0000 7f19ce7fc700 1 -- 172.21.15.72:0/2005462610 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f19d4013470 con 0x7f19d81e9460 2023-07-25T14:37:01.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:01.395+0000 7f19ce7fc700 1 --2- 172.21.15.72:0/2005462610 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f19bc06ace0 0x7f19bc06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:01.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:01.396+0000 7f19dd8b6700 1 --2- 172.21.15.72:0/2005462610 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f19bc06ace0 0x7f19bc06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:01.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:01.396+0000 7f19ce7fc700 1 -- 172.21.15.72:0/2005462610 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6753+0+0 (secure 0 0 0) 0x7f19d408aec0 con 0x7f19d81e9460 2023-07-25T14:37:01.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:01.396+0000 7f19dd8b6700 1 --2- 172.21.15.72:0/2005462610 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f19bc06ace0 0x7f19bc06d1a0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f19c8000fb0 tx=0x7f19c8001150 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:01.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:01.400+0000 7f19ce7fc700 1 -- 172.21.15.72:0/2005462610 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f19d4055e60 con 0x7f19d81e9460 2023-07-25T14:37:01.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:01.590+0000 7f19dfb1a700 1 -- 172.21.15.72:0/2005462610 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs2_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f19d8152240 con 0x7f19d81e9460 2023-07-25T14:37:02.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:02.245+0000 7f19ce7fc700 1 -- 172.21.15.72:0/2005462610 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs2_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs2_data' created v41) v1 ==== 172+0+0 (secure 0 0 0) 0x7f19d4059480 con 0x7f19d81e9460 2023-07-25T14:37:02.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:02.253+0000 7f19dfb1a700 1 -- 172.21.15.72:0/2005462610 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f19bc06ace0 msgr2=0x7f19bc06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:02.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:02.253+0000 7f19dfb1a700 1 --2- 172.21.15.72:0/2005462610 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f19bc06ace0 0x7f19bc06d1a0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f19c8000fb0 tx=0x7f19c8001150 comp rx=0 tx=0).stop 2023-07-25T14:37:02.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:02.253+0000 7f19dfb1a700 1 -- 172.21.15.72:0/2005462610 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f19d81e9460 msgr2=0x7f19d814d030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:02.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:02.253+0000 7f19dfb1a700 1 --2- 172.21.15.72:0/2005462610 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f19d81e9460 0x7f19d814d030 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f19d400e4b0 tx=0x7f19d40047c0 comp rx=0 tx=0).stop 2023-07-25T14:37:02.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:02.253+0000 7f19dfb1a700 1 -- 172.21.15.72:0/2005462610 shutdown_connections 2023-07-25T14:37:02.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:02.253+0000 7f19dfb1a700 1 --2- 172.21.15.72:0/2005462610 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f19bc06ace0 0x7f19bc06d1a0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:02.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:02.253+0000 7f19dfb1a700 1 --2- 172.21.15.72:0/2005462610 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f19c4004850 0x7f19d80ac330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:02.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:02.253+0000 7f19dfb1a700 1 --2- 172.21.15.72:0/2005462610 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f19d814d570 0x7f19d8152560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:02.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:02.253+0000 7f19dfb1a700 1 --2- 172.21.15.72:0/2005462610 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f19d81e9460 0x7f19d814d030 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:02.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:02.253+0000 7f19dfb1a700 1 -- 172.21.15.72:0/2005462610 >> 172.21.15.72:0/2005462610 conn(0x7f19d80a87e0 msgr2=0x7f19d80c69f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:02.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:02.257+0000 7f19dfb1a700 1 -- 172.21.15.72:0/2005462610 shutdown_connections 2023-07-25T14:37:02.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:02.259+0000 7f19dfb1a700 1 -- 172.21.15.72:0/2005462610 wait complete. 2023-07-25T14:37:02.277 INFO:teuthology.orchestra.run.smithi072.stderr:pool 'cephfs2_data' created 2023-07-25T14:37:02.291 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs2 cephfs2_metadata cephfs2_data 2023-07-25T14:37:02.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:02.406+0000 7f1d08d07700 1 Processor -- start 2023-07-25T14:37:02.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:02.406+0000 7f1d08d07700 1 -- start start 2023-07-25T14:37:02.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:02.407+0000 7f1d08d07700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f1d04151950 0x7f1d0406a190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:02.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:02.407+0000 7f1d08d07700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d040c2fe0 con 0x7f1d0406a6d0 2023-07-25T14:37:02.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:02.407+0000 7f1d08d07700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d04155070 con 0x7f1d040724c0 2023-07-25T14:37:02.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:02.407+0000 7f1d08d07700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d04071a60 con 0x7f1d04151950 2023-07-25T14:37:02.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:02.407+0000 7f1d02d9d700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f1d0406a6d0 0x7f1d040c3bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:33052/0 (socket says 172.21.15.72:33052) 2023-07-25T14:37:02.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:02.407+0000 7f1d02d9d700 1 -- 172.21.15.72:0/2330192526 learned_addr learned my addr 172.21.15.72:0/2330192526 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:37:02.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:02.408+0000 7f1d0259c700 1 --2- 172.21.15.72:0/2330192526 >> v2:172.21.15.92:3300/0 conn(0x7f1d04151950 0x7f1d0406a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:02.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:02.408+0000 7f1d0159a700 1 -- 172.21.15.72:0/2330192526 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 797178047 0 0) 0x7f1d040c2fe0 con 0x7f1d0406a6d0 2023-07-25T14:37:02.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:02.408+0000 7f1d0159a700 1 -- 172.21.15.72:0/2330192526 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1cec0035b0 con 0x7f1d0406a6d0 2023-07-25T14:37:02.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:02.408+0000 7f1d0159a700 1 -- 172.21.15.72:0/2330192526 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1722304835 0 0) 0x7f1cec0035b0 con 0x7f1d0406a6d0 2023-07-25T14:37:02.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:02.408+0000 7f1d0159a700 1 -- 172.21.15.72:0/2330192526 >> v2:172.21.15.92:3300/0 conn(0x7f1d04151950 msgr2=0x7f1d0406a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:02.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:02.408+0000 7f1d0159a700 1 --2- 172.21.15.72:0/2330192526 >> v2:172.21.15.92:3300/0 conn(0x7f1d04151950 0x7f1d0406a190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:02.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:02.408+0000 7f1d0159a700 1 -- 172.21.15.72:0/2330192526 >> v1:172.21.15.92:6789/0 conn(0x7f1d040724c0 legacy=0x7f1d040c34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:02.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:02.408+0000 7f1d0159a700 1 -- 172.21.15.72:0/2330192526 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d040c15c0 con 0x7f1d0406a6d0 2023-07-25T14:37:02.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:02.408+0000 7f1d0159a700 1 -- 172.21.15.72:0/2330192526 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2559588315 0 0) 0x7f1cfc0019f0 con 0x7f1d0406a6d0 2023-07-25T14:37:02.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:02.408+0000 7f1d0159a700 1 -- 172.21.15.72:0/2330192526 >> v1:172.21.15.72:6789/0 conn(0x7f1d0406a6d0 legacy=0x7f1d040c3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:02.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:02.408+0000 7f1d0159a700 1 --2- 172.21.15.72:0/2330192526 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1cec003a00 0x7f1cec003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:02.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:02.408+0000 7f1d0159a700 1 --2- 172.21.15.72:0/2330192526 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1cec004850 0x7f1cec004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:02.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:02.408+0000 7f1d0159a700 1 --2- 172.21.15.72:0/2330192526 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1cec005210 0x7f1cec00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:02.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:02.408+0000 7f1d0159a700 1 -- 172.21.15.72:0/2330192526 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d04071a60 con 0x7f1cec005210 2023-07-25T14:37:02.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:02.408+0000 7f1d0159a700 1 -- 172.21.15.72:0/2330192526 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cec00c1b0 con 0x7f1cec003a00 2023-07-25T14:37:02.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:02.408+0000 7f1d0159a700 1 -- 172.21.15.72:0/2330192526 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cec00c370 con 0x7f1cec004850 2023-07-25T14:37:02.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:02.408+0000 7f1d02d9d700 1 --2- 172.21.15.72:0/2330192526 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1cec005210 0x7f1cec00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:02.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:02.408+0000 7f1d0259c700 1 --2- 172.21.15.72:0/2330192526 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1cec003a00 0x7f1cec003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:02.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:02.408+0000 7f1d01d9b700 1 --2- 172.21.15.72:0/2330192526 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1cec004850 0x7f1cec004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:02.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:02.408+0000 7f1d02d9d700 1 -- 172.21.15.72:0/2330192526 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1cec004850 msgr2=0x7f1cec004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:02.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:02.408+0000 7f1d02d9d700 1 --2- 172.21.15.72:0/2330192526 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1cec004850 0x7f1cec004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:02.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:02.408+0000 7f1d02d9d700 1 -- 172.21.15.72:0/2330192526 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1cec003a00 msgr2=0x7f1cec003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:02.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:02.408+0000 7f1d02d9d700 1 --2- 172.21.15.72:0/2330192526 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1cec003a00 0x7f1cec003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:02.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:02.408+0000 7f1d02d9d700 1 -- 172.21.15.72:0/2330192526 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cec0035b0 con 0x7f1cec005210 2023-07-25T14:37:02.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:02.408+0000 7f1d01d9b700 1 --2- 172.21.15.72:0/2330192526 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1cec004850 0x7f1cec004cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-25T14:37:02.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:02.409+0000 7f1d02d9d700 1 -- 172.21.15.72:0/2330192526 reap_dead start 2023-07-25T14:37:02.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:02.409+0000 7f1d02d9d700 1 --2- 172.21.15.72:0/2330192526 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1cec005210 0x7f1cec00ba10 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f1cfc00a830 tx=0x7f1cec005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4f9f9a03b031751 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:02.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:02.409+0000 7f1d0159a700 1 -- 172.21.15.72:0/2330192526 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cfc00a2f0 con 0x7f1cec005210 2023-07-25T14:37:02.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:02.409+0000 7f1d0159a700 1 -- 172.21.15.72:0/2330192526 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cfc012620 con 0x7f1cec005210 2023-07-25T14:37:02.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:02.409+0000 7f1d0159a700 1 -- 172.21.15.72:0/2330192526 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cfc0129d0 con 0x7f1cec005210 2023-07-25T14:37:02.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:02.409+0000 7f1d08d07700 1 -- 172.21.15.72:0/2330192526 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1cec005210 msgr2=0x7f1cec00ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:02.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:02.409+0000 7f1d08d07700 1 --2- 172.21.15.72:0/2330192526 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1cec005210 0x7f1cec00ba10 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f1cfc00a830 tx=0x7f1cec005880 comp rx=0 tx=0).stop 2023-07-25T14:37:02.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:02.409+0000 7f1d08d07700 1 -- 172.21.15.72:0/2330192526 shutdown_connections 2023-07-25T14:37:02.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:02.409+0000 7f1d08d07700 1 --2- 172.21.15.72:0/2330192526 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1cec005210 0x7f1cec00ba10 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:02.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:02.409+0000 7f1d08d07700 1 -- 172.21.15.72:0/2330192526 >> 172.21.15.72:0/2330192526 conn(0x7f1d040a87e0 msgr2=0x7f1d040a8bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:02.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:02.409+0000 7f1d08d07700 1 -- 172.21.15.72:0/2330192526 shutdown_connections 2023-07-25T14:37:02.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:02.409+0000 7f1d08d07700 1 -- 172.21.15.72:0/2330192526 wait complete. 2023-07-25T14:37:02.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:02.411+0000 7f1d08d07700 1 Processor -- start 2023-07-25T14:37:02.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:02.411+0000 7f1d08d07700 1 -- start start 2023-07-25T14:37:02.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:02.411+0000 7f1d08d07700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1cec005210 0x7f1d041e9e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:02.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:02.411+0000 7f1d08d07700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1d04156d00 0x7f1d04157180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:02.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:02.411+0000 7f1d08d07700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1d04153270 0x7f1d041536f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:02.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:02.411+0000 7f1d08d07700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d04156590 con 0x7f1d04153270 2023-07-25T14:37:02.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:02.411+0000 7f1d08d07700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d040c0a40 con 0x7f1cec005210 2023-07-25T14:37:02.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:02.411+0000 7f1d08d07700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d040bdb00 con 0x7f1d04156d00 2023-07-25T14:37:02.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:02.412+0000 7f1d02d9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1d04153270 0x7f1d041536f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:02.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:02.412+0000 7f1d02d9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1d04153270 0x7f1d041536f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42328/0 (socket says 172.21.15.72:42328) 2023-07-25T14:37:02.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:02.412+0000 7f1d02d9d700 1 -- 172.21.15.72:0/1827629719 learned_addr learned my addr 172.21.15.72:0/1827629719 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:37:02.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:02.412+0000 7f1d0259c700 1 --2- 172.21.15.72:0/1827629719 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1cec005210 0x7f1d041e9e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:02.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:02.412+0000 7f1d01d9b700 1 --2- 172.21.15.72:0/1827629719 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1d04156d00 0x7f1d04157180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:02.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:02.412+0000 7f1d02d9d700 1 -- 172.21.15.72:0/1827629719 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1d04156d00 msgr2=0x7f1d04157180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:02.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:02.412+0000 7f1d02d9d700 1 --2- 172.21.15.72:0/1827629719 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1d04156d00 0x7f1d04157180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:02.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:02.412+0000 7f1d02d9d700 1 -- 172.21.15.72:0/1827629719 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1cec005210 msgr2=0x7f1d041e9e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:02.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:02.412+0000 7f1d02d9d700 1 --2- 172.21.15.72:0/1827629719 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1cec005210 0x7f1d041e9e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:02.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:02.412+0000 7f1d02d9d700 1 -- 172.21.15.72:0/1827629719 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d040bdda0 con 0x7f1d04153270 2023-07-25T14:37:02.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:02.412+0000 7f1d0259c700 1 --2- 172.21.15.72:0/1827629719 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1cec005210 0x7f1d041e9e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-25T14:37:02.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:02.412+0000 7f1d01d9b700 1 --2- 172.21.15.72:0/1827629719 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1d04156d00 0x7f1d04157180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-25T14:37:02.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:02.412+0000 7f1d02d9d700 1 --2- 172.21.15.72:0/1827629719 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1d04153270 0x7f1d041536f0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f1d0406b0f0 tx=0x7f1cfc001d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:02.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:02.412+0000 7f1cf2ffd700 1 -- 172.21.15.72:0/1827629719 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cfc012ba0 con 0x7f1d04153270 2023-07-25T14:37:02.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:02.412+0000 7f1cf2ffd700 1 -- 172.21.15.72:0/1827629719 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cfc012d00 con 0x7f1d04153270 2023-07-25T14:37:02.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:02.412+0000 7f1cf2ffd700 1 -- 172.21.15.72:0/1827629719 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cfc01d660 con 0x7f1d04153270 2023-07-25T14:37:02.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:02.412+0000 7f1d08d07700 1 -- 172.21.15.72:0/1827629719 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d04157ae0 con 0x7f1d04153270 2023-07-25T14:37:02.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:02.412+0000 7f1d08d07700 1 -- 172.21.15.72:0/1827629719 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d041567e0 con 0x7f1d04153270 2023-07-25T14:37:02.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:02.413+0000 7f1d08d07700 1 -- 172.21.15.72:0/1827629719 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d0404e470 con 0x7f1d04153270 2023-07-25T14:37:02.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:02.414+0000 7f1cf2ffd700 1 -- 172.21.15.72:0/1827629719 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1cfc01d7c0 con 0x7f1d04153270 2023-07-25T14:37:02.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:02.414+0000 7f1cf2ffd700 1 --2- 172.21.15.72:0/1827629719 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f1ce406ace0 0x7f1ce406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:02.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:02.414+0000 7f1cf2ffd700 1 -- 172.21.15.72:0/1827629719 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 7136+0+0 (secure 0 0 0) 0x7f1cfc08bab0 con 0x7f1d04153270 2023-07-25T14:37:02.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:02.414+0000 7f1d0259c700 1 --2- 172.21.15.72:0/1827629719 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f1ce406ace0 0x7f1ce406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:02.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:02.414+0000 7f1d0259c700 1 --2- 172.21.15.72:0/1827629719 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f1ce406ace0 0x7f1ce406d1a0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f1cf8009ae0 tx=0x7f1cf8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:02.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:02.419+0000 7f1cf2ffd700 1 -- 172.21.15.72:0/1827629719 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f1cfc056740 con 0x7f1d04153270 2023-07-25T14:37:02.659 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:02.648+0000 7f1d08d07700 1 -- 172.21.15.72:0/1827629719 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs2", "metadata": "cephfs2_metadata", "data": "cephfs2_data"} v 0) v1 -- 0x7f1d040a8170 con 0x7f1d04153270 2023-07-25T14:37:03.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:03.279+0000 7f1cf2ffd700 1 -- 172.21.15.72:0/1827629719 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs2", "metadata": "cephfs2_metadata", "data": "cephfs2_data"}]=0 new fs with metadata pool 8 and data pool 9 v18) v1 ==== 175+0+0 (secure 0 0 0) 0x7f1cfc059d60 con 0x7f1d04153270 2023-07-25T14:37:03.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:03.288+0000 7f1d08d07700 1 -- 172.21.15.72:0/1827629719 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f1ce406ace0 msgr2=0x7f1ce406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:03.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:03.288+0000 7f1d08d07700 1 --2- 172.21.15.72:0/1827629719 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f1ce406ace0 0x7f1ce406d1a0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f1cf8009ae0 tx=0x7f1cf8008040 comp rx=0 tx=0).stop 2023-07-25T14:37:03.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:03.288+0000 7f1d08d07700 1 -- 172.21.15.72:0/1827629719 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1d04153270 msgr2=0x7f1d041536f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:03.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:03.288+0000 7f1d08d07700 1 --2- 172.21.15.72:0/1827629719 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1d04153270 0x7f1d041536f0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f1d0406b0f0 tx=0x7f1cfc001d80 comp rx=0 tx=0).stop 2023-07-25T14:37:03.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:03.289+0000 7f1d08d07700 1 -- 172.21.15.72:0/1827629719 shutdown_connections 2023-07-25T14:37:03.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:03.289+0000 7f1d08d07700 1 --2- 172.21.15.72:0/1827629719 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f1ce406ace0 0x7f1ce406d1a0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:03.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:03.289+0000 7f1d08d07700 1 --2- 172.21.15.72:0/1827629719 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1d04153270 0x7f1d041536f0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:03.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:03.289+0000 7f1d08d07700 1 --2- 172.21.15.72:0/1827629719 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1cec005210 0x7f1d041e9e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:03.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:03.289+0000 7f1d08d07700 1 --2- 172.21.15.72:0/1827629719 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1d04156d00 0x7f1d04157180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:03.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:03.289+0000 7f1d08d07700 1 -- 172.21.15.72:0/1827629719 >> 172.21.15.72:0/1827629719 conn(0x7f1d040a87e0 msgr2=0x7f1d040a6f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:03.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:03.292+0000 7f1d08d07700 1 -- 172.21.15.72:0/1827629719 shutdown_connections 2023-07-25T14:37:03.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:03.292+0000 7f1d08d07700 1 -- 172.21.15.72:0/1827629719 wait complete. 2023-07-25T14:37:03.313 INFO:teuthology.orchestra.run.smithi072.stderr:new fs with metadata pool 8 and data pool 9 2023-07-25T14:37:03.326 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-25T14:37:03.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:03.438+0000 7f9a30003700 1 Processor -- start 2023-07-25T14:37:03.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:03.438+0000 7f9a30003700 1 -- start start 2023-07-25T14:37:03.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:03.439+0000 7f9a30003700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f9a2814dea0 0x7f9a2806a190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:03.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:03.439+0000 7f9a30003700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f9a28072300 0x7f9a28151200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:03.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:03.439+0000 7f9a30003700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a280a8230 con 0x7f9a280a86c0 2023-07-25T14:37:03.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:03.439+0000 7f9a30003700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a280c18d0 con 0x7f9a28072300 2023-07-25T14:37:03.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:03.439+0000 7f9a30003700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a2806ea10 con 0x7f9a2814dea0 2023-07-25T14:37:03.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:03.439+0000 7f9a2d59e700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f9a28072300 0x7f9a28151200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:03.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:03.439+0000 7f9a2e5a0700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f9a280a86c0 0x7f9a280c0bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:33080/0 (socket says 172.21.15.72:33080) 2023-07-25T14:37:03.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:03.439+0000 7f9a2e5a0700 1 -- 172.21.15.72:0/892365091 learned_addr learned my addr 172.21.15.72:0/892365091 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:37:03.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:03.439+0000 7f9a2dd9f700 1 --2- 172.21.15.72:0/892365091 >> v2:172.21.15.92:3300/0 conn(0x7f9a2814dea0 0x7f9a2806a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:03.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:03.439+0000 7f9a2d59e700 1 -- 172.21.15.72:0/892365091 >> v2:172.21.15.92:3300/0 conn(0x7f9a2814dea0 msgr2=0x7f9a2806a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:03.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:03.439+0000 7f9a2d59e700 1 --2- 172.21.15.72:0/892365091 >> v2:172.21.15.92:3300/0 conn(0x7f9a2814dea0 0x7f9a2806a190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:03.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:03.439+0000 7f9a2d59e700 1 -- 172.21.15.72:0/892365091 >> v1:172.21.15.72:6789/0 conn(0x7f9a280a86c0 legacy=0x7f9a280c0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:03.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:03.439+0000 7f9a2cd9d700 1 -- 172.21.15.72:0/892365091 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1476524590 0 0) 0x7f9a280a8230 con 0x7f9a280a86c0 2023-07-25T14:37:03.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:03.439+0000 7f9a2d59e700 1 -- 172.21.15.72:0/892365091 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a280a7c20 con 0x7f9a28072300 2023-07-25T14:37:03.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:03.439+0000 7f9a2d59e700 1 --2- 172.21.15.72:0/892365091 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9a28072300 0x7f9a28151200 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f9a28061e10 tx=0x7f9a1800bdc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f0c3a00db37fad9 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:03.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:03.439+0000 7f9a2cd9d700 1 -- 172.21.15.72:0/892365091 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a1800dc70 con 0x7f9a28072300 2023-07-25T14:37:03.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:03.439+0000 7f9a2cd9d700 1 -- 172.21.15.72:0/892365091 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a1800ddd0 con 0x7f9a28072300 2023-07-25T14:37:03.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:03.439+0000 7f9a2cd9d700 1 -- 172.21.15.72:0/892365091 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a18010690 con 0x7f9a28072300 2023-07-25T14:37:03.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:03.440+0000 7f9a30003700 1 -- 172.21.15.72:0/892365091 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9a28072300 msgr2=0x7f9a28151200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:03.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:03.440+0000 7f9a30003700 1 --2- 172.21.15.72:0/892365091 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9a28072300 0x7f9a28151200 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f9a28061e10 tx=0x7f9a1800bdc0 comp rx=0 tx=0).stop 2023-07-25T14:37:03.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:03.440+0000 7f9a30003700 1 -- 172.21.15.72:0/892365091 shutdown_connections 2023-07-25T14:37:03.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:03.440+0000 7f9a30003700 1 --2- 172.21.15.72:0/892365091 >> v2:172.21.15.92:3300/0 conn(0x7f9a2814dea0 0x7f9a2806a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:03.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:03.440+0000 7f9a30003700 1 --2- 172.21.15.72:0/892365091 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9a28072300 0x7f9a28151200 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:03.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:03.440+0000 7f9a30003700 1 -- 172.21.15.72:0/892365091 >> 172.21.15.72:0/892365091 conn(0x7f9a2806def0 msgr2=0x7f9a2806e300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:03.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:03.440+0000 7f9a30003700 1 -- 172.21.15.72:0/892365091 shutdown_connections 2023-07-25T14:37:03.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:03.440+0000 7f9a30003700 1 -- 172.21.15.72:0/892365091 wait complete. 2023-07-25T14:37:03.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:03.441+0000 7f9a30003700 1 Processor -- start 2023-07-25T14:37:03.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:03.441+0000 7f9a30003700 1 -- start start 2023-07-25T14:37:03.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:03.442+0000 7f9a30003700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9a28072300 0x7f9a2814cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:03.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:03.442+0000 7f9a30003700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9a280a86c0 0x7f9a281448a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:03.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:03.442+0000 7f9a30003700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9a2814dea0 0x7f9a28144de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:03.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:03.442+0000 7f9a30003700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a281dc220 con 0x7f9a28072300 2023-07-25T14:37:03.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:03.442+0000 7f9a30003700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a28145320 con 0x7f9a2814dea0 2023-07-25T14:37:03.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:03.442+0000 7f9a30003700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a281da740 con 0x7f9a280a86c0 2023-07-25T14:37:03.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:03.442+0000 7f9a2dd9f700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9a28072300 0x7f9a2814cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:03.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:03.442+0000 7f9a2dd9f700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9a28072300 0x7f9a2814cee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42350/0 (socket says 172.21.15.72:42350) 2023-07-25T14:37:03.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:03.442+0000 7f9a2dd9f700 1 -- 172.21.15.72:0/3503174631 learned_addr learned my addr 172.21.15.72:0/3503174631 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:37:03.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:03.442+0000 7f9a2d59e700 1 --2- 172.21.15.72:0/3503174631 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9a280a86c0 0x7f9a281448a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:03.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:03.442+0000 7f9a2e5a0700 1 --2- 172.21.15.72:0/3503174631 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9a2814dea0 0x7f9a28144de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:03.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:03.442+0000 7f9a2dd9f700 1 -- 172.21.15.72:0/3503174631 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9a280a86c0 msgr2=0x7f9a281448a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:03.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:03.442+0000 7f9a2dd9f700 1 --2- 172.21.15.72:0/3503174631 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9a280a86c0 0x7f9a281448a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:03.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:03.442+0000 7f9a2dd9f700 1 -- 172.21.15.72:0/3503174631 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9a2814dea0 msgr2=0x7f9a28144de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:03.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:03.442+0000 7f9a2dd9f700 1 --2- 172.21.15.72:0/3503174631 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9a2814dea0 0x7f9a28144de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:03.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:03.442+0000 7f9a2dd9f700 1 -- 172.21.15.72:0/3503174631 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a1800b740 con 0x7f9a28072300 2023-07-25T14:37:03.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:03.442+0000 7f9a2dd9f700 1 --2- 172.21.15.72:0/3503174631 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9a28072300 0x7f9a2814cee0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f9a2400e880 tx=0x7f9a2400ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:03.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:03.442+0000 7f9a1e7fc700 1 -- 172.21.15.72:0/3503174631 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a240095b0 con 0x7f9a28072300 2023-07-25T14:37:03.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:03.442+0000 7f9a1e7fc700 1 -- 172.21.15.72:0/3503174631 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a2400ee80 con 0x7f9a28072300 2023-07-25T14:37:03.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:03.442+0000 7f9a30003700 1 -- 172.21.15.72:0/3503174631 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a281daa20 con 0x7f9a28072300 2023-07-25T14:37:03.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:03.442+0000 7f9a1e7fc700 1 -- 172.21.15.72:0/3503174631 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a2400ca70 con 0x7f9a28072300 2023-07-25T14:37:03.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:03.443+0000 7f9a30003700 1 -- 172.21.15.72:0/3503174631 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a280a9460 con 0x7f9a28072300 2023-07-25T14:37:03.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:03.443+0000 7f9a30003700 1 -- 172.21.15.72:0/3503174631 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a280a7ea0 con 0x7f9a28072300 2023-07-25T14:37:03.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:03.444+0000 7f9a1e7fc700 1 -- 172.21.15.72:0/3503174631 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9a2400cbd0 con 0x7f9a28072300 2023-07-25T14:37:03.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:03.444+0000 7f9a1e7fc700 1 --2- 172.21.15.72:0/3503174631 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f9a0c06ace0 0x7f9a0c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:03.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:03.444+0000 7f9a1e7fc700 1 -- 172.21.15.72:0/3503174631 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 7238+0+0 (secure 0 0 0) 0x7f9a240898d0 con 0x7f9a28072300 2023-07-25T14:37:03.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:03.444+0000 7f9a2d59e700 1 --2- 172.21.15.72:0/3503174631 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f9a0c06ace0 0x7f9a0c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:03.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:03.445+0000 7f9a2d59e700 1 --2- 172.21.15.72:0/3503174631 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f9a0c06ace0 0x7f9a0c06d1a0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f9a281e6080 tx=0x7f9a18013000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:03.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:03.449+0000 7f9a1e7fc700 1 -- 172.21.15.72:0/3503174631 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f9a280a7ea0 con 0x7f9a28072300 2023-07-25T14:37:03.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:03.637+0000 7f9a30003700 1 -- 172.21.15.72:0/3503174631 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9a280a7ea0 con 0x7f9a28072300 2023-07-25T14:37:03.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:03.639+0000 7f9a1e7fc700 1 -- 172.21.15.72:0/3503174631 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v42) v1 ==== 74+0+22119 (secure 0 0 0) 0x7f9a280a7ea0 con 0x7f9a28072300 2023-07-25T14:37:03.651 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-25T14:37:03.651 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":42,"fsid":"9170db48-9170-43e8-8ccb-9813e6240906","created":"2023-07-25T14:35:21.733262+0000","modified":"2023-07-25T14:37:02.650196+0000","last_up_change":"2023-07-25T14:35:31.355010+0000","last_in_change":"2023-07-25T14:35:24.195785+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-25T14:35:32.983457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-25T14:35:33.326342+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-07-25T14:36:47.694223+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-07-25T14:36:48.536715+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs2_metadata","create_time":"2023-07-25T14:37:01.238292+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs2_data","create_time":"2023-07-25T14:37:01.609127+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d517fdad-0bfe-49f0-89f2-9421c3761839","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6801","nonce":2475407414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6803","nonce":2475407414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6807","nonce":2475407414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6805","nonce":2475407414}]},"public_addr":"172.21.15.72:6801/2475407414","cluster_addr":"172.21.15.72:6803/2475407414","heartbeat_back_addr":"172.21.15.72:6807/2475407414","heartbeat_front_addr":"172.21.15.72:6805/2475407414","state":["exists","up"]},{"osd":1,"uuid":"e1564be3-f209-47e5-a8d0-32fc618a474f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6822","nonce":870954016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6825","nonce":870954016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6831","nonce":870954016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6827","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6829","nonce":870954016}]},"public_addr":"172.21.15.72:6822/870954016","cluster_addr":"172.21.15.72:6825/870954016","heartbeat_back_addr":"172.21.15.72:6831/870954016","heartbeat_front_addr":"172.21.15.72:6829/870954016","state":["exists","up"]},{"osd":2,"uuid":"c4647d30-ffa6-417a-9026-ef530c75910e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6809","nonce":2143129442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6811","nonce":2143129442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6815","nonce":2143129442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6813","nonce":2143129442}]},"public_addr":"172.21.15.72:6809/2143129442","cluster_addr":"172.21.15.72:6811/2143129442","heartbeat_back_addr":"172.21.15.72:6815/2143129442","heartbeat_front_addr":"172.21.15.72:6813/2143129442","state":["exists","up"]},{"osd":3,"uuid":"76c9d9a7-c2e2-4612-a58b-d6882dd76b58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6817","nonce":3404066311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6819","nonce":3404066311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6828","nonce":3404066311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6821","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6823","nonce":3404066311}]},"public_addr":"172.21.15.72:6817/3404066311","cluster_addr":"172.21.15.72:6819/3404066311","heartbeat_back_addr":"172.21.15.72:6828/3404066311","heartbeat_front_addr":"172.21.15.72:6823/3404066311","state":["exists","up"]},{"osd":4,"uuid":"7f8920dc-0ad4-4a73-ab40-65408f83eadd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6817","nonce":2381008739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6819","nonce":2381008739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6825","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6827","nonce":2381008739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6822","nonce":2381008739}]},"public_addr":"172.21.15.92:6817/2381008739","cluster_addr":"172.21.15.92:6819/2381008739","heartbeat_back_addr":"172.21.15.92:6827/2381008739","heartbeat_front_addr":"172.21.15.92:6822/2381008739","state":["exists","up"]},{"osd":5,"uuid":"56257e7c-31eb-44c5-9ec7-1318a4e0bb35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6801","nonce":2161935604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6803","nonce":2161935604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6807","nonce":2161935604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6805","nonce":2161935604}]},"public_addr":"172.21.15.92:6801/2161935604","cluster_addr":"172.21.15.92:6803/2161935604","heartbeat_back_addr":"172.21.15.92:6807/2161935604","heartbeat_front_addr":"172.21.15.92:6805/2161935604","state":["exists","up"]},{"osd":6,"uuid":"a150d3d8-a0c9-4955-968a-8d98eff4ffb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6809","nonce":3770163493}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6811","nonce":3770163493}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6815","nonce":3770163493}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6813","nonce":3770163493}]},"public_addr":"172.21.15.92:6809/3770163493","cluster_addr":"172.21.15.92:6811/3770163493","heartbeat_back_addr":"172.21.15.92:6815/3770163493","heartbeat_front_addr":"172.21.15.92:6813/3770163493","state":["exists","up"]},{"osd":7,"uuid":"07799c27-54ee-4591-a42d-a978d6b32065","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6821","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6823","nonce":2135777609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6826","nonce":2135777609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6831","nonce":2135777609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6829","nonce":2135777609}]},"public_addr":"172.21.15.92:6823/2135777609","cluster_addr":"172.21.15.92:6826/2135777609","heartbeat_back_addr":"172.21.15.92:6831/2135777609","heartbeat_front_addr":"172.21.15.92:6829/2135777609","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.345365+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.378150+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.146566+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.372172+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:30.398421+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.385632+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.465611+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.443583+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-25T14:37:03.653 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:03.641+0000 7f9a30003700 1 -- 172.21.15.72:0/3503174631 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f9a0c06ace0 msgr2=0x7f9a0c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:03.653 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:03.641+0000 7f9a30003700 1 --2- 172.21.15.72:0/3503174631 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f9a0c06ace0 0x7f9a0c06d1a0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f9a281e6080 tx=0x7f9a18013000 comp rx=0 tx=0).stop 2023-07-25T14:37:03.653 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:03.641+0000 7f9a30003700 1 -- 172.21.15.72:0/3503174631 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9a28072300 msgr2=0x7f9a2814cee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:03.653 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:03.641+0000 7f9a30003700 1 --2- 172.21.15.72:0/3503174631 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9a28072300 0x7f9a2814cee0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f9a2400e880 tx=0x7f9a2400ec40 comp rx=0 tx=0).stop 2023-07-25T14:37:03.653 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:03.641+0000 7f9a30003700 1 -- 172.21.15.72:0/3503174631 shutdown_connections 2023-07-25T14:37:03.653 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:03.641+0000 7f9a30003700 1 --2- 172.21.15.72:0/3503174631 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f9a0c06ace0 0x7f9a0c06d1a0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:03.653 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:03.641+0000 7f9a30003700 1 --2- 172.21.15.72:0/3503174631 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9a2814dea0 0x7f9a28144de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:03.654 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:03.641+0000 7f9a30003700 1 --2- 172.21.15.72:0/3503174631 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9a28072300 0x7f9a2814cee0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:03.654 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:03.641+0000 7f9a30003700 1 --2- 172.21.15.72:0/3503174631 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9a280a86c0 0x7f9a281448a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:03.654 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:03.641+0000 7f9a30003700 1 -- 172.21.15.72:0/3503174631 >> 172.21.15.72:0/3503174631 conn(0x7f9a2806def0 msgr2=0x7f9a2814a250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:03.654 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:03.641+0000 7f9a30003700 1 -- 172.21.15.72:0/3503174631 shutdown_connections 2023-07-25T14:37:03.654 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:03.641+0000 7f9a30003700 1 -- 172.21.15.72:0/3503174631 wait complete. 2023-07-25T14:37:03.665 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-25T14:37:03.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:03.774+0000 7f9c5099e700 1 Processor -- start 2023-07-25T14:37:03.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:03.774+0000 7f9c5099e700 1 -- start start 2023-07-25T14:37:03.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:03.774+0000 7f9c5099e700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9c4c14e860 0x7f9c4c0a5ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:03.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:03.774+0000 7f9c5099e700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c4c0c2a80 con 0x7f9c4c154560 2023-07-25T14:37:03.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:03.774+0000 7f9c5099e700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c4c0c1d00 con 0x7f9c4c0c4a80 2023-07-25T14:37:03.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:03.774+0000 7f9c5099e700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c4c0c6240 con 0x7f9c4c14e860 2023-07-25T14:37:03.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:03.775+0000 7f9c4bfff700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f9c4c154560 0x7f9c4c1549f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:33098/0 (socket says 172.21.15.72:33098) 2023-07-25T14:37:03.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:03.775+0000 7f9c4bfff700 1 -- 172.21.15.72:0/3956738682 learned_addr learned my addr 172.21.15.72:0/3956738682 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:37:03.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:03.775+0000 7f9c4b7fe700 1 --2- 172.21.15.72:0/3956738682 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9c4c14e860 0x7f9c4c0a5ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:03.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:03.775+0000 7f9c4a7fc700 1 -- 172.21.15.72:0/3956738682 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2485867908 0 0) 0x7f9c4c0c2a80 con 0x7f9c4c154560 2023-07-25T14:37:03.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:03.775+0000 7f9c4a7fc700 1 -- 172.21.15.72:0/3956738682 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9c340035b0 con 0x7f9c4c154560 2023-07-25T14:37:03.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:03.775+0000 7f9c4a7fc700 1 -- 172.21.15.72:0/3956738682 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1473803983 0 0) 0x7f9c340035b0 con 0x7f9c4c154560 2023-07-25T14:37:03.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:03.775+0000 7f9c4a7fc700 1 -- 172.21.15.72:0/3956738682 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9c4c14e860 msgr2=0x7f9c4c0a5ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:03.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:03.775+0000 7f9c4a7fc700 1 --2- 172.21.15.72:0/3956738682 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9c4c14e860 0x7f9c4c0a5ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:03.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:03.775+0000 7f9c4a7fc700 1 -- 172.21.15.72:0/3956738682 >> v1:172.21.15.92:6789/0 conn(0x7f9c4c0c4a80 legacy=0x7f9c4c06ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:03.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:03.775+0000 7f9c4a7fc700 1 -- 172.21.15.72:0/3956738682 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c4c06ea80 con 0x7f9c4c154560 2023-07-25T14:37:03.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:03.775+0000 7f9c4a7fc700 1 -- 172.21.15.72:0/3956738682 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2559588315 0 0) 0x7f9c440019f0 con 0x7f9c4c154560 2023-07-25T14:37:03.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:03.775+0000 7f9c4a7fc700 1 -- 172.21.15.72:0/3956738682 >> v1:172.21.15.72:6789/0 conn(0x7f9c4c154560 legacy=0x7f9c4c1549f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:03.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:03.775+0000 7f9c4a7fc700 1 --2- 172.21.15.72:0/3956738682 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9c34003a30 0x7f9c34003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:03.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:03.775+0000 7f9c4a7fc700 1 --2- 172.21.15.72:0/3956738682 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9c34004350 0x7f9c34004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:03.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:03.775+0000 7f9c4a7fc700 1 --2- 172.21.15.72:0/3956738682 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9c34004fe0 0x7f9c3400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:03.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:03.775+0000 7f9c4a7fc700 1 -- 172.21.15.72:0/3956738682 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c3400bf50 con 0x7f9c34004350 2023-07-25T14:37:03.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:03.775+0000 7f9c4a7fc700 1 -- 172.21.15.72:0/3956738682 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c3400c090 con 0x7f9c34004fe0 2023-07-25T14:37:03.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:03.775+0000 7f9c4a7fc700 1 -- 172.21.15.72:0/3956738682 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c3400c1d0 con 0x7f9c34003a30 2023-07-25T14:37:03.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:03.775+0000 7f9c4affd700 1 --2- 172.21.15.72:0/3956738682 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9c34004350 0x7f9c34004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:03.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:03.775+0000 7f9c4b7fe700 1 --2- 172.21.15.72:0/3956738682 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9c34003a30 0x7f9c34003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:03.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:03.775+0000 7f9c4bfff700 1 --2- 172.21.15.72:0/3956738682 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9c34004fe0 0x7f9c3400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:03.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:03.775+0000 7f9c4affd700 1 -- 172.21.15.72:0/3956738682 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9c34003a30 msgr2=0x7f9c34003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:03.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:03.775+0000 7f9c4affd700 1 --2- 172.21.15.72:0/3956738682 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9c34003a30 0x7f9c34003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:03.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:03.775+0000 7f9c4affd700 1 -- 172.21.15.72:0/3956738682 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9c34004fe0 msgr2=0x7f9c3400ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:03.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:03.775+0000 7f9c4affd700 1 --2- 172.21.15.72:0/3956738682 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9c34004fe0 0x7f9c3400ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:03.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:03.775+0000 7f9c4affd700 1 -- 172.21.15.72:0/3956738682 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c340035b0 con 0x7f9c34004350 2023-07-25T14:37:03.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:03.776+0000 7f9c4affd700 1 --2- 172.21.15.72:0/3956738682 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9c34004350 0x7f9c34004850 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f9c4c0c4ea0 tx=0x7f9c34005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7f52d99233784c2 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:03.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:03.776+0000 7f9c4a7fc700 1 -- 172.21.15.72:0/3956738682 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c4000c660 con 0x7f9c34004350 2023-07-25T14:37:03.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:03.776+0000 7f9c4a7fc700 1 -- 172.21.15.72:0/3956738682 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c4000c7c0 con 0x7f9c34004350 2023-07-25T14:37:03.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:03.776+0000 7f9c4a7fc700 1 -- 172.21.15.72:0/3956738682 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c4000cb70 con 0x7f9c34004350 2023-07-25T14:37:03.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:03.776+0000 7f9c5099e700 1 -- 172.21.15.72:0/3956738682 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9c34004350 msgr2=0x7f9c34004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:03.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:03.776+0000 7f9c5099e700 1 --2- 172.21.15.72:0/3956738682 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9c34004350 0x7f9c34004850 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f9c4c0c4ea0 tx=0x7f9c34005880 comp rx=0 tx=0).stop 2023-07-25T14:37:03.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:03.776+0000 7f9c4bfff700 1 -- 172.21.15.72:0/3956738682 reap_dead start 2023-07-25T14:37:03.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:03.776+0000 7f9c5099e700 1 -- 172.21.15.72:0/3956738682 shutdown_connections 2023-07-25T14:37:03.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:03.776+0000 7f9c5099e700 1 -- 172.21.15.72:0/3956738682 >> 172.21.15.72:0/3956738682 conn(0x7f9c4c0c7150 msgr2=0x7f9c4c0c3350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:03.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:03.776+0000 7f9c5099e700 1 -- 172.21.15.72:0/3956738682 shutdown_connections 2023-07-25T14:37:03.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:03.776+0000 7f9c5099e700 1 -- 172.21.15.72:0/3956738682 wait complete. 2023-07-25T14:37:03.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:03.778+0000 7f9c5099e700 1 Processor -- start 2023-07-25T14:37:03.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:03.778+0000 7f9c5099e700 1 -- start start 2023-07-25T14:37:03.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:03.779+0000 7f9c5099e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9c34004350 0x7f9c4c14b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:03.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:03.779+0000 7f9c5099e700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9c4c0c0690 0x7f9c4c146ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:03.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:03.779+0000 7f9c5099e700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9c4c147020 0x7f9c4c1e9490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:03.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:03.779+0000 7f9c5099e700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c4c0bd6e0 con 0x7f9c34004350 2023-07-25T14:37:03.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:03.779+0000 7f9c5099e700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c4c153d80 con 0x7f9c4c147020 2023-07-25T14:37:03.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:03.779+0000 7f9c5099e700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c4c153f90 con 0x7f9c4c0c0690 2023-07-25T14:37:03.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:03.779+0000 7f9c4b7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9c34004350 0x7f9c4c14b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:03.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:03.779+0000 7f9c4b7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9c34004350 0x7f9c4c14b580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42370/0 (socket says 172.21.15.72:42370) 2023-07-25T14:37:03.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:03.779+0000 7f9c4b7fe700 1 -- 172.21.15.72:0/783668030 learned_addr learned my addr 172.21.15.72:0/783668030 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:37:03.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:03.779+0000 7f9c4affd700 1 --2- 172.21.15.72:0/783668030 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9c4c0c0690 0x7f9c4c146ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:03.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:03.779+0000 7f9c4bfff700 1 --2- 172.21.15.72:0/783668030 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9c4c147020 0x7f9c4c1e9490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:03.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:03.779+0000 7f9c4b7fe700 1 -- 172.21.15.72:0/783668030 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9c4c0c0690 msgr2=0x7f9c4c146ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:03.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:03.779+0000 7f9c4b7fe700 1 --2- 172.21.15.72:0/783668030 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9c4c0c0690 0x7f9c4c146ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:03.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:03.779+0000 7f9c4b7fe700 1 -- 172.21.15.72:0/783668030 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9c4c147020 msgr2=0x7f9c4c1e9490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:03.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:03.779+0000 7f9c4b7fe700 1 --2- 172.21.15.72:0/783668030 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9c4c147020 0x7f9c4c1e9490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:03.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:03.779+0000 7f9c4b7fe700 1 -- 172.21.15.72:0/783668030 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c4c0abf40 con 0x7f9c34004350 2023-07-25T14:37:03.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:03.779+0000 7f9c4b7fe700 1 --2- 172.21.15.72:0/783668030 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9c34004350 0x7f9c4c14b580 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f9c3c011ab0 tx=0x7f9c3c011e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:03.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:03.779+0000 7f9c33fff700 1 -- 172.21.15.72:0/783668030 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c3c016070 con 0x7f9c34004350 2023-07-25T14:37:03.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:03.779+0000 7f9c33fff700 1 -- 172.21.15.72:0/783668030 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c3c00e9f0 con 0x7f9c34004350 2023-07-25T14:37:03.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:03.779+0000 7f9c5099e700 1 -- 172.21.15.72:0/783668030 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c4c0ac220 con 0x7f9c34004350 2023-07-25T14:37:03.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:03.779+0000 7f9c33fff700 1 -- 172.21.15.72:0/783668030 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c3c00eb80 con 0x7f9c34004350 2023-07-25T14:37:03.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:03.779+0000 7f9c5099e700 1 -- 172.21.15.72:0/783668030 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c4c0abbf0 con 0x7f9c34004350 2023-07-25T14:37:03.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:03.780+0000 7f9c5099e700 1 -- 172.21.15.72:0/783668030 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c4c04e470 con 0x7f9c34004350 2023-07-25T14:37:03.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:03.781+0000 7f9c33fff700 1 -- 172.21.15.72:0/783668030 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9c3c00ece0 con 0x7f9c34004350 2023-07-25T14:37:03.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:03.781+0000 7f9c33fff700 1 --2- 172.21.15.72:0/783668030 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f9c3806ace0 0x7f9c3806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:03.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:03.781+0000 7f9c33fff700 1 -- 172.21.15.72:0/783668030 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 7238+0+0 (secure 0 0 0) 0x7f9c3c08b280 con 0x7f9c34004350 2023-07-25T14:37:03.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:03.781+0000 7f9c4affd700 1 --2- 172.21.15.72:0/783668030 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f9c3806ace0 0x7f9c3806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:03.799 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:03.782+0000 7f9c4affd700 1 --2- 172.21.15.72:0/783668030 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f9c3806ace0 0x7f9c3806d1a0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f9c4c0c4ea0 tx=0x7f9c40005040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:03.800 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:03.786+0000 7f9c33fff700 1 -- 172.21.15.72:0/783668030 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f9c3c0599d0 con 0x7f9c34004350 2023-07-25T14:37:03.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:03.975+0000 7f9c5099e700 1 -- 172.21.15.72:0/783668030 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9c4c0ac630 con 0x7f9c34004350 2023-07-25T14:37:03.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:03.976+0000 7f9c33fff700 1 -- 172.21.15.72:0/783668030 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v42) v1 ==== 74+0+22119 (secure 0 0 0) 0x7f9c3c059560 con 0x7f9c34004350 2023-07-25T14:37:03.988 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-25T14:37:03.988 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":42,"fsid":"9170db48-9170-43e8-8ccb-9813e6240906","created":"2023-07-25T14:35:21.733262+0000","modified":"2023-07-25T14:37:02.650196+0000","last_up_change":"2023-07-25T14:35:31.355010+0000","last_in_change":"2023-07-25T14:35:24.195785+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-25T14:35:32.983457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-25T14:35:33.326342+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-07-25T14:36:47.694223+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-07-25T14:36:48.536715+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs2_metadata","create_time":"2023-07-25T14:37:01.238292+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs2_data","create_time":"2023-07-25T14:37:01.609127+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d517fdad-0bfe-49f0-89f2-9421c3761839","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6801","nonce":2475407414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6803","nonce":2475407414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6807","nonce":2475407414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6805","nonce":2475407414}]},"public_addr":"172.21.15.72:6801/2475407414","cluster_addr":"172.21.15.72:6803/2475407414","heartbeat_back_addr":"172.21.15.72:6807/2475407414","heartbeat_front_addr":"172.21.15.72:6805/2475407414","state":["exists","up"]},{"osd":1,"uuid":"e1564be3-f209-47e5-a8d0-32fc618a474f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6822","nonce":870954016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6825","nonce":870954016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6831","nonce":870954016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6827","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6829","nonce":870954016}]},"public_addr":"172.21.15.72:6822/870954016","cluster_addr":"172.21.15.72:6825/870954016","heartbeat_back_addr":"172.21.15.72:6831/870954016","heartbeat_front_addr":"172.21.15.72:6829/870954016","state":["exists","up"]},{"osd":2,"uuid":"c4647d30-ffa6-417a-9026-ef530c75910e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6809","nonce":2143129442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6811","nonce":2143129442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6815","nonce":2143129442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6813","nonce":2143129442}]},"public_addr":"172.21.15.72:6809/2143129442","cluster_addr":"172.21.15.72:6811/2143129442","heartbeat_back_addr":"172.21.15.72:6815/2143129442","heartbeat_front_addr":"172.21.15.72:6813/2143129442","state":["exists","up"]},{"osd":3,"uuid":"76c9d9a7-c2e2-4612-a58b-d6882dd76b58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6817","nonce":3404066311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6819","nonce":3404066311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6828","nonce":3404066311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6821","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6823","nonce":3404066311}]},"public_addr":"172.21.15.72:6817/3404066311","cluster_addr":"172.21.15.72:6819/3404066311","heartbeat_back_addr":"172.21.15.72:6828/3404066311","heartbeat_front_addr":"172.21.15.72:6823/3404066311","state":["exists","up"]},{"osd":4,"uuid":"7f8920dc-0ad4-4a73-ab40-65408f83eadd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6817","nonce":2381008739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6819","nonce":2381008739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6825","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6827","nonce":2381008739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6822","nonce":2381008739}]},"public_addr":"172.21.15.92:6817/2381008739","cluster_addr":"172.21.15.92:6819/2381008739","heartbeat_back_addr":"172.21.15.92:6827/2381008739","heartbeat_front_addr":"172.21.15.92:6822/2381008739","state":["exists","up"]},{"osd":5,"uuid":"56257e7c-31eb-44c5-9ec7-1318a4e0bb35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6801","nonce":2161935604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6803","nonce":2161935604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6807","nonce":2161935604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6805","nonce":2161935604}]},"public_addr":"172.21.15.92:6801/2161935604","cluster_addr":"172.21.15.92:6803/2161935604","heartbeat_back_addr":"172.21.15.92:6807/2161935604","heartbeat_front_addr":"172.21.15.92:6805/2161935604","state":["exists","up"]},{"osd":6,"uuid":"a150d3d8-a0c9-4955-968a-8d98eff4ffb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6809","nonce":3770163493}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6811","nonce":3770163493}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6815","nonce":3770163493}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6813","nonce":3770163493}]},"public_addr":"172.21.15.92:6809/3770163493","cluster_addr":"172.21.15.92:6811/3770163493","heartbeat_back_addr":"172.21.15.92:6815/3770163493","heartbeat_front_addr":"172.21.15.92:6813/3770163493","state":["exists","up"]},{"osd":7,"uuid":"07799c27-54ee-4591-a42d-a978d6b32065","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6821","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6823","nonce":2135777609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6826","nonce":2135777609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6831","nonce":2135777609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6829","nonce":2135777609}]},"public_addr":"172.21.15.92:6823/2135777609","cluster_addr":"172.21.15.92:6826/2135777609","heartbeat_back_addr":"172.21.15.92:6831/2135777609","heartbeat_front_addr":"172.21.15.92:6829/2135777609","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.345365+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.378150+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.146566+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.372172+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:30.398421+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.385632+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.465611+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.443583+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-25T14:37:03.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:03.978+0000 7f9c5099e700 1 -- 172.21.15.72:0/783668030 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f9c3806ace0 msgr2=0x7f9c3806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:03.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:03.978+0000 7f9c5099e700 1 --2- 172.21.15.72:0/783668030 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f9c3806ace0 0x7f9c3806d1a0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f9c4c0c4ea0 tx=0x7f9c40005040 comp rx=0 tx=0).stop 2023-07-25T14:37:03.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:03.978+0000 7f9c5099e700 1 -- 172.21.15.72:0/783668030 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9c34004350 msgr2=0x7f9c4c14b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:03.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:03.978+0000 7f9c5099e700 1 --2- 172.21.15.72:0/783668030 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9c34004350 0x7f9c4c14b580 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f9c3c011ab0 tx=0x7f9c3c011e70 comp rx=0 tx=0).stop 2023-07-25T14:37:03.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:03.978+0000 7f9c5099e700 1 -- 172.21.15.72:0/783668030 shutdown_connections 2023-07-25T14:37:03.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:03.978+0000 7f9c5099e700 1 --2- 172.21.15.72:0/783668030 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f9c3806ace0 0x7f9c3806d1a0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:03.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:03.978+0000 7f9c5099e700 1 --2- 172.21.15.72:0/783668030 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9c4c147020 0x7f9c4c1e9490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:03.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:03.978+0000 7f9c5099e700 1 --2- 172.21.15.72:0/783668030 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9c34004350 0x7f9c4c14b580 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:03.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:03.978+0000 7f9c5099e700 1 --2- 172.21.15.72:0/783668030 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9c4c0c0690 0x7f9c4c146ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:03.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:03.978+0000 7f9c5099e700 1 -- 172.21.15.72:0/783668030 >> 172.21.15.72:0/783668030 conn(0x7f9c4c0c7150 msgr2=0x7f9c4c14d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:03.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:03.978+0000 7f9c5099e700 1 -- 172.21.15.72:0/783668030 shutdown_connections 2023-07-25T14:37:03.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:03.978+0000 7f9c5099e700 1 -- 172.21.15.72:0/783668030 wait complete. 2023-07-25T14:37:04.002 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs2 standby_count_wanted 0 2023-07-25T14:37:04.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:04.113+0000 7fa68e306700 1 Processor -- start 2023-07-25T14:37:04.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:04.113+0000 7fa68e306700 1 -- start start 2023-07-25T14:37:04.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:04.114+0000 7fa68e306700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa68806b6d0 0x7fa688155750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:04.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:04.114+0000 7fa68e306700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fa688155c90 0x7fa68815ca80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:04.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:04.114+0000 7fa68e306700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa688066060 con 0x7fa68814f900 2023-07-25T14:37:04.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:04.114+0000 7fa68e306700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa68806ed90 con 0x7fa688155c90 2023-07-25T14:37:04.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:04.114+0000 7fa68e306700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa68814fce0 con 0x7fa68806b6d0 2023-07-25T14:37:04.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:04.114+0000 7fa6877fe700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa68806b6d0 0x7fa688155750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:04.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:04.114+0000 7fa68c8a3700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fa688155c90 0x7fa68815ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:04.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:04.114+0000 7fa6877fe700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa68806b6d0 0x7fa688155750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3301/0 says I am v2:172.21.15.72:47606/0 (socket says 172.21.15.72:47606) 2023-07-25T14:37:04.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:04.114+0000 7fa6877fe700 1 -- 172.21.15.72:0/3693322551 learned_addr learned my addr 172.21.15.72:0/3693322551 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:37:04.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:04.114+0000 7fa687fff700 1 --1- 172.21.15.72:0/3693322551 >> v1:172.21.15.92:6789/0 conn(0x7fa68814f900 0x7fa6880ab5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.72:56688/0 (socket says 172.21.15.72:56688) 2023-07-25T14:37:04.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:04.115+0000 7fa6877fe700 1 -- 172.21.15.72:0/3693322551 >> v2:172.21.15.92:3300/0 conn(0x7fa688155c90 msgr2=0x7fa68815ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:04.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:04.115+0000 7fa6877fe700 1 --2- 172.21.15.72:0/3693322551 >> v2:172.21.15.92:3300/0 conn(0x7fa688155c90 0x7fa68815ca80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:04.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:04.115+0000 7fa6877fe700 1 -- 172.21.15.72:0/3693322551 >> v1:172.21.15.92:6789/0 conn(0x7fa68814f900 legacy=0x7fa6880ab5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:04.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:04.115+0000 7fa6877fe700 1 -- 172.21.15.72:0/3693322551 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6880664f0 con 0x7fa68806b6d0 2023-07-25T14:37:04.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:04.115+0000 7fa6877fe700 1 --2- 172.21.15.72:0/3693322551 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa68806b6d0 0x7fa688155750 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fa6780098f0 tx=0x7fa678009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c4948286d1bbe882 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:04.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:04.115+0000 7fa686ffd700 1 -- 172.21.15.72:0/3693322551 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa678011830 con 0x7fa68806b6d0 2023-07-25T14:37:04.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:04.115+0000 7fa686ffd700 1 -- 172.21.15.72:0/3693322551 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa678011990 con 0x7fa68806b6d0 2023-07-25T14:37:04.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:04.115+0000 7fa686ffd700 1 -- 172.21.15.72:0/3693322551 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa678011d20 con 0x7fa68806b6d0 2023-07-25T14:37:04.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:04.116+0000 7fa68e306700 1 -- 172.21.15.72:0/3693322551 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa68806b6d0 msgr2=0x7fa688155750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:04.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:04.116+0000 7fa68e306700 1 --2- 172.21.15.72:0/3693322551 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa68806b6d0 0x7fa688155750 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fa6780098f0 tx=0x7fa678009c00 comp rx=0 tx=0).stop 2023-07-25T14:37:04.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:04.116+0000 7fa68e306700 1 -- 172.21.15.72:0/3693322551 shutdown_connections 2023-07-25T14:37:04.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:04.116+0000 7fa68e306700 1 --2- 172.21.15.72:0/3693322551 >> v2:172.21.15.92:3300/0 conn(0x7fa688155c90 0x7fa68815ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:04.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:04.116+0000 7fa68e306700 1 --2- 172.21.15.72:0/3693322551 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa68806b6d0 0x7fa688155750 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:04.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:04.116+0000 7fa68e306700 1 -- 172.21.15.72:0/3693322551 >> 172.21.15.72:0/3693322551 conn(0x7fa68806def0 msgr2=0x7fa68806e300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:04.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:04.116+0000 7fa68e306700 1 -- 172.21.15.72:0/3693322551 shutdown_connections 2023-07-25T14:37:04.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:04.116+0000 7fa68e306700 1 -- 172.21.15.72:0/3693322551 wait complete. 2023-07-25T14:37:04.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:04.117+0000 7fa68e306700 1 Processor -- start 2023-07-25T14:37:04.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:04.117+0000 7fa68e306700 1 -- start start 2023-07-25T14:37:04.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:04.118+0000 7fa68e306700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa68806b6d0 0x7fa6881ed920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:04.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:04.118+0000 7fa68e306700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa68814f900 0x7fa6880bf840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:04.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:04.118+0000 7fa68e306700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa688155c90 0x7fa688144c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:04.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:04.118+0000 7fa68e306700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6880c5900 con 0x7fa68814f900 2023-07-25T14:37:04.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:04.118+0000 7fa68e306700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6880a9e70 con 0x7fa68806b6d0 2023-07-25T14:37:04.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:04.118+0000 7fa68e306700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6881ede60 con 0x7fa688155c90 2023-07-25T14:37:04.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:04.118+0000 7fa6877fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa68814f900 0x7fa6880bf840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:04.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:04.118+0000 7fa6877fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa68814f900 0x7fa6880bf840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42384/0 (socket says 172.21.15.72:42384) 2023-07-25T14:37:04.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:04.118+0000 7fa6877fe700 1 -- 172.21.15.72:0/3928391380 learned_addr learned my addr 172.21.15.72:0/3928391380 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:37:04.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:04.118+0000 7fa68c8a3700 1 --2- 172.21.15.72:0/3928391380 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa688155c90 0x7fa688144c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:04.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:04.118+0000 7fa687fff700 1 --2- 172.21.15.72:0/3928391380 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa68806b6d0 0x7fa6881ed920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:04.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:04.118+0000 7fa6877fe700 1 -- 172.21.15.72:0/3928391380 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa688155c90 msgr2=0x7fa688144c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:04.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:04.118+0000 7fa6877fe700 1 --2- 172.21.15.72:0/3928391380 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa688155c90 0x7fa688144c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:04.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:04.118+0000 7fa6877fe700 1 -- 172.21.15.72:0/3928391380 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa68806b6d0 msgr2=0x7fa6881ed920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:04.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:04.118+0000 7fa6877fe700 1 --2- 172.21.15.72:0/3928391380 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa68806b6d0 0x7fa6881ed920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:04.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:04.118+0000 7fa6877fe700 1 -- 172.21.15.72:0/3928391380 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa678009550 con 0x7fa68814f900 2023-07-25T14:37:04.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:04.118+0000 7fa687fff700 1 --2- 172.21.15.72:0/3928391380 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa68806b6d0 0x7fa6881ed920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-25T14:37:04.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:04.118+0000 7fa6877fe700 1 --2- 172.21.15.72:0/3928391380 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa68814f900 0x7fa6880bf840 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fa678009c40 tx=0x7fa678004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:04.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:04.118+0000 7fa684ff9700 1 -- 172.21.15.72:0/3928391380 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa678004480 con 0x7fa68814f900 2023-07-25T14:37:04.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:04.118+0000 7fa684ff9700 1 -- 172.21.15.72:0/3928391380 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa67801f070 con 0x7fa68814f900 2023-07-25T14:37:04.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:04.118+0000 7fa684ff9700 1 -- 172.21.15.72:0/3928391380 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6780038e0 con 0x7fa68814f900 2023-07-25T14:37:04.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:04.118+0000 7fa68e306700 1 -- 172.21.15.72:0/3928391380 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa688154220 con 0x7fa68814f900 2023-07-25T14:37:04.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:04.119+0000 7fa68e306700 1 -- 172.21.15.72:0/3928391380 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6880a9820 con 0x7fa68814f900 2023-07-25T14:37:04.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:04.119+0000 7fa68e306700 1 -- 172.21.15.72:0/3928391380 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa68804e470 con 0x7fa68814f900 2023-07-25T14:37:04.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:04.120+0000 7fa684ff9700 1 -- 172.21.15.72:0/3928391380 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa678021030 con 0x7fa68814f900 2023-07-25T14:37:04.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:04.120+0000 7fa684ff9700 1 --2- 172.21.15.72:0/3928391380 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fa67406ace0 0x7fa67406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:04.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:04.120+0000 7fa684ff9700 1 -- 172.21.15.72:0/3928391380 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 7238+0+0 (secure 0 0 0) 0x7fa67808aca0 con 0x7fa68814f900 2023-07-25T14:37:04.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:04.120+0000 7fa687fff700 1 --2- 172.21.15.72:0/3928391380 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fa67406ace0 0x7fa67406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:04.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:04.121+0000 7fa687fff700 1 --2- 172.21.15.72:0/3928391380 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fa67406ace0 0x7fa67406d1a0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fa67c000f60 tx=0x7fa67c007dd0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:04.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:04.125+0000 7fa684ff9700 1 -- 172.21.15.72:0/3928391380 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fa678055940 con 0x7fa68814f900 2023-07-25T14:37:04.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:04.361+0000 7fa68e306700 1 -- 172.21.15.72:0/3928391380 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs2", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fa6880a9fb0 con 0x7fa68814f900 2023-07-25T14:37:05.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:05.294+0000 7fa684ff9700 1 -- 172.21.15.72:0/3928391380 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs2", "var": "standby_count_wanted", "val": "0"}]=0 v21) v1 ==== 119+0+0 (secure 0 0 0) 0x7fa6780150b0 con 0x7fa68814f900 2023-07-25T14:37:05.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:05.297+0000 7fa68e306700 1 -- 172.21.15.72:0/3928391380 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fa67406ace0 msgr2=0x7fa67406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:05.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:05.297+0000 7fa68e306700 1 --2- 172.21.15.72:0/3928391380 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fa67406ace0 0x7fa67406d1a0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fa67c000f60 tx=0x7fa67c007dd0 comp rx=0 tx=0).stop 2023-07-25T14:37:05.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:05.297+0000 7fa68e306700 1 -- 172.21.15.72:0/3928391380 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa68814f900 msgr2=0x7fa6880bf840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:05.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:05.297+0000 7fa68e306700 1 --2- 172.21.15.72:0/3928391380 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa68814f900 0x7fa6880bf840 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fa678009c40 tx=0x7fa678004750 comp rx=0 tx=0).stop 2023-07-25T14:37:05.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:05.297+0000 7fa68e306700 1 -- 172.21.15.72:0/3928391380 shutdown_connections 2023-07-25T14:37:05.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:05.297+0000 7fa68e306700 1 --2- 172.21.15.72:0/3928391380 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fa67406ace0 0x7fa67406d1a0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:05.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:05.297+0000 7fa68e306700 1 --2- 172.21.15.72:0/3928391380 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa688155c90 0x7fa688144c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:05.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:05.297+0000 7fa68e306700 1 --2- 172.21.15.72:0/3928391380 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa68806b6d0 0x7fa6881ed920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:05.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:05.297+0000 7fa68e306700 1 --2- 172.21.15.72:0/3928391380 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa68814f900 0x7fa6880bf840 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:05.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:05.297+0000 7fa68e306700 1 -- 172.21.15.72:0/3928391380 >> 172.21.15.72:0/3928391380 conn(0x7fa68806def0 msgr2=0x7fa6880c1720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:05.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:05.297+0000 7fa68e306700 1 -- 172.21.15.72:0/3928391380 shutdown_connections 2023-07-25T14:37:05.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:05.297+0000 7fa68e306700 1 -- 172.21.15.72:0/3928391380 wait complete. 2023-07-25T14:37:05.325 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-07-25T14:37:05.325 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs2 allow_standby_replay false 2023-07-25T14:37:05.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:05.445+0000 7f71c50a3700 1 Processor -- start 2023-07-25T14:37:05.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:05.445+0000 7f71c50a3700 1 -- start start 2023-07-25T14:37:05.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:05.446+0000 7f71c50a3700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f71c006ed70 0x7f71c00bf9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:05.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:05.446+0000 7f71c50a3700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f71c006a190 0x7f71c00bfef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:05.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:05.446+0000 7f71c50a3700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71c0066050 con 0x7f71c00bf5d0 2023-07-25T14:37:05.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:05.446+0000 7f71c50a3700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71c006b560 con 0x7f71c006a190 2023-07-25T14:37:05.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:05.446+0000 7f71c50a3700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71c0151be0 con 0x7f71c006ed70 2023-07-25T14:37:05.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:05.446+0000 7f71bed9d700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f71c00bf5d0 0x7f71c00a7490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:33126/0 (socket says 172.21.15.72:33126) 2023-07-25T14:37:05.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:05.446+0000 7f71bed9d700 1 -- 172.21.15.72:0/3709356261 learned_addr learned my addr 172.21.15.72:0/3709356261 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:37:05.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:05.447+0000 7f71bf59e700 1 --2- 172.21.15.72:0/3709356261 >> v2:172.21.15.92:3300/0 conn(0x7f71c006a190 0x7f71c00bfef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:05.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:05.447+0000 7f71be59c700 1 --2- 172.21.15.72:0/3709356261 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f71c006ed70 0x7f71c00bf9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:05.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:05.447+0000 7f71bdd9b700 1 -- 172.21.15.72:0/3709356261 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4232382596 0 0) 0x7f71c0066050 con 0x7f71c00bf5d0 2023-07-25T14:37:05.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:05.447+0000 7f71bdd9b700 1 -- 172.21.15.72:0/3709356261 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f71a80035b0 con 0x7f71c00bf5d0 2023-07-25T14:37:05.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:05.447+0000 7f71bdd9b700 1 -- 172.21.15.72:0/3709356261 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3257233809 0 0) 0x7f71a80035b0 con 0x7f71c00bf5d0 2023-07-25T14:37:05.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:05.447+0000 7f71bdd9b700 1 -- 172.21.15.72:0/3709356261 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f71c006ed70 msgr2=0x7f71c00bf9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:05.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:05.447+0000 7f71bdd9b700 1 --2- 172.21.15.72:0/3709356261 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f71c006ed70 0x7f71c00bf9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:05.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:05.447+0000 7f71bdd9b700 1 -- 172.21.15.72:0/3709356261 >> v2:172.21.15.92:3300/0 conn(0x7f71c006a190 msgr2=0x7f71c00bfef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:05.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:05.447+0000 7f71bdd9b700 1 --2- 172.21.15.72:0/3709356261 >> v2:172.21.15.92:3300/0 conn(0x7f71c006a190 0x7f71c00bfef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:05.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:05.447+0000 7f71bdd9b700 1 -- 172.21.15.72:0/3709356261 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71c0154d60 con 0x7f71c00bf5d0 2023-07-25T14:37:05.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:05.447+0000 7f71bdd9b700 1 -- 172.21.15.72:0/3709356261 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2559588315 0 0) 0x7f71b4001670 con 0x7f71c00bf5d0 2023-07-25T14:37:05.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:05.447+0000 7f71bdd9b700 1 -- 172.21.15.72:0/3709356261 >> v1:172.21.15.72:6789/0 conn(0x7f71c00bf5d0 legacy=0x7f71c00a7490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:05.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:05.447+0000 7f71bdd9b700 1 --2- 172.21.15.72:0/3709356261 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f71c006ed70 0x7f71a8003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:05.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:05.447+0000 7f71bdd9b700 1 --2- 172.21.15.72:0/3709356261 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f71a8003f80 0x7f71a8004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:05.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:05.447+0000 7f71bdd9b700 1 --2- 172.21.15.72:0/3709356261 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f71a8004d90 0x7f71a8005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:05.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:05.447+0000 7f71bdd9b700 1 -- 172.21.15.72:0/3709356261 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71c006b560 con 0x7f71a8004d90 2023-07-25T14:37:05.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:05.447+0000 7f71bdd9b700 1 -- 172.21.15.72:0/3709356261 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71c0151be0 con 0x7f71a8003f80 2023-07-25T14:37:05.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:05.447+0000 7f71bdd9b700 1 -- 172.21.15.72:0/3709356261 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71a800ba10 con 0x7f71c006ed70 2023-07-25T14:37:05.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:05.447+0000 7f71bf59e700 1 --2- 172.21.15.72:0/3709356261 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f71a8004d90 0x7f71a8005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:05.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:05.447+0000 7f71be59c700 1 --2- 172.21.15.72:0/3709356261 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f71a8003f80 0x7f71a8004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:05.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:05.447+0000 7f71bed9d700 1 --2- 172.21.15.72:0/3709356261 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f71c006ed70 0x7f71a8003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:05.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:05.447+0000 7f71bf59e700 1 -- 172.21.15.72:0/3709356261 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f71c006ed70 msgr2=0x7f71a8003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:05.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:05.447+0000 7f71bf59e700 1 --2- 172.21.15.72:0/3709356261 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f71c006ed70 0x7f71a8003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:05.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:05.447+0000 7f71bf59e700 1 -- 172.21.15.72:0/3709356261 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f71a8003f80 msgr2=0x7f71a8004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:05.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:05.447+0000 7f71bf59e700 1 --2- 172.21.15.72:0/3709356261 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f71a8003f80 0x7f71a8004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:05.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:05.447+0000 7f71bf59e700 1 -- 172.21.15.72:0/3709356261 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71a80035b0 con 0x7f71a8004d90 2023-07-25T14:37:05.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:05.447+0000 7f71bed9d700 1 --2- 172.21.15.72:0/3709356261 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f71c006ed70 0x7f71a8003a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-25T14:37:05.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:05.447+0000 7f71be59c700 1 --2- 172.21.15.72:0/3709356261 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f71a8003f80 0x7f71a8004850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-25T14:37:05.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:05.448+0000 7f71bf59e700 1 --2- 172.21.15.72:0/3709356261 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f71a8004d90 0x7f71a8005210 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f71b8009f90 tx=0x7f71a8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6c2a8a170922bd7 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:05.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:05.448+0000 7f71bdd9b700 1 -- 172.21.15.72:0/3709356261 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71b800ebd0 con 0x7f71a8004d90 2023-07-25T14:37:05.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:05.448+0000 7f71bdd9b700 1 -- 172.21.15.72:0/3709356261 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71b800f040 con 0x7f71a8004d90 2023-07-25T14:37:05.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:05.448+0000 7f71bdd9b700 1 -- 172.21.15.72:0/3709356261 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71b8014480 con 0x7f71a8004d90 2023-07-25T14:37:05.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:05.448+0000 7f71c50a3700 1 -- 172.21.15.72:0/3709356261 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f71a8004d90 msgr2=0x7f71a8005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:05.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:05.448+0000 7f71c50a3700 1 --2- 172.21.15.72:0/3709356261 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f71a8004d90 0x7f71a8005210 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f71b8009f90 tx=0x7f71a8005880 comp rx=0 tx=0).stop 2023-07-25T14:37:05.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:05.448+0000 7f71bf59e700 1 -- 172.21.15.72:0/3709356261 reap_dead start 2023-07-25T14:37:05.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:05.448+0000 7f71c50a3700 1 -- 172.21.15.72:0/3709356261 shutdown_connections 2023-07-25T14:37:05.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:05.448+0000 7f71c50a3700 1 -- 172.21.15.72:0/3709356261 >> 172.21.15.72:0/3709356261 conn(0x7f71c006def0 msgr2=0x7f71c006e300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:05.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:05.448+0000 7f71c50a3700 1 -- 172.21.15.72:0/3709356261 shutdown_connections 2023-07-25T14:37:05.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:05.448+0000 7f71c50a3700 1 -- 172.21.15.72:0/3709356261 wait complete. 2023-07-25T14:37:05.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:05.450+0000 7f71c50a3700 1 Processor -- start 2023-07-25T14:37:05.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:05.450+0000 7f71c50a3700 1 -- start start 2023-07-25T14:37:05.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:05.450+0000 7f71c50a3700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f71a8004d90 0x7f71c00c18b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:05.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:05.450+0000 7f71c50a3700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f71c0158240 0x7f71c0156280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:05.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:05.450+0000 7f71c50a3700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f71c01567c0 0x7f71c01de9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:05.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:05.450+0000 7f71c50a3700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71c0158760 con 0x7f71a8004d90 2023-07-25T14:37:05.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:05.450+0000 7f71c50a3700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71c00abf80 con 0x7f71c0158240 2023-07-25T14:37:05.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:05.450+0000 7f71c50a3700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71c0157150 con 0x7f71c01567c0 2023-07-25T14:37:05.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:05.451+0000 7f71bed9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f71a8004d90 0x7f71c00c18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:05.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:05.451+0000 7f71bed9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f71a8004d90 0x7f71c00c18b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42402/0 (socket says 172.21.15.72:42402) 2023-07-25T14:37:05.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:05.451+0000 7f71bed9d700 1 -- 172.21.15.72:0/1469364550 learned_addr learned my addr 172.21.15.72:0/1469364550 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:37:05.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:05.451+0000 7f71be59c700 1 --2- 172.21.15.72:0/1469364550 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f71c0158240 0x7f71c0156280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:05.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:05.451+0000 7f71bf59e700 1 --2- 172.21.15.72:0/1469364550 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f71c01567c0 0x7f71c01de9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:05.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:05.451+0000 7f71bed9d700 1 -- 172.21.15.72:0/1469364550 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f71c01567c0 msgr2=0x7f71c01de9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:05.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:05.451+0000 7f71bed9d700 1 --2- 172.21.15.72:0/1469364550 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f71c01567c0 0x7f71c01de9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:05.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:05.451+0000 7f71bed9d700 1 -- 172.21.15.72:0/1469364550 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f71c0158240 msgr2=0x7f71c0156280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:05.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:05.451+0000 7f71bed9d700 1 --2- 172.21.15.72:0/1469364550 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f71c0158240 0x7f71c0156280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:05.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:05.451+0000 7f71bed9d700 1 -- 172.21.15.72:0/1469364550 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71c0156c50 con 0x7f71a8004d90 2023-07-25T14:37:05.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:05.451+0000 7f71be59c700 1 --2- 172.21.15.72:0/1469364550 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f71c0158240 0x7f71c0156280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-25T14:37:05.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:05.451+0000 7f71bed9d700 1 --2- 172.21.15.72:0/1469364550 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f71a8004d90 0x7f71c00c18b0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f71b400e8f0 tx=0x7f71b400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:05.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:05.451+0000 7f71a77fe700 1 -- 172.21.15.72:0/1469364550 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71b400c7e0 con 0x7f71a8004d90 2023-07-25T14:37:05.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:05.451+0000 7f71a77fe700 1 -- 172.21.15.72:0/1469364550 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71b400c940 con 0x7f71a8004d90 2023-07-25T14:37:05.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:05.451+0000 7f71c50a3700 1 -- 172.21.15.72:0/1469364550 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71c01e1450 con 0x7f71a8004d90 2023-07-25T14:37:05.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:05.451+0000 7f71a77fe700 1 -- 172.21.15.72:0/1469364550 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71b400ccd0 con 0x7f71a8004d90 2023-07-25T14:37:05.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:05.451+0000 7f71c50a3700 1 -- 172.21.15.72:0/1469364550 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71c00c1df0 con 0x7f71a8004d90 2023-07-25T14:37:05.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:05.452+0000 7f71c50a3700 1 -- 172.21.15.72:0/1469364550 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71c0151db0 con 0x7f71a8004d90 2023-07-25T14:37:05.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:05.453+0000 7f71a77fe700 1 -- 172.21.15.72:0/1469364550 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f71b401d460 con 0x7f71a8004d90 2023-07-25T14:37:05.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:05.453+0000 7f71a77fe700 1 --2- 172.21.15.72:0/1469364550 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f71ac06ace0 0x7f71ac06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:05.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:05.453+0000 7f71a77fe700 1 -- 172.21.15.72:0/1469364550 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 7238+0+0 (secure 0 0 0) 0x7f71b4089900 con 0x7f71a8004d90 2023-07-25T14:37:05.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:05.453+0000 7f71be59c700 1 --2- 172.21.15.72:0/1469364550 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f71ac06ace0 0x7f71ac06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:05.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:05.453+0000 7f71be59c700 1 --2- 172.21.15.72:0/1469364550 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f71ac06ace0 0x7f71ac06d1a0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f71b0009b50 tx=0x7f71b0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:05.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:05.457+0000 7f71a77fe700 1 -- 172.21.15.72:0/1469364550 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f71b4054510 con 0x7f71a8004d90 2023-07-25T14:37:05.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:05.688+0000 7f71c50a3700 1 -- 172.21.15.72:0/1469364550 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs2", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f71c00abc70 con 0x7f71a8004d90 2023-07-25T14:37:06.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:06.301+0000 7f71a77fe700 1 -- 172.21.15.72:0/1469364550 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs2", "var": "allow_standby_replay", "val": "false"}]=0 v22) v1 ==== 123+0+0 (secure 0 0 0) 0x7f71b4057b30 con 0x7f71a8004d90 2023-07-25T14:37:06.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:06.303+0000 7f71c50a3700 1 -- 172.21.15.72:0/1469364550 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f71ac06ace0 msgr2=0x7f71ac06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:06.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:06.303+0000 7f71c50a3700 1 --2- 172.21.15.72:0/1469364550 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f71ac06ace0 0x7f71ac06d1a0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f71b0009b50 tx=0x7f71b0008040 comp rx=0 tx=0).stop 2023-07-25T14:37:06.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:06.303+0000 7f71c50a3700 1 -- 172.21.15.72:0/1469364550 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f71a8004d90 msgr2=0x7f71c00c18b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:06.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:06.303+0000 7f71c50a3700 1 --2- 172.21.15.72:0/1469364550 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f71a8004d90 0x7f71c00c18b0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f71b400e8f0 tx=0x7f71b400ecb0 comp rx=0 tx=0).stop 2023-07-25T14:37:06.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:06.303+0000 7f71c50a3700 1 -- 172.21.15.72:0/1469364550 shutdown_connections 2023-07-25T14:37:06.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:06.303+0000 7f71c50a3700 1 --2- 172.21.15.72:0/1469364550 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f71ac06ace0 0x7f71ac06d1a0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:06.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:06.303+0000 7f71c50a3700 1 --2- 172.21.15.72:0/1469364550 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f71c01567c0 0x7f71c01de9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:06.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:06.303+0000 7f71c50a3700 1 --2- 172.21.15.72:0/1469364550 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f71a8004d90 0x7f71c00c18b0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:06.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:06.303+0000 7f71c50a3700 1 --2- 172.21.15.72:0/1469364550 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f71c0158240 0x7f71c0156280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:06.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:06.303+0000 7f71c50a3700 1 -- 172.21.15.72:0/1469364550 >> 172.21.15.72:0/1469364550 conn(0x7f71c006def0 msgr2=0x7f71c00c5390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:06.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:06.303+0000 7f71c50a3700 1 -- 172.21.15.72:0/1469364550 shutdown_connections 2023-07-25T14:37:06.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:06.303+0000 7f71c50a3700 1 -- 172.21.15.72:0/1469364550 wait complete. 2023-07-25T14:37:06.327 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs2' 2023-07-25T14:37:06.327 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-25T14:37:06.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:06.437+0000 7f454ab9e700 1 Processor -- start 2023-07-25T14:37:06.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:06.437+0000 7f454ab9e700 1 -- start start 2023-07-25T14:37:06.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:06.438+0000 7f454ab9e700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4544151870 0x7f45440c9db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:06.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:06.438+0000 7f454ab9e700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f4544158100 0x7f4544154bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:06.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:06.438+0000 7f454ab9e700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45441550f0 con 0x7f45440c7df0 2023-07-25T14:37:06.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:06.438+0000 7f454ab9e700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4544151c50 con 0x7f4544158100 2023-07-25T14:37:06.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:06.438+0000 7f454ab9e700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45440c5710 con 0x7f4544151870 2023-07-25T14:37:06.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:06.438+0000 7f454939b700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f45440c7df0 0x7f45441544a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:33148/0 (socket says 172.21.15.72:33148) 2023-07-25T14:37:06.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:06.438+0000 7f454939b700 1 -- 172.21.15.72:0/1100694268 learned_addr learned my addr 172.21.15.72:0/1100694268 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:37:06.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:06.438+0000 7f454a39d700 1 --2- 172.21.15.72:0/1100694268 >> v2:172.21.15.92:3300/0 conn(0x7f4544158100 0x7f4544154bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:06.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:06.438+0000 7f4549b9c700 1 --2- 172.21.15.72:0/1100694268 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4544151870 0x7f45440c9db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:06.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:06.438+0000 7f4548b9a700 1 -- 172.21.15.72:0/1100694268 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3863601189 0 0) 0x7f45441550f0 con 0x7f45440c7df0 2023-07-25T14:37:06.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:06.439+0000 7f4548b9a700 1 -- 172.21.15.72:0/1100694268 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f45300035b0 con 0x7f45440c7df0 2023-07-25T14:37:06.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:06.439+0000 7f4548b9a700 1 -- 172.21.15.72:0/1100694268 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2241078015 0 0) 0x7f45300035b0 con 0x7f45440c7df0 2023-07-25T14:37:06.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:06.439+0000 7f4548b9a700 1 -- 172.21.15.72:0/1100694268 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4544151870 msgr2=0x7f45440c9db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:06.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:06.439+0000 7f4548b9a700 1 --2- 172.21.15.72:0/1100694268 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4544151870 0x7f45440c9db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:06.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:06.439+0000 7f4548b9a700 1 -- 172.21.15.72:0/1100694268 >> v2:172.21.15.92:3300/0 conn(0x7f4544158100 msgr2=0x7f4544154bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:06.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:06.439+0000 7f4548b9a700 1 --2- 172.21.15.72:0/1100694268 >> v2:172.21.15.92:3300/0 conn(0x7f4544158100 0x7f4544154bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:06.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:06.439+0000 7f4548b9a700 1 -- 172.21.15.72:0/1100694268 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45440c4400 con 0x7f45440c7df0 2023-07-25T14:37:06.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:06.439+0000 7f4548b9a700 1 -- 172.21.15.72:0/1100694268 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2559588315 0 0) 0x7f4540001670 con 0x7f45440c7df0 2023-07-25T14:37:06.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:06.439+0000 7f4548b9a700 1 -- 172.21.15.72:0/1100694268 >> v1:172.21.15.72:6789/0 conn(0x7f45440c7df0 legacy=0x7f45441544a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:06.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:06.439+0000 7f4548b9a700 1 --2- 172.21.15.72:0/1100694268 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4544151870 0x7f4530003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:06.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:06.439+0000 7f4548b9a700 1 --2- 172.21.15.72:0/1100694268 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4530003f80 0x7f4530004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:06.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:06.439+0000 7f4548b9a700 1 --2- 172.21.15.72:0/1100694268 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4530004d90 0x7f4530005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:06.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:06.439+0000 7f4548b9a700 1 -- 172.21.15.72:0/1100694268 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4544151c50 con 0x7f4530004d90 2023-07-25T14:37:06.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:06.439+0000 7f4548b9a700 1 -- 172.21.15.72:0/1100694268 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f453000ba10 con 0x7f4530003f80 2023-07-25T14:37:06.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:06.439+0000 7f4548b9a700 1 -- 172.21.15.72:0/1100694268 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f453000bb50 con 0x7f4544151870 2023-07-25T14:37:06.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:06.439+0000 7f454a39d700 1 --2- 172.21.15.72:0/1100694268 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4530004d90 0x7f4530005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:06.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:06.439+0000 7f4549b9c700 1 --2- 172.21.15.72:0/1100694268 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4544151870 0x7f4530003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:06.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:06.439+0000 7f454939b700 1 --2- 172.21.15.72:0/1100694268 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4530003f80 0x7f4530004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:06.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:06.439+0000 7f454a39d700 1 -- 172.21.15.72:0/1100694268 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4544151870 msgr2=0x7f4530003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:06.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:06.439+0000 7f454a39d700 1 --2- 172.21.15.72:0/1100694268 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4544151870 0x7f4530003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:06.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:06.439+0000 7f454a39d700 1 -- 172.21.15.72:0/1100694268 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4530003f80 msgr2=0x7f4530004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:06.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:06.439+0000 7f454a39d700 1 --2- 172.21.15.72:0/1100694268 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4530003f80 0x7f4530004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:06.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:06.439+0000 7f454a39d700 1 -- 172.21.15.72:0/1100694268 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45300035b0 con 0x7f4530004d90 2023-07-25T14:37:06.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:06.439+0000 7f454a39d700 1 --2- 172.21.15.72:0/1100694268 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4530004d90 0x7f4530005210 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f454406ade0 tx=0x7f4530005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cada4018d1e67125 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:06.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:06.439+0000 7f4548b9a700 1 -- 172.21.15.72:0/1100694268 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f453c00eb70 con 0x7f4530004d90 2023-07-25T14:37:06.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:06.440+0000 7f4548b9a700 1 -- 172.21.15.72:0/1100694268 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f453c00f040 con 0x7f4530004d90 2023-07-25T14:37:06.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:06.440+0000 7f4548b9a700 1 -- 172.21.15.72:0/1100694268 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f453c014480 con 0x7f4530004d90 2023-07-25T14:37:06.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:06.440+0000 7f454ab9e700 1 -- 172.21.15.72:0/1100694268 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4530004d90 msgr2=0x7f4530005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:06.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:06.440+0000 7f454ab9e700 1 --2- 172.21.15.72:0/1100694268 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4530004d90 0x7f4530005210 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f454406ade0 tx=0x7f4530005880 comp rx=0 tx=0).stop 2023-07-25T14:37:06.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:06.440+0000 7f454a39d700 1 -- 172.21.15.72:0/1100694268 reap_dead start 2023-07-25T14:37:06.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:06.440+0000 7f454ab9e700 1 -- 172.21.15.72:0/1100694268 shutdown_connections 2023-07-25T14:37:06.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:06.440+0000 7f454ab9e700 1 -- 172.21.15.72:0/1100694268 >> 172.21.15.72:0/1100694268 conn(0x7f4544071aa0 msgr2=0x7f4544071eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:06.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:06.440+0000 7f454ab9e700 1 -- 172.21.15.72:0/1100694268 shutdown_connections 2023-07-25T14:37:06.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:06.440+0000 7f454ab9e700 1 -- 172.21.15.72:0/1100694268 wait complete. 2023-07-25T14:37:06.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:06.441+0000 7f454ab9e700 1 Processor -- start 2023-07-25T14:37:06.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:06.442+0000 7f454ab9e700 1 -- start start 2023-07-25T14:37:06.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:06.442+0000 7f454ab9e700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4530004d90 0x7f45440aaa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:06.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:06.442+0000 7f454ab9e700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f45440aa330 0x7f45441ed210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:06.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:06.442+0000 7f454ab9e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f45441ed750 0x7f45441e9a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:06.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:06.442+0000 7f454ab9e700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f454414cbc0 con 0x7f45441ed750 2023-07-25T14:37:06.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:06.442+0000 7f454ab9e700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45441e9580 con 0x7f45440aa330 2023-07-25T14:37:06.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:06.442+0000 7f454ab9e700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f454414e150 con 0x7f4530004d90 2023-07-25T14:37:06.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:06.442+0000 7f454a39d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f45441ed750 0x7f45441e9a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:06.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:06.442+0000 7f454a39d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f45441ed750 0x7f45441e9a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42426/0 (socket says 172.21.15.72:42426) 2023-07-25T14:37:06.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:06.442+0000 7f454a39d700 1 -- 172.21.15.72:0/975629807 learned_addr learned my addr 172.21.15.72:0/975629807 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:37:06.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:06.442+0000 7f4549b9c700 1 --2- 172.21.15.72:0/975629807 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4530004d90 0x7f45440aaa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:06.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:06.442+0000 7f454939b700 1 --2- 172.21.15.72:0/975629807 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f45440aa330 0x7f45441ed210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:06.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:06.443+0000 7f454a39d700 1 -- 172.21.15.72:0/975629807 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4530004d90 msgr2=0x7f45440aaa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:06.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:06.443+0000 7f454a39d700 1 --2- 172.21.15.72:0/975629807 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4530004d90 0x7f45440aaa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:06.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:06.443+0000 7f454a39d700 1 -- 172.21.15.72:0/975629807 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f45440aa330 msgr2=0x7f45441ed210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:06.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:06.443+0000 7f454a39d700 1 --2- 172.21.15.72:0/975629807 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f45440aa330 0x7f45441ed210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:06.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:06.443+0000 7f454a39d700 1 -- 172.21.15.72:0/975629807 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45441ecb30 con 0x7f45441ed750 2023-07-25T14:37:06.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:06.443+0000 7f454a39d700 1 --2- 172.21.15.72:0/975629807 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f45441ed750 0x7f45441e9a40 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f453c016040 tx=0x7f453c009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:06.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:06.443+0000 7f45367fc700 1 -- 172.21.15.72:0/975629807 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f453c007000 con 0x7f45441ed750 2023-07-25T14:37:06.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:06.443+0000 7f45367fc700 1 -- 172.21.15.72:0/975629807 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f453c003e50 con 0x7f45441ed750 2023-07-25T14:37:06.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:06.443+0000 7f454ab9e700 1 -- 172.21.15.72:0/975629807 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f454414e3f0 con 0x7f45441ed750 2023-07-25T14:37:06.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:06.443+0000 7f45367fc700 1 -- 172.21.15.72:0/975629807 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f453c014aa0 con 0x7f45441ed750 2023-07-25T14:37:06.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:06.443+0000 7f454ab9e700 1 -- 172.21.15.72:0/975629807 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f454414e9b0 con 0x7f45441ed750 2023-07-25T14:37:06.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:06.444+0000 7f454ab9e700 1 -- 172.21.15.72:0/975629807 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f454404e470 con 0x7f45441ed750 2023-07-25T14:37:06.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:06.444+0000 7f45367fc700 1 -- 172.21.15.72:0/975629807 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f453c024070 con 0x7f45441ed750 2023-07-25T14:37:06.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:06.445+0000 7f45367fc700 1 --2- 172.21.15.72:0/975629807 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f452806ace0 0x7f452806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:06.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:06.445+0000 7f45367fc700 1 -- 172.21.15.72:0/975629807 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 7238+0+0 (secure 0 0 0) 0x7f453c08b410 con 0x7f45441ed750 2023-07-25T14:37:06.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:06.445+0000 7f4549b9c700 1 --2- 172.21.15.72:0/975629807 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f452806ace0 0x7f452806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:06.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:06.445+0000 7f4549b9c700 1 --2- 172.21.15.72:0/975629807 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f452806ace0 0x7f452806d1a0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f4538009c60 tx=0x7f4538009210 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:06.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:06.449+0000 7f45367fc700 1 -- 172.21.15.72:0/975629807 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f453c0560b0 con 0x7f45441ed750 2023-07-25T14:37:06.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:06.680+0000 7f454ab9e700 1 -- 172.21.15.72:0/975629807 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f454414eb40 con 0x7f45441ed750 2023-07-25T14:37:06.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:06.680+0000 7f45367fc700 1 -- 172.21.15.72:0/975629807 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+5813 (secure 0 0 0) 0x7f453c0596d0 con 0x7f45441ed750 2023-07-25T14:37:06.692 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-25T14:37:06.692 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":22,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5092,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6834/3640355071","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":3640355071},{"type":"v1","addr":"172.21.15.92:6834","nonce":3640355071}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5095,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/936080292","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6833","nonce":936080292},{"type":"v1","addr":"172.21.15.92:6835","nonce":936080292}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-25T14:36:49.567868+0000","modified":"2023-07-25T14:36:53.213193+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5331},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5331":{"gid":5331,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.72:6837/1193027887","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6835","nonce":1193027887},{"type":"v1","addr":"172.21.15.72:6837","nonce":1193027887}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-25T14:37:02.650515+0000","modified":"2023-07-25T14:37:06.294518+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5328},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5328":{"gid":5328,"name":"c","rank":0,"incarnation":18,"state":"up:active","state_seq":7,"addr":"172.21.15.72:6836/2944832990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":2944832990},{"type":"v1","addr":"172.21.15.72:6836","nonce":2944832990}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-07-25T14:37:06.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:06.682+0000 7f454ab9e700 1 -- 172.21.15.72:0/975629807 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f452806ace0 msgr2=0x7f452806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:06.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:06.682+0000 7f454ab9e700 1 --2- 172.21.15.72:0/975629807 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f452806ace0 0x7f452806d1a0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f4538009c60 tx=0x7f4538009210 comp rx=0 tx=0).stop 2023-07-25T14:37:06.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:06.682+0000 7f454ab9e700 1 -- 172.21.15.72:0/975629807 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f45441ed750 msgr2=0x7f45441e9a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:06.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:06.682+0000 7f454ab9e700 1 --2- 172.21.15.72:0/975629807 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f45441ed750 0x7f45441e9a40 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f453c016040 tx=0x7f453c009750 comp rx=0 tx=0).stop 2023-07-25T14:37:06.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:06.682+0000 7f454ab9e700 1 -- 172.21.15.72:0/975629807 shutdown_connections 2023-07-25T14:37:06.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:06.682+0000 7f454ab9e700 1 --2- 172.21.15.72:0/975629807 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f452806ace0 0x7f452806d1a0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:06.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:06.682+0000 7f454ab9e700 1 --2- 172.21.15.72:0/975629807 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4530004d90 0x7f45440aaa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:06.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:06.682+0000 7f454ab9e700 1 --2- 172.21.15.72:0/975629807 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f45441ed750 0x7f45441e9a40 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:06.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:06.682+0000 7f454ab9e700 1 --2- 172.21.15.72:0/975629807 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f45440aa330 0x7f45441ed210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:06.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:06.682+0000 7f454ab9e700 1 -- 172.21.15.72:0/975629807 >> 172.21.15.72:0/975629807 conn(0x7f4544071aa0 msgr2=0x7f45441524a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:06.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:06.682+0000 7f454ab9e700 1 -- 172.21.15.72:0/975629807 shutdown_connections 2023-07-25T14:37:06.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:06.682+0000 7f454ab9e700 1 -- 172.21.15.72:0/975629807 wait complete. 2023-07-25T14:37:06.695 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 22 2023-07-25T14:37:06.708 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-25T14:37:06.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:06.816+0000 7fe4f1a46700 1 Processor -- start 2023-07-25T14:37:06.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:06.816+0000 7fe4f1a46700 1 -- start start 2023-07-25T14:37:06.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:06.817+0000 7fe4f1a46700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe4ec14e6f0 0x7fe4ec0c67d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:06.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:06.817+0000 7fe4f1a46700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fe4ec0c11f0 0x7fe4ec0a8880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:06.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:06.817+0000 7fe4f1a46700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4ec0ba1c0 con 0x7fe4ec06f280 2023-07-25T14:37:06.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:06.817+0000 7fe4f1a46700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4ec0a7920 con 0x7fe4ec14e6f0 2023-07-25T14:37:06.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:06.817+0000 7fe4f1a46700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4ec154640 con 0x7fe4ec0c11f0 2023-07-25T14:37:06.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:06.817+0000 7fe4eaffd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe4ec14e6f0 0x7fe4ec0c67d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:06.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:06.817+0000 7fe4ea7fc700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fe4ec06f280 0x7fe4ec0a8170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:33166/0 (socket says 172.21.15.72:33166) 2023-07-25T14:37:06.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:06.817+0000 7fe4ea7fc700 1 -- 172.21.15.72:0/785191397 learned_addr learned my addr 172.21.15.72:0/785191397 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:37:06.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:06.818+0000 7fe4eaffd700 1 -- 172.21.15.72:0/785191397 >> v2:172.21.15.92:3300/0 conn(0x7fe4ec0c11f0 msgr2=0x7fe4ec0a8880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:06.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:06.818+0000 7fe4eaffd700 1 --2- 172.21.15.72:0/785191397 >> v2:172.21.15.92:3300/0 conn(0x7fe4ec0c11f0 0x7fe4ec0a8880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:06.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:06.818+0000 7fe4eaffd700 1 -- 172.21.15.72:0/785191397 >> v1:172.21.15.72:6789/0 conn(0x7fe4ec06f280 legacy=0x7fe4ec0a8170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:06.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:06.818+0000 7fe4eaffd700 1 -- 172.21.15.72:0/785191397 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4ec154900 con 0x7fe4ec14e6f0 2023-07-25T14:37:06.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:06.818+0000 7fe4eaffd700 1 --2- 172.21.15.72:0/785191397 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe4ec14e6f0 0x7fe4ec0c67d0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fe4ec0c7880 tx=0x7fe4e000bdc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=735a875aab702e3a server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:06.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:06.818+0000 7fe4e9ffb700 1 -- 172.21.15.72:0/785191397 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4e000dc70 con 0x7fe4ec14e6f0 2023-07-25T14:37:06.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:06.818+0000 7fe4e9ffb700 1 -- 172.21.15.72:0/785191397 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4e000ddd0 con 0x7fe4ec14e6f0 2023-07-25T14:37:06.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:06.818+0000 7fe4e9ffb700 1 -- 172.21.15.72:0/785191397 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4e0010690 con 0x7fe4ec14e6f0 2023-07-25T14:37:06.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:06.818+0000 7fe4f1a46700 1 -- 172.21.15.72:0/785191397 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe4ec14e6f0 msgr2=0x7fe4ec0c67d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:06.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:06.818+0000 7fe4f1a46700 1 --2- 172.21.15.72:0/785191397 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe4ec14e6f0 0x7fe4ec0c67d0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fe4ec0c7880 tx=0x7fe4e000bdc0 comp rx=0 tx=0).stop 2023-07-25T14:37:06.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:06.818+0000 7fe4f1a46700 1 -- 172.21.15.72:0/785191397 shutdown_connections 2023-07-25T14:37:06.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:06.818+0000 7fe4f1a46700 1 --2- 172.21.15.72:0/785191397 >> v2:172.21.15.92:3300/0 conn(0x7fe4ec0c11f0 0x7fe4ec0a8880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:06.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:06.818+0000 7fe4f1a46700 1 --2- 172.21.15.72:0/785191397 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe4ec14e6f0 0x7fe4ec0c67d0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:06.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:06.818+0000 7fe4f1a46700 1 -- 172.21.15.72:0/785191397 >> 172.21.15.72:0/785191397 conn(0x7fe4ec0714f0 msgr2=0x7fe4ec071900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:06.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:06.818+0000 7fe4f1a46700 1 -- 172.21.15.72:0/785191397 shutdown_connections 2023-07-25T14:37:06.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:06.818+0000 7fe4f1a46700 1 -- 172.21.15.72:0/785191397 wait complete. 2023-07-25T14:37:06.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:06.820+0000 7fe4f1a46700 1 Processor -- start 2023-07-25T14:37:06.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:06.820+0000 7fe4f1a46700 1 -- start start 2023-07-25T14:37:06.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:06.820+0000 7fe4f1a46700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe4ec06f280 0x7fe4ec1e9640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:06.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:06.820+0000 7fe4f1a46700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe4ec0c11f0 0x7fe4ec14bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:06.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:06.820+0000 7fe4f1a46700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe4ec14e6f0 0x7fe4ec0b8970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:06.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:06.820+0000 7fe4f1a46700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4ec1e9b80 con 0x7fe4ec06f280 2023-07-25T14:37:06.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:06.820+0000 7fe4f1a46700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4ec153c90 con 0x7fe4ec0c11f0 2023-07-25T14:37:06.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:06.820+0000 7fe4f1a46700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4ec1e6b30 con 0x7fe4ec14e6f0 2023-07-25T14:37:06.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:06.821+0000 7fe4eaffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe4ec06f280 0x7fe4ec1e9640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:06.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:06.821+0000 7fe4eaffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe4ec06f280 0x7fe4ec1e9640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42434/0 (socket says 172.21.15.72:42434) 2023-07-25T14:37:06.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:06.821+0000 7fe4eaffd700 1 -- 172.21.15.72:0/2107371475 learned_addr learned my addr 172.21.15.72:0/2107371475 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:37:06.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:06.821+0000 7fe4eb7fe700 1 --2- 172.21.15.72:0/2107371475 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe4ec14e6f0 0x7fe4ec0b8970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:06.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:06.821+0000 7fe4ea7fc700 1 --2- 172.21.15.72:0/2107371475 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe4ec0c11f0 0x7fe4ec14bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:06.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:06.821+0000 7fe4eaffd700 1 -- 172.21.15.72:0/2107371475 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe4ec14e6f0 msgr2=0x7fe4ec0b8970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:06.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:06.821+0000 7fe4eaffd700 1 --2- 172.21.15.72:0/2107371475 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe4ec14e6f0 0x7fe4ec0b8970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:06.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:06.821+0000 7fe4eaffd700 1 -- 172.21.15.72:0/2107371475 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe4ec0c11f0 msgr2=0x7fe4ec14bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:06.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:06.821+0000 7fe4eaffd700 1 --2- 172.21.15.72:0/2107371475 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe4ec0c11f0 0x7fe4ec14bac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:06.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:06.821+0000 7fe4eaffd700 1 -- 172.21.15.72:0/2107371475 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4e000b740 con 0x7fe4ec06f280 2023-07-25T14:37:06.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:06.821+0000 7fe4ea7fc700 1 --2- 172.21.15.72:0/2107371475 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe4ec0c11f0 0x7fe4ec14bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-25T14:37:06.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:06.821+0000 7fe4eaffd700 1 --2- 172.21.15.72:0/2107371475 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe4ec06f280 0x7fe4ec1e9640 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fe4e0000c00 tx=0x7fe4e0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:06.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:06.821+0000 7fe4d3fff700 1 -- 172.21.15.72:0/2107371475 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4e001f070 con 0x7fe4ec06f280 2023-07-25T14:37:06.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:06.821+0000 7fe4d3fff700 1 -- 172.21.15.72:0/2107371475 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4e0003b20 con 0x7fe4ec06f280 2023-07-25T14:37:06.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:06.821+0000 7fe4f1a46700 1 -- 172.21.15.72:0/2107371475 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4ec154040 con 0x7fe4ec06f280 2023-07-25T14:37:06.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:06.821+0000 7fe4d3fff700 1 -- 172.21.15.72:0/2107371475 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4e0024470 con 0x7fe4ec06f280 2023-07-25T14:37:06.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:06.821+0000 7fe4f1a46700 1 -- 172.21.15.72:0/2107371475 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4ec1e6dd0 con 0x7fe4ec06f280 2023-07-25T14:37:06.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:06.822+0000 7fe4f1a46700 1 -- 172.21.15.72:0/2107371475 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4ec04e470 con 0x7fe4ec06f280 2023-07-25T14:37:06.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:06.823+0000 7fe4d3fff700 1 -- 172.21.15.72:0/2107371475 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe4e0019400 con 0x7fe4ec06f280 2023-07-25T14:37:06.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:06.823+0000 7fe4d3fff700 1 --2- 172.21.15.72:0/2107371475 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fe4d806ace0 0x7fe4d806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:06.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:06.823+0000 7fe4d3fff700 1 -- 172.21.15.72:0/2107371475 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 7238+0+0 (secure 0 0 0) 0x7fe4e008ce80 con 0x7fe4ec06f280 2023-07-25T14:37:06.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:06.823+0000 7fe4ea7fc700 1 --2- 172.21.15.72:0/2107371475 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fe4d806ace0 0x7fe4d806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:06.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:06.823+0000 7fe4ea7fc700 1 --2- 172.21.15.72:0/2107371475 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fe4d806ace0 0x7fe4d806d1a0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fe4dc005910 tx=0x7fe4dc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:06.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:06.827+0000 7fe4d3fff700 1 -- 172.21.15.72:0/2107371475 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fe4e0057b20 con 0x7fe4ec06f280 2023-07-25T14:37:07.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.015+0000 7fe4f1a46700 1 -- 172.21.15.72:0/2107371475 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe4ec1511b0 con 0x7fe4ec06f280 2023-07-25T14:37:07.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.016+0000 7fe4d3fff700 1 -- 172.21.15.72:0/2107371475 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) v1 ==== 74+0+22106 (secure 0 0 0) 0x7fe4e005b140 con 0x7fe4ec06f280 2023-07-25T14:37:07.028 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-25T14:37:07.028 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":43,"fsid":"9170db48-9170-43e8-8ccb-9813e6240906","created":"2023-07-25T14:35:21.733262+0000","modified":"2023-07-25T14:37:04.264643+0000","last_up_change":"2023-07-25T14:35:31.355010+0000","last_in_change":"2023-07-25T14:35:24.195785+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-25T14:35:32.983457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-25T14:35:33.326342+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-07-25T14:36:47.694223+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-07-25T14:36:48.536715+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs2_metadata","create_time":"2023-07-25T14:37:01.238292+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs2_data","create_time":"2023-07-25T14:37:01.609127+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d517fdad-0bfe-49f0-89f2-9421c3761839","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6801","nonce":2475407414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6803","nonce":2475407414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6807","nonce":2475407414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6805","nonce":2475407414}]},"public_addr":"172.21.15.72:6801/2475407414","cluster_addr":"172.21.15.72:6803/2475407414","heartbeat_back_addr":"172.21.15.72:6807/2475407414","heartbeat_front_addr":"172.21.15.72:6805/2475407414","state":["exists","up"]},{"osd":1,"uuid":"e1564be3-f209-47e5-a8d0-32fc618a474f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6822","nonce":870954016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6825","nonce":870954016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6831","nonce":870954016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6827","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6829","nonce":870954016}]},"public_addr":"172.21.15.72:6822/870954016","cluster_addr":"172.21.15.72:6825/870954016","heartbeat_back_addr":"172.21.15.72:6831/870954016","heartbeat_front_addr":"172.21.15.72:6829/870954016","state":["exists","up"]},{"osd":2,"uuid":"c4647d30-ffa6-417a-9026-ef530c75910e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6809","nonce":2143129442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6811","nonce":2143129442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6815","nonce":2143129442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6813","nonce":2143129442}]},"public_addr":"172.21.15.72:6809/2143129442","cluster_addr":"172.21.15.72:6811/2143129442","heartbeat_back_addr":"172.21.15.72:6815/2143129442","heartbeat_front_addr":"172.21.15.72:6813/2143129442","state":["exists","up"]},{"osd":3,"uuid":"76c9d9a7-c2e2-4612-a58b-d6882dd76b58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6817","nonce":3404066311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6819","nonce":3404066311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6828","nonce":3404066311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6821","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6823","nonce":3404066311}]},"public_addr":"172.21.15.72:6817/3404066311","cluster_addr":"172.21.15.72:6819/3404066311","heartbeat_back_addr":"172.21.15.72:6828/3404066311","heartbeat_front_addr":"172.21.15.72:6823/3404066311","state":["exists","up"]},{"osd":4,"uuid":"7f8920dc-0ad4-4a73-ab40-65408f83eadd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6817","nonce":2381008739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6819","nonce":2381008739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6825","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6827","nonce":2381008739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6822","nonce":2381008739}]},"public_addr":"172.21.15.92:6817/2381008739","cluster_addr":"172.21.15.92:6819/2381008739","heartbeat_back_addr":"172.21.15.92:6827/2381008739","heartbeat_front_addr":"172.21.15.92:6822/2381008739","state":["exists","up"]},{"osd":5,"uuid":"56257e7c-31eb-44c5-9ec7-1318a4e0bb35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6801","nonce":2161935604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6803","nonce":2161935604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6807","nonce":2161935604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6805","nonce":2161935604}]},"public_addr":"172.21.15.92:6801/2161935604","cluster_addr":"172.21.15.92:6803/2161935604","heartbeat_back_addr":"172.21.15.92:6807/2161935604","heartbeat_front_addr":"172.21.15.92:6805/2161935604","state":["exists","up"]},{"osd":6,"uuid":"a150d3d8-a0c9-4955-968a-8d98eff4ffb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6809","nonce":3770163493}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6811","nonce":3770163493}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6815","nonce":3770163493}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6813","nonce":3770163493}]},"public_addr":"172.21.15.92:6809/3770163493","cluster_addr":"172.21.15.92:6811/3770163493","heartbeat_back_addr":"172.21.15.92:6815/3770163493","heartbeat_front_addr":"172.21.15.92:6813/3770163493","state":["exists","up"]},{"osd":7,"uuid":"07799c27-54ee-4591-a42d-a978d6b32065","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6821","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6823","nonce":2135777609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6826","nonce":2135777609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6831","nonce":2135777609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6829","nonce":2135777609}]},"public_addr":"172.21.15.92:6823/2135777609","cluster_addr":"172.21.15.92:6826/2135777609","heartbeat_back_addr":"172.21.15.92:6831/2135777609","heartbeat_front_addr":"172.21.15.92:6829/2135777609","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.345365+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.378150+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.146566+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.372172+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:30.398421+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.385632+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.465611+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.443583+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-25T14:37:07.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.018+0000 7fe4f1a46700 1 -- 172.21.15.72:0/2107371475 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fe4d806ace0 msgr2=0x7fe4d806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:07.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.018+0000 7fe4f1a46700 1 --2- 172.21.15.72:0/2107371475 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fe4d806ace0 0x7fe4d806d1a0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fe4dc005910 tx=0x7fe4dc009040 comp rx=0 tx=0).stop 2023-07-25T14:37:07.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.018+0000 7fe4f1a46700 1 -- 172.21.15.72:0/2107371475 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe4ec06f280 msgr2=0x7fe4ec1e9640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:07.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.018+0000 7fe4f1a46700 1 --2- 172.21.15.72:0/2107371475 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe4ec06f280 0x7fe4ec1e9640 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fe4e0000c00 tx=0x7fe4e0004750 comp rx=0 tx=0).stop 2023-07-25T14:37:07.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.018+0000 7fe4f1a46700 1 -- 172.21.15.72:0/2107371475 shutdown_connections 2023-07-25T14:37:07.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.018+0000 7fe4f1a46700 1 --2- 172.21.15.72:0/2107371475 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fe4d806ace0 0x7fe4d806d1a0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:07.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.018+0000 7fe4f1a46700 1 --2- 172.21.15.72:0/2107371475 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe4ec14e6f0 0x7fe4ec0b8970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:07.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.018+0000 7fe4f1a46700 1 --2- 172.21.15.72:0/2107371475 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe4ec06f280 0x7fe4ec1e9640 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:07.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.018+0000 7fe4f1a46700 1 --2- 172.21.15.72:0/2107371475 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe4ec0c11f0 0x7fe4ec14bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:07.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.018+0000 7fe4f1a46700 1 -- 172.21.15.72:0/2107371475 >> 172.21.15.72:0/2107371475 conn(0x7fe4ec0714f0 msgr2=0x7fe4ec1500e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:07.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.018+0000 7fe4f1a46700 1 -- 172.21.15.72:0/2107371475 shutdown_connections 2023-07-25T14:37:07.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.018+0000 7fe4f1a46700 1 -- 172.21.15.72:0/2107371475 wait complete. 2023-07-25T14:37:07.042 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-07-25T14:37:07.042 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-25T14:37:07.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.150+0000 7f1c90ede700 1 Processor -- start 2023-07-25T14:37:07.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.151+0000 7f1c90ede700 1 -- start start 2023-07-25T14:37:07.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.151+0000 7f1c90ede700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1c8c151950 0x7f1c8c06a190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:07.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.151+0000 7f1c90ede700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c8c0c2fe0 con 0x7f1c8c06a6d0 2023-07-25T14:37:07.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.151+0000 7f1c90ede700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c8c155070 con 0x7f1c8c0724c0 2023-07-25T14:37:07.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.151+0000 7f1c90ede700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c8c071a60 con 0x7f1c8c151950 2023-07-25T14:37:07.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.152+0000 7f1c8a59c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1c8c151950 0x7f1c8c06a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:07.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.152+0000 7f1c8ad9d700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f1c8c06a6d0 0x7f1c8c0c3bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:33182/0 (socket says 172.21.15.72:33182) 2023-07-25T14:37:07.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.152+0000 7f1c8ad9d700 1 -- 172.21.15.72:0/3360237886 learned_addr learned my addr 172.21.15.72:0/3360237886 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:37:07.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.152+0000 7f1c8a59c700 1 -- 172.21.15.72:0/3360237886 >> v1:172.21.15.92:6789/0 conn(0x7f1c8c0724c0 legacy=0x7f1c8c0c34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:07.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.152+0000 7f1c8a59c700 1 -- 172.21.15.72:0/3360237886 >> v1:172.21.15.72:6789/0 conn(0x7f1c8c06a6d0 legacy=0x7f1c8c0c3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:07.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.152+0000 7f1c8a59c700 1 -- 172.21.15.72:0/3360237886 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c8c0c15c0 con 0x7f1c8c151950 2023-07-25T14:37:07.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.152+0000 7f1c8a59c700 1 --2- 172.21.15.72:0/3360237886 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1c8c151950 0x7f1c8c06a190 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f1c80009840 tx=0x7f1c80009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67aecd26eb83f4df server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:07.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.152+0000 7f1c8959a700 1 -- 172.21.15.72:0/3360237886 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c80011830 con 0x7f1c8c151950 2023-07-25T14:37:07.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.152+0000 7f1c8959a700 1 -- 172.21.15.72:0/3360237886 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c80011990 con 0x7f1c8c151950 2023-07-25T14:37:07.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.152+0000 7f1c8959a700 1 -- 172.21.15.72:0/3360237886 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c80011d20 con 0x7f1c8c151950 2023-07-25T14:37:07.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.153+0000 7f1c90ede700 1 -- 172.21.15.72:0/3360237886 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1c8c151950 msgr2=0x7f1c8c06a190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:07.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.153+0000 7f1c90ede700 1 --2- 172.21.15.72:0/3360237886 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1c8c151950 0x7f1c8c06a190 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f1c80009840 tx=0x7f1c80009b50 comp rx=0 tx=0).stop 2023-07-25T14:37:07.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.153+0000 7f1c90ede700 1 -- 172.21.15.72:0/3360237886 shutdown_connections 2023-07-25T14:37:07.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.153+0000 7f1c90ede700 1 --2- 172.21.15.72:0/3360237886 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1c8c151950 0x7f1c8c06a190 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:07.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.153+0000 7f1c90ede700 1 -- 172.21.15.72:0/3360237886 >> 172.21.15.72:0/3360237886 conn(0x7f1c8c0a87e0 msgr2=0x7f1c8c0a8bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:07.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.153+0000 7f1c90ede700 1 -- 172.21.15.72:0/3360237886 shutdown_connections 2023-07-25T14:37:07.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.153+0000 7f1c90ede700 1 -- 172.21.15.72:0/3360237886 wait complete. 2023-07-25T14:37:07.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.154+0000 7f1c90ede700 1 Processor -- start 2023-07-25T14:37:07.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.154+0000 7f1c90ede700 1 -- start start 2023-07-25T14:37:07.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.155+0000 7f1c90ede700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1c8c06a6d0 0x7f1c8c156920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:07.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.155+0000 7f1c90ede700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1c8c0724c0 0x7f1c8c157150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:07.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.155+0000 7f1c90ede700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1c8c151950 0x7f1c8c1dd8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:07.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.155+0000 7f1c90ede700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c8c14e590 con 0x7f1c8c0724c0 2023-07-25T14:37:07.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.155+0000 7f1c90ede700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c8c14eac0 con 0x7f1c8c151950 2023-07-25T14:37:07.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.155+0000 7f1c90ede700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c8c14e7e0 con 0x7f1c8c06a6d0 2023-07-25T14:37:07.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.155+0000 7f1c89d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1c8c0724c0 0x7f1c8c157150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:07.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.155+0000 7f1c89d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1c8c0724c0 0x7f1c8c157150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42450/0 (socket says 172.21.15.72:42450) 2023-07-25T14:37:07.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.155+0000 7f1c89d9b700 1 -- 172.21.15.72:0/2081674867 learned_addr learned my addr 172.21.15.72:0/2081674867 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:37:07.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.155+0000 7f1c8a59c700 1 --2- 172.21.15.72:0/2081674867 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1c8c06a6d0 0x7f1c8c156920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:07.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.155+0000 7f1c8ad9d700 1 --2- 172.21.15.72:0/2081674867 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1c8c151950 0x7f1c8c1dd8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:07.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.155+0000 7f1c89d9b700 1 -- 172.21.15.72:0/2081674867 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1c8c06a6d0 msgr2=0x7f1c8c156920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:07.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.155+0000 7f1c89d9b700 1 --2- 172.21.15.72:0/2081674867 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1c8c06a6d0 0x7f1c8c156920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:07.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.155+0000 7f1c89d9b700 1 -- 172.21.15.72:0/2081674867 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1c8c151950 msgr2=0x7f1c8c1dd8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:07.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.155+0000 7f1c89d9b700 1 --2- 172.21.15.72:0/2081674867 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1c8c151950 0x7f1c8c1dd8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:07.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.155+0000 7f1c89d9b700 1 -- 172.21.15.72:0/2081674867 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c800094a0 con 0x7f1c8c0724c0 2023-07-25T14:37:07.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.155+0000 7f1c89d9b700 1 --2- 172.21.15.72:0/2081674867 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1c8c0724c0 0x7f1c8c157150 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f1c7c00c4e0 tx=0x7f1c7c00c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:07.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.155+0000 7f1c7affd700 1 -- 172.21.15.72:0/2081674867 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c7c0052d0 con 0x7f1c8c0724c0 2023-07-25T14:37:07.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.155+0000 7f1c7affd700 1 -- 172.21.15.72:0/2081674867 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c7c005430 con 0x7f1c8c0724c0 2023-07-25T14:37:07.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.155+0000 7f1c90ede700 1 -- 172.21.15.72:0/2081674867 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c8c156120 con 0x7f1c8c0724c0 2023-07-25T14:37:07.175 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.155+0000 7f1c7affd700 1 -- 172.21.15.72:0/2081674867 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c7c0038c0 con 0x7f1c8c0724c0 2023-07-25T14:37:07.176 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.156+0000 7f1c90ede700 1 -- 172.21.15.72:0/2081674867 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c8c0a7960 con 0x7f1c8c0724c0 2023-07-25T14:37:07.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.156+0000 7f1c90ede700 1 -- 172.21.15.72:0/2081674867 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c8c156640 con 0x7f1c8c0724c0 2023-07-25T14:37:07.177 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.157+0000 7f1c7affd700 1 -- 172.21.15.72:0/2081674867 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1c7c003a20 con 0x7f1c8c0724c0 2023-07-25T14:37:07.178 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.157+0000 7f1c7affd700 1 --2- 172.21.15.72:0/2081674867 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f1c6c06ace0 0x7f1c6c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:07.178 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.157+0000 7f1c7affd700 1 -- 172.21.15.72:0/2081674867 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 7238+0+0 (secure 0 0 0) 0x7f1c7c088d70 con 0x7f1c8c0724c0 2023-07-25T14:37:07.178 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.157+0000 7f1c8a59c700 1 --2- 172.21.15.72:0/2081674867 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f1c6c06ace0 0x7f1c6c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:07.178 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.158+0000 7f1c8a59c700 1 --2- 172.21.15.72:0/2081674867 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f1c6c06ace0 0x7f1c6c06d1a0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f1c800090b0 tx=0x7f1c8001c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:07.179 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.162+0000 7f1c7affd700 1 -- 172.21.15.72:0/2081674867 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f1c8c156640 con 0x7f1c8c0724c0 2023-07-25T14:37:07.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.350+0000 7f1c90ede700 1 -- 172.21.15.72:0/2081674867 --> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1c8c154d00 con 0x7f1c6c06ace0 2023-07-25T14:37:07.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.364+0000 7f1c7affd700 1 -- 172.21.15.72:0/2081674867 <== mgr.4104 v2:172.21.15.72:6832/1171220306 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+549698 (secure 0 0 0) 0x7f1c80011c80 con 0x7f1c6c06ace0 2023-07-25T14:37:07.380 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-25T14:37:07.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.368+0000 7f1c90ede700 1 -- 172.21.15.72:0/2081674867 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f1c6c06ace0 msgr2=0x7f1c6c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:07.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.368+0000 7f1c90ede700 1 --2- 172.21.15.72:0/2081674867 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f1c6c06ace0 0x7f1c6c06d1a0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f1c800090b0 tx=0x7f1c8001c040 comp rx=0 tx=0).stop 2023-07-25T14:37:07.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.368+0000 7f1c90ede700 1 -- 172.21.15.72:0/2081674867 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1c8c0724c0 msgr2=0x7f1c8c157150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:07.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.368+0000 7f1c90ede700 1 --2- 172.21.15.72:0/2081674867 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1c8c0724c0 0x7f1c8c157150 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f1c7c00c4e0 tx=0x7f1c7c00c8a0 comp rx=0 tx=0).stop 2023-07-25T14:37:07.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.368+0000 7f1c90ede700 1 -- 172.21.15.72:0/2081674867 shutdown_connections 2023-07-25T14:37:07.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.368+0000 7f1c90ede700 1 --2- 172.21.15.72:0/2081674867 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f1c6c06ace0 0x7f1c6c06d1a0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:07.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.368+0000 7f1c90ede700 1 --2- 172.21.15.72:0/2081674867 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1c8c06a6d0 0x7f1c8c156920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:07.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.368+0000 7f1c90ede700 1 --2- 172.21.15.72:0/2081674867 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1c8c151950 0x7f1c8c1dd8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:07.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.368+0000 7f1c90ede700 1 --2- 172.21.15.72:0/2081674867 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1c8c0724c0 0x7f1c8c157150 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:07.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.368+0000 7f1c90ede700 1 -- 172.21.15.72:0/2081674867 >> 172.21.15.72:0/2081674867 conn(0x7f1c8c0a87e0 msgr2=0x7f1c8c06ece0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:07.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.368+0000 7f1c90ede700 1 -- 172.21.15.72:0/2081674867 shutdown_connections 2023-07-25T14:37:07.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.368+0000 7f1c90ede700 1 -- 172.21.15.72:0/2081674867 wait complete. 2023-07-25T14:37:07.386 INFO:teuthology.orchestra.run.smithi072.stderr:dumped all 2023-07-25T14:37:07.391 INFO:teuthology.orchestra.run.smithi072.stdout:{"pg_ready":true,"pg_map":{"version":84,"stamp":"2023-07-25T14:37:07.303245+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596599,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":251,"num_write_kb":2447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":197,"ondisk_log_size":197,"up":402,"acting":402,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":381,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220316,"kb_used_data":4148,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754754404,"statfs":{"total":773094113280,"available":772868509696,"internally_reserved":0,"allocated":4247552,"data_stored":3058519,"data_compressed":64510,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":38,"apply_latency_ms":38,"commit_latency_ns":38000000,"apply_latency_ns":38000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":3869,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001101"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":59,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.361892+0000","last_change":"2023-07-25T14:35:34.370772+0000","last_active":"2023-07-25T14:37:05.361892+0000","last_peered":"2023-07-25T14:37:05.361892+0000","last_clean":"2023-07-25T14:37:05.361892+0000","last_became_active":"2023-07-25T14:35:34.370549+0000","last_became_peered":"2023-07-25T14:35:34.370549+0000","last_unstale":"2023-07-25T14:37:05.361892+0000","last_undegraded":"2023-07-25T14:37:05.361892+0000","last_fullsized":"2023-07-25T14:37:05.361892+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_clean_scrub_stamp":"2023-07-25T14:35:33.358525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T22:29:40.424880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":21,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:04.273915+0000","last_change":"2023-07-25T14:36:49.189178+0000","last_active":"2023-07-25T14:37:04.273915+0000","last_peered":"2023-07-25T14:37:04.273915+0000","last_clean":"2023-07-25T14:37:04.273915+0000","last_became_active":"2023-07-25T14:36:49.188876+0000","last_became_peered":"2023-07-25T14:36:49.188876+0000","last_unstale":"2023-07-25T14:37:04.273915+0000","last_undegraded":"2023-07-25T14:37:04.273915+0000","last_fullsized":"2023-07-25T14:37:04.273915+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_clean_scrub_stamp":"2023-07-25T14:36:48.163149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T16:46:14.058628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:04.279657+0000","last_change":"2023-07-25T14:36:50.213458+0000","last_active":"2023-07-25T14:37:04.279657+0000","last_peered":"2023-07-25T14:37:04.279657+0000","last_clean":"2023-07-25T14:37:04.279657+0000","last_became_active":"2023-07-25T14:36:50.213138+0000","last_became_peered":"2023-07-25T14:36:50.213138+0000","last_unstale":"2023-07-25T14:37:04.279657+0000","last_undegraded":"2023-07-25T14:37:04.279657+0000","last_fullsized":"2023-07-25T14:37:04.279657+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T15:48:18.672192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"42'2","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:04.274824+0000","last_change":"2023-07-25T14:37:02.264296+0000","last_active":"2023-07-25T14:37:04.274824+0000","last_peered":"2023-07-25T14:37:04.274824+0000","last_clean":"2023-07-25T14:37:04.274824+0000","last_became_active":"2023-07-25T14:37:02.264037+0000","last_became_peered":"2023-07-25T14:37:02.264037+0000","last_unstale":"2023-07-25T14:37:04.274824+0000","last_undegraded":"2023-07-25T14:37:04.274824+0000","last_fullsized":"2023-07-25T14:37:04.274824+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:01.239242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:01.239242+0000","last_clean_scrub_stamp":"2023-07-25T14:37:01.239242+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T14:50:53.231410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:04.280062+0000","last_change":"2023-07-25T14:37:03.270937+0000","last_active":"2023-07-25T14:37:04.280062+0000","last_peered":"2023-07-25T14:37:04.280062+0000","last_clean":"2023-07-25T14:37:04.280062+0000","last_became_active":"2023-07-25T14:37:03.270637+0000","last_became_peered":"2023-07-25T14:37:03.270637+0000","last_unstale":"2023-07-25T14:37:04.280062+0000","last_undegraded":"2023-07-25T14:37:04.280062+0000","last_fullsized":"2023-07-25T14:37:04.280062+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_clean_scrub_stamp":"2023-07-25T14:37:02.240886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T21:29:23.851980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":59,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.361606+0000","last_change":"2023-07-25T14:35:35.321055+0000","last_active":"2023-07-25T14:37:05.361606+0000","last_peered":"2023-07-25T14:37:05.361606+0000","last_clean":"2023-07-25T14:37:05.361606+0000","last_became_active":"2023-07-25T14:35:35.320739+0000","last_became_peered":"2023-07-25T14:35:35.320739+0000","last_unstale":"2023-07-25T14:37:05.361606+0000","last_undegraded":"2023-07-25T14:37:05.361606+0000","last_fullsized":"2023-07-25T14:37:05.361606+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_clean_scrub_stamp":"2023-07-25T14:35:33.358525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T20:36:33.589389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":21,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.360698+0000","last_change":"2023-07-25T14:36:49.188367+0000","last_active":"2023-07-25T14:37:05.360698+0000","last_peered":"2023-07-25T14:37:05.360698+0000","last_clean":"2023-07-25T14:37:05.360698+0000","last_became_active":"2023-07-25T14:36:49.188073+0000","last_became_peered":"2023-07-25T14:36:49.188073+0000","last_unstale":"2023-07-25T14:37:05.360698+0000","last_undegraded":"2023-07-25T14:37:05.360698+0000","last_fullsized":"2023-07-25T14:37:05.360698+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_clean_scrub_stamp":"2023-07-25T14:36:48.163149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T22:30:04.157240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:04.278811+0000","last_change":"2023-07-25T14:36:50.207719+0000","last_active":"2023-07-25T14:37:04.278811+0000","last_peered":"2023-07-25T14:37:04.278811+0000","last_clean":"2023-07-25T14:37:04.278811+0000","last_became_active":"2023-07-25T14:36:50.207251+0000","last_became_peered":"2023-07-25T14:36:50.207251+0000","last_unstale":"2023-07-25T14:37:04.278811+0000","last_undegraded":"2023-07-25T14:37:04.278811+0000","last_fullsized":"2023-07-25T14:37:04.278811+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T20:06:11.124144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"42'1","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.364430+0000","last_change":"2023-07-25T14:37:02.264296+0000","last_active":"2023-07-25T14:37:05.364430+0000","last_peered":"2023-07-25T14:37:05.364430+0000","last_clean":"2023-07-25T14:37:05.364430+0000","last_became_active":"2023-07-25T14:37:02.264037+0000","last_became_peered":"2023-07-25T14:37:02.264037+0000","last_unstale":"2023-07-25T14:37:05.364430+0000","last_undegraded":"2023-07-25T14:37:05.364430+0000","last_fullsized":"2023-07-25T14:37:05.364430+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:01.239242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:01.239242+0000","last_clean_scrub_stamp":"2023-07-25T14:37:01.239242+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T22:07:22.773074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.302824+0000","last_change":"2023-07-25T14:37:03.294626+0000","last_active":"2023-07-25T14:37:05.302824+0000","last_peered":"2023-07-25T14:37:05.302824+0000","last_clean":"2023-07-25T14:37:05.302824+0000","last_became_active":"2023-07-25T14:37:03.294122+0000","last_became_peered":"2023-07-25T14:37:03.294122+0000","last_unstale":"2023-07-25T14:37:05.302824+0000","last_undegraded":"2023-07-25T14:37:05.302824+0000","last_fullsized":"2023-07-25T14:37:05.302824+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_clean_scrub_stamp":"2023-07-25T14:37:02.240886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T21:26:59.702249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":63,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:04.279087+0000","last_change":"2023-07-25T14:35:35.321057+0000","last_active":"2023-07-25T14:37:04.279087+0000","last_peered":"2023-07-25T14:37:04.279087+0000","last_clean":"2023-07-25T14:37:04.279087+0000","last_became_active":"2023-07-25T14:35:35.320751+0000","last_became_peered":"2023-07-25T14:35:35.320751+0000","last_unstale":"2023-07-25T14:37:04.279087+0000","last_undegraded":"2023-07-25T14:37:04.279087+0000","last_fullsized":"2023-07-25T14:37:04.279087+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_clean_scrub_stamp":"2023-07-25T14:35:33.358525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T15:59:02.381912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.6","version":"39'1","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.362039+0000","last_change":"2023-07-25T14:36:49.189206+0000","last_active":"2023-07-25T14:37:05.362039+0000","last_peered":"2023-07-25T14:37:05.362039+0000","last_clean":"2023-07-25T14:37:05.362039+0000","last_became_active":"2023-07-25T14:36:49.188939+0000","last_became_peered":"2023-07-25T14:36:49.188939+0000","last_unstale":"2023-07-25T14:37:05.362039+0000","last_undegraded":"2023-07-25T14:37:05.362039+0000","last_fullsized":"2023-07-25T14:37:05.362039+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_clean_scrub_stamp":"2023-07-25T14:36:48.163149+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:18:52.217871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.361824+0000","last_change":"2023-07-25T14:36:50.211993+0000","last_active":"2023-07-25T14:37:05.361824+0000","last_peered":"2023-07-25T14:37:05.361824+0000","last_clean":"2023-07-25T14:37:05.361824+0000","last_became_active":"2023-07-25T14:36:50.211594+0000","last_became_peered":"2023-07-25T14:36:50.211594+0000","last_unstale":"2023-07-25T14:37:05.361824+0000","last_undegraded":"2023-07-25T14:37:05.361824+0000","last_fullsized":"2023-07-25T14:37:05.361824+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T21:59:41.233477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:04.278658+0000","last_change":"2023-07-25T14:37:02.263206+0000","last_active":"2023-07-25T14:37:04.278658+0000","last_peered":"2023-07-25T14:37:04.278658+0000","last_clean":"2023-07-25T14:37:04.278658+0000","last_became_active":"2023-07-25T14:37:02.262924+0000","last_became_peered":"2023-07-25T14:37:02.262924+0000","last_unstale":"2023-07-25T14:37:04.278658+0000","last_undegraded":"2023-07-25T14:37:04.278658+0000","last_fullsized":"2023-07-25T14:37:04.278658+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:01.239242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:01.239242+0000","last_clean_scrub_stamp":"2023-07-25T14:37:01.239242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T21:44:31.667717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:04.273973+0000","last_change":"2023-07-25T14:37:03.289910+0000","last_active":"2023-07-25T14:37:04.273973+0000","last_peered":"2023-07-25T14:37:04.273973+0000","last_clean":"2023-07-25T14:37:04.273973+0000","last_became_active":"2023-07-25T14:37:03.288508+0000","last_became_peered":"2023-07-25T14:37:03.288508+0000","last_unstale":"2023-07-25T14:37:04.273973+0000","last_undegraded":"2023-07-25T14:37:04.273973+0000","last_fullsized":"2023-07-25T14:37:04.273973+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_clean_scrub_stamp":"2023-07-25T14:37:02.240886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T18:17:33.408755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":59,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.301916+0000","last_change":"2023-07-25T14:35:35.321201+0000","last_active":"2023-07-25T14:37:05.301916+0000","last_peered":"2023-07-25T14:37:05.301916+0000","last_clean":"2023-07-25T14:37:05.301916+0000","last_became_active":"2023-07-25T14:35:35.320728+0000","last_became_peered":"2023-07-25T14:35:35.320728+0000","last_unstale":"2023-07-25T14:37:05.301916+0000","last_undegraded":"2023-07-25T14:37:05.301916+0000","last_fullsized":"2023-07-25T14:37:05.301916+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_clean_scrub_stamp":"2023-07-25T14:35:33.358525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:14:12.078574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"38'2","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:04.280242+0000","last_change":"2023-07-25T14:36:49.190402+0000","last_active":"2023-07-25T14:37:04.280242+0000","last_peered":"2023-07-25T14:37:04.280242+0000","last_clean":"2023-07-25T14:37:04.280242+0000","last_became_active":"2023-07-25T14:36:49.190103+0000","last_became_peered":"2023-07-25T14:36:49.190103+0000","last_unstale":"2023-07-25T14:37:04.280242+0000","last_undegraded":"2023-07-25T14:37:04.280242+0000","last_fullsized":"2023-07-25T14:37:04.280242+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_clean_scrub_stamp":"2023-07-25T14:36:48.163149+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T23:42:05.916601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:04.274936+0000","last_change":"2023-07-25T14:36:50.196768+0000","last_active":"2023-07-25T14:37:04.274936+0000","last_peered":"2023-07-25T14:37:04.274936+0000","last_clean":"2023-07-25T14:37:04.274936+0000","last_became_active":"2023-07-25T14:36:50.195596+0000","last_became_peered":"2023-07-25T14:36:50.195596+0000","last_unstale":"2023-07-25T14:37:04.274936+0000","last_undegraded":"2023-07-25T14:37:04.274936+0000","last_fullsized":"2023-07-25T14:37:04.274936+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T22:33:40.706684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.360955+0000","last_change":"2023-07-25T14:37:02.263927+0000","last_active":"2023-07-25T14:37:05.360955+0000","last_peered":"2023-07-25T14:37:05.360955+0000","last_clean":"2023-07-25T14:37:05.360955+0000","last_became_active":"2023-07-25T14:37:02.263649+0000","last_became_peered":"2023-07-25T14:37:02.263649+0000","last_unstale":"2023-07-25T14:37:05.360955+0000","last_undegraded":"2023-07-25T14:37:05.360955+0000","last_fullsized":"2023-07-25T14:37:05.360955+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:01.239242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:01.239242+0000","last_clean_scrub_stamp":"2023-07-25T14:37:01.239242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T01:44:05.128284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.362900+0000","last_change":"2023-07-25T14:37:03.300472+0000","last_active":"2023-07-25T14:37:05.362900+0000","last_peered":"2023-07-25T14:37:05.362900+0000","last_clean":"2023-07-25T14:37:05.362900+0000","last_became_active":"2023-07-25T14:37:03.300163+0000","last_became_peered":"2023-07-25T14:37:03.300163+0000","last_unstale":"2023-07-25T14:37:05.362900+0000","last_undegraded":"2023-07-25T14:37:05.362900+0000","last_fullsized":"2023-07-25T14:37:05.362900+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_clean_scrub_stamp":"2023-07-25T14:37:02.240886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T17:09:13.033871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":59,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.302362+0000","last_change":"2023-07-25T14:35:35.321448+0000","last_active":"2023-07-25T14:37:05.302362+0000","last_peered":"2023-07-25T14:37:05.302362+0000","last_clean":"2023-07-25T14:37:05.302362+0000","last_became_active":"2023-07-25T14:35:35.320830+0000","last_became_peered":"2023-07-25T14:35:35.320830+0000","last_unstale":"2023-07-25T14:37:05.302362+0000","last_undegraded":"2023-07-25T14:37:05.302362+0000","last_fullsized":"2023-07-25T14:37:05.302362+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_clean_scrub_stamp":"2023-07-25T14:35:33.358525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T16:40:24.596009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":21,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.302802+0000","last_change":"2023-07-25T14:36:49.189278+0000","last_active":"2023-07-25T14:37:05.302802+0000","last_peered":"2023-07-25T14:37:05.302802+0000","last_clean":"2023-07-25T14:37:05.302802+0000","last_became_active":"2023-07-25T14:36:49.189011+0000","last_became_peered":"2023-07-25T14:36:49.189011+0000","last_unstale":"2023-07-25T14:37:05.302802+0000","last_undegraded":"2023-07-25T14:37:05.302802+0000","last_fullsized":"2023-07-25T14:37:05.302802+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_clean_scrub_stamp":"2023-07-25T14:36:48.163149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T21:33:26.601537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:04.274321+0000","last_change":"2023-07-25T14:36:50.198441+0000","last_active":"2023-07-25T14:37:04.274321+0000","last_peered":"2023-07-25T14:37:04.274321+0000","last_clean":"2023-07-25T14:37:04.274321+0000","last_became_active":"2023-07-25T14:36:50.198177+0000","last_became_peered":"2023-07-25T14:36:50.198177+0000","last_unstale":"2023-07-25T14:37:04.274321+0000","last_undegraded":"2023-07-25T14:37:04.274321+0000","last_fullsized":"2023-07-25T14:37:04.274321+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T16:25:49.216554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"42'2","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.364082+0000","last_change":"2023-07-25T14:37:02.262457+0000","last_active":"2023-07-25T14:37:05.364082+0000","last_peered":"2023-07-25T14:37:05.364082+0000","last_clean":"2023-07-25T14:37:05.364082+0000","last_became_active":"2023-07-25T14:37:02.262178+0000","last_became_peered":"2023-07-25T14:37:02.262178+0000","last_unstale":"2023-07-25T14:37:05.364082+0000","last_undegraded":"2023-07-25T14:37:05.364082+0000","last_fullsized":"2023-07-25T14:37:05.364082+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:01.239242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:01.239242+0000","last_clean_scrub_stamp":"2023-07-25T14:37:01.239242+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T20:15:26.987028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:04.279453+0000","last_change":"2023-07-25T14:37:03.270853+0000","last_active":"2023-07-25T14:37:04.279453+0000","last_peered":"2023-07-25T14:37:04.279453+0000","last_clean":"2023-07-25T14:37:04.279453+0000","last_became_active":"2023-07-25T14:37:03.270563+0000","last_became_peered":"2023-07-25T14:37:03.270563+0000","last_unstale":"2023-07-25T14:37:04.279453+0000","last_undegraded":"2023-07-25T14:37:04.279453+0000","last_fullsized":"2023-07-25T14:37:04.279453+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_clean_scrub_stamp":"2023-07-25T14:37:02.240886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T01:01:22.310520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":209,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.301925+0000","last_change":"2023-07-25T14:35:34.372381+0000","last_active":"2023-07-25T14:37:05.301925+0000","last_peered":"2023-07-25T14:37:05.301925+0000","last_clean":"2023-07-25T14:37:05.301925+0000","last_became_active":"2023-07-25T14:35:34.371110+0000","last_became_peered":"2023-07-25T14:35:34.371110+0000","last_unstale":"2023-07-25T14:37:05.301925+0000","last_undegraded":"2023-07-25T14:37:05.301925+0000","last_fullsized":"2023-07-25T14:37:05.301925+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_clean_scrub_stamp":"2023-07-25T14:35:33.358525+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T15:57:06.749608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":57,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.360761+0000","last_change":"2023-07-25T14:35:34.370121+0000","last_active":"2023-07-25T14:37:05.360761+0000","last_peered":"2023-07-25T14:37:05.360761+0000","last_clean":"2023-07-25T14:37:05.360761+0000","last_became_active":"2023-07-25T14:35:34.369795+0000","last_became_peered":"2023-07-25T14:35:34.369795+0000","last_unstale":"2023-07-25T14:37:05.360761+0000","last_undegraded":"2023-07-25T14:37:05.360761+0000","last_fullsized":"2023-07-25T14:37:05.360761+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_clean_scrub_stamp":"2023-07-25T14:35:33.358525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T16:38:27.484494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":21,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.360360+0000","last_change":"2023-07-25T14:36:49.188513+0000","last_active":"2023-07-25T14:37:05.360360+0000","last_peered":"2023-07-25T14:37:05.360360+0000","last_clean":"2023-07-25T14:37:05.360360+0000","last_became_active":"2023-07-25T14:36:49.188212+0000","last_became_peered":"2023-07-25T14:36:49.188212+0000","last_unstale":"2023-07-25T14:37:05.360360+0000","last_undegraded":"2023-07-25T14:37:05.360360+0000","last_fullsized":"2023-07-25T14:37:05.360360+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_clean_scrub_stamp":"2023-07-25T14:36:48.163149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T16:29:47.163618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.302944+0000","last_change":"2023-07-25T14:36:50.207537+0000","last_active":"2023-07-25T14:37:05.302944+0000","last_peered":"2023-07-25T14:37:05.302944+0000","last_clean":"2023-07-25T14:37:05.302944+0000","last_became_active":"2023-07-25T14:36:50.207278+0000","last_became_peered":"2023-07-25T14:36:50.207278+0000","last_unstale":"2023-07-25T14:37:05.302944+0000","last_undegraded":"2023-07-25T14:37:05.302944+0000","last_fullsized":"2023-07-25T14:37:05.302944+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T16:25:49.216554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.360943+0000","last_change":"2023-07-25T14:37:02.266873+0000","last_active":"2023-07-25T14:37:05.360943+0000","last_peered":"2023-07-25T14:37:05.360943+0000","last_clean":"2023-07-25T14:37:05.360943+0000","last_became_active":"2023-07-25T14:37:02.266608+0000","last_became_peered":"2023-07-25T14:37:02.266608+0000","last_unstale":"2023-07-25T14:37:05.360943+0000","last_undegraded":"2023-07-25T14:37:05.360943+0000","last_fullsized":"2023-07-25T14:37:05.360943+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:01.239242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:01.239242+0000","last_clean_scrub_stamp":"2023-07-25T14:37:01.239242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T01:48:49.638469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:04.274084+0000","last_change":"2023-07-25T14:37:03.291173+0000","last_active":"2023-07-25T14:37:04.274084+0000","last_peered":"2023-07-25T14:37:04.274084+0000","last_clean":"2023-07-25T14:37:04.274084+0000","last_became_active":"2023-07-25T14:37:03.290898+0000","last_became_peered":"2023-07-25T14:37:03.290898+0000","last_unstale":"2023-07-25T14:37:04.274084+0000","last_undegraded":"2023-07-25T14:37:04.274084+0000","last_fullsized":"2023-07-25T14:37:04.274084+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_clean_scrub_stamp":"2023-07-25T14:37:02.240886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T01:12:32.894290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":59,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.363928+0000","last_change":"2023-07-25T14:35:34.371737+0000","last_active":"2023-07-25T14:37:05.363928+0000","last_peered":"2023-07-25T14:37:05.363928+0000","last_clean":"2023-07-25T14:37:05.363928+0000","last_became_active":"2023-07-25T14:35:34.371411+0000","last_became_peered":"2023-07-25T14:35:34.371411+0000","last_unstale":"2023-07-25T14:37:05.363928+0000","last_undegraded":"2023-07-25T14:37:05.363928+0000","last_fullsized":"2023-07-25T14:37:05.363928+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_clean_scrub_stamp":"2023-07-25T14:35:33.358525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T21:06:22.547601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":21,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.302158+0000","last_change":"2023-07-25T14:36:49.190255+0000","last_active":"2023-07-25T14:37:05.302158+0000","last_peered":"2023-07-25T14:37:05.302158+0000","last_clean":"2023-07-25T14:37:05.302158+0000","last_became_active":"2023-07-25T14:36:49.189883+0000","last_became_peered":"2023-07-25T14:36:49.189883+0000","last_unstale":"2023-07-25T14:37:05.302158+0000","last_undegraded":"2023-07-25T14:37:05.302158+0000","last_fullsized":"2023-07-25T14:37:05.302158+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_clean_scrub_stamp":"2023-07-25T14:36:48.163149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T19:08:17.863636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.363732+0000","last_change":"2023-07-25T14:36:50.212966+0000","last_active":"2023-07-25T14:37:05.363732+0000","last_peered":"2023-07-25T14:37:05.363732+0000","last_clean":"2023-07-25T14:37:05.363732+0000","last_became_active":"2023-07-25T14:36:50.212728+0000","last_became_peered":"2023-07-25T14:36:50.212728+0000","last_unstale":"2023-07-25T14:37:05.363732+0000","last_undegraded":"2023-07-25T14:37:05.363732+0000","last_fullsized":"2023-07-25T14:37:05.363732+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T19:31:57.062482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"42'1","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:04.279226+0000","last_change":"2023-07-25T14:37:02.264758+0000","last_active":"2023-07-25T14:37:04.279226+0000","last_peered":"2023-07-25T14:37:04.279226+0000","last_clean":"2023-07-25T14:37:04.279226+0000","last_became_active":"2023-07-25T14:37:02.264376+0000","last_became_peered":"2023-07-25T14:37:02.264376+0000","last_unstale":"2023-07-25T14:37:04.279226+0000","last_undegraded":"2023-07-25T14:37:04.279226+0000","last_fullsized":"2023-07-25T14:37:04.279226+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:01.239242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:01.239242+0000","last_clean_scrub_stamp":"2023-07-25T14:37:01.239242+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T01:46:02.706625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.363863+0000","last_change":"2023-07-25T14:37:03.294988+0000","last_active":"2023-07-25T14:37:05.363863+0000","last_peered":"2023-07-25T14:37:05.363863+0000","last_clean":"2023-07-25T14:37:05.363863+0000","last_became_active":"2023-07-25T14:37:03.294679+0000","last_became_peered":"2023-07-25T14:37:03.294679+0000","last_unstale":"2023-07-25T14:37:05.363863+0000","last_undegraded":"2023-07-25T14:37:05.363863+0000","last_fullsized":"2023-07-25T14:37:05.363863+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_clean_scrub_stamp":"2023-07-25T14:37:02.240886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T18:09:05.593042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":61,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:04.280019+0000","last_change":"2023-07-25T14:35:34.371347+0000","last_active":"2023-07-25T14:37:04.280019+0000","last_peered":"2023-07-25T14:37:04.280019+0000","last_clean":"2023-07-25T14:37:04.280019+0000","last_became_active":"2023-07-25T14:35:34.371044+0000","last_became_peered":"2023-07-25T14:35:34.371044+0000","last_unstale":"2023-07-25T14:37:04.280019+0000","last_undegraded":"2023-07-25T14:37:04.280019+0000","last_fullsized":"2023-07-25T14:37:04.280019+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_clean_scrub_stamp":"2023-07-25T14:35:33.358525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T15:56:26.027680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":21,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:04.279970+0000","last_change":"2023-07-25T14:36:49.191235+0000","last_active":"2023-07-25T14:37:04.279970+0000","last_peered":"2023-07-25T14:37:04.279970+0000","last_clean":"2023-07-25T14:37:04.279970+0000","last_became_active":"2023-07-25T14:36:49.190894+0000","last_became_peered":"2023-07-25T14:36:49.190894+0000","last_unstale":"2023-07-25T14:37:04.279970+0000","last_undegraded":"2023-07-25T14:37:04.279970+0000","last_fullsized":"2023-07-25T14:37:04.279970+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_clean_scrub_stamp":"2023-07-25T14:36:48.163149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:10:17.458141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.364630+0000","last_change":"2023-07-25T14:36:50.194211+0000","last_active":"2023-07-25T14:37:05.364630+0000","last_peered":"2023-07-25T14:37:05.364630+0000","last_clean":"2023-07-25T14:37:05.364630+0000","last_became_active":"2023-07-25T14:36:50.193907+0000","last_became_peered":"2023-07-25T14:36:50.193907+0000","last_unstale":"2023-07-25T14:37:05.364630+0000","last_undegraded":"2023-07-25T14:37:05.364630+0000","last_fullsized":"2023-07-25T14:37:05.364630+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T18:30:23.936686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:04.274181+0000","last_change":"2023-07-25T14:37:02.263340+0000","last_active":"2023-07-25T14:37:04.274181+0000","last_peered":"2023-07-25T14:37:04.274181+0000","last_clean":"2023-07-25T14:37:04.274181+0000","last_became_active":"2023-07-25T14:37:02.263103+0000","last_became_peered":"2023-07-25T14:37:02.263103+0000","last_unstale":"2023-07-25T14:37:04.274181+0000","last_undegraded":"2023-07-25T14:37:04.274181+0000","last_fullsized":"2023-07-25T14:37:04.274181+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:01.239242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:01.239242+0000","last_clean_scrub_stamp":"2023-07-25T14:37:01.239242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T16:24:25.274560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.302803+0000","last_change":"2023-07-25T14:37:03.297190+0000","last_active":"2023-07-25T14:37:05.302803+0000","last_peered":"2023-07-25T14:37:05.302803+0000","last_clean":"2023-07-25T14:37:05.302803+0000","last_became_active":"2023-07-25T14:37:03.296923+0000","last_became_peered":"2023-07-25T14:37:03.296923+0000","last_unstale":"2023-07-25T14:37:05.302803+0000","last_undegraded":"2023-07-25T14:37:05.302803+0000","last_fullsized":"2023-07-25T14:37:05.302803+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_clean_scrub_stamp":"2023-07-25T14:37:02.240886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T15:08:57.831744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":21,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.302203+0000","last_change":"2023-07-25T14:36:49.189655+0000","last_active":"2023-07-25T14:37:05.302203+0000","last_peered":"2023-07-25T14:37:05.302203+0000","last_clean":"2023-07-25T14:37:05.302203+0000","last_became_active":"2023-07-25T14:36:49.189391+0000","last_became_peered":"2023-07-25T14:36:49.189391+0000","last_unstale":"2023-07-25T14:37:05.302203+0000","last_undegraded":"2023-07-25T14:37:05.302203+0000","last_fullsized":"2023-07-25T14:37:05.302203+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_clean_scrub_stamp":"2023-07-25T14:36:48.163149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T22:20:37.731525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:04.273835+0000","last_change":"2023-07-25T14:36:50.206937+0000","last_active":"2023-07-25T14:37:04.273835+0000","last_peered":"2023-07-25T14:37:04.273835+0000","last_clean":"2023-07-25T14:37:04.273835+0000","last_became_active":"2023-07-25T14:36:50.206661+0000","last_became_peered":"2023-07-25T14:36:50.206661+0000","last_unstale":"2023-07-25T14:37:04.273835+0000","last_undegraded":"2023-07-25T14:37:04.273835+0000","last_fullsized":"2023-07-25T14:37:04.273835+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T19:08:18.867578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:04.274533+0000","last_change":"2023-07-25T14:37:02.259224+0000","last_active":"2023-07-25T14:37:04.274533+0000","last_peered":"2023-07-25T14:37:04.274533+0000","last_clean":"2023-07-25T14:37:04.274533+0000","last_became_active":"2023-07-25T14:37:02.258954+0000","last_became_peered":"2023-07-25T14:37:02.258954+0000","last_unstale":"2023-07-25T14:37:04.274533+0000","last_undegraded":"2023-07-25T14:37:04.274533+0000","last_fullsized":"2023-07-25T14:37:04.274533+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:01.239242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:01.239242+0000","last_clean_scrub_stamp":"2023-07-25T14:37:01.239242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T01:31:19.042176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:04.279885+0000","last_change":"2023-07-25T14:37:03.288156+0000","last_active":"2023-07-25T14:37:04.279885+0000","last_peered":"2023-07-25T14:37:04.279885+0000","last_clean":"2023-07-25T14:37:04.279885+0000","last_became_active":"2023-07-25T14:37:03.287876+0000","last_became_peered":"2023-07-25T14:37:03.287876+0000","last_unstale":"2023-07-25T14:37:04.279885+0000","last_undegraded":"2023-07-25T14:37:04.279885+0000","last_fullsized":"2023-07-25T14:37:04.279885+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_clean_scrub_stamp":"2023-07-25T14:37:02.240886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T02:07:22.015256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":21,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:04.273703+0000","last_change":"2023-07-25T14:36:49.189641+0000","last_active":"2023-07-25T14:37:04.273703+0000","last_peered":"2023-07-25T14:37:04.273703+0000","last_clean":"2023-07-25T14:37:04.273703+0000","last_became_active":"2023-07-25T14:36:49.189365+0000","last_became_peered":"2023-07-25T14:36:49.189365+0000","last_unstale":"2023-07-25T14:37:04.273703+0000","last_undegraded":"2023-07-25T14:37:04.273703+0000","last_fullsized":"2023-07-25T14:37:04.273703+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_clean_scrub_stamp":"2023-07-25T14:36:48.163149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:05:42.947016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.360966+0000","last_change":"2023-07-25T14:36:50.198991+0000","last_active":"2023-07-25T14:37:05.360966+0000","last_peered":"2023-07-25T14:37:05.360966+0000","last_clean":"2023-07-25T14:37:05.360966+0000","last_became_active":"2023-07-25T14:36:50.198737+0000","last_became_peered":"2023-07-25T14:36:50.198737+0000","last_unstale":"2023-07-25T14:37:05.360966+0000","last_undegraded":"2023-07-25T14:37:05.360966+0000","last_fullsized":"2023-07-25T14:37:05.360966+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T20:34:40.704873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"42'2","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.363436+0000","last_change":"2023-07-25T14:37:02.269206+0000","last_active":"2023-07-25T14:37:05.363436+0000","last_peered":"2023-07-25T14:37:05.363436+0000","last_clean":"2023-07-25T14:37:05.363436+0000","last_became_active":"2023-07-25T14:37:02.269016+0000","last_became_peered":"2023-07-25T14:37:02.269016+0000","last_unstale":"2023-07-25T14:37:05.363436+0000","last_undegraded":"2023-07-25T14:37:05.363436+0000","last_fullsized":"2023-07-25T14:37:05.363436+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:01.239242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:01.239242+0000","last_clean_scrub_stamp":"2023-07-25T14:37:01.239242+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T01:44:05.128284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:04.279977+0000","last_change":"2023-07-25T14:37:03.284921+0000","last_active":"2023-07-25T14:37:04.279977+0000","last_peered":"2023-07-25T14:37:04.279977+0000","last_clean":"2023-07-25T14:37:04.279977+0000","last_became_active":"2023-07-25T14:37:03.284565+0000","last_became_peered":"2023-07-25T14:37:03.284565+0000","last_unstale":"2023-07-25T14:37:04.279977+0000","last_undegraded":"2023-07-25T14:37:04.279977+0000","last_fullsized":"2023-07-25T14:37:04.279977+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_clean_scrub_stamp":"2023-07-25T14:37:02.240886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:35:39.918684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":21,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:04.279618+0000","last_change":"2023-07-25T14:36:49.182153+0000","last_active":"2023-07-25T14:37:04.279618+0000","last_peered":"2023-07-25T14:37:04.279618+0000","last_clean":"2023-07-25T14:37:04.279618+0000","last_became_active":"2023-07-25T14:36:49.181886+0000","last_became_peered":"2023-07-25T14:36:49.181886+0000","last_unstale":"2023-07-25T14:37:04.279618+0000","last_undegraded":"2023-07-25T14:37:04.279618+0000","last_fullsized":"2023-07-25T14:37:04.279618+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_clean_scrub_stamp":"2023-07-25T14:36:48.163149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:25:47.581521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.360664+0000","last_change":"2023-07-25T14:36:50.203783+0000","last_active":"2023-07-25T14:37:05.360664+0000","last_peered":"2023-07-25T14:37:05.360664+0000","last_clean":"2023-07-25T14:37:05.360664+0000","last_became_active":"2023-07-25T14:36:50.203485+0000","last_became_peered":"2023-07-25T14:36:50.203485+0000","last_unstale":"2023-07-25T14:37:05.360664+0000","last_undegraded":"2023-07-25T14:37:05.360664+0000","last_fullsized":"2023-07-25T14:37:05.360664+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T01:49:00.736541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:04.279158+0000","last_change":"2023-07-25T14:37:02.263008+0000","last_active":"2023-07-25T14:37:04.279158+0000","last_peered":"2023-07-25T14:37:04.279158+0000","last_clean":"2023-07-25T14:37:04.279158+0000","last_became_active":"2023-07-25T14:37:02.262734+0000","last_became_peered":"2023-07-25T14:37:02.262734+0000","last_unstale":"2023-07-25T14:37:04.279158+0000","last_undegraded":"2023-07-25T14:37:04.279158+0000","last_fullsized":"2023-07-25T14:37:04.279158+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:01.239242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:01.239242+0000","last_clean_scrub_stamp":"2023-07-25T14:37:01.239242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T15:00:18.647656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:04.274214+0000","last_change":"2023-07-25T14:37:03.289930+0000","last_active":"2023-07-25T14:37:04.274214+0000","last_peered":"2023-07-25T14:37:04.274214+0000","last_clean":"2023-07-25T14:37:04.274214+0000","last_became_active":"2023-07-25T14:37:03.288162+0000","last_became_peered":"2023-07-25T14:37:03.288162+0000","last_unstale":"2023-07-25T14:37:04.274214+0000","last_undegraded":"2023-07-25T14:37:04.274214+0000","last_fullsized":"2023-07-25T14:37:04.274214+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_clean_scrub_stamp":"2023-07-25T14:37:02.240886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T19:04:38.768708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"38'2","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.364715+0000","last_change":"2023-07-25T14:36:49.192944+0000","last_active":"2023-07-25T14:37:05.364715+0000","last_peered":"2023-07-25T14:37:05.364715+0000","last_clean":"2023-07-25T14:37:05.364715+0000","last_became_active":"2023-07-25T14:36:49.191983+0000","last_became_peered":"2023-07-25T14:36:49.191983+0000","last_unstale":"2023-07-25T14:37:05.364715+0000","last_undegraded":"2023-07-25T14:37:05.364715+0000","last_fullsized":"2023-07-25T14:37:05.364715+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_clean_scrub_stamp":"2023-07-25T14:36:48.163149+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T19:42:35.645756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.364096+0000","last_change":"2023-07-25T14:36:50.199234+0000","last_active":"2023-07-25T14:37:05.364096+0000","last_peered":"2023-07-25T14:37:05.364096+0000","last_clean":"2023-07-25T14:37:05.364096+0000","last_became_active":"2023-07-25T14:36:50.198957+0000","last_became_peered":"2023-07-25T14:36:50.198957+0000","last_unstale":"2023-07-25T14:37:05.364096+0000","last_undegraded":"2023-07-25T14:37:05.364096+0000","last_fullsized":"2023-07-25T14:37:05.364096+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T19:35:01.012822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.361710+0000","last_change":"2023-07-25T14:37:02.258175+0000","last_active":"2023-07-25T14:37:05.361710+0000","last_peered":"2023-07-25T14:37:05.361710+0000","last_clean":"2023-07-25T14:37:05.361710+0000","last_became_active":"2023-07-25T14:37:02.257876+0000","last_became_peered":"2023-07-25T14:37:02.257876+0000","last_unstale":"2023-07-25T14:37:05.361710+0000","last_undegraded":"2023-07-25T14:37:05.361710+0000","last_fullsized":"2023-07-25T14:37:05.361710+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:01.239242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:01.239242+0000","last_clean_scrub_stamp":"2023-07-25T14:37:01.239242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T02:36:01.886737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.361092+0000","last_change":"2023-07-25T14:37:03.282790+0000","last_active":"2023-07-25T14:37:05.361092+0000","last_peered":"2023-07-25T14:37:05.361092+0000","last_clean":"2023-07-25T14:37:05.361092+0000","last_became_active":"2023-07-25T14:37:03.282098+0000","last_became_peered":"2023-07-25T14:37:03.282098+0000","last_unstale":"2023-07-25T14:37:05.361092+0000","last_undegraded":"2023-07-25T14:37:05.361092+0000","last_fullsized":"2023-07-25T14:37:05.361092+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_clean_scrub_stamp":"2023-07-25T14:37:02.240886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T02:13:05.864447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":21,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.363799+0000","last_change":"2023-07-25T14:36:49.189168+0000","last_active":"2023-07-25T14:37:05.363799+0000","last_peered":"2023-07-25T14:37:05.363799+0000","last_clean":"2023-07-25T14:37:05.363799+0000","last_became_active":"2023-07-25T14:36:49.188894+0000","last_became_peered":"2023-07-25T14:36:49.188894+0000","last_unstale":"2023-07-25T14:37:05.363799+0000","last_undegraded":"2023-07-25T14:37:05.363799+0000","last_fullsized":"2023-07-25T14:37:05.363799+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_clean_scrub_stamp":"2023-07-25T14:36:48.163149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T19:35:32.519083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.361359+0000","last_change":"2023-07-25T14:36:50.208734+0000","last_active":"2023-07-25T14:37:05.361359+0000","last_peered":"2023-07-25T14:37:05.361359+0000","last_clean":"2023-07-25T14:37:05.361359+0000","last_became_active":"2023-07-25T14:36:50.208472+0000","last_became_peered":"2023-07-25T14:36:50.208472+0000","last_unstale":"2023-07-25T14:37:05.361359+0000","last_undegraded":"2023-07-25T14:37:05.361359+0000","last_fullsized":"2023-07-25T14:37:05.361359+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T19:26:52.681755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:04.279443+0000","last_change":"2023-07-25T14:37:02.262204+0000","last_active":"2023-07-25T14:37:04.279443+0000","last_peered":"2023-07-25T14:37:04.279443+0000","last_clean":"2023-07-25T14:37:04.279443+0000","last_became_active":"2023-07-25T14:37:02.261930+0000","last_became_peered":"2023-07-25T14:37:02.261930+0000","last_unstale":"2023-07-25T14:37:04.279443+0000","last_undegraded":"2023-07-25T14:37:04.279443+0000","last_fullsized":"2023-07-25T14:37:04.279443+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:01.239242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:01.239242+0000","last_clean_scrub_stamp":"2023-07-25T14:37:01.239242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T23:18:02.200413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.302573+0000","last_change":"2023-07-25T14:37:03.301201+0000","last_active":"2023-07-25T14:37:05.302573+0000","last_peered":"2023-07-25T14:37:05.302573+0000","last_clean":"2023-07-25T14:37:05.302573+0000","last_became_active":"2023-07-25T14:37:03.300897+0000","last_became_peered":"2023-07-25T14:37:03.300897+0000","last_unstale":"2023-07-25T14:37:05.302573+0000","last_undegraded":"2023-07-25T14:37:05.302573+0000","last_fullsized":"2023-07-25T14:37:05.302573+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_clean_scrub_stamp":"2023-07-25T14:37:02.240886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T19:04:38.768708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.d","version":"38'1","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:04.280313+0000","last_change":"2023-07-25T14:36:49.188916+0000","last_active":"2023-07-25T14:37:04.280313+0000","last_peered":"2023-07-25T14:37:04.280313+0000","last_clean":"2023-07-25T14:37:04.280313+0000","last_became_active":"2023-07-25T14:36:49.188691+0000","last_became_peered":"2023-07-25T14:36:49.188691+0000","last_unstale":"2023-07-25T14:37:04.280313+0000","last_undegraded":"2023-07-25T14:37:04.280313+0000","last_fullsized":"2023-07-25T14:37:04.280313+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_clean_scrub_stamp":"2023-07-25T14:36:48.163149+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T23:32:05.986662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.361371+0000","last_change":"2023-07-25T14:36:50.212960+0000","last_active":"2023-07-25T14:37:05.361371+0000","last_peered":"2023-07-25T14:37:05.361371+0000","last_clean":"2023-07-25T14:37:05.361371+0000","last_became_active":"2023-07-25T14:36:50.212690+0000","last_became_peered":"2023-07-25T14:36:50.212690+0000","last_unstale":"2023-07-25T14:37:05.361371+0000","last_undegraded":"2023-07-25T14:37:05.361371+0000","last_fullsized":"2023-07-25T14:37:05.361371+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T22:28:25.884312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.360370+0000","last_change":"2023-07-25T14:37:02.268733+0000","last_active":"2023-07-25T14:37:05.360370+0000","last_peered":"2023-07-25T14:37:05.360370+0000","last_clean":"2023-07-25T14:37:05.360370+0000","last_became_active":"2023-07-25T14:37:02.268544+0000","last_became_peered":"2023-07-25T14:37:02.268544+0000","last_unstale":"2023-07-25T14:37:05.360370+0000","last_undegraded":"2023-07-25T14:37:05.360370+0000","last_fullsized":"2023-07-25T14:37:05.360370+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:01.239242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:01.239242+0000","last_clean_scrub_stamp":"2023-07-25T14:37:01.239242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T18:09:13.146391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.363642+0000","last_change":"2023-07-25T14:37:03.295153+0000","last_active":"2023-07-25T14:37:05.363642+0000","last_peered":"2023-07-25T14:37:05.363642+0000","last_clean":"2023-07-25T14:37:05.363642+0000","last_became_active":"2023-07-25T14:37:03.294913+0000","last_became_peered":"2023-07-25T14:37:03.294913+0000","last_unstale":"2023-07-25T14:37:05.363642+0000","last_undegraded":"2023-07-25T14:37:05.363642+0000","last_fullsized":"2023-07-25T14:37:05.363642+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_clean_scrub_stamp":"2023-07-25T14:37:02.240886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T23:37:58.636048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.e","version":"38'2","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:04.279417+0000","last_change":"2023-07-25T14:36:49.188196+0000","last_active":"2023-07-25T14:37:04.279417+0000","last_peered":"2023-07-25T14:37:04.279417+0000","last_clean":"2023-07-25T14:37:04.279417+0000","last_became_active":"2023-07-25T14:36:49.187926+0000","last_became_peered":"2023-07-25T14:36:49.187926+0000","last_unstale":"2023-07-25T14:37:04.279417+0000","last_undegraded":"2023-07-25T14:37:04.279417+0000","last_fullsized":"2023-07-25T14:37:04.279417+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_clean_scrub_stamp":"2023-07-25T14:36:48.163149+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T22:51:40.109837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:04.274717+0000","last_change":"2023-07-25T14:36:50.196466+0000","last_active":"2023-07-25T14:37:04.274717+0000","last_peered":"2023-07-25T14:37:04.274717+0000","last_clean":"2023-07-25T14:37:04.274717+0000","last_became_active":"2023-07-25T14:36:50.196192+0000","last_became_peered":"2023-07-25T14:36:50.196192+0000","last_unstale":"2023-07-25T14:37:04.274717+0000","last_undegraded":"2023-07-25T14:37:04.274717+0000","last_fullsized":"2023-07-25T14:37:04.274717+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T17:39:24.380477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.362744+0000","last_change":"2023-07-25T14:37:02.262617+0000","last_active":"2023-07-25T14:37:05.362744+0000","last_peered":"2023-07-25T14:37:05.362744+0000","last_clean":"2023-07-25T14:37:05.362744+0000","last_became_active":"2023-07-25T14:37:02.262334+0000","last_became_peered":"2023-07-25T14:37:02.262334+0000","last_unstale":"2023-07-25T14:37:05.362744+0000","last_undegraded":"2023-07-25T14:37:05.362744+0000","last_fullsized":"2023-07-25T14:37:05.362744+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:01.239242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:01.239242+0000","last_clean_scrub_stamp":"2023-07-25T14:37:01.239242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T18:38:25.515724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.362662+0000","last_change":"2023-07-25T14:37:03.291262+0000","last_active":"2023-07-25T14:37:05.362662+0000","last_peered":"2023-07-25T14:37:05.362662+0000","last_clean":"2023-07-25T14:37:05.362662+0000","last_became_active":"2023-07-25T14:37:03.290896+0000","last_became_peered":"2023-07-25T14:37:03.290896+0000","last_unstale":"2023-07-25T14:37:05.362662+0000","last_undegraded":"2023-07-25T14:37:05.362662+0000","last_fullsized":"2023-07-25T14:37:05.362662+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_clean_scrub_stamp":"2023-07-25T14:37:02.240886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T02:29:28.163022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.f","version":"38'1","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.361961+0000","last_change":"2023-07-25T14:36:49.191240+0000","last_active":"2023-07-25T14:37:05.361961+0000","last_peered":"2023-07-25T14:37:05.361961+0000","last_clean":"2023-07-25T14:37:05.361961+0000","last_became_active":"2023-07-25T14:36:49.190922+0000","last_became_peered":"2023-07-25T14:36:49.190922+0000","last_unstale":"2023-07-25T14:37:05.361961+0000","last_undegraded":"2023-07-25T14:37:05.361961+0000","last_fullsized":"2023-07-25T14:37:05.361961+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_clean_scrub_stamp":"2023-07-25T14:36:48.163149+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T22:15:36.940298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.362208+0000","last_change":"2023-07-25T14:36:50.197939+0000","last_active":"2023-07-25T14:37:05.362208+0000","last_peered":"2023-07-25T14:37:05.362208+0000","last_clean":"2023-07-25T14:37:05.362208+0000","last_became_active":"2023-07-25T14:36:50.197093+0000","last_became_peered":"2023-07-25T14:36:50.197093+0000","last_unstale":"2023-07-25T14:37:05.362208+0000","last_undegraded":"2023-07-25T14:37:05.362208+0000","last_fullsized":"2023-07-25T14:37:05.362208+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T23:55:04.578607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.360411+0000","last_change":"2023-07-25T14:37:02.272353+0000","last_active":"2023-07-25T14:37:05.360411+0000","last_peered":"2023-07-25T14:37:05.360411+0000","last_clean":"2023-07-25T14:37:05.360411+0000","last_became_active":"2023-07-25T14:37:02.272062+0000","last_became_peered":"2023-07-25T14:37:02.272062+0000","last_unstale":"2023-07-25T14:37:05.360411+0000","last_undegraded":"2023-07-25T14:37:05.360411+0000","last_fullsized":"2023-07-25T14:37:05.360411+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:01.239242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:01.239242+0000","last_clean_scrub_stamp":"2023-07-25T14:37:01.239242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T16:06:47.397497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.360323+0000","last_change":"2023-07-25T14:37:03.274827+0000","last_active":"2023-07-25T14:37:05.360323+0000","last_peered":"2023-07-25T14:37:05.360323+0000","last_clean":"2023-07-25T14:37:05.360323+0000","last_became_active":"2023-07-25T14:37:03.274583+0000","last_became_peered":"2023-07-25T14:37:03.274583+0000","last_unstale":"2023-07-25T14:37:05.360323+0000","last_undegraded":"2023-07-25T14:37:05.360323+0000","last_fullsized":"2023-07-25T14:37:05.360323+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_clean_scrub_stamp":"2023-07-25T14:37:02.240886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T17:08:02.249764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.363579+0000","last_change":"2023-07-25T14:37:03.290483+0000","last_active":"2023-07-25T14:37:05.363579+0000","last_peered":"2023-07-25T14:37:05.363579+0000","last_clean":"2023-07-25T14:37:05.363579+0000","last_became_active":"2023-07-25T14:37:03.290165+0000","last_became_peered":"2023-07-25T14:37:03.290165+0000","last_unstale":"2023-07-25T14:37:05.363579+0000","last_undegraded":"2023-07-25T14:37:05.363579+0000","last_fullsized":"2023-07-25T14:37:05.363579+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_clean_scrub_stamp":"2023-07-25T14:37:02.240886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T21:27:56.546539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.10","version":"38'8","reported_seq":29,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:04.273794+0000","last_change":"2023-07-25T14:36:49.187460+0000","last_active":"2023-07-25T14:37:04.273794+0000","last_peered":"2023-07-25T14:37:04.273794+0000","last_clean":"2023-07-25T14:37:04.273794+0000","last_became_active":"2023-07-25T14:36:49.187132+0000","last_became_peered":"2023-07-25T14:36:49.187132+0000","last_unstale":"2023-07-25T14:37:04.273794+0000","last_undegraded":"2023-07-25T14:37:04.273794+0000","last_fullsized":"2023-07-25T14:37:04.273794+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_clean_scrub_stamp":"2023-07-25T14:36:48.163149+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T02:36:05.441856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.302146+0000","last_change":"2023-07-25T14:36:50.207141+0000","last_active":"2023-07-25T14:37:05.302146+0000","last_peered":"2023-07-25T14:37:05.302146+0000","last_clean":"2023-07-25T14:37:05.302146+0000","last_became_active":"2023-07-25T14:36:50.206727+0000","last_became_peered":"2023-07-25T14:36:50.206727+0000","last_unstale":"2023-07-25T14:37:05.302146+0000","last_undegraded":"2023-07-25T14:37:05.302146+0000","last_fullsized":"2023-07-25T14:37:05.302146+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T02:36:06.445799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1e","version":"42'1","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.364217+0000","last_change":"2023-07-25T14:37:02.260579+0000","last_active":"2023-07-25T14:37:05.364217+0000","last_peered":"2023-07-25T14:37:05.364217+0000","last_clean":"2023-07-25T14:37:05.364217+0000","last_became_active":"2023-07-25T14:37:02.260287+0000","last_became_peered":"2023-07-25T14:37:02.260287+0000","last_unstale":"2023-07-25T14:37:05.364217+0000","last_undegraded":"2023-07-25T14:37:05.364217+0000","last_fullsized":"2023-07-25T14:37:05.364217+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:01.239242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:01.239242+0000","last_clean_scrub_stamp":"2023-07-25T14:37:01.239242+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T02:10:31.233482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:04.274765+0000","last_change":"2023-07-25T14:37:03.298021+0000","last_active":"2023-07-25T14:37:04.274765+0000","last_peered":"2023-07-25T14:37:04.274765+0000","last_clean":"2023-07-25T14:37:04.274765+0000","last_became_active":"2023-07-25T14:37:03.297694+0000","last_became_peered":"2023-07-25T14:37:03.297694+0000","last_unstale":"2023-07-25T14:37:04.274765+0000","last_undegraded":"2023-07-25T14:37:04.274765+0000","last_fullsized":"2023-07-25T14:37:04.274765+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_clean_scrub_stamp":"2023-07-25T14:37:02.240886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T21:12:20.389396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":21,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.361986+0000","last_change":"2023-07-25T14:36:49.191960+0000","last_active":"2023-07-25T14:37:05.361986+0000","last_peered":"2023-07-25T14:37:05.361986+0000","last_clean":"2023-07-25T14:37:05.361986+0000","last_became_active":"2023-07-25T14:36:49.191688+0000","last_became_peered":"2023-07-25T14:36:49.191688+0000","last_unstale":"2023-07-25T14:37:05.361986+0000","last_undegraded":"2023-07-25T14:37:05.361986+0000","last_fullsized":"2023-07-25T14:37:05.361986+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_clean_scrub_stamp":"2023-07-25T14:36:48.163149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T18:26:02.773663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.362715+0000","last_change":"2023-07-25T14:36:50.199005+0000","last_active":"2023-07-25T14:37:05.362715+0000","last_peered":"2023-07-25T14:37:05.362715+0000","last_clean":"2023-07-25T14:37:05.362715+0000","last_became_active":"2023-07-25T14:36:50.198743+0000","last_became_peered":"2023-07-25T14:36:50.198743+0000","last_unstale":"2023-07-25T14:37:05.362715+0000","last_undegraded":"2023-07-25T14:37:05.362715+0000","last_fullsized":"2023-07-25T14:37:05.362715+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T19:31:40.714411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1f","version":"42'4","reported_seq":17,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:04.274556+0000","last_change":"2023-07-25T14:37:02.262747+0000","last_active":"2023-07-25T14:37:04.274556+0000","last_peered":"2023-07-25T14:37:04.274556+0000","last_clean":"2023-07-25T14:37:04.274556+0000","last_became_active":"2023-07-25T14:37:02.262450+0000","last_became_peered":"2023-07-25T14:37:02.262450+0000","last_unstale":"2023-07-25T14:37:04.274556+0000","last_undegraded":"2023-07-25T14:37:04.274556+0000","last_fullsized":"2023-07-25T14:37:04.274556+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:01.239242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:01.239242+0000","last_clean_scrub_stamp":"2023-07-25T14:37:01.239242+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T01:04:23.895896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:04.274433+0000","last_change":"2023-07-25T14:37:03.288809+0000","last_active":"2023-07-25T14:37:04.274433+0000","last_peered":"2023-07-25T14:37:04.274433+0000","last_clean":"2023-07-25T14:37:04.274433+0000","last_became_active":"2023-07-25T14:37:03.288509+0000","last_became_peered":"2023-07-25T14:37:03.288509+0000","last_unstale":"2023-07-25T14:37:04.274433+0000","last_undegraded":"2023-07-25T14:37:04.274433+0000","last_fullsized":"2023-07-25T14:37:04.274433+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_clean_scrub_stamp":"2023-07-25T14:37:02.240886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T16:09:07.074027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":21,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.302437+0000","last_change":"2023-07-25T14:36:49.188746+0000","last_active":"2023-07-25T14:37:05.302437+0000","last_peered":"2023-07-25T14:37:05.302437+0000","last_clean":"2023-07-25T14:37:05.302437+0000","last_became_active":"2023-07-25T14:36:49.188445+0000","last_became_peered":"2023-07-25T14:36:49.188445+0000","last_unstale":"2023-07-25T14:37:05.302437+0000","last_undegraded":"2023-07-25T14:37:05.302437+0000","last_fullsized":"2023-07-25T14:37:05.302437+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_clean_scrub_stamp":"2023-07-25T14:36:48.163149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:14:07.408815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:04.274202+0000","last_change":"2023-07-25T14:36:50.196519+0000","last_active":"2023-07-25T14:37:04.274202+0000","last_peered":"2023-07-25T14:37:04.274202+0000","last_clean":"2023-07-25T14:37:04.274202+0000","last_became_active":"2023-07-25T14:36:50.196242+0000","last_became_peered":"2023-07-25T14:36:50.196242+0000","last_unstale":"2023-07-25T14:37:04.274202+0000","last_undegraded":"2023-07-25T14:37:04.274202+0000","last_fullsized":"2023-07-25T14:37:04.274202+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T15:08:44.757950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"42'2","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:04.279310+0000","last_change":"2023-07-25T14:37:02.264592+0000","last_active":"2023-07-25T14:37:04.279310+0000","last_peered":"2023-07-25T14:37:04.279310+0000","last_clean":"2023-07-25T14:37:04.279310+0000","last_became_active":"2023-07-25T14:37:02.264302+0000","last_became_peered":"2023-07-25T14:37:02.264302+0000","last_unstale":"2023-07-25T14:37:04.279310+0000","last_undegraded":"2023-07-25T14:37:04.279310+0000","last_fullsized":"2023-07-25T14:37:04.279310+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:01.239242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:01.239242+0000","last_clean_scrub_stamp":"2023-07-25T14:37:01.239242+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T17:30:00.968965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.13","version":"38'2","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.361988+0000","last_change":"2023-07-25T14:36:49.193327+0000","last_active":"2023-07-25T14:37:05.361988+0000","last_peered":"2023-07-25T14:37:05.361988+0000","last_clean":"2023-07-25T14:37:05.361988+0000","last_became_active":"2023-07-25T14:36:49.192656+0000","last_became_peered":"2023-07-25T14:36:49.192656+0000","last_unstale":"2023-07-25T14:37:05.361988+0000","last_undegraded":"2023-07-25T14:37:05.361988+0000","last_fullsized":"2023-07-25T14:37:05.361988+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_clean_scrub_stamp":"2023-07-25T14:36:48.163149+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:19:48.189807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.361192+0000","last_change":"2023-07-25T14:36:50.211789+0000","last_active":"2023-07-25T14:37:05.361192+0000","last_peered":"2023-07-25T14:37:05.361192+0000","last_clean":"2023-07-25T14:37:05.361192+0000","last_became_active":"2023-07-25T14:36:50.211520+0000","last_became_peered":"2023-07-25T14:36:50.211520+0000","last_unstale":"2023-07-25T14:37:05.361192+0000","last_undegraded":"2023-07-25T14:37:05.361192+0000","last_fullsized":"2023-07-25T14:37:05.361192+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T19:49:25.615797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1d","version":"42'2","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:04.274302+0000","last_change":"2023-07-25T14:37:02.269473+0000","last_active":"2023-07-25T14:37:04.274302+0000","last_peered":"2023-07-25T14:37:04.274302+0000","last_clean":"2023-07-25T14:37:04.274302+0000","last_became_active":"2023-07-25T14:37:02.269146+0000","last_became_peered":"2023-07-25T14:37:02.269146+0000","last_unstale":"2023-07-25T14:37:04.274302+0000","last_undegraded":"2023-07-25T14:37:04.274302+0000","last_fullsized":"2023-07-25T14:37:04.274302+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:01.239242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:01.239242+0000","last_clean_scrub_stamp":"2023-07-25T14:37:01.239242+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T19:25:36.378383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:04.274224+0000","last_change":"2023-07-25T14:37:03.297654+0000","last_active":"2023-07-25T14:37:04.274224+0000","last_peered":"2023-07-25T14:37:04.274224+0000","last_clean":"2023-07-25T14:37:04.274224+0000","last_became_active":"2023-07-25T14:37:03.293780+0000","last_became_peered":"2023-07-25T14:37:03.293780+0000","last_unstale":"2023-07-25T14:37:04.274224+0000","last_undegraded":"2023-07-25T14:37:04.274224+0000","last_fullsized":"2023-07-25T14:37:04.274224+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_clean_scrub_stamp":"2023-07-25T14:37:02.240886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T22:03:20.904923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"39'9","reported_seq":30,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.360694+0000","last_change":"2023-07-25T14:36:49.178494+0000","last_active":"2023-07-25T14:37:05.360694+0000","last_peered":"2023-07-25T14:37:05.360694+0000","last_clean":"2023-07-25T14:37:05.360694+0000","last_became_active":"2023-07-25T14:36:49.178170+0000","last_became_peered":"2023-07-25T14:36:49.178170+0000","last_unstale":"2023-07-25T14:37:05.360694+0000","last_undegraded":"2023-07-25T14:37:05.360694+0000","last_fullsized":"2023-07-25T14:37:05.360694+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_clean_scrub_stamp":"2023-07-25T14:36:48.163149+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T22:06:58.370248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3071,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.303087+0000","last_change":"2023-07-25T14:36:50.206981+0000","last_active":"2023-07-25T14:37:05.303087+0000","last_peered":"2023-07-25T14:37:05.303087+0000","last_clean":"2023-07-25T14:37:05.303087+0000","last_became_active":"2023-07-25T14:36:50.206684+0000","last_became_peered":"2023-07-25T14:36:50.206684+0000","last_unstale":"2023-07-25T14:37:05.303087+0000","last_undegraded":"2023-07-25T14:37:05.303087+0000","last_fullsized":"2023-07-25T14:37:05.303087+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T01:31:06.970026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1a","version":"42'1","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:04.274230+0000","last_change":"2023-07-25T14:37:02.259257+0000","last_active":"2023-07-25T14:37:04.274230+0000","last_peered":"2023-07-25T14:37:04.274230+0000","last_clean":"2023-07-25T14:37:04.274230+0000","last_became_active":"2023-07-25T14:37:02.258998+0000","last_became_peered":"2023-07-25T14:37:02.258998+0000","last_unstale":"2023-07-25T14:37:04.274230+0000","last_undegraded":"2023-07-25T14:37:04.274230+0000","last_fullsized":"2023-07-25T14:37:04.274230+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:01.239242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:01.239242+0000","last_clean_scrub_stamp":"2023-07-25T14:37:01.239242+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T21:26:58.700605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.364289+0000","last_change":"2023-07-25T14:37:03.300719+0000","last_active":"2023-07-25T14:37:05.364289+0000","last_peered":"2023-07-25T14:37:05.364289+0000","last_clean":"2023-07-25T14:37:05.364289+0000","last_became_active":"2023-07-25T14:37:03.300401+0000","last_became_peered":"2023-07-25T14:37:03.300401+0000","last_unstale":"2023-07-25T14:37:05.364289+0000","last_undegraded":"2023-07-25T14:37:05.364289+0000","last_fullsized":"2023-07-25T14:37:05.364289+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_clean_scrub_stamp":"2023-07-25T14:37:02.240886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T23:05:46.179742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"38'3","reported_seq":24,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.302924+0000","last_change":"2023-07-25T14:36:49.189087+0000","last_active":"2023-07-25T14:37:05.302924+0000","last_peered":"2023-07-25T14:37:05.302924+0000","last_clean":"2023-07-25T14:37:05.302924+0000","last_became_active":"2023-07-25T14:36:49.188727+0000","last_became_peered":"2023-07-25T14:36:49.188727+0000","last_unstale":"2023-07-25T14:37:05.302924+0000","last_undegraded":"2023-07-25T14:37:05.302924+0000","last_fullsized":"2023-07-25T14:37:05.302924+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_clean_scrub_stamp":"2023-07-25T14:36:48.163149+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T19:25:23.302291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.363701+0000","last_change":"2023-07-25T14:36:50.201912+0000","last_active":"2023-07-25T14:37:05.363701+0000","last_peered":"2023-07-25T14:37:05.363701+0000","last_clean":"2023-07-25T14:37:05.363701+0000","last_became_active":"2023-07-25T14:36:50.201362+0000","last_became_peered":"2023-07-25T14:36:50.201362+0000","last_unstale":"2023-07-25T14:37:05.363701+0000","last_undegraded":"2023-07-25T14:37:05.363701+0000","last_fullsized":"2023-07-25T14:37:05.363701+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T01:20:17.380127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"42'1","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:04.279206+0000","last_change":"2023-07-25T14:37:02.264960+0000","last_active":"2023-07-25T14:37:04.279206+0000","last_peered":"2023-07-25T14:37:04.279206+0000","last_clean":"2023-07-25T14:37:04.279206+0000","last_became_active":"2023-07-25T14:37:02.264672+0000","last_became_peered":"2023-07-25T14:37:02.264672+0000","last_unstale":"2023-07-25T14:37:04.279206+0000","last_undegraded":"2023-07-25T14:37:04.279206+0000","last_fullsized":"2023-07-25T14:37:04.279206+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:01.239242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:01.239242+0000","last_clean_scrub_stamp":"2023-07-25T14:37:01.239242+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:59:25.549134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.364016+0000","last_change":"2023-07-25T14:37:03.293507+0000","last_active":"2023-07-25T14:37:05.364016+0000","last_peered":"2023-07-25T14:37:05.364016+0000","last_clean":"2023-07-25T14:37:05.364016+0000","last_became_active":"2023-07-25T14:37:03.293250+0000","last_became_peered":"2023-07-25T14:37:03.293250+0000","last_unstale":"2023-07-25T14:37:05.364016+0000","last_undegraded":"2023-07-25T14:37:05.364016+0000","last_fullsized":"2023-07-25T14:37:05.364016+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_clean_scrub_stamp":"2023-07-25T14:37:02.240886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:59:26.550778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":21,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:04.274987+0000","last_change":"2023-07-25T14:36:49.190277+0000","last_active":"2023-07-25T14:37:04.274987+0000","last_peered":"2023-07-25T14:37:04.274987+0000","last_clean":"2023-07-25T14:37:04.274987+0000","last_became_active":"2023-07-25T14:36:49.189911+0000","last_became_peered":"2023-07-25T14:36:49.189911+0000","last_unstale":"2023-07-25T14:37:04.274987+0000","last_undegraded":"2023-07-25T14:37:04.274987+0000","last_fullsized":"2023-07-25T14:37:04.274987+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_clean_scrub_stamp":"2023-07-25T14:36:48.163149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:19:34.939185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.303141+0000","last_change":"2023-07-25T14:36:50.200137+0000","last_active":"2023-07-25T14:37:05.303141+0000","last_peered":"2023-07-25T14:37:05.303141+0000","last_clean":"2023-07-25T14:37:05.303141+0000","last_became_active":"2023-07-25T14:36:50.199771+0000","last_became_peered":"2023-07-25T14:36:50.199771+0000","last_unstale":"2023-07-25T14:37:05.303141+0000","last_undegraded":"2023-07-25T14:37:05.303141+0000","last_fullsized":"2023-07-25T14:37:05.303141+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:29:16.803888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:04.278758+0000","last_change":"2023-07-25T14:37:02.262531+0000","last_active":"2023-07-25T14:37:04.278758+0000","last_peered":"2023-07-25T14:37:04.278758+0000","last_clean":"2023-07-25T14:37:04.278758+0000","last_became_active":"2023-07-25T14:37:02.262249+0000","last_became_peered":"2023-07-25T14:37:02.262249+0000","last_unstale":"2023-07-25T14:37:04.278758+0000","last_undegraded":"2023-07-25T14:37:04.278758+0000","last_fullsized":"2023-07-25T14:37:04.278758+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:01.239242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:01.239242+0000","last_clean_scrub_stamp":"2023-07-25T14:37:01.239242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T19:35:45.595176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.362619+0000","last_change":"2023-07-25T14:37:03.291703+0000","last_active":"2023-07-25T14:37:05.362619+0000","last_peered":"2023-07-25T14:37:05.362619+0000","last_clean":"2023-07-25T14:37:05.362619+0000","last_became_active":"2023-07-25T14:37:03.291279+0000","last_became_peered":"2023-07-25T14:37:03.291279+0000","last_unstale":"2023-07-25T14:37:05.362619+0000","last_undegraded":"2023-07-25T14:37:05.362619+0000","last_fullsized":"2023-07-25T14:37:05.362619+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_clean_scrub_stamp":"2023-07-25T14:37:02.240886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T22:57:46.551907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":21,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:04.279957+0000","last_change":"2023-07-25T14:36:49.179031+0000","last_active":"2023-07-25T14:37:04.279957+0000","last_peered":"2023-07-25T14:37:04.279957+0000","last_clean":"2023-07-25T14:37:04.279957+0000","last_became_active":"2023-07-25T14:36:49.178709+0000","last_became_peered":"2023-07-25T14:36:49.178709+0000","last_unstale":"2023-07-25T14:37:04.279957+0000","last_undegraded":"2023-07-25T14:37:04.279957+0000","last_fullsized":"2023-07-25T14:37:04.279957+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_clean_scrub_stamp":"2023-07-25T14:36:48.163149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T23:56:16.555841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:04.279663+0000","last_change":"2023-07-25T14:36:50.212104+0000","last_active":"2023-07-25T14:37:04.279663+0000","last_peered":"2023-07-25T14:37:04.279663+0000","last_clean":"2023-07-25T14:37:04.279663+0000","last_became_active":"2023-07-25T14:36:50.211493+0000","last_became_peered":"2023-07-25T14:36:50.211493+0000","last_unstale":"2023-07-25T14:37:04.279663+0000","last_undegraded":"2023-07-25T14:37:04.279663+0000","last_fullsized":"2023-07-25T14:37:04.279663+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T22:07:10.700924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:04.279214+0000","last_change":"2023-07-25T14:37:02.263084+0000","last_active":"2023-07-25T14:37:04.279214+0000","last_peered":"2023-07-25T14:37:04.279214+0000","last_clean":"2023-07-25T14:37:04.279214+0000","last_became_active":"2023-07-25T14:37:02.262776+0000","last_became_peered":"2023-07-25T14:37:02.262776+0000","last_unstale":"2023-07-25T14:37:04.279214+0000","last_undegraded":"2023-07-25T14:37:04.279214+0000","last_fullsized":"2023-07-25T14:37:04.279214+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:01.239242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:01.239242+0000","last_clean_scrub_stamp":"2023-07-25T14:37:01.239242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T22:21:33.528931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.361053+0000","last_change":"2023-07-25T14:37:03.292290+0000","last_active":"2023-07-25T14:37:05.361053+0000","last_peered":"2023-07-25T14:37:05.361053+0000","last_clean":"2023-07-25T14:37:05.361053+0000","last_became_active":"2023-07-25T14:37:03.291964+0000","last_became_peered":"2023-07-25T14:37:03.291964+0000","last_unstale":"2023-07-25T14:37:05.361053+0000","last_undegraded":"2023-07-25T14:37:05.361053+0000","last_fullsized":"2023-07-25T14:37:05.361053+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_clean_scrub_stamp":"2023-07-25T14:37:02.240886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T21:27:56.546539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":21,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:04.273770+0000","last_change":"2023-07-25T14:36:49.187292+0000","last_active":"2023-07-25T14:37:04.273770+0000","last_peered":"2023-07-25T14:37:04.273770+0000","last_clean":"2023-07-25T14:37:04.273770+0000","last_became_active":"2023-07-25T14:36:49.186847+0000","last_became_peered":"2023-07-25T14:36:49.186847+0000","last_unstale":"2023-07-25T14:37:04.273770+0000","last_undegraded":"2023-07-25T14:37:04.273770+0000","last_fullsized":"2023-07-25T14:37:04.273770+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_clean_scrub_stamp":"2023-07-25T14:36:48.163149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T17:44:48.840249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.360730+0000","last_change":"2023-07-25T14:36:50.203758+0000","last_active":"2023-07-25T14:37:05.360730+0000","last_peered":"2023-07-25T14:37:05.360730+0000","last_clean":"2023-07-25T14:37:05.360730+0000","last_became_active":"2023-07-25T14:36:50.203473+0000","last_became_peered":"2023-07-25T14:36:50.203473+0000","last_unstale":"2023-07-25T14:37:05.360730+0000","last_undegraded":"2023-07-25T14:37:05.360730+0000","last_fullsized":"2023-07-25T14:37:05.360730+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T20:17:30.647817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.364215+0000","last_change":"2023-07-25T14:37:02.264282+0000","last_active":"2023-07-25T14:37:05.364215+0000","last_peered":"2023-07-25T14:37:05.364215+0000","last_clean":"2023-07-25T14:37:05.364215+0000","last_became_active":"2023-07-25T14:37:02.264032+0000","last_became_peered":"2023-07-25T14:37:02.264032+0000","last_unstale":"2023-07-25T14:37:05.364215+0000","last_undegraded":"2023-07-25T14:37:05.364215+0000","last_fullsized":"2023-07-25T14:37:05.364215+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:01.239242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:01.239242+0000","last_clean_scrub_stamp":"2023-07-25T14:37:01.239242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T23:18:02.200413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.303095+0000","last_change":"2023-07-25T14:37:03.296433+0000","last_active":"2023-07-25T14:37:05.303095+0000","last_peered":"2023-07-25T14:37:05.303095+0000","last_clean":"2023-07-25T14:37:05.303095+0000","last_became_active":"2023-07-25T14:37:03.296056+0000","last_became_peered":"2023-07-25T14:37:03.296056+0000","last_unstale":"2023-07-25T14:37:05.303095+0000","last_undegraded":"2023-07-25T14:37:05.303095+0000","last_fullsized":"2023-07-25T14:37:05.303095+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_clean_scrub_stamp":"2023-07-25T14:37:02.240886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T21:27:23.198621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":21,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:04.279609+0000","last_change":"2023-07-25T14:36:49.188625+0000","last_active":"2023-07-25T14:37:04.279609+0000","last_peered":"2023-07-25T14:37:04.279609+0000","last_clean":"2023-07-25T14:37:04.279609+0000","last_became_active":"2023-07-25T14:36:49.188284+0000","last_became_peered":"2023-07-25T14:36:49.188284+0000","last_unstale":"2023-07-25T14:37:04.279609+0000","last_undegraded":"2023-07-25T14:37:04.279609+0000","last_fullsized":"2023-07-25T14:37:04.279609+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_clean_scrub_stamp":"2023-07-25T14:36:48.163149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T02:19:20.961003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:04.273674+0000","last_change":"2023-07-25T14:36:50.202710+0000","last_active":"2023-07-25T14:37:04.273674+0000","last_peered":"2023-07-25T14:37:04.273674+0000","last_clean":"2023-07-25T14:37:04.273674+0000","last_became_active":"2023-07-25T14:36:50.202435+0000","last_became_peered":"2023-07-25T14:36:50.202435+0000","last_unstale":"2023-07-25T14:37:04.273674+0000","last_undegraded":"2023-07-25T14:37:04.273674+0000","last_fullsized":"2023-07-25T14:37:04.273674+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T15:58:22.558174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.302830+0000","last_change":"2023-07-25T14:37:02.265530+0000","last_active":"2023-07-25T14:37:05.302830+0000","last_peered":"2023-07-25T14:37:05.302830+0000","last_clean":"2023-07-25T14:37:05.302830+0000","last_became_active":"2023-07-25T14:37:02.265245+0000","last_became_peered":"2023-07-25T14:37:02.265245+0000","last_unstale":"2023-07-25T14:37:05.302830+0000","last_undegraded":"2023-07-25T14:37:05.302830+0000","last_fullsized":"2023-07-25T14:37:05.302830+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:01.239242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:01.239242+0000","last_clean_scrub_stamp":"2023-07-25T14:37:01.239242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T22:34:49.200033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:04.279356+0000","last_change":"2023-07-25T14:37:03.283886+0000","last_active":"2023-07-25T14:37:04.279356+0000","last_peered":"2023-07-25T14:37:04.279356+0000","last_clean":"2023-07-25T14:37:04.279356+0000","last_became_active":"2023-07-25T14:37:03.283521+0000","last_became_peered":"2023-07-25T14:37:03.283521+0000","last_unstale":"2023-07-25T14:37:04.279356+0000","last_undegraded":"2023-07-25T14:37:04.279356+0000","last_fullsized":"2023-07-25T14:37:04.279356+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_clean_scrub_stamp":"2023-07-25T14:37:02.240886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T20:15:27.988672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"38'1","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:04.280018+0000","last_change":"2023-07-25T14:36:49.186416+0000","last_active":"2023-07-25T14:37:04.280018+0000","last_peered":"2023-07-25T14:37:04.280018+0000","last_clean":"2023-07-25T14:37:04.280018+0000","last_became_active":"2023-07-25T14:36:49.186112+0000","last_became_peered":"2023-07-25T14:36:49.186112+0000","last_unstale":"2023-07-25T14:37:04.280018+0000","last_undegraded":"2023-07-25T14:37:04.280018+0000","last_fullsized":"2023-07-25T14:37:04.280018+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_clean_scrub_stamp":"2023-07-25T14:36:48.163149+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:37:27.193075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:04.274237+0000","last_change":"2023-07-25T14:36:50.197978+0000","last_active":"2023-07-25T14:37:04.274237+0000","last_peered":"2023-07-25T14:37:04.274237+0000","last_clean":"2023-07-25T14:37:04.274237+0000","last_became_active":"2023-07-25T14:36:50.197726+0000","last_became_peered":"2023-07-25T14:36:50.197726+0000","last_unstale":"2023-07-25T14:37:04.274237+0000","last_undegraded":"2023-07-25T14:37:04.274237+0000","last_fullsized":"2023-07-25T14:37:04.274237+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T22:34:37.127883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"42'6","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:04.279907+0000","last_change":"2023-07-25T14:37:02.262021+0000","last_active":"2023-07-25T14:37:04.279907+0000","last_peered":"2023-07-25T14:37:04.279907+0000","last_clean":"2023-07-25T14:37:04.279907+0000","last_became_active":"2023-07-25T14:37:02.261728+0000","last_became_peered":"2023-07-25T14:37:02.261728+0000","last_unstale":"2023-07-25T14:37:04.279907+0000","last_undegraded":"2023-07-25T14:37:04.279907+0000","last_fullsized":"2023-07-25T14:37:04.279907+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:01.239242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:01.239242+0000","last_clean_scrub_stamp":"2023-07-25T14:37:01.239242+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T19:42:48.721849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.302697+0000","last_change":"2023-07-25T14:37:03.296582+0000","last_active":"2023-07-25T14:37:05.302697+0000","last_peered":"2023-07-25T14:37:05.302697+0000","last_clean":"2023-07-25T14:37:05.302697+0000","last_became_active":"2023-07-25T14:37:03.296253+0000","last_became_peered":"2023-07-25T14:37:03.296253+0000","last_unstale":"2023-07-25T14:37:05.302697+0000","last_undegraded":"2023-07-25T14:37:05.302697+0000","last_fullsized":"2023-07-25T14:37:05.302697+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_clean_scrub_stamp":"2023-07-25T14:37:02.240886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T16:24:26.276203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1b","version":"38'1","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.364575+0000","last_change":"2023-07-25T14:36:49.193129+0000","last_active":"2023-07-25T14:37:05.364575+0000","last_peered":"2023-07-25T14:37:05.364575+0000","last_clean":"2023-07-25T14:37:05.364575+0000","last_became_active":"2023-07-25T14:36:49.192313+0000","last_became_peered":"2023-07-25T14:36:49.192313+0000","last_unstale":"2023-07-25T14:37:05.364575+0000","last_undegraded":"2023-07-25T14:37:05.364575+0000","last_fullsized":"2023-07-25T14:37:05.364575+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_clean_scrub_stamp":"2023-07-25T14:36:48.163149+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T19:50:09.723619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:04.279866+0000","last_change":"2023-07-25T14:36:50.206176+0000","last_active":"2023-07-25T14:37:04.279866+0000","last_peered":"2023-07-25T14:37:04.279866+0000","last_clean":"2023-07-25T14:37:04.279866+0000","last_became_active":"2023-07-25T14:36:50.205387+0000","last_became_peered":"2023-07-25T14:36:50.205387+0000","last_unstale":"2023-07-25T14:37:04.279866+0000","last_undegraded":"2023-07-25T14:37:04.279866+0000","last_fullsized":"2023-07-25T14:37:04.279866+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:09:02.983213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"42'3","reported_seq":16,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.303173+0000","last_change":"2023-07-25T14:37:02.269037+0000","last_active":"2023-07-25T14:37:05.303173+0000","last_peered":"2023-07-25T14:37:05.303173+0000","last_clean":"2023-07-25T14:37:05.303173+0000","last_became_active":"2023-07-25T14:37:02.268739+0000","last_became_peered":"2023-07-25T14:37:02.268739+0000","last_unstale":"2023-07-25T14:37:05.303173+0000","last_undegraded":"2023-07-25T14:37:05.303173+0000","last_fullsized":"2023-07-25T14:37:05.303173+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:01.239242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:01.239242+0000","last_clean_scrub_stamp":"2023-07-25T14:37:01.239242+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T17:39:36.452627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.361110+0000","last_change":"2023-07-25T14:37:03.282451+0000","last_active":"2023-07-25T14:37:05.361110+0000","last_peered":"2023-07-25T14:37:05.361110+0000","last_clean":"2023-07-25T14:37:05.361110+0000","last_became_active":"2023-07-25T14:37:03.281694+0000","last_became_peered":"2023-07-25T14:37:03.281694+0000","last_unstale":"2023-07-25T14:37:05.361110+0000","last_undegraded":"2023-07-25T14:37:05.361110+0000","last_fullsized":"2023-07-25T14:37:05.361110+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_clean_scrub_stamp":"2023-07-25T14:37:02.240886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T23:04:16.798996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"38'2","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.301652+0000","last_change":"2023-07-25T14:36:49.188456+0000","last_active":"2023-07-25T14:37:05.301652+0000","last_peered":"2023-07-25T14:37:05.301652+0000","last_clean":"2023-07-25T14:37:05.301652+0000","last_became_active":"2023-07-25T14:36:49.188176+0000","last_became_peered":"2023-07-25T14:36:49.188176+0000","last_unstale":"2023-07-25T14:37:05.301652+0000","last_undegraded":"2023-07-25T14:37:05.301652+0000","last_fullsized":"2023-07-25T14:37:05.301652+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_clean_scrub_stamp":"2023-07-25T14:36:48.163149+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T16:58:12.518541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.361016+0000","last_change":"2023-07-25T14:36:50.205852+0000","last_active":"2023-07-25T14:37:05.361016+0000","last_peered":"2023-07-25T14:37:05.361016+0000","last_clean":"2023-07-25T14:37:05.361016+0000","last_became_active":"2023-07-25T14:36:50.205542+0000","last_became_peered":"2023-07-25T14:36:50.205542+0000","last_unstale":"2023-07-25T14:37:05.361016+0000","last_undegraded":"2023-07-25T14:37:05.361016+0000","last_fullsized":"2023-07-25T14:37:05.361016+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T23:46:09.285332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.360822+0000","last_change":"2023-07-25T14:37:02.252129+0000","last_active":"2023-07-25T14:37:05.360822+0000","last_peered":"2023-07-25T14:37:05.360822+0000","last_clean":"2023-07-25T14:37:05.360822+0000","last_became_active":"2023-07-25T14:37:02.251862+0000","last_became_peered":"2023-07-25T14:37:02.251862+0000","last_unstale":"2023-07-25T14:37:05.360822+0000","last_undegraded":"2023-07-25T14:37:05.360822+0000","last_fullsized":"2023-07-25T14:37:05.360822+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:01.239242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:01.239242+0000","last_clean_scrub_stamp":"2023-07-25T14:37:01.239242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T01:23:52.434841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.302400+0000","last_change":"2023-07-25T14:37:03.296791+0000","last_active":"2023-07-25T14:37:05.302400+0000","last_peered":"2023-07-25T14:37:05.302400+0000","last_clean":"2023-07-25T14:37:05.302400+0000","last_became_active":"2023-07-25T14:37:03.296425+0000","last_became_peered":"2023-07-25T14:37:03.296425+0000","last_unstale":"2023-07-25T14:37:05.302400+0000","last_undegraded":"2023-07-25T14:37:05.302400+0000","last_fullsized":"2023-07-25T14:37:05.302400+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_clean_scrub_stamp":"2023-07-25T14:37:02.240886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T19:39:27.866088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1d","version":"38'2","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.360164+0000","last_change":"2023-07-25T14:36:49.188711+0000","last_active":"2023-07-25T14:37:05.360164+0000","last_peered":"2023-07-25T14:37:05.360164+0000","last_clean":"2023-07-25T14:37:05.360164+0000","last_became_active":"2023-07-25T14:36:49.188454+0000","last_became_peered":"2023-07-25T14:36:49.188454+0000","last_unstale":"2023-07-25T14:37:05.360164+0000","last_undegraded":"2023-07-25T14:37:05.360164+0000","last_fullsized":"2023-07-25T14:37:05.360164+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_clean_scrub_stamp":"2023-07-25T14:36:48.163149+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T16:28:13.540791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:04.279754+0000","last_change":"2023-07-25T14:36:50.210856+0000","last_active":"2023-07-25T14:37:04.279754+0000","last_peered":"2023-07-25T14:37:04.279754+0000","last_clean":"2023-07-25T14:37:04.279754+0000","last_became_active":"2023-07-25T14:36:50.210524+0000","last_became_peered":"2023-07-25T14:36:50.210524+0000","last_unstale":"2023-07-25T14:37:04.279754+0000","last_undegraded":"2023-07-25T14:37:04.279754+0000","last_fullsized":"2023-07-25T14:37:04.279754+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T19:39:22.593137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"42'2","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.364457+0000","last_change":"2023-07-25T14:37:02.264993+0000","last_active":"2023-07-25T14:37:05.364457+0000","last_peered":"2023-07-25T14:37:05.364457+0000","last_clean":"2023-07-25T14:37:05.364457+0000","last_became_active":"2023-07-25T14:37:02.264716+0000","last_became_peered":"2023-07-25T14:37:02.264716+0000","last_unstale":"2023-07-25T14:37:05.364457+0000","last_undegraded":"2023-07-25T14:37:05.364457+0000","last_fullsized":"2023-07-25T14:37:05.364457+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:01.239242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:01.239242+0000","last_clean_scrub_stamp":"2023-07-25T14:37:01.239242+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T20:48:31.954134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:04.278979+0000","last_change":"2023-07-25T14:37:03.273189+0000","last_active":"2023-07-25T14:37:04.278979+0000","last_peered":"2023-07-25T14:37:04.278979+0000","last_clean":"2023-07-25T14:37:04.278979+0000","last_became_active":"2023-07-25T14:37:03.272836+0000","last_became_peered":"2023-07-25T14:37:03.272836+0000","last_unstale":"2023-07-25T14:37:04.278979+0000","last_undegraded":"2023-07-25T14:37:04.278979+0000","last_fullsized":"2023-07-25T14:37:04.278979+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_clean_scrub_stamp":"2023-07-25T14:37:02.240886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T17:07:24.735725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1e","version":"38'1","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:04.279532+0000","last_change":"2023-07-25T14:36:49.182497+0000","last_active":"2023-07-25T14:37:04.279532+0000","last_peered":"2023-07-25T14:37:04.279532+0000","last_clean":"2023-07-25T14:37:04.279532+0000","last_became_active":"2023-07-25T14:36:49.182166+0000","last_became_peered":"2023-07-25T14:36:49.182166+0000","last_unstale":"2023-07-25T14:37:04.279532+0000","last_undegraded":"2023-07-25T14:37:04.279532+0000","last_fullsized":"2023-07-25T14:37:04.279532+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_clean_scrub_stamp":"2023-07-25T14:36:48.163149+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T02:10:18.157389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.361772+0000","last_change":"2023-07-25T14:36:50.202196+0000","last_active":"2023-07-25T14:37:05.361772+0000","last_peered":"2023-07-25T14:37:05.361772+0000","last_clean":"2023-07-25T14:37:05.361772+0000","last_became_active":"2023-07-25T14:36:50.201924+0000","last_became_peered":"2023-07-25T14:36:50.201924+0000","last_unstale":"2023-07-25T14:37:05.361772+0000","last_undegraded":"2023-07-25T14:37:05.361772+0000","last_fullsized":"2023-07-25T14:37:05.361772+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T21:47:46.363868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"42'8","reported_seq":21,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.302343+0000","last_change":"2023-07-25T14:37:02.261701+0000","last_active":"2023-07-25T14:37:05.302343+0000","last_peered":"2023-07-25T14:37:05.302343+0000","last_clean":"2023-07-25T14:37:05.302343+0000","last_became_active":"2023-07-25T14:37:02.261410+0000","last_became_peered":"2023-07-25T14:37:02.261410+0000","last_unstale":"2023-07-25T14:37:05.302343+0000","last_undegraded":"2023-07-25T14:37:05.302343+0000","last_fullsized":"2023-07-25T14:37:05.302343+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:01.239242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:01.239242+0000","last_clean_scrub_stamp":"2023-07-25T14:37:01.239242+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T01:12:31.892646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.302039+0000","last_change":"2023-07-25T14:37:03.301073+0000","last_active":"2023-07-25T14:37:05.302039+0000","last_peered":"2023-07-25T14:37:05.302039+0000","last_clean":"2023-07-25T14:37:05.302039+0000","last_became_active":"2023-07-25T14:37:03.300825+0000","last_became_peered":"2023-07-25T14:37:03.300825+0000","last_unstale":"2023-07-25T14:37:05.302039+0000","last_undegraded":"2023-07-25T14:37:05.302039+0000","last_fullsized":"2023-07-25T14:37:05.302039+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_clean_scrub_stamp":"2023-07-25T14:37:02.240886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:05:57.024753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1f","version":"38'4","reported_seq":25,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.364697+0000","last_change":"2023-07-25T14:36:49.189633+0000","last_active":"2023-07-25T14:37:05.364697+0000","last_peered":"2023-07-25T14:37:05.364697+0000","last_clean":"2023-07-25T14:37:05.364697+0000","last_became_active":"2023-07-25T14:36:49.189347+0000","last_became_peered":"2023-07-25T14:36:49.189347+0000","last_unstale":"2023-07-25T14:37:05.364697+0000","last_undegraded":"2023-07-25T14:37:05.364697+0000","last_fullsized":"2023-07-25T14:37:05.364697+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_clean_scrub_stamp":"2023-07-25T14:36:48.163149+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:09:01.979270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.363216+0000","last_change":"2023-07-25T14:36:50.213941+0000","last_active":"2023-07-25T14:37:05.363216+0000","last_peered":"2023-07-25T14:37:05.363216+0000","last_clean":"2023-07-25T14:37:05.363216+0000","last_became_active":"2023-07-25T14:36:50.213697+0000","last_became_peered":"2023-07-25T14:36:50.213697+0000","last_unstale":"2023-07-25T14:37:05.363216+0000","last_undegraded":"2023-07-25T14:37:05.363216+0000","last_fullsized":"2023-07-25T14:37:05.363216+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T20:17:30.647817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:04.279327+0000","last_change":"2023-07-25T14:37:02.264807+0000","last_active":"2023-07-25T14:37:04.279327+0000","last_peered":"2023-07-25T14:37:04.279327+0000","last_clean":"2023-07-25T14:37:04.279327+0000","last_became_active":"2023-07-25T14:37:02.264523+0000","last_became_peered":"2023-07-25T14:37:02.264523+0000","last_unstale":"2023-07-25T14:37:04.279327+0000","last_undegraded":"2023-07-25T14:37:04.279327+0000","last_fullsized":"2023-07-25T14:37:04.279327+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:01.239242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:01.239242+0000","last_clean_scrub_stamp":"2023-07-25T14:37:01.239242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T17:28:42.324250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:04.278650+0000","last_change":"2023-07-25T14:37:03.292347+0000","last_active":"2023-07-25T14:37:04.278650+0000","last_peered":"2023-07-25T14:37:04.278650+0000","last_clean":"2023-07-25T14:37:04.278650+0000","last_became_active":"2023-07-25T14:37:03.292060+0000","last_became_peered":"2023-07-25T14:37:03.292060+0000","last_unstale":"2023-07-25T14:37:04.278650+0000","last_undegraded":"2023-07-25T14:37:04.278650+0000","last_fullsized":"2023-07-25T14:37:04.278650+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_clean_scrub_stamp":"2023-07-25T14:37:02.240886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T19:32:10.136276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.302798+0000","last_change":"2023-07-25T14:37:03.294828+0000","last_active":"2023-07-25T14:37:05.302798+0000","last_peered":"2023-07-25T14:37:05.302798+0000","last_clean":"2023-07-25T14:37:05.302798+0000","last_became_active":"2023-07-25T14:37:03.294371+0000","last_became_peered":"2023-07-25T14:37:03.294371+0000","last_unstale":"2023-07-25T14:37:05.302798+0000","last_undegraded":"2023-07-25T14:37:05.302798+0000","last_fullsized":"2023-07-25T14:37:05.302798+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_clean_scrub_stamp":"2023-07-25T14:37:02.240886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T22:03:20.904923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.360989+0000","last_change":"2023-07-25T14:36:50.203988+0000","last_active":"2023-07-25T14:37:05.360989+0000","last_peered":"2023-07-25T14:37:05.360989+0000","last_clean":"2023-07-25T14:37:05.360989+0000","last_became_active":"2023-07-25T14:36:50.203732+0000","last_became_peered":"2023-07-25T14:36:50.203732+0000","last_unstale":"2023-07-25T14:37:05.360989+0000","last_undegraded":"2023-07-25T14:37:05.360989+0000","last_fullsized":"2023-07-25T14:37:05.360989+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T01:05:55.734046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.364345+0000","last_change":"2023-07-25T14:37:03.296878+0000","last_active":"2023-07-25T14:37:05.364345+0000","last_peered":"2023-07-25T14:37:05.364345+0000","last_clean":"2023-07-25T14:37:05.364345+0000","last_became_active":"2023-07-25T14:37:03.296622+0000","last_became_peered":"2023-07-25T14:37:03.296622+0000","last_unstale":"2023-07-25T14:37:05.364345+0000","last_undegraded":"2023-07-25T14:37:05.364345+0000","last_fullsized":"2023-07-25T14:37:05.364345+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_clean_scrub_stamp":"2023-07-25T14:37:02.240886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T23:59:17.135471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.362771+0000","last_change":"2023-07-25T14:36:50.198090+0000","last_active":"2023-07-25T14:37:05.362771+0000","last_peered":"2023-07-25T14:37:05.362771+0000","last_clean":"2023-07-25T14:37:05.362771+0000","last_became_active":"2023-07-25T14:36:50.197854+0000","last_became_peered":"2023-07-25T14:36:50.197854+0000","last_unstale":"2023-07-25T14:37:05.362771+0000","last_undegraded":"2023-07-25T14:37:05.362771+0000","last_fullsized":"2023-07-25T14:37:05.362771+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T16:42:55.883446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.363615+0000","last_change":"2023-07-25T14:37:03.304720+0000","last_active":"2023-07-25T14:37:05.363615+0000","last_peered":"2023-07-25T14:37:05.363615+0000","last_clean":"2023-07-25T14:37:05.363615+0000","last_became_active":"2023-07-25T14:37:03.304452+0000","last_became_peered":"2023-07-25T14:37:03.304452+0000","last_unstale":"2023-07-25T14:37:05.363615+0000","last_undegraded":"2023-07-25T14:37:05.363615+0000","last_fullsized":"2023-07-25T14:37:05.363615+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_clean_scrub_stamp":"2023-07-25T14:37:02.240886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:35:31.697908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:04.279571+0000","last_change":"2023-07-25T14:36:50.206009+0000","last_active":"2023-07-25T14:37:04.279571+0000","last_peered":"2023-07-25T14:37:04.279571+0000","last_clean":"2023-07-25T14:37:04.279571+0000","last_became_active":"2023-07-25T14:36:50.205731+0000","last_became_peered":"2023-07-25T14:36:50.205731+0000","last_unstale":"2023-07-25T14:37:04.279571+0000","last_undegraded":"2023-07-25T14:37:04.279571+0000","last_fullsized":"2023-07-25T14:37:04.279571+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T18:30:23.936686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.361719+0000","last_change":"2023-07-25T14:37:03.295725+0000","last_active":"2023-07-25T14:37:05.361719+0000","last_peered":"2023-07-25T14:37:05.361719+0000","last_clean":"2023-07-25T14:37:05.361719+0000","last_became_active":"2023-07-25T14:37:03.295442+0000","last_became_peered":"2023-07-25T14:37:03.295442+0000","last_unstale":"2023-07-25T14:37:05.361719+0000","last_undegraded":"2023-07-25T14:37:05.361719+0000","last_fullsized":"2023-07-25T14:37:05.361719+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_clean_scrub_stamp":"2023-07-25T14:37:02.240886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T01:34:58.908253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.361462+0000","last_change":"2023-07-25T14:36:50.206158+0000","last_active":"2023-07-25T14:37:05.361462+0000","last_peered":"2023-07-25T14:37:05.361462+0000","last_clean":"2023-07-25T14:37:05.361462+0000","last_became_active":"2023-07-25T14:36:50.205826+0000","last_became_peered":"2023-07-25T14:36:50.205826+0000","last_unstale":"2023-07-25T14:37:05.361462+0000","last_undegraded":"2023-07-25T14:37:05.361462+0000","last_fullsized":"2023-07-25T14:37:05.361462+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:55:45.982937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.364145+0000","last_change":"2023-07-25T14:37:03.294723+0000","last_active":"2023-07-25T14:37:05.364145+0000","last_peered":"2023-07-25T14:37:05.364145+0000","last_clean":"2023-07-25T14:37:05.364145+0000","last_became_active":"2023-07-25T14:37:03.294453+0000","last_became_peered":"2023-07-25T14:37:03.294453+0000","last_unstale":"2023-07-25T14:37:05.364145+0000","last_undegraded":"2023-07-25T14:37:05.364145+0000","last_fullsized":"2023-07-25T14:37:05.364145+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_clean_scrub_stamp":"2023-07-25T14:37:02.240886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T23:06:03.045191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:04.279876+0000","last_change":"2023-07-25T14:36:50.214125+0000","last_active":"2023-07-25T14:37:04.279876+0000","last_peered":"2023-07-25T14:37:04.279876+0000","last_clean":"2023-07-25T14:37:04.279876+0000","last_became_active":"2023-07-25T14:36:50.213810+0000","last_became_peered":"2023-07-25T14:36:50.213810+0000","last_unstale":"2023-07-25T14:37:04.279876+0000","last_undegraded":"2023-07-25T14:37:04.279876+0000","last_fullsized":"2023-07-25T14:37:04.279876+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T22:02:41.537005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.302193+0000","last_change":"2023-07-25T14:37:03.295322+0000","last_active":"2023-07-25T14:37:05.302193+0000","last_peered":"2023-07-25T14:37:05.302193+0000","last_clean":"2023-07-25T14:37:05.302193+0000","last_became_active":"2023-07-25T14:37:03.294827+0000","last_became_peered":"2023-07-25T14:37:03.294827+0000","last_unstale":"2023-07-25T14:37:05.302193+0000","last_undegraded":"2023-07-25T14:37:05.302193+0000","last_fullsized":"2023-07-25T14:37:05.302193+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_clean_scrub_stamp":"2023-07-25T14:37:02.240886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T16:23:10.727951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:04.279321+0000","last_change":"2023-07-25T14:36:50.201315+0000","last_active":"2023-07-25T14:37:04.279321+0000","last_peered":"2023-07-25T14:37:04.279321+0000","last_clean":"2023-07-25T14:37:04.279321+0000","last_became_active":"2023-07-25T14:36:50.201043+0000","last_became_peered":"2023-07-25T14:36:50.201043+0000","last_unstale":"2023-07-25T14:37:04.279321+0000","last_undegraded":"2023-07-25T14:37:04.279321+0000","last_fullsized":"2023-07-25T14:37:04.279321+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T19:50:10.727562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.360653+0000","last_change":"2023-07-25T14:37:03.293323+0000","last_active":"2023-07-25T14:37:05.360653+0000","last_peered":"2023-07-25T14:37:05.360653+0000","last_clean":"2023-07-25T14:37:05.360653+0000","last_became_active":"2023-07-25T14:37:03.293021+0000","last_became_peered":"2023-07-25T14:37:03.293021+0000","last_unstale":"2023-07-25T14:37:05.360653+0000","last_undegraded":"2023-07-25T14:37:05.360653+0000","last_fullsized":"2023-07-25T14:37:05.360653+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_clean_scrub_stamp":"2023-07-25T14:37:02.240886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T23:04:16.798996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.361675+0000","last_change":"2023-07-25T14:36:50.193509+0000","last_active":"2023-07-25T14:37:05.361675+0000","last_peered":"2023-07-25T14:37:05.361675+0000","last_clean":"2023-07-25T14:37:05.361675+0000","last_became_active":"2023-07-25T14:36:50.193223+0000","last_became_peered":"2023-07-25T14:36:50.193223+0000","last_unstale":"2023-07-25T14:37:05.361675+0000","last_undegraded":"2023-07-25T14:37:05.361675+0000","last_fullsized":"2023-07-25T14:37:05.361675+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T20:18:50.988942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.302383+0000","last_change":"2023-07-25T14:37:03.301119+0000","last_active":"2023-07-25T14:37:05.302383+0000","last_peered":"2023-07-25T14:37:05.302383+0000","last_clean":"2023-07-25T14:37:05.302383+0000","last_became_active":"2023-07-25T14:37:03.300850+0000","last_became_peered":"2023-07-25T14:37:03.300850+0000","last_unstale":"2023-07-25T14:37:05.302383+0000","last_undegraded":"2023-07-25T14:37:05.302383+0000","last_fullsized":"2023-07-25T14:37:05.302383+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_clean_scrub_stamp":"2023-07-25T14:37:02.240886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T18:17:33.408755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.361680+0000","last_change":"2023-07-25T14:36:50.206676+0000","last_active":"2023-07-25T14:37:05.361680+0000","last_peered":"2023-07-25T14:37:05.361680+0000","last_clean":"2023-07-25T14:37:05.361680+0000","last_became_active":"2023-07-25T14:36:50.206388+0000","last_became_peered":"2023-07-25T14:36:50.206388+0000","last_unstale":"2023-07-25T14:37:05.361680+0000","last_undegraded":"2023-07-25T14:37:05.361680+0000","last_fullsized":"2023-07-25T14:37:05.361680+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T22:25:01.919234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:04.278878+0000","last_change":"2023-07-25T14:37:03.284720+0000","last_active":"2023-07-25T14:37:04.278878+0000","last_peered":"2023-07-25T14:37:04.278878+0000","last_clean":"2023-07-25T14:37:04.278878+0000","last_became_active":"2023-07-25T14:37:03.284357+0000","last_became_peered":"2023-07-25T14:37:03.284357+0000","last_unstale":"2023-07-25T14:37:04.278878+0000","last_undegraded":"2023-07-25T14:37:04.278878+0000","last_fullsized":"2023-07-25T14:37:04.278878+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_clean_scrub_stamp":"2023-07-25T14:37:02.240886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T15:01:37.336868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.360572+0000","last_change":"2023-07-25T14:36:50.201691+0000","last_active":"2023-07-25T14:37:05.360572+0000","last_peered":"2023-07-25T14:37:05.360572+0000","last_clean":"2023-07-25T14:37:05.360572+0000","last_became_active":"2023-07-25T14:36:50.201277+0000","last_became_peered":"2023-07-25T14:36:50.201277+0000","last_unstale":"2023-07-25T14:37:05.360572+0000","last_undegraded":"2023-07-25T14:37:05.360572+0000","last_fullsized":"2023-07-25T14:37:05.360572+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T18:38:37.067083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.361797+0000","last_change":"2023-07-25T14:37:03.284263+0000","last_active":"2023-07-25T14:37:05.361797+0000","last_peered":"2023-07-25T14:37:05.361797+0000","last_clean":"2023-07-25T14:37:05.361797+0000","last_became_active":"2023-07-25T14:37:03.283945+0000","last_became_peered":"2023-07-25T14:37:03.283945+0000","last_unstale":"2023-07-25T14:37:05.361797+0000","last_undegraded":"2023-07-25T14:37:05.361797+0000","last_fullsized":"2023-07-25T14:37:05.361797+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_clean_scrub_stamp":"2023-07-25T14:37:02.240886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T16:35:37.962502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.360663+0000","last_change":"2023-07-25T14:36:50.204317+0000","last_active":"2023-07-25T14:37:05.360663+0000","last_peered":"2023-07-25T14:37:05.360663+0000","last_clean":"2023-07-25T14:37:05.360663+0000","last_became_active":"2023-07-25T14:36:50.203984+0000","last_became_peered":"2023-07-25T14:36:50.203984+0000","last_unstale":"2023-07-25T14:37:05.360663+0000","last_undegraded":"2023-07-25T14:37:05.360663+0000","last_fullsized":"2023-07-25T14:37:05.360663+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T23:46:09.285332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.361451+0000","last_change":"2023-07-25T14:37:03.285433+0000","last_active":"2023-07-25T14:37:05.361451+0000","last_peered":"2023-07-25T14:37:05.361451+0000","last_clean":"2023-07-25T14:37:05.361451+0000","last_became_active":"2023-07-25T14:37:03.285102+0000","last_became_peered":"2023-07-25T14:37:03.285102+0000","last_unstale":"2023-07-25T14:37:05.361451+0000","last_undegraded":"2023-07-25T14:37:05.361451+0000","last_fullsized":"2023-07-25T14:37:05.361451+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_clean_scrub_stamp":"2023-07-25T14:37:02.240886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T02:09:53.775729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:04.274248+0000","last_change":"2023-07-25T14:36:50.202547+0000","last_active":"2023-07-25T14:37:04.274248+0000","last_peered":"2023-07-25T14:37:04.274248+0000","last_clean":"2023-07-25T14:37:04.274248+0000","last_became_active":"2023-07-25T14:36:50.202242+0000","last_became_peered":"2023-07-25T14:36:50.202242+0000","last_unstale":"2023-07-25T14:37:04.274248+0000","last_undegraded":"2023-07-25T14:37:04.274248+0000","last_fullsized":"2023-07-25T14:37:04.274248+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T21:33:27.605480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:04.273976+0000","last_change":"2023-07-25T14:37:03.293640+0000","last_active":"2023-07-25T14:37:04.273976+0000","last_peered":"2023-07-25T14:37:04.273976+0000","last_clean":"2023-07-25T14:37:04.273976+0000","last_became_active":"2023-07-25T14:37:03.293347+0000","last_became_peered":"2023-07-25T14:37:03.293347+0000","last_unstale":"2023-07-25T14:37:04.273976+0000","last_undegraded":"2023-07-25T14:37:04.273976+0000","last_fullsized":"2023-07-25T14:37:04.273976+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_clean_scrub_stamp":"2023-07-25T14:37:02.240886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T22:20:51.809262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.364493+0000","last_change":"2023-07-25T14:36:50.211635+0000","last_active":"2023-07-25T14:37:05.364493+0000","last_peered":"2023-07-25T14:37:05.364493+0000","last_clean":"2023-07-25T14:37:05.364493+0000","last_became_active":"2023-07-25T14:36:50.211036+0000","last_became_peered":"2023-07-25T14:36:50.211036+0000","last_unstale":"2023-07-25T14:37:05.364493+0000","last_undegraded":"2023-07-25T14:37:05.364493+0000","last_fullsized":"2023-07-25T14:37:05.364493+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T15:48:18.672192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.302095+0000","last_change":"2023-07-25T14:37:03.294285+0000","last_active":"2023-07-25T14:37:05.302095+0000","last_peered":"2023-07-25T14:37:05.302095+0000","last_clean":"2023-07-25T14:37:05.302095+0000","last_became_active":"2023-07-25T14:37:03.294003+0000","last_became_peered":"2023-07-25T14:37:03.294003+0000","last_unstale":"2023-07-25T14:37:05.302095+0000","last_undegraded":"2023-07-25T14:37:05.302095+0000","last_fullsized":"2023-07-25T14:37:05.302095+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_clean_scrub_stamp":"2023-07-25T14:37:02.240886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T17:45:02.917986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.361881+0000","last_change":"2023-07-25T14:36:50.213055+0000","last_active":"2023-07-25T14:37:05.361881+0000","last_peered":"2023-07-25T14:37:05.361881+0000","last_clean":"2023-07-25T14:37:05.361881+0000","last_became_active":"2023-07-25T14:36:50.211933+0000","last_became_peered":"2023-07-25T14:36:50.211933+0000","last_unstale":"2023-07-25T14:37:05.361881+0000","last_undegraded":"2023-07-25T14:37:05.361881+0000","last_fullsized":"2023-07-25T14:37:05.361881+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T15:31:36.354172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.364312+0000","last_change":"2023-07-25T14:37:03.294076+0000","last_active":"2023-07-25T14:37:05.364312+0000","last_peered":"2023-07-25T14:37:05.364312+0000","last_clean":"2023-07-25T14:37:05.364312+0000","last_became_active":"2023-07-25T14:37:03.293816+0000","last_became_peered":"2023-07-25T14:37:03.293816+0000","last_unstale":"2023-07-25T14:37:05.364312+0000","last_undegraded":"2023-07-25T14:37:05.364312+0000","last_fullsized":"2023-07-25T14:37:05.364312+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_clean_scrub_stamp":"2023-07-25T14:37:02.240886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T18:30:32.992558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.361517+0000","last_change":"2023-07-25T14:36:50.212251+0000","last_active":"2023-07-25T14:37:05.361517+0000","last_peered":"2023-07-25T14:37:05.361517+0000","last_clean":"2023-07-25T14:37:05.361517+0000","last_became_active":"2023-07-25T14:36:50.211890+0000","last_became_peered":"2023-07-25T14:36:50.211890+0000","last_unstale":"2023-07-25T14:37:05.361517+0000","last_undegraded":"2023-07-25T14:37:05.361517+0000","last_fullsized":"2023-07-25T14:37:05.361517+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T01:04:10.819668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:04.273577+0000","last_change":"2023-07-25T14:37:03.301320+0000","last_active":"2023-07-25T14:37:04.273577+0000","last_peered":"2023-07-25T14:37:04.273577+0000","last_clean":"2023-07-25T14:37:04.273577+0000","last_became_active":"2023-07-25T14:37:03.300887+0000","last_became_peered":"2023-07-25T14:37:03.300887+0000","last_unstale":"2023-07-25T14:37:04.273577+0000","last_undegraded":"2023-07-25T14:37:04.273577+0000","last_fullsized":"2023-07-25T14:37:04.273577+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_clean_scrub_stamp":"2023-07-25T14:37:02.240886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T16:58:26.596278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:04.279569+0000","last_change":"2023-07-25T14:36:50.212257+0000","last_active":"2023-07-25T14:37:04.279569+0000","last_peered":"2023-07-25T14:37:04.279569+0000","last_clean":"2023-07-25T14:37:04.279569+0000","last_became_active":"2023-07-25T14:36:50.211850+0000","last_became_peered":"2023-07-25T14:36:50.211850+0000","last_unstale":"2023-07-25T14:37:04.279569+0000","last_undegraded":"2023-07-25T14:37:04.279569+0000","last_fullsized":"2023-07-25T14:37:04.279569+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T23:05:33.105948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.361199+0000","last_change":"2023-07-25T14:37:03.284655+0000","last_active":"2023-07-25T14:37:05.361199+0000","last_peered":"2023-07-25T14:37:05.361199+0000","last_clean":"2023-07-25T14:37:05.361199+0000","last_became_active":"2023-07-25T14:37:03.284390+0000","last_became_peered":"2023-07-25T14:37:03.284390+0000","last_unstale":"2023-07-25T14:37:05.361199+0000","last_undegraded":"2023-07-25T14:37:05.361199+0000","last_fullsized":"2023-07-25T14:37:05.361199+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_clean_scrub_stamp":"2023-07-25T14:37:02.240886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T15:14:16.938401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:04.279642+0000","last_change":"2023-07-25T14:36:50.206017+0000","last_active":"2023-07-25T14:37:04.279642+0000","last_peered":"2023-07-25T14:37:04.279642+0000","last_clean":"2023-07-25T14:37:04.279642+0000","last_became_active":"2023-07-25T14:36:50.205693+0000","last_became_peered":"2023-07-25T14:36:50.205693+0000","last_unstale":"2023-07-25T14:37:04.279642+0000","last_undegraded":"2023-07-25T14:37:04.279642+0000","last_fullsized":"2023-07-25T14:37:04.279642+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T23:59:04.061677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.364149+0000","last_change":"2023-07-25T14:37:03.297136+0000","last_active":"2023-07-25T14:37:05.364149+0000","last_peered":"2023-07-25T14:37:05.364149+0000","last_clean":"2023-07-25T14:37:05.364149+0000","last_became_active":"2023-07-25T14:37:03.296853+0000","last_became_peered":"2023-07-25T14:37:03.296853+0000","last_unstale":"2023-07-25T14:37:05.364149+0000","last_undegraded":"2023-07-25T14:37:05.364149+0000","last_fullsized":"2023-07-25T14:37:05.364149+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_clean_scrub_stamp":"2023-07-25T14:37:02.240886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T22:51:54.187574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.360726+0000","last_change":"2023-07-25T14:36:50.212013+0000","last_active":"2023-07-25T14:37:05.360726+0000","last_peered":"2023-07-25T14:37:05.360726+0000","last_clean":"2023-07-25T14:37:05.360726+0000","last_became_active":"2023-07-25T14:36:50.211722+0000","last_became_peered":"2023-07-25T14:36:50.211722+0000","last_unstale":"2023-07-25T14:37:05.360726+0000","last_undegraded":"2023-07-25T14:37:05.360726+0000","last_fullsized":"2023-07-25T14:37:05.360726+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T02:12:52.790653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3f","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.361659+0000","last_change":"2023-07-25T14:37:03.295102+0000","last_active":"2023-07-25T14:37:05.361659+0000","last_peered":"2023-07-25T14:37:05.361659+0000","last_clean":"2023-07-25T14:37:05.361659+0000","last_became_active":"2023-07-25T14:37:03.294834+0000","last_became_peered":"2023-07-25T14:37:03.294834+0000","last_unstale":"2023-07-25T14:37:05.361659+0000","last_undegraded":"2023-07-25T14:37:05.361659+0000","last_fullsized":"2023-07-25T14:37:05.361659+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_clean_scrub_stamp":"2023-07-25T14:37:02.240886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T20:22:05.098648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.362701+0000","last_change":"2023-07-25T14:36:50.204379+0000","last_active":"2023-07-25T14:37:05.362701+0000","last_peered":"2023-07-25T14:37:05.362701+0000","last_clean":"2023-07-25T14:37:05.362701+0000","last_became_active":"2023-07-25T14:36:50.203202+0000","last_became_peered":"2023-07-25T14:36:50.203202+0000","last_unstale":"2023-07-25T14:37:05.362701+0000","last_undegraded":"2023-07-25T14:37:05.362701+0000","last_fullsized":"2023-07-25T14:37:05.362701+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T14:38:04.645962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:04.280212+0000","last_change":"2023-07-25T14:37:03.284729+0000","last_active":"2023-07-25T14:37:04.280212+0000","last_peered":"2023-07-25T14:37:04.280212+0000","last_clean":"2023-07-25T14:37:04.280212+0000","last_became_active":"2023-07-25T14:37:03.284410+0000","last_became_peered":"2023-07-25T14:37:03.284410+0000","last_unstale":"2023-07-25T14:37:04.280212+0000","last_undegraded":"2023-07-25T14:37:04.280212+0000","last_fullsized":"2023-07-25T14:37:04.280212+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_clean_scrub_stamp":"2023-07-25T14:37:02.240886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T20:29:08.115324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:04.274069+0000","last_change":"2023-07-25T14:36:50.206731+0000","last_active":"2023-07-25T14:37:04.274069+0000","last_peered":"2023-07-25T14:37:04.274069+0000","last_clean":"2023-07-25T14:37:04.274069+0000","last_became_active":"2023-07-25T14:36:50.206426+0000","last_became_peered":"2023-07-25T14:36:50.206426+0000","last_unstale":"2023-07-25T14:37:04.274069+0000","last_undegraded":"2023-07-25T14:37:04.274069+0000","last_fullsized":"2023-07-25T14:37:04.274069+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:14:08.412757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.303177+0000","last_change":"2023-07-25T14:37:03.295003+0000","last_active":"2023-07-25T14:37:05.303177+0000","last_peered":"2023-07-25T14:37:05.303177+0000","last_clean":"2023-07-25T14:37:05.303177+0000","last_became_active":"2023-07-25T14:37:03.294561+0000","last_became_peered":"2023-07-25T14:37:03.294561+0000","last_unstale":"2023-07-25T14:37:05.303177+0000","last_undegraded":"2023-07-25T14:37:05.303177+0000","last_fullsized":"2023-07-25T14:37:05.303177+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_clean_scrub_stamp":"2023-07-25T14:37:02.240886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T01:04:24.897540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.361603+0000","last_change":"2023-07-25T14:36:50.200453+0000","last_active":"2023-07-25T14:37:05.361603+0000","last_peered":"2023-07-25T14:37:05.361603+0000","last_clean":"2023-07-25T14:37:05.361603+0000","last_became_active":"2023-07-25T14:36:50.200070+0000","last_became_peered":"2023-07-25T14:36:50.200070+0000","last_unstale":"2023-07-25T14:37:05.361603+0000","last_undegraded":"2023-07-25T14:37:05.361603+0000","last_fullsized":"2023-07-25T14:37:05.361603+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T20:42:15.910532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:04.273816+0000","last_change":"2023-07-25T14:37:03.292563+0000","last_active":"2023-07-25T14:37:04.273816+0000","last_peered":"2023-07-25T14:37:04.273816+0000","last_clean":"2023-07-25T14:37:04.273816+0000","last_became_active":"2023-07-25T14:37:03.292269+0000","last_became_peered":"2023-07-25T14:37:03.292269+0000","last_unstale":"2023-07-25T14:37:04.273816+0000","last_undegraded":"2023-07-25T14:37:04.273816+0000","last_fullsized":"2023-07-25T14:37:04.273816+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_clean_scrub_stamp":"2023-07-25T14:37:02.240886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T16:23:10.727951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:04.279415+0000","last_change":"2023-07-25T14:36:50.199364+0000","last_active":"2023-07-25T14:37:04.279415+0000","last_peered":"2023-07-25T14:37:04.279415+0000","last_clean":"2023-07-25T14:37:04.279415+0000","last_became_active":"2023-07-25T14:36:50.198943+0000","last_became_peered":"2023-07-25T14:36:50.198943+0000","last_unstale":"2023-07-25T14:37:04.279415+0000","last_undegraded":"2023-07-25T14:37:04.279415+0000","last_fullsized":"2023-07-25T14:37:04.279415+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T19:11:42.787555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.361372+0000","last_change":"2023-07-25T14:37:03.285468+0000","last_active":"2023-07-25T14:37:05.361372+0000","last_peered":"2023-07-25T14:37:05.361372+0000","last_clean":"2023-07-25T14:37:05.361372+0000","last_became_active":"2023-07-25T14:37:03.285119+0000","last_became_peered":"2023-07-25T14:37:03.285119+0000","last_unstale":"2023-07-25T14:37:05.361372+0000","last_undegraded":"2023-07-25T14:37:05.361372+0000","last_fullsized":"2023-07-25T14:37:05.361372+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_clean_scrub_stamp":"2023-07-25T14:37:02.240886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T22:48:17.277203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:04.274510+0000","last_change":"2023-07-25T14:36:50.206841+0000","last_active":"2023-07-25T14:37:04.274510+0000","last_peered":"2023-07-25T14:37:04.274510+0000","last_clean":"2023-07-25T14:37:04.274510+0000","last_became_active":"2023-07-25T14:36:50.206563+0000","last_became_peered":"2023-07-25T14:36:50.206563+0000","last_unstale":"2023-07-25T14:37:04.274510+0000","last_undegraded":"2023-07-25T14:37:04.274510+0000","last_fullsized":"2023-07-25T14:37:04.274510+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T21:27:10.124827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.362657+0000","last_change":"2023-07-25T14:37:03.295094+0000","last_active":"2023-07-25T14:37:05.362657+0000","last_peered":"2023-07-25T14:37:05.362657+0000","last_clean":"2023-07-25T14:37:05.362657+0000","last_became_active":"2023-07-25T14:37:03.294714+0000","last_became_peered":"2023-07-25T14:37:03.294714+0000","last_unstale":"2023-07-25T14:37:05.362657+0000","last_undegraded":"2023-07-25T14:37:05.362657+0000","last_fullsized":"2023-07-25T14:37:05.362657+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_clean_scrub_stamp":"2023-07-25T14:37:02.240886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T20:02:55.863984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:04.274889+0000","last_change":"2023-07-25T14:36:50.202401+0000","last_active":"2023-07-25T14:37:04.274889+0000","last_peered":"2023-07-25T14:37:04.274889+0000","last_clean":"2023-07-25T14:37:04.274889+0000","last_became_active":"2023-07-25T14:36:50.202122+0000","last_became_peered":"2023-07-25T14:36:50.202122+0000","last_unstale":"2023-07-25T14:37:04.274889+0000","last_undegraded":"2023-07-25T14:37:04.274889+0000","last_fullsized":"2023-07-25T14:37:04.274889+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T15:18:03.100506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:04.278986+0000","last_change":"2023-07-25T14:37:03.282301+0000","last_active":"2023-07-25T14:37:04.278986+0000","last_peered":"2023-07-25T14:37:04.278986+0000","last_clean":"2023-07-25T14:37:04.278986+0000","last_became_active":"2023-07-25T14:37:03.281898+0000","last_became_peered":"2023-07-25T14:37:03.281898+0000","last_unstale":"2023-07-25T14:37:04.278986+0000","last_undegraded":"2023-07-25T14:37:04.278986+0000","last_fullsized":"2023-07-25T14:37:04.278986+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_clean_scrub_stamp":"2023-07-25T14:37:02.240886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T18:09:05.593042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:04.274679+0000","last_change":"2023-07-25T14:36:50.207115+0000","last_active":"2023-07-25T14:37:04.274679+0000","last_peered":"2023-07-25T14:37:04.274679+0000","last_clean":"2023-07-25T14:37:04.274679+0000","last_became_active":"2023-07-25T14:36:50.206848+0000","last_became_peered":"2023-07-25T14:36:50.206848+0000","last_unstale":"2023-07-25T14:37:04.274679+0000","last_undegraded":"2023-07-25T14:37:04.274679+0000","last_fullsized":"2023-07-25T14:37:04.274679+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:29:16.803888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.363288+0000","last_change":"2023-07-25T14:37:03.280417+0000","last_active":"2023-07-25T14:37:05.363288+0000","last_peered":"2023-07-25T14:37:05.363288+0000","last_clean":"2023-07-25T14:37:05.363288+0000","last_became_active":"2023-07-25T14:37:03.279600+0000","last_became_peered":"2023-07-25T14:37:03.279600+0000","last_unstale":"2023-07-25T14:37:05.363288+0000","last_undegraded":"2023-07-25T14:37:05.363288+0000","last_fullsized":"2023-07-25T14:37:05.363288+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_clean_scrub_stamp":"2023-07-25T14:37:02.240886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T01:23:53.436485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:04.273653+0000","last_change":"2023-07-25T14:36:50.208542+0000","last_active":"2023-07-25T14:37:04.273653+0000","last_peered":"2023-07-25T14:37:04.273653+0000","last_clean":"2023-07-25T14:37:04.273653+0000","last_became_active":"2023-07-25T14:36:50.208292+0000","last_became_peered":"2023-07-25T14:36:50.208292+0000","last_unstale":"2023-07-25T14:37:04.273653+0000","last_undegraded":"2023-07-25T14:37:04.273653+0000","last_fullsized":"2023-07-25T14:37:04.273653+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:15:27.887140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:04.279445+0000","last_change":"2023-07-25T14:37:03.294175+0000","last_active":"2023-07-25T14:37:04.279445+0000","last_peered":"2023-07-25T14:37:04.279445+0000","last_clean":"2023-07-25T14:37:04.279445+0000","last_became_active":"2023-07-25T14:37:03.293812+0000","last_became_peered":"2023-07-25T14:37:03.293812+0000","last_unstale":"2023-07-25T14:37:04.279445+0000","last_undegraded":"2023-07-25T14:37:04.279445+0000","last_fullsized":"2023-07-25T14:37:04.279445+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_clean_scrub_stamp":"2023-07-25T14:37:02.240886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T19:35:14.086616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.302211+0000","last_change":"2023-07-25T14:36:50.205352+0000","last_active":"2023-07-25T14:37:05.302211+0000","last_peered":"2023-07-25T14:37:05.302211+0000","last_clean":"2023-07-25T14:37:05.302211+0000","last_became_active":"2023-07-25T14:36:50.205041+0000","last_became_peered":"2023-07-25T14:36:50.205041+0000","last_unstale":"2023-07-25T14:37:05.302211+0000","last_undegraded":"2023-07-25T14:37:05.302211+0000","last_fullsized":"2023-07-25T14:37:05.302211+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T16:46:15.062571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:04.279666+0000","last_change":"2023-07-25T14:37:03.287944+0000","last_active":"2023-07-25T14:37:04.279666+0000","last_peered":"2023-07-25T14:37:04.279666+0000","last_clean":"2023-07-25T14:37:04.279666+0000","last_became_active":"2023-07-25T14:37:03.287629+0000","last_became_peered":"2023-07-25T14:37:03.287629+0000","last_unstale":"2023-07-25T14:37:04.279666+0000","last_undegraded":"2023-07-25T14:37:04.279666+0000","last_fullsized":"2023-07-25T14:37:04.279666+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_clean_scrub_stamp":"2023-07-25T14:37:02.240886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T22:41:21.303941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.363850+0000","last_change":"2023-07-25T14:36:50.200879+0000","last_active":"2023-07-25T14:37:05.363850+0000","last_peered":"2023-07-25T14:37:05.363850+0000","last_clean":"2023-07-25T14:37:05.363850+0000","last_became_active":"2023-07-25T14:36:50.199174+0000","last_became_peered":"2023-07-25T14:36:50.199174+0000","last_unstale":"2023-07-25T14:37:05.363850+0000","last_undegraded":"2023-07-25T14:37:05.363850+0000","last_fullsized":"2023-07-25T14:37:05.363850+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T21:20:57.111964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.361023+0000","last_change":"2023-07-25T14:37:03.294946+0000","last_active":"2023-07-25T14:37:05.361023+0000","last_peered":"2023-07-25T14:37:05.361023+0000","last_clean":"2023-07-25T14:37:05.361023+0000","last_became_active":"2023-07-25T14:37:03.294416+0000","last_became_peered":"2023-07-25T14:37:03.294416+0000","last_unstale":"2023-07-25T14:37:05.361023+0000","last_undegraded":"2023-07-25T14:37:05.361023+0000","last_fullsized":"2023-07-25T14:37:05.361023+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_clean_scrub_stamp":"2023-07-25T14:37:02.240886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T18:38:50.140877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:04.280116+0000","last_change":"2023-07-25T14:36:50.209446+0000","last_active":"2023-07-25T14:37:04.280116+0000","last_peered":"2023-07-25T14:37:04.280116+0000","last_clean":"2023-07-25T14:37:04.280116+0000","last_became_active":"2023-07-25T14:36:50.209144+0000","last_became_peered":"2023-07-25T14:36:50.209144+0000","last_unstale":"2023-07-25T14:37:04.280116+0000","last_undegraded":"2023-07-25T14:37:04.280116+0000","last_fullsized":"2023-07-25T14:37:04.280116+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T16:38:34.985665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:04.279075+0000","last_change":"2023-07-25T14:37:03.292805+0000","last_active":"2023-07-25T14:37:04.279075+0000","last_peered":"2023-07-25T14:37:04.279075+0000","last_clean":"2023-07-25T14:37:04.279075+0000","last_became_active":"2023-07-25T14:37:03.292469+0000","last_became_peered":"2023-07-25T14:37:03.292469+0000","last_unstale":"2023-07-25T14:37:04.279075+0000","last_undegraded":"2023-07-25T14:37:04.279075+0000","last_fullsized":"2023-07-25T14:37:04.279075+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_clean_scrub_stamp":"2023-07-25T14:37:02.240886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T21:21:10.185758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:04.274059+0000","last_change":"2023-07-25T14:36:50.204689+0000","last_active":"2023-07-25T14:37:04.274059+0000","last_peered":"2023-07-25T14:37:04.274059+0000","last_clean":"2023-07-25T14:37:04.274059+0000","last_became_active":"2023-07-25T14:36:50.204430+0000","last_became_peered":"2023-07-25T14:36:50.204430+0000","last_unstale":"2023-07-25T14:37:04.274059+0000","last_undegraded":"2023-07-25T14:37:04.274059+0000","last_fullsized":"2023-07-25T14:37:04.274059+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T16:41:40.404575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.361328+0000","last_change":"2023-07-25T14:37:03.293189+0000","last_active":"2023-07-25T14:37:05.361328+0000","last_peered":"2023-07-25T14:37:05.361328+0000","last_clean":"2023-07-25T14:37:05.361328+0000","last_became_active":"2023-07-25T14:37:03.292966+0000","last_became_peered":"2023-07-25T14:37:03.292966+0000","last_unstale":"2023-07-25T14:37:05.361328+0000","last_undegraded":"2023-07-25T14:37:05.361328+0000","last_fullsized":"2023-07-25T14:37:05.361328+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_clean_scrub_stamp":"2023-07-25T14:37:02.240886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T23:34:14.960597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:04.279721+0000","last_change":"2023-07-25T14:36:50.211484+0000","last_active":"2023-07-25T14:37:04.279721+0000","last_peered":"2023-07-25T14:37:04.279721+0000","last_clean":"2023-07-25T14:37:04.279721+0000","last_became_active":"2023-07-25T14:36:50.211113+0000","last_became_peered":"2023-07-25T14:36:50.211113+0000","last_unstale":"2023-07-25T14:37:04.279721+0000","last_undegraded":"2023-07-25T14:37:04.279721+0000","last_fullsized":"2023-07-25T14:37:04.279721+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T20:48:19.881984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:04.273973+0000","last_change":"2023-07-25T14:37:03.292515+0000","last_active":"2023-07-25T14:37:04.273973+0000","last_peered":"2023-07-25T14:37:04.273973+0000","last_clean":"2023-07-25T14:37:04.273973+0000","last_became_active":"2023-07-25T14:37:03.292136+0000","last_became_peered":"2023-07-25T14:37:03.292136+0000","last_unstale":"2023-07-25T14:37:04.273973+0000","last_undegraded":"2023-07-25T14:37:04.273973+0000","last_fullsized":"2023-07-25T14:37:04.273973+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_clean_scrub_stamp":"2023-07-25T14:37:02.240886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T19:39:27.866088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:04.280073+0000","last_change":"2023-07-25T14:36:50.210983+0000","last_active":"2023-07-25T14:37:04.280073+0000","last_peered":"2023-07-25T14:37:04.280073+0000","last_clean":"2023-07-25T14:37:04.280073+0000","last_became_active":"2023-07-25T14:36:50.210721+0000","last_became_peered":"2023-07-25T14:36:50.210721+0000","last_unstale":"2023-07-25T14:37:04.280073+0000","last_undegraded":"2023-07-25T14:37:04.280073+0000","last_fullsized":"2023-07-25T14:37:04.280073+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T20:11:06.039462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:04.280165+0000","last_change":"2023-07-25T14:37:03.282507+0000","last_active":"2023-07-25T14:37:04.280165+0000","last_peered":"2023-07-25T14:37:04.280165+0000","last_clean":"2023-07-25T14:37:04.280165+0000","last_became_active":"2023-07-25T14:37:03.281535+0000","last_became_peered":"2023-07-25T14:37:03.281535+0000","last_unstale":"2023-07-25T14:37:04.280165+0000","last_undegraded":"2023-07-25T14:37:04.280165+0000","last_fullsized":"2023-07-25T14:37:04.280165+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_clean_scrub_stamp":"2023-07-25T14:37:02.240886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T21:07:51.429961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3f","version":"0'0","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.303006+0000","last_change":"2023-07-25T14:36:50.199855+0000","last_active":"2023-07-25T14:37:05.303006+0000","last_peered":"2023-07-25T14:37:05.303006+0000","last_clean":"2023-07-25T14:37:05.303006+0000","last_became_active":"2023-07-25T14:36:50.199464+0000","last_became_peered":"2023-07-25T14:36:50.199464+0000","last_unstale":"2023-07-25T14:37:05.303006+0000","last_undegraded":"2023-07-25T14:37:05.303006+0000","last_fullsized":"2023-07-25T14:37:05.303006+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T16:08:54.000233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":3869,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64510,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574871,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27588,"kb_used_data":564,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344252,"statfs":{"total":96636764160,"available":96608514048,"internally_reserved":0,"allocated":577536,"data_stored":824181,"data_compressed":32255,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jul 25 14:36:37 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":9.1600000000000001,"5min":9.1600000000000001,"15min":9.1600000000000001},"last":0.502}]},{"osd":1,"last update":"Tue Jul 25 14:36:37 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.5009999999999999,"5min":1.5009999999999999,"15min":1.5009999999999999},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.526,"5min":1.526,"15min":1.526},"last":0.63500000000000001}]},{"osd":2,"last update":"Tue Jul 25 14:36:37 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":8.1739999999999995,"5min":8.1739999999999995,"15min":8.1739999999999995},"last":0.89700000000000002}]},{"osd":3,"last update":"Tue Jul 25 14:36:37 2023","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":7.2279999999999998,"5min":7.2279999999999998,"15min":7.2279999999999998},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":7.1870000000000003,"5min":7.1870000000000003,"15min":7.1870000000000003},"last":0.95099999999999996}]},{"osd":4,"last update":"Tue Jul 25 14:36:37 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.877}]},{"osd":5,"last update":"Tue Jul 25 14:36:37 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":1.0309999999999999},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.80000000000000004}]},{"osd":6,"last update":"Tue Jul 25 14:36:37 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.286,"5min":1.286,"15min":1.286},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.97199999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574870,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27516,"kb_used_data":496,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344324,"statfs":{"total":96636764160,"available":96608587776,"internally_reserved":0,"allocated":507904,"data_stored":234235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jul 25 14:36:32 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":1.9370000000000001,"5min":1.9370000000000001,"15min":1.9370000000000001},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":2.6779999999999999,"5min":2.6779999999999999,"15min":2.6779999999999999},"last":0.39700000000000002}]},{"osd":1,"last update":"Tue Jul 25 14:36:32 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":2.5720000000000001,"5min":2.5720000000000001,"15min":2.5720000000000001},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":1.6259999999999999,"5min":1.6259999999999999,"15min":1.6259999999999999},"last":0.47999999999999998}]},{"osd":2,"last update":"Tue Jul 25 14:36:32 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.45500000000000002}]},{"osd":3,"last update":"Tue Jul 25 14:36:32 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":3.5750000000000002,"5min":3.5750000000000002,"15min":3.5750000000000002},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":4.7190000000000003,"5min":4.7190000000000003,"15min":4.7190000000000003},"last":0.57299999999999995}]},{"osd":4,"last update":"Tue Jul 25 14:36:32 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":4.694,"5min":4.694,"15min":4.694},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":2.7839999999999998,"5min":2.7839999999999998,"15min":2.7839999999999998},"last":0.64300000000000002}]},{"osd":5,"last update":"Tue Jul 25 14:36:32 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.7310000000000001,"5min":1.7310000000000001,"15min":1.7310000000000001},"last":0.65900000000000003}]},{"osd":7,"last update":"Tue Jul 25 14:36:32 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":2.7290000000000001,"5min":2.7290000000000001,"15min":2.7290000000000001},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.61299999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574870,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27584,"kb_used_data":560,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344256,"statfs":{"total":96636764160,"available":96608518144,"internally_reserved":0,"allocated":573440,"data_stored":824091,"data_compressed":32255,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jul 25 14:36:34 2023","interfaces":[{"interface":"back","average":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"last":0.26600000000000001},{"interface":"front","average":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"last":0.36399999999999999}]},{"osd":2,"last update":"Tue Jul 25 14:36:34 2023","interfaces":[{"interface":"back","average":{"1min":0.309,"5min":0.309,"15min":0.309},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"last":0.28100000000000003},{"interface":"front","average":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"last":0.32000000000000001}]},{"osd":3,"last update":"Tue Jul 25 14:36:34 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.374,"15min":0.374},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.496,"5min":0.496,"15min":0.496},"last":0.251}]},{"osd":4,"last update":"Tue Jul 25 14:36:34 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.53600000000000003}]},{"osd":5,"last update":"Tue Jul 25 14:36:34 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.46300000000000002}]},{"osd":6,"last update":"Tue Jul 25 14:36:34 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.504},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.442}]},{"osd":7,"last update":"Tue Jul 25 14:36:34 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.58199999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574870,"num_pgs":61,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27524,"kb_used_data":504,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344316,"statfs":{"total":96636764160,"available":96608579584,"internally_reserved":0,"allocated":516096,"data_stored":234682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Jul 25 14:36:32 2023","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"min":{"1min":0.19600000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":6.5369999999999999,"5min":6.5369999999999999,"15min":6.5369999999999999},"last":0.31}]},{"osd":2,"last update":"Tue Jul 25 14:36:32 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.374,"15min":0.374},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.29099999999999998},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":6.5659999999999998,"5min":6.5659999999999998,"15min":6.5659999999999998},"last":0.36899999999999999}]},{"osd":3,"last update":"Tue Jul 25 14:36:32 2023","interfaces":[{"interface":"back","average":{"1min":1.026,"5min":1.026,"15min":1.026},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":12.449,"5min":12.449,"15min":12.449},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":1.079,"5min":1.079,"15min":1.079},"last":0.38400000000000001}]},{"osd":4,"last update":"Tue Jul 25 14:36:32 2023","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":6.5099999999999998,"5min":6.5099999999999998,"15min":6.5099999999999998},"last":0.51500000000000001},{"interface":"front","average":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":12.35,"5min":12.35,"15min":12.35},"last":0.63400000000000001}]},{"osd":5,"last update":"Tue Jul 25 14:36:32 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.107,"5min":1.107,"15min":1.107},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":6.4349999999999996,"5min":6.4349999999999996,"15min":6.4349999999999996},"last":0.57299999999999995}]},{"osd":6,"last update":"Tue Jul 25 14:36:32 2023","interfaces":[{"interface":"back","average":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":12.417,"5min":12.417,"15min":12.417},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.625}]},{"osd":7,"last update":"Tue Jul 25 14:36:32 2023","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":6.4809999999999999,"5min":6.4809999999999999,"15min":6.4809999999999999},"last":0.61099999999999999},{"interface":"front","average":{"1min":1.22,"5min":1.22,"15min":1.22},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":12.388999999999999,"5min":12.388999999999999,"15min":12.388999999999999},"last":0.54500000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574870,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27528,"kb_used_data":508,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344312,"statfs":{"total":96636764160,"available":96608575488,"internally_reserved":0,"allocated":520192,"data_stored":235651,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jul 25 14:36:31 2023","interfaces":[{"interface":"back","average":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":2.1030000000000002,"5min":2.1030000000000002,"15min":2.1030000000000002},"last":0.28999999999999998},{"interface":"front","average":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":16.969000000000001,"5min":16.969000000000001,"15min":16.969000000000001},"last":0.27100000000000002}]},{"osd":1,"last update":"Tue Jul 25 14:36:31 2023","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"last":0.37},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":1.111,"5min":1.111,"15min":1.111},"last":0.309}]},{"osd":3,"last update":"Tue Jul 25 14:36:31 2023","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":13.035,"5min":13.035,"15min":13.035},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.33100000000000002}]},{"osd":4,"last update":"Tue Jul 25 14:36:31 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":6.165,"5min":6.165,"15min":6.165},"last":0.63200000000000001},{"interface":"front","average":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":13.004,"5min":13.004,"15min":13.004},"last":0.51900000000000002}]},{"osd":5,"last update":"Tue Jul 25 14:36:31 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":6.226,"5min":6.226,"15min":6.226},"last":0.50800000000000001}]},{"osd":6,"last update":"Tue Jul 25 14:36:31 2023","interfaces":[{"interface":"back","average":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":12.974,"5min":12.974,"15min":12.974},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.621}]},{"osd":7,"last update":"Tue Jul 25 14:36:31 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":6.1989999999999998,"5min":6.1989999999999998,"15min":6.1989999999999998},"last":0.60099999999999998},{"interface":"front","average":{"1min":1.141,"5min":1.141,"15min":1.141},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":12.936999999999999,"5min":12.936999999999999,"15min":12.936999999999999},"last":0.55300000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574870,"num_pgs":59,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27524,"kb_used_data":504,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344316,"statfs":{"total":96636764160,"available":96608579584,"internally_reserved":0,"allocated":516096,"data_stored":233196,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jul 25 14:36:34 2023","interfaces":[{"interface":"back","average":{"1min":0.316,"5min":0.316,"15min":0.316},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"last":0.373}]},{"osd":1,"last update":"Tue Jul 25 14:36:34 2023","interfaces":[{"interface":"back","average":{"1min":0.307,"5min":0.307,"15min":0.307},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.378,"5min":0.378,"15min":0.378},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.376,"5min":0.376,"15min":0.376},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"last":0.29699999999999999}]},{"osd":2,"last update":"Tue Jul 25 14:36:34 2023","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.377,"15min":0.377},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.502,"5min":0.502,"15min":0.502},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.40799999999999997}]},{"osd":4,"last update":"Tue Jul 25 14:36:34 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.67800000000000005}]},{"osd":5,"last update":"Tue Jul 25 14:36:34 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.54500000000000004}]},{"osd":6,"last update":"Tue Jul 25 14:36:34 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.68999999999999995}]},{"osd":7,"last update":"Tue Jul 25 14:36:34 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.72899999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574870,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27532,"kb_used_data":512,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344308,"statfs":{"total":96636764160,"available":96608571392,"internally_reserved":0,"allocated":524288,"data_stored":238198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jul 25 14:36:33 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.46000000000000002}]},{"osd":1,"last update":"Tue Jul 25 14:36:33 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.42999999999999999}]},{"osd":2,"last update":"Tue Jul 25 14:36:33 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.623}]},{"osd":3,"last update":"Tue Jul 25 14:36:33 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.8720000000000001,"5min":1.8720000000000001,"15min":1.8720000000000001},"last":0.51800000000000002}]},{"osd":5,"last update":"Tue Jul 25 14:36:33 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.66000000000000003}]},{"osd":6,"last update":"Tue Jul 25 14:36:33 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.68899999999999995}]},{"osd":7,"last update":"Tue Jul 25 14:36:33 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.70199999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574870,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27520,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344320,"statfs":{"total":96636764160,"available":96608583680,"internally_reserved":0,"allocated":512000,"data_stored":234285,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jul 25 14:36:31 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":2.548,"5min":2.548,"15min":2.548},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.54700000000000004}]},{"osd":1,"last update":"Tue Jul 25 14:36:31 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.657,"5min":1.657,"15min":1.657},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.752,"5min":1.752,"15min":1.752},"last":0.65500000000000003}]},{"osd":2,"last update":"Tue Jul 25 14:36:31 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.498},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.64200000000000002}]},{"osd":3,"last update":"Tue Jul 25 14:36:31 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.627}]},{"osd":4,"last update":"Tue Jul 25 14:36:31 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.45300000000000001}]},{"osd":6,"last update":"Tue Jul 25 14:36:31 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.57299999999999995}]},{"osd":7,"last update":"Tue Jul 25 14:36:31 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.58499999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32255,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32255,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3071,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-25T14:37:07.405 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-25T14:37:07.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.539+0000 7fca22cc6700 1 Processor -- start 2023-07-25T14:37:07.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.539+0000 7fca22cc6700 1 -- start start 2023-07-25T14:37:07.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.540+0000 7fca22cc6700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fca1c14f810 0x7fca1c0c4370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:07.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.540+0000 7fca22cc6700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fca1c0a9cc0 0x7fca1c1525e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:07.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.540+0000 7fca22cc6700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca1c0c5890 con 0x7fca1c0bb0b0 2023-07-25T14:37:07.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.540+0000 7fca22cc6700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca1c152150 con 0x7fca1c14f810 2023-07-25T14:37:07.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.540+0000 7fca22cc6700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca1c14fbf0 con 0x7fca1c0a9cc0 2023-07-25T14:37:07.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.540+0000 7fca20a62700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fca1c14f810 0x7fca1c0c4370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:07.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.540+0000 7fca20a62700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fca1c14f810 0x7fca1c0c4370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42456/0 (socket says 172.21.15.72:42456) 2023-07-25T14:37:07.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.540+0000 7fca20a62700 1 -- 172.21.15.72:0/4048344601 learned_addr learned my addr 172.21.15.72:0/4048344601 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:37:07.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.540+0000 7fca1bfff700 1 --2- 172.21.15.72:0/4048344601 >> v2:172.21.15.92:3300/0 conn(0x7fca1c0a9cc0 0x7fca1c1525e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:07.555 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.541+0000 7fca20a62700 1 -- 172.21.15.72:0/4048344601 >> v2:172.21.15.92:3300/0 conn(0x7fca1c0a9cc0 msgr2=0x7fca1c1525e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:07.555 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.541+0000 7fca20a62700 1 --2- 172.21.15.72:0/4048344601 >> v2:172.21.15.92:3300/0 conn(0x7fca1c0a9cc0 0x7fca1c1525e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:07.555 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.541+0000 7fca20a62700 1 -- 172.21.15.72:0/4048344601 >> v1:172.21.15.92:6789/0 conn(0x7fca1c0bb0b0 legacy=0x7fca1c152b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:07.555 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.541+0000 7fca20a62700 1 -- 172.21.15.72:0/4048344601 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca1c1566a0 con 0x7fca1c14f810 2023-07-25T14:37:07.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.541+0000 7fca1bfff700 1 --2- 172.21.15.72:0/4048344601 >> v2:172.21.15.92:3300/0 conn(0x7fca1c0a9cc0 0x7fca1c1525e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-25T14:37:07.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.541+0000 7fca20a62700 1 --2- 172.21.15.72:0/4048344601 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fca1c14f810 0x7fca1c0c4370 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fca1c0c1f90 tx=0x7fca10009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec857cd02d7848df server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:07.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.541+0000 7fca1b7fe700 1 -- 172.21.15.72:0/4048344601 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca10004230 con 0x7fca1c14f810 2023-07-25T14:37:07.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.541+0000 7fca1b7fe700 1 -- 172.21.15.72:0/4048344601 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca10004390 con 0x7fca1c14f810 2023-07-25T14:37:07.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.541+0000 7fca1b7fe700 1 -- 172.21.15.72:0/4048344601 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca100036a0 con 0x7fca1c14f810 2023-07-25T14:37:07.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.541+0000 7fca22cc6700 1 -- 172.21.15.72:0/4048344601 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fca1c14f810 msgr2=0x7fca1c0c4370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:07.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.541+0000 7fca22cc6700 1 --2- 172.21.15.72:0/4048344601 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fca1c14f810 0x7fca1c0c4370 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fca1c0c1f90 tx=0x7fca10009bd0 comp rx=0 tx=0).stop 2023-07-25T14:37:07.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.541+0000 7fca22cc6700 1 -- 172.21.15.72:0/4048344601 shutdown_connections 2023-07-25T14:37:07.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.541+0000 7fca22cc6700 1 --2- 172.21.15.72:0/4048344601 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fca1c14f810 0x7fca1c0c4370 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:07.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.541+0000 7fca22cc6700 1 --2- 172.21.15.72:0/4048344601 >> v2:172.21.15.92:3300/0 conn(0x7fca1c0a9cc0 0x7fca1c1525e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:07.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.541+0000 7fca22cc6700 1 -- 172.21.15.72:0/4048344601 >> 172.21.15.72:0/4048344601 conn(0x7fca1c06a8d0 msgr2=0x7fca1c0a94e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:07.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.542+0000 7fca22cc6700 1 -- 172.21.15.72:0/4048344601 shutdown_connections 2023-07-25T14:37:07.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.542+0000 7fca22cc6700 1 -- 172.21.15.72:0/4048344601 wait complete. 2023-07-25T14:37:07.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.543+0000 7fca22cc6700 1 Processor -- start 2023-07-25T14:37:07.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.543+0000 7fca22cc6700 1 -- start start 2023-07-25T14:37:07.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.544+0000 7fca22cc6700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fca1c0a9cc0 0x7fca1c0bde70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:07.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.544+0000 7fca22cc6700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fca1c0bb0b0 0x7fca1c0aa7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:07.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.544+0000 7fca22cc6700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fca1c14f810 0x7fca1c0aacf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:07.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.544+0000 7fca22cc6700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca1c0c0b80 con 0x7fca1c14f810 2023-07-25T14:37:07.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.544+0000 7fca22cc6700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca1c0a8840 con 0x7fca1c0bb0b0 2023-07-25T14:37:07.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.544+0000 7fca22cc6700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca1c0a8a90 con 0x7fca1c0a9cc0 2023-07-25T14:37:07.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.544+0000 7fca21263700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fca1c14f810 0x7fca1c0aacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:07.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.544+0000 7fca21263700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fca1c14f810 0x7fca1c0aacf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42466/0 (socket says 172.21.15.72:42466) 2023-07-25T14:37:07.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.544+0000 7fca21263700 1 -- 172.21.15.72:0/560597188 learned_addr learned my addr 172.21.15.72:0/560597188 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:37:07.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.544+0000 7fca1bfff700 1 --2- 172.21.15.72:0/560597188 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fca1c0bb0b0 0x7fca1c0aa7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:07.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.544+0000 7fca20a62700 1 --2- 172.21.15.72:0/560597188 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fca1c0a9cc0 0x7fca1c0bde70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:07.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.544+0000 7fca21263700 1 -- 172.21.15.72:0/560597188 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fca1c0a9cc0 msgr2=0x7fca1c0bde70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:07.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.545+0000 7fca21263700 1 --2- 172.21.15.72:0/560597188 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fca1c0a9cc0 0x7fca1c0bde70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:07.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.545+0000 7fca21263700 1 -- 172.21.15.72:0/560597188 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fca1c0bb0b0 msgr2=0x7fca1c0aa7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:07.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.545+0000 7fca21263700 1 --2- 172.21.15.72:0/560597188 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fca1c0bb0b0 0x7fca1c0aa7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:07.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.545+0000 7fca21263700 1 -- 172.21.15.72:0/560597188 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca10009550 con 0x7fca1c14f810 2023-07-25T14:37:07.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.545+0000 7fca1bfff700 1 --2- 172.21.15.72:0/560597188 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fca1c0bb0b0 0x7fca1c0aa7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-25T14:37:07.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.545+0000 7fca20a62700 1 --2- 172.21.15.72:0/560597188 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fca1c0a9cc0 0x7fca1c0bde70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-25T14:37:07.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.545+0000 7fca21263700 1 --2- 172.21.15.72:0/560597188 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fca1c14f810 0x7fca1c0aacf0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fca1400cc40 tx=0x7fca140049e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:07.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.545+0000 7fca197fa700 1 -- 172.21.15.72:0/560597188 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca1400ab40 con 0x7fca1c14f810 2023-07-25T14:37:07.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.545+0000 7fca197fa700 1 -- 172.21.15.72:0/560597188 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca1400aca0 con 0x7fca1c14f810 2023-07-25T14:37:07.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.545+0000 7fca22cc6700 1 -- 172.21.15.72:0/560597188 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca1c14e730 con 0x7fca1c14f810 2023-07-25T14:37:07.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.545+0000 7fca197fa700 1 -- 172.21.15.72:0/560597188 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca14012660 con 0x7fca1c14f810 2023-07-25T14:37:07.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.545+0000 7fca22cc6700 1 -- 172.21.15.72:0/560597188 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca1c0c1a10 con 0x7fca1c14f810 2023-07-25T14:37:07.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.546+0000 7fca22cc6700 1 -- 172.21.15.72:0/560597188 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca1c0aa5b0 con 0x7fca1c14f810 2023-07-25T14:37:07.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.546+0000 7fca197fa700 1 -- 172.21.15.72:0/560597188 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fca140127c0 con 0x7fca1c14f810 2023-07-25T14:37:07.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.547+0000 7fca197fa700 1 --2- 172.21.15.72:0/560597188 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fca0006ad60 0x7fca0006d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:07.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.547+0000 7fca197fa700 1 -- 172.21.15.72:0/560597188 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 7238+0+0 (secure 0 0 0) 0x7fca1408a000 con 0x7fca1c14f810 2023-07-25T14:37:07.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.547+0000 7fca20a62700 1 --2- 172.21.15.72:0/560597188 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fca0006ad60 0x7fca0006d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:07.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.547+0000 7fca20a62700 1 --2- 172.21.15.72:0/560597188 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fca0006ad60 0x7fca0006d220 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fca10009130 tx=0x7fca10008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:07.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.551+0000 7fca197fa700 1 -- 172.21.15.72:0/560597188 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fca14054c60 con 0x7fca1c14f810 2023-07-25T14:37:07.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.733+0000 7fca22cc6700 1 -- 172.21.15.72:0/560597188 --> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fca1c0c2420 con 0x7fca0006ad60 2023-07-25T14:37:07.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.747+0000 7fca197fa700 1 -- 172.21.15.72:0/560597188 <== mgr.4104 v2:172.21.15.72:6832/1171220306 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+549698 (secure 0 0 0) 0x7fca10003850 con 0x7fca0006ad60 2023-07-25T14:37:07.763 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-25T14:37:07.766 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.751+0000 7fca22cc6700 1 -- 172.21.15.72:0/560597188 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fca0006ad60 msgr2=0x7fca0006d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:07.767 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.751+0000 7fca22cc6700 1 --2- 172.21.15.72:0/560597188 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fca0006ad60 0x7fca0006d220 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fca10009130 tx=0x7fca10008030 comp rx=0 tx=0).stop 2023-07-25T14:37:07.767 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.751+0000 7fca22cc6700 1 -- 172.21.15.72:0/560597188 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fca1c14f810 msgr2=0x7fca1c0aacf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:07.767 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.751+0000 7fca22cc6700 1 --2- 172.21.15.72:0/560597188 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fca1c14f810 0x7fca1c0aacf0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fca1400cc40 tx=0x7fca140049e0 comp rx=0 tx=0).stop 2023-07-25T14:37:07.767 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.752+0000 7fca22cc6700 1 -- 172.21.15.72:0/560597188 shutdown_connections 2023-07-25T14:37:07.767 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.752+0000 7fca22cc6700 1 --2- 172.21.15.72:0/560597188 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fca0006ad60 0x7fca0006d220 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:07.767 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.752+0000 7fca22cc6700 1 --2- 172.21.15.72:0/560597188 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fca1c0a9cc0 0x7fca1c0bde70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:07.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.752+0000 7fca22cc6700 1 --2- 172.21.15.72:0/560597188 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fca1c14f810 0x7fca1c0aacf0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:07.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.752+0000 7fca22cc6700 1 --2- 172.21.15.72:0/560597188 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fca1c0bb0b0 0x7fca1c0aa7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:07.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.752+0000 7fca22cc6700 1 -- 172.21.15.72:0/560597188 >> 172.21.15.72:0/560597188 conn(0x7fca1c06a8d0 msgr2=0x7fca1c1525e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:07.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.752+0000 7fca22cc6700 1 -- 172.21.15.72:0/560597188 shutdown_connections 2023-07-25T14:37:07.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.752+0000 7fca22cc6700 1 -- 172.21.15.72:0/560597188 wait complete. 2023-07-25T14:37:07.768 INFO:teuthology.orchestra.run.smithi072.stderr:dumped all 2023-07-25T14:37:07.775 INFO:teuthology.orchestra.run.smithi072.stdout:{"pg_ready":true,"pg_map":{"version":84,"stamp":"2023-07-25T14:37:07.303245+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596599,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":251,"num_write_kb":2447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":197,"ondisk_log_size":197,"up":402,"acting":402,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":381,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220316,"kb_used_data":4148,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754754404,"statfs":{"total":773094113280,"available":772868509696,"internally_reserved":0,"allocated":4247552,"data_stored":3058519,"data_compressed":64510,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":38,"apply_latency_ms":38,"commit_latency_ns":38000000,"apply_latency_ns":38000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":3869,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001101"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":59,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.361892+0000","last_change":"2023-07-25T14:35:34.370772+0000","last_active":"2023-07-25T14:37:05.361892+0000","last_peered":"2023-07-25T14:37:05.361892+0000","last_clean":"2023-07-25T14:37:05.361892+0000","last_became_active":"2023-07-25T14:35:34.370549+0000","last_became_peered":"2023-07-25T14:35:34.370549+0000","last_unstale":"2023-07-25T14:37:05.361892+0000","last_undegraded":"2023-07-25T14:37:05.361892+0000","last_fullsized":"2023-07-25T14:37:05.361892+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_clean_scrub_stamp":"2023-07-25T14:35:33.358525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T22:29:40.424880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":21,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:04.273915+0000","last_change":"2023-07-25T14:36:49.189178+0000","last_active":"2023-07-25T14:37:04.273915+0000","last_peered":"2023-07-25T14:37:04.273915+0000","last_clean":"2023-07-25T14:37:04.273915+0000","last_became_active":"2023-07-25T14:36:49.188876+0000","last_became_peered":"2023-07-25T14:36:49.188876+0000","last_unstale":"2023-07-25T14:37:04.273915+0000","last_undegraded":"2023-07-25T14:37:04.273915+0000","last_fullsized":"2023-07-25T14:37:04.273915+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_clean_scrub_stamp":"2023-07-25T14:36:48.163149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T16:46:14.058628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:04.279657+0000","last_change":"2023-07-25T14:36:50.213458+0000","last_active":"2023-07-25T14:37:04.279657+0000","last_peered":"2023-07-25T14:37:04.279657+0000","last_clean":"2023-07-25T14:37:04.279657+0000","last_became_active":"2023-07-25T14:36:50.213138+0000","last_became_peered":"2023-07-25T14:36:50.213138+0000","last_unstale":"2023-07-25T14:37:04.279657+0000","last_undegraded":"2023-07-25T14:37:04.279657+0000","last_fullsized":"2023-07-25T14:37:04.279657+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T15:48:18.672192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"42'2","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:04.274824+0000","last_change":"2023-07-25T14:37:02.264296+0000","last_active":"2023-07-25T14:37:04.274824+0000","last_peered":"2023-07-25T14:37:04.274824+0000","last_clean":"2023-07-25T14:37:04.274824+0000","last_became_active":"2023-07-25T14:37:02.264037+0000","last_became_peered":"2023-07-25T14:37:02.264037+0000","last_unstale":"2023-07-25T14:37:04.274824+0000","last_undegraded":"2023-07-25T14:37:04.274824+0000","last_fullsized":"2023-07-25T14:37:04.274824+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:01.239242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:01.239242+0000","last_clean_scrub_stamp":"2023-07-25T14:37:01.239242+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T14:50:53.231410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:04.280062+0000","last_change":"2023-07-25T14:37:03.270937+0000","last_active":"2023-07-25T14:37:04.280062+0000","last_peered":"2023-07-25T14:37:04.280062+0000","last_clean":"2023-07-25T14:37:04.280062+0000","last_became_active":"2023-07-25T14:37:03.270637+0000","last_became_peered":"2023-07-25T14:37:03.270637+0000","last_unstale":"2023-07-25T14:37:04.280062+0000","last_undegraded":"2023-07-25T14:37:04.280062+0000","last_fullsized":"2023-07-25T14:37:04.280062+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_clean_scrub_stamp":"2023-07-25T14:37:02.240886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T21:29:23.851980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":59,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.361606+0000","last_change":"2023-07-25T14:35:35.321055+0000","last_active":"2023-07-25T14:37:05.361606+0000","last_peered":"2023-07-25T14:37:05.361606+0000","last_clean":"2023-07-25T14:37:05.361606+0000","last_became_active":"2023-07-25T14:35:35.320739+0000","last_became_peered":"2023-07-25T14:35:35.320739+0000","last_unstale":"2023-07-25T14:37:05.361606+0000","last_undegraded":"2023-07-25T14:37:05.361606+0000","last_fullsized":"2023-07-25T14:37:05.361606+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_clean_scrub_stamp":"2023-07-25T14:35:33.358525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T20:36:33.589389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":21,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.360698+0000","last_change":"2023-07-25T14:36:49.188367+0000","last_active":"2023-07-25T14:37:05.360698+0000","last_peered":"2023-07-25T14:37:05.360698+0000","last_clean":"2023-07-25T14:37:05.360698+0000","last_became_active":"2023-07-25T14:36:49.188073+0000","last_became_peered":"2023-07-25T14:36:49.188073+0000","last_unstale":"2023-07-25T14:37:05.360698+0000","last_undegraded":"2023-07-25T14:37:05.360698+0000","last_fullsized":"2023-07-25T14:37:05.360698+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_clean_scrub_stamp":"2023-07-25T14:36:48.163149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T22:30:04.157240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:04.278811+0000","last_change":"2023-07-25T14:36:50.207719+0000","last_active":"2023-07-25T14:37:04.278811+0000","last_peered":"2023-07-25T14:37:04.278811+0000","last_clean":"2023-07-25T14:37:04.278811+0000","last_became_active":"2023-07-25T14:36:50.207251+0000","last_became_peered":"2023-07-25T14:36:50.207251+0000","last_unstale":"2023-07-25T14:37:04.278811+0000","last_undegraded":"2023-07-25T14:37:04.278811+0000","last_fullsized":"2023-07-25T14:37:04.278811+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T20:06:11.124144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"42'1","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.364430+0000","last_change":"2023-07-25T14:37:02.264296+0000","last_active":"2023-07-25T14:37:05.364430+0000","last_peered":"2023-07-25T14:37:05.364430+0000","last_clean":"2023-07-25T14:37:05.364430+0000","last_became_active":"2023-07-25T14:37:02.264037+0000","last_became_peered":"2023-07-25T14:37:02.264037+0000","last_unstale":"2023-07-25T14:37:05.364430+0000","last_undegraded":"2023-07-25T14:37:05.364430+0000","last_fullsized":"2023-07-25T14:37:05.364430+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:01.239242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:01.239242+0000","last_clean_scrub_stamp":"2023-07-25T14:37:01.239242+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T22:07:22.773074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.302824+0000","last_change":"2023-07-25T14:37:03.294626+0000","last_active":"2023-07-25T14:37:05.302824+0000","last_peered":"2023-07-25T14:37:05.302824+0000","last_clean":"2023-07-25T14:37:05.302824+0000","last_became_active":"2023-07-25T14:37:03.294122+0000","last_became_peered":"2023-07-25T14:37:03.294122+0000","last_unstale":"2023-07-25T14:37:05.302824+0000","last_undegraded":"2023-07-25T14:37:05.302824+0000","last_fullsized":"2023-07-25T14:37:05.302824+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_clean_scrub_stamp":"2023-07-25T14:37:02.240886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T21:26:59.702249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":63,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:04.279087+0000","last_change":"2023-07-25T14:35:35.321057+0000","last_active":"2023-07-25T14:37:04.279087+0000","last_peered":"2023-07-25T14:37:04.279087+0000","last_clean":"2023-07-25T14:37:04.279087+0000","last_became_active":"2023-07-25T14:35:35.320751+0000","last_became_peered":"2023-07-25T14:35:35.320751+0000","last_unstale":"2023-07-25T14:37:04.279087+0000","last_undegraded":"2023-07-25T14:37:04.279087+0000","last_fullsized":"2023-07-25T14:37:04.279087+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_clean_scrub_stamp":"2023-07-25T14:35:33.358525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T15:59:02.381912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.6","version":"39'1","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.362039+0000","last_change":"2023-07-25T14:36:49.189206+0000","last_active":"2023-07-25T14:37:05.362039+0000","last_peered":"2023-07-25T14:37:05.362039+0000","last_clean":"2023-07-25T14:37:05.362039+0000","last_became_active":"2023-07-25T14:36:49.188939+0000","last_became_peered":"2023-07-25T14:36:49.188939+0000","last_unstale":"2023-07-25T14:37:05.362039+0000","last_undegraded":"2023-07-25T14:37:05.362039+0000","last_fullsized":"2023-07-25T14:37:05.362039+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_clean_scrub_stamp":"2023-07-25T14:36:48.163149+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:18:52.217871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.361824+0000","last_change":"2023-07-25T14:36:50.211993+0000","last_active":"2023-07-25T14:37:05.361824+0000","last_peered":"2023-07-25T14:37:05.361824+0000","last_clean":"2023-07-25T14:37:05.361824+0000","last_became_active":"2023-07-25T14:36:50.211594+0000","last_became_peered":"2023-07-25T14:36:50.211594+0000","last_unstale":"2023-07-25T14:37:05.361824+0000","last_undegraded":"2023-07-25T14:37:05.361824+0000","last_fullsized":"2023-07-25T14:37:05.361824+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T21:59:41.233477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:04.278658+0000","last_change":"2023-07-25T14:37:02.263206+0000","last_active":"2023-07-25T14:37:04.278658+0000","last_peered":"2023-07-25T14:37:04.278658+0000","last_clean":"2023-07-25T14:37:04.278658+0000","last_became_active":"2023-07-25T14:37:02.262924+0000","last_became_peered":"2023-07-25T14:37:02.262924+0000","last_unstale":"2023-07-25T14:37:04.278658+0000","last_undegraded":"2023-07-25T14:37:04.278658+0000","last_fullsized":"2023-07-25T14:37:04.278658+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:01.239242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:01.239242+0000","last_clean_scrub_stamp":"2023-07-25T14:37:01.239242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T21:44:31.667717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:04.273973+0000","last_change":"2023-07-25T14:37:03.289910+0000","last_active":"2023-07-25T14:37:04.273973+0000","last_peered":"2023-07-25T14:37:04.273973+0000","last_clean":"2023-07-25T14:37:04.273973+0000","last_became_active":"2023-07-25T14:37:03.288508+0000","last_became_peered":"2023-07-25T14:37:03.288508+0000","last_unstale":"2023-07-25T14:37:04.273973+0000","last_undegraded":"2023-07-25T14:37:04.273973+0000","last_fullsized":"2023-07-25T14:37:04.273973+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_clean_scrub_stamp":"2023-07-25T14:37:02.240886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T18:17:33.408755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":59,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.301916+0000","last_change":"2023-07-25T14:35:35.321201+0000","last_active":"2023-07-25T14:37:05.301916+0000","last_peered":"2023-07-25T14:37:05.301916+0000","last_clean":"2023-07-25T14:37:05.301916+0000","last_became_active":"2023-07-25T14:35:35.320728+0000","last_became_peered":"2023-07-25T14:35:35.320728+0000","last_unstale":"2023-07-25T14:37:05.301916+0000","last_undegraded":"2023-07-25T14:37:05.301916+0000","last_fullsized":"2023-07-25T14:37:05.301916+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_clean_scrub_stamp":"2023-07-25T14:35:33.358525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:14:12.078574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"38'2","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:04.280242+0000","last_change":"2023-07-25T14:36:49.190402+0000","last_active":"2023-07-25T14:37:04.280242+0000","last_peered":"2023-07-25T14:37:04.280242+0000","last_clean":"2023-07-25T14:37:04.280242+0000","last_became_active":"2023-07-25T14:36:49.190103+0000","last_became_peered":"2023-07-25T14:36:49.190103+0000","last_unstale":"2023-07-25T14:37:04.280242+0000","last_undegraded":"2023-07-25T14:37:04.280242+0000","last_fullsized":"2023-07-25T14:37:04.280242+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_clean_scrub_stamp":"2023-07-25T14:36:48.163149+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T23:42:05.916601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:04.274936+0000","last_change":"2023-07-25T14:36:50.196768+0000","last_active":"2023-07-25T14:37:04.274936+0000","last_peered":"2023-07-25T14:37:04.274936+0000","last_clean":"2023-07-25T14:37:04.274936+0000","last_became_active":"2023-07-25T14:36:50.195596+0000","last_became_peered":"2023-07-25T14:36:50.195596+0000","last_unstale":"2023-07-25T14:37:04.274936+0000","last_undegraded":"2023-07-25T14:37:04.274936+0000","last_fullsized":"2023-07-25T14:37:04.274936+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T22:33:40.706684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.360955+0000","last_change":"2023-07-25T14:37:02.263927+0000","last_active":"2023-07-25T14:37:05.360955+0000","last_peered":"2023-07-25T14:37:05.360955+0000","last_clean":"2023-07-25T14:37:05.360955+0000","last_became_active":"2023-07-25T14:37:02.263649+0000","last_became_peered":"2023-07-25T14:37:02.263649+0000","last_unstale":"2023-07-25T14:37:05.360955+0000","last_undegraded":"2023-07-25T14:37:05.360955+0000","last_fullsized":"2023-07-25T14:37:05.360955+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:01.239242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:01.239242+0000","last_clean_scrub_stamp":"2023-07-25T14:37:01.239242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T01:44:05.128284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.362900+0000","last_change":"2023-07-25T14:37:03.300472+0000","last_active":"2023-07-25T14:37:05.362900+0000","last_peered":"2023-07-25T14:37:05.362900+0000","last_clean":"2023-07-25T14:37:05.362900+0000","last_became_active":"2023-07-25T14:37:03.300163+0000","last_became_peered":"2023-07-25T14:37:03.300163+0000","last_unstale":"2023-07-25T14:37:05.362900+0000","last_undegraded":"2023-07-25T14:37:05.362900+0000","last_fullsized":"2023-07-25T14:37:05.362900+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_clean_scrub_stamp":"2023-07-25T14:37:02.240886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T17:09:13.033871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":59,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.302362+0000","last_change":"2023-07-25T14:35:35.321448+0000","last_active":"2023-07-25T14:37:05.302362+0000","last_peered":"2023-07-25T14:37:05.302362+0000","last_clean":"2023-07-25T14:37:05.302362+0000","last_became_active":"2023-07-25T14:35:35.320830+0000","last_became_peered":"2023-07-25T14:35:35.320830+0000","last_unstale":"2023-07-25T14:37:05.302362+0000","last_undegraded":"2023-07-25T14:37:05.302362+0000","last_fullsized":"2023-07-25T14:37:05.302362+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_clean_scrub_stamp":"2023-07-25T14:35:33.358525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T16:40:24.596009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":21,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.302802+0000","last_change":"2023-07-25T14:36:49.189278+0000","last_active":"2023-07-25T14:37:05.302802+0000","last_peered":"2023-07-25T14:37:05.302802+0000","last_clean":"2023-07-25T14:37:05.302802+0000","last_became_active":"2023-07-25T14:36:49.189011+0000","last_became_peered":"2023-07-25T14:36:49.189011+0000","last_unstale":"2023-07-25T14:37:05.302802+0000","last_undegraded":"2023-07-25T14:37:05.302802+0000","last_fullsized":"2023-07-25T14:37:05.302802+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_clean_scrub_stamp":"2023-07-25T14:36:48.163149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T21:33:26.601537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:04.274321+0000","last_change":"2023-07-25T14:36:50.198441+0000","last_active":"2023-07-25T14:37:04.274321+0000","last_peered":"2023-07-25T14:37:04.274321+0000","last_clean":"2023-07-25T14:37:04.274321+0000","last_became_active":"2023-07-25T14:36:50.198177+0000","last_became_peered":"2023-07-25T14:36:50.198177+0000","last_unstale":"2023-07-25T14:37:04.274321+0000","last_undegraded":"2023-07-25T14:37:04.274321+0000","last_fullsized":"2023-07-25T14:37:04.274321+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T16:25:49.216554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"42'2","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.364082+0000","last_change":"2023-07-25T14:37:02.262457+0000","last_active":"2023-07-25T14:37:05.364082+0000","last_peered":"2023-07-25T14:37:05.364082+0000","last_clean":"2023-07-25T14:37:05.364082+0000","last_became_active":"2023-07-25T14:37:02.262178+0000","last_became_peered":"2023-07-25T14:37:02.262178+0000","last_unstale":"2023-07-25T14:37:05.364082+0000","last_undegraded":"2023-07-25T14:37:05.364082+0000","last_fullsized":"2023-07-25T14:37:05.364082+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:01.239242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:01.239242+0000","last_clean_scrub_stamp":"2023-07-25T14:37:01.239242+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T20:15:26.987028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:04.279453+0000","last_change":"2023-07-25T14:37:03.270853+0000","last_active":"2023-07-25T14:37:04.279453+0000","last_peered":"2023-07-25T14:37:04.279453+0000","last_clean":"2023-07-25T14:37:04.279453+0000","last_became_active":"2023-07-25T14:37:03.270563+0000","last_became_peered":"2023-07-25T14:37:03.270563+0000","last_unstale":"2023-07-25T14:37:04.279453+0000","last_undegraded":"2023-07-25T14:37:04.279453+0000","last_fullsized":"2023-07-25T14:37:04.279453+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_clean_scrub_stamp":"2023-07-25T14:37:02.240886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T01:01:22.310520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":209,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.301925+0000","last_change":"2023-07-25T14:35:34.372381+0000","last_active":"2023-07-25T14:37:05.301925+0000","last_peered":"2023-07-25T14:37:05.301925+0000","last_clean":"2023-07-25T14:37:05.301925+0000","last_became_active":"2023-07-25T14:35:34.371110+0000","last_became_peered":"2023-07-25T14:35:34.371110+0000","last_unstale":"2023-07-25T14:37:05.301925+0000","last_undegraded":"2023-07-25T14:37:05.301925+0000","last_fullsized":"2023-07-25T14:37:05.301925+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_clean_scrub_stamp":"2023-07-25T14:35:33.358525+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T15:57:06.749608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":57,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.360761+0000","last_change":"2023-07-25T14:35:34.370121+0000","last_active":"2023-07-25T14:37:05.360761+0000","last_peered":"2023-07-25T14:37:05.360761+0000","last_clean":"2023-07-25T14:37:05.360761+0000","last_became_active":"2023-07-25T14:35:34.369795+0000","last_became_peered":"2023-07-25T14:35:34.369795+0000","last_unstale":"2023-07-25T14:37:05.360761+0000","last_undegraded":"2023-07-25T14:37:05.360761+0000","last_fullsized":"2023-07-25T14:37:05.360761+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_clean_scrub_stamp":"2023-07-25T14:35:33.358525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T16:38:27.484494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":21,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.360360+0000","last_change":"2023-07-25T14:36:49.188513+0000","last_active":"2023-07-25T14:37:05.360360+0000","last_peered":"2023-07-25T14:37:05.360360+0000","last_clean":"2023-07-25T14:37:05.360360+0000","last_became_active":"2023-07-25T14:36:49.188212+0000","last_became_peered":"2023-07-25T14:36:49.188212+0000","last_unstale":"2023-07-25T14:37:05.360360+0000","last_undegraded":"2023-07-25T14:37:05.360360+0000","last_fullsized":"2023-07-25T14:37:05.360360+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_clean_scrub_stamp":"2023-07-25T14:36:48.163149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T16:29:47.163618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.302944+0000","last_change":"2023-07-25T14:36:50.207537+0000","last_active":"2023-07-25T14:37:05.302944+0000","last_peered":"2023-07-25T14:37:05.302944+0000","last_clean":"2023-07-25T14:37:05.302944+0000","last_became_active":"2023-07-25T14:36:50.207278+0000","last_became_peered":"2023-07-25T14:36:50.207278+0000","last_unstale":"2023-07-25T14:37:05.302944+0000","last_undegraded":"2023-07-25T14:37:05.302944+0000","last_fullsized":"2023-07-25T14:37:05.302944+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T16:25:49.216554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.360943+0000","last_change":"2023-07-25T14:37:02.266873+0000","last_active":"2023-07-25T14:37:05.360943+0000","last_peered":"2023-07-25T14:37:05.360943+0000","last_clean":"2023-07-25T14:37:05.360943+0000","last_became_active":"2023-07-25T14:37:02.266608+0000","last_became_peered":"2023-07-25T14:37:02.266608+0000","last_unstale":"2023-07-25T14:37:05.360943+0000","last_undegraded":"2023-07-25T14:37:05.360943+0000","last_fullsized":"2023-07-25T14:37:05.360943+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:01.239242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:01.239242+0000","last_clean_scrub_stamp":"2023-07-25T14:37:01.239242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T01:48:49.638469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:04.274084+0000","last_change":"2023-07-25T14:37:03.291173+0000","last_active":"2023-07-25T14:37:04.274084+0000","last_peered":"2023-07-25T14:37:04.274084+0000","last_clean":"2023-07-25T14:37:04.274084+0000","last_became_active":"2023-07-25T14:37:03.290898+0000","last_became_peered":"2023-07-25T14:37:03.290898+0000","last_unstale":"2023-07-25T14:37:04.274084+0000","last_undegraded":"2023-07-25T14:37:04.274084+0000","last_fullsized":"2023-07-25T14:37:04.274084+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_clean_scrub_stamp":"2023-07-25T14:37:02.240886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T01:12:32.894290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":59,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.363928+0000","last_change":"2023-07-25T14:35:34.371737+0000","last_active":"2023-07-25T14:37:05.363928+0000","last_peered":"2023-07-25T14:37:05.363928+0000","last_clean":"2023-07-25T14:37:05.363928+0000","last_became_active":"2023-07-25T14:35:34.371411+0000","last_became_peered":"2023-07-25T14:35:34.371411+0000","last_unstale":"2023-07-25T14:37:05.363928+0000","last_undegraded":"2023-07-25T14:37:05.363928+0000","last_fullsized":"2023-07-25T14:37:05.363928+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_clean_scrub_stamp":"2023-07-25T14:35:33.358525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T21:06:22.547601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":21,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.302158+0000","last_change":"2023-07-25T14:36:49.190255+0000","last_active":"2023-07-25T14:37:05.302158+0000","last_peered":"2023-07-25T14:37:05.302158+0000","last_clean":"2023-07-25T14:37:05.302158+0000","last_became_active":"2023-07-25T14:36:49.189883+0000","last_became_peered":"2023-07-25T14:36:49.189883+0000","last_unstale":"2023-07-25T14:37:05.302158+0000","last_undegraded":"2023-07-25T14:37:05.302158+0000","last_fullsized":"2023-07-25T14:37:05.302158+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_clean_scrub_stamp":"2023-07-25T14:36:48.163149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T19:08:17.863636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.363732+0000","last_change":"2023-07-25T14:36:50.212966+0000","last_active":"2023-07-25T14:37:05.363732+0000","last_peered":"2023-07-25T14:37:05.363732+0000","last_clean":"2023-07-25T14:37:05.363732+0000","last_became_active":"2023-07-25T14:36:50.212728+0000","last_became_peered":"2023-07-25T14:36:50.212728+0000","last_unstale":"2023-07-25T14:37:05.363732+0000","last_undegraded":"2023-07-25T14:37:05.363732+0000","last_fullsized":"2023-07-25T14:37:05.363732+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T19:31:57.062482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"42'1","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:04.279226+0000","last_change":"2023-07-25T14:37:02.264758+0000","last_active":"2023-07-25T14:37:04.279226+0000","last_peered":"2023-07-25T14:37:04.279226+0000","last_clean":"2023-07-25T14:37:04.279226+0000","last_became_active":"2023-07-25T14:37:02.264376+0000","last_became_peered":"2023-07-25T14:37:02.264376+0000","last_unstale":"2023-07-25T14:37:04.279226+0000","last_undegraded":"2023-07-25T14:37:04.279226+0000","last_fullsized":"2023-07-25T14:37:04.279226+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:01.239242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:01.239242+0000","last_clean_scrub_stamp":"2023-07-25T14:37:01.239242+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T01:46:02.706625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.363863+0000","last_change":"2023-07-25T14:37:03.294988+0000","last_active":"2023-07-25T14:37:05.363863+0000","last_peered":"2023-07-25T14:37:05.363863+0000","last_clean":"2023-07-25T14:37:05.363863+0000","last_became_active":"2023-07-25T14:37:03.294679+0000","last_became_peered":"2023-07-25T14:37:03.294679+0000","last_unstale":"2023-07-25T14:37:05.363863+0000","last_undegraded":"2023-07-25T14:37:05.363863+0000","last_fullsized":"2023-07-25T14:37:05.363863+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_clean_scrub_stamp":"2023-07-25T14:37:02.240886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T18:09:05.593042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":61,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:04.280019+0000","last_change":"2023-07-25T14:35:34.371347+0000","last_active":"2023-07-25T14:37:04.280019+0000","last_peered":"2023-07-25T14:37:04.280019+0000","last_clean":"2023-07-25T14:37:04.280019+0000","last_became_active":"2023-07-25T14:35:34.371044+0000","last_became_peered":"2023-07-25T14:35:34.371044+0000","last_unstale":"2023-07-25T14:37:04.280019+0000","last_undegraded":"2023-07-25T14:37:04.280019+0000","last_fullsized":"2023-07-25T14:37:04.280019+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_clean_scrub_stamp":"2023-07-25T14:35:33.358525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T15:56:26.027680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":21,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:04.279970+0000","last_change":"2023-07-25T14:36:49.191235+0000","last_active":"2023-07-25T14:37:04.279970+0000","last_peered":"2023-07-25T14:37:04.279970+0000","last_clean":"2023-07-25T14:37:04.279970+0000","last_became_active":"2023-07-25T14:36:49.190894+0000","last_became_peered":"2023-07-25T14:36:49.190894+0000","last_unstale":"2023-07-25T14:37:04.279970+0000","last_undegraded":"2023-07-25T14:37:04.279970+0000","last_fullsized":"2023-07-25T14:37:04.279970+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_clean_scrub_stamp":"2023-07-25T14:36:48.163149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:10:17.458141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.364630+0000","last_change":"2023-07-25T14:36:50.194211+0000","last_active":"2023-07-25T14:37:05.364630+0000","last_peered":"2023-07-25T14:37:05.364630+0000","last_clean":"2023-07-25T14:37:05.364630+0000","last_became_active":"2023-07-25T14:36:50.193907+0000","last_became_peered":"2023-07-25T14:36:50.193907+0000","last_unstale":"2023-07-25T14:37:05.364630+0000","last_undegraded":"2023-07-25T14:37:05.364630+0000","last_fullsized":"2023-07-25T14:37:05.364630+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T18:30:23.936686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:04.274181+0000","last_change":"2023-07-25T14:37:02.263340+0000","last_active":"2023-07-25T14:37:04.274181+0000","last_peered":"2023-07-25T14:37:04.274181+0000","last_clean":"2023-07-25T14:37:04.274181+0000","last_became_active":"2023-07-25T14:37:02.263103+0000","last_became_peered":"2023-07-25T14:37:02.263103+0000","last_unstale":"2023-07-25T14:37:04.274181+0000","last_undegraded":"2023-07-25T14:37:04.274181+0000","last_fullsized":"2023-07-25T14:37:04.274181+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:01.239242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:01.239242+0000","last_clean_scrub_stamp":"2023-07-25T14:37:01.239242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T16:24:25.274560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.302803+0000","last_change":"2023-07-25T14:37:03.297190+0000","last_active":"2023-07-25T14:37:05.302803+0000","last_peered":"2023-07-25T14:37:05.302803+0000","last_clean":"2023-07-25T14:37:05.302803+0000","last_became_active":"2023-07-25T14:37:03.296923+0000","last_became_peered":"2023-07-25T14:37:03.296923+0000","last_unstale":"2023-07-25T14:37:05.302803+0000","last_undegraded":"2023-07-25T14:37:05.302803+0000","last_fullsized":"2023-07-25T14:37:05.302803+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_clean_scrub_stamp":"2023-07-25T14:37:02.240886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T15:08:57.831744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":21,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.302203+0000","last_change":"2023-07-25T14:36:49.189655+0000","last_active":"2023-07-25T14:37:05.302203+0000","last_peered":"2023-07-25T14:37:05.302203+0000","last_clean":"2023-07-25T14:37:05.302203+0000","last_became_active":"2023-07-25T14:36:49.189391+0000","last_became_peered":"2023-07-25T14:36:49.189391+0000","last_unstale":"2023-07-25T14:37:05.302203+0000","last_undegraded":"2023-07-25T14:37:05.302203+0000","last_fullsized":"2023-07-25T14:37:05.302203+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_clean_scrub_stamp":"2023-07-25T14:36:48.163149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T22:20:37.731525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:04.273835+0000","last_change":"2023-07-25T14:36:50.206937+0000","last_active":"2023-07-25T14:37:04.273835+0000","last_peered":"2023-07-25T14:37:04.273835+0000","last_clean":"2023-07-25T14:37:04.273835+0000","last_became_active":"2023-07-25T14:36:50.206661+0000","last_became_peered":"2023-07-25T14:36:50.206661+0000","last_unstale":"2023-07-25T14:37:04.273835+0000","last_undegraded":"2023-07-25T14:37:04.273835+0000","last_fullsized":"2023-07-25T14:37:04.273835+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T19:08:18.867578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:04.274533+0000","last_change":"2023-07-25T14:37:02.259224+0000","last_active":"2023-07-25T14:37:04.274533+0000","last_peered":"2023-07-25T14:37:04.274533+0000","last_clean":"2023-07-25T14:37:04.274533+0000","last_became_active":"2023-07-25T14:37:02.258954+0000","last_became_peered":"2023-07-25T14:37:02.258954+0000","last_unstale":"2023-07-25T14:37:04.274533+0000","last_undegraded":"2023-07-25T14:37:04.274533+0000","last_fullsized":"2023-07-25T14:37:04.274533+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:01.239242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:01.239242+0000","last_clean_scrub_stamp":"2023-07-25T14:37:01.239242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T01:31:19.042176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:04.279885+0000","last_change":"2023-07-25T14:37:03.288156+0000","last_active":"2023-07-25T14:37:04.279885+0000","last_peered":"2023-07-25T14:37:04.279885+0000","last_clean":"2023-07-25T14:37:04.279885+0000","last_became_active":"2023-07-25T14:37:03.287876+0000","last_became_peered":"2023-07-25T14:37:03.287876+0000","last_unstale":"2023-07-25T14:37:04.279885+0000","last_undegraded":"2023-07-25T14:37:04.279885+0000","last_fullsized":"2023-07-25T14:37:04.279885+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_clean_scrub_stamp":"2023-07-25T14:37:02.240886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T02:07:22.015256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":21,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:04.273703+0000","last_change":"2023-07-25T14:36:49.189641+0000","last_active":"2023-07-25T14:37:04.273703+0000","last_peered":"2023-07-25T14:37:04.273703+0000","last_clean":"2023-07-25T14:37:04.273703+0000","last_became_active":"2023-07-25T14:36:49.189365+0000","last_became_peered":"2023-07-25T14:36:49.189365+0000","last_unstale":"2023-07-25T14:37:04.273703+0000","last_undegraded":"2023-07-25T14:37:04.273703+0000","last_fullsized":"2023-07-25T14:37:04.273703+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_clean_scrub_stamp":"2023-07-25T14:36:48.163149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:05:42.947016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.360966+0000","last_change":"2023-07-25T14:36:50.198991+0000","last_active":"2023-07-25T14:37:05.360966+0000","last_peered":"2023-07-25T14:37:05.360966+0000","last_clean":"2023-07-25T14:37:05.360966+0000","last_became_active":"2023-07-25T14:36:50.198737+0000","last_became_peered":"2023-07-25T14:36:50.198737+0000","last_unstale":"2023-07-25T14:37:05.360966+0000","last_undegraded":"2023-07-25T14:37:05.360966+0000","last_fullsized":"2023-07-25T14:37:05.360966+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T20:34:40.704873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"42'2","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.363436+0000","last_change":"2023-07-25T14:37:02.269206+0000","last_active":"2023-07-25T14:37:05.363436+0000","last_peered":"2023-07-25T14:37:05.363436+0000","last_clean":"2023-07-25T14:37:05.363436+0000","last_became_active":"2023-07-25T14:37:02.269016+0000","last_became_peered":"2023-07-25T14:37:02.269016+0000","last_unstale":"2023-07-25T14:37:05.363436+0000","last_undegraded":"2023-07-25T14:37:05.363436+0000","last_fullsized":"2023-07-25T14:37:05.363436+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:01.239242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:01.239242+0000","last_clean_scrub_stamp":"2023-07-25T14:37:01.239242+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T01:44:05.128284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:04.279977+0000","last_change":"2023-07-25T14:37:03.284921+0000","last_active":"2023-07-25T14:37:04.279977+0000","last_peered":"2023-07-25T14:37:04.279977+0000","last_clean":"2023-07-25T14:37:04.279977+0000","last_became_active":"2023-07-25T14:37:03.284565+0000","last_became_peered":"2023-07-25T14:37:03.284565+0000","last_unstale":"2023-07-25T14:37:04.279977+0000","last_undegraded":"2023-07-25T14:37:04.279977+0000","last_fullsized":"2023-07-25T14:37:04.279977+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_clean_scrub_stamp":"2023-07-25T14:37:02.240886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:35:39.918684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":21,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:04.279618+0000","last_change":"2023-07-25T14:36:49.182153+0000","last_active":"2023-07-25T14:37:04.279618+0000","last_peered":"2023-07-25T14:37:04.279618+0000","last_clean":"2023-07-25T14:37:04.279618+0000","last_became_active":"2023-07-25T14:36:49.181886+0000","last_became_peered":"2023-07-25T14:36:49.181886+0000","last_unstale":"2023-07-25T14:37:04.279618+0000","last_undegraded":"2023-07-25T14:37:04.279618+0000","last_fullsized":"2023-07-25T14:37:04.279618+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_clean_scrub_stamp":"2023-07-25T14:36:48.163149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:25:47.581521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.360664+0000","last_change":"2023-07-25T14:36:50.203783+0000","last_active":"2023-07-25T14:37:05.360664+0000","last_peered":"2023-07-25T14:37:05.360664+0000","last_clean":"2023-07-25T14:37:05.360664+0000","last_became_active":"2023-07-25T14:36:50.203485+0000","last_became_peered":"2023-07-25T14:36:50.203485+0000","last_unstale":"2023-07-25T14:37:05.360664+0000","last_undegraded":"2023-07-25T14:37:05.360664+0000","last_fullsized":"2023-07-25T14:37:05.360664+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T01:49:00.736541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:04.279158+0000","last_change":"2023-07-25T14:37:02.263008+0000","last_active":"2023-07-25T14:37:04.279158+0000","last_peered":"2023-07-25T14:37:04.279158+0000","last_clean":"2023-07-25T14:37:04.279158+0000","last_became_active":"2023-07-25T14:37:02.262734+0000","last_became_peered":"2023-07-25T14:37:02.262734+0000","last_unstale":"2023-07-25T14:37:04.279158+0000","last_undegraded":"2023-07-25T14:37:04.279158+0000","last_fullsized":"2023-07-25T14:37:04.279158+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:01.239242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:01.239242+0000","last_clean_scrub_stamp":"2023-07-25T14:37:01.239242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T15:00:18.647656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:04.274214+0000","last_change":"2023-07-25T14:37:03.289930+0000","last_active":"2023-07-25T14:37:04.274214+0000","last_peered":"2023-07-25T14:37:04.274214+0000","last_clean":"2023-07-25T14:37:04.274214+0000","last_became_active":"2023-07-25T14:37:03.288162+0000","last_became_peered":"2023-07-25T14:37:03.288162+0000","last_unstale":"2023-07-25T14:37:04.274214+0000","last_undegraded":"2023-07-25T14:37:04.274214+0000","last_fullsized":"2023-07-25T14:37:04.274214+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_clean_scrub_stamp":"2023-07-25T14:37:02.240886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T19:04:38.768708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"38'2","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.364715+0000","last_change":"2023-07-25T14:36:49.192944+0000","last_active":"2023-07-25T14:37:05.364715+0000","last_peered":"2023-07-25T14:37:05.364715+0000","last_clean":"2023-07-25T14:37:05.364715+0000","last_became_active":"2023-07-25T14:36:49.191983+0000","last_became_peered":"2023-07-25T14:36:49.191983+0000","last_unstale":"2023-07-25T14:37:05.364715+0000","last_undegraded":"2023-07-25T14:37:05.364715+0000","last_fullsized":"2023-07-25T14:37:05.364715+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_clean_scrub_stamp":"2023-07-25T14:36:48.163149+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T19:42:35.645756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.364096+0000","last_change":"2023-07-25T14:36:50.199234+0000","last_active":"2023-07-25T14:37:05.364096+0000","last_peered":"2023-07-25T14:37:05.364096+0000","last_clean":"2023-07-25T14:37:05.364096+0000","last_became_active":"2023-07-25T14:36:50.198957+0000","last_became_peered":"2023-07-25T14:36:50.198957+0000","last_unstale":"2023-07-25T14:37:05.364096+0000","last_undegraded":"2023-07-25T14:37:05.364096+0000","last_fullsized":"2023-07-25T14:37:05.364096+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T19:35:01.012822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.361710+0000","last_change":"2023-07-25T14:37:02.258175+0000","last_active":"2023-07-25T14:37:05.361710+0000","last_peered":"2023-07-25T14:37:05.361710+0000","last_clean":"2023-07-25T14:37:05.361710+0000","last_became_active":"2023-07-25T14:37:02.257876+0000","last_became_peered":"2023-07-25T14:37:02.257876+0000","last_unstale":"2023-07-25T14:37:05.361710+0000","last_undegraded":"2023-07-25T14:37:05.361710+0000","last_fullsized":"2023-07-25T14:37:05.361710+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:01.239242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:01.239242+0000","last_clean_scrub_stamp":"2023-07-25T14:37:01.239242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T02:36:01.886737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.361092+0000","last_change":"2023-07-25T14:37:03.282790+0000","last_active":"2023-07-25T14:37:05.361092+0000","last_peered":"2023-07-25T14:37:05.361092+0000","last_clean":"2023-07-25T14:37:05.361092+0000","last_became_active":"2023-07-25T14:37:03.282098+0000","last_became_peered":"2023-07-25T14:37:03.282098+0000","last_unstale":"2023-07-25T14:37:05.361092+0000","last_undegraded":"2023-07-25T14:37:05.361092+0000","last_fullsized":"2023-07-25T14:37:05.361092+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_clean_scrub_stamp":"2023-07-25T14:37:02.240886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T02:13:05.864447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":21,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.363799+0000","last_change":"2023-07-25T14:36:49.189168+0000","last_active":"2023-07-25T14:37:05.363799+0000","last_peered":"2023-07-25T14:37:05.363799+0000","last_clean":"2023-07-25T14:37:05.363799+0000","last_became_active":"2023-07-25T14:36:49.188894+0000","last_became_peered":"2023-07-25T14:36:49.188894+0000","last_unstale":"2023-07-25T14:37:05.363799+0000","last_undegraded":"2023-07-25T14:37:05.363799+0000","last_fullsized":"2023-07-25T14:37:05.363799+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_clean_scrub_stamp":"2023-07-25T14:36:48.163149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T19:35:32.519083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.361359+0000","last_change":"2023-07-25T14:36:50.208734+0000","last_active":"2023-07-25T14:37:05.361359+0000","last_peered":"2023-07-25T14:37:05.361359+0000","last_clean":"2023-07-25T14:37:05.361359+0000","last_became_active":"2023-07-25T14:36:50.208472+0000","last_became_peered":"2023-07-25T14:36:50.208472+0000","last_unstale":"2023-07-25T14:37:05.361359+0000","last_undegraded":"2023-07-25T14:37:05.361359+0000","last_fullsized":"2023-07-25T14:37:05.361359+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T19:26:52.681755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:04.279443+0000","last_change":"2023-07-25T14:37:02.262204+0000","last_active":"2023-07-25T14:37:04.279443+0000","last_peered":"2023-07-25T14:37:04.279443+0000","last_clean":"2023-07-25T14:37:04.279443+0000","last_became_active":"2023-07-25T14:37:02.261930+0000","last_became_peered":"2023-07-25T14:37:02.261930+0000","last_unstale":"2023-07-25T14:37:04.279443+0000","last_undegraded":"2023-07-25T14:37:04.279443+0000","last_fullsized":"2023-07-25T14:37:04.279443+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:01.239242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:01.239242+0000","last_clean_scrub_stamp":"2023-07-25T14:37:01.239242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T23:18:02.200413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.302573+0000","last_change":"2023-07-25T14:37:03.301201+0000","last_active":"2023-07-25T14:37:05.302573+0000","last_peered":"2023-07-25T14:37:05.302573+0000","last_clean":"2023-07-25T14:37:05.302573+0000","last_became_active":"2023-07-25T14:37:03.300897+0000","last_became_peered":"2023-07-25T14:37:03.300897+0000","last_unstale":"2023-07-25T14:37:05.302573+0000","last_undegraded":"2023-07-25T14:37:05.302573+0000","last_fullsized":"2023-07-25T14:37:05.302573+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_clean_scrub_stamp":"2023-07-25T14:37:02.240886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T19:04:38.768708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.d","version":"38'1","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:04.280313+0000","last_change":"2023-07-25T14:36:49.188916+0000","last_active":"2023-07-25T14:37:04.280313+0000","last_peered":"2023-07-25T14:37:04.280313+0000","last_clean":"2023-07-25T14:37:04.280313+0000","last_became_active":"2023-07-25T14:36:49.188691+0000","last_became_peered":"2023-07-25T14:36:49.188691+0000","last_unstale":"2023-07-25T14:37:04.280313+0000","last_undegraded":"2023-07-25T14:37:04.280313+0000","last_fullsized":"2023-07-25T14:37:04.280313+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_clean_scrub_stamp":"2023-07-25T14:36:48.163149+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T23:32:05.986662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.361371+0000","last_change":"2023-07-25T14:36:50.212960+0000","last_active":"2023-07-25T14:37:05.361371+0000","last_peered":"2023-07-25T14:37:05.361371+0000","last_clean":"2023-07-25T14:37:05.361371+0000","last_became_active":"2023-07-25T14:36:50.212690+0000","last_became_peered":"2023-07-25T14:36:50.212690+0000","last_unstale":"2023-07-25T14:37:05.361371+0000","last_undegraded":"2023-07-25T14:37:05.361371+0000","last_fullsized":"2023-07-25T14:37:05.361371+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T22:28:25.884312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.360370+0000","last_change":"2023-07-25T14:37:02.268733+0000","last_active":"2023-07-25T14:37:05.360370+0000","last_peered":"2023-07-25T14:37:05.360370+0000","last_clean":"2023-07-25T14:37:05.360370+0000","last_became_active":"2023-07-25T14:37:02.268544+0000","last_became_peered":"2023-07-25T14:37:02.268544+0000","last_unstale":"2023-07-25T14:37:05.360370+0000","last_undegraded":"2023-07-25T14:37:05.360370+0000","last_fullsized":"2023-07-25T14:37:05.360370+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:01.239242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:01.239242+0000","last_clean_scrub_stamp":"2023-07-25T14:37:01.239242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T18:09:13.146391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.363642+0000","last_change":"2023-07-25T14:37:03.295153+0000","last_active":"2023-07-25T14:37:05.363642+0000","last_peered":"2023-07-25T14:37:05.363642+0000","last_clean":"2023-07-25T14:37:05.363642+0000","last_became_active":"2023-07-25T14:37:03.294913+0000","last_became_peered":"2023-07-25T14:37:03.294913+0000","last_unstale":"2023-07-25T14:37:05.363642+0000","last_undegraded":"2023-07-25T14:37:05.363642+0000","last_fullsized":"2023-07-25T14:37:05.363642+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_clean_scrub_stamp":"2023-07-25T14:37:02.240886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T23:37:58.636048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.e","version":"38'2","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:04.279417+0000","last_change":"2023-07-25T14:36:49.188196+0000","last_active":"2023-07-25T14:37:04.279417+0000","last_peered":"2023-07-25T14:37:04.279417+0000","last_clean":"2023-07-25T14:37:04.279417+0000","last_became_active":"2023-07-25T14:36:49.187926+0000","last_became_peered":"2023-07-25T14:36:49.187926+0000","last_unstale":"2023-07-25T14:37:04.279417+0000","last_undegraded":"2023-07-25T14:37:04.279417+0000","last_fullsized":"2023-07-25T14:37:04.279417+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_clean_scrub_stamp":"2023-07-25T14:36:48.163149+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T22:51:40.109837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:04.274717+0000","last_change":"2023-07-25T14:36:50.196466+0000","last_active":"2023-07-25T14:37:04.274717+0000","last_peered":"2023-07-25T14:37:04.274717+0000","last_clean":"2023-07-25T14:37:04.274717+0000","last_became_active":"2023-07-25T14:36:50.196192+0000","last_became_peered":"2023-07-25T14:36:50.196192+0000","last_unstale":"2023-07-25T14:37:04.274717+0000","last_undegraded":"2023-07-25T14:37:04.274717+0000","last_fullsized":"2023-07-25T14:37:04.274717+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T17:39:24.380477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.362744+0000","last_change":"2023-07-25T14:37:02.262617+0000","last_active":"2023-07-25T14:37:05.362744+0000","last_peered":"2023-07-25T14:37:05.362744+0000","last_clean":"2023-07-25T14:37:05.362744+0000","last_became_active":"2023-07-25T14:37:02.262334+0000","last_became_peered":"2023-07-25T14:37:02.262334+0000","last_unstale":"2023-07-25T14:37:05.362744+0000","last_undegraded":"2023-07-25T14:37:05.362744+0000","last_fullsized":"2023-07-25T14:37:05.362744+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:01.239242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:01.239242+0000","last_clean_scrub_stamp":"2023-07-25T14:37:01.239242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T18:38:25.515724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.362662+0000","last_change":"2023-07-25T14:37:03.291262+0000","last_active":"2023-07-25T14:37:05.362662+0000","last_peered":"2023-07-25T14:37:05.362662+0000","last_clean":"2023-07-25T14:37:05.362662+0000","last_became_active":"2023-07-25T14:37:03.290896+0000","last_became_peered":"2023-07-25T14:37:03.290896+0000","last_unstale":"2023-07-25T14:37:05.362662+0000","last_undegraded":"2023-07-25T14:37:05.362662+0000","last_fullsized":"2023-07-25T14:37:05.362662+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_clean_scrub_stamp":"2023-07-25T14:37:02.240886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T02:29:28.163022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.f","version":"38'1","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.361961+0000","last_change":"2023-07-25T14:36:49.191240+0000","last_active":"2023-07-25T14:37:05.361961+0000","last_peered":"2023-07-25T14:37:05.361961+0000","last_clean":"2023-07-25T14:37:05.361961+0000","last_became_active":"2023-07-25T14:36:49.190922+0000","last_became_peered":"2023-07-25T14:36:49.190922+0000","last_unstale":"2023-07-25T14:37:05.361961+0000","last_undegraded":"2023-07-25T14:37:05.361961+0000","last_fullsized":"2023-07-25T14:37:05.361961+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_clean_scrub_stamp":"2023-07-25T14:36:48.163149+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T22:15:36.940298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.362208+0000","last_change":"2023-07-25T14:36:50.197939+0000","last_active":"2023-07-25T14:37:05.362208+0000","last_peered":"2023-07-25T14:37:05.362208+0000","last_clean":"2023-07-25T14:37:05.362208+0000","last_became_active":"2023-07-25T14:36:50.197093+0000","last_became_peered":"2023-07-25T14:36:50.197093+0000","last_unstale":"2023-07-25T14:37:05.362208+0000","last_undegraded":"2023-07-25T14:37:05.362208+0000","last_fullsized":"2023-07-25T14:37:05.362208+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T23:55:04.578607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.360411+0000","last_change":"2023-07-25T14:37:02.272353+0000","last_active":"2023-07-25T14:37:05.360411+0000","last_peered":"2023-07-25T14:37:05.360411+0000","last_clean":"2023-07-25T14:37:05.360411+0000","last_became_active":"2023-07-25T14:37:02.272062+0000","last_became_peered":"2023-07-25T14:37:02.272062+0000","last_unstale":"2023-07-25T14:37:05.360411+0000","last_undegraded":"2023-07-25T14:37:05.360411+0000","last_fullsized":"2023-07-25T14:37:05.360411+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:01.239242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:01.239242+0000","last_clean_scrub_stamp":"2023-07-25T14:37:01.239242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T16:06:47.397497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.360323+0000","last_change":"2023-07-25T14:37:03.274827+0000","last_active":"2023-07-25T14:37:05.360323+0000","last_peered":"2023-07-25T14:37:05.360323+0000","last_clean":"2023-07-25T14:37:05.360323+0000","last_became_active":"2023-07-25T14:37:03.274583+0000","last_became_peered":"2023-07-25T14:37:03.274583+0000","last_unstale":"2023-07-25T14:37:05.360323+0000","last_undegraded":"2023-07-25T14:37:05.360323+0000","last_fullsized":"2023-07-25T14:37:05.360323+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_clean_scrub_stamp":"2023-07-25T14:37:02.240886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T17:08:02.249764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.363579+0000","last_change":"2023-07-25T14:37:03.290483+0000","last_active":"2023-07-25T14:37:05.363579+0000","last_peered":"2023-07-25T14:37:05.363579+0000","last_clean":"2023-07-25T14:37:05.363579+0000","last_became_active":"2023-07-25T14:37:03.290165+0000","last_became_peered":"2023-07-25T14:37:03.290165+0000","last_unstale":"2023-07-25T14:37:05.363579+0000","last_undegraded":"2023-07-25T14:37:05.363579+0000","last_fullsized":"2023-07-25T14:37:05.363579+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_clean_scrub_stamp":"2023-07-25T14:37:02.240886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T21:27:56.546539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.10","version":"38'8","reported_seq":29,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:04.273794+0000","last_change":"2023-07-25T14:36:49.187460+0000","last_active":"2023-07-25T14:37:04.273794+0000","last_peered":"2023-07-25T14:37:04.273794+0000","last_clean":"2023-07-25T14:37:04.273794+0000","last_became_active":"2023-07-25T14:36:49.187132+0000","last_became_peered":"2023-07-25T14:36:49.187132+0000","last_unstale":"2023-07-25T14:37:04.273794+0000","last_undegraded":"2023-07-25T14:37:04.273794+0000","last_fullsized":"2023-07-25T14:37:04.273794+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_clean_scrub_stamp":"2023-07-25T14:36:48.163149+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T02:36:05.441856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.302146+0000","last_change":"2023-07-25T14:36:50.207141+0000","last_active":"2023-07-25T14:37:05.302146+0000","last_peered":"2023-07-25T14:37:05.302146+0000","last_clean":"2023-07-25T14:37:05.302146+0000","last_became_active":"2023-07-25T14:36:50.206727+0000","last_became_peered":"2023-07-25T14:36:50.206727+0000","last_unstale":"2023-07-25T14:37:05.302146+0000","last_undegraded":"2023-07-25T14:37:05.302146+0000","last_fullsized":"2023-07-25T14:37:05.302146+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T02:36:06.445799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1e","version":"42'1","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.364217+0000","last_change":"2023-07-25T14:37:02.260579+0000","last_active":"2023-07-25T14:37:05.364217+0000","last_peered":"2023-07-25T14:37:05.364217+0000","last_clean":"2023-07-25T14:37:05.364217+0000","last_became_active":"2023-07-25T14:37:02.260287+0000","last_became_peered":"2023-07-25T14:37:02.260287+0000","last_unstale":"2023-07-25T14:37:05.364217+0000","last_undegraded":"2023-07-25T14:37:05.364217+0000","last_fullsized":"2023-07-25T14:37:05.364217+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:01.239242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:01.239242+0000","last_clean_scrub_stamp":"2023-07-25T14:37:01.239242+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T02:10:31.233482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:04.274765+0000","last_change":"2023-07-25T14:37:03.298021+0000","last_active":"2023-07-25T14:37:04.274765+0000","last_peered":"2023-07-25T14:37:04.274765+0000","last_clean":"2023-07-25T14:37:04.274765+0000","last_became_active":"2023-07-25T14:37:03.297694+0000","last_became_peered":"2023-07-25T14:37:03.297694+0000","last_unstale":"2023-07-25T14:37:04.274765+0000","last_undegraded":"2023-07-25T14:37:04.274765+0000","last_fullsized":"2023-07-25T14:37:04.274765+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_clean_scrub_stamp":"2023-07-25T14:37:02.240886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T21:12:20.389396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":21,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.361986+0000","last_change":"2023-07-25T14:36:49.191960+0000","last_active":"2023-07-25T14:37:05.361986+0000","last_peered":"2023-07-25T14:37:05.361986+0000","last_clean":"2023-07-25T14:37:05.361986+0000","last_became_active":"2023-07-25T14:36:49.191688+0000","last_became_peered":"2023-07-25T14:36:49.191688+0000","last_unstale":"2023-07-25T14:37:05.361986+0000","last_undegraded":"2023-07-25T14:37:05.361986+0000","last_fullsized":"2023-07-25T14:37:05.361986+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_clean_scrub_stamp":"2023-07-25T14:36:48.163149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T18:26:02.773663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.362715+0000","last_change":"2023-07-25T14:36:50.199005+0000","last_active":"2023-07-25T14:37:05.362715+0000","last_peered":"2023-07-25T14:37:05.362715+0000","last_clean":"2023-07-25T14:37:05.362715+0000","last_became_active":"2023-07-25T14:36:50.198743+0000","last_became_peered":"2023-07-25T14:36:50.198743+0000","last_unstale":"2023-07-25T14:37:05.362715+0000","last_undegraded":"2023-07-25T14:37:05.362715+0000","last_fullsized":"2023-07-25T14:37:05.362715+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T19:31:40.714411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1f","version":"42'4","reported_seq":17,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:04.274556+0000","last_change":"2023-07-25T14:37:02.262747+0000","last_active":"2023-07-25T14:37:04.274556+0000","last_peered":"2023-07-25T14:37:04.274556+0000","last_clean":"2023-07-25T14:37:04.274556+0000","last_became_active":"2023-07-25T14:37:02.262450+0000","last_became_peered":"2023-07-25T14:37:02.262450+0000","last_unstale":"2023-07-25T14:37:04.274556+0000","last_undegraded":"2023-07-25T14:37:04.274556+0000","last_fullsized":"2023-07-25T14:37:04.274556+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:01.239242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:01.239242+0000","last_clean_scrub_stamp":"2023-07-25T14:37:01.239242+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T01:04:23.895896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:04.274433+0000","last_change":"2023-07-25T14:37:03.288809+0000","last_active":"2023-07-25T14:37:04.274433+0000","last_peered":"2023-07-25T14:37:04.274433+0000","last_clean":"2023-07-25T14:37:04.274433+0000","last_became_active":"2023-07-25T14:37:03.288509+0000","last_became_peered":"2023-07-25T14:37:03.288509+0000","last_unstale":"2023-07-25T14:37:04.274433+0000","last_undegraded":"2023-07-25T14:37:04.274433+0000","last_fullsized":"2023-07-25T14:37:04.274433+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_clean_scrub_stamp":"2023-07-25T14:37:02.240886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T16:09:07.074027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":21,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.302437+0000","last_change":"2023-07-25T14:36:49.188746+0000","last_active":"2023-07-25T14:37:05.302437+0000","last_peered":"2023-07-25T14:37:05.302437+0000","last_clean":"2023-07-25T14:37:05.302437+0000","last_became_active":"2023-07-25T14:36:49.188445+0000","last_became_peered":"2023-07-25T14:36:49.188445+0000","last_unstale":"2023-07-25T14:37:05.302437+0000","last_undegraded":"2023-07-25T14:37:05.302437+0000","last_fullsized":"2023-07-25T14:37:05.302437+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_clean_scrub_stamp":"2023-07-25T14:36:48.163149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:14:07.408815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:04.274202+0000","last_change":"2023-07-25T14:36:50.196519+0000","last_active":"2023-07-25T14:37:04.274202+0000","last_peered":"2023-07-25T14:37:04.274202+0000","last_clean":"2023-07-25T14:37:04.274202+0000","last_became_active":"2023-07-25T14:36:50.196242+0000","last_became_peered":"2023-07-25T14:36:50.196242+0000","last_unstale":"2023-07-25T14:37:04.274202+0000","last_undegraded":"2023-07-25T14:37:04.274202+0000","last_fullsized":"2023-07-25T14:37:04.274202+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T15:08:44.757950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"42'2","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:04.279310+0000","last_change":"2023-07-25T14:37:02.264592+0000","last_active":"2023-07-25T14:37:04.279310+0000","last_peered":"2023-07-25T14:37:04.279310+0000","last_clean":"2023-07-25T14:37:04.279310+0000","last_became_active":"2023-07-25T14:37:02.264302+0000","last_became_peered":"2023-07-25T14:37:02.264302+0000","last_unstale":"2023-07-25T14:37:04.279310+0000","last_undegraded":"2023-07-25T14:37:04.279310+0000","last_fullsized":"2023-07-25T14:37:04.279310+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:01.239242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:01.239242+0000","last_clean_scrub_stamp":"2023-07-25T14:37:01.239242+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T17:30:00.968965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.13","version":"38'2","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.361988+0000","last_change":"2023-07-25T14:36:49.193327+0000","last_active":"2023-07-25T14:37:05.361988+0000","last_peered":"2023-07-25T14:37:05.361988+0000","last_clean":"2023-07-25T14:37:05.361988+0000","last_became_active":"2023-07-25T14:36:49.192656+0000","last_became_peered":"2023-07-25T14:36:49.192656+0000","last_unstale":"2023-07-25T14:37:05.361988+0000","last_undegraded":"2023-07-25T14:37:05.361988+0000","last_fullsized":"2023-07-25T14:37:05.361988+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_clean_scrub_stamp":"2023-07-25T14:36:48.163149+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:19:48.189807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.361192+0000","last_change":"2023-07-25T14:36:50.211789+0000","last_active":"2023-07-25T14:37:05.361192+0000","last_peered":"2023-07-25T14:37:05.361192+0000","last_clean":"2023-07-25T14:37:05.361192+0000","last_became_active":"2023-07-25T14:36:50.211520+0000","last_became_peered":"2023-07-25T14:36:50.211520+0000","last_unstale":"2023-07-25T14:37:05.361192+0000","last_undegraded":"2023-07-25T14:37:05.361192+0000","last_fullsized":"2023-07-25T14:37:05.361192+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T19:49:25.615797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1d","version":"42'2","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:04.274302+0000","last_change":"2023-07-25T14:37:02.269473+0000","last_active":"2023-07-25T14:37:04.274302+0000","last_peered":"2023-07-25T14:37:04.274302+0000","last_clean":"2023-07-25T14:37:04.274302+0000","last_became_active":"2023-07-25T14:37:02.269146+0000","last_became_peered":"2023-07-25T14:37:02.269146+0000","last_unstale":"2023-07-25T14:37:04.274302+0000","last_undegraded":"2023-07-25T14:37:04.274302+0000","last_fullsized":"2023-07-25T14:37:04.274302+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:01.239242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:01.239242+0000","last_clean_scrub_stamp":"2023-07-25T14:37:01.239242+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T19:25:36.378383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:04.274224+0000","last_change":"2023-07-25T14:37:03.297654+0000","last_active":"2023-07-25T14:37:04.274224+0000","last_peered":"2023-07-25T14:37:04.274224+0000","last_clean":"2023-07-25T14:37:04.274224+0000","last_became_active":"2023-07-25T14:37:03.293780+0000","last_became_peered":"2023-07-25T14:37:03.293780+0000","last_unstale":"2023-07-25T14:37:04.274224+0000","last_undegraded":"2023-07-25T14:37:04.274224+0000","last_fullsized":"2023-07-25T14:37:04.274224+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_clean_scrub_stamp":"2023-07-25T14:37:02.240886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T22:03:20.904923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"39'9","reported_seq":30,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.360694+0000","last_change":"2023-07-25T14:36:49.178494+0000","last_active":"2023-07-25T14:37:05.360694+0000","last_peered":"2023-07-25T14:37:05.360694+0000","last_clean":"2023-07-25T14:37:05.360694+0000","last_became_active":"2023-07-25T14:36:49.178170+0000","last_became_peered":"2023-07-25T14:36:49.178170+0000","last_unstale":"2023-07-25T14:37:05.360694+0000","last_undegraded":"2023-07-25T14:37:05.360694+0000","last_fullsized":"2023-07-25T14:37:05.360694+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_clean_scrub_stamp":"2023-07-25T14:36:48.163149+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T22:06:58.370248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3071,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.303087+0000","last_change":"2023-07-25T14:36:50.206981+0000","last_active":"2023-07-25T14:37:05.303087+0000","last_peered":"2023-07-25T14:37:05.303087+0000","last_clean":"2023-07-25T14:37:05.303087+0000","last_became_active":"2023-07-25T14:36:50.206684+0000","last_became_peered":"2023-07-25T14:36:50.206684+0000","last_unstale":"2023-07-25T14:37:05.303087+0000","last_undegraded":"2023-07-25T14:37:05.303087+0000","last_fullsized":"2023-07-25T14:37:05.303087+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T01:31:06.970026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1a","version":"42'1","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:04.274230+0000","last_change":"2023-07-25T14:37:02.259257+0000","last_active":"2023-07-25T14:37:04.274230+0000","last_peered":"2023-07-25T14:37:04.274230+0000","last_clean":"2023-07-25T14:37:04.274230+0000","last_became_active":"2023-07-25T14:37:02.258998+0000","last_became_peered":"2023-07-25T14:37:02.258998+0000","last_unstale":"2023-07-25T14:37:04.274230+0000","last_undegraded":"2023-07-25T14:37:04.274230+0000","last_fullsized":"2023-07-25T14:37:04.274230+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:01.239242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:01.239242+0000","last_clean_scrub_stamp":"2023-07-25T14:37:01.239242+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T21:26:58.700605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.364289+0000","last_change":"2023-07-25T14:37:03.300719+0000","last_active":"2023-07-25T14:37:05.364289+0000","last_peered":"2023-07-25T14:37:05.364289+0000","last_clean":"2023-07-25T14:37:05.364289+0000","last_became_active":"2023-07-25T14:37:03.300401+0000","last_became_peered":"2023-07-25T14:37:03.300401+0000","last_unstale":"2023-07-25T14:37:05.364289+0000","last_undegraded":"2023-07-25T14:37:05.364289+0000","last_fullsized":"2023-07-25T14:37:05.364289+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_clean_scrub_stamp":"2023-07-25T14:37:02.240886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T23:05:46.179742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"38'3","reported_seq":24,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.302924+0000","last_change":"2023-07-25T14:36:49.189087+0000","last_active":"2023-07-25T14:37:05.302924+0000","last_peered":"2023-07-25T14:37:05.302924+0000","last_clean":"2023-07-25T14:37:05.302924+0000","last_became_active":"2023-07-25T14:36:49.188727+0000","last_became_peered":"2023-07-25T14:36:49.188727+0000","last_unstale":"2023-07-25T14:37:05.302924+0000","last_undegraded":"2023-07-25T14:37:05.302924+0000","last_fullsized":"2023-07-25T14:37:05.302924+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_clean_scrub_stamp":"2023-07-25T14:36:48.163149+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T19:25:23.302291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.363701+0000","last_change":"2023-07-25T14:36:50.201912+0000","last_active":"2023-07-25T14:37:05.363701+0000","last_peered":"2023-07-25T14:37:05.363701+0000","last_clean":"2023-07-25T14:37:05.363701+0000","last_became_active":"2023-07-25T14:36:50.201362+0000","last_became_peered":"2023-07-25T14:36:50.201362+0000","last_unstale":"2023-07-25T14:37:05.363701+0000","last_undegraded":"2023-07-25T14:37:05.363701+0000","last_fullsized":"2023-07-25T14:37:05.363701+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T01:20:17.380127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"42'1","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:04.279206+0000","last_change":"2023-07-25T14:37:02.264960+0000","last_active":"2023-07-25T14:37:04.279206+0000","last_peered":"2023-07-25T14:37:04.279206+0000","last_clean":"2023-07-25T14:37:04.279206+0000","last_became_active":"2023-07-25T14:37:02.264672+0000","last_became_peered":"2023-07-25T14:37:02.264672+0000","last_unstale":"2023-07-25T14:37:04.279206+0000","last_undegraded":"2023-07-25T14:37:04.279206+0000","last_fullsized":"2023-07-25T14:37:04.279206+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:01.239242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:01.239242+0000","last_clean_scrub_stamp":"2023-07-25T14:37:01.239242+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:59:25.549134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.364016+0000","last_change":"2023-07-25T14:37:03.293507+0000","last_active":"2023-07-25T14:37:05.364016+0000","last_peered":"2023-07-25T14:37:05.364016+0000","last_clean":"2023-07-25T14:37:05.364016+0000","last_became_active":"2023-07-25T14:37:03.293250+0000","last_became_peered":"2023-07-25T14:37:03.293250+0000","last_unstale":"2023-07-25T14:37:05.364016+0000","last_undegraded":"2023-07-25T14:37:05.364016+0000","last_fullsized":"2023-07-25T14:37:05.364016+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_clean_scrub_stamp":"2023-07-25T14:37:02.240886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:59:26.550778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":21,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:04.274987+0000","last_change":"2023-07-25T14:36:49.190277+0000","last_active":"2023-07-25T14:37:04.274987+0000","last_peered":"2023-07-25T14:37:04.274987+0000","last_clean":"2023-07-25T14:37:04.274987+0000","last_became_active":"2023-07-25T14:36:49.189911+0000","last_became_peered":"2023-07-25T14:36:49.189911+0000","last_unstale":"2023-07-25T14:37:04.274987+0000","last_undegraded":"2023-07-25T14:37:04.274987+0000","last_fullsized":"2023-07-25T14:37:04.274987+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_clean_scrub_stamp":"2023-07-25T14:36:48.163149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:19:34.939185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.303141+0000","last_change":"2023-07-25T14:36:50.200137+0000","last_active":"2023-07-25T14:37:05.303141+0000","last_peered":"2023-07-25T14:37:05.303141+0000","last_clean":"2023-07-25T14:37:05.303141+0000","last_became_active":"2023-07-25T14:36:50.199771+0000","last_became_peered":"2023-07-25T14:36:50.199771+0000","last_unstale":"2023-07-25T14:37:05.303141+0000","last_undegraded":"2023-07-25T14:37:05.303141+0000","last_fullsized":"2023-07-25T14:37:05.303141+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:29:16.803888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:04.278758+0000","last_change":"2023-07-25T14:37:02.262531+0000","last_active":"2023-07-25T14:37:04.278758+0000","last_peered":"2023-07-25T14:37:04.278758+0000","last_clean":"2023-07-25T14:37:04.278758+0000","last_became_active":"2023-07-25T14:37:02.262249+0000","last_became_peered":"2023-07-25T14:37:02.262249+0000","last_unstale":"2023-07-25T14:37:04.278758+0000","last_undegraded":"2023-07-25T14:37:04.278758+0000","last_fullsized":"2023-07-25T14:37:04.278758+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:01.239242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:01.239242+0000","last_clean_scrub_stamp":"2023-07-25T14:37:01.239242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T19:35:45.595176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.362619+0000","last_change":"2023-07-25T14:37:03.291703+0000","last_active":"2023-07-25T14:37:05.362619+0000","last_peered":"2023-07-25T14:37:05.362619+0000","last_clean":"2023-07-25T14:37:05.362619+0000","last_became_active":"2023-07-25T14:37:03.291279+0000","last_became_peered":"2023-07-25T14:37:03.291279+0000","last_unstale":"2023-07-25T14:37:05.362619+0000","last_undegraded":"2023-07-25T14:37:05.362619+0000","last_fullsized":"2023-07-25T14:37:05.362619+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_clean_scrub_stamp":"2023-07-25T14:37:02.240886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T22:57:46.551907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":21,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:04.279957+0000","last_change":"2023-07-25T14:36:49.179031+0000","last_active":"2023-07-25T14:37:04.279957+0000","last_peered":"2023-07-25T14:37:04.279957+0000","last_clean":"2023-07-25T14:37:04.279957+0000","last_became_active":"2023-07-25T14:36:49.178709+0000","last_became_peered":"2023-07-25T14:36:49.178709+0000","last_unstale":"2023-07-25T14:37:04.279957+0000","last_undegraded":"2023-07-25T14:37:04.279957+0000","last_fullsized":"2023-07-25T14:37:04.279957+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_clean_scrub_stamp":"2023-07-25T14:36:48.163149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T23:56:16.555841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:04.279663+0000","last_change":"2023-07-25T14:36:50.212104+0000","last_active":"2023-07-25T14:37:04.279663+0000","last_peered":"2023-07-25T14:37:04.279663+0000","last_clean":"2023-07-25T14:37:04.279663+0000","last_became_active":"2023-07-25T14:36:50.211493+0000","last_became_peered":"2023-07-25T14:36:50.211493+0000","last_unstale":"2023-07-25T14:37:04.279663+0000","last_undegraded":"2023-07-25T14:37:04.279663+0000","last_fullsized":"2023-07-25T14:37:04.279663+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T22:07:10.700924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:04.279214+0000","last_change":"2023-07-25T14:37:02.263084+0000","last_active":"2023-07-25T14:37:04.279214+0000","last_peered":"2023-07-25T14:37:04.279214+0000","last_clean":"2023-07-25T14:37:04.279214+0000","last_became_active":"2023-07-25T14:37:02.262776+0000","last_became_peered":"2023-07-25T14:37:02.262776+0000","last_unstale":"2023-07-25T14:37:04.279214+0000","last_undegraded":"2023-07-25T14:37:04.279214+0000","last_fullsized":"2023-07-25T14:37:04.279214+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:01.239242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:01.239242+0000","last_clean_scrub_stamp":"2023-07-25T14:37:01.239242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T22:21:33.528931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.361053+0000","last_change":"2023-07-25T14:37:03.292290+0000","last_active":"2023-07-25T14:37:05.361053+0000","last_peered":"2023-07-25T14:37:05.361053+0000","last_clean":"2023-07-25T14:37:05.361053+0000","last_became_active":"2023-07-25T14:37:03.291964+0000","last_became_peered":"2023-07-25T14:37:03.291964+0000","last_unstale":"2023-07-25T14:37:05.361053+0000","last_undegraded":"2023-07-25T14:37:05.361053+0000","last_fullsized":"2023-07-25T14:37:05.361053+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_clean_scrub_stamp":"2023-07-25T14:37:02.240886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T21:27:56.546539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":21,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:04.273770+0000","last_change":"2023-07-25T14:36:49.187292+0000","last_active":"2023-07-25T14:37:04.273770+0000","last_peered":"2023-07-25T14:37:04.273770+0000","last_clean":"2023-07-25T14:37:04.273770+0000","last_became_active":"2023-07-25T14:36:49.186847+0000","last_became_peered":"2023-07-25T14:36:49.186847+0000","last_unstale":"2023-07-25T14:37:04.273770+0000","last_undegraded":"2023-07-25T14:37:04.273770+0000","last_fullsized":"2023-07-25T14:37:04.273770+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_clean_scrub_stamp":"2023-07-25T14:36:48.163149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T17:44:48.840249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.360730+0000","last_change":"2023-07-25T14:36:50.203758+0000","last_active":"2023-07-25T14:37:05.360730+0000","last_peered":"2023-07-25T14:37:05.360730+0000","last_clean":"2023-07-25T14:37:05.360730+0000","last_became_active":"2023-07-25T14:36:50.203473+0000","last_became_peered":"2023-07-25T14:36:50.203473+0000","last_unstale":"2023-07-25T14:37:05.360730+0000","last_undegraded":"2023-07-25T14:37:05.360730+0000","last_fullsized":"2023-07-25T14:37:05.360730+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T20:17:30.647817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.364215+0000","last_change":"2023-07-25T14:37:02.264282+0000","last_active":"2023-07-25T14:37:05.364215+0000","last_peered":"2023-07-25T14:37:05.364215+0000","last_clean":"2023-07-25T14:37:05.364215+0000","last_became_active":"2023-07-25T14:37:02.264032+0000","last_became_peered":"2023-07-25T14:37:02.264032+0000","last_unstale":"2023-07-25T14:37:05.364215+0000","last_undegraded":"2023-07-25T14:37:05.364215+0000","last_fullsized":"2023-07-25T14:37:05.364215+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:01.239242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:01.239242+0000","last_clean_scrub_stamp":"2023-07-25T14:37:01.239242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T23:18:02.200413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.303095+0000","last_change":"2023-07-25T14:37:03.296433+0000","last_active":"2023-07-25T14:37:05.303095+0000","last_peered":"2023-07-25T14:37:05.303095+0000","last_clean":"2023-07-25T14:37:05.303095+0000","last_became_active":"2023-07-25T14:37:03.296056+0000","last_became_peered":"2023-07-25T14:37:03.296056+0000","last_unstale":"2023-07-25T14:37:05.303095+0000","last_undegraded":"2023-07-25T14:37:05.303095+0000","last_fullsized":"2023-07-25T14:37:05.303095+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_clean_scrub_stamp":"2023-07-25T14:37:02.240886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T21:27:23.198621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":21,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:04.279609+0000","last_change":"2023-07-25T14:36:49.188625+0000","last_active":"2023-07-25T14:37:04.279609+0000","last_peered":"2023-07-25T14:37:04.279609+0000","last_clean":"2023-07-25T14:37:04.279609+0000","last_became_active":"2023-07-25T14:36:49.188284+0000","last_became_peered":"2023-07-25T14:36:49.188284+0000","last_unstale":"2023-07-25T14:37:04.279609+0000","last_undegraded":"2023-07-25T14:37:04.279609+0000","last_fullsized":"2023-07-25T14:37:04.279609+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_clean_scrub_stamp":"2023-07-25T14:36:48.163149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T02:19:20.961003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:04.273674+0000","last_change":"2023-07-25T14:36:50.202710+0000","last_active":"2023-07-25T14:37:04.273674+0000","last_peered":"2023-07-25T14:37:04.273674+0000","last_clean":"2023-07-25T14:37:04.273674+0000","last_became_active":"2023-07-25T14:36:50.202435+0000","last_became_peered":"2023-07-25T14:36:50.202435+0000","last_unstale":"2023-07-25T14:37:04.273674+0000","last_undegraded":"2023-07-25T14:37:04.273674+0000","last_fullsized":"2023-07-25T14:37:04.273674+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T15:58:22.558174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.302830+0000","last_change":"2023-07-25T14:37:02.265530+0000","last_active":"2023-07-25T14:37:05.302830+0000","last_peered":"2023-07-25T14:37:05.302830+0000","last_clean":"2023-07-25T14:37:05.302830+0000","last_became_active":"2023-07-25T14:37:02.265245+0000","last_became_peered":"2023-07-25T14:37:02.265245+0000","last_unstale":"2023-07-25T14:37:05.302830+0000","last_undegraded":"2023-07-25T14:37:05.302830+0000","last_fullsized":"2023-07-25T14:37:05.302830+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:01.239242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:01.239242+0000","last_clean_scrub_stamp":"2023-07-25T14:37:01.239242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T22:34:49.200033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:04.279356+0000","last_change":"2023-07-25T14:37:03.283886+0000","last_active":"2023-07-25T14:37:04.279356+0000","last_peered":"2023-07-25T14:37:04.279356+0000","last_clean":"2023-07-25T14:37:04.279356+0000","last_became_active":"2023-07-25T14:37:03.283521+0000","last_became_peered":"2023-07-25T14:37:03.283521+0000","last_unstale":"2023-07-25T14:37:04.279356+0000","last_undegraded":"2023-07-25T14:37:04.279356+0000","last_fullsized":"2023-07-25T14:37:04.279356+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_clean_scrub_stamp":"2023-07-25T14:37:02.240886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T20:15:27.988672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"38'1","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:04.280018+0000","last_change":"2023-07-25T14:36:49.186416+0000","last_active":"2023-07-25T14:37:04.280018+0000","last_peered":"2023-07-25T14:37:04.280018+0000","last_clean":"2023-07-25T14:37:04.280018+0000","last_became_active":"2023-07-25T14:36:49.186112+0000","last_became_peered":"2023-07-25T14:36:49.186112+0000","last_unstale":"2023-07-25T14:37:04.280018+0000","last_undegraded":"2023-07-25T14:37:04.280018+0000","last_fullsized":"2023-07-25T14:37:04.280018+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_clean_scrub_stamp":"2023-07-25T14:36:48.163149+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:37:27.193075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:04.274237+0000","last_change":"2023-07-25T14:36:50.197978+0000","last_active":"2023-07-25T14:37:04.274237+0000","last_peered":"2023-07-25T14:37:04.274237+0000","last_clean":"2023-07-25T14:37:04.274237+0000","last_became_active":"2023-07-25T14:36:50.197726+0000","last_became_peered":"2023-07-25T14:36:50.197726+0000","last_unstale":"2023-07-25T14:37:04.274237+0000","last_undegraded":"2023-07-25T14:37:04.274237+0000","last_fullsized":"2023-07-25T14:37:04.274237+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T22:34:37.127883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"42'6","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:04.279907+0000","last_change":"2023-07-25T14:37:02.262021+0000","last_active":"2023-07-25T14:37:04.279907+0000","last_peered":"2023-07-25T14:37:04.279907+0000","last_clean":"2023-07-25T14:37:04.279907+0000","last_became_active":"2023-07-25T14:37:02.261728+0000","last_became_peered":"2023-07-25T14:37:02.261728+0000","last_unstale":"2023-07-25T14:37:04.279907+0000","last_undegraded":"2023-07-25T14:37:04.279907+0000","last_fullsized":"2023-07-25T14:37:04.279907+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:01.239242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:01.239242+0000","last_clean_scrub_stamp":"2023-07-25T14:37:01.239242+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T19:42:48.721849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.302697+0000","last_change":"2023-07-25T14:37:03.296582+0000","last_active":"2023-07-25T14:37:05.302697+0000","last_peered":"2023-07-25T14:37:05.302697+0000","last_clean":"2023-07-25T14:37:05.302697+0000","last_became_active":"2023-07-25T14:37:03.296253+0000","last_became_peered":"2023-07-25T14:37:03.296253+0000","last_unstale":"2023-07-25T14:37:05.302697+0000","last_undegraded":"2023-07-25T14:37:05.302697+0000","last_fullsized":"2023-07-25T14:37:05.302697+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_clean_scrub_stamp":"2023-07-25T14:37:02.240886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T16:24:26.276203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1b","version":"38'1","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.364575+0000","last_change":"2023-07-25T14:36:49.193129+0000","last_active":"2023-07-25T14:37:05.364575+0000","last_peered":"2023-07-25T14:37:05.364575+0000","last_clean":"2023-07-25T14:37:05.364575+0000","last_became_active":"2023-07-25T14:36:49.192313+0000","last_became_peered":"2023-07-25T14:36:49.192313+0000","last_unstale":"2023-07-25T14:37:05.364575+0000","last_undegraded":"2023-07-25T14:37:05.364575+0000","last_fullsized":"2023-07-25T14:37:05.364575+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_clean_scrub_stamp":"2023-07-25T14:36:48.163149+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T19:50:09.723619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:04.279866+0000","last_change":"2023-07-25T14:36:50.206176+0000","last_active":"2023-07-25T14:37:04.279866+0000","last_peered":"2023-07-25T14:37:04.279866+0000","last_clean":"2023-07-25T14:37:04.279866+0000","last_became_active":"2023-07-25T14:36:50.205387+0000","last_became_peered":"2023-07-25T14:36:50.205387+0000","last_unstale":"2023-07-25T14:37:04.279866+0000","last_undegraded":"2023-07-25T14:37:04.279866+0000","last_fullsized":"2023-07-25T14:37:04.279866+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:09:02.983213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"42'3","reported_seq":16,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.303173+0000","last_change":"2023-07-25T14:37:02.269037+0000","last_active":"2023-07-25T14:37:05.303173+0000","last_peered":"2023-07-25T14:37:05.303173+0000","last_clean":"2023-07-25T14:37:05.303173+0000","last_became_active":"2023-07-25T14:37:02.268739+0000","last_became_peered":"2023-07-25T14:37:02.268739+0000","last_unstale":"2023-07-25T14:37:05.303173+0000","last_undegraded":"2023-07-25T14:37:05.303173+0000","last_fullsized":"2023-07-25T14:37:05.303173+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:01.239242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:01.239242+0000","last_clean_scrub_stamp":"2023-07-25T14:37:01.239242+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T17:39:36.452627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.361110+0000","last_change":"2023-07-25T14:37:03.282451+0000","last_active":"2023-07-25T14:37:05.361110+0000","last_peered":"2023-07-25T14:37:05.361110+0000","last_clean":"2023-07-25T14:37:05.361110+0000","last_became_active":"2023-07-25T14:37:03.281694+0000","last_became_peered":"2023-07-25T14:37:03.281694+0000","last_unstale":"2023-07-25T14:37:05.361110+0000","last_undegraded":"2023-07-25T14:37:05.361110+0000","last_fullsized":"2023-07-25T14:37:05.361110+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_clean_scrub_stamp":"2023-07-25T14:37:02.240886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T23:04:16.798996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"38'2","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.301652+0000","last_change":"2023-07-25T14:36:49.188456+0000","last_active":"2023-07-25T14:37:05.301652+0000","last_peered":"2023-07-25T14:37:05.301652+0000","last_clean":"2023-07-25T14:37:05.301652+0000","last_became_active":"2023-07-25T14:36:49.188176+0000","last_became_peered":"2023-07-25T14:36:49.188176+0000","last_unstale":"2023-07-25T14:37:05.301652+0000","last_undegraded":"2023-07-25T14:37:05.301652+0000","last_fullsized":"2023-07-25T14:37:05.301652+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_clean_scrub_stamp":"2023-07-25T14:36:48.163149+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T16:58:12.518541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.361016+0000","last_change":"2023-07-25T14:36:50.205852+0000","last_active":"2023-07-25T14:37:05.361016+0000","last_peered":"2023-07-25T14:37:05.361016+0000","last_clean":"2023-07-25T14:37:05.361016+0000","last_became_active":"2023-07-25T14:36:50.205542+0000","last_became_peered":"2023-07-25T14:36:50.205542+0000","last_unstale":"2023-07-25T14:37:05.361016+0000","last_undegraded":"2023-07-25T14:37:05.361016+0000","last_fullsized":"2023-07-25T14:37:05.361016+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T23:46:09.285332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.360822+0000","last_change":"2023-07-25T14:37:02.252129+0000","last_active":"2023-07-25T14:37:05.360822+0000","last_peered":"2023-07-25T14:37:05.360822+0000","last_clean":"2023-07-25T14:37:05.360822+0000","last_became_active":"2023-07-25T14:37:02.251862+0000","last_became_peered":"2023-07-25T14:37:02.251862+0000","last_unstale":"2023-07-25T14:37:05.360822+0000","last_undegraded":"2023-07-25T14:37:05.360822+0000","last_fullsized":"2023-07-25T14:37:05.360822+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:01.239242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:01.239242+0000","last_clean_scrub_stamp":"2023-07-25T14:37:01.239242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T01:23:52.434841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.302400+0000","last_change":"2023-07-25T14:37:03.296791+0000","last_active":"2023-07-25T14:37:05.302400+0000","last_peered":"2023-07-25T14:37:05.302400+0000","last_clean":"2023-07-25T14:37:05.302400+0000","last_became_active":"2023-07-25T14:37:03.296425+0000","last_became_peered":"2023-07-25T14:37:03.296425+0000","last_unstale":"2023-07-25T14:37:05.302400+0000","last_undegraded":"2023-07-25T14:37:05.302400+0000","last_fullsized":"2023-07-25T14:37:05.302400+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_clean_scrub_stamp":"2023-07-25T14:37:02.240886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T19:39:27.866088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1d","version":"38'2","reported_seq":23,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.360164+0000","last_change":"2023-07-25T14:36:49.188711+0000","last_active":"2023-07-25T14:37:05.360164+0000","last_peered":"2023-07-25T14:37:05.360164+0000","last_clean":"2023-07-25T14:37:05.360164+0000","last_became_active":"2023-07-25T14:36:49.188454+0000","last_became_peered":"2023-07-25T14:36:49.188454+0000","last_unstale":"2023-07-25T14:37:05.360164+0000","last_undegraded":"2023-07-25T14:37:05.360164+0000","last_fullsized":"2023-07-25T14:37:05.360164+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_clean_scrub_stamp":"2023-07-25T14:36:48.163149+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T16:28:13.540791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:04.279754+0000","last_change":"2023-07-25T14:36:50.210856+0000","last_active":"2023-07-25T14:37:04.279754+0000","last_peered":"2023-07-25T14:37:04.279754+0000","last_clean":"2023-07-25T14:37:04.279754+0000","last_became_active":"2023-07-25T14:36:50.210524+0000","last_became_peered":"2023-07-25T14:36:50.210524+0000","last_unstale":"2023-07-25T14:37:04.279754+0000","last_undegraded":"2023-07-25T14:37:04.279754+0000","last_fullsized":"2023-07-25T14:37:04.279754+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T19:39:22.593137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"42'2","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.364457+0000","last_change":"2023-07-25T14:37:02.264993+0000","last_active":"2023-07-25T14:37:05.364457+0000","last_peered":"2023-07-25T14:37:05.364457+0000","last_clean":"2023-07-25T14:37:05.364457+0000","last_became_active":"2023-07-25T14:37:02.264716+0000","last_became_peered":"2023-07-25T14:37:02.264716+0000","last_unstale":"2023-07-25T14:37:05.364457+0000","last_undegraded":"2023-07-25T14:37:05.364457+0000","last_fullsized":"2023-07-25T14:37:05.364457+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:01.239242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:01.239242+0000","last_clean_scrub_stamp":"2023-07-25T14:37:01.239242+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T20:48:31.954134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:04.278979+0000","last_change":"2023-07-25T14:37:03.273189+0000","last_active":"2023-07-25T14:37:04.278979+0000","last_peered":"2023-07-25T14:37:04.278979+0000","last_clean":"2023-07-25T14:37:04.278979+0000","last_became_active":"2023-07-25T14:37:03.272836+0000","last_became_peered":"2023-07-25T14:37:03.272836+0000","last_unstale":"2023-07-25T14:37:04.278979+0000","last_undegraded":"2023-07-25T14:37:04.278979+0000","last_fullsized":"2023-07-25T14:37:04.278979+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_clean_scrub_stamp":"2023-07-25T14:37:02.240886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T17:07:24.735725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1e","version":"38'1","reported_seq":22,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:04.279532+0000","last_change":"2023-07-25T14:36:49.182497+0000","last_active":"2023-07-25T14:37:04.279532+0000","last_peered":"2023-07-25T14:37:04.279532+0000","last_clean":"2023-07-25T14:37:04.279532+0000","last_became_active":"2023-07-25T14:36:49.182166+0000","last_became_peered":"2023-07-25T14:36:49.182166+0000","last_unstale":"2023-07-25T14:37:04.279532+0000","last_undegraded":"2023-07-25T14:37:04.279532+0000","last_fullsized":"2023-07-25T14:37:04.279532+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_clean_scrub_stamp":"2023-07-25T14:36:48.163149+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T02:10:18.157389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.361772+0000","last_change":"2023-07-25T14:36:50.202196+0000","last_active":"2023-07-25T14:37:05.361772+0000","last_peered":"2023-07-25T14:37:05.361772+0000","last_clean":"2023-07-25T14:37:05.361772+0000","last_became_active":"2023-07-25T14:36:50.201924+0000","last_became_peered":"2023-07-25T14:36:50.201924+0000","last_unstale":"2023-07-25T14:37:05.361772+0000","last_undegraded":"2023-07-25T14:37:05.361772+0000","last_fullsized":"2023-07-25T14:37:05.361772+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T21:47:46.363868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"42'8","reported_seq":21,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.302343+0000","last_change":"2023-07-25T14:37:02.261701+0000","last_active":"2023-07-25T14:37:05.302343+0000","last_peered":"2023-07-25T14:37:05.302343+0000","last_clean":"2023-07-25T14:37:05.302343+0000","last_became_active":"2023-07-25T14:37:02.261410+0000","last_became_peered":"2023-07-25T14:37:02.261410+0000","last_unstale":"2023-07-25T14:37:05.302343+0000","last_undegraded":"2023-07-25T14:37:05.302343+0000","last_fullsized":"2023-07-25T14:37:05.302343+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:01.239242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:01.239242+0000","last_clean_scrub_stamp":"2023-07-25T14:37:01.239242+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T01:12:31.892646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.302039+0000","last_change":"2023-07-25T14:37:03.301073+0000","last_active":"2023-07-25T14:37:05.302039+0000","last_peered":"2023-07-25T14:37:05.302039+0000","last_clean":"2023-07-25T14:37:05.302039+0000","last_became_active":"2023-07-25T14:37:03.300825+0000","last_became_peered":"2023-07-25T14:37:03.300825+0000","last_unstale":"2023-07-25T14:37:05.302039+0000","last_undegraded":"2023-07-25T14:37:05.302039+0000","last_fullsized":"2023-07-25T14:37:05.302039+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_clean_scrub_stamp":"2023-07-25T14:37:02.240886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:05:57.024753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1f","version":"38'4","reported_seq":25,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.364697+0000","last_change":"2023-07-25T14:36:49.189633+0000","last_active":"2023-07-25T14:37:05.364697+0000","last_peered":"2023-07-25T14:37:05.364697+0000","last_clean":"2023-07-25T14:37:05.364697+0000","last_became_active":"2023-07-25T14:36:49.189347+0000","last_became_peered":"2023-07-25T14:36:49.189347+0000","last_unstale":"2023-07-25T14:37:05.364697+0000","last_undegraded":"2023-07-25T14:37:05.364697+0000","last_fullsized":"2023-07-25T14:37:05.364697+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:48.163149+0000","last_clean_scrub_stamp":"2023-07-25T14:36:48.163149+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:09:01.979270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.363216+0000","last_change":"2023-07-25T14:36:50.213941+0000","last_active":"2023-07-25T14:37:05.363216+0000","last_peered":"2023-07-25T14:37:05.363216+0000","last_clean":"2023-07-25T14:37:05.363216+0000","last_became_active":"2023-07-25T14:36:50.213697+0000","last_became_peered":"2023-07-25T14:36:50.213697+0000","last_unstale":"2023-07-25T14:37:05.363216+0000","last_undegraded":"2023-07-25T14:37:05.363216+0000","last_fullsized":"2023-07-25T14:37:05.363216+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T20:17:30.647817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:04.279327+0000","last_change":"2023-07-25T14:37:02.264807+0000","last_active":"2023-07-25T14:37:04.279327+0000","last_peered":"2023-07-25T14:37:04.279327+0000","last_clean":"2023-07-25T14:37:04.279327+0000","last_became_active":"2023-07-25T14:37:02.264523+0000","last_became_peered":"2023-07-25T14:37:02.264523+0000","last_unstale":"2023-07-25T14:37:04.279327+0000","last_undegraded":"2023-07-25T14:37:04.279327+0000","last_fullsized":"2023-07-25T14:37:04.279327+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:01.239242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:01.239242+0000","last_clean_scrub_stamp":"2023-07-25T14:37:01.239242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T17:28:42.324250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:04.278650+0000","last_change":"2023-07-25T14:37:03.292347+0000","last_active":"2023-07-25T14:37:04.278650+0000","last_peered":"2023-07-25T14:37:04.278650+0000","last_clean":"2023-07-25T14:37:04.278650+0000","last_became_active":"2023-07-25T14:37:03.292060+0000","last_became_peered":"2023-07-25T14:37:03.292060+0000","last_unstale":"2023-07-25T14:37:04.278650+0000","last_undegraded":"2023-07-25T14:37:04.278650+0000","last_fullsized":"2023-07-25T14:37:04.278650+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_clean_scrub_stamp":"2023-07-25T14:37:02.240886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T19:32:10.136276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.302798+0000","last_change":"2023-07-25T14:37:03.294828+0000","last_active":"2023-07-25T14:37:05.302798+0000","last_peered":"2023-07-25T14:37:05.302798+0000","last_clean":"2023-07-25T14:37:05.302798+0000","last_became_active":"2023-07-25T14:37:03.294371+0000","last_became_peered":"2023-07-25T14:37:03.294371+0000","last_unstale":"2023-07-25T14:37:05.302798+0000","last_undegraded":"2023-07-25T14:37:05.302798+0000","last_fullsized":"2023-07-25T14:37:05.302798+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_clean_scrub_stamp":"2023-07-25T14:37:02.240886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T22:03:20.904923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.360989+0000","last_change":"2023-07-25T14:36:50.203988+0000","last_active":"2023-07-25T14:37:05.360989+0000","last_peered":"2023-07-25T14:37:05.360989+0000","last_clean":"2023-07-25T14:37:05.360989+0000","last_became_active":"2023-07-25T14:36:50.203732+0000","last_became_peered":"2023-07-25T14:36:50.203732+0000","last_unstale":"2023-07-25T14:37:05.360989+0000","last_undegraded":"2023-07-25T14:37:05.360989+0000","last_fullsized":"2023-07-25T14:37:05.360989+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T01:05:55.734046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.364345+0000","last_change":"2023-07-25T14:37:03.296878+0000","last_active":"2023-07-25T14:37:05.364345+0000","last_peered":"2023-07-25T14:37:05.364345+0000","last_clean":"2023-07-25T14:37:05.364345+0000","last_became_active":"2023-07-25T14:37:03.296622+0000","last_became_peered":"2023-07-25T14:37:03.296622+0000","last_unstale":"2023-07-25T14:37:05.364345+0000","last_undegraded":"2023-07-25T14:37:05.364345+0000","last_fullsized":"2023-07-25T14:37:05.364345+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_clean_scrub_stamp":"2023-07-25T14:37:02.240886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T23:59:17.135471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.362771+0000","last_change":"2023-07-25T14:36:50.198090+0000","last_active":"2023-07-25T14:37:05.362771+0000","last_peered":"2023-07-25T14:37:05.362771+0000","last_clean":"2023-07-25T14:37:05.362771+0000","last_became_active":"2023-07-25T14:36:50.197854+0000","last_became_peered":"2023-07-25T14:36:50.197854+0000","last_unstale":"2023-07-25T14:37:05.362771+0000","last_undegraded":"2023-07-25T14:37:05.362771+0000","last_fullsized":"2023-07-25T14:37:05.362771+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T16:42:55.883446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.363615+0000","last_change":"2023-07-25T14:37:03.304720+0000","last_active":"2023-07-25T14:37:05.363615+0000","last_peered":"2023-07-25T14:37:05.363615+0000","last_clean":"2023-07-25T14:37:05.363615+0000","last_became_active":"2023-07-25T14:37:03.304452+0000","last_became_peered":"2023-07-25T14:37:03.304452+0000","last_unstale":"2023-07-25T14:37:05.363615+0000","last_undegraded":"2023-07-25T14:37:05.363615+0000","last_fullsized":"2023-07-25T14:37:05.363615+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_clean_scrub_stamp":"2023-07-25T14:37:02.240886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:35:31.697908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:04.279571+0000","last_change":"2023-07-25T14:36:50.206009+0000","last_active":"2023-07-25T14:37:04.279571+0000","last_peered":"2023-07-25T14:37:04.279571+0000","last_clean":"2023-07-25T14:37:04.279571+0000","last_became_active":"2023-07-25T14:36:50.205731+0000","last_became_peered":"2023-07-25T14:36:50.205731+0000","last_unstale":"2023-07-25T14:37:04.279571+0000","last_undegraded":"2023-07-25T14:37:04.279571+0000","last_fullsized":"2023-07-25T14:37:04.279571+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T18:30:23.936686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.361719+0000","last_change":"2023-07-25T14:37:03.295725+0000","last_active":"2023-07-25T14:37:05.361719+0000","last_peered":"2023-07-25T14:37:05.361719+0000","last_clean":"2023-07-25T14:37:05.361719+0000","last_became_active":"2023-07-25T14:37:03.295442+0000","last_became_peered":"2023-07-25T14:37:03.295442+0000","last_unstale":"2023-07-25T14:37:05.361719+0000","last_undegraded":"2023-07-25T14:37:05.361719+0000","last_fullsized":"2023-07-25T14:37:05.361719+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_clean_scrub_stamp":"2023-07-25T14:37:02.240886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T01:34:58.908253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.361462+0000","last_change":"2023-07-25T14:36:50.206158+0000","last_active":"2023-07-25T14:37:05.361462+0000","last_peered":"2023-07-25T14:37:05.361462+0000","last_clean":"2023-07-25T14:37:05.361462+0000","last_became_active":"2023-07-25T14:36:50.205826+0000","last_became_peered":"2023-07-25T14:36:50.205826+0000","last_unstale":"2023-07-25T14:37:05.361462+0000","last_undegraded":"2023-07-25T14:37:05.361462+0000","last_fullsized":"2023-07-25T14:37:05.361462+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:55:45.982937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.364145+0000","last_change":"2023-07-25T14:37:03.294723+0000","last_active":"2023-07-25T14:37:05.364145+0000","last_peered":"2023-07-25T14:37:05.364145+0000","last_clean":"2023-07-25T14:37:05.364145+0000","last_became_active":"2023-07-25T14:37:03.294453+0000","last_became_peered":"2023-07-25T14:37:03.294453+0000","last_unstale":"2023-07-25T14:37:05.364145+0000","last_undegraded":"2023-07-25T14:37:05.364145+0000","last_fullsized":"2023-07-25T14:37:05.364145+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_clean_scrub_stamp":"2023-07-25T14:37:02.240886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T23:06:03.045191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:04.279876+0000","last_change":"2023-07-25T14:36:50.214125+0000","last_active":"2023-07-25T14:37:04.279876+0000","last_peered":"2023-07-25T14:37:04.279876+0000","last_clean":"2023-07-25T14:37:04.279876+0000","last_became_active":"2023-07-25T14:36:50.213810+0000","last_became_peered":"2023-07-25T14:36:50.213810+0000","last_unstale":"2023-07-25T14:37:04.279876+0000","last_undegraded":"2023-07-25T14:37:04.279876+0000","last_fullsized":"2023-07-25T14:37:04.279876+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T22:02:41.537005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.302193+0000","last_change":"2023-07-25T14:37:03.295322+0000","last_active":"2023-07-25T14:37:05.302193+0000","last_peered":"2023-07-25T14:37:05.302193+0000","last_clean":"2023-07-25T14:37:05.302193+0000","last_became_active":"2023-07-25T14:37:03.294827+0000","last_became_peered":"2023-07-25T14:37:03.294827+0000","last_unstale":"2023-07-25T14:37:05.302193+0000","last_undegraded":"2023-07-25T14:37:05.302193+0000","last_fullsized":"2023-07-25T14:37:05.302193+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_clean_scrub_stamp":"2023-07-25T14:37:02.240886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T16:23:10.727951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:04.279321+0000","last_change":"2023-07-25T14:36:50.201315+0000","last_active":"2023-07-25T14:37:04.279321+0000","last_peered":"2023-07-25T14:37:04.279321+0000","last_clean":"2023-07-25T14:37:04.279321+0000","last_became_active":"2023-07-25T14:36:50.201043+0000","last_became_peered":"2023-07-25T14:36:50.201043+0000","last_unstale":"2023-07-25T14:37:04.279321+0000","last_undegraded":"2023-07-25T14:37:04.279321+0000","last_fullsized":"2023-07-25T14:37:04.279321+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T19:50:10.727562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.360653+0000","last_change":"2023-07-25T14:37:03.293323+0000","last_active":"2023-07-25T14:37:05.360653+0000","last_peered":"2023-07-25T14:37:05.360653+0000","last_clean":"2023-07-25T14:37:05.360653+0000","last_became_active":"2023-07-25T14:37:03.293021+0000","last_became_peered":"2023-07-25T14:37:03.293021+0000","last_unstale":"2023-07-25T14:37:05.360653+0000","last_undegraded":"2023-07-25T14:37:05.360653+0000","last_fullsized":"2023-07-25T14:37:05.360653+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_clean_scrub_stamp":"2023-07-25T14:37:02.240886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T23:04:16.798996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.361675+0000","last_change":"2023-07-25T14:36:50.193509+0000","last_active":"2023-07-25T14:37:05.361675+0000","last_peered":"2023-07-25T14:37:05.361675+0000","last_clean":"2023-07-25T14:37:05.361675+0000","last_became_active":"2023-07-25T14:36:50.193223+0000","last_became_peered":"2023-07-25T14:36:50.193223+0000","last_unstale":"2023-07-25T14:37:05.361675+0000","last_undegraded":"2023-07-25T14:37:05.361675+0000","last_fullsized":"2023-07-25T14:37:05.361675+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T20:18:50.988942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.302383+0000","last_change":"2023-07-25T14:37:03.301119+0000","last_active":"2023-07-25T14:37:05.302383+0000","last_peered":"2023-07-25T14:37:05.302383+0000","last_clean":"2023-07-25T14:37:05.302383+0000","last_became_active":"2023-07-25T14:37:03.300850+0000","last_became_peered":"2023-07-25T14:37:03.300850+0000","last_unstale":"2023-07-25T14:37:05.302383+0000","last_undegraded":"2023-07-25T14:37:05.302383+0000","last_fullsized":"2023-07-25T14:37:05.302383+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_clean_scrub_stamp":"2023-07-25T14:37:02.240886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T18:17:33.408755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.361680+0000","last_change":"2023-07-25T14:36:50.206676+0000","last_active":"2023-07-25T14:37:05.361680+0000","last_peered":"2023-07-25T14:37:05.361680+0000","last_clean":"2023-07-25T14:37:05.361680+0000","last_became_active":"2023-07-25T14:36:50.206388+0000","last_became_peered":"2023-07-25T14:36:50.206388+0000","last_unstale":"2023-07-25T14:37:05.361680+0000","last_undegraded":"2023-07-25T14:37:05.361680+0000","last_fullsized":"2023-07-25T14:37:05.361680+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T22:25:01.919234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:04.278878+0000","last_change":"2023-07-25T14:37:03.284720+0000","last_active":"2023-07-25T14:37:04.278878+0000","last_peered":"2023-07-25T14:37:04.278878+0000","last_clean":"2023-07-25T14:37:04.278878+0000","last_became_active":"2023-07-25T14:37:03.284357+0000","last_became_peered":"2023-07-25T14:37:03.284357+0000","last_unstale":"2023-07-25T14:37:04.278878+0000","last_undegraded":"2023-07-25T14:37:04.278878+0000","last_fullsized":"2023-07-25T14:37:04.278878+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_clean_scrub_stamp":"2023-07-25T14:37:02.240886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T15:01:37.336868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.360572+0000","last_change":"2023-07-25T14:36:50.201691+0000","last_active":"2023-07-25T14:37:05.360572+0000","last_peered":"2023-07-25T14:37:05.360572+0000","last_clean":"2023-07-25T14:37:05.360572+0000","last_became_active":"2023-07-25T14:36:50.201277+0000","last_became_peered":"2023-07-25T14:36:50.201277+0000","last_unstale":"2023-07-25T14:37:05.360572+0000","last_undegraded":"2023-07-25T14:37:05.360572+0000","last_fullsized":"2023-07-25T14:37:05.360572+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T18:38:37.067083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.361797+0000","last_change":"2023-07-25T14:37:03.284263+0000","last_active":"2023-07-25T14:37:05.361797+0000","last_peered":"2023-07-25T14:37:05.361797+0000","last_clean":"2023-07-25T14:37:05.361797+0000","last_became_active":"2023-07-25T14:37:03.283945+0000","last_became_peered":"2023-07-25T14:37:03.283945+0000","last_unstale":"2023-07-25T14:37:05.361797+0000","last_undegraded":"2023-07-25T14:37:05.361797+0000","last_fullsized":"2023-07-25T14:37:05.361797+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_clean_scrub_stamp":"2023-07-25T14:37:02.240886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T16:35:37.962502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.360663+0000","last_change":"2023-07-25T14:36:50.204317+0000","last_active":"2023-07-25T14:37:05.360663+0000","last_peered":"2023-07-25T14:37:05.360663+0000","last_clean":"2023-07-25T14:37:05.360663+0000","last_became_active":"2023-07-25T14:36:50.203984+0000","last_became_peered":"2023-07-25T14:36:50.203984+0000","last_unstale":"2023-07-25T14:37:05.360663+0000","last_undegraded":"2023-07-25T14:37:05.360663+0000","last_fullsized":"2023-07-25T14:37:05.360663+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T23:46:09.285332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.361451+0000","last_change":"2023-07-25T14:37:03.285433+0000","last_active":"2023-07-25T14:37:05.361451+0000","last_peered":"2023-07-25T14:37:05.361451+0000","last_clean":"2023-07-25T14:37:05.361451+0000","last_became_active":"2023-07-25T14:37:03.285102+0000","last_became_peered":"2023-07-25T14:37:03.285102+0000","last_unstale":"2023-07-25T14:37:05.361451+0000","last_undegraded":"2023-07-25T14:37:05.361451+0000","last_fullsized":"2023-07-25T14:37:05.361451+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_clean_scrub_stamp":"2023-07-25T14:37:02.240886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T02:09:53.775729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:04.274248+0000","last_change":"2023-07-25T14:36:50.202547+0000","last_active":"2023-07-25T14:37:04.274248+0000","last_peered":"2023-07-25T14:37:04.274248+0000","last_clean":"2023-07-25T14:37:04.274248+0000","last_became_active":"2023-07-25T14:36:50.202242+0000","last_became_peered":"2023-07-25T14:36:50.202242+0000","last_unstale":"2023-07-25T14:37:04.274248+0000","last_undegraded":"2023-07-25T14:37:04.274248+0000","last_fullsized":"2023-07-25T14:37:04.274248+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T21:33:27.605480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:04.273976+0000","last_change":"2023-07-25T14:37:03.293640+0000","last_active":"2023-07-25T14:37:04.273976+0000","last_peered":"2023-07-25T14:37:04.273976+0000","last_clean":"2023-07-25T14:37:04.273976+0000","last_became_active":"2023-07-25T14:37:03.293347+0000","last_became_peered":"2023-07-25T14:37:03.293347+0000","last_unstale":"2023-07-25T14:37:04.273976+0000","last_undegraded":"2023-07-25T14:37:04.273976+0000","last_fullsized":"2023-07-25T14:37:04.273976+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_clean_scrub_stamp":"2023-07-25T14:37:02.240886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T22:20:51.809262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.364493+0000","last_change":"2023-07-25T14:36:50.211635+0000","last_active":"2023-07-25T14:37:05.364493+0000","last_peered":"2023-07-25T14:37:05.364493+0000","last_clean":"2023-07-25T14:37:05.364493+0000","last_became_active":"2023-07-25T14:36:50.211036+0000","last_became_peered":"2023-07-25T14:36:50.211036+0000","last_unstale":"2023-07-25T14:37:05.364493+0000","last_undegraded":"2023-07-25T14:37:05.364493+0000","last_fullsized":"2023-07-25T14:37:05.364493+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T15:48:18.672192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.302095+0000","last_change":"2023-07-25T14:37:03.294285+0000","last_active":"2023-07-25T14:37:05.302095+0000","last_peered":"2023-07-25T14:37:05.302095+0000","last_clean":"2023-07-25T14:37:05.302095+0000","last_became_active":"2023-07-25T14:37:03.294003+0000","last_became_peered":"2023-07-25T14:37:03.294003+0000","last_unstale":"2023-07-25T14:37:05.302095+0000","last_undegraded":"2023-07-25T14:37:05.302095+0000","last_fullsized":"2023-07-25T14:37:05.302095+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_clean_scrub_stamp":"2023-07-25T14:37:02.240886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T17:45:02.917986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.361881+0000","last_change":"2023-07-25T14:36:50.213055+0000","last_active":"2023-07-25T14:37:05.361881+0000","last_peered":"2023-07-25T14:37:05.361881+0000","last_clean":"2023-07-25T14:37:05.361881+0000","last_became_active":"2023-07-25T14:36:50.211933+0000","last_became_peered":"2023-07-25T14:36:50.211933+0000","last_unstale":"2023-07-25T14:37:05.361881+0000","last_undegraded":"2023-07-25T14:37:05.361881+0000","last_fullsized":"2023-07-25T14:37:05.361881+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T15:31:36.354172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.364312+0000","last_change":"2023-07-25T14:37:03.294076+0000","last_active":"2023-07-25T14:37:05.364312+0000","last_peered":"2023-07-25T14:37:05.364312+0000","last_clean":"2023-07-25T14:37:05.364312+0000","last_became_active":"2023-07-25T14:37:03.293816+0000","last_became_peered":"2023-07-25T14:37:03.293816+0000","last_unstale":"2023-07-25T14:37:05.364312+0000","last_undegraded":"2023-07-25T14:37:05.364312+0000","last_fullsized":"2023-07-25T14:37:05.364312+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_clean_scrub_stamp":"2023-07-25T14:37:02.240886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T18:30:32.992558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.361517+0000","last_change":"2023-07-25T14:36:50.212251+0000","last_active":"2023-07-25T14:37:05.361517+0000","last_peered":"2023-07-25T14:37:05.361517+0000","last_clean":"2023-07-25T14:37:05.361517+0000","last_became_active":"2023-07-25T14:36:50.211890+0000","last_became_peered":"2023-07-25T14:36:50.211890+0000","last_unstale":"2023-07-25T14:37:05.361517+0000","last_undegraded":"2023-07-25T14:37:05.361517+0000","last_fullsized":"2023-07-25T14:37:05.361517+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T01:04:10.819668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:04.273577+0000","last_change":"2023-07-25T14:37:03.301320+0000","last_active":"2023-07-25T14:37:04.273577+0000","last_peered":"2023-07-25T14:37:04.273577+0000","last_clean":"2023-07-25T14:37:04.273577+0000","last_became_active":"2023-07-25T14:37:03.300887+0000","last_became_peered":"2023-07-25T14:37:03.300887+0000","last_unstale":"2023-07-25T14:37:04.273577+0000","last_undegraded":"2023-07-25T14:37:04.273577+0000","last_fullsized":"2023-07-25T14:37:04.273577+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_clean_scrub_stamp":"2023-07-25T14:37:02.240886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T16:58:26.596278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:04.279569+0000","last_change":"2023-07-25T14:36:50.212257+0000","last_active":"2023-07-25T14:37:04.279569+0000","last_peered":"2023-07-25T14:37:04.279569+0000","last_clean":"2023-07-25T14:37:04.279569+0000","last_became_active":"2023-07-25T14:36:50.211850+0000","last_became_peered":"2023-07-25T14:36:50.211850+0000","last_unstale":"2023-07-25T14:37:04.279569+0000","last_undegraded":"2023-07-25T14:37:04.279569+0000","last_fullsized":"2023-07-25T14:37:04.279569+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T23:05:33.105948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.361199+0000","last_change":"2023-07-25T14:37:03.284655+0000","last_active":"2023-07-25T14:37:05.361199+0000","last_peered":"2023-07-25T14:37:05.361199+0000","last_clean":"2023-07-25T14:37:05.361199+0000","last_became_active":"2023-07-25T14:37:03.284390+0000","last_became_peered":"2023-07-25T14:37:03.284390+0000","last_unstale":"2023-07-25T14:37:05.361199+0000","last_undegraded":"2023-07-25T14:37:05.361199+0000","last_fullsized":"2023-07-25T14:37:05.361199+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_clean_scrub_stamp":"2023-07-25T14:37:02.240886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T15:14:16.938401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:04.279642+0000","last_change":"2023-07-25T14:36:50.206017+0000","last_active":"2023-07-25T14:37:04.279642+0000","last_peered":"2023-07-25T14:37:04.279642+0000","last_clean":"2023-07-25T14:37:04.279642+0000","last_became_active":"2023-07-25T14:36:50.205693+0000","last_became_peered":"2023-07-25T14:36:50.205693+0000","last_unstale":"2023-07-25T14:37:04.279642+0000","last_undegraded":"2023-07-25T14:37:04.279642+0000","last_fullsized":"2023-07-25T14:37:04.279642+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T23:59:04.061677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.364149+0000","last_change":"2023-07-25T14:37:03.297136+0000","last_active":"2023-07-25T14:37:05.364149+0000","last_peered":"2023-07-25T14:37:05.364149+0000","last_clean":"2023-07-25T14:37:05.364149+0000","last_became_active":"2023-07-25T14:37:03.296853+0000","last_became_peered":"2023-07-25T14:37:03.296853+0000","last_unstale":"2023-07-25T14:37:05.364149+0000","last_undegraded":"2023-07-25T14:37:05.364149+0000","last_fullsized":"2023-07-25T14:37:05.364149+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_clean_scrub_stamp":"2023-07-25T14:37:02.240886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T22:51:54.187574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.360726+0000","last_change":"2023-07-25T14:36:50.212013+0000","last_active":"2023-07-25T14:37:05.360726+0000","last_peered":"2023-07-25T14:37:05.360726+0000","last_clean":"2023-07-25T14:37:05.360726+0000","last_became_active":"2023-07-25T14:36:50.211722+0000","last_became_peered":"2023-07-25T14:36:50.211722+0000","last_unstale":"2023-07-25T14:37:05.360726+0000","last_undegraded":"2023-07-25T14:37:05.360726+0000","last_fullsized":"2023-07-25T14:37:05.360726+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T02:12:52.790653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3f","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.361659+0000","last_change":"2023-07-25T14:37:03.295102+0000","last_active":"2023-07-25T14:37:05.361659+0000","last_peered":"2023-07-25T14:37:05.361659+0000","last_clean":"2023-07-25T14:37:05.361659+0000","last_became_active":"2023-07-25T14:37:03.294834+0000","last_became_peered":"2023-07-25T14:37:03.294834+0000","last_unstale":"2023-07-25T14:37:05.361659+0000","last_undegraded":"2023-07-25T14:37:05.361659+0000","last_fullsized":"2023-07-25T14:37:05.361659+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_clean_scrub_stamp":"2023-07-25T14:37:02.240886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T20:22:05.098648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.362701+0000","last_change":"2023-07-25T14:36:50.204379+0000","last_active":"2023-07-25T14:37:05.362701+0000","last_peered":"2023-07-25T14:37:05.362701+0000","last_clean":"2023-07-25T14:37:05.362701+0000","last_became_active":"2023-07-25T14:36:50.203202+0000","last_became_peered":"2023-07-25T14:36:50.203202+0000","last_unstale":"2023-07-25T14:37:05.362701+0000","last_undegraded":"2023-07-25T14:37:05.362701+0000","last_fullsized":"2023-07-25T14:37:05.362701+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T14:38:04.645962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:04.280212+0000","last_change":"2023-07-25T14:37:03.284729+0000","last_active":"2023-07-25T14:37:04.280212+0000","last_peered":"2023-07-25T14:37:04.280212+0000","last_clean":"2023-07-25T14:37:04.280212+0000","last_became_active":"2023-07-25T14:37:03.284410+0000","last_became_peered":"2023-07-25T14:37:03.284410+0000","last_unstale":"2023-07-25T14:37:04.280212+0000","last_undegraded":"2023-07-25T14:37:04.280212+0000","last_fullsized":"2023-07-25T14:37:04.280212+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_clean_scrub_stamp":"2023-07-25T14:37:02.240886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T20:29:08.115324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:04.274069+0000","last_change":"2023-07-25T14:36:50.206731+0000","last_active":"2023-07-25T14:37:04.274069+0000","last_peered":"2023-07-25T14:37:04.274069+0000","last_clean":"2023-07-25T14:37:04.274069+0000","last_became_active":"2023-07-25T14:36:50.206426+0000","last_became_peered":"2023-07-25T14:36:50.206426+0000","last_unstale":"2023-07-25T14:37:04.274069+0000","last_undegraded":"2023-07-25T14:37:04.274069+0000","last_fullsized":"2023-07-25T14:37:04.274069+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:14:08.412757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.303177+0000","last_change":"2023-07-25T14:37:03.295003+0000","last_active":"2023-07-25T14:37:05.303177+0000","last_peered":"2023-07-25T14:37:05.303177+0000","last_clean":"2023-07-25T14:37:05.303177+0000","last_became_active":"2023-07-25T14:37:03.294561+0000","last_became_peered":"2023-07-25T14:37:03.294561+0000","last_unstale":"2023-07-25T14:37:05.303177+0000","last_undegraded":"2023-07-25T14:37:05.303177+0000","last_fullsized":"2023-07-25T14:37:05.303177+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_clean_scrub_stamp":"2023-07-25T14:37:02.240886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T01:04:24.897540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.361603+0000","last_change":"2023-07-25T14:36:50.200453+0000","last_active":"2023-07-25T14:37:05.361603+0000","last_peered":"2023-07-25T14:37:05.361603+0000","last_clean":"2023-07-25T14:37:05.361603+0000","last_became_active":"2023-07-25T14:36:50.200070+0000","last_became_peered":"2023-07-25T14:36:50.200070+0000","last_unstale":"2023-07-25T14:37:05.361603+0000","last_undegraded":"2023-07-25T14:37:05.361603+0000","last_fullsized":"2023-07-25T14:37:05.361603+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T20:42:15.910532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:04.273816+0000","last_change":"2023-07-25T14:37:03.292563+0000","last_active":"2023-07-25T14:37:04.273816+0000","last_peered":"2023-07-25T14:37:04.273816+0000","last_clean":"2023-07-25T14:37:04.273816+0000","last_became_active":"2023-07-25T14:37:03.292269+0000","last_became_peered":"2023-07-25T14:37:03.292269+0000","last_unstale":"2023-07-25T14:37:04.273816+0000","last_undegraded":"2023-07-25T14:37:04.273816+0000","last_fullsized":"2023-07-25T14:37:04.273816+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_clean_scrub_stamp":"2023-07-25T14:37:02.240886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T16:23:10.727951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:04.279415+0000","last_change":"2023-07-25T14:36:50.199364+0000","last_active":"2023-07-25T14:37:04.279415+0000","last_peered":"2023-07-25T14:37:04.279415+0000","last_clean":"2023-07-25T14:37:04.279415+0000","last_became_active":"2023-07-25T14:36:50.198943+0000","last_became_peered":"2023-07-25T14:36:50.198943+0000","last_unstale":"2023-07-25T14:37:04.279415+0000","last_undegraded":"2023-07-25T14:37:04.279415+0000","last_fullsized":"2023-07-25T14:37:04.279415+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T19:11:42.787555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.361372+0000","last_change":"2023-07-25T14:37:03.285468+0000","last_active":"2023-07-25T14:37:05.361372+0000","last_peered":"2023-07-25T14:37:05.361372+0000","last_clean":"2023-07-25T14:37:05.361372+0000","last_became_active":"2023-07-25T14:37:03.285119+0000","last_became_peered":"2023-07-25T14:37:03.285119+0000","last_unstale":"2023-07-25T14:37:05.361372+0000","last_undegraded":"2023-07-25T14:37:05.361372+0000","last_fullsized":"2023-07-25T14:37:05.361372+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_clean_scrub_stamp":"2023-07-25T14:37:02.240886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T22:48:17.277203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:04.274510+0000","last_change":"2023-07-25T14:36:50.206841+0000","last_active":"2023-07-25T14:37:04.274510+0000","last_peered":"2023-07-25T14:37:04.274510+0000","last_clean":"2023-07-25T14:37:04.274510+0000","last_became_active":"2023-07-25T14:36:50.206563+0000","last_became_peered":"2023-07-25T14:36:50.206563+0000","last_unstale":"2023-07-25T14:37:04.274510+0000","last_undegraded":"2023-07-25T14:37:04.274510+0000","last_fullsized":"2023-07-25T14:37:04.274510+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T21:27:10.124827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.362657+0000","last_change":"2023-07-25T14:37:03.295094+0000","last_active":"2023-07-25T14:37:05.362657+0000","last_peered":"2023-07-25T14:37:05.362657+0000","last_clean":"2023-07-25T14:37:05.362657+0000","last_became_active":"2023-07-25T14:37:03.294714+0000","last_became_peered":"2023-07-25T14:37:03.294714+0000","last_unstale":"2023-07-25T14:37:05.362657+0000","last_undegraded":"2023-07-25T14:37:05.362657+0000","last_fullsized":"2023-07-25T14:37:05.362657+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_clean_scrub_stamp":"2023-07-25T14:37:02.240886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T20:02:55.863984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:04.274889+0000","last_change":"2023-07-25T14:36:50.202401+0000","last_active":"2023-07-25T14:37:04.274889+0000","last_peered":"2023-07-25T14:37:04.274889+0000","last_clean":"2023-07-25T14:37:04.274889+0000","last_became_active":"2023-07-25T14:36:50.202122+0000","last_became_peered":"2023-07-25T14:36:50.202122+0000","last_unstale":"2023-07-25T14:37:04.274889+0000","last_undegraded":"2023-07-25T14:37:04.274889+0000","last_fullsized":"2023-07-25T14:37:04.274889+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T15:18:03.100506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:04.278986+0000","last_change":"2023-07-25T14:37:03.282301+0000","last_active":"2023-07-25T14:37:04.278986+0000","last_peered":"2023-07-25T14:37:04.278986+0000","last_clean":"2023-07-25T14:37:04.278986+0000","last_became_active":"2023-07-25T14:37:03.281898+0000","last_became_peered":"2023-07-25T14:37:03.281898+0000","last_unstale":"2023-07-25T14:37:04.278986+0000","last_undegraded":"2023-07-25T14:37:04.278986+0000","last_fullsized":"2023-07-25T14:37:04.278986+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_clean_scrub_stamp":"2023-07-25T14:37:02.240886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T18:09:05.593042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:04.274679+0000","last_change":"2023-07-25T14:36:50.207115+0000","last_active":"2023-07-25T14:37:04.274679+0000","last_peered":"2023-07-25T14:37:04.274679+0000","last_clean":"2023-07-25T14:37:04.274679+0000","last_became_active":"2023-07-25T14:36:50.206848+0000","last_became_peered":"2023-07-25T14:36:50.206848+0000","last_unstale":"2023-07-25T14:37:04.274679+0000","last_undegraded":"2023-07-25T14:37:04.274679+0000","last_fullsized":"2023-07-25T14:37:04.274679+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:29:16.803888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.363288+0000","last_change":"2023-07-25T14:37:03.280417+0000","last_active":"2023-07-25T14:37:05.363288+0000","last_peered":"2023-07-25T14:37:05.363288+0000","last_clean":"2023-07-25T14:37:05.363288+0000","last_became_active":"2023-07-25T14:37:03.279600+0000","last_became_peered":"2023-07-25T14:37:03.279600+0000","last_unstale":"2023-07-25T14:37:05.363288+0000","last_undegraded":"2023-07-25T14:37:05.363288+0000","last_fullsized":"2023-07-25T14:37:05.363288+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_clean_scrub_stamp":"2023-07-25T14:37:02.240886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T01:23:53.436485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:04.273653+0000","last_change":"2023-07-25T14:36:50.208542+0000","last_active":"2023-07-25T14:37:04.273653+0000","last_peered":"2023-07-25T14:37:04.273653+0000","last_clean":"2023-07-25T14:37:04.273653+0000","last_became_active":"2023-07-25T14:36:50.208292+0000","last_became_peered":"2023-07-25T14:36:50.208292+0000","last_unstale":"2023-07-25T14:37:04.273653+0000","last_undegraded":"2023-07-25T14:37:04.273653+0000","last_fullsized":"2023-07-25T14:37:04.273653+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:15:27.887140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:04.279445+0000","last_change":"2023-07-25T14:37:03.294175+0000","last_active":"2023-07-25T14:37:04.279445+0000","last_peered":"2023-07-25T14:37:04.279445+0000","last_clean":"2023-07-25T14:37:04.279445+0000","last_became_active":"2023-07-25T14:37:03.293812+0000","last_became_peered":"2023-07-25T14:37:03.293812+0000","last_unstale":"2023-07-25T14:37:04.279445+0000","last_undegraded":"2023-07-25T14:37:04.279445+0000","last_fullsized":"2023-07-25T14:37:04.279445+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_clean_scrub_stamp":"2023-07-25T14:37:02.240886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T19:35:14.086616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.302211+0000","last_change":"2023-07-25T14:36:50.205352+0000","last_active":"2023-07-25T14:37:05.302211+0000","last_peered":"2023-07-25T14:37:05.302211+0000","last_clean":"2023-07-25T14:37:05.302211+0000","last_became_active":"2023-07-25T14:36:50.205041+0000","last_became_peered":"2023-07-25T14:36:50.205041+0000","last_unstale":"2023-07-25T14:37:05.302211+0000","last_undegraded":"2023-07-25T14:37:05.302211+0000","last_fullsized":"2023-07-25T14:37:05.302211+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T16:46:15.062571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:04.279666+0000","last_change":"2023-07-25T14:37:03.287944+0000","last_active":"2023-07-25T14:37:04.279666+0000","last_peered":"2023-07-25T14:37:04.279666+0000","last_clean":"2023-07-25T14:37:04.279666+0000","last_became_active":"2023-07-25T14:37:03.287629+0000","last_became_peered":"2023-07-25T14:37:03.287629+0000","last_unstale":"2023-07-25T14:37:04.279666+0000","last_undegraded":"2023-07-25T14:37:04.279666+0000","last_fullsized":"2023-07-25T14:37:04.279666+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_clean_scrub_stamp":"2023-07-25T14:37:02.240886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T22:41:21.303941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.363850+0000","last_change":"2023-07-25T14:36:50.200879+0000","last_active":"2023-07-25T14:37:05.363850+0000","last_peered":"2023-07-25T14:37:05.363850+0000","last_clean":"2023-07-25T14:37:05.363850+0000","last_became_active":"2023-07-25T14:36:50.199174+0000","last_became_peered":"2023-07-25T14:36:50.199174+0000","last_unstale":"2023-07-25T14:37:05.363850+0000","last_undegraded":"2023-07-25T14:37:05.363850+0000","last_fullsized":"2023-07-25T14:37:05.363850+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T21:20:57.111964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.361023+0000","last_change":"2023-07-25T14:37:03.294946+0000","last_active":"2023-07-25T14:37:05.361023+0000","last_peered":"2023-07-25T14:37:05.361023+0000","last_clean":"2023-07-25T14:37:05.361023+0000","last_became_active":"2023-07-25T14:37:03.294416+0000","last_became_peered":"2023-07-25T14:37:03.294416+0000","last_unstale":"2023-07-25T14:37:05.361023+0000","last_undegraded":"2023-07-25T14:37:05.361023+0000","last_fullsized":"2023-07-25T14:37:05.361023+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_clean_scrub_stamp":"2023-07-25T14:37:02.240886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T18:38:50.140877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:04.280116+0000","last_change":"2023-07-25T14:36:50.209446+0000","last_active":"2023-07-25T14:37:04.280116+0000","last_peered":"2023-07-25T14:37:04.280116+0000","last_clean":"2023-07-25T14:37:04.280116+0000","last_became_active":"2023-07-25T14:36:50.209144+0000","last_became_peered":"2023-07-25T14:36:50.209144+0000","last_unstale":"2023-07-25T14:37:04.280116+0000","last_undegraded":"2023-07-25T14:37:04.280116+0000","last_fullsized":"2023-07-25T14:37:04.280116+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T16:38:34.985665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:04.279075+0000","last_change":"2023-07-25T14:37:03.292805+0000","last_active":"2023-07-25T14:37:04.279075+0000","last_peered":"2023-07-25T14:37:04.279075+0000","last_clean":"2023-07-25T14:37:04.279075+0000","last_became_active":"2023-07-25T14:37:03.292469+0000","last_became_peered":"2023-07-25T14:37:03.292469+0000","last_unstale":"2023-07-25T14:37:04.279075+0000","last_undegraded":"2023-07-25T14:37:04.279075+0000","last_fullsized":"2023-07-25T14:37:04.279075+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_clean_scrub_stamp":"2023-07-25T14:37:02.240886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T21:21:10.185758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:04.274059+0000","last_change":"2023-07-25T14:36:50.204689+0000","last_active":"2023-07-25T14:37:04.274059+0000","last_peered":"2023-07-25T14:37:04.274059+0000","last_clean":"2023-07-25T14:37:04.274059+0000","last_became_active":"2023-07-25T14:36:50.204430+0000","last_became_peered":"2023-07-25T14:36:50.204430+0000","last_unstale":"2023-07-25T14:37:04.274059+0000","last_undegraded":"2023-07-25T14:37:04.274059+0000","last_fullsized":"2023-07-25T14:37:04.274059+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T16:41:40.404575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.361328+0000","last_change":"2023-07-25T14:37:03.293189+0000","last_active":"2023-07-25T14:37:05.361328+0000","last_peered":"2023-07-25T14:37:05.361328+0000","last_clean":"2023-07-25T14:37:05.361328+0000","last_became_active":"2023-07-25T14:37:03.292966+0000","last_became_peered":"2023-07-25T14:37:03.292966+0000","last_unstale":"2023-07-25T14:37:05.361328+0000","last_undegraded":"2023-07-25T14:37:05.361328+0000","last_fullsized":"2023-07-25T14:37:05.361328+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_clean_scrub_stamp":"2023-07-25T14:37:02.240886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T23:34:14.960597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:04.279721+0000","last_change":"2023-07-25T14:36:50.211484+0000","last_active":"2023-07-25T14:37:04.279721+0000","last_peered":"2023-07-25T14:37:04.279721+0000","last_clean":"2023-07-25T14:37:04.279721+0000","last_became_active":"2023-07-25T14:36:50.211113+0000","last_became_peered":"2023-07-25T14:36:50.211113+0000","last_unstale":"2023-07-25T14:37:04.279721+0000","last_undegraded":"2023-07-25T14:37:04.279721+0000","last_fullsized":"2023-07-25T14:37:04.279721+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T20:48:19.881984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:04.273973+0000","last_change":"2023-07-25T14:37:03.292515+0000","last_active":"2023-07-25T14:37:04.273973+0000","last_peered":"2023-07-25T14:37:04.273973+0000","last_clean":"2023-07-25T14:37:04.273973+0000","last_became_active":"2023-07-25T14:37:03.292136+0000","last_became_peered":"2023-07-25T14:37:03.292136+0000","last_unstale":"2023-07-25T14:37:04.273973+0000","last_undegraded":"2023-07-25T14:37:04.273973+0000","last_fullsized":"2023-07-25T14:37:04.273973+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_clean_scrub_stamp":"2023-07-25T14:37:02.240886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T19:39:27.866088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:04.280073+0000","last_change":"2023-07-25T14:36:50.210983+0000","last_active":"2023-07-25T14:37:04.280073+0000","last_peered":"2023-07-25T14:37:04.280073+0000","last_clean":"2023-07-25T14:37:04.280073+0000","last_became_active":"2023-07-25T14:36:50.210721+0000","last_became_peered":"2023-07-25T14:36:50.210721+0000","last_unstale":"2023-07-25T14:37:04.280073+0000","last_undegraded":"2023-07-25T14:37:04.280073+0000","last_fullsized":"2023-07-25T14:37:04.280073+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T20:11:06.039462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:04.280165+0000","last_change":"2023-07-25T14:37:03.282507+0000","last_active":"2023-07-25T14:37:04.280165+0000","last_peered":"2023-07-25T14:37:04.280165+0000","last_clean":"2023-07-25T14:37:04.280165+0000","last_became_active":"2023-07-25T14:37:03.281535+0000","last_became_peered":"2023-07-25T14:37:03.281535+0000","last_unstale":"2023-07-25T14:37:04.280165+0000","last_undegraded":"2023-07-25T14:37:04.280165+0000","last_fullsized":"2023-07-25T14:37:04.280165+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:02.240886+0000","last_clean_scrub_stamp":"2023-07-25T14:37:02.240886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T21:07:51.429961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3f","version":"0'0","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-07-25T14:37:05.303006+0000","last_change":"2023-07-25T14:36:50.199855+0000","last_active":"2023-07-25T14:37:05.303006+0000","last_peered":"2023-07-25T14:37:05.303006+0000","last_clean":"2023-07-25T14:37:05.303006+0000","last_became_active":"2023-07-25T14:36:50.199464+0000","last_became_peered":"2023-07-25T14:36:50.199464+0000","last_unstale":"2023-07-25T14:37:05.303006+0000","last_undegraded":"2023-07-25T14:37:05.303006+0000","last_fullsized":"2023-07-25T14:37:05.303006+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:36:49.167092+0000","last_clean_scrub_stamp":"2023-07-25T14:36:49.167092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T16:08:54.000233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":3869,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64510,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574871,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27588,"kb_used_data":564,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344252,"statfs":{"total":96636764160,"available":96608514048,"internally_reserved":0,"allocated":577536,"data_stored":824181,"data_compressed":32255,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jul 25 14:36:37 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":9.1600000000000001,"5min":9.1600000000000001,"15min":9.1600000000000001},"last":0.502}]},{"osd":1,"last update":"Tue Jul 25 14:36:37 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.5009999999999999,"5min":1.5009999999999999,"15min":1.5009999999999999},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.526,"5min":1.526,"15min":1.526},"last":0.63500000000000001}]},{"osd":2,"last update":"Tue Jul 25 14:36:37 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":8.1739999999999995,"5min":8.1739999999999995,"15min":8.1739999999999995},"last":0.89700000000000002}]},{"osd":3,"last update":"Tue Jul 25 14:36:37 2023","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":7.2279999999999998,"5min":7.2279999999999998,"15min":7.2279999999999998},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":7.1870000000000003,"5min":7.1870000000000003,"15min":7.1870000000000003},"last":0.95099999999999996}]},{"osd":4,"last update":"Tue Jul 25 14:36:37 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.877}]},{"osd":5,"last update":"Tue Jul 25 14:36:37 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":1.0309999999999999},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.80000000000000004}]},{"osd":6,"last update":"Tue Jul 25 14:36:37 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.286,"5min":1.286,"15min":1.286},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.97199999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574870,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27516,"kb_used_data":496,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344324,"statfs":{"total":96636764160,"available":96608587776,"internally_reserved":0,"allocated":507904,"data_stored":234235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jul 25 14:36:32 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":1.9370000000000001,"5min":1.9370000000000001,"15min":1.9370000000000001},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":2.6779999999999999,"5min":2.6779999999999999,"15min":2.6779999999999999},"last":0.39700000000000002}]},{"osd":1,"last update":"Tue Jul 25 14:36:32 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":2.5720000000000001,"5min":2.5720000000000001,"15min":2.5720000000000001},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":1.6259999999999999,"5min":1.6259999999999999,"15min":1.6259999999999999},"last":0.47999999999999998}]},{"osd":2,"last update":"Tue Jul 25 14:36:32 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.45500000000000002}]},{"osd":3,"last update":"Tue Jul 25 14:36:32 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":3.5750000000000002,"5min":3.5750000000000002,"15min":3.5750000000000002},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":4.7190000000000003,"5min":4.7190000000000003,"15min":4.7190000000000003},"last":0.57299999999999995}]},{"osd":4,"last update":"Tue Jul 25 14:36:32 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":4.694,"5min":4.694,"15min":4.694},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":2.7839999999999998,"5min":2.7839999999999998,"15min":2.7839999999999998},"last":0.64300000000000002}]},{"osd":5,"last update":"Tue Jul 25 14:36:32 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.7310000000000001,"5min":1.7310000000000001,"15min":1.7310000000000001},"last":0.65900000000000003}]},{"osd":7,"last update":"Tue Jul 25 14:36:32 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":2.7290000000000001,"5min":2.7290000000000001,"15min":2.7290000000000001},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.61299999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574870,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27584,"kb_used_data":560,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344256,"statfs":{"total":96636764160,"available":96608518144,"internally_reserved":0,"allocated":573440,"data_stored":824091,"data_compressed":32255,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jul 25 14:36:34 2023","interfaces":[{"interface":"back","average":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"last":0.26600000000000001},{"interface":"front","average":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"last":0.36399999999999999}]},{"osd":2,"last update":"Tue Jul 25 14:36:34 2023","interfaces":[{"interface":"back","average":{"1min":0.309,"5min":0.309,"15min":0.309},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"last":0.28100000000000003},{"interface":"front","average":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"last":0.32000000000000001}]},{"osd":3,"last update":"Tue Jul 25 14:36:34 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.374,"15min":0.374},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.496,"5min":0.496,"15min":0.496},"last":0.251}]},{"osd":4,"last update":"Tue Jul 25 14:36:34 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.53600000000000003}]},{"osd":5,"last update":"Tue Jul 25 14:36:34 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.46300000000000002}]},{"osd":6,"last update":"Tue Jul 25 14:36:34 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.504},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.442}]},{"osd":7,"last update":"Tue Jul 25 14:36:34 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.58199999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574870,"num_pgs":61,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27524,"kb_used_data":504,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344316,"statfs":{"total":96636764160,"available":96608579584,"internally_reserved":0,"allocated":516096,"data_stored":234682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Jul 25 14:36:32 2023","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"min":{"1min":0.19600000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":6.5369999999999999,"5min":6.5369999999999999,"15min":6.5369999999999999},"last":0.31}]},{"osd":2,"last update":"Tue Jul 25 14:36:32 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.374,"15min":0.374},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.29099999999999998},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":6.5659999999999998,"5min":6.5659999999999998,"15min":6.5659999999999998},"last":0.36899999999999999}]},{"osd":3,"last update":"Tue Jul 25 14:36:32 2023","interfaces":[{"interface":"back","average":{"1min":1.026,"5min":1.026,"15min":1.026},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":12.449,"5min":12.449,"15min":12.449},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":1.079,"5min":1.079,"15min":1.079},"last":0.38400000000000001}]},{"osd":4,"last update":"Tue Jul 25 14:36:32 2023","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":6.5099999999999998,"5min":6.5099999999999998,"15min":6.5099999999999998},"last":0.51500000000000001},{"interface":"front","average":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":12.35,"5min":12.35,"15min":12.35},"last":0.63400000000000001}]},{"osd":5,"last update":"Tue Jul 25 14:36:32 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.107,"5min":1.107,"15min":1.107},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":6.4349999999999996,"5min":6.4349999999999996,"15min":6.4349999999999996},"last":0.57299999999999995}]},{"osd":6,"last update":"Tue Jul 25 14:36:32 2023","interfaces":[{"interface":"back","average":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":12.417,"5min":12.417,"15min":12.417},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.625}]},{"osd":7,"last update":"Tue Jul 25 14:36:32 2023","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":6.4809999999999999,"5min":6.4809999999999999,"15min":6.4809999999999999},"last":0.61099999999999999},{"interface":"front","average":{"1min":1.22,"5min":1.22,"15min":1.22},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":12.388999999999999,"5min":12.388999999999999,"15min":12.388999999999999},"last":0.54500000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574870,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27528,"kb_used_data":508,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344312,"statfs":{"total":96636764160,"available":96608575488,"internally_reserved":0,"allocated":520192,"data_stored":235651,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jul 25 14:36:31 2023","interfaces":[{"interface":"back","average":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":2.1030000000000002,"5min":2.1030000000000002,"15min":2.1030000000000002},"last":0.28999999999999998},{"interface":"front","average":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":16.969000000000001,"5min":16.969000000000001,"15min":16.969000000000001},"last":0.27100000000000002}]},{"osd":1,"last update":"Tue Jul 25 14:36:31 2023","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"last":0.37},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":1.111,"5min":1.111,"15min":1.111},"last":0.309}]},{"osd":3,"last update":"Tue Jul 25 14:36:31 2023","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":13.035,"5min":13.035,"15min":13.035},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.33100000000000002}]},{"osd":4,"last update":"Tue Jul 25 14:36:31 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":6.165,"5min":6.165,"15min":6.165},"last":0.63200000000000001},{"interface":"front","average":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":13.004,"5min":13.004,"15min":13.004},"last":0.51900000000000002}]},{"osd":5,"last update":"Tue Jul 25 14:36:31 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":6.226,"5min":6.226,"15min":6.226},"last":0.50800000000000001}]},{"osd":6,"last update":"Tue Jul 25 14:36:31 2023","interfaces":[{"interface":"back","average":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":12.974,"5min":12.974,"15min":12.974},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.621}]},{"osd":7,"last update":"Tue Jul 25 14:36:31 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":6.1989999999999998,"5min":6.1989999999999998,"15min":6.1989999999999998},"last":0.60099999999999998},{"interface":"front","average":{"1min":1.141,"5min":1.141,"15min":1.141},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":12.936999999999999,"5min":12.936999999999999,"15min":12.936999999999999},"last":0.55300000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574870,"num_pgs":59,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27524,"kb_used_data":504,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344316,"statfs":{"total":96636764160,"available":96608579584,"internally_reserved":0,"allocated":516096,"data_stored":233196,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jul 25 14:36:34 2023","interfaces":[{"interface":"back","average":{"1min":0.316,"5min":0.316,"15min":0.316},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"last":0.373}]},{"osd":1,"last update":"Tue Jul 25 14:36:34 2023","interfaces":[{"interface":"back","average":{"1min":0.307,"5min":0.307,"15min":0.307},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.378,"5min":0.378,"15min":0.378},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.376,"5min":0.376,"15min":0.376},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"last":0.29699999999999999}]},{"osd":2,"last update":"Tue Jul 25 14:36:34 2023","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.377,"15min":0.377},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.502,"5min":0.502,"15min":0.502},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.40799999999999997}]},{"osd":4,"last update":"Tue Jul 25 14:36:34 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.67800000000000005}]},{"osd":5,"last update":"Tue Jul 25 14:36:34 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.54500000000000004}]},{"osd":6,"last update":"Tue Jul 25 14:36:34 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.68999999999999995}]},{"osd":7,"last update":"Tue Jul 25 14:36:34 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.72899999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574870,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27532,"kb_used_data":512,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344308,"statfs":{"total":96636764160,"available":96608571392,"internally_reserved":0,"allocated":524288,"data_stored":238198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jul 25 14:36:33 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.46000000000000002}]},{"osd":1,"last update":"Tue Jul 25 14:36:33 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.42999999999999999}]},{"osd":2,"last update":"Tue Jul 25 14:36:33 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.623}]},{"osd":3,"last update":"Tue Jul 25 14:36:33 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.8720000000000001,"5min":1.8720000000000001,"15min":1.8720000000000001},"last":0.51800000000000002}]},{"osd":5,"last update":"Tue Jul 25 14:36:33 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.66000000000000003}]},{"osd":6,"last update":"Tue Jul 25 14:36:33 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.68899999999999995}]},{"osd":7,"last update":"Tue Jul 25 14:36:33 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.70199999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574870,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27520,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344320,"statfs":{"total":96636764160,"available":96608583680,"internally_reserved":0,"allocated":512000,"data_stored":234285,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jul 25 14:36:31 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":2.548,"5min":2.548,"15min":2.548},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.54700000000000004}]},{"osd":1,"last update":"Tue Jul 25 14:36:31 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.657,"5min":1.657,"15min":1.657},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.752,"5min":1.752,"15min":1.752},"last":0.65500000000000003}]},{"osd":2,"last update":"Tue Jul 25 14:36:31 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.498},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.64200000000000002}]},{"osd":3,"last update":"Tue Jul 25 14:36:31 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.627}]},{"osd":4,"last update":"Tue Jul 25 14:36:31 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.45300000000000001}]},{"osd":6,"last update":"Tue Jul 25 14:36:31 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.57299999999999995}]},{"osd":7,"last update":"Tue Jul 25 14:36:31 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.58499999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32255,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32255,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3071,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-25T14:37:07.786 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-07-25T14:37:07.786 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mon 'allow r' osd 'allow rw pool=cephfs2_data' mds allow 2023-07-25T14:37:07.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.930+0000 7f9f33b3c700 1 Processor -- start 2023-07-25T14:37:07.942 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.931+0000 7f9f33b3c700 1 -- start start 2023-07-25T14:37:07.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.931+0000 7f9f33b3c700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f9f2c151ba0 0x7f9f2c0c2230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:07.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.931+0000 7f9f33b3c700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f2c0c54f0 con 0x7f9f2c154d50 2023-07-25T14:37:07.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.931+0000 7f9f33b3c700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f2c0c6670 con 0x7f9f2c0c5f40 2023-07-25T14:37:07.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.931+0000 7f9f33b3c700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f2c0c5740 con 0x7f9f2c151ba0 2023-07-25T14:37:07.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.931+0000 7f9f320d9700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f9f2c154d50 0x7f9f2c15b970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:33206/0 (socket says 172.21.15.72:33206) 2023-07-25T14:37:07.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.931+0000 7f9f320d9700 1 -- 172.21.15.72:0/1568901822 learned_addr learned my addr 172.21.15.72:0/1568901822 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:37:07.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.932+0000 7f9f318d8700 1 --2- 172.21.15.72:0/1568901822 >> v2:172.21.15.92:3300/0 conn(0x7f9f2c151ba0 0x7f9f2c0c2230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:07.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.932+0000 7f9f308d6700 1 -- 172.21.15.72:0/1568901822 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1853525050 0 0) 0x7f9f2c0c54f0 con 0x7f9f2c154d50 2023-07-25T14:37:07.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.932+0000 7f9f308d6700 1 -- 172.21.15.72:0/1568901822 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9f180035b0 con 0x7f9f2c154d50 2023-07-25T14:37:07.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.932+0000 7f9f308d6700 1 -- 172.21.15.72:0/1568901822 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2130479715 0 0) 0x7f9f180035b0 con 0x7f9f2c154d50 2023-07-25T14:37:07.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.932+0000 7f9f308d6700 1 -- 172.21.15.72:0/1568901822 >> v2:172.21.15.92:3300/0 conn(0x7f9f2c151ba0 msgr2=0x7f9f2c0c2230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:07.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.932+0000 7f9f308d6700 1 --2- 172.21.15.72:0/1568901822 >> v2:172.21.15.92:3300/0 conn(0x7f9f2c151ba0 0x7f9f2c0c2230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:07.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.932+0000 7f9f308d6700 1 -- 172.21.15.72:0/1568901822 >> v1:172.21.15.92:6789/0 conn(0x7f9f2c0c5f40 legacy=0x7f9f2c154640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:07.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.932+0000 7f9f308d6700 1 -- 172.21.15.72:0/1568901822 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f2c0c5a20 con 0x7f9f2c154d50 2023-07-25T14:37:07.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.932+0000 7f9f308d6700 1 -- 172.21.15.72:0/1568901822 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2559588315 0 0) 0x7f9f240019f0 con 0x7f9f2c154d50 2023-07-25T14:37:07.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.932+0000 7f9f308d6700 1 -- 172.21.15.72:0/1568901822 >> v1:172.21.15.72:6789/0 conn(0x7f9f2c154d50 legacy=0x7f9f2c15b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:07.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.932+0000 7f9f308d6700 1 --2- 172.21.15.72:0/1568901822 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9f18003a00 0x7f9f18003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:07.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.932+0000 7f9f308d6700 1 --2- 172.21.15.72:0/1568901822 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9f18004850 0x7f9f18004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:07.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.932+0000 7f9f308d6700 1 --2- 172.21.15.72:0/1568901822 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9f18005210 0x7f9f1800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:07.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.932+0000 7f9f308d6700 1 -- 172.21.15.72:0/1568901822 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f2c0c5740 con 0x7f9f18004850 2023-07-25T14:37:07.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.932+0000 7f9f308d6700 1 -- 172.21.15.72:0/1568901822 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f1800c160 con 0x7f9f18003a00 2023-07-25T14:37:07.947 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.932+0000 7f9f308d6700 1 -- 172.21.15.72:0/1568901822 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f1800c320 con 0x7f9f18005210 2023-07-25T14:37:07.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.932+0000 7f9f310d7700 1 --2- 172.21.15.72:0/1568901822 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9f18004850 0x7f9f18004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:07.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.932+0000 7f9f318d8700 1 --2- 172.21.15.72:0/1568901822 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9f18003a00 0x7f9f18003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:07.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.932+0000 7f9f320d9700 1 --2- 172.21.15.72:0/1568901822 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9f18005210 0x7f9f1800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:07.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.932+0000 7f9f310d7700 1 -- 172.21.15.72:0/1568901822 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9f18005210 msgr2=0x7f9f1800ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:07.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.932+0000 7f9f310d7700 1 --2- 172.21.15.72:0/1568901822 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9f18005210 0x7f9f1800ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:07.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.932+0000 7f9f310d7700 1 -- 172.21.15.72:0/1568901822 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9f18003a00 msgr2=0x7f9f18003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:07.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.932+0000 7f9f310d7700 1 --2- 172.21.15.72:0/1568901822 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9f18003a00 0x7f9f18003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:07.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.932+0000 7f9f320d9700 1 -- 172.21.15.72:0/1568901822 reap_dead start 2023-07-25T14:37:07.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.932+0000 7f9f310d7700 1 -- 172.21.15.72:0/1568901822 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f180035b0 con 0x7f9f18004850 2023-07-25T14:37:07.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.933+0000 7f9f310d7700 1 --2- 172.21.15.72:0/1568901822 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9f18004850 0x7f9f18004cd0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f9f2c0c6320 tx=0x7f9f18005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71a76b0386297656 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:07.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.933+0000 7f9f308d6700 1 -- 172.21.15.72:0/1568901822 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f280052d0 con 0x7f9f18004850 2023-07-25T14:37:07.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.933+0000 7f9f308d6700 1 -- 172.21.15.72:0/1568901822 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f28005430 con 0x7f9f18004850 2023-07-25T14:37:07.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.933+0000 7f9f308d6700 1 -- 172.21.15.72:0/1568901822 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f280038a0 con 0x7f9f18004850 2023-07-25T14:37:07.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.933+0000 7f9f33b3c700 1 -- 172.21.15.72:0/1568901822 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9f18004850 msgr2=0x7f9f18004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:07.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.933+0000 7f9f33b3c700 1 --2- 172.21.15.72:0/1568901822 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9f18004850 0x7f9f18004cd0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f9f2c0c6320 tx=0x7f9f18005880 comp rx=0 tx=0).stop 2023-07-25T14:37:07.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.933+0000 7f9f33b3c700 1 -- 172.21.15.72:0/1568901822 shutdown_connections 2023-07-25T14:37:07.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.933+0000 7f9f33b3c700 1 --2- 172.21.15.72:0/1568901822 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9f18004850 0x7f9f18004cd0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:07.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.933+0000 7f9f33b3c700 1 -- 172.21.15.72:0/1568901822 >> 172.21.15.72:0/1568901822 conn(0x7f9f2c0a87e0 msgr2=0x7f9f2c0a8bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:07.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.933+0000 7f9f33b3c700 1 -- 172.21.15.72:0/1568901822 shutdown_connections 2023-07-25T14:37:07.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.933+0000 7f9f33b3c700 1 -- 172.21.15.72:0/1568901822 wait complete. 2023-07-25T14:37:07.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.935+0000 7f9f33b3c700 1 Processor -- start 2023-07-25T14:37:07.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.935+0000 7f9f33b3c700 1 -- start start 2023-07-25T14:37:07.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.935+0000 7f9f33b3c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9f18004850 0x7f9f2c153770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:07.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.935+0000 7f9f33b3c700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9f2c154330 0x7f9f2c1e5320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:07.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.935+0000 7f9f33b3c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9f2c1e5860 0x7f9f2c1e8670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:07.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.935+0000 7f9f33b3c700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f2c0be460 con 0x7f9f2c1e5860 2023-07-25T14:37:07.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.935+0000 7f9f33b3c700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f2c0c07b0 con 0x7f9f18004850 2023-07-25T14:37:07.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.935+0000 7f9f33b3c700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f2c0c0d70 con 0x7f9f2c154330 2023-07-25T14:37:07.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.935+0000 7f9f320d9700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9f2c1e5860 0x7f9f2c1e8670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:07.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.935+0000 7f9f320d9700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9f2c1e5860 0x7f9f2c1e8670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42482/0 (socket says 172.21.15.72:42482) 2023-07-25T14:37:07.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.935+0000 7f9f320d9700 1 -- 172.21.15.72:0/892166541 learned_addr learned my addr 172.21.15.72:0/892166541 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:37:07.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.935+0000 7f9f310d7700 1 --2- 172.21.15.72:0/892166541 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9f2c154330 0x7f9f2c1e5320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:07.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.935+0000 7f9f318d8700 1 --2- 172.21.15.72:0/892166541 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9f18004850 0x7f9f2c153770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:07.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.936+0000 7f9f320d9700 1 -- 172.21.15.72:0/892166541 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9f2c154330 msgr2=0x7f9f2c1e5320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:07.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.936+0000 7f9f320d9700 1 --2- 172.21.15.72:0/892166541 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9f2c154330 0x7f9f2c1e5320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:07.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.936+0000 7f9f320d9700 1 -- 172.21.15.72:0/892166541 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9f18004850 msgr2=0x7f9f2c153770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:07.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.936+0000 7f9f320d9700 1 --2- 172.21.15.72:0/892166541 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9f18004850 0x7f9f2c153770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:07.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.936+0000 7f9f320d9700 1 -- 172.21.15.72:0/892166541 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f2c0bdba0 con 0x7f9f2c1e5860 2023-07-25T14:37:07.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.936+0000 7f9f320d9700 1 --2- 172.21.15.72:0/892166541 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9f2c1e5860 0x7f9f2c1e8670 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f9f2c0c4fe0 tx=0x7f9f2400a640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:07.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.936+0000 7f9f227fc700 1 -- 172.21.15.72:0/892166541 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f240019e0 con 0x7f9f2c1e5860 2023-07-25T14:37:07.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.936+0000 7f9f227fc700 1 -- 172.21.15.72:0/892166541 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f2400ab40 con 0x7f9f2c1e5860 2023-07-25T14:37:07.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.936+0000 7f9f33b3c700 1 -- 172.21.15.72:0/892166541 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f2c0bde80 con 0x7f9f2c1e5860 2023-07-25T14:37:07.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.936+0000 7f9f227fc700 1 -- 172.21.15.72:0/892166541 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f240133f0 con 0x7f9f2c1e5860 2023-07-25T14:37:07.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.936+0000 7f9f33b3c700 1 -- 172.21.15.72:0/892166541 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f2c153cb0 con 0x7f9f2c1e5860 2023-07-25T14:37:07.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.937+0000 7f9f33b3c700 1 -- 172.21.15.72:0/892166541 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f2c04e470 con 0x7f9f2c1e5860 2023-07-25T14:37:07.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.937+0000 7f9f227fc700 1 -- 172.21.15.72:0/892166541 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9f24013760 con 0x7f9f2c1e5860 2023-07-25T14:37:07.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.938+0000 7f9f227fc700 1 --2- 172.21.15.72:0/892166541 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f9f1006ace0 0x7f9f1006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:07.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.938+0000 7f9f227fc700 1 -- 172.21.15.72:0/892166541 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 7238+0+0 (secure 0 0 0) 0x7f9f2408a270 con 0x7f9f2c1e5860 2023-07-25T14:37:07.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.938+0000 7f9f318d8700 1 --2- 172.21.15.72:0/892166541 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f9f1006ace0 0x7f9f1006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:07.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.938+0000 7f9f318d8700 1 --2- 172.21.15.72:0/892166541 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f9f1006ace0 0x7f9f1006d1a0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f9f1c009c60 tx=0x7f9f1c009210 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:07.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:07.942+0000 7f9f227fc700 1 -- 172.21.15.72:0/892166541 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f9f24054e80 con 0x7f9f2c1e5860 2023-07-25T14:37:08.050 INFO:tasks.ceph.mds.c.smithi072.stderr:2023-07-25T14:37:08.039+0000 7f7c6aa45700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-25T14:37:08.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:08.205+0000 7f9f33b3c700 1 -- 172.21.15.72:0/892166541 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs2_data", "mds", "allow"]} v 0) v1 -- 0x7f9f2c0c52d0 con 0x7f9f2c1e5860 2023-07-25T14:37:08.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:08.208+0000 7f9f227fc700 1 -- 172.21.15.72:0/892166541 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs2_data", "mds", "allow"]}]=0 updated caps for client.1 v14) v1 ==== 185+0+142 (secure 0 0 0) 0x7f9f240584a0 con 0x7f9f2c1e5860 2023-07-25T14:37:08.220 INFO:teuthology.orchestra.run.smithi072.stdout:[client.1] 2023-07-25T14:37:08.220 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQCI3b9kRPMxKxAAACbj386PGidKwcHoe2J57A== 2023-07-25T14:37:08.220 INFO:teuthology.orchestra.run.smithi072.stdout: caps mds = "allow" 2023-07-25T14:37:08.220 INFO:teuthology.orchestra.run.smithi072.stdout: caps mon = "allow r" 2023-07-25T14:37:08.220 INFO:teuthology.orchestra.run.smithi072.stdout: caps osd = "allow rw pool=cephfs2_data" 2023-07-25T14:37:08.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:08.210+0000 7f9f33b3c700 1 -- 172.21.15.72:0/892166541 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f9f1006ace0 msgr2=0x7f9f1006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:08.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:08.210+0000 7f9f33b3c700 1 --2- 172.21.15.72:0/892166541 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f9f1006ace0 0x7f9f1006d1a0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f9f1c009c60 tx=0x7f9f1c009210 comp rx=0 tx=0).stop 2023-07-25T14:37:08.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:08.210+0000 7f9f33b3c700 1 -- 172.21.15.72:0/892166541 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9f2c1e5860 msgr2=0x7f9f2c1e8670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:08.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:08.210+0000 7f9f33b3c700 1 --2- 172.21.15.72:0/892166541 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9f2c1e5860 0x7f9f2c1e8670 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f9f2c0c4fe0 tx=0x7f9f2400a640 comp rx=0 tx=0).stop 2023-07-25T14:37:08.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:08.210+0000 7f9f33b3c700 1 -- 172.21.15.72:0/892166541 shutdown_connections 2023-07-25T14:37:08.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:08.210+0000 7f9f33b3c700 1 --2- 172.21.15.72:0/892166541 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f9f1006ace0 0x7f9f1006d1a0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:08.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:08.210+0000 7f9f33b3c700 1 --2- 172.21.15.72:0/892166541 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9f2c1e5860 0x7f9f2c1e8670 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:08.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:08.210+0000 7f9f33b3c700 1 --2- 172.21.15.72:0/892166541 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9f18004850 0x7f9f2c153770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:08.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:08.210+0000 7f9f33b3c700 1 --2- 172.21.15.72:0/892166541 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9f2c154330 0x7f9f2c1e5320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:08.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:08.210+0000 7f9f33b3c700 1 -- 172.21.15.72:0/892166541 >> 172.21.15.72:0/892166541 conn(0x7f9f2c0a87e0 msgr2=0x7f9f2c0c4600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:08.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:08.211+0000 7f9f33b3c700 1 -- 172.21.15.72:0/892166541 shutdown_connections 2023-07-25T14:37:08.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:08.211+0000 7f9f33b3c700 1 -- 172.21.15.72:0/892166541 wait complete. 2023-07-25T14:37:08.224 INFO:teuthology.orchestra.run.smithi072.stderr:updated caps for client.1 2023-07-25T14:37:08.233 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-07-25T14:37:08.234 DEBUG:teuthology.orchestra.run.smithi092:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-25T14:37:08.256 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-07-25T14:37:08.257 DEBUG:teuthology.orchestra.run.smithi092:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-25T14:37:08.317 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-25T14:37:08.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:08.425+0000 7f0233c45700 1 Processor -- start 2023-07-25T14:37:08.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:08.426+0000 7f0233c45700 1 -- start start 2023-07-25T14:37:08.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:08.426+0000 7f0233c45700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f022c0bfaf0 0x7f022c0bfed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:08.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:08.426+0000 7f0233c45700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f022c0bb350 0x7f022c06c910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:08.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:08.426+0000 7f0233c45700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f022c0bc790 con 0x7f022c0bbcf0 2023-07-25T14:37:08.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:08.426+0000 7f0233c45700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f022c06e1a0 con 0x7f022c0bb350 2023-07-25T14:37:08.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:08.426+0000 7f0233c45700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f022c06f6b0 con 0x7f022c0bfaf0 2023-07-25T14:37:08.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:08.427+0000 7f02321e2700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f022c0bb350 0x7f022c06c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:08.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:08.427+0000 7f02321e2700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f022c0bb350 0x7f022c06c910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42490/0 (socket says 172.21.15.72:42490) 2023-07-25T14:37:08.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:08.427+0000 7f02311e0700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f022c0bbcf0 0x7f022c06efa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:33222/0 (socket says 172.21.15.72:33222) 2023-07-25T14:37:08.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:08.427+0000 7f02321e2700 1 -- 172.21.15.72:0/3096189789 learned_addr learned my addr 172.21.15.72:0/3096189789 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:37:08.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:08.427+0000 7f02319e1700 1 --2- 172.21.15.72:0/3096189789 >> v2:172.21.15.92:3300/0 conn(0x7f022c0bfaf0 0x7f022c0bfed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:08.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:08.427+0000 7f02321e2700 1 -- 172.21.15.72:0/3096189789 >> v2:172.21.15.92:3300/0 conn(0x7f022c0bfaf0 msgr2=0x7f022c0bfed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:08.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:08.427+0000 7f02321e2700 1 --2- 172.21.15.72:0/3096189789 >> v2:172.21.15.92:3300/0 conn(0x7f022c0bfaf0 0x7f022c0bfed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:08.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:08.427+0000 7f02321e2700 1 -- 172.21.15.72:0/3096189789 >> v1:172.21.15.72:6789/0 conn(0x7f022c0bbcf0 legacy=0x7f022c06efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:08.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:08.427+0000 7f02321e2700 1 -- 172.21.15.72:0/3096189789 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f022c0c0900 con 0x7f022c0bb350 2023-07-25T14:37:08.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:08.427+0000 7f02309df700 1 -- 172.21.15.72:0/3096189789 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 982070562 0 0) 0x7f022c0bc790 con 0x7f022c0bbcf0 2023-07-25T14:37:08.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:08.427+0000 7f02321e2700 1 --2- 172.21.15.72:0/3096189789 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f022c0bb350 0x7f022c06c910 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f022c06bab0 tx=0x7f022400c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a5d4303984230eb server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:08.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:08.427+0000 7f02309df700 1 -- 172.21.15.72:0/3096189789 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f022400c9c0 con 0x7f022c0bb350 2023-07-25T14:37:08.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:08.427+0000 7f02309df700 1 -- 172.21.15.72:0/3096189789 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f022400cb20 con 0x7f022c0bb350 2023-07-25T14:37:08.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:08.427+0000 7f02309df700 1 -- 172.21.15.72:0/3096189789 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0224008500 con 0x7f022c0bb350 2023-07-25T14:37:08.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:08.428+0000 7f0233c45700 1 -- 172.21.15.72:0/3096189789 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f022c0bb350 msgr2=0x7f022c06c910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:08.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:08.428+0000 7f0233c45700 1 --2- 172.21.15.72:0/3096189789 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f022c0bb350 0x7f022c06c910 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f022c06bab0 tx=0x7f022400c330 comp rx=0 tx=0).stop 2023-07-25T14:37:08.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:08.428+0000 7f0233c45700 1 -- 172.21.15.72:0/3096189789 shutdown_connections 2023-07-25T14:37:08.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:08.428+0000 7f0233c45700 1 --2- 172.21.15.72:0/3096189789 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f022c0bb350 0x7f022c06c910 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:08.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:08.428+0000 7f0233c45700 1 --2- 172.21.15.72:0/3096189789 >> v2:172.21.15.92:3300/0 conn(0x7f022c0bfaf0 0x7f022c0bfed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:08.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:08.428+0000 7f0233c45700 1 -- 172.21.15.72:0/3096189789 >> 172.21.15.72:0/3096189789 conn(0x7f022c071bf0 msgr2=0x7f022c06a190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:08.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:08.428+0000 7f0233c45700 1 -- 172.21.15.72:0/3096189789 shutdown_connections 2023-07-25T14:37:08.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:08.428+0000 7f0233c45700 1 -- 172.21.15.72:0/3096189789 wait complete. 2023-07-25T14:37:08.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:08.429+0000 7f0233c45700 1 Processor -- start 2023-07-25T14:37:08.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:08.429+0000 7f0233c45700 1 -- start start 2023-07-25T14:37:08.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:08.430+0000 7f0233c45700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f022c0bb350 0x7f022c0be0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:08.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:08.430+0000 7f0233c45700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f022c0bfaf0 0x7f022c1e68b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:08.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:08.430+0000 7f0233c45700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f022c0be5e0 0x7f022c1e6df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:08.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:08.430+0000 7f0233c45700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f022c147750 con 0x7f022c0bfaf0 2023-07-25T14:37:08.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:08.430+0000 7f0233c45700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f022c0c5420 con 0x7f022c0be5e0 2023-07-25T14:37:08.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:08.430+0000 7f0233c45700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f022c1e9330 con 0x7f022c0bb350 2023-07-25T14:37:08.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:08.430+0000 7f02311e0700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f022c0bfaf0 0x7f022c1e68b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:08.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:08.430+0000 7f02311e0700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f022c0bfaf0 0x7f022c1e68b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42494/0 (socket says 172.21.15.72:42494) 2023-07-25T14:37:08.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:08.430+0000 7f02311e0700 1 -- 172.21.15.72:0/2301878399 learned_addr learned my addr 172.21.15.72:0/2301878399 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:37:08.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:08.430+0000 7f02319e1700 1 --2- 172.21.15.72:0/2301878399 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f022c0bb350 0x7f022c0be0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:08.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:08.430+0000 7f02321e2700 1 --2- 172.21.15.72:0/2301878399 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f022c0be5e0 0x7f022c1e6df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:08.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:08.430+0000 7f02311e0700 1 -- 172.21.15.72:0/2301878399 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f022c0bb350 msgr2=0x7f022c0be0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:08.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:08.430+0000 7f02311e0700 1 --2- 172.21.15.72:0/2301878399 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f022c0bb350 0x7f022c0be0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:08.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:08.430+0000 7f02311e0700 1 -- 172.21.15.72:0/2301878399 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f022c0be5e0 msgr2=0x7f022c1e6df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:08.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:08.430+0000 7f02311e0700 1 --2- 172.21.15.72:0/2301878399 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f022c0be5e0 0x7f022c1e6df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:08.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:08.430+0000 7f02311e0700 1 -- 172.21.15.72:0/2301878399 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f022400ac40 con 0x7f022c0bfaf0 2023-07-25T14:37:08.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:08.430+0000 7f02319e1700 1 --2- 172.21.15.72:0/2301878399 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f022c0bb350 0x7f022c0be0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-25T14:37:08.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:08.430+0000 7f02311e0700 1 --2- 172.21.15.72:0/2301878399 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f022c0bfaf0 0x7f022c1e68b0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f022800c540 tx=0x7f022800c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:08.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:08.430+0000 7f02227fc700 1 -- 172.21.15.72:0/2301878399 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0228004c80 con 0x7f022c0bfaf0 2023-07-25T14:37:08.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:08.430+0000 7f02227fc700 1 -- 172.21.15.72:0/2301878399 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0228004de0 con 0x7f022c0bfaf0 2023-07-25T14:37:08.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:08.430+0000 7f0233c45700 1 -- 172.21.15.72:0/2301878399 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f022c1e9610 con 0x7f022c0bfaf0 2023-07-25T14:37:08.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:08.430+0000 7f02227fc700 1 -- 172.21.15.72:0/2301878399 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0228007310 con 0x7f022c0bfaf0 2023-07-25T14:37:08.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:08.430+0000 7f0233c45700 1 -- 172.21.15.72:0/2301878399 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f022c0c59c0 con 0x7f022c0bfaf0 2023-07-25T14:37:08.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:08.431+0000 7f0233c45700 1 -- 172.21.15.72:0/2301878399 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f022c0c5280 con 0x7f022c0bfaf0 2023-07-25T14:37:08.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:08.432+0000 7f02227fc700 1 -- 172.21.15.72:0/2301878399 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0228007470 con 0x7f022c0bfaf0 2023-07-25T14:37:08.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:08.432+0000 7f02227fc700 1 --2- 172.21.15.72:0/2301878399 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f021006ace0 0x7f021006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:08.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:08.432+0000 7f02227fc700 1 -- 172.21.15.72:0/2301878399 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 7238+0+0 (secure 0 0 0) 0x7f0228089720 con 0x7f022c0bfaf0 2023-07-25T14:37:08.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:08.432+0000 7f02319e1700 1 --2- 172.21.15.72:0/2301878399 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f021006ace0 0x7f021006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:08.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:08.433+0000 7f02319e1700 1 --2- 172.21.15.72:0/2301878399 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f021006ace0 0x7f021006d1a0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f021c00ba00 tx=0x7f021c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:08.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:08.437+0000 7f02227fc700 1 -- 172.21.15.72:0/2301878399 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f022c0c5280 con 0x7f022c0bfaf0 2023-07-25T14:37:08.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:08.623+0000 7f0233c45700 1 -- 172.21.15.72:0/2301878399 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f022c0c5280 con 0x7f022c0bfaf0 2023-07-25T14:37:08.635 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:08.624+0000 7f02227fc700 1 -- 172.21.15.72:0/2301878399 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) v1 ==== 74+0+22106 (secure 0 0 0) 0x7f022c0c5280 con 0x7f022c0bfaf0 2023-07-25T14:37:08.636 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-25T14:37:08.636 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":43,"fsid":"9170db48-9170-43e8-8ccb-9813e6240906","created":"2023-07-25T14:35:21.733262+0000","modified":"2023-07-25T14:37:04.264643+0000","last_up_change":"2023-07-25T14:35:31.355010+0000","last_in_change":"2023-07-25T14:35:24.195785+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-25T14:35:32.983457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-25T14:35:33.326342+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-07-25T14:36:47.694223+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-07-25T14:36:48.536715+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs2_metadata","create_time":"2023-07-25T14:37:01.238292+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs2_data","create_time":"2023-07-25T14:37:01.609127+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d517fdad-0bfe-49f0-89f2-9421c3761839","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6801","nonce":2475407414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6803","nonce":2475407414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6807","nonce":2475407414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6805","nonce":2475407414}]},"public_addr":"172.21.15.72:6801/2475407414","cluster_addr":"172.21.15.72:6803/2475407414","heartbeat_back_addr":"172.21.15.72:6807/2475407414","heartbeat_front_addr":"172.21.15.72:6805/2475407414","state":["exists","up"]},{"osd":1,"uuid":"e1564be3-f209-47e5-a8d0-32fc618a474f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6822","nonce":870954016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6825","nonce":870954016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6831","nonce":870954016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6827","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6829","nonce":870954016}]},"public_addr":"172.21.15.72:6822/870954016","cluster_addr":"172.21.15.72:6825/870954016","heartbeat_back_addr":"172.21.15.72:6831/870954016","heartbeat_front_addr":"172.21.15.72:6829/870954016","state":["exists","up"]},{"osd":2,"uuid":"c4647d30-ffa6-417a-9026-ef530c75910e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6809","nonce":2143129442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6811","nonce":2143129442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6815","nonce":2143129442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6813","nonce":2143129442}]},"public_addr":"172.21.15.72:6809/2143129442","cluster_addr":"172.21.15.72:6811/2143129442","heartbeat_back_addr":"172.21.15.72:6815/2143129442","heartbeat_front_addr":"172.21.15.72:6813/2143129442","state":["exists","up"]},{"osd":3,"uuid":"76c9d9a7-c2e2-4612-a58b-d6882dd76b58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6817","nonce":3404066311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6819","nonce":3404066311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6828","nonce":3404066311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6821","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6823","nonce":3404066311}]},"public_addr":"172.21.15.72:6817/3404066311","cluster_addr":"172.21.15.72:6819/3404066311","heartbeat_back_addr":"172.21.15.72:6828/3404066311","heartbeat_front_addr":"172.21.15.72:6823/3404066311","state":["exists","up"]},{"osd":4,"uuid":"7f8920dc-0ad4-4a73-ab40-65408f83eadd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6817","nonce":2381008739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6819","nonce":2381008739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6825","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6827","nonce":2381008739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6822","nonce":2381008739}]},"public_addr":"172.21.15.92:6817/2381008739","cluster_addr":"172.21.15.92:6819/2381008739","heartbeat_back_addr":"172.21.15.92:6827/2381008739","heartbeat_front_addr":"172.21.15.92:6822/2381008739","state":["exists","up"]},{"osd":5,"uuid":"56257e7c-31eb-44c5-9ec7-1318a4e0bb35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6801","nonce":2161935604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6803","nonce":2161935604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6807","nonce":2161935604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6805","nonce":2161935604}]},"public_addr":"172.21.15.92:6801/2161935604","cluster_addr":"172.21.15.92:6803/2161935604","heartbeat_back_addr":"172.21.15.92:6807/2161935604","heartbeat_front_addr":"172.21.15.92:6805/2161935604","state":["exists","up"]},{"osd":6,"uuid":"a150d3d8-a0c9-4955-968a-8d98eff4ffb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6809","nonce":3770163493}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6811","nonce":3770163493}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6815","nonce":3770163493}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6813","nonce":3770163493}]},"public_addr":"172.21.15.92:6809/3770163493","cluster_addr":"172.21.15.92:6811/3770163493","heartbeat_back_addr":"172.21.15.92:6815/3770163493","heartbeat_front_addr":"172.21.15.92:6813/3770163493","state":["exists","up"]},{"osd":7,"uuid":"07799c27-54ee-4591-a42d-a978d6b32065","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6821","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6823","nonce":2135777609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6826","nonce":2135777609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6831","nonce":2135777609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6829","nonce":2135777609}]},"public_addr":"172.21.15.92:6823/2135777609","cluster_addr":"172.21.15.92:6826/2135777609","heartbeat_back_addr":"172.21.15.92:6831/2135777609","heartbeat_front_addr":"172.21.15.92:6829/2135777609","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.345365+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.378150+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.146566+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.372172+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:30.398421+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.385632+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.465611+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.443583+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-25T14:37:08.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:08.626+0000 7f0233c45700 1 -- 172.21.15.72:0/2301878399 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f021006ace0 msgr2=0x7f021006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:08.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:08.626+0000 7f0233c45700 1 --2- 172.21.15.72:0/2301878399 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f021006ace0 0x7f021006d1a0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f021c00ba00 tx=0x7f021c008040 comp rx=0 tx=0).stop 2023-07-25T14:37:08.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:08.626+0000 7f0233c45700 1 -- 172.21.15.72:0/2301878399 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f022c0bfaf0 msgr2=0x7f022c1e68b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:08.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:08.626+0000 7f0233c45700 1 --2- 172.21.15.72:0/2301878399 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f022c0bfaf0 0x7f022c1e68b0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f022800c540 tx=0x7f022800c900 comp rx=0 tx=0).stop 2023-07-25T14:37:08.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:08.626+0000 7f0233c45700 1 -- 172.21.15.72:0/2301878399 shutdown_connections 2023-07-25T14:37:08.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:08.626+0000 7f0233c45700 1 --2- 172.21.15.72:0/2301878399 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f021006ace0 0x7f021006d1a0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:08.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:08.626+0000 7f0233c45700 1 --2- 172.21.15.72:0/2301878399 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f022c0bb350 0x7f022c0be0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:08.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:08.626+0000 7f0233c45700 1 --2- 172.21.15.72:0/2301878399 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f022c0be5e0 0x7f022c1e6df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:08.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:08.626+0000 7f0233c45700 1 --2- 172.21.15.72:0/2301878399 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f022c0bfaf0 0x7f022c1e68b0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:08.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:08.626+0000 7f0233c45700 1 -- 172.21.15.72:0/2301878399 >> 172.21.15.72:0/2301878399 conn(0x7f022c071bf0 msgr2=0x7f022c06c910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:08.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:08.626+0000 7f0233c45700 1 -- 172.21.15.72:0/2301878399 shutdown_connections 2023-07-25T14:37:08.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:08.626+0000 7f0233c45700 1 -- 172.21.15.72:0/2301878399 wait complete. 2023-07-25T14:37:08.649 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-07-25T14:35:32.983457+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-07-25T14:35:33.326342+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-25T14:36:47.694223+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2023-07-25T14:36:48.536715+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '39', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-07-25T14:37:01.238292+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '42', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs2_data', 'create_time': '2023-07-25T14:37:01.609127+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '43', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-25T14:37:08.650 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-25T14:37:08.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:08.761+0000 7f76cfb4d700 1 Processor -- start 2023-07-25T14:37:08.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:08.762+0000 7f76cfb4d700 1 -- start start 2023-07-25T14:37:08.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:08.762+0000 7f76cfb4d700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f76c8151950 0x7f76c806a190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:08.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:08.762+0000 7f76cfb4d700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76c80c2fe0 con 0x7f76c806a6d0 2023-07-25T14:37:08.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:08.762+0000 7f76cfb4d700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76c8155070 con 0x7f76c80724c0 2023-07-25T14:37:08.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:08.762+0000 7f76cfb4d700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76c8071a60 con 0x7f76c8151950 2023-07-25T14:37:08.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:08.762+0000 7f76ce0ea700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f76c806a6d0 0x7f76c80c3bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:33238/0 (socket says 172.21.15.72:33238) 2023-07-25T14:37:08.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:08.762+0000 7f76ce0ea700 1 -- 172.21.15.72:0/258181781 learned_addr learned my addr 172.21.15.72:0/258181781 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:37:08.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:08.763+0000 7f76cd8e9700 1 --2- 172.21.15.72:0/258181781 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f76c8151950 0x7f76c806a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:08.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:08.763+0000 7f76cc8e7700 1 -- 172.21.15.72:0/258181781 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2615274657 0 0) 0x7f76c80c2fe0 con 0x7f76c806a6d0 2023-07-25T14:37:08.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:08.763+0000 7f76cc8e7700 1 -- 172.21.15.72:0/258181781 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f76b40035b0 con 0x7f76c806a6d0 2023-07-25T14:37:08.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:08.763+0000 7f76cc8e7700 1 -- 172.21.15.72:0/258181781 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3182142107 0 0) 0x7f76b40035b0 con 0x7f76c806a6d0 2023-07-25T14:37:08.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:08.763+0000 7f76cc8e7700 1 -- 172.21.15.72:0/258181781 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f76c8151950 msgr2=0x7f76c806a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:08.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:08.763+0000 7f76cc8e7700 1 --2- 172.21.15.72:0/258181781 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f76c8151950 0x7f76c806a190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:08.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:08.763+0000 7f76cc8e7700 1 -- 172.21.15.72:0/258181781 >> v1:172.21.15.92:6789/0 conn(0x7f76c80724c0 legacy=0x7f76c80c34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:08.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:08.763+0000 7f76cc8e7700 1 -- 172.21.15.72:0/258181781 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76c80c15c0 con 0x7f76c806a6d0 2023-07-25T14:37:08.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:08.763+0000 7f76cc8e7700 1 -- 172.21.15.72:0/258181781 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2559588315 0 0) 0x7f76c00019f0 con 0x7f76c806a6d0 2023-07-25T14:37:08.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:08.763+0000 7f76cc8e7700 1 -- 172.21.15.72:0/258181781 >> v1:172.21.15.72:6789/0 conn(0x7f76c806a6d0 legacy=0x7f76c80c3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:08.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:08.763+0000 7f76cc8e7700 1 --2- 172.21.15.72:0/258181781 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f76b4003a30 0x7f76b4003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:08.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:08.763+0000 7f76cc8e7700 1 --2- 172.21.15.72:0/258181781 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f76b40043e0 0x7f76b40048b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:08.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:08.763+0000 7f76cc8e7700 1 --2- 172.21.15.72:0/258181781 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f76c8151950 0x7f76b40051b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:08.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:08.763+0000 7f76cc8e7700 1 -- 172.21.15.72:0/258181781 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76c8071a60 con 0x7f76b40043e0 2023-07-25T14:37:08.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:08.763+0000 7f76cc8e7700 1 -- 172.21.15.72:0/258181781 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76b400bac0 con 0x7f76b4003a30 2023-07-25T14:37:08.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:08.763+0000 7f76cc8e7700 1 -- 172.21.15.72:0/258181781 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76b400bc80 con 0x7f76c8151950 2023-07-25T14:37:08.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:08.763+0000 7f76cd0e8700 1 --2- 172.21.15.72:0/258181781 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f76b40043e0 0x7f76b40048b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:08.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:08.763+0000 7f76ce0ea700 1 --2- 172.21.15.72:0/258181781 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f76c8151950 0x7f76b40051b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:08.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:08.763+0000 7f76cd8e9700 1 --2- 172.21.15.72:0/258181781 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f76b4003a30 0x7f76b4003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:08.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:08.763+0000 7f76cd0e8700 1 -- 172.21.15.72:0/258181781 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f76c8151950 msgr2=0x7f76b40051b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:08.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:08.763+0000 7f76cd0e8700 1 --2- 172.21.15.72:0/258181781 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f76c8151950 0x7f76b40051b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:08.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:08.763+0000 7f76cd0e8700 1 -- 172.21.15.72:0/258181781 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f76b4003a30 msgr2=0x7f76b4003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:08.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:08.763+0000 7f76cd0e8700 1 --2- 172.21.15.72:0/258181781 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f76b4003a30 0x7f76b4003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:08.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:08.763+0000 7f76cd0e8700 1 -- 172.21.15.72:0/258181781 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76b40035b0 con 0x7f76b40043e0 2023-07-25T14:37:08.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:08.763+0000 7f76cd8e9700 1 --2- 172.21.15.72:0/258181781 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f76b4003a30 0x7f76b4003e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-25T14:37:08.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:08.764+0000 7f76cd0e8700 1 --2- 172.21.15.72:0/258181781 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f76b40043e0 0x7f76b40048b0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f76c80728c0 tx=0x7f76b4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5586cd14b3ea6566 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:08.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:08.764+0000 7f76cc8e7700 1 -- 172.21.15.72:0/258181781 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76c400c660 con 0x7f76b40043e0 2023-07-25T14:37:08.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:08.764+0000 7f76cc8e7700 1 -- 172.21.15.72:0/258181781 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76c400c7c0 con 0x7f76b40043e0 2023-07-25T14:37:08.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:08.764+0000 7f76cc8e7700 1 -- 172.21.15.72:0/258181781 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76c400cb70 con 0x7f76b40043e0 2023-07-25T14:37:08.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:08.764+0000 7f76cfb4d700 1 -- 172.21.15.72:0/258181781 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f76b40043e0 msgr2=0x7f76b40048b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:08.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:08.764+0000 7f76cfb4d700 1 --2- 172.21.15.72:0/258181781 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f76b40043e0 0x7f76b40048b0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f76c80728c0 tx=0x7f76b4005880 comp rx=0 tx=0).stop 2023-07-25T14:37:08.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:08.764+0000 7f76ce0ea700 1 -- 172.21.15.72:0/258181781 reap_dead start 2023-07-25T14:37:08.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:08.764+0000 7f76cfb4d700 1 -- 172.21.15.72:0/258181781 shutdown_connections 2023-07-25T14:37:08.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:08.764+0000 7f76cfb4d700 1 -- 172.21.15.72:0/258181781 >> 172.21.15.72:0/258181781 conn(0x7f76c80a87e0 msgr2=0x7f76c80a8bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:08.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:08.764+0000 7f76cfb4d700 1 -- 172.21.15.72:0/258181781 shutdown_connections 2023-07-25T14:37:08.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:08.764+0000 7f76cfb4d700 1 -- 172.21.15.72:0/258181781 wait complete. 2023-07-25T14:37:08.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:08.765+0000 7f76cfb4d700 1 Processor -- start 2023-07-25T14:37:08.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:08.766+0000 7f76cfb4d700 1 -- start start 2023-07-25T14:37:08.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:08.766+0000 7f76cfb4d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f76b40043e0 0x7f76c806f390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:08.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:08.766+0000 7f76cfb4d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f76c81507c0 0x7f76c814af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:08.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:08.766+0000 7f76cfb4d700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f76c814bc60 0x7f76c814b450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:08.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:08.766+0000 7f76cfb4d700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76c80a9c90 con 0x7f76b40043e0 2023-07-25T14:37:08.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:08.766+0000 7f76cfb4d700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76c81ea1e0 con 0x7f76c81507c0 2023-07-25T14:37:08.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:08.766+0000 7f76cfb4d700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76c81e9eb0 con 0x7f76c814bc60 2023-07-25T14:37:08.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:08.766+0000 7f76cd8e9700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f76b40043e0 0x7f76c806f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:08.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:08.766+0000 7f76cd8e9700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f76b40043e0 0x7f76c806f390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42510/0 (socket says 172.21.15.72:42510) 2023-07-25T14:37:08.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:08.766+0000 7f76cd8e9700 1 -- 172.21.15.72:0/3046460139 learned_addr learned my addr 172.21.15.72:0/3046460139 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:37:08.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:08.766+0000 7f76ce0ea700 1 --2- 172.21.15.72:0/3046460139 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f76c814bc60 0x7f76c814b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:08.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:08.766+0000 7f76cd0e8700 1 --2- 172.21.15.72:0/3046460139 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f76c81507c0 0x7f76c814af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:08.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:08.767+0000 7f76cd8e9700 1 -- 172.21.15.72:0/3046460139 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f76c814bc60 msgr2=0x7f76c814b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:08.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:08.767+0000 7f76cd8e9700 1 --2- 172.21.15.72:0/3046460139 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f76c814bc60 0x7f76c814b450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:08.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:08.767+0000 7f76cd8e9700 1 -- 172.21.15.72:0/3046460139 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f76c81507c0 msgr2=0x7f76c814af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:08.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:08.767+0000 7f76cd8e9700 1 --2- 172.21.15.72:0/3046460139 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f76c81507c0 0x7f76c814af10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:08.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:08.767+0000 7f76cd8e9700 1 -- 172.21.15.72:0/3046460139 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76c8153e20 con 0x7f76b40043e0 2023-07-25T14:37:08.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:08.767+0000 7f76ce0ea700 1 --2- 172.21.15.72:0/3046460139 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f76c814bc60 0x7f76c814b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-25T14:37:08.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:08.767+0000 7f76cd0e8700 1 --2- 172.21.15.72:0/3046460139 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f76c81507c0 0x7f76c814af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-25T14:37:08.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:08.767+0000 7f76cd8e9700 1 --2- 172.21.15.72:0/3046460139 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f76b40043e0 0x7f76c806f390 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f76b80118d0 tx=0x7f76b8011c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:08.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:08.767+0000 7f76be7fc700 1 -- 172.21.15.72:0/3046460139 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76b8004220 con 0x7f76b40043e0 2023-07-25T14:37:08.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:08.767+0000 7f76be7fc700 1 -- 172.21.15.72:0/3046460139 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76b8004380 con 0x7f76b40043e0 2023-07-25T14:37:08.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:08.767+0000 7f76cfb4d700 1 -- 172.21.15.72:0/3046460139 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76c806fca0 con 0x7f76b40043e0 2023-07-25T14:37:08.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:08.767+0000 7f76be7fc700 1 -- 172.21.15.72:0/3046460139 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76b80036a0 con 0x7f76b40043e0 2023-07-25T14:37:08.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:08.767+0000 7f76cfb4d700 1 -- 172.21.15.72:0/3046460139 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76c814b990 con 0x7f76b40043e0 2023-07-25T14:37:08.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:08.768+0000 7f76cfb4d700 1 -- 172.21.15.72:0/3046460139 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76c804e470 con 0x7f76b40043e0 2023-07-25T14:37:08.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:08.768+0000 7f76be7fc700 1 -- 172.21.15.72:0/3046460139 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f76b8003800 con 0x7f76b40043e0 2023-07-25T14:37:08.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:08.769+0000 7f76be7fc700 1 --2- 172.21.15.72:0/3046460139 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f76ac06ace0 0x7f76ac06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:08.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:08.769+0000 7f76be7fc700 1 -- 172.21.15.72:0/3046460139 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 7238+0+0 (secure 0 0 0) 0x7f76b8089e20 con 0x7f76b40043e0 2023-07-25T14:37:08.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:08.769+0000 7f76cd0e8700 1 --2- 172.21.15.72:0/3046460139 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f76ac06ace0 0x7f76ac06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:08.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:08.769+0000 7f76cd0e8700 1 --2- 172.21.15.72:0/3046460139 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f76ac06ace0 0x7f76ac06d1a0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f76c4014040 tx=0x7f76c4005040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:08.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:08.773+0000 7f76be7fc700 1 -- 172.21.15.72:0/3046460139 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f76b8054a20 con 0x7f76b40043e0 2023-07-25T14:37:08.972 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:08.961+0000 7f76cfb4d700 1 -- 172.21.15.72:0/3046460139 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f76c80722a0 con 0x7f76b40043e0 2023-07-25T14:37:08.972 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:08.961+0000 7f76be7fc700 1 -- 172.21.15.72:0/3046460139 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v43) v1 ==== 92+0+10 (secure 0 0 0) 0x7f76b8022020 con 0x7f76b40043e0 2023-07-25T14:37:08.973 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 8 2023-07-25T14:37:08.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:08.963+0000 7f76cfb4d700 1 -- 172.21.15.72:0/3046460139 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f76ac06ace0 msgr2=0x7f76ac06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:08.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:08.963+0000 7f76cfb4d700 1 --2- 172.21.15.72:0/3046460139 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f76ac06ace0 0x7f76ac06d1a0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f76c4014040 tx=0x7f76c4005040 comp rx=0 tx=0).stop 2023-07-25T14:37:08.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:08.963+0000 7f76cfb4d700 1 -- 172.21.15.72:0/3046460139 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f76b40043e0 msgr2=0x7f76c806f390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:08.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:08.963+0000 7f76cfb4d700 1 --2- 172.21.15.72:0/3046460139 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f76b40043e0 0x7f76c806f390 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f76b80118d0 tx=0x7f76b8011c90 comp rx=0 tx=0).stop 2023-07-25T14:37:08.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:08.963+0000 7f76cfb4d700 1 -- 172.21.15.72:0/3046460139 shutdown_connections 2023-07-25T14:37:08.975 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:08.963+0000 7f76cfb4d700 1 --2- 172.21.15.72:0/3046460139 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f76ac06ace0 0x7f76ac06d1a0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:08.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:08.963+0000 7f76cfb4d700 1 --2- 172.21.15.72:0/3046460139 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f76c814bc60 0x7f76c814b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:08.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:08.963+0000 7f76cfb4d700 1 --2- 172.21.15.72:0/3046460139 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f76b40043e0 0x7f76c806f390 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:08.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:08.963+0000 7f76cfb4d700 1 --2- 172.21.15.72:0/3046460139 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f76c81507c0 0x7f76c814af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:08.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:08.963+0000 7f76cfb4d700 1 -- 172.21.15.72:0/3046460139 >> 172.21.15.72:0/3046460139 conn(0x7f76c80a87e0 msgr2=0x7f76c80c53c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:08.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:08.964+0000 7f76cfb4d700 1 -- 172.21.15.72:0/3046460139 shutdown_connections 2023-07-25T14:37:08.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:08.964+0000 7f76cfb4d700 1 -- 172.21.15.72:0/3046460139 wait complete. 2023-07-25T14:37:08.988 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-25T14:37:09.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.099+0000 7f33caea2700 1 Processor -- start 2023-07-25T14:37:09.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.099+0000 7f33caea2700 1 -- start start 2023-07-25T14:37:09.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.100+0000 7f33caea2700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f33c40c4930 0x7f33c40c3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:09.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.100+0000 7f33caea2700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33c40c2fe0 con 0x7f33c4151950 2023-07-25T14:37:09.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.100+0000 7f33caea2700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33c4155070 con 0x7f33c40724c0 2023-07-25T14:37:09.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.100+0000 7f33caea2700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33c4071a60 con 0x7f33c40c4930 2023-07-25T14:37:09.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.100+0000 7f33c943f700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f33c40c4930 0x7f33c40c3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:09.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.100+0000 7f33c8c3e700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f33c4151950 0x7f33c406a190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:33254/0 (socket says 172.21.15.72:33254) 2023-07-25T14:37:09.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.100+0000 7f33c8c3e700 1 -- 172.21.15.72:0/2006446018 learned_addr learned my addr 172.21.15.72:0/2006446018 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:37:09.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.101+0000 7f33c943f700 1 -- 172.21.15.72:0/2006446018 >> v1:172.21.15.92:6789/0 conn(0x7f33c40724c0 legacy=0x7f33c40c34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:09.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.101+0000 7f33c943f700 1 -- 172.21.15.72:0/2006446018 >> v1:172.21.15.72:6789/0 conn(0x7f33c4151950 legacy=0x7f33c406a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:09.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.101+0000 7f33c37fe700 1 -- 172.21.15.72:0/2006446018 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2590876682 0 0) 0x7f33c40c2fe0 con 0x7f33c4151950 2023-07-25T14:37:09.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.101+0000 7f33c943f700 1 -- 172.21.15.72:0/2006446018 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33c40c15c0 con 0x7f33c40c4930 2023-07-25T14:37:09.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.101+0000 7f33c943f700 1 --2- 172.21.15.72:0/2006446018 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f33c40c4930 0x7f33c40c3bd0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f33bc009d90 tx=0x7f33bc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbf263c5fd228aec server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:09.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.101+0000 7f33c37fe700 1 -- 172.21.15.72:0/2006446018 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33bc00e070 con 0x7f33c40c4930 2023-07-25T14:37:09.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.101+0000 7f33c37fe700 1 -- 172.21.15.72:0/2006446018 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33bc00bbd0 con 0x7f33c40c4930 2023-07-25T14:37:09.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.101+0000 7f33c37fe700 1 -- 172.21.15.72:0/2006446018 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33bc012430 con 0x7f33c40c4930 2023-07-25T14:37:09.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.101+0000 7f33caea2700 1 -- 172.21.15.72:0/2006446018 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f33c40c4930 msgr2=0x7f33c40c3bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:09.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.101+0000 7f33caea2700 1 --2- 172.21.15.72:0/2006446018 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f33c40c4930 0x7f33c40c3bd0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f33bc009d90 tx=0x7f33bc00b330 comp rx=0 tx=0).stop 2023-07-25T14:37:09.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.101+0000 7f33caea2700 1 -- 172.21.15.72:0/2006446018 shutdown_connections 2023-07-25T14:37:09.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.101+0000 7f33caea2700 1 --2- 172.21.15.72:0/2006446018 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f33c40c4930 0x7f33c40c3bd0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:09.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.101+0000 7f33caea2700 1 -- 172.21.15.72:0/2006446018 >> 172.21.15.72:0/2006446018 conn(0x7f33c40a87e0 msgr2=0x7f33c40a8bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:09.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.101+0000 7f33caea2700 1 -- 172.21.15.72:0/2006446018 shutdown_connections 2023-07-25T14:37:09.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.101+0000 7f33caea2700 1 -- 172.21.15.72:0/2006446018 wait complete. 2023-07-25T14:37:09.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.103+0000 7f33caea2700 1 Processor -- start 2023-07-25T14:37:09.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.103+0000 7f33caea2700 1 -- start start 2023-07-25T14:37:09.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.103+0000 7f33caea2700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f33c40724c0 0x7f33c40a7940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:09.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.103+0000 7f33caea2700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f33c40c4930 0x7f33c414ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:09.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.103+0000 7f33caea2700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f33c4151950 0x7f33c414b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:09.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.103+0000 7f33caea2700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33c40a8390 con 0x7f33c40c4930 2023-07-25T14:37:09.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.103+0000 7f33caea2700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33c41eadd0 con 0x7f33c4151950 2023-07-25T14:37:09.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.103+0000 7f33caea2700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33c4155620 con 0x7f33c40724c0 2023-07-25T14:37:09.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.103+0000 7f33c3fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f33c40c4930 0x7f33c414ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:09.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.104+0000 7f33c3fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f33c40c4930 0x7f33c414ae80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42526/0 (socket says 172.21.15.72:42526) 2023-07-25T14:37:09.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.104+0000 7f33c3fff700 1 -- 172.21.15.72:0/3067048700 learned_addr learned my addr 172.21.15.72:0/3067048700 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:37:09.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.104+0000 7f33c8c3e700 1 --2- 172.21.15.72:0/3067048700 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f33c40724c0 0x7f33c40a7940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:09.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.104+0000 7f33c943f700 1 --2- 172.21.15.72:0/3067048700 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f33c4151950 0x7f33c414b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:09.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.104+0000 7f33c3fff700 1 -- 172.21.15.72:0/3067048700 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f33c40724c0 msgr2=0x7f33c40a7940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:09.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.104+0000 7f33c3fff700 1 --2- 172.21.15.72:0/3067048700 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f33c40724c0 0x7f33c40a7940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:09.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.104+0000 7f33c3fff700 1 -- 172.21.15.72:0/3067048700 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f33c4151950 msgr2=0x7f33c414b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:09.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.104+0000 7f33c3fff700 1 --2- 172.21.15.72:0/3067048700 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f33c4151950 0x7f33c414b3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:09.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.104+0000 7f33c3fff700 1 -- 172.21.15.72:0/3067048700 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33bc009a70 con 0x7f33c40c4930 2023-07-25T14:37:09.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.104+0000 7f33c3fff700 1 --2- 172.21.15.72:0/3067048700 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f33c40c4930 0x7f33c414ae80 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f33b000c700 tx=0x7f33b000ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:09.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.104+0000 7f33c17fa700 1 -- 172.21.15.72:0/3067048700 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33b00052d0 con 0x7f33c40c4930 2023-07-25T14:37:09.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.104+0000 7f33c17fa700 1 -- 172.21.15.72:0/3067048700 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33b0005430 con 0x7f33c40c4930 2023-07-25T14:37:09.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.104+0000 7f33caea2700 1 -- 172.21.15.72:0/3067048700 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33c414ba60 con 0x7f33c40c4930 2023-07-25T14:37:09.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.104+0000 7f33c17fa700 1 -- 172.21.15.72:0/3067048700 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33b0003880 con 0x7f33c40c4930 2023-07-25T14:37:09.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.104+0000 7f33caea2700 1 -- 172.21.15.72:0/3067048700 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33c40a7e80 con 0x7f33c40c4930 2023-07-25T14:37:09.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.105+0000 7f33caea2700 1 -- 172.21.15.72:0/3067048700 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33c406f1a0 con 0x7f33c40c4930 2023-07-25T14:37:09.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.106+0000 7f33c17fa700 1 -- 172.21.15.72:0/3067048700 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f33b00039e0 con 0x7f33c40c4930 2023-07-25T14:37:09.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.106+0000 7f33c17fa700 1 --2- 172.21.15.72:0/3067048700 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f33a806ace0 0x7f33a806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:09.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.106+0000 7f33c8c3e700 1 --2- 172.21.15.72:0/3067048700 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f33a806ace0 0x7f33a806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:09.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.106+0000 7f33c17fa700 1 -- 172.21.15.72:0/3067048700 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 7238+0+0 (secure 0 0 0) 0x7f33b0088b40 con 0x7f33c40c4930 2023-07-25T14:37:09.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.106+0000 7f33c8c3e700 1 --2- 172.21.15.72:0/3067048700 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f33a806ace0 0x7f33a806d1a0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f33b8000f60 tx=0x7f33b8004a50 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:09.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.110+0000 7f33c17fa700 1 -- 172.21.15.72:0/3067048700 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f33b0053810 con 0x7f33c40c4930 2023-07-25T14:37:09.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.296+0000 7f33caea2700 1 -- 172.21.15.72:0/3067048700 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f33c404e470 con 0x7f33c40c4930 2023-07-25T14:37:09.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.296+0000 7f33c17fa700 1 -- 172.21.15.72:0/3067048700 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v43) v1 ==== 93+0+10 (secure 0 0 0) 0x7f33b0056e30 con 0x7f33c40c4930 2023-07-25T14:37:09.308 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 1 2023-07-25T14:37:09.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.298+0000 7f33caea2700 1 -- 172.21.15.72:0/3067048700 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f33a806ace0 msgr2=0x7f33a806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:09.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.298+0000 7f33caea2700 1 --2- 172.21.15.72:0/3067048700 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f33a806ace0 0x7f33a806d1a0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f33b8000f60 tx=0x7f33b8004a50 comp rx=0 tx=0).stop 2023-07-25T14:37:09.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.298+0000 7f33caea2700 1 -- 172.21.15.72:0/3067048700 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f33c40c4930 msgr2=0x7f33c414ae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:09.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.298+0000 7f33caea2700 1 --2- 172.21.15.72:0/3067048700 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f33c40c4930 0x7f33c414ae80 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f33b000c700 tx=0x7f33b000ca10 comp rx=0 tx=0).stop 2023-07-25T14:37:09.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.298+0000 7f33caea2700 1 -- 172.21.15.72:0/3067048700 shutdown_connections 2023-07-25T14:37:09.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.298+0000 7f33caea2700 1 --2- 172.21.15.72:0/3067048700 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f33a806ace0 0x7f33a806d1a0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:09.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.298+0000 7f33caea2700 1 --2- 172.21.15.72:0/3067048700 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f33c40724c0 0x7f33c40a7940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:09.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.298+0000 7f33caea2700 1 --2- 172.21.15.72:0/3067048700 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f33c4151950 0x7f33c414b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:09.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.298+0000 7f33caea2700 1 --2- 172.21.15.72:0/3067048700 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f33c40c4930 0x7f33c414ae80 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:09.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.298+0000 7f33caea2700 1 -- 172.21.15.72:0/3067048700 >> 172.21.15.72:0/3067048700 conn(0x7f33c40a87e0 msgr2=0x7f33c406e4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:09.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.298+0000 7f33caea2700 1 -- 172.21.15.72:0/3067048700 shutdown_connections 2023-07-25T14:37:09.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.298+0000 7f33caea2700 1 -- 172.21.15.72:0/3067048700 wait complete. 2023-07-25T14:37:09.321 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-25T14:37:09.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.432+0000 7f3f6239e700 1 Processor -- start 2023-07-25T14:37:09.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.432+0000 7f3f6239e700 1 -- start start 2023-07-25T14:37:09.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.433+0000 7f3f6239e700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f3f5c151950 0x7f3f5c06a190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:09.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.433+0000 7f3f6239e700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3f5c06a6d0 0x7f3f5c0c3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:09.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.433+0000 7f3f6239e700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f5c0c2fe0 con 0x7f3f5c0724c0 2023-07-25T14:37:09.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.433+0000 7f3f6239e700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f5c071a60 con 0x7f3f5c151950 2023-07-25T14:37:09.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.433+0000 7f3f6239e700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f5c0c2a70 con 0x7f3f5c06a6d0 2023-07-25T14:37:09.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.433+0000 7f3f5bfff700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f3f5c151950 0x7f3f5c06a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:09.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.433+0000 7f3f6093b700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3f5c06a6d0 0x7f3f5c0c3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:09.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.433+0000 7f3f5bfff700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f3f5c151950 0x7f3f5c06a190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.72:38104/0 (socket says 172.21.15.72:38104) 2023-07-25T14:37:09.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.433+0000 7f3f6093b700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3f5c06a6d0 0x7f3f5c0c3bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3301/0 says I am v2:172.21.15.72:47762/0 (socket says 172.21.15.72:47762) 2023-07-25T14:37:09.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.433+0000 7f3f5bfff700 1 -- 172.21.15.72:0/564982382 learned_addr learned my addr 172.21.15.72:0/564982382 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:37:09.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.433+0000 7f3f5b7fe700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f3f5c0724c0 0x7f3f5c0c34c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.72:56842/0 (socket says 172.21.15.72:56842) 2023-07-25T14:37:09.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.434+0000 7f3f5bfff700 1 -- 172.21.15.72:0/564982382 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3f5c06a6d0 msgr2=0x7f3f5c0c3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:09.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.434+0000 7f3f5bfff700 1 --2- 172.21.15.72:0/564982382 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3f5c06a6d0 0x7f3f5c0c3bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:09.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.434+0000 7f3f5bfff700 1 -- 172.21.15.72:0/564982382 >> v1:172.21.15.92:6789/0 conn(0x7f3f5c0724c0 legacy=0x7f3f5c0c34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:09.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.434+0000 7f3f5bfff700 1 -- 172.21.15.72:0/564982382 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f5c155070 con 0x7f3f5c151950 2023-07-25T14:37:09.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.434+0000 7f3f5affd700 1 -- 172.21.15.72:0/564982382 <== mon.1 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3506790345 0 0) 0x7f3f5c0c2fe0 con 0x7f3f5c0724c0 2023-07-25T14:37:09.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.434+0000 7f3f6093b700 1 --2- 172.21.15.72:0/564982382 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3f5c06a6d0 0x7f3f5c0c3bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-25T14:37:09.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.434+0000 7f3f5bfff700 1 --2- 172.21.15.72:0/564982382 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3f5c151950 0x7f3f5c06a190 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f3f500098f0 tx=0x7f3f50009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4d5bb925cc434cef server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:09.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.434+0000 7f3f5affd700 1 -- 172.21.15.72:0/564982382 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f50011830 con 0x7f3f5c151950 2023-07-25T14:37:09.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.434+0000 7f3f5affd700 1 -- 172.21.15.72:0/564982382 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f50011990 con 0x7f3f5c151950 2023-07-25T14:37:09.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.434+0000 7f3f5affd700 1 -- 172.21.15.72:0/564982382 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f50011d20 con 0x7f3f5c151950 2023-07-25T14:37:09.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.435+0000 7f3f6239e700 1 -- 172.21.15.72:0/564982382 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3f5c151950 msgr2=0x7f3f5c06a190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:09.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.435+0000 7f3f6239e700 1 --2- 172.21.15.72:0/564982382 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3f5c151950 0x7f3f5c06a190 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f3f500098f0 tx=0x7f3f50009c00 comp rx=0 tx=0).stop 2023-07-25T14:37:09.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.435+0000 7f3f6239e700 1 -- 172.21.15.72:0/564982382 shutdown_connections 2023-07-25T14:37:09.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.435+0000 7f3f6239e700 1 --2- 172.21.15.72:0/564982382 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3f5c06a6d0 0x7f3f5c0c3bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:09.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.435+0000 7f3f6239e700 1 --2- 172.21.15.72:0/564982382 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3f5c151950 0x7f3f5c06a190 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:09.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.435+0000 7f3f6239e700 1 -- 172.21.15.72:0/564982382 >> 172.21.15.72:0/564982382 conn(0x7f3f5c0a87e0 msgr2=0x7f3f5c0a8bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:09.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.435+0000 7f3f6239e700 1 -- 172.21.15.72:0/564982382 shutdown_connections 2023-07-25T14:37:09.450 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.435+0000 7f3f6239e700 1 -- 172.21.15.72:0/564982382 wait complete. 2023-07-25T14:37:09.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.436+0000 7f3f6239e700 1 Processor -- start 2023-07-25T14:37:09.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.436+0000 7f3f6239e700 1 -- start start 2023-07-25T14:37:09.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.437+0000 7f3f6239e700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3f5c06a6d0 0x7f3f5c157d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:09.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.437+0000 7f3f6239e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3f5c0724c0 0x7f3f5c1e9fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:09.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.437+0000 7f3f6239e700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3f5c151950 0x7f3f5c06f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:09.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.437+0000 7f3f6239e700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f5c0c03b0 con 0x7f3f5c0724c0 2023-07-25T14:37:09.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.437+0000 7f3f6239e700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f5c1ecd60 con 0x7f3f5c06a6d0 2023-07-25T14:37:09.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.437+0000 7f3f6239e700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f5c1ea520 con 0x7f3f5c151950 2023-07-25T14:37:09.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.437+0000 7f3f5b7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3f5c0724c0 0x7f3f5c1e9fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:09.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.437+0000 7f3f5b7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3f5c0724c0 0x7f3f5c1e9fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42538/0 (socket says 172.21.15.72:42538) 2023-07-25T14:37:09.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.437+0000 7f3f5b7fe700 1 -- 172.21.15.72:0/4263140391 learned_addr learned my addr 172.21.15.72:0/4263140391 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:37:09.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.437+0000 7f3f6093b700 1 --2- 172.21.15.72:0/4263140391 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3f5c151950 0x7f3f5c06f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:09.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.437+0000 7f3f5bfff700 1 --2- 172.21.15.72:0/4263140391 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3f5c06a6d0 0x7f3f5c157d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:09.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.437+0000 7f3f5b7fe700 1 -- 172.21.15.72:0/4263140391 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3f5c151950 msgr2=0x7f3f5c06f2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:09.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.437+0000 7f3f5b7fe700 1 --2- 172.21.15.72:0/4263140391 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3f5c151950 0x7f3f5c06f2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:09.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.437+0000 7f3f5b7fe700 1 -- 172.21.15.72:0/4263140391 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3f5c06a6d0 msgr2=0x7f3f5c157d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:09.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.437+0000 7f3f5b7fe700 1 --2- 172.21.15.72:0/4263140391 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3f5c06a6d0 0x7f3f5c157d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:09.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.437+0000 7f3f5b7fe700 1 -- 172.21.15.72:0/4263140391 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f54009a70 con 0x7f3f5c0724c0 2023-07-25T14:37:09.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.437+0000 7f3f5b7fe700 1 --2- 172.21.15.72:0/4263140391 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3f5c0724c0 0x7f3f5c1e9fe0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f3f4c0011e0 tx=0x7f3f4c00cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:09.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.437+0000 7f3f58ff9700 1 -- 172.21.15.72:0/4263140391 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f4c004c80 con 0x7f3f5c0724c0 2023-07-25T14:37:09.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.437+0000 7f3f58ff9700 1 -- 172.21.15.72:0/4263140391 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f4c004e00 con 0x7f3f5c0724c0 2023-07-25T14:37:09.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.437+0000 7f3f6239e700 1 -- 172.21.15.72:0/4263140391 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f50009550 con 0x7f3f5c0724c0 2023-07-25T14:37:09.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.438+0000 7f3f58ff9700 1 -- 172.21.15.72:0/4263140391 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f4c007310 con 0x7f3f5c0724c0 2023-07-25T14:37:09.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.438+0000 7f3f6239e700 1 -- 172.21.15.72:0/4263140391 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f5c0abf70 con 0x7f3f5c0724c0 2023-07-25T14:37:09.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.439+0000 7f3f6239e700 1 -- 172.21.15.72:0/4263140391 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f5c150c30 con 0x7f3f5c0724c0 2023-07-25T14:37:09.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.439+0000 7f3f58ff9700 1 -- 172.21.15.72:0/4263140391 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3f4c007470 con 0x7f3f5c0724c0 2023-07-25T14:37:09.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.439+0000 7f3f58ff9700 1 --2- 172.21.15.72:0/4263140391 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f3f4806ace0 0x7f3f4806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:09.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.439+0000 7f3f58ff9700 1 -- 172.21.15.72:0/4263140391 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 7238+0+0 (secure 0 0 0) 0x7f3f4c0896c0 con 0x7f3f5c0724c0 2023-07-25T14:37:09.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.439+0000 7f3f5bfff700 1 --2- 172.21.15.72:0/4263140391 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f3f4806ace0 0x7f3f4806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:09.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.440+0000 7f3f5bfff700 1 --2- 172.21.15.72:0/4263140391 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f3f4806ace0 0x7f3f4806d1a0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f3f50014040 tx=0x7f3f50008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:09.456 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.443+0000 7f3f58ff9700 1 -- 172.21.15.72:0/4263140391 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f3f4c054360 con 0x7f3f5c0724c0 2023-07-25T14:37:09.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.631+0000 7f3f6239e700 1 -- 172.21.15.72:0/4263140391 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3f5c0c40e0 con 0x7f3f5c0724c0 2023-07-25T14:37:09.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.631+0000 7f3f58ff9700 1 -- 172.21.15.72:0/4263140391 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v43) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3f4c057980 con 0x7f3f5c0724c0 2023-07-25T14:37:09.643 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2023-07-25T14:37:09.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.633+0000 7f3f6239e700 1 -- 172.21.15.72:0/4263140391 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f3f4806ace0 msgr2=0x7f3f4806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:09.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.633+0000 7f3f6239e700 1 --2- 172.21.15.72:0/4263140391 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f3f4806ace0 0x7f3f4806d1a0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f3f50014040 tx=0x7f3f50008030 comp rx=0 tx=0).stop 2023-07-25T14:37:09.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.633+0000 7f3f6239e700 1 -- 172.21.15.72:0/4263140391 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3f5c0724c0 msgr2=0x7f3f5c1e9fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:09.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.633+0000 7f3f6239e700 1 --2- 172.21.15.72:0/4263140391 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3f5c0724c0 0x7f3f5c1e9fe0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f3f4c0011e0 tx=0x7f3f4c00cae0 comp rx=0 tx=0).stop 2023-07-25T14:37:09.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.633+0000 7f3f6239e700 1 -- 172.21.15.72:0/4263140391 shutdown_connections 2023-07-25T14:37:09.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.633+0000 7f3f6239e700 1 --2- 172.21.15.72:0/4263140391 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f3f4806ace0 0x7f3f4806d1a0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:09.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.633+0000 7f3f6239e700 1 --2- 172.21.15.72:0/4263140391 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3f5c151950 0x7f3f5c06f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:09.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.633+0000 7f3f6239e700 1 --2- 172.21.15.72:0/4263140391 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3f5c06a6d0 0x7f3f5c157d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:09.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.633+0000 7f3f6239e700 1 --2- 172.21.15.72:0/4263140391 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3f5c0724c0 0x7f3f5c1e9fe0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:09.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.633+0000 7f3f6239e700 1 -- 172.21.15.72:0/4263140391 >> 172.21.15.72:0/4263140391 conn(0x7f3f5c0a87e0 msgr2=0x7f3f5c0c45e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:09.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.633+0000 7f3f6239e700 1 -- 172.21.15.72:0/4263140391 shutdown_connections 2023-07-25T14:37:09.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.633+0000 7f3f6239e700 1 -- 172.21.15.72:0/4263140391 wait complete. 2023-07-25T14:37:09.657 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-25T14:37:09.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.767+0000 7feb13796700 1 Processor -- start 2023-07-25T14:37:09.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.767+0000 7feb13796700 1 -- start start 2023-07-25T14:37:09.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.768+0000 7feb13796700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7feb0c152a50 0x7feb0c0c1860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:09.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.768+0000 7feb13796700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7feb0c0ab8e0 0x7feb0c0c1da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:09.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.768+0000 7feb13796700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb0c0c0aa0 con 0x7feb0c148bb0 2023-07-25T14:37:09.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.768+0000 7feb13796700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb0c152fa0 con 0x7feb0c0ab8e0 2023-07-25T14:37:09.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.768+0000 7feb13796700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb0c0c0d80 con 0x7feb0c152a50 2023-07-25T14:37:09.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.768+0000 7feb11532700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7feb0c148bb0 0x7feb0c06ed20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:33280/0 (socket says 172.21.15.72:33280) 2023-07-25T14:37:09.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.768+0000 7feb11532700 1 -- 172.21.15.72:0/4122699988 learned_addr learned my addr 172.21.15.72:0/4122699988 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:37:09.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.768+0000 7feb11d33700 1 --2- 172.21.15.72:0/4122699988 >> v2:172.21.15.72:3300/0 conn(0x7feb0c0ab8e0 0x7feb0c0c1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:09.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.768+0000 7feb03fff700 1 -- 172.21.15.72:0/4122699988 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1743158949 0 0) 0x7feb0c0c0aa0 con 0x7feb0c148bb0 2023-07-25T14:37:09.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.768+0000 7feb03fff700 1 -- 172.21.15.72:0/4122699988 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feaf80035b0 con 0x7feb0c148bb0 2023-07-25T14:37:09.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.768+0000 7feb11d33700 1 -- 172.21.15.72:0/4122699988 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7feb0c152a50 msgr2=0x7feb0c0c1860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:09.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.768+0000 7feb11d33700 1 --2- 172.21.15.72:0/4122699988 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7feb0c152a50 0x7feb0c0c1860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:09.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.768+0000 7feb11d33700 1 -- 172.21.15.72:0/4122699988 >> v1:172.21.15.72:6789/0 conn(0x7feb0c148bb0 legacy=0x7feb0c06ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:09.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.768+0000 7feb11d33700 1 -- 172.21.15.72:0/4122699988 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb0c0c1060 con 0x7feb0c0ab8e0 2023-07-25T14:37:09.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.769+0000 7feb11d33700 1 --2- 172.21.15.72:0/4122699988 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feb0c0ab8e0 0x7feb0c0c1da0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7feb04009d90 tx=0x7feb0400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d7ad1955ec282cb server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:09.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.769+0000 7feb03fff700 1 -- 172.21.15.72:0/4122699988 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb0400e070 con 0x7feb0c0ab8e0 2023-07-25T14:37:09.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.769+0000 7feb03fff700 1 -- 172.21.15.72:0/4122699988 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb0400bb20 con 0x7feb0c0ab8e0 2023-07-25T14:37:09.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.769+0000 7feb03fff700 1 -- 172.21.15.72:0/4122699988 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb04012430 con 0x7feb0c0ab8e0 2023-07-25T14:37:09.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.769+0000 7feb13796700 1 -- 172.21.15.72:0/4122699988 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feb0c0ab8e0 msgr2=0x7feb0c0c1da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:09.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.769+0000 7feb13796700 1 --2- 172.21.15.72:0/4122699988 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feb0c0ab8e0 0x7feb0c0c1da0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7feb04009d90 tx=0x7feb0400b330 comp rx=0 tx=0).stop 2023-07-25T14:37:09.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.769+0000 7feb13796700 1 -- 172.21.15.72:0/4122699988 shutdown_connections 2023-07-25T14:37:09.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.769+0000 7feb13796700 1 --2- 172.21.15.72:0/4122699988 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feb0c0ab8e0 0x7feb0c0c1da0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:09.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.769+0000 7feb13796700 1 --2- 172.21.15.72:0/4122699988 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7feb0c152a50 0x7feb0c0c1860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:09.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.769+0000 7feb13796700 1 -- 172.21.15.72:0/4122699988 >> 172.21.15.72:0/4122699988 conn(0x7feb0c071bf0 msgr2=0x7feb0c06a190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:09.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.769+0000 7feb13796700 1 -- 172.21.15.72:0/4122699988 shutdown_connections 2023-07-25T14:37:09.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.769+0000 7feb13796700 1 -- 172.21.15.72:0/4122699988 wait complete. 2023-07-25T14:37:09.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.770+0000 7feb13796700 1 Processor -- start 2023-07-25T14:37:09.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.770+0000 7feb13796700 1 -- start start 2023-07-25T14:37:09.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.771+0000 7feb13796700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feb0c0ab8e0 0x7feb0c151a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:09.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.771+0000 7feb13796700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feb0c148bb0 0x7feb0c151100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:09.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.771+0000 7feb13796700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7feb0c152a50 0x7feb0c14e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:09.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.771+0000 7feb13796700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb0c14d0b0 con 0x7feb0c0ab8e0 2023-07-25T14:37:09.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.771+0000 7feb13796700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb0c14d350 con 0x7feb0c148bb0 2023-07-25T14:37:09.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.771+0000 7feb13796700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb0c14d630 con 0x7feb0c152a50 2023-07-25T14:37:09.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.771+0000 7feb11532700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feb0c0ab8e0 0x7feb0c151a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:09.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.771+0000 7feb11532700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feb0c0ab8e0 0x7feb0c151a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42550/0 (socket says 172.21.15.72:42550) 2023-07-25T14:37:09.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.771+0000 7feb11532700 1 -- 172.21.15.72:0/3128802863 learned_addr learned my addr 172.21.15.72:0/3128802863 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:37:09.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.771+0000 7feb11532700 1 -- 172.21.15.72:0/3128802863 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7feb0c152a50 msgr2=0x7feb0c14e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:09.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.771+0000 7feb11532700 1 --2- 172.21.15.72:0/3128802863 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7feb0c152a50 0x7feb0c14e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:09.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.771+0000 7feb11532700 1 -- 172.21.15.72:0/3128802863 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feb0c148bb0 msgr2=0x7feb0c151100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:09.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.771+0000 7feb11532700 1 --2- 172.21.15.72:0/3128802863 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feb0c148bb0 0x7feb0c151100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:09.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.771+0000 7feb11532700 1 -- 172.21.15.72:0/3128802863 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb04009a70 con 0x7feb0c0ab8e0 2023-07-25T14:37:09.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.772+0000 7feb11532700 1 --2- 172.21.15.72:0/3128802863 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feb0c0ab8e0 0x7feb0c151a90 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7feafc00c700 tx=0x7feafc00cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:09.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.772+0000 7feb01ffb700 1 -- 172.21.15.72:0/3128802863 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feafc005d70 con 0x7feb0c0ab8e0 2023-07-25T14:37:09.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.772+0000 7feb01ffb700 1 -- 172.21.15.72:0/3128802863 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feafc0070d0 con 0x7feb0c0ab8e0 2023-07-25T14:37:09.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.772+0000 7feb13796700 1 -- 172.21.15.72:0/3128802863 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb0c151640 con 0x7feb0c0ab8e0 2023-07-25T14:37:09.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.772+0000 7feb01ffb700 1 -- 172.21.15.72:0/3128802863 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feafc007460 con 0x7feb0c0ab8e0 2023-07-25T14:37:09.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.772+0000 7feb13796700 1 -- 172.21.15.72:0/3128802863 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb0c1542f0 con 0x7feb0c0ab8e0 2023-07-25T14:37:09.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.773+0000 7feb13796700 1 -- 172.21.15.72:0/3128802863 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb0c14eef0 con 0x7feb0c0ab8e0 2023-07-25T14:37:09.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.773+0000 7feb01ffb700 1 -- 172.21.15.72:0/3128802863 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7feafc0075c0 con 0x7feb0c0ab8e0 2023-07-25T14:37:09.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.774+0000 7feb01ffb700 1 --2- 172.21.15.72:0/3128802863 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7feaf006ace0 0x7feaf006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:09.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.774+0000 7feb01ffb700 1 -- 172.21.15.72:0/3128802863 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 7238+0+0 (secure 0 0 0) 0x7feafc088fd0 con 0x7feb0c0ab8e0 2023-07-25T14:37:09.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.774+0000 7feb10d31700 1 --2- 172.21.15.72:0/3128802863 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7feaf006ace0 0x7feaf006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:09.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.774+0000 7feb10d31700 1 --2- 172.21.15.72:0/3128802863 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7feaf006ace0 0x7feaf006d1a0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7feb0c14cfe0 tx=0x7feb08006c80 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:09.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.778+0000 7feb01ffb700 1 -- 172.21.15.72:0/3128802863 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7feb0c14eef0 con 0x7feb0c0ab8e0 2023-07-25T14:37:09.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.968+0000 7feb13796700 1 -- 172.21.15.72:0/3128802863 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7feb0c14eef0 con 0x7feb0c0ab8e0 2023-07-25T14:37:09.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.968+0000 7feb01ffb700 1 -- 172.21.15.72:0/3128802863 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v43) v1 ==== 100+0+11 (secure 0 0 0) 0x7feb0c14eef0 con 0x7feb0c0ab8e0 2023-07-25T14:37:09.980 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 64 2023-07-25T14:37:09.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.970+0000 7feb13796700 1 -- 172.21.15.72:0/3128802863 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7feaf006ace0 msgr2=0x7feaf006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:09.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.970+0000 7feb13796700 1 --2- 172.21.15.72:0/3128802863 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7feaf006ace0 0x7feaf006d1a0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7feb0c14cfe0 tx=0x7feb08006c80 comp rx=0 tx=0).stop 2023-07-25T14:37:09.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.970+0000 7feb13796700 1 -- 172.21.15.72:0/3128802863 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feb0c0ab8e0 msgr2=0x7feb0c151a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:09.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.970+0000 7feb13796700 1 --2- 172.21.15.72:0/3128802863 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feb0c0ab8e0 0x7feb0c151a90 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7feafc00c700 tx=0x7feafc00cac0 comp rx=0 tx=0).stop 2023-07-25T14:37:09.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.970+0000 7feb13796700 1 -- 172.21.15.72:0/3128802863 shutdown_connections 2023-07-25T14:37:09.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.970+0000 7feb13796700 1 --2- 172.21.15.72:0/3128802863 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7feaf006ace0 0x7feaf006d1a0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:09.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.970+0000 7feb13796700 1 --2- 172.21.15.72:0/3128802863 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7feb0c152a50 0x7feb0c14e1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:09.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.970+0000 7feb13796700 1 --2- 172.21.15.72:0/3128802863 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feb0c0ab8e0 0x7feb0c151a90 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:09.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.970+0000 7feb13796700 1 --2- 172.21.15.72:0/3128802863 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feb0c148bb0 0x7feb0c151100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:09.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.970+0000 7feb13796700 1 -- 172.21.15.72:0/3128802863 >> 172.21.15.72:0/3128802863 conn(0x7feb0c071bf0 msgr2=0x7feb0c146220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:09.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.970+0000 7feb13796700 1 -- 172.21.15.72:0/3128802863 shutdown_connections 2023-07-25T14:37:09.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:09.970+0000 7feb13796700 1 -- 172.21.15.72:0/3128802863 wait complete. 2023-07-25T14:37:09.993 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-07-25T14:37:10.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.104+0000 7f609f131700 1 Processor -- start 2023-07-25T14:37:10.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.104+0000 7f609f131700 1 -- start start 2023-07-25T14:37:10.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.105+0000 7f609f131700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f609814faf0 0x7f60980c5e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:10.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.105+0000 7f609f131700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f60980ba0e0 0x7f60981558a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:10.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.105+0000 7f609f131700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f6098155de0 0x7f6098071960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:10.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.105+0000 7f609f131700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60980c4930 con 0x7f60980ba0e0 2023-07-25T14:37:10.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.105+0000 7f609f131700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60980c5670 con 0x7f6098155de0 2023-07-25T14:37:10.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.105+0000 7f609f131700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60980726e0 con 0x7f609814faf0 2023-07-25T14:37:10.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.105+0000 7f6097fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f60980ba0e0 0x7f60981558a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:10.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.105+0000 7f6097fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f60980ba0e0 0x7f60981558a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42560/0 (socket says 172.21.15.72:42560) 2023-07-25T14:37:10.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.105+0000 7f6097fff700 1 -- 172.21.15.72:0/3200991242 learned_addr learned my addr 172.21.15.72:0/3200991242 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:37:10.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.105+0000 7f609cecd700 1 --2- 172.21.15.72:0/3200991242 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f609814faf0 0x7f60980c5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:10.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.105+0000 7f6097fff700 1 -- 172.21.15.72:0/3200991242 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f609814faf0 msgr2=0x7f60980c5e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:10.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.105+0000 7f609d6ce700 1 --2- 172.21.15.72:0/3200991242 >> v2:172.21.15.92:3300/0 conn(0x7f6098155de0 0x7f6098071960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:10.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.105+0000 7f6097fff700 1 --2- 172.21.15.72:0/3200991242 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f609814faf0 0x7f60980c5e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:10.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.105+0000 7f6097fff700 1 -- 172.21.15.72:0/3200991242 >> v2:172.21.15.92:3300/0 conn(0x7f6098155de0 msgr2=0x7f6098071960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:10.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.105+0000 7f6097fff700 1 --2- 172.21.15.72:0/3200991242 >> v2:172.21.15.92:3300/0 conn(0x7f6098155de0 0x7f6098071960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:10.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.105+0000 7f6097fff700 1 -- 172.21.15.72:0/3200991242 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60980c4b80 con 0x7f60980ba0e0 2023-07-25T14:37:10.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.105+0000 7f609d6ce700 1 --2- 172.21.15.72:0/3200991242 >> v2:172.21.15.92:3300/0 conn(0x7f6098155de0 0x7f6098071960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-25T14:37:10.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.105+0000 7f6097fff700 1 --2- 172.21.15.72:0/3200991242 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f60980ba0e0 0x7f60981558a0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f6098153440 tx=0x7f6084009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=535a02f9278ba312 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:10.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.106+0000 7f60977fe700 1 -- 172.21.15.72:0/3200991242 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f608400b870 con 0x7f60980ba0e0 2023-07-25T14:37:10.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.106+0000 7f60977fe700 1 -- 172.21.15.72:0/3200991242 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f608400b9d0 con 0x7f60980ba0e0 2023-07-25T14:37:10.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.106+0000 7f60977fe700 1 -- 172.21.15.72:0/3200991242 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f608400bd60 con 0x7f60980ba0e0 2023-07-25T14:37:10.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.106+0000 7f609f131700 1 -- 172.21.15.72:0/3200991242 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f60980ba0e0 msgr2=0x7f60981558a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:10.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.106+0000 7f609f131700 1 --2- 172.21.15.72:0/3200991242 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f60980ba0e0 0x7f60981558a0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f6098153440 tx=0x7f6084009bd0 comp rx=0 tx=0).stop 2023-07-25T14:37:10.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.106+0000 7f609f131700 1 -- 172.21.15.72:0/3200991242 shutdown_connections 2023-07-25T14:37:10.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.106+0000 7f609f131700 1 --2- 172.21.15.72:0/3200991242 >> v2:172.21.15.92:3300/0 conn(0x7f6098155de0 0x7f6098071960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:10.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.106+0000 7f609f131700 1 --2- 172.21.15.72:0/3200991242 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f609814faf0 0x7f60980c5e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:10.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.106+0000 7f609f131700 1 --2- 172.21.15.72:0/3200991242 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f60980ba0e0 0x7f60981558a0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:10.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.106+0000 7f609f131700 1 -- 172.21.15.72:0/3200991242 >> 172.21.15.72:0/3200991242 conn(0x7f60980a87e0 msgr2=0x7f60980a8bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:10.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.106+0000 7f609f131700 1 -- 172.21.15.72:0/3200991242 shutdown_connections 2023-07-25T14:37:10.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.106+0000 7f609f131700 1 -- 172.21.15.72:0/3200991242 wait complete. 2023-07-25T14:37:10.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.107+0000 7f609f131700 1 Processor -- start 2023-07-25T14:37:10.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.107+0000 7f609f131700 1 -- start start 2023-07-25T14:37:10.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.108+0000 7f609f131700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f60980ba0e0 0x7f6098151880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:10.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.108+0000 7f609f131700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f609814faf0 0x7f6098152070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:10.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.108+0000 7f609f131700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6098155de0 0x7f609806e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:10.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.108+0000 7f609f131700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6098152c60 con 0x7f60980ba0e0 2023-07-25T14:37:10.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.108+0000 7f609f131700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60980babd0 con 0x7f609814faf0 2023-07-25T14:37:10.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.108+0000 7f609f131700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60980bae70 con 0x7f6098155de0 2023-07-25T14:37:10.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.108+0000 7f609cecd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f60980ba0e0 0x7f6098151880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:10.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.108+0000 7f609cecd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f60980ba0e0 0x7f6098151880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42564/0 (socket says 172.21.15.72:42564) 2023-07-25T14:37:10.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.108+0000 7f609cecd700 1 -- 172.21.15.72:0/3147464403 learned_addr learned my addr 172.21.15.72:0/3147464403 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:37:10.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.108+0000 7f6097fff700 1 --2- 172.21.15.72:0/3147464403 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f609814faf0 0x7f6098152070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:10.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.108+0000 7f609d6ce700 1 --2- 172.21.15.72:0/3147464403 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6098155de0 0x7f609806e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:10.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.109+0000 7f609cecd700 1 -- 172.21.15.72:0/3147464403 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6098155de0 msgr2=0x7f609806e3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:10.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.109+0000 7f609cecd700 1 --2- 172.21.15.72:0/3147464403 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6098155de0 0x7f609806e3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:10.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.109+0000 7f609cecd700 1 -- 172.21.15.72:0/3147464403 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f609814faf0 msgr2=0x7f6098152070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:10.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.109+0000 7f609cecd700 1 --2- 172.21.15.72:0/3147464403 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f609814faf0 0x7f6098152070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:10.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.109+0000 7f609cecd700 1 -- 172.21.15.72:0/3147464403 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6084009550 con 0x7f60980ba0e0 2023-07-25T14:37:10.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.109+0000 7f609cecd700 1 --2- 172.21.15.72:0/3147464403 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f60980ba0e0 0x7f6098151880 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f608c00c7f0 tx=0x7f608c00cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:10.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.109+0000 7f60957fa700 1 -- 172.21.15.72:0/3147464403 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f608c011800 con 0x7f60980ba0e0 2023-07-25T14:37:10.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.109+0000 7f60957fa700 1 -- 172.21.15.72:0/3147464403 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f608c011960 con 0x7f60980ba0e0 2023-07-25T14:37:10.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.109+0000 7f609f131700 1 -- 172.21.15.72:0/3147464403 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6098152eb0 con 0x7f60980ba0e0 2023-07-25T14:37:10.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.109+0000 7f60957fa700 1 -- 172.21.15.72:0/3147464403 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f608c011d10 con 0x7f60980ba0e0 2023-07-25T14:37:10.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.109+0000 7f609f131700 1 -- 172.21.15.72:0/3147464403 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60981502a0 con 0x7f60980ba0e0 2023-07-25T14:37:10.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.110+0000 7f609f131700 1 -- 172.21.15.72:0/3147464403 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f609804e470 con 0x7f60980ba0e0 2023-07-25T14:37:10.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.110+0000 7f60957fa700 1 -- 172.21.15.72:0/3147464403 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f608c018360 con 0x7f60980ba0e0 2023-07-25T14:37:10.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.111+0000 7f60957fa700 1 --2- 172.21.15.72:0/3147464403 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f607c06ace0 0x7f607c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:10.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.111+0000 7f60957fa700 1 -- 172.21.15.72:0/3147464403 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 7238+0+0 (secure 0 0 0) 0x7f608c0894b0 con 0x7f60980ba0e0 2023-07-25T14:37:10.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.111+0000 7f6097fff700 1 --2- 172.21.15.72:0/3147464403 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f607c06ace0 0x7f607c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:10.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.111+0000 7f6097fff700 1 --2- 172.21.15.72:0/3147464403 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f607c06ace0 0x7f607c06d1a0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f6084014040 tx=0x7f6084008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:10.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.115+0000 7f60957fa700 1 -- 172.21.15.72:0/3147464403 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f608c054150 con 0x7f60980ba0e0 2023-07-25T14:37:10.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.306+0000 7f609f131700 1 -- 172.21.15.72:0/3147464403 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7f60980c36a0 con 0x7f60980ba0e0 2023-07-25T14:37:10.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.306+0000 7f60957fa700 1 -- 172.21.15.72:0/3147464403 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v43) v1 ==== 105+0+11 (secure 0 0 0) 0x7f608c057770 con 0x7f60980ba0e0 2023-07-25T14:37:10.318 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2023-07-25T14:37:10.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.308+0000 7f609f131700 1 -- 172.21.15.72:0/3147464403 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f607c06ace0 msgr2=0x7f607c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:10.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.308+0000 7f609f131700 1 --2- 172.21.15.72:0/3147464403 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f607c06ace0 0x7f607c06d1a0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f6084014040 tx=0x7f6084008030 comp rx=0 tx=0).stop 2023-07-25T14:37:10.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.308+0000 7f609f131700 1 -- 172.21.15.72:0/3147464403 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f60980ba0e0 msgr2=0x7f6098151880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:10.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.308+0000 7f609f131700 1 --2- 172.21.15.72:0/3147464403 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f60980ba0e0 0x7f6098151880 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f608c00c7f0 tx=0x7f608c00cbb0 comp rx=0 tx=0).stop 2023-07-25T14:37:10.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.308+0000 7f609f131700 1 -- 172.21.15.72:0/3147464403 shutdown_connections 2023-07-25T14:37:10.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.308+0000 7f609f131700 1 --2- 172.21.15.72:0/3147464403 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f607c06ace0 0x7f607c06d1a0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:10.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.308+0000 7f609f131700 1 --2- 172.21.15.72:0/3147464403 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6098155de0 0x7f609806e3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:10.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.308+0000 7f609f131700 1 --2- 172.21.15.72:0/3147464403 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f60980ba0e0 0x7f6098151880 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:10.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.308+0000 7f609f131700 1 --2- 172.21.15.72:0/3147464403 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f609814faf0 0x7f6098152070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:10.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.308+0000 7f609f131700 1 -- 172.21.15.72:0/3147464403 >> 172.21.15.72:0/3147464403 conn(0x7f60980a87e0 msgr2=0x7f60980a6570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:10.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.308+0000 7f609f131700 1 -- 172.21.15.72:0/3147464403 shutdown_connections 2023-07-25T14:37:10.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.308+0000 7f609f131700 1 -- 172.21.15.72:0/3147464403 wait complete. 2023-07-25T14:37:10.332 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-07-25T14:37:10.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.443+0000 7fd114ee9700 1 Processor -- start 2023-07-25T14:37:10.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.443+0000 7fd114ee9700 1 -- start start 2023-07-25T14:37:10.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.444+0000 7fd114ee9700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd110154d50 0x7fd11015c980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:10.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.444+0000 7fd114ee9700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1100c54f0 con 0x7fd110151ba0 2023-07-25T14:37:10.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.444+0000 7fd114ee9700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1100c6670 con 0x7fd1100c5f40 2023-07-25T14:37:10.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.444+0000 7fd114ee9700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1100c5740 con 0x7fd110154d50 2023-07-25T14:37:10.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.444+0000 7fd10ed9d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd110154d50 0x7fd11015c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:10.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.444+0000 7fd10ed9d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fd110154d50 0x7fd11015c980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42576/0 (socket says 172.21.15.72:42576) 2023-07-25T14:37:10.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.444+0000 7fd10e59c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fd110151ba0 0x7fd1100c2230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:33308/0 (socket says 172.21.15.72:33308) 2023-07-25T14:37:10.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.444+0000 7fd10ed9d700 1 -- 172.21.15.72:0/2661172230 learned_addr learned my addr 172.21.15.72:0/2661172230 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:37:10.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.445+0000 7fd10ed9d700 1 -- 172.21.15.72:0/2661172230 >> v1:172.21.15.92:6789/0 conn(0x7fd1100c5f40 legacy=0x7fd110154640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:10.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.445+0000 7fd10ed9d700 1 -- 172.21.15.72:0/2661172230 >> v1:172.21.15.72:6789/0 conn(0x7fd110151ba0 legacy=0x7fd1100c2230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:10.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.445+0000 7fd10ed9d700 1 -- 172.21.15.72:0/2661172230 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1100c5a20 con 0x7fd110154d50 2023-07-25T14:37:10.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.445+0000 7fd10d59a700 1 -- 172.21.15.72:0/2661172230 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 885190732 0 0) 0x7fd1100c54f0 con 0x7fd110151ba0 2023-07-25T14:37:10.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.445+0000 7fd10ed9d700 1 --2- 172.21.15.72:0/2661172230 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd110154d50 0x7fd11015c980 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fd108009e50 tx=0x7fd10800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=836bd02328ae6577 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:10.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.445+0000 7fd10d59a700 1 -- 172.21.15.72:0/2661172230 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd10800e070 con 0x7fd110154d50 2023-07-25T14:37:10.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.445+0000 7fd10d59a700 1 -- 172.21.15.72:0/2661172230 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd108003a20 con 0x7fd110154d50 2023-07-25T14:37:10.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.445+0000 7fd10d59a700 1 -- 172.21.15.72:0/2661172230 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd108003dd0 con 0x7fd110154d50 2023-07-25T14:37:10.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.445+0000 7fd114ee9700 1 -- 172.21.15.72:0/2661172230 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd110154d50 msgr2=0x7fd11015c980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:10.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.445+0000 7fd114ee9700 1 --2- 172.21.15.72:0/2661172230 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd110154d50 0x7fd11015c980 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fd108009e50 tx=0x7fd10800b330 comp rx=0 tx=0).stop 2023-07-25T14:37:10.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.445+0000 7fd114ee9700 1 -- 172.21.15.72:0/2661172230 shutdown_connections 2023-07-25T14:37:10.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.445+0000 7fd114ee9700 1 --2- 172.21.15.72:0/2661172230 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd110154d50 0x7fd11015c980 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:10.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.445+0000 7fd114ee9700 1 -- 172.21.15.72:0/2661172230 >> 172.21.15.72:0/2661172230 conn(0x7fd1100a87e0 msgr2=0x7fd1100a8bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:10.463 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.446+0000 7fd114ee9700 1 -- 172.21.15.72:0/2661172230 shutdown_connections 2023-07-25T14:37:10.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.446+0000 7fd114ee9700 1 -- 172.21.15.72:0/2661172230 wait complete. 2023-07-25T14:37:10.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.447+0000 7fd114ee9700 1 Processor -- start 2023-07-25T14:37:10.464 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.447+0000 7fd114ee9700 1 -- start start 2023-07-25T14:37:10.467 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.447+0000 7fd114ee9700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd1100c5f40 0x7fd1101da8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:10.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.447+0000 7fd114ee9700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd110151ba0 0x7fd11006a190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:10.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.447+0000 7fd114ee9700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd1101dba40 0x7fd11014e800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:10.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.447+0000 7fd114ee9700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1101dcdc0 con 0x7fd1100c5f40 2023-07-25T14:37:10.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.447+0000 7fd114ee9700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd11006ad50 con 0x7fd1101dba40 2023-07-25T14:37:10.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.447+0000 7fd114ee9700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1101dd150 con 0x7fd110151ba0 2023-07-25T14:37:10.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.448+0000 7fd10e59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd1100c5f40 0x7fd1101da8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:10.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.448+0000 7fd10e59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd1100c5f40 0x7fd1101da8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42578/0 (socket says 172.21.15.72:42578) 2023-07-25T14:37:10.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.448+0000 7fd10e59c700 1 -- 172.21.15.72:0/2048627524 learned_addr learned my addr 172.21.15.72:0/2048627524 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:37:10.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.448+0000 7fd10ed9d700 1 --2- 172.21.15.72:0/2048627524 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd1101dba40 0x7fd11014e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:10.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.448+0000 7fd10dd9b700 1 --2- 172.21.15.72:0/2048627524 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd110151ba0 0x7fd11006a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:10.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.448+0000 7fd10e59c700 1 -- 172.21.15.72:0/2048627524 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd110151ba0 msgr2=0x7fd11006a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:10.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.448+0000 7fd10e59c700 1 --2- 172.21.15.72:0/2048627524 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd110151ba0 0x7fd11006a190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:10.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.448+0000 7fd10e59c700 1 -- 172.21.15.72:0/2048627524 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd1101dba40 msgr2=0x7fd11014e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:10.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.448+0000 7fd10e59c700 1 --2- 172.21.15.72:0/2048627524 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd1101dba40 0x7fd11014e800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:10.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.448+0000 7fd10e59c700 1 -- 172.21.15.72:0/2048627524 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd108009b30 con 0x7fd1100c5f40 2023-07-25T14:37:10.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.448+0000 7fd10dd9b700 1 --2- 172.21.15.72:0/2048627524 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd110151ba0 0x7fd11006a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-25T14:37:10.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.448+0000 7fd10ed9d700 1 --2- 172.21.15.72:0/2048627524 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd1101dba40 0x7fd11014e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-25T14:37:10.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.448+0000 7fd10e59c700 1 --2- 172.21.15.72:0/2048627524 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd1100c5f40 0x7fd1101da8c0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fd10400c520 tx=0x7fd10400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:10.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.448+0000 7fd0feffd700 1 -- 172.21.15.72:0/2048627524 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd104004c80 con 0x7fd1100c5f40 2023-07-25T14:37:10.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.448+0000 7fd0feffd700 1 -- 172.21.15.72:0/2048627524 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd104004e00 con 0x7fd1100c5f40 2023-07-25T14:37:10.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.448+0000 7fd114ee9700 1 -- 172.21.15.72:0/2048627524 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1101dd9b0 con 0x7fd1100c5f40 2023-07-25T14:37:10.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.448+0000 7fd0feffd700 1 -- 172.21.15.72:0/2048627524 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd104007310 con 0x7fd1100c5f40 2023-07-25T14:37:10.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.448+0000 7fd114ee9700 1 -- 172.21.15.72:0/2048627524 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1101dd360 con 0x7fd1100c5f40 2023-07-25T14:37:10.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.449+0000 7fd114ee9700 1 -- 172.21.15.72:0/2048627524 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd11004e470 con 0x7fd1100c5f40 2023-07-25T14:37:10.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.450+0000 7fd0feffd700 1 -- 172.21.15.72:0/2048627524 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd104007470 con 0x7fd1100c5f40 2023-07-25T14:37:10.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.450+0000 7fd0feffd700 1 --2- 172.21.15.72:0/2048627524 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fd0f006ace0 0x7fd0f006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:10.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.450+0000 7fd0feffd700 1 -- 172.21.15.72:0/2048627524 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 7238+0+0 (secure 0 0 0) 0x7fd104089b20 con 0x7fd1100c5f40 2023-07-25T14:37:10.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.450+0000 7fd10dd9b700 1 --2- 172.21.15.72:0/2048627524 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fd0f006ace0 0x7fd0f006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:10.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.451+0000 7fd10dd9b700 1 --2- 172.21.15.72:0/2048627524 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fd0f006ace0 0x7fd0f006d1a0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fd110071f50 tx=0x7fd100009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:10.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.454+0000 7fd0feffd700 1 -- 172.21.15.72:0/2048627524 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fd1040548a0 con 0x7fd1100c5f40 2023-07-25T14:37:10.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.640+0000 7fd114ee9700 1 -- 172.21.15.72:0/2048627524 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7fd1100c52d0 con 0x7fd1100c5f40 2023-07-25T14:37:10.651 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.640+0000 7fd0feffd700 1 -- 172.21.15.72:0/2048627524 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v43) v1 ==== 101+0+11 (secure 0 0 0) 0x7fd104057ec0 con 0x7fd1100c5f40 2023-07-25T14:37:10.652 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 64 2023-07-25T14:37:10.654 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.642+0000 7fd114ee9700 1 -- 172.21.15.72:0/2048627524 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fd0f006ace0 msgr2=0x7fd0f006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:10.654 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.642+0000 7fd114ee9700 1 --2- 172.21.15.72:0/2048627524 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fd0f006ace0 0x7fd0f006d1a0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fd110071f50 tx=0x7fd100009040 comp rx=0 tx=0).stop 2023-07-25T14:37:10.654 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.642+0000 7fd114ee9700 1 -- 172.21.15.72:0/2048627524 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd1100c5f40 msgr2=0x7fd1101da8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:10.654 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.642+0000 7fd114ee9700 1 --2- 172.21.15.72:0/2048627524 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd1100c5f40 0x7fd1101da8c0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fd10400c520 tx=0x7fd10400c8e0 comp rx=0 tx=0).stop 2023-07-25T14:37:10.654 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.642+0000 7fd114ee9700 1 -- 172.21.15.72:0/2048627524 shutdown_connections 2023-07-25T14:37:10.654 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.642+0000 7fd114ee9700 1 --2- 172.21.15.72:0/2048627524 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fd0f006ace0 0x7fd0f006d1a0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:10.654 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.642+0000 7fd114ee9700 1 --2- 172.21.15.72:0/2048627524 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd1101dba40 0x7fd11014e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:10.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.642+0000 7fd114ee9700 1 --2- 172.21.15.72:0/2048627524 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd1100c5f40 0x7fd1101da8c0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:10.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.642+0000 7fd114ee9700 1 --2- 172.21.15.72:0/2048627524 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd110151ba0 0x7fd11006a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:10.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.642+0000 7fd114ee9700 1 -- 172.21.15.72:0/2048627524 >> 172.21.15.72:0/2048627524 conn(0x7fd1100a87e0 msgr2=0x7fd110154450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:10.655 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.642+0000 7fd114ee9700 1 -- 172.21.15.72:0/2048627524 shutdown_connections 2023-07-25T14:37:10.656 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.642+0000 7fd114ee9700 1 -- 172.21.15.72:0/2048627524 wait complete. 2023-07-25T14:37:10.665 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-25T14:37:10.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.775+0000 7fdcaabe4700 1 Processor -- start 2023-07-25T14:37:10.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.775+0000 7fdcaabe4700 1 -- start start 2023-07-25T14:37:10.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.775+0000 7fdcaabe4700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fdca406f240 0x7fdca41514c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:10.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.775+0000 7fdcaabe4700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fdca40c11f0 0x7fdca4151a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:10.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.775+0000 7fdcaabe4700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdca40a8f40 con 0x7fdca414e4d0 2023-07-25T14:37:10.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.775+0000 7fdcaabe4700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdca40a9370 con 0x7fdca406f240 2023-07-25T14:37:10.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.775+0000 7fdcaabe4700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdca41555a0 con 0x7fdca40c11f0 2023-07-25T14:37:10.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.775+0000 7fdca3fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fdca406f240 0x7fdca41514c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:10.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.775+0000 7fdca3fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fdca406f240 0x7fdca41514c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42588/0 (socket says 172.21.15.72:42588) 2023-07-25T14:37:10.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.775+0000 7fdca3fff700 1 -- 172.21.15.72:0/1079337882 learned_addr learned my addr 172.21.15.72:0/1079337882 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:37:10.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.775+0000 7fdca8980700 1 --1- 172.21.15.72:0/1079337882 >> v1:172.21.15.72:6789/0 conn(0x7fdca414e4d0 0x7fdca40a6390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:33322/0 (socket says 172.21.15.72:33322) 2023-07-25T14:37:10.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.776+0000 7fdca9181700 1 --2- 172.21.15.72:0/1079337882 >> v2:172.21.15.92:3300/0 conn(0x7fdca40c11f0 0x7fdca4151a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:10.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.776+0000 7fdca3fff700 1 -- 172.21.15.72:0/1079337882 >> v2:172.21.15.92:3300/0 conn(0x7fdca40c11f0 msgr2=0x7fdca4151a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:10.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.776+0000 7fdca3fff700 1 --2- 172.21.15.72:0/1079337882 >> v2:172.21.15.92:3300/0 conn(0x7fdca40c11f0 0x7fdca4151a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:10.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.776+0000 7fdca3fff700 1 -- 172.21.15.72:0/1079337882 >> v1:172.21.15.72:6789/0 conn(0x7fdca414e4d0 legacy=0x7fdca40a6390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:10.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.776+0000 7fdca3fff700 1 -- 172.21.15.72:0/1079337882 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdca4150fc0 con 0x7fdca406f240 2023-07-25T14:37:10.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.776+0000 7fdca37fe700 1 -- 172.21.15.72:0/1079337882 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 852302940 0 0) 0x7fdca40a8f40 con 0x7fdca414e4d0 2023-07-25T14:37:10.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.776+0000 7fdca3fff700 1 --2- 172.21.15.72:0/1079337882 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdca406f240 0x7fdca41514c0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fdca406d5e0 tx=0x7fdc90009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c9d20b92d2bc7b8 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:10.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.776+0000 7fdca37fe700 1 -- 172.21.15.72:0/1079337882 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc9000b870 con 0x7fdca406f240 2023-07-25T14:37:10.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.776+0000 7fdca37fe700 1 -- 172.21.15.72:0/1079337882 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc9000b9d0 con 0x7fdca406f240 2023-07-25T14:37:10.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.776+0000 7fdca37fe700 1 -- 172.21.15.72:0/1079337882 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc9000bd60 con 0x7fdca406f240 2023-07-25T14:37:10.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.776+0000 7fdcaabe4700 1 -- 172.21.15.72:0/1079337882 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdca406f240 msgr2=0x7fdca41514c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:10.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.776+0000 7fdcaabe4700 1 --2- 172.21.15.72:0/1079337882 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdca406f240 0x7fdca41514c0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fdca406d5e0 tx=0x7fdc90009bd0 comp rx=0 tx=0).stop 2023-07-25T14:37:10.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.776+0000 7fdcaabe4700 1 -- 172.21.15.72:0/1079337882 shutdown_connections 2023-07-25T14:37:10.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.776+0000 7fdcaabe4700 1 --2- 172.21.15.72:0/1079337882 >> v2:172.21.15.92:3300/0 conn(0x7fdca40c11f0 0x7fdca4151a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:10.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.777+0000 7fdcaabe4700 1 --2- 172.21.15.72:0/1079337882 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdca406f240 0x7fdca41514c0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:10.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.777+0000 7fdcaabe4700 1 -- 172.21.15.72:0/1079337882 >> 172.21.15.72:0/1079337882 conn(0x7fdca4071540 msgr2=0x7fdca4071950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:10.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.777+0000 7fdcaabe4700 1 -- 172.21.15.72:0/1079337882 shutdown_connections 2023-07-25T14:37:10.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.777+0000 7fdcaabe4700 1 -- 172.21.15.72:0/1079337882 wait complete. 2023-07-25T14:37:10.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.778+0000 7fdcaabe4700 1 Processor -- start 2023-07-25T14:37:10.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.778+0000 7fdcaabe4700 1 -- start start 2023-07-25T14:37:10.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.778+0000 7fdcaabe4700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdca406f240 0x7fdca41ea040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:10.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.778+0000 7fdcaabe4700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fdca40c11f0 0x7fdca41ea580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:10.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.778+0000 7fdcaabe4700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdca414e4d0 0x7fdca41e8600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:10.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.778+0000 7fdcaabe4700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdca41eaac0 con 0x7fdca406f240 2023-07-25T14:37:10.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.778+0000 7fdcaabe4700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdca41e8170 con 0x7fdca414e4d0 2023-07-25T14:37:10.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.778+0000 7fdcaabe4700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdca414ccb0 con 0x7fdca40c11f0 2023-07-25T14:37:10.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.779+0000 7fdca8980700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdca406f240 0x7fdca41ea040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:10.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.779+0000 7fdca8980700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdca406f240 0x7fdca41ea040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42592/0 (socket says 172.21.15.72:42592) 2023-07-25T14:37:10.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.779+0000 7fdca8980700 1 -- 172.21.15.72:0/1089719631 learned_addr learned my addr 172.21.15.72:0/1089719631 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:37:10.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.779+0000 7fdca8980700 1 -- 172.21.15.72:0/1089719631 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fdca40c11f0 msgr2=0x7fdca41ea580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:10.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.779+0000 7fdca3fff700 1 --2- 172.21.15.72:0/1089719631 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fdca40c11f0 0x7fdca41ea580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:10.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.779+0000 7fdca9181700 1 --2- 172.21.15.72:0/1089719631 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdca414e4d0 0x7fdca41e8600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:10.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.779+0000 7fdca8980700 1 --2- 172.21.15.72:0/1089719631 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fdca40c11f0 0x7fdca41ea580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:10.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.779+0000 7fdca8980700 1 -- 172.21.15.72:0/1089719631 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdca414e4d0 msgr2=0x7fdca41e8600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:10.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.779+0000 7fdca8980700 1 --2- 172.21.15.72:0/1089719631 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdca414e4d0 0x7fdca41e8600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:10.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.779+0000 7fdca8980700 1 -- 172.21.15.72:0/1089719631 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc90009550 con 0x7fdca406f240 2023-07-25T14:37:10.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.779+0000 7fdca8980700 1 --2- 172.21.15.72:0/1089719631 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdca406f240 0x7fdca41ea040 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fdc9800c550 tx=0x7fdc9800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:10.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.779+0000 7fdca17fa700 1 -- 172.21.15.72:0/1089719631 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc98004c80 con 0x7fdca406f240 2023-07-25T14:37:10.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.779+0000 7fdca17fa700 1 -- 172.21.15.72:0/1089719631 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc98004e00 con 0x7fdca406f240 2023-07-25T14:37:10.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.779+0000 7fdcaabe4700 1 -- 172.21.15.72:0/1089719631 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdca414c6f0 con 0x7fdca406f240 2023-07-25T14:37:10.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.779+0000 7fdca17fa700 1 -- 172.21.15.72:0/1089719631 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc98007310 con 0x7fdca406f240 2023-07-25T14:37:10.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.779+0000 7fdcaabe4700 1 -- 172.21.15.72:0/1089719631 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdca41e7e00 con 0x7fdca406f240 2023-07-25T14:37:10.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.780+0000 7fdcaabe4700 1 -- 172.21.15.72:0/1089719631 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdca404e470 con 0x7fdca406f240 2023-07-25T14:37:10.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.781+0000 7fdca17fa700 1 -- 172.21.15.72:0/1089719631 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fdc98007470 con 0x7fdca406f240 2023-07-25T14:37:10.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.781+0000 7fdca17fa700 1 --2- 172.21.15.72:0/1089719631 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fdc8806ace0 0x7fdc8806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:10.797 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.781+0000 7fdca17fa700 1 -- 172.21.15.72:0/1089719631 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 7238+0+0 (secure 0 0 0) 0x7fdc980895d0 con 0x7fdca406f240 2023-07-25T14:37:10.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.781+0000 7fdca3fff700 1 --2- 172.21.15.72:0/1089719631 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fdc8806ace0 0x7fdc8806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:10.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.781+0000 7fdca3fff700 1 --2- 172.21.15.72:0/1089719631 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fdc8806ace0 0x7fdc8806d1a0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fdca406f680 tx=0x7fdc90008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:10.798 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.785+0000 7fdca17fa700 1 -- 172.21.15.72:0/1089719631 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fdc98054270 con 0x7fdca406f240 2023-07-25T14:37:10.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.987+0000 7fdcaabe4700 1 -- 172.21.15.72:0/1089719631 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fdca40c6ba0 con 0x7fdca406f240 2023-07-25T14:37:10.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.987+0000 7fdca17fa700 1 -- 172.21.15.72:0/1089719631 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v43) v1 ==== 80+0+0 (secure 0 0 0) 0x7fdc98057890 con 0x7fdca406f240 2023-07-25T14:37:11.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.990+0000 7fdcaabe4700 1 -- 172.21.15.72:0/1089719631 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fdc8806ace0 msgr2=0x7fdc8806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:11.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.990+0000 7fdcaabe4700 1 --2- 172.21.15.72:0/1089719631 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fdc8806ace0 0x7fdc8806d1a0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fdca406f680 tx=0x7fdc90008030 comp rx=0 tx=0).stop 2023-07-25T14:37:11.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.990+0000 7fdcaabe4700 1 -- 172.21.15.72:0/1089719631 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdca406f240 msgr2=0x7fdca41ea040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:11.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.990+0000 7fdcaabe4700 1 --2- 172.21.15.72:0/1089719631 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdca406f240 0x7fdca41ea040 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fdc9800c550 tx=0x7fdc9800c910 comp rx=0 tx=0).stop 2023-07-25T14:37:11.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.990+0000 7fdcaabe4700 1 -- 172.21.15.72:0/1089719631 shutdown_connections 2023-07-25T14:37:11.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.990+0000 7fdcaabe4700 1 --2- 172.21.15.72:0/1089719631 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fdc8806ace0 0x7fdc8806d1a0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:11.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.990+0000 7fdcaabe4700 1 --2- 172.21.15.72:0/1089719631 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdca414e4d0 0x7fdca41e8600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:11.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.990+0000 7fdcaabe4700 1 --2- 172.21.15.72:0/1089719631 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdca406f240 0x7fdca41ea040 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:11.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.990+0000 7fdcaabe4700 1 --2- 172.21.15.72:0/1089719631 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fdca40c11f0 0x7fdca41ea580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:11.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.990+0000 7fdcaabe4700 1 -- 172.21.15.72:0/1089719631 >> 172.21.15.72:0/1089719631 conn(0x7fdca4071540 msgr2=0x7fdca40a6390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:11.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.990+0000 7fdcaabe4700 1 -- 172.21.15.72:0/1089719631 shutdown_connections 2023-07-25T14:37:11.002 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:10.990+0000 7fdcaabe4700 1 -- 172.21.15.72:0/1089719631 wait complete. 2023-07-25T14:37:11.003 INFO:teuthology.orchestra.run.smithi072.stderr:listed 0 entries 2023-07-25T14:37:11.013 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-07-25T14:37:11.013 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-25T14:37:11.014 DEBUG:teuthology.orchestra.run.smithi092:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-07-25T14:37:11.059 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi092.front.sepia.ceph.com 2023-07-25T14:37:11.060 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-25T14:37:11.060 DEBUG:teuthology.orchestra.run.smithi092:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-07-25T14:37:11.080 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-07-25T14:37:11.081 DEBUG:teuthology.orchestra.run.smithi092:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-25T14:37:11.140 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284264k,nr_inodes=4071066,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=45,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19843 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260552k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 2023-07-25T14:37:11.141 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-25T14:37:11.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:11.250+0000 7fdd90195700 1 Processor -- start 2023-07-25T14:37:11.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:11.250+0000 7fdd90195700 1 -- start start 2023-07-25T14:37:11.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:11.251+0000 7fdd90195700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fdd880724c0 0x7fdd880c34c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:11.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:11.251+0000 7fdd90195700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fdd880c4930 0x7fdd880c3a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:11.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:11.251+0000 7fdd90195700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd880c2fe0 con 0x7fdd88151950 2023-07-25T14:37:11.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:11.251+0000 7fdd90195700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd88071a60 con 0x7fdd880724c0 2023-07-25T14:37:11.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:11.251+0000 7fdd90195700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd880c2a70 con 0x7fdd880c4930 2023-07-25T14:37:11.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:11.251+0000 7fdd8d730700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fdd880724c0 0x7fdd880c34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:11.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:11.251+0000 7fdd8df31700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fdd88151950 0x7fdd8806a190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:33336/0 (socket says 172.21.15.72:33336) 2023-07-25T14:37:11.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:11.251+0000 7fdd8df31700 1 -- 172.21.15.72:0/279108920 learned_addr learned my addr 172.21.15.72:0/279108920 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:37:11.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:11.251+0000 7fdd8d730700 1 -- 172.21.15.72:0/279108920 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fdd880c4930 msgr2=0x7fdd880c3a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:11.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:11.251+0000 7fdd8e732700 1 --2- 172.21.15.72:0/279108920 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fdd880c4930 0x7fdd880c3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:11.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:11.251+0000 7fdd8d730700 1 --2- 172.21.15.72:0/279108920 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fdd880c4930 0x7fdd880c3a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:11.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:11.251+0000 7fdd8d730700 1 -- 172.21.15.72:0/279108920 >> v1:172.21.15.72:6789/0 conn(0x7fdd88151950 legacy=0x7fdd8806a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:11.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:11.251+0000 7fdd8d730700 1 -- 172.21.15.72:0/279108920 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd88155070 con 0x7fdd880724c0 2023-07-25T14:37:11.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:11.251+0000 7fdd8cf2f700 1 -- 172.21.15.72:0/279108920 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1232049253 0 0) 0x7fdd880c2fe0 con 0x7fdd88151950 2023-07-25T14:37:11.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:11.251+0000 7fdd8e732700 1 --2- 172.21.15.72:0/279108920 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fdd880c4930 0x7fdd880c3a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-25T14:37:11.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:11.252+0000 7fdd8d730700 1 --2- 172.21.15.72:0/279108920 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdd880724c0 0x7fdd880c34c0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fdd84009840 tx=0x7fdd84009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68965c7f2ccd6d3c server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:11.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:11.252+0000 7fdd8cf2f700 1 -- 172.21.15.72:0/279108920 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd84011830 con 0x7fdd880724c0 2023-07-25T14:37:11.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:11.252+0000 7fdd8cf2f700 1 -- 172.21.15.72:0/279108920 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd84011990 con 0x7fdd880724c0 2023-07-25T14:37:11.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:11.252+0000 7fdd8cf2f700 1 -- 172.21.15.72:0/279108920 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd84011d20 con 0x7fdd880724c0 2023-07-25T14:37:11.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:11.252+0000 7fdd90195700 1 -- 172.21.15.72:0/279108920 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdd880724c0 msgr2=0x7fdd880c34c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:11.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:11.252+0000 7fdd90195700 1 --2- 172.21.15.72:0/279108920 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdd880724c0 0x7fdd880c34c0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fdd84009840 tx=0x7fdd84009b50 comp rx=0 tx=0).stop 2023-07-25T14:37:11.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:11.252+0000 7fdd90195700 1 -- 172.21.15.72:0/279108920 shutdown_connections 2023-07-25T14:37:11.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:11.252+0000 7fdd90195700 1 --2- 172.21.15.72:0/279108920 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fdd880c4930 0x7fdd880c3a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:11.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:11.252+0000 7fdd90195700 1 --2- 172.21.15.72:0/279108920 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdd880724c0 0x7fdd880c34c0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:11.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:11.252+0000 7fdd90195700 1 -- 172.21.15.72:0/279108920 >> 172.21.15.72:0/279108920 conn(0x7fdd880a87e0 msgr2=0x7fdd880a8bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:11.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:11.252+0000 7fdd90195700 1 -- 172.21.15.72:0/279108920 shutdown_connections 2023-07-25T14:37:11.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:11.252+0000 7fdd90195700 1 -- 172.21.15.72:0/279108920 wait complete. 2023-07-25T14:37:11.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:11.253+0000 7fdd90195700 1 Processor -- start 2023-07-25T14:37:11.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:11.253+0000 7fdd90195700 1 -- start start 2023-07-25T14:37:11.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:11.254+0000 7fdd90195700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdd880724c0 0x7fdd881e9970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:11.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:11.254+0000 7fdd90195700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fdd880c4930 0x7fdd880ac0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:11.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:11.254+0000 7fdd90195700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdd88151950 0x7fdd881559d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:11.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:11.254+0000 7fdd90195700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd880bdea0 con 0x7fdd880724c0 2023-07-25T14:37:11.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:11.254+0000 7fdd90195700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd880beb70 con 0x7fdd88151950 2023-07-25T14:37:11.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:11.254+0000 7fdd90195700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd880ab020 con 0x7fdd880c4930 2023-07-25T14:37:11.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:11.254+0000 7fdd8df31700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdd880724c0 0x7fdd881e9970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:11.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:11.254+0000 7fdd8df31700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdd880724c0 0x7fdd881e9970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42606/0 (socket says 172.21.15.72:42606) 2023-07-25T14:37:11.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:11.254+0000 7fdd8df31700 1 -- 172.21.15.72:0/289632199 learned_addr learned my addr 172.21.15.72:0/289632199 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:37:11.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:11.254+0000 7fdd8df31700 1 -- 172.21.15.72:0/289632199 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fdd880c4930 msgr2=0x7fdd880ac0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:11.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:11.254+0000 7fdd8df31700 1 --2- 172.21.15.72:0/289632199 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fdd880c4930 0x7fdd880ac0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:11.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:11.254+0000 7fdd8df31700 1 -- 172.21.15.72:0/289632199 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdd88151950 msgr2=0x7fdd881559d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:11.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:11.254+0000 7fdd8df31700 1 --2- 172.21.15.72:0/289632199 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdd88151950 0x7fdd881559d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:11.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:11.254+0000 7fdd8df31700 1 -- 172.21.15.72:0/289632199 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd840094a0 con 0x7fdd880724c0 2023-07-25T14:37:11.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:11.255+0000 7fdd8df31700 1 --2- 172.21.15.72:0/289632199 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdd880724c0 0x7fdd881e9970 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fdd7800c580 tx=0x7fdd7800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:11.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:11.255+0000 7fdd7e7fc700 1 -- 172.21.15.72:0/289632199 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd78004c80 con 0x7fdd880724c0 2023-07-25T14:37:11.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:11.255+0000 7fdd7e7fc700 1 -- 172.21.15.72:0/289632199 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd78004e00 con 0x7fdd880724c0 2023-07-25T14:37:11.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:11.255+0000 7fdd90195700 1 -- 172.21.15.72:0/289632199 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd880ab300 con 0x7fdd880724c0 2023-07-25T14:37:11.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:11.255+0000 7fdd7e7fc700 1 -- 172.21.15.72:0/289632199 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd78007310 con 0x7fdd880724c0 2023-07-25T14:37:11.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:11.255+0000 7fdd90195700 1 -- 172.21.15.72:0/289632199 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd880ab8c0 con 0x7fdd880724c0 2023-07-25T14:37:11.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:11.256+0000 7fdd90195700 1 -- 172.21.15.72:0/289632199 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd8804e470 con 0x7fdd880724c0 2023-07-25T14:37:11.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:11.256+0000 7fdd7e7fc700 1 -- 172.21.15.72:0/289632199 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fdd78007470 con 0x7fdd880724c0 2023-07-25T14:37:11.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:11.256+0000 7fdd7e7fc700 1 --2- 172.21.15.72:0/289632199 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fdd6c06ad10 0x7fdd6c06d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:11.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:11.257+0000 7fdd7e7fc700 1 -- 172.21.15.72:0/289632199 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 7238+0+0 (secure 0 0 0) 0x7fdd78089680 con 0x7fdd880724c0 2023-07-25T14:37:11.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:11.257+0000 7fdd8d730700 1 --2- 172.21.15.72:0/289632199 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fdd6c06ad10 0x7fdd6c06d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:11.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:11.257+0000 7fdd8d730700 1 --2- 172.21.15.72:0/289632199 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fdd6c06ad10 0x7fdd6c06d1d0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fdd881512b0 tx=0x7fdd84010000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:11.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:11.261+0000 7fdd7e7fc700 1 -- 172.21.15.72:0/289632199 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fdd78054290 con 0x7fdd880724c0 2023-07-25T14:37:11.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:11.499+0000 7fdd90195700 1 -- 172.21.15.72:0/289632199 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fdd880a8d50 con 0x7fdd880724c0 2023-07-25T14:37:11.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:11.499+0000 7fdd7e7fc700 1 -- 172.21.15.72:0/289632199 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v22) v1 ==== 53+0+149 (secure 0 0 0) 0x7fdd780578b0 con 0x7fdd880724c0 2023-07-25T14:37:11.511 INFO:teuthology.orchestra.run.smithi072.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-25T14:37:11.511 INFO:teuthology.orchestra.run.smithi072.stdout:name: cephfs2, metadata pool: cephfs2_metadata, data pools: [cephfs2_data ] 2023-07-25T14:37:11.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:11.501+0000 7fdd90195700 1 -- 172.21.15.72:0/289632199 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fdd6c06ad10 msgr2=0x7fdd6c06d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:11.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:11.501+0000 7fdd90195700 1 --2- 172.21.15.72:0/289632199 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fdd6c06ad10 0x7fdd6c06d1d0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fdd881512b0 tx=0x7fdd84010000 comp rx=0 tx=0).stop 2023-07-25T14:37:11.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:11.501+0000 7fdd90195700 1 -- 172.21.15.72:0/289632199 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdd880724c0 msgr2=0x7fdd881e9970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:11.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:11.501+0000 7fdd90195700 1 --2- 172.21.15.72:0/289632199 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdd880724c0 0x7fdd881e9970 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fdd7800c580 tx=0x7fdd7800c940 comp rx=0 tx=0).stop 2023-07-25T14:37:11.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:11.502+0000 7fdd90195700 1 -- 172.21.15.72:0/289632199 shutdown_connections 2023-07-25T14:37:11.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:11.502+0000 7fdd90195700 1 --2- 172.21.15.72:0/289632199 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fdd6c06ad10 0x7fdd6c06d1d0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:11.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:11.502+0000 7fdd90195700 1 --2- 172.21.15.72:0/289632199 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdd88151950 0x7fdd881559d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:11.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:11.502+0000 7fdd90195700 1 --2- 172.21.15.72:0/289632199 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdd880724c0 0x7fdd881e9970 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:11.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:11.502+0000 7fdd90195700 1 --2- 172.21.15.72:0/289632199 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fdd880c4930 0x7fdd880ac0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:11.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:11.502+0000 7fdd90195700 1 -- 172.21.15.72:0/289632199 >> 172.21.15.72:0/289632199 conn(0x7fdd880a87e0 msgr2=0x7fdd8806f930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:11.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:11.502+0000 7fdd90195700 1 -- 172.21.15.72:0/289632199 shutdown_connections 2023-07-25T14:37:11.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:11.502+0000 7fdd90195700 1 -- 172.21.15.72:0/289632199 wait complete. 2023-07-25T14:37:11.524 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs2; just confirmed its presence on cluster 2023-07-25T14:37:11.525 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-25T14:37:11.525 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi092.front.sepia.ceph.com 2023-07-25T14:37:11.525 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-07-25T14:37:11.526 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-07-25T14:37:11.526 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs2 2023-07-25T14:37:11.526 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-07-25T14:37:11.526 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-25T14:37:11.527 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-07-25T14:37:11.527 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-25T14:37:11.527 DEBUG:teuthology.orchestra.run.smithi092:> ip addr 2023-07-25T14:37:11.549 INFO:teuthology.orchestra.run.smithi092.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-25T14:37:11.549 INFO:teuthology.orchestra.run.smithi092.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-25T14:37:11.549 INFO:teuthology.orchestra.run.smithi092.stdout: inet 127.0.0.1/8 scope host lo 2023-07-25T14:37:11.549 INFO:teuthology.orchestra.run.smithi092.stdout: valid_lft forever preferred_lft forever 2023-07-25T14:37:11.550 INFO:teuthology.orchestra.run.smithi092.stdout: inet6 ::1/128 scope host 2023-07-25T14:37:11.550 INFO:teuthology.orchestra.run.smithi092.stdout: valid_lft forever preferred_lft forever 2023-07-25T14:37:11.550 INFO:teuthology.orchestra.run.smithi092.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-25T14:37:11.550 INFO:teuthology.orchestra.run.smithi092.stdout: link/ether 0c:c4:7a:d8:a1:b2 brd ff:ff:ff:ff:ff:ff 2023-07-25T14:37:11.550 INFO:teuthology.orchestra.run.smithi092.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-25T14:37:11.550 INFO:teuthology.orchestra.run.smithi092.stdout: link/ether 0c:c4:7a:d8:a1:b3 brd ff:ff:ff:ff:ff:ff 2023-07-25T14:37:11.550 INFO:teuthology.orchestra.run.smithi092.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-25T14:37:11.551 INFO:teuthology.orchestra.run.smithi092.stdout: link/ether 0c:c4:7a:8f:cd:44 brd ff:ff:ff:ff:ff:ff 2023-07-25T14:37:11.551 INFO:teuthology.orchestra.run.smithi092.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-25T14:37:11.551 INFO:teuthology.orchestra.run.smithi092.stdout: link/ether 0c:c4:7a:8f:cd:45 brd ff:ff:ff:ff:ff:ff 2023-07-25T14:37:11.551 INFO:teuthology.orchestra.run.smithi092.stdout: inet 172.21.15.92/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-07-25T14:37:11.551 INFO:teuthology.orchestra.run.smithi092.stdout: valid_lft 42162sec preferred_lft 42162sec 2023-07-25T14:37:11.551 INFO:teuthology.orchestra.run.smithi092.stdout: inet6 fe80::c8ab:79f5:f80b:16b/64 scope link noprefixroute 2023-07-25T14:37:11.551 INFO:teuthology.orchestra.run.smithi092.stdout: valid_lft forever preferred_lft forever 2023-07-25T14:37:11.551 INFO:teuthology.orchestra.run.smithi092.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-25T14:37:11.552 INFO:teuthology.orchestra.run.smithi092.stdout: link/ether 0e:6e:1c:1c:77:0f brd ff:ff:ff:ff:ff:ff 2023-07-25T14:37:11.552 INFO:teuthology.orchestra.run.smithi092.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-25T14:37:11.552 INFO:teuthology.orchestra.run.smithi092.stdout: valid_lft forever preferred_lft forever 2023-07-25T14:37:11.552 INFO:teuthology.orchestra.run.smithi092.stdout: inet6 fe80::5099:6cff:fecf:8811/64 scope link 2023-07-25T14:37:11.552 INFO:teuthology.orchestra.run.smithi092.stdout: valid_lft forever preferred_lft forever 2023-07-25T14:37:11.552 INFO:teuthology.orchestra.run.smithi092.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-25T14:37:11.552 INFO:teuthology.orchestra.run.smithi092.stdout: link/ether 0e:6e:1c:1c:77:0f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-07-25T14:37:11.553 INFO:teuthology.orchestra.run.smithi092.stdout: inet6 fe80::c6e:1cff:fe1c:770f/64 scope link 2023-07-25T14:37:11.553 INFO:teuthology.orchestra.run.smithi092.stdout: valid_lft forever preferred_lft forever 2023-07-25T14:37:11.553 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-25T14:37:11.553 DEBUG:teuthology.orchestra.run.smithi092:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-25T14:37:11.620 INFO:teuthology.orchestra.run.smithi092.stdout:1 2023-07-25T14:37:11.621 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-25T14:37:11.622 DEBUG:teuthology.orchestra.run.smithi092:> route 2023-07-25T14:37:11.683 INFO:teuthology.orchestra.run.smithi092.stdout:Kernel IP routing table 2023-07-25T14:37:11.683 INFO:teuthology.orchestra.run.smithi092.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-25T14:37:11.684 INFO:teuthology.orchestra.run.smithi092.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-07-25T14:37:11.684 INFO:teuthology.orchestra.run.smithi092.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-07-25T14:37:11.684 INFO:teuthology.orchestra.run.smithi092.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-25T14:37:11.684 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-25T14:37:11.685 DEBUG:teuthology.orchestra.run.smithi092:> (cd / && exec bash -c ' 2023-07-25T14:37:11.685 DEBUG:teuthology.orchestra.run.smithi092:> set -e 2023-07-25T14:37:11.685 DEBUG:teuthology.orchestra.run.smithi092:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-07-25T14:37:11.686 DEBUG:teuthology.orchestra.run.smithi092:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-07-25T14:37:11.686 DEBUG:teuthology.orchestra.run.smithi092:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-07-25T14:37:11.686 DEBUG:teuthology.orchestra.run.smithi092:> ') 2023-07-25T14:37:11.802 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-25T14:37:11.803 DEBUG:teuthology.orchestra.run.smithi092:> ip netns list 2023-07-25T14:37:11.824 INFO:teuthology.orchestra.run.smithi092.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-07-25T14:37:11.825 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-07-25T14:37:11.825 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-25T14:37:11.826 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip link set brx.0 up 2023-07-25T14:37:11.897 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-25T14:37:11.898 DEBUG:teuthology.orchestra.run.smithi092:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-07-25T14:37:11.959 INFO:teuthology.orchestra.run.smithi092.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-07-25T14:37:11.959 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-25T14:37:11.960 DEBUG:teuthology.orchestra.run.smithi092:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-07-25T14:37:12.020 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-07-25T14:37:12.020 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-25T14:37:12.021 DEBUG:teuthology.orchestra.run.smithi092:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs2 2023-07-25T14:37:12.114 INFO:teuthology.orchestra.run.smithi092.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs2 2023-07-25T14:37:12.114 INFO:teuthology.orchestra.run.smithi092.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs2". 2023-07-25T14:37:12.114 INFO:teuthology.orchestra.run.smithi092.stdout:invalid new device string format 2023-07-25T14:37:12.123 INFO:teuthology.orchestra.run.smithi092.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs2 2023-07-25T14:37:12.124 INFO:teuthology.orchestra.run.smithi092.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs2". 2023-07-25T14:37:12.124 INFO:teuthology.orchestra.run.smithi092.stdout:invalid new device string format 2023-07-25T14:37:12.124 INFO:teuthology.orchestra.run.smithi092.stdout:mount.ceph: resolved to: "172.21.15.72:3300,172.21.15.92:3300,172.21.15.92:3301" 2023-07-25T14:37:12.124 INFO:teuthology.orchestra.run.smithi092.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-25T14:37:12.191 INFO:teuthology.orchestra.run.smithi092.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs2 2023-07-25T14:37:12.191 INFO:teuthology.orchestra.run.smithi092.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs2". 2023-07-25T14:37:12.192 INFO:teuthology.orchestra.run.smithi092.stdout:invalid new device string format 2023-07-25T14:37:12.192 INFO:teuthology.orchestra.run.smithi092.stdout:mount.ceph: resolved to: "172.21.15.72:3300,172.21.15.92:3300,172.21.15.92:3301" 2023-07-25T14:37:12.192 INFO:teuthology.orchestra.run.smithi092.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-25T14:37:12.192 INFO:teuthology.orchestra.run.smithi092.stdout:mount.ceph: resolved to: "172.21.15.72:6789,172.21.15.92:6789,172.21.15.92:6790" 2023-07-25T14:37:12.192 INFO:teuthology.orchestra.run.smithi092.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.72:6789,172.21.15.92:6789,172.21.15.92:6790:/ 2023-07-25T14:37:12.192 INFO:teuthology.orchestra.run.smithi092.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs2,key=1,fsid=9170db48-9170-43e8-8ccb-9813e6240906" will pass to kernel 2023-07-25T14:37:12.193 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-25T14:37:12.194 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-25T14:37:12.194 DEBUG:teuthology.orchestra.run.smithi092:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-07-25T14:37:12.222 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-25T14:37:12.223 DEBUG:teuthology.orchestra.run.smithi092:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-25T14:37:12.311 INFO:teuthology.orchestra.run.smithi092.stdout:client5389 2023-07-25T14:37:12.311 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-07-25T14:37:12.312 DEBUG:teuthology.orchestra.run.smithi092:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-25T14:37:12.329 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs authorize cephfs client.testuser / rw 2023-07-25T14:37:12.465 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:12.454+0000 7f8b64d28700 1 Processor -- start 2023-07-25T14:37:12.466 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:12.454+0000 7f8b64d28700 1 -- start start 2023-07-25T14:37:12.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:12.455+0000 7f8b64d28700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8b6014e200 0x7f8b600c09f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:12.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:12.455+0000 7f8b64d28700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8b600c02c0 0x7f8b6006a190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:12.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:12.455+0000 7f8b64d28700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b6014e5e0 con 0x7f8b6006a6d0 2023-07-25T14:37:12.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:12.455+0000 7f8b64d28700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b60154fd0 con 0x7f8b600c02c0 2023-07-25T14:37:12.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:12.455+0000 7f8b64d28700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b600c0f30 con 0x7f8b6014e200 2023-07-25T14:37:12.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:12.455+0000 7f8b5dd9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8b600c02c0 0x7f8b6006a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:12.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:12.455+0000 7f8b5ed9d700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f8b6006a6d0 0x7f8b60157880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:33354/0 (socket says 172.21.15.72:33354) 2023-07-25T14:37:12.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:12.455+0000 7f8b5dd9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8b600c02c0 0x7f8b6006a190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42614/0 (socket says 172.21.15.72:42614) 2023-07-25T14:37:12.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:12.455+0000 7f8b5ed9d700 1 -- 172.21.15.72:0/1142646093 learned_addr learned my addr 172.21.15.72:0/1142646093 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:37:12.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:12.455+0000 7f8b5e59c700 1 --2- 172.21.15.72:0/1142646093 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8b6014e200 0x7f8b600c09f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:12.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:12.456+0000 7f8b5dd9b700 1 -- 172.21.15.72:0/1142646093 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8b6014e200 msgr2=0x7f8b600c09f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:12.471 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:12.456+0000 7f8b5dd9b700 1 --2- 172.21.15.72:0/1142646093 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8b6014e200 0x7f8b600c09f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:12.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:12.456+0000 7f8b5dd9b700 1 -- 172.21.15.72:0/1142646093 >> v1:172.21.15.72:6789/0 conn(0x7f8b6006a6d0 legacy=0x7f8b60157880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:12.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:12.456+0000 7f8b5dd9b700 1 -- 172.21.15.72:0/1142646093 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b60154350 con 0x7f8b600c02c0 2023-07-25T14:37:12.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:12.456+0000 7f8b5d59a700 1 -- 172.21.15.72:0/1142646093 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1007786310 0 0) 0x7f8b6014e5e0 con 0x7f8b6006a6d0 2023-07-25T14:37:12.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:12.456+0000 7f8b5dd9b700 1 --2- 172.21.15.72:0/1142646093 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8b600c02c0 0x7f8b6006a190 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f8b50009840 tx=0x7f8b50009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de304a8af01e21a server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:12.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:12.456+0000 7f8b5d59a700 1 -- 172.21.15.72:0/1142646093 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b50011830 con 0x7f8b600c02c0 2023-07-25T14:37:12.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:12.456+0000 7f8b5d59a700 1 -- 172.21.15.72:0/1142646093 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b50011990 con 0x7f8b600c02c0 2023-07-25T14:37:12.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:12.456+0000 7f8b5d59a700 1 -- 172.21.15.72:0/1142646093 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b50011d20 con 0x7f8b600c02c0 2023-07-25T14:37:12.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:12.456+0000 7f8b64d28700 1 -- 172.21.15.72:0/1142646093 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8b600c02c0 msgr2=0x7f8b6006a190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:12.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:12.456+0000 7f8b64d28700 1 --2- 172.21.15.72:0/1142646093 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8b600c02c0 0x7f8b6006a190 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f8b50009840 tx=0x7f8b50009b50 comp rx=0 tx=0).stop 2023-07-25T14:37:12.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:12.456+0000 7f8b64d28700 1 -- 172.21.15.72:0/1142646093 shutdown_connections 2023-07-25T14:37:12.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:12.457+0000 7f8b64d28700 1 --2- 172.21.15.72:0/1142646093 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8b6014e200 0x7f8b600c09f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:12.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:12.457+0000 7f8b64d28700 1 --2- 172.21.15.72:0/1142646093 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8b600c02c0 0x7f8b6006a190 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:12.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:12.457+0000 7f8b64d28700 1 -- 172.21.15.72:0/1142646093 >> 172.21.15.72:0/1142646093 conn(0x7f8b6006bbc0 msgr2=0x7f8b600a8590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:12.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:12.457+0000 7f8b64d28700 1 -- 172.21.15.72:0/1142646093 shutdown_connections 2023-07-25T14:37:12.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:12.457+0000 7f8b64d28700 1 -- 172.21.15.72:0/1142646093 wait complete. 2023-07-25T14:37:12.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:12.458+0000 7f8b64d28700 1 Processor -- start 2023-07-25T14:37:12.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:12.458+0000 7f8b64d28700 1 -- start start 2023-07-25T14:37:12.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:12.459+0000 7f8b64d28700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8b6006a6d0 0x7f8b60149ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:12.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:12.459+0000 7f8b64d28700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8b600c02c0 0x7f8b600c33e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:12.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:12.459+0000 7f8b64d28700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8b6014e200 0x7f8b600c3920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:12.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:12.459+0000 7f8b64d28700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b600aa060 con 0x7f8b600c02c0 2023-07-25T14:37:12.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:12.459+0000 7f8b64d28700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b601ea7e0 con 0x7f8b6006a6d0 2023-07-25T14:37:12.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:12.459+0000 7f8b64d28700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b600a9d80 con 0x7f8b6014e200 2023-07-25T14:37:12.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:12.459+0000 7f8b5dd9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8b600c02c0 0x7f8b600c33e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:12.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:12.459+0000 7f8b5dd9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8b600c02c0 0x7f8b600c33e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42620/0 (socket says 172.21.15.72:42620) 2023-07-25T14:37:12.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:12.459+0000 7f8b5dd9b700 1 -- 172.21.15.72:0/2124602075 learned_addr learned my addr 172.21.15.72:0/2124602075 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:37:12.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:12.459+0000 7f8b5ed9d700 1 --2- 172.21.15.72:0/2124602075 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8b6014e200 0x7f8b600c3920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:12.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:12.459+0000 7f8b5e59c700 1 --2- 172.21.15.72:0/2124602075 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8b6006a6d0 0x7f8b60149ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:12.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:12.459+0000 7f8b5dd9b700 1 -- 172.21.15.72:0/2124602075 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8b6014e200 msgr2=0x7f8b600c3920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:12.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:12.459+0000 7f8b5dd9b700 1 --2- 172.21.15.72:0/2124602075 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8b6014e200 0x7f8b600c3920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:12.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:12.459+0000 7f8b5dd9b700 1 -- 172.21.15.72:0/2124602075 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8b6006a6d0 msgr2=0x7f8b60149ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:12.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:12.460+0000 7f8b5dd9b700 1 --2- 172.21.15.72:0/2124602075 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8b6006a6d0 0x7f8b60149ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:12.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:12.460+0000 7f8b5dd9b700 1 -- 172.21.15.72:0/2124602075 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b500094a0 con 0x7f8b600c02c0 2023-07-25T14:37:12.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:12.460+0000 7f8b5dd9b700 1 --2- 172.21.15.72:0/2124602075 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8b600c02c0 0x7f8b600c33e0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f8b50009b90 tx=0x7f8b50004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:12.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:12.460+0000 7f8b4effd700 1 -- 172.21.15.72:0/2124602075 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b500038a0 con 0x7f8b600c02c0 2023-07-25T14:37:12.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:12.460+0000 7f8b4effd700 1 -- 172.21.15.72:0/2124602075 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b5001f070 con 0x7f8b600c02c0 2023-07-25T14:37:12.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:12.460+0000 7f8b64d28700 1 -- 172.21.15.72:0/2124602075 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b600aa5a0 con 0x7f8b600c02c0 2023-07-25T14:37:12.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:12.460+0000 7f8b4effd700 1 -- 172.21.15.72:0/2124602075 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b50003c20 con 0x7f8b600c02c0 2023-07-25T14:37:12.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:12.460+0000 7f8b64d28700 1 -- 172.21.15.72:0/2124602075 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b6014a3e0 con 0x7f8b600c02c0 2023-07-25T14:37:12.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:12.461+0000 7f8b64d28700 1 -- 172.21.15.72:0/2124602075 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b600aa790 con 0x7f8b600c02c0 2023-07-25T14:37:12.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:12.461+0000 7f8b4effd700 1 -- 172.21.15.72:0/2124602075 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8b5001a430 con 0x7f8b600c02c0 2023-07-25T14:37:12.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:12.462+0000 7f8b4effd700 1 --2- 172.21.15.72:0/2124602075 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f8b4006ace0 0x7f8b4006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:12.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:12.462+0000 7f8b4effd700 1 -- 172.21.15.72:0/2124602075 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 7238+0+0 (secure 0 0 0) 0x7f8b50021070 con 0x7f8b600c02c0 2023-07-25T14:37:12.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:12.462+0000 7f8b5e59c700 1 --2- 172.21.15.72:0/2124602075 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f8b4006ace0 0x7f8b4006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:12.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:12.462+0000 7f8b5e59c700 1 --2- 172.21.15.72:0/2124602075 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f8b4006ace0 0x7f8b4006d1a0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f8b6006f2e0 tx=0x7f8b54008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:12.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:12.466+0000 7f8b4effd700 1 -- 172.21.15.72:0/2124602075 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f8b50055f60 con 0x7f8b600c02c0 2023-07-25T14:37:12.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:12.694+0000 7f8b64d28700 1 -- 172.21.15.72:0/2124602075 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs authorize", "filesystem": "cephfs", "entity": "client.testuser", "caps": ["/", "rw"]} v 0) v1 -- 0x7f8b6004e470 con 0x7f8b600c02c0 2023-07-25T14:37:12.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:12.698+0000 7f8b4effd700 1 -- 172.21.15.72:0/2124602075 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs authorize", "filesystem": "cephfs", "entity": "client.testuser", "caps": ["/", "rw"]}]=0 v15) v1 ==== 134+0+185 (secure 0 0 0) 0x7f8b50059580 con 0x7f8b600c02c0 2023-07-25T14:37:12.710 INFO:teuthology.orchestra.run.smithi072.stdout:[client.testuser] 2023-07-25T14:37:12.710 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQAY3r9kYc2CKRAA4brFhJzECz/5INyzrXGiVw== 2023-07-25T14:37:12.711 INFO:teuthology.orchestra.run.smithi072.stdout: caps mds = "allow rw fsname=cephfs" 2023-07-25T14:37:12.711 INFO:teuthology.orchestra.run.smithi072.stdout: caps mon = "allow r fsname=cephfs" 2023-07-25T14:37:12.711 INFO:teuthology.orchestra.run.smithi072.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-07-25T14:37:12.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:12.700+0000 7f8b64d28700 1 -- 172.21.15.72:0/2124602075 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f8b4006ace0 msgr2=0x7f8b4006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:12.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:12.700+0000 7f8b64d28700 1 --2- 172.21.15.72:0/2124602075 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f8b4006ace0 0x7f8b4006d1a0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f8b6006f2e0 tx=0x7f8b54008040 comp rx=0 tx=0).stop 2023-07-25T14:37:12.713 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:12.700+0000 7f8b64d28700 1 -- 172.21.15.72:0/2124602075 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8b600c02c0 msgr2=0x7f8b600c33e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:12.714 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:12.700+0000 7f8b64d28700 1 --2- 172.21.15.72:0/2124602075 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8b600c02c0 0x7f8b600c33e0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f8b50009b90 tx=0x7f8b50004750 comp rx=0 tx=0).stop 2023-07-25T14:37:12.714 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:12.700+0000 7f8b64d28700 1 -- 172.21.15.72:0/2124602075 shutdown_connections 2023-07-25T14:37:12.714 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:12.700+0000 7f8b64d28700 1 --2- 172.21.15.72:0/2124602075 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f8b4006ace0 0x7f8b4006d1a0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:12.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:12.700+0000 7f8b64d28700 1 --2- 172.21.15.72:0/2124602075 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8b6014e200 0x7f8b600c3920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:12.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:12.700+0000 7f8b64d28700 1 --2- 172.21.15.72:0/2124602075 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8b6006a6d0 0x7f8b60149ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:12.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:12.700+0000 7f8b64d28700 1 --2- 172.21.15.72:0/2124602075 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8b600c02c0 0x7f8b600c33e0 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:12.715 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:12.700+0000 7f8b64d28700 1 -- 172.21.15.72:0/2124602075 >> 172.21.15.72:0/2124602075 conn(0x7f8b6006bbc0 msgr2=0x7f8b60071430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:12.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:12.700+0000 7f8b64d28700 1 -- 172.21.15.72:0/2124602075 shutdown_connections 2023-07-25T14:37:12.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:12.700+0000 7f8b64d28700 1 -- 172.21.15.72:0/2124602075 wait complete. 2023-07-25T14:37:12.724 DEBUG:teuthology.orchestra.run.smithi072:> mktemp 2023-07-25T14:37:12.741 INFO:teuthology.orchestra.run.smithi072.stdout:/tmp/tmp.4lo54Xk1SR 2023-07-25T14:37:12.741 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-07-25T14:37:12.742 DEBUG:teuthology.orchestra.run.smithi072:> dd of=/tmp/tmp.4lo54Xk1SR 2023-07-25T14:37:12.797 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-07-25T14:37:12.798 DEBUG:teuthology.orchestra.run.smithi072:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-25T14:37:12.854 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-07-25T14:37:12.855 DEBUG:teuthology.orchestra.run.smithi072:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-25T14:37:12.912 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-25T14:37:13.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.060+0000 7fdfd83d7700 1 Processor -- start 2023-07-25T14:37:13.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.060+0000 7fdfd83d7700 1 -- start start 2023-07-25T14:37:13.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.061+0000 7fdfd83d7700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fdfd0151ba0 0x7fdfd00c2230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:13.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.061+0000 7fdfd83d7700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fdfd0154d50 0x7fdfd015b970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:13.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.061+0000 7fdfd83d7700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfd00c54f0 con 0x7fdfd00c5f40 2023-07-25T14:37:13.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.061+0000 7fdfd83d7700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfd00c6670 con 0x7fdfd0154d50 2023-07-25T14:37:13.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.061+0000 7fdfd83d7700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfd00c5740 con 0x7fdfd0151ba0 2023-07-25T14:37:13.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.061+0000 7fdfd6974700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fdfd0154d50 0x7fdfd015b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:13.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.061+0000 7fdfd6974700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fdfd0154d50 0x7fdfd015b970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42632/0 (socket says 172.21.15.72:42632) 2023-07-25T14:37:13.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.061+0000 7fdfd6974700 1 -- 172.21.15.72:0/2785799005 learned_addr learned my addr 172.21.15.72:0/2785799005 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:37:13.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.062+0000 7fdfd6173700 1 --2- 172.21.15.72:0/2785799005 >> v2:172.21.15.92:3300/0 conn(0x7fdfd0151ba0 0x7fdfd00c2230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:13.076 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.062+0000 7fdfd6974700 1 -- 172.21.15.72:0/2785799005 >> v2:172.21.15.92:3300/0 conn(0x7fdfd0151ba0 msgr2=0x7fdfd00c2230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:13.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.062+0000 7fdfd6974700 1 --2- 172.21.15.72:0/2785799005 >> v2:172.21.15.92:3300/0 conn(0x7fdfd0151ba0 0x7fdfd00c2230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:13.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.062+0000 7fdfd6974700 1 -- 172.21.15.72:0/2785799005 >> v1:172.21.15.92:6789/0 conn(0x7fdfd00c5f40 legacy=0x7fdfd0154640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:13.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.062+0000 7fdfd6974700 1 -- 172.21.15.72:0/2785799005 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfd00c5a20 con 0x7fdfd0154d50 2023-07-25T14:37:13.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.062+0000 7fdfd6974700 1 --2- 172.21.15.72:0/2785799005 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdfd0154d50 0x7fdfd015b970 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fdfd00c52a0 tx=0x7fdfc800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccb757f97f077d19 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:13.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.062+0000 7fdfd5171700 1 -- 172.21.15.72:0/2785799005 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfc800e070 con 0x7fdfd0154d50 2023-07-25T14:37:13.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.062+0000 7fdfd5171700 1 -- 172.21.15.72:0/2785799005 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfc8003a20 con 0x7fdfd0154d50 2023-07-25T14:37:13.077 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.062+0000 7fdfd5171700 1 -- 172.21.15.72:0/2785799005 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfc8003dd0 con 0x7fdfd0154d50 2023-07-25T14:37:13.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.062+0000 7fdfd83d7700 1 -- 172.21.15.72:0/2785799005 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdfd0154d50 msgr2=0x7fdfd015b970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:13.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.062+0000 7fdfd83d7700 1 --2- 172.21.15.72:0/2785799005 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdfd0154d50 0x7fdfd015b970 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fdfd00c52a0 tx=0x7fdfc800b330 comp rx=0 tx=0).stop 2023-07-25T14:37:13.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.063+0000 7fdfd83d7700 1 -- 172.21.15.72:0/2785799005 shutdown_connections 2023-07-25T14:37:13.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.063+0000 7fdfd83d7700 1 --2- 172.21.15.72:0/2785799005 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdfd0154d50 0x7fdfd015b970 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:13.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.063+0000 7fdfd83d7700 1 --2- 172.21.15.72:0/2785799005 >> v2:172.21.15.92:3300/0 conn(0x7fdfd0151ba0 0x7fdfd00c2230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:13.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.063+0000 7fdfd83d7700 1 -- 172.21.15.72:0/2785799005 >> 172.21.15.72:0/2785799005 conn(0x7fdfd00a87e0 msgr2=0x7fdfd00a8bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:13.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.063+0000 7fdfd83d7700 1 -- 172.21.15.72:0/2785799005 shutdown_connections 2023-07-25T14:37:13.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.063+0000 7fdfd83d7700 1 -- 172.21.15.72:0/2785799005 wait complete. 2023-07-25T14:37:13.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.064+0000 7fdfd83d7700 1 Processor -- start 2023-07-25T14:37:13.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.064+0000 7fdfd83d7700 1 -- start start 2023-07-25T14:37:13.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.064+0000 7fdfd83d7700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdfd00c5f40 0x7fdfd01e75b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:13.081 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.064+0000 7fdfd83d7700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdfd0151ba0 0x7fdfd01eab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:13.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.064+0000 7fdfd83d7700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fdfd00bff80 0x7fdfd00aac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:13.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.064+0000 7fdfd83d7700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfd00a96c0 con 0x7fdfd0151ba0 2023-07-25T14:37:13.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.064+0000 7fdfd83d7700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfd01eba70 con 0x7fdfd00c5f40 2023-07-25T14:37:13.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.064+0000 7fdfd83d7700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfd01eb1d0 con 0x7fdfd00bff80 2023-07-25T14:37:13.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.064+0000 7fdfd5972700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdfd0151ba0 0x7fdfd01eab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:13.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.064+0000 7fdfd5972700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdfd0151ba0 0x7fdfd01eab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42636/0 (socket says 172.21.15.72:42636) 2023-07-25T14:37:13.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.064+0000 7fdfd5972700 1 -- 172.21.15.72:0/3123280309 learned_addr learned my addr 172.21.15.72:0/3123280309 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:37:13.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.065+0000 7fdfd6173700 1 --2- 172.21.15.72:0/3123280309 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdfd00c5f40 0x7fdfd01e75b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:13.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.065+0000 7fdfd6974700 1 --2- 172.21.15.72:0/3123280309 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fdfd00bff80 0x7fdfd00aac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:13.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.065+0000 7fdfd5972700 1 -- 172.21.15.72:0/3123280309 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fdfd00bff80 msgr2=0x7fdfd00aac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:13.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.065+0000 7fdfd5972700 1 --2- 172.21.15.72:0/3123280309 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fdfd00bff80 0x7fdfd00aac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:13.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.065+0000 7fdfd5972700 1 -- 172.21.15.72:0/3123280309 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdfd00c5f40 msgr2=0x7fdfd01e75b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:13.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.065+0000 7fdfd5972700 1 --2- 172.21.15.72:0/3123280309 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdfd00c5f40 0x7fdfd01e75b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:13.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.065+0000 7fdfd5972700 1 -- 172.21.15.72:0/3123280309 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfc8009b30 con 0x7fdfd0151ba0 2023-07-25T14:37:13.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.065+0000 7fdfd6173700 1 --2- 172.21.15.72:0/3123280309 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdfd00c5f40 0x7fdfd01e75b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-25T14:37:13.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.065+0000 7fdfd6974700 1 --2- 172.21.15.72:0/3123280309 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fdfd00bff80 0x7fdfd00aac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-25T14:37:13.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.065+0000 7fdfd5972700 1 --2- 172.21.15.72:0/3123280309 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdfd0151ba0 0x7fdfd01eab40 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fdfcc00c4a0 tx=0x7fdfcc00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:13.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.065+0000 7fdfc6ffd700 1 -- 172.21.15.72:0/3123280309 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfcc011790 con 0x7fdfd0151ba0 2023-07-25T14:37:13.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.065+0000 7fdfc6ffd700 1 -- 172.21.15.72:0/3123280309 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfcc0118f0 con 0x7fdfd0151ba0 2023-07-25T14:37:13.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.065+0000 7fdfd83d7700 1 -- 172.21.15.72:0/3123280309 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfd01eb4b0 con 0x7fdfd0151ba0 2023-07-25T14:37:13.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.065+0000 7fdfc6ffd700 1 -- 172.21.15.72:0/3123280309 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfcc011ca0 con 0x7fdfd0151ba0 2023-07-25T14:37:13.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.065+0000 7fdfd83d7700 1 -- 172.21.15.72:0/3123280309 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfd01535e0 con 0x7fdfd0151ba0 2023-07-25T14:37:13.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.066+0000 7fdfd83d7700 1 -- 172.21.15.72:0/3123280309 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfd0153800 con 0x7fdfd0151ba0 2023-07-25T14:37:13.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.066+0000 7fdfc6ffd700 1 -- 172.21.15.72:0/3123280309 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fdfcc01c460 con 0x7fdfd0151ba0 2023-07-25T14:37:13.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.067+0000 7fdfc6ffd700 1 --2- 172.21.15.72:0/3123280309 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fdfb406ace0 0x7fdfb406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:13.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.067+0000 7fdfc6ffd700 1 -- 172.21.15.72:0/3123280309 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 7238+0+0 (secure 0 0 0) 0x7fdfcc0896e0 con 0x7fdfd0151ba0 2023-07-25T14:37:13.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.067+0000 7fdfd6173700 1 --2- 172.21.15.72:0/3123280309 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fdfb406ace0 0x7fdfb406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:13.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.067+0000 7fdfd6173700 1 --2- 172.21.15.72:0/3123280309 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fdfb406ace0 0x7fdfb406d1a0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fdfc0009a00 tx=0x7fdfc0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:13.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.071+0000 7fdfc6ffd700 1 -- 172.21.15.72:0/3123280309 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fdfcc054380 con 0x7fdfd0151ba0 2023-07-25T14:37:13.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.262+0000 7fdfd83d7700 1 -- 172.21.15.72:0/3123280309 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdfd006ca00 con 0x7fdfd0151ba0 2023-07-25T14:37:13.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.264+0000 7fdfc6ffd700 1 -- 172.21.15.72:0/3123280309 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) v1 ==== 74+0+22106 (secure 0 0 0) 0x7fdfcc0579a0 con 0x7fdfd0151ba0 2023-07-25T14:37:13.275 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-25T14:37:13.276 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":43,"fsid":"9170db48-9170-43e8-8ccb-9813e6240906","created":"2023-07-25T14:35:21.733262+0000","modified":"2023-07-25T14:37:04.264643+0000","last_up_change":"2023-07-25T14:35:31.355010+0000","last_in_change":"2023-07-25T14:35:24.195785+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-25T14:35:32.983457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-25T14:35:33.326342+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-07-25T14:36:47.694223+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-07-25T14:36:48.536715+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs2_metadata","create_time":"2023-07-25T14:37:01.238292+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs2_data","create_time":"2023-07-25T14:37:01.609127+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d517fdad-0bfe-49f0-89f2-9421c3761839","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6801","nonce":2475407414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6803","nonce":2475407414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6807","nonce":2475407414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6805","nonce":2475407414}]},"public_addr":"172.21.15.72:6801/2475407414","cluster_addr":"172.21.15.72:6803/2475407414","heartbeat_back_addr":"172.21.15.72:6807/2475407414","heartbeat_front_addr":"172.21.15.72:6805/2475407414","state":["exists","up"]},{"osd":1,"uuid":"e1564be3-f209-47e5-a8d0-32fc618a474f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6822","nonce":870954016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6825","nonce":870954016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6831","nonce":870954016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6827","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6829","nonce":870954016}]},"public_addr":"172.21.15.72:6822/870954016","cluster_addr":"172.21.15.72:6825/870954016","heartbeat_back_addr":"172.21.15.72:6831/870954016","heartbeat_front_addr":"172.21.15.72:6829/870954016","state":["exists","up"]},{"osd":2,"uuid":"c4647d30-ffa6-417a-9026-ef530c75910e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6809","nonce":2143129442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6811","nonce":2143129442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6815","nonce":2143129442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6813","nonce":2143129442}]},"public_addr":"172.21.15.72:6809/2143129442","cluster_addr":"172.21.15.72:6811/2143129442","heartbeat_back_addr":"172.21.15.72:6815/2143129442","heartbeat_front_addr":"172.21.15.72:6813/2143129442","state":["exists","up"]},{"osd":3,"uuid":"76c9d9a7-c2e2-4612-a58b-d6882dd76b58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6817","nonce":3404066311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6819","nonce":3404066311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6828","nonce":3404066311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6821","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6823","nonce":3404066311}]},"public_addr":"172.21.15.72:6817/3404066311","cluster_addr":"172.21.15.72:6819/3404066311","heartbeat_back_addr":"172.21.15.72:6828/3404066311","heartbeat_front_addr":"172.21.15.72:6823/3404066311","state":["exists","up"]},{"osd":4,"uuid":"7f8920dc-0ad4-4a73-ab40-65408f83eadd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6817","nonce":2381008739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6819","nonce":2381008739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6825","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6827","nonce":2381008739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6822","nonce":2381008739}]},"public_addr":"172.21.15.92:6817/2381008739","cluster_addr":"172.21.15.92:6819/2381008739","heartbeat_back_addr":"172.21.15.92:6827/2381008739","heartbeat_front_addr":"172.21.15.92:6822/2381008739","state":["exists","up"]},{"osd":5,"uuid":"56257e7c-31eb-44c5-9ec7-1318a4e0bb35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6801","nonce":2161935604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6803","nonce":2161935604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6807","nonce":2161935604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6805","nonce":2161935604}]},"public_addr":"172.21.15.92:6801/2161935604","cluster_addr":"172.21.15.92:6803/2161935604","heartbeat_back_addr":"172.21.15.92:6807/2161935604","heartbeat_front_addr":"172.21.15.92:6805/2161935604","state":["exists","up"]},{"osd":6,"uuid":"a150d3d8-a0c9-4955-968a-8d98eff4ffb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6809","nonce":3770163493}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6811","nonce":3770163493}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6815","nonce":3770163493}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6813","nonce":3770163493}]},"public_addr":"172.21.15.92:6809/3770163493","cluster_addr":"172.21.15.92:6811/3770163493","heartbeat_back_addr":"172.21.15.92:6815/3770163493","heartbeat_front_addr":"172.21.15.92:6813/3770163493","state":["exists","up"]},{"osd":7,"uuid":"07799c27-54ee-4591-a42d-a978d6b32065","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6821","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6823","nonce":2135777609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6826","nonce":2135777609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6831","nonce":2135777609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6829","nonce":2135777609}]},"public_addr":"172.21.15.92:6823/2135777609","cluster_addr":"172.21.15.92:6826/2135777609","heartbeat_back_addr":"172.21.15.92:6831/2135777609","heartbeat_front_addr":"172.21.15.92:6829/2135777609","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.345365+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.378150+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.146566+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.372172+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:30.398421+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.385632+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.465611+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.443583+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-25T14:37:13.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.266+0000 7fdfd83d7700 1 -- 172.21.15.72:0/3123280309 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fdfb406ace0 msgr2=0x7fdfb406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:13.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.266+0000 7fdfd83d7700 1 --2- 172.21.15.72:0/3123280309 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fdfb406ace0 0x7fdfb406d1a0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fdfc0009a00 tx=0x7fdfc0008040 comp rx=0 tx=0).stop 2023-07-25T14:37:13.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.266+0000 7fdfd83d7700 1 -- 172.21.15.72:0/3123280309 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdfd0151ba0 msgr2=0x7fdfd01eab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:13.277 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.266+0000 7fdfd83d7700 1 --2- 172.21.15.72:0/3123280309 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdfd0151ba0 0x7fdfd01eab40 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fdfcc00c4a0 tx=0x7fdfcc00c860 comp rx=0 tx=0).stop 2023-07-25T14:37:13.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.266+0000 7fdfd83d7700 1 -- 172.21.15.72:0/3123280309 shutdown_connections 2023-07-25T14:37:13.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.266+0000 7fdfd83d7700 1 --2- 172.21.15.72:0/3123280309 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fdfb406ace0 0x7fdfb406d1a0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:13.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.266+0000 7fdfd83d7700 1 --2- 172.21.15.72:0/3123280309 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fdfd00bff80 0x7fdfd00aac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:13.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.266+0000 7fdfd83d7700 1 --2- 172.21.15.72:0/3123280309 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdfd00c5f40 0x7fdfd01e75b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:13.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.266+0000 7fdfd83d7700 1 --2- 172.21.15.72:0/3123280309 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdfd0151ba0 0x7fdfd01eab40 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:13.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.266+0000 7fdfd83d7700 1 -- 172.21.15.72:0/3123280309 >> 172.21.15.72:0/3123280309 conn(0x7fdfd00a87e0 msgr2=0x7fdfd0071640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:13.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.266+0000 7fdfd83d7700 1 -- 172.21.15.72:0/3123280309 shutdown_connections 2023-07-25T14:37:13.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.266+0000 7fdfd83d7700 1 -- 172.21.15.72:0/3123280309 wait complete. 2023-07-25T14:37:13.289 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-07-25T14:35:32.983457+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-07-25T14:35:33.326342+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-25T14:36:47.694223+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2023-07-25T14:36:48.536715+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '39', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-07-25T14:37:01.238292+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '42', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs2_data', 'create_time': '2023-07-25T14:37:01.609127+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '43', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-25T14:37:13.290 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-25T14:37:13.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.402+0000 7f072aec9700 1 Processor -- start 2023-07-25T14:37:13.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.402+0000 7f072aec9700 1 -- start start 2023-07-25T14:37:13.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.403+0000 7f072aec9700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f07240724c0 0x7f07240c34c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:13.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.403+0000 7f072aec9700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07240c2fe0 con 0x7f0724151950 2023-07-25T14:37:13.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.403+0000 7f072aec9700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0724155070 con 0x7f07240c4930 2023-07-25T14:37:13.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.403+0000 7f072aec9700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0724071a60 con 0x7f07240724c0 2023-07-25T14:37:13.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.403+0000 7f0723fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f07240724c0 0x7f07240c34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:13.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.403+0000 7f0723fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f07240724c0 0x7f07240c34c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42644/0 (socket says 172.21.15.72:42644) 2023-07-25T14:37:13.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.403+0000 7f0723fff700 1 -- 172.21.15.72:0/2142062325 learned_addr learned my addr 172.21.15.72:0/2142062325 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:37:13.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.403+0000 7f0728c65700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f0724151950 0x7f072406a190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:33378/0 (socket says 172.21.15.72:33378) 2023-07-25T14:37:13.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.403+0000 7f0723fff700 1 -- 172.21.15.72:0/2142062325 >> v1:172.21.15.92:6789/0 conn(0x7f07240c4930 legacy=0x7f07240c3a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:13.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.403+0000 7f0723fff700 1 -- 172.21.15.72:0/2142062325 >> v1:172.21.15.72:6789/0 conn(0x7f0724151950 legacy=0x7f072406a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:13.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.403+0000 7f0723fff700 1 -- 172.21.15.72:0/2142062325 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07240c15c0 con 0x7f07240724c0 2023-07-25T14:37:13.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.403+0000 7f07237fe700 1 -- 172.21.15.72:0/2142062325 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4190027712 0 0) 0x7f07240c2fe0 con 0x7f0724151950 2023-07-25T14:37:13.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.403+0000 7f0723fff700 1 --2- 172.21.15.72:0/2142062325 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f07240724c0 0x7f07240c34c0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f07100098f0 tx=0x7f0710009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3daa76a48dfd7d40 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:13.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.403+0000 7f07237fe700 1 -- 172.21.15.72:0/2142062325 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f071000b8a0 con 0x7f07240724c0 2023-07-25T14:37:13.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.403+0000 7f07237fe700 1 -- 172.21.15.72:0/2142062325 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f071000ba00 con 0x7f07240724c0 2023-07-25T14:37:13.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.403+0000 7f07237fe700 1 -- 172.21.15.72:0/2142062325 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f071000bd90 con 0x7f07240724c0 2023-07-25T14:37:13.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.404+0000 7f072aec9700 1 -- 172.21.15.72:0/2142062325 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f07240724c0 msgr2=0x7f07240c34c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:13.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.404+0000 7f072aec9700 1 --2- 172.21.15.72:0/2142062325 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f07240724c0 0x7f07240c34c0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f07100098f0 tx=0x7f0710009c00 comp rx=0 tx=0).stop 2023-07-25T14:37:13.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.404+0000 7f072aec9700 1 -- 172.21.15.72:0/2142062325 shutdown_connections 2023-07-25T14:37:13.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.404+0000 7f072aec9700 1 --2- 172.21.15.72:0/2142062325 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f07240724c0 0x7f07240c34c0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:13.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.404+0000 7f072aec9700 1 -- 172.21.15.72:0/2142062325 >> 172.21.15.72:0/2142062325 conn(0x7f07240a87e0 msgr2=0x7f07240a8bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:13.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.404+0000 7f072aec9700 1 -- 172.21.15.72:0/2142062325 shutdown_connections 2023-07-25T14:37:13.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.404+0000 7f072aec9700 1 -- 172.21.15.72:0/2142062325 wait complete. 2023-07-25T14:37:13.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.405+0000 7f072aec9700 1 Processor -- start 2023-07-25T14:37:13.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.405+0000 7f072aec9700 1 -- start start 2023-07-25T14:37:13.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.406+0000 7f072aec9700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f07240724c0 0x7f0724152d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:13.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.406+0000 7f072aec9700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f07240c4930 0x7f07241eb080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:13.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.406+0000 7f072aec9700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0724151950 0x7f07241eb5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:13.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.406+0000 7f072aec9700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07240bdff0 con 0x7f0724151950 2023-07-25T14:37:13.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.406+0000 7f072aec9700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f072414e3a0 con 0x7f07240724c0 2023-07-25T14:37:13.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.406+0000 7f072aec9700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f072406fd90 con 0x7f07240c4930 2023-07-25T14:37:13.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.406+0000 7f0729466700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0724151950 0x7f07241eb5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:13.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.406+0000 7f0729466700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0724151950 0x7f07241eb5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42652/0 (socket says 172.21.15.72:42652) 2023-07-25T14:37:13.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.406+0000 7f0729466700 1 -- 172.21.15.72:0/3276131320 learned_addr learned my addr 172.21.15.72:0/3276131320 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:37:13.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.406+0000 7f0728c65700 1 --2- 172.21.15.72:0/3276131320 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f07240724c0 0x7f0724152d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:13.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.406+0000 7f0723fff700 1 --2- 172.21.15.72:0/3276131320 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f07240c4930 0x7f07241eb080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:13.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.406+0000 7f0729466700 1 -- 172.21.15.72:0/3276131320 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f07240c4930 msgr2=0x7f07241eb080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:13.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.406+0000 7f0729466700 1 --2- 172.21.15.72:0/3276131320 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f07240c4930 0x7f07241eb080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:13.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.406+0000 7f0729466700 1 -- 172.21.15.72:0/3276131320 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f07240724c0 msgr2=0x7f0724152d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:13.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.406+0000 7f0729466700 1 --2- 172.21.15.72:0/3276131320 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f07240724c0 0x7f0724152d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:13.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.406+0000 7f0729466700 1 -- 172.21.15.72:0/3276131320 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0710009550 con 0x7f0724151950 2023-07-25T14:37:13.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.407+0000 7f0729466700 1 --2- 172.21.15.72:0/3276131320 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0724151950 0x7f07241eb5c0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f071c00cc80 tx=0x7f071c00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:13.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.407+0000 7f07217fa700 1 -- 172.21.15.72:0/3276131320 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f071c003c00 con 0x7f0724151950 2023-07-25T14:37:13.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.407+0000 7f07217fa700 1 -- 172.21.15.72:0/3276131320 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f071c003d60 con 0x7f0724151950 2023-07-25T14:37:13.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.407+0000 7f072aec9700 1 -- 172.21.15.72:0/3276131320 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07241ed840 con 0x7f0724151950 2023-07-25T14:37:13.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.407+0000 7f07217fa700 1 -- 172.21.15.72:0/3276131320 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f071c00aae0 con 0x7f0724151950 2023-07-25T14:37:13.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.407+0000 7f072aec9700 1 -- 172.21.15.72:0/3276131320 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07240bdc80 con 0x7f0724151950 2023-07-25T14:37:13.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.408+0000 7f072aec9700 1 -- 172.21.15.72:0/3276131320 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07240c4100 con 0x7f0724151950 2023-07-25T14:37:13.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.408+0000 7f07217fa700 1 -- 172.21.15.72:0/3276131320 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f071c00ac40 con 0x7f0724151950 2023-07-25T14:37:13.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.409+0000 7f07217fa700 1 --2- 172.21.15.72:0/3276131320 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f070806ace0 0x7f070806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:13.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.409+0000 7f0728c65700 1 --2- 172.21.15.72:0/3276131320 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f070806ace0 0x7f070806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:13.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.409+0000 7f07217fa700 1 -- 172.21.15.72:0/3276131320 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 7238+0+0 (secure 0 0 0) 0x7f071c0898c0 con 0x7f0724151950 2023-07-25T14:37:13.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.409+0000 7f0728c65700 1 --2- 172.21.15.72:0/3276131320 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f070806ace0 0x7f070806d1a0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f0718000f60 tx=0x7f0718004a50 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:13.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.413+0000 7f07217fa700 1 -- 172.21.15.72:0/3276131320 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f071c054560 con 0x7f0724151950 2023-07-25T14:37:13.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.600+0000 7f072aec9700 1 -- 172.21.15.72:0/3276131320 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f07241eada0 con 0x7f0724151950 2023-07-25T14:37:13.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.600+0000 7f07217fa700 1 -- 172.21.15.72:0/3276131320 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v43) v1 ==== 92+0+10 (secure 0 0 0) 0x7f07241eada0 con 0x7f0724151950 2023-07-25T14:37:13.612 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 8 2023-07-25T14:37:13.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.602+0000 7f072aec9700 1 -- 172.21.15.72:0/3276131320 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f070806ace0 msgr2=0x7f070806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:13.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.602+0000 7f072aec9700 1 --2- 172.21.15.72:0/3276131320 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f070806ace0 0x7f070806d1a0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f0718000f60 tx=0x7f0718004a50 comp rx=0 tx=0).stop 2023-07-25T14:37:13.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.602+0000 7f072aec9700 1 -- 172.21.15.72:0/3276131320 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0724151950 msgr2=0x7f07241eb5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:13.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.602+0000 7f072aec9700 1 --2- 172.21.15.72:0/3276131320 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0724151950 0x7f07241eb5c0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f071c00cc80 tx=0x7f071c00cf90 comp rx=0 tx=0).stop 2023-07-25T14:37:13.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.602+0000 7f072aec9700 1 -- 172.21.15.72:0/3276131320 shutdown_connections 2023-07-25T14:37:13.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.602+0000 7f072aec9700 1 --2- 172.21.15.72:0/3276131320 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f070806ace0 0x7f070806d1a0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:13.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.602+0000 7f072aec9700 1 --2- 172.21.15.72:0/3276131320 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0724151950 0x7f07241eb5c0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:13.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.602+0000 7f072aec9700 1 --2- 172.21.15.72:0/3276131320 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f07240724c0 0x7f0724152d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:13.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.602+0000 7f072aec9700 1 --2- 172.21.15.72:0/3276131320 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f07240c4930 0x7f07241eb080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:13.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.602+0000 7f072aec9700 1 -- 172.21.15.72:0/3276131320 >> 172.21.15.72:0/3276131320 conn(0x7f07240a87e0 msgr2=0x7f07240c2590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:13.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.602+0000 7f072aec9700 1 -- 172.21.15.72:0/3276131320 shutdown_connections 2023-07-25T14:37:13.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.602+0000 7f072aec9700 1 -- 172.21.15.72:0/3276131320 wait complete. 2023-07-25T14:37:13.625 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-25T14:37:13.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.737+0000 7f11b4183700 1 Processor -- start 2023-07-25T14:37:13.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.738+0000 7f11b4183700 1 -- start start 2023-07-25T14:37:13.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.738+0000 7f11b4183700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f11ac151950 0x7f11ac06a190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:13.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.738+0000 7f11b4183700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f11ac06a6d0 0x7f11ac0c3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:13.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.738+0000 7f11b4183700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11ac0c2fe0 con 0x7f11ac0724c0 2023-07-25T14:37:13.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.738+0000 7f11b4183700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11ac071a60 con 0x7f11ac06a6d0 2023-07-25T14:37:13.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.738+0000 7f11b4183700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11ac0c2a70 con 0x7f11ac151950 2023-07-25T14:37:13.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.738+0000 7f11b2720700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f11ac06a6d0 0x7f11ac0c3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:13.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.738+0000 7f11b2720700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f11ac06a6d0 0x7f11ac0c3bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42660/0 (socket says 172.21.15.72:42660) 2023-07-25T14:37:13.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.738+0000 7f11b2720700 1 -- 172.21.15.72:0/62183395 learned_addr learned my addr 172.21.15.72:0/62183395 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:37:13.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.739+0000 7f11b2720700 1 -- 172.21.15.72:0/62183395 >> v2:172.21.15.92:3300/0 conn(0x7f11ac151950 msgr2=0x7f11ac06a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:13.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.739+0000 7f11b2720700 1 --2- 172.21.15.72:0/62183395 >> v2:172.21.15.92:3300/0 conn(0x7f11ac151950 0x7f11ac06a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:13.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.739+0000 7f11b2720700 1 -- 172.21.15.72:0/62183395 >> v1:172.21.15.92:6789/0 conn(0x7f11ac0724c0 legacy=0x7f11ac0c34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:13.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.739+0000 7f11b2720700 1 -- 172.21.15.72:0/62183395 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11ac155070 con 0x7f11ac06a6d0 2023-07-25T14:37:13.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.739+0000 7f11b2720700 1 --2- 172.21.15.72:0/62183395 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f11ac06a6d0 0x7f11ac0c3bd0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f11ac06ad50 tx=0x7f11a400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=644b497084597b24 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:13.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.739+0000 7f11b0f1d700 1 -- 172.21.15.72:0/62183395 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11a400e070 con 0x7f11ac06a6d0 2023-07-25T14:37:13.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.739+0000 7f11b0f1d700 1 -- 172.21.15.72:0/62183395 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11a4003a20 con 0x7f11ac06a6d0 2023-07-25T14:37:13.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.739+0000 7f11b0f1d700 1 -- 172.21.15.72:0/62183395 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11a4003dd0 con 0x7f11ac06a6d0 2023-07-25T14:37:13.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.739+0000 7f11b4183700 1 -- 172.21.15.72:0/62183395 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f11ac06a6d0 msgr2=0x7f11ac0c3bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:13.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.739+0000 7f11b4183700 1 --2- 172.21.15.72:0/62183395 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f11ac06a6d0 0x7f11ac0c3bd0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f11ac06ad50 tx=0x7f11a400b330 comp rx=0 tx=0).stop 2023-07-25T14:37:13.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.740+0000 7f11b4183700 1 -- 172.21.15.72:0/62183395 shutdown_connections 2023-07-25T14:37:13.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.740+0000 7f11b4183700 1 --2- 172.21.15.72:0/62183395 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f11ac06a6d0 0x7f11ac0c3bd0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:13.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.740+0000 7f11b4183700 1 --2- 172.21.15.72:0/62183395 >> v2:172.21.15.92:3300/0 conn(0x7f11ac151950 0x7f11ac06a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:13.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.740+0000 7f11b4183700 1 -- 172.21.15.72:0/62183395 >> 172.21.15.72:0/62183395 conn(0x7f11ac0a87e0 msgr2=0x7f11ac0a8bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:13.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.740+0000 7f11b4183700 1 -- 172.21.15.72:0/62183395 shutdown_connections 2023-07-25T14:37:13.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.740+0000 7f11b4183700 1 -- 172.21.15.72:0/62183395 wait complete. 2023-07-25T14:37:13.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.741+0000 7f11b4183700 1 Processor -- start 2023-07-25T14:37:13.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.741+0000 7f11b4183700 1 -- start start 2023-07-25T14:37:13.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.741+0000 7f11b4183700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f11ac06a6d0 0x7f11ac1ed320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:13.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.741+0000 7f11b4183700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f11ac0724c0 0x7f11ac0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:13.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.741+0000 7f11b4183700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f11ac151950 0x7f11ac1ec5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:13.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.741+0000 7f11b4183700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11ac14b110 con 0x7f11ac06a6d0 2023-07-25T14:37:13.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.741+0000 7f11b4183700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11ac0a4eb0 con 0x7f11ac151950 2023-07-25T14:37:13.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.741+0000 7f11b4183700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11ac1eafb0 con 0x7f11ac0724c0 2023-07-25T14:37:13.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.741+0000 7f11b1f1f700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f11ac06a6d0 0x7f11ac1ed320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:13.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.741+0000 7f11b1f1f700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f11ac06a6d0 0x7f11ac1ed320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42662/0 (socket says 172.21.15.72:42662) 2023-07-25T14:37:13.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.741+0000 7f11b1f1f700 1 -- 172.21.15.72:0/4133731581 learned_addr learned my addr 172.21.15.72:0/4133731581 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:37:13.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.742+0000 7f11b2720700 1 --2- 172.21.15.72:0/4133731581 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f11ac151950 0x7f11ac1ec5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:13.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.742+0000 7f11b171e700 1 --2- 172.21.15.72:0/4133731581 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f11ac0724c0 0x7f11ac0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:13.759 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.742+0000 7f11b1f1f700 1 -- 172.21.15.72:0/4133731581 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f11ac0724c0 msgr2=0x7f11ac0a5040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:13.759 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.742+0000 7f11b1f1f700 1 --2- 172.21.15.72:0/4133731581 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f11ac0724c0 0x7f11ac0a5040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:13.759 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.742+0000 7f11b1f1f700 1 -- 172.21.15.72:0/4133731581 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f11ac151950 msgr2=0x7f11ac1ec5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:13.759 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.742+0000 7f11b1f1f700 1 --2- 172.21.15.72:0/4133731581 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f11ac151950 0x7f11ac1ec5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:13.759 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.742+0000 7f11b1f1f700 1 -- 172.21.15.72:0/4133731581 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11a4009b30 con 0x7f11ac06a6d0 2023-07-25T14:37:13.759 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.742+0000 7f11b1f1f700 1 --2- 172.21.15.72:0/4133731581 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f11ac06a6d0 0x7f11ac1ed320 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f119c00b4a0 tx=0x7f119c00b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:13.759 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.742+0000 7f11a27fc700 1 -- 172.21.15.72:0/4133731581 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f119c011830 con 0x7f11ac06a6d0 2023-07-25T14:37:13.759 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.742+0000 7f11a27fc700 1 -- 172.21.15.72:0/4133731581 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f119c011990 con 0x7f11ac06a6d0 2023-07-25T14:37:13.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.742+0000 7f11b4183700 1 -- 172.21.15.72:0/4133731581 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11ac0a7e30 con 0x7f11ac06a6d0 2023-07-25T14:37:13.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.742+0000 7f11a27fc700 1 -- 172.21.15.72:0/4133731581 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f119c011d40 con 0x7f11ac06a6d0 2023-07-25T14:37:13.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.742+0000 7f11b4183700 1 -- 172.21.15.72:0/4133731581 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11ac1edb60 con 0x7f11ac06a6d0 2023-07-25T14:37:13.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.743+0000 7f11b4183700 1 -- 172.21.15.72:0/4133731581 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11ac150230 con 0x7f11ac06a6d0 2023-07-25T14:37:13.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.743+0000 7f11a27fc700 1 -- 172.21.15.72:0/4133731581 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f119c01a400 con 0x7f11ac06a6d0 2023-07-25T14:37:13.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.744+0000 7f11a27fc700 1 --2- 172.21.15.72:0/4133731581 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f119006ace0 0x7f119006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:13.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.744+0000 7f11a27fc700 1 -- 172.21.15.72:0/4133731581 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 7238+0+0 (secure 0 0 0) 0x7f119c089910 con 0x7f11ac06a6d0 2023-07-25T14:37:13.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.744+0000 7f11b171e700 1 --2- 172.21.15.72:0/4133731581 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f119006ace0 0x7f119006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:13.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.744+0000 7f11b171e700 1 --2- 172.21.15.72:0/4133731581 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f119006ace0 0x7f119006d1a0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f11ac0c6700 tx=0x7f11a8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:13.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.748+0000 7f11a27fc700 1 -- 172.21.15.72:0/4133731581 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f119c054530 con 0x7f11ac06a6d0 2023-07-25T14:37:13.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.934+0000 7f11b4183700 1 -- 172.21.15.72:0/4133731581 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f11ac04e470 con 0x7f11ac06a6d0 2023-07-25T14:37:13.946 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.935+0000 7f11a27fc700 1 -- 172.21.15.72:0/4133731581 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v43) v1 ==== 93+0+10 (secure 0 0 0) 0x7f119c057b50 con 0x7f11ac06a6d0 2023-07-25T14:37:13.946 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 1 2023-07-25T14:37:13.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.937+0000 7f11b4183700 1 -- 172.21.15.72:0/4133731581 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f119006ace0 msgr2=0x7f119006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:13.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.937+0000 7f11b4183700 1 --2- 172.21.15.72:0/4133731581 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f119006ace0 0x7f119006d1a0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f11ac0c6700 tx=0x7f11a8009040 comp rx=0 tx=0).stop 2023-07-25T14:37:13.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.937+0000 7f11b4183700 1 -- 172.21.15.72:0/4133731581 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f11ac06a6d0 msgr2=0x7f11ac1ed320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:13.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.937+0000 7f11b4183700 1 --2- 172.21.15.72:0/4133731581 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f11ac06a6d0 0x7f11ac1ed320 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f119c00b4a0 tx=0x7f119c00b860 comp rx=0 tx=0).stop 2023-07-25T14:37:13.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.937+0000 7f11b4183700 1 -- 172.21.15.72:0/4133731581 shutdown_connections 2023-07-25T14:37:13.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.937+0000 7f11b4183700 1 --2- 172.21.15.72:0/4133731581 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f119006ace0 0x7f119006d1a0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:13.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.937+0000 7f11b4183700 1 --2- 172.21.15.72:0/4133731581 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f11ac151950 0x7f11ac1ec5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:13.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.937+0000 7f11b4183700 1 --2- 172.21.15.72:0/4133731581 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f11ac06a6d0 0x7f11ac1ed320 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:13.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.937+0000 7f11b4183700 1 --2- 172.21.15.72:0/4133731581 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f11ac0724c0 0x7f11ac0a5040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:13.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.937+0000 7f11b4183700 1 -- 172.21.15.72:0/4133731581 >> 172.21.15.72:0/4133731581 conn(0x7f11ac0a87e0 msgr2=0x7f11ac150760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:13.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.937+0000 7f11b4183700 1 -- 172.21.15.72:0/4133731581 shutdown_connections 2023-07-25T14:37:13.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:13.937+0000 7f11b4183700 1 -- 172.21.15.72:0/4133731581 wait complete. 2023-07-25T14:37:13.960 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-25T14:37:14.083 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.072+0000 7f0c7ed52700 1 Processor -- start 2023-07-25T14:37:14.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.072+0000 7f0c7ed52700 1 -- start start 2023-07-25T14:37:14.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.073+0000 7f0c7ed52700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0c78154df0 0x7f0c7815fd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:14.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.073+0000 7f0c7ed52700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c78157cd0 con 0x7f0c7806b2a0 2023-07-25T14:37:14.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.073+0000 7f0c7ed52700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c78158870 con 0x7f0c781518c0 2023-07-25T14:37:14.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.073+0000 7f0c7ed52700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c7806b750 con 0x7f0c78154df0 2023-07-25T14:37:14.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.073+0000 7f0c7d2ef700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0c78154df0 0x7f0c7815fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:14.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.073+0000 7f0c7d2ef700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0c78154df0 0x7f0c7815fd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42674/0 (socket says 172.21.15.72:42674) 2023-07-25T14:37:14.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.073+0000 7f0c77fff700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f0c7806b2a0 0x7f0c780c4370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:33408/0 (socket says 172.21.15.72:33408) 2023-07-25T14:37:14.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.073+0000 7f0c7d2ef700 1 -- 172.21.15.72:0/2814132384 learned_addr learned my addr 172.21.15.72:0/2814132384 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:37:14.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.073+0000 7f0c7d2ef700 1 -- 172.21.15.72:0/2814132384 >> v1:172.21.15.92:6789/0 conn(0x7f0c781518c0 legacy=0x7f0c78158160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:14.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.073+0000 7f0c7d2ef700 1 -- 172.21.15.72:0/2814132384 >> v1:172.21.15.72:6789/0 conn(0x7f0c7806b2a0 legacy=0x7f0c780c4370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:14.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.073+0000 7f0c7d2ef700 1 -- 172.21.15.72:0/2814132384 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c780c2520 con 0x7f0c78154df0 2023-07-25T14:37:14.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.073+0000 7f0c7d2ef700 1 --2- 172.21.15.72:0/2814132384 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0c78154df0 0x7f0c7815fd00 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f0c70009e50 tx=0x7f0c7000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d6f7db54f8fffe0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:14.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.074+0000 7f0c777fe700 1 -- 172.21.15.72:0/2814132384 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c7000e070 con 0x7f0c78154df0 2023-07-25T14:37:14.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.074+0000 7f0c777fe700 1 -- 172.21.15.72:0/2814132384 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c70003a70 con 0x7f0c78154df0 2023-07-25T14:37:14.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.074+0000 7f0c777fe700 1 -- 172.21.15.72:0/2814132384 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c70003e20 con 0x7f0c78154df0 2023-07-25T14:37:14.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.074+0000 7f0c7ed52700 1 -- 172.21.15.72:0/2814132384 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0c78154df0 msgr2=0x7f0c7815fd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:14.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.074+0000 7f0c7ed52700 1 --2- 172.21.15.72:0/2814132384 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0c78154df0 0x7f0c7815fd00 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f0c70009e50 tx=0x7f0c7000b330 comp rx=0 tx=0).stop 2023-07-25T14:37:14.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.074+0000 7f0c7ed52700 1 -- 172.21.15.72:0/2814132384 shutdown_connections 2023-07-25T14:37:14.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.074+0000 7f0c7ed52700 1 --2- 172.21.15.72:0/2814132384 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0c78154df0 0x7f0c7815fd00 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:14.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.074+0000 7f0c7ed52700 1 -- 172.21.15.72:0/2814132384 >> 172.21.15.72:0/2814132384 conn(0x7f0c7806a8d0 msgr2=0x7f0c780a94e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:14.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.074+0000 7f0c7ed52700 1 -- 172.21.15.72:0/2814132384 shutdown_connections 2023-07-25T14:37:14.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.074+0000 7f0c7ed52700 1 -- 172.21.15.72:0/2814132384 wait complete. 2023-07-25T14:37:14.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.075+0000 7f0c7ed52700 1 Processor -- start 2023-07-25T14:37:14.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.075+0000 7f0c7ed52700 1 -- start start 2023-07-25T14:37:14.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.076+0000 7f0c7ed52700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0c7806b2a0 0x7f0c7806c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:14.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.076+0000 7f0c7ed52700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0c781518c0 0x7f0c781eb190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:14.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.076+0000 7f0c7ed52700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0c78154df0 0x7f0c781eb6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:14.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.076+0000 7f0c7ed52700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c781ed8c0 con 0x7f0c78154df0 2023-07-25T14:37:14.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.076+0000 7f0c7ed52700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c780aabe0 con 0x7f0c781518c0 2023-07-25T14:37:14.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.076+0000 7f0c7ed52700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c780bec00 con 0x7f0c7806b2a0 2023-07-25T14:37:14.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.076+0000 7f0c7d2ef700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0c78154df0 0x7f0c781eb6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:14.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.076+0000 7f0c7d2ef700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0c78154df0 0x7f0c781eb6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42680/0 (socket says 172.21.15.72:42680) 2023-07-25T14:37:14.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.076+0000 7f0c7d2ef700 1 -- 172.21.15.72:0/4016368420 learned_addr learned my addr 172.21.15.72:0/4016368420 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:37:14.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.076+0000 7f0c77fff700 1 --2- 172.21.15.72:0/4016368420 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0c781518c0 0x7f0c781eb190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:14.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.076+0000 7f0c7caee700 1 --2- 172.21.15.72:0/4016368420 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0c7806b2a0 0x7f0c7806c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:14.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.076+0000 7f0c7d2ef700 1 -- 172.21.15.72:0/4016368420 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0c7806b2a0 msgr2=0x7f0c7806c7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:14.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.076+0000 7f0c7d2ef700 1 --2- 172.21.15.72:0/4016368420 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0c7806b2a0 0x7f0c7806c7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:14.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.076+0000 7f0c7d2ef700 1 -- 172.21.15.72:0/4016368420 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0c781518c0 msgr2=0x7f0c781eb190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:14.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.076+0000 7f0c7d2ef700 1 --2- 172.21.15.72:0/4016368420 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0c781518c0 0x7f0c781eb190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:14.093 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.076+0000 7f0c7d2ef700 1 -- 172.21.15.72:0/4016368420 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c70009b30 con 0x7f0c78154df0 2023-07-25T14:37:14.093 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.077+0000 7f0c7d2ef700 1 --2- 172.21.15.72:0/4016368420 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0c78154df0 0x7f0c781eb6d0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f0c70001220 tx=0x7f0c70004b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:14.093 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.077+0000 7f0c757fa700 1 -- 172.21.15.72:0/4016368420 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c70004440 con 0x7f0c78154df0 2023-07-25T14:37:14.093 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.077+0000 7f0c757fa700 1 -- 172.21.15.72:0/4016368420 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c700045a0 con 0x7f0c78154df0 2023-07-25T14:37:14.093 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.077+0000 7f0c7ed52700 1 -- 172.21.15.72:0/4016368420 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c781edb10 con 0x7f0c78154df0 2023-07-25T14:37:14.094 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.077+0000 7f0c757fa700 1 -- 172.21.15.72:0/4016368420 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c70004950 con 0x7f0c78154df0 2023-07-25T14:37:14.094 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.077+0000 7f0c7ed52700 1 -- 172.21.15.72:0/4016368420 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c781532c0 con 0x7f0c78154df0 2023-07-25T14:37:14.094 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.078+0000 7f0c7ed52700 1 -- 172.21.15.72:0/4016368420 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c781eaeb0 con 0x7f0c78154df0 2023-07-25T14:37:14.094 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.078+0000 7f0c757fa700 1 -- 172.21.15.72:0/4016368420 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0c70012430 con 0x7f0c78154df0 2023-07-25T14:37:14.094 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.079+0000 7f0c757fa700 1 --2- 172.21.15.72:0/4016368420 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f0c5c06ace0 0x7f0c5c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:14.094 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.079+0000 7f0c757fa700 1 -- 172.21.15.72:0/4016368420 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 7238+0+0 (secure 0 0 0) 0x7f0c7008adc0 con 0x7f0c78154df0 2023-07-25T14:37:14.094 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.079+0000 7f0c7caee700 1 --2- 172.21.15.72:0/4016368420 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f0c5c06ace0 0x7f0c5c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:14.094 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.079+0000 7f0c7caee700 1 --2- 172.21.15.72:0/4016368420 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f0c5c06ace0 0x7f0c5c06d1a0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f0c6c007fd0 tx=0x7f0c6c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:14.095 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.083+0000 7f0c757fa700 1 -- 172.21.15.72:0/4016368420 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f0c781eaeb0 con 0x7f0c78154df0 2023-07-25T14:37:14.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.273+0000 7f0c7ed52700 1 -- 172.21.15.72:0/4016368420 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0c781eaeb0 con 0x7f0c78154df0 2023-07-25T14:37:14.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.274+0000 7f0c757fa700 1 -- 172.21.15.72:0/4016368420 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v43) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0c781eaeb0 con 0x7f0c78154df0 2023-07-25T14:37:14.285 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2023-07-25T14:37:14.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.276+0000 7f0c7ed52700 1 -- 172.21.15.72:0/4016368420 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f0c5c06ace0 msgr2=0x7f0c5c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:14.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.276+0000 7f0c7ed52700 1 --2- 172.21.15.72:0/4016368420 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f0c5c06ace0 0x7f0c5c06d1a0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f0c6c007fd0 tx=0x7f0c6c009040 comp rx=0 tx=0).stop 2023-07-25T14:37:14.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.276+0000 7f0c7ed52700 1 -- 172.21.15.72:0/4016368420 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0c78154df0 msgr2=0x7f0c781eb6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:14.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.276+0000 7f0c7ed52700 1 --2- 172.21.15.72:0/4016368420 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0c78154df0 0x7f0c781eb6d0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f0c70001220 tx=0x7f0c70004b20 comp rx=0 tx=0).stop 2023-07-25T14:37:14.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.276+0000 7f0c7ed52700 1 -- 172.21.15.72:0/4016368420 shutdown_connections 2023-07-25T14:37:14.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.276+0000 7f0c7ed52700 1 --2- 172.21.15.72:0/4016368420 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f0c5c06ace0 0x7f0c5c06d1a0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:14.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.276+0000 7f0c7ed52700 1 --2- 172.21.15.72:0/4016368420 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0c7806b2a0 0x7f0c7806c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:14.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.276+0000 7f0c7ed52700 1 --2- 172.21.15.72:0/4016368420 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0c78154df0 0x7f0c781eb6d0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:14.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.276+0000 7f0c7ed52700 1 --2- 172.21.15.72:0/4016368420 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0c781518c0 0x7f0c781eb190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:14.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.276+0000 7f0c7ed52700 1 -- 172.21.15.72:0/4016368420 >> 172.21.15.72:0/4016368420 conn(0x7f0c7806a8d0 msgr2=0x7f0c78156100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:14.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.276+0000 7f0c7ed52700 1 -- 172.21.15.72:0/4016368420 shutdown_connections 2023-07-25T14:37:14.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.276+0000 7f0c7ed52700 1 -- 172.21.15.72:0/4016368420 wait complete. 2023-07-25T14:37:14.299 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-25T14:37:14.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.410+0000 7f6597c9e700 1 Processor -- start 2023-07-25T14:37:14.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.410+0000 7f6597c9e700 1 -- start start 2023-07-25T14:37:14.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.411+0000 7f6597c9e700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f65900bfaf0 0x7f65900bfed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:14.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.411+0000 7f6597c9e700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f65900bbcf0 0x7f659006efa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:14.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.411+0000 7f6597c9e700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f65900bb350 0x7f659006c910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:14.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.411+0000 7f6597c9e700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f659006e1a0 con 0x7f65900bfaf0 2023-07-25T14:37:14.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.411+0000 7f6597c9e700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65900bc790 con 0x7f65900bbcf0 2023-07-25T14:37:14.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.411+0000 7f6597c9e700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65900c0900 con 0x7f65900bb350 2023-07-25T14:37:14.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.411+0000 7f6595a3a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f65900bfaf0 0x7f65900bfed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:14.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.411+0000 7f6595a3a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f65900bfaf0 0x7f65900bfed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42684/0 (socket says 172.21.15.72:42684) 2023-07-25T14:37:14.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.411+0000 7f6595a3a700 1 -- 172.21.15.72:0/2500884975 learned_addr learned my addr 172.21.15.72:0/2500884975 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:37:14.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.411+0000 7f6595239700 1 --2- 172.21.15.72:0/2500884975 >> v2:172.21.15.92:3300/0 conn(0x7f65900bbcf0 0x7f659006efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:14.424 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.411+0000 7f659623b700 1 --2- 172.21.15.72:0/2500884975 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f65900bb350 0x7f659006c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:14.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.412+0000 7f6595a3a700 1 -- 172.21.15.72:0/2500884975 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f65900bb350 msgr2=0x7f659006c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:14.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.412+0000 7f6595a3a700 1 --2- 172.21.15.72:0/2500884975 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f65900bb350 0x7f659006c910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:14.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.412+0000 7f6595a3a700 1 -- 172.21.15.72:0/2500884975 >> v2:172.21.15.92:3300/0 conn(0x7f65900bbcf0 msgr2=0x7f659006efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:14.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.412+0000 7f6595a3a700 1 --2- 172.21.15.72:0/2500884975 >> v2:172.21.15.92:3300/0 conn(0x7f65900bbcf0 0x7f659006efa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:14.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.412+0000 7f6595a3a700 1 -- 172.21.15.72:0/2500884975 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65900bc4b0 con 0x7f65900bfaf0 2023-07-25T14:37:14.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.412+0000 7f6595a3a700 1 --2- 172.21.15.72:0/2500884975 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f65900bfaf0 0x7f65900bfed0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f6590070570 tx=0x7f658000ada0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f34bedf02ebab1f server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:14.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.412+0000 7f6594a38700 1 -- 172.21.15.72:0/2500884975 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f658000cb30 con 0x7f65900bfaf0 2023-07-25T14:37:14.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.412+0000 7f6594a38700 1 -- 172.21.15.72:0/2500884975 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f658000cc90 con 0x7f65900bfaf0 2023-07-25T14:37:14.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.412+0000 7f6594a38700 1 -- 172.21.15.72:0/2500884975 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6580018400 con 0x7f65900bfaf0 2023-07-25T14:37:14.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.412+0000 7f6597c9e700 1 -- 172.21.15.72:0/2500884975 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f65900bfaf0 msgr2=0x7f65900bfed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:14.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.412+0000 7f6597c9e700 1 --2- 172.21.15.72:0/2500884975 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f65900bfaf0 0x7f65900bfed0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f6590070570 tx=0x7f658000ada0 comp rx=0 tx=0).stop 2023-07-25T14:37:14.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.412+0000 7f6597c9e700 1 -- 172.21.15.72:0/2500884975 shutdown_connections 2023-07-25T14:37:14.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.412+0000 7f6597c9e700 1 --2- 172.21.15.72:0/2500884975 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f65900bb350 0x7f659006c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:14.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.412+0000 7f6597c9e700 1 --2- 172.21.15.72:0/2500884975 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f65900bfaf0 0x7f65900bfed0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:14.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.412+0000 7f6597c9e700 1 --2- 172.21.15.72:0/2500884975 >> v2:172.21.15.92:3300/0 conn(0x7f65900bbcf0 0x7f659006efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:14.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.412+0000 7f6597c9e700 1 -- 172.21.15.72:0/2500884975 >> 172.21.15.72:0/2500884975 conn(0x7f6590071bf0 msgr2=0x7f659006a190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:14.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.413+0000 7f6597c9e700 1 -- 172.21.15.72:0/2500884975 shutdown_connections 2023-07-25T14:37:14.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.413+0000 7f6597c9e700 1 -- 172.21.15.72:0/2500884975 wait complete. 2023-07-25T14:37:14.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.414+0000 7f6597c9e700 1 Processor -- start 2023-07-25T14:37:14.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.414+0000 7f6597c9e700 1 -- start start 2023-07-25T14:37:14.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.414+0000 7f6597c9e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f65900bb350 0x7f6590151800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:14.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.414+0000 7f6597c9e700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f65900bfaf0 0x7f65901e5df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:14.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.414+0000 7f6597c9e700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f659014d1d0 0x7f659014f920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:14.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.414+0000 7f6597c9e700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6590151d40 con 0x7f65900bb350 2023-07-25T14:37:14.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.414+0000 7f6597c9e700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65901e5630 con 0x7f65900bfaf0 2023-07-25T14:37:14.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.414+0000 7f6597c9e700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6590147df0 con 0x7f659014d1d0 2023-07-25T14:37:14.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.414+0000 7f6595a3a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f65900bb350 0x7f6590151800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:14.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.414+0000 7f6595a3a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f65900bb350 0x7f6590151800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42690/0 (socket says 172.21.15.72:42690) 2023-07-25T14:37:14.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.414+0000 7f6595a3a700 1 -- 172.21.15.72:0/2090602787 learned_addr learned my addr 172.21.15.72:0/2090602787 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:37:14.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.415+0000 7f659623b700 1 --2- 172.21.15.72:0/2090602787 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f659014d1d0 0x7f659014f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:14.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.415+0000 7f6595239700 1 --2- 172.21.15.72:0/2090602787 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f65900bfaf0 0x7f65901e5df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:14.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.415+0000 7f6595a3a700 1 -- 172.21.15.72:0/2090602787 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f659014d1d0 msgr2=0x7f659014f920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:14.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.415+0000 7f6595a3a700 1 --2- 172.21.15.72:0/2090602787 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f659014d1d0 0x7f659014f920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:14.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.415+0000 7f6595a3a700 1 -- 172.21.15.72:0/2090602787 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f65900bfaf0 msgr2=0x7f65901e5df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:14.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.415+0000 7f6595a3a700 1 --2- 172.21.15.72:0/2090602787 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f65900bfaf0 0x7f65901e5df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:14.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.415+0000 7f6595a3a700 1 -- 172.21.15.72:0/2090602787 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f658000a6f0 con 0x7f65900bb350 2023-07-25T14:37:14.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.415+0000 7f6595a3a700 1 --2- 172.21.15.72:0/2090602787 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f65900bb350 0x7f6590151800 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f658000c4d0 tx=0x7f6580004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:14.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.415+0000 7f65867fc700 1 -- 172.21.15.72:0/2090602787 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f658001f070 con 0x7f65900bb350 2023-07-25T14:37:14.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.415+0000 7f65867fc700 1 -- 172.21.15.72:0/2090602787 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65800036a0 con 0x7f65900bb350 2023-07-25T14:37:14.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.415+0000 7f6597c9e700 1 -- 172.21.15.72:0/2090602787 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65901480d0 con 0x7f65900bb350 2023-07-25T14:37:14.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.415+0000 7f65867fc700 1 -- 172.21.15.72:0/2090602787 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6580003a30 con 0x7f65900bb350 2023-07-25T14:37:14.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.415+0000 7f6597c9e700 1 -- 172.21.15.72:0/2090602787 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65901e6330 con 0x7f65900bb350 2023-07-25T14:37:14.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.416+0000 7f6597c9e700 1 -- 172.21.15.72:0/2090602787 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65901e5490 con 0x7f65900bb350 2023-07-25T14:37:14.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.416+0000 7f65867fc700 1 -- 172.21.15.72:0/2090602787 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6580003b90 con 0x7f65900bb350 2023-07-25T14:37:14.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.417+0000 7f65867fc700 1 --2- 172.21.15.72:0/2090602787 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f657406ace0 0x7f657406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:14.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.417+0000 7f6595239700 1 --2- 172.21.15.72:0/2090602787 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f657406ace0 0x7f657406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:14.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.417+0000 7f65867fc700 1 -- 172.21.15.72:0/2090602787 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 7238+0+0 (secure 0 0 0) 0x7f658008cc60 con 0x7f65900bb350 2023-07-25T14:37:14.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.417+0000 7f6595239700 1 --2- 172.21.15.72:0/2090602787 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f657406ace0 0x7f657406d1a0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f6590152a20 tx=0x7f658c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:14.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.421+0000 7f65867fc700 1 -- 172.21.15.72:0/2090602787 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f65901e5490 con 0x7f65900bb350 2023-07-25T14:37:14.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.609+0000 7f6597c9e700 1 -- 172.21.15.72:0/2090602787 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f65901e5490 con 0x7f65900bb350 2023-07-25T14:37:14.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.610+0000 7f65867fc700 1 -- 172.21.15.72:0/2090602787 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v43) v1 ==== 100+0+11 (secure 0 0 0) 0x7f65901e5490 con 0x7f65900bb350 2023-07-25T14:37:14.621 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 64 2023-07-25T14:37:14.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.612+0000 7f6597c9e700 1 -- 172.21.15.72:0/2090602787 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f657406ace0 msgr2=0x7f657406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:14.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.612+0000 7f6597c9e700 1 --2- 172.21.15.72:0/2090602787 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f657406ace0 0x7f657406d1a0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f6590152a20 tx=0x7f658c008040 comp rx=0 tx=0).stop 2023-07-25T14:37:14.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.612+0000 7f6597c9e700 1 -- 172.21.15.72:0/2090602787 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f65900bb350 msgr2=0x7f6590151800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:14.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.612+0000 7f6597c9e700 1 --2- 172.21.15.72:0/2090602787 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f65900bb350 0x7f6590151800 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f658000c4d0 tx=0x7f6580004750 comp rx=0 tx=0).stop 2023-07-25T14:37:14.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.612+0000 7f6597c9e700 1 -- 172.21.15.72:0/2090602787 shutdown_connections 2023-07-25T14:37:14.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.612+0000 7f6597c9e700 1 --2- 172.21.15.72:0/2090602787 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f657406ace0 0x7f657406d1a0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:14.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.612+0000 7f6597c9e700 1 --2- 172.21.15.72:0/2090602787 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f659014d1d0 0x7f659014f920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:14.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.612+0000 7f6597c9e700 1 --2- 172.21.15.72:0/2090602787 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f65900bb350 0x7f6590151800 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:14.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.612+0000 7f6597c9e700 1 --2- 172.21.15.72:0/2090602787 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f65900bfaf0 0x7f65901e5df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:14.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.612+0000 7f6597c9e700 1 -- 172.21.15.72:0/2090602787 >> 172.21.15.72:0/2090602787 conn(0x7f6590071bf0 msgr2=0x7f659006c910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:14.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.612+0000 7f6597c9e700 1 -- 172.21.15.72:0/2090602787 shutdown_connections 2023-07-25T14:37:14.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.612+0000 7f6597c9e700 1 -- 172.21.15.72:0/2090602787 wait complete. 2023-07-25T14:37:14.635 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-07-25T14:37:14.759 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.747+0000 7efde629d700 1 Processor -- start 2023-07-25T14:37:14.759 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.747+0000 7efde629d700 1 -- start start 2023-07-25T14:37:14.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.748+0000 7efde629d700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7efde014f810 0x7efde00c4370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:14.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.748+0000 7efde629d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7efde00a9cc0 0x7efde01525e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:14.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.748+0000 7efde629d700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7efde00bb0b0 0x7efde0152b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:14.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.748+0000 7efde629d700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efde00c5890 con 0x7efde00a9cc0 2023-07-25T14:37:14.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.748+0000 7efde629d700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efde0152150 con 0x7efde00bb0b0 2023-07-25T14:37:14.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.748+0000 7efde629d700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efde014fbf0 con 0x7efde014f810 2023-07-25T14:37:14.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.748+0000 7efddf7fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7efde00a9cc0 0x7efde01525e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:14.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.748+0000 7efddf7fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7efde00a9cc0 0x7efde01525e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42700/0 (socket says 172.21.15.72:42700) 2023-07-25T14:37:14.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.748+0000 7efddf7fe700 1 -- 172.21.15.72:0/742238947 learned_addr learned my addr 172.21.15.72:0/742238947 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:37:14.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.749+0000 7efde483a700 1 --2- 172.21.15.72:0/742238947 >> v2:172.21.15.92:3300/0 conn(0x7efde00bb0b0 0x7efde0152b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:14.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.749+0000 7efddf7fe700 1 -- 172.21.15.72:0/742238947 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7efde014f810 msgr2=0x7efde00c4370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:14.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.749+0000 7efddffff700 1 --2- 172.21.15.72:0/742238947 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7efde014f810 0x7efde00c4370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:14.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.749+0000 7efddf7fe700 1 --2- 172.21.15.72:0/742238947 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7efde014f810 0x7efde00c4370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:14.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.749+0000 7efddf7fe700 1 -- 172.21.15.72:0/742238947 >> v2:172.21.15.92:3300/0 conn(0x7efde00bb0b0 msgr2=0x7efde0152b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:14.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.749+0000 7efddf7fe700 1 --2- 172.21.15.72:0/742238947 >> v2:172.21.15.92:3300/0 conn(0x7efde00bb0b0 0x7efde0152b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:14.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.749+0000 7efddf7fe700 1 -- 172.21.15.72:0/742238947 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efde01566a0 con 0x7efde00a9cc0 2023-07-25T14:37:14.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.749+0000 7efddf7fe700 1 --2- 172.21.15.72:0/742238947 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efde00a9cc0 0x7efde01525e0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7efde006e350 tx=0x7efdd0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c9e18c32c60989d server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:14.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.749+0000 7efddeffd700 1 -- 172.21.15.72:0/742238947 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdd000b870 con 0x7efde00a9cc0 2023-07-25T14:37:14.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.749+0000 7efddeffd700 1 -- 172.21.15.72:0/742238947 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdd000b9d0 con 0x7efde00a9cc0 2023-07-25T14:37:14.764 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.749+0000 7efddeffd700 1 -- 172.21.15.72:0/742238947 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdd000bd60 con 0x7efde00a9cc0 2023-07-25T14:37:14.764 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.749+0000 7efde629d700 1 -- 172.21.15.72:0/742238947 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efde00a9cc0 msgr2=0x7efde01525e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:14.764 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.749+0000 7efde629d700 1 --2- 172.21.15.72:0/742238947 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efde00a9cc0 0x7efde01525e0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7efde006e350 tx=0x7efdd0009bd0 comp rx=0 tx=0).stop 2023-07-25T14:37:14.764 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.749+0000 7efde629d700 1 -- 172.21.15.72:0/742238947 shutdown_connections 2023-07-25T14:37:14.764 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.749+0000 7efde629d700 1 --2- 172.21.15.72:0/742238947 >> v2:172.21.15.92:3300/0 conn(0x7efde00bb0b0 0x7efde0152b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:14.764 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.749+0000 7efde629d700 1 --2- 172.21.15.72:0/742238947 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7efde014f810 0x7efde00c4370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:14.765 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.749+0000 7efde629d700 1 --2- 172.21.15.72:0/742238947 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efde00a9cc0 0x7efde01525e0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:14.765 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.749+0000 7efde629d700 1 -- 172.21.15.72:0/742238947 >> 172.21.15.72:0/742238947 conn(0x7efde006a8d0 msgr2=0x7efde00a94e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:14.765 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.749+0000 7efde629d700 1 -- 172.21.15.72:0/742238947 shutdown_connections 2023-07-25T14:37:14.765 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.750+0000 7efde629d700 1 -- 172.21.15.72:0/742238947 wait complete. 2023-07-25T14:37:14.767 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.751+0000 7efde629d700 1 Processor -- start 2023-07-25T14:37:14.767 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.751+0000 7efde629d700 1 -- start start 2023-07-25T14:37:14.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.751+0000 7efde629d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efde00a9cc0 0x7efde01edbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:14.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.751+0000 7efde629d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efde00bb0b0 0x7efde00c7970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:14.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.751+0000 7efde629d700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7efde014f810 0x7efde01e9a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:14.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.751+0000 7efde629d700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efde00bbd80 con 0x7efde00bb0b0 2023-07-25T14:37:14.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.751+0000 7efde629d700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efde00bd270 con 0x7efde00a9cc0 2023-07-25T14:37:14.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.751+0000 7efde629d700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efde00bbfd0 con 0x7efde014f810 2023-07-25T14:37:14.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.752+0000 7efddf7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efde00bb0b0 0x7efde00c7970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:14.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.752+0000 7efddf7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efde00bb0b0 0x7efde00c7970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42704/0 (socket says 172.21.15.72:42704) 2023-07-25T14:37:14.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.752+0000 7efddf7fe700 1 -- 172.21.15.72:0/2491092328 learned_addr learned my addr 172.21.15.72:0/2491092328 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:37:14.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.752+0000 7efddffff700 1 --2- 172.21.15.72:0/2491092328 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efde00a9cc0 0x7efde01edbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:14.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.752+0000 7efde483a700 1 --2- 172.21.15.72:0/2491092328 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7efde014f810 0x7efde01e9a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:14.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.752+0000 7efddf7fe700 1 -- 172.21.15.72:0/2491092328 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7efde014f810 msgr2=0x7efde01e9a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:14.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.752+0000 7efddf7fe700 1 --2- 172.21.15.72:0/2491092328 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7efde014f810 0x7efde01e9a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:14.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.752+0000 7efddf7fe700 1 -- 172.21.15.72:0/2491092328 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efde00a9cc0 msgr2=0x7efde01edbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:14.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.752+0000 7efddf7fe700 1 --2- 172.21.15.72:0/2491092328 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efde00a9cc0 0x7efde01edbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:14.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.752+0000 7efddf7fe700 1 -- 172.21.15.72:0/2491092328 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdd0009550 con 0x7efde00bb0b0 2023-07-25T14:37:14.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.752+0000 7efddf7fe700 1 --2- 172.21.15.72:0/2491092328 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efde00bb0b0 0x7efde00c7970 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7efde00c5280 tx=0x7efdd0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:14.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.752+0000 7efddcff9700 1 -- 172.21.15.72:0/2491092328 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdd00129c0 con 0x7efde00bb0b0 2023-07-25T14:37:14.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.752+0000 7efddcff9700 1 -- 172.21.15.72:0/2491092328 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdd001e070 con 0x7efde00bb0b0 2023-07-25T14:37:14.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.752+0000 7efde629d700 1 -- 172.21.15.72:0/2491092328 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efde01ed0d0 con 0x7efde00bb0b0 2023-07-25T14:37:14.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.752+0000 7efddcff9700 1 -- 172.21.15.72:0/2491092328 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdd0012d60 con 0x7efde00bb0b0 2023-07-25T14:37:14.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.752+0000 7efde629d700 1 -- 172.21.15.72:0/2491092328 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efde01ed690 con 0x7efde00bb0b0 2023-07-25T14:37:14.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.753+0000 7efde629d700 1 -- 172.21.15.72:0/2491092328 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efde004e470 con 0x7efde00bb0b0 2023-07-25T14:37:14.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.754+0000 7efddcff9700 1 -- 172.21.15.72:0/2491092328 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7efdd001a420 con 0x7efde00bb0b0 2023-07-25T14:37:14.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.754+0000 7efddcff9700 1 --2- 172.21.15.72:0/2491092328 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7efdcc06ad30 0x7efdcc06d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:14.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.754+0000 7efddcff9700 1 -- 172.21.15.72:0/2491092328 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 7238+0+0 (secure 0 0 0) 0x7efdd008b220 con 0x7efde00bb0b0 2023-07-25T14:37:14.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.754+0000 7efddffff700 1 --2- 172.21.15.72:0/2491092328 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7efdcc06ad30 0x7efdcc06d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:14.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.755+0000 7efddffff700 1 --2- 172.21.15.72:0/2491092328 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7efdcc06ad30 0x7efdcc06d1f0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7efdd400a990 tx=0x7efdd4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:14.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.758+0000 7efddcff9700 1 -- 172.21.15.72:0/2491092328 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7efdd0055fa0 con 0x7efde00bb0b0 2023-07-25T14:37:14.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.944+0000 7efde629d700 1 -- 172.21.15.72:0/2491092328 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7efde00c6ae0 con 0x7efde00bb0b0 2023-07-25T14:37:14.956 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.944+0000 7efddcff9700 1 -- 172.21.15.72:0/2491092328 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v43) v1 ==== 105+0+11 (secure 0 0 0) 0x7efdd00150b0 con 0x7efde00bb0b0 2023-07-25T14:37:14.956 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2023-07-25T14:37:14.957 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.946+0000 7efde629d700 1 -- 172.21.15.72:0/2491092328 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7efdcc06ad30 msgr2=0x7efdcc06d1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:14.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.946+0000 7efde629d700 1 --2- 172.21.15.72:0/2491092328 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7efdcc06ad30 0x7efdcc06d1f0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7efdd400a990 tx=0x7efdd4008040 comp rx=0 tx=0).stop 2023-07-25T14:37:14.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.946+0000 7efde629d700 1 -- 172.21.15.72:0/2491092328 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efde00bb0b0 msgr2=0x7efde00c7970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:14.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.946+0000 7efde629d700 1 --2- 172.21.15.72:0/2491092328 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efde00bb0b0 0x7efde00c7970 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7efde00c5280 tx=0x7efdd0004750 comp rx=0 tx=0).stop 2023-07-25T14:37:14.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.946+0000 7efde629d700 1 -- 172.21.15.72:0/2491092328 shutdown_connections 2023-07-25T14:37:14.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.946+0000 7efde629d700 1 --2- 172.21.15.72:0/2491092328 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7efdcc06ad30 0x7efdcc06d1f0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:14.958 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.946+0000 7efde629d700 1 --2- 172.21.15.72:0/2491092328 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7efde014f810 0x7efde01e9a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:14.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.946+0000 7efde629d700 1 --2- 172.21.15.72:0/2491092328 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efde00a9cc0 0x7efde01edbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:14.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.946+0000 7efde629d700 1 --2- 172.21.15.72:0/2491092328 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7efde00bb0b0 0x7efde00c7970 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:14.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.946+0000 7efde629d700 1 -- 172.21.15.72:0/2491092328 >> 172.21.15.72:0/2491092328 conn(0x7efde006a8d0 msgr2=0x7efde0151270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:14.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.946+0000 7efde629d700 1 -- 172.21.15.72:0/2491092328 shutdown_connections 2023-07-25T14:37:14.959 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:14.946+0000 7efde629d700 1 -- 172.21.15.72:0/2491092328 wait complete. 2023-07-25T14:37:14.969 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-07-25T14:37:15.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.080+0000 7f41ac587700 1 Processor -- start 2023-07-25T14:37:15.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.080+0000 7f41ac587700 1 -- start start 2023-07-25T14:37:15.093 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.081+0000 7f41ac587700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f41a414f810 0x7f41a4152ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:15.093 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.081+0000 7f41ac587700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41a40c02a0 con 0x7f41a406e080 2023-07-25T14:37:15.094 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.081+0000 7f41ac587700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41a40c2f10 con 0x7f41a40c2330 2023-07-25T14:37:15.094 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.081+0000 7f41ac587700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41a40c04f0 con 0x7f41a414f810 2023-07-25T14:37:15.094 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.081+0000 7f41a9b22700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f41a406e080 0x7f41a414f100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:33448/0 (socket says 172.21.15.72:33448) 2023-07-25T14:37:15.094 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.081+0000 7f41a9b22700 1 -- 172.21.15.72:0/3299665146 learned_addr learned my addr 172.21.15.72:0/3299665146 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:37:15.094 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.081+0000 7f41aab24700 1 --2- 172.21.15.72:0/3299665146 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f41a414f810 0x7f41a4152ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:15.094 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.081+0000 7f41a9321700 1 -- 172.21.15.72:0/3299665146 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2155441430 0 0) 0x7f41a40c02a0 con 0x7f41a406e080 2023-07-25T14:37:15.094 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.081+0000 7f41a9321700 1 -- 172.21.15.72:0/3299665146 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f41900035b0 con 0x7f41a406e080 2023-07-25T14:37:15.095 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.082+0000 7f41a9321700 1 -- 172.21.15.72:0/3299665146 <== mon.1 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2090274592 0 0) 0x7f41a40c2f10 con 0x7f41a40c2330 2023-07-25T14:37:15.095 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.082+0000 7f41a9321700 1 -- 172.21.15.72:0/3299665146 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f41a40c02a0 con 0x7f41a40c2330 2023-07-25T14:37:15.095 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.082+0000 7f41aab24700 1 -- 172.21.15.72:0/3299665146 >> v1:172.21.15.92:6789/0 conn(0x7f41a40c2330 legacy=0x7f41a4155c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:15.095 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.082+0000 7f41a9321700 1 -- 172.21.15.72:0/3299665146 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2306264692 0 0) 0x7f41900035b0 con 0x7f41a406e080 2023-07-25T14:37:15.095 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.082+0000 7f41aab24700 1 -- 172.21.15.72:0/3299665146 >> v1:172.21.15.72:6789/0 conn(0x7f41a406e080 legacy=0x7f41a414f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:15.095 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.082+0000 7f41aab24700 1 -- 172.21.15.72:0/3299665146 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41a40c07d0 con 0x7f41a414f810 2023-07-25T14:37:15.095 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.082+0000 7f41aab24700 1 --2- 172.21.15.72:0/3299665146 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f41a414f810 0x7f41a4152ab0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f419c009dc0 tx=0x7f419c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dbe322b94a706829 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:15.095 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.082+0000 7f41a9321700 1 -- 172.21.15.72:0/3299665146 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f419c00e070 con 0x7f41a414f810 2023-07-25T14:37:15.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.082+0000 7f41a9321700 1 -- 172.21.15.72:0/3299665146 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f419c003a20 con 0x7f41a414f810 2023-07-25T14:37:15.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.082+0000 7f41a9321700 1 -- 172.21.15.72:0/3299665146 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41a0001670 con 0x7f41a414f810 2023-07-25T14:37:15.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.083+0000 7f41ac587700 1 -- 172.21.15.72:0/3299665146 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f41a414f810 msgr2=0x7f41a4152ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:15.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.083+0000 7f41ac587700 1 --2- 172.21.15.72:0/3299665146 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f41a414f810 0x7f41a4152ab0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f419c009dc0 tx=0x7f419c00b330 comp rx=0 tx=0).stop 2023-07-25T14:37:15.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.083+0000 7f41ac587700 1 -- 172.21.15.72:0/3299665146 shutdown_connections 2023-07-25T14:37:15.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.083+0000 7f41ac587700 1 --2- 172.21.15.72:0/3299665146 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f41a414f810 0x7f41a4152ab0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:15.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.083+0000 7f41ac587700 1 -- 172.21.15.72:0/3299665146 >> 172.21.15.72:0/3299665146 conn(0x7f41a40a7510 msgr2=0x7f41a40a78f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:15.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.083+0000 7f41ac587700 1 -- 172.21.15.72:0/3299665146 shutdown_connections 2023-07-25T14:37:15.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.083+0000 7f41ac587700 1 -- 172.21.15.72:0/3299665146 wait complete. 2023-07-25T14:37:15.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.084+0000 7f41ac587700 1 Processor -- start 2023-07-25T14:37:15.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.084+0000 7f41ac587700 1 -- start start 2023-07-25T14:37:15.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.085+0000 7f41ac587700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f41a406e080 0x7f41a40bc030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:15.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.085+0000 7f41ac587700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f41a40c2330 0x7f41a41ed020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:15.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.085+0000 7f41ac587700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f41a414f810 0x7f41a41e9840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:15.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.085+0000 7f41ac587700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41a40ba780 con 0x7f41a414f810 2023-07-25T14:37:15.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.085+0000 7f41ac587700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41a40b9b10 con 0x7f41a406e080 2023-07-25T14:37:15.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.085+0000 7f41ac587700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41a40722c0 con 0x7f41a40c2330 2023-07-25T14:37:15.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.085+0000 7f41aab24700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f41a414f810 0x7f41a41e9840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:15.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.085+0000 7f41aab24700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f41a414f810 0x7f41a41e9840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42720/0 (socket says 172.21.15.72:42720) 2023-07-25T14:37:15.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.085+0000 7f41aab24700 1 -- 172.21.15.72:0/3481801786 learned_addr learned my addr 172.21.15.72:0/3481801786 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:37:15.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.085+0000 7f41a9b22700 1 --2- 172.21.15.72:0/3481801786 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f41a40c2330 0x7f41a41ed020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:15.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.085+0000 7f41aa323700 1 --2- 172.21.15.72:0/3481801786 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f41a406e080 0x7f41a40bc030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:15.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.085+0000 7f41aab24700 1 -- 172.21.15.72:0/3481801786 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f41a40c2330 msgr2=0x7f41a41ed020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:15.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.085+0000 7f41aab24700 1 --2- 172.21.15.72:0/3481801786 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f41a40c2330 0x7f41a41ed020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:15.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.085+0000 7f41aab24700 1 -- 172.21.15.72:0/3481801786 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f41a406e080 msgr2=0x7f41a40bc030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:15.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.085+0000 7f41aab24700 1 --2- 172.21.15.72:0/3481801786 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f41a406e080 0x7f41a40bc030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:15.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.085+0000 7f41aab24700 1 -- 172.21.15.72:0/3481801786 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f419c009a70 con 0x7f41a414f810 2023-07-25T14:37:15.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.085+0000 7f41aa323700 1 --2- 172.21.15.72:0/3481801786 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f41a406e080 0x7f41a40bc030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-25T14:37:15.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.085+0000 7f41aab24700 1 --2- 172.21.15.72:0/3481801786 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f41a414f810 0x7f41a41e9840 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f419c009d90 tx=0x7f419c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:15.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.085+0000 7f419affd700 1 -- 172.21.15.72:0/3481801786 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f419c0043c0 con 0x7f41a414f810 2023-07-25T14:37:15.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.085+0000 7f419affd700 1 -- 172.21.15.72:0/3481801786 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f419c004540 con 0x7f41a414f810 2023-07-25T14:37:15.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.085+0000 7f41ac587700 1 -- 172.21.15.72:0/3481801786 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41a41edb30 con 0x7f41a414f810 2023-07-25T14:37:15.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.085+0000 7f419affd700 1 -- 172.21.15.72:0/3481801786 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f419c0048f0 con 0x7f41a414f810 2023-07-25T14:37:15.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.085+0000 7f41ac587700 1 -- 172.21.15.72:0/3481801786 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41a40ba040 con 0x7f41a414f810 2023-07-25T14:37:15.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.086+0000 7f41ac587700 1 -- 172.21.15.72:0/3481801786 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41a404e470 con 0x7f41a414f810 2023-07-25T14:37:15.103 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.087+0000 7f419affd700 1 -- 172.21.15.72:0/3481801786 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f419c01c460 con 0x7f41a414f810 2023-07-25T14:37:15.103 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.087+0000 7f419affd700 1 --2- 172.21.15.72:0/3481801786 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f418806ace0 0x7f418806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:15.103 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.087+0000 7f41aa323700 1 --2- 172.21.15.72:0/3481801786 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f418806ace0 0x7f418806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:15.103 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.087+0000 7f419affd700 1 -- 172.21.15.72:0/3481801786 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 7238+0+0 (secure 0 0 0) 0x7f419c08ae50 con 0x7f41a414f810 2023-07-25T14:37:15.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.088+0000 7f41aa323700 1 --2- 172.21.15.72:0/3481801786 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f418806ace0 0x7f418806d1a0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f41940011e0 tx=0x7f4194009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:15.104 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.091+0000 7f419affd700 1 -- 172.21.15.72:0/3481801786 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f419c055ba0 con 0x7f41a414f810 2023-07-25T14:37:15.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.279+0000 7f41ac587700 1 -- 172.21.15.72:0/3481801786 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7f41a40bfd50 con 0x7f41a414f810 2023-07-25T14:37:15.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.279+0000 7f419affd700 1 -- 172.21.15.72:0/3481801786 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v43) v1 ==== 101+0+11 (secure 0 0 0) 0x7f419c016020 con 0x7f41a414f810 2023-07-25T14:37:15.291 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 64 2023-07-25T14:37:15.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.281+0000 7f41ac587700 1 -- 172.21.15.72:0/3481801786 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f418806ace0 msgr2=0x7f418806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:15.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.281+0000 7f41ac587700 1 --2- 172.21.15.72:0/3481801786 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f418806ace0 0x7f418806d1a0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f41940011e0 tx=0x7f4194009040 comp rx=0 tx=0).stop 2023-07-25T14:37:15.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.281+0000 7f41ac587700 1 -- 172.21.15.72:0/3481801786 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f41a414f810 msgr2=0x7f41a41e9840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:15.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.281+0000 7f41ac587700 1 --2- 172.21.15.72:0/3481801786 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f41a414f810 0x7f41a41e9840 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f419c009d90 tx=0x7f419c004ad0 comp rx=0 tx=0).stop 2023-07-25T14:37:15.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.281+0000 7f41ac587700 1 -- 172.21.15.72:0/3481801786 shutdown_connections 2023-07-25T14:37:15.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.281+0000 7f41ac587700 1 --2- 172.21.15.72:0/3481801786 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f418806ace0 0x7f418806d1a0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:15.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.281+0000 7f41ac587700 1 --2- 172.21.15.72:0/3481801786 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f41a414f810 0x7f41a41e9840 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:15.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.281+0000 7f41ac587700 1 --2- 172.21.15.72:0/3481801786 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f41a406e080 0x7f41a40bc030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:15.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.281+0000 7f41ac587700 1 --2- 172.21.15.72:0/3481801786 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f41a40c2330 0x7f41a41ed020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:15.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.281+0000 7f41ac587700 1 -- 172.21.15.72:0/3481801786 >> 172.21.15.72:0/3481801786 conn(0x7f41a40a7510 msgr2=0x7f41a406cf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:15.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.281+0000 7f41ac587700 1 -- 172.21.15.72:0/3481801786 shutdown_connections 2023-07-25T14:37:15.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.281+0000 7f41ac587700 1 -- 172.21.15.72:0/3481801786 wait complete. 2023-07-25T14:37:15.304 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-25T14:37:15.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.413+0000 7fab1c226700 1 Processor -- start 2023-07-25T14:37:15.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.414+0000 7fab1c226700 1 -- start start 2023-07-25T14:37:15.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.414+0000 7fab1c226700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fab1414e4d0 0x7fab140a6390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:15.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.414+0000 7fab1c226700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fab1406f240 0x7fab141514c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:15.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.414+0000 7fab1c226700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fab140c11f0 0x7fab14151a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:15.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.414+0000 7fab1c226700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab140a9370 con 0x7fab1406f240 2023-07-25T14:37:15.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.414+0000 7fab1c226700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab14151f40 con 0x7fab1414e4d0 2023-07-25T14:37:15.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.414+0000 7fab1c226700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab140a8f40 con 0x7fab140c11f0 2023-07-25T14:37:15.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.415+0000 7fab197c1700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fab1406f240 0x7fab141514c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:15.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.415+0000 7fab197c1700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fab1406f240 0x7fab141514c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42724/0 (socket says 172.21.15.72:42724) 2023-07-25T14:37:15.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.415+0000 7fab197c1700 1 -- 172.21.15.72:0/2741071246 learned_addr learned my addr 172.21.15.72:0/2741071246 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:37:15.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.415+0000 7fab19fc2700 1 --2- 172.21.15.72:0/2741071246 >> v2:172.21.15.92:3300/0 conn(0x7fab1414e4d0 0x7fab140a6390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:15.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.415+0000 7fab1a7c3700 1 --2- 172.21.15.72:0/2741071246 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fab140c11f0 0x7fab14151a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:15.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.415+0000 7fab197c1700 1 -- 172.21.15.72:0/2741071246 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fab140c11f0 msgr2=0x7fab14151a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:15.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.415+0000 7fab197c1700 1 --2- 172.21.15.72:0/2741071246 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fab140c11f0 0x7fab14151a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:15.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.415+0000 7fab197c1700 1 -- 172.21.15.72:0/2741071246 >> v2:172.21.15.92:3300/0 conn(0x7fab1414e4d0 msgr2=0x7fab140a6390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:15.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.415+0000 7fab197c1700 1 --2- 172.21.15.72:0/2741071246 >> v2:172.21.15.92:3300/0 conn(0x7fab1414e4d0 0x7fab140a6390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:15.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.415+0000 7fab197c1700 1 -- 172.21.15.72:0/2741071246 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab14150fc0 con 0x7fab1406f240 2023-07-25T14:37:15.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.415+0000 7fab1a7c3700 1 --2- 172.21.15.72:0/2741071246 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fab140c11f0 0x7fab14151a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-25T14:37:15.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.415+0000 7fab197c1700 1 --2- 172.21.15.72:0/2741071246 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fab1406f240 0x7fab141514c0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fab140aca00 tx=0x7fab10009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2db9eca35bd88f9 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:15.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.415+0000 7fab18fc0700 1 -- 172.21.15.72:0/2741071246 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab1000b870 con 0x7fab1406f240 2023-07-25T14:37:15.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.415+0000 7fab18fc0700 1 -- 172.21.15.72:0/2741071246 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab1000b9d0 con 0x7fab1406f240 2023-07-25T14:37:15.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.415+0000 7fab18fc0700 1 -- 172.21.15.72:0/2741071246 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab1000bd60 con 0x7fab1406f240 2023-07-25T14:37:15.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.416+0000 7fab1c226700 1 -- 172.21.15.72:0/2741071246 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fab1406f240 msgr2=0x7fab141514c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:15.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.416+0000 7fab1c226700 1 --2- 172.21.15.72:0/2741071246 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fab1406f240 0x7fab141514c0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fab140aca00 tx=0x7fab10009bd0 comp rx=0 tx=0).stop 2023-07-25T14:37:15.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.416+0000 7fab1c226700 1 -- 172.21.15.72:0/2741071246 shutdown_connections 2023-07-25T14:37:15.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.416+0000 7fab1c226700 1 --2- 172.21.15.72:0/2741071246 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fab140c11f0 0x7fab14151a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:15.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.416+0000 7fab1c226700 1 --2- 172.21.15.72:0/2741071246 >> v2:172.21.15.92:3300/0 conn(0x7fab1414e4d0 0x7fab140a6390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:15.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.416+0000 7fab1c226700 1 --2- 172.21.15.72:0/2741071246 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fab1406f240 0x7fab141514c0 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:15.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.416+0000 7fab1c226700 1 -- 172.21.15.72:0/2741071246 >> 172.21.15.72:0/2741071246 conn(0x7fab14071540 msgr2=0x7fab14071950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:15.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.416+0000 7fab1c226700 1 -- 172.21.15.72:0/2741071246 shutdown_connections 2023-07-25T14:37:15.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.416+0000 7fab1c226700 1 -- 172.21.15.72:0/2741071246 wait complete. 2023-07-25T14:37:15.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.417+0000 7fab1c226700 1 Processor -- start 2023-07-25T14:37:15.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.417+0000 7fab1c226700 1 -- start start 2023-07-25T14:37:15.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.417+0000 7fab1c226700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fab1406f240 0x7fab140c5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:15.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.418+0000 7fab1c226700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fab140c11f0 0x7fab140a5310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:15.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.418+0000 7fab1c226700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fab1414e4d0 0x7fab140a5850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:15.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.418+0000 7fab1c226700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab140bd940 con 0x7fab1406f240 2023-07-25T14:37:15.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.418+0000 7fab1c226700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab141ea470 con 0x7fab1414e4d0 2023-07-25T14:37:15.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.418+0000 7fab1c226700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab140bde70 con 0x7fab140c11f0 2023-07-25T14:37:15.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.418+0000 7fab19fc2700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fab1406f240 0x7fab140c5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:15.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.418+0000 7fab19fc2700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fab1406f240 0x7fab140c5700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42728/0 (socket says 172.21.15.72:42728) 2023-07-25T14:37:15.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.418+0000 7fab19fc2700 1 -- 172.21.15.72:0/3182915530 learned_addr learned my addr 172.21.15.72:0/3182915530 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:37:15.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.418+0000 7fab19fc2700 1 -- 172.21.15.72:0/3182915530 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fab140c11f0 msgr2=0x7fab140a5310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:15.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.418+0000 7fab19fc2700 1 --2- 172.21.15.72:0/3182915530 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fab140c11f0 0x7fab140a5310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:15.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.418+0000 7fab19fc2700 1 -- 172.21.15.72:0/3182915530 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fab1414e4d0 msgr2=0x7fab140a5850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:15.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.418+0000 7fab19fc2700 1 --2- 172.21.15.72:0/3182915530 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fab1414e4d0 0x7fab140a5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:15.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.418+0000 7fab19fc2700 1 -- 172.21.15.72:0/3182915530 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab10009550 con 0x7fab1406f240 2023-07-25T14:37:15.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.418+0000 7fab19fc2700 1 --2- 172.21.15.72:0/3182915530 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fab1406f240 0x7fab140c5700 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fab0400d800 tx=0x7fab0400dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:15.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.418+0000 7fab0a7fc700 1 -- 172.21.15.72:0/3182915530 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab040125f0 con 0x7fab1406f240 2023-07-25T14:37:15.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.418+0000 7fab0a7fc700 1 -- 172.21.15.72:0/3182915530 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab04012750 con 0x7fab1406f240 2023-07-25T14:37:15.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.418+0000 7fab1c226700 1 -- 172.21.15.72:0/3182915530 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab140bdb90 con 0x7fab1406f240 2023-07-25T14:37:15.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.418+0000 7fab0a7fc700 1 -- 172.21.15.72:0/3182915530 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab04012b00 con 0x7fab1406f240 2023-07-25T14:37:15.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.418+0000 7fab1c226700 1 -- 172.21.15.72:0/3182915530 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab140c5c40 con 0x7fab1406f240 2023-07-25T14:37:15.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.419+0000 7fab1c226700 1 -- 172.21.15.72:0/3182915530 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab1404e470 con 0x7fab1406f240 2023-07-25T14:37:15.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.419+0000 7fab0a7fc700 1 -- 172.21.15.72:0/3182915530 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fab04012c60 con 0x7fab1406f240 2023-07-25T14:37:15.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.420+0000 7fab0a7fc700 1 --2- 172.21.15.72:0/3182915530 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7faaf806ace0 0x7faaf806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:15.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.420+0000 7fab0a7fc700 1 -- 172.21.15.72:0/3182915530 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 7238+0+0 (secure 0 0 0) 0x7fab04089c40 con 0x7fab1406f240 2023-07-25T14:37:15.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.420+0000 7fab197c1700 1 --2- 172.21.15.72:0/3182915530 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7faaf806ace0 0x7faaf806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:15.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.420+0000 7fab197c1700 1 --2- 172.21.15.72:0/3182915530 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7faaf806ace0 0x7faaf806d1a0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fab1406f680 tx=0x7fab10010000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:15.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.424+0000 7fab0a7fc700 1 -- 172.21.15.72:0/3182915530 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fab040548e0 con 0x7fab1406f240 2023-07-25T14:37:15.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.630+0000 7fab1c226700 1 -- 172.21.15.72:0/3182915530 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fab14151cf0 con 0x7fab1406f240 2023-07-25T14:37:15.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.630+0000 7fab0a7fc700 1 -- 172.21.15.72:0/3182915530 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v43) v1 ==== 80+0+0 (secure 0 0 0) 0x7fab04057f00 con 0x7fab1406f240 2023-07-25T14:37:15.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.632+0000 7fab1c226700 1 -- 172.21.15.72:0/3182915530 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7faaf806ace0 msgr2=0x7faaf806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:15.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.632+0000 7fab1c226700 1 --2- 172.21.15.72:0/3182915530 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7faaf806ace0 0x7faaf806d1a0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fab1406f680 tx=0x7fab10010000 comp rx=0 tx=0).stop 2023-07-25T14:37:15.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.632+0000 7fab1c226700 1 -- 172.21.15.72:0/3182915530 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fab1406f240 msgr2=0x7fab140c5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:15.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.632+0000 7fab1c226700 1 --2- 172.21.15.72:0/3182915530 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fab1406f240 0x7fab140c5700 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fab0400d800 tx=0x7fab0400dbc0 comp rx=0 tx=0).stop 2023-07-25T14:37:15.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.632+0000 7fab1c226700 1 -- 172.21.15.72:0/3182915530 shutdown_connections 2023-07-25T14:37:15.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.632+0000 7fab1c226700 1 --2- 172.21.15.72:0/3182915530 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7faaf806ace0 0x7faaf806d1a0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:15.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.632+0000 7fab1c226700 1 --2- 172.21.15.72:0/3182915530 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fab1414e4d0 0x7fab140a5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:15.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.632+0000 7fab1c226700 1 --2- 172.21.15.72:0/3182915530 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fab1406f240 0x7fab140c5700 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:15.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.632+0000 7fab1c226700 1 --2- 172.21.15.72:0/3182915530 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fab140c11f0 0x7fab140a5310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:15.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.632+0000 7fab1c226700 1 -- 172.21.15.72:0/3182915530 >> 172.21.15.72:0/3182915530 conn(0x7fab14071540 msgr2=0x7fab14071920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:15.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.632+0000 7fab1c226700 1 -- 172.21.15.72:0/3182915530 shutdown_connections 2023-07-25T14:37:15.645 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.632+0000 7fab1c226700 1 -- 172.21.15.72:0/3182915530 wait complete. 2023-07-25T14:37:15.645 INFO:teuthology.orchestra.run.smithi072.stderr:listed 0 entries 2023-07-25T14:37:15.655 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-07-25T14:37:15.655 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-25T14:37:15.656 DEBUG:teuthology.orchestra.run.smithi072:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-07-25T14:37:15.696 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi072.front.sepia.ceph.com 2023-07-25T14:37:15.697 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-25T14:37:15.697 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-07-25T14:37:15.754 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-07-25T14:37:15.754 DEBUG:teuthology.orchestra.run.smithi072:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-25T14:37:15.810 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284104k,nr_inodes=4071026,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=45,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16327 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260520k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 2023-07-25T14:37:15.811 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-25T14:37:15.870 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T14:37:15.896 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T14:37:15.974 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.963+0000 7fb52bfc6700 1 Processor -- start 2023-07-25T14:37:15.974 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.963+0000 7fb52bfc6700 1 -- start start 2023-07-25T14:37:15.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.964+0000 7fb52bfc6700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb524072300 0x7fb52406a190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:15.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.964+0000 7fb52bfc6700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb5240a86c0 0x7fb5240c0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:15.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.964+0000 7fb52bfc6700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5240a8230 con 0x7fb52414dea0 2023-07-25T14:37:15.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.964+0000 7fb52bfc6700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5240c18d0 con 0x7fb5240a86c0 2023-07-25T14:37:15.976 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.964+0000 7fb52bfc6700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb52406ea10 con 0x7fb524072300 2023-07-25T14:37:15.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.964+0000 7fb52a563700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb5240a86c0 0x7fb5240c0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:15.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.964+0000 7fb52a563700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb5240a86c0 0x7fb5240c0bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42740/0 (socket says 172.21.15.72:42740) 2023-07-25T14:37:15.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.964+0000 7fb52a563700 1 -- 172.21.15.72:0/1092442067 learned_addr learned my addr 172.21.15.72:0/1092442067 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:37:15.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.964+0000 7fb529d62700 1 --1- 172.21.15.72:0/1092442067 >> v1:172.21.15.72:6789/0 conn(0x7fb52414dea0 0x7fb524151200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:33472/0 (socket says 172.21.15.72:33472) 2023-07-25T14:37:15.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.964+0000 7fb52a563700 1 -- 172.21.15.72:0/1092442067 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb524072300 msgr2=0x7fb52406a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:15.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.964+0000 7fb52a563700 1 --2- 172.21.15.72:0/1092442067 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb524072300 0x7fb52406a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:15.977 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.964+0000 7fb52a563700 1 -- 172.21.15.72:0/1092442067 >> v1:172.21.15.72:6789/0 conn(0x7fb52414dea0 legacy=0x7fb524151200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:15.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.964+0000 7fb52a563700 1 -- 172.21.15.72:0/1092442067 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5240a7c20 con 0x7fb5240a86c0 2023-07-25T14:37:15.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.964+0000 7fb528d60700 1 -- 172.21.15.72:0/1092442067 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2447189822 0 0) 0x7fb5240a8230 con 0x7fb52414dea0 2023-07-25T14:37:15.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.964+0000 7fb52a563700 1 --2- 172.21.15.72:0/1092442067 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb5240a86c0 0x7fb5240c0bc0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fb51c009e50 tx=0x7fb51c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=503bc036c4a30dcc server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:15.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.964+0000 7fb528d60700 1 -- 172.21.15.72:0/1092442067 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb51c00e070 con 0x7fb5240a86c0 2023-07-25T14:37:15.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.964+0000 7fb528d60700 1 -- 172.21.15.72:0/1092442067 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb51c00b9c0 con 0x7fb5240a86c0 2023-07-25T14:37:15.978 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.965+0000 7fb528d60700 1 -- 172.21.15.72:0/1092442067 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb51c00bd70 con 0x7fb5240a86c0 2023-07-25T14:37:15.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.965+0000 7fb52bfc6700 1 -- 172.21.15.72:0/1092442067 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb5240a86c0 msgr2=0x7fb5240c0bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:15.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.965+0000 7fb52bfc6700 1 --2- 172.21.15.72:0/1092442067 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb5240a86c0 0x7fb5240c0bc0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fb51c009e50 tx=0x7fb51c00b330 comp rx=0 tx=0).stop 2023-07-25T14:37:15.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.965+0000 7fb52bfc6700 1 -- 172.21.15.72:0/1092442067 shutdown_connections 2023-07-25T14:37:15.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.965+0000 7fb52bfc6700 1 --2- 172.21.15.72:0/1092442067 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb5240a86c0 0x7fb5240c0bc0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:15.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.965+0000 7fb52bfc6700 1 --2- 172.21.15.72:0/1092442067 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb524072300 0x7fb52406a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:15.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.965+0000 7fb52bfc6700 1 -- 172.21.15.72:0/1092442067 >> 172.21.15.72:0/1092442067 conn(0x7fb52406def0 msgr2=0x7fb52406e300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:15.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.965+0000 7fb52bfc6700 1 -- 172.21.15.72:0/1092442067 shutdown_connections 2023-07-25T14:37:15.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.965+0000 7fb52bfc6700 1 -- 172.21.15.72:0/1092442067 wait complete. 2023-07-25T14:37:15.981 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.967+0000 7fb52bfc6700 1 Processor -- start 2023-07-25T14:37:15.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.967+0000 7fb52bfc6700 1 -- start start 2023-07-25T14:37:15.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.967+0000 7fb52bfc6700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb524072300 0x7fb5241e8c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:15.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.967+0000 7fb52bfc6700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb5240a86c0 0x7fb5241ead40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:15.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.967+0000 7fb52bfc6700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb52414dea0 0x7fb5240ab7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:15.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.967+0000 7fb52bfc6700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5241e7bb0 con 0x7fb524072300 2023-07-25T14:37:15.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.967+0000 7fb52bfc6700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5241eb590 con 0x7fb5240a86c0 2023-07-25T14:37:15.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.967+0000 7fb52bfc6700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5241eb870 con 0x7fb52414dea0 2023-07-25T14:37:15.982 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.968+0000 7fb529d62700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb524072300 0x7fb5241e8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:15.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.968+0000 7fb529d62700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb524072300 0x7fb5241e8c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42742/0 (socket says 172.21.15.72:42742) 2023-07-25T14:37:15.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.968+0000 7fb529d62700 1 -- 172.21.15.72:0/2405074990 learned_addr learned my addr 172.21.15.72:0/2405074990 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:37:15.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.968+0000 7fb529d62700 1 -- 172.21.15.72:0/2405074990 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb52414dea0 msgr2=0x7fb5240ab7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:15.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.968+0000 7fb529d62700 1 --2- 172.21.15.72:0/2405074990 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb52414dea0 0x7fb5240ab7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:15.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.968+0000 7fb529d62700 1 -- 172.21.15.72:0/2405074990 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb5240a86c0 msgr2=0x7fb5241ead40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:15.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.968+0000 7fb529561700 1 --2- 172.21.15.72:0/2405074990 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb5240a86c0 0x7fb5241ead40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:15.983 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.968+0000 7fb529d62700 1 --2- 172.21.15.72:0/2405074990 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb5240a86c0 0x7fb5241ead40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:15.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.968+0000 7fb529d62700 1 -- 172.21.15.72:0/2405074990 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb51c009b30 con 0x7fb524072300 2023-07-25T14:37:15.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.968+0000 7fb529d62700 1 --2- 172.21.15.72:0/2405074990 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb524072300 0x7fb5241e8c40 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fb52000c550 tx=0x7fb52000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:15.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.968+0000 7fb51a7fc700 1 -- 172.21.15.72:0/2405074990 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb520004c80 con 0x7fb524072300 2023-07-25T14:37:15.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.968+0000 7fb51a7fc700 1 -- 172.21.15.72:0/2405074990 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb520004e00 con 0x7fb524072300 2023-07-25T14:37:15.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.968+0000 7fb52bfc6700 1 -- 172.21.15.72:0/2405074990 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5241ebb50 con 0x7fb524072300 2023-07-25T14:37:15.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.968+0000 7fb51a7fc700 1 -- 172.21.15.72:0/2405074990 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb520007310 con 0x7fb524072300 2023-07-25T14:37:15.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.968+0000 7fb52bfc6700 1 -- 172.21.15.72:0/2405074990 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5241e77d0 con 0x7fb524072300 2023-07-25T14:37:15.984 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.969+0000 7fb52bfc6700 1 -- 172.21.15.72:0/2405074990 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb52406bcf0 con 0x7fb524072300 2023-07-25T14:37:15.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.970+0000 7fb51a7fc700 1 -- 172.21.15.72:0/2405074990 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb520007470 con 0x7fb524072300 2023-07-25T14:37:15.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.970+0000 7fb51a7fc700 1 --2- 172.21.15.72:0/2405074990 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fb50806ace0 0x7fb50806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:15.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.970+0000 7fb51a7fc700 1 -- 172.21.15.72:0/2405074990 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 7238+0+0 (secure 0 0 0) 0x7fb5200895d0 con 0x7fb524072300 2023-07-25T14:37:15.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.970+0000 7fb529561700 1 --2- 172.21.15.72:0/2405074990 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fb50806ace0 0x7fb50806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:15.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.970+0000 7fb529561700 1 --2- 172.21.15.72:0/2405074990 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fb50806ace0 0x7fb50806d1a0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fb514006fd0 tx=0x7fb514008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:15.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:15.974+0000 7fb51a7fc700 1 -- 172.21.15.72:0/2405074990 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fb520054270 con 0x7fb524072300 2023-07-25T14:37:16.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:16.207+0000 7fb52bfc6700 1 -- 172.21.15.72:0/2405074990 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fb5240c0770 con 0x7fb524072300 2023-07-25T14:37:16.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:16.207+0000 7fb51a7fc700 1 -- 172.21.15.72:0/2405074990 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v22) v1 ==== 53+0+149 (secure 0 0 0) 0x7fb520057890 con 0x7fb524072300 2023-07-25T14:37:16.219 INFO:teuthology.orchestra.run.smithi072.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-25T14:37:16.219 INFO:teuthology.orchestra.run.smithi072.stdout:name: cephfs2, metadata pool: cephfs2_metadata, data pools: [cephfs2_data ] 2023-07-25T14:37:16.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:16.209+0000 7fb52bfc6700 1 -- 172.21.15.72:0/2405074990 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fb50806ace0 msgr2=0x7fb50806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:16.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:16.209+0000 7fb52bfc6700 1 --2- 172.21.15.72:0/2405074990 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fb50806ace0 0x7fb50806d1a0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fb514006fd0 tx=0x7fb514008040 comp rx=0 tx=0).stop 2023-07-25T14:37:16.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:16.209+0000 7fb52bfc6700 1 -- 172.21.15.72:0/2405074990 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb524072300 msgr2=0x7fb5241e8c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:16.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:16.209+0000 7fb52bfc6700 1 --2- 172.21.15.72:0/2405074990 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb524072300 0x7fb5241e8c40 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fb52000c550 tx=0x7fb52000c910 comp rx=0 tx=0).stop 2023-07-25T14:37:16.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:16.209+0000 7fb52bfc6700 1 -- 172.21.15.72:0/2405074990 shutdown_connections 2023-07-25T14:37:16.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:16.209+0000 7fb52bfc6700 1 --2- 172.21.15.72:0/2405074990 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fb50806ace0 0x7fb50806d1a0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:16.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:16.209+0000 7fb52bfc6700 1 --2- 172.21.15.72:0/2405074990 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb52414dea0 0x7fb5240ab7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:16.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:16.209+0000 7fb52bfc6700 1 --2- 172.21.15.72:0/2405074990 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb524072300 0x7fb5241e8c40 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:16.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:16.209+0000 7fb52bfc6700 1 --2- 172.21.15.72:0/2405074990 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb5240a86c0 0x7fb5241ead40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:16.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:16.209+0000 7fb52bfc6700 1 -- 172.21.15.72:0/2405074990 >> 172.21.15.72:0/2405074990 conn(0x7fb52406def0 msgr2=0x7fb52414b6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:16.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:16.210+0000 7fb52bfc6700 1 -- 172.21.15.72:0/2405074990 shutdown_connections 2023-07-25T14:37:16.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:16.210+0000 7fb52bfc6700 1 -- 172.21.15.72:0/2405074990 wait complete. 2023-07-25T14:37:16.233 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs2; just confirmed its presence on cluster 2023-07-25T14:37:16.234 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-25T14:37:16.234 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi072.front.sepia.ceph.com 2023-07-25T14:37:16.235 INFO:tasks.cephfs.mount:self.client.name = client.testuser 2023-07-25T14:37:16.235 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-07-25T14:37:16.235 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs2 2023-07-25T14:37:16.236 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-07-25T14:37:16.236 INFO:tasks.cephfs.mount:self.client_keyring_path = /tmp/tmp.4lo54Xk1SR 2023-07-25T14:37:16.237 DEBUG:teuthology.orchestra.run.smithi072:> mktemp 2023-07-25T14:37:16.289 INFO:teuthology.orchestra.run.smithi072.stdout:/tmp/tmp.RoCybonZIP 2023-07-25T14:37:16.290 DEBUG:teuthology.orchestra.run.smithi072:> sudo cp /tmp/tmp.4lo54Xk1SR /tmp/tmp.RoCybonZIP 2023-07-25T14:37:16.356 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod 0666 /tmp/tmp.RoCybonZIP 2023-07-25T14:37:16.481 DEBUG:teuthology.orchestra.remote:smithi072:/tmp/tmp.RoCybonZIP is 185B 2023-07-25T14:37:16.501 DEBUG:teuthology.orchestra.run.smithi072:> rm -fr /tmp/tmp.RoCybonZIP 2023-07-25T14:37:16.518 INFO:tasks.cephfs.mount:keyring content - [client.testuser] key = AQAY3r9kYc2CKRAA4brFhJzECz/5INyzrXGiVw== caps mds = "allow rw fsname=cephfs" caps mon = "allow r fsname=cephfs" caps osd = "allow rw tag cephfs data=cephfs" 2023-07-25T14:37:16.518 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-25T14:37:16.519 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-25T14:37:16.519 DEBUG:teuthology.orchestra.run.smithi072:> ip addr 2023-07-25T14:37:16.574 INFO:teuthology.orchestra.run.smithi072.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-25T14:37:16.575 INFO:teuthology.orchestra.run.smithi072.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-25T14:37:16.575 INFO:teuthology.orchestra.run.smithi072.stdout: inet 127.0.0.1/8 scope host lo 2023-07-25T14:37:16.575 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-07-25T14:37:16.575 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 ::1/128 scope host 2023-07-25T14:37:16.575 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-07-25T14:37:16.575 INFO:teuthology.orchestra.run.smithi072.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-25T14:37:16.576 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:d8:da:f4 brd ff:ff:ff:ff:ff:ff 2023-07-25T14:37:16.576 INFO:teuthology.orchestra.run.smithi072.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-25T14:37:16.576 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:d8:da:f5 brd ff:ff:ff:ff:ff:ff 2023-07-25T14:37:16.576 INFO:teuthology.orchestra.run.smithi072.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-25T14:37:16.576 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:8f:b7:64 brd ff:ff:ff:ff:ff:ff 2023-07-25T14:37:16.576 INFO:teuthology.orchestra.run.smithi072.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-25T14:37:16.576 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:8f:b7:65 brd ff:ff:ff:ff:ff:ff 2023-07-25T14:37:16.577 INFO:teuthology.orchestra.run.smithi072.stdout: inet 172.21.15.72/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-07-25T14:37:16.577 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft 42201sec preferred_lft 42201sec 2023-07-25T14:37:16.577 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 fe80::3ce1:9f7:ed06:b425/64 scope link noprefixroute 2023-07-25T14:37:16.577 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-07-25T14:37:16.577 INFO:teuthology.orchestra.run.smithi072.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-25T14:37:16.577 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 16:a9:d8:9c:48:e3 brd ff:ff:ff:ff:ff:ff 2023-07-25T14:37:16.577 INFO:teuthology.orchestra.run.smithi072.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-25T14:37:16.577 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-07-25T14:37:16.578 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 fe80::3892:87ff:fee8:8d42/64 scope link 2023-07-25T14:37:16.578 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-07-25T14:37:16.578 INFO:teuthology.orchestra.run.smithi072.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-25T14:37:16.578 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 16:a9:d8:9c:48:e3 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-07-25T14:37:16.578 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 fe80::14a9:d8ff:fe9c:48e3/64 scope link 2023-07-25T14:37:16.578 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-07-25T14:37:16.579 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-25T14:37:16.579 DEBUG:teuthology.orchestra.run.smithi072:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-25T14:37:16.640 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-07-25T14:37:16.642 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-25T14:37:16.642 DEBUG:teuthology.orchestra.run.smithi072:> route 2023-07-25T14:37:16.700 INFO:teuthology.orchestra.run.smithi072.stdout:Kernel IP routing table 2023-07-25T14:37:16.700 INFO:teuthology.orchestra.run.smithi072.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-25T14:37:16.701 INFO:teuthology.orchestra.run.smithi072.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-07-25T14:37:16.701 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-07-25T14:37:16.701 INFO:teuthology.orchestra.run.smithi072.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-25T14:37:16.701 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-25T14:37:16.702 DEBUG:teuthology.orchestra.run.smithi072:> (cd / && exec bash -c ' 2023-07-25T14:37:16.702 DEBUG:teuthology.orchestra.run.smithi072:> set -e 2023-07-25T14:37:16.702 DEBUG:teuthology.orchestra.run.smithi072:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-07-25T14:37:16.703 DEBUG:teuthology.orchestra.run.smithi072:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-07-25T14:37:16.703 DEBUG:teuthology.orchestra.run.smithi072:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-07-25T14:37:16.703 DEBUG:teuthology.orchestra.run.smithi072:> ') 2023-07-25T14:37:16.803 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-25T14:37:16.804 DEBUG:teuthology.orchestra.run.smithi072:> ip netns list 2023-07-25T14:37:16.820 INFO:teuthology.orchestra.run.smithi072.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-07-25T14:37:16.821 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-25T14:37:16.821 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-25T14:37:16.822 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip link set brx.0 up 2023-07-25T14:37:16.887 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-25T14:37:16.888 DEBUG:teuthology.orchestra.run.smithi072:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-07-25T14:37:16.943 INFO:teuthology.orchestra.run.smithi072.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-07-25T14:37:16.944 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-25T14:37:16.944 DEBUG:teuthology.orchestra.run.smithi072:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-07-25T14:37:17.000 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-07-25T14:37:17.000 DEBUG:teuthology.orchestra.run.smithi072:> dd if=/tmp/tmp.4lo54Xk1SR of=/dev/stdout 2023-07-25T14:37:17.056 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-07-25T14:37:17.056 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-25T14:37:17.057 DEBUG:teuthology.orchestra.run.smithi072:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,secret=AQAY3r9kYc2CKRAA4brFhJzECz/5INyzrXGiVw==,conf=/etc/ceph/ceph.conf,norbytes,name=testuser,mds_namespace=cephfs2 2023-07-25T14:37:17.141 INFO:teuthology.orchestra.run.smithi072.stdout:parsing options: rw,norequire_active_mds,secret=AQAY3r9kYc2CKRAA4brFhJzECz/5INyzrXGiVw==,conf=/etc/ceph/ceph.conf,norbytes,name=testuser,mds_namespace=cephfs2 2023-07-25T14:37:17.141 INFO:teuthology.orchestra.run.smithi072.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=testuser,mds_namespace=cephfs2". 2023-07-25T14:37:17.142 INFO:teuthology.orchestra.run.smithi072.stdout:invalid new device string format 2023-07-25T14:37:17.142 INFO:teuthology.orchestra.run.smithi072.stdout:keyring.get_secret failed 2023-07-25T14:37:17.150 INFO:teuthology.orchestra.run.smithi072.stdout:parsing options: rw,norequire_active_mds,secret=AQAY3r9kYc2CKRAA4brFhJzECz/5INyzrXGiVw==,conf=/etc/ceph/ceph.conf,norbytes,name=testuser,mds_namespace=cephfs2 2023-07-25T14:37:17.150 INFO:teuthology.orchestra.run.smithi072.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=testuser,mds_namespace=cephfs2". 2023-07-25T14:37:17.150 INFO:teuthology.orchestra.run.smithi072.stdout:invalid new device string format 2023-07-25T14:37:17.151 INFO:teuthology.orchestra.run.smithi072.stdout:mount.ceph: resolved to: "172.21.15.72:3300,172.21.15.92:3300,172.21.15.92:3301" 2023-07-25T14:37:17.151 INFO:teuthology.orchestra.run.smithi072.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-25T14:37:17.151 INFO:teuthology.orchestra.run.smithi072.stdout:keyring.get_secret failed 2023-07-25T14:37:17.206 INFO:teuthology.orchestra.run.smithi072.stderr:mount error 2 = No such file or directory 2023-07-25T14:37:17.207 INFO:teuthology.orchestra.run.smithi072.stdout:parsing options: rw,norequire_active_mds,secret=AQAY3r9kYc2CKRAA4brFhJzECz/5INyzrXGiVw==,conf=/etc/ceph/ceph.conf,norbytes,name=testuser,mds_namespace=cephfs2 2023-07-25T14:37:17.207 INFO:teuthology.orchestra.run.smithi072.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=testuser,mds_namespace=cephfs2". 2023-07-25T14:37:17.207 INFO:teuthology.orchestra.run.smithi072.stdout:invalid new device string format 2023-07-25T14:37:17.207 INFO:teuthology.orchestra.run.smithi072.stdout:mount.ceph: resolved to: "172.21.15.72:3300,172.21.15.92:3300,172.21.15.92:3301" 2023-07-25T14:37:17.208 INFO:teuthology.orchestra.run.smithi072.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-25T14:37:17.208 INFO:teuthology.orchestra.run.smithi072.stdout:mount.ceph: resolved to: "172.21.15.72:6789,172.21.15.92:6789,172.21.15.92:6790" 2023-07-25T14:37:17.208 INFO:teuthology.orchestra.run.smithi072.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.72:6789,172.21.15.92:6789,172.21.15.92:6790:/ 2023-07-25T14:37:17.208 INFO:teuthology.orchestra.run.smithi072.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=testuser,mds_namespace=cephfs2,key=testuser,fsid=9170db48-9170-43e8-8ccb-9813e6240906" will pass to kernel 2023-07-25T14:37:17.209 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-07-25T14:37:17.209 INFO:tasks.cephfs.kernel_mount:mount command failed 2023-07-25T14:37:17.210 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-25T14:37:17.210 DEBUG:teuthology.orchestra.run.smithi072:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-25T14:37:17.246 DEBUG:teuthology.orchestra.run.smithi092:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-25T14:37:17.298 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-25T14:37:17.299 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-07-25T14:37:17.299 DEBUG:teuthology.orchestra.run.smithi072:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-25T14:37:17.316 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284104k,nr_inodes=4071026,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=45,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16327 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260520k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 2023-07-25T14:37:17.316 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-07-25T14:37:17.317 DEBUG:teuthology.orchestra.run.smithi092:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-25T14:37:17.337 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-07-25T14:37:17.338 DEBUG:teuthology.orchestra.run.smithi092:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-25T14:37:17.398 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-25T14:37:17.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:17.506+0000 7f46e3527700 1 Processor -- start 2023-07-25T14:37:17.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:17.506+0000 7f46e3527700 1 -- start start 2023-07-25T14:37:17.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:17.507+0000 7f46e3527700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f46dc151950 0x7f46dc06a190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:17.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:17.507+0000 7f46e3527700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f46dc0724c0 0x7f46dc0c34c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:17.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:17.507+0000 7f46e3527700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f46dc06a6d0 0x7f46dc0c3a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:17.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:17.507+0000 7f46e3527700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46dc071a60 con 0x7f46dc151950 2023-07-25T14:37:17.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:17.507+0000 7f46e3527700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46dc0c2a70 con 0x7f46dc06a6d0 2023-07-25T14:37:17.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:17.507+0000 7f46e3527700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46dc151d30 con 0x7f46dc0724c0 2023-07-25T14:37:17.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:17.507+0000 7f46e12c3700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f46dc151950 0x7f46dc06a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:17.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:17.507+0000 7f46e12c3700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f46dc151950 0x7f46dc06a190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42752/0 (socket says 172.21.15.72:42752) 2023-07-25T14:37:17.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:17.507+0000 7f46e12c3700 1 -- 172.21.15.72:0/2083662286 learned_addr learned my addr 172.21.15.72:0/2083662286 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:37:17.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:17.508+0000 7f46e12c3700 1 -- 172.21.15.72:0/2083662286 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f46dc0724c0 msgr2=0x7f46dc0c34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:17.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:17.508+0000 7f46e12c3700 1 --2- 172.21.15.72:0/2083662286 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f46dc0724c0 0x7f46dc0c34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:17.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:17.508+0000 7f46e12c3700 1 -- 172.21.15.72:0/2083662286 >> v2:172.21.15.92:3300/0 conn(0x7f46dc06a6d0 msgr2=0x7f46dc0c3a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:17.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:17.508+0000 7f46e1ac4700 1 --2- 172.21.15.72:0/2083662286 >> v2:172.21.15.92:3300/0 conn(0x7f46dc06a6d0 0x7f46dc0c3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:17.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:17.508+0000 7f46e12c3700 1 --2- 172.21.15.72:0/2083662286 >> v2:172.21.15.92:3300/0 conn(0x7f46dc06a6d0 0x7f46dc0c3a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:17.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:17.508+0000 7f46e12c3700 1 -- 172.21.15.72:0/2083662286 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46dc0c2fe0 con 0x7f46dc151950 2023-07-25T14:37:17.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:17.508+0000 7f46e1ac4700 1 --2- 172.21.15.72:0/2083662286 >> v2:172.21.15.92:3300/0 conn(0x7f46dc06a6d0 0x7f46dc0c3a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-25T14:37:17.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:17.508+0000 7f46e12c3700 1 --2- 172.21.15.72:0/2083662286 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f46dc151950 0x7f46dc06a190 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f46dc06d430 tx=0x7f46cc009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c220a448d1863cf server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:17.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:17.508+0000 7f46d3fff700 1 -- 172.21.15.72:0/2083662286 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46cc00b870 con 0x7f46dc151950 2023-07-25T14:37:17.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:17.508+0000 7f46d3fff700 1 -- 172.21.15.72:0/2083662286 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46cc00b9d0 con 0x7f46dc151950 2023-07-25T14:37:17.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:17.508+0000 7f46d3fff700 1 -- 172.21.15.72:0/2083662286 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46cc00bd60 con 0x7f46dc151950 2023-07-25T14:37:17.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:17.508+0000 7f46e3527700 1 -- 172.21.15.72:0/2083662286 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f46dc151950 msgr2=0x7f46dc06a190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:17.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:17.508+0000 7f46e3527700 1 --2- 172.21.15.72:0/2083662286 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f46dc151950 0x7f46dc06a190 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f46dc06d430 tx=0x7f46cc009bd0 comp rx=0 tx=0).stop 2023-07-25T14:37:17.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:17.508+0000 7f46e3527700 1 -- 172.21.15.72:0/2083662286 shutdown_connections 2023-07-25T14:37:17.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:17.508+0000 7f46e3527700 1 --2- 172.21.15.72:0/2083662286 >> v2:172.21.15.92:3300/0 conn(0x7f46dc06a6d0 0x7f46dc0c3a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:17.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:17.508+0000 7f46e3527700 1 --2- 172.21.15.72:0/2083662286 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f46dc151950 0x7f46dc06a190 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:17.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:17.508+0000 7f46e3527700 1 --2- 172.21.15.72:0/2083662286 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f46dc0724c0 0x7f46dc0c34c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:17.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:17.508+0000 7f46e3527700 1 -- 172.21.15.72:0/2083662286 >> 172.21.15.72:0/2083662286 conn(0x7f46dc0a87e0 msgr2=0x7f46dc0a8bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:17.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:17.509+0000 7f46e3527700 1 -- 172.21.15.72:0/2083662286 shutdown_connections 2023-07-25T14:37:17.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:17.509+0000 7f46e3527700 1 -- 172.21.15.72:0/2083662286 wait complete. 2023-07-25T14:37:17.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:17.510+0000 7f46e3527700 1 Processor -- start 2023-07-25T14:37:17.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:17.510+0000 7f46e3527700 1 -- start start 2023-07-25T14:37:17.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:17.510+0000 7f46e3527700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f46dc06a6d0 0x7f46dc1ed0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:17.525 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:17.510+0000 7f46e3527700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f46dc0724c0 0x7f46dc0a4af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:17.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:17.510+0000 7f46e3527700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f46dc151950 0x7f46dc0a5030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:17.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:17.510+0000 7f46e3527700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46dc0a5900 con 0x7f46dc0724c0 2023-07-25T14:37:17.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:17.510+0000 7f46e3527700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46dc14b5f0 con 0x7f46dc151950 2023-07-25T14:37:17.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:17.510+0000 7f46e3527700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46dc153f90 con 0x7f46dc06a6d0 2023-07-25T14:37:17.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:17.510+0000 7f46e0ac2700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f46dc0724c0 0x7f46dc0a4af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:17.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:17.511+0000 7f46e12c3700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f46dc06a6d0 0x7f46dc1ed0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:17.526 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:17.510+0000 7f46e0ac2700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f46dc0724c0 0x7f46dc0a4af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42758/0 (socket says 172.21.15.72:42758) 2023-07-25T14:37:17.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:17.511+0000 7f46e0ac2700 1 -- 172.21.15.72:0/3012095470 learned_addr learned my addr 172.21.15.72:0/3012095470 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:37:17.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:17.511+0000 7f46e1ac4700 1 --2- 172.21.15.72:0/3012095470 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f46dc151950 0x7f46dc0a5030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:17.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:17.511+0000 7f46e0ac2700 1 -- 172.21.15.72:0/3012095470 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f46dc06a6d0 msgr2=0x7f46dc1ed0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:17.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:17.511+0000 7f46e0ac2700 1 --2- 172.21.15.72:0/3012095470 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f46dc06a6d0 0x7f46dc1ed0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:17.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:17.511+0000 7f46e0ac2700 1 -- 172.21.15.72:0/3012095470 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f46dc151950 msgr2=0x7f46dc0a5030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:17.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:17.511+0000 7f46e0ac2700 1 --2- 172.21.15.72:0/3012095470 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f46dc151950 0x7f46dc0a5030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:17.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:17.511+0000 7f46e0ac2700 1 -- 172.21.15.72:0/3012095470 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46cc009550 con 0x7f46dc0724c0 2023-07-25T14:37:17.527 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:17.511+0000 7f46e0ac2700 1 --2- 172.21.15.72:0/3012095470 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f46dc0724c0 0x7f46dc0a4af0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f46d800b530 tx=0x7f46d800b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:17.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:17.511+0000 7f46d1ffb700 1 -- 172.21.15.72:0/3012095470 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46d8011830 con 0x7f46dc0724c0 2023-07-25T14:37:17.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:17.511+0000 7f46d1ffb700 1 -- 172.21.15.72:0/3012095470 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46d8011990 con 0x7f46dc0724c0 2023-07-25T14:37:17.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:17.511+0000 7f46e3527700 1 -- 172.21.15.72:0/3012095470 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46dc153cb0 con 0x7f46dc0724c0 2023-07-25T14:37:17.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:17.511+0000 7f46d1ffb700 1 -- 172.21.15.72:0/3012095470 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46d8011d40 con 0x7f46dc0724c0 2023-07-25T14:37:17.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:17.511+0000 7f46e3527700 1 -- 172.21.15.72:0/3012095470 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46dc1ede60 con 0x7f46dc0724c0 2023-07-25T14:37:17.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:17.512+0000 7f46e3527700 1 -- 172.21.15.72:0/3012095470 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46dc0c1880 con 0x7f46dc0724c0 2023-07-25T14:37:17.528 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:17.513+0000 7f46d1ffb700 1 -- 172.21.15.72:0/3012095470 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f46d801a400 con 0x7f46dc0724c0 2023-07-25T14:37:17.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:17.513+0000 7f46d1ffb700 1 --2- 172.21.15.72:0/3012095470 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f46c006ace0 0x7f46c006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:17.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:17.513+0000 7f46d1ffb700 1 -- 172.21.15.72:0/3012095470 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 7238+0+0 (secure 0 0 0) 0x7f46d8089810 con 0x7f46dc0724c0 2023-07-25T14:37:17.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:17.513+0000 7f46e12c3700 1 --2- 172.21.15.72:0/3012095470 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f46c006ace0 0x7f46c006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:17.529 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:17.513+0000 7f46e12c3700 1 --2- 172.21.15.72:0/3012095470 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f46c006ace0 0x7f46c006d1a0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f46cc014040 tx=0x7f46cc008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:17.530 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:17.517+0000 7f46d1ffb700 1 -- 172.21.15.72:0/3012095470 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f46dc0c1880 con 0x7f46dc0724c0 2023-07-25T14:37:17.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:17.706+0000 7f46e3527700 1 -- 172.21.15.72:0/3012095470 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f46dc1eaf40 con 0x7f46dc0724c0 2023-07-25T14:37:17.719 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:17.708+0000 7f46d1ffb700 1 -- 172.21.15.72:0/3012095470 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) v1 ==== 74+0+22106 (secure 0 0 0) 0x7f46dc1eaf40 con 0x7f46dc0724c0 2023-07-25T14:37:17.719 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-25T14:37:17.720 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":43,"fsid":"9170db48-9170-43e8-8ccb-9813e6240906","created":"2023-07-25T14:35:21.733262+0000","modified":"2023-07-25T14:37:04.264643+0000","last_up_change":"2023-07-25T14:35:31.355010+0000","last_in_change":"2023-07-25T14:35:24.195785+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-25T14:35:32.983457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-25T14:35:33.326342+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-07-25T14:36:47.694223+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-07-25T14:36:48.536715+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs2_metadata","create_time":"2023-07-25T14:37:01.238292+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs2_data","create_time":"2023-07-25T14:37:01.609127+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d517fdad-0bfe-49f0-89f2-9421c3761839","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6801","nonce":2475407414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6803","nonce":2475407414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6807","nonce":2475407414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6805","nonce":2475407414}]},"public_addr":"172.21.15.72:6801/2475407414","cluster_addr":"172.21.15.72:6803/2475407414","heartbeat_back_addr":"172.21.15.72:6807/2475407414","heartbeat_front_addr":"172.21.15.72:6805/2475407414","state":["exists","up"]},{"osd":1,"uuid":"e1564be3-f209-47e5-a8d0-32fc618a474f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6822","nonce":870954016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6825","nonce":870954016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6831","nonce":870954016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6827","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6829","nonce":870954016}]},"public_addr":"172.21.15.72:6822/870954016","cluster_addr":"172.21.15.72:6825/870954016","heartbeat_back_addr":"172.21.15.72:6831/870954016","heartbeat_front_addr":"172.21.15.72:6829/870954016","state":["exists","up"]},{"osd":2,"uuid":"c4647d30-ffa6-417a-9026-ef530c75910e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6809","nonce":2143129442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6811","nonce":2143129442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6815","nonce":2143129442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6813","nonce":2143129442}]},"public_addr":"172.21.15.72:6809/2143129442","cluster_addr":"172.21.15.72:6811/2143129442","heartbeat_back_addr":"172.21.15.72:6815/2143129442","heartbeat_front_addr":"172.21.15.72:6813/2143129442","state":["exists","up"]},{"osd":3,"uuid":"76c9d9a7-c2e2-4612-a58b-d6882dd76b58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6817","nonce":3404066311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6819","nonce":3404066311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6828","nonce":3404066311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6821","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6823","nonce":3404066311}]},"public_addr":"172.21.15.72:6817/3404066311","cluster_addr":"172.21.15.72:6819/3404066311","heartbeat_back_addr":"172.21.15.72:6828/3404066311","heartbeat_front_addr":"172.21.15.72:6823/3404066311","state":["exists","up"]},{"osd":4,"uuid":"7f8920dc-0ad4-4a73-ab40-65408f83eadd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6817","nonce":2381008739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6819","nonce":2381008739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6825","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6827","nonce":2381008739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6822","nonce":2381008739}]},"public_addr":"172.21.15.92:6817/2381008739","cluster_addr":"172.21.15.92:6819/2381008739","heartbeat_back_addr":"172.21.15.92:6827/2381008739","heartbeat_front_addr":"172.21.15.92:6822/2381008739","state":["exists","up"]},{"osd":5,"uuid":"56257e7c-31eb-44c5-9ec7-1318a4e0bb35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6801","nonce":2161935604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6803","nonce":2161935604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6807","nonce":2161935604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6805","nonce":2161935604}]},"public_addr":"172.21.15.92:6801/2161935604","cluster_addr":"172.21.15.92:6803/2161935604","heartbeat_back_addr":"172.21.15.92:6807/2161935604","heartbeat_front_addr":"172.21.15.92:6805/2161935604","state":["exists","up"]},{"osd":6,"uuid":"a150d3d8-a0c9-4955-968a-8d98eff4ffb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6809","nonce":3770163493}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6811","nonce":3770163493}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6815","nonce":3770163493}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6813","nonce":3770163493}]},"public_addr":"172.21.15.92:6809/3770163493","cluster_addr":"172.21.15.92:6811/3770163493","heartbeat_back_addr":"172.21.15.92:6815/3770163493","heartbeat_front_addr":"172.21.15.92:6813/3770163493","state":["exists","up"]},{"osd":7,"uuid":"07799c27-54ee-4591-a42d-a978d6b32065","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6821","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6823","nonce":2135777609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6826","nonce":2135777609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6831","nonce":2135777609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6829","nonce":2135777609}]},"public_addr":"172.21.15.92:6823/2135777609","cluster_addr":"172.21.15.92:6826/2135777609","heartbeat_back_addr":"172.21.15.92:6831/2135777609","heartbeat_front_addr":"172.21.15.92:6829/2135777609","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.345365+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.378150+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.146566+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.372172+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:30.398421+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.385632+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.465611+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.443583+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-25T14:37:17.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:17.710+0000 7f46e3527700 1 -- 172.21.15.72:0/3012095470 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f46c006ace0 msgr2=0x7f46c006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:17.722 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:17.710+0000 7f46e3527700 1 --2- 172.21.15.72:0/3012095470 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f46c006ace0 0x7f46c006d1a0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f46cc014040 tx=0x7f46cc008030 comp rx=0 tx=0).stop 2023-07-25T14:37:17.722 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:17.710+0000 7f46e3527700 1 -- 172.21.15.72:0/3012095470 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f46dc0724c0 msgr2=0x7f46dc0a4af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:17.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:17.710+0000 7f46e3527700 1 --2- 172.21.15.72:0/3012095470 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f46dc0724c0 0x7f46dc0a4af0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f46d800b530 tx=0x7f46d800b840 comp rx=0 tx=0).stop 2023-07-25T14:37:17.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:17.710+0000 7f46e3527700 1 -- 172.21.15.72:0/3012095470 shutdown_connections 2023-07-25T14:37:17.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:17.710+0000 7f46e3527700 1 --2- 172.21.15.72:0/3012095470 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f46c006ace0 0x7f46c006d1a0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:17.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:17.710+0000 7f46e3527700 1 --2- 172.21.15.72:0/3012095470 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f46dc06a6d0 0x7f46dc1ed0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:17.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:17.710+0000 7f46e3527700 1 --2- 172.21.15.72:0/3012095470 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f46dc151950 0x7f46dc0a5030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:17.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:17.710+0000 7f46e3527700 1 --2- 172.21.15.72:0/3012095470 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f46dc0724c0 0x7f46dc0a4af0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:17.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:17.710+0000 7f46e3527700 1 -- 172.21.15.72:0/3012095470 >> 172.21.15.72:0/3012095470 conn(0x7f46dc0a87e0 msgr2=0x7f46dc150860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:17.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:17.710+0000 7f46e3527700 1 -- 172.21.15.72:0/3012095470 shutdown_connections 2023-07-25T14:37:17.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:17.710+0000 7f46e3527700 1 -- 172.21.15.72:0/3012095470 wait complete. 2023-07-25T14:37:17.734 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-07-25T14:35:32.983457+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-07-25T14:35:33.326342+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-25T14:36:47.694223+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2023-07-25T14:36:48.536715+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '39', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-07-25T14:37:01.238292+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '42', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs2_data', 'create_time': '2023-07-25T14:37:01.609127+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '43', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-25T14:37:17.735 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-25T14:37:17.858 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:17.847+0000 7f6591b29700 1 Processor -- start 2023-07-25T14:37:17.858 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:17.847+0000 7f6591b29700 1 -- start start 2023-07-25T14:37:17.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:17.848+0000 7f6591b29700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f658c151ba0 0x7f658c0c2230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:17.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:17.848+0000 7f6591b29700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f658c154d50 0x7f658c15b970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:17.860 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:17.848+0000 7f6591b29700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f658c0c54f0 con 0x7f658c0c5f40 2023-07-25T14:37:17.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:17.848+0000 7f6591b29700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f658c0c6670 con 0x7f658c151ba0 2023-07-25T14:37:17.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:17.848+0000 7f6591b29700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f658c0c5740 con 0x7f658c154d50 2023-07-25T14:37:17.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:17.848+0000 7f658b7fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f658c151ba0 0x7f658c0c2230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:17.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:17.848+0000 7f658b7fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f658c151ba0 0x7f658c0c2230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42764/0 (socket says 172.21.15.72:42764) 2023-07-25T14:37:17.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:17.848+0000 7f658b7fe700 1 -- 172.21.15.72:0/2964250974 learned_addr learned my addr 172.21.15.72:0/2964250974 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:37:17.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:17.848+0000 7f658b7fe700 1 -- 172.21.15.72:0/2964250974 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f658c154d50 msgr2=0x7f658c15b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:17.861 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:17.848+0000 7f658bfff700 1 --2- 172.21.15.72:0/2964250974 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f658c154d50 0x7f658c15b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:17.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:17.848+0000 7f658b7fe700 1 --2- 172.21.15.72:0/2964250974 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f658c154d50 0x7f658c15b970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:17.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:17.848+0000 7f658b7fe700 1 -- 172.21.15.72:0/2964250974 >> v1:172.21.15.92:6789/0 conn(0x7f658c0c5f40 legacy=0x7f658c154640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:17.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:17.848+0000 7f658b7fe700 1 -- 172.21.15.72:0/2964250974 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f658c0c5a20 con 0x7f658c151ba0 2023-07-25T14:37:17.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:17.848+0000 7f658bfff700 1 --2- 172.21.15.72:0/2964250974 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f658c154d50 0x7f658c15b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-25T14:37:17.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:17.848+0000 7f658b7fe700 1 --2- 172.21.15.72:0/2964250974 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f658c151ba0 0x7f658c0c2230 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f658000bb90 tx=0x7f658000bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ec11e78566c322f server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:17.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:17.848+0000 7f658a7fc700 1 -- 172.21.15.72:0/2964250974 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f658000dd50 con 0x7f658c151ba0 2023-07-25T14:37:17.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:17.848+0000 7f658a7fc700 1 -- 172.21.15.72:0/2964250974 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6580010470 con 0x7f658c151ba0 2023-07-25T14:37:17.862 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:17.849+0000 7f658a7fc700 1 -- 172.21.15.72:0/2964250974 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6580010800 con 0x7f658c151ba0 2023-07-25T14:37:17.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:17.849+0000 7f6591b29700 1 -- 172.21.15.72:0/2964250974 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f658c151ba0 msgr2=0x7f658c0c2230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:17.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:17.849+0000 7f6591b29700 1 --2- 172.21.15.72:0/2964250974 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f658c151ba0 0x7f658c0c2230 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f658000bb90 tx=0x7f658000bea0 comp rx=0 tx=0).stop 2023-07-25T14:37:17.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:17.849+0000 7f6591b29700 1 -- 172.21.15.72:0/2964250974 shutdown_connections 2023-07-25T14:37:17.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:17.849+0000 7f6591b29700 1 --2- 172.21.15.72:0/2964250974 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f658c154d50 0x7f658c15b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:17.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:17.849+0000 7f6591b29700 1 --2- 172.21.15.72:0/2964250974 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f658c151ba0 0x7f658c0c2230 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:17.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:17.849+0000 7f6591b29700 1 -- 172.21.15.72:0/2964250974 >> 172.21.15.72:0/2964250974 conn(0x7f658c0a87e0 msgr2=0x7f658c0a8bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:17.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:17.849+0000 7f6591b29700 1 -- 172.21.15.72:0/2964250974 shutdown_connections 2023-07-25T14:37:17.863 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:17.849+0000 7f6591b29700 1 -- 172.21.15.72:0/2964250974 wait complete. 2023-07-25T14:37:17.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:17.850+0000 7f6591b29700 1 Processor -- start 2023-07-25T14:37:17.865 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:17.850+0000 7f6591b29700 1 -- start start 2023-07-25T14:37:17.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:17.851+0000 7f6591b29700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f658c0c5f40 0x7f658c0bccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:17.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:17.851+0000 7f6591b29700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f658c151ba0 0x7f658c14cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:17.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:17.851+0000 7f6591b29700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f658c14d0e0 0x7f658c0ab5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:17.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:17.851+0000 7f6591b29700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f658c1ed600 con 0x7f658c14d0e0 2023-07-25T14:37:17.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:17.851+0000 7f6591b29700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f658c1ed320 con 0x7f658c0c5f40 2023-07-25T14:37:17.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:17.851+0000 7f6591b29700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f658c0aa800 con 0x7f658c151ba0 2023-07-25T14:37:17.866 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:17.851+0000 7f658bfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f658c14d0e0 0x7f658c0ab5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:17.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:17.851+0000 7f658bfff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f658c14d0e0 0x7f658c0ab5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42774/0 (socket says 172.21.15.72:42774) 2023-07-25T14:37:17.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:17.851+0000 7f658bfff700 1 -- 172.21.15.72:0/907963162 learned_addr learned my addr 172.21.15.72:0/907963162 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:37:17.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:17.851+0000 7f658b7fe700 1 --2- 172.21.15.72:0/907963162 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f658c0c5f40 0x7f658c0bccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:17.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:17.851+0000 7f658affd700 1 --2- 172.21.15.72:0/907963162 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f658c151ba0 0x7f658c14cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:17.867 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:17.851+0000 7f658bfff700 1 -- 172.21.15.72:0/907963162 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f658c151ba0 msgr2=0x7f658c14cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:17.868 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:17.851+0000 7f658bfff700 1 --2- 172.21.15.72:0/907963162 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f658c151ba0 0x7f658c14cba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:17.868 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:17.851+0000 7f658bfff700 1 -- 172.21.15.72:0/907963162 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f658c0c5f40 msgr2=0x7f658c0bccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:17.868 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:17.851+0000 7f658bfff700 1 --2- 172.21.15.72:0/907963162 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f658c0c5f40 0x7f658c0bccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:17.868 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:17.851+0000 7f658bfff700 1 -- 172.21.15.72:0/907963162 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f658000b7f0 con 0x7f658c14d0e0 2023-07-25T14:37:17.868 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:17.852+0000 7f658bfff700 1 --2- 172.21.15.72:0/907963162 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f658c14d0e0 0x7f658c0ab5c0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f657c00c7f0 tx=0x7f657c00cb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:17.868 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:17.852+0000 7f6573fff700 1 -- 172.21.15.72:0/907963162 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f657c004220 con 0x7f658c14d0e0 2023-07-25T14:37:17.868 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:17.852+0000 7f6573fff700 1 -- 172.21.15.72:0/907963162 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f657c0043a0 con 0x7f658c14d0e0 2023-07-25T14:37:17.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:17.852+0000 7f6591b29700 1 -- 172.21.15.72:0/907963162 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f658c0aaae0 con 0x7f658c14d0e0 2023-07-25T14:37:17.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:17.852+0000 7f6573fff700 1 -- 172.21.15.72:0/907963162 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f657c0038e0 con 0x7f658c14d0e0 2023-07-25T14:37:17.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:17.852+0000 7f6591b29700 1 -- 172.21.15.72:0/907963162 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f658c0ab0a0 con 0x7f658c14d0e0 2023-07-25T14:37:17.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:17.853+0000 7f6591b29700 1 -- 172.21.15.72:0/907963162 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f658c04e470 con 0x7f658c14d0e0 2023-07-25T14:37:17.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:17.853+0000 7f6573fff700 1 -- 172.21.15.72:0/907963162 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f657c003a40 con 0x7f658c14d0e0 2023-07-25T14:37:17.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:17.854+0000 7f6573fff700 1 --2- 172.21.15.72:0/907963162 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f657806ad10 0x7f657806d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:17.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:17.854+0000 7f6573fff700 1 -- 172.21.15.72:0/907963162 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 7238+0+0 (secure 0 0 0) 0x7f657c089710 con 0x7f658c14d0e0 2023-07-25T14:37:17.869 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:17.854+0000 7f658b7fe700 1 --2- 172.21.15.72:0/907963162 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f657806ad10 0x7f657806d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:17.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:17.854+0000 7f658b7fe700 1 --2- 172.21.15.72:0/907963162 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f657806ad10 0x7f657806d1d0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f658000bee0 tx=0x7f6580013000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:17.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:17.858+0000 7f6573fff700 1 -- 172.21.15.72:0/907963162 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f657c054320 con 0x7f658c14d0e0 2023-07-25T14:37:18.055 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.044+0000 7f6591b29700 1 -- 172.21.15.72:0/907963162 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f658c0c52d0 con 0x7f658c14d0e0 2023-07-25T14:37:18.056 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.044+0000 7f6573fff700 1 -- 172.21.15.72:0/907963162 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v43) v1 ==== 92+0+10 (secure 0 0 0) 0x7f657c057940 con 0x7f658c14d0e0 2023-07-25T14:37:18.056 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 8 2023-07-25T14:37:18.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.046+0000 7f6591b29700 1 -- 172.21.15.72:0/907963162 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f657806ad10 msgr2=0x7f657806d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:18.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.046+0000 7f6591b29700 1 --2- 172.21.15.72:0/907963162 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f657806ad10 0x7f657806d1d0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f658000bee0 tx=0x7f6580013000 comp rx=0 tx=0).stop 2023-07-25T14:37:18.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.047+0000 7f6591b29700 1 -- 172.21.15.72:0/907963162 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f658c14d0e0 msgr2=0x7f658c0ab5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:18.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.047+0000 7f6591b29700 1 --2- 172.21.15.72:0/907963162 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f658c14d0e0 0x7f658c0ab5c0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f657c00c7f0 tx=0x7f657c00cb00 comp rx=0 tx=0).stop 2023-07-25T14:37:18.058 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.047+0000 7f6591b29700 1 -- 172.21.15.72:0/907963162 shutdown_connections 2023-07-25T14:37:18.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.047+0000 7f6591b29700 1 --2- 172.21.15.72:0/907963162 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f657806ad10 0x7f657806d1d0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:18.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.047+0000 7f6591b29700 1 --2- 172.21.15.72:0/907963162 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f658c14d0e0 0x7f658c0ab5c0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:18.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.047+0000 7f6591b29700 1 --2- 172.21.15.72:0/907963162 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f658c0c5f40 0x7f658c0bccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:18.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.047+0000 7f6591b29700 1 --2- 172.21.15.72:0/907963162 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f658c151ba0 0x7f658c14cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:18.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.047+0000 7f6591b29700 1 -- 172.21.15.72:0/907963162 >> 172.21.15.72:0/907963162 conn(0x7f658c0a87e0 msgr2=0x7f658c0c4600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:18.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.047+0000 7f6591b29700 1 -- 172.21.15.72:0/907963162 shutdown_connections 2023-07-25T14:37:18.059 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.047+0000 7f6591b29700 1 -- 172.21.15.72:0/907963162 wait complete. 2023-07-25T14:37:18.070 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-25T14:37:18.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.181+0000 7f6f708f3700 1 Processor -- start 2023-07-25T14:37:18.192 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.181+0000 7f6f708f3700 1 -- start start 2023-07-25T14:37:18.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.182+0000 7f6f708f3700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f6f6c0bead0 0x7f6f6c0c0350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:18.193 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.182+0000 7f6f708f3700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6f6c0c0890 0x7f6f6c0c44d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:18.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.182+0000 7f6f708f3700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f6c0bfeb0 con 0x7f6f6c151a90 2023-07-25T14:37:18.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.182+0000 7f6f708f3700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f6c0c10b0 con 0x7f6f6c0bead0 2023-07-25T14:37:18.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.182+0000 7f6f708f3700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f6c0c1940 con 0x7f6f6c0c0890 2023-07-25T14:37:18.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.182+0000 7f6f6ad9d700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6f6c0c0890 0x7f6f6c0c44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:18.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.182+0000 7f6f69d9b700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f6f6c0bead0 0x7f6f6c0c0350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:18.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.182+0000 7f6f6a59c700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f6f6c151a90 0x7f6f6c154d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.72:57088/0 (socket says 172.21.15.72:57088) 2023-07-25T14:37:18.194 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.182+0000 7f6f6a59c700 1 -- 172.21.15.72:0/3544215586 learned_addr learned my addr 172.21.15.72:0/3544215586 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:37:18.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.183+0000 7f6f6ad9d700 1 -- 172.21.15.72:0/3544215586 >> v2:172.21.15.92:3300/0 conn(0x7f6f6c0bead0 msgr2=0x7f6f6c0c0350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:18.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.183+0000 7f6f6ad9d700 1 --2- 172.21.15.72:0/3544215586 >> v2:172.21.15.92:3300/0 conn(0x7f6f6c0bead0 0x7f6f6c0c0350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:18.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.183+0000 7f6f6ad9d700 1 -- 172.21.15.72:0/3544215586 >> v1:172.21.15.92:6789/0 conn(0x7f6f6c151a90 legacy=0x7f6f6c154d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:18.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.183+0000 7f6f6959a700 1 -- 172.21.15.72:0/3544215586 <== mon.1 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1336760813 0 0) 0x7f6f6c0bfeb0 con 0x7f6f6c151a90 2023-07-25T14:37:18.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.183+0000 7f6f6ad9d700 1 -- 172.21.15.72:0/3544215586 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f6c0bf2e0 con 0x7f6f6c0c0890 2023-07-25T14:37:18.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.183+0000 7f6f69d9b700 1 --2- 172.21.15.72:0/3544215586 >> v2:172.21.15.92:3300/0 conn(0x7f6f6c0bead0 0x7f6f6c0c0350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-25T14:37:18.196 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.183+0000 7f6f6ad9d700 1 --2- 172.21.15.72:0/3544215586 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6f6c0c0890 0x7f6f6c0c44d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f6f64009d90 tx=0x7f6f6400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bd3a6c8a18710ed4 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:18.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.183+0000 7f6f6959a700 1 -- 172.21.15.72:0/3544215586 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f6400e070 con 0x7f6f6c0c0890 2023-07-25T14:37:18.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.183+0000 7f6f6959a700 1 -- 172.21.15.72:0/3544215586 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f6400bb20 con 0x7f6f6c0c0890 2023-07-25T14:37:18.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.183+0000 7f6f6959a700 1 -- 172.21.15.72:0/3544215586 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f64012430 con 0x7f6f6c0c0890 2023-07-25T14:37:18.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.183+0000 7f6f708f3700 1 -- 172.21.15.72:0/3544215586 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6f6c0c0890 msgr2=0x7f6f6c0c44d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:18.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.183+0000 7f6f708f3700 1 --2- 172.21.15.72:0/3544215586 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6f6c0c0890 0x7f6f6c0c44d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f6f64009d90 tx=0x7f6f6400b330 comp rx=0 tx=0).stop 2023-07-25T14:37:18.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.184+0000 7f6f708f3700 1 -- 172.21.15.72:0/3544215586 shutdown_connections 2023-07-25T14:37:18.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.184+0000 7f6f708f3700 1 --2- 172.21.15.72:0/3544215586 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6f6c0c0890 0x7f6f6c0c44d0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:18.197 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.184+0000 7f6f708f3700 1 --2- 172.21.15.72:0/3544215586 >> v2:172.21.15.92:3300/0 conn(0x7f6f6c0bead0 0x7f6f6c0c0350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:18.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.184+0000 7f6f708f3700 1 -- 172.21.15.72:0/3544215586 >> 172.21.15.72:0/3544215586 conn(0x7f6f6c06c3a0 msgr2=0x7f6f6c06c780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:18.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.184+0000 7f6f708f3700 1 -- 172.21.15.72:0/3544215586 shutdown_connections 2023-07-25T14:37:18.198 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.184+0000 7f6f708f3700 1 -- 172.21.15.72:0/3544215586 wait complete. 2023-07-25T14:37:18.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.185+0000 7f6f708f3700 1 Processor -- start 2023-07-25T14:37:18.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.185+0000 7f6f708f3700 1 -- start start 2023-07-25T14:37:18.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.186+0000 7f6f708f3700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6f6c0bead0 0x7f6f6c1eaf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:18.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.186+0000 7f6f708f3700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6f6c0c0890 0x7f6f6c1eda10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:18.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.186+0000 7f6f708f3700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6f6c151a90 0x7f6f6c149320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:18.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.186+0000 7f6f708f3700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f6c1e9ed0 con 0x7f6f6c151a90 2023-07-25T14:37:18.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.186+0000 7f6f708f3700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f6c1edf50 con 0x7f6f6c0c0890 2023-07-25T14:37:18.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.186+0000 7f6f708f3700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f6c151220 con 0x7f6f6c0bead0 2023-07-25T14:37:18.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.186+0000 7f6f6ad9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6f6c151a90 0x7f6f6c149320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:18.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.186+0000 7f6f6ad9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6f6c151a90 0x7f6f6c149320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42788/0 (socket says 172.21.15.72:42788) 2023-07-25T14:37:18.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.186+0000 7f6f6ad9d700 1 -- 172.21.15.72:0/1023340280 learned_addr learned my addr 172.21.15.72:0/1023340280 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:37:18.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.186+0000 7f6f6a59c700 1 --2- 172.21.15.72:0/1023340280 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6f6c0bead0 0x7f6f6c1eaf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:18.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.186+0000 7f6f69d9b700 1 --2- 172.21.15.72:0/1023340280 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6f6c0c0890 0x7f6f6c1eda10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:18.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.186+0000 7f6f6ad9d700 1 -- 172.21.15.72:0/1023340280 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6f6c0bead0 msgr2=0x7f6f6c1eaf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:18.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.186+0000 7f6f6ad9d700 1 --2- 172.21.15.72:0/1023340280 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6f6c0bead0 0x7f6f6c1eaf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:18.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.186+0000 7f6f6ad9d700 1 -- 172.21.15.72:0/1023340280 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6f6c0c0890 msgr2=0x7f6f6c1eda10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:18.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.186+0000 7f6f6ad9d700 1 --2- 172.21.15.72:0/1023340280 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6f6c0c0890 0x7f6f6c1eda10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:18.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.186+0000 7f6f6ad9d700 1 -- 172.21.15.72:0/1023340280 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f5c0094a0 con 0x7f6f6c151a90 2023-07-25T14:37:18.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.186+0000 7f6f6ad9d700 1 --2- 172.21.15.72:0/1023340280 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6f6c151a90 0x7f6f6c149320 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f6f6c06b490 tx=0x7f6f64004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:18.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.186+0000 7f6f5affd700 1 -- 172.21.15.72:0/1023340280 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f64012430 con 0x7f6f6c151a90 2023-07-25T14:37:18.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.186+0000 7f6f5affd700 1 -- 172.21.15.72:0/1023340280 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f64020070 con 0x7f6f6c151a90 2023-07-25T14:37:18.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.186+0000 7f6f708f3700 1 -- 172.21.15.72:0/1023340280 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f64009a70 con 0x7f6f6c151a90 2023-07-25T14:37:18.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.186+0000 7f6f5affd700 1 -- 172.21.15.72:0/1023340280 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f64004280 con 0x7f6f6c151a90 2023-07-25T14:37:18.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.187+0000 7f6f708f3700 1 -- 172.21.15.72:0/1023340280 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f6c150f40 con 0x7f6f6c151a90 2023-07-25T14:37:18.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.187+0000 7f6f708f3700 1 -- 172.21.15.72:0/1023340280 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f6c1ea040 con 0x7f6f6c151a90 2023-07-25T14:37:18.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.188+0000 7f6f5affd700 1 -- 172.21.15.72:0/1023340280 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6f640043e0 con 0x7f6f6c151a90 2023-07-25T14:37:18.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.188+0000 7f6f5affd700 1 --2- 172.21.15.72:0/1023340280 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f6f4c06ace0 0x7f6f4c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:18.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.188+0000 7f6f6a59c700 1 --2- 172.21.15.72:0/1023340280 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f6f4c06ace0 0x7f6f4c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:18.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.188+0000 7f6f5affd700 1 -- 172.21.15.72:0/1023340280 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 7238+0+0 (secure 0 0 0) 0x7f6f64022070 con 0x7f6f6c151a90 2023-07-25T14:37:18.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.189+0000 7f6f6a59c700 1 --2- 172.21.15.72:0/1023340280 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f6f4c06ace0 0x7f6f4c06d1a0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f6f60007fd0 tx=0x7f6f60007de0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:18.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.193+0000 7f6f5affd700 1 -- 172.21.15.72:0/1023340280 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f6f64056360 con 0x7f6f6c151a90 2023-07-25T14:37:18.393 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.382+0000 7f6f708f3700 1 -- 172.21.15.72:0/1023340280 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6f6c04e470 con 0x7f6f6c151a90 2023-07-25T14:37:18.394 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.383+0000 7f6f5affd700 1 -- 172.21.15.72:0/1023340280 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v43) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6f6402f340 con 0x7f6f6c151a90 2023-07-25T14:37:18.394 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 1 2023-07-25T14:37:18.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.385+0000 7f6f708f3700 1 -- 172.21.15.72:0/1023340280 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f6f4c06ace0 msgr2=0x7f6f4c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:18.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.385+0000 7f6f708f3700 1 --2- 172.21.15.72:0/1023340280 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f6f4c06ace0 0x7f6f4c06d1a0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f6f60007fd0 tx=0x7f6f60007de0 comp rx=0 tx=0).stop 2023-07-25T14:37:18.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.385+0000 7f6f708f3700 1 -- 172.21.15.72:0/1023340280 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6f6c151a90 msgr2=0x7f6f6c149320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:18.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.385+0000 7f6f708f3700 1 --2- 172.21.15.72:0/1023340280 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6f6c151a90 0x7f6f6c149320 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f6f6c06b490 tx=0x7f6f64004ad0 comp rx=0 tx=0).stop 2023-07-25T14:37:18.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.385+0000 7f6f708f3700 1 -- 172.21.15.72:0/1023340280 shutdown_connections 2023-07-25T14:37:18.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.385+0000 7f6f708f3700 1 --2- 172.21.15.72:0/1023340280 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f6f4c06ace0 0x7f6f4c06d1a0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:18.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.385+0000 7f6f708f3700 1 --2- 172.21.15.72:0/1023340280 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6f6c0bead0 0x7f6f6c1eaf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:18.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.385+0000 7f6f708f3700 1 --2- 172.21.15.72:0/1023340280 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6f6c151a90 0x7f6f6c149320 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:18.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.385+0000 7f6f708f3700 1 --2- 172.21.15.72:0/1023340280 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6f6c0c0890 0x7f6f6c1eda10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:18.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.385+0000 7f6f708f3700 1 -- 172.21.15.72:0/1023340280 >> 172.21.15.72:0/1023340280 conn(0x7f6f6c06c3a0 msgr2=0x7f6f6c152130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:18.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.385+0000 7f6f708f3700 1 -- 172.21.15.72:0/1023340280 shutdown_connections 2023-07-25T14:37:18.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.385+0000 7f6f708f3700 1 -- 172.21.15.72:0/1023340280 wait complete. 2023-07-25T14:37:18.408 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-25T14:37:18.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.521+0000 7f875fbde700 1 Processor -- start 2023-07-25T14:37:18.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.521+0000 7f875fbde700 1 -- start start 2023-07-25T14:37:18.536 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.522+0000 7f875fbde700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f87580a9cc0 0x7f87581525e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:18.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.522+0000 7f875fbde700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87580c5890 con 0x7f875814f810 2023-07-25T14:37:18.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.522+0000 7f875fbde700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8758152150 con 0x7f87580bb0b0 2023-07-25T14:37:18.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.522+0000 7f875fbde700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f875814fbf0 con 0x7f87580a9cc0 2023-07-25T14:37:18.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.522+0000 7f875d179700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f87580a9cc0 0x7f87581525e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:18.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.522+0000 7f875d97a700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f875814f810 0x7f87580c4370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:33528/0 (socket says 172.21.15.72:33528) 2023-07-25T14:37:18.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.522+0000 7f875d97a700 1 -- 172.21.15.72:0/628152422 learned_addr learned my addr 172.21.15.72:0/628152422 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:37:18.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.522+0000 7f875d179700 1 -- 172.21.15.72:0/628152422 >> v1:172.21.15.92:6789/0 conn(0x7f87580bb0b0 legacy=0x7f8758152b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:18.538 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.522+0000 7f875d179700 1 -- 172.21.15.72:0/628152422 >> v1:172.21.15.72:6789/0 conn(0x7f875814f810 legacy=0x7f87580c4370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:18.538 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.522+0000 7f875d179700 1 -- 172.21.15.72:0/628152422 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87581566a0 con 0x7f87580a9cc0 2023-07-25T14:37:18.538 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.523+0000 7f875d179700 1 --2- 172.21.15.72:0/628152422 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f87580a9cc0 0x7f87581525e0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f8754009840 tx=0x7f8754009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a297d0422f76ad0c server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:18.538 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.523+0000 7f875c978700 1 -- 172.21.15.72:0/628152422 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8754004230 con 0x7f87580a9cc0 2023-07-25T14:37:18.538 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.523+0000 7f875c978700 1 -- 172.21.15.72:0/628152422 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8754004390 con 0x7f87580a9cc0 2023-07-25T14:37:18.538 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.523+0000 7f875c978700 1 -- 172.21.15.72:0/628152422 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87540036a0 con 0x7f87580a9cc0 2023-07-25T14:37:18.538 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.523+0000 7f875fbde700 1 -- 172.21.15.72:0/628152422 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f87580a9cc0 msgr2=0x7f87581525e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:18.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.523+0000 7f875fbde700 1 --2- 172.21.15.72:0/628152422 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f87580a9cc0 0x7f87581525e0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f8754009840 tx=0x7f8754009b50 comp rx=0 tx=0).stop 2023-07-25T14:37:18.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.523+0000 7f875fbde700 1 -- 172.21.15.72:0/628152422 shutdown_connections 2023-07-25T14:37:18.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.523+0000 7f875fbde700 1 --2- 172.21.15.72:0/628152422 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f87580a9cc0 0x7f87581525e0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:18.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.523+0000 7f875fbde700 1 -- 172.21.15.72:0/628152422 >> 172.21.15.72:0/628152422 conn(0x7f875806a8d0 msgr2=0x7f87580a94e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:18.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.523+0000 7f875fbde700 1 -- 172.21.15.72:0/628152422 shutdown_connections 2023-07-25T14:37:18.539 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.523+0000 7f875fbde700 1 -- 172.21.15.72:0/628152422 wait complete. 2023-07-25T14:37:18.541 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.525+0000 7f875fbde700 1 Processor -- start 2023-07-25T14:37:18.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.525+0000 7f875fbde700 1 -- start start 2023-07-25T14:37:18.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.526+0000 7f875fbde700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f87580a9cc0 0x7f87580a69f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:18.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.526+0000 7f875fbde700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f87580bb0b0 0x7f87580a8f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:18.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.526+0000 7f875fbde700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f875814f810 0x7f87580a5d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:18.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.526+0000 7f875fbde700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87580bead0 con 0x7f87580a9cc0 2023-07-25T14:37:18.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.526+0000 7f875fbde700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87580c0730 con 0x7f87580bb0b0 2023-07-25T14:37:18.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.526+0000 7f875fbde700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8758155110 con 0x7f875814f810 2023-07-25T14:37:18.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.526+0000 7f875d97a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f87580a9cc0 0x7f87580a69f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:18.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.526+0000 7f875d97a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f87580a9cc0 0x7f87580a69f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42798/0 (socket says 172.21.15.72:42798) 2023-07-25T14:37:18.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.526+0000 7f875d97a700 1 -- 172.21.15.72:0/837585826 learned_addr learned my addr 172.21.15.72:0/837585826 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:37:18.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.526+0000 7f875d97a700 1 -- 172.21.15.72:0/837585826 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f875814f810 msgr2=0x7f87580a5d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:18.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.526+0000 7f875d97a700 1 --2- 172.21.15.72:0/837585826 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f875814f810 0x7f87580a5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:18.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.526+0000 7f875d97a700 1 -- 172.21.15.72:0/837585826 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f87580bb0b0 msgr2=0x7f87580a8f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:18.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.526+0000 7f875d97a700 1 --2- 172.21.15.72:0/837585826 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f87580bb0b0 0x7f87580a8f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:18.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.526+0000 7f875d97a700 1 -- 172.21.15.72:0/837585826 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87540094a0 con 0x7f87580a9cc0 2023-07-25T14:37:18.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.526+0000 7f875d97a700 1 --2- 172.21.15.72:0/837585826 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f87580a9cc0 0x7f87580a69f0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f874800c520 tx=0x7f874800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:18.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.526+0000 7f874e7fc700 1 -- 172.21.15.72:0/837585826 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8748005d70 con 0x7f87580a9cc0 2023-07-25T14:37:18.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.526+0000 7f874e7fc700 1 -- 172.21.15.72:0/837585826 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87480070d0 con 0x7f87580a9cc0 2023-07-25T14:37:18.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.526+0000 7f875fbde700 1 -- 172.21.15.72:0/837585826 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87581e8870 con 0x7f87580a9cc0 2023-07-25T14:37:18.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.526+0000 7f874e7fc700 1 -- 172.21.15.72:0/837585826 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8748007440 con 0x7f87580a9cc0 2023-07-25T14:37:18.544 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.527+0000 7f875fbde700 1 -- 172.21.15.72:0/837585826 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87581553b0 con 0x7f87580a9cc0 2023-07-25T14:37:18.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.527+0000 7f875fbde700 1 -- 172.21.15.72:0/837585826 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87580bec10 con 0x7f87580a9cc0 2023-07-25T14:37:18.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.528+0000 7f874e7fc700 1 -- 172.21.15.72:0/837585826 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f87480075a0 con 0x7f87580a9cc0 2023-07-25T14:37:18.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.528+0000 7f874e7fc700 1 --2- 172.21.15.72:0/837585826 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f873c06ace0 0x7f873c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:18.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.528+0000 7f874e7fc700 1 -- 172.21.15.72:0/837585826 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 7238+0+0 (secure 0 0 0) 0x7f8748088d30 con 0x7f87580a9cc0 2023-07-25T14:37:18.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.528+0000 7f875d179700 1 --2- 172.21.15.72:0/837585826 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f873c06ace0 0x7f873c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:18.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.529+0000 7f875d179700 1 --2- 172.21.15.72:0/837585826 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f873c06ace0 0x7f873c06d1a0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f87580be9c0 tx=0x7f8754013040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:18.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.532+0000 7f874e7fc700 1 -- 172.21.15.72:0/837585826 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f87580bec10 con 0x7f87580a9cc0 2023-07-25T14:37:18.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.720+0000 7f875fbde700 1 -- 172.21.15.72:0/837585826 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f875804e470 con 0x7f87580a9cc0 2023-07-25T14:37:18.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.720+0000 7f874e7fc700 1 -- 172.21.15.72:0/837585826 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v43) v1 ==== 104+0+11 (secure 0 0 0) 0x7f87480539f0 con 0x7f87580a9cc0 2023-07-25T14:37:18.732 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2023-07-25T14:37:18.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.722+0000 7f875fbde700 1 -- 172.21.15.72:0/837585826 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f873c06ace0 msgr2=0x7f873c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:18.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.722+0000 7f875fbde700 1 --2- 172.21.15.72:0/837585826 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f873c06ace0 0x7f873c06d1a0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f87580be9c0 tx=0x7f8754013040 comp rx=0 tx=0).stop 2023-07-25T14:37:18.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.722+0000 7f875fbde700 1 -- 172.21.15.72:0/837585826 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f87580a9cc0 msgr2=0x7f87580a69f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:18.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.722+0000 7f875fbde700 1 --2- 172.21.15.72:0/837585826 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f87580a9cc0 0x7f87580a69f0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f874800c520 tx=0x7f874800c8e0 comp rx=0 tx=0).stop 2023-07-25T14:37:18.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.722+0000 7f875fbde700 1 -- 172.21.15.72:0/837585826 shutdown_connections 2023-07-25T14:37:18.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.722+0000 7f875fbde700 1 --2- 172.21.15.72:0/837585826 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f873c06ace0 0x7f873c06d1a0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:18.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.722+0000 7f875fbde700 1 --2- 172.21.15.72:0/837585826 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f875814f810 0x7f87580a5d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:18.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.722+0000 7f875fbde700 1 --2- 172.21.15.72:0/837585826 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f87580a9cc0 0x7f87580a69f0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:18.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.722+0000 7f875fbde700 1 --2- 172.21.15.72:0/837585826 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f87580bb0b0 0x7f87580a8f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:18.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.722+0000 7f875fbde700 1 -- 172.21.15.72:0/837585826 >> 172.21.15.72:0/837585826 conn(0x7f875806a8d0 msgr2=0x7f87580c67d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:18.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.722+0000 7f875fbde700 1 -- 172.21.15.72:0/837585826 shutdown_connections 2023-07-25T14:37:18.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.722+0000 7f875fbde700 1 -- 172.21.15.72:0/837585826 wait complete. 2023-07-25T14:37:18.745 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-25T14:37:18.868 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.856+0000 7fc509f62700 1 Processor -- start 2023-07-25T14:37:18.868 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.856+0000 7fc509f62700 1 -- start start 2023-07-25T14:37:18.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.857+0000 7fc509f62700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fc5040724c0 0x7fc5040c34c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:18.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.857+0000 7fc509f62700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc5040c4930 0x7fc5040c3a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:18.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.857+0000 7fc509f62700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5040c2fe0 con 0x7fc504151950 2023-07-25T14:37:18.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.857+0000 7fc509f62700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc504071a60 con 0x7fc5040724c0 2023-07-25T14:37:18.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.857+0000 7fc509f62700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5040c2a70 con 0x7fc5040c4930 2023-07-25T14:37:18.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.857+0000 7fc503fff700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc5040c4930 0x7fc5040c3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:18.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.857+0000 7fc502ffd700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fc5040724c0 0x7fc5040c34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:18.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.857+0000 7fc502ffd700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fc5040724c0 0x7fc5040c34c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.72:38378/0 (socket says 172.21.15.72:38378) 2023-07-25T14:37:18.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.857+0000 7fc502ffd700 1 -- 172.21.15.72:0/1047285754 learned_addr learned my addr 172.21.15.72:0/1047285754 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:37:18.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.857+0000 7fc5037fe700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7fc504151950 0x7fc50406a190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.72:57114/0 (socket says 172.21.15.72:57114) 2023-07-25T14:37:18.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.857+0000 7fc503fff700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc5040c4930 0x7fc5040c3a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3301/0 says I am v2:172.21.15.72:48036/0 (socket says 172.21.15.72:48036) 2023-07-25T14:37:18.872 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.858+0000 7fc502ffd700 1 -- 172.21.15.72:0/1047285754 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc5040c4930 msgr2=0x7fc5040c3a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:18.872 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.858+0000 7fc502ffd700 1 --2- 172.21.15.72:0/1047285754 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc5040c4930 0x7fc5040c3a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:18.872 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.858+0000 7fc502ffd700 1 -- 172.21.15.72:0/1047285754 >> v1:172.21.15.92:6789/0 conn(0x7fc504151950 legacy=0x7fc50406a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:18.872 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.858+0000 7fc502ffd700 1 -- 172.21.15.72:0/1047285754 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc504155070 con 0x7fc5040724c0 2023-07-25T14:37:18.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.858+0000 7fc503fff700 1 --2- 172.21.15.72:0/1047285754 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc5040c4930 0x7fc5040c3a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-25T14:37:18.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.858+0000 7fc502ffd700 1 --2- 172.21.15.72:0/1047285754 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc5040724c0 0x7fc5040c34c0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fc4f40098f0 tx=0x7fc4f4009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d72783f9e9f88173 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:18.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.858+0000 7fc5027fc700 1 -- 172.21.15.72:0/1047285754 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4f4011830 con 0x7fc5040724c0 2023-07-25T14:37:18.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.858+0000 7fc5027fc700 1 -- 172.21.15.72:0/1047285754 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4f4011990 con 0x7fc5040724c0 2023-07-25T14:37:18.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.858+0000 7fc5027fc700 1 -- 172.21.15.72:0/1047285754 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4f4011d20 con 0x7fc5040724c0 2023-07-25T14:37:18.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.859+0000 7fc509f62700 1 -- 172.21.15.72:0/1047285754 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc5040724c0 msgr2=0x7fc5040c34c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:18.874 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.859+0000 7fc509f62700 1 --2- 172.21.15.72:0/1047285754 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc5040724c0 0x7fc5040c34c0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fc4f40098f0 tx=0x7fc4f4009c00 comp rx=0 tx=0).stop 2023-07-25T14:37:18.874 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.859+0000 7fc509f62700 1 -- 172.21.15.72:0/1047285754 shutdown_connections 2023-07-25T14:37:18.874 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.859+0000 7fc509f62700 1 --2- 172.21.15.72:0/1047285754 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc5040c4930 0x7fc5040c3a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:18.874 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.859+0000 7fc509f62700 1 --2- 172.21.15.72:0/1047285754 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc5040724c0 0x7fc5040c34c0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:18.874 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.859+0000 7fc509f62700 1 -- 172.21.15.72:0/1047285754 >> 172.21.15.72:0/1047285754 conn(0x7fc5040a87e0 msgr2=0x7fc5040a8bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:18.875 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.859+0000 7fc509f62700 1 -- 172.21.15.72:0/1047285754 shutdown_connections 2023-07-25T14:37:18.875 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.859+0000 7fc509f62700 1 -- 172.21.15.72:0/1047285754 wait complete. 2023-07-25T14:37:18.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.860+0000 7fc509f62700 1 Processor -- start 2023-07-25T14:37:18.877 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.860+0000 7fc509f62700 1 -- start start 2023-07-25T14:37:18.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.861+0000 7fc509f62700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc5040724c0 0x7fc504157b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:18.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.861+0000 7fc509f62700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc5040c4930 0x7fc5040bdf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:18.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.861+0000 7fc509f62700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc504151950 0x7fc5040be470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:18.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.861+0000 7fc509f62700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5040c0d50 con 0x7fc5040724c0 2023-07-25T14:37:18.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.861+0000 7fc509f62700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc504155ef0 con 0x7fc504151950 2023-07-25T14:37:18.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.861+0000 7fc509f62700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc504156a70 con 0x7fc5040c4930 2023-07-25T14:37:18.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.861+0000 7fc5037fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc5040724c0 0x7fc504157b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:18.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.861+0000 7fc5037fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc5040724c0 0x7fc504157b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42810/0 (socket says 172.21.15.72:42810) 2023-07-25T14:37:18.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.861+0000 7fc5037fe700 1 -- 172.21.15.72:0/3661897925 learned_addr learned my addr 172.21.15.72:0/3661897925 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:37:18.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.861+0000 7fc503fff700 1 --2- 172.21.15.72:0/3661897925 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc504151950 0x7fc5040be470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:18.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.861+0000 7fc502ffd700 1 --2- 172.21.15.72:0/3661897925 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc5040c4930 0x7fc5040bdf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:18.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.861+0000 7fc5037fe700 1 -- 172.21.15.72:0/3661897925 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc5040c4930 msgr2=0x7fc5040bdf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:18.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.861+0000 7fc5037fe700 1 --2- 172.21.15.72:0/3661897925 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc5040c4930 0x7fc5040bdf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:18.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.861+0000 7fc5037fe700 1 -- 172.21.15.72:0/3661897925 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc504151950 msgr2=0x7fc5040be470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:18.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.861+0000 7fc5037fe700 1 --2- 172.21.15.72:0/3661897925 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc504151950 0x7fc5040be470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:18.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.861+0000 7fc5037fe700 1 -- 172.21.15.72:0/3661897925 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4fc009a70 con 0x7fc5040724c0 2023-07-25T14:37:18.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.861+0000 7fc503fff700 1 --2- 172.21.15.72:0/3661897925 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc504151950 0x7fc5040be470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-25T14:37:18.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.861+0000 7fc502ffd700 1 --2- 172.21.15.72:0/3661897925 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc5040c4930 0x7fc5040bdf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-25T14:37:18.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.861+0000 7fc5037fe700 1 --2- 172.21.15.72:0/3661897925 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc5040724c0 0x7fc504157b40 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fc4ec00c530 tx=0x7fc4ec00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:18.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.861+0000 7fc4fbfff700 1 -- 172.21.15.72:0/3661897925 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4ec005cb0 con 0x7fc5040724c0 2023-07-25T14:37:18.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.862+0000 7fc509f62700 1 -- 172.21.15.72:0/3661897925 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4f4009550 con 0x7fc5040724c0 2023-07-25T14:37:18.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.862+0000 7fc4fbfff700 1 -- 172.21.15.72:0/3661897925 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4ec005e10 con 0x7fc5040724c0 2023-07-25T14:37:18.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.862+0000 7fc4fbfff700 1 -- 172.21.15.72:0/3661897925 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4ec0072d0 con 0x7fc5040724c0 2023-07-25T14:37:18.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.862+0000 7fc509f62700 1 -- 172.21.15.72:0/3661897925 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc504156140 con 0x7fc5040724c0 2023-07-25T14:37:18.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.862+0000 7fc509f62700 1 -- 172.21.15.72:0/3661897925 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc504156e00 con 0x7fc5040724c0 2023-07-25T14:37:18.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.863+0000 7fc4fbfff700 1 -- 172.21.15.72:0/3661897925 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc4ec007430 con 0x7fc5040724c0 2023-07-25T14:37:18.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.863+0000 7fc4fbfff700 1 --2- 172.21.15.72:0/3661897925 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fc4e406ace0 0x7fc4e406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:18.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.863+0000 7fc4fbfff700 1 -- 172.21.15.72:0/3661897925 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 7238+0+0 (secure 0 0 0) 0x7fc4ec088cc0 con 0x7fc5040724c0 2023-07-25T14:37:18.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.863+0000 7fc502ffd700 1 --2- 172.21.15.72:0/3661897925 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fc4e406ace0 0x7fc4e406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:18.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.864+0000 7fc502ffd700 1 --2- 172.21.15.72:0/3661897925 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fc4e406ace0 0x7fc4e406d1a0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fc4f40098f0 tx=0x7fc4f4008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:18.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:18.868+0000 7fc4fbfff700 1 -- 172.21.15.72:0/3661897925 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fc4ec053990 con 0x7fc5040724c0 2023-07-25T14:37:19.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.054+0000 7fc509f62700 1 -- 172.21.15.72:0/3661897925 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc50404e470 con 0x7fc5040724c0 2023-07-25T14:37:19.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.055+0000 7fc4fbfff700 1 -- 172.21.15.72:0/3661897925 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v43) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc4ec056fb0 con 0x7fc5040724c0 2023-07-25T14:37:19.066 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 64 2023-07-25T14:37:19.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.057+0000 7fc509f62700 1 -- 172.21.15.72:0/3661897925 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fc4e406ace0 msgr2=0x7fc4e406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:19.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.057+0000 7fc509f62700 1 --2- 172.21.15.72:0/3661897925 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fc4e406ace0 0x7fc4e406d1a0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fc4f40098f0 tx=0x7fc4f4008030 comp rx=0 tx=0).stop 2023-07-25T14:37:19.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.057+0000 7fc509f62700 1 -- 172.21.15.72:0/3661897925 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc5040724c0 msgr2=0x7fc504157b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:19.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.057+0000 7fc509f62700 1 --2- 172.21.15.72:0/3661897925 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc5040724c0 0x7fc504157b40 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fc4ec00c530 tx=0x7fc4ec00c8f0 comp rx=0 tx=0).stop 2023-07-25T14:37:19.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.057+0000 7fc509f62700 1 -- 172.21.15.72:0/3661897925 shutdown_connections 2023-07-25T14:37:19.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.057+0000 7fc509f62700 1 --2- 172.21.15.72:0/3661897925 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fc4e406ace0 0x7fc4e406d1a0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:19.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.057+0000 7fc509f62700 1 --2- 172.21.15.72:0/3661897925 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc504151950 0x7fc5040be470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:19.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.057+0000 7fc509f62700 1 --2- 172.21.15.72:0/3661897925 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc5040724c0 0x7fc504157b40 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:19.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.057+0000 7fc509f62700 1 --2- 172.21.15.72:0/3661897925 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc5040c4930 0x7fc5040bdf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:19.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.057+0000 7fc509f62700 1 -- 172.21.15.72:0/3661897925 >> 172.21.15.72:0/3661897925 conn(0x7fc5040a87e0 msgr2=0x7fc50406e400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:19.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.057+0000 7fc509f62700 1 -- 172.21.15.72:0/3661897925 shutdown_connections 2023-07-25T14:37:19.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.057+0000 7fc509f62700 1 -- 172.21.15.72:0/3661897925 wait complete. 2023-07-25T14:37:19.081 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-07-25T14:37:19.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.193+0000 7fe025a2f700 1 Processor -- start 2023-07-25T14:37:19.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.193+0000 7fe025a2f700 1 -- start start 2023-07-25T14:37:19.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.194+0000 7fe025a2f700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fe02006f280 0x7fe0200a8170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:19.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.194+0000 7fe025a2f700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe0200c11f0 0x7fe0200a86b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:19.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.194+0000 7fe025a2f700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0200ba1c0 con 0x7fe02014e6f0 2023-07-25T14:37:19.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.194+0000 7fe025a2f700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0200a7920 con 0x7fe02006f280 2023-07-25T14:37:19.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.194+0000 7fe025a2f700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe020154640 con 0x7fe0200c11f0 2023-07-25T14:37:19.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.194+0000 7fe01effd700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fe02014e6f0 0x7fe0200c67d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:33554/0 (socket says 172.21.15.72:33554) 2023-07-25T14:37:19.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.194+0000 7fe01effd700 1 -- 172.21.15.72:0/321421950 learned_addr learned my addr 172.21.15.72:0/321421950 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:37:19.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.194+0000 7fe01dffb700 1 -- 172.21.15.72:0/321421950 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3073879210 0 0) 0x7fe0200ba1c0 con 0x7fe02014e6f0 2023-07-25T14:37:19.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.194+0000 7fe01f7fe700 1 --2- 172.21.15.72:0/321421950 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe0200c11f0 0x7fe0200a86b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:19.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.194+0000 7fe01e7fc700 1 --2- 172.21.15.72:0/321421950 >> v2:172.21.15.92:3300/0 conn(0x7fe02006f280 0x7fe0200a8170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:19.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.195+0000 7fe01dffb700 1 -- 172.21.15.72:0/321421950 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe0080035b0 con 0x7fe02014e6f0 2023-07-25T14:37:19.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.195+0000 7fe01dffb700 1 -- 172.21.15.72:0/321421950 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3677851191 0 0) 0x7fe0080035b0 con 0x7fe02014e6f0 2023-07-25T14:37:19.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.195+0000 7fe01dffb700 1 -- 172.21.15.72:0/321421950 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe0200c11f0 msgr2=0x7fe0200a86b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:19.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.195+0000 7fe01dffb700 1 --2- 172.21.15.72:0/321421950 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe0200c11f0 0x7fe0200a86b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:19.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.195+0000 7fe01dffb700 1 -- 172.21.15.72:0/321421950 >> v2:172.21.15.92:3300/0 conn(0x7fe02006f280 msgr2=0x7fe0200a8170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:19.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.195+0000 7fe01dffb700 1 --2- 172.21.15.72:0/321421950 >> v2:172.21.15.92:3300/0 conn(0x7fe02006f280 0x7fe0200a8170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:19.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.195+0000 7fe01dffb700 1 -- 172.21.15.72:0/321421950 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe020154900 con 0x7fe02014e6f0 2023-07-25T14:37:19.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.195+0000 7fe01dffb700 1 -- 172.21.15.72:0/321421950 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2559588315 0 0) 0x7fe010001670 con 0x7fe02014e6f0 2023-07-25T14:37:19.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.195+0000 7fe01dffb700 1 -- 172.21.15.72:0/321421950 >> v1:172.21.15.72:6789/0 conn(0x7fe02014e6f0 legacy=0x7fe0200c67d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:19.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.195+0000 7fe01dffb700 1 --2- 172.21.15.72:0/321421950 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe0200c11f0 0x7fe008003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:19.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.195+0000 7fe01dffb700 1 --2- 172.21.15.72:0/321421950 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe008003f80 0x7fe008004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:19.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.195+0000 7fe01dffb700 1 --2- 172.21.15.72:0/321421950 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe008004d90 0x7fe008005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:19.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.195+0000 7fe01dffb700 1 -- 172.21.15.72:0/321421950 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe020154640 con 0x7fe008003f80 2023-07-25T14:37:19.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.195+0000 7fe01dffb700 1 -- 172.21.15.72:0/321421950 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe00800ba10 con 0x7fe008004d90 2023-07-25T14:37:19.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.195+0000 7fe01dffb700 1 -- 172.21.15.72:0/321421950 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe00800bb50 con 0x7fe0200c11f0 2023-07-25T14:37:19.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.195+0000 7fe01e7fc700 1 --2- 172.21.15.72:0/321421950 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe008003f80 0x7fe008004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:19.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.195+0000 7fe01f7fe700 1 --2- 172.21.15.72:0/321421950 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe008004d90 0x7fe008005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:19.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.195+0000 7fe01effd700 1 --2- 172.21.15.72:0/321421950 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe0200c11f0 0x7fe008003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:19.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.195+0000 7fe01e7fc700 1 -- 172.21.15.72:0/321421950 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe0200c11f0 msgr2=0x7fe008003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:19.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.195+0000 7fe01e7fc700 1 --2- 172.21.15.72:0/321421950 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe0200c11f0 0x7fe008003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:19.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.195+0000 7fe01e7fc700 1 -- 172.21.15.72:0/321421950 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe008004d90 msgr2=0x7fe008005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:19.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.195+0000 7fe01e7fc700 1 --2- 172.21.15.72:0/321421950 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe008004d90 0x7fe008005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:19.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.195+0000 7fe01e7fc700 1 -- 172.21.15.72:0/321421950 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0080035b0 con 0x7fe008003f80 2023-07-25T14:37:19.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.195+0000 7fe01effd700 1 --2- 172.21.15.72:0/321421950 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe0200c11f0 0x7fe008003a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-25T14:37:19.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.195+0000 7fe01e7fc700 1 --2- 172.21.15.72:0/321421950 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe008003f80 0x7fe008004850 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fe014009b30 tx=0x7fe008005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cabfa0e6aabdd696 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:19.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.195+0000 7fe01dffb700 1 -- 172.21.15.72:0/321421950 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe01400e660 con 0x7fe008003f80 2023-07-25T14:37:19.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.196+0000 7fe01dffb700 1 -- 172.21.15.72:0/321421950 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe01400e7c0 con 0x7fe008003f80 2023-07-25T14:37:19.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.196+0000 7fe01dffb700 1 -- 172.21.15.72:0/321421950 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe01400eb30 con 0x7fe008003f80 2023-07-25T14:37:19.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.196+0000 7fe025a2f700 1 -- 172.21.15.72:0/321421950 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe008003f80 msgr2=0x7fe008004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:19.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.196+0000 7fe025a2f700 1 --2- 172.21.15.72:0/321421950 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe008003f80 0x7fe008004850 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fe014009b30 tx=0x7fe008005880 comp rx=0 tx=0).stop 2023-07-25T14:37:19.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.196+0000 7fe01f7fe700 1 -- 172.21.15.72:0/321421950 reap_dead start 2023-07-25T14:37:19.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.196+0000 7fe025a2f700 1 -- 172.21.15.72:0/321421950 shutdown_connections 2023-07-25T14:37:19.214 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.196+0000 7fe025a2f700 1 -- 172.21.15.72:0/321421950 >> 172.21.15.72:0/321421950 conn(0x7fe0200714f0 msgr2=0x7fe020071900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:19.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.196+0000 7fe025a2f700 1 -- 172.21.15.72:0/321421950 shutdown_connections 2023-07-25T14:37:19.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.196+0000 7fe025a2f700 1 -- 172.21.15.72:0/321421950 wait complete. 2023-07-25T14:37:19.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.197+0000 7fe025a2f700 1 Processor -- start 2023-07-25T14:37:19.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.197+0000 7fe025a2f700 1 -- start start 2023-07-25T14:37:19.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.198+0000 7fe025a2f700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe008003f80 0x7fe0200b8850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:19.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.198+0000 7fe025a2f700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe0200b8d90 0x7fe020153870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:19.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.198+0000 7fe025a2f700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe020153db0 0x7fe0201eae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:19.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.198+0000 7fe025a2f700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0201ea9d0 con 0x7fe020153db0 2023-07-25T14:37:19.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.198+0000 7fe025a2f700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0200a8cc0 con 0x7fe008003f80 2023-07-25T14:37:19.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.198+0000 7fe025a2f700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe02014a990 con 0x7fe0200b8d90 2023-07-25T14:37:19.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.198+0000 7fe01f7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe020153db0 0x7fe0201eae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:19.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.198+0000 7fe01f7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe020153db0 0x7fe0201eae20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42834/0 (socket says 172.21.15.72:42834) 2023-07-25T14:37:19.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.198+0000 7fe01f7fe700 1 -- 172.21.15.72:0/622465232 learned_addr learned my addr 172.21.15.72:0/622465232 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:37:19.221 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.198+0000 7fe01effd700 1 --2- 172.21.15.72:0/622465232 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe008003f80 0x7fe0200b8850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:19.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.198+0000 7fe01e7fc700 1 --2- 172.21.15.72:0/622465232 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe0200b8d90 0x7fe020153870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:19.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.199+0000 7fe01f7fe700 1 -- 172.21.15.72:0/622465232 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe0200b8d90 msgr2=0x7fe020153870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:19.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.199+0000 7fe01f7fe700 1 --2- 172.21.15.72:0/622465232 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe0200b8d90 0x7fe020153870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:19.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.199+0000 7fe01f7fe700 1 -- 172.21.15.72:0/622465232 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe008003f80 msgr2=0x7fe0200b8850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:19.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.199+0000 7fe01f7fe700 1 --2- 172.21.15.72:0/622465232 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe008003f80 0x7fe0200b8850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:19.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.199+0000 7fe01f7fe700 1 -- 172.21.15.72:0/622465232 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0200bd9e0 con 0x7fe020153db0 2023-07-25T14:37:19.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.199+0000 7fe01effd700 1 --2- 172.21.15.72:0/622465232 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe008003f80 0x7fe0200b8850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-25T14:37:19.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.199+0000 7fe01f7fe700 1 --2- 172.21.15.72:0/622465232 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe020153db0 0x7fe0201eae20 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fe0200c0e70 tx=0x7fe018011ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:19.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.199+0000 7fe007fff700 1 -- 172.21.15.72:0/622465232 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe01800e040 con 0x7fe020153db0 2023-07-25T14:37:19.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.199+0000 7fe007fff700 1 -- 172.21.15.72:0/622465232 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe01800f040 con 0x7fe020153db0 2023-07-25T14:37:19.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.199+0000 7fe007fff700 1 -- 172.21.15.72:0/622465232 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe01800fd00 con 0x7fe020153db0 2023-07-25T14:37:19.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.199+0000 7fe025a2f700 1 -- 172.21.15.72:0/622465232 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0200bdcc0 con 0x7fe020153db0 2023-07-25T14:37:19.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.199+0000 7fe025a2f700 1 -- 172.21.15.72:0/622465232 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe02014f950 con 0x7fe020153db0 2023-07-25T14:37:19.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.200+0000 7fe025a2f700 1 -- 172.21.15.72:0/622465232 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe02004e470 con 0x7fe020153db0 2023-07-25T14:37:19.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.200+0000 7fe007fff700 1 -- 172.21.15.72:0/622465232 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe018015430 con 0x7fe020153db0 2023-07-25T14:37:19.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.201+0000 7fe007fff700 1 --2- 172.21.15.72:0/622465232 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fe00c06ad10 0x7fe00c06d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:19.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.201+0000 7fe01effd700 1 --2- 172.21.15.72:0/622465232 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fe00c06ad10 0x7fe00c06d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:19.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.201+0000 7fe007fff700 1 -- 172.21.15.72:0/622465232 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 7238+0+0 (secure 0 0 0) 0x7fe018089ca0 con 0x7fe020153db0 2023-07-25T14:37:19.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.201+0000 7fe01effd700 1 --2- 172.21.15.72:0/622465232 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fe00c06ad10 0x7fe00c06d1d0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fe010000ff0 tx=0x7fe010009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:19.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.205+0000 7fe007fff700 1 -- 172.21.15.72:0/622465232 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fe0180583d0 con 0x7fe020153db0 2023-07-25T14:37:19.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.398+0000 7fe025a2f700 1 -- 172.21.15.72:0/622465232 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe02006f060 con 0x7fe020153db0 2023-07-25T14:37:19.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.398+0000 7fe007fff700 1 -- 172.21.15.72:0/622465232 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v43) v1 ==== 105+0+11 (secure 0 0 0) 0x7fe018057f60 con 0x7fe020153db0 2023-07-25T14:37:19.410 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2023-07-25T14:37:19.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.401+0000 7fe025a2f700 1 -- 172.21.15.72:0/622465232 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fe00c06ad10 msgr2=0x7fe00c06d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:19.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.401+0000 7fe025a2f700 1 --2- 172.21.15.72:0/622465232 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fe00c06ad10 0x7fe00c06d1d0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fe010000ff0 tx=0x7fe010009040 comp rx=0 tx=0).stop 2023-07-25T14:37:19.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.401+0000 7fe025a2f700 1 -- 172.21.15.72:0/622465232 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe020153db0 msgr2=0x7fe0201eae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:19.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.401+0000 7fe025a2f700 1 --2- 172.21.15.72:0/622465232 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe020153db0 0x7fe0201eae20 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fe0200c0e70 tx=0x7fe018011ed0 comp rx=0 tx=0).stop 2023-07-25T14:37:19.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.401+0000 7fe025a2f700 1 -- 172.21.15.72:0/622465232 shutdown_connections 2023-07-25T14:37:19.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.401+0000 7fe025a2f700 1 --2- 172.21.15.72:0/622465232 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fe00c06ad10 0x7fe00c06d1d0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:19.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.401+0000 7fe025a2f700 1 --2- 172.21.15.72:0/622465232 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe020153db0 0x7fe0201eae20 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:19.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.401+0000 7fe025a2f700 1 --2- 172.21.15.72:0/622465232 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe008003f80 0x7fe0200b8850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:19.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.401+0000 7fe025a2f700 1 --2- 172.21.15.72:0/622465232 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe0200b8d90 0x7fe020153870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:19.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.401+0000 7fe025a2f700 1 -- 172.21.15.72:0/622465232 >> 172.21.15.72:0/622465232 conn(0x7fe0200714f0 msgr2=0x7fe0200c22d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:19.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.401+0000 7fe025a2f700 1 -- 172.21.15.72:0/622465232 shutdown_connections 2023-07-25T14:37:19.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.401+0000 7fe025a2f700 1 -- 172.21.15.72:0/622465232 wait complete. 2023-07-25T14:37:19.423 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-07-25T14:37:19.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.536+0000 7f3ce1840700 1 Processor -- start 2023-07-25T14:37:19.551 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.536+0000 7f3ce1840700 1 -- start start 2023-07-25T14:37:19.552 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.537+0000 7f3ce1840700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f3cdc14f810 0x7f3cdc0c4370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:19.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.537+0000 7f3ce1840700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f3cdc0bb0b0 0x7f3cdc152cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:19.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.537+0000 7f3ce1840700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cdc0c5890 con 0x7f3cdc0a9cc0 2023-07-25T14:37:19.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.537+0000 7f3ce1840700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3cdc152150 con 0x7f3cdc0bb0b0 2023-07-25T14:37:19.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.537+0000 7f3ce1840700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3cdc14fbf0 con 0x7f3cdc14f810 2023-07-25T14:37:19.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.537+0000 7f3cdb7fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f3cdc0bb0b0 0x7f3cdc152cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:19.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.537+0000 7f3cdb7fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f3cdc0bb0b0 0x7f3cdc152cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42840/0 (socket says 172.21.15.72:42840) 2023-07-25T14:37:19.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.537+0000 7f3cdb7fe700 1 -- 172.21.15.72:0/598542709 learned_addr learned my addr 172.21.15.72:0/598542709 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:37:19.554 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.537+0000 7f3cda7fc700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f3cdc0a9cc0 0x7f3cdc1525e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:33574/0 (socket says 172.21.15.72:33574) 2023-07-25T14:37:19.555 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.537+0000 7f3cdaffd700 1 --2- 172.21.15.72:0/598542709 >> v2:172.21.15.92:3300/0 conn(0x7f3cdc14f810 0x7f3cdc0c4370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:19.555 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.538+0000 7f3cdb7fe700 1 -- 172.21.15.72:0/598542709 >> v2:172.21.15.92:3300/0 conn(0x7f3cdc14f810 msgr2=0x7f3cdc0c4370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:19.555 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.538+0000 7f3cdb7fe700 1 --2- 172.21.15.72:0/598542709 >> v2:172.21.15.92:3300/0 conn(0x7f3cdc14f810 0x7f3cdc0c4370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:19.555 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.538+0000 7f3cdb7fe700 1 -- 172.21.15.72:0/598542709 >> v1:172.21.15.72:6789/0 conn(0x7f3cdc0a9cc0 legacy=0x7f3cdc1525e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:19.555 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.538+0000 7f3cdb7fe700 1 -- 172.21.15.72:0/598542709 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cdc1566a0 con 0x7f3cdc0bb0b0 2023-07-25T14:37:19.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.538+0000 7f3cd9ffb700 1 -- 172.21.15.72:0/598542709 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1790076673 0 0) 0x7f3cdc0c5890 con 0x7f3cdc0a9cc0 2023-07-25T14:37:19.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.538+0000 7f3cdb7fe700 1 --2- 172.21.15.72:0/598542709 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3cdc0bb0b0 0x7f3cdc152cf0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f3cdc0aa300 tx=0x7f3cd400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac59b59f39e19af0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:19.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.538+0000 7f3cd9ffb700 1 -- 172.21.15.72:0/598542709 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cd400e070 con 0x7f3cdc0bb0b0 2023-07-25T14:37:19.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.538+0000 7f3cd9ffb700 1 -- 172.21.15.72:0/598542709 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cd400b9c0 con 0x7f3cdc0bb0b0 2023-07-25T14:37:19.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.538+0000 7f3cd9ffb700 1 -- 172.21.15.72:0/598542709 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cd400bd70 con 0x7f3cdc0bb0b0 2023-07-25T14:37:19.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.538+0000 7f3ce1840700 1 -- 172.21.15.72:0/598542709 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3cdc0bb0b0 msgr2=0x7f3cdc152cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:19.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.538+0000 7f3ce1840700 1 --2- 172.21.15.72:0/598542709 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3cdc0bb0b0 0x7f3cdc152cf0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f3cdc0aa300 tx=0x7f3cd400b330 comp rx=0 tx=0).stop 2023-07-25T14:37:19.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.538+0000 7f3ce1840700 1 -- 172.21.15.72:0/598542709 shutdown_connections 2023-07-25T14:37:19.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.538+0000 7f3ce1840700 1 --2- 172.21.15.72:0/598542709 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3cdc0bb0b0 0x7f3cdc152cf0 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:19.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.538+0000 7f3ce1840700 1 --2- 172.21.15.72:0/598542709 >> v2:172.21.15.92:3300/0 conn(0x7f3cdc14f810 0x7f3cdc0c4370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:19.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.538+0000 7f3ce1840700 1 -- 172.21.15.72:0/598542709 >> 172.21.15.72:0/598542709 conn(0x7f3cdc06a8d0 msgr2=0x7f3cdc0a94e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:19.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.538+0000 7f3ce1840700 1 -- 172.21.15.72:0/598542709 shutdown_connections 2023-07-25T14:37:19.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.539+0000 7f3ce1840700 1 -- 172.21.15.72:0/598542709 wait complete. 2023-07-25T14:37:19.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.540+0000 7f3ce1840700 1 Processor -- start 2023-07-25T14:37:19.559 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.540+0000 7f3ce1840700 1 -- start start 2023-07-25T14:37:19.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.540+0000 7f3ce1840700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3cdc0a9cc0 0x7f3cdc0ac9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:19.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.540+0000 7f3ce1840700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3cdc0bb0b0 0x7f3cdc0ba540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:19.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.540+0000 7f3ce1840700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3cdc14f810 0x7f3cdc06b450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:19.564 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.540+0000 7f3ce1840700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cdc06c500 con 0x7f3cdc0a9cc0 2023-07-25T14:37:19.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.540+0000 7f3ce1840700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cdc1ea200 con 0x7f3cdc14f810 2023-07-25T14:37:19.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.540+0000 7f3ce1840700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cdc06c7a0 con 0x7f3cdc0bb0b0 2023-07-25T14:37:19.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.541+0000 7f3cdaffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3cdc0a9cc0 0x7f3cdc0ac9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:19.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.541+0000 7f3cdaffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3cdc0a9cc0 0x7f3cdc0ac9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42842/0 (socket says 172.21.15.72:42842) 2023-07-25T14:37:19.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.541+0000 7f3cdaffd700 1 -- 172.21.15.72:0/2083536684 learned_addr learned my addr 172.21.15.72:0/2083536684 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:37:19.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.541+0000 7f3cdb7fe700 1 --2- 172.21.15.72:0/2083536684 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3cdc14f810 0x7f3cdc06b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:19.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.541+0000 7f3cda7fc700 1 --2- 172.21.15.72:0/2083536684 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3cdc0bb0b0 0x7f3cdc0ba540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:19.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.541+0000 7f3cdaffd700 1 -- 172.21.15.72:0/2083536684 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3cdc0bb0b0 msgr2=0x7f3cdc0ba540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:19.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.541+0000 7f3cdaffd700 1 --2- 172.21.15.72:0/2083536684 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3cdc0bb0b0 0x7f3cdc0ba540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:19.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.541+0000 7f3cdaffd700 1 -- 172.21.15.72:0/2083536684 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3cdc14f810 msgr2=0x7f3cdc06b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:19.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.541+0000 7f3cdaffd700 1 --2- 172.21.15.72:0/2083536684 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3cdc14f810 0x7f3cdc06b450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:19.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.541+0000 7f3cdaffd700 1 -- 172.21.15.72:0/2083536684 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cd4009b30 con 0x7f3cdc0a9cc0 2023-07-25T14:37:19.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.541+0000 7f3cdb7fe700 1 --2- 172.21.15.72:0/2083536684 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3cdc14f810 0x7f3cdc06b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-25T14:37:19.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.541+0000 7f3cdaffd700 1 --2- 172.21.15.72:0/2083536684 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3cdc0a9cc0 0x7f3cdc0ac9f0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f3cd000e810 tx=0x7f3cd000ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:19.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.541+0000 7f3cc3fff700 1 -- 172.21.15.72:0/2083536684 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cd0013610 con 0x7f3cdc0a9cc0 2023-07-25T14:37:19.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.541+0000 7f3cc3fff700 1 -- 172.21.15.72:0/2083536684 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cd0013770 con 0x7f3cdc0a9cc0 2023-07-25T14:37:19.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.541+0000 7f3cc3fff700 1 -- 172.21.15.72:0/2083536684 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cd0013b20 con 0x7f3cdc0a9cc0 2023-07-25T14:37:19.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.541+0000 7f3ce1840700 1 -- 172.21.15.72:0/2083536684 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cdc0acf30 con 0x7f3cdc0a9cc0 2023-07-25T14:37:19.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.541+0000 7f3ce1840700 1 -- 172.21.15.72:0/2083536684 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cdc0bea60 con 0x7f3cdc0a9cc0 2023-07-25T14:37:19.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.542+0000 7f3ce1840700 1 -- 172.21.15.72:0/2083536684 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3cdc0bece0 con 0x7f3cdc0a9cc0 2023-07-25T14:37:19.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.543+0000 7f3cc3fff700 1 -- 172.21.15.72:0/2083536684 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3cd0013c80 con 0x7f3cdc0a9cc0 2023-07-25T14:37:19.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.543+0000 7f3cc3fff700 1 --2- 172.21.15.72:0/2083536684 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f3cc806ace0 0x7f3cc806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:19.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.543+0000 7f3cc3fff700 1 -- 172.21.15.72:0/2083536684 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 7238+0+0 (secure 0 0 0) 0x7f3cd0089610 con 0x7f3cdc0a9cc0 2023-07-25T14:37:19.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.543+0000 7f3cda7fc700 1 --2- 172.21.15.72:0/2083536684 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f3cc806ace0 0x7f3cc806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:19.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.543+0000 7f3cda7fc700 1 --2- 172.21.15.72:0/2083536684 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f3cc806ace0 0x7f3cc806d1a0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f3cdc0c66d0 tx=0x7f3ccc007c90 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:19.570 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.548+0000 7f3cc3fff700 1 -- 172.21.15.72:0/2083536684 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f3cd0057d40 con 0x7f3cdc0a9cc0 2023-07-25T14:37:19.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.733+0000 7f3ce1840700 1 -- 172.21.15.72:0/2083536684 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7f3cdc04e470 con 0x7f3cdc0a9cc0 2023-07-25T14:37:19.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.734+0000 7f3cc3fff700 1 -- 172.21.15.72:0/2083536684 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v43) v1 ==== 101+0+11 (secure 0 0 0) 0x7f3cd00578d0 con 0x7f3cdc0a9cc0 2023-07-25T14:37:19.745 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 64 2023-07-25T14:37:19.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.737+0000 7f3ce1840700 1 -- 172.21.15.72:0/2083536684 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f3cc806ace0 msgr2=0x7f3cc806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:19.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.737+0000 7f3ce1840700 1 --2- 172.21.15.72:0/2083536684 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f3cc806ace0 0x7f3cc806d1a0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f3cdc0c66d0 tx=0x7f3ccc007c90 comp rx=0 tx=0).stop 2023-07-25T14:37:19.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.737+0000 7f3ce1840700 1 -- 172.21.15.72:0/2083536684 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3cdc0a9cc0 msgr2=0x7f3cdc0ac9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:19.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.737+0000 7f3ce1840700 1 --2- 172.21.15.72:0/2083536684 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3cdc0a9cc0 0x7f3cdc0ac9f0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f3cd000e810 tx=0x7f3cd000ebd0 comp rx=0 tx=0).stop 2023-07-25T14:37:19.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.737+0000 7f3ce1840700 1 -- 172.21.15.72:0/2083536684 shutdown_connections 2023-07-25T14:37:19.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.737+0000 7f3ce1840700 1 --2- 172.21.15.72:0/2083536684 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f3cc806ace0 0x7f3cc806d1a0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:19.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.737+0000 7f3ce1840700 1 --2- 172.21.15.72:0/2083536684 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3cdc14f810 0x7f3cdc06b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:19.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.737+0000 7f3ce1840700 1 --2- 172.21.15.72:0/2083536684 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3cdc0a9cc0 0x7f3cdc0ac9f0 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:19.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.737+0000 7f3ce1840700 1 --2- 172.21.15.72:0/2083536684 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3cdc0bb0b0 0x7f3cdc0ba540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:19.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.737+0000 7f3ce1840700 1 -- 172.21.15.72:0/2083536684 >> 172.21.15.72:0/2083536684 conn(0x7f3cdc06a8d0 msgr2=0x7f3cdc150810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:19.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.737+0000 7f3ce1840700 1 -- 172.21.15.72:0/2083536684 shutdown_connections 2023-07-25T14:37:19.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.737+0000 7f3ce1840700 1 -- 172.21.15.72:0/2083536684 wait complete. 2023-07-25T14:37:19.759 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-25T14:37:19.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.869+0000 7f61966a4700 1 Processor -- start 2023-07-25T14:37:19.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.869+0000 7f61966a4700 1 -- start start 2023-07-25T14:37:19.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.870+0000 7f61966a4700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f619006e580 0x7f61900c4c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:19.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.870+0000 7f61966a4700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f619006f9b0 0x7f61900c51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:19.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.870+0000 7f61966a4700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f619006eaf0 con 0x7f6190151980 2023-07-25T14:37:19.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.870+0000 7f61966a4700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f619006f770 con 0x7f619006f9b0 2023-07-25T14:37:19.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.870+0000 7f61966a4700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61900c29e0 con 0x7f619006e580 2023-07-25T14:37:19.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.870+0000 7f618f7fe700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f619006e580 0x7f61900c4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:19.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.870+0000 7f6194c41700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f619006f9b0 0x7f61900c51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:19.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.870+0000 7f618ffff700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f6190151980 0x7f61900c12b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.72:57160/0 (socket says 172.21.15.72:57160) 2023-07-25T14:37:19.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.870+0000 7f6194c41700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f619006f9b0 0x7f61900c51b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.72:38426/0 (socket says 172.21.15.72:38426) 2023-07-25T14:37:19.884 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.870+0000 7f618ffff700 1 -- 172.21.15.72:0/1729521203 learned_addr learned my addr 172.21.15.72:0/1729521203 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:37:19.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.871+0000 7f618f7fe700 1 -- 172.21.15.72:0/1729521203 >> v2:172.21.15.92:3300/0 conn(0x7f619006f9b0 msgr2=0x7f61900c51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:19.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.871+0000 7f618f7fe700 1 --2- 172.21.15.72:0/1729521203 >> v2:172.21.15.92:3300/0 conn(0x7f619006f9b0 0x7f61900c51b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:19.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.871+0000 7f618f7fe700 1 -- 172.21.15.72:0/1729521203 >> v1:172.21.15.92:6789/0 conn(0x7f6190151980 legacy=0x7f61900c12b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:19.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.871+0000 7f618effd700 1 -- 172.21.15.72:0/1729521203 <== mon.1 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3158986917 0 0) 0x7f619006eaf0 con 0x7f6190151980 2023-07-25T14:37:19.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.871+0000 7f618f7fe700 1 -- 172.21.15.72:0/1729521203 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f619006edd0 con 0x7f619006e580 2023-07-25T14:37:19.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.871+0000 7f6194c41700 1 --2- 172.21.15.72:0/1729521203 >> v2:172.21.15.92:3300/0 conn(0x7f619006f9b0 0x7f61900c51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-25T14:37:19.885 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.871+0000 7f618f7fe700 1 --2- 172.21.15.72:0/1729521203 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f619006e580 0x7f61900c4c70 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6180009840 tx=0x7f6180009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cb1ddf1c7fd17493 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:19.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.871+0000 7f618effd700 1 -- 172.21.15.72:0/1729521203 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6180011830 con 0x7f619006e580 2023-07-25T14:37:19.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.871+0000 7f618effd700 1 -- 172.21.15.72:0/1729521203 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6180011990 con 0x7f619006e580 2023-07-25T14:37:19.886 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.871+0000 7f618effd700 1 -- 172.21.15.72:0/1729521203 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6180011d20 con 0x7f619006e580 2023-07-25T14:37:19.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.872+0000 7f61966a4700 1 -- 172.21.15.72:0/1729521203 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f619006e580 msgr2=0x7f61900c4c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:19.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.872+0000 7f61966a4700 1 --2- 172.21.15.72:0/1729521203 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f619006e580 0x7f61900c4c70 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6180009840 tx=0x7f6180009b50 comp rx=0 tx=0).stop 2023-07-25T14:37:19.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.872+0000 7f61966a4700 1 -- 172.21.15.72:0/1729521203 shutdown_connections 2023-07-25T14:37:19.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.872+0000 7f61966a4700 1 --2- 172.21.15.72:0/1729521203 >> v2:172.21.15.92:3300/0 conn(0x7f619006f9b0 0x7f61900c51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:19.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.872+0000 7f61966a4700 1 --2- 172.21.15.72:0/1729521203 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f619006e580 0x7f61900c4c70 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:19.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.872+0000 7f61966a4700 1 -- 172.21.15.72:0/1729521203 >> 172.21.15.72:0/1729521203 conn(0x7f61900a8520 msgr2=0x7f61900a8900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:19.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.872+0000 7f61966a4700 1 -- 172.21.15.72:0/1729521203 shutdown_connections 2023-07-25T14:37:19.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.872+0000 7f61966a4700 1 -- 172.21.15.72:0/1729521203 wait complete. 2023-07-25T14:37:19.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.873+0000 7f61966a4700 1 Processor -- start 2023-07-25T14:37:19.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.873+0000 7f61966a4700 1 -- start start 2023-07-25T14:37:19.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.874+0000 7f61966a4700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f619006e580 0x7f61901e97c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:19.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.874+0000 7f61966a4700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f619006f9b0 0x7f619014d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:19.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.874+0000 7f61966a4700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6190151980 0x7f619014a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:19.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.874+0000 7f61966a4700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61901559a0 con 0x7f6190151980 2023-07-25T14:37:19.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.874+0000 7f61966a4700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6190155c40 con 0x7f619006e580 2023-07-25T14:37:19.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.874+0000 7f61966a4700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6190155f20 con 0x7f619006f9b0 2023-07-25T14:37:19.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.874+0000 7f6194c41700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6190151980 0x7f619014a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:19.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.874+0000 7f6194c41700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6190151980 0x7f619014a470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42860/0 (socket says 172.21.15.72:42860) 2023-07-25T14:37:19.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.874+0000 7f6194c41700 1 -- 172.21.15.72:0/2748571297 learned_addr learned my addr 172.21.15.72:0/2748571297 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:37:19.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.874+0000 7f618ffff700 1 --2- 172.21.15.72:0/2748571297 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f619006e580 0x7f61901e97c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:19.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.874+0000 7f618f7fe700 1 --2- 172.21.15.72:0/2748571297 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f619006f9b0 0x7f619014d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:19.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.875+0000 7f6194c41700 1 -- 172.21.15.72:0/2748571297 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f619006f9b0 msgr2=0x7f619014d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:19.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.875+0000 7f6194c41700 1 --2- 172.21.15.72:0/2748571297 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f619006f9b0 0x7f619014d450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:19.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.875+0000 7f6194c41700 1 -- 172.21.15.72:0/2748571297 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f619006e580 msgr2=0x7f61901e97c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:19.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.875+0000 7f6194c41700 1 --2- 172.21.15.72:0/2748571297 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f619006e580 0x7f61901e97c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:19.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.875+0000 7f6194c41700 1 -- 172.21.15.72:0/2748571297 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6188009a70 con 0x7f6190151980 2023-07-25T14:37:19.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.875+0000 7f6194c41700 1 --2- 172.21.15.72:0/2748571297 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6190151980 0x7f619014a470 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f618800efc0 tx=0x7f618800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:19.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.875+0000 7f618cff9700 1 -- 172.21.15.72:0/2748571297 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f618800ca90 con 0x7f6190151980 2023-07-25T14:37:19.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.875+0000 7f618cff9700 1 -- 172.21.15.72:0/2748571297 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f618800f040 con 0x7f6190151980 2023-07-25T14:37:19.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.875+0000 7f61966a4700 1 -- 172.21.15.72:0/2748571297 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61800094a0 con 0x7f6190151980 2023-07-25T14:37:19.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.875+0000 7f618cff9700 1 -- 172.21.15.72:0/2748571297 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f618800ce10 con 0x7f6190151980 2023-07-25T14:37:19.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.875+0000 7f61966a4700 1 -- 172.21.15.72:0/2748571297 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61901564e0 con 0x7f6190151980 2023-07-25T14:37:19.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.876+0000 7f61966a4700 1 -- 172.21.15.72:0/2748571297 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61901566d0 con 0x7f6190151980 2023-07-25T14:37:19.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.876+0000 7f618cff9700 1 -- 172.21.15.72:0/2748571297 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6188014480 con 0x7f6190151980 2023-07-25T14:37:19.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.877+0000 7f618cff9700 1 --2- 172.21.15.72:0/2748571297 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f617c06ad10 0x7f617c06d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:19.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.877+0000 7f618cff9700 1 -- 172.21.15.72:0/2748571297 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 7238+0+0 (secure 0 0 0) 0x7f6188089f20 con 0x7f6190151980 2023-07-25T14:37:19.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.877+0000 7f618ffff700 1 --2- 172.21.15.72:0/2748571297 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f617c06ad10 0x7f617c06d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:19.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.877+0000 7f618ffff700 1 --2- 172.21.15.72:0/2748571297 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f617c06ad10 0x7f617c06d1d0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f6184000fb0 tx=0x7f6184007db0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:19.899 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:19.881+0000 7f618cff9700 1 -- 172.21.15.72:0/2748571297 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f61880585c0 con 0x7f6190151980 2023-07-25T14:37:20.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:20.086+0000 7f61966a4700 1 -- 172.21.15.72:0/2748571297 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f619004e470 con 0x7f6190151980 2023-07-25T14:37:20.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:20.086+0000 7f618cff9700 1 -- 172.21.15.72:0/2748571297 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v43) v1 ==== 80+0+0 (secure 0 0 0) 0x7f6188009d70 con 0x7f6190151980 2023-07-25T14:37:20.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:20.088+0000 7f61966a4700 1 -- 172.21.15.72:0/2748571297 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f617c06ad10 msgr2=0x7f617c06d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:20.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:20.088+0000 7f61966a4700 1 --2- 172.21.15.72:0/2748571297 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f617c06ad10 0x7f617c06d1d0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f6184000fb0 tx=0x7f6184007db0 comp rx=0 tx=0).stop 2023-07-25T14:37:20.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:20.088+0000 7f61966a4700 1 -- 172.21.15.72:0/2748571297 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6190151980 msgr2=0x7f619014a470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:20.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:20.088+0000 7f61966a4700 1 --2- 172.21.15.72:0/2748571297 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6190151980 0x7f619014a470 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f618800efc0 tx=0x7f618800c3a0 comp rx=0 tx=0).stop 2023-07-25T14:37:20.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:20.088+0000 7f61966a4700 1 -- 172.21.15.72:0/2748571297 shutdown_connections 2023-07-25T14:37:20.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:20.088+0000 7f61966a4700 1 --2- 172.21.15.72:0/2748571297 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f617c06ad10 0x7f617c06d1d0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:20.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:20.088+0000 7f61966a4700 1 --2- 172.21.15.72:0/2748571297 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6190151980 0x7f619014a470 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:20.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:20.088+0000 7f61966a4700 1 --2- 172.21.15.72:0/2748571297 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f619006e580 0x7f61901e97c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:20.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:20.088+0000 7f61966a4700 1 --2- 172.21.15.72:0/2748571297 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f619006f9b0 0x7f619014d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:20.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:20.088+0000 7f61966a4700 1 -- 172.21.15.72:0/2748571297 >> 172.21.15.72:0/2748571297 conn(0x7f61900a8520 msgr2=0x7f619006b950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:20.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:20.089+0000 7f61966a4700 1 -- 172.21.15.72:0/2748571297 shutdown_connections 2023-07-25T14:37:20.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:20.089+0000 7f61966a4700 1 -- 172.21.15.72:0/2748571297 wait complete. 2023-07-25T14:37:20.101 INFO:teuthology.orchestra.run.smithi072.stderr:listed 0 entries 2023-07-25T14:37:20.110 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-07-25T14:37:20.111 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-25T14:37:20.111 DEBUG:teuthology.orchestra.run.smithi092:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-07-25T14:37:20.159 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi092.front.sepia.ceph.com 2023-07-25T14:37:20.159 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-25T14:37:20.160 DEBUG:teuthology.orchestra.run.smithi092:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-07-25T14:37:20.180 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-25T14:37:20.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:20.289+0000 7f22e487b700 1 Processor -- start 2023-07-25T14:37:20.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:20.289+0000 7f22e487b700 1 -- start start 2023-07-25T14:37:20.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:20.290+0000 7f22e487b700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f22e00c5f40 0x7f22e0154640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:20.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:20.290+0000 7f22e487b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f22e00ba0e0 0x7f22e0154b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:20.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:20.290+0000 7f22e487b700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22e00c54f0 con 0x7f22e0151ba0 2023-07-25T14:37:20.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:20.290+0000 7f22e487b700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22e00c6670 con 0x7f22e00ba0e0 2023-07-25T14:37:20.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:20.290+0000 7f22e487b700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22e00c5740 con 0x7f22e00c5f40 2023-07-25T14:37:20.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:20.290+0000 7f22ded9d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f22e00ba0e0 0x7f22e0154b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:20.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:20.290+0000 7f22de59c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f22e0151ba0 0x7f22e00c2230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:33600/0 (socket says 172.21.15.72:33600) 2023-07-25T14:37:20.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:20.290+0000 7f22de59c700 1 -- 172.21.15.72:0/4102856942 learned_addr learned my addr 172.21.15.72:0/4102856942 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:37:20.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:20.291+0000 7f22ded9d700 1 -- 172.21.15.72:0/4102856942 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f22e00c5f40 msgr2=0x7f22e0154640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:20.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:20.291+0000 7f22ded9d700 1 --2- 172.21.15.72:0/4102856942 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f22e00c5f40 0x7f22e0154640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:20.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:20.291+0000 7f22ded9d700 1 -- 172.21.15.72:0/4102856942 >> v1:172.21.15.72:6789/0 conn(0x7f22e0151ba0 legacy=0x7f22e00c2230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:20.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:20.291+0000 7f22ded9d700 1 -- 172.21.15.72:0/4102856942 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22e00c5a20 con 0x7f22e00ba0e0 2023-07-25T14:37:20.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:20.291+0000 7f22dd59a700 1 -- 172.21.15.72:0/4102856942 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 751887434 0 0) 0x7f22e00c54f0 con 0x7f22e0151ba0 2023-07-25T14:37:20.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:20.291+0000 7f22ded9d700 1 --2- 172.21.15.72:0/4102856942 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f22e00ba0e0 0x7f22e0154b80 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f22d800bfa0 tx=0x7f22d800d330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=156563e5116d66cb server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:20.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:20.291+0000 7f22dd59a700 1 -- 172.21.15.72:0/4102856942 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22d8010070 con 0x7f22e00ba0e0 2023-07-25T14:37:20.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:20.291+0000 7f22dd59a700 1 -- 172.21.15.72:0/4102856942 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22d800b2e0 con 0x7f22e00ba0e0 2023-07-25T14:37:20.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:20.291+0000 7f22dd59a700 1 -- 172.21.15.72:0/4102856942 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22d800dcf0 con 0x7f22e00ba0e0 2023-07-25T14:37:20.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:20.291+0000 7f22e487b700 1 -- 172.21.15.72:0/4102856942 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f22e00ba0e0 msgr2=0x7f22e0154b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:20.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:20.291+0000 7f22e487b700 1 --2- 172.21.15.72:0/4102856942 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f22e00ba0e0 0x7f22e0154b80 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f22d800bfa0 tx=0x7f22d800d330 comp rx=0 tx=0).stop 2023-07-25T14:37:20.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:20.291+0000 7f22e487b700 1 -- 172.21.15.72:0/4102856942 shutdown_connections 2023-07-25T14:37:20.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:20.291+0000 7f22e487b700 1 --2- 172.21.15.72:0/4102856942 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f22e00ba0e0 0x7f22e0154b80 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:20.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:20.291+0000 7f22e487b700 1 --2- 172.21.15.72:0/4102856942 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f22e00c5f40 0x7f22e0154640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:20.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:20.291+0000 7f22e487b700 1 -- 172.21.15.72:0/4102856942 >> 172.21.15.72:0/4102856942 conn(0x7f22e00a87e0 msgr2=0x7f22e00a8bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:20.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:20.291+0000 7f22e487b700 1 -- 172.21.15.72:0/4102856942 shutdown_connections 2023-07-25T14:37:20.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:20.292+0000 7f22e487b700 1 -- 172.21.15.72:0/4102856942 wait complete. 2023-07-25T14:37:20.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:20.293+0000 7f22e487b700 1 Processor -- start 2023-07-25T14:37:20.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:20.293+0000 7f22e487b700 1 -- start start 2023-07-25T14:37:20.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:20.293+0000 7f22e487b700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f22e00ba0e0 0x7f22e00ba660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:20.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:20.293+0000 7f22e487b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f22e00c5f40 0x7f22e01534c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:20.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:20.293+0000 7f22e487b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f22e0151ba0 0x7f22e00b93b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:20.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:20.293+0000 7f22e487b700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22e01530a0 con 0x7f22e00c5f40 2023-07-25T14:37:20.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:20.293+0000 7f22e487b700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22e0072400 con 0x7f22e0151ba0 2023-07-25T14:37:20.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:20.293+0000 7f22e487b700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22e0152d00 con 0x7f22e00ba0e0 2023-07-25T14:37:20.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:20.294+0000 7f22ddd9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f22e00c5f40 0x7f22e01534c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:20.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:20.294+0000 7f22ddd9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f22e00c5f40 0x7f22e01534c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42872/0 (socket says 172.21.15.72:42872) 2023-07-25T14:37:20.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:20.294+0000 7f22ddd9b700 1 -- 172.21.15.72:0/672640824 learned_addr learned my addr 172.21.15.72:0/672640824 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:37:20.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:20.294+0000 7f22de59c700 1 --2- 172.21.15.72:0/672640824 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f22e00ba0e0 0x7f22e00ba660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:20.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:20.294+0000 7f22ded9d700 1 --2- 172.21.15.72:0/672640824 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f22e0151ba0 0x7f22e00b93b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:20.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:20.294+0000 7f22ddd9b700 1 -- 172.21.15.72:0/672640824 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f22e00ba0e0 msgr2=0x7f22e00ba660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:20.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:20.294+0000 7f22ddd9b700 1 --2- 172.21.15.72:0/672640824 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f22e00ba0e0 0x7f22e00ba660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:20.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:20.294+0000 7f22ddd9b700 1 -- 172.21.15.72:0/672640824 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f22e0151ba0 msgr2=0x7f22e00b93b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:20.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:20.294+0000 7f22ddd9b700 1 --2- 172.21.15.72:0/672640824 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f22e0151ba0 0x7f22e00b93b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:20.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:20.294+0000 7f22ddd9b700 1 -- 172.21.15.72:0/672640824 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22d800bc80 con 0x7f22e00c5f40 2023-07-25T14:37:20.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:20.294+0000 7f22ddd9b700 1 --2- 172.21.15.72:0/672640824 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f22e00c5f40 0x7f22e01534c0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f22d000b530 tx=0x7f22d000b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:20.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:20.294+0000 7f22ceffd700 1 -- 172.21.15.72:0/672640824 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22d0011830 con 0x7f22e00c5f40 2023-07-25T14:37:20.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:20.294+0000 7f22ceffd700 1 -- 172.21.15.72:0/672640824 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22d0011990 con 0x7f22e00c5f40 2023-07-25T14:37:20.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:20.294+0000 7f22e487b700 1 -- 172.21.15.72:0/672640824 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22e0153f70 con 0x7f22e00c5f40 2023-07-25T14:37:20.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:20.294+0000 7f22ceffd700 1 -- 172.21.15.72:0/672640824 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22d0011d40 con 0x7f22e00c5f40 2023-07-25T14:37:20.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:20.294+0000 7f22e487b700 1 -- 172.21.15.72:0/672640824 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22e0154530 con 0x7f22e00c5f40 2023-07-25T14:37:20.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:20.295+0000 7f22e487b700 1 -- 172.21.15.72:0/672640824 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22e0154750 con 0x7f22e00c5f40 2023-07-25T14:37:20.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:20.296+0000 7f22ceffd700 1 -- 172.21.15.72:0/672640824 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f22d001a400 con 0x7f22e00c5f40 2023-07-25T14:37:20.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:20.296+0000 7f22ceffd700 1 --2- 172.21.15.72:0/672640824 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f22c006ace0 0x7f22c006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:20.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:20.296+0000 7f22ceffd700 1 -- 172.21.15.72:0/672640824 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 7238+0+0 (secure 0 0 0) 0x7f22d0089830 con 0x7f22e00c5f40 2023-07-25T14:37:20.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:20.296+0000 7f22de59c700 1 --2- 172.21.15.72:0/672640824 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f22c006ace0 0x7f22c006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:20.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:20.296+0000 7f22de59c700 1 --2- 172.21.15.72:0/672640824 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f22c006ace0 0x7f22c006d1a0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f22d4000f60 tx=0x7f22d4007e70 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:20.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:20.300+0000 7f22ceffd700 1 -- 172.21.15.72:0/672640824 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f22e0154750 con 0x7f22e00c5f40 2023-07-25T14:37:20.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:20.532+0000 7f22e487b700 1 -- 172.21.15.72:0/672640824 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f22e0154750 con 0x7f22e00c5f40 2023-07-25T14:37:20.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:20.532+0000 7f22ceffd700 1 -- 172.21.15.72:0/672640824 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+5813 (secure 0 0 0) 0x7f22e0154750 con 0x7f22e00c5f40 2023-07-25T14:37:20.543 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-25T14:37:20.543 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":22,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5092,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6834/3640355071","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":3640355071},{"type":"v1","addr":"172.21.15.92:6834","nonce":3640355071}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5095,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/936080292","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6833","nonce":936080292},{"type":"v1","addr":"172.21.15.92:6835","nonce":936080292}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-25T14:36:49.567868+0000","modified":"2023-07-25T14:36:53.213193+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5331},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5331":{"gid":5331,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.72:6837/1193027887","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6835","nonce":1193027887},{"type":"v1","addr":"172.21.15.72:6837","nonce":1193027887}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-25T14:37:02.650515+0000","modified":"2023-07-25T14:37:06.294518+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5328},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5328":{"gid":5328,"name":"c","rank":0,"incarnation":18,"state":"up:active","state_seq":7,"addr":"172.21.15.72:6836/2944832990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":2944832990},{"type":"v1","addr":"172.21.15.72:6836","nonce":2944832990}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-07-25T14:37:20.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:20.535+0000 7f22e487b700 1 -- 172.21.15.72:0/672640824 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f22c006ace0 msgr2=0x7f22c006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:20.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:20.535+0000 7f22e487b700 1 --2- 172.21.15.72:0/672640824 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f22c006ace0 0x7f22c006d1a0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f22d4000f60 tx=0x7f22d4007e70 comp rx=0 tx=0).stop 2023-07-25T14:37:20.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:20.535+0000 7f22e487b700 1 -- 172.21.15.72:0/672640824 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f22e00c5f40 msgr2=0x7f22e01534c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:20.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:20.535+0000 7f22e487b700 1 --2- 172.21.15.72:0/672640824 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f22e00c5f40 0x7f22e01534c0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f22d000b530 tx=0x7f22d000b840 comp rx=0 tx=0).stop 2023-07-25T14:37:20.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:20.535+0000 7f22e487b700 1 -- 172.21.15.72:0/672640824 shutdown_connections 2023-07-25T14:37:20.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:20.535+0000 7f22e487b700 1 --2- 172.21.15.72:0/672640824 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f22c006ace0 0x7f22c006d1a0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:20.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:20.535+0000 7f22e487b700 1 --2- 172.21.15.72:0/672640824 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f22e00ba0e0 0x7f22e00ba660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:20.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:20.535+0000 7f22e487b700 1 --2- 172.21.15.72:0/672640824 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f22e0151ba0 0x7f22e00b93b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:20.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:20.535+0000 7f22e487b700 1 --2- 172.21.15.72:0/672640824 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f22e00c5f40 0x7f22e01534c0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:20.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:20.535+0000 7f22e487b700 1 -- 172.21.15.72:0/672640824 >> 172.21.15.72:0/672640824 conn(0x7f22e00a87e0 msgr2=0x7f22e00c4600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:20.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:20.535+0000 7f22e487b700 1 -- 172.21.15.72:0/672640824 shutdown_connections 2023-07-25T14:37:20.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:20.535+0000 7f22e487b700 1 -- 172.21.15.72:0/672640824 wait complete. 2023-07-25T14:37:20.547 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 22 2023-07-25T14:37:20.557 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-25T14:37:20.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:20.666+0000 7f059a313700 1 Processor -- start 2023-07-25T14:37:20.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:20.667+0000 7f059a313700 1 -- start start 2023-07-25T14:37:20.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:20.667+0000 7f059a313700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0594151ba0 0x7f05940c2230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:20.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:20.667+0000 7f059a313700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f0594154d50 0x7f059415b970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:20.685 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:20.667+0000 7f059a313700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05940c54f0 con 0x7f05940c5f40 2023-07-25T14:37:20.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:20.667+0000 7f059a313700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05940c6670 con 0x7f0594154d50 2023-07-25T14:37:20.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:20.667+0000 7f059a313700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05940c5740 con 0x7f0594151ba0 2023-07-25T14:37:20.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:20.668+0000 7f0593fff700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0594151ba0 0x7f05940c2230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:20.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:20.668+0000 7f05937fe700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f05940c5f40 0x7f0594154640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.72:57190/0 (socket says 172.21.15.72:57190) 2023-07-25T14:37:20.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:20.668+0000 7f05988b0700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f0594154d50 0x7f059415b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:20.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:20.668+0000 7f05937fe700 1 -- 172.21.15.72:0/3760305309 learned_addr learned my addr 172.21.15.72:0/3760305309 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:37:20.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:20.668+0000 7f0592ffd700 1 -- 172.21.15.72:0/3760305309 <== mon.1 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 725504113 0 0) 0x7f05940c54f0 con 0x7f05940c5f40 2023-07-25T14:37:20.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:20.668+0000 7f0592ffd700 1 -- 172.21.15.72:0/3760305309 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f05800035b0 con 0x7f05940c5f40 2023-07-25T14:37:20.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:20.668+0000 7f05988b0700 1 -- 172.21.15.72:0/3760305309 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0594151ba0 msgr2=0x7f05940c2230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:20.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:20.668+0000 7f05988b0700 1 --2- 172.21.15.72:0/3760305309 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0594151ba0 0x7f05940c2230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:20.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:20.668+0000 7f05988b0700 1 -- 172.21.15.72:0/3760305309 >> v1:172.21.15.92:6789/0 conn(0x7f05940c5f40 legacy=0x7f0594154640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:20.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:20.668+0000 7f05988b0700 1 -- 172.21.15.72:0/3760305309 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05940c5a20 con 0x7f0594154d50 2023-07-25T14:37:20.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:20.668+0000 7f0593fff700 1 --2- 172.21.15.72:0/3760305309 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0594151ba0 0x7f05940c2230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-25T14:37:20.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:20.668+0000 7f05988b0700 1 --2- 172.21.15.72:0/3760305309 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0594154d50 0x7f059415b970 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f058c009d90 tx=0x7f058c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d0dbc351547c90c9 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:20.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:20.668+0000 7f0592ffd700 1 -- 172.21.15.72:0/3760305309 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f058c00e070 con 0x7f0594154d50 2023-07-25T14:37:20.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:20.668+0000 7f0592ffd700 1 -- 172.21.15.72:0/3760305309 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f058c00bb20 con 0x7f0594154d50 2023-07-25T14:37:20.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:20.668+0000 7f0592ffd700 1 -- 172.21.15.72:0/3760305309 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f058c012430 con 0x7f0594154d50 2023-07-25T14:37:20.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:20.669+0000 7f059a313700 1 -- 172.21.15.72:0/3760305309 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0594154d50 msgr2=0x7f059415b970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:20.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:20.669+0000 7f059a313700 1 --2- 172.21.15.72:0/3760305309 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0594154d50 0x7f059415b970 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f058c009d90 tx=0x7f058c00b330 comp rx=0 tx=0).stop 2023-07-25T14:37:20.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:20.669+0000 7f059a313700 1 -- 172.21.15.72:0/3760305309 shutdown_connections 2023-07-25T14:37:20.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:20.669+0000 7f059a313700 1 --2- 172.21.15.72:0/3760305309 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0594151ba0 0x7f05940c2230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:20.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:20.669+0000 7f059a313700 1 --2- 172.21.15.72:0/3760305309 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0594154d50 0x7f059415b970 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:20.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:20.669+0000 7f059a313700 1 -- 172.21.15.72:0/3760305309 >> 172.21.15.72:0/3760305309 conn(0x7f05940a87e0 msgr2=0x7f05940a8bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:20.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:20.669+0000 7f059a313700 1 -- 172.21.15.72:0/3760305309 shutdown_connections 2023-07-25T14:37:20.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:20.669+0000 7f059a313700 1 -- 172.21.15.72:0/3760305309 wait complete. 2023-07-25T14:37:20.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:20.670+0000 7f059a313700 1 Processor -- start 2023-07-25T14:37:20.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:20.670+0000 7f059a313700 1 -- start start 2023-07-25T14:37:20.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:20.671+0000 7f059a313700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f05940c5f40 0x7f0594149b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:20.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:20.671+0000 7f059a313700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0594151ba0 0x7f05940a7640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:20.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:20.671+0000 7f059a313700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f05940a7b80 0x7f0594147280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:20.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:20.671+0000 7f059a313700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05940a9f20 con 0x7f0594151ba0 2023-07-25T14:37:20.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:20.671+0000 7f059a313700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f059414f220 con 0x7f05940c5f40 2023-07-25T14:37:20.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:20.671+0000 7f059a313700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f059414f500 con 0x7f05940a7b80 2023-07-25T14:37:20.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:20.671+0000 7f05937fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0594151ba0 0x7f05940a7640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:20.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:20.671+0000 7f05937fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0594151ba0 0x7f05940a7640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42888/0 (socket says 172.21.15.72:42888) 2023-07-25T14:37:20.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:20.671+0000 7f05937fe700 1 -- 172.21.15.72:0/3299002377 learned_addr learned my addr 172.21.15.72:0/3299002377 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:37:20.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:20.671+0000 7f05988b0700 1 --2- 172.21.15.72:0/3299002377 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f05940a7b80 0x7f0594147280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:20.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:20.671+0000 7f0593fff700 1 --2- 172.21.15.72:0/3299002377 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f05940c5f40 0x7f0594149b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:20.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:20.671+0000 7f05937fe700 1 -- 172.21.15.72:0/3299002377 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f05940a7b80 msgr2=0x7f0594147280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:20.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:20.671+0000 7f05937fe700 1 --2- 172.21.15.72:0/3299002377 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f05940a7b80 0x7f0594147280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:20.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:20.671+0000 7f05937fe700 1 -- 172.21.15.72:0/3299002377 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f05940c5f40 msgr2=0x7f0594149b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:20.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:20.671+0000 7f05937fe700 1 --2- 172.21.15.72:0/3299002377 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f05940c5f40 0x7f0594149b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:20.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:20.671+0000 7f05937fe700 1 -- 172.21.15.72:0/3299002377 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05840094a0 con 0x7f0594151ba0 2023-07-25T14:37:20.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:20.671+0000 7f0593fff700 1 --2- 172.21.15.72:0/3299002377 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f05940c5f40 0x7f0594149b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-25T14:37:20.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:20.672+0000 7f05937fe700 1 --2- 172.21.15.72:0/3299002377 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0594151ba0 0x7f05940a7640 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f057c005910 tx=0x7f057c00ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:20.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:20.672+0000 7f0590ff9700 1 -- 172.21.15.72:0/3299002377 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f057c005d70 con 0x7f0594151ba0 2023-07-25T14:37:20.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:20.672+0000 7f0590ff9700 1 -- 172.21.15.72:0/3299002377 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f057c0070d0 con 0x7f0594151ba0 2023-07-25T14:37:20.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:20.672+0000 7f059a313700 1 -- 172.21.15.72:0/3299002377 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f058c009a70 con 0x7f0594151ba0 2023-07-25T14:37:20.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:20.672+0000 7f0590ff9700 1 -- 172.21.15.72:0/3299002377 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f057c007460 con 0x7f0594151ba0 2023-07-25T14:37:20.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:20.672+0000 7f059a313700 1 -- 172.21.15.72:0/3299002377 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05940a6e40 con 0x7f0594151ba0 2023-07-25T14:37:20.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:20.673+0000 7f059a313700 1 -- 172.21.15.72:0/3299002377 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f059404e470 con 0x7f0594151ba0 2023-07-25T14:37:20.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:20.673+0000 7f0590ff9700 1 -- 172.21.15.72:0/3299002377 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f057c0075c0 con 0x7f0594151ba0 2023-07-25T14:37:20.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:20.673+0000 7f0590ff9700 1 --2- 172.21.15.72:0/3299002377 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f057406ace0 0x7f057406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:20.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:20.674+0000 7f0590ff9700 1 -- 172.21.15.72:0/3299002377 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 7238+0+0 (secure 0 0 0) 0x7f057c088f40 con 0x7f0594151ba0 2023-07-25T14:37:20.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:20.674+0000 7f0593fff700 1 --2- 172.21.15.72:0/3299002377 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f057406ace0 0x7f057406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:20.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:20.674+0000 7f0593fff700 1 --2- 172.21.15.72:0/3299002377 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f057406ace0 0x7f057406d1a0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f059406e340 tx=0x7f0584008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:20.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:20.678+0000 7f0590ff9700 1 -- 172.21.15.72:0/3299002377 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f057c053b50 con 0x7f0594151ba0 2023-07-25T14:37:20.875 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:20.865+0000 7f059a313700 1 -- 172.21.15.72:0/3299002377 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f05940bd7c0 con 0x7f0594151ba0 2023-07-25T14:37:20.876 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:20.866+0000 7f0590ff9700 1 -- 172.21.15.72:0/3299002377 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) v1 ==== 74+0+22106 (secure 0 0 0) 0x7f057c057170 con 0x7f0594151ba0 2023-07-25T14:37:20.877 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-25T14:37:20.877 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":43,"fsid":"9170db48-9170-43e8-8ccb-9813e6240906","created":"2023-07-25T14:35:21.733262+0000","modified":"2023-07-25T14:37:04.264643+0000","last_up_change":"2023-07-25T14:35:31.355010+0000","last_in_change":"2023-07-25T14:35:24.195785+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-25T14:35:32.983457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-25T14:35:33.326342+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-07-25T14:36:47.694223+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-07-25T14:36:48.536715+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs2_metadata","create_time":"2023-07-25T14:37:01.238292+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs2_data","create_time":"2023-07-25T14:37:01.609127+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d517fdad-0bfe-49f0-89f2-9421c3761839","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6801","nonce":2475407414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6803","nonce":2475407414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6807","nonce":2475407414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6805","nonce":2475407414}]},"public_addr":"172.21.15.72:6801/2475407414","cluster_addr":"172.21.15.72:6803/2475407414","heartbeat_back_addr":"172.21.15.72:6807/2475407414","heartbeat_front_addr":"172.21.15.72:6805/2475407414","state":["exists","up"]},{"osd":1,"uuid":"e1564be3-f209-47e5-a8d0-32fc618a474f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6822","nonce":870954016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6825","nonce":870954016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6831","nonce":870954016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6827","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6829","nonce":870954016}]},"public_addr":"172.21.15.72:6822/870954016","cluster_addr":"172.21.15.72:6825/870954016","heartbeat_back_addr":"172.21.15.72:6831/870954016","heartbeat_front_addr":"172.21.15.72:6829/870954016","state":["exists","up"]},{"osd":2,"uuid":"c4647d30-ffa6-417a-9026-ef530c75910e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6809","nonce":2143129442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6811","nonce":2143129442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6815","nonce":2143129442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6813","nonce":2143129442}]},"public_addr":"172.21.15.72:6809/2143129442","cluster_addr":"172.21.15.72:6811/2143129442","heartbeat_back_addr":"172.21.15.72:6815/2143129442","heartbeat_front_addr":"172.21.15.72:6813/2143129442","state":["exists","up"]},{"osd":3,"uuid":"76c9d9a7-c2e2-4612-a58b-d6882dd76b58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6817","nonce":3404066311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6819","nonce":3404066311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6828","nonce":3404066311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6821","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6823","nonce":3404066311}]},"public_addr":"172.21.15.72:6817/3404066311","cluster_addr":"172.21.15.72:6819/3404066311","heartbeat_back_addr":"172.21.15.72:6828/3404066311","heartbeat_front_addr":"172.21.15.72:6823/3404066311","state":["exists","up"]},{"osd":4,"uuid":"7f8920dc-0ad4-4a73-ab40-65408f83eadd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6817","nonce":2381008739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6819","nonce":2381008739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6825","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6827","nonce":2381008739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6822","nonce":2381008739}]},"public_addr":"172.21.15.92:6817/2381008739","cluster_addr":"172.21.15.92:6819/2381008739","heartbeat_back_addr":"172.21.15.92:6827/2381008739","heartbeat_front_addr":"172.21.15.92:6822/2381008739","state":["exists","up"]},{"osd":5,"uuid":"56257e7c-31eb-44c5-9ec7-1318a4e0bb35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6801","nonce":2161935604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6803","nonce":2161935604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6807","nonce":2161935604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6805","nonce":2161935604}]},"public_addr":"172.21.15.92:6801/2161935604","cluster_addr":"172.21.15.92:6803/2161935604","heartbeat_back_addr":"172.21.15.92:6807/2161935604","heartbeat_front_addr":"172.21.15.92:6805/2161935604","state":["exists","up"]},{"osd":6,"uuid":"a150d3d8-a0c9-4955-968a-8d98eff4ffb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6809","nonce":3770163493}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6811","nonce":3770163493}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6815","nonce":3770163493}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6813","nonce":3770163493}]},"public_addr":"172.21.15.92:6809/3770163493","cluster_addr":"172.21.15.92:6811/3770163493","heartbeat_back_addr":"172.21.15.92:6815/3770163493","heartbeat_front_addr":"172.21.15.92:6813/3770163493","state":["exists","up"]},{"osd":7,"uuid":"07799c27-54ee-4591-a42d-a978d6b32065","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6821","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6823","nonce":2135777609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6826","nonce":2135777609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6831","nonce":2135777609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6829","nonce":2135777609}]},"public_addr":"172.21.15.92:6823/2135777609","cluster_addr":"172.21.15.92:6826/2135777609","heartbeat_back_addr":"172.21.15.92:6831/2135777609","heartbeat_front_addr":"172.21.15.92:6829/2135777609","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.345365+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.378150+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.146566+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.372172+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:30.398421+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.385632+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.465611+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.443583+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-25T14:37:20.878 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:20.868+0000 7f059a313700 1 -- 172.21.15.72:0/3299002377 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f057406ace0 msgr2=0x7f057406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:20.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:20.868+0000 7f059a313700 1 --2- 172.21.15.72:0/3299002377 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f057406ace0 0x7f057406d1a0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f059406e340 tx=0x7f0584008040 comp rx=0 tx=0).stop 2023-07-25T14:37:20.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:20.868+0000 7f059a313700 1 -- 172.21.15.72:0/3299002377 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0594151ba0 msgr2=0x7f05940a7640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:20.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:20.868+0000 7f059a313700 1 --2- 172.21.15.72:0/3299002377 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0594151ba0 0x7f05940a7640 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f057c005910 tx=0x7f057c00ca90 comp rx=0 tx=0).stop 2023-07-25T14:37:20.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:20.868+0000 7f059a313700 1 -- 172.21.15.72:0/3299002377 shutdown_connections 2023-07-25T14:37:20.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:20.868+0000 7f059a313700 1 --2- 172.21.15.72:0/3299002377 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f057406ace0 0x7f057406d1a0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:20.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:20.868+0000 7f059a313700 1 --2- 172.21.15.72:0/3299002377 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f05940a7b80 0x7f0594147280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:20.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:20.868+0000 7f059a313700 1 --2- 172.21.15.72:0/3299002377 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f05940c5f40 0x7f0594149b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:20.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:20.868+0000 7f059a313700 1 --2- 172.21.15.72:0/3299002377 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0594151ba0 0x7f05940a7640 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:20.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:20.868+0000 7f059a313700 1 -- 172.21.15.72:0/3299002377 >> 172.21.15.72:0/3299002377 conn(0x7f05940a87e0 msgr2=0x7f0594150b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:20.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:20.868+0000 7f059a313700 1 -- 172.21.15.72:0/3299002377 shutdown_connections 2023-07-25T14:37:20.880 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:20.868+0000 7f059a313700 1 -- 172.21.15.72:0/3299002377 wait complete. 2023-07-25T14:37:20.891 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-07-25T14:35:32.983457+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-07-25T14:35:33.326342+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-25T14:36:47.694223+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2023-07-25T14:36:48.536715+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '39', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-07-25T14:37:01.238292+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '42', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs2_data', 'create_time': '2023-07-25T14:37:01.609127+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '43', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-25T14:37:20.892 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-25T14:37:21.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.004+0000 7f3e7a6f4700 1 Processor -- start 2023-07-25T14:37:21.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.004+0000 7f3e7a6f4700 1 -- start start 2023-07-25T14:37:21.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.005+0000 7f3e7a6f4700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3e741518c0 0x7f3e7406b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:21.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.005+0000 7f3e7a6f4700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f3e740c4370 0x7f3e740c47a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:21.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.005+0000 7f3e7a6f4700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e74157cd0 con 0x7f3e74154df0 2023-07-25T14:37:21.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.005+0000 7f3e7a6f4700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e740c2310 con 0x7f3e740c4370 2023-07-25T14:37:21.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.005+0000 7f3e7a6f4700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e74158870 con 0x7f3e741518c0 2023-07-25T14:37:21.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.005+0000 7f3e78c91700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f3e740c4370 0x7f3e740c47a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:21.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.005+0000 7f3e78c91700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f3e740c4370 0x7f3e740c47a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42894/0 (socket says 172.21.15.72:42894) 2023-07-25T14:37:21.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.005+0000 7f3e737fe700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f3e74154df0 0x7f3e74158160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:33628/0 (socket says 172.21.15.72:33628) 2023-07-25T14:37:21.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.005+0000 7f3e78c91700 1 -- 172.21.15.72:0/2752169011 learned_addr learned my addr 172.21.15.72:0/2752169011 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:37:21.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.005+0000 7f3e73fff700 1 --2- 172.21.15.72:0/2752169011 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3e741518c0 0x7f3e7406b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:21.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.005+0000 7f3e78c91700 1 -- 172.21.15.72:0/2752169011 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3e741518c0 msgr2=0x7f3e7406b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:21.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.005+0000 7f3e78c91700 1 --2- 172.21.15.72:0/2752169011 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3e741518c0 0x7f3e7406b2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:21.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.005+0000 7f3e78c91700 1 -- 172.21.15.72:0/2752169011 >> v1:172.21.15.72:6789/0 conn(0x7f3e74154df0 legacy=0x7f3e74158160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:21.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.005+0000 7f3e78c91700 1 -- 172.21.15.72:0/2752169011 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e741552a0 con 0x7f3e740c4370 2023-07-25T14:37:21.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.005+0000 7f3e72ffd700 1 -- 172.21.15.72:0/2752169011 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3577992601 0 0) 0x7f3e74157cd0 con 0x7f3e74154df0 2023-07-25T14:37:21.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.005+0000 7f3e78c91700 1 --2- 172.21.15.72:0/2752169011 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3e740c4370 0x7f3e740c47a0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f3e6c009e50 tx=0x7f3e6c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4723bc54d9b4fd7e server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:21.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.006+0000 7f3e72ffd700 1 -- 172.21.15.72:0/2752169011 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e6c00e070 con 0x7f3e740c4370 2023-07-25T14:37:21.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.006+0000 7f3e72ffd700 1 -- 172.21.15.72:0/2752169011 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e6c00b9c0 con 0x7f3e740c4370 2023-07-25T14:37:21.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.006+0000 7f3e72ffd700 1 -- 172.21.15.72:0/2752169011 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e6c00bd70 con 0x7f3e740c4370 2023-07-25T14:37:21.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.006+0000 7f3e7a6f4700 1 -- 172.21.15.72:0/2752169011 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3e740c4370 msgr2=0x7f3e740c47a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:21.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.006+0000 7f3e7a6f4700 1 --2- 172.21.15.72:0/2752169011 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3e740c4370 0x7f3e740c47a0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f3e6c009e50 tx=0x7f3e6c00b330 comp rx=0 tx=0).stop 2023-07-25T14:37:21.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.006+0000 7f3e7a6f4700 1 -- 172.21.15.72:0/2752169011 shutdown_connections 2023-07-25T14:37:21.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.006+0000 7f3e7a6f4700 1 --2- 172.21.15.72:0/2752169011 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3e740c4370 0x7f3e740c47a0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:21.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.006+0000 7f3e7a6f4700 1 --2- 172.21.15.72:0/2752169011 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3e741518c0 0x7f3e7406b2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:21.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.006+0000 7f3e7a6f4700 1 -- 172.21.15.72:0/2752169011 >> 172.21.15.72:0/2752169011 conn(0x7f3e7406a8d0 msgr2=0x7f3e740a94e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:21.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.006+0000 7f3e7a6f4700 1 -- 172.21.15.72:0/2752169011 shutdown_connections 2023-07-25T14:37:21.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.006+0000 7f3e7a6f4700 1 -- 172.21.15.72:0/2752169011 wait complete. 2023-07-25T14:37:21.022 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.007+0000 7f3e7a6f4700 1 Processor -- start 2023-07-25T14:37:21.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.007+0000 7f3e7a6f4700 1 -- start start 2023-07-25T14:37:21.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.008+0000 7f3e7a6f4700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3e740c4370 0x7f3e741ed480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:21.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.008+0000 7f3e7a6f4700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3e741518c0 0x7f3e74153920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:21.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.008+0000 7f3e7a6f4700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3e74154df0 0x7f3e740c6ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:21.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.008+0000 7f3e7a6f4700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e741eda70 con 0x7f3e74154df0 2023-07-25T14:37:21.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.008+0000 7f3e7a6f4700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e740a9120 con 0x7f3e740c4370 2023-07-25T14:37:21.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.008+0000 7f3e7a6f4700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e740a8880 con 0x7f3e741518c0 2023-07-25T14:37:21.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.008+0000 7f3e78c91700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3e74154df0 0x7f3e740c6ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:21.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.008+0000 7f3e78c91700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3e74154df0 0x7f3e740c6ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42900/0 (socket says 172.21.15.72:42900) 2023-07-25T14:37:21.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.008+0000 7f3e78c91700 1 -- 172.21.15.72:0/3337575255 learned_addr learned my addr 172.21.15.72:0/3337575255 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:37:21.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.008+0000 7f3e73fff700 1 --2- 172.21.15.72:0/3337575255 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3e740c4370 0x7f3e741ed480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:21.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.008+0000 7f3e737fe700 1 --2- 172.21.15.72:0/3337575255 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3e741518c0 0x7f3e74153920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:21.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.009+0000 7f3e78c91700 1 -- 172.21.15.72:0/3337575255 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3e741518c0 msgr2=0x7f3e74153920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:21.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.009+0000 7f3e78c91700 1 --2- 172.21.15.72:0/3337575255 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3e741518c0 0x7f3e74153920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:21.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.009+0000 7f3e78c91700 1 -- 172.21.15.72:0/3337575255 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3e740c4370 msgr2=0x7f3e741ed480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:21.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.009+0000 7f3e78c91700 1 --2- 172.21.15.72:0/3337575255 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3e740c4370 0x7f3e741ed480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:21.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.009+0000 7f3e78c91700 1 -- 172.21.15.72:0/3337575255 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e6c009b30 con 0x7f3e74154df0 2023-07-25T14:37:21.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.009+0000 7f3e78c91700 1 --2- 172.21.15.72:0/3337575255 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3e74154df0 0x7f3e740c6ad0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f3e6c00b370 tx=0x7f3e6c004b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:21.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.009+0000 7f3e70ff9700 1 -- 172.21.15.72:0/3337575255 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e6c004880 con 0x7f3e74154df0 2023-07-25T14:37:21.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.009+0000 7f3e70ff9700 1 -- 172.21.15.72:0/3337575255 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e6c0092e0 con 0x7f3e74154df0 2023-07-25T14:37:21.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.009+0000 7f3e7a6f4700 1 -- 172.21.15.72:0/3337575255 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e740a8b60 con 0x7f3e74154df0 2023-07-25T14:37:21.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.009+0000 7f3e70ff9700 1 -- 172.21.15.72:0/3337575255 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e6c01c680 con 0x7f3e74154df0 2023-07-25T14:37:21.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.009+0000 7f3e7a6f4700 1 -- 172.21.15.72:0/3337575255 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e740c18c0 con 0x7f3e74154df0 2023-07-25T14:37:21.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.010+0000 7f3e7a6f4700 1 -- 172.21.15.72:0/3337575255 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e741e95c0 con 0x7f3e74154df0 2023-07-25T14:37:21.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.010+0000 7f3e70ff9700 1 -- 172.21.15.72:0/3337575255 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3e6c01c7e0 con 0x7f3e74154df0 2023-07-25T14:37:21.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.011+0000 7f3e70ff9700 1 --2- 172.21.15.72:0/3337575255 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f3e6006ace0 0x7f3e6006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:21.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.011+0000 7f3e70ff9700 1 -- 172.21.15.72:0/3337575255 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 7238+0+0 (secure 0 0 0) 0x7f3e6c08b180 con 0x7f3e74154df0 2023-07-25T14:37:21.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.011+0000 7f3e73fff700 1 --2- 172.21.15.72:0/3337575255 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f3e6006ace0 0x7f3e6006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:21.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.011+0000 7f3e73fff700 1 --2- 172.21.15.72:0/3337575255 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f3e6006ace0 0x7f3e6006d1a0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f3e68006b20 tx=0x7f3e68008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:21.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.015+0000 7f3e70ff9700 1 -- 172.21.15.72:0/3337575255 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f3e741e95c0 con 0x7f3e74154df0 2023-07-25T14:37:21.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.202+0000 7f3e7a6f4700 1 -- 172.21.15.72:0/3337575255 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f3e741e95c0 con 0x7f3e74154df0 2023-07-25T14:37:21.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.203+0000 7f3e70ff9700 1 -- 172.21.15.72:0/3337575255 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v43) v1 ==== 92+0+10 (secure 0 0 0) 0x7f3e741e95c0 con 0x7f3e74154df0 2023-07-25T14:37:21.213 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 8 2023-07-25T14:37:21.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.205+0000 7f3e7a6f4700 1 -- 172.21.15.72:0/3337575255 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f3e6006ace0 msgr2=0x7f3e6006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:21.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.205+0000 7f3e7a6f4700 1 --2- 172.21.15.72:0/3337575255 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f3e6006ace0 0x7f3e6006d1a0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f3e68006b20 tx=0x7f3e68008040 comp rx=0 tx=0).stop 2023-07-25T14:37:21.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.205+0000 7f3e7a6f4700 1 -- 172.21.15.72:0/3337575255 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3e74154df0 msgr2=0x7f3e740c6ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:21.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.205+0000 7f3e7a6f4700 1 --2- 172.21.15.72:0/3337575255 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3e74154df0 0x7f3e740c6ad0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f3e6c00b370 tx=0x7f3e6c004b20 comp rx=0 tx=0).stop 2023-07-25T14:37:21.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.205+0000 7f3e7a6f4700 1 -- 172.21.15.72:0/3337575255 shutdown_connections 2023-07-25T14:37:21.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.205+0000 7f3e7a6f4700 1 --2- 172.21.15.72:0/3337575255 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f3e6006ace0 0x7f3e6006d1a0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:21.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.205+0000 7f3e7a6f4700 1 --2- 172.21.15.72:0/3337575255 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3e74154df0 0x7f3e740c6ad0 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:21.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.205+0000 7f3e7a6f4700 1 --2- 172.21.15.72:0/3337575255 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3e740c4370 0x7f3e741ed480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:21.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.205+0000 7f3e7a6f4700 1 --2- 172.21.15.72:0/3337575255 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3e741518c0 0x7f3e74153920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:21.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.205+0000 7f3e7a6f4700 1 -- 172.21.15.72:0/3337575255 >> 172.21.15.72:0/3337575255 conn(0x7f3e7406a8d0 msgr2=0x7f3e7406c490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:21.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.205+0000 7f3e7a6f4700 1 -- 172.21.15.72:0/3337575255 shutdown_connections 2023-07-25T14:37:21.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.205+0000 7f3e7a6f4700 1 -- 172.21.15.72:0/3337575255 wait complete. 2023-07-25T14:37:21.227 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-25T14:37:21.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.340+0000 7f085cb17700 1 Processor -- start 2023-07-25T14:37:21.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.340+0000 7f085cb17700 1 -- start start 2023-07-25T14:37:21.354 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.341+0000 7f085cb17700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f08580c4930 0x7f08580c3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:21.354 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.341+0000 7f085cb17700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08580c2fe0 con 0x7f08580724c0 2023-07-25T14:37:21.354 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.341+0000 7f085cb17700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0858155070 con 0x7f0858151950 2023-07-25T14:37:21.355 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.341+0000 7f085cb17700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0858071a60 con 0x7f08580c4930 2023-07-25T14:37:21.355 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.341+0000 7f0855d9b700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f08580724c0 0x7f08580c34c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:33640/0 (socket says 172.21.15.72:33640) 2023-07-25T14:37:21.355 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.341+0000 7f0855d9b700 1 -- 172.21.15.72:0/953567404 learned_addr learned my addr 172.21.15.72:0/953567404 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:37:21.355 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.341+0000 7f0856d9d700 1 --2- 172.21.15.72:0/953567404 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f08580c4930 0x7f08580c3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:21.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.341+0000 7f085559a700 1 -- 172.21.15.72:0/953567404 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 305874929 0 0) 0x7f08580c2fe0 con 0x7f08580724c0 2023-07-25T14:37:21.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.341+0000 7f085559a700 1 -- 172.21.15.72:0/953567404 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f08400035b0 con 0x7f08580724c0 2023-07-25T14:37:21.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.341+0000 7f085559a700 1 -- 172.21.15.72:0/953567404 <== mon.1 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3818839019 0 0) 0x7f0858155070 con 0x7f0858151950 2023-07-25T14:37:21.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.342+0000 7f085559a700 1 -- 172.21.15.72:0/953567404 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f08580c2fe0 con 0x7f0858151950 2023-07-25T14:37:21.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.342+0000 7f085559a700 1 -- 172.21.15.72:0/953567404 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2612713711 0 0) 0x7f08400035b0 con 0x7f08580724c0 2023-07-25T14:37:21.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.342+0000 7f085559a700 1 -- 172.21.15.72:0/953567404 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f08580c4930 msgr2=0x7f08580c3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:21.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.342+0000 7f085559a700 1 --2- 172.21.15.72:0/953567404 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f08580c4930 0x7f08580c3bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:21.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.342+0000 7f085559a700 1 -- 172.21.15.72:0/953567404 >> v1:172.21.15.92:6789/0 conn(0x7f0858151950 legacy=0x7f085806a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:21.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.342+0000 7f085559a700 1 -- 172.21.15.72:0/953567404 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08580c15c0 con 0x7f08580724c0 2023-07-25T14:37:21.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.342+0000 7f085559a700 1 -- 172.21.15.72:0/953567404 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2559588315 0 0) 0x7f0848001670 con 0x7f08580724c0 2023-07-25T14:37:21.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.342+0000 7f085559a700 1 -- 172.21.15.72:0/953567404 >> v1:172.21.15.72:6789/0 conn(0x7f08580724c0 legacy=0x7f08580c34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:21.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.342+0000 7f085559a700 1 --2- 172.21.15.72:0/953567404 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0840003bc0 0x7f0840003fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:21.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.342+0000 7f085559a700 1 --2- 172.21.15.72:0/953567404 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f08580c4930 0x7f0840004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:21.358 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.342+0000 7f085559a700 1 --2- 172.21.15.72:0/953567404 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0840004d90 0x7f0840005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:21.358 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.342+0000 7f085559a700 1 -- 172.21.15.72:0/953567404 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0858071a60 con 0x7f0840003bc0 2023-07-25T14:37:21.358 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.342+0000 7f085559a700 1 -- 172.21.15.72:0/953567404 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f084000bba0 con 0x7f0840004d90 2023-07-25T14:37:21.358 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.342+0000 7f085559a700 1 -- 172.21.15.72:0/953567404 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f084000bd30 con 0x7f08580c4930 2023-07-25T14:37:21.358 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.342+0000 7f085659c700 1 --2- 172.21.15.72:0/953567404 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0840003bc0 0x7f0840003fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:21.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.342+0000 7f0856d9d700 1 --2- 172.21.15.72:0/953567404 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0840004d90 0x7f0840005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:21.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.342+0000 7f0855d9b700 1 --2- 172.21.15.72:0/953567404 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f08580c4930 0x7f0840004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:21.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.342+0000 7f085659c700 1 -- 172.21.15.72:0/953567404 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f08580c4930 msgr2=0x7f0840004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:21.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.342+0000 7f085659c700 1 --2- 172.21.15.72:0/953567404 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f08580c4930 0x7f0840004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:21.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.342+0000 7f085659c700 1 -- 172.21.15.72:0/953567404 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0840004d90 msgr2=0x7f0840005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:21.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.342+0000 7f085659c700 1 --2- 172.21.15.72:0/953567404 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0840004d90 0x7f0840005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:21.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.342+0000 7f085659c700 1 -- 172.21.15.72:0/953567404 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08400035b0 con 0x7f0840003bc0 2023-07-25T14:37:21.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.342+0000 7f0856d9d700 1 --2- 172.21.15.72:0/953567404 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0840004d90 0x7f0840005210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-25T14:37:21.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.342+0000 7f085659c700 1 --2- 172.21.15.72:0/953567404 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0840003bc0 0x7f0840003fc0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f084c001970 tx=0x7f0840005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2336a0a722008cb1 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:21.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.342+0000 7f085559a700 1 -- 172.21.15.72:0/953567404 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f084c001430 con 0x7f0840003bc0 2023-07-25T14:37:21.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.342+0000 7f085559a700 1 -- 172.21.15.72:0/953567404 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f084c0052d0 con 0x7f0840003bc0 2023-07-25T14:37:21.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.342+0000 7f085559a700 1 -- 172.21.15.72:0/953567404 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f084c003680 con 0x7f0840003bc0 2023-07-25T14:37:21.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.343+0000 7f085cb17700 1 -- 172.21.15.72:0/953567404 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0840003bc0 msgr2=0x7f0840003fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:21.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.343+0000 7f085cb17700 1 --2- 172.21.15.72:0/953567404 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0840003bc0 0x7f0840003fc0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f084c001970 tx=0x7f0840005880 comp rx=0 tx=0).stop 2023-07-25T14:37:21.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.343+0000 7f0856d9d700 1 -- 172.21.15.72:0/953567404 reap_dead start 2023-07-25T14:37:21.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.343+0000 7f085cb17700 1 -- 172.21.15.72:0/953567404 shutdown_connections 2023-07-25T14:37:21.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.343+0000 7f085cb17700 1 -- 172.21.15.72:0/953567404 >> 172.21.15.72:0/953567404 conn(0x7f08580a87e0 msgr2=0x7f08580a8bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:21.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.343+0000 7f085cb17700 1 -- 172.21.15.72:0/953567404 shutdown_connections 2023-07-25T14:37:21.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.343+0000 7f085cb17700 1 -- 172.21.15.72:0/953567404 wait complete. 2023-07-25T14:37:21.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.344+0000 7f085cb17700 1 Processor -- start 2023-07-25T14:37:21.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.344+0000 7f085cb17700 1 -- start start 2023-07-25T14:37:21.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.345+0000 7f085cb17700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0840003bc0 0x7f08580abb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:21.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.345+0000 7f085cb17700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f08580bf810 0x7f08580bdb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:21.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.345+0000 7f085cb17700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f08580be040 0x7f085814e420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:21.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.345+0000 7f085cb17700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f085814f940 con 0x7f0840003bc0 2023-07-25T14:37:21.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.345+0000 7f085cb17700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0858156620 con 0x7f08580be040 2023-07-25T14:37:21.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.345+0000 7f085cb17700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08581ed7f0 con 0x7f08580bf810 2023-07-25T14:37:21.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.345+0000 7f085659c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0840003bc0 0x7f08580abb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:21.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.345+0000 7f085659c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0840003bc0 0x7f08580abb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42916/0 (socket says 172.21.15.72:42916) 2023-07-25T14:37:21.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.345+0000 7f085659c700 1 -- 172.21.15.72:0/3694678511 learned_addr learned my addr 172.21.15.72:0/3694678511 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:37:21.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.345+0000 7f0856d9d700 1 --2- 172.21.15.72:0/3694678511 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f08580be040 0x7f085814e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:21.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.345+0000 7f0855d9b700 1 --2- 172.21.15.72:0/3694678511 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f08580bf810 0x7f08580bdb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:21.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.345+0000 7f085659c700 1 -- 172.21.15.72:0/3694678511 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f08580bf810 msgr2=0x7f08580bdb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:21.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.345+0000 7f085659c700 1 --2- 172.21.15.72:0/3694678511 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f08580bf810 0x7f08580bdb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:21.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.345+0000 7f085659c700 1 -- 172.21.15.72:0/3694678511 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f08580be040 msgr2=0x7f085814e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:21.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.345+0000 7f085659c700 1 --2- 172.21.15.72:0/3694678511 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f08580be040 0x7f085814e420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:21.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.345+0000 7f085659c700 1 -- 172.21.15.72:0/3694678511 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08581edc80 con 0x7f0840003bc0 2023-07-25T14:37:21.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.345+0000 7f0856d9d700 1 --2- 172.21.15.72:0/3694678511 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f08580be040 0x7f085814e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-25T14:37:21.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.346+0000 7f085659c700 1 --2- 172.21.15.72:0/3694678511 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0840003bc0 0x7f08580abb00 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f084c004000 tx=0x7f084c0012d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:21.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.346+0000 7f0846ffd700 1 -- 172.21.15.72:0/3694678511 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f084c0013d0 con 0x7f0840003bc0 2023-07-25T14:37:21.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.346+0000 7f0846ffd700 1 -- 172.21.15.72:0/3694678511 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f084c003d70 con 0x7f0840003bc0 2023-07-25T14:37:21.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.346+0000 7f085cb17700 1 -- 172.21.15.72:0/3694678511 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f085814f210 con 0x7f0840003bc0 2023-07-25T14:37:21.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.346+0000 7f0846ffd700 1 -- 172.21.15.72:0/3694678511 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f084c006aa0 con 0x7f0840003bc0 2023-07-25T14:37:21.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.346+0000 7f085cb17700 1 -- 172.21.15.72:0/3694678511 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08580ac040 con 0x7f0840003bc0 2023-07-25T14:37:21.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.347+0000 7f085cb17700 1 -- 172.21.15.72:0/3694678511 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08581edad0 con 0x7f0840003bc0 2023-07-25T14:37:21.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.347+0000 7f0846ffd700 1 -- 172.21.15.72:0/3694678511 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f084c006c00 con 0x7f0840003bc0 2023-07-25T14:37:21.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.348+0000 7f0846ffd700 1 --2- 172.21.15.72:0/3694678511 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f083806ace0 0x7f083806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:21.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.348+0000 7f0846ffd700 1 -- 172.21.15.72:0/3694678511 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 7238+0+0 (secure 0 0 0) 0x7f084c08a270 con 0x7f0840003bc0 2023-07-25T14:37:21.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.348+0000 7f0855d9b700 1 --2- 172.21.15.72:0/3694678511 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f083806ace0 0x7f083806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:21.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.348+0000 7f0855d9b700 1 --2- 172.21.15.72:0/3694678511 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f083806ace0 0x7f083806d1a0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f08580c0e50 tx=0x7f0848009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:21.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.352+0000 7f0846ffd700 1 -- 172.21.15.72:0/3694678511 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f084c054f10 con 0x7f0840003bc0 2023-07-25T14:37:21.552 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.542+0000 7f085cb17700 1 -- 172.21.15.72:0/3694678511 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f08580c6830 con 0x7f0840003bc0 2023-07-25T14:37:21.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.543+0000 7f0846ffd700 1 -- 172.21.15.72:0/3694678511 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v43) v1 ==== 93+0+10 (secure 0 0 0) 0x7f084c058530 con 0x7f0840003bc0 2023-07-25T14:37:21.553 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 1 2023-07-25T14:37:21.555 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.545+0000 7f085cb17700 1 -- 172.21.15.72:0/3694678511 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f083806ace0 msgr2=0x7f083806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:21.555 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.545+0000 7f085cb17700 1 --2- 172.21.15.72:0/3694678511 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f083806ace0 0x7f083806d1a0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f08580c0e50 tx=0x7f0848009040 comp rx=0 tx=0).stop 2023-07-25T14:37:21.555 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.545+0000 7f085cb17700 1 -- 172.21.15.72:0/3694678511 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0840003bc0 msgr2=0x7f08580abb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:21.555 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.545+0000 7f085cb17700 1 --2- 172.21.15.72:0/3694678511 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0840003bc0 0x7f08580abb00 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f084c004000 tx=0x7f084c0012d0 comp rx=0 tx=0).stop 2023-07-25T14:37:21.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.545+0000 7f085cb17700 1 -- 172.21.15.72:0/3694678511 shutdown_connections 2023-07-25T14:37:21.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.545+0000 7f085cb17700 1 --2- 172.21.15.72:0/3694678511 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f083806ace0 0x7f083806d1a0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:21.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.545+0000 7f085cb17700 1 --2- 172.21.15.72:0/3694678511 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f08580be040 0x7f085814e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:21.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.545+0000 7f085cb17700 1 --2- 172.21.15.72:0/3694678511 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0840003bc0 0x7f08580abb00 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:21.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.545+0000 7f085cb17700 1 --2- 172.21.15.72:0/3694678511 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f08580bf810 0x7f08580bdb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:21.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.545+0000 7f085cb17700 1 -- 172.21.15.72:0/3694678511 >> 172.21.15.72:0/3694678511 conn(0x7f08580a87e0 msgr2=0x7f08580c6080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:21.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.545+0000 7f085cb17700 1 -- 172.21.15.72:0/3694678511 shutdown_connections 2023-07-25T14:37:21.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.545+0000 7f085cb17700 1 -- 172.21.15.72:0/3694678511 wait complete. 2023-07-25T14:37:21.567 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-25T14:37:21.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.680+0000 7fdfac055700 1 Processor -- start 2023-07-25T14:37:21.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.681+0000 7fdfac055700 1 -- start start 2023-07-25T14:37:21.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.681+0000 7fdfac055700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fdfa4071030 0x7fdfa40c4de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:21.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.681+0000 7fdfac055700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fdfa40b9270 0x7fdfa406e290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:21.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.681+0000 7fdfac055700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fdfa40c56c0 0x7fdfa40c3ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:21.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.681+0000 7fdfac055700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfa40c4760 con 0x7fdfa40b9270 2023-07-25T14:37:21.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.681+0000 7fdfac055700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfa406e7d0 con 0x7fdfa4071030 2023-07-25T14:37:21.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.681+0000 7fdfac055700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfa4071950 con 0x7fdfa40c56c0 2023-07-25T14:37:21.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.682+0000 7fdfa95f0700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fdfa40b9270 0x7fdfa406e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:21.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.682+0000 7fdfa95f0700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fdfa40b9270 0x7fdfa406e290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42924/0 (socket says 172.21.15.72:42924) 2023-07-25T14:37:21.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.682+0000 7fdfa95f0700 1 -- 172.21.15.72:0/447007589 learned_addr learned my addr 172.21.15.72:0/447007589 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:37:21.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.682+0000 7fdfa9df1700 1 --2- 172.21.15.72:0/447007589 >> v2:172.21.15.92:3300/0 conn(0x7fdfa4071030 0x7fdfa40c4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:21.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.682+0000 7fdfaa5f2700 1 --2- 172.21.15.72:0/447007589 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fdfa40c56c0 0x7fdfa40c3ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:21.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.682+0000 7fdfa95f0700 1 -- 172.21.15.72:0/447007589 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fdfa40c56c0 msgr2=0x7fdfa40c3ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:21.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.682+0000 7fdfa95f0700 1 --2- 172.21.15.72:0/447007589 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fdfa40c56c0 0x7fdfa40c3ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:21.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.682+0000 7fdfa95f0700 1 -- 172.21.15.72:0/447007589 >> v2:172.21.15.92:3300/0 conn(0x7fdfa4071030 msgr2=0x7fdfa40c4de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:21.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.682+0000 7fdfa95f0700 1 --2- 172.21.15.72:0/447007589 >> v2:172.21.15.92:3300/0 conn(0x7fdfa4071030 0x7fdfa40c4de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:21.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.682+0000 7fdfa95f0700 1 -- 172.21.15.72:0/447007589 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfa40c43f0 con 0x7fdfa40b9270 2023-07-25T14:37:21.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.682+0000 7fdfaa5f2700 1 --2- 172.21.15.72:0/447007589 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fdfa40c56c0 0x7fdfa40c3ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-25T14:37:21.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.682+0000 7fdfa95f0700 1 --2- 172.21.15.72:0/447007589 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdfa40b9270 0x7fdfa406e290 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fdfa406f380 tx=0x7fdf94009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6225436b70744ea server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:21.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.682+0000 7fdfa8def700 1 -- 172.21.15.72:0/447007589 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf9400b860 con 0x7fdfa40b9270 2023-07-25T14:37:21.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.682+0000 7fdfa8def700 1 -- 172.21.15.72:0/447007589 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf9400b9c0 con 0x7fdfa40b9270 2023-07-25T14:37:21.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.682+0000 7fdfa8def700 1 -- 172.21.15.72:0/447007589 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf9400bd50 con 0x7fdfa40b9270 2023-07-25T14:37:21.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.683+0000 7fdfac055700 1 -- 172.21.15.72:0/447007589 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdfa40b9270 msgr2=0x7fdfa406e290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:21.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.683+0000 7fdfac055700 1 --2- 172.21.15.72:0/447007589 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdfa40b9270 0x7fdfa406e290 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fdfa406f380 tx=0x7fdf94009c00 comp rx=0 tx=0).stop 2023-07-25T14:37:21.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.683+0000 7fdfac055700 1 -- 172.21.15.72:0/447007589 shutdown_connections 2023-07-25T14:37:21.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.683+0000 7fdfac055700 1 --2- 172.21.15.72:0/447007589 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fdfa40c56c0 0x7fdfa40c3ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:21.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.683+0000 7fdfac055700 1 --2- 172.21.15.72:0/447007589 >> v2:172.21.15.92:3300/0 conn(0x7fdfa4071030 0x7fdfa40c4de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:21.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.683+0000 7fdfac055700 1 --2- 172.21.15.72:0/447007589 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdfa40b9270 0x7fdfa406e290 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:21.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.683+0000 7fdfac055700 1 -- 172.21.15.72:0/447007589 >> 172.21.15.72:0/447007589 conn(0x7fdfa40a7660 msgr2=0x7fdfa40a7a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:21.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.683+0000 7fdfac055700 1 -- 172.21.15.72:0/447007589 shutdown_connections 2023-07-25T14:37:21.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.683+0000 7fdfac055700 1 -- 172.21.15.72:0/447007589 wait complete. 2023-07-25T14:37:21.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.684+0000 7fdfac055700 1 Processor -- start 2023-07-25T14:37:21.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.684+0000 7fdfac055700 1 -- start start 2023-07-25T14:37:21.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.685+0000 7fdfac055700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdfa4071030 0x7fdfa414d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:21.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.685+0000 7fdfac055700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fdfa40b9270 0x7fdfa40b5410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:21.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.685+0000 7fdfac055700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdfa40c56c0 0x7fdfa4149770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:21.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.685+0000 7fdfac055700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfa40b8f80 con 0x7fdfa4071030 2023-07-25T14:37:21.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.685+0000 7fdfac055700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfa414d6a0 con 0x7fdfa40c56c0 2023-07-25T14:37:21.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.685+0000 7fdfac055700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfa40b5e00 con 0x7fdfa40b9270 2023-07-25T14:37:21.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.685+0000 7fdfa9df1700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdfa4071030 0x7fdfa414d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:21.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.685+0000 7fdfa9df1700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdfa4071030 0x7fdfa414d160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42930/0 (socket says 172.21.15.72:42930) 2023-07-25T14:37:21.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.685+0000 7fdfa9df1700 1 -- 172.21.15.72:0/3193524656 learned_addr learned my addr 172.21.15.72:0/3193524656 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:37:21.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.685+0000 7fdfa9df1700 1 -- 172.21.15.72:0/3193524656 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fdfa40b9270 msgr2=0x7fdfa40b5410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:21.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.685+0000 7fdfaa5f2700 1 --2- 172.21.15.72:0/3193524656 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdfa40c56c0 0x7fdfa4149770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:21.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.685+0000 7fdfa95f0700 1 --2- 172.21.15.72:0/3193524656 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fdfa40b9270 0x7fdfa40b5410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:21.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.685+0000 7fdfa9df1700 1 --2- 172.21.15.72:0/3193524656 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fdfa40b9270 0x7fdfa40b5410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:21.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.685+0000 7fdfa9df1700 1 -- 172.21.15.72:0/3193524656 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdfa40c56c0 msgr2=0x7fdfa4149770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:21.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.685+0000 7fdfa9df1700 1 --2- 172.21.15.72:0/3193524656 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdfa40c56c0 0x7fdfa4149770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:21.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.685+0000 7fdfa9df1700 1 -- 172.21.15.72:0/3193524656 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf94009550 con 0x7fdfa4071030 2023-07-25T14:37:21.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.685+0000 7fdfaa5f2700 1 --2- 172.21.15.72:0/3193524656 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdfa40c56c0 0x7fdfa4149770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-25T14:37:21.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.685+0000 7fdfa95f0700 1 --2- 172.21.15.72:0/3193524656 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fdfa40b9270 0x7fdfa40b5410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-25T14:37:21.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.685+0000 7fdfa9df1700 1 --2- 172.21.15.72:0/3193524656 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdfa4071030 0x7fdfa414d160 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fdfa000e810 tx=0x7fdfa000ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:21.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.685+0000 7fdf9a7fc700 1 -- 172.21.15.72:0/3193524656 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfa0013610 con 0x7fdfa4071030 2023-07-25T14:37:21.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.685+0000 7fdf9a7fc700 1 -- 172.21.15.72:0/3193524656 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfa0013770 con 0x7fdfa4071030 2023-07-25T14:37:21.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.685+0000 7fdfac055700 1 -- 172.21.15.72:0/3193524656 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfa414ae90 con 0x7fdfa4071030 2023-07-25T14:37:21.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.686+0000 7fdf9a7fc700 1 -- 172.21.15.72:0/3193524656 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfa0013b00 con 0x7fdfa4071030 2023-07-25T14:37:21.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.686+0000 7fdfac055700 1 -- 172.21.15.72:0/3193524656 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfa40b8ba0 con 0x7fdfa4071030 2023-07-25T14:37:21.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.686+0000 7fdfac055700 1 -- 172.21.15.72:0/3193524656 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfa40a4ba0 con 0x7fdfa4071030 2023-07-25T14:37:21.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.687+0000 7fdf9a7fc700 1 -- 172.21.15.72:0/3193524656 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fdfa0013c60 con 0x7fdfa4071030 2023-07-25T14:37:21.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.687+0000 7fdf9a7fc700 1 --2- 172.21.15.72:0/3193524656 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fdf8806ace0 0x7fdf8806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:21.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.687+0000 7fdf9a7fc700 1 -- 172.21.15.72:0/3193524656 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 7238+0+0 (secure 0 0 0) 0x7fdfa0089510 con 0x7fdfa4071030 2023-07-25T14:37:21.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.687+0000 7fdfa95f0700 1 --2- 172.21.15.72:0/3193524656 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fdf8806ace0 0x7fdf8806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:21.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.688+0000 7fdfa95f0700 1 --2- 172.21.15.72:0/3193524656 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fdf8806ace0 0x7fdf8806d1a0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fdfa406c670 tx=0x7fdf94008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:21.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.692+0000 7fdf9a7fc700 1 -- 172.21.15.72:0/3193524656 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fdfa00541b0 con 0x7fdfa4071030 2023-07-25T14:37:21.887 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.877+0000 7fdfac055700 1 -- 172.21.15.72:0/3193524656 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fdfa404e470 con 0x7fdfa4071030 2023-07-25T14:37:21.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.878+0000 7fdf9a7fc700 1 -- 172.21.15.72:0/3193524656 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v43) v1 ==== 104+0+11 (secure 0 0 0) 0x7fdfa00577d0 con 0x7fdfa4071030 2023-07-25T14:37:21.888 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2023-07-25T14:37:21.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.880+0000 7fdfac055700 1 -- 172.21.15.72:0/3193524656 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fdf8806ace0 msgr2=0x7fdf8806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:21.890 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.880+0000 7fdfac055700 1 --2- 172.21.15.72:0/3193524656 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fdf8806ace0 0x7fdf8806d1a0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fdfa406c670 tx=0x7fdf94008030 comp rx=0 tx=0).stop 2023-07-25T14:37:21.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.880+0000 7fdfac055700 1 -- 172.21.15.72:0/3193524656 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdfa4071030 msgr2=0x7fdfa414d160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:21.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.880+0000 7fdfac055700 1 --2- 172.21.15.72:0/3193524656 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdfa4071030 0x7fdfa414d160 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fdfa000e810 tx=0x7fdfa000ebd0 comp rx=0 tx=0).stop 2023-07-25T14:37:21.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.880+0000 7fdfac055700 1 -- 172.21.15.72:0/3193524656 shutdown_connections 2023-07-25T14:37:21.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.880+0000 7fdfac055700 1 --2- 172.21.15.72:0/3193524656 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fdf8806ace0 0x7fdf8806d1a0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:21.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.880+0000 7fdfac055700 1 --2- 172.21.15.72:0/3193524656 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdfa40c56c0 0x7fdfa4149770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:21.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.880+0000 7fdfac055700 1 --2- 172.21.15.72:0/3193524656 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fdfa4071030 0x7fdfa414d160 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:21.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.880+0000 7fdfac055700 1 --2- 172.21.15.72:0/3193524656 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fdfa40b9270 0x7fdfa40b5410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:21.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.880+0000 7fdfac055700 1 -- 172.21.15.72:0/3193524656 >> 172.21.15.72:0/3193524656 conn(0x7fdfa40a7660 msgr2=0x7fdfa414e310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:21.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.880+0000 7fdfac055700 1 -- 172.21.15.72:0/3193524656 shutdown_connections 2023-07-25T14:37:21.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:21.880+0000 7fdfac055700 1 -- 172.21.15.72:0/3193524656 wait complete. 2023-07-25T14:37:21.902 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-25T14:37:22.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.015+0000 7fe6e4338700 1 Processor -- start 2023-07-25T14:37:22.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.015+0000 7fe6e4338700 1 -- start start 2023-07-25T14:37:22.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.016+0000 7fe6e4338700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fe6dc0bf5d0 0x7fe6dc0a7490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:22.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.016+0000 7fe6e4338700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe6dc06ed70 0x7fe6dc0bf9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:22.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.016+0000 7fe6e4338700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6dc066050 con 0x7fe6dc06a190 2023-07-25T14:37:22.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.016+0000 7fe6e4338700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6dc06b560 con 0x7fe6dc0bf5d0 2023-07-25T14:37:22.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.016+0000 7fe6e4338700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6dc151be0 con 0x7fe6dc06ed70 2023-07-25T14:37:22.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.016+0000 7fe6e28d5700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fe6dc06a190 0x7fe6dc157830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:33678/0 (socket says 172.21.15.72:33678) 2023-07-25T14:37:22.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.016+0000 7fe6e28d5700 1 -- 172.21.15.72:0/1933677124 learned_addr learned my addr 172.21.15.72:0/1933677124 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:37:22.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.016+0000 7fe6e20d4700 1 --2- 172.21.15.72:0/1933677124 >> v2:172.21.15.92:3300/0 conn(0x7fe6dc0bf5d0 0x7fe6dc0a7490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:22.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.016+0000 7fe6e18d3700 1 --2- 172.21.15.72:0/1933677124 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe6dc06ed70 0x7fe6dc0bf9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:22.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.016+0000 7fe6e10d2700 1 -- 172.21.15.72:0/1933677124 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3248868910 0 0) 0x7fe6dc066050 con 0x7fe6dc06a190 2023-07-25T14:37:22.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.016+0000 7fe6e10d2700 1 -- 172.21.15.72:0/1933677124 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe6c80035b0 con 0x7fe6dc06a190 2023-07-25T14:37:22.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.016+0000 7fe6e10d2700 1 -- 172.21.15.72:0/1933677124 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1646867069 0 0) 0x7fe6c80035b0 con 0x7fe6dc06a190 2023-07-25T14:37:22.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.016+0000 7fe6e10d2700 1 -- 172.21.15.72:0/1933677124 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe6dc06ed70 msgr2=0x7fe6dc0bf9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:22.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.016+0000 7fe6e10d2700 1 --2- 172.21.15.72:0/1933677124 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe6dc06ed70 0x7fe6dc0bf9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:22.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.016+0000 7fe6e10d2700 1 -- 172.21.15.72:0/1933677124 >> v2:172.21.15.92:3300/0 conn(0x7fe6dc0bf5d0 msgr2=0x7fe6dc0a7490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:22.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.016+0000 7fe6e10d2700 1 --2- 172.21.15.72:0/1933677124 >> v2:172.21.15.92:3300/0 conn(0x7fe6dc0bf5d0 0x7fe6dc0a7490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:22.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.016+0000 7fe6e10d2700 1 -- 172.21.15.72:0/1933677124 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6dc154d60 con 0x7fe6dc06a190 2023-07-25T14:37:22.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.016+0000 7fe6e10d2700 1 -- 172.21.15.72:0/1933677124 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2559588315 0 0) 0x7fe6d40019f0 con 0x7fe6dc06a190 2023-07-25T14:37:22.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.016+0000 7fe6e10d2700 1 -- 172.21.15.72:0/1933677124 >> v1:172.21.15.72:6789/0 conn(0x7fe6dc06a190 legacy=0x7fe6dc157830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:22.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.016+0000 7fe6e10d2700 1 --2- 172.21.15.72:0/1933677124 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe6dc06ed70 0x7fe6c8003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:22.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.016+0000 7fe6e10d2700 1 --2- 172.21.15.72:0/1933677124 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe6c8003f80 0x7fe6c8004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:22.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.016+0000 7fe6e10d2700 1 --2- 172.21.15.72:0/1933677124 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe6c8004d90 0x7fe6c8005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:22.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.016+0000 7fe6e10d2700 1 -- 172.21.15.72:0/1933677124 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6dc06b560 con 0x7fe6c8004d90 2023-07-25T14:37:22.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.017+0000 7fe6e10d2700 1 -- 172.21.15.72:0/1933677124 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6dc151be0 con 0x7fe6c8003f80 2023-07-25T14:37:22.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.017+0000 7fe6e10d2700 1 -- 172.21.15.72:0/1933677124 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6c800ba10 con 0x7fe6dc06ed70 2023-07-25T14:37:22.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.017+0000 7fe6e28d5700 1 --2- 172.21.15.72:0/1933677124 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe6c8004d90 0x7fe6c8005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:22.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.017+0000 7fe6e18d3700 1 --2- 172.21.15.72:0/1933677124 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe6c8003f80 0x7fe6c8004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:22.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.017+0000 7fe6e20d4700 1 --2- 172.21.15.72:0/1933677124 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe6dc06ed70 0x7fe6c8003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:22.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.017+0000 7fe6e28d5700 1 -- 172.21.15.72:0/1933677124 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe6dc06ed70 msgr2=0x7fe6c8003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:22.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.017+0000 7fe6e28d5700 1 --2- 172.21.15.72:0/1933677124 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe6dc06ed70 0x7fe6c8003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:22.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.017+0000 7fe6e28d5700 1 -- 172.21.15.72:0/1933677124 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe6c8003f80 msgr2=0x7fe6c8004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:22.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.017+0000 7fe6e28d5700 1 --2- 172.21.15.72:0/1933677124 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe6c8003f80 0x7fe6c8004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:22.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.017+0000 7fe6e28d5700 1 -- 172.21.15.72:0/1933677124 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6c80035b0 con 0x7fe6c8004d90 2023-07-25T14:37:22.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.017+0000 7fe6e28d5700 1 --2- 172.21.15.72:0/1933677124 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe6c8004d90 0x7fe6c8005210 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fe6dc070c50 tx=0x7fe6c8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b1e053d335d6057 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:22.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.017+0000 7fe6e10d2700 1 -- 172.21.15.72:0/1933677124 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6d400a340 con 0x7fe6c8004d90 2023-07-25T14:37:22.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.017+0000 7fe6e10d2700 1 -- 172.21.15.72:0/1933677124 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6d4012600 con 0x7fe6c8004d90 2023-07-25T14:37:22.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.017+0000 7fe6e10d2700 1 -- 172.21.15.72:0/1933677124 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6d40129b0 con 0x7fe6c8004d90 2023-07-25T14:37:22.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.018+0000 7fe6e4338700 1 -- 172.21.15.72:0/1933677124 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe6c8004d90 msgr2=0x7fe6c8005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:22.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.018+0000 7fe6e4338700 1 --2- 172.21.15.72:0/1933677124 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe6c8004d90 0x7fe6c8005210 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fe6dc070c50 tx=0x7fe6c8005880 comp rx=0 tx=0).stop 2023-07-25T14:37:22.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.018+0000 7fe6e28d5700 1 -- 172.21.15.72:0/1933677124 reap_dead start 2023-07-25T14:37:22.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.018+0000 7fe6e4338700 1 -- 172.21.15.72:0/1933677124 shutdown_connections 2023-07-25T14:37:22.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.018+0000 7fe6e4338700 1 -- 172.21.15.72:0/1933677124 >> 172.21.15.72:0/1933677124 conn(0x7fe6dc06def0 msgr2=0x7fe6dc06e300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:22.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.018+0000 7fe6e4338700 1 -- 172.21.15.72:0/1933677124 shutdown_connections 2023-07-25T14:37:22.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.018+0000 7fe6e4338700 1 -- 172.21.15.72:0/1933677124 wait complete. 2023-07-25T14:37:22.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.019+0000 7fe6e4338700 1 Processor -- start 2023-07-25T14:37:22.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.019+0000 7fe6e4338700 1 -- start start 2023-07-25T14:37:22.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.020+0000 7fe6e4338700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe6c8004d90 0x7fe6dc0c19b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:22.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.020+0000 7fe6e4338700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe6dc14cc40 0x7fe6dc14bef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:22.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.020+0000 7fe6e4338700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe6dc14c430 0x7fe6dc1ed2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:22.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.020+0000 7fe6e4338700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6dc157510 con 0x7fe6c8004d90 2023-07-25T14:37:22.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.020+0000 7fe6e4338700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6dc1e1950 con 0x7fe6dc14c430 2023-07-25T14:37:22.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.020+0000 7fe6e4338700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6dc1e0dc0 con 0x7fe6dc14cc40 2023-07-25T14:37:22.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.020+0000 7fe6e20d4700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe6c8004d90 0x7fe6dc0c19b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:22.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.020+0000 7fe6e20d4700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe6c8004d90 0x7fe6dc0c19b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42950/0 (socket says 172.21.15.72:42950) 2023-07-25T14:37:22.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.020+0000 7fe6e20d4700 1 -- 172.21.15.72:0/2124992356 learned_addr learned my addr 172.21.15.72:0/2124992356 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:37:22.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.020+0000 7fe6e28d5700 1 --2- 172.21.15.72:0/2124992356 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe6dc14c430 0x7fe6dc1ed2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:22.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.020+0000 7fe6e20d4700 1 -- 172.21.15.72:0/2124992356 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe6dc14cc40 msgr2=0x7fe6dc14bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:22.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.020+0000 7fe6e20d4700 1 --2- 172.21.15.72:0/2124992356 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe6dc14cc40 0x7fe6dc14bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:22.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.020+0000 7fe6e20d4700 1 -- 172.21.15.72:0/2124992356 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe6dc14c430 msgr2=0x7fe6dc1ed2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:22.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.020+0000 7fe6e20d4700 1 --2- 172.21.15.72:0/2124992356 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe6dc14c430 0x7fe6dc1ed2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:22.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.020+0000 7fe6e20d4700 1 -- 172.21.15.72:0/2124992356 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6dc0ac310 con 0x7fe6c8004d90 2023-07-25T14:37:22.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.020+0000 7fe6e20d4700 1 --2- 172.21.15.72:0/2124992356 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe6c8004d90 0x7fe6dc0c19b0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fe6d8011aa0 tx=0x7fe6d8011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:22.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.020+0000 7fe6d2ffd700 1 -- 172.21.15.72:0/2124992356 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6d800f9e0 con 0x7fe6c8004d90 2023-07-25T14:37:22.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.020+0000 7fe6d2ffd700 1 -- 172.21.15.72:0/2124992356 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6d800fb40 con 0x7fe6c8004d90 2023-07-25T14:37:22.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.020+0000 7fe6e4338700 1 -- 172.21.15.72:0/2124992356 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6dc158720 con 0x7fe6c8004d90 2023-07-25T14:37:22.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.020+0000 7fe6d2ffd700 1 -- 172.21.15.72:0/2124992356 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6d8014440 con 0x7fe6c8004d90 2023-07-25T14:37:22.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.020+0000 7fe6e4338700 1 -- 172.21.15.72:0/2124992356 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6dc0abfa0 con 0x7fe6c8004d90 2023-07-25T14:37:22.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.021+0000 7fe6e4338700 1 -- 172.21.15.72:0/2124992356 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6dc0abe00 con 0x7fe6c8004d90 2023-07-25T14:37:22.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.022+0000 7fe6d2ffd700 1 -- 172.21.15.72:0/2124992356 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe6d80145a0 con 0x7fe6c8004d90 2023-07-25T14:37:22.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.022+0000 7fe6d2ffd700 1 --2- 172.21.15.72:0/2124992356 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fe6c006ace0 0x7fe6c006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:22.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.022+0000 7fe6d2ffd700 1 -- 172.21.15.72:0/2124992356 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 7238+0+0 (secure 0 0 0) 0x7fe6d808a180 con 0x7fe6c8004d90 2023-07-25T14:37:22.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.022+0000 7fe6e18d3700 1 --2- 172.21.15.72:0/2124992356 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fe6c006ace0 0x7fe6c006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:22.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.022+0000 7fe6e18d3700 1 --2- 172.21.15.72:0/2124992356 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fe6c006ace0 0x7fe6c006d1a0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fe6dc1dfd90 tx=0x7fe6cc0093c0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:22.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.026+0000 7fe6d2ffd700 1 -- 172.21.15.72:0/2124992356 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fe6dc0abe00 con 0x7fe6c8004d90 2023-07-25T14:37:22.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.217+0000 7fe6e4338700 1 -- 172.21.15.72:0/2124992356 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe6dc0abe00 con 0x7fe6c8004d90 2023-07-25T14:37:22.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.217+0000 7fe6d2ffd700 1 -- 172.21.15.72:0/2124992356 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v43) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe6dc0abe00 con 0x7fe6c8004d90 2023-07-25T14:37:22.228 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 64 2023-07-25T14:37:22.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.219+0000 7fe6e4338700 1 -- 172.21.15.72:0/2124992356 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fe6c006ace0 msgr2=0x7fe6c006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:22.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.219+0000 7fe6e4338700 1 --2- 172.21.15.72:0/2124992356 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fe6c006ace0 0x7fe6c006d1a0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fe6dc1dfd90 tx=0x7fe6cc0093c0 comp rx=0 tx=0).stop 2023-07-25T14:37:22.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.219+0000 7fe6e4338700 1 -- 172.21.15.72:0/2124992356 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe6c8004d90 msgr2=0x7fe6dc0c19b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:22.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.219+0000 7fe6e4338700 1 --2- 172.21.15.72:0/2124992356 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe6c8004d90 0x7fe6dc0c19b0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fe6d8011aa0 tx=0x7fe6d8011e60 comp rx=0 tx=0).stop 2023-07-25T14:37:22.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.219+0000 7fe6e4338700 1 -- 172.21.15.72:0/2124992356 shutdown_connections 2023-07-25T14:37:22.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.219+0000 7fe6e4338700 1 --2- 172.21.15.72:0/2124992356 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fe6c006ace0 0x7fe6c006d1a0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:22.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.219+0000 7fe6e4338700 1 --2- 172.21.15.72:0/2124992356 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe6dc14c430 0x7fe6dc1ed2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:22.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.219+0000 7fe6e4338700 1 --2- 172.21.15.72:0/2124992356 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe6c8004d90 0x7fe6dc0c19b0 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:22.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.219+0000 7fe6e4338700 1 --2- 172.21.15.72:0/2124992356 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe6dc14cc40 0x7fe6dc14bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:22.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.219+0000 7fe6e4338700 1 -- 172.21.15.72:0/2124992356 >> 172.21.15.72:0/2124992356 conn(0x7fe6dc06def0 msgr2=0x7fe6dc154370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:22.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.220+0000 7fe6e4338700 1 -- 172.21.15.72:0/2124992356 shutdown_connections 2023-07-25T14:37:22.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.220+0000 7fe6e4338700 1 -- 172.21.15.72:0/2124992356 wait complete. 2023-07-25T14:37:22.242 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-07-25T14:37:22.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.356+0000 7f10c583f700 1 Processor -- start 2023-07-25T14:37:22.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.356+0000 7f10c583f700 1 -- start start 2023-07-25T14:37:22.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.357+0000 7f10c583f700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f10c00bead0 0x7f10c00c0350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:22.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.357+0000 7f10c583f700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f10c00c0890 0x7f10c00c44d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:22.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.357+0000 7f10c583f700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10c00bfeb0 con 0x7f10c0151a90 2023-07-25T14:37:22.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.357+0000 7f10c583f700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10c00c10b0 con 0x7f10c00c0890 2023-07-25T14:37:22.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.357+0000 7f10c583f700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10c00c1940 con 0x7f10c00bead0 2023-07-25T14:37:22.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.357+0000 7f10bf7fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f10c00c0890 0x7f10c00c44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:22.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.357+0000 7f10bf7fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f10c00c0890 0x7f10c00c44d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42960/0 (socket says 172.21.15.72:42960) 2023-07-25T14:37:22.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.357+0000 7f10beffd700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f10c0151a90 0x7f10c0154d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:33694/0 (socket says 172.21.15.72:33694) 2023-07-25T14:37:22.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.357+0000 7f10bf7fe700 1 -- 172.21.15.72:0/3723358194 learned_addr learned my addr 172.21.15.72:0/3723358194 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:37:22.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.357+0000 7f10be7fc700 1 --2- 172.21.15.72:0/3723358194 >> v2:172.21.15.92:3300/0 conn(0x7f10c00bead0 0x7f10c00c0350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:22.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.357+0000 7f10bf7fe700 1 -- 172.21.15.72:0/3723358194 >> v2:172.21.15.92:3300/0 conn(0x7f10c00bead0 msgr2=0x7f10c00c0350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:22.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.357+0000 7f10bf7fe700 1 --2- 172.21.15.72:0/3723358194 >> v2:172.21.15.92:3300/0 conn(0x7f10c00bead0 0x7f10c00c0350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:22.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.357+0000 7f10bf7fe700 1 -- 172.21.15.72:0/3723358194 >> v1:172.21.15.72:6789/0 conn(0x7f10c0151a90 legacy=0x7f10c0154d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:22.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.357+0000 7f10bf7fe700 1 -- 172.21.15.72:0/3723358194 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10c00bf2e0 con 0x7f10c00c0890 2023-07-25T14:37:22.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.357+0000 7f10bdffb700 1 -- 172.21.15.72:0/3723358194 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2718554256 0 0) 0x7f10c00bfeb0 con 0x7f10c0151a90 2023-07-25T14:37:22.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.358+0000 7f10bf7fe700 1 --2- 172.21.15.72:0/3723358194 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f10c00c0890 0x7f10c00c44d0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f10c006cf50 tx=0x7f10b800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25aa22c0f2fa8c9 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:22.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.358+0000 7f10bdffb700 1 -- 172.21.15.72:0/3723358194 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10b800e070 con 0x7f10c00c0890 2023-07-25T14:37:22.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.358+0000 7f10bdffb700 1 -- 172.21.15.72:0/3723358194 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10b800b9c0 con 0x7f10c00c0890 2023-07-25T14:37:22.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.358+0000 7f10bdffb700 1 -- 172.21.15.72:0/3723358194 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10b800bd70 con 0x7f10c00c0890 2023-07-25T14:37:22.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.358+0000 7f10c583f700 1 -- 172.21.15.72:0/3723358194 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f10c00c0890 msgr2=0x7f10c00c44d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:22.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.358+0000 7f10c583f700 1 --2- 172.21.15.72:0/3723358194 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f10c00c0890 0x7f10c00c44d0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f10c006cf50 tx=0x7f10b800b330 comp rx=0 tx=0).stop 2023-07-25T14:37:22.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.358+0000 7f10c583f700 1 -- 172.21.15.72:0/3723358194 shutdown_connections 2023-07-25T14:37:22.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.358+0000 7f10c583f700 1 --2- 172.21.15.72:0/3723358194 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f10c00c0890 0x7f10c00c44d0 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:22.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.358+0000 7f10c583f700 1 --2- 172.21.15.72:0/3723358194 >> v2:172.21.15.92:3300/0 conn(0x7f10c00bead0 0x7f10c00c0350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:22.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.358+0000 7f10c583f700 1 -- 172.21.15.72:0/3723358194 >> 172.21.15.72:0/3723358194 conn(0x7f10c006c3a0 msgr2=0x7f10c006c780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:22.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.358+0000 7f10c583f700 1 -- 172.21.15.72:0/3723358194 shutdown_connections 2023-07-25T14:37:22.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.358+0000 7f10c583f700 1 -- 172.21.15.72:0/3723358194 wait complete. 2023-07-25T14:37:22.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.359+0000 7f10c583f700 1 Processor -- start 2023-07-25T14:37:22.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.360+0000 7f10c583f700 1 -- start start 2023-07-25T14:37:22.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.360+0000 7f10c583f700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f10c00bead0 0x7f10c0145ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:22.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.360+0000 7f10c583f700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f10c00c0890 0x7f10c00c9300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:22.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.360+0000 7f10c583f700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f10c0151a90 0x7f10c00c9840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:22.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.360+0000 7f10c583f700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10c00caa50 con 0x7f10c0151a90 2023-07-25T14:37:22.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.360+0000 7f10c583f700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10c01e9480 con 0x7f10c00bead0 2023-07-25T14:37:22.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.360+0000 7f10c583f700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10c01e9720 con 0x7f10c00c0890 2023-07-25T14:37:22.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.360+0000 7f10bf7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f10c0151a90 0x7f10c00c9840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:22.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.360+0000 7f10bf7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f10c0151a90 0x7f10c00c9840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42966/0 (socket says 172.21.15.72:42966) 2023-07-25T14:37:22.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.360+0000 7f10bf7fe700 1 -- 172.21.15.72:0/3264468866 learned_addr learned my addr 172.21.15.72:0/3264468866 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:37:22.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.361+0000 7f10beffd700 1 --2- 172.21.15.72:0/3264468866 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f10c00bead0 0x7f10c0145ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:22.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.361+0000 7f10be7fc700 1 --2- 172.21.15.72:0/3264468866 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f10c00c0890 0x7f10c00c9300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:22.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.361+0000 7f10bf7fe700 1 -- 172.21.15.72:0/3264468866 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f10c00c0890 msgr2=0x7f10c00c9300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:22.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.361+0000 7f10bf7fe700 1 --2- 172.21.15.72:0/3264468866 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f10c00c0890 0x7f10c00c9300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:22.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.361+0000 7f10bf7fe700 1 -- 172.21.15.72:0/3264468866 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f10c00bead0 msgr2=0x7f10c0145ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:22.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.361+0000 7f10bf7fe700 1 --2- 172.21.15.72:0/3264468866 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f10c00bead0 0x7f10c0145ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:22.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.361+0000 7f10bf7fe700 1 -- 172.21.15.72:0/3264468866 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10b8009b30 con 0x7f10c0151a90 2023-07-25T14:37:22.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.361+0000 7f10be7fc700 1 --2- 172.21.15.72:0/3264468866 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f10c00c0890 0x7f10c00c9300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-25T14:37:22.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.361+0000 7f10bf7fe700 1 --2- 172.21.15.72:0/3264468866 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f10c0151a90 0x7f10c00c9840 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f10c006d1b0 tx=0x7f10b8004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:22.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.361+0000 7f10a7fff700 1 -- 172.21.15.72:0/3264468866 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10b80048f0 con 0x7f10c0151a90 2023-07-25T14:37:22.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.361+0000 7f10a7fff700 1 -- 172.21.15.72:0/3264468866 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10b80099b0 con 0x7f10c0151a90 2023-07-25T14:37:22.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.361+0000 7f10c583f700 1 -- 172.21.15.72:0/3264468866 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10c01e9a00 con 0x7f10c0151a90 2023-07-25T14:37:22.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.361+0000 7f10a7fff700 1 -- 172.21.15.72:0/3264468866 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10b801c680 con 0x7f10c0151a90 2023-07-25T14:37:22.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.361+0000 7f10c583f700 1 -- 172.21.15.72:0/3264468866 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10c01460e0 con 0x7f10c0151a90 2023-07-25T14:37:22.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.362+0000 7f10c583f700 1 -- 172.21.15.72:0/3264468866 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10c00c7ea0 con 0x7f10c0151a90 2023-07-25T14:37:22.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.363+0000 7f10a7fff700 1 -- 172.21.15.72:0/3264468866 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f10b801c7e0 con 0x7f10c0151a90 2023-07-25T14:37:22.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.363+0000 7f10a7fff700 1 --2- 172.21.15.72:0/3264468866 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f10ac06ace0 0x7f10ac06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:22.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.363+0000 7f10a7fff700 1 -- 172.21.15.72:0/3264468866 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 7238+0+0 (secure 0 0 0) 0x7f10b808b4c0 con 0x7f10c0151a90 2023-07-25T14:37:22.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.363+0000 7f10beffd700 1 --2- 172.21.15.72:0/3264468866 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f10ac06ace0 0x7f10ac06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:22.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.363+0000 7f10beffd700 1 --2- 172.21.15.72:0/3264468866 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f10ac06ace0 0x7f10ac06d1a0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f10b4007fd0 tx=0x7f10b4007de0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:22.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.367+0000 7f10a7fff700 1 -- 172.21.15.72:0/3264468866 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f10b80560e0 con 0x7f10c0151a90 2023-07-25T14:37:22.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.552+0000 7f10c583f700 1 -- 172.21.15.72:0/3264468866 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7f10c01ea200 con 0x7f10c0151a90 2023-07-25T14:37:22.563 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.552+0000 7f10a7fff700 1 -- 172.21.15.72:0/3264468866 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v43) v1 ==== 105+0+11 (secure 0 0 0) 0x7f10c01ea200 con 0x7f10c0151a90 2023-07-25T14:37:22.563 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2023-07-25T14:37:22.565 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.555+0000 7f10c583f700 1 -- 172.21.15.72:0/3264468866 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f10ac06ace0 msgr2=0x7f10ac06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:22.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.555+0000 7f10c583f700 1 --2- 172.21.15.72:0/3264468866 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f10ac06ace0 0x7f10ac06d1a0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f10b4007fd0 tx=0x7f10b4007de0 comp rx=0 tx=0).stop 2023-07-25T14:37:22.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.555+0000 7f10c583f700 1 -- 172.21.15.72:0/3264468866 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f10c0151a90 msgr2=0x7f10c00c9840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:22.566 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.555+0000 7f10c583f700 1 --2- 172.21.15.72:0/3264468866 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f10c0151a90 0x7f10c00c9840 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f10c006d1b0 tx=0x7f10b8004ad0 comp rx=0 tx=0).stop 2023-07-25T14:37:22.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.555+0000 7f10c583f700 1 -- 172.21.15.72:0/3264468866 shutdown_connections 2023-07-25T14:37:22.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.555+0000 7f10c583f700 1 --2- 172.21.15.72:0/3264468866 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f10ac06ace0 0x7f10ac06d1a0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:22.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.555+0000 7f10c583f700 1 --2- 172.21.15.72:0/3264468866 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f10c0151a90 0x7f10c00c9840 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:22.567 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.555+0000 7f10c583f700 1 --2- 172.21.15.72:0/3264468866 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f10c00bead0 0x7f10c0145ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:22.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.555+0000 7f10c583f700 1 --2- 172.21.15.72:0/3264468866 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f10c00c0890 0x7f10c00c9300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:22.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.555+0000 7f10c583f700 1 -- 172.21.15.72:0/3264468866 >> 172.21.15.72:0/3264468866 conn(0x7f10c006c3a0 msgr2=0x7f10c00c3140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:22.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.555+0000 7f10c583f700 1 -- 172.21.15.72:0/3264468866 shutdown_connections 2023-07-25T14:37:22.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.555+0000 7f10c583f700 1 -- 172.21.15.72:0/3264468866 wait complete. 2023-07-25T14:37:22.577 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-07-25T14:37:22.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.689+0000 7f16cfa27700 1 Processor -- start 2023-07-25T14:37:22.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.690+0000 7f16cfa27700 1 -- start start 2023-07-25T14:37:22.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.690+0000 7f16cfa27700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f16c8151950 0x7f16c806a190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:22.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.691+0000 7f16cfa27700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f16c80724c0 0x7f16c80c34c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:22.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.691+0000 7f16cfa27700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16c80c2fe0 con 0x7f16c806a6d0 2023-07-25T14:37:22.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.691+0000 7f16cfa27700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16c8071a60 con 0x7f16c80724c0 2023-07-25T14:37:22.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.691+0000 7f16cfa27700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16c80c2a70 con 0x7f16c8151950 2023-07-25T14:37:22.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.691+0000 7f16cd7c3700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f16c8151950 0x7f16c806a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:22.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.691+0000 7f16ccfc2700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f16c80724c0 0x7f16c80c34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:22.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.691+0000 7f16ccfc2700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f16c80724c0 0x7f16c80c34c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.72:38542/0 (socket says 172.21.15.72:38542) 2023-07-25T14:37:22.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.691+0000 7f16cd7c3700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f16c8151950 0x7f16c806a190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3301/0 says I am v2:172.21.15.72:48198/0 (socket says 172.21.15.72:48198) 2023-07-25T14:37:22.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.691+0000 7f16ccfc2700 1 -- 172.21.15.72:0/3401424821 learned_addr learned my addr 172.21.15.72:0/3401424821 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:37:22.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.691+0000 7f16cdfc4700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f16c806a6d0 0x7f16c80c3a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.72:57284/0 (socket says 172.21.15.72:57284) 2023-07-25T14:37:22.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.691+0000 7f16cd7c3700 1 -- 172.21.15.72:0/3401424821 >> v2:172.21.15.92:3300/0 conn(0x7f16c80724c0 msgr2=0x7f16c80c34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:22.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.691+0000 7f16cd7c3700 1 --2- 172.21.15.72:0/3401424821 >> v2:172.21.15.92:3300/0 conn(0x7f16c80724c0 0x7f16c80c34c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:22.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.691+0000 7f16cd7c3700 1 -- 172.21.15.72:0/3401424821 >> v1:172.21.15.92:6789/0 conn(0x7f16c806a6d0 legacy=0x7f16c80c3a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:22.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.691+0000 7f16cd7c3700 1 -- 172.21.15.72:0/3401424821 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16c8155070 con 0x7f16c8151950 2023-07-25T14:37:22.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.691+0000 7f16ccfc2700 1 --2- 172.21.15.72:0/3401424821 >> v2:172.21.15.92:3300/0 conn(0x7f16c80724c0 0x7f16c80c34c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-25T14:37:22.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.692+0000 7f16cd7c3700 1 --2- 172.21.15.72:0/3401424821 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f16c8151950 0x7f16c806a190 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f16bc009840 tx=0x7f16bc009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=db0a6ce926c2692b server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:22.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.692+0000 7f16bbfff700 1 -- 172.21.15.72:0/3401424821 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16bc011830 con 0x7f16c8151950 2023-07-25T14:37:22.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.692+0000 7f16bbfff700 1 -- 172.21.15.72:0/3401424821 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16bc011990 con 0x7f16c8151950 2023-07-25T14:37:22.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.692+0000 7f16bbfff700 1 -- 172.21.15.72:0/3401424821 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16bc011d20 con 0x7f16c8151950 2023-07-25T14:37:22.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.692+0000 7f16cfa27700 1 -- 172.21.15.72:0/3401424821 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f16c8151950 msgr2=0x7f16c806a190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:22.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.692+0000 7f16cfa27700 1 --2- 172.21.15.72:0/3401424821 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f16c8151950 0x7f16c806a190 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f16bc009840 tx=0x7f16bc009b50 comp rx=0 tx=0).stop 2023-07-25T14:37:22.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.692+0000 7f16cfa27700 1 -- 172.21.15.72:0/3401424821 shutdown_connections 2023-07-25T14:37:22.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.692+0000 7f16cfa27700 1 --2- 172.21.15.72:0/3401424821 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f16c8151950 0x7f16c806a190 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:22.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.692+0000 7f16cfa27700 1 --2- 172.21.15.72:0/3401424821 >> v2:172.21.15.92:3300/0 conn(0x7f16c80724c0 0x7f16c80c34c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:22.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.692+0000 7f16cfa27700 1 -- 172.21.15.72:0/3401424821 >> 172.21.15.72:0/3401424821 conn(0x7f16c80a87e0 msgr2=0x7f16c80a8bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:22.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.692+0000 7f16cfa27700 1 -- 172.21.15.72:0/3401424821 shutdown_connections 2023-07-25T14:37:22.705 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.692+0000 7f16cfa27700 1 -- 172.21.15.72:0/3401424821 wait complete. 2023-07-25T14:37:22.707 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.693+0000 7f16cfa27700 1 Processor -- start 2023-07-25T14:37:22.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.693+0000 7f16cfa27700 1 -- start start 2023-07-25T14:37:22.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.694+0000 7f16cfa27700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f16c806a6d0 0x7f16c8152c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:22.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.694+0000 7f16cfa27700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f16c80724c0 0x7f16c806f930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:22.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.694+0000 7f16cfa27700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f16c8151950 0x7f16c80a9df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:22.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.694+0000 7f16cfa27700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16c81531b0 con 0x7f16c80724c0 2023-07-25T14:37:22.708 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.694+0000 7f16cfa27700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16c80a9860 con 0x7f16c8151950 2023-07-25T14:37:22.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.694+0000 7f16cfa27700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16c8152190 con 0x7f16c806a6d0 2023-07-25T14:37:22.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.694+0000 7f16ccfc2700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f16c80724c0 0x7f16c806f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:22.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.694+0000 7f16ccfc2700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f16c80724c0 0x7f16c806f930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42978/0 (socket says 172.21.15.72:42978) 2023-07-25T14:37:22.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.694+0000 7f16ccfc2700 1 -- 172.21.15.72:0/2186746626 learned_addr learned my addr 172.21.15.72:0/2186746626 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:37:22.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.694+0000 7f16cdfc4700 1 --2- 172.21.15.72:0/2186746626 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f16c8151950 0x7f16c80a9df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:22.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.694+0000 7f16cd7c3700 1 --2- 172.21.15.72:0/2186746626 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f16c806a6d0 0x7f16c8152c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:22.709 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.695+0000 7f16ccfc2700 1 -- 172.21.15.72:0/2186746626 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f16c806a6d0 msgr2=0x7f16c8152c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:22.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.695+0000 7f16ccfc2700 1 --2- 172.21.15.72:0/2186746626 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f16c806a6d0 0x7f16c8152c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:22.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.695+0000 7f16ccfc2700 1 -- 172.21.15.72:0/2186746626 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f16c8151950 msgr2=0x7f16c80a9df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:22.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.695+0000 7f16ccfc2700 1 --2- 172.21.15.72:0/2186746626 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f16c8151950 0x7f16c80a9df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:22.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.695+0000 7f16ccfc2700 1 -- 172.21.15.72:0/2186746626 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16c4009550 con 0x7f16c80724c0 2023-07-25T14:37:22.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.695+0000 7f16cd7c3700 1 --2- 172.21.15.72:0/2186746626 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f16c806a6d0 0x7f16c8152c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-25T14:37:22.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.695+0000 7f16ccfc2700 1 --2- 172.21.15.72:0/2186746626 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f16c80724c0 0x7f16c806f930 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f16c400ebb0 tx=0x7f16c400eec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:22.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.695+0000 7f16b9ffb700 1 -- 172.21.15.72:0/2186746626 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16c400c850 con 0x7f16c80724c0 2023-07-25T14:37:22.710 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.695+0000 7f16b9ffb700 1 -- 172.21.15.72:0/2186746626 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16c400c9b0 con 0x7f16c80724c0 2023-07-25T14:37:22.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.695+0000 7f16cfa27700 1 -- 172.21.15.72:0/2186746626 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16bc0094a0 con 0x7f16c80724c0 2023-07-25T14:37:22.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.695+0000 7f16b9ffb700 1 -- 172.21.15.72:0/2186746626 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16c400cd20 con 0x7f16c80724c0 2023-07-25T14:37:22.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.695+0000 7f16cfa27700 1 -- 172.21.15.72:0/2186746626 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16c8152750 con 0x7f16c80724c0 2023-07-25T14:37:22.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.696+0000 7f16cfa27700 1 -- 172.21.15.72:0/2186746626 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16c804e470 con 0x7f16c80724c0 2023-07-25T14:37:22.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.696+0000 7f16b9ffb700 1 -- 172.21.15.72:0/2186746626 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f16c4013470 con 0x7f16c80724c0 2023-07-25T14:37:22.711 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.697+0000 7f16b9ffb700 1 --2- 172.21.15.72:0/2186746626 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f16ac06ace0 0x7f16ac06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:22.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.697+0000 7f16b9ffb700 1 -- 172.21.15.72:0/2186746626 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 7238+0+0 (secure 0 0 0) 0x7f16c40899e0 con 0x7f16c80724c0 2023-07-25T14:37:22.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.697+0000 7f16cd7c3700 1 --2- 172.21.15.72:0/2186746626 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f16ac06ace0 0x7f16ac06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:22.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.697+0000 7f16cd7c3700 1 --2- 172.21.15.72:0/2186746626 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f16ac06ace0 0x7f16ac06d1a0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f16bc000c00 tx=0x7f16bc01c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:22.712 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.701+0000 7f16b9ffb700 1 -- 172.21.15.72:0/2186746626 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f16c4054680 con 0x7f16c80724c0 2023-07-25T14:37:22.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.887+0000 7f16cfa27700 1 -- 172.21.15.72:0/2186746626 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7f16c80722a0 con 0x7f16c80724c0 2023-07-25T14:37:22.898 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.888+0000 7f16b9ffb700 1 -- 172.21.15.72:0/2186746626 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v43) v1 ==== 101+0+11 (secure 0 0 0) 0x7f16c4057ca0 con 0x7f16c80724c0 2023-07-25T14:37:22.899 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 64 2023-07-25T14:37:22.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.890+0000 7f16cfa27700 1 -- 172.21.15.72:0/2186746626 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f16ac06ace0 msgr2=0x7f16ac06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:22.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.890+0000 7f16cfa27700 1 --2- 172.21.15.72:0/2186746626 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f16ac06ace0 0x7f16ac06d1a0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f16bc000c00 tx=0x7f16bc01c040 comp rx=0 tx=0).stop 2023-07-25T14:37:22.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.890+0000 7f16cfa27700 1 -- 172.21.15.72:0/2186746626 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f16c80724c0 msgr2=0x7f16c806f930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:22.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.890+0000 7f16cfa27700 1 --2- 172.21.15.72:0/2186746626 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f16c80724c0 0x7f16c806f930 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f16c400ebb0 tx=0x7f16c400eec0 comp rx=0 tx=0).stop 2023-07-25T14:37:22.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.890+0000 7f16cfa27700 1 -- 172.21.15.72:0/2186746626 shutdown_connections 2023-07-25T14:37:22.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.890+0000 7f16cfa27700 1 --2- 172.21.15.72:0/2186746626 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f16ac06ace0 0x7f16ac06d1a0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:22.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.890+0000 7f16cfa27700 1 --2- 172.21.15.72:0/2186746626 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f16c806a6d0 0x7f16c8152c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:22.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.890+0000 7f16cfa27700 1 --2- 172.21.15.72:0/2186746626 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f16c8151950 0x7f16c80a9df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:22.902 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.890+0000 7f16cfa27700 1 --2- 172.21.15.72:0/2186746626 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f16c80724c0 0x7f16c806f930 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:22.902 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.890+0000 7f16cfa27700 1 -- 172.21.15.72:0/2186746626 >> 172.21.15.72:0/2186746626 conn(0x7f16c80a87e0 msgr2=0x7f16c80c34c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:22.902 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.890+0000 7f16cfa27700 1 -- 172.21.15.72:0/2186746626 shutdown_connections 2023-07-25T14:37:22.902 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:22.890+0000 7f16cfa27700 1 -- 172.21.15.72:0/2186746626 wait complete. 2023-07-25T14:37:22.912 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-25T14:37:23.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.021+0000 7f4ebf6c7700 1 Processor -- start 2023-07-25T14:37:23.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.021+0000 7f4ebf6c7700 1 -- start start 2023-07-25T14:37:23.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.022+0000 7f4ebf6c7700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4eb8151ba0 0x7f4eb80c2230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:23.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.022+0000 7f4ebf6c7700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f4eb80c5f40 0x7f4eb8154640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:23.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.022+0000 7f4ebf6c7700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f4eb80ba0e0 0x7f4eb8154b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:23.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.022+0000 7f4ebf6c7700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4eb80c54f0 con 0x7f4eb80c5f40 2023-07-25T14:37:23.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.022+0000 7f4ebf6c7700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4eb80c6670 con 0x7f4eb80ba0e0 2023-07-25T14:37:23.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.022+0000 7f4ebf6c7700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4eb80c5740 con 0x7f4eb8151ba0 2023-07-25T14:37:23.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.022+0000 7f4ebcc62700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f4eb80c5f40 0x7f4eb8154640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:23.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.022+0000 7f4ebcc62700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f4eb80c5f40 0x7f4eb8154640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42986/0 (socket says 172.21.15.72:42986) 2023-07-25T14:37:23.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.022+0000 7f4ebcc62700 1 -- 172.21.15.72:0/3707037414 learned_addr learned my addr 172.21.15.72:0/3707037414 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:37:23.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.022+0000 7f4ebdc64700 1 --2- 172.21.15.72:0/3707037414 >> v2:172.21.15.92:3300/0 conn(0x7f4eb80ba0e0 0x7f4eb8154b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:23.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.022+0000 7f4ebd463700 1 --2- 172.21.15.72:0/3707037414 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4eb8151ba0 0x7f4eb80c2230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:23.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.022+0000 7f4ebcc62700 1 -- 172.21.15.72:0/3707037414 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4eb8151ba0 msgr2=0x7f4eb80c2230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:23.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.022+0000 7f4ebcc62700 1 --2- 172.21.15.72:0/3707037414 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4eb8151ba0 0x7f4eb80c2230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:23.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.022+0000 7f4ebcc62700 1 -- 172.21.15.72:0/3707037414 >> v2:172.21.15.92:3300/0 conn(0x7f4eb80ba0e0 msgr2=0x7f4eb8154b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:23.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.022+0000 7f4ebcc62700 1 --2- 172.21.15.72:0/3707037414 >> v2:172.21.15.92:3300/0 conn(0x7f4eb80ba0e0 0x7f4eb8154b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:23.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.022+0000 7f4ebcc62700 1 -- 172.21.15.72:0/3707037414 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4eb80c5a20 con 0x7f4eb80c5f40 2023-07-25T14:37:23.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.022+0000 7f4ebcc62700 1 --2- 172.21.15.72:0/3707037414 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4eb80c5f40 0x7f4eb8154640 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f4eb806ec00 tx=0x7f4eb4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f63853d9ff3b02f server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:23.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.023+0000 7f4eaffff700 1 -- 172.21.15.72:0/3707037414 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4eb400b870 con 0x7f4eb80c5f40 2023-07-25T14:37:23.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.023+0000 7f4eaffff700 1 -- 172.21.15.72:0/3707037414 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4eb400b9d0 con 0x7f4eb80c5f40 2023-07-25T14:37:23.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.023+0000 7f4eaffff700 1 -- 172.21.15.72:0/3707037414 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4eb400bd60 con 0x7f4eb80c5f40 2023-07-25T14:37:23.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.023+0000 7f4ebf6c7700 1 -- 172.21.15.72:0/3707037414 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4eb80c5f40 msgr2=0x7f4eb8154640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:23.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.023+0000 7f4ebf6c7700 1 --2- 172.21.15.72:0/3707037414 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4eb80c5f40 0x7f4eb8154640 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f4eb806ec00 tx=0x7f4eb4009bd0 comp rx=0 tx=0).stop 2023-07-25T14:37:23.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.023+0000 7f4ebf6c7700 1 -- 172.21.15.72:0/3707037414 shutdown_connections 2023-07-25T14:37:23.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.023+0000 7f4ebf6c7700 1 --2- 172.21.15.72:0/3707037414 >> v2:172.21.15.92:3300/0 conn(0x7f4eb80ba0e0 0x7f4eb8154b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:23.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.023+0000 7f4ebf6c7700 1 --2- 172.21.15.72:0/3707037414 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4eb8151ba0 0x7f4eb80c2230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:23.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.023+0000 7f4ebf6c7700 1 --2- 172.21.15.72:0/3707037414 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4eb80c5f40 0x7f4eb8154640 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:23.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.023+0000 7f4ebf6c7700 1 -- 172.21.15.72:0/3707037414 >> 172.21.15.72:0/3707037414 conn(0x7f4eb80a87e0 msgr2=0x7f4eb80a8bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:23.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.023+0000 7f4ebf6c7700 1 -- 172.21.15.72:0/3707037414 shutdown_connections 2023-07-25T14:37:23.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.023+0000 7f4ebf6c7700 1 -- 172.21.15.72:0/3707037414 wait complete. 2023-07-25T14:37:23.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.025+0000 7f4ebf6c7700 1 Processor -- start 2023-07-25T14:37:23.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.025+0000 7f4ebf6c7700 1 -- start start 2023-07-25T14:37:23.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.026+0000 7f4ebf6c7700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4eb80ba0e0 0x7f4eb80ac240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:23.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.026+0000 7f4ebf6c7700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4eb80c5f40 0x7f4eb81e7a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:23.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.026+0000 7f4ebf6c7700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4eb8151ba0 0x7f4eb81e7f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:23.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.026+0000 7f4ebf6c7700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4eb80a7ef0 con 0x7f4eb80c5f40 2023-07-25T14:37:23.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.026+0000 7f4ebf6c7700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4eb80aa5c0 con 0x7f4eb8151ba0 2023-07-25T14:37:23.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.026+0000 7f4ebf6c7700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4eb80aaa50 con 0x7f4eb80ba0e0 2023-07-25T14:37:23.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.026+0000 7f4ebcc62700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4eb80c5f40 0x7f4eb81e7a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:23.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.026+0000 7f4ebcc62700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4eb80c5f40 0x7f4eb81e7a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:42992/0 (socket says 172.21.15.72:42992) 2023-07-25T14:37:23.042 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.026+0000 7f4ebcc62700 1 -- 172.21.15.72:0/655574199 learned_addr learned my addr 172.21.15.72:0/655574199 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:37:23.042 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.026+0000 7f4ebd463700 1 --2- 172.21.15.72:0/655574199 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4eb80ba0e0 0x7f4eb80ac240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:23.042 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.026+0000 7f4ebdc64700 1 --2- 172.21.15.72:0/655574199 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4eb8151ba0 0x7f4eb81e7f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:23.042 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.026+0000 7f4ebcc62700 1 -- 172.21.15.72:0/655574199 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4eb80ba0e0 msgr2=0x7f4eb80ac240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:23.042 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.026+0000 7f4ebcc62700 1 --2- 172.21.15.72:0/655574199 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4eb80ba0e0 0x7f4eb80ac240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:23.042 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.026+0000 7f4ebcc62700 1 -- 172.21.15.72:0/655574199 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4eb8151ba0 msgr2=0x7f4eb81e7f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:23.042 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.026+0000 7f4ebcc62700 1 --2- 172.21.15.72:0/655574199 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4eb8151ba0 0x7f4eb81e7f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:23.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.026+0000 7f4ebcc62700 1 -- 172.21.15.72:0/655574199 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4eb4009550 con 0x7f4eb80c5f40 2023-07-25T14:37:23.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.026+0000 7f4ebdc64700 1 --2- 172.21.15.72:0/655574199 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4eb8151ba0 0x7f4eb81e7f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-25T14:37:23.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.026+0000 7f4ebcc62700 1 --2- 172.21.15.72:0/655574199 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4eb80c5f40 0x7f4eb81e7a30 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f4eb4000c00 tx=0x7f4eb4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:23.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.026+0000 7f4eadffb700 1 -- 172.21.15.72:0/655574199 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4eb4004540 con 0x7f4eb80c5f40 2023-07-25T14:37:23.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.026+0000 7f4eadffb700 1 -- 172.21.15.72:0/655574199 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4eb40036a0 con 0x7f4eb80c5f40 2023-07-25T14:37:23.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.026+0000 7f4ebf6c7700 1 -- 172.21.15.72:0/655574199 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4eb81554b0 con 0x7f4eb80c5f40 2023-07-25T14:37:23.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.026+0000 7f4eadffb700 1 -- 172.21.15.72:0/655574199 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4eb4003a50 con 0x7f4eb80c5f40 2023-07-25T14:37:23.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.027+0000 7f4ebf6c7700 1 -- 172.21.15.72:0/655574199 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4eb80aa250 con 0x7f4eb80c5f40 2023-07-25T14:37:23.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.027+0000 7f4ebf6c7700 1 -- 172.21.15.72:0/655574199 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4eb80a8380 con 0x7f4eb80c5f40 2023-07-25T14:37:23.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.029+0000 7f4eadffb700 1 -- 172.21.15.72:0/655574199 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4eb4021070 con 0x7f4eb80c5f40 2023-07-25T14:37:23.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.029+0000 7f4eadffb700 1 --2- 172.21.15.72:0/655574199 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f4e9c06ace0 0x7f4e9c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:23.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.029+0000 7f4eadffb700 1 -- 172.21.15.72:0/655574199 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 7238+0+0 (secure 0 0 0) 0x7f4eb408b4e0 con 0x7f4eb80c5f40 2023-07-25T14:37:23.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.030+0000 7f4ebd463700 1 --2- 172.21.15.72:0/655574199 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f4e9c06ace0 0x7f4e9c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:23.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.030+0000 7f4ebd463700 1 --2- 172.21.15.72:0/655574199 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f4e9c06ace0 0x7f4e9c06d1a0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f4eb8155440 tx=0x7f4ea8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:23.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.033+0000 7f4eadffb700 1 -- 172.21.15.72:0/655574199 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f4eb4056260 con 0x7f4eb80c5f40 2023-07-25T14:37:23.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.258+0000 7f4ebf6c7700 1 -- 172.21.15.72:0/655574199 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4eb804e470 con 0x7f4eb80c5f40 2023-07-25T14:37:23.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.259+0000 7f4eadffb700 1 -- 172.21.15.72:0/655574199 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+5813 (secure 0 0 0) 0x7f4eb4015070 con 0x7f4eb80c5f40 2023-07-25T14:37:23.269 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-25T14:37:23.269 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":22,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5092,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6834/3640355071","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":3640355071},{"type":"v1","addr":"172.21.15.92:6834","nonce":3640355071}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5095,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/936080292","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6833","nonce":936080292},{"type":"v1","addr":"172.21.15.92:6835","nonce":936080292}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-25T14:36:49.567868+0000","modified":"2023-07-25T14:36:53.213193+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5331},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5331":{"gid":5331,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.72:6837/1193027887","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6835","nonce":1193027887},{"type":"v1","addr":"172.21.15.72:6837","nonce":1193027887}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-25T14:37:02.650515+0000","modified":"2023-07-25T14:37:06.294518+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5328},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5328":{"gid":5328,"name":"c","rank":0,"incarnation":18,"state":"up:active","state_seq":7,"addr":"172.21.15.72:6836/2944832990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":2944832990},{"type":"v1","addr":"172.21.15.72:6836","nonce":2944832990}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-07-25T14:37:23.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.261+0000 7f4ebf6c7700 1 -- 172.21.15.72:0/655574199 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f4e9c06ace0 msgr2=0x7f4e9c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:23.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.261+0000 7f4ebf6c7700 1 --2- 172.21.15.72:0/655574199 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f4e9c06ace0 0x7f4e9c06d1a0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f4eb8155440 tx=0x7f4ea8008040 comp rx=0 tx=0).stop 2023-07-25T14:37:23.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.261+0000 7f4ebf6c7700 1 -- 172.21.15.72:0/655574199 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4eb80c5f40 msgr2=0x7f4eb81e7a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:23.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.261+0000 7f4ebf6c7700 1 --2- 172.21.15.72:0/655574199 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4eb80c5f40 0x7f4eb81e7a30 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f4eb4000c00 tx=0x7f4eb4004750 comp rx=0 tx=0).stop 2023-07-25T14:37:23.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.261+0000 7f4ebf6c7700 1 -- 172.21.15.72:0/655574199 shutdown_connections 2023-07-25T14:37:23.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.261+0000 7f4ebf6c7700 1 --2- 172.21.15.72:0/655574199 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f4e9c06ace0 0x7f4e9c06d1a0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:23.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.261+0000 7f4ebf6c7700 1 --2- 172.21.15.72:0/655574199 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4eb80ba0e0 0x7f4eb80ac240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:23.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.261+0000 7f4ebf6c7700 1 --2- 172.21.15.72:0/655574199 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4eb8151ba0 0x7f4eb81e7f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:23.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.261+0000 7f4ebf6c7700 1 --2- 172.21.15.72:0/655574199 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4eb80c5f40 0x7f4eb81e7a30 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:23.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.261+0000 7f4ebf6c7700 1 -- 172.21.15.72:0/655574199 >> 172.21.15.72:0/655574199 conn(0x7f4eb80a87e0 msgr2=0x7f4eb81502f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:23.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.261+0000 7f4ebf6c7700 1 -- 172.21.15.72:0/655574199 shutdown_connections 2023-07-25T14:37:23.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.261+0000 7f4ebf6c7700 1 -- 172.21.15.72:0/655574199 wait complete. 2023-07-25T14:37:23.273 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 22 2023-07-25T14:37:23.283 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-25T14:37:23.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.394+0000 7f3b856f0700 1 Processor -- start 2023-07-25T14:37:23.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.394+0000 7f3b856f0700 1 -- start start 2023-07-25T14:37:23.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.394+0000 7f3b856f0700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3b800bead0 0x7f3b800c0350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:23.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.394+0000 7f3b856f0700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f3b800c0890 0x7f3b800c44d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:23.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.394+0000 7f3b856f0700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b800bfeb0 con 0x7f3b80151a90 2023-07-25T14:37:23.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.394+0000 7f3b856f0700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b800c10b0 con 0x7f3b800c0890 2023-07-25T14:37:23.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.394+0000 7f3b856f0700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b800c1940 con 0x7f3b800bead0 2023-07-25T14:37:23.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.395+0000 7f3b7f7fe700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f3b800c0890 0x7f3b800c44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:23.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.395+0000 7f3b7e7fc700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3b800bead0 0x7f3b800c0350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:23.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.395+0000 7f3b7effd700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f3b80151a90 0x7f3b80154d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.72:57308/0 (socket says 172.21.15.72:57308) 2023-07-25T14:37:23.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.395+0000 7f3b7effd700 1 -- 172.21.15.72:0/1008754977 learned_addr learned my addr 172.21.15.72:0/1008754977 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:37:23.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.395+0000 7f3b7dffb700 1 -- 172.21.15.72:0/1008754977 <== mon.1 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1004213220 0 0) 0x7f3b800bfeb0 con 0x7f3b80151a90 2023-07-25T14:37:23.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.395+0000 7f3b7e7fc700 1 -- 172.21.15.72:0/1008754977 >> v2:172.21.15.92:3300/0 conn(0x7f3b800c0890 msgr2=0x7f3b800c44d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:23.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.395+0000 7f3b7e7fc700 1 --2- 172.21.15.72:0/1008754977 >> v2:172.21.15.92:3300/0 conn(0x7f3b800c0890 0x7f3b800c44d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:23.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.395+0000 7f3b7e7fc700 1 -- 172.21.15.72:0/1008754977 >> v1:172.21.15.92:6789/0 conn(0x7f3b80151a90 legacy=0x7f3b80154d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:23.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.395+0000 7f3b7e7fc700 1 -- 172.21.15.72:0/1008754977 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b800bf2e0 con 0x7f3b800bead0 2023-07-25T14:37:23.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.395+0000 7f3b7e7fc700 1 --2- 172.21.15.72:0/1008754977 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3b800bead0 0x7f3b800c0350 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f3b74009840 tx=0x7f3b74009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c550577425fcfe6a server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:23.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.395+0000 7f3b7dffb700 1 -- 172.21.15.72:0/1008754977 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b74011830 con 0x7f3b800bead0 2023-07-25T14:37:23.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.395+0000 7f3b7dffb700 1 -- 172.21.15.72:0/1008754977 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b74011990 con 0x7f3b800bead0 2023-07-25T14:37:23.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.395+0000 7f3b7dffb700 1 -- 172.21.15.72:0/1008754977 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b74011d20 con 0x7f3b800bead0 2023-07-25T14:37:23.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.396+0000 7f3b856f0700 1 -- 172.21.15.72:0/1008754977 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3b800bead0 msgr2=0x7f3b800c0350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:23.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.396+0000 7f3b856f0700 1 --2- 172.21.15.72:0/1008754977 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3b800bead0 0x7f3b800c0350 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f3b74009840 tx=0x7f3b74009b50 comp rx=0 tx=0).stop 2023-07-25T14:37:23.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.396+0000 7f3b856f0700 1 -- 172.21.15.72:0/1008754977 shutdown_connections 2023-07-25T14:37:23.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.396+0000 7f3b856f0700 1 --2- 172.21.15.72:0/1008754977 >> v2:172.21.15.92:3300/0 conn(0x7f3b800c0890 0x7f3b800c44d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:23.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.396+0000 7f3b856f0700 1 --2- 172.21.15.72:0/1008754977 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3b800bead0 0x7f3b800c0350 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:23.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.396+0000 7f3b856f0700 1 -- 172.21.15.72:0/1008754977 >> 172.21.15.72:0/1008754977 conn(0x7f3b8006c3a0 msgr2=0x7f3b8006c780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:23.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.396+0000 7f3b856f0700 1 -- 172.21.15.72:0/1008754977 shutdown_connections 2023-07-25T14:37:23.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.396+0000 7f3b856f0700 1 -- 172.21.15.72:0/1008754977 wait complete. 2023-07-25T14:37:23.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.397+0000 7f3b856f0700 1 Processor -- start 2023-07-25T14:37:23.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.397+0000 7f3b856f0700 1 -- start start 2023-07-25T14:37:23.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.398+0000 7f3b856f0700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3b800bead0 0x7f3b80150920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:23.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.398+0000 7f3b856f0700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3b800c0890 0x7f3b8014f510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:23.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.398+0000 7f3b856f0700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3b80151a90 0x7f3b8014fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:23.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.398+0000 7f3b856f0700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b80140380 con 0x7f3b800bead0 2023-07-25T14:37:23.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.398+0000 7f3b856f0700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b801eaaf0 con 0x7f3b80151a90 2023-07-25T14:37:23.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.398+0000 7f3b856f0700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b8014f080 con 0x7f3b800c0890 2023-07-25T14:37:23.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.398+0000 7f3b7effd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3b800bead0 0x7f3b80150920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:23.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.398+0000 7f3b7effd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3b800bead0 0x7f3b80150920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43004/0 (socket says 172.21.15.72:43004) 2023-07-25T14:37:23.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.398+0000 7f3b7effd700 1 -- 172.21.15.72:0/1934276513 learned_addr learned my addr 172.21.15.72:0/1934276513 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:37:23.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.398+0000 7f3b7e7fc700 1 --2- 172.21.15.72:0/1934276513 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3b800c0890 0x7f3b8014f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:23.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.398+0000 7f3b7f7fe700 1 --2- 172.21.15.72:0/1934276513 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3b80151a90 0x7f3b8014fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:23.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.398+0000 7f3b7effd700 1 -- 172.21.15.72:0/1934276513 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3b800c0890 msgr2=0x7f3b8014f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:23.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.398+0000 7f3b7effd700 1 --2- 172.21.15.72:0/1934276513 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3b800c0890 0x7f3b8014f510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:23.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.398+0000 7f3b7effd700 1 -- 172.21.15.72:0/1934276513 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3b80151a90 msgr2=0x7f3b8014fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:23.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.398+0000 7f3b7effd700 1 --2- 172.21.15.72:0/1934276513 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3b80151a90 0x7f3b8014fa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:23.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.398+0000 7f3b7effd700 1 -- 172.21.15.72:0/1934276513 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b740094a0 con 0x7f3b800bead0 2023-07-25T14:37:23.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.399+0000 7f3b7effd700 1 --2- 172.21.15.72:0/1934276513 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3b800bead0 0x7f3b80150920 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f3b700011e0 tx=0x7f3b7000ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:23.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.399+0000 7f3b677fe700 1 -- 172.21.15.72:0/1934276513 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b70004c80 con 0x7f3b800bead0 2023-07-25T14:37:23.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.399+0000 7f3b677fe700 1 -- 172.21.15.72:0/1934276513 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b70004e00 con 0x7f3b800bead0 2023-07-25T14:37:23.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.399+0000 7f3b856f0700 1 -- 172.21.15.72:0/1934276513 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b801e9bf0 con 0x7f3b800bead0 2023-07-25T14:37:23.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.399+0000 7f3b677fe700 1 -- 172.21.15.72:0/1934276513 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b70007310 con 0x7f3b800bead0 2023-07-25T14:37:23.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.399+0000 7f3b856f0700 1 -- 172.21.15.72:0/1934276513 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b801ea1b0 con 0x7f3b800bead0 2023-07-25T14:37:23.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.400+0000 7f3b856f0700 1 -- 172.21.15.72:0/1934276513 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b8004e470 con 0x7f3b800bead0 2023-07-25T14:37:23.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.400+0000 7f3b677fe700 1 -- 172.21.15.72:0/1934276513 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3b70007470 con 0x7f3b800bead0 2023-07-25T14:37:23.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.400+0000 7f3b677fe700 1 --2- 172.21.15.72:0/1934276513 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f3b6c06ace0 0x7f3b6c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:23.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.401+0000 7f3b677fe700 1 -- 172.21.15.72:0/1934276513 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 7238+0+0 (secure 0 0 0) 0x7f3b70089540 con 0x7f3b800bead0 2023-07-25T14:37:23.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.401+0000 7f3b7e7fc700 1 --2- 172.21.15.72:0/1934276513 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f3b6c06ace0 0x7f3b6c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:23.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.401+0000 7f3b7e7fc700 1 --2- 172.21.15.72:0/1934276513 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f3b6c06ace0 0x7f3b6c06d1a0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f3b74009fd0 tx=0x7f3b7401c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:23.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.405+0000 7f3b677fe700 1 -- 172.21.15.72:0/1934276513 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f3b70054160 con 0x7f3b800bead0 2023-07-25T14:37:23.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.596+0000 7f3b856f0700 1 -- 172.21.15.72:0/1934276513 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3b800c5aa0 con 0x7f3b800bead0 2023-07-25T14:37:23.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.598+0000 7f3b677fe700 1 -- 172.21.15.72:0/1934276513 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) v1 ==== 74+0+22106 (secure 0 0 0) 0x7f3b70057780 con 0x7f3b800bead0 2023-07-25T14:37:23.608 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-25T14:37:23.608 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":43,"fsid":"9170db48-9170-43e8-8ccb-9813e6240906","created":"2023-07-25T14:35:21.733262+0000","modified":"2023-07-25T14:37:04.264643+0000","last_up_change":"2023-07-25T14:35:31.355010+0000","last_in_change":"2023-07-25T14:35:24.195785+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-25T14:35:32.983457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-25T14:35:33.326342+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-07-25T14:36:47.694223+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-07-25T14:36:48.536715+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs2_metadata","create_time":"2023-07-25T14:37:01.238292+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs2_data","create_time":"2023-07-25T14:37:01.609127+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d517fdad-0bfe-49f0-89f2-9421c3761839","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6801","nonce":2475407414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6803","nonce":2475407414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6807","nonce":2475407414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6805","nonce":2475407414}]},"public_addr":"172.21.15.72:6801/2475407414","cluster_addr":"172.21.15.72:6803/2475407414","heartbeat_back_addr":"172.21.15.72:6807/2475407414","heartbeat_front_addr":"172.21.15.72:6805/2475407414","state":["exists","up"]},{"osd":1,"uuid":"e1564be3-f209-47e5-a8d0-32fc618a474f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6822","nonce":870954016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6825","nonce":870954016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6831","nonce":870954016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6827","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6829","nonce":870954016}]},"public_addr":"172.21.15.72:6822/870954016","cluster_addr":"172.21.15.72:6825/870954016","heartbeat_back_addr":"172.21.15.72:6831/870954016","heartbeat_front_addr":"172.21.15.72:6829/870954016","state":["exists","up"]},{"osd":2,"uuid":"c4647d30-ffa6-417a-9026-ef530c75910e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6809","nonce":2143129442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6811","nonce":2143129442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6815","nonce":2143129442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6813","nonce":2143129442}]},"public_addr":"172.21.15.72:6809/2143129442","cluster_addr":"172.21.15.72:6811/2143129442","heartbeat_back_addr":"172.21.15.72:6815/2143129442","heartbeat_front_addr":"172.21.15.72:6813/2143129442","state":["exists","up"]},{"osd":3,"uuid":"76c9d9a7-c2e2-4612-a58b-d6882dd76b58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6817","nonce":3404066311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6819","nonce":3404066311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6828","nonce":3404066311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6821","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6823","nonce":3404066311}]},"public_addr":"172.21.15.72:6817/3404066311","cluster_addr":"172.21.15.72:6819/3404066311","heartbeat_back_addr":"172.21.15.72:6828/3404066311","heartbeat_front_addr":"172.21.15.72:6823/3404066311","state":["exists","up"]},{"osd":4,"uuid":"7f8920dc-0ad4-4a73-ab40-65408f83eadd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6817","nonce":2381008739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6819","nonce":2381008739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6825","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6827","nonce":2381008739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6822","nonce":2381008739}]},"public_addr":"172.21.15.92:6817/2381008739","cluster_addr":"172.21.15.92:6819/2381008739","heartbeat_back_addr":"172.21.15.92:6827/2381008739","heartbeat_front_addr":"172.21.15.92:6822/2381008739","state":["exists","up"]},{"osd":5,"uuid":"56257e7c-31eb-44c5-9ec7-1318a4e0bb35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6801","nonce":2161935604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6803","nonce":2161935604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6807","nonce":2161935604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6805","nonce":2161935604}]},"public_addr":"172.21.15.92:6801/2161935604","cluster_addr":"172.21.15.92:6803/2161935604","heartbeat_back_addr":"172.21.15.92:6807/2161935604","heartbeat_front_addr":"172.21.15.92:6805/2161935604","state":["exists","up"]},{"osd":6,"uuid":"a150d3d8-a0c9-4955-968a-8d98eff4ffb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6809","nonce":3770163493}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6811","nonce":3770163493}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6815","nonce":3770163493}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6813","nonce":3770163493}]},"public_addr":"172.21.15.92:6809/3770163493","cluster_addr":"172.21.15.92:6811/3770163493","heartbeat_back_addr":"172.21.15.92:6815/3770163493","heartbeat_front_addr":"172.21.15.92:6813/3770163493","state":["exists","up"]},{"osd":7,"uuid":"07799c27-54ee-4591-a42d-a978d6b32065","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6821","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6823","nonce":2135777609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6826","nonce":2135777609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6831","nonce":2135777609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6829","nonce":2135777609}]},"public_addr":"172.21.15.92:6823/2135777609","cluster_addr":"172.21.15.92:6826/2135777609","heartbeat_back_addr":"172.21.15.92:6831/2135777609","heartbeat_front_addr":"172.21.15.92:6829/2135777609","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.345365+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.378150+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.146566+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.372172+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:30.398421+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.385632+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.465611+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.443583+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-25T14:37:23.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.600+0000 7f3b856f0700 1 -- 172.21.15.72:0/1934276513 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f3b6c06ace0 msgr2=0x7f3b6c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:23.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.600+0000 7f3b856f0700 1 --2- 172.21.15.72:0/1934276513 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f3b6c06ace0 0x7f3b6c06d1a0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f3b74009fd0 tx=0x7f3b7401c040 comp rx=0 tx=0).stop 2023-07-25T14:37:23.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.600+0000 7f3b856f0700 1 -- 172.21.15.72:0/1934276513 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3b800bead0 msgr2=0x7f3b80150920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:23.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.600+0000 7f3b856f0700 1 --2- 172.21.15.72:0/1934276513 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3b800bead0 0x7f3b80150920 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f3b700011e0 tx=0x7f3b7000ca30 comp rx=0 tx=0).stop 2023-07-25T14:37:23.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.600+0000 7f3b856f0700 1 -- 172.21.15.72:0/1934276513 shutdown_connections 2023-07-25T14:37:23.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.600+0000 7f3b856f0700 1 --2- 172.21.15.72:0/1934276513 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f3b6c06ace0 0x7f3b6c06d1a0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:23.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.600+0000 7f3b856f0700 1 --2- 172.21.15.72:0/1934276513 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3b80151a90 0x7f3b8014fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:23.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.600+0000 7f3b856f0700 1 --2- 172.21.15.72:0/1934276513 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3b800bead0 0x7f3b80150920 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:23.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.600+0000 7f3b856f0700 1 --2- 172.21.15.72:0/1934276513 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3b800c0890 0x7f3b8014f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:23.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.600+0000 7f3b856f0700 1 -- 172.21.15.72:0/1934276513 >> 172.21.15.72:0/1934276513 conn(0x7f3b8006c3a0 msgr2=0x7f3b800c2d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:23.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.600+0000 7f3b856f0700 1 -- 172.21.15.72:0/1934276513 shutdown_connections 2023-07-25T14:37:23.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.600+0000 7f3b856f0700 1 -- 172.21.15.72:0/1934276513 wait complete. 2023-07-25T14:37:23.622 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-07-25T14:37:23.623 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-25T14:37:23.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.732+0000 7f97b7990700 1 Processor -- start 2023-07-25T14:37:23.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.732+0000 7f97b7990700 1 -- start start 2023-07-25T14:37:23.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.733+0000 7f97b7990700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f97b006ed70 0x7f97b00bf9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:23.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.733+0000 7f97b7990700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f97b006a190 0x7f97b00bfef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:23.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.733+0000 7f97b7990700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97b0066050 con 0x7f97b00bf5d0 2023-07-25T14:37:23.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.733+0000 7f97b7990700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97b006b560 con 0x7f97b006ed70 2023-07-25T14:37:23.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.733+0000 7f97b7990700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97b0151be0 con 0x7f97b006a190 2023-07-25T14:37:23.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.733+0000 7f97b4f2b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f97b006ed70 0x7f97b00bf9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:23.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.733+0000 7f97b4f2b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f97b006ed70 0x7f97b00bf9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43014/0 (socket says 172.21.15.72:43014) 2023-07-25T14:37:23.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.733+0000 7f97b4f2b700 1 -- 172.21.15.72:0/508135079 learned_addr learned my addr 172.21.15.72:0/508135079 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:37:23.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.733+0000 7f97b5f2d700 1 --2- 172.21.15.72:0/508135079 >> v2:172.21.15.92:3300/0 conn(0x7f97b006a190 0x7f97b00bfef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:23.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.733+0000 7f97b4f2b700 1 -- 172.21.15.72:0/508135079 >> v2:172.21.15.92:3300/0 conn(0x7f97b006a190 msgr2=0x7f97b00bfef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:23.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.733+0000 7f97b4f2b700 1 --2- 172.21.15.72:0/508135079 >> v2:172.21.15.92:3300/0 conn(0x7f97b006a190 0x7f97b00bfef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:23.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.733+0000 7f97b4f2b700 1 -- 172.21.15.72:0/508135079 >> v1:172.21.15.92:6789/0 conn(0x7f97b00bf5d0 legacy=0x7f97b00a7490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:23.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.733+0000 7f97b4f2b700 1 -- 172.21.15.72:0/508135079 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97b0154d60 con 0x7f97b006ed70 2023-07-25T14:37:23.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.734+0000 7f97b4f2b700 1 --2- 172.21.15.72:0/508135079 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f97b006ed70 0x7f97b00bf9b0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f97b00665f0 tx=0x7f97ac009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43d6249830a1a81e server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:23.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.734+0000 7f97a7fff700 1 -- 172.21.15.72:0/508135079 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97ac011830 con 0x7f97b006ed70 2023-07-25T14:37:23.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.734+0000 7f97a7fff700 1 -- 172.21.15.72:0/508135079 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97ac011990 con 0x7f97b006ed70 2023-07-25T14:37:23.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.734+0000 7f97a7fff700 1 -- 172.21.15.72:0/508135079 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97ac011d20 con 0x7f97b006ed70 2023-07-25T14:37:23.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.734+0000 7f97b7990700 1 -- 172.21.15.72:0/508135079 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f97b006ed70 msgr2=0x7f97b00bf9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:23.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.734+0000 7f97b7990700 1 --2- 172.21.15.72:0/508135079 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f97b006ed70 0x7f97b00bf9b0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f97b00665f0 tx=0x7f97ac009bd0 comp rx=0 tx=0).stop 2023-07-25T14:37:23.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.734+0000 7f97b7990700 1 -- 172.21.15.72:0/508135079 shutdown_connections 2023-07-25T14:37:23.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.734+0000 7f97b7990700 1 --2- 172.21.15.72:0/508135079 >> v2:172.21.15.92:3300/0 conn(0x7f97b006a190 0x7f97b00bfef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:23.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.734+0000 7f97b7990700 1 --2- 172.21.15.72:0/508135079 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f97b006ed70 0x7f97b00bf9b0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:23.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.734+0000 7f97b7990700 1 -- 172.21.15.72:0/508135079 >> 172.21.15.72:0/508135079 conn(0x7f97b006def0 msgr2=0x7f97b006e300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:23.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.734+0000 7f97b7990700 1 -- 172.21.15.72:0/508135079 shutdown_connections 2023-07-25T14:37:23.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.734+0000 7f97b7990700 1 -- 172.21.15.72:0/508135079 wait complete. 2023-07-25T14:37:23.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.736+0000 7f97b7990700 1 Processor -- start 2023-07-25T14:37:23.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.736+0000 7f97b7990700 1 -- start start 2023-07-25T14:37:23.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.737+0000 7f97b7990700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f97b006a190 0x7f97b01ee0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:23.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.737+0000 7f97b7990700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f97b006ed70 0x7f97b01e0e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:23.750 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.737+0000 7f97b7990700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f97b00bf5d0 0x7f97b01e9fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:23.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.737+0000 7f97b7990700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97b0154b10 con 0x7f97b006ed70 2023-07-25T14:37:23.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.737+0000 7f97b7990700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97b01edc30 con 0x7f97b006a190 2023-07-25T14:37:23.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.737+0000 7f97b7990700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97b0153e40 con 0x7f97b00bf5d0 2023-07-25T14:37:23.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.737+0000 7f97b4f2b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f97b006ed70 0x7f97b01e0e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:23.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.737+0000 7f97b4f2b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f97b006ed70 0x7f97b01e0e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43020/0 (socket says 172.21.15.72:43020) 2023-07-25T14:37:23.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.737+0000 7f97b4f2b700 1 -- 172.21.15.72:0/3859363998 learned_addr learned my addr 172.21.15.72:0/3859363998 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:37:23.751 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.737+0000 7f97b572c700 1 --2- 172.21.15.72:0/3859363998 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f97b006a190 0x7f97b01ee0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:23.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.737+0000 7f97b5f2d700 1 --2- 172.21.15.72:0/3859363998 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f97b00bf5d0 0x7f97b01e9fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:23.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.737+0000 7f97b4f2b700 1 -- 172.21.15.72:0/3859363998 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f97b00bf5d0 msgr2=0x7f97b01e9fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:23.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.737+0000 7f97b4f2b700 1 --2- 172.21.15.72:0/3859363998 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f97b00bf5d0 0x7f97b01e9fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:23.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.737+0000 7f97b4f2b700 1 -- 172.21.15.72:0/3859363998 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f97b006a190 msgr2=0x7f97b01ee0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:23.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.737+0000 7f97b4f2b700 1 --2- 172.21.15.72:0/3859363998 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f97b006a190 0x7f97b01ee0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:23.752 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.737+0000 7f97b4f2b700 1 -- 172.21.15.72:0/3859363998 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97ac009550 con 0x7f97b006ed70 2023-07-25T14:37:23.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.737+0000 7f97b4f2b700 1 --2- 172.21.15.72:0/3859363998 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f97b006ed70 0x7f97b01e0e50 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f97ac000c00 tx=0x7f97ac004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:23.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.737+0000 7f97a5ffb700 1 -- 172.21.15.72:0/3859363998 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97ac004480 con 0x7f97b006ed70 2023-07-25T14:37:23.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.737+0000 7f97a5ffb700 1 -- 172.21.15.72:0/3859363998 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97ac01f070 con 0x7f97b006ed70 2023-07-25T14:37:23.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.738+0000 7f97b7990700 1 -- 172.21.15.72:0/3859363998 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97b0153b60 con 0x7f97b006ed70 2023-07-25T14:37:23.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.738+0000 7f97a5ffb700 1 -- 172.21.15.72:0/3859363998 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97ac0038c0 con 0x7f97b006ed70 2023-07-25T14:37:23.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.738+0000 7f97b7990700 1 -- 172.21.15.72:0/3859363998 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97b01ed8c0 con 0x7f97b006ed70 2023-07-25T14:37:23.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.739+0000 7f97b7990700 1 -- 172.21.15.72:0/3859363998 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97b01edda0 con 0x7f97b006ed70 2023-07-25T14:37:23.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.739+0000 7f97a5ffb700 1 -- 172.21.15.72:0/3859363998 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f97ac021030 con 0x7f97b006ed70 2023-07-25T14:37:23.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.739+0000 7f97a5ffb700 1 --2- 172.21.15.72:0/3859363998 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f979406ace0 0x7f979406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:23.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.740+0000 7f97a5ffb700 1 -- 172.21.15.72:0/3859363998 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 7238+0+0 (secure 0 0 0) 0x7f97ac08ade0 con 0x7f97b006ed70 2023-07-25T14:37:23.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.740+0000 7f97b572c700 1 --2- 172.21.15.72:0/3859363998 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f979406ace0 0x7f979406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:23.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.740+0000 7f97b572c700 1 --2- 172.21.15.72:0/3859363998 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f979406ace0 0x7f979406d1a0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f97a0000f60 tx=0x7f97a0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:23.755 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.744+0000 7f97a5ffb700 1 -- 172.21.15.72:0/3859363998 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f97ac055ba0 con 0x7f97b006ed70 2023-07-25T14:37:23.985 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.975+0000 7f97b7990700 1 -- 172.21.15.72:0/3859363998 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f97b004e470 con 0x7f97b006ed70 2023-07-25T14:37:23.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.975+0000 7f97a5ffb700 1 -- 172.21.15.72:0/3859363998 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+5813 (secure 0 0 0) 0x7f97ac0591c0 con 0x7f97b006ed70 2023-07-25T14:37:23.986 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-25T14:37:23.987 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":22,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5092,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6834/3640355071","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":3640355071},{"type":"v1","addr":"172.21.15.92:6834","nonce":3640355071}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5095,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/936080292","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6833","nonce":936080292},{"type":"v1","addr":"172.21.15.92:6835","nonce":936080292}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-25T14:36:49.567868+0000","modified":"2023-07-25T14:36:53.213193+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5331},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5331":{"gid":5331,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.72:6837/1193027887","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6835","nonce":1193027887},{"type":"v1","addr":"172.21.15.72:6837","nonce":1193027887}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-25T14:37:02.650515+0000","modified":"2023-07-25T14:37:06.294518+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5328},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5328":{"gid":5328,"name":"c","rank":0,"incarnation":18,"state":"up:active","state_seq":7,"addr":"172.21.15.72:6836/2944832990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":2944832990},{"type":"v1","addr":"172.21.15.72:6836","nonce":2944832990}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-07-25T14:37:23.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.977+0000 7f97b7990700 1 -- 172.21.15.72:0/3859363998 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f979406ace0 msgr2=0x7f979406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:23.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.977+0000 7f97b7990700 1 --2- 172.21.15.72:0/3859363998 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f979406ace0 0x7f979406d1a0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f97a0000f60 tx=0x7f97a0009040 comp rx=0 tx=0).stop 2023-07-25T14:37:23.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.977+0000 7f97b7990700 1 -- 172.21.15.72:0/3859363998 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f97b006ed70 msgr2=0x7f97b01e0e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:23.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.977+0000 7f97b7990700 1 --2- 172.21.15.72:0/3859363998 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f97b006ed70 0x7f97b01e0e50 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f97ac000c00 tx=0x7f97ac004750 comp rx=0 tx=0).stop 2023-07-25T14:37:23.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.977+0000 7f97b7990700 1 -- 172.21.15.72:0/3859363998 shutdown_connections 2023-07-25T14:37:23.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.977+0000 7f97b7990700 1 --2- 172.21.15.72:0/3859363998 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f979406ace0 0x7f979406d1a0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:23.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.977+0000 7f97b7990700 1 --2- 172.21.15.72:0/3859363998 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f97b00bf5d0 0x7f97b01e9fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:23.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.977+0000 7f97b7990700 1 --2- 172.21.15.72:0/3859363998 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f97b006a190 0x7f97b01ee0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:23.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.977+0000 7f97b7990700 1 --2- 172.21.15.72:0/3859363998 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f97b006ed70 0x7f97b01e0e50 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:23.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.977+0000 7f97b7990700 1 -- 172.21.15.72:0/3859363998 >> 172.21.15.72:0/3859363998 conn(0x7f97b006def0 msgr2=0x7f97b014fb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:23.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.977+0000 7f97b7990700 1 -- 172.21.15.72:0/3859363998 shutdown_connections 2023-07-25T14:37:23.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:23.977+0000 7f97b7990700 1 -- 172.21.15.72:0/3859363998 wait complete. 2023-07-25T14:37:23.992 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 22 2023-07-25T14:37:23.999 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-25T14:37:24.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.108+0000 7fbf3b2c4700 1 Processor -- start 2023-07-25T14:37:24.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.109+0000 7fbf3b2c4700 1 -- start start 2023-07-25T14:37:24.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.109+0000 7fbf3b2c4700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fbf34072300 0x7fbf3406a190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:24.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.109+0000 7fbf3b2c4700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf340a8230 con 0x7fbf3414dea0 2023-07-25T14:37:24.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.109+0000 7fbf3b2c4700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf340a7c20 con 0x7fbf340a86c0 2023-07-25T14:37:24.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.109+0000 7fbf3b2c4700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf340c18d0 con 0x7fbf34072300 2023-07-25T14:37:24.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.110+0000 7fbf39060700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fbf3414dea0 0x7fbf34151200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:33762/0 (socket says 172.21.15.72:33762) 2023-07-25T14:37:24.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.110+0000 7fbf39060700 1 -- 172.21.15.72:0/4271583482 learned_addr learned my addr 172.21.15.72:0/4271583482 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:37:24.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.110+0000 7fbf3885f700 1 --2- 172.21.15.72:0/4271583482 >> v2:172.21.15.92:3300/0 conn(0x7fbf34072300 0x7fbf3406a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:24.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.110+0000 7fbf2bfff700 1 -- 172.21.15.72:0/4271583482 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 184362440 0 0) 0x7fbf340a8230 con 0x7fbf3414dea0 2023-07-25T14:37:24.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.110+0000 7fbf2bfff700 1 -- 172.21.15.72:0/4271583482 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf200035b0 con 0x7fbf3414dea0 2023-07-25T14:37:24.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.110+0000 7fbf2bfff700 1 -- 172.21.15.72:0/4271583482 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1259413008 0 0) 0x7fbf200035b0 con 0x7fbf3414dea0 2023-07-25T14:37:24.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.110+0000 7fbf3885f700 1 -- 172.21.15.72:0/4271583482 >> v1:172.21.15.92:6789/0 conn(0x7fbf340a86c0 legacy=0x7fbf340c0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:24.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.110+0000 7fbf3885f700 1 -- 172.21.15.72:0/4271583482 >> v1:172.21.15.72:6789/0 conn(0x7fbf3414dea0 legacy=0x7fbf34151200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:24.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.110+0000 7fbf3885f700 1 -- 172.21.15.72:0/4271583482 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf3406ec20 con 0x7fbf34072300 2023-07-25T14:37:24.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.110+0000 7fbf3885f700 1 --2- 172.21.15.72:0/4271583482 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbf34072300 0x7fbf3406a190 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fbf30009840 tx=0x7fbf30009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=24ee5270a11b80 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:24.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.110+0000 7fbf2bfff700 1 -- 172.21.15.72:0/4271583482 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf24001670 con 0x7fbf34072300 2023-07-25T14:37:24.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.110+0000 7fbf2bfff700 1 -- 172.21.15.72:0/4271583482 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf30004030 con 0x7fbf34072300 2023-07-25T14:37:24.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.110+0000 7fbf2bfff700 1 -- 172.21.15.72:0/4271583482 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf300043c0 con 0x7fbf34072300 2023-07-25T14:37:24.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.111+0000 7fbf3b2c4700 1 -- 172.21.15.72:0/4271583482 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbf34072300 msgr2=0x7fbf3406a190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:24.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.111+0000 7fbf3b2c4700 1 --2- 172.21.15.72:0/4271583482 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbf34072300 0x7fbf3406a190 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fbf30009840 tx=0x7fbf30009b50 comp rx=0 tx=0).stop 2023-07-25T14:37:24.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.111+0000 7fbf3b2c4700 1 -- 172.21.15.72:0/4271583482 shutdown_connections 2023-07-25T14:37:24.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.111+0000 7fbf3b2c4700 1 --2- 172.21.15.72:0/4271583482 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbf34072300 0x7fbf3406a190 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:24.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.111+0000 7fbf3b2c4700 1 -- 172.21.15.72:0/4271583482 >> 172.21.15.72:0/4271583482 conn(0x7fbf3406def0 msgr2=0x7fbf3406e300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:24.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.111+0000 7fbf3b2c4700 1 -- 172.21.15.72:0/4271583482 shutdown_connections 2023-07-25T14:37:24.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.111+0000 7fbf3b2c4700 1 -- 172.21.15.72:0/4271583482 wait complete. 2023-07-25T14:37:24.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.113+0000 7fbf3b2c4700 1 Processor -- start 2023-07-25T14:37:24.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.113+0000 7fbf3b2c4700 1 -- start start 2023-07-25T14:37:24.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.113+0000 7fbf3b2c4700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fbf34072300 0x7fbf340c58a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:24.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.113+0000 7fbf3b2c4700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbf340a86c0 0x7fbf340aaf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:24.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.113+0000 7fbf3b2c4700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbf3414dea0 0x7fbf340ab450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:24.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.113+0000 7fbf3b2c4700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf340bbcd0 con 0x7fbf3414dea0 2023-07-25T14:37:24.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.113+0000 7fbf3b2c4700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf340bfc70 con 0x7fbf340a86c0 2023-07-25T14:37:24.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.113+0000 7fbf3b2c4700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf340bc800 con 0x7fbf34072300 2023-07-25T14:37:24.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.114+0000 7fbf39861700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbf3414dea0 0x7fbf340ab450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:24.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.114+0000 7fbf39861700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbf3414dea0 0x7fbf340ab450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43036/0 (socket says 172.21.15.72:43036) 2023-07-25T14:37:24.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.114+0000 7fbf39861700 1 -- 172.21.15.72:0/1906822406 learned_addr learned my addr 172.21.15.72:0/1906822406 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:37:24.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.114+0000 7fbf3885f700 1 --2- 172.21.15.72:0/1906822406 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbf340a86c0 0x7fbf340aaf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:24.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.114+0000 7fbf39060700 1 --2- 172.21.15.72:0/1906822406 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fbf34072300 0x7fbf340c58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:24.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.114+0000 7fbf39861700 1 -- 172.21.15.72:0/1906822406 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fbf34072300 msgr2=0x7fbf340c58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:24.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.114+0000 7fbf39861700 1 --2- 172.21.15.72:0/1906822406 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fbf34072300 0x7fbf340c58a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:24.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.114+0000 7fbf39861700 1 -- 172.21.15.72:0/1906822406 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbf340a86c0 msgr2=0x7fbf340aaf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:24.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.114+0000 7fbf39861700 1 --2- 172.21.15.72:0/1906822406 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbf340a86c0 0x7fbf340aaf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:24.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.114+0000 7fbf39861700 1 -- 172.21.15.72:0/1906822406 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf300094a0 con 0x7fbf3414dea0 2023-07-25T14:37:24.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.114+0000 7fbf39861700 1 --2- 172.21.15.72:0/1906822406 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbf3414dea0 0x7fbf340ab450 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fbf2c00cc50 tx=0x7fbf2c00cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:24.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.114+0000 7fbf29ffb700 1 -- 172.21.15.72:0/1906822406 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf2c003c00 con 0x7fbf3414dea0 2023-07-25T14:37:24.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.114+0000 7fbf29ffb700 1 -- 172.21.15.72:0/1906822406 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf2c003d60 con 0x7fbf3414dea0 2023-07-25T14:37:24.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.114+0000 7fbf3b2c4700 1 -- 172.21.15.72:0/1906822406 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf340bbed0 con 0x7fbf3414dea0 2023-07-25T14:37:24.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.114+0000 7fbf29ffb700 1 -- 172.21.15.72:0/1906822406 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf2c00ab60 con 0x7fbf3414dea0 2023-07-25T14:37:24.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.114+0000 7fbf3b2c4700 1 -- 172.21.15.72:0/1906822406 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf340bc490 con 0x7fbf3414dea0 2023-07-25T14:37:24.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.115+0000 7fbf3b2c4700 1 -- 172.21.15.72:0/1906822406 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf340aac30 con 0x7fbf3414dea0 2023-07-25T14:37:24.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.116+0000 7fbf29ffb700 1 -- 172.21.15.72:0/1906822406 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fbf2c00acc0 con 0x7fbf3414dea0 2023-07-25T14:37:24.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.116+0000 7fbf29ffb700 1 --2- 172.21.15.72:0/1906822406 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fbf1806ace0 0x7fbf1806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:24.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.116+0000 7fbf29ffb700 1 -- 172.21.15.72:0/1906822406 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 7238+0+0 (secure 0 0 0) 0x7fbf2c0899f0 con 0x7fbf3414dea0 2023-07-25T14:37:24.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.116+0000 7fbf39060700 1 --2- 172.21.15.72:0/1906822406 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fbf1806ace0 0x7fbf1806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:24.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.117+0000 7fbf39060700 1 --2- 172.21.15.72:0/1906822406 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fbf1806ace0 0x7fbf1806d1a0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fbf340aa480 tx=0x7fbf24001bc0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:24.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.120+0000 7fbf29ffb700 1 -- 172.21.15.72:0/1906822406 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fbf340aac30 con 0x7fbf3414dea0 2023-07-25T14:37:24.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.350+0000 7fbf3b2c4700 1 -- 172.21.15.72:0/1906822406 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbf340aac30 con 0x7fbf3414dea0 2023-07-25T14:37:24.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.350+0000 7fbf29ffb700 1 -- 172.21.15.72:0/1906822406 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+5813 (secure 0 0 0) 0x7fbf340aac30 con 0x7fbf3414dea0 2023-07-25T14:37:24.361 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-25T14:37:24.361 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":22,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5092,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6834/3640355071","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":3640355071},{"type":"v1","addr":"172.21.15.92:6834","nonce":3640355071}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5095,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/936080292","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6833","nonce":936080292},{"type":"v1","addr":"172.21.15.92:6835","nonce":936080292}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-25T14:36:49.567868+0000","modified":"2023-07-25T14:36:53.213193+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5331},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5331":{"gid":5331,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.72:6837/1193027887","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6835","nonce":1193027887},{"type":"v1","addr":"172.21.15.72:6837","nonce":1193027887}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-25T14:37:02.650515+0000","modified":"2023-07-25T14:37:06.294518+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5328},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5328":{"gid":5328,"name":"c","rank":0,"incarnation":18,"state":"up:active","state_seq":7,"addr":"172.21.15.72:6836/2944832990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":2944832990},{"type":"v1","addr":"172.21.15.72:6836","nonce":2944832990}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-07-25T14:37:24.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.352+0000 7fbf3b2c4700 1 -- 172.21.15.72:0/1906822406 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fbf1806ace0 msgr2=0x7fbf1806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:24.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.352+0000 7fbf3b2c4700 1 --2- 172.21.15.72:0/1906822406 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fbf1806ace0 0x7fbf1806d1a0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fbf340aa480 tx=0x7fbf24001bc0 comp rx=0 tx=0).stop 2023-07-25T14:37:24.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.352+0000 7fbf3b2c4700 1 -- 172.21.15.72:0/1906822406 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbf3414dea0 msgr2=0x7fbf340ab450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:24.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.352+0000 7fbf3b2c4700 1 --2- 172.21.15.72:0/1906822406 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbf3414dea0 0x7fbf340ab450 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fbf2c00cc50 tx=0x7fbf2c00cf60 comp rx=0 tx=0).stop 2023-07-25T14:37:24.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.352+0000 7fbf3b2c4700 1 -- 172.21.15.72:0/1906822406 shutdown_connections 2023-07-25T14:37:24.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.352+0000 7fbf3b2c4700 1 --2- 172.21.15.72:0/1906822406 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fbf1806ace0 0x7fbf1806d1a0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:24.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.352+0000 7fbf3b2c4700 1 --2- 172.21.15.72:0/1906822406 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fbf34072300 0x7fbf340c58a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:24.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.352+0000 7fbf3b2c4700 1 --2- 172.21.15.72:0/1906822406 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbf3414dea0 0x7fbf340ab450 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:24.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.352+0000 7fbf3b2c4700 1 --2- 172.21.15.72:0/1906822406 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbf340a86c0 0x7fbf340aaf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:24.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.352+0000 7fbf3b2c4700 1 -- 172.21.15.72:0/1906822406 >> 172.21.15.72:0/1906822406 conn(0x7fbf3406def0 msgr2=0x7fbf3414d0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:24.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.353+0000 7fbf3b2c4700 1 -- 172.21.15.72:0/1906822406 shutdown_connections 2023-07-25T14:37:24.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.353+0000 7fbf3b2c4700 1 -- 172.21.15.72:0/1906822406 wait complete. 2023-07-25T14:37:24.364 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 22 2023-07-25T14:37:24.374 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-25T14:37:24.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.486+0000 7f8739ed3700 1 Processor -- start 2023-07-25T14:37:24.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.486+0000 7f8739ed3700 1 -- start start 2023-07-25T14:37:24.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.486+0000 7f8739ed3700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f873406e080 0x7f8734152ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:24.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.486+0000 7f8739ed3700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87340c02a0 con 0x7f87340c2710 2023-07-25T14:37:24.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.486+0000 7f8739ed3700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87340c2b40 con 0x7f87340c2330 2023-07-25T14:37:24.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.486+0000 7f8739ed3700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87340c2f10 con 0x7f873406e080 2023-07-25T14:37:24.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.487+0000 7f8732ffd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f873406e080 0x7f8734152ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:24.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.487+0000 7f8733fff700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f87340c2710 0x7f873414f100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:33780/0 (socket says 172.21.15.72:33780) 2023-07-25T14:37:24.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.487+0000 7f8732ffd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f873406e080 0x7f8734152ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43042/0 (socket says 172.21.15.72:43042) 2023-07-25T14:37:24.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.487+0000 7f8733fff700 1 -- 172.21.15.72:0/503666083 learned_addr learned my addr 172.21.15.72:0/503666083 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:37:24.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.487+0000 7f8732ffd700 1 -- 172.21.15.72:0/503666083 >> v1:172.21.15.92:6789/0 conn(0x7f87340c2330 legacy=0x7f8734155c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:24.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.487+0000 7f8732ffd700 1 -- 172.21.15.72:0/503666083 >> v1:172.21.15.72:6789/0 conn(0x7f87340c2710 legacy=0x7f873414f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:24.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.487+0000 7f8732ffd700 1 -- 172.21.15.72:0/503666083 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87340c04f0 con 0x7f873406e080 2023-07-25T14:37:24.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.487+0000 7f87327fc700 1 -- 172.21.15.72:0/503666083 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3539838149 0 0) 0x7f87340c02a0 con 0x7f87340c2710 2023-07-25T14:37:24.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.487+0000 7f8732ffd700 1 --2- 172.21.15.72:0/503666083 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f873406e080 0x7f8734152ab0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f8728009840 tx=0x7f8728009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74210cd27b1f2bb6 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:24.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.487+0000 7f87327fc700 1 -- 172.21.15.72:0/503666083 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8728004230 con 0x7f873406e080 2023-07-25T14:37:24.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.487+0000 7f87327fc700 1 -- 172.21.15.72:0/503666083 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8728004390 con 0x7f873406e080 2023-07-25T14:37:24.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.487+0000 7f87327fc700 1 -- 172.21.15.72:0/503666083 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87280036a0 con 0x7f873406e080 2023-07-25T14:37:24.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.488+0000 7f8739ed3700 1 -- 172.21.15.72:0/503666083 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f873406e080 msgr2=0x7f8734152ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:24.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.488+0000 7f8739ed3700 1 --2- 172.21.15.72:0/503666083 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f873406e080 0x7f8734152ab0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f8728009840 tx=0x7f8728009b50 comp rx=0 tx=0).stop 2023-07-25T14:37:24.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.488+0000 7f8739ed3700 1 -- 172.21.15.72:0/503666083 shutdown_connections 2023-07-25T14:37:24.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.488+0000 7f8739ed3700 1 --2- 172.21.15.72:0/503666083 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f873406e080 0x7f8734152ab0 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:24.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.488+0000 7f8739ed3700 1 -- 172.21.15.72:0/503666083 >> 172.21.15.72:0/503666083 conn(0x7f87340a7510 msgr2=0x7f87340a78f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:24.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.488+0000 7f8739ed3700 1 -- 172.21.15.72:0/503666083 shutdown_connections 2023-07-25T14:37:24.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.488+0000 7f8739ed3700 1 -- 172.21.15.72:0/503666083 wait complete. 2023-07-25T14:37:24.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.489+0000 7f8739ed3700 1 Processor -- start 2023-07-25T14:37:24.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.489+0000 7f8739ed3700 1 -- start start 2023-07-25T14:37:24.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.490+0000 7f8739ed3700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f873406e080 0x7f873414c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:24.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.490+0000 7f8739ed3700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f87340c2330 0x7f87340a6a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:24.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.490+0000 7f8739ed3700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f87340c2710 0x7f87341e7520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:24.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.490+0000 7f8739ed3700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87340bc520 con 0x7f87340c2330 2023-07-25T14:37:24.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.490+0000 7f8739ed3700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87340a4490 con 0x7f87340c2710 2023-07-25T14:37:24.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.490+0000 7f8739ed3700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87341eb650 con 0x7f873406e080 2023-07-25T14:37:24.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.490+0000 7f8732ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f87340c2330 0x7f87340a6a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:24.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.490+0000 7f8732ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f87340c2330 0x7f87340a6a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43048/0 (socket says 172.21.15.72:43048) 2023-07-25T14:37:24.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.490+0000 7f8732ffd700 1 -- 172.21.15.72:0/3052680013 learned_addr learned my addr 172.21.15.72:0/3052680013 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:37:24.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.490+0000 7f8733fff700 1 --2- 172.21.15.72:0/3052680013 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f87340c2710 0x7f87341e7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:24.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.490+0000 7f87337fe700 1 --2- 172.21.15.72:0/3052680013 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f873406e080 0x7f873414c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:24.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.490+0000 7f8732ffd700 1 -- 172.21.15.72:0/3052680013 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f873406e080 msgr2=0x7f873414c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:24.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.490+0000 7f8732ffd700 1 --2- 172.21.15.72:0/3052680013 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f873406e080 0x7f873414c0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:24.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.490+0000 7f8732ffd700 1 -- 172.21.15.72:0/3052680013 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f87340c2710 msgr2=0x7f87341e7520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:24.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.490+0000 7f8732ffd700 1 --2- 172.21.15.72:0/3052680013 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f87340c2710 0x7f87341e7520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:24.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.491+0000 7f8732ffd700 1 -- 172.21.15.72:0/3052680013 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87280094a0 con 0x7f87340c2330 2023-07-25T14:37:24.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.491+0000 7f8733fff700 1 --2- 172.21.15.72:0/3052680013 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f87340c2710 0x7f87341e7520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-25T14:37:24.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.491+0000 7f87337fe700 1 --2- 172.21.15.72:0/3052680013 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f873406e080 0x7f873414c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-25T14:37:24.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.491+0000 7f8732ffd700 1 --2- 172.21.15.72:0/3052680013 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f87340c2330 0x7f87340a6a30 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f87280090b0 tx=0x7f87280047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:24.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.491+0000 7f871bfff700 1 -- 172.21.15.72:0/3052680013 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8728011630 con 0x7f87340c2330 2023-07-25T14:37:24.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.491+0000 7f871bfff700 1 -- 172.21.15.72:0/3052680013 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8728011790 con 0x7f87340c2330 2023-07-25T14:37:24.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.491+0000 7f8739ed3700 1 -- 172.21.15.72:0/3052680013 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87340a4d50 con 0x7f87340c2330 2023-07-25T14:37:24.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.491+0000 7f871bfff700 1 -- 172.21.15.72:0/3052680013 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8728011b40 con 0x7f87340c2330 2023-07-25T14:37:24.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.491+0000 7f8739ed3700 1 -- 172.21.15.72:0/3052680013 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f873414cbb0 con 0x7f87340c2330 2023-07-25T14:37:24.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.492+0000 7f8739ed3700 1 -- 172.21.15.72:0/3052680013 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87341eb790 con 0x7f87340c2330 2023-07-25T14:37:24.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.492+0000 7f871bfff700 1 -- 172.21.15.72:0/3052680013 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8728011ca0 con 0x7f87340c2330 2023-07-25T14:37:24.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.493+0000 7f871bfff700 1 --2- 172.21.15.72:0/3052680013 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f872006ace0 0x7f872006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:24.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.493+0000 7f871bfff700 1 -- 172.21.15.72:0/3052680013 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 7238+0+0 (secure 0 0 0) 0x7f872808b1b0 con 0x7f87340c2330 2023-07-25T14:37:24.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.493+0000 7f87337fe700 1 --2- 172.21.15.72:0/3052680013 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f872006ace0 0x7f872006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:24.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.493+0000 7f87337fe700 1 --2- 172.21.15.72:0/3052680013 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f872006ace0 0x7f872006d1a0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f8724003f40 tx=0x7f8724009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:24.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.497+0000 7f871bfff700 1 -- 172.21.15.72:0/3052680013 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f87341eb790 con 0x7f87340c2330 2023-07-25T14:37:24.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.684+0000 7f8739ed3700 1 -- 172.21.15.72:0/3052680013 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f87341eb790 con 0x7f87340c2330 2023-07-25T14:37:24.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.686+0000 7f871bfff700 1 -- 172.21.15.72:0/3052680013 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) v1 ==== 74+0+22106 (secure 0 0 0) 0x7f87341eb790 con 0x7f87340c2330 2023-07-25T14:37:24.697 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-25T14:37:24.697 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":43,"fsid":"9170db48-9170-43e8-8ccb-9813e6240906","created":"2023-07-25T14:35:21.733262+0000","modified":"2023-07-25T14:37:04.264643+0000","last_up_change":"2023-07-25T14:35:31.355010+0000","last_in_change":"2023-07-25T14:35:24.195785+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-25T14:35:32.983457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-25T14:35:33.326342+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-07-25T14:36:47.694223+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-07-25T14:36:48.536715+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs2_metadata","create_time":"2023-07-25T14:37:01.238292+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs2_data","create_time":"2023-07-25T14:37:01.609127+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d517fdad-0bfe-49f0-89f2-9421c3761839","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6801","nonce":2475407414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6803","nonce":2475407414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6807","nonce":2475407414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6805","nonce":2475407414}]},"public_addr":"172.21.15.72:6801/2475407414","cluster_addr":"172.21.15.72:6803/2475407414","heartbeat_back_addr":"172.21.15.72:6807/2475407414","heartbeat_front_addr":"172.21.15.72:6805/2475407414","state":["exists","up"]},{"osd":1,"uuid":"e1564be3-f209-47e5-a8d0-32fc618a474f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6822","nonce":870954016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6825","nonce":870954016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6831","nonce":870954016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6827","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6829","nonce":870954016}]},"public_addr":"172.21.15.72:6822/870954016","cluster_addr":"172.21.15.72:6825/870954016","heartbeat_back_addr":"172.21.15.72:6831/870954016","heartbeat_front_addr":"172.21.15.72:6829/870954016","state":["exists","up"]},{"osd":2,"uuid":"c4647d30-ffa6-417a-9026-ef530c75910e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6809","nonce":2143129442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6811","nonce":2143129442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6815","nonce":2143129442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6813","nonce":2143129442}]},"public_addr":"172.21.15.72:6809/2143129442","cluster_addr":"172.21.15.72:6811/2143129442","heartbeat_back_addr":"172.21.15.72:6815/2143129442","heartbeat_front_addr":"172.21.15.72:6813/2143129442","state":["exists","up"]},{"osd":3,"uuid":"76c9d9a7-c2e2-4612-a58b-d6882dd76b58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6817","nonce":3404066311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6819","nonce":3404066311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6828","nonce":3404066311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6821","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6823","nonce":3404066311}]},"public_addr":"172.21.15.72:6817/3404066311","cluster_addr":"172.21.15.72:6819/3404066311","heartbeat_back_addr":"172.21.15.72:6828/3404066311","heartbeat_front_addr":"172.21.15.72:6823/3404066311","state":["exists","up"]},{"osd":4,"uuid":"7f8920dc-0ad4-4a73-ab40-65408f83eadd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6817","nonce":2381008739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6819","nonce":2381008739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6825","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6827","nonce":2381008739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6822","nonce":2381008739}]},"public_addr":"172.21.15.92:6817/2381008739","cluster_addr":"172.21.15.92:6819/2381008739","heartbeat_back_addr":"172.21.15.92:6827/2381008739","heartbeat_front_addr":"172.21.15.92:6822/2381008739","state":["exists","up"]},{"osd":5,"uuid":"56257e7c-31eb-44c5-9ec7-1318a4e0bb35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6801","nonce":2161935604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6803","nonce":2161935604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6807","nonce":2161935604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6805","nonce":2161935604}]},"public_addr":"172.21.15.92:6801/2161935604","cluster_addr":"172.21.15.92:6803/2161935604","heartbeat_back_addr":"172.21.15.92:6807/2161935604","heartbeat_front_addr":"172.21.15.92:6805/2161935604","state":["exists","up"]},{"osd":6,"uuid":"a150d3d8-a0c9-4955-968a-8d98eff4ffb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6809","nonce":3770163493}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6811","nonce":3770163493}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6815","nonce":3770163493}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6813","nonce":3770163493}]},"public_addr":"172.21.15.92:6809/3770163493","cluster_addr":"172.21.15.92:6811/3770163493","heartbeat_back_addr":"172.21.15.92:6815/3770163493","heartbeat_front_addr":"172.21.15.92:6813/3770163493","state":["exists","up"]},{"osd":7,"uuid":"07799c27-54ee-4591-a42d-a978d6b32065","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6821","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6823","nonce":2135777609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6826","nonce":2135777609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6831","nonce":2135777609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6829","nonce":2135777609}]},"public_addr":"172.21.15.92:6823/2135777609","cluster_addr":"172.21.15.92:6826/2135777609","heartbeat_back_addr":"172.21.15.92:6831/2135777609","heartbeat_front_addr":"172.21.15.92:6829/2135777609","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.345365+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.378150+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.146566+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.372172+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:30.398421+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.385632+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.465611+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.443583+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-25T14:37:24.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.688+0000 7f8739ed3700 1 -- 172.21.15.72:0/3052680013 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f872006ace0 msgr2=0x7f872006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:24.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.688+0000 7f8739ed3700 1 --2- 172.21.15.72:0/3052680013 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f872006ace0 0x7f872006d1a0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f8724003f40 tx=0x7f8724009040 comp rx=0 tx=0).stop 2023-07-25T14:37:24.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.688+0000 7f8739ed3700 1 -- 172.21.15.72:0/3052680013 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f87340c2330 msgr2=0x7f87340a6a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:24.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.688+0000 7f8739ed3700 1 --2- 172.21.15.72:0/3052680013 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f87340c2330 0x7f87340a6a30 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f87280090b0 tx=0x7f87280047c0 comp rx=0 tx=0).stop 2023-07-25T14:37:24.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.688+0000 7f8739ed3700 1 -- 172.21.15.72:0/3052680013 shutdown_connections 2023-07-25T14:37:24.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.688+0000 7f8739ed3700 1 --2- 172.21.15.72:0/3052680013 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f872006ace0 0x7f872006d1a0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:24.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.688+0000 7f8739ed3700 1 --2- 172.21.15.72:0/3052680013 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f873406e080 0x7f873414c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:24.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.688+0000 7f8739ed3700 1 --2- 172.21.15.72:0/3052680013 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f87340c2710 0x7f87341e7520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:24.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.688+0000 7f8739ed3700 1 --2- 172.21.15.72:0/3052680013 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f87340c2330 0x7f87340a6a30 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:24.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.688+0000 7f8739ed3700 1 -- 172.21.15.72:0/3052680013 >> 172.21.15.72:0/3052680013 conn(0x7f87340a7510 msgr2=0x7f8734151560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:24.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.688+0000 7f8739ed3700 1 -- 172.21.15.72:0/3052680013 shutdown_connections 2023-07-25T14:37:24.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.688+0000 7f8739ed3700 1 -- 172.21.15.72:0/3052680013 wait complete. 2023-07-25T14:37:24.712 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-07-25T14:37:24.832 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.822+0000 7f15e0a68700 1 Processor -- start 2023-07-25T14:37:24.833 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.822+0000 7f15e0a68700 1 -- start start 2023-07-25T14:37:24.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.823+0000 7f15e0a68700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f15dc0aad30 0x7f15dc0ab110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:24.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.823+0000 7f15e0a68700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15dc06edd0 con 0x7f15dc14c460 2023-07-25T14:37:24.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.823+0000 7f15e0a68700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15dc0ac1d0 con 0x7f15dc065e30 2023-07-25T14:37:24.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.823+0000 7f15e0a68700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15dc0aa1f0 con 0x7f15dc0aad30 2023-07-25T14:37:24.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.824+0000 7f15dad9d700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f15dc14c460 0x7f15dc06a190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:33792/0 (socket says 172.21.15.72:33792) 2023-07-25T14:37:24.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.824+0000 7f15dad9d700 1 -- 172.21.15.72:0/2711909804 learned_addr learned my addr 172.21.15.72:0/2711909804 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:37:24.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.824+0000 7f15d959a700 1 -- 172.21.15.72:0/2711909804 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3694535050 0 0) 0x7f15dc06edd0 con 0x7f15dc14c460 2023-07-25T14:37:24.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.824+0000 7f15d959a700 1 -- 172.21.15.72:0/2711909804 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f15c40035b0 con 0x7f15dc14c460 2023-07-25T14:37:24.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.824+0000 7f15da59c700 1 --2- 172.21.15.72:0/2711909804 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f15dc0aad30 0x7f15dc0ab110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:24.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.824+0000 7f15d959a700 1 -- 172.21.15.72:0/2711909804 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2088027341 0 0) 0x7f15c40035b0 con 0x7f15dc14c460 2023-07-25T14:37:24.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.824+0000 7f15d959a700 1 -- 172.21.15.72:0/2711909804 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f15dc0aad30 msgr2=0x7f15dc0ab110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:24.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.824+0000 7f15d959a700 1 --2- 172.21.15.72:0/2711909804 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f15dc0aad30 0x7f15dc0ab110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:24.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.824+0000 7f15d959a700 1 -- 172.21.15.72:0/2711909804 >> v1:172.21.15.92:6789/0 conn(0x7f15dc065e30 legacy=0x7f15dc14bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:24.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.824+0000 7f15d959a700 1 -- 172.21.15.72:0/2711909804 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15dc06e830 con 0x7f15dc14c460 2023-07-25T14:37:24.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.824+0000 7f15d959a700 1 -- 172.21.15.72:0/2711909804 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2559588315 0 0) 0x7f15d40019f0 con 0x7f15dc14c460 2023-07-25T14:37:24.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.824+0000 7f15d959a700 1 -- 172.21.15.72:0/2711909804 >> v1:172.21.15.72:6789/0 conn(0x7f15dc14c460 legacy=0x7f15dc06a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:24.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.824+0000 7f15d959a700 1 --2- 172.21.15.72:0/2711909804 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f15c4003a30 0x7f15c4003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:24.839 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.824+0000 7f15d959a700 1 --2- 172.21.15.72:0/2711909804 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f15dc0aad30 0x7f15c4004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:24.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.824+0000 7f15d959a700 1 --2- 172.21.15.72:0/2711909804 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f15c4004d90 0x7f15c4005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:24.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.824+0000 7f15d959a700 1 -- 172.21.15.72:0/2711909804 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15dc0aa1f0 con 0x7f15c4004d90 2023-07-25T14:37:24.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.824+0000 7f15d959a700 1 -- 172.21.15.72:0/2711909804 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15c400bbd0 con 0x7f15c4003a30 2023-07-25T14:37:24.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.824+0000 7f15d959a700 1 -- 172.21.15.72:0/2711909804 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15c400bd90 con 0x7f15dc0aad30 2023-07-25T14:37:24.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.824+0000 7f15dad9d700 1 --2- 172.21.15.72:0/2711909804 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f15c4004d90 0x7f15c4005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:24.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.824+0000 7f15d9d9b700 1 --2- 172.21.15.72:0/2711909804 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f15dc0aad30 0x7f15c4004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:24.840 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.824+0000 7f15da59c700 1 --2- 172.21.15.72:0/2711909804 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f15c4003a30 0x7f15c4003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:24.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.824+0000 7f15dad9d700 1 -- 172.21.15.72:0/2711909804 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f15dc0aad30 msgr2=0x7f15c4004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:24.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.825+0000 7f15dad9d700 1 --2- 172.21.15.72:0/2711909804 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f15dc0aad30 0x7f15c4004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:24.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.825+0000 7f15dad9d700 1 -- 172.21.15.72:0/2711909804 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f15c4003a30 msgr2=0x7f15c4003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:24.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.825+0000 7f15dad9d700 1 --2- 172.21.15.72:0/2711909804 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f15c4003a30 0x7f15c4003e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:24.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.825+0000 7f15dad9d700 1 -- 172.21.15.72:0/2711909804 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15c40035b0 con 0x7f15c4004d90 2023-07-25T14:37:24.841 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.825+0000 7f15dad9d700 1 --2- 172.21.15.72:0/2711909804 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f15c4004d90 0x7f15c4005210 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f15dc070b00 tx=0x7f15c4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43301b0f89c20c7f server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:24.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.825+0000 7f15d959a700 1 -- 172.21.15.72:0/2711909804 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15d400a2f0 con 0x7f15c4004d90 2023-07-25T14:37:24.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.825+0000 7f15d959a700 1 -- 172.21.15.72:0/2711909804 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15d4012600 con 0x7f15c4004d90 2023-07-25T14:37:24.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.825+0000 7f15d959a700 1 -- 172.21.15.72:0/2711909804 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15d40129b0 con 0x7f15c4004d90 2023-07-25T14:37:24.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.825+0000 7f15e0a68700 1 -- 172.21.15.72:0/2711909804 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f15c4004d90 msgr2=0x7f15c4005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:24.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.825+0000 7f15e0a68700 1 --2- 172.21.15.72:0/2711909804 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f15c4004d90 0x7f15c4005210 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f15dc070b00 tx=0x7f15c4005880 comp rx=0 tx=0).stop 2023-07-25T14:37:24.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.825+0000 7f15dad9d700 1 -- 172.21.15.72:0/2711909804 reap_dead start 2023-07-25T14:37:24.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.825+0000 7f15e0a68700 1 -- 172.21.15.72:0/2711909804 shutdown_connections 2023-07-25T14:37:24.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.825+0000 7f15e0a68700 1 -- 172.21.15.72:0/2711909804 >> 172.21.15.72:0/2711909804 conn(0x7f15dc06dd10 msgr2=0x7f15dc06e120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:24.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.825+0000 7f15e0a68700 1 -- 172.21.15.72:0/2711909804 shutdown_connections 2023-07-25T14:37:24.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.825+0000 7f15e0a68700 1 -- 172.21.15.72:0/2711909804 wait complete. 2023-07-25T14:37:24.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.827+0000 7f15e0a68700 1 Processor -- start 2023-07-25T14:37:24.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.827+0000 7f15e0a68700 1 -- start start 2023-07-25T14:37:24.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.827+0000 7f15e0a68700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f15c4004d90 0x7f15dc14e380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:24.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.827+0000 7f15e0a68700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f15dc156180 0x7f15dc1e7420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:24.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.827+0000 7f15e0a68700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f15dc154620 0x7f15dc0c48e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:24.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.827+0000 7f15e0a68700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15dc14f110 con 0x7f15dc156180 2023-07-25T14:37:24.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.827+0000 7f15e0a68700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15dc14f360 con 0x7f15dc154620 2023-07-25T14:37:24.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.827+0000 7f15e0a68700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15dc14f640 con 0x7f15c4004d90 2023-07-25T14:37:24.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.828+0000 7f15d9d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f15dc156180 0x7f15dc1e7420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:24.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.828+0000 7f15d9d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f15dc156180 0x7f15dc1e7420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43066/0 (socket says 172.21.15.72:43066) 2023-07-25T14:37:24.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.828+0000 7f15d9d9b700 1 -- 172.21.15.72:0/4039866812 learned_addr learned my addr 172.21.15.72:0/4039866812 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:37:24.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.828+0000 7f15dad9d700 1 --2- 172.21.15.72:0/4039866812 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f15dc154620 0x7f15dc0c48e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:24.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.828+0000 7f15da59c700 1 --2- 172.21.15.72:0/4039866812 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f15c4004d90 0x7f15dc14e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:24.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.828+0000 7f15d9d9b700 1 -- 172.21.15.72:0/4039866812 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f15c4004d90 msgr2=0x7f15dc14e380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:24.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.828+0000 7f15d9d9b700 1 --2- 172.21.15.72:0/4039866812 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f15c4004d90 0x7f15dc14e380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:24.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.828+0000 7f15d9d9b700 1 -- 172.21.15.72:0/4039866812 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f15dc154620 msgr2=0x7f15dc0c48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:24.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.828+0000 7f15d9d9b700 1 --2- 172.21.15.72:0/4039866812 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f15dc154620 0x7f15dc0c48e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:24.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.828+0000 7f15d9d9b700 1 -- 172.21.15.72:0/4039866812 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15dc153e20 con 0x7f15dc156180 2023-07-25T14:37:24.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.828+0000 7f15da59c700 1 --2- 172.21.15.72:0/4039866812 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f15c4004d90 0x7f15dc14e380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-25T14:37:24.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.828+0000 7f15d9d9b700 1 --2- 172.21.15.72:0/4039866812 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f15dc156180 0x7f15dc1e7420 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f15cc00f7f0 tx=0x7f15cc00fb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:24.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.828+0000 7f15caffd700 1 -- 172.21.15.72:0/4039866812 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15cc0052e0 con 0x7f15dc156180 2023-07-25T14:37:24.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.828+0000 7f15caffd700 1 -- 172.21.15.72:0/4039866812 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15cc005440 con 0x7f15dc156180 2023-07-25T14:37:24.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.828+0000 7f15e0a68700 1 -- 172.21.15.72:0/4039866812 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15dc154100 con 0x7f15dc156180 2023-07-25T14:37:24.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.828+0000 7f15caffd700 1 -- 172.21.15.72:0/4039866812 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15cc0038c0 con 0x7f15dc156180 2023-07-25T14:37:24.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.828+0000 7f15e0a68700 1 -- 172.21.15.72:0/4039866812 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15dc0c4e20 con 0x7f15dc156180 2023-07-25T14:37:24.848 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.829+0000 7f15e0a68700 1 -- 172.21.15.72:0/4039866812 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15dc154470 con 0x7f15dc156180 2023-07-25T14:37:24.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.830+0000 7f15caffd700 1 -- 172.21.15.72:0/4039866812 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f15cc003a20 con 0x7f15dc156180 2023-07-25T14:37:24.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.830+0000 7f15caffd700 1 --2- 172.21.15.72:0/4039866812 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f15bc06ace0 0x7f15bc06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:24.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.830+0000 7f15caffd700 1 -- 172.21.15.72:0/4039866812 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 7238+0+0 (secure 0 0 0) 0x7f15cc089620 con 0x7f15dc156180 2023-07-25T14:37:24.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.830+0000 7f15da59c700 1 --2- 172.21.15.72:0/4039866812 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f15bc06ace0 0x7f15bc06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:24.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.830+0000 7f15da59c700 1 --2- 172.21.15.72:0/4039866812 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f15bc06ace0 0x7f15bc06d1a0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f15d0009c60 tx=0x7f15d0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:24.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:24.834+0000 7f15caffd700 1 -- 172.21.15.72:0/4039866812 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f15cc0542c0 con 0x7f15dc156180 2023-07-25T14:37:25.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:25.067+0000 7f15e0a68700 1 -- 172.21.15.72:0/4039866812 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f15dc04e470 con 0x7f15dc156180 2023-07-25T14:37:25.078 INFO:tasks.ceph.mon.a.smithi072.stderr:2023-07-25T14:37:25.068+0000 7f5fcfeea700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-07-25T14:37:25.084 INFO:tasks.ceph.mds.a.smithi072.stderr: -3929> 2023-07-25T14:36:54.051+0000 7f9af66c0700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-25T14:37:25.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:25.075+0000 7f15caffd700 1 -- 172.21.15.72:0/4039866812 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v23) v1 ==== 161+0+0 (secure 0 0 0) 0x7f15cc0578e0 con 0x7f15dc156180 2023-07-25T14:37:25.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:25.078+0000 7f15e0a68700 1 -- 172.21.15.72:0/4039866812 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f15bc06ace0 msgr2=0x7f15bc06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:25.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:25.078+0000 7f15e0a68700 1 --2- 172.21.15.72:0/4039866812 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f15bc06ace0 0x7f15bc06d1a0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f15d0009c60 tx=0x7f15d0008040 comp rx=0 tx=0).stop 2023-07-25T14:37:25.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:25.078+0000 7f15e0a68700 1 -- 172.21.15.72:0/4039866812 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f15dc156180 msgr2=0x7f15dc1e7420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:25.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:25.078+0000 7f15e0a68700 1 --2- 172.21.15.72:0/4039866812 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f15dc156180 0x7f15dc1e7420 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f15cc00f7f0 tx=0x7f15cc00fb00 comp rx=0 tx=0).stop 2023-07-25T14:37:25.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:25.078+0000 7f15e0a68700 1 -- 172.21.15.72:0/4039866812 shutdown_connections 2023-07-25T14:37:25.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:25.078+0000 7f15e0a68700 1 --2- 172.21.15.72:0/4039866812 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f15bc06ace0 0x7f15bc06d1a0 secure :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f15d0009c60 tx=0x7f15d0008040 comp rx=0 tx=0).stop 2023-07-25T14:37:25.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:25.078+0000 7f15e0a68700 1 --2- 172.21.15.72:0/4039866812 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f15c4004d90 0x7f15dc14e380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:25.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:25.078+0000 7f15e0a68700 1 --2- 172.21.15.72:0/4039866812 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f15dc154620 0x7f15dc0c48e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:25.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:25.078+0000 7f15e0a68700 1 --2- 172.21.15.72:0/4039866812 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f15dc156180 0x7f15dc1e7420 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:25.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:25.078+0000 7f15e0a68700 1 -- 172.21.15.72:0/4039866812 >> 172.21.15.72:0/4039866812 conn(0x7f15dc06dd10 msgr2=0x7f15dc0ab110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:25.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:25.078+0000 7f15e0a68700 1 -- 172.21.15.72:0/4039866812 shutdown_connections 2023-07-25T14:37:25.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:25.078+0000 7f15e0a68700 1 -- 172.21.15.72:0/4039866812 wait complete. 2023-07-25T14:37:25.090 INFO:teuthology.orchestra.run.smithi072.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-07-25T14:37:25.101 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-07-25T14:37:25.114 INFO:tasks.ceph.mds.a.smithi072.stdout:starting mds.a at 2023-07-25T14:37:25.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:25.213+0000 7fc11cb10700 1 Processor -- start 2023-07-25T14:37:25.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:25.213+0000 7fc11cb10700 1 -- start start 2023-07-25T14:37:25.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:25.214+0000 7fc11cb10700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc118151ba0 0x7fc1180c2230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:25.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:25.214+0000 7fc11cb10700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc1180c5f40 0x7fc118154640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:25.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:25.214+0000 7fc11cb10700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1180c54f0 con 0x7fc1180ba0e0 2023-07-25T14:37:25.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:25.214+0000 7fc11cb10700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1180c6670 con 0x7fc1180c5f40 2023-07-25T14:37:25.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:25.214+0000 7fc11cb10700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1180c5740 con 0x7fc118151ba0 2023-07-25T14:37:25.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:25.214+0000 7fc115d9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc1180c5f40 0x7fc118154640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:25.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:25.214+0000 7fc116d9d700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fc1180ba0e0 0x7fc118071740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:33822/0 (socket says 172.21.15.72:33822) 2023-07-25T14:37:25.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:25.214+0000 7fc116d9d700 1 -- 172.21.15.72:0/4036114725 learned_addr learned my addr 172.21.15.72:0/4036114725 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:37:25.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:25.214+0000 7fc11659c700 1 --2- 172.21.15.72:0/4036114725 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc118151ba0 0x7fc1180c2230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:25.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:25.214+0000 7fc115d9b700 1 -- 172.21.15.72:0/4036114725 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc118151ba0 msgr2=0x7fc1180c2230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:25.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:25.214+0000 7fc115d9b700 1 --2- 172.21.15.72:0/4036114725 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc118151ba0 0x7fc1180c2230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:25.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:25.214+0000 7fc115d9b700 1 -- 172.21.15.72:0/4036114725 >> v1:172.21.15.72:6789/0 conn(0x7fc1180ba0e0 legacy=0x7fc118071740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:25.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:25.214+0000 7fc115d9b700 1 -- 172.21.15.72:0/4036114725 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1180c5a20 con 0x7fc1180c5f40 2023-07-25T14:37:25.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:25.214+0000 7fc11559a700 1 -- 172.21.15.72:0/4036114725 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3854806672 0 0) 0x7fc1180c54f0 con 0x7fc1180ba0e0 2023-07-25T14:37:25.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:25.215+0000 7fc115d9b700 1 --2- 172.21.15.72:0/4036114725 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc1180c5f40 0x7fc118154640 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fc108009840 tx=0x7fc108009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f3007a5f7ce8667 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:25.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:25.215+0000 7fc11559a700 1 -- 172.21.15.72:0/4036114725 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc108011830 con 0x7fc1180c5f40 2023-07-25T14:37:25.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:25.215+0000 7fc11559a700 1 -- 172.21.15.72:0/4036114725 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc108011990 con 0x7fc1180c5f40 2023-07-25T14:37:25.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:25.215+0000 7fc11559a700 1 -- 172.21.15.72:0/4036114725 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc108011d20 con 0x7fc1180c5f40 2023-07-25T14:37:25.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:25.215+0000 7fc11cb10700 1 -- 172.21.15.72:0/4036114725 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc1180c5f40 msgr2=0x7fc118154640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:25.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:25.215+0000 7fc11cb10700 1 --2- 172.21.15.72:0/4036114725 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc1180c5f40 0x7fc118154640 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fc108009840 tx=0x7fc108009b50 comp rx=0 tx=0).stop 2023-07-25T14:37:25.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:25.215+0000 7fc11cb10700 1 -- 172.21.15.72:0/4036114725 shutdown_connections 2023-07-25T14:37:25.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:25.215+0000 7fc11cb10700 1 --2- 172.21.15.72:0/4036114725 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc118151ba0 0x7fc1180c2230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:25.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:25.215+0000 7fc11cb10700 1 --2- 172.21.15.72:0/4036114725 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc1180c5f40 0x7fc118154640 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:25.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:25.215+0000 7fc11cb10700 1 -- 172.21.15.72:0/4036114725 >> 172.21.15.72:0/4036114725 conn(0x7fc1180a87e0 msgr2=0x7fc1180a8bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:25.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:25.215+0000 7fc11cb10700 1 -- 172.21.15.72:0/4036114725 shutdown_connections 2023-07-25T14:37:25.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:25.215+0000 7fc11cb10700 1 -- 172.21.15.72:0/4036114725 wait complete. 2023-07-25T14:37:25.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:25.217+0000 7fc11cb10700 1 Processor -- start 2023-07-25T14:37:25.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:25.217+0000 7fc11cb10700 1 -- start start 2023-07-25T14:37:25.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:25.217+0000 7fc11cb10700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc1180ba0e0 0x7fc11815f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:25.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:25.217+0000 7fc11cb10700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc1180c5f40 0x7fc118154d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:25.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:25.217+0000 7fc11cb10700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc118151ba0 0x7fc1181e9a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:25.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:25.217+0000 7fc11cb10700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1180ab220 con 0x7fc1180ba0e0 2023-07-25T14:37:25.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:25.217+0000 7fc11cb10700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc11814f2a0 con 0x7fc1180c5f40 2023-07-25T14:37:25.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:25.217+0000 7fc11cb10700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc11814e970 con 0x7fc118151ba0 2023-07-25T14:37:25.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:25.217+0000 7fc11659c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc1180ba0e0 0x7fc11815f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:25.231 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:25.217+0000 7fc11659c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc1180ba0e0 0x7fc11815f4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43088/0 (socket says 172.21.15.72:43088) 2023-07-25T14:37:25.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:25.217+0000 7fc11659c700 1 -- 172.21.15.72:0/1858997351 learned_addr learned my addr 172.21.15.72:0/1858997351 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:37:25.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:25.218+0000 7fc11659c700 1 -- 172.21.15.72:0/1858997351 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc118151ba0 msgr2=0x7fc1181e9a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:25.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:25.218+0000 7fc11659c700 1 --2- 172.21.15.72:0/1858997351 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc118151ba0 0x7fc1181e9a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:25.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:25.218+0000 7fc115d9b700 1 --2- 172.21.15.72:0/1858997351 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc1180c5f40 0x7fc118154d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:25.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:25.218+0000 7fc11659c700 1 -- 172.21.15.72:0/1858997351 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc1180c5f40 msgr2=0x7fc118154d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:25.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:25.218+0000 7fc11659c700 1 --2- 172.21.15.72:0/1858997351 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc1180c5f40 0x7fc118154d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:25.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:25.218+0000 7fc11659c700 1 -- 172.21.15.72:0/1858997351 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1080094a0 con 0x7fc1180ba0e0 2023-07-25T14:37:25.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:25.218+0000 7fc11659c700 1 --2- 172.21.15.72:0/1858997351 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc1180ba0e0 0x7fc11815f4c0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fc10c00e870 tx=0x7fc10c00ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:25.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:25.218+0000 7fc106ffd700 1 -- 172.21.15.72:0/1858997351 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc10c009590 con 0x7fc1180ba0e0 2023-07-25T14:37:25.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:25.218+0000 7fc106ffd700 1 -- 172.21.15.72:0/1858997351 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc10c00ee70 con 0x7fc1180ba0e0 2023-07-25T14:37:25.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:25.218+0000 7fc11cb10700 1 -- 172.21.15.72:0/1858997351 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc11814ec50 con 0x7fc1180ba0e0 2023-07-25T14:37:25.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:25.218+0000 7fc106ffd700 1 -- 172.21.15.72:0/1858997351 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc10c00ca50 con 0x7fc1180ba0e0 2023-07-25T14:37:25.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:25.218+0000 7fc11cb10700 1 -- 172.21.15.72:0/1858997351 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc118150000 con 0x7fc1180ba0e0 2023-07-25T14:37:25.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:25.219+0000 7fc11cb10700 1 -- 172.21.15.72:0/1858997351 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc118151f80 con 0x7fc1180ba0e0 2023-07-25T14:37:25.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:25.219+0000 7fc106ffd700 1 -- 172.21.15.72:0/1858997351 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc10c00cbb0 con 0x7fc1180ba0e0 2023-07-25T14:37:25.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:25.220+0000 7fc106ffd700 1 --2- 172.21.15.72:0/1858997351 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fc0f806ace0 0x7fc0f806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:25.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:25.220+0000 7fc106ffd700 1 -- 172.21.15.72:0/1858997351 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 7324+0+0 (secure 0 0 0) 0x7fc10c089840 con 0x7fc1180ba0e0 2023-07-25T14:37:25.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:25.220+0000 7fc115d9b700 1 --2- 172.21.15.72:0/1858997351 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fc0f806ace0 0x7fc0f806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:25.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:25.220+0000 7fc115d9b700 1 --2- 172.21.15.72:0/1858997351 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fc0f806ace0 0x7fc0f806d1a0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fc1180c6320 tx=0x7fc108008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:25.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:25.224+0000 7fc106ffd700 1 -- 172.21.15.72:0/1858997351 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fc10c057f20 con 0x7fc1180ba0e0 2023-07-25T14:37:25.469 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:25.459+0000 7fc11cb10700 1 -- 172.21.15.72:0/1858997351 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fc11804e470 con 0x7fc1180ba0e0 2023-07-25T14:37:26.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:26.076+0000 7fc106ffd700 1 -- 172.21.15.72:0/1858997351 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v24) v1 ==== 104+0+0 (secure 0 0 0) 0x7fc10c00ce60 con 0x7fc1180ba0e0 2023-07-25T14:37:26.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:26.078+0000 7fc11cb10700 1 -- 172.21.15.72:0/1858997351 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fc0f806ace0 msgr2=0x7fc0f806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:26.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:26.078+0000 7fc11cb10700 1 --2- 172.21.15.72:0/1858997351 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fc0f806ace0 0x7fc0f806d1a0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fc1180c6320 tx=0x7fc108008030 comp rx=0 tx=0).stop 2023-07-25T14:37:26.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:26.078+0000 7fc11cb10700 1 -- 172.21.15.72:0/1858997351 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc1180ba0e0 msgr2=0x7fc11815f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:26.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:26.078+0000 7fc11cb10700 1 --2- 172.21.15.72:0/1858997351 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc1180ba0e0 0x7fc11815f4c0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fc10c00e870 tx=0x7fc10c00ec30 comp rx=0 tx=0).stop 2023-07-25T14:37:26.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:26.079+0000 7fc11cb10700 1 -- 172.21.15.72:0/1858997351 shutdown_connections 2023-07-25T14:37:26.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:26.079+0000 7fc11cb10700 1 --2- 172.21.15.72:0/1858997351 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fc0f806ace0 0x7fc0f806d1a0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:26.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:26.079+0000 7fc11cb10700 1 --2- 172.21.15.72:0/1858997351 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc118151ba0 0x7fc1181e9a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:26.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:26.079+0000 7fc11cb10700 1 --2- 172.21.15.72:0/1858997351 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc1180ba0e0 0x7fc11815f4c0 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:26.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:26.079+0000 7fc11cb10700 1 --2- 172.21.15.72:0/1858997351 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc1180c5f40 0x7fc118154d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:26.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:26.079+0000 7fc11cb10700 1 -- 172.21.15.72:0/1858997351 >> 172.21.15.72:0/1858997351 conn(0x7fc1180a87e0 msgr2=0x7fc118150820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:26.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:26.079+0000 7fc11cb10700 1 -- 172.21.15.72:0/1858997351 shutdown_connections 2023-07-25T14:37:26.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:26.079+0000 7fc11cb10700 1 -- 172.21.15.72:0/1858997351 wait complete. 2023-07-25T14:37:26.103 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-07-25T14:37:26.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:26.265+0000 7f50ab3ba700 1 Processor -- start 2023-07-25T14:37:26.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:26.265+0000 7f50ab3ba700 1 -- start start 2023-07-25T14:37:26.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:26.266+0000 7f50ab3ba700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f50a40c5820 0x7f50a4154570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:26.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:26.266+0000 7f50ab3ba700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50a406d010 con 0x7f50a40c45a0 2023-07-25T14:37:26.278 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:26.266+0000 7f50ab3ba700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50a41584d0 con 0x7f50a4070d10 2023-07-25T14:37:26.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:26.266+0000 7f50ab3ba700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50a40c3460 con 0x7f50a40c5820 2023-07-25T14:37:26.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:26.266+0000 7f50a9156700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f50a40c45a0 0x7f50a4151780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:33834/0 (socket says 172.21.15.72:33834) 2023-07-25T14:37:26.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:26.266+0000 7f50a9156700 1 -- 172.21.15.72:0/2436921910 learned_addr learned my addr 172.21.15.72:0/2436921910 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:37:26.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:26.266+0000 7f50a8955700 1 --2- 172.21.15.72:0/2436921910 >> v2:172.21.15.92:3300/0 conn(0x7f50a40c5820 0x7f50a4154570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:26.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:26.266+0000 7f509bfff700 1 -- 172.21.15.72:0/2436921910 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1261334653 0 0) 0x7f50a406d010 con 0x7f50a40c45a0 2023-07-25T14:37:26.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:26.266+0000 7f509bfff700 1 -- 172.21.15.72:0/2436921910 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f50900035b0 con 0x7f50a40c45a0 2023-07-25T14:37:26.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:26.266+0000 7f509bfff700 1 -- 172.21.15.72:0/2436921910 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1531994263 0 0) 0x7f50900035b0 con 0x7f50a40c45a0 2023-07-25T14:37:26.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:26.266+0000 7f509bfff700 1 -- 172.21.15.72:0/2436921910 >> v2:172.21.15.92:3300/0 conn(0x7f50a40c5820 msgr2=0x7f50a4154570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:26.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:26.266+0000 7f509bfff700 1 --2- 172.21.15.72:0/2436921910 >> v2:172.21.15.92:3300/0 conn(0x7f50a40c5820 0x7f50a4154570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:26.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:26.266+0000 7f509bfff700 1 -- 172.21.15.72:0/2436921910 >> v1:172.21.15.92:6789/0 conn(0x7f50a4070d10 legacy=0x7f50a4154ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:26.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:26.266+0000 7f509bfff700 1 -- 172.21.15.72:0/2436921910 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50a40c2340 con 0x7f50a40c45a0 2023-07-25T14:37:26.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:26.266+0000 7f509bfff700 1 -- 172.21.15.72:0/2436921910 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2559588315 0 0) 0x7f50a0001670 con 0x7f50a40c45a0 2023-07-25T14:37:26.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:26.267+0000 7f509bfff700 1 -- 172.21.15.72:0/2436921910 >> v1:172.21.15.72:6789/0 conn(0x7f50a40c45a0 legacy=0x7f50a4151780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:26.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:26.267+0000 7f509bfff700 1 --2- 172.21.15.72:0/2436921910 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5090003a00 0x7f5090003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:26.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:26.267+0000 7f509bfff700 1 --2- 172.21.15.72:0/2436921910 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5090004850 0x7f5090004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:26.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:26.267+0000 7f509bfff700 1 --2- 172.21.15.72:0/2436921910 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5090005210 0x7f509000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:26.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:26.267+0000 7f509bfff700 1 -- 172.21.15.72:0/2436921910 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50a40c3460 con 0x7f5090004850 2023-07-25T14:37:26.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:26.267+0000 7f509bfff700 1 -- 172.21.15.72:0/2436921910 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f509000c110 con 0x7f5090005210 2023-07-25T14:37:26.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:26.267+0000 7f509bfff700 1 -- 172.21.15.72:0/2436921910 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f509000c2d0 con 0x7f5090003a00 2023-07-25T14:37:26.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:26.267+0000 7f50a8955700 1 --2- 172.21.15.72:0/2436921910 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5090004850 0x7f5090004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:26.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:26.267+0000 7f50a9957700 1 --2- 172.21.15.72:0/2436921910 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5090005210 0x7f509000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:26.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:26.267+0000 7f50a9156700 1 --2- 172.21.15.72:0/2436921910 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5090003a00 0x7f5090003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:26.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:26.267+0000 7f50a8955700 1 -- 172.21.15.72:0/2436921910 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5090003a00 msgr2=0x7f5090003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:26.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:26.267+0000 7f50a8955700 1 --2- 172.21.15.72:0/2436921910 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5090003a00 0x7f5090003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:26.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:26.267+0000 7f50a8955700 1 -- 172.21.15.72:0/2436921910 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5090005210 msgr2=0x7f509000ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:26.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:26.267+0000 7f50a8955700 1 --2- 172.21.15.72:0/2436921910 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5090005210 0x7f509000ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:26.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:26.267+0000 7f50a8955700 1 -- 172.21.15.72:0/2436921910 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50900035b0 con 0x7f5090004850 2023-07-25T14:37:26.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:26.267+0000 7f50a9957700 1 --2- 172.21.15.72:0/2436921910 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5090005210 0x7f509000ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-25T14:37:26.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:26.267+0000 7f50a9957700 1 -- 172.21.15.72:0/2436921910 reap_dead start 2023-07-25T14:37:26.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:26.267+0000 7f50a8955700 1 --2- 172.21.15.72:0/2436921910 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5090004850 0x7f5090004cd0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f5094009b30 tx=0x7f5090005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=baa68045a7c7b2e2 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:26.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:26.267+0000 7f509bfff700 1 -- 172.21.15.72:0/2436921910 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f509400e6c0 con 0x7f5090004850 2023-07-25T14:37:26.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:26.267+0000 7f509bfff700 1 -- 172.21.15.72:0/2436921910 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f509400e820 con 0x7f5090004850 2023-07-25T14:37:26.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:26.267+0000 7f509bfff700 1 -- 172.21.15.72:0/2436921910 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f509400eb90 con 0x7f5090004850 2023-07-25T14:37:26.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:26.268+0000 7f50ab3ba700 1 -- 172.21.15.72:0/2436921910 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5090004850 msgr2=0x7f5090004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:26.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:26.268+0000 7f50ab3ba700 1 --2- 172.21.15.72:0/2436921910 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5090004850 0x7f5090004cd0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f5094009b30 tx=0x7f5090005880 comp rx=0 tx=0).stop 2023-07-25T14:37:26.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:26.268+0000 7f50ab3ba700 1 -- 172.21.15.72:0/2436921910 shutdown_connections 2023-07-25T14:37:26.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:26.268+0000 7f50ab3ba700 1 --2- 172.21.15.72:0/2436921910 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5090004850 0x7f5090004cd0 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:26.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:26.268+0000 7f50ab3ba700 1 -- 172.21.15.72:0/2436921910 >> 172.21.15.72:0/2436921910 conn(0x7f50a40a9530 msgr2=0x7f50a40a9910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:26.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:26.268+0000 7f50ab3ba700 1 -- 172.21.15.72:0/2436921910 shutdown_connections 2023-07-25T14:37:26.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:26.268+0000 7f50ab3ba700 1 -- 172.21.15.72:0/2436921910 wait complete. 2023-07-25T14:37:26.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:26.269+0000 7f50ab3ba700 1 Processor -- start 2023-07-25T14:37:26.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:26.269+0000 7f50ab3ba700 1 -- start start 2023-07-25T14:37:26.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:26.270+0000 7f50ab3ba700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5090004850 0x7f50a41e97b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:26.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:26.270+0000 7f50ab3ba700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f50a40aaa40 0x7f50a4156d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:26.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:26.270+0000 7f50ab3ba700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f50a41e6a20 0x7f50a41e6ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:26.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:26.270+0000 7f50ab3ba700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50a40c2a00 con 0x7f50a40aaa40 2023-07-25T14:37:26.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:26.270+0000 7f50ab3ba700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50a40ad150 con 0x7f50a41e6a20 2023-07-25T14:37:26.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:26.270+0000 7f50ab3ba700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50a40c5d50 con 0x7f5090004850 2023-07-25T14:37:26.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:26.270+0000 7f50a8955700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f50a40aaa40 0x7f50a4156d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:26.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:26.270+0000 7f50a8955700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f50a40aaa40 0x7f50a4156d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43112/0 (socket says 172.21.15.72:43112) 2023-07-25T14:37:26.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:26.270+0000 7f50a8955700 1 -- 172.21.15.72:0/4133569274 learned_addr learned my addr 172.21.15.72:0/4133569274 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:37:26.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:26.270+0000 7f50a9957700 1 --2- 172.21.15.72:0/4133569274 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f50a41e6a20 0x7f50a41e6ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:26.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:26.270+0000 7f50a9156700 1 --2- 172.21.15.72:0/4133569274 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5090004850 0x7f50a41e97b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:26.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:26.270+0000 7f50a8955700 1 -- 172.21.15.72:0/4133569274 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5090004850 msgr2=0x7f50a41e97b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:26.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:26.270+0000 7f50a8955700 1 --2- 172.21.15.72:0/4133569274 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5090004850 0x7f50a41e97b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:26.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:26.270+0000 7f50a8955700 1 -- 172.21.15.72:0/4133569274 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f50a41e6a20 msgr2=0x7f50a41e6ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:26.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:26.270+0000 7f50a8955700 1 --2- 172.21.15.72:0/4133569274 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f50a41e6a20 0x7f50a41e6ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:26.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:26.270+0000 7f50a8955700 1 -- 172.21.15.72:0/4133569274 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50a41e9de0 con 0x7f50a40aaa40 2023-07-25T14:37:26.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:26.270+0000 7f50a8955700 1 --2- 172.21.15.72:0/4133569274 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f50a40aaa40 0x7f50a4156d70 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f509400efd0 tx=0x7f50940047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:26.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:26.271+0000 7f5099ffb700 1 -- 172.21.15.72:0/4133569274 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f509400e6c0 con 0x7f50a40aaa40 2023-07-25T14:37:26.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:26.271+0000 7f5099ffb700 1 -- 172.21.15.72:0/4133569274 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5094003ab0 con 0x7f50a40aaa40 2023-07-25T14:37:26.289 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:26.271+0000 7f50ab3ba700 1 -- 172.21.15.72:0/4133569274 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50a41ea0c0 con 0x7f50a40aaa40 2023-07-25T14:37:26.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:26.271+0000 7f5099ffb700 1 -- 172.21.15.72:0/4133569274 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5094003e60 con 0x7f50a40aaa40 2023-07-25T14:37:26.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:26.271+0000 7f50ab3ba700 1 -- 172.21.15.72:0/4133569274 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50a41ea680 con 0x7f50a40aaa40 2023-07-25T14:37:26.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:26.272+0000 7f50ab3ba700 1 -- 172.21.15.72:0/4133569274 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50a40bc8a0 con 0x7f50a40aaa40 2023-07-25T14:37:26.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:26.272+0000 7f5099ffb700 1 -- 172.21.15.72:0/4133569274 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5094013470 con 0x7f50a40aaa40 2023-07-25T14:37:26.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:26.273+0000 7f5099ffb700 1 --2- 172.21.15.72:0/4133569274 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f508806ace0 0x7f508806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:26.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:26.273+0000 7f5099ffb700 1 -- 172.21.15.72:0/4133569274 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 7324+0+0 (secure 0 0 0) 0x7f509408b010 con 0x7f50a40aaa40 2023-07-25T14:37:26.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:26.273+0000 7f50a9156700 1 --2- 172.21.15.72:0/4133569274 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f508806ace0 0x7f508806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:26.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:26.273+0000 7f50a9156700 1 --2- 172.21.15.72:0/4133569274 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f508806ace0 0x7f508806d1a0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f50a0001eb0 tx=0x7f50a0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:26.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:26.277+0000 7f5099ffb700 1 -- 172.21.15.72:0/4133569274 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f5094055d80 con 0x7f50a40aaa40 2023-07-25T14:37:26.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:26.464+0000 7f50ab3ba700 1 -- 172.21.15.72:0/4133569274 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f50a40c2a00 con 0x7f50a40aaa40 2023-07-25T14:37:27.087 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:27.077+0000 7f5099ffb700 1 -- 172.21.15.72:0/4133569274 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v45) v1 ==== 181+0+0 (secure 0 0 0) 0x7f50940593a0 con 0x7f50a40aaa40 2023-07-25T14:37:27.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:27.080+0000 7f50ab3ba700 1 -- 172.21.15.72:0/4133569274 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f508806ace0 msgr2=0x7f508806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:27.090 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:27.080+0000 7f50ab3ba700 1 --2- 172.21.15.72:0/4133569274 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f508806ace0 0x7f508806d1a0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f50a0001eb0 tx=0x7f50a0009040 comp rx=0 tx=0).stop 2023-07-25T14:37:27.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:27.080+0000 7f50ab3ba700 1 -- 172.21.15.72:0/4133569274 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f50a40aaa40 msgr2=0x7f50a4156d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:27.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:27.080+0000 7f50ab3ba700 1 --2- 172.21.15.72:0/4133569274 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f50a40aaa40 0x7f50a4156d70 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f509400efd0 tx=0x7f50940047c0 comp rx=0 tx=0).stop 2023-07-25T14:37:27.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:27.080+0000 7f50ab3ba700 1 -- 172.21.15.72:0/4133569274 shutdown_connections 2023-07-25T14:37:27.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:27.080+0000 7f50ab3ba700 1 --2- 172.21.15.72:0/4133569274 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f508806ace0 0x7f508806d1a0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:27.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:27.080+0000 7f50ab3ba700 1 --2- 172.21.15.72:0/4133569274 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5090004850 0x7f50a41e97b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:27.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:27.080+0000 7f50ab3ba700 1 --2- 172.21.15.72:0/4133569274 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f50a41e6a20 0x7f50a41e6ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:27.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:27.080+0000 7f50ab3ba700 1 --2- 172.21.15.72:0/4133569274 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f50a40aaa40 0x7f50a4156d70 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:27.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:27.080+0000 7f50ab3ba700 1 -- 172.21.15.72:0/4133569274 >> 172.21.15.72:0/4133569274 conn(0x7f50a40a9530 msgr2=0x7f50a4152050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:27.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:27.080+0000 7f50ab3ba700 1 -- 172.21.15.72:0/4133569274 shutdown_connections 2023-07-25T14:37:27.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:27.080+0000 7f50ab3ba700 1 -- 172.21.15.72:0/4133569274 wait complete. 2023-07-25T14:37:27.092 INFO:teuthology.orchestra.run.smithi072.stderr:pool 'cephfs_metadata' removed 2023-07-25T14:37:27.105 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-07-25T14:37:27.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:27.225+0000 7f2d4994e700 1 Processor -- start 2023-07-25T14:37:27.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:27.225+0000 7f2d4994e700 1 -- start start 2023-07-25T14:37:27.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:27.225+0000 7f2d4994e700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2d440c0f50 0x7f2d440c1820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:27.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:27.225+0000 7f2d4994e700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d440a5a90 con 0x7f2d441529e0 2023-07-25T14:37:27.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:27.225+0000 7f2d4994e700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d440c1f50 con 0x7f2d4414c130 2023-07-25T14:37:27.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:27.225+0000 7f2d4994e700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d440c0b30 con 0x7f2d440c0f50 2023-07-25T14:37:27.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:27.225+0000 7f2d427fc700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2d440c0f50 0x7f2d440c1820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:27.237 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:27.226+0000 7f2d437fe700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f2d441529e0 0x7f2d4406d420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:33858/0 (socket says 172.21.15.72:33858) 2023-07-25T14:37:27.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:27.226+0000 7f2d437fe700 1 -- 172.21.15.72:0/4213944632 learned_addr learned my addr 172.21.15.72:0/4213944632 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:37:27.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:27.226+0000 7f2d427fc700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f2d440c0f50 0x7f2d440c1820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43120/0 (socket says 172.21.15.72:43120) 2023-07-25T14:37:27.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:27.226+0000 7f2d427fc700 1 -- 172.21.15.72:0/4213944632 >> v1:172.21.15.92:6789/0 conn(0x7f2d4414c130 legacy=0x7f2d440a5380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:27.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:27.226+0000 7f2d427fc700 1 -- 172.21.15.72:0/4213944632 >> v1:172.21.15.72:6789/0 conn(0x7f2d441529e0 legacy=0x7f2d4406d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:27.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:27.226+0000 7f2d427fc700 1 -- 172.21.15.72:0/4213944632 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d440c0190 con 0x7f2d440c0f50 2023-07-25T14:37:27.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:27.226+0000 7f2d427fc700 1 --2- 172.21.15.72:0/4213944632 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2d440c0f50 0x7f2d440c1820 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f2d34009840 tx=0x7f2d34009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff443bd1b45998ae server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:27.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:27.226+0000 7f2d41ffb700 1 -- 172.21.15.72:0/4213944632 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d34004230 con 0x7f2d440c0f50 2023-07-25T14:37:27.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:27.226+0000 7f2d41ffb700 1 -- 172.21.15.72:0/4213944632 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d34004390 con 0x7f2d440c0f50 2023-07-25T14:37:27.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:27.226+0000 7f2d41ffb700 1 -- 172.21.15.72:0/4213944632 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d340036a0 con 0x7f2d440c0f50 2023-07-25T14:37:27.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:27.227+0000 7f2d4994e700 1 -- 172.21.15.72:0/4213944632 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2d440c0f50 msgr2=0x7f2d440c1820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:27.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:27.227+0000 7f2d4994e700 1 --2- 172.21.15.72:0/4213944632 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2d440c0f50 0x7f2d440c1820 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f2d34009840 tx=0x7f2d34009b50 comp rx=0 tx=0).stop 2023-07-25T14:37:27.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:27.227+0000 7f2d4994e700 1 -- 172.21.15.72:0/4213944632 shutdown_connections 2023-07-25T14:37:27.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:27.227+0000 7f2d4994e700 1 --2- 172.21.15.72:0/4213944632 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2d440c0f50 0x7f2d440c1820 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:27.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:27.227+0000 7f2d4994e700 1 -- 172.21.15.72:0/4213944632 >> 172.21.15.72:0/4213944632 conn(0x7f2d440c61e0 msgr2=0x7f2d440c21f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:27.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:27.227+0000 7f2d4994e700 1 -- 172.21.15.72:0/4213944632 shutdown_connections 2023-07-25T14:37:27.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:27.227+0000 7f2d4994e700 1 -- 172.21.15.72:0/4213944632 wait complete. 2023-07-25T14:37:27.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:27.228+0000 7f2d4994e700 1 Processor -- start 2023-07-25T14:37:27.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:27.228+0000 7f2d4994e700 1 -- start start 2023-07-25T14:37:27.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:27.229+0000 7f2d4994e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2d440c0f50 0x7f2d44150ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:27.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:27.229+0000 7f2d4994e700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2d4414c130 0x7f2d440703c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:27.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:27.229+0000 7f2d4994e700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2d441529e0 0x7f2d44071400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:27.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:27.229+0000 7f2d4994e700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d44070900 con 0x7f2d440c0f50 2023-07-25T14:37:27.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:27.229+0000 7f2d4994e700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d441ed180 con 0x7f2d4414c130 2023-07-25T14:37:27.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:27.229+0000 7f2d4994e700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d44144fe0 con 0x7f2d441529e0 2023-07-25T14:37:27.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:27.229+0000 7f2d42ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2d440c0f50 0x7f2d44150ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:27.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:27.229+0000 7f2d42ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2d440c0f50 0x7f2d44150ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43124/0 (socket says 172.21.15.72:43124) 2023-07-25T14:37:27.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:27.229+0000 7f2d42ffd700 1 -- 172.21.15.72:0/659549908 learned_addr learned my addr 172.21.15.72:0/659549908 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:37:27.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:27.229+0000 7f2d437fe700 1 --2- 172.21.15.72:0/659549908 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2d441529e0 0x7f2d44071400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:27.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:27.229+0000 7f2d427fc700 1 --2- 172.21.15.72:0/659549908 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2d4414c130 0x7f2d440703c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:27.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:27.229+0000 7f2d42ffd700 1 -- 172.21.15.72:0/659549908 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2d441529e0 msgr2=0x7f2d44071400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:27.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:27.229+0000 7f2d42ffd700 1 --2- 172.21.15.72:0/659549908 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2d441529e0 0x7f2d44071400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:27.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:27.229+0000 7f2d42ffd700 1 -- 172.21.15.72:0/659549908 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2d4414c130 msgr2=0x7f2d440703c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:27.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:27.229+0000 7f2d42ffd700 1 --2- 172.21.15.72:0/659549908 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2d4414c130 0x7f2d440703c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:27.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:27.229+0000 7f2d42ffd700 1 -- 172.21.15.72:0/659549908 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d340094a0 con 0x7f2d440c0f50 2023-07-25T14:37:27.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:27.229+0000 7f2d437fe700 1 --2- 172.21.15.72:0/659549908 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2d441529e0 0x7f2d44071400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-25T14:37:27.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:27.229+0000 7f2d427fc700 1 --2- 172.21.15.72:0/659549908 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2d4414c130 0x7f2d440703c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-25T14:37:27.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:27.229+0000 7f2d42ffd700 1 --2- 172.21.15.72:0/659549908 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2d440c0f50 0x7f2d44150ef0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f2d3800b4a0 tx=0x7f2d3800b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:27.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:27.229+0000 7f2d2bfff700 1 -- 172.21.15.72:0/659549908 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d38011830 con 0x7f2d440c0f50 2023-07-25T14:37:27.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:27.229+0000 7f2d2bfff700 1 -- 172.21.15.72:0/659549908 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d38011990 con 0x7f2d440c0f50 2023-07-25T14:37:27.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:27.229+0000 7f2d4994e700 1 -- 172.21.15.72:0/659549908 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d441452c0 con 0x7f2d440c0f50 2023-07-25T14:37:27.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:27.229+0000 7f2d2bfff700 1 -- 172.21.15.72:0/659549908 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d38011d40 con 0x7f2d440c0f50 2023-07-25T14:37:27.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:27.229+0000 7f2d4994e700 1 -- 172.21.15.72:0/659549908 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d441444b0 con 0x7f2d440c0f50 2023-07-25T14:37:27.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:27.230+0000 7f2d4994e700 1 -- 172.21.15.72:0/659549908 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d4404e470 con 0x7f2d440c0f50 2023-07-25T14:37:27.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:27.231+0000 7f2d2bfff700 1 -- 172.21.15.72:0/659549908 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2d3801a400 con 0x7f2d440c0f50 2023-07-25T14:37:27.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:27.231+0000 7f2d2bfff700 1 --2- 172.21.15.72:0/659549908 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f2d3006ad10 0x7f2d3006d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:27.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:27.231+0000 7f2d2bfff700 1 -- 172.21.15.72:0/659549908 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6886+0+0 (secure 0 0 0) 0x7f2d38089520 con 0x7f2d440c0f50 2023-07-25T14:37:27.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:27.231+0000 7f2d427fc700 1 --2- 172.21.15.72:0/659549908 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f2d3006ad10 0x7f2d3006d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:27.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:27.231+0000 7f2d427fc700 1 --2- 172.21.15.72:0/659549908 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f2d3006ad10 0x7f2d3006d1d0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f2d441494f0 tx=0x7f2d34013040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:27.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:27.235+0000 7f2d2bfff700 1 -- 172.21.15.72:0/659549908 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f2d380542c0 con 0x7f2d440c0f50 2023-07-25T14:37:27.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:27.429+0000 7f2d4994e700 1 -- 172.21.15.72:0/659549908 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f2d4406e410 con 0x7f2d440c0f50 2023-07-25T14:37:28.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.082+0000 7f2d2bfff700 1 -- 172.21.15.72:0/659549908 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v46) v1 ==== 169+0+0 (secure 0 0 0) 0x7f2d380578e0 con 0x7f2d440c0f50 2023-07-25T14:37:28.095 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.085+0000 7f2d4994e700 1 -- 172.21.15.72:0/659549908 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f2d3006ad10 msgr2=0x7f2d3006d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:28.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.085+0000 7f2d4994e700 1 --2- 172.21.15.72:0/659549908 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f2d3006ad10 0x7f2d3006d1d0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f2d441494f0 tx=0x7f2d34013040 comp rx=0 tx=0).stop 2023-07-25T14:37:28.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.085+0000 7f2d4994e700 1 -- 172.21.15.72:0/659549908 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2d440c0f50 msgr2=0x7f2d44150ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:28.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.085+0000 7f2d4994e700 1 --2- 172.21.15.72:0/659549908 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2d440c0f50 0x7f2d44150ef0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f2d3800b4a0 tx=0x7f2d3800b860 comp rx=0 tx=0).stop 2023-07-25T14:37:28.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.085+0000 7f2d4994e700 1 -- 172.21.15.72:0/659549908 shutdown_connections 2023-07-25T14:37:28.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.085+0000 7f2d4994e700 1 --2- 172.21.15.72:0/659549908 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f2d3006ad10 0x7f2d3006d1d0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:28.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.085+0000 7f2d4994e700 1 --2- 172.21.15.72:0/659549908 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2d441529e0 0x7f2d44071400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:28.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.085+0000 7f2d4994e700 1 --2- 172.21.15.72:0/659549908 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2d440c0f50 0x7f2d44150ef0 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:28.097 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.085+0000 7f2d4994e700 1 --2- 172.21.15.72:0/659549908 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2d4414c130 0x7f2d440703c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:28.097 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.085+0000 7f2d4994e700 1 -- 172.21.15.72:0/659549908 >> 172.21.15.72:0/659549908 conn(0x7f2d440c61e0 msgr2=0x7f2d440a5c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:28.097 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.086+0000 7f2d4994e700 1 -- 172.21.15.72:0/659549908 shutdown_connections 2023-07-25T14:37:28.097 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.086+0000 7f2d4994e700 1 -- 172.21.15.72:0/659549908 wait complete. 2023-07-25T14:37:28.097 INFO:teuthology.orchestra.run.smithi072.stderr:pool 'cephfs_data' removed 2023-07-25T14:37:28.109 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-25T14:37:28.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.219+0000 7f290e3a8700 1 Processor -- start 2023-07-25T14:37:28.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.220+0000 7f290e3a8700 1 -- start start 2023-07-25T14:37:28.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.220+0000 7f290e3a8700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f29080c5f40 0x7f2908154640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:28.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.220+0000 7f290e3a8700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f29080ba0e0 0x7f2908154b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:28.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.220+0000 7f290e3a8700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29080c54f0 con 0x7f2908151ba0 2023-07-25T14:37:28.232 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.220+0000 7f290e3a8700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29080c6670 con 0x7f29080c5f40 2023-07-25T14:37:28.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.220+0000 7f290e3a8700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29080c5740 con 0x7f29080ba0e0 2023-07-25T14:37:28.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.220+0000 7f29077fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f29080c5f40 0x7f2908154640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:28.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.220+0000 7f2907fff700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f2908151ba0 0x7f29080c2230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:33868/0 (socket says 172.21.15.72:33868) 2023-07-25T14:37:28.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.220+0000 7f2907fff700 1 -- 172.21.15.72:0/3726538861 learned_addr learned my addr 172.21.15.72:0/3726538861 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:37:28.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.221+0000 7f29077fe700 1 -- 172.21.15.72:0/3726538861 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f29080ba0e0 msgr2=0x7f2908154b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:28.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.221+0000 7f290c945700 1 --2- 172.21.15.72:0/3726538861 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f29080ba0e0 0x7f2908154b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:28.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.221+0000 7f2906ffd700 1 -- 172.21.15.72:0/3726538861 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3259442216 0 0) 0x7f29080c54f0 con 0x7f2908151ba0 2023-07-25T14:37:28.233 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.221+0000 7f29077fe700 1 --2- 172.21.15.72:0/3726538861 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f29080ba0e0 0x7f2908154b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:28.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.221+0000 7f29077fe700 1 -- 172.21.15.72:0/3726538861 >> v1:172.21.15.72:6789/0 conn(0x7f2908151ba0 legacy=0x7f29080c2230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:28.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.221+0000 7f29077fe700 1 -- 172.21.15.72:0/3726538861 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29080c5a20 con 0x7f29080c5f40 2023-07-25T14:37:28.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.221+0000 7f290c945700 1 --2- 172.21.15.72:0/3726538861 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f29080ba0e0 0x7f2908154b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-25T14:37:28.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.221+0000 7f29077fe700 1 --2- 172.21.15.72:0/3726538861 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f29080c5f40 0x7f2908154640 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f28f800bae0 tx=0x7f28f800bdf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdd188109735de68 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:28.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.221+0000 7f2906ffd700 1 -- 172.21.15.72:0/3726538861 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28f800dd30 con 0x7f29080c5f40 2023-07-25T14:37:28.234 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.221+0000 7f2906ffd700 1 -- 172.21.15.72:0/3726538861 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28f800de90 con 0x7f29080c5f40 2023-07-25T14:37:28.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.221+0000 7f2906ffd700 1 -- 172.21.15.72:0/3726538861 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28f8010690 con 0x7f29080c5f40 2023-07-25T14:37:28.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.221+0000 7f290e3a8700 1 -- 172.21.15.72:0/3726538861 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f29080c5f40 msgr2=0x7f2908154640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:28.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.221+0000 7f290e3a8700 1 --2- 172.21.15.72:0/3726538861 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f29080c5f40 0x7f2908154640 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f28f800bae0 tx=0x7f28f800bdf0 comp rx=0 tx=0).stop 2023-07-25T14:37:28.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.222+0000 7f290e3a8700 1 -- 172.21.15.72:0/3726538861 shutdown_connections 2023-07-25T14:37:28.235 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.222+0000 7f290e3a8700 1 --2- 172.21.15.72:0/3726538861 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f29080ba0e0 0x7f2908154b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:28.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.222+0000 7f290e3a8700 1 --2- 172.21.15.72:0/3726538861 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f29080c5f40 0x7f2908154640 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:28.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.222+0000 7f290e3a8700 1 -- 172.21.15.72:0/3726538861 >> 172.21.15.72:0/3726538861 conn(0x7f29080a87e0 msgr2=0x7f29080a8bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:28.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.222+0000 7f290e3a8700 1 -- 172.21.15.72:0/3726538861 shutdown_connections 2023-07-25T14:37:28.236 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.222+0000 7f290e3a8700 1 -- 172.21.15.72:0/3726538861 wait complete. 2023-07-25T14:37:28.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.223+0000 7f290e3a8700 1 Processor -- start 2023-07-25T14:37:28.238 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.223+0000 7f290e3a8700 1 -- start start 2023-07-25T14:37:28.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.223+0000 7f290e3a8700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f29080ba0e0 0x7f29080bd050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:28.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.223+0000 7f290e3a8700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f29080c5f40 0x7f29081eceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:28.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.224+0000 7f290e3a8700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2908151ba0 0x7f290814ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:28.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.224+0000 7f290e3a8700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29081eb550 con 0x7f2908151ba0 2023-07-25T14:37:28.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.224+0000 7f290e3a8700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29081ed6f0 con 0x7f29080c5f40 2023-07-25T14:37:28.239 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.224+0000 7f290e3a8700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29081ed990 con 0x7f29080ba0e0 2023-07-25T14:37:28.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.224+0000 7f290c945700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2908151ba0 0x7f290814ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:28.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.224+0000 7f290c945700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2908151ba0 0x7f290814ac50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43142/0 (socket says 172.21.15.72:43142) 2023-07-25T14:37:28.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.224+0000 7f290c945700 1 -- 172.21.15.72:0/1012326330 learned_addr learned my addr 172.21.15.72:0/1012326330 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:37:28.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.224+0000 7f2907fff700 1 --2- 172.21.15.72:0/1012326330 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f29080ba0e0 0x7f29080bd050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:28.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.224+0000 7f29077fe700 1 --2- 172.21.15.72:0/1012326330 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f29080c5f40 0x7f29081eceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:28.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.224+0000 7f290c945700 1 -- 172.21.15.72:0/1012326330 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f29080ba0e0 msgr2=0x7f29080bd050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:28.240 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.224+0000 7f290c945700 1 --2- 172.21.15.72:0/1012326330 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f29080ba0e0 0x7f29080bd050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:28.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.224+0000 7f290c945700 1 -- 172.21.15.72:0/1012326330 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f29080c5f40 msgr2=0x7f29081eceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:28.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.224+0000 7f290c945700 1 --2- 172.21.15.72:0/1012326330 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f29080c5f40 0x7f29081eceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:28.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.224+0000 7f290c945700 1 -- 172.21.15.72:0/1012326330 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28f800b740 con 0x7f2908151ba0 2023-07-25T14:37:28.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.224+0000 7f2907fff700 1 --2- 172.21.15.72:0/1012326330 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f29080ba0e0 0x7f29080bd050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-25T14:37:28.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.224+0000 7f29077fe700 1 --2- 172.21.15.72:0/1012326330 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f29080c5f40 0x7f29081eceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-25T14:37:28.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.224+0000 7f290c945700 1 --2- 172.21.15.72:0/1012326330 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2908151ba0 0x7f290814ac50 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f290000cea0 tx=0x7f290000cf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:28.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.224+0000 7f2904ff9700 1 -- 172.21.15.72:0/1012326330 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f290000ae50 con 0x7f2908151ba0 2023-07-25T14:37:28.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.224+0000 7f2904ff9700 1 -- 172.21.15.72:0/1012326330 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2900003a20 con 0x7f2908151ba0 2023-07-25T14:37:28.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.224+0000 7f290e3a8700 1 -- 172.21.15.72:0/1012326330 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29081eb7a0 con 0x7f2908151ba0 2023-07-25T14:37:28.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.224+0000 7f2904ff9700 1 -- 172.21.15.72:0/1012326330 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2900003dd0 con 0x7f2908151ba0 2023-07-25T14:37:28.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.224+0000 7f290e3a8700 1 -- 172.21.15.72:0/1012326330 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29081ed3f0 con 0x7f2908151ba0 2023-07-25T14:37:28.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.225+0000 7f290e3a8700 1 -- 172.21.15.72:0/1012326330 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f290806c600 con 0x7f2908151ba0 2023-07-25T14:37:28.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.226+0000 7f2904ff9700 1 -- 172.21.15.72:0/1012326330 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2900003f30 con 0x7f2908151ba0 2023-07-25T14:37:28.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.226+0000 7f2904ff9700 1 --2- 172.21.15.72:0/1012326330 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f28e806ace0 0x7f28e806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:28.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.226+0000 7f2904ff9700 1 -- 172.21.15.72:0/1012326330 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6472+0+0 (secure 0 0 0) 0x7f2900089a20 con 0x7f2908151ba0 2023-07-25T14:37:28.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.226+0000 7f2907fff700 1 --2- 172.21.15.72:0/1012326330 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f28e806ace0 0x7f28e806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:28.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.226+0000 7f2907fff700 1 --2- 172.21.15.72:0/1012326330 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f28e806ace0 0x7f28e806d1a0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f28f0000f60 tx=0x7f28f0007d30 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:28.243 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.230+0000 7f2904ff9700 1 -- 172.21.15.72:0/1012326330 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f29000549c0 con 0x7f2908151ba0 2023-07-25T14:37:28.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.428+0000 7f290e3a8700 1 -- 172.21.15.72:0/1012326330 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f29081eb990 con 0x7f2908151ba0 2023-07-25T14:37:28.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.429+0000 7f2904ff9700 1 -- 172.21.15.72:0/1012326330 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v46) v1 ==== 74+0+18579 (secure 0 0 0) 0x7f2900057fe0 con 0x7f2908151ba0 2023-07-25T14:37:28.440 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-25T14:37:28.440 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":46,"fsid":"9170db48-9170-43e8-8ccb-9813e6240906","created":"2023-07-25T14:35:21.733262+0000","modified":"2023-07-25T14:37:28.076031+0000","last_up_change":"2023-07-25T14:35:31.355010+0000","last_in_change":"2023-07-25T14:35:24.195785+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-25T14:35:32.983457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-25T14:35:33.326342+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs2_metadata","create_time":"2023-07-25T14:37:01.238292+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs2_data","create_time":"2023-07-25T14:37:01.609127+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d517fdad-0bfe-49f0-89f2-9421c3761839","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6801","nonce":2475407414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6803","nonce":2475407414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6807","nonce":2475407414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6805","nonce":2475407414}]},"public_addr":"172.21.15.72:6801/2475407414","cluster_addr":"172.21.15.72:6803/2475407414","heartbeat_back_addr":"172.21.15.72:6807/2475407414","heartbeat_front_addr":"172.21.15.72:6805/2475407414","state":["exists","up"]},{"osd":1,"uuid":"e1564be3-f209-47e5-a8d0-32fc618a474f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6822","nonce":870954016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6825","nonce":870954016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6831","nonce":870954016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6827","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6829","nonce":870954016}]},"public_addr":"172.21.15.72:6822/870954016","cluster_addr":"172.21.15.72:6825/870954016","heartbeat_back_addr":"172.21.15.72:6831/870954016","heartbeat_front_addr":"172.21.15.72:6829/870954016","state":["exists","up"]},{"osd":2,"uuid":"c4647d30-ffa6-417a-9026-ef530c75910e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6809","nonce":2143129442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6811","nonce":2143129442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6815","nonce":2143129442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6813","nonce":2143129442}]},"public_addr":"172.21.15.72:6809/2143129442","cluster_addr":"172.21.15.72:6811/2143129442","heartbeat_back_addr":"172.21.15.72:6815/2143129442","heartbeat_front_addr":"172.21.15.72:6813/2143129442","state":["exists","up"]},{"osd":3,"uuid":"76c9d9a7-c2e2-4612-a58b-d6882dd76b58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6817","nonce":3404066311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6819","nonce":3404066311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6828","nonce":3404066311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6821","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6823","nonce":3404066311}]},"public_addr":"172.21.15.72:6817/3404066311","cluster_addr":"172.21.15.72:6819/3404066311","heartbeat_back_addr":"172.21.15.72:6828/3404066311","heartbeat_front_addr":"172.21.15.72:6823/3404066311","state":["exists","up"]},{"osd":4,"uuid":"7f8920dc-0ad4-4a73-ab40-65408f83eadd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6817","nonce":2381008739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6819","nonce":2381008739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6825","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6827","nonce":2381008739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6822","nonce":2381008739}]},"public_addr":"172.21.15.92:6817/2381008739","cluster_addr":"172.21.15.92:6819/2381008739","heartbeat_back_addr":"172.21.15.92:6827/2381008739","heartbeat_front_addr":"172.21.15.92:6822/2381008739","state":["exists","up"]},{"osd":5,"uuid":"56257e7c-31eb-44c5-9ec7-1318a4e0bb35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6801","nonce":2161935604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6803","nonce":2161935604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6807","nonce":2161935604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6805","nonce":2161935604}]},"public_addr":"172.21.15.92:6801/2161935604","cluster_addr":"172.21.15.92:6803/2161935604","heartbeat_back_addr":"172.21.15.92:6807/2161935604","heartbeat_front_addr":"172.21.15.92:6805/2161935604","state":["exists","up"]},{"osd":6,"uuid":"a150d3d8-a0c9-4955-968a-8d98eff4ffb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6809","nonce":3770163493}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6811","nonce":3770163493}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6815","nonce":3770163493}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6813","nonce":3770163493}]},"public_addr":"172.21.15.92:6809/3770163493","cluster_addr":"172.21.15.92:6811/3770163493","heartbeat_back_addr":"172.21.15.92:6815/3770163493","heartbeat_front_addr":"172.21.15.92:6813/3770163493","state":["exists","up"]},{"osd":7,"uuid":"07799c27-54ee-4591-a42d-a978d6b32065","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6821","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6823","nonce":2135777609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6826","nonce":2135777609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6831","nonce":2135777609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6829","nonce":2135777609}]},"public_addr":"172.21.15.92:6823/2135777609","cluster_addr":"172.21.15.92:6826/2135777609","heartbeat_back_addr":"172.21.15.92:6831/2135777609","heartbeat_front_addr":"172.21.15.92:6829/2135777609","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.345365+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.378150+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.146566+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.372172+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:30.398421+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.385632+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.465611+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.443583+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.72:6837/1193027887":"2023-07-26T14:37:25.068539+0000","172.21.15.72:6835/1193027887":"2023-07-26T14:37:25.068539+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-25T14:37:28.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.431+0000 7f290e3a8700 1 -- 172.21.15.72:0/1012326330 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f28e806ace0 msgr2=0x7f28e806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:28.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.431+0000 7f290e3a8700 1 --2- 172.21.15.72:0/1012326330 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f28e806ace0 0x7f28e806d1a0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f28f0000f60 tx=0x7f28f0007d30 comp rx=0 tx=0).stop 2023-07-25T14:37:28.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.431+0000 7f290e3a8700 1 -- 172.21.15.72:0/1012326330 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2908151ba0 msgr2=0x7f290814ac50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:28.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.431+0000 7f290e3a8700 1 --2- 172.21.15.72:0/1012326330 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2908151ba0 0x7f290814ac50 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f290000cea0 tx=0x7f290000cf80 comp rx=0 tx=0).stop 2023-07-25T14:37:28.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.432+0000 7f290e3a8700 1 -- 172.21.15.72:0/1012326330 shutdown_connections 2023-07-25T14:37:28.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.432+0000 7f290e3a8700 1 --2- 172.21.15.72:0/1012326330 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f28e806ace0 0x7f28e806d1a0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:28.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.432+0000 7f290e3a8700 1 --2- 172.21.15.72:0/1012326330 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f29080ba0e0 0x7f29080bd050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:28.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.432+0000 7f290e3a8700 1 --2- 172.21.15.72:0/1012326330 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2908151ba0 0x7f290814ac50 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:28.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.432+0000 7f290e3a8700 1 --2- 172.21.15.72:0/1012326330 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f29080c5f40 0x7f29081eceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:28.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.432+0000 7f290e3a8700 1 -- 172.21.15.72:0/1012326330 >> 172.21.15.72:0/1012326330 conn(0x7f29080a87e0 msgr2=0x7f29080c4600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:28.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.432+0000 7f290e3a8700 1 -- 172.21.15.72:0/1012326330 shutdown_connections 2023-07-25T14:37:28.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.432+0000 7f290e3a8700 1 -- 172.21.15.72:0/1012326330 wait complete. 2023-07-25T14:37:28.454 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-07-25T14:35:32.983457+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-07-25T14:35:33.326342+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-07-25T14:37:01.238292+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '42', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs2_data', 'create_time': '2023-07-25T14:37:01.609127+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '43', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-25T14:37:28.454 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-25T14:37:28.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.567+0000 7fb778e8c700 1 Processor -- start 2023-07-25T14:37:28.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.567+0000 7fb778e8c700 1 -- start start 2023-07-25T14:37:28.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.568+0000 7fb778e8c700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb77414f900 0x7fb7740ab5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:28.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.568+0000 7fb778e8c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb77406b6d0 0x7fb774155750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:28.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.568+0000 7fb778e8c700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb774066060 con 0x7fb7740abb10 2023-07-25T14:37:28.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.568+0000 7fb778e8c700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb77406ed90 con 0x7fb77406b6d0 2023-07-25T14:37:28.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.568+0000 7fb778e8c700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb77414fce0 con 0x7fb77414f900 2023-07-25T14:37:28.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.568+0000 7fb771d9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb77406b6d0 0x7fb774155750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:28.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.568+0000 7fb772d9d700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fb7740abb10 0x7fb774155c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:33886/0 (socket says 172.21.15.72:33886) 2023-07-25T14:37:28.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.568+0000 7fb772d9d700 1 -- 172.21.15.72:0/1015632329 learned_addr learned my addr 172.21.15.72:0/1015632329 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:37:28.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.568+0000 7fb77259c700 1 --2- 172.21.15.72:0/1015632329 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb77414f900 0x7fb7740ab5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:28.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.568+0000 7fb771d9b700 1 -- 172.21.15.72:0/1015632329 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb77414f900 msgr2=0x7fb7740ab5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:28.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.568+0000 7fb771d9b700 1 --2- 172.21.15.72:0/1015632329 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb77414f900 0x7fb7740ab5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:28.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.568+0000 7fb771d9b700 1 -- 172.21.15.72:0/1015632329 >> v1:172.21.15.72:6789/0 conn(0x7fb7740abb10 legacy=0x7fb774155c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:28.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.568+0000 7fb771d9b700 1 -- 172.21.15.72:0/1015632329 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7740664f0 con 0x7fb77406b6d0 2023-07-25T14:37:28.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.568+0000 7fb77159a700 1 -- 172.21.15.72:0/1015632329 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1952008155 0 0) 0x7fb774066060 con 0x7fb7740abb10 2023-07-25T14:37:28.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.568+0000 7fb771d9b700 1 --2- 172.21.15.72:0/1015632329 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb77406b6d0 0x7fb774155750 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fb768009840 tx=0x7fb768009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=115a032393a06636 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:28.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.568+0000 7fb77159a700 1 -- 172.21.15.72:0/1015632329 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb768011830 con 0x7fb77406b6d0 2023-07-25T14:37:28.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.568+0000 7fb77159a700 1 -- 172.21.15.72:0/1015632329 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb768011990 con 0x7fb77406b6d0 2023-07-25T14:37:28.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.568+0000 7fb77159a700 1 -- 172.21.15.72:0/1015632329 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb768011d20 con 0x7fb77406b6d0 2023-07-25T14:37:28.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.569+0000 7fb778e8c700 1 -- 172.21.15.72:0/1015632329 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb77406b6d0 msgr2=0x7fb774155750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:28.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.569+0000 7fb778e8c700 1 --2- 172.21.15.72:0/1015632329 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb77406b6d0 0x7fb774155750 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fb768009840 tx=0x7fb768009b50 comp rx=0 tx=0).stop 2023-07-25T14:37:28.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.569+0000 7fb778e8c700 1 -- 172.21.15.72:0/1015632329 shutdown_connections 2023-07-25T14:37:28.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.569+0000 7fb778e8c700 1 --2- 172.21.15.72:0/1015632329 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb77414f900 0x7fb7740ab5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:28.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.569+0000 7fb778e8c700 1 --2- 172.21.15.72:0/1015632329 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb77406b6d0 0x7fb774155750 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:28.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.569+0000 7fb778e8c700 1 -- 172.21.15.72:0/1015632329 >> 172.21.15.72:0/1015632329 conn(0x7fb77406def0 msgr2=0x7fb77406e300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:28.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.569+0000 7fb778e8c700 1 -- 172.21.15.72:0/1015632329 shutdown_connections 2023-07-25T14:37:28.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.569+0000 7fb778e8c700 1 -- 172.21.15.72:0/1015632329 wait complete. 2023-07-25T14:37:28.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.570+0000 7fb778e8c700 1 Processor -- start 2023-07-25T14:37:28.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.570+0000 7fb778e8c700 1 -- start start 2023-07-25T14:37:28.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.571+0000 7fb778e8c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb77406b6d0 0x7fb7740c55a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:28.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.571+0000 7fb778e8c700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb7740abb10 0x7fb774141640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:28.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.571+0000 7fb778e8c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb77414f900 0x7fb774141b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:28.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.571+0000 7fb778e8c700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb774149ce0 con 0x7fb77414f900 2023-07-25T14:37:28.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.571+0000 7fb778e8c700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7741eb970 con 0x7fb77406b6d0 2023-07-25T14:37:28.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.571+0000 7fb778e8c700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7741ebc50 con 0x7fb7740abb10 2023-07-25T14:37:28.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.571+0000 7fb772d9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb77414f900 0x7fb774141b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:28.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.571+0000 7fb772d9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb77414f900 0x7fb774141b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43156/0 (socket says 172.21.15.72:43156) 2023-07-25T14:37:28.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.571+0000 7fb772d9d700 1 -- 172.21.15.72:0/1304086255 learned_addr learned my addr 172.21.15.72:0/1304086255 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:37:28.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.571+0000 7fb771d9b700 1 --2- 172.21.15.72:0/1304086255 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb7740abb10 0x7fb774141640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:28.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.571+0000 7fb77259c700 1 --2- 172.21.15.72:0/1304086255 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb77406b6d0 0x7fb7740c55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:28.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.571+0000 7fb772d9d700 1 -- 172.21.15.72:0/1304086255 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb7740abb10 msgr2=0x7fb774141640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:28.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.571+0000 7fb772d9d700 1 --2- 172.21.15.72:0/1304086255 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb7740abb10 0x7fb774141640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:28.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.571+0000 7fb772d9d700 1 -- 172.21.15.72:0/1304086255 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb77406b6d0 msgr2=0x7fb7740c55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:28.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.571+0000 7fb772d9d700 1 --2- 172.21.15.72:0/1304086255 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb77406b6d0 0x7fb7740c55a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:28.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.571+0000 7fb772d9d700 1 -- 172.21.15.72:0/1304086255 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7680094a0 con 0x7fb77414f900 2023-07-25T14:37:28.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.572+0000 7fb772d9d700 1 --2- 172.21.15.72:0/1304086255 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb77414f900 0x7fb774141b80 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fb76c00cca0 tx=0x7fb76c00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:28.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.572+0000 7fb762ffd700 1 -- 172.21.15.72:0/1304086255 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb76c00ab70 con 0x7fb77414f900 2023-07-25T14:37:28.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.572+0000 7fb762ffd700 1 -- 172.21.15.72:0/1304086255 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb76c00acd0 con 0x7fb77414f900 2023-07-25T14:37:28.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.572+0000 7fb778e8c700 1 -- 172.21.15.72:0/1304086255 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb774149f30 con 0x7fb77414f900 2023-07-25T14:37:28.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.572+0000 7fb762ffd700 1 -- 172.21.15.72:0/1304086255 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb76c007310 con 0x7fb77414f900 2023-07-25T14:37:28.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.572+0000 7fb778e8c700 1 -- 172.21.15.72:0/1304086255 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7741444b0 con 0x7fb77414f900 2023-07-25T14:37:28.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.573+0000 7fb778e8c700 1 -- 172.21.15.72:0/1304086255 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb77414a450 con 0x7fb77414f900 2023-07-25T14:37:28.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.573+0000 7fb762ffd700 1 -- 172.21.15.72:0/1304086255 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb76c007470 con 0x7fb77414f900 2023-07-25T14:37:28.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.574+0000 7fb762ffd700 1 --2- 172.21.15.72:0/1304086255 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fb75406ace0 0x7fb75406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:28.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.574+0000 7fb762ffd700 1 -- 172.21.15.72:0/1304086255 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6472+0+0 (secure 0 0 0) 0x7fb76c089360 con 0x7fb77414f900 2023-07-25T14:37:28.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.574+0000 7fb77259c700 1 --2- 172.21.15.72:0/1304086255 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fb75406ace0 0x7fb75406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:28.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.574+0000 7fb77259c700 1 --2- 172.21.15.72:0/1304086255 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fb75406ace0 0x7fb75406d1a0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fb764006b20 tx=0x7fb764008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:28.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.578+0000 7fb762ffd700 1 -- 172.21.15.72:0/1304086255 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fb77414a450 con 0x7fb77414f900 2023-07-25T14:37:28.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.765+0000 7fb778e8c700 1 -- 172.21.15.72:0/1304086255 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fb77414a450 con 0x7fb77414f900 2023-07-25T14:37:28.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.765+0000 7fb762ffd700 1 -- 172.21.15.72:0/1304086255 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v46) v1 ==== 92+0+10 (secure 0 0 0) 0x7fb77414a450 con 0x7fb77414f900 2023-07-25T14:37:28.775 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 8 2023-07-25T14:37:28.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.767+0000 7fb778e8c700 1 -- 172.21.15.72:0/1304086255 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fb75406ace0 msgr2=0x7fb75406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:28.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.767+0000 7fb778e8c700 1 --2- 172.21.15.72:0/1304086255 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fb75406ace0 0x7fb75406d1a0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fb764006b20 tx=0x7fb764008040 comp rx=0 tx=0).stop 2023-07-25T14:37:28.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.767+0000 7fb778e8c700 1 -- 172.21.15.72:0/1304086255 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb77414f900 msgr2=0x7fb774141b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:28.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.767+0000 7fb778e8c700 1 --2- 172.21.15.72:0/1304086255 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb77414f900 0x7fb774141b80 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fb76c00cca0 tx=0x7fb76c00a060 comp rx=0 tx=0).stop 2023-07-25T14:37:28.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.767+0000 7fb778e8c700 1 -- 172.21.15.72:0/1304086255 shutdown_connections 2023-07-25T14:37:28.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.767+0000 7fb778e8c700 1 --2- 172.21.15.72:0/1304086255 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fb75406ace0 0x7fb75406d1a0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:28.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.767+0000 7fb778e8c700 1 --2- 172.21.15.72:0/1304086255 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb77414f900 0x7fb774141b80 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:28.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.767+0000 7fb778e8c700 1 --2- 172.21.15.72:0/1304086255 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb77406b6d0 0x7fb7740c55a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:28.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.767+0000 7fb778e8c700 1 --2- 172.21.15.72:0/1304086255 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb7740abb10 0x7fb774141640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:28.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.767+0000 7fb778e8c700 1 -- 172.21.15.72:0/1304086255 >> 172.21.15.72:0/1304086255 conn(0x7fb77406def0 msgr2=0x7fb77406e2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:28.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.767+0000 7fb778e8c700 1 -- 172.21.15.72:0/1304086255 shutdown_connections 2023-07-25T14:37:28.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.767+0000 7fb778e8c700 1 -- 172.21.15.72:0/1304086255 wait complete. 2023-07-25T14:37:28.789 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-25T14:37:28.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.902+0000 7f5e3de09700 1 Processor -- start 2023-07-25T14:37:28.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.902+0000 7f5e3de09700 1 -- start start 2023-07-25T14:37:28.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.902+0000 7f5e3de09700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5e380c4930 0x7f5e380c3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:28.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.902+0000 7f5e3de09700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e380c2fe0 con 0x7f5e380724c0 2023-07-25T14:37:28.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.902+0000 7f5e3de09700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e38155070 con 0x7f5e38151950 2023-07-25T14:37:28.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.902+0000 7f5e3de09700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e38071a60 con 0x7f5e380c4930 2023-07-25T14:37:28.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.903+0000 7f5e36ffd700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f5e380724c0 0x7f5e380c34c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:33896/0 (socket says 172.21.15.72:33896) 2023-07-25T14:37:28.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.903+0000 7f5e36ffd700 1 -- 172.21.15.72:0/755450454 learned_addr learned my addr 172.21.15.72:0/755450454 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:37:28.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.903+0000 7f5e37fff700 1 --2- 172.21.15.72:0/755450454 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5e380c4930 0x7f5e380c3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:28.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.903+0000 7f5e367fc700 1 -- 172.21.15.72:0/755450454 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 596985110 0 0) 0x7f5e380c2fe0 con 0x7f5e380724c0 2023-07-25T14:37:28.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.903+0000 7f5e367fc700 1 -- 172.21.15.72:0/755450454 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5e200035b0 con 0x7f5e380724c0 2023-07-25T14:37:28.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.903+0000 7f5e367fc700 1 -- 172.21.15.72:0/755450454 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1405009023 0 0) 0x7f5e200035b0 con 0x7f5e380724c0 2023-07-25T14:37:28.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.903+0000 7f5e367fc700 1 -- 172.21.15.72:0/755450454 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5e380c4930 msgr2=0x7f5e380c3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:28.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.903+0000 7f5e367fc700 1 --2- 172.21.15.72:0/755450454 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5e380c4930 0x7f5e380c3bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:28.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.903+0000 7f5e367fc700 1 -- 172.21.15.72:0/755450454 >> v1:172.21.15.92:6789/0 conn(0x7f5e38151950 legacy=0x7f5e3806a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:28.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.903+0000 7f5e367fc700 1 -- 172.21.15.72:0/755450454 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e380c15c0 con 0x7f5e380724c0 2023-07-25T14:37:28.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.903+0000 7f5e367fc700 1 -- 172.21.15.72:0/755450454 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2559588315 0 0) 0x7f5e2c001670 con 0x7f5e380724c0 2023-07-25T14:37:28.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.903+0000 7f5e367fc700 1 -- 172.21.15.72:0/755450454 >> v1:172.21.15.72:6789/0 conn(0x7f5e380724c0 legacy=0x7f5e380c34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:28.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.903+0000 7f5e367fc700 1 --2- 172.21.15.72:0/755450454 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5e20003a30 0x7f5e20003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:28.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.903+0000 7f5e367fc700 1 --2- 172.21.15.72:0/755450454 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5e20004850 0x7f5e20004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:28.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.903+0000 7f5e367fc700 1 --2- 172.21.15.72:0/755450454 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5e380c4930 0x7f5e20005250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:28.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.903+0000 7f5e367fc700 1 -- 172.21.15.72:0/755450454 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e38071a60 con 0x7f5e20003a30 2023-07-25T14:37:28.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.903+0000 7f5e367fc700 1 -- 172.21.15.72:0/755450454 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e2000bb40 con 0x7f5e20004850 2023-07-25T14:37:28.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.903+0000 7f5e367fc700 1 -- 172.21.15.72:0/755450454 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e2000bd00 con 0x7f5e380c4930 2023-07-25T14:37:28.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.903+0000 7f5e377fe700 1 --2- 172.21.15.72:0/755450454 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5e20003a30 0x7f5e20003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:28.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.903+0000 7f5e36ffd700 1 --2- 172.21.15.72:0/755450454 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5e20004850 0x7f5e20004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:28.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.903+0000 7f5e37fff700 1 --2- 172.21.15.72:0/755450454 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5e380c4930 0x7f5e20005250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:28.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.904+0000 7f5e377fe700 1 -- 172.21.15.72:0/755450454 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5e380c4930 msgr2=0x7f5e20005250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:28.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.904+0000 7f5e377fe700 1 --2- 172.21.15.72:0/755450454 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5e380c4930 0x7f5e20005250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:28.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.904+0000 7f5e377fe700 1 -- 172.21.15.72:0/755450454 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5e20004850 msgr2=0x7f5e20004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:28.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.904+0000 7f5e377fe700 1 --2- 172.21.15.72:0/755450454 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5e20004850 0x7f5e20004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:28.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.904+0000 7f5e377fe700 1 -- 172.21.15.72:0/755450454 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e200035b0 con 0x7f5e20003a30 2023-07-25T14:37:28.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.904+0000 7f5e37fff700 1 --2- 172.21.15.72:0/755450454 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5e380c4930 0x7f5e20005250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-25T14:37:28.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.904+0000 7f5e377fe700 1 --2- 172.21.15.72:0/755450454 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5e20003a30 0x7f5e20003e50 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f5e280017c0 tx=0x7f5e20005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1aeaa726db5da389 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:28.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.904+0000 7f5e367fc700 1 -- 172.21.15.72:0/755450454 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e280052d0 con 0x7f5e20003a30 2023-07-25T14:37:28.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.904+0000 7f5e367fc700 1 -- 172.21.15.72:0/755450454 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e28005430 con 0x7f5e20003a30 2023-07-25T14:37:28.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.904+0000 7f5e367fc700 1 -- 172.21.15.72:0/755450454 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e280038c0 con 0x7f5e20003a30 2023-07-25T14:37:28.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.904+0000 7f5e3de09700 1 -- 172.21.15.72:0/755450454 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5e20003a30 msgr2=0x7f5e20003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:28.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.904+0000 7f5e3de09700 1 --2- 172.21.15.72:0/755450454 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5e20003a30 0x7f5e20003e50 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f5e280017c0 tx=0x7f5e20005880 comp rx=0 tx=0).stop 2023-07-25T14:37:28.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.904+0000 7f5e37fff700 1 -- 172.21.15.72:0/755450454 reap_dead start 2023-07-25T14:37:28.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.904+0000 7f5e3de09700 1 -- 172.21.15.72:0/755450454 shutdown_connections 2023-07-25T14:37:28.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.904+0000 7f5e3de09700 1 -- 172.21.15.72:0/755450454 >> 172.21.15.72:0/755450454 conn(0x7f5e380a87e0 msgr2=0x7f5e380a8bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:28.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.904+0000 7f5e3de09700 1 -- 172.21.15.72:0/755450454 shutdown_connections 2023-07-25T14:37:28.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.904+0000 7f5e3de09700 1 -- 172.21.15.72:0/755450454 wait complete. 2023-07-25T14:37:28.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.905+0000 7f5e3de09700 1 Processor -- start 2023-07-25T14:37:28.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.906+0000 7f5e3de09700 1 -- start start 2023-07-25T14:37:28.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.906+0000 7f5e3de09700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5e20003a30 0x7f5e381eaac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:28.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.906+0000 7f5e3de09700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5e38157e50 0x7f5e380aba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:28.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.906+0000 7f5e3de09700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5e380c0750 0x7f5e3814f980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:28.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.906+0000 7f5e3de09700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e380c02c0 con 0x7f5e380c0750 2023-07-25T14:37:28.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.906+0000 7f5e3de09700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e381e7210 con 0x7f5e38157e50 2023-07-25T14:37:28.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.906+0000 7f5e3de09700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e38158410 con 0x7f5e20003a30 2023-07-25T14:37:28.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.906+0000 7f5e37fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5e380c0750 0x7f5e3814f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:28.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.906+0000 7f5e37fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5e380c0750 0x7f5e3814f980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43172/0 (socket says 172.21.15.72:43172) 2023-07-25T14:37:28.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.906+0000 7f5e37fff700 1 -- 172.21.15.72:0/2821395260 learned_addr learned my addr 172.21.15.72:0/2821395260 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:37:28.928 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.907+0000 7f5e36ffd700 1 --2- 172.21.15.72:0/2821395260 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5e38157e50 0x7f5e380aba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:28.928 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.907+0000 7f5e377fe700 1 --2- 172.21.15.72:0/2821395260 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5e20003a30 0x7f5e381eaac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:28.928 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.907+0000 7f5e37fff700 1 -- 172.21.15.72:0/2821395260 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5e20003a30 msgr2=0x7f5e381eaac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:28.928 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.907+0000 7f5e37fff700 1 --2- 172.21.15.72:0/2821395260 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5e20003a30 0x7f5e381eaac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:28.928 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.907+0000 7f5e37fff700 1 -- 172.21.15.72:0/2821395260 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5e38157e50 msgr2=0x7f5e380aba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:28.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.907+0000 7f5e37fff700 1 --2- 172.21.15.72:0/2821395260 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5e38157e50 0x7f5e380aba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:28.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.907+0000 7f5e37fff700 1 -- 172.21.15.72:0/2821395260 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e380bfc70 con 0x7f5e380c0750 2023-07-25T14:37:28.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.907+0000 7f5e37fff700 1 --2- 172.21.15.72:0/2821395260 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5e380c0750 0x7f5e3814f980 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f5e3806b0f0 tx=0x7f5e300104a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:28.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.907+0000 7f5e1ffff700 1 -- 172.21.15.72:0/2821395260 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e3001b070 con 0x7f5e380c0750 2023-07-25T14:37:28.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.907+0000 7f5e1ffff700 1 -- 172.21.15.72:0/2821395260 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e3000f040 con 0x7f5e380c0750 2023-07-25T14:37:28.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.907+0000 7f5e1ffff700 1 -- 172.21.15.72:0/2821395260 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e3000e050 con 0x7f5e380c0750 2023-07-25T14:37:28.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.907+0000 7f5e3de09700 1 -- 172.21.15.72:0/2821395260 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e380bff50 con 0x7f5e380c0750 2023-07-25T14:37:28.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.907+0000 7f5e3de09700 1 -- 172.21.15.72:0/2821395260 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e381586f0 con 0x7f5e380c0750 2023-07-25T14:37:28.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.908+0000 7f5e3de09700 1 -- 172.21.15.72:0/2821395260 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e380c7930 con 0x7f5e380c0750 2023-07-25T14:37:28.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.908+0000 7f5e1ffff700 1 -- 172.21.15.72:0/2821395260 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5e30015440 con 0x7f5e380c0750 2023-07-25T14:37:28.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.909+0000 7f5e1ffff700 1 --2- 172.21.15.72:0/2821395260 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f5e2406ad10 0x7f5e2406d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:28.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.909+0000 7f5e377fe700 1 --2- 172.21.15.72:0/2821395260 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f5e2406ad10 0x7f5e2406d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:28.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.909+0000 7f5e1ffff700 1 -- 172.21.15.72:0/2821395260 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6472+0+0 (secure 0 0 0) 0x7f5e30089690 con 0x7f5e380c0750 2023-07-25T14:37:28.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.909+0000 7f5e377fe700 1 --2- 172.21.15.72:0/2821395260 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f5e2406ad10 0x7f5e2406d1d0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f5e28000c00 tx=0x7f5e28009030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:28.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:28.913+0000 7f5e1ffff700 1 -- 172.21.15.72:0/2821395260 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f5e300545a0 con 0x7f5e380c0750 2023-07-25T14:37:29.112 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.102+0000 7f5e3de09700 1 -- 172.21.15.72:0/2821395260 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5e3804e470 con 0x7f5e380c0750 2023-07-25T14:37:29.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.102+0000 7f5e1ffff700 1 -- 172.21.15.72:0/2821395260 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v46) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5e30057bc0 con 0x7f5e380c0750 2023-07-25T14:37:29.113 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 1 2023-07-25T14:37:29.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.104+0000 7f5e3de09700 1 -- 172.21.15.72:0/2821395260 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f5e2406ad10 msgr2=0x7f5e2406d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:29.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.104+0000 7f5e3de09700 1 --2- 172.21.15.72:0/2821395260 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f5e2406ad10 0x7f5e2406d1d0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f5e28000c00 tx=0x7f5e28009030 comp rx=0 tx=0).stop 2023-07-25T14:37:29.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.104+0000 7f5e3de09700 1 -- 172.21.15.72:0/2821395260 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5e380c0750 msgr2=0x7f5e3814f980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:29.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.104+0000 7f5e3de09700 1 --2- 172.21.15.72:0/2821395260 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5e380c0750 0x7f5e3814f980 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f5e3806b0f0 tx=0x7f5e300104a0 comp rx=0 tx=0).stop 2023-07-25T14:37:29.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.105+0000 7f5e3de09700 1 -- 172.21.15.72:0/2821395260 shutdown_connections 2023-07-25T14:37:29.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.105+0000 7f5e3de09700 1 --2- 172.21.15.72:0/2821395260 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f5e2406ad10 0x7f5e2406d1d0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:29.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.105+0000 7f5e3de09700 1 --2- 172.21.15.72:0/2821395260 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5e20003a30 0x7f5e381eaac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:29.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.105+0000 7f5e3de09700 1 --2- 172.21.15.72:0/2821395260 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5e380c0750 0x7f5e3814f980 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:29.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.105+0000 7f5e3de09700 1 --2- 172.21.15.72:0/2821395260 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5e38157e50 0x7f5e380aba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:29.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.105+0000 7f5e3de09700 1 -- 172.21.15.72:0/2821395260 >> 172.21.15.72:0/2821395260 conn(0x7f5e380a87e0 msgr2=0x7f5e380c62f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:29.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.105+0000 7f5e3de09700 1 -- 172.21.15.72:0/2821395260 shutdown_connections 2023-07-25T14:37:29.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.105+0000 7f5e3de09700 1 -- 172.21.15.72:0/2821395260 wait complete. 2023-07-25T14:37:29.127 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-07-25T14:37:29.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.240+0000 7f93b8c6b700 1 Processor -- start 2023-07-25T14:37:29.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.240+0000 7f93b8c6b700 1 -- start start 2023-07-25T14:37:29.252 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.240+0000 7f93b8c6b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f93b4152260 0x7f93b4070240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:29.252 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.240+0000 7f93b8c6b700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f93b40c7120 0x7f93b41533f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:29.252 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.240+0000 7f93b8c6b700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93b40c25b0 con 0x7f93b406e700 2023-07-25T14:37:29.252 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.241+0000 7f93b8c6b700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93b40ad7f0 con 0x7f93b4152260 2023-07-25T14:37:29.252 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.241+0000 7f93b8c6b700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93b40c60d0 con 0x7f93b40c7120 2023-07-25T14:37:29.252 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.241+0000 7f93b259c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f93b4152260 0x7f93b4070240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:29.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.241+0000 7f93b259c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f93b4152260 0x7f93b4070240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43176/0 (socket says 172.21.15.72:43176) 2023-07-25T14:37:29.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.241+0000 7f93b259c700 1 -- 172.21.15.72:0/3139267585 learned_addr learned my addr 172.21.15.72:0/3139267585 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:37:29.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.241+0000 7f93b1d9b700 1 --2- 172.21.15.72:0/3139267585 >> v2:172.21.15.92:3300/0 conn(0x7f93b40c7120 0x7f93b41533f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:29.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.241+0000 7f93b259c700 1 -- 172.21.15.72:0/3139267585 >> v2:172.21.15.92:3300/0 conn(0x7f93b40c7120 msgr2=0x7f93b41533f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:29.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.241+0000 7f93b259c700 1 --2- 172.21.15.72:0/3139267585 >> v2:172.21.15.92:3300/0 conn(0x7f93b40c7120 0x7f93b41533f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:29.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.241+0000 7f93b259c700 1 -- 172.21.15.72:0/3139267585 >> v1:172.21.15.92:6789/0 conn(0x7f93b406e700 legacy=0x7f93b414ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:29.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.241+0000 7f93b259c700 1 -- 172.21.15.72:0/3139267585 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93b40c63b0 con 0x7f93b4152260 2023-07-25T14:37:29.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.241+0000 7f93b259c700 1 --2- 172.21.15.72:0/3139267585 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f93b4152260 0x7f93b4070240 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f93b40c8790 tx=0x7f93a4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=603d53973382199c server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:29.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.241+0000 7f93b159a700 1 -- 172.21.15.72:0/3139267585 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93a400b870 con 0x7f93b4152260 2023-07-25T14:37:29.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.241+0000 7f93b159a700 1 -- 172.21.15.72:0/3139267585 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93a400b9d0 con 0x7f93b4152260 2023-07-25T14:37:29.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.241+0000 7f93b159a700 1 -- 172.21.15.72:0/3139267585 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93a400bd60 con 0x7f93b4152260 2023-07-25T14:37:29.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.242+0000 7f93b8c6b700 1 -- 172.21.15.72:0/3139267585 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f93b4152260 msgr2=0x7f93b4070240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:29.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.242+0000 7f93b8c6b700 1 --2- 172.21.15.72:0/3139267585 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f93b4152260 0x7f93b4070240 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f93b40c8790 tx=0x7f93a4009bd0 comp rx=0 tx=0).stop 2023-07-25T14:37:29.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.242+0000 7f93b8c6b700 1 -- 172.21.15.72:0/3139267585 shutdown_connections 2023-07-25T14:37:29.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.242+0000 7f93b8c6b700 1 --2- 172.21.15.72:0/3139267585 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f93b4152260 0x7f93b4070240 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:29.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.242+0000 7f93b8c6b700 1 --2- 172.21.15.72:0/3139267585 >> v2:172.21.15.92:3300/0 conn(0x7f93b40c7120 0x7f93b41533f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:29.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.242+0000 7f93b8c6b700 1 -- 172.21.15.72:0/3139267585 >> 172.21.15.72:0/3139267585 conn(0x7f93b40c77c0 msgr2=0x7f93b40c7ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:29.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.242+0000 7f93b8c6b700 1 -- 172.21.15.72:0/3139267585 shutdown_connections 2023-07-25T14:37:29.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.242+0000 7f93b8c6b700 1 -- 172.21.15.72:0/3139267585 wait complete. 2023-07-25T14:37:29.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.243+0000 7f93b8c6b700 1 Processor -- start 2023-07-25T14:37:29.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.243+0000 7f93b8c6b700 1 -- start start 2023-07-25T14:37:29.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.244+0000 7f93b8c6b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f93b406e700 0x7f93b40c17f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:29.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.244+0000 7f93b8c6b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f93b40c7120 0x7f93b4151480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:29.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.244+0000 7f93b8c6b700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f93b4152260 0x7f93b40aa3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:29.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.244+0000 7f93b8c6b700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93b40abc70 con 0x7f93b40c7120 2023-07-25T14:37:29.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.244+0000 7f93b8c6b700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93b40ad0d0 con 0x7f93b406e700 2023-07-25T14:37:29.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.244+0000 7f93b8c6b700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93b41ea4b0 con 0x7f93b4152260 2023-07-25T14:37:29.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.244+0000 7f93b1d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f93b40c7120 0x7f93b4151480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:29.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.244+0000 7f93b1d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f93b40c7120 0x7f93b4151480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43182/0 (socket says 172.21.15.72:43182) 2023-07-25T14:37:29.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.244+0000 7f93b1d9b700 1 -- 172.21.15.72:0/1521900870 learned_addr learned my addr 172.21.15.72:0/1521900870 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:37:29.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.244+0000 7f93b259c700 1 --2- 172.21.15.72:0/1521900870 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f93b406e700 0x7f93b40c17f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:29.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.244+0000 7f93b2d9d700 1 --2- 172.21.15.72:0/1521900870 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f93b4152260 0x7f93b40aa3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:29.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.244+0000 7f93b1d9b700 1 -- 172.21.15.72:0/1521900870 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f93b4152260 msgr2=0x7f93b40aa3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:29.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.244+0000 7f93b1d9b700 1 --2- 172.21.15.72:0/1521900870 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f93b4152260 0x7f93b40aa3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:29.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.244+0000 7f93b1d9b700 1 -- 172.21.15.72:0/1521900870 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f93b406e700 msgr2=0x7f93b40c17f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:29.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.244+0000 7f93b1d9b700 1 --2- 172.21.15.72:0/1521900870 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f93b406e700 0x7f93b40c17f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:29.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.244+0000 7f93b1d9b700 1 -- 172.21.15.72:0/1521900870 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93a4009550 con 0x7f93b40c7120 2023-07-25T14:37:29.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.244+0000 7f93b1d9b700 1 --2- 172.21.15.72:0/1521900870 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f93b40c7120 0x7f93b4151480 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f93a800e870 tx=0x7f93a800eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:29.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.245+0000 7f93a2ffd700 1 -- 172.21.15.72:0/1521900870 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93a8013610 con 0x7f93b40c7120 2023-07-25T14:37:29.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.245+0000 7f93a2ffd700 1 -- 172.21.15.72:0/1521900870 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93a8013770 con 0x7f93b40c7120 2023-07-25T14:37:29.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.245+0000 7f93b8c6b700 1 -- 172.21.15.72:0/1521900870 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93b41ea9e0 con 0x7f93b40c7120 2023-07-25T14:37:29.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.245+0000 7f93a2ffd700 1 -- 172.21.15.72:0/1521900870 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93a8013b20 con 0x7f93b40c7120 2023-07-25T14:37:29.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.245+0000 7f93b8c6b700 1 -- 172.21.15.72:0/1521900870 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93b41ea700 con 0x7f93b40c7120 2023-07-25T14:37:29.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.245+0000 7f93b8c6b700 1 -- 172.21.15.72:0/1521900870 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93b4156260 con 0x7f93b40c7120 2023-07-25T14:37:29.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.246+0000 7f93a2ffd700 1 -- 172.21.15.72:0/1521900870 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f93a8013c80 con 0x7f93b40c7120 2023-07-25T14:37:29.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.247+0000 7f93a2ffd700 1 --2- 172.21.15.72:0/1521900870 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f939406ace0 0x7f939406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:29.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.247+0000 7f93a2ffd700 1 -- 172.21.15.72:0/1521900870 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6472+0+0 (secure 0 0 0) 0x7f93a80895c0 con 0x7f93b40c7120 2023-07-25T14:37:29.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.247+0000 7f93b259c700 1 --2- 172.21.15.72:0/1521900870 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f939406ace0 0x7f939406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:29.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.247+0000 7f93b259c700 1 --2- 172.21.15.72:0/1521900870 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f939406ace0 0x7f939406d1a0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f93a4000c00 tx=0x7f93a4008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:29.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.250+0000 7f93a2ffd700 1 -- 172.21.15.72:0/1521900870 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f93a8057ff0 con 0x7f93b40c7120 2023-07-25T14:37:29.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.435+0000 7f93b8c6b700 1 -- 172.21.15.72:0/1521900870 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7f93b404e470 con 0x7f93b40c7120 2023-07-25T14:37:29.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.436+0000 7f93a2ffd700 1 -- 172.21.15.72:0/1521900870 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v46) v1 ==== 105+0+11 (secure 0 0 0) 0x7f93a8057b80 con 0x7f93b40c7120 2023-07-25T14:37:29.446 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2023-07-25T14:37:29.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.437+0000 7f93b8c6b700 1 -- 172.21.15.72:0/1521900870 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f939406ace0 msgr2=0x7f939406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:29.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.437+0000 7f93b8c6b700 1 --2- 172.21.15.72:0/1521900870 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f939406ace0 0x7f939406d1a0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f93a4000c00 tx=0x7f93a4008030 comp rx=0 tx=0).stop 2023-07-25T14:37:29.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.437+0000 7f93b8c6b700 1 -- 172.21.15.72:0/1521900870 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f93b40c7120 msgr2=0x7f93b4151480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:29.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.437+0000 7f93b8c6b700 1 --2- 172.21.15.72:0/1521900870 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f93b40c7120 0x7f93b4151480 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f93a800e870 tx=0x7f93a800eb80 comp rx=0 tx=0).stop 2023-07-25T14:37:29.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.438+0000 7f93b8c6b700 1 -- 172.21.15.72:0/1521900870 shutdown_connections 2023-07-25T14:37:29.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.438+0000 7f93b8c6b700 1 --2- 172.21.15.72:0/1521900870 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f939406ace0 0x7f939406d1a0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:29.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.438+0000 7f93b8c6b700 1 --2- 172.21.15.72:0/1521900870 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f93b4152260 0x7f93b40aa3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:29.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.438+0000 7f93b8c6b700 1 --2- 172.21.15.72:0/1521900870 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f93b406e700 0x7f93b40c17f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:29.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.438+0000 7f93b8c6b700 1 --2- 172.21.15.72:0/1521900870 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f93b40c7120 0x7f93b4151480 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:29.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.438+0000 7f93b8c6b700 1 -- 172.21.15.72:0/1521900870 >> 172.21.15.72:0/1521900870 conn(0x7f93b40c77c0 msgr2=0x7f93b4155480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:29.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.438+0000 7f93b8c6b700 1 -- 172.21.15.72:0/1521900870 shutdown_connections 2023-07-25T14:37:29.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.438+0000 7f93b8c6b700 1 -- 172.21.15.72:0/1521900870 wait complete. 2023-07-25T14:37:29.459 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-07-25T14:37:29.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.572+0000 7fa6aaf6d700 1 Processor -- start 2023-07-25T14:37:29.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.572+0000 7fa6aaf6d700 1 -- start start 2023-07-25T14:37:29.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.573+0000 7fa6aaf6d700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa6a4151ba0 0x7fa6a40c2230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:29.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.573+0000 7fa6aaf6d700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6a40c54f0 con 0x7fa6a4154d50 2023-07-25T14:37:29.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.573+0000 7fa6aaf6d700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6a40c6670 con 0x7fa6a40c5f40 2023-07-25T14:37:29.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.573+0000 7fa6aaf6d700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6a40c5740 con 0x7fa6a4151ba0 2023-07-25T14:37:29.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.573+0000 7fa6a950a700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fa6a4154d50 0x7fa6a415b970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:33928/0 (socket says 172.21.15.72:33928) 2023-07-25T14:37:29.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.573+0000 7fa6a950a700 1 -- 172.21.15.72:0/454848864 learned_addr learned my addr 172.21.15.72:0/454848864 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:37:29.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.573+0000 7fa6a8d09700 1 --2- 172.21.15.72:0/454848864 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa6a4151ba0 0x7fa6a40c2230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:29.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.573+0000 7fa6a37fe700 1 -- 172.21.15.72:0/454848864 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2151245019 0 0) 0x7fa6a40c54f0 con 0x7fa6a4154d50 2023-07-25T14:37:29.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.573+0000 7fa6a37fe700 1 -- 172.21.15.72:0/454848864 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa6940035b0 con 0x7fa6a4154d50 2023-07-25T14:37:29.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.573+0000 7fa6a37fe700 1 -- 172.21.15.72:0/454848864 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1041751227 0 0) 0x7fa6940035b0 con 0x7fa6a4154d50 2023-07-25T14:37:29.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.573+0000 7fa6a37fe700 1 -- 172.21.15.72:0/454848864 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa6a4151ba0 msgr2=0x7fa6a40c2230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:29.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.573+0000 7fa6a37fe700 1 --2- 172.21.15.72:0/454848864 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa6a4151ba0 0x7fa6a40c2230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:29.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.573+0000 7fa6a37fe700 1 -- 172.21.15.72:0/454848864 >> v1:172.21.15.92:6789/0 conn(0x7fa6a40c5f40 legacy=0x7fa6a4154640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:29.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.573+0000 7fa6a37fe700 1 -- 172.21.15.72:0/454848864 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6a40c5a20 con 0x7fa6a4154d50 2023-07-25T14:37:29.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.573+0000 7fa6a37fe700 1 -- 172.21.15.72:0/454848864 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2559588315 0 0) 0x7fa69c0019f0 con 0x7fa6a4154d50 2023-07-25T14:37:29.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.573+0000 7fa6a37fe700 1 -- 172.21.15.72:0/454848864 >> v1:172.21.15.72:6789/0 conn(0x7fa6a4154d50 legacy=0x7fa6a415b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:29.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.573+0000 7fa6a37fe700 1 --2- 172.21.15.72:0/454848864 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa6a4151ba0 0x7fa694003a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:29.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.573+0000 7fa6a37fe700 1 --2- 172.21.15.72:0/454848864 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa694003fb0 0x7fa694004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:29.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.573+0000 7fa6a37fe700 1 --2- 172.21.15.72:0/454848864 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa694004d90 0x7fa694005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:29.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.573+0000 7fa6a37fe700 1 -- 172.21.15.72:0/454848864 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6a40c5740 con 0x7fa694003fb0 2023-07-25T14:37:29.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.573+0000 7fa6a37fe700 1 -- 172.21.15.72:0/454848864 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa69400bc50 con 0x7fa694004d90 2023-07-25T14:37:29.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.573+0000 7fa6a37fe700 1 -- 172.21.15.72:0/454848864 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa69400be10 con 0x7fa6a4151ba0 2023-07-25T14:37:29.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.574+0000 7fa6a3fff700 1 --2- 172.21.15.72:0/454848864 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa694003fb0 0x7fa694004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:29.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.574+0000 7fa6a8d09700 1 --2- 172.21.15.72:0/454848864 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa6a4151ba0 0x7fa694003a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:29.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.574+0000 7fa6a950a700 1 --2- 172.21.15.72:0/454848864 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa694004d90 0x7fa694005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:29.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.574+0000 7fa6a3fff700 1 -- 172.21.15.72:0/454848864 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa6a4151ba0 msgr2=0x7fa694003a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:29.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.574+0000 7fa6a3fff700 1 --2- 172.21.15.72:0/454848864 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa6a4151ba0 0x7fa694003a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:29.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.574+0000 7fa6a3fff700 1 -- 172.21.15.72:0/454848864 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa694004d90 msgr2=0x7fa694005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:29.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.574+0000 7fa6a3fff700 1 --2- 172.21.15.72:0/454848864 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa694004d90 0x7fa694005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:29.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.574+0000 7fa6a3fff700 1 -- 172.21.15.72:0/454848864 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6940035b0 con 0x7fa694003fb0 2023-07-25T14:37:29.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.574+0000 7fa6a3fff700 1 --2- 172.21.15.72:0/454848864 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa694003fb0 0x7fa694004850 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fa6a40c6320 tx=0x7fa694005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28904dbd117edc8a server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:29.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.574+0000 7fa6a37fe700 1 -- 172.21.15.72:0/454848864 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6900052d0 con 0x7fa694003fb0 2023-07-25T14:37:29.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.574+0000 7fa6a37fe700 1 -- 172.21.15.72:0/454848864 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa690005470 con 0x7fa694003fb0 2023-07-25T14:37:29.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.574+0000 7fa6a37fe700 1 -- 172.21.15.72:0/454848864 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6900038c0 con 0x7fa694003fb0 2023-07-25T14:37:29.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.575+0000 7fa6aaf6d700 1 -- 172.21.15.72:0/454848864 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa694003fb0 msgr2=0x7fa694004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:29.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.575+0000 7fa6aaf6d700 1 --2- 172.21.15.72:0/454848864 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa694003fb0 0x7fa694004850 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fa6a40c6320 tx=0x7fa694005880 comp rx=0 tx=0).stop 2023-07-25T14:37:29.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.575+0000 7fa6a950a700 1 -- 172.21.15.72:0/454848864 reap_dead start 2023-07-25T14:37:29.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.575+0000 7fa6aaf6d700 1 -- 172.21.15.72:0/454848864 shutdown_connections 2023-07-25T14:37:29.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.575+0000 7fa6aaf6d700 1 -- 172.21.15.72:0/454848864 >> 172.21.15.72:0/454848864 conn(0x7fa6a40a87e0 msgr2=0x7fa6a40a8bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:29.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.575+0000 7fa6aaf6d700 1 -- 172.21.15.72:0/454848864 shutdown_connections 2023-07-25T14:37:29.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.575+0000 7fa6aaf6d700 1 -- 172.21.15.72:0/454848864 wait complete. 2023-07-25T14:37:29.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.576+0000 7fa6aaf6d700 1 Processor -- start 2023-07-25T14:37:29.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.576+0000 7fa6aaf6d700 1 -- start start 2023-07-25T14:37:29.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.577+0000 7fa6aaf6d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa694003fb0 0x7fa6a41e87a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:29.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.577+0000 7fa6aaf6d700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa6a4150c20 0x7fa6a41e7cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:29.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.577+0000 7fa6aaf6d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa6a406a370 0x7fa6a414e420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:29.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.577+0000 7fa6aaf6d700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6a41e78b0 con 0x7fa694003fb0 2023-07-25T14:37:29.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.577+0000 7fa6aaf6d700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6a41eb710 con 0x7fa6a406a370 2023-07-25T14:37:29.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.577+0000 7fa6aaf6d700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6a41e8ce0 con 0x7fa6a4150c20 2023-07-25T14:37:29.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.577+0000 7fa6a8d09700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa694003fb0 0x7fa6a41e87a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:29.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.577+0000 7fa6a8d09700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa694003fb0 0x7fa6a41e87a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43200/0 (socket says 172.21.15.72:43200) 2023-07-25T14:37:29.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.577+0000 7fa6a8d09700 1 -- 172.21.15.72:0/2394533942 learned_addr learned my addr 172.21.15.72:0/2394533942 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:37:29.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.577+0000 7fa6a950a700 1 --2- 172.21.15.72:0/2394533942 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa6a406a370 0x7fa6a414e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:29.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.577+0000 7fa6a8d09700 1 -- 172.21.15.72:0/2394533942 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa6a4150c20 msgr2=0x7fa6a41e7cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:29.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.577+0000 7fa6a8d09700 1 --2- 172.21.15.72:0/2394533942 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa6a4150c20 0x7fa6a41e7cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:29.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.577+0000 7fa6a8d09700 1 -- 172.21.15.72:0/2394533942 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa6a406a370 msgr2=0x7fa6a414e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:29.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.577+0000 7fa6a8d09700 1 --2- 172.21.15.72:0/2394533942 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa6a406a370 0x7fa6a414e420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:29.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.577+0000 7fa6a8d09700 1 -- 172.21.15.72:0/2394533942 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6a406b090 con 0x7fa694003fb0 2023-07-25T14:37:29.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.577+0000 7fa6a950a700 1 --2- 172.21.15.72:0/2394533942 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa6a406a370 0x7fa6a414e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-25T14:37:29.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.577+0000 7fa6a8d09700 1 --2- 172.21.15.72:0/2394533942 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa694003fb0 0x7fa6a41e87a0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fa6980119d0 tx=0x7fa698011d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:29.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.577+0000 7fa6a17fa700 1 -- 172.21.15.72:0/2394533942 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa69800f940 con 0x7fa694003fb0 2023-07-25T14:37:29.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.577+0000 7fa6a17fa700 1 -- 172.21.15.72:0/2394533942 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa69800faa0 con 0x7fa694003fb0 2023-07-25T14:37:29.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.577+0000 7fa6aaf6d700 1 -- 172.21.15.72:0/2394533942 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6a41eb430 con 0x7fa694003fb0 2023-07-25T14:37:29.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.577+0000 7fa6a17fa700 1 -- 172.21.15.72:0/2394533942 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa69800fe30 con 0x7fa694003fb0 2023-07-25T14:37:29.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.577+0000 7fa6aaf6d700 1 -- 172.21.15.72:0/2394533942 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6a41e8210 con 0x7fa694003fb0 2023-07-25T14:37:29.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.578+0000 7fa6aaf6d700 1 -- 172.21.15.72:0/2394533942 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6a41e7330 con 0x7fa694003fb0 2023-07-25T14:37:29.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.579+0000 7fa6a17fa700 1 -- 172.21.15.72:0/2394533942 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa698014440 con 0x7fa694003fb0 2023-07-25T14:37:29.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.579+0000 7fa6a17fa700 1 --2- 172.21.15.72:0/2394533942 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fa68806ace0 0x7fa68806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:29.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.579+0000 7fa6a17fa700 1 -- 172.21.15.72:0/2394533942 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6472+0+0 (secure 0 0 0) 0x7fa698089d00 con 0x7fa694003fb0 2023-07-25T14:37:29.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.579+0000 7fa6a3fff700 1 --2- 172.21.15.72:0/2394533942 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fa68806ace0 0x7fa68806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:29.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.580+0000 7fa6a3fff700 1 --2- 172.21.15.72:0/2394533942 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fa68806ace0 0x7fa68806d1a0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fa6a40c6320 tx=0x7fa690011000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:29.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.583+0000 7fa6a17fa700 1 -- 172.21.15.72:0/2394533942 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fa6a41e7330 con 0x7fa694003fb0 2023-07-25T14:37:29.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.772+0000 7fa6aaf6d700 1 -- 172.21.15.72:0/2394533942 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7fa6a41e79f0 con 0x7fa694003fb0 2023-07-25T14:37:29.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.772+0000 7fa6a17fa700 1 -- 172.21.15.72:0/2394533942 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v46) v1 ==== 101+0+11 (secure 0 0 0) 0x7fa6a41e79f0 con 0x7fa694003fb0 2023-07-25T14:37:29.782 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 64 2023-07-25T14:37:29.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.774+0000 7fa6aaf6d700 1 -- 172.21.15.72:0/2394533942 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fa68806ace0 msgr2=0x7fa68806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:29.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.774+0000 7fa6aaf6d700 1 --2- 172.21.15.72:0/2394533942 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fa68806ace0 0x7fa68806d1a0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fa6a40c6320 tx=0x7fa690011000 comp rx=0 tx=0).stop 2023-07-25T14:37:29.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.774+0000 7fa6aaf6d700 1 -- 172.21.15.72:0/2394533942 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa694003fb0 msgr2=0x7fa6a41e87a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:29.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.774+0000 7fa6aaf6d700 1 --2- 172.21.15.72:0/2394533942 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa694003fb0 0x7fa6a41e87a0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fa6980119d0 tx=0x7fa698011d90 comp rx=0 tx=0).stop 2023-07-25T14:37:29.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.774+0000 7fa6aaf6d700 1 -- 172.21.15.72:0/2394533942 shutdown_connections 2023-07-25T14:37:29.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.774+0000 7fa6aaf6d700 1 --2- 172.21.15.72:0/2394533942 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fa68806ace0 0x7fa68806d1a0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:29.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.774+0000 7fa6aaf6d700 1 --2- 172.21.15.72:0/2394533942 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa6a406a370 0x7fa6a414e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:29.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.774+0000 7fa6aaf6d700 1 --2- 172.21.15.72:0/2394533942 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fa694003fb0 0x7fa6a41e87a0 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:29.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.774+0000 7fa6aaf6d700 1 --2- 172.21.15.72:0/2394533942 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fa6a4150c20 0x7fa6a41e7cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:29.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.774+0000 7fa6aaf6d700 1 -- 172.21.15.72:0/2394533942 >> 172.21.15.72:0/2394533942 conn(0x7fa6a40a87e0 msgr2=0x7fa6a406f850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:29.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.775+0000 7fa6aaf6d700 1 -- 172.21.15.72:0/2394533942 shutdown_connections 2023-07-25T14:37:29.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.775+0000 7fa6aaf6d700 1 -- 172.21.15.72:0/2394533942 wait complete. 2023-07-25T14:37:29.796 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-25T14:37:29.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.906+0000 7f23fbda9700 1 Processor -- start 2023-07-25T14:37:29.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.906+0000 7f23fbda9700 1 -- start start 2023-07-25T14:37:29.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.907+0000 7f23fbda9700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f23f40724c0 0x7f23f40c34c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:29.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.907+0000 7f23fbda9700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f23f40c4930 0x7f23f40c3a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:29.918 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.907+0000 7f23fbda9700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23f40c2fe0 con 0x7f23f4151950 2023-07-25T14:37:29.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.907+0000 7f23fbda9700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23f4071a60 con 0x7f23f40724c0 2023-07-25T14:37:29.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.907+0000 7f23fbda9700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23f40c2a70 con 0x7f23f40c4930 2023-07-25T14:37:29.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.907+0000 7f23f9344700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f23f40724c0 0x7f23f40c34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:29.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.907+0000 7f23f9b45700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f23f4151950 0x7f23f406a190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:33944/0 (socket says 172.21.15.72:33944) 2023-07-25T14:37:29.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.907+0000 7f23f9b45700 1 -- 172.21.15.72:0/2115513624 learned_addr learned my addr 172.21.15.72:0/2115513624 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:37:29.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.907+0000 7f23f9344700 1 -- 172.21.15.72:0/2115513624 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f23f40c4930 msgr2=0x7f23f40c3a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:29.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.907+0000 7f23fa346700 1 --2- 172.21.15.72:0/2115513624 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f23f40c4930 0x7f23f40c3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:29.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.907+0000 7f23f8b43700 1 -- 172.21.15.72:0/2115513624 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1831281528 0 0) 0x7f23f40c2fe0 con 0x7f23f4151950 2023-07-25T14:37:29.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.907+0000 7f23f9344700 1 --2- 172.21.15.72:0/2115513624 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f23f40c4930 0x7f23f40c3a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:29.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.907+0000 7f23f9344700 1 -- 172.21.15.72:0/2115513624 >> v1:172.21.15.72:6789/0 conn(0x7f23f4151950 legacy=0x7f23f406a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:29.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.907+0000 7f23f9344700 1 -- 172.21.15.72:0/2115513624 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23f4155070 con 0x7f23f40724c0 2023-07-25T14:37:29.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.907+0000 7f23fa346700 1 --2- 172.21.15.72:0/2115513624 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f23f40c4930 0x7f23f40c3a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-25T14:37:29.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.908+0000 7f23f9344700 1 --2- 172.21.15.72:0/2115513624 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23f40724c0 0x7f23f40c34c0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f23f0009840 tx=0x7f23f0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=627b4a298e9a670 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:29.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.908+0000 7f23f8b43700 1 -- 172.21.15.72:0/2115513624 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23f0011830 con 0x7f23f40724c0 2023-07-25T14:37:29.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.908+0000 7f23f8b43700 1 -- 172.21.15.72:0/2115513624 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23f0011990 con 0x7f23f40724c0 2023-07-25T14:37:29.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.908+0000 7f23f8b43700 1 -- 172.21.15.72:0/2115513624 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23f0011d20 con 0x7f23f40724c0 2023-07-25T14:37:29.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.908+0000 7f23fbda9700 1 -- 172.21.15.72:0/2115513624 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23f40724c0 msgr2=0x7f23f40c34c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:29.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.908+0000 7f23fbda9700 1 --2- 172.21.15.72:0/2115513624 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23f40724c0 0x7f23f40c34c0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f23f0009840 tx=0x7f23f0009b50 comp rx=0 tx=0).stop 2023-07-25T14:37:29.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.908+0000 7f23fbda9700 1 -- 172.21.15.72:0/2115513624 shutdown_connections 2023-07-25T14:37:29.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.908+0000 7f23fbda9700 1 --2- 172.21.15.72:0/2115513624 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f23f40c4930 0x7f23f40c3a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:29.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.908+0000 7f23fbda9700 1 --2- 172.21.15.72:0/2115513624 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23f40724c0 0x7f23f40c34c0 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:29.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.908+0000 7f23fbda9700 1 -- 172.21.15.72:0/2115513624 >> 172.21.15.72:0/2115513624 conn(0x7f23f40a87e0 msgr2=0x7f23f40a8bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:29.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.908+0000 7f23fbda9700 1 -- 172.21.15.72:0/2115513624 shutdown_connections 2023-07-25T14:37:29.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.908+0000 7f23fbda9700 1 -- 172.21.15.72:0/2115513624 wait complete. 2023-07-25T14:37:29.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.909+0000 7f23fbda9700 1 Processor -- start 2023-07-25T14:37:29.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.910+0000 7f23fbda9700 1 -- start start 2023-07-25T14:37:29.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.910+0000 7f23fbda9700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f23f40724c0 0x7f23f41e9970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:29.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.910+0000 7f23fbda9700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23f40c4930 0x7f23f40ac0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:29.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.910+0000 7f23fbda9700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f23f4151950 0x7f23f41559d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:29.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.910+0000 7f23fbda9700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23f40bdea0 con 0x7f23f40c4930 2023-07-25T14:37:29.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.910+0000 7f23fbda9700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23f40beb70 con 0x7f23f40724c0 2023-07-25T14:37:29.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.910+0000 7f23fbda9700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23f40ab020 con 0x7f23f4151950 2023-07-25T14:37:29.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.910+0000 7f23f9344700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23f40c4930 0x7f23f40ac0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:29.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.910+0000 7f23f9344700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23f40c4930 0x7f23f40ac0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43216/0 (socket says 172.21.15.72:43216) 2023-07-25T14:37:29.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.910+0000 7f23f9344700 1 -- 172.21.15.72:0/1438931047 learned_addr learned my addr 172.21.15.72:0/1438931047 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:37:29.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.911+0000 7f23f9b45700 1 --2- 172.21.15.72:0/1438931047 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f23f40724c0 0x7f23f41e9970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:29.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.911+0000 7f23fa346700 1 --2- 172.21.15.72:0/1438931047 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f23f4151950 0x7f23f41559d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:29.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.911+0000 7f23f9344700 1 -- 172.21.15.72:0/1438931047 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f23f4151950 msgr2=0x7f23f41559d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:29.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.911+0000 7f23f9344700 1 --2- 172.21.15.72:0/1438931047 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f23f4151950 0x7f23f41559d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:29.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.911+0000 7f23f9344700 1 -- 172.21.15.72:0/1438931047 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f23f40724c0 msgr2=0x7f23f41e9970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:29.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.911+0000 7f23f9344700 1 --2- 172.21.15.72:0/1438931047 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f23f40724c0 0x7f23f41e9970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:29.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.911+0000 7f23f9344700 1 -- 172.21.15.72:0/1438931047 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23f00094a0 con 0x7f23f40c4930 2023-07-25T14:37:29.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.911+0000 7f23fa346700 1 --2- 172.21.15.72:0/1438931047 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f23f4151950 0x7f23f41559d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-25T14:37:29.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.911+0000 7f23f9344700 1 --2- 172.21.15.72:0/1438931047 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23f40c4930 0x7f23f40ac0c0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f23f00090b0 tx=0x7f23f0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:29.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.911+0000 7f23ea7fc700 1 -- 172.21.15.72:0/1438931047 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23f00036a0 con 0x7f23f40c4930 2023-07-25T14:37:29.928 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.911+0000 7f23ea7fc700 1 -- 172.21.15.72:0/1438931047 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23f001f070 con 0x7f23f40c4930 2023-07-25T14:37:29.928 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.911+0000 7f23fbda9700 1 -- 172.21.15.72:0/1438931047 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23f40ab300 con 0x7f23f40c4930 2023-07-25T14:37:29.928 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.911+0000 7f23ea7fc700 1 -- 172.21.15.72:0/1438931047 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23f0003a40 con 0x7f23f40c4930 2023-07-25T14:37:29.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.911+0000 7f23fbda9700 1 -- 172.21.15.72:0/1438931047 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23f40ab8c0 con 0x7f23f40c4930 2023-07-25T14:37:29.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.912+0000 7f23fbda9700 1 -- 172.21.15.72:0/1438931047 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23f404e470 con 0x7f23f40c4930 2023-07-25T14:37:29.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.913+0000 7f23ea7fc700 1 -- 172.21.15.72:0/1438931047 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f23f0003ba0 con 0x7f23f40c4930 2023-07-25T14:37:29.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.913+0000 7f23ea7fc700 1 --2- 172.21.15.72:0/1438931047 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f23d806ad10 0x7f23d806d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:29.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.913+0000 7f23ea7fc700 1 -- 172.21.15.72:0/1438931047 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6472+0+0 (secure 0 0 0) 0x7f23f0021070 con 0x7f23f40c4930 2023-07-25T14:37:29.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.913+0000 7f23f9b45700 1 --2- 172.21.15.72:0/1438931047 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f23d806ad10 0x7f23d806d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:29.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.913+0000 7f23f9b45700 1 --2- 172.21.15.72:0/1438931047 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f23d806ad10 0x7f23d806d1d0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f23e4000f60 tx=0x7f23e4007e70 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:29.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:29.917+0000 7f23ea7fc700 1 -- 172.21.15.72:0/1438931047 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f23f0055f30 con 0x7f23f40c4930 2023-07-25T14:37:30.157 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.147+0000 7f23fbda9700 1 -- 172.21.15.72:0/1438931047 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f23f40a8d50 con 0x7f23f40c4930 2023-07-25T14:37:30.158 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.147+0000 7f23ea7fc700 1 -- 172.21.15.72:0/1438931047 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4667 (secure 0 0 0) 0x7f23f002b090 con 0x7f23f40c4930 2023-07-25T14:37:30.158 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-25T14:37:30.159 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":24,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5092,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6834/3640355071","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":3640355071},{"type":"v1","addr":"172.21.15.92:6834","nonce":3640355071}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5095,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/936080292","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6833","nonce":936080292},{"type":"v1","addr":"172.21.15.92:6835","nonce":936080292}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5937,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6837/549993324","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6835","nonce":549993324},{"type":"v1","addr":"172.21.15.72:6837","nonce":549993324}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-25T14:37:02.650515+0000","modified":"2023-07-25T14:37:06.294518+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5328},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5328":{"gid":5328,"name":"c","rank":0,"incarnation":18,"state":"up:active","state_seq":7,"addr":"172.21.15.72:6836/2944832990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":2944832990},{"type":"v1","addr":"172.21.15.72:6836","nonce":2944832990}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-07-25T14:37:30.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.149+0000 7f23fbda9700 1 -- 172.21.15.72:0/1438931047 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f23d806ad10 msgr2=0x7f23d806d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:30.160 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.149+0000 7f23fbda9700 1 --2- 172.21.15.72:0/1438931047 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f23d806ad10 0x7f23d806d1d0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f23e4000f60 tx=0x7f23e4007e70 comp rx=0 tx=0).stop 2023-07-25T14:37:30.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.149+0000 7f23fbda9700 1 -- 172.21.15.72:0/1438931047 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23f40c4930 msgr2=0x7f23f40ac0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:30.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.149+0000 7f23fbda9700 1 --2- 172.21.15.72:0/1438931047 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23f40c4930 0x7f23f40ac0c0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f23f00090b0 tx=0x7f23f0004750 comp rx=0 tx=0).stop 2023-07-25T14:37:30.161 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.149+0000 7f23fbda9700 1 -- 172.21.15.72:0/1438931047 shutdown_connections 2023-07-25T14:37:30.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.149+0000 7f23fbda9700 1 --2- 172.21.15.72:0/1438931047 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f23d806ad10 0x7f23d806d1d0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:30.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.149+0000 7f23fbda9700 1 --2- 172.21.15.72:0/1438931047 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f23f4151950 0x7f23f41559d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:30.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.149+0000 7f23fbda9700 1 --2- 172.21.15.72:0/1438931047 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f23f40724c0 0x7f23f41e9970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:30.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.149+0000 7f23fbda9700 1 --2- 172.21.15.72:0/1438931047 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23f40c4930 0x7f23f40ac0c0 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:30.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.149+0000 7f23fbda9700 1 -- 172.21.15.72:0/1438931047 >> 172.21.15.72:0/1438931047 conn(0x7f23f40a87e0 msgr2=0x7f23f406f930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:30.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.149+0000 7f23fbda9700 1 -- 172.21.15.72:0/1438931047 shutdown_connections 2023-07-25T14:37:30.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.149+0000 7f23fbda9700 1 -- 172.21.15.72:0/1438931047 wait complete. 2023-07-25T14:37:30.164 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 24 2023-07-25T14:37:30.172 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-25T14:37:30.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.284+0000 7f1571fe5700 1 Processor -- start 2023-07-25T14:37:30.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.284+0000 7f1571fe5700 1 -- start start 2023-07-25T14:37:30.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.284+0000 7f1571fe5700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f156c06b2a0 0x7f156c154df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:30.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.284+0000 7f1571fe5700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f156c0c4370 0x7f156c0c47a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:30.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.285+0000 7f1571fe5700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f156c157cd0 con 0x7f156c1518c0 2023-07-25T14:37:30.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.285+0000 7f1571fe5700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f156c06b750 con 0x7f156c0c4370 2023-07-25T14:37:30.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.285+0000 7f1571fe5700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f156c0c2310 con 0x7f156c06b2a0 2023-07-25T14:37:30.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.285+0000 7f156bfff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f156c0c4370 0x7f156c0c47a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:30.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.285+0000 7f156bfff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f156c0c4370 0x7f156c0c47a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43224/0 (socket says 172.21.15.72:43224) 2023-07-25T14:37:30.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.285+0000 7f156bfff700 1 -- 172.21.15.72:0/3139796331 learned_addr learned my addr 172.21.15.72:0/3139796331 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:37:30.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.285+0000 7f156affd700 1 --2- 172.21.15.72:0/3139796331 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f156c06b2a0 0x7f156c154df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:30.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.285+0000 7f156bfff700 1 -- 172.21.15.72:0/3139796331 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f156c06b2a0 msgr2=0x7f156c154df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:30.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.285+0000 7f156bfff700 1 --2- 172.21.15.72:0/3139796331 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f156c06b2a0 0x7f156c154df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:30.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.285+0000 7f156bfff700 1 -- 172.21.15.72:0/3139796331 >> v1:172.21.15.92:6789/0 conn(0x7f156c1518c0 legacy=0x7f156c158160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:30.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.285+0000 7f156bfff700 1 -- 172.21.15.72:0/3139796331 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f156c158870 con 0x7f156c0c4370 2023-07-25T14:37:30.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.285+0000 7f156affd700 1 --2- 172.21.15.72:0/3139796331 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f156c06b2a0 0x7f156c154df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-25T14:37:30.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.285+0000 7f156bfff700 1 --2- 172.21.15.72:0/3139796331 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f156c0c4370 0x7f156c0c47a0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f1564009e50 tx=0x7f156400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc22d5afb56da30c server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:30.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.285+0000 7f156a7fc700 1 -- 172.21.15.72:0/3139796331 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f156400e070 con 0x7f156c0c4370 2023-07-25T14:37:30.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.285+0000 7f156a7fc700 1 -- 172.21.15.72:0/3139796331 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f156400b9c0 con 0x7f156c0c4370 2023-07-25T14:37:30.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.285+0000 7f156a7fc700 1 -- 172.21.15.72:0/3139796331 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f156400bd70 con 0x7f156c0c4370 2023-07-25T14:37:30.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.286+0000 7f1571fe5700 1 -- 172.21.15.72:0/3139796331 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f156c0c4370 msgr2=0x7f156c0c47a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:30.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.286+0000 7f1571fe5700 1 --2- 172.21.15.72:0/3139796331 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f156c0c4370 0x7f156c0c47a0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f1564009e50 tx=0x7f156400b330 comp rx=0 tx=0).stop 2023-07-25T14:37:30.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.286+0000 7f1571fe5700 1 -- 172.21.15.72:0/3139796331 shutdown_connections 2023-07-25T14:37:30.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.286+0000 7f1571fe5700 1 --2- 172.21.15.72:0/3139796331 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f156c0c4370 0x7f156c0c47a0 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:30.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.286+0000 7f1571fe5700 1 --2- 172.21.15.72:0/3139796331 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f156c06b2a0 0x7f156c154df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:30.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.286+0000 7f1571fe5700 1 -- 172.21.15.72:0/3139796331 >> 172.21.15.72:0/3139796331 conn(0x7f156c06a8d0 msgr2=0x7f156c0a94e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:30.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.286+0000 7f1571fe5700 1 -- 172.21.15.72:0/3139796331 shutdown_connections 2023-07-25T14:37:30.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.286+0000 7f1571fe5700 1 -- 172.21.15.72:0/3139796331 wait complete. 2023-07-25T14:37:30.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.287+0000 7f1571fe5700 1 Processor -- start 2023-07-25T14:37:30.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.287+0000 7f1571fe5700 1 -- start start 2023-07-25T14:37:30.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.288+0000 7f1571fe5700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f156c06b2a0 0x7f156c1ed020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:30.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.288+0000 7f1571fe5700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f156c0c4370 0x7f156c14dc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:30.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.288+0000 7f1571fe5700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f156c1518c0 0x7f156c14e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:30.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.288+0000 7f1571fe5700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f156c0beb60 con 0x7f156c06b2a0 2023-07-25T14:37:30.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.288+0000 7f1571fe5700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f156c0aa310 con 0x7f156c0c4370 2023-07-25T14:37:30.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.288+0000 7f1571fe5700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f156c0aa5f0 con 0x7f156c1518c0 2023-07-25T14:37:30.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.288+0000 7f156b7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f156c06b2a0 0x7f156c1ed020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:30.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.288+0000 7f156b7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f156c06b2a0 0x7f156c1ed020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43228/0 (socket says 172.21.15.72:43228) 2023-07-25T14:37:30.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.288+0000 7f156b7fe700 1 -- 172.21.15.72:0/573798220 learned_addr learned my addr 172.21.15.72:0/573798220 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:37:30.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.288+0000 7f156affd700 1 --2- 172.21.15.72:0/573798220 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f156c0c4370 0x7f156c14dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:30.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.288+0000 7f156bfff700 1 --2- 172.21.15.72:0/573798220 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f156c1518c0 0x7f156c14e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:30.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.288+0000 7f156b7fe700 1 -- 172.21.15.72:0/573798220 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f156c1518c0 msgr2=0x7f156c14e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:30.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.288+0000 7f156b7fe700 1 --2- 172.21.15.72:0/573798220 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f156c1518c0 0x7f156c14e1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:30.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.288+0000 7f156b7fe700 1 -- 172.21.15.72:0/573798220 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f156c0c4370 msgr2=0x7f156c14dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:30.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.288+0000 7f156b7fe700 1 --2- 172.21.15.72:0/573798220 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f156c0c4370 0x7f156c14dc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:30.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.288+0000 7f156b7fe700 1 -- 172.21.15.72:0/573798220 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1564009b30 con 0x7f156c06b2a0 2023-07-25T14:37:30.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.288+0000 7f156b7fe700 1 --2- 172.21.15.72:0/573798220 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f156c06b2a0 0x7f156c1ed020 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f155c00c450 tx=0x7f155c00c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:30.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.288+0000 7f1553fff700 1 -- 172.21.15.72:0/573798220 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f155c0052d0 con 0x7f156c06b2a0 2023-07-25T14:37:30.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.289+0000 7f1553fff700 1 -- 172.21.15.72:0/573798220 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f155c005430 con 0x7f156c06b2a0 2023-07-25T14:37:30.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.289+0000 7f1571fe5700 1 -- 172.21.15.72:0/573798220 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f156c0a9ff0 con 0x7f156c06b2a0 2023-07-25T14:37:30.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.289+0000 7f1553fff700 1 -- 172.21.15.72:0/573798220 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f155c0038c0 con 0x7f156c06b2a0 2023-07-25T14:37:30.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.289+0000 7f1571fe5700 1 -- 172.21.15.72:0/573798220 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f156c14e8a0 con 0x7f156c06b2a0 2023-07-25T14:37:30.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.290+0000 7f1571fe5700 1 -- 172.21.15.72:0/573798220 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f156c04e470 con 0x7f156c06b2a0 2023-07-25T14:37:30.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.290+0000 7f1553fff700 1 -- 172.21.15.72:0/573798220 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f155c003a20 con 0x7f156c06b2a0 2023-07-25T14:37:30.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.290+0000 7f1553fff700 1 --2- 172.21.15.72:0/573798220 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f155806ace0 0x7f155806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:30.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.290+0000 7f1553fff700 1 -- 172.21.15.72:0/573798220 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6472+0+0 (secure 0 0 0) 0x7f155c0888f0 con 0x7f156c06b2a0 2023-07-25T14:37:30.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.290+0000 7f156affd700 1 --2- 172.21.15.72:0/573798220 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f155806ace0 0x7f155806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:30.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.291+0000 7f156affd700 1 --2- 172.21.15.72:0/573798220 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f155806ace0 0x7f155806d1a0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f156c154340 tx=0x7f1560008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:30.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.295+0000 7f1553fff700 1 -- 172.21.15.72:0/573798220 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f155c053890 con 0x7f156c06b2a0 2023-07-25T14:37:30.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.483+0000 7f1571fe5700 1 -- 172.21.15.72:0/573798220 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f156c0702b0 con 0x7f156c06b2a0 2023-07-25T14:37:30.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.484+0000 7f1553fff700 1 -- 172.21.15.72:0/573798220 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v46) v1 ==== 74+0+18579 (secure 0 0 0) 0x7f155c00ce60 con 0x7f156c06b2a0 2023-07-25T14:37:30.495 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-25T14:37:30.496 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":46,"fsid":"9170db48-9170-43e8-8ccb-9813e6240906","created":"2023-07-25T14:35:21.733262+0000","modified":"2023-07-25T14:37:28.076031+0000","last_up_change":"2023-07-25T14:35:31.355010+0000","last_in_change":"2023-07-25T14:35:24.195785+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-25T14:35:32.983457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-25T14:35:33.326342+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs2_metadata","create_time":"2023-07-25T14:37:01.238292+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs2_data","create_time":"2023-07-25T14:37:01.609127+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d517fdad-0bfe-49f0-89f2-9421c3761839","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6801","nonce":2475407414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6803","nonce":2475407414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6807","nonce":2475407414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6805","nonce":2475407414}]},"public_addr":"172.21.15.72:6801/2475407414","cluster_addr":"172.21.15.72:6803/2475407414","heartbeat_back_addr":"172.21.15.72:6807/2475407414","heartbeat_front_addr":"172.21.15.72:6805/2475407414","state":["exists","up"]},{"osd":1,"uuid":"e1564be3-f209-47e5-a8d0-32fc618a474f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6822","nonce":870954016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6825","nonce":870954016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6831","nonce":870954016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6827","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6829","nonce":870954016}]},"public_addr":"172.21.15.72:6822/870954016","cluster_addr":"172.21.15.72:6825/870954016","heartbeat_back_addr":"172.21.15.72:6831/870954016","heartbeat_front_addr":"172.21.15.72:6829/870954016","state":["exists","up"]},{"osd":2,"uuid":"c4647d30-ffa6-417a-9026-ef530c75910e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6809","nonce":2143129442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6811","nonce":2143129442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6815","nonce":2143129442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6813","nonce":2143129442}]},"public_addr":"172.21.15.72:6809/2143129442","cluster_addr":"172.21.15.72:6811/2143129442","heartbeat_back_addr":"172.21.15.72:6815/2143129442","heartbeat_front_addr":"172.21.15.72:6813/2143129442","state":["exists","up"]},{"osd":3,"uuid":"76c9d9a7-c2e2-4612-a58b-d6882dd76b58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6817","nonce":3404066311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6819","nonce":3404066311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6828","nonce":3404066311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6821","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6823","nonce":3404066311}]},"public_addr":"172.21.15.72:6817/3404066311","cluster_addr":"172.21.15.72:6819/3404066311","heartbeat_back_addr":"172.21.15.72:6828/3404066311","heartbeat_front_addr":"172.21.15.72:6823/3404066311","state":["exists","up"]},{"osd":4,"uuid":"7f8920dc-0ad4-4a73-ab40-65408f83eadd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6817","nonce":2381008739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6819","nonce":2381008739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6825","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6827","nonce":2381008739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6822","nonce":2381008739}]},"public_addr":"172.21.15.92:6817/2381008739","cluster_addr":"172.21.15.92:6819/2381008739","heartbeat_back_addr":"172.21.15.92:6827/2381008739","heartbeat_front_addr":"172.21.15.92:6822/2381008739","state":["exists","up"]},{"osd":5,"uuid":"56257e7c-31eb-44c5-9ec7-1318a4e0bb35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6801","nonce":2161935604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6803","nonce":2161935604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6807","nonce":2161935604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6805","nonce":2161935604}]},"public_addr":"172.21.15.92:6801/2161935604","cluster_addr":"172.21.15.92:6803/2161935604","heartbeat_back_addr":"172.21.15.92:6807/2161935604","heartbeat_front_addr":"172.21.15.92:6805/2161935604","state":["exists","up"]},{"osd":6,"uuid":"a150d3d8-a0c9-4955-968a-8d98eff4ffb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6809","nonce":3770163493}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6811","nonce":3770163493}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6815","nonce":3770163493}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6813","nonce":3770163493}]},"public_addr":"172.21.15.92:6809/3770163493","cluster_addr":"172.21.15.92:6811/3770163493","heartbeat_back_addr":"172.21.15.92:6815/3770163493","heartbeat_front_addr":"172.21.15.92:6813/3770163493","state":["exists","up"]},{"osd":7,"uuid":"07799c27-54ee-4591-a42d-a978d6b32065","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6821","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6823","nonce":2135777609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6826","nonce":2135777609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6831","nonce":2135777609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6829","nonce":2135777609}]},"public_addr":"172.21.15.92:6823/2135777609","cluster_addr":"172.21.15.92:6826/2135777609","heartbeat_back_addr":"172.21.15.92:6831/2135777609","heartbeat_front_addr":"172.21.15.92:6829/2135777609","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.345365+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.378150+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.146566+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.372172+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:30.398421+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.385632+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.465611+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.443583+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.72:6837/1193027887":"2023-07-26T14:37:25.068539+0000","172.21.15.72:6835/1193027887":"2023-07-26T14:37:25.068539+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-25T14:37:30.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.487+0000 7f1571fe5700 1 -- 172.21.15.72:0/573798220 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f155806ace0 msgr2=0x7f155806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:30.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.487+0000 7f1571fe5700 1 --2- 172.21.15.72:0/573798220 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f155806ace0 0x7f155806d1a0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f156c154340 tx=0x7f1560008040 comp rx=0 tx=0).stop 2023-07-25T14:37:30.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.487+0000 7f1571fe5700 1 -- 172.21.15.72:0/573798220 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f156c06b2a0 msgr2=0x7f156c1ed020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:30.498 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.487+0000 7f1571fe5700 1 --2- 172.21.15.72:0/573798220 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f156c06b2a0 0x7f156c1ed020 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f155c00c450 tx=0x7f155c00c760 comp rx=0 tx=0).stop 2023-07-25T14:37:30.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.487+0000 7f1571fe5700 1 -- 172.21.15.72:0/573798220 shutdown_connections 2023-07-25T14:37:30.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.487+0000 7f1571fe5700 1 --2- 172.21.15.72:0/573798220 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f155806ace0 0x7f155806d1a0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:30.499 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.487+0000 7f1571fe5700 1 --2- 172.21.15.72:0/573798220 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f156c1518c0 0x7f156c14e1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:30.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.487+0000 7f1571fe5700 1 --2- 172.21.15.72:0/573798220 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f156c06b2a0 0x7f156c1ed020 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:30.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.487+0000 7f1571fe5700 1 --2- 172.21.15.72:0/573798220 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f156c0c4370 0x7f156c14dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:30.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.487+0000 7f1571fe5700 1 -- 172.21.15.72:0/573798220 >> 172.21.15.72:0/573798220 conn(0x7f156c06a8d0 msgr2=0x7f156c1549c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:30.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.487+0000 7f1571fe5700 1 -- 172.21.15.72:0/573798220 shutdown_connections 2023-07-25T14:37:30.501 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.487+0000 7f1571fe5700 1 -- 172.21.15.72:0/573798220 wait complete. 2023-07-25T14:37:30.509 INFO:tasks.cephfs.filesystem:Destroying file system cephfs2 and related pools 2023-07-25T14:37:30.510 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-25T14:37:30.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.620+0000 7f01ceac2700 1 Processor -- start 2023-07-25T14:37:30.630 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.620+0000 7f01ceac2700 1 -- start start 2023-07-25T14:37:30.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.620+0000 7f01ceac2700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f01c8071390 0x7f01c80c5570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:30.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.620+0000 7f01ceac2700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f01c806ee90 0x7f01c806a190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:30.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.620+0000 7f01ceac2700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01c8154670 con 0x7f01c81518f0 2023-07-25T14:37:30.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.620+0000 7f01ceac2700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01c8072770 con 0x7f01c8071390 2023-07-25T14:37:30.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.620+0000 7f01ceac2700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01c8151cd0 con 0x7f01c806ee90 2023-07-25T14:37:30.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.620+0000 7f01cc85e700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f01c81518f0 0x7f01c8154b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:33972/0 (socket says 172.21.15.72:33972) 2023-07-25T14:37:30.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.620+0000 7f01cc85e700 1 -- 172.21.15.72:0/2832265916 learned_addr learned my addr 172.21.15.72:0/2832265916 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:37:30.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.621+0000 7f01c7fff700 1 --2- 172.21.15.72:0/2832265916 >> v2:172.21.15.92:3300/0 conn(0x7f01c8071390 0x7f01c80c5570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:30.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.621+0000 7f01cd05f700 1 --2- 172.21.15.72:0/2832265916 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f01c806ee90 0x7f01c806a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:30.637 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.621+0000 7f01c77fe700 1 -- 172.21.15.72:0/2832265916 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2094804927 0 0) 0x7f01c8154670 con 0x7f01c81518f0 2023-07-25T14:37:30.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.621+0000 7f01c77fe700 1 -- 172.21.15.72:0/2832265916 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f01b80035b0 con 0x7f01c81518f0 2023-07-25T14:37:30.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.621+0000 7f01c77fe700 1 -- 172.21.15.72:0/2832265916 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4258813018 0 0) 0x7f01b80035b0 con 0x7f01c81518f0 2023-07-25T14:37:30.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.621+0000 7f01c7fff700 1 -- 172.21.15.72:0/2832265916 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f01c806ee90 msgr2=0x7f01c806a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:30.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.621+0000 7f01c7fff700 1 --2- 172.21.15.72:0/2832265916 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f01c806ee90 0x7f01c806a190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:30.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.621+0000 7f01c7fff700 1 -- 172.21.15.72:0/2832265916 >> v1:172.21.15.72:6789/0 conn(0x7f01c81518f0 legacy=0x7f01c8154b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:30.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.621+0000 7f01c7fff700 1 -- 172.21.15.72:0/2832265916 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01c8154320 con 0x7f01c8071390 2023-07-25T14:37:30.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.621+0000 7f01c7fff700 1 --2- 172.21.15.72:0/2832265916 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f01c8071390 0x7f01c80c5570 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f01b4009840 tx=0x7f01b4009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=38f5bcb6b69aefa0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:30.638 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.621+0000 7f01c77fe700 1 -- 172.21.15.72:0/2832265916 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01bc001670 con 0x7f01c8071390 2023-07-25T14:37:30.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.621+0000 7f01c77fe700 1 -- 172.21.15.72:0/2832265916 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01b4004030 con 0x7f01c8071390 2023-07-25T14:37:30.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.621+0000 7f01c77fe700 1 -- 172.21.15.72:0/2832265916 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01b40043c0 con 0x7f01c8071390 2023-07-25T14:37:30.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.622+0000 7f01ceac2700 1 -- 172.21.15.72:0/2832265916 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f01c8071390 msgr2=0x7f01c80c5570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:30.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.622+0000 7f01ceac2700 1 --2- 172.21.15.72:0/2832265916 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f01c8071390 0x7f01c80c5570 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f01b4009840 tx=0x7f01b4009b50 comp rx=0 tx=0).stop 2023-07-25T14:37:30.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.622+0000 7f01ceac2700 1 -- 172.21.15.72:0/2832265916 shutdown_connections 2023-07-25T14:37:30.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.622+0000 7f01ceac2700 1 --2- 172.21.15.72:0/2832265916 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f01c806ee90 0x7f01c806a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:30.639 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.622+0000 7f01ceac2700 1 --2- 172.21.15.72:0/2832265916 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f01c8071390 0x7f01c80c5570 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:30.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.622+0000 7f01ceac2700 1 -- 172.21.15.72:0/2832265916 >> 172.21.15.72:0/2832265916 conn(0x7f01c8066460 msgr2=0x7f01c806b2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:30.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.622+0000 7f01ceac2700 1 -- 172.21.15.72:0/2832265916 shutdown_connections 2023-07-25T14:37:30.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.622+0000 7f01ceac2700 1 -- 172.21.15.72:0/2832265916 wait complete. 2023-07-25T14:37:30.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.623+0000 7f01ceac2700 1 Processor -- start 2023-07-25T14:37:30.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.623+0000 7f01ceac2700 1 -- start start 2023-07-25T14:37:30.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.624+0000 7f01ceac2700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f01c806ee90 0x7f01c8150970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:30.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.624+0000 7f01ceac2700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f01c8071390 0x7f01c80c2fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:30.640 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.624+0000 7f01ceac2700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f01c81518f0 0x7f01c8146890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:30.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.624+0000 7f01ceac2700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01c8157e70 con 0x7f01c8071390 2023-07-25T14:37:30.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.624+0000 7f01ceac2700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01c8147950 con 0x7f01c81518f0 2023-07-25T14:37:30.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.624+0000 7f01ceac2700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01c8157540 con 0x7f01c806ee90 2023-07-25T14:37:30.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.624+0000 7f01c7fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f01c8071390 0x7f01c80c2fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:30.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.624+0000 7f01c7fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f01c8071390 0x7f01c80c2fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43244/0 (socket says 172.21.15.72:43244) 2023-07-25T14:37:30.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.624+0000 7f01c7fff700 1 -- 172.21.15.72:0/3055260218 learned_addr learned my addr 172.21.15.72:0/3055260218 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:37:30.641 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.624+0000 7f01cc85e700 1 --2- 172.21.15.72:0/3055260218 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f01c806ee90 0x7f01c8150970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:30.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.624+0000 7f01cd05f700 1 --2- 172.21.15.72:0/3055260218 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f01c81518f0 0x7f01c8146890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:30.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.624+0000 7f01c7fff700 1 -- 172.21.15.72:0/3055260218 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f01c806ee90 msgr2=0x7f01c8150970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:30.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.624+0000 7f01c7fff700 1 --2- 172.21.15.72:0/3055260218 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f01c806ee90 0x7f01c8150970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:30.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.624+0000 7f01c7fff700 1 -- 172.21.15.72:0/3055260218 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f01c81518f0 msgr2=0x7f01c8146890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:30.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.624+0000 7f01c7fff700 1 --2- 172.21.15.72:0/3055260218 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f01c81518f0 0x7f01c8146890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:30.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.624+0000 7f01c7fff700 1 -- 172.21.15.72:0/3055260218 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01b40094a0 con 0x7f01c8071390 2023-07-25T14:37:30.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.625+0000 7f01c7fff700 1 --2- 172.21.15.72:0/3055260218 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f01c8071390 0x7f01c80c2fc0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f01b400a010 tx=0x7f01b4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:30.642 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.625+0000 7f01c57fa700 1 -- 172.21.15.72:0/3055260218 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01b4003cf0 con 0x7f01c8071390 2023-07-25T14:37:30.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.625+0000 7f01c57fa700 1 -- 172.21.15.72:0/3055260218 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01b401f070 con 0x7f01c8071390 2023-07-25T14:37:30.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.625+0000 7f01ceac2700 1 -- 172.21.15.72:0/3055260218 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01c8157820 con 0x7f01c8071390 2023-07-25T14:37:30.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.625+0000 7f01c57fa700 1 -- 172.21.15.72:0/3055260218 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01b4011870 con 0x7f01c8071390 2023-07-25T14:37:30.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.625+0000 7f01ceac2700 1 -- 172.21.15.72:0/3055260218 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01c8156e60 con 0x7f01c8071390 2023-07-25T14:37:30.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.626+0000 7f01ceac2700 1 -- 172.21.15.72:0/3055260218 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01c8157fe0 con 0x7f01c8071390 2023-07-25T14:37:30.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.626+0000 7f01c57fa700 1 -- 172.21.15.72:0/3055260218 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f01b40119d0 con 0x7f01c8071390 2023-07-25T14:37:30.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.627+0000 7f01c57fa700 1 --2- 172.21.15.72:0/3055260218 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f01ac06ace0 0x7f01ac06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:30.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.627+0000 7f01cc85e700 1 --2- 172.21.15.72:0/3055260218 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f01ac06ace0 0x7f01ac06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:30.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.627+0000 7f01c57fa700 1 -- 172.21.15.72:0/3055260218 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6472+0+0 (secure 0 0 0) 0x7f01b4021070 con 0x7f01c8071390 2023-07-25T14:37:30.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.627+0000 7f01cc85e700 1 --2- 172.21.15.72:0/3055260218 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f01ac06ace0 0x7f01ac06d1a0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f01bc000f60 tx=0x7f01bc001e00 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:30.644 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.631+0000 7f01c57fa700 1 -- 172.21.15.72:0/3055260218 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f01b4055ce0 con 0x7f01c8071390 2023-07-25T14:37:30.870 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.860+0000 7f01ceac2700 1 -- 172.21.15.72:0/3055260218 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f01c804e470 con 0x7f01c8071390 2023-07-25T14:37:30.871 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.861+0000 7f01c57fa700 1 -- 172.21.15.72:0/3055260218 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4667 (secure 0 0 0) 0x7f01b4059300 con 0x7f01c8071390 2023-07-25T14:37:30.871 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-25T14:37:30.871 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":24,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5092,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6834/3640355071","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":3640355071},{"type":"v1","addr":"172.21.15.92:6834","nonce":3640355071}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5095,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/936080292","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6833","nonce":936080292},{"type":"v1","addr":"172.21.15.92:6835","nonce":936080292}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5937,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6837/549993324","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6835","nonce":549993324},{"type":"v1","addr":"172.21.15.72:6837","nonce":549993324}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-25T14:37:02.650515+0000","modified":"2023-07-25T14:37:06.294518+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5328},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5328":{"gid":5328,"name":"c","rank":0,"incarnation":18,"state":"up:active","state_seq":7,"addr":"172.21.15.72:6836/2944832990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":2944832990},{"type":"v1","addr":"172.21.15.72:6836","nonce":2944832990}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-07-25T14:37:30.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.863+0000 7f01ceac2700 1 -- 172.21.15.72:0/3055260218 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f01ac06ace0 msgr2=0x7f01ac06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:30.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.863+0000 7f01ceac2700 1 --2- 172.21.15.72:0/3055260218 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f01ac06ace0 0x7f01ac06d1a0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f01bc000f60 tx=0x7f01bc001e00 comp rx=0 tx=0).stop 2023-07-25T14:37:30.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.863+0000 7f01ceac2700 1 -- 172.21.15.72:0/3055260218 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f01c8071390 msgr2=0x7f01c80c2fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:30.873 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.863+0000 7f01ceac2700 1 --2- 172.21.15.72:0/3055260218 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f01c8071390 0x7f01c80c2fc0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f01b400a010 tx=0x7f01b4004750 comp rx=0 tx=0).stop 2023-07-25T14:37:30.874 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.863+0000 7f01ceac2700 1 -- 172.21.15.72:0/3055260218 shutdown_connections 2023-07-25T14:37:30.874 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.863+0000 7f01ceac2700 1 --2- 172.21.15.72:0/3055260218 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f01ac06ace0 0x7f01ac06d1a0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:30.874 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.863+0000 7f01ceac2700 1 --2- 172.21.15.72:0/3055260218 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f01c806ee90 0x7f01c8150970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:30.874 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.863+0000 7f01ceac2700 1 --2- 172.21.15.72:0/3055260218 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f01c81518f0 0x7f01c8146890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:30.874 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.863+0000 7f01ceac2700 1 --2- 172.21.15.72:0/3055260218 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f01c8071390 0x7f01c80c2fc0 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:30.874 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.863+0000 7f01ceac2700 1 -- 172.21.15.72:0/3055260218 >> 172.21.15.72:0/3055260218 conn(0x7f01c8066460 msgr2=0x7f01c806aec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:30.874 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.863+0000 7f01ceac2700 1 -- 172.21.15.72:0/3055260218 shutdown_connections 2023-07-25T14:37:30.874 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.863+0000 7f01ceac2700 1 -- 172.21.15.72:0/3055260218 wait complete. 2023-07-25T14:37:30.875 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 24 2023-07-25T14:37:30.885 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-25T14:37:31.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.994+0000 7f2653ee1700 1 Processor -- start 2023-07-25T14:37:31.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.994+0000 7f2653ee1700 1 -- start start 2023-07-25T14:37:31.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.995+0000 7f2653ee1700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f264c14f810 0x7f264c0c4370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:31.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.995+0000 7f2653ee1700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f264c0bb0b0 0x7f264c152cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:31.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.995+0000 7f2653ee1700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f264c0c5890 con 0x7f264c0a9cc0 2023-07-25T14:37:31.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.995+0000 7f2653ee1700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f264c152150 con 0x7f264c0bb0b0 2023-07-25T14:37:31.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.995+0000 7f2653ee1700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f264c14fbf0 con 0x7f264c14f810 2023-07-25T14:37:31.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.995+0000 7f265247e700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f264c0bb0b0 0x7f264c152cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:31.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.995+0000 7f265147c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f264c0a9cc0 0x7f264c1525e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:33986/0 (socket says 172.21.15.72:33986) 2023-07-25T14:37:31.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.995+0000 7f265147c700 1 -- 172.21.15.72:0/184500649 learned_addr learned my addr 172.21.15.72:0/184500649 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:37:31.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.996+0000 7f2651c7d700 1 --2- 172.21.15.72:0/184500649 >> v2:172.21.15.92:3300/0 conn(0x7f264c14f810 0x7f264c0c4370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:31.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.996+0000 7f265247e700 1 -- 172.21.15.72:0/184500649 >> v2:172.21.15.92:3300/0 conn(0x7f264c14f810 msgr2=0x7f264c0c4370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:31.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.996+0000 7f265247e700 1 --2- 172.21.15.72:0/184500649 >> v2:172.21.15.92:3300/0 conn(0x7f264c14f810 0x7f264c0c4370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:31.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.996+0000 7f265247e700 1 -- 172.21.15.72:0/184500649 >> v1:172.21.15.72:6789/0 conn(0x7f264c0a9cc0 legacy=0x7f264c1525e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:31.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.996+0000 7f265247e700 1 -- 172.21.15.72:0/184500649 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f264c1566a0 con 0x7f264c0bb0b0 2023-07-25T14:37:31.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.996+0000 7f2650c7b700 1 -- 172.21.15.72:0/184500649 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3038711350 0 0) 0x7f264c0c5890 con 0x7f264c0a9cc0 2023-07-25T14:37:31.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.996+0000 7f2651c7d700 1 --2- 172.21.15.72:0/184500649 >> v2:172.21.15.92:3300/0 conn(0x7f264c14f810 0x7f264c0c4370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-25T14:37:31.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.996+0000 7f265247e700 1 --2- 172.21.15.72:0/184500649 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f264c0bb0b0 0x7f264c152cf0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f264c0aa300 tx=0x7f264400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9538f7634949b94 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:31.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.996+0000 7f2650c7b700 1 -- 172.21.15.72:0/184500649 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f264400e070 con 0x7f264c0bb0b0 2023-07-25T14:37:31.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.996+0000 7f2650c7b700 1 -- 172.21.15.72:0/184500649 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f264400bbd0 con 0x7f264c0bb0b0 2023-07-25T14:37:31.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.996+0000 7f2650c7b700 1 -- 172.21.15.72:0/184500649 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2644012430 con 0x7f264c0bb0b0 2023-07-25T14:37:31.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.996+0000 7f2653ee1700 1 -- 172.21.15.72:0/184500649 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f264c0bb0b0 msgr2=0x7f264c152cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:31.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.996+0000 7f2653ee1700 1 --2- 172.21.15.72:0/184500649 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f264c0bb0b0 0x7f264c152cf0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f264c0aa300 tx=0x7f264400b330 comp rx=0 tx=0).stop 2023-07-25T14:37:31.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.996+0000 7f2653ee1700 1 -- 172.21.15.72:0/184500649 shutdown_connections 2023-07-25T14:37:31.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.996+0000 7f2653ee1700 1 --2- 172.21.15.72:0/184500649 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f264c0bb0b0 0x7f264c152cf0 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:31.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.996+0000 7f2653ee1700 1 --2- 172.21.15.72:0/184500649 >> v2:172.21.15.92:3300/0 conn(0x7f264c14f810 0x7f264c0c4370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:31.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.996+0000 7f2653ee1700 1 -- 172.21.15.72:0/184500649 >> 172.21.15.72:0/184500649 conn(0x7f264c06a8d0 msgr2=0x7f264c0a94e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:31.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.997+0000 7f2653ee1700 1 -- 172.21.15.72:0/184500649 shutdown_connections 2023-07-25T14:37:31.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.997+0000 7f2653ee1700 1 -- 172.21.15.72:0/184500649 wait complete. 2023-07-25T14:37:31.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.998+0000 7f2653ee1700 1 Processor -- start 2023-07-25T14:37:31.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.998+0000 7f2653ee1700 1 -- start start 2023-07-25T14:37:31.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.998+0000 7f2653ee1700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f264c0a9cc0 0x7f264c0bd8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:31.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.998+0000 7f2653ee1700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f264c0bb0b0 0x7f264c0acb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:31.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.998+0000 7f2653ee1700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f264c14f810 0x7f264c0ad0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:31.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.998+0000 7f2653ee1700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f264c0c00b0 con 0x7f264c14f810 2023-07-25T14:37:31.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.998+0000 7f2653ee1700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f264c0a8920 con 0x7f264c0bb0b0 2023-07-25T14:37:31.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.998+0000 7f2653ee1700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f264c0ad600 con 0x7f264c0a9cc0 2023-07-25T14:37:31.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.999+0000 7f265247e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f264c14f810 0x7f264c0ad0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:31.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.999+0000 7f265247e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f264c14f810 0x7f264c0ad0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43260/0 (socket says 172.21.15.72:43260) 2023-07-25T14:37:31.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.999+0000 7f265247e700 1 -- 172.21.15.72:0/3338931470 learned_addr learned my addr 172.21.15.72:0/3338931470 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:37:31.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.999+0000 7f265147c700 1 --2- 172.21.15.72:0/3338931470 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f264c0bb0b0 0x7f264c0acb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:31.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.999+0000 7f2651c7d700 1 --2- 172.21.15.72:0/3338931470 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f264c0a9cc0 0x7f264c0bd8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:31.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.999+0000 7f265247e700 1 -- 172.21.15.72:0/3338931470 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f264c0a9cc0 msgr2=0x7f264c0bd8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:31.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.999+0000 7f265247e700 1 --2- 172.21.15.72:0/3338931470 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f264c0a9cc0 0x7f264c0bd8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:31.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.999+0000 7f265247e700 1 -- 172.21.15.72:0/3338931470 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f264c0bb0b0 msgr2=0x7f264c0acb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:31.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.999+0000 7f265247e700 1 --2- 172.21.15.72:0/3338931470 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f264c0bb0b0 0x7f264c0acb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:31.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.999+0000 7f265247e700 1 -- 172.21.15.72:0/3338931470 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2644009a70 con 0x7f264c14f810 2023-07-25T14:37:31.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.999+0000 7f265147c700 1 --2- 172.21.15.72:0/3338931470 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f264c0bb0b0 0x7f264c0acb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-25T14:37:31.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.999+0000 7f2651c7d700 1 --2- 172.21.15.72:0/3338931470 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f264c0a9cc0 0x7f264c0bd8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-25T14:37:31.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.999+0000 7f265247e700 1 --2- 172.21.15.72:0/3338931470 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f264c14f810 0x7f264c0ad0c0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f264c070830 tx=0x7f2644004b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:31.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.999+0000 7f26427fc700 1 -- 172.21.15.72:0/3338931470 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2644012430 con 0x7f264c14f810 2023-07-25T14:37:31.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.999+0000 7f26427fc700 1 -- 172.21.15.72:0/3338931470 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2644020070 con 0x7f264c14f810 2023-07-25T14:37:31.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.999+0000 7f26427fc700 1 -- 172.21.15.72:0/3338931470 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2644004280 con 0x7f264c14f810 2023-07-25T14:37:31.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.999+0000 7f2653ee1700 1 -- 172.21.15.72:0/3338931470 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f264c1eac20 con 0x7f264c14f810 2023-07-25T14:37:31.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:30.999+0000 7f2653ee1700 1 -- 172.21.15.72:0/3338931470 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f264c1eb150 con 0x7f264c14f810 2023-07-25T14:37:31.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:31.000+0000 7f2653ee1700 1 -- 172.21.15.72:0/3338931470 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f264c04e470 con 0x7f264c14f810 2023-07-25T14:37:31.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:31.001+0000 7f26427fc700 1 -- 172.21.15.72:0/3338931470 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f26440043e0 con 0x7f264c14f810 2023-07-25T14:37:31.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:31.002+0000 7f26427fc700 1 --2- 172.21.15.72:0/3338931470 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f263006ace0 0x7f263006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:31.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:31.002+0000 7f26427fc700 1 -- 172.21.15.72:0/3338931470 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6472+0+0 (secure 0 0 0) 0x7f2644022070 con 0x7f264c14f810 2023-07-25T14:37:31.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:31.002+0000 7f2651c7d700 1 --2- 172.21.15.72:0/3338931470 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f263006ace0 0x7f263006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:31.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:31.002+0000 7f2651c7d700 1 --2- 172.21.15.72:0/3338931470 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f263006ace0 0x7f263006d1a0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f263c006fd0 tx=0x7f263c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:31.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:31.005+0000 7f26427fc700 1 -- 172.21.15.72:0/3338931470 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f2644056860 con 0x7f264c14f810 2023-07-25T14:37:31.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:31.236+0000 7f2653ee1700 1 -- 172.21.15.72:0/3338931470 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f264c0c26d0 con 0x7f264c14f810 2023-07-25T14:37:31.247 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:31.237+0000 7f26427fc700 1 -- 172.21.15.72:0/3338931470 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4667 (secure 0 0 0) 0x7f2644059e80 con 0x7f264c14f810 2023-07-25T14:37:31.247 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-25T14:37:31.247 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":24,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5092,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6834/3640355071","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":3640355071},{"type":"v1","addr":"172.21.15.92:6834","nonce":3640355071}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5095,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/936080292","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6833","nonce":936080292},{"type":"v1","addr":"172.21.15.92:6835","nonce":936080292}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5937,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6837/549993324","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6835","nonce":549993324},{"type":"v1","addr":"172.21.15.72:6837","nonce":549993324}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-25T14:37:02.650515+0000","modified":"2023-07-25T14:37:06.294518+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5328},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5328":{"gid":5328,"name":"c","rank":0,"incarnation":18,"state":"up:active","state_seq":7,"addr":"172.21.15.72:6836/2944832990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":2944832990},{"type":"v1","addr":"172.21.15.72:6836","nonce":2944832990}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-07-25T14:37:31.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:31.239+0000 7f2653ee1700 1 -- 172.21.15.72:0/3338931470 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f263006ace0 msgr2=0x7f263006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:31.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:31.239+0000 7f2653ee1700 1 --2- 172.21.15.72:0/3338931470 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f263006ace0 0x7f263006d1a0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f263c006fd0 tx=0x7f263c008040 comp rx=0 tx=0).stop 2023-07-25T14:37:31.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:31.239+0000 7f2653ee1700 1 -- 172.21.15.72:0/3338931470 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f264c14f810 msgr2=0x7f264c0ad0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:31.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:31.239+0000 7f2653ee1700 1 --2- 172.21.15.72:0/3338931470 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f264c14f810 0x7f264c0ad0c0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f264c070830 tx=0x7f2644004b20 comp rx=0 tx=0).stop 2023-07-25T14:37:31.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:31.239+0000 7f2653ee1700 1 -- 172.21.15.72:0/3338931470 shutdown_connections 2023-07-25T14:37:31.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:31.239+0000 7f2653ee1700 1 --2- 172.21.15.72:0/3338931470 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f263006ace0 0x7f263006d1a0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:31.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:31.239+0000 7f2653ee1700 1 --2- 172.21.15.72:0/3338931470 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f264c0a9cc0 0x7f264c0bd8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:31.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:31.239+0000 7f2653ee1700 1 --2- 172.21.15.72:0/3338931470 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f264c14f810 0x7f264c0ad0c0 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:31.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:31.239+0000 7f2653ee1700 1 --2- 172.21.15.72:0/3338931470 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f264c0bb0b0 0x7f264c0acb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:31.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:31.239+0000 7f2653ee1700 1 -- 172.21.15.72:0/3338931470 >> 172.21.15.72:0/3338931470 conn(0x7f264c06a8d0 msgr2=0x7f264c1506a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:31.251 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:31.239+0000 7f2653ee1700 1 -- 172.21.15.72:0/3338931470 shutdown_connections 2023-07-25T14:37:31.251 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:31.239+0000 7f2653ee1700 1 -- 172.21.15.72:0/3338931470 wait complete. 2023-07-25T14:37:31.251 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 24 2023-07-25T14:37:31.261 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-25T14:37:31.380 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:31.370+0000 7fbaa84af700 1 Processor -- start 2023-07-25T14:37:31.381 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:31.370+0000 7fbaa84af700 1 -- start start 2023-07-25T14:37:31.382 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:31.371+0000 7fbaa84af700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fbaa0152260 0x7fbaa0070240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:31.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:31.371+0000 7fbaa84af700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbaa00c25b0 con 0x7fbaa006e700 2023-07-25T14:37:31.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:31.371+0000 7fbaa84af700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbaa00c60d0 con 0x7fbaa00c7120 2023-07-25T14:37:31.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:31.371+0000 7fbaa84af700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbaa00ad7f0 con 0x7fbaa0152260 2023-07-25T14:37:31.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:31.371+0000 7fbaa624b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fbaa0152260 0x7fbaa0070240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:31.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:31.371+0000 7fbaa6a4c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fbaa006e700 0x7fbaa014ef80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:34004/0 (socket says 172.21.15.72:34004) 2023-07-25T14:37:31.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:31.371+0000 7fbaa624b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fbaa0152260 0x7fbaa0070240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43264/0 (socket says 172.21.15.72:43264) 2023-07-25T14:37:31.383 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:31.371+0000 7fbaa6a4c700 1 -- 172.21.15.72:0/3977510618 learned_addr learned my addr 172.21.15.72:0/3977510618 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:37:31.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:31.372+0000 7fbaa624b700 1 -- 172.21.15.72:0/3977510618 >> v1:172.21.15.92:6789/0 conn(0x7fbaa00c7120 legacy=0x7fbaa01533f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:31.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:31.372+0000 7fbaa624b700 1 -- 172.21.15.72:0/3977510618 >> v1:172.21.15.72:6789/0 conn(0x7fbaa006e700 legacy=0x7fbaa014ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:31.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:31.372+0000 7fbaa624b700 1 -- 172.21.15.72:0/3977510618 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbaa00c63b0 con 0x7fbaa0152260 2023-07-25T14:37:31.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:31.372+0000 7fbaa5249700 1 -- 172.21.15.72:0/3977510618 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3918319571 0 0) 0x7fbaa00c25b0 con 0x7fbaa006e700 2023-07-25T14:37:31.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:31.372+0000 7fbaa624b700 1 --2- 172.21.15.72:0/3977510618 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbaa0152260 0x7fbaa0070240 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fba90009840 tx=0x7fba90009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7bb77fbea995c16 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:31.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:31.372+0000 7fbaa5249700 1 -- 172.21.15.72:0/3977510618 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba90011830 con 0x7fbaa0152260 2023-07-25T14:37:31.384 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:31.372+0000 7fbaa5249700 1 -- 172.21.15.72:0/3977510618 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba90011990 con 0x7fbaa0152260 2023-07-25T14:37:31.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:31.372+0000 7fbaa5249700 1 -- 172.21.15.72:0/3977510618 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba90011d20 con 0x7fbaa0152260 2023-07-25T14:37:31.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:31.372+0000 7fbaa84af700 1 -- 172.21.15.72:0/3977510618 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbaa0152260 msgr2=0x7fbaa0070240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:31.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:31.372+0000 7fbaa84af700 1 --2- 172.21.15.72:0/3977510618 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbaa0152260 0x7fbaa0070240 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fba90009840 tx=0x7fba90009b50 comp rx=0 tx=0).stop 2023-07-25T14:37:31.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:31.372+0000 7fbaa84af700 1 -- 172.21.15.72:0/3977510618 shutdown_connections 2023-07-25T14:37:31.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:31.372+0000 7fbaa84af700 1 --2- 172.21.15.72:0/3977510618 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbaa0152260 0x7fbaa0070240 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:31.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:31.372+0000 7fbaa84af700 1 -- 172.21.15.72:0/3977510618 >> 172.21.15.72:0/3977510618 conn(0x7fbaa00c77c0 msgr2=0x7fbaa00c7ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:31.385 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:31.373+0000 7fbaa84af700 1 -- 172.21.15.72:0/3977510618 shutdown_connections 2023-07-25T14:37:31.386 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:31.373+0000 7fbaa84af700 1 -- 172.21.15.72:0/3977510618 wait complete. 2023-07-25T14:37:31.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:31.374+0000 7fbaa84af700 1 Processor -- start 2023-07-25T14:37:31.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:31.374+0000 7fbaa84af700 1 -- start start 2023-07-25T14:37:31.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:31.374+0000 7fbaa84af700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fbaa006e700 0x7fbaa00bc780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:31.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:31.374+0000 7fbaa84af700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbaa00c7120 0x7fbaa00acd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:31.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:31.374+0000 7fbaa84af700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbaa0152260 0x7fbaa00bd420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:31.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:31.374+0000 7fbaa84af700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaa00bafa0 con 0x7fbaa00c7120 2023-07-25T14:37:31.388 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:31.374+0000 7fbaa84af700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaa00bb240 con 0x7fbaa0152260 2023-07-25T14:37:31.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:31.374+0000 7fbaa84af700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbaa00bb520 con 0x7fbaa006e700 2023-07-25T14:37:31.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:31.374+0000 7fbaa5a4a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbaa00c7120 0x7fbaa00acd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:31.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:31.374+0000 7fbaa5a4a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbaa00c7120 0x7fbaa00acd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43272/0 (socket says 172.21.15.72:43272) 2023-07-25T14:37:31.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:31.374+0000 7fbaa5a4a700 1 -- 172.21.15.72:0/4253718143 learned_addr learned my addr 172.21.15.72:0/4253718143 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:37:31.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:31.374+0000 7fbaa6a4c700 1 --2- 172.21.15.72:0/4253718143 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbaa0152260 0x7fbaa00bd420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:31.389 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:31.374+0000 7fbaa624b700 1 --2- 172.21.15.72:0/4253718143 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fbaa006e700 0x7fbaa00bc780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:31.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:31.375+0000 7fbaa5a4a700 1 -- 172.21.15.72:0/4253718143 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fbaa006e700 msgr2=0x7fbaa00bc780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:31.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:31.375+0000 7fbaa5a4a700 1 --2- 172.21.15.72:0/4253718143 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fbaa006e700 0x7fbaa00bc780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:31.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:31.375+0000 7fbaa5a4a700 1 -- 172.21.15.72:0/4253718143 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbaa0152260 msgr2=0x7fbaa00bd420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:31.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:31.375+0000 7fbaa5a4a700 1 --2- 172.21.15.72:0/4253718143 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbaa0152260 0x7fbaa00bd420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:31.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:31.375+0000 7fbaa5a4a700 1 -- 172.21.15.72:0/4253718143 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba900094a0 con 0x7fbaa00c7120 2023-07-25T14:37:31.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:31.375+0000 7fbaa5a4a700 1 --2- 172.21.15.72:0/4253718143 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbaa00c7120 0x7fbaa00acd70 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fba9c00c4e0 tx=0x7fba9c00c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:31.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:31.375+0000 7fba96ffd700 1 -- 172.21.15.72:0/4253718143 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba9c0052d0 con 0x7fbaa00c7120 2023-07-25T14:37:31.390 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:31.375+0000 7fba96ffd700 1 -- 172.21.15.72:0/4253718143 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba9c005430 con 0x7fbaa00c7120 2023-07-25T14:37:31.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:31.375+0000 7fbaa84af700 1 -- 172.21.15.72:0/4253718143 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbaa00bb800 con 0x7fbaa00c7120 2023-07-25T14:37:31.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:31.375+0000 7fba96ffd700 1 -- 172.21.15.72:0/4253718143 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba9c0038c0 con 0x7fbaa00c7120 2023-07-25T14:37:31.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:31.375+0000 7fbaa84af700 1 -- 172.21.15.72:0/4253718143 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbaa00bbae0 con 0x7fbaa00c7120 2023-07-25T14:37:31.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:31.376+0000 7fbaa84af700 1 -- 172.21.15.72:0/4253718143 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbaa00c22d0 con 0x7fbaa00c7120 2023-07-25T14:37:31.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:31.376+0000 7fba96ffd700 1 -- 172.21.15.72:0/4253718143 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fba9c003a20 con 0x7fbaa00c7120 2023-07-25T14:37:31.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:31.377+0000 7fba96ffd700 1 --2- 172.21.15.72:0/4253718143 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fba8406ace0 0x7fba8406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:31.391 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:31.377+0000 7fbaa624b700 1 --2- 172.21.15.72:0/4253718143 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fba8406ace0 0x7fba8406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:31.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:31.377+0000 7fba96ffd700 1 -- 172.21.15.72:0/4253718143 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6472+0+0 (secure 0 0 0) 0x7fba9c0889c0 con 0x7fbaa00c7120 2023-07-25T14:37:31.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:31.377+0000 7fbaa624b700 1 --2- 172.21.15.72:0/4253718143 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fba8406ace0 0x7fba8406d1a0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fba900090b0 tx=0x7fba9001c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:31.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:31.381+0000 7fba96ffd700 1 -- 172.21.15.72:0/4253718143 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fba9c0538d0 con 0x7fbaa00c7120 2023-07-25T14:37:31.580 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:31.570+0000 7fbaa84af700 1 -- 172.21.15.72:0/4253718143 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbaa0152a40 con 0x7fbaa00c7120 2023-07-25T14:37:31.581 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:31.571+0000 7fba96ffd700 1 -- 172.21.15.72:0/4253718143 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v46) v1 ==== 74+0+18579 (secure 0 0 0) 0x7fba9c056ef0 con 0x7fbaa00c7120 2023-07-25T14:37:31.582 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-25T14:37:31.582 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":46,"fsid":"9170db48-9170-43e8-8ccb-9813e6240906","created":"2023-07-25T14:35:21.733262+0000","modified":"2023-07-25T14:37:28.076031+0000","last_up_change":"2023-07-25T14:35:31.355010+0000","last_in_change":"2023-07-25T14:35:24.195785+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-25T14:35:32.983457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-25T14:35:33.326342+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs2_metadata","create_time":"2023-07-25T14:37:01.238292+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs2_data","create_time":"2023-07-25T14:37:01.609127+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d517fdad-0bfe-49f0-89f2-9421c3761839","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6801","nonce":2475407414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6803","nonce":2475407414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6807","nonce":2475407414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6805","nonce":2475407414}]},"public_addr":"172.21.15.72:6801/2475407414","cluster_addr":"172.21.15.72:6803/2475407414","heartbeat_back_addr":"172.21.15.72:6807/2475407414","heartbeat_front_addr":"172.21.15.72:6805/2475407414","state":["exists","up"]},{"osd":1,"uuid":"e1564be3-f209-47e5-a8d0-32fc618a474f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6822","nonce":870954016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6825","nonce":870954016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6831","nonce":870954016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6827","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6829","nonce":870954016}]},"public_addr":"172.21.15.72:6822/870954016","cluster_addr":"172.21.15.72:6825/870954016","heartbeat_back_addr":"172.21.15.72:6831/870954016","heartbeat_front_addr":"172.21.15.72:6829/870954016","state":["exists","up"]},{"osd":2,"uuid":"c4647d30-ffa6-417a-9026-ef530c75910e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6809","nonce":2143129442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6811","nonce":2143129442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6815","nonce":2143129442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6813","nonce":2143129442}]},"public_addr":"172.21.15.72:6809/2143129442","cluster_addr":"172.21.15.72:6811/2143129442","heartbeat_back_addr":"172.21.15.72:6815/2143129442","heartbeat_front_addr":"172.21.15.72:6813/2143129442","state":["exists","up"]},{"osd":3,"uuid":"76c9d9a7-c2e2-4612-a58b-d6882dd76b58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6817","nonce":3404066311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6819","nonce":3404066311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6828","nonce":3404066311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6821","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6823","nonce":3404066311}]},"public_addr":"172.21.15.72:6817/3404066311","cluster_addr":"172.21.15.72:6819/3404066311","heartbeat_back_addr":"172.21.15.72:6828/3404066311","heartbeat_front_addr":"172.21.15.72:6823/3404066311","state":["exists","up"]},{"osd":4,"uuid":"7f8920dc-0ad4-4a73-ab40-65408f83eadd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6817","nonce":2381008739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6819","nonce":2381008739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6825","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6827","nonce":2381008739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6822","nonce":2381008739}]},"public_addr":"172.21.15.92:6817/2381008739","cluster_addr":"172.21.15.92:6819/2381008739","heartbeat_back_addr":"172.21.15.92:6827/2381008739","heartbeat_front_addr":"172.21.15.92:6822/2381008739","state":["exists","up"]},{"osd":5,"uuid":"56257e7c-31eb-44c5-9ec7-1318a4e0bb35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6801","nonce":2161935604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6803","nonce":2161935604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6807","nonce":2161935604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6805","nonce":2161935604}]},"public_addr":"172.21.15.92:6801/2161935604","cluster_addr":"172.21.15.92:6803/2161935604","heartbeat_back_addr":"172.21.15.92:6807/2161935604","heartbeat_front_addr":"172.21.15.92:6805/2161935604","state":["exists","up"]},{"osd":6,"uuid":"a150d3d8-a0c9-4955-968a-8d98eff4ffb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6809","nonce":3770163493}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6811","nonce":3770163493}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6815","nonce":3770163493}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6813","nonce":3770163493}]},"public_addr":"172.21.15.92:6809/3770163493","cluster_addr":"172.21.15.92:6811/3770163493","heartbeat_back_addr":"172.21.15.92:6815/3770163493","heartbeat_front_addr":"172.21.15.92:6813/3770163493","state":["exists","up"]},{"osd":7,"uuid":"07799c27-54ee-4591-a42d-a978d6b32065","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6821","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6823","nonce":2135777609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6826","nonce":2135777609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6831","nonce":2135777609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6829","nonce":2135777609}]},"public_addr":"172.21.15.92:6823/2135777609","cluster_addr":"172.21.15.92:6826/2135777609","heartbeat_back_addr":"172.21.15.92:6831/2135777609","heartbeat_front_addr":"172.21.15.92:6829/2135777609","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.345365+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.378150+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.146566+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.372172+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:30.398421+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.385632+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.465611+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.443583+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.72:6837/1193027887":"2023-07-26T14:37:25.068539+0000","172.21.15.72:6835/1193027887":"2023-07-26T14:37:25.068539+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-25T14:37:31.584 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:31.574+0000 7fbaa84af700 1 -- 172.21.15.72:0/4253718143 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fba8406ace0 msgr2=0x7fba8406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:31.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:31.574+0000 7fbaa84af700 1 --2- 172.21.15.72:0/4253718143 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fba8406ace0 0x7fba8406d1a0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fba900090b0 tx=0x7fba9001c040 comp rx=0 tx=0).stop 2023-07-25T14:37:31.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:31.574+0000 7fbaa84af700 1 -- 172.21.15.72:0/4253718143 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbaa00c7120 msgr2=0x7fbaa00acd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:31.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:31.574+0000 7fbaa84af700 1 --2- 172.21.15.72:0/4253718143 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbaa00c7120 0x7fbaa00acd70 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fba9c00c4e0 tx=0x7fba9c00c7f0 comp rx=0 tx=0).stop 2023-07-25T14:37:31.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:31.574+0000 7fbaa84af700 1 -- 172.21.15.72:0/4253718143 shutdown_connections 2023-07-25T14:37:31.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:31.574+0000 7fbaa84af700 1 --2- 172.21.15.72:0/4253718143 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fba8406ace0 0x7fba8406d1a0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:31.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:31.574+0000 7fbaa84af700 1 --2- 172.21.15.72:0/4253718143 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fbaa006e700 0x7fbaa00bc780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:31.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:31.574+0000 7fbaa84af700 1 --2- 172.21.15.72:0/4253718143 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbaa0152260 0x7fbaa00bd420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:31.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:31.574+0000 7fbaa84af700 1 --2- 172.21.15.72:0/4253718143 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fbaa00c7120 0x7fbaa00acd70 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:31.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:31.574+0000 7fbaa84af700 1 -- 172.21.15.72:0/4253718143 >> 172.21.15.72:0/4253718143 conn(0x7fbaa00c77c0 msgr2=0x7fbaa014fc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:31.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:31.574+0000 7fbaa84af700 1 -- 172.21.15.72:0/4253718143 shutdown_connections 2023-07-25T14:37:31.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:31.574+0000 7fbaa84af700 1 -- 172.21.15.72:0/4253718143 wait complete. 2023-07-25T14:37:31.596 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs2 2023-07-25T14:37:31.718 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:31.706+0000 7f52ce3a6700 1 Processor -- start 2023-07-25T14:37:31.719 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:31.706+0000 7f52ce3a6700 1 -- start start 2023-07-25T14:37:31.719 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:31.707+0000 7f52ce3a6700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f52c8151980 0x7f52c80c12b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:31.719 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:31.707+0000 7f52ce3a6700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f52c80c17f0 0x7f52c80c4c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:31.719 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:31.707+0000 7f52ce3a6700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52c806eaf0 con 0x7f52c806e580 2023-07-25T14:37:31.719 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:31.707+0000 7f52ce3a6700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52c806f770 con 0x7f52c8151980 2023-07-25T14:37:31.719 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:31.707+0000 7f52ce3a6700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52c80c29e0 con 0x7f52c80c17f0 2023-07-25T14:37:31.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:31.707+0000 7f52c7fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f52c8151980 0x7f52c80c12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:31.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:31.707+0000 7f52c7fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f52c8151980 0x7f52c80c12b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43278/0 (socket says 172.21.15.72:43278) 2023-07-25T14:37:31.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:31.707+0000 7f52cc943700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f52c806e580 0x7f52c80c51b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:34018/0 (socket says 172.21.15.72:34018) 2023-07-25T14:37:31.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:31.707+0000 7f52c7fff700 1 -- 172.21.15.72:0/172787674 learned_addr learned my addr 172.21.15.72:0/172787674 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:37:31.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:31.707+0000 7f52c7fff700 1 -- 172.21.15.72:0/172787674 >> v2:172.21.15.92:3300/0 conn(0x7f52c80c17f0 msgr2=0x7f52c80c4c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:31.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:31.707+0000 7f52c77fe700 1 --2- 172.21.15.72:0/172787674 >> v2:172.21.15.92:3300/0 conn(0x7f52c80c17f0 0x7f52c80c4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:31.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:31.707+0000 7f52c7fff700 1 --2- 172.21.15.72:0/172787674 >> v2:172.21.15.92:3300/0 conn(0x7f52c80c17f0 0x7f52c80c4c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:31.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:31.707+0000 7f52c6ffd700 1 -- 172.21.15.72:0/172787674 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1845265011 0 0) 0x7f52c806eaf0 con 0x7f52c806e580 2023-07-25T14:37:31.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:31.707+0000 7f52c7fff700 1 -- 172.21.15.72:0/172787674 >> v1:172.21.15.72:6789/0 conn(0x7f52c806e580 legacy=0x7f52c80c51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:31.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:31.707+0000 7f52c7fff700 1 -- 172.21.15.72:0/172787674 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52c806edd0 con 0x7f52c8151980 2023-07-25T14:37:31.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:31.707+0000 7f52c77fe700 1 --2- 172.21.15.72:0/172787674 >> v2:172.21.15.92:3300/0 conn(0x7f52c80c17f0 0x7f52c80c4c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-25T14:37:31.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:31.708+0000 7f52c7fff700 1 --2- 172.21.15.72:0/172787674 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f52c8151980 0x7f52c80c12b0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f52c80a90a0 tx=0x7f52bc009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f06e8fe6139e622 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:31.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:31.708+0000 7f52c6ffd700 1 -- 172.21.15.72:0/172787674 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52bc005e30 con 0x7f52c8151980 2023-07-25T14:37:31.722 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:31.708+0000 7f52c6ffd700 1 -- 172.21.15.72:0/172787674 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52bc004030 con 0x7f52c8151980 2023-07-25T14:37:31.722 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:31.708+0000 7f52c6ffd700 1 -- 172.21.15.72:0/172787674 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52bc0043e0 con 0x7f52c8151980 2023-07-25T14:37:31.722 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:31.708+0000 7f52ce3a6700 1 -- 172.21.15.72:0/172787674 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f52c8151980 msgr2=0x7f52c80c12b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:31.722 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:31.708+0000 7f52ce3a6700 1 --2- 172.21.15.72:0/172787674 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f52c8151980 0x7f52c80c12b0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f52c80a90a0 tx=0x7f52bc009bd0 comp rx=0 tx=0).stop 2023-07-25T14:37:31.722 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:31.708+0000 7f52ce3a6700 1 -- 172.21.15.72:0/172787674 shutdown_connections 2023-07-25T14:37:31.722 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:31.708+0000 7f52ce3a6700 1 --2- 172.21.15.72:0/172787674 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f52c8151980 0x7f52c80c12b0 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:31.722 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:31.708+0000 7f52ce3a6700 1 --2- 172.21.15.72:0/172787674 >> v2:172.21.15.92:3300/0 conn(0x7f52c80c17f0 0x7f52c80c4c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:31.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:31.708+0000 7f52ce3a6700 1 -- 172.21.15.72:0/172787674 >> 172.21.15.72:0/172787674 conn(0x7f52c80a8520 msgr2=0x7f52c80a8900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:31.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:31.708+0000 7f52ce3a6700 1 -- 172.21.15.72:0/172787674 shutdown_connections 2023-07-25T14:37:31.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:31.708+0000 7f52ce3a6700 1 -- 172.21.15.72:0/172787674 wait complete. 2023-07-25T14:37:31.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:31.709+0000 7f52ce3a6700 1 Processor -- start 2023-07-25T14:37:31.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:31.710+0000 7f52ce3a6700 1 -- start start 2023-07-25T14:37:31.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:31.710+0000 7f52ce3a6700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f52c806e580 0x7f52c8156e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:31.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:31.710+0000 7f52ce3a6700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f52c80c17f0 0x7f52c80bc7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:31.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:31.710+0000 7f52ce3a6700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f52c8151980 0x7f52c80bccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:31.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:31.710+0000 7f52ce3a6700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52c8152a60 con 0x7f52c80c17f0 2023-07-25T14:37:31.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:31.710+0000 7f52ce3a6700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52c81ecfc0 con 0x7f52c8151980 2023-07-25T14:37:31.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:31.710+0000 7f52ce3a6700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52c81ed260 con 0x7f52c806e580 2023-07-25T14:37:31.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:31.710+0000 7f52c77fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f52c80c17f0 0x7f52c80bc7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:31.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:31.710+0000 7f52c77fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f52c80c17f0 0x7f52c80bc7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43288/0 (socket says 172.21.15.72:43288) 2023-07-25T14:37:31.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:31.710+0000 7f52c77fe700 1 -- 172.21.15.72:0/560989691 learned_addr learned my addr 172.21.15.72:0/560989691 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:37:31.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:31.710+0000 7f52cc943700 1 --2- 172.21.15.72:0/560989691 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f52c8151980 0x7f52c80bccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:31.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:31.710+0000 7f52c7fff700 1 --2- 172.21.15.72:0/560989691 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f52c806e580 0x7f52c8156e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:31.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:31.711+0000 7f52c77fe700 1 -- 172.21.15.72:0/560989691 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f52c806e580 msgr2=0x7f52c8156e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:31.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:31.711+0000 7f52c77fe700 1 --2- 172.21.15.72:0/560989691 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f52c806e580 0x7f52c8156e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:31.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:31.711+0000 7f52c77fe700 1 -- 172.21.15.72:0/560989691 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f52c8151980 msgr2=0x7f52c80bccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:31.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:31.711+0000 7f52c77fe700 1 --2- 172.21.15.72:0/560989691 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f52c8151980 0x7f52c80bccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:31.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:31.711+0000 7f52c77fe700 1 -- 172.21.15.72:0/560989691 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52bc009500 con 0x7f52c80c17f0 2023-07-25T14:37:31.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:31.711+0000 7f52cc943700 1 --2- 172.21.15.72:0/560989691 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f52c8151980 0x7f52c80bccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-25T14:37:31.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:31.711+0000 7f52c77fe700 1 --2- 172.21.15.72:0/560989691 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f52c80c17f0 0x7f52c80bc7b0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f52b800c750 tx=0x7f52b800ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:31.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:31.711+0000 7f52c4ff9700 1 -- 172.21.15.72:0/560989691 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52b8011800 con 0x7f52c80c17f0 2023-07-25T14:37:31.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:31.711+0000 7f52c4ff9700 1 -- 172.21.15.72:0/560989691 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52b8011960 con 0x7f52c80c17f0 2023-07-25T14:37:31.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:31.711+0000 7f52ce3a6700 1 -- 172.21.15.72:0/560989691 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52c8153290 con 0x7f52c80c17f0 2023-07-25T14:37:31.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:31.711+0000 7f52c4ff9700 1 -- 172.21.15.72:0/560989691 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52b8011cd0 con 0x7f52c80c17f0 2023-07-25T14:37:31.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:31.711+0000 7f52ce3a6700 1 -- 172.21.15.72:0/560989691 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52c8153850 con 0x7f52c80c17f0 2023-07-25T14:37:31.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:31.712+0000 7f52ce3a6700 1 -- 172.21.15.72:0/560989691 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52c804e470 con 0x7f52c80c17f0 2023-07-25T14:37:31.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:31.713+0000 7f52c4ff9700 1 -- 172.21.15.72:0/560989691 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f52b8021350 con 0x7f52c80c17f0 2023-07-25T14:37:31.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:31.713+0000 7f52c4ff9700 1 --2- 172.21.15.72:0/560989691 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f52b406ad10 0x7f52b406d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:31.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:31.713+0000 7f52c4ff9700 1 -- 172.21.15.72:0/560989691 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6472+0+0 (secure 0 0 0) 0x7f52b80895c0 con 0x7f52c80c17f0 2023-07-25T14:37:31.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:31.713+0000 7f52c7fff700 1 --2- 172.21.15.72:0/560989691 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f52b406ad10 0x7f52b406d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:31.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:31.713+0000 7f52c7fff700 1 --2- 172.21.15.72:0/560989691 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f52b406ad10 0x7f52b406d1d0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f52c80a90a0 tx=0x7f52bc008070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:31.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:31.717+0000 7f52c4ff9700 1 -- 172.21.15.72:0/560989691 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f52b8057ed0 con 0x7f52c80c17f0 2023-07-25T14:37:31.960 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:31.950+0000 7f52ce3a6700 1 -- 172.21.15.72:0/560989691 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs2"} v 0) v1 -- 0x7f52c8157b20 con 0x7f52c80c17f0 2023-07-25T14:37:31.960 INFO:tasks.ceph.mon.a.smithi072.stderr:2023-07-25T14:37:31.950+0000 7f5fcfeea700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-07-25T14:37:31.964 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:31.954+0000 7f52c4ff9700 1 -- 172.21.15.72:0/560989691 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs2"}]=0 cephfs2 marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v25) v1 ==== 163+0+0 (secure 0 0 0) 0x7f52b8057a60 con 0x7f52c80c17f0 2023-07-25T14:37:31.965 INFO:tasks.ceph.mds.c.smithi072.stderr: -3216> 2023-07-25T14:37:08.039+0000 7f7c6aa45700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-25T14:37:31.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:31.957+0000 7f52ce3a6700 1 -- 172.21.15.72:0/560989691 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f52b406ad10 msgr2=0x7f52b406d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:31.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:31.957+0000 7f52ce3a6700 1 --2- 172.21.15.72:0/560989691 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f52b406ad10 0x7f52b406d1d0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f52c80a90a0 tx=0x7f52bc008070 comp rx=0 tx=0).stop 2023-07-25T14:37:31.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:31.957+0000 7f52ce3a6700 1 -- 172.21.15.72:0/560989691 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f52c80c17f0 msgr2=0x7f52c80bc7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:31.967 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:31.957+0000 7f52ce3a6700 1 --2- 172.21.15.72:0/560989691 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f52c80c17f0 0x7f52c80bc7b0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f52b800c750 tx=0x7f52b800ca60 comp rx=0 tx=0).stop 2023-07-25T14:37:31.968 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:31.957+0000 7f52ce3a6700 1 -- 172.21.15.72:0/560989691 shutdown_connections 2023-07-25T14:37:31.968 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:31.957+0000 7f52ce3a6700 1 --2- 172.21.15.72:0/560989691 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f52b406ad10 0x7f52b406d1d0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:31.968 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:31.957+0000 7f52ce3a6700 1 --2- 172.21.15.72:0/560989691 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f52c806e580 0x7f52c8156e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:31.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:31.957+0000 7f52ce3a6700 1 --2- 172.21.15.72:0/560989691 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f52c8151980 0x7f52c80bccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:31.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:31.957+0000 7f52ce3a6700 1 --2- 172.21.15.72:0/560989691 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f52c80c17f0 0x7f52c80bc7b0 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:31.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:31.957+0000 7f52ce3a6700 1 -- 172.21.15.72:0/560989691 >> 172.21.15.72:0/560989691 conn(0x7f52c80a8520 msgr2=0x7f52c806b8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:31.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:31.957+0000 7f52ce3a6700 1 -- 172.21.15.72:0/560989691 shutdown_connections 2023-07-25T14:37:31.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:31.957+0000 7f52ce3a6700 1 -- 172.21.15.72:0/560989691 wait complete. 2023-07-25T14:37:31.970 INFO:teuthology.orchestra.run.smithi072.stderr:cephfs2 marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-07-25T14:37:31.983 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs2 --yes-i-really-mean-it 2023-07-25T14:37:31.996 INFO:tasks.ceph.mds.c.smithi072.stdout:starting mds.c at 2023-07-25T14:37:32.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:32.096+0000 7f8823d25700 1 Processor -- start 2023-07-25T14:37:32.106 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:32.096+0000 7f8823d25700 1 -- start start 2023-07-25T14:37:32.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:32.097+0000 7f8823d25700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f881c151950 0x7f881c06a190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:32.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:32.097+0000 7f8823d25700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f881c0c2fe0 con 0x7f881c06a6d0 2023-07-25T14:37:32.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:32.097+0000 7f8823d25700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f881c155070 con 0x7f881c0724c0 2023-07-25T14:37:32.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:32.097+0000 7f8823d25700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f881c071a60 con 0x7f881c151950 2023-07-25T14:37:32.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:32.097+0000 7f8821ac1700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f881c151950 0x7f881c06a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:32.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:32.097+0000 7f88222c2700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f881c06a6d0 0x7f881c0c3bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:34042/0 (socket says 172.21.15.72:34042) 2023-07-25T14:37:32.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:32.097+0000 7f88222c2700 1 -- 172.21.15.72:0/3965798193 learned_addr learned my addr 172.21.15.72:0/3965798193 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:37:32.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:32.098+0000 7f8821ac1700 1 -- 172.21.15.72:0/3965798193 >> v1:172.21.15.92:6789/0 conn(0x7f881c0724c0 legacy=0x7f881c0c34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:32.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:32.098+0000 7f8821ac1700 1 -- 172.21.15.72:0/3965798193 >> v1:172.21.15.72:6789/0 conn(0x7f881c06a6d0 legacy=0x7f881c0c3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:32.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:32.098+0000 7f8821ac1700 1 -- 172.21.15.72:0/3965798193 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f881c0c15c0 con 0x7f881c151950 2023-07-25T14:37:32.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:32.098+0000 7f8820abf700 1 -- 172.21.15.72:0/3965798193 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3709087298 0 0) 0x7f881c0c2fe0 con 0x7f881c06a6d0 2023-07-25T14:37:32.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:32.098+0000 7f8821ac1700 1 --2- 172.21.15.72:0/3965798193 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f881c151950 0x7f881c06a190 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f8818009840 tx=0x7f8818009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b7f457833583332 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:32.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:32.098+0000 7f8820abf700 1 -- 172.21.15.72:0/3965798193 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8818011830 con 0x7f881c151950 2023-07-25T14:37:32.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:32.098+0000 7f8820abf700 1 -- 172.21.15.72:0/3965798193 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8818011990 con 0x7f881c151950 2023-07-25T14:37:32.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:32.098+0000 7f8820abf700 1 -- 172.21.15.72:0/3965798193 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8818011d20 con 0x7f881c151950 2023-07-25T14:37:32.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:32.098+0000 7f8823d25700 1 -- 172.21.15.72:0/3965798193 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f881c151950 msgr2=0x7f881c06a190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:32.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:32.098+0000 7f8823d25700 1 --2- 172.21.15.72:0/3965798193 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f881c151950 0x7f881c06a190 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f8818009840 tx=0x7f8818009b50 comp rx=0 tx=0).stop 2023-07-25T14:37:32.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:32.099+0000 7f8823d25700 1 -- 172.21.15.72:0/3965798193 shutdown_connections 2023-07-25T14:37:32.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:32.099+0000 7f8823d25700 1 --2- 172.21.15.72:0/3965798193 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f881c151950 0x7f881c06a190 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:32.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:32.099+0000 7f8823d25700 1 -- 172.21.15.72:0/3965798193 >> 172.21.15.72:0/3965798193 conn(0x7f881c0a87e0 msgr2=0x7f881c0a8bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:32.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:32.099+0000 7f8823d25700 1 -- 172.21.15.72:0/3965798193 shutdown_connections 2023-07-25T14:37:32.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:32.099+0000 7f8823d25700 1 -- 172.21.15.72:0/3965798193 wait complete. 2023-07-25T14:37:32.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:32.100+0000 7f8823d25700 1 Processor -- start 2023-07-25T14:37:32.112 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:32.100+0000 7f8823d25700 1 -- start start 2023-07-25T14:37:32.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:32.101+0000 7f8823d25700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f881c06a6d0 0x7f881c0abaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:32.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:32.101+0000 7f8823d25700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f881c0724c0 0x7f881c0abfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:32.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:32.101+0000 7f8823d25700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f881c151950 0x7f881c156540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:32.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:32.101+0000 7f8823d25700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f881c1559b0 con 0x7f881c151950 2023-07-25T14:37:32.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:32.101+0000 7f8823d25700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f881c1ec1b0 con 0x7f881c0724c0 2023-07-25T14:37:32.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:32.101+0000 7f8823d25700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f881c1eb2e0 con 0x7f881c06a6d0 2023-07-25T14:37:32.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:32.101+0000 7f88222c2700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f881c151950 0x7f881c156540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:32.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:32.101+0000 7f88222c2700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f881c151950 0x7f881c156540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43312/0 (socket says 172.21.15.72:43312) 2023-07-25T14:37:32.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:32.101+0000 7f88222c2700 1 -- 172.21.15.72:0/2395366826 learned_addr learned my addr 172.21.15.72:0/2395366826 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:37:32.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:32.101+0000 7f88212c0700 1 --2- 172.21.15.72:0/2395366826 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f881c0724c0 0x7f881c0abfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:32.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:32.101+0000 7f8821ac1700 1 --2- 172.21.15.72:0/2395366826 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f881c06a6d0 0x7f881c0abaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:32.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:32.101+0000 7f88222c2700 1 -- 172.21.15.72:0/2395366826 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f881c06a6d0 msgr2=0x7f881c0abaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:32.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:32.101+0000 7f88222c2700 1 --2- 172.21.15.72:0/2395366826 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f881c06a6d0 0x7f881c0abaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:32.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:32.101+0000 7f88222c2700 1 -- 172.21.15.72:0/2395366826 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f881c0724c0 msgr2=0x7f881c0abfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:32.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:32.101+0000 7f88222c2700 1 --2- 172.21.15.72:0/2395366826 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f881c0724c0 0x7f881c0abfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:32.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:32.101+0000 7f88222c2700 1 -- 172.21.15.72:0/2395366826 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88180094a0 con 0x7f881c151950 2023-07-25T14:37:32.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:32.102+0000 7f88222c2700 1 --2- 172.21.15.72:0/2395366826 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f881c151950 0x7f881c156540 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f8814002230 tx=0x7f881400cf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:32.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:32.102+0000 7f88127fc700 1 -- 172.21.15.72:0/2395366826 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f881400aac0 con 0x7f881c151950 2023-07-25T14:37:32.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:32.102+0000 7f88127fc700 1 -- 172.21.15.72:0/2395366826 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f881400ac40 con 0x7f881c151950 2023-07-25T14:37:32.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:32.102+0000 7f8823d25700 1 -- 172.21.15.72:0/2395366826 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f881c0c0de0 con 0x7f881c151950 2023-07-25T14:37:32.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:32.102+0000 7f88127fc700 1 -- 172.21.15.72:0/2395366826 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88140070d0 con 0x7f881c151950 2023-07-25T14:37:32.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:32.102+0000 7f8823d25700 1 -- 172.21.15.72:0/2395366826 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f881c1eb810 con 0x7f881c151950 2023-07-25T14:37:32.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:32.103+0000 7f8823d25700 1 -- 172.21.15.72:0/2395366826 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f881c1ec2f0 con 0x7f881c151950 2023-07-25T14:37:32.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:32.103+0000 7f88127fc700 1 -- 172.21.15.72:0/2395366826 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8814007250 con 0x7f881c151950 2023-07-25T14:37:32.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:32.104+0000 7f88127fc700 1 --2- 172.21.15.72:0/2395366826 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f880006ace0 0x7f880006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:32.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:32.104+0000 7f88127fc700 1 -- 172.21.15.72:0/2395366826 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6558+0+0 (secure 0 0 0) 0x7f8814089490 con 0x7f881c151950 2023-07-25T14:37:32.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:32.104+0000 7f8821ac1700 1 --2- 172.21.15.72:0/2395366826 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f880006ace0 0x7f880006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:32.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:32.104+0000 7f8821ac1700 1 --2- 172.21.15.72:0/2395366826 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f880006ace0 0x7f880006d1a0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f88180090b0 tx=0x7f881801c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:32.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:32.108+0000 7f88127fc700 1 -- 172.21.15.72:0/2395366826 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f881c1ec2f0 con 0x7f881c151950 2023-07-25T14:37:32.351 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:32.341+0000 7f8823d25700 1 -- 172.21.15.72:0/2395366826 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs2", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f881c1ec2f0 con 0x7f881c151950 2023-07-25T14:37:32.966 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:32.956+0000 7f88127fc700 1 -- 172.21.15.72:0/2395366826 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs2", "yes_i_really_mean_it": true}]=0 v26) v1 ==== 105+0+0 (secure 0 0 0) 0x7f881c1ec2f0 con 0x7f881c151950 2023-07-25T14:37:32.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:32.959+0000 7f8823d25700 1 -- 172.21.15.72:0/2395366826 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f880006ace0 msgr2=0x7f880006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:32.969 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:32.959+0000 7f8823d25700 1 --2- 172.21.15.72:0/2395366826 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f880006ace0 0x7f880006d1a0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f88180090b0 tx=0x7f881801c040 comp rx=0 tx=0).stop 2023-07-25T14:37:32.970 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:32.959+0000 7f8823d25700 1 -- 172.21.15.72:0/2395366826 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f881c151950 msgr2=0x7f881c156540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:32.970 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:32.959+0000 7f8823d25700 1 --2- 172.21.15.72:0/2395366826 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f881c151950 0x7f881c156540 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f8814002230 tx=0x7f881400cf50 comp rx=0 tx=0).stop 2023-07-25T14:37:32.970 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:32.959+0000 7f8823d25700 1 -- 172.21.15.72:0/2395366826 shutdown_connections 2023-07-25T14:37:32.970 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:32.959+0000 7f8823d25700 1 --2- 172.21.15.72:0/2395366826 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f880006ace0 0x7f880006d1a0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:32.970 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:32.959+0000 7f8823d25700 1 --2- 172.21.15.72:0/2395366826 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f881c06a6d0 0x7f881c0abaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:32.970 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:32.959+0000 7f8823d25700 1 --2- 172.21.15.72:0/2395366826 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f881c151950 0x7f881c156540 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:32.970 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:32.959+0000 7f8823d25700 1 --2- 172.21.15.72:0/2395366826 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f881c0724c0 0x7f881c0abfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:32.971 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:32.959+0000 7f8823d25700 1 -- 172.21.15.72:0/2395366826 >> 172.21.15.72:0/2395366826 conn(0x7f881c0a87e0 msgr2=0x7f881c153840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:32.971 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:32.959+0000 7f8823d25700 1 -- 172.21.15.72:0/2395366826 shutdown_connections 2023-07-25T14:37:32.971 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:32.959+0000 7f8823d25700 1 -- 172.21.15.72:0/2395366826 wait complete. 2023-07-25T14:37:32.984 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs2_metadata cephfs2_metadata --yes-i-really-really-mean-it 2023-07-25T14:37:33.155 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:33.145+0000 7fb2881c1700 1 Processor -- start 2023-07-25T14:37:33.156 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:33.145+0000 7fb2881c1700 1 -- start start 2023-07-25T14:37:33.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:33.146+0000 7fb2881c1700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb2800c5b90 0x7fb2800c6d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:33.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:33.146+0000 7fb2881c1700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb2800c5f70 0x7fb280154c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:33.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:33.146+0000 7fb2881c1700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2800c5250 con 0x7fb2800c49d0 2023-07-25T14:37:33.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:33.146+0000 7fb2881c1700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2800c5530 con 0x7fb2800c5f70 2023-07-25T14:37:33.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:33.146+0000 7fb2881c1700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2800c6520 con 0x7fb2800c5b90 2023-07-25T14:37:33.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:33.146+0000 7fb28575c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fb2800c49d0 0x7fb28006db00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:34056/0 (socket says 172.21.15.72:34056) 2023-07-25T14:37:33.163 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:33.146+0000 7fb28675e700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb2800c5f70 0x7fb280154c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:33.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:33.146+0000 7fb28575c700 1 -- 172.21.15.72:0/952515225 learned_addr learned my addr 172.21.15.72:0/952515225 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:37:33.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:33.146+0000 7fb285f5d700 1 --2- 172.21.15.72:0/952515225 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb2800c5b90 0x7fb2800c6d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:33.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:33.146+0000 7fb28675e700 1 -- 172.21.15.72:0/952515225 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb2800c5b90 msgr2=0x7fb2800c6d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:33.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:33.146+0000 7fb28675e700 1 --2- 172.21.15.72:0/952515225 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb2800c5b90 0x7fb2800c6d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:33.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:33.146+0000 7fb28675e700 1 -- 172.21.15.72:0/952515225 >> v1:172.21.15.72:6789/0 conn(0x7fb2800c49d0 legacy=0x7fb28006db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:33.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:33.146+0000 7fb28675e700 1 -- 172.21.15.72:0/952515225 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2800c6800 con 0x7fb2800c5f70 2023-07-25T14:37:33.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:33.146+0000 7fb284f5b700 1 -- 172.21.15.72:0/952515225 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2481498446 0 0) 0x7fb2800c5250 con 0x7fb2800c49d0 2023-07-25T14:37:33.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:33.147+0000 7fb28675e700 1 --2- 172.21.15.72:0/952515225 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb2800c5f70 0x7fb280154c70 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7fb278009d90 tx=0x7fb27800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=972ab0de8ade764 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:33.166 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:33.147+0000 7fb284f5b700 1 -- 172.21.15.72:0/952515225 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb27800e070 con 0x7fb2800c5f70 2023-07-25T14:37:33.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:33.147+0000 7fb284f5b700 1 -- 172.21.15.72:0/952515225 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb27800bbd0 con 0x7fb2800c5f70 2023-07-25T14:37:33.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:33.147+0000 7fb284f5b700 1 -- 172.21.15.72:0/952515225 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb278012430 con 0x7fb2800c5f70 2023-07-25T14:37:33.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:33.147+0000 7fb2881c1700 1 -- 172.21.15.72:0/952515225 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb2800c5f70 msgr2=0x7fb280154c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:33.167 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:33.147+0000 7fb2881c1700 1 --2- 172.21.15.72:0/952515225 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb2800c5f70 0x7fb280154c70 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7fb278009d90 tx=0x7fb27800b330 comp rx=0 tx=0).stop 2023-07-25T14:37:33.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:33.147+0000 7fb2881c1700 1 -- 172.21.15.72:0/952515225 shutdown_connections 2023-07-25T14:37:33.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:33.147+0000 7fb2881c1700 1 --2- 172.21.15.72:0/952515225 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb2800c5f70 0x7fb280154c70 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:33.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:33.147+0000 7fb2881c1700 1 --2- 172.21.15.72:0/952515225 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb2800c5b90 0x7fb2800c6d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:33.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:33.147+0000 7fb2881c1700 1 -- 172.21.15.72:0/952515225 >> 172.21.15.72:0/952515225 conn(0x7fb28006bbc0 msgr2=0x7fb2800a8590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:33.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:33.147+0000 7fb2881c1700 1 -- 172.21.15.72:0/952515225 shutdown_connections 2023-07-25T14:37:33.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:33.147+0000 7fb2881c1700 1 -- 172.21.15.72:0/952515225 wait complete. 2023-07-25T14:37:33.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:33.148+0000 7fb2881c1700 1 Processor -- start 2023-07-25T14:37:33.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:33.148+0000 7fb2881c1700 1 -- start start 2023-07-25T14:37:33.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:33.149+0000 7fb2881c1700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb2800c49d0 0x7fb2801ea8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:33.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:33.149+0000 7fb2881c1700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb2800c5b90 0x7fb2801e9e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:33.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:33.149+0000 7fb2881c1700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb2800c5f70 0x7fb2800a78d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:33.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:33.149+0000 7fb2881c1700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2801eae20 con 0x7fb2800c49d0 2023-07-25T14:37:33.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:33.149+0000 7fb2881c1700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2801ea380 con 0x7fb2800c5f70 2023-07-25T14:37:33.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:33.149+0000 7fb2881c1700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2800bce40 con 0x7fb2800c5b90 2023-07-25T14:37:33.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:33.149+0000 7fb285f5d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb2800c49d0 0x7fb2801ea8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:33.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:33.149+0000 7fb285f5d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb2800c49d0 0x7fb2801ea8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43324/0 (socket says 172.21.15.72:43324) 2023-07-25T14:37:33.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:33.149+0000 7fb285f5d700 1 -- 172.21.15.72:0/2609157419 learned_addr learned my addr 172.21.15.72:0/2609157419 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:37:33.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:33.149+0000 7fb28575c700 1 --2- 172.21.15.72:0/2609157419 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb2800c5b90 0x7fb2801e9e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:33.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:33.149+0000 7fb28675e700 1 --2- 172.21.15.72:0/2609157419 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb2800c5f70 0x7fb2800a78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:33.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:33.150+0000 7fb285f5d700 1 -- 172.21.15.72:0/2609157419 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb2800c5b90 msgr2=0x7fb2801e9e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:33.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:33.150+0000 7fb285f5d700 1 --2- 172.21.15.72:0/2609157419 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb2800c5b90 0x7fb2801e9e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:33.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:33.150+0000 7fb285f5d700 1 -- 172.21.15.72:0/2609157419 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb2800c5f70 msgr2=0x7fb2800a78d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:33.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:33.150+0000 7fb285f5d700 1 --2- 172.21.15.72:0/2609157419 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb2800c5f70 0x7fb2800a78d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:33.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:33.150+0000 7fb285f5d700 1 -- 172.21.15.72:0/2609157419 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb278009a70 con 0x7fb2800c49d0 2023-07-25T14:37:33.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:33.150+0000 7fb285f5d700 1 --2- 172.21.15.72:0/2609157419 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb2800c49d0 0x7fb2801ea8e0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fb27000e810 tx=0x7fb27000ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:33.172 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:33.150+0000 7fb2767fc700 1 -- 172.21.15.72:0/2609157419 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb270013610 con 0x7fb2800c49d0 2023-07-25T14:37:33.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:33.150+0000 7fb2767fc700 1 -- 172.21.15.72:0/2609157419 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb270013770 con 0x7fb2800c49d0 2023-07-25T14:37:33.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:33.150+0000 7fb2881c1700 1 -- 172.21.15.72:0/2609157419 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2800bd120 con 0x7fb2800c49d0 2023-07-25T14:37:33.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:33.150+0000 7fb2767fc700 1 -- 172.21.15.72:0/2609157419 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb270013b20 con 0x7fb2800c49d0 2023-07-25T14:37:33.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:33.150+0000 7fb2881c1700 1 -- 172.21.15.72:0/2609157419 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2801ecb80 con 0x7fb2800c49d0 2023-07-25T14:37:33.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:33.151+0000 7fb2881c1700 1 -- 172.21.15.72:0/2609157419 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2800bd640 con 0x7fb2800c49d0 2023-07-25T14:37:33.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:33.151+0000 7fb2767fc700 1 -- 172.21.15.72:0/2609157419 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb270013c80 con 0x7fb2800c49d0 2023-07-25T14:37:33.173 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:33.152+0000 7fb2767fc700 1 --2- 172.21.15.72:0/2609157419 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fb26406ace0 0x7fb26406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:33.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:33.152+0000 7fb2767fc700 1 -- 172.21.15.72:0/2609157419 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6558+0+0 (secure 0 0 0) 0x7fb2700893c0 con 0x7fb2800c49d0 2023-07-25T14:37:33.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:33.152+0000 7fb28575c700 1 --2- 172.21.15.72:0/2609157419 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fb26406ace0 0x7fb26406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:33.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:33.152+0000 7fb28575c700 1 --2- 172.21.15.72:0/2609157419 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fb26406ace0 0x7fb26406d1a0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fb2800a8420 tx=0x7fb27c007be0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:33.174 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:33.156+0000 7fb2767fc700 1 -- 172.21.15.72:0/2609157419 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fb2800bd640 con 0x7fb2800c49d0 2023-07-25T14:37:33.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:33.342+0000 7fb2881c1700 1 -- 172.21.15.72:0/2609157419 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs2_metadata", "pool2": "cephfs2_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fb2801ec9e0 con 0x7fb2800c49d0 2023-07-25T14:37:34.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:34.100+0000 7fb2767fc700 1 -- 172.21.15.72:0/2609157419 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs2_metadata", "pool2": "cephfs2_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs2_metadata' removed v48) v1 ==== 184+0+0 (secure 0 0 0) 0x7fb2801ec9e0 con 0x7fb2800c49d0 2023-07-25T14:37:34.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:34.103+0000 7fb2881c1700 1 -- 172.21.15.72:0/2609157419 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fb26406ace0 msgr2=0x7fb26406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:34.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:34.103+0000 7fb2881c1700 1 --2- 172.21.15.72:0/2609157419 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fb26406ace0 0x7fb26406d1a0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fb2800a8420 tx=0x7fb27c007be0 comp rx=0 tx=0).stop 2023-07-25T14:37:34.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:34.103+0000 7fb2881c1700 1 -- 172.21.15.72:0/2609157419 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb2800c49d0 msgr2=0x7fb2801ea8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:34.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:34.103+0000 7fb2881c1700 1 --2- 172.21.15.72:0/2609157419 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb2800c49d0 0x7fb2801ea8e0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fb27000e810 tx=0x7fb27000ebd0 comp rx=0 tx=0).stop 2023-07-25T14:37:34.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:34.104+0000 7fb2881c1700 1 -- 172.21.15.72:0/2609157419 shutdown_connections 2023-07-25T14:37:34.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:34.104+0000 7fb2881c1700 1 --2- 172.21.15.72:0/2609157419 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fb26406ace0 0x7fb26406d1a0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:34.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:34.104+0000 7fb2881c1700 1 --2- 172.21.15.72:0/2609157419 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb2800c5f70 0x7fb2800a78d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:34.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:34.104+0000 7fb2881c1700 1 --2- 172.21.15.72:0/2609157419 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb2800c49d0 0x7fb2801ea8e0 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:34.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:34.104+0000 7fb2881c1700 1 --2- 172.21.15.72:0/2609157419 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb2800c5b90 0x7fb2801e9e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:34.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:34.104+0000 7fb2881c1700 1 -- 172.21.15.72:0/2609157419 >> 172.21.15.72:0/2609157419 conn(0x7fb28006bbc0 msgr2=0x7fb280153ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:34.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:34.104+0000 7fb2881c1700 1 -- 172.21.15.72:0/2609157419 shutdown_connections 2023-07-25T14:37:34.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:34.104+0000 7fb2881c1700 1 -- 172.21.15.72:0/2609157419 wait complete. 2023-07-25T14:37:34.116 INFO:teuthology.orchestra.run.smithi072.stderr:pool 'cephfs2_metadata' removed 2023-07-25T14:37:34.129 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs2_data cephfs2_data --yes-i-really-really-mean-it 2023-07-25T14:37:34.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:34.246+0000 7f308e8b6700 1 Processor -- start 2023-07-25T14:37:34.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:34.246+0000 7f308e8b6700 1 -- start start 2023-07-25T14:37:34.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:34.247+0000 7f308e8b6700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f30880c5f70 0x7f30880c6d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:34.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:34.247+0000 7f308e8b6700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30880c5250 con 0x7f30880c5b90 2023-07-25T14:37:34.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:34.247+0000 7f308e8b6700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30880c5530 con 0x7f30880c49d0 2023-07-25T14:37:34.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:34.247+0000 7f308e8b6700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30880c6520 con 0x7f30880c5f70 2023-07-25T14:37:34.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:34.247+0000 7f308ce53700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f30880c5f70 0x7f30880c6d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:34.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:34.247+0000 7f3087fff700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f30880c5b90 0x7f308806db00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:34068/0 (socket says 172.21.15.72:34068) 2023-07-25T14:37:34.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:34.247+0000 7f3087fff700 1 -- 172.21.15.72:0/692660583 learned_addr learned my addr 172.21.15.72:0/692660583 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:37:34.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:34.247+0000 7f308ce53700 1 --2- 172.21.15.72:0/692660583 >> v2:172.21.15.72:3300/0 conn(0x7f30880c5f70 0x7f30880c6d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43336/0 (socket says 172.21.15.72:43336) 2023-07-25T14:37:34.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:34.247+0000 7f308ce53700 1 -- 172.21.15.72:0/692660583 >> v1:172.21.15.92:6789/0 conn(0x7f30880c49d0 legacy=0x7f3088154c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:34.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:34.247+0000 7f308ce53700 1 -- 172.21.15.72:0/692660583 >> v1:172.21.15.72:6789/0 conn(0x7f30880c5b90 legacy=0x7f308806db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:34.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:34.247+0000 7f3086ffd700 1 -- 172.21.15.72:0/692660583 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4094779687 0 0) 0x7f30880c5250 con 0x7f30880c5b90 2023-07-25T14:37:34.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:34.247+0000 7f308ce53700 1 -- 172.21.15.72:0/692660583 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30880c6800 con 0x7f30880c5f70 2023-07-25T14:37:34.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:34.247+0000 7f308ce53700 1 --2- 172.21.15.72:0/692660583 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f30880c5f70 0x7f30880c6d20 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f3080009d90 tx=0x7f308000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a7abf64f76e6c32 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:34.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:34.248+0000 7f3086ffd700 1 -- 172.21.15.72:0/692660583 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f308000e070 con 0x7f30880c5f70 2023-07-25T14:37:34.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:34.248+0000 7f3086ffd700 1 -- 172.21.15.72:0/692660583 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f308000bb90 con 0x7f30880c5f70 2023-07-25T14:37:34.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:34.248+0000 7f3086ffd700 1 -- 172.21.15.72:0/692660583 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3080003a20 con 0x7f30880c5f70 2023-07-25T14:37:34.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:34.248+0000 7f308e8b6700 1 -- 172.21.15.72:0/692660583 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f30880c5f70 msgr2=0x7f30880c6d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:34.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:34.248+0000 7f308e8b6700 1 --2- 172.21.15.72:0/692660583 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f30880c5f70 0x7f30880c6d20 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f3080009d90 tx=0x7f308000b330 comp rx=0 tx=0).stop 2023-07-25T14:37:34.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:34.248+0000 7f308e8b6700 1 -- 172.21.15.72:0/692660583 shutdown_connections 2023-07-25T14:37:34.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:34.248+0000 7f308e8b6700 1 --2- 172.21.15.72:0/692660583 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f30880c5f70 0x7f30880c6d20 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:34.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:34.248+0000 7f308e8b6700 1 -- 172.21.15.72:0/692660583 >> 172.21.15.72:0/692660583 conn(0x7f308806bbc0 msgr2=0x7f30880a8590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:34.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:34.248+0000 7f308e8b6700 1 -- 172.21.15.72:0/692660583 shutdown_connections 2023-07-25T14:37:34.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:34.248+0000 7f308e8b6700 1 -- 172.21.15.72:0/692660583 wait complete. 2023-07-25T14:37:34.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:34.249+0000 7f308e8b6700 1 Processor -- start 2023-07-25T14:37:34.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:34.249+0000 7f308e8b6700 1 -- start start 2023-07-25T14:37:34.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:34.250+0000 7f308e8b6700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f30880c49d0 0x7f30880a76c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:34.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:34.250+0000 7f308e8b6700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f30880c5b90 0x7f308814eea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:34.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:34.250+0000 7f308e8b6700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f30880c5f70 0x7f308814f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:34.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:34.250+0000 7f308e8b6700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30881eaa50 con 0x7f30880c5b90 2023-07-25T14:37:34.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:34.250+0000 7f308e8b6700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3088099fc0 con 0x7f30880c49d0 2023-07-25T14:37:34.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:34.250+0000 7f308e8b6700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30880bf160 con 0x7f30880c5f70 2023-07-25T14:37:34.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:34.250+0000 7f30877fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f30880c5b90 0x7f308814eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:34.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:34.250+0000 7f30877fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f30880c5b90 0x7f308814eea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43340/0 (socket says 172.21.15.72:43340) 2023-07-25T14:37:34.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:34.250+0000 7f30877fe700 1 -- 172.21.15.72:0/357868206 learned_addr learned my addr 172.21.15.72:0/357868206 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:37:34.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:34.250+0000 7f3087fff700 1 --2- 172.21.15.72:0/357868206 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f30880c49d0 0x7f30880a76c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:34.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:34.250+0000 7f308ce53700 1 --2- 172.21.15.72:0/357868206 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f30880c5f70 0x7f308814f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:34.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:34.250+0000 7f30877fe700 1 -- 172.21.15.72:0/357868206 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f30880c5f70 msgr2=0x7f308814f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:34.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:34.250+0000 7f30877fe700 1 --2- 172.21.15.72:0/357868206 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f30880c5f70 0x7f308814f3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:34.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:34.251+0000 7f30877fe700 1 -- 172.21.15.72:0/357868206 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f30880c49d0 msgr2=0x7f30880a76c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:34.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:34.251+0000 7f30877fe700 1 --2- 172.21.15.72:0/357868206 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f30880c49d0 0x7f30880a76c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:34.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:34.251+0000 7f30877fe700 1 -- 172.21.15.72:0/357868206 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3080009a70 con 0x7f30880c5b90 2023-07-25T14:37:34.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:34.251+0000 7f3087fff700 1 --2- 172.21.15.72:0/357868206 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f30880c49d0 0x7f30880a76c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-25T14:37:34.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:34.251+0000 7f30877fe700 1 --2- 172.21.15.72:0/357868206 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f30880c5b90 0x7f308814eea0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f307800b450 tx=0x7f307800b810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:34.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:34.251+0000 7f3084ff9700 1 -- 172.21.15.72:0/357868206 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3078011830 con 0x7f30880c5b90 2023-07-25T14:37:34.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:34.251+0000 7f3084ff9700 1 -- 172.21.15.72:0/357868206 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3078011990 con 0x7f30880c5b90 2023-07-25T14:37:34.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:34.251+0000 7f3084ff9700 1 -- 172.21.15.72:0/357868206 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3078011d20 con 0x7f30880c5b90 2023-07-25T14:37:34.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:34.251+0000 7f308e8b6700 1 -- 172.21.15.72:0/357868206 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30881e8340 con 0x7f30880c5b90 2023-07-25T14:37:34.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:34.251+0000 7f308e8b6700 1 -- 172.21.15.72:0/357868206 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30880be3b0 con 0x7f30880c5b90 2023-07-25T14:37:34.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:34.252+0000 7f308e8b6700 1 -- 172.21.15.72:0/357868206 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30881eab90 con 0x7f30880c5b90 2023-07-25T14:37:34.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:34.252+0000 7f3084ff9700 1 -- 172.21.15.72:0/357868206 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f307801a400 con 0x7f30880c5b90 2023-07-25T14:37:34.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:34.253+0000 7f3084ff9700 1 --2- 172.21.15.72:0/357868206 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f307406ace0 0x7f307406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:34.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:34.253+0000 7f3084ff9700 1 -- 172.21.15.72:0/357868206 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6118+0+0 (secure 0 0 0) 0x7f3078089530 con 0x7f30880c5b90 2023-07-25T14:37:34.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:34.253+0000 7f3087fff700 1 --2- 172.21.15.72:0/357868206 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f307406ace0 0x7f307406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:34.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:34.253+0000 7f3087fff700 1 --2- 172.21.15.72:0/357868206 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f307406ace0 0x7f307406d1a0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f307c000f60 tx=0x7f307c007ca0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:34.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:34.257+0000 7f3084ff9700 1 -- 172.21.15.72:0/357868206 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f30881eab90 con 0x7f30880c5b90 2023-07-25T14:37:34.462 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:34.452+0000 7f308e8b6700 1 -- 172.21.15.72:0/357868206 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs2_data", "pool2": "cephfs2_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f30881eab90 con 0x7f30880c5b90 2023-07-25T14:37:35.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:35.107+0000 7f3084ff9700 1 -- 172.21.15.72:0/357868206 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs2_data", "pool2": "cephfs2_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs2_data' removed v49) v1 ==== 172+0+0 (secure 0 0 0) 0x7f30881eab90 con 0x7f30880c5b90 2023-07-25T14:37:35.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:35.111+0000 7f308e8b6700 1 -- 172.21.15.72:0/357868206 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f307406ace0 msgr2=0x7f307406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:35.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:35.111+0000 7f308e8b6700 1 --2- 172.21.15.72:0/357868206 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f307406ace0 0x7f307406d1a0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f307c000f60 tx=0x7f307c007ca0 comp rx=0 tx=0).stop 2023-07-25T14:37:35.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:35.111+0000 7f308e8b6700 1 -- 172.21.15.72:0/357868206 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f30880c5b90 msgr2=0x7f308814eea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:35.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:35.111+0000 7f308e8b6700 1 --2- 172.21.15.72:0/357868206 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f30880c5b90 0x7f308814eea0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f307800b450 tx=0x7f307800b810 comp rx=0 tx=0).stop 2023-07-25T14:37:35.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:35.111+0000 7f308e8b6700 1 -- 172.21.15.72:0/357868206 shutdown_connections 2023-07-25T14:37:35.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:35.111+0000 7f308e8b6700 1 --2- 172.21.15.72:0/357868206 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f307406ace0 0x7f307406d1a0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:35.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:35.111+0000 7f308e8b6700 1 --2- 172.21.15.72:0/357868206 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f30880c5f70 0x7f308814f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:35.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:35.111+0000 7f308e8b6700 1 --2- 172.21.15.72:0/357868206 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f30880c49d0 0x7f30880a76c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:35.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:35.111+0000 7f308e8b6700 1 --2- 172.21.15.72:0/357868206 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f30880c5b90 0x7f308814eea0 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:35.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:35.111+0000 7f308e8b6700 1 -- 172.21.15.72:0/357868206 >> 172.21.15.72:0/357868206 conn(0x7f308806bbc0 msgr2=0x7f3088154170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:35.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:35.111+0000 7f308e8b6700 1 -- 172.21.15.72:0/357868206 shutdown_connections 2023-07-25T14:37:35.123 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:35.111+0000 7f308e8b6700 1 -- 172.21.15.72:0/357868206 wait complete. 2023-07-25T14:37:35.125 INFO:teuthology.orchestra.run.smithi072.stderr:pool 'cephfs2_data' removed 2023-07-25T14:37:35.140 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-07-25T14:37:35.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:35.254+0000 7fc18eed9700 1 Processor -- start 2023-07-25T14:37:35.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:35.254+0000 7fc18eed9700 1 -- start start 2023-07-25T14:37:35.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:35.255+0000 7fc18eed9700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fc1880724c0 0x7fc1880c34c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:35.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:35.255+0000 7fc18eed9700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1880c2fe0 con 0x7fc1880c4930 2023-07-25T14:37:35.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:35.255+0000 7fc18eed9700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc188155070 con 0x7fc188151950 2023-07-25T14:37:35.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:35.255+0000 7fc18eed9700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc188071a60 con 0x7fc1880724c0 2023-07-25T14:37:35.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:35.255+0000 7fc18d476700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fc1880c4930 0x7fc1880c3a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:34086/0 (socket says 172.21.15.72:34086) 2023-07-25T14:37:35.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:35.255+0000 7fc18d476700 1 -- 172.21.15.72:0/1228692094 learned_addr learned my addr 172.21.15.72:0/1228692094 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:37:35.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:35.255+0000 7fc187fff700 1 --2- 172.21.15.72:0/1228692094 >> v2:172.21.15.92:3300/0 conn(0x7fc1880724c0 0x7fc1880c34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:35.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:35.255+0000 7fc1877fe700 1 -- 172.21.15.72:0/1228692094 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2674150284 0 0) 0x7fc1880c2fe0 con 0x7fc1880c4930 2023-07-25T14:37:35.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:35.255+0000 7fc1877fe700 1 -- 172.21.15.72:0/1228692094 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc1780035b0 con 0x7fc1880c4930 2023-07-25T14:37:35.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:35.256+0000 7fc1877fe700 1 -- 172.21.15.72:0/1228692094 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3516107241 0 0) 0x7fc1780035b0 con 0x7fc1880c4930 2023-07-25T14:37:35.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:35.256+0000 7fc1877fe700 1 -- 172.21.15.72:0/1228692094 >> v2:172.21.15.92:3300/0 conn(0x7fc1880724c0 msgr2=0x7fc1880c34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:35.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:35.256+0000 7fc1877fe700 1 --2- 172.21.15.72:0/1228692094 >> v2:172.21.15.92:3300/0 conn(0x7fc1880724c0 0x7fc1880c34c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:35.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:35.256+0000 7fc1877fe700 1 -- 172.21.15.72:0/1228692094 >> v1:172.21.15.92:6789/0 conn(0x7fc188151950 legacy=0x7fc18806a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:35.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:35.256+0000 7fc1877fe700 1 -- 172.21.15.72:0/1228692094 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1880c15c0 con 0x7fc1880c4930 2023-07-25T14:37:35.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:35.256+0000 7fc1877fe700 1 -- 172.21.15.72:0/1228692094 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2559588315 0 0) 0x7fc1800019f0 con 0x7fc1880c4930 2023-07-25T14:37:35.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:35.256+0000 7fc1877fe700 1 -- 172.21.15.72:0/1228692094 >> v1:172.21.15.72:6789/0 conn(0x7fc1880c4930 legacy=0x7fc1880c3a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:35.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:35.256+0000 7fc1877fe700 1 --2- 172.21.15.72:0/1228692094 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc178003a00 0x7fc178003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:35.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:35.256+0000 7fc1877fe700 1 --2- 172.21.15.72:0/1228692094 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc178004850 0x7fc178004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:35.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:35.256+0000 7fc1877fe700 1 --2- 172.21.15.72:0/1228692094 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc178005210 0x7fc17800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:35.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:35.256+0000 7fc1877fe700 1 -- 172.21.15.72:0/1228692094 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc188071a60 con 0x7fc178004850 2023-07-25T14:37:35.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:35.256+0000 7fc1877fe700 1 -- 172.21.15.72:0/1228692094 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc17800c1b0 con 0x7fc178005210 2023-07-25T14:37:35.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:35.256+0000 7fc1877fe700 1 -- 172.21.15.72:0/1228692094 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc17800c370 con 0x7fc178003a00 2023-07-25T14:37:35.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:35.256+0000 7fc187fff700 1 --2- 172.21.15.72:0/1228692094 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc178004850 0x7fc178004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:35.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:35.256+0000 7fc18d476700 1 --2- 172.21.15.72:0/1228692094 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc178005210 0x7fc17800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:35.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:35.256+0000 7fc18cc75700 1 --2- 172.21.15.72:0/1228692094 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc178003a00 0x7fc178003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:35.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:35.256+0000 7fc187fff700 1 -- 172.21.15.72:0/1228692094 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc178003a00 msgr2=0x7fc178003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:35.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:35.256+0000 7fc187fff700 1 --2- 172.21.15.72:0/1228692094 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc178003a00 0x7fc178003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:35.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:35.256+0000 7fc187fff700 1 -- 172.21.15.72:0/1228692094 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc178005210 msgr2=0x7fc17800ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:35.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:35.256+0000 7fc187fff700 1 --2- 172.21.15.72:0/1228692094 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc178005210 0x7fc17800ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:35.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:35.256+0000 7fc187fff700 1 -- 172.21.15.72:0/1228692094 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1780035b0 con 0x7fc178004850 2023-07-25T14:37:35.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:35.256+0000 7fc18d476700 1 --2- 172.21.15.72:0/1228692094 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc178005210 0x7fc17800ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-25T14:37:35.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:35.256+0000 7fc18d476700 1 -- 172.21.15.72:0/1228692094 reap_dead start 2023-07-25T14:37:35.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:35.256+0000 7fc187fff700 1 --2- 172.21.15.72:0/1228692094 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc178004850 0x7fc178004cd0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fc174009b60 tx=0x7fc178005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eee8b800a57138d7 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:35.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:35.256+0000 7fc1877fe700 1 -- 172.21.15.72:0/1228692094 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc17400e6c0 con 0x7fc178004850 2023-07-25T14:37:35.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:35.256+0000 7fc1877fe700 1 -- 172.21.15.72:0/1228692094 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc17400e820 con 0x7fc178004850 2023-07-25T14:37:35.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:35.256+0000 7fc1877fe700 1 -- 172.21.15.72:0/1228692094 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc17400eb90 con 0x7fc178004850 2023-07-25T14:37:35.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:35.257+0000 7fc18eed9700 1 -- 172.21.15.72:0/1228692094 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc178004850 msgr2=0x7fc178004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:35.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:35.257+0000 7fc18eed9700 1 --2- 172.21.15.72:0/1228692094 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc178004850 0x7fc178004cd0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fc174009b60 tx=0x7fc178005880 comp rx=0 tx=0).stop 2023-07-25T14:37:35.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:35.257+0000 7fc18eed9700 1 -- 172.21.15.72:0/1228692094 shutdown_connections 2023-07-25T14:37:35.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:35.257+0000 7fc18eed9700 1 --2- 172.21.15.72:0/1228692094 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc178004850 0x7fc178004cd0 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:35.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:35.257+0000 7fc18eed9700 1 -- 172.21.15.72:0/1228692094 >> 172.21.15.72:0/1228692094 conn(0x7fc1880a87e0 msgr2=0x7fc1880a8bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:35.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:35.257+0000 7fc18eed9700 1 -- 172.21.15.72:0/1228692094 shutdown_connections 2023-07-25T14:37:35.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:35.257+0000 7fc18eed9700 1 -- 172.21.15.72:0/1228692094 wait complete. 2023-07-25T14:37:35.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:35.258+0000 7fc18eed9700 1 Processor -- start 2023-07-25T14:37:35.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:35.258+0000 7fc18eed9700 1 -- start start 2023-07-25T14:37:35.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:35.259+0000 7fc18eed9700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc178004850 0x7fc1881e9460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:35.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:35.259+0000 7fc18eed9700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc188153d20 0x7fc188153390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:35.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:35.259+0000 7fc18eed9700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc1880abbf0 0x7fc1880ac070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:35.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:35.259+0000 7fc18eed9700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1880ab760 con 0x7fc178004850 2023-07-25T14:37:35.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:35.259+0000 7fc18eed9700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1880ac5b0 con 0x7fc188153d20 2023-07-25T14:37:35.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:35.259+0000 7fc18eed9700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1881e9ab0 con 0x7fc1880abbf0 2023-07-25T14:37:35.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:35.259+0000 7fc18cc75700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc178004850 0x7fc1881e9460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:35.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:35.259+0000 7fc18cc75700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc178004850 0x7fc1881e9460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43358/0 (socket says 172.21.15.72:43358) 2023-07-25T14:37:35.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:35.259+0000 7fc18cc75700 1 -- 172.21.15.72:0/2644154139 learned_addr learned my addr 172.21.15.72:0/2644154139 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:37:35.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:35.259+0000 7fc187fff700 1 --2- 172.21.15.72:0/2644154139 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc188153d20 0x7fc188153390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:35.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:35.259+0000 7fc18d476700 1 --2- 172.21.15.72:0/2644154139 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc1880abbf0 0x7fc1880ac070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:35.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:35.259+0000 7fc18cc75700 1 -- 172.21.15.72:0/2644154139 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc1880abbf0 msgr2=0x7fc1880ac070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:35.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:35.259+0000 7fc18cc75700 1 --2- 172.21.15.72:0/2644154139 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc1880abbf0 0x7fc1880ac070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:35.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:35.259+0000 7fc18cc75700 1 -- 172.21.15.72:0/2644154139 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc188153d20 msgr2=0x7fc188153390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:35.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:35.259+0000 7fc18cc75700 1 --2- 172.21.15.72:0/2644154139 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc188153d20 0x7fc188153390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:35.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:35.259+0000 7fc18cc75700 1 -- 172.21.15.72:0/2644154139 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1881e9d90 con 0x7fc178004850 2023-07-25T14:37:35.281 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:35.260+0000 7fc18cc75700 1 --2- 172.21.15.72:0/2644154139 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc178004850 0x7fc1881e9460 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fc17c00e5a0 tx=0x7fc17c00e8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:35.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:35.260+0000 7fc1857fa700 1 -- 172.21.15.72:0/2644154139 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc17c0052e0 con 0x7fc178004850 2023-07-25T14:37:35.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:35.260+0000 7fc1857fa700 1 -- 172.21.15.72:0/2644154139 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc17c005440 con 0x7fc178004850 2023-07-25T14:37:35.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:35.260+0000 7fc18eed9700 1 -- 172.21.15.72:0/2644154139 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1881ea070 con 0x7fc178004850 2023-07-25T14:37:35.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:35.260+0000 7fc1857fa700 1 -- 172.21.15.72:0/2644154139 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc17c0038a0 con 0x7fc178004850 2023-07-25T14:37:35.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:35.260+0000 7fc18eed9700 1 -- 172.21.15.72:0/2644154139 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc188151090 con 0x7fc178004850 2023-07-25T14:37:35.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:35.261+0000 7fc18eed9700 1 -- 172.21.15.72:0/2644154139 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1880aba40 con 0x7fc178004850 2023-07-25T14:37:35.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:35.261+0000 7fc1857fa700 1 -- 172.21.15.72:0/2644154139 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc17c003a00 con 0x7fc178004850 2023-07-25T14:37:35.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:35.262+0000 7fc1857fa700 1 --2- 172.21.15.72:0/2644154139 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fc16c06ace0 0x7fc16c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:35.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:35.262+0000 7fc187fff700 1 --2- 172.21.15.72:0/2644154139 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fc16c06ace0 0x7fc16c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:35.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:35.262+0000 7fc1857fa700 1 -- 172.21.15.72:0/2644154139 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5702+0+0 (secure 0 0 0) 0x7fc17c0888a0 con 0x7fc178004850 2023-07-25T14:37:35.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:35.262+0000 7fc187fff700 1 --2- 172.21.15.72:0/2644154139 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fc16c06ace0 0x7fc16c06d1a0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fc1740090b0 tx=0x7fc17401e040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:35.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:35.266+0000 7fc1857fa700 1 -- 172.21.15.72:0/2644154139 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fc17c053bf0 con 0x7fc178004850 2023-07-25T14:37:35.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:35.457+0000 7fc18eed9700 1 -- 172.21.15.72:0/2644154139 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fc18804e470 con 0x7fc178004850 2023-07-25T14:37:35.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:35.461+0000 7fc1857fa700 1 -- 172.21.15.72:0/2644154139 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7fc17c003cb0 con 0x7fc178004850 2023-07-25T14:37:35.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:35.463+0000 7fc18eed9700 1 -- 172.21.15.72:0/2644154139 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fc16c06ace0 msgr2=0x7fc16c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:35.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:35.463+0000 7fc18eed9700 1 --2- 172.21.15.72:0/2644154139 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fc16c06ace0 0x7fc16c06d1a0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fc1740090b0 tx=0x7fc17401e040 comp rx=0 tx=0).stop 2023-07-25T14:37:35.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:35.463+0000 7fc18eed9700 1 -- 172.21.15.72:0/2644154139 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc178004850 msgr2=0x7fc1881e9460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:35.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:35.463+0000 7fc18eed9700 1 --2- 172.21.15.72:0/2644154139 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc178004850 0x7fc1881e9460 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fc17c00e5a0 tx=0x7fc17c00e8b0 comp rx=0 tx=0).stop 2023-07-25T14:37:35.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:35.464+0000 7fc18eed9700 1 -- 172.21.15.72:0/2644154139 shutdown_connections 2023-07-25T14:37:35.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:35.464+0000 7fc18eed9700 1 --2- 172.21.15.72:0/2644154139 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fc16c06ace0 0x7fc16c06d1a0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:35.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:35.464+0000 7fc18eed9700 1 --2- 172.21.15.72:0/2644154139 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc1880abbf0 0x7fc1880ac070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:35.475 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:35.464+0000 7fc18eed9700 1 --2- 172.21.15.72:0/2644154139 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc178004850 0x7fc1881e9460 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:35.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:35.464+0000 7fc18eed9700 1 --2- 172.21.15.72:0/2644154139 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc188153d20 0x7fc188153390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:35.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:35.464+0000 7fc18eed9700 1 -- 172.21.15.72:0/2644154139 >> 172.21.15.72:0/2644154139 conn(0x7fc1880a87e0 msgr2=0x7fc18814d250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:35.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:35.464+0000 7fc18eed9700 1 -- 172.21.15.72:0/2644154139 shutdown_connections 2023-07-25T14:37:35.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:35.464+0000 7fc18eed9700 1 -- 172.21.15.72:0/2644154139 wait complete. 2023-07-25T14:37:35.486 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_all_caps_absent' 2023-07-25T14:37:35.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:35.596+0000 7f26e8107700 1 Processor -- start 2023-07-25T14:37:35.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:35.596+0000 7f26e8107700 1 -- start start 2023-07-25T14:37:35.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:35.597+0000 7f26e8107700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f26e014faf0 0x7f26e00c5e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:35.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:35.597+0000 7f26e8107700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f26e00c3f10 0x7f26e0071960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:35.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:35.597+0000 7f26e8107700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26e00c4930 con 0x7f26e00ba0e0 2023-07-25T14:37:35.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:35.597+0000 7f26e8107700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26e00c5670 con 0x7f26e00c3f10 2023-07-25T14:37:35.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:35.597+0000 7f26e8107700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26e00726e0 con 0x7f26e014faf0 2023-07-25T14:37:35.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:35.597+0000 7f26e56a2700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f26e00ba0e0 0x7f26e01558a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:34104/0 (socket says 172.21.15.72:34104) 2023-07-25T14:37:35.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:35.597+0000 7f26e56a2700 1 -- 172.21.15.72:0/303073393 learned_addr learned my addr 172.21.15.72:0/303073393 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:37:35.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:35.597+0000 7f26e4ea1700 1 -- 172.21.15.72:0/303073393 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1255633289 0 0) 0x7f26e00c4930 con 0x7f26e00ba0e0 2023-07-25T14:37:35.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:35.597+0000 7f26e4ea1700 1 -- 172.21.15.72:0/303073393 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f26cc0035b0 con 0x7f26e00ba0e0 2023-07-25T14:37:35.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:35.597+0000 7f26e66a4700 1 --2- 172.21.15.72:0/303073393 >> v2:172.21.15.92:3300/0 conn(0x7f26e00c3f10 0x7f26e0071960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:35.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:35.597+0000 7f26e5ea3700 1 --2- 172.21.15.72:0/303073393 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f26e014faf0 0x7f26e00c5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:35.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:35.597+0000 7f26e4ea1700 1 -- 172.21.15.72:0/303073393 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2264139242 0 0) 0x7f26cc0035b0 con 0x7f26e00ba0e0 2023-07-25T14:37:35.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:35.597+0000 7f26e4ea1700 1 -- 172.21.15.72:0/303073393 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f26e014faf0 msgr2=0x7f26e00c5e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:35.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:35.597+0000 7f26e4ea1700 1 --2- 172.21.15.72:0/303073393 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f26e014faf0 0x7f26e00c5e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:35.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:35.597+0000 7f26e4ea1700 1 -- 172.21.15.72:0/303073393 >> v2:172.21.15.92:3300/0 conn(0x7f26e00c3f10 msgr2=0x7f26e0071960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:35.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:35.597+0000 7f26e4ea1700 1 --2- 172.21.15.72:0/303073393 >> v2:172.21.15.92:3300/0 conn(0x7f26e00c3f10 0x7f26e0071960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:35.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:35.597+0000 7f26e4ea1700 1 -- 172.21.15.72:0/303073393 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26e00c4b80 con 0x7f26e00ba0e0 2023-07-25T14:37:35.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:35.597+0000 7f26e4ea1700 1 -- 172.21.15.72:0/303073393 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2559588315 0 0) 0x7f26d0001670 con 0x7f26e00ba0e0 2023-07-25T14:37:35.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:35.597+0000 7f26e4ea1700 1 -- 172.21.15.72:0/303073393 >> v1:172.21.15.72:6789/0 conn(0x7f26e00ba0e0 legacy=0x7f26e01558a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:35.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:35.597+0000 7f26e4ea1700 1 --2- 172.21.15.72:0/303073393 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f26cc003a00 0x7f26cc003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:35.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:35.597+0000 7f26e4ea1700 1 --2- 172.21.15.72:0/303073393 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f26e014faf0 0x7f26cc004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:35.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:35.597+0000 7f26e4ea1700 1 --2- 172.21.15.72:0/303073393 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f26cc004d90 0x7f26cc005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:35.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:35.597+0000 7f26e4ea1700 1 -- 172.21.15.72:0/303073393 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26e00c5670 con 0x7f26cc003a00 2023-07-25T14:37:35.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:35.597+0000 7f26e4ea1700 1 -- 172.21.15.72:0/303073393 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26e00726e0 con 0x7f26cc004d90 2023-07-25T14:37:35.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:35.597+0000 7f26e4ea1700 1 -- 172.21.15.72:0/303073393 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26cc00bb70 con 0x7f26e014faf0 2023-07-25T14:37:35.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:35.597+0000 7f26e5ea3700 1 --2- 172.21.15.72:0/303073393 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f26cc003a00 0x7f26cc003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:35.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:35.598+0000 7f26e56a2700 1 --2- 172.21.15.72:0/303073393 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f26e014faf0 0x7f26cc004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:35.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:35.598+0000 7f26e66a4700 1 --2- 172.21.15.72:0/303073393 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f26cc004d90 0x7f26cc005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:35.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:35.598+0000 7f26e5ea3700 1 -- 172.21.15.72:0/303073393 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f26e014faf0 msgr2=0x7f26cc004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:35.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:35.598+0000 7f26e5ea3700 1 --2- 172.21.15.72:0/303073393 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f26e014faf0 0x7f26cc004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:35.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:35.598+0000 7f26e5ea3700 1 -- 172.21.15.72:0/303073393 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f26cc004d90 msgr2=0x7f26cc005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:35.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:35.598+0000 7f26e5ea3700 1 --2- 172.21.15.72:0/303073393 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f26cc004d90 0x7f26cc005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:35.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:35.598+0000 7f26e5ea3700 1 -- 172.21.15.72:0/303073393 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26cc0035b0 con 0x7f26cc003a00 2023-07-25T14:37:35.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:35.598+0000 7f26e66a4700 1 --2- 172.21.15.72:0/303073393 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f26cc004d90 0x7f26cc005210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-25T14:37:35.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:35.598+0000 7f26e5ea3700 1 --2- 172.21.15.72:0/303073393 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f26cc003a00 0x7f26cc003e20 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f26dc009890 tx=0x7f26cc005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5736301ff04ba94e server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:35.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:35.598+0000 7f26e4ea1700 1 -- 172.21.15.72:0/303073393 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26dc00c070 con 0x7f26cc003a00 2023-07-25T14:37:35.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:35.598+0000 7f26e4ea1700 1 -- 172.21.15.72:0/303073393 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26dc013610 con 0x7f26cc003a00 2023-07-25T14:37:35.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:35.598+0000 7f26e4ea1700 1 -- 172.21.15.72:0/303073393 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26dc0139a0 con 0x7f26cc003a00 2023-07-25T14:37:35.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:35.598+0000 7f26e8107700 1 -- 172.21.15.72:0/303073393 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f26cc003a00 msgr2=0x7f26cc003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:35.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:35.598+0000 7f26e8107700 1 --2- 172.21.15.72:0/303073393 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f26cc003a00 0x7f26cc003e20 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f26dc009890 tx=0x7f26cc005880 comp rx=0 tx=0).stop 2023-07-25T14:37:35.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:35.598+0000 7f26e66a4700 1 -- 172.21.15.72:0/303073393 reap_dead start 2023-07-25T14:37:35.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:35.599+0000 7f26e8107700 1 -- 172.21.15.72:0/303073393 shutdown_connections 2023-07-25T14:37:35.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:35.599+0000 7f26e8107700 1 -- 172.21.15.72:0/303073393 >> 172.21.15.72:0/303073393 conn(0x7f26e00a87e0 msgr2=0x7f26e00a8bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:35.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:35.599+0000 7f26e8107700 1 -- 172.21.15.72:0/303073393 shutdown_connections 2023-07-25T14:37:35.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:35.599+0000 7f26e8107700 1 -- 172.21.15.72:0/303073393 wait complete. 2023-07-25T14:37:35.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:35.600+0000 7f26e8107700 1 Processor -- start 2023-07-25T14:37:35.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:35.600+0000 7f26e8107700 1 -- start start 2023-07-25T14:37:35.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:35.600+0000 7f26e8107700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f26cc003a00 0x7f26e0156240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:35.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:35.600+0000 7f26e8107700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f26e01508f0 0x7f26e01511b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:35.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:35.600+0000 7f26e8107700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f26e01e8ff0 0x7f26e00bc540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:35.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:35.600+0000 7f26e8107700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26e01503a0 con 0x7f26e01508f0 2023-07-25T14:37:35.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:35.600+0000 7f26e8107700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26e01e8600 con 0x7f26cc003a00 2023-07-25T14:37:35.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:35.600+0000 7f26e8107700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26e01e88e0 con 0x7f26e01e8ff0 2023-07-25T14:37:35.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:35.600+0000 7f26e56a2700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f26e01508f0 0x7f26e01511b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:35.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:35.600+0000 7f26e56a2700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f26e01508f0 0x7f26e01511b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43378/0 (socket says 172.21.15.72:43378) 2023-07-25T14:37:35.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:35.600+0000 7f26e56a2700 1 -- 172.21.15.72:0/2551280202 learned_addr learned my addr 172.21.15.72:0/2551280202 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:37:35.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:35.601+0000 7f26e5ea3700 1 --2- 172.21.15.72:0/2551280202 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f26cc003a00 0x7f26e0156240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:35.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:35.601+0000 7f26e66a4700 1 --2- 172.21.15.72:0/2551280202 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f26e01e8ff0 0x7f26e00bc540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:35.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:35.601+0000 7f26e56a2700 1 -- 172.21.15.72:0/2551280202 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f26e01e8ff0 msgr2=0x7f26e00bc540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:35.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:35.601+0000 7f26e56a2700 1 --2- 172.21.15.72:0/2551280202 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f26e01e8ff0 0x7f26e00bc540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:35.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:35.601+0000 7f26e56a2700 1 -- 172.21.15.72:0/2551280202 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f26cc003a00 msgr2=0x7f26e0156240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:35.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:35.601+0000 7f26e56a2700 1 --2- 172.21.15.72:0/2551280202 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f26cc003a00 0x7f26e0156240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:35.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:35.601+0000 7f26e56a2700 1 -- 172.21.15.72:0/2551280202 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26e0156780 con 0x7f26e01508f0 2023-07-25T14:37:35.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:35.601+0000 7f26e56a2700 1 --2- 172.21.15.72:0/2551280202 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f26e01508f0 0x7f26e01511b0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f26d0007370 tx=0x7f26d0007680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:35.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:35.601+0000 7f26d67fc700 1 -- 172.21.15.72:0/2551280202 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26d000f8d0 con 0x7f26e01508f0 2023-07-25T14:37:35.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:35.601+0000 7f26d67fc700 1 -- 172.21.15.72:0/2551280202 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26d000fa30 con 0x7f26e01508f0 2023-07-25T14:37:35.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:35.601+0000 7f26e8107700 1 -- 172.21.15.72:0/2551280202 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26e00c4600 con 0x7f26e01508f0 2023-07-25T14:37:35.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:35.601+0000 7f26d67fc700 1 -- 172.21.15.72:0/2551280202 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26d000fde0 con 0x7f26e01508f0 2023-07-25T14:37:35.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:35.601+0000 7f26e8107700 1 -- 172.21.15.72:0/2551280202 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26e0153150 con 0x7f26e01508f0 2023-07-25T14:37:35.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:35.602+0000 7f26e8107700 1 -- 172.21.15.72:0/2551280202 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26e00c1bc0 con 0x7f26e01508f0 2023-07-25T14:37:35.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:35.602+0000 7f26d67fc700 1 -- 172.21.15.72:0/2551280202 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f26d001e3b0 con 0x7f26e01508f0 2023-07-25T14:37:35.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:35.603+0000 7f26d67fc700 1 --2- 172.21.15.72:0/2551280202 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f26c406ace0 0x7f26c406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:35.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:35.603+0000 7f26d67fc700 1 -- 172.21.15.72:0/2551280202 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5702+0+0 (secure 0 0 0) 0x7f26d0088de0 con 0x7f26e01508f0 2023-07-25T14:37:35.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:35.603+0000 7f26e5ea3700 1 --2- 172.21.15.72:0/2551280202 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f26c406ace0 0x7f26c406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:35.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:35.603+0000 7f26e5ea3700 1 --2- 172.21.15.72:0/2551280202 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f26c406ace0 0x7f26c406d1a0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f26dc000c00 tx=0x7f26dc00c000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:35.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:35.607+0000 7f26d67fc700 1 -- 172.21.15.72:0/2551280202 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f26d0054080 con 0x7f26e01508f0 2023-07-25T14:37:35.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:35.870+0000 7f26e8107700 1 -- 172.21.15.72:0/2551280202 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_all_caps_absent"]} v 0) v1 -- 0x7f26e004e470 con 0x7f26e01508f0 2023-07-25T14:37:36.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:36.111+0000 7f26d67fc700 1 -- 172.21.15.72:0/2551280202 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_all_caps_absent"]}]=0 v131) v1 ==== 159+0+0 (secure 0 0 0) 0x7f26d001a0e0 con 0x7f26e01508f0 2023-07-25T14:37:36.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:36.113+0000 7f26e8107700 1 -- 172.21.15.72:0/2551280202 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f26c406ace0 msgr2=0x7f26c406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:36.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:36.113+0000 7f26e8107700 1 --2- 172.21.15.72:0/2551280202 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f26c406ace0 0x7f26c406d1a0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f26dc000c00 tx=0x7f26dc00c000 comp rx=0 tx=0).stop 2023-07-25T14:37:36.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:36.113+0000 7f26e8107700 1 -- 172.21.15.72:0/2551280202 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f26e01508f0 msgr2=0x7f26e01511b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:36.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:36.113+0000 7f26e8107700 1 --2- 172.21.15.72:0/2551280202 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f26e01508f0 0x7f26e01511b0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f26d0007370 tx=0x7f26d0007680 comp rx=0 tx=0).stop 2023-07-25T14:37:36.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:36.113+0000 7f26e8107700 1 -- 172.21.15.72:0/2551280202 shutdown_connections 2023-07-25T14:37:36.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:36.113+0000 7f26e8107700 1 --2- 172.21.15.72:0/2551280202 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f26c406ace0 0x7f26c406d1a0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:36.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:36.113+0000 7f26e8107700 1 --2- 172.21.15.72:0/2551280202 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f26e01e8ff0 0x7f26e00bc540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:36.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:36.113+0000 7f26e8107700 1 --2- 172.21.15.72:0/2551280202 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f26cc003a00 0x7f26e0156240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:36.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:36.113+0000 7f26e8107700 1 --2- 172.21.15.72:0/2551280202 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f26e01508f0 0x7f26e01511b0 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:36.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:36.113+0000 7f26e8107700 1 -- 172.21.15.72:0/2551280202 >> 172.21.15.72:0/2551280202 conn(0x7f26e00a87e0 msgr2=0x7f26e0071960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:36.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:36.113+0000 7f26e8107700 1 -- 172.21.15.72:0/2551280202 shutdown_connections 2023-07-25T14:37:36.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:36.113+0000 7f26e8107700 1 -- 172.21.15.72:0/2551280202 wait complete. 2023-07-25T14:37:36.136 INFO:tasks.cephfs_test_runner:test_mount_all_caps_absent (tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth) ... ok 2023-07-25T14:37:36.137 INFO:tasks.cephfs_test_runner:Starting test: test_mount_mon_and_osd_caps_present_mds_caps_absent (tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth) 2023-07-25T14:37:36.137 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_mon_and_osd_caps_present_mds_caps_absent' 2023-07-25T14:37:36.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:36.247+0000 7f35c9d4a700 1 Processor -- start 2023-07-25T14:37:36.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:36.247+0000 7f35c9d4a700 1 -- start start 2023-07-25T14:37:36.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:36.247+0000 7f35c9d4a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f35c4151950 0x7f35c406a190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:36.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:36.247+0000 7f35c9d4a700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f35c40724c0 0x7f35c40c34c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:36.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:36.248+0000 7f35c9d4a700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35c40c2fe0 con 0x7f35c406a6d0 2023-07-25T14:37:36.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:36.248+0000 7f35c9d4a700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35c4071a60 con 0x7f35c4151950 2023-07-25T14:37:36.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:36.248+0000 7f35c9d4a700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35c40c2a70 con 0x7f35c40724c0 2023-07-25T14:37:36.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:36.248+0000 7f35c37fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f35c4151950 0x7f35c406a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:36.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:36.248+0000 7f35c37fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f35c4151950 0x7f35c406a190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43386/0 (socket says 172.21.15.72:43386) 2023-07-25T14:37:36.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:36.248+0000 7f35c3fff700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f35c406a6d0 0x7f35c40c3a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:34126/0 (socket says 172.21.15.72:34126) 2023-07-25T14:37:36.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:36.248+0000 7f35c37fe700 1 -- 172.21.15.72:0/4165586940 learned_addr learned my addr 172.21.15.72:0/4165586940 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:37:36.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:36.248+0000 7f35c2ffd700 1 --2- 172.21.15.72:0/4165586940 >> v2:172.21.15.92:3300/0 conn(0x7f35c40724c0 0x7f35c40c34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:36.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:36.248+0000 7f35c37fe700 1 -- 172.21.15.72:0/4165586940 >> v2:172.21.15.92:3300/0 conn(0x7f35c40724c0 msgr2=0x7f35c40c34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:36.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:36.248+0000 7f35c37fe700 1 --2- 172.21.15.72:0/4165586940 >> v2:172.21.15.92:3300/0 conn(0x7f35c40724c0 0x7f35c40c34c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:36.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:36.248+0000 7f35c37fe700 1 -- 172.21.15.72:0/4165586940 >> v1:172.21.15.72:6789/0 conn(0x7f35c406a6d0 legacy=0x7f35c40c3a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:36.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:36.248+0000 7f35c37fe700 1 -- 172.21.15.72:0/4165586940 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35c4155070 con 0x7f35c4151950 2023-07-25T14:37:36.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:36.248+0000 7f35c27fc700 1 -- 172.21.15.72:0/4165586940 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 56690930 0 0) 0x7f35c40c2fe0 con 0x7f35c406a6d0 2023-07-25T14:37:36.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:36.248+0000 7f35c37fe700 1 --2- 172.21.15.72:0/4165586940 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f35c4151950 0x7f35c406a190 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f35c40acbc0 tx=0x7f35b4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f481dbe821151600 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:36.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:36.248+0000 7f35c27fc700 1 -- 172.21.15.72:0/4165586940 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35b400b870 con 0x7f35c4151950 2023-07-25T14:37:36.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:36.248+0000 7f35c27fc700 1 -- 172.21.15.72:0/4165586940 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35b400b9d0 con 0x7f35c4151950 2023-07-25T14:37:36.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:36.248+0000 7f35c27fc700 1 -- 172.21.15.72:0/4165586940 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35b400bd60 con 0x7f35c4151950 2023-07-25T14:37:36.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:36.249+0000 7f35c9d4a700 1 -- 172.21.15.72:0/4165586940 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f35c4151950 msgr2=0x7f35c406a190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:36.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:36.249+0000 7f35c9d4a700 1 --2- 172.21.15.72:0/4165586940 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f35c4151950 0x7f35c406a190 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f35c40acbc0 tx=0x7f35b4009bd0 comp rx=0 tx=0).stop 2023-07-25T14:37:36.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:36.249+0000 7f35c9d4a700 1 -- 172.21.15.72:0/4165586940 shutdown_connections 2023-07-25T14:37:36.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:36.249+0000 7f35c9d4a700 1 --2- 172.21.15.72:0/4165586940 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f35c4151950 0x7f35c406a190 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:36.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:36.249+0000 7f35c9d4a700 1 --2- 172.21.15.72:0/4165586940 >> v2:172.21.15.92:3300/0 conn(0x7f35c40724c0 0x7f35c40c34c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:36.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:36.249+0000 7f35c9d4a700 1 -- 172.21.15.72:0/4165586940 >> 172.21.15.72:0/4165586940 conn(0x7f35c40a87e0 msgr2=0x7f35c40a8bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:36.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:36.249+0000 7f35c9d4a700 1 -- 172.21.15.72:0/4165586940 shutdown_connections 2023-07-25T14:37:36.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:36.249+0000 7f35c9d4a700 1 -- 172.21.15.72:0/4165586940 wait complete. 2023-07-25T14:37:36.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:36.250+0000 7f35c9d4a700 1 Processor -- start 2023-07-25T14:37:36.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:36.250+0000 7f35c9d4a700 1 -- start start 2023-07-25T14:37:36.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:36.251+0000 7f35c9d4a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f35c406a6d0 0x7f35c40bde90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:36.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:36.251+0000 7f35c9d4a700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f35c40724c0 0x7f35c414e270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:36.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:36.251+0000 7f35c9d4a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f35c4151950 0x7f35c414e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:36.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:36.251+0000 7f35c9d4a700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35c40ac220 con 0x7f35c406a6d0 2023-07-25T14:37:36.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:36.251+0000 7f35c9d4a700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35c414ecf0 con 0x7f35c4151950 2023-07-25T14:37:36.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:36.251+0000 7f35c9d4a700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35c40ab980 con 0x7f35c40724c0 2023-07-25T14:37:36.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:36.251+0000 7f35c37fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f35c406a6d0 0x7f35c40bde90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:36.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:36.251+0000 7f35c37fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f35c406a6d0 0x7f35c40bde90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43392/0 (socket says 172.21.15.72:43392) 2023-07-25T14:37:36.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:36.251+0000 7f35c37fe700 1 -- 172.21.15.72:0/1901124257 learned_addr learned my addr 172.21.15.72:0/1901124257 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:37:36.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:36.251+0000 7f35c3fff700 1 --2- 172.21.15.72:0/1901124257 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f35c4151950 0x7f35c414e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:36.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:36.251+0000 7f35c2ffd700 1 --2- 172.21.15.72:0/1901124257 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f35c40724c0 0x7f35c414e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:36.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:36.251+0000 7f35c37fe700 1 -- 172.21.15.72:0/1901124257 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f35c40724c0 msgr2=0x7f35c414e270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:36.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:36.251+0000 7f35c37fe700 1 --2- 172.21.15.72:0/1901124257 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f35c40724c0 0x7f35c414e270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:36.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:36.251+0000 7f35c37fe700 1 -- 172.21.15.72:0/1901124257 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f35c4151950 msgr2=0x7f35c414e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:36.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:36.251+0000 7f35c37fe700 1 --2- 172.21.15.72:0/1901124257 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f35c4151950 0x7f35c414e7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:36.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:36.251+0000 7f35c37fe700 1 -- 172.21.15.72:0/1901124257 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35b4009550 con 0x7f35c406a6d0 2023-07-25T14:37:36.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:36.251+0000 7f35c37fe700 1 --2- 172.21.15.72:0/1901124257 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f35c406a6d0 0x7f35c40bde90 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f35b4014040 tx=0x7f35b4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:36.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:36.251+0000 7f35abfff700 1 -- 172.21.15.72:0/1901124257 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35b4004220 con 0x7f35c406a6d0 2023-07-25T14:37:36.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:36.252+0000 7f35abfff700 1 -- 172.21.15.72:0/1901124257 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35b401e070 con 0x7f35c406a6d0 2023-07-25T14:37:36.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:36.252+0000 7f35c9d4a700 1 -- 172.21.15.72:0/1901124257 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35c40abc60 con 0x7f35c406a6d0 2023-07-25T14:37:36.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:36.252+0000 7f35abfff700 1 -- 172.21.15.72:0/1901124257 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35b4004580 con 0x7f35c406a6d0 2023-07-25T14:37:36.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:36.252+0000 7f35c9d4a700 1 -- 172.21.15.72:0/1901124257 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35c40beff0 con 0x7f35c406a6d0 2023-07-25T14:37:36.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:36.252+0000 7f35c9d4a700 1 -- 172.21.15.72:0/1901124257 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35c40bee50 con 0x7f35c406a6d0 2023-07-25T14:37:36.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:36.253+0000 7f35abfff700 1 -- 172.21.15.72:0/1901124257 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f35b4012780 con 0x7f35c406a6d0 2023-07-25T14:37:36.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:36.253+0000 7f35abfff700 1 --2- 172.21.15.72:0/1901124257 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f35b006ace0 0x7f35b006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:36.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:36.253+0000 7f35abfff700 1 -- 172.21.15.72:0/1901124257 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5702+0+0 (secure 0 0 0) 0x7f35b408a5f0 con 0x7f35c406a6d0 2023-07-25T14:37:36.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:36.253+0000 7f35c2ffd700 1 --2- 172.21.15.72:0/1901124257 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f35b006ace0 0x7f35b006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:36.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:36.254+0000 7f35c2ffd700 1 --2- 172.21.15.72:0/1901124257 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f35b006ace0 0x7f35b006d1a0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f35b8009950 tx=0x7f35b8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:36.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:36.258+0000 7f35abfff700 1 -- 172.21.15.72:0/1901124257 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f35c40bee50 con 0x7f35c406a6d0 2023-07-25T14:37:36.537 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:36.526+0000 7f35c9d4a700 1 -- 172.21.15.72:0/1901124257 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_mon_and_osd_caps_present_mds_caps_absent"]} v 0) v1 -- 0x7f35c40c15a0 con 0x7f35c406a6d0 2023-07-25T14:37:37.124 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.113+0000 7f35abfff700 1 -- 172.21.15.72:0/1901124257 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_mon_and_osd_caps_present_mds_caps_absent"]}]=0 v132) v1 ==== 187+0+0 (secure 0 0 0) 0x7f35c40c15a0 con 0x7f35c406a6d0 2023-07-25T14:37:37.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.116+0000 7f35c9d4a700 1 -- 172.21.15.72:0/1901124257 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f35b006ace0 msgr2=0x7f35b006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:37.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.116+0000 7f35c9d4a700 1 --2- 172.21.15.72:0/1901124257 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f35b006ace0 0x7f35b006d1a0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f35b8009950 tx=0x7f35b8008040 comp rx=0 tx=0).stop 2023-07-25T14:37:37.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.116+0000 7f35c9d4a700 1 -- 172.21.15.72:0/1901124257 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f35c406a6d0 msgr2=0x7f35c40bde90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:37.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.116+0000 7f35c9d4a700 1 --2- 172.21.15.72:0/1901124257 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f35c406a6d0 0x7f35c40bde90 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f35b4014040 tx=0x7f35b4004750 comp rx=0 tx=0).stop 2023-07-25T14:37:37.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.116+0000 7f35c9d4a700 1 -- 172.21.15.72:0/1901124257 shutdown_connections 2023-07-25T14:37:37.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.116+0000 7f35c9d4a700 1 --2- 172.21.15.72:0/1901124257 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f35b006ace0 0x7f35b006d1a0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:37.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.116+0000 7f35c9d4a700 1 --2- 172.21.15.72:0/1901124257 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f35c4151950 0x7f35c414e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:37.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.116+0000 7f35c9d4a700 1 --2- 172.21.15.72:0/1901124257 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f35c406a6d0 0x7f35c40bde90 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:37.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.116+0000 7f35c9d4a700 1 --2- 172.21.15.72:0/1901124257 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f35c40724c0 0x7f35c414e270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:37.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.116+0000 7f35c9d4a700 1 -- 172.21.15.72:0/1901124257 >> 172.21.15.72:0/1901124257 conn(0x7f35c40a87e0 msgr2=0x7f35c414f7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:37.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.116+0000 7f35c9d4a700 1 -- 172.21.15.72:0/1901124257 shutdown_connections 2023-07-25T14:37:37.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.116+0000 7f35c9d4a700 1 -- 172.21.15.72:0/1901124257 wait complete. 2023-07-25T14:37:37.141 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-25T14:37:37.264 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.253+0000 7f49dfab3700 1 Processor -- start 2023-07-25T14:37:37.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.254+0000 7f49dfab3700 1 -- start start 2023-07-25T14:37:37.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.254+0000 7f49dfab3700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f49d806b2a0 0x7f49d8154df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:37.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.254+0000 7f49dfab3700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49d8157cd0 con 0x7f49d81518c0 2023-07-25T14:37:37.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.254+0000 7f49dfab3700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49d8158870 con 0x7f49d80c4370 2023-07-25T14:37:37.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.254+0000 7f49dfab3700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49d806b750 con 0x7f49d806b2a0 2023-07-25T14:37:37.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.254+0000 7f49dd04e700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f49d806b2a0 0x7f49d8154df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:37.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.254+0000 7f49dd84f700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f49d81518c0 0x7f49d8158160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:34136/0 (socket says 172.21.15.72:34136) 2023-07-25T14:37:37.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.254+0000 7f49dd84f700 1 -- 172.21.15.72:0/2709578096 learned_addr learned my addr 172.21.15.72:0/2709578096 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:37:37.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.255+0000 7f49dd04e700 1 -- 172.21.15.72:0/2709578096 >> v1:172.21.15.92:6789/0 conn(0x7f49d80c4370 legacy=0x7f49d815ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:37.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.255+0000 7f49dd04e700 1 -- 172.21.15.72:0/2709578096 >> v1:172.21.15.72:6789/0 conn(0x7f49d81518c0 legacy=0x7f49d8158160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:37.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.255+0000 7f49dd04e700 1 -- 172.21.15.72:0/2709578096 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49d80c2520 con 0x7f49d806b2a0 2023-07-25T14:37:37.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.255+0000 7f49dc84d700 1 -- 172.21.15.72:0/2709578096 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3560301169 0 0) 0x7f49d8157cd0 con 0x7f49d81518c0 2023-07-25T14:37:37.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.255+0000 7f49dd04e700 1 --2- 172.21.15.72:0/2709578096 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f49d806b2a0 0x7f49d8154df0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f49d4009840 tx=0x7f49d4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a346db9a751355 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:37.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.255+0000 7f49dc84d700 1 -- 172.21.15.72:0/2709578096 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49d4004230 con 0x7f49d806b2a0 2023-07-25T14:37:37.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.255+0000 7f49dc84d700 1 -- 172.21.15.72:0/2709578096 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49d4004390 con 0x7f49d806b2a0 2023-07-25T14:37:37.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.255+0000 7f49dc84d700 1 -- 172.21.15.72:0/2709578096 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49d40036a0 con 0x7f49d806b2a0 2023-07-25T14:37:37.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.255+0000 7f49dfab3700 1 -- 172.21.15.72:0/2709578096 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f49d806b2a0 msgr2=0x7f49d8154df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:37.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.255+0000 7f49dfab3700 1 --2- 172.21.15.72:0/2709578096 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f49d806b2a0 0x7f49d8154df0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f49d4009840 tx=0x7f49d4009b50 comp rx=0 tx=0).stop 2023-07-25T14:37:37.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.255+0000 7f49dfab3700 1 -- 172.21.15.72:0/2709578096 shutdown_connections 2023-07-25T14:37:37.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.255+0000 7f49dfab3700 1 --2- 172.21.15.72:0/2709578096 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f49d806b2a0 0x7f49d8154df0 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:37.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.255+0000 7f49dfab3700 1 -- 172.21.15.72:0/2709578096 >> 172.21.15.72:0/2709578096 conn(0x7f49d806a8d0 msgr2=0x7f49d80a94e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:37.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.256+0000 7f49dfab3700 1 -- 172.21.15.72:0/2709578096 shutdown_connections 2023-07-25T14:37:37.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.256+0000 7f49dfab3700 1 -- 172.21.15.72:0/2709578096 wait complete. 2023-07-25T14:37:37.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.257+0000 7f49dfab3700 1 Processor -- start 2023-07-25T14:37:37.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.257+0000 7f49dfab3700 1 -- start start 2023-07-25T14:37:37.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.257+0000 7f49dfab3700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f49d806b2a0 0x7f49d81ea300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:37.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.257+0000 7f49dfab3700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f49d80c4370 0x7f49d80a8de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:37.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.257+0000 7f49dfab3700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f49d81518c0 0x7f49d80ac4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:37.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.257+0000 7f49dfab3700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49d80c76f0 con 0x7f49d80c4370 2023-07-25T14:37:37.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.257+0000 7f49dfab3700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49d80c7ec0 con 0x7f49d806b2a0 2023-07-25T14:37:37.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.257+0000 7f49dfab3700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49d80c6750 con 0x7f49d81518c0 2023-07-25T14:37:37.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.257+0000 7f49dd04e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f49d80c4370 0x7f49d80a8de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:37.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.257+0000 7f49dd04e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f49d80c4370 0x7f49d80a8de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43408/0 (socket says 172.21.15.72:43408) 2023-07-25T14:37:37.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.258+0000 7f49dd04e700 1 -- 172.21.15.72:0/4094402721 learned_addr learned my addr 172.21.15.72:0/4094402721 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:37:37.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.258+0000 7f49dd84f700 1 --2- 172.21.15.72:0/4094402721 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f49d806b2a0 0x7f49d81ea300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:37.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.258+0000 7f49de050700 1 --2- 172.21.15.72:0/4094402721 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f49d81518c0 0x7f49d80ac4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:37.272 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.258+0000 7f49dd04e700 1 -- 172.21.15.72:0/4094402721 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f49d81518c0 msgr2=0x7f49d80ac4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:37.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.258+0000 7f49dd04e700 1 --2- 172.21.15.72:0/4094402721 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f49d81518c0 0x7f49d80ac4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:37.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.258+0000 7f49dd04e700 1 -- 172.21.15.72:0/4094402721 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f49d806b2a0 msgr2=0x7f49d81ea300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:37.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.258+0000 7f49dd04e700 1 --2- 172.21.15.72:0/4094402721 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f49d806b2a0 0x7f49d81ea300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:37.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.258+0000 7f49dd04e700 1 -- 172.21.15.72:0/4094402721 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49d40094a0 con 0x7f49d80c4370 2023-07-25T14:37:37.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.258+0000 7f49dd84f700 1 --2- 172.21.15.72:0/4094402721 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f49d806b2a0 0x7f49d81ea300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-25T14:37:37.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.258+0000 7f49dd04e700 1 --2- 172.21.15.72:0/4094402721 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f49d80c4370 0x7f49d80a8de0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f49d80c5280 tx=0x7f49d4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:37.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.258+0000 7f49ce7fc700 1 -- 172.21.15.72:0/4094402721 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49d4011630 con 0x7f49d80c4370 2023-07-25T14:37:37.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.258+0000 7f49ce7fc700 1 -- 172.21.15.72:0/4094402721 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49d401e070 con 0x7f49d80c4370 2023-07-25T14:37:37.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.258+0000 7f49dfab3700 1 -- 172.21.15.72:0/4094402721 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49d80c7900 con 0x7f49d80c4370 2023-07-25T14:37:37.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.258+0000 7f49ce7fc700 1 -- 172.21.15.72:0/4094402721 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49d40119b0 con 0x7f49d80c4370 2023-07-25T14:37:37.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.258+0000 7f49dfab3700 1 -- 172.21.15.72:0/4094402721 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49d80a9320 con 0x7f49d80c4370 2023-07-25T14:37:37.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.259+0000 7f49dfab3700 1 -- 172.21.15.72:0/4094402721 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49d80c6900 con 0x7f49d80c4370 2023-07-25T14:37:37.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.260+0000 7f49ce7fc700 1 -- 172.21.15.72:0/4094402721 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f49d4011b10 con 0x7f49d80c4370 2023-07-25T14:37:37.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.260+0000 7f49ce7fc700 1 --2- 172.21.15.72:0/4094402721 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f49bc06ace0 0x7f49bc06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:37.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.260+0000 7f49ce7fc700 1 -- 172.21.15.72:0/4094402721 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5702+0+0 (secure 0 0 0) 0x7f49d408a650 con 0x7f49d80c4370 2023-07-25T14:37:37.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.260+0000 7f49dd84f700 1 --2- 172.21.15.72:0/4094402721 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f49bc06ace0 0x7f49bc06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:37.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.260+0000 7f49dd84f700 1 --2- 172.21.15.72:0/4094402721 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f49bc06ace0 0x7f49bc06d1a0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f49c8000f60 tx=0x7f49c8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:37.276 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.264+0000 7f49ce7fc700 1 -- 172.21.15.72:0/4094402721 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f49d80c6900 con 0x7f49d80c4370 2023-07-25T14:37:37.468 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.457+0000 7f49dfab3700 1 -- 172.21.15.72:0/4094402721 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f49d80c68c0 con 0x7f49d80c4370 2023-07-25T14:37:37.470 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.458+0000 7f49ce7fc700 1 -- 172.21.15.72:0/4094402721 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v49) v1 ==== 74+0+14997 (secure 0 0 0) 0x7f49d40558f0 con 0x7f49d80c4370 2023-07-25T14:37:37.470 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-25T14:37:37.470 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":49,"fsid":"9170db48-9170-43e8-8ccb-9813e6240906","created":"2023-07-25T14:35:21.733262+0000","modified":"2023-07-25T14:37:35.098725+0000","last_up_change":"2023-07-25T14:35:31.355010+0000","last_in_change":"2023-07-25T14:35:24.195785+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-25T14:35:32.983457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-25T14:35:33.326342+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d517fdad-0bfe-49f0-89f2-9421c3761839","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6801","nonce":2475407414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6803","nonce":2475407414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6807","nonce":2475407414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6805","nonce":2475407414}]},"public_addr":"172.21.15.72:6801/2475407414","cluster_addr":"172.21.15.72:6803/2475407414","heartbeat_back_addr":"172.21.15.72:6807/2475407414","heartbeat_front_addr":"172.21.15.72:6805/2475407414","state":["exists","up"]},{"osd":1,"uuid":"e1564be3-f209-47e5-a8d0-32fc618a474f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6822","nonce":870954016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6825","nonce":870954016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6831","nonce":870954016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6827","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6829","nonce":870954016}]},"public_addr":"172.21.15.72:6822/870954016","cluster_addr":"172.21.15.72:6825/870954016","heartbeat_back_addr":"172.21.15.72:6831/870954016","heartbeat_front_addr":"172.21.15.72:6829/870954016","state":["exists","up"]},{"osd":2,"uuid":"c4647d30-ffa6-417a-9026-ef530c75910e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6809","nonce":2143129442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6811","nonce":2143129442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6815","nonce":2143129442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6813","nonce":2143129442}]},"public_addr":"172.21.15.72:6809/2143129442","cluster_addr":"172.21.15.72:6811/2143129442","heartbeat_back_addr":"172.21.15.72:6815/2143129442","heartbeat_front_addr":"172.21.15.72:6813/2143129442","state":["exists","up"]},{"osd":3,"uuid":"76c9d9a7-c2e2-4612-a58b-d6882dd76b58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6817","nonce":3404066311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6819","nonce":3404066311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6828","nonce":3404066311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6821","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6823","nonce":3404066311}]},"public_addr":"172.21.15.72:6817/3404066311","cluster_addr":"172.21.15.72:6819/3404066311","heartbeat_back_addr":"172.21.15.72:6828/3404066311","heartbeat_front_addr":"172.21.15.72:6823/3404066311","state":["exists","up"]},{"osd":4,"uuid":"7f8920dc-0ad4-4a73-ab40-65408f83eadd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6817","nonce":2381008739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6819","nonce":2381008739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6825","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6827","nonce":2381008739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6822","nonce":2381008739}]},"public_addr":"172.21.15.92:6817/2381008739","cluster_addr":"172.21.15.92:6819/2381008739","heartbeat_back_addr":"172.21.15.92:6827/2381008739","heartbeat_front_addr":"172.21.15.92:6822/2381008739","state":["exists","up"]},{"osd":5,"uuid":"56257e7c-31eb-44c5-9ec7-1318a4e0bb35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6801","nonce":2161935604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6803","nonce":2161935604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6807","nonce":2161935604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6805","nonce":2161935604}]},"public_addr":"172.21.15.92:6801/2161935604","cluster_addr":"172.21.15.92:6803/2161935604","heartbeat_back_addr":"172.21.15.92:6807/2161935604","heartbeat_front_addr":"172.21.15.92:6805/2161935604","state":["exists","up"]},{"osd":6,"uuid":"a150d3d8-a0c9-4955-968a-8d98eff4ffb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6809","nonce":3770163493}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6811","nonce":3770163493}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6815","nonce":3770163493}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6813","nonce":3770163493}]},"public_addr":"172.21.15.92:6809/3770163493","cluster_addr":"172.21.15.92:6811/3770163493","heartbeat_back_addr":"172.21.15.92:6815/3770163493","heartbeat_front_addr":"172.21.15.92:6813/3770163493","state":["exists","up"]},{"osd":7,"uuid":"07799c27-54ee-4591-a42d-a978d6b32065","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6821","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6823","nonce":2135777609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6826","nonce":2135777609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6831","nonce":2135777609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6829","nonce":2135777609}]},"public_addr":"172.21.15.92:6823/2135777609","cluster_addr":"172.21.15.92:6826/2135777609","heartbeat_back_addr":"172.21.15.92:6831/2135777609","heartbeat_front_addr":"172.21.15.92:6829/2135777609","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.345365+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.378150+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.146566+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.372172+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:30.398421+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.385632+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.465611+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.443583+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.72:6836/2944832990":"2023-07-26T14:37:31.950675+0000","172.21.15.72:6834/2944832990":"2023-07-26T14:37:31.950675+0000","172.21.15.72:6835/1193027887":"2023-07-26T14:37:25.068539+0000","172.21.15.72:6837/1193027887":"2023-07-26T14:37:25.068539+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-25T14:37:37.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.460+0000 7f49dfab3700 1 -- 172.21.15.72:0/4094402721 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f49bc06ace0 msgr2=0x7f49bc06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:37.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.460+0000 7f49dfab3700 1 --2- 172.21.15.72:0/4094402721 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f49bc06ace0 0x7f49bc06d1a0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f49c8000f60 tx=0x7f49c8009040 comp rx=0 tx=0).stop 2023-07-25T14:37:37.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.460+0000 7f49dfab3700 1 -- 172.21.15.72:0/4094402721 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f49d80c4370 msgr2=0x7f49d80a8de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:37.472 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.460+0000 7f49dfab3700 1 --2- 172.21.15.72:0/4094402721 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f49d80c4370 0x7f49d80a8de0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f49d80c5280 tx=0x7f49d4004750 comp rx=0 tx=0).stop 2023-07-25T14:37:37.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.460+0000 7f49dfab3700 1 -- 172.21.15.72:0/4094402721 shutdown_connections 2023-07-25T14:37:37.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.460+0000 7f49dfab3700 1 --2- 172.21.15.72:0/4094402721 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f49bc06ace0 0x7f49bc06d1a0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:37.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.460+0000 7f49dfab3700 1 --2- 172.21.15.72:0/4094402721 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f49d81518c0 0x7f49d80ac4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:37.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.460+0000 7f49dfab3700 1 --2- 172.21.15.72:0/4094402721 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f49d806b2a0 0x7f49d81ea300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:37.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.460+0000 7f49dfab3700 1 --2- 172.21.15.72:0/4094402721 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f49d80c4370 0x7f49d80a8de0 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:37.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.460+0000 7f49dfab3700 1 -- 172.21.15.72:0/4094402721 >> 172.21.15.72:0/4094402721 conn(0x7f49d806a8d0 msgr2=0x7f49d814e670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:37.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.460+0000 7f49dfab3700 1 -- 172.21.15.72:0/4094402721 shutdown_connections 2023-07-25T14:37:37.474 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.460+0000 7f49dfab3700 1 -- 172.21.15.72:0/4094402721 wait complete. 2023-07-25T14:37:37.483 INFO:tasks.cephfs.cephfs_test_case.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-07-25T14:35:32.983457+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-07-25T14:35:33.326342+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-25T14:37:37.484 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-25T14:37:37.606 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.595+0000 7fab660f8700 1 Processor -- start 2023-07-25T14:37:37.607 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.595+0000 7fab660f8700 1 -- start start 2023-07-25T14:37:37.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.596+0000 7fab660f8700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fab60151950 0x7fab6006a190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:37.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.596+0000 7fab660f8700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fab6006a6d0 0x7fab600c3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:37.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.596+0000 7fab660f8700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab600c2fe0 con 0x7fab600724c0 2023-07-25T14:37:37.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.596+0000 7fab660f8700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab60071a60 con 0x7fab60151950 2023-07-25T14:37:37.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.596+0000 7fab660f8700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab600c2a70 con 0x7fab6006a6d0 2023-07-25T14:37:37.608 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.597+0000 7fab5ffff700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fab6006a6d0 0x7fab600c3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:37.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.597+0000 7fab5f7fe700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fab60151950 0x7fab6006a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:37.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.597+0000 7fab5effd700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7fab600724c0 0x7fab600c34c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.72:57724/0 (socket says 172.21.15.72:57724) 2023-07-25T14:37:37.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.597+0000 7fab5effd700 1 -- 172.21.15.72:0/3582383143 learned_addr learned my addr 172.21.15.72:0/3582383143 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:37:37.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.597+0000 7fab5ffff700 1 --2- 172.21.15.72:0/3582383143 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fab6006a6d0 0x7fab600c3bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3301/0 says I am v2:172.21.15.72:48642/0 (socket says 172.21.15.72:48642) 2023-07-25T14:37:37.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.597+0000 7fab5ffff700 1 -- 172.21.15.72:0/3582383143 >> v2:172.21.15.92:3300/0 conn(0x7fab60151950 msgr2=0x7fab6006a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:37.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.597+0000 7fab5ffff700 1 --2- 172.21.15.72:0/3582383143 >> v2:172.21.15.92:3300/0 conn(0x7fab60151950 0x7fab6006a190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:37.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.597+0000 7fab5ffff700 1 -- 172.21.15.72:0/3582383143 >> v1:172.21.15.92:6789/0 conn(0x7fab600724c0 legacy=0x7fab600c34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:37.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.597+0000 7fab5ffff700 1 -- 172.21.15.72:0/3582383143 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab60155070 con 0x7fab6006a6d0 2023-07-25T14:37:37.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.597+0000 7fab5f7fe700 1 --2- 172.21.15.72:0/3582383143 >> v2:172.21.15.92:3300/0 conn(0x7fab60151950 0x7fab6006a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-25T14:37:37.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.597+0000 7fab5ffff700 1 --2- 172.21.15.72:0/3582383143 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fab6006a6d0 0x7fab600c3bd0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fab58009d90 tx=0x7fab5800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d01839b08c8aacc server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:37.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.597+0000 7fab5e7fc700 1 -- 172.21.15.72:0/3582383143 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab5800e070 con 0x7fab6006a6d0 2023-07-25T14:37:37.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.597+0000 7fab5e7fc700 1 -- 172.21.15.72:0/3582383143 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab5800bb20 con 0x7fab6006a6d0 2023-07-25T14:37:37.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.597+0000 7fab5e7fc700 1 -- 172.21.15.72:0/3582383143 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab58012430 con 0x7fab6006a6d0 2023-07-25T14:37:37.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.598+0000 7fab660f8700 1 -- 172.21.15.72:0/3582383143 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fab6006a6d0 msgr2=0x7fab600c3bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:37.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.598+0000 7fab660f8700 1 --2- 172.21.15.72:0/3582383143 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fab6006a6d0 0x7fab600c3bd0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fab58009d90 tx=0x7fab5800b330 comp rx=0 tx=0).stop 2023-07-25T14:37:37.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.598+0000 7fab660f8700 1 -- 172.21.15.72:0/3582383143 shutdown_connections 2023-07-25T14:37:37.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.598+0000 7fab660f8700 1 --2- 172.21.15.72:0/3582383143 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fab6006a6d0 0x7fab600c3bd0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:37.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.598+0000 7fab660f8700 1 --2- 172.21.15.72:0/3582383143 >> v2:172.21.15.92:3300/0 conn(0x7fab60151950 0x7fab6006a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:37.614 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.598+0000 7fab660f8700 1 -- 172.21.15.72:0/3582383143 >> 172.21.15.72:0/3582383143 conn(0x7fab600a87e0 msgr2=0x7fab600a8bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:37.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.598+0000 7fab660f8700 1 -- 172.21.15.72:0/3582383143 shutdown_connections 2023-07-25T14:37:37.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.598+0000 7fab660f8700 1 -- 172.21.15.72:0/3582383143 wait complete. 2023-07-25T14:37:37.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.599+0000 7fab660f8700 1 Processor -- start 2023-07-25T14:37:37.615 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.599+0000 7fab660f8700 1 -- start start 2023-07-25T14:37:37.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.600+0000 7fab660f8700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fab6006a6d0 0x7fab601ed420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:37.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.600+0000 7fab660f8700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fab600724c0 0x7fab6014d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:37.616 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.600+0000 7fab660f8700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fab60151950 0x7fab6014a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:37.617 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.600+0000 7fab660f8700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab601ec9d0 con 0x7fab60151950 2023-07-25T14:37:37.617 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.600+0000 7fab660f8700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab601ecf90 con 0x7fab600724c0 2023-07-25T14:37:37.617 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.600+0000 7fab660f8700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab600a77a0 con 0x7fab6006a6d0 2023-07-25T14:37:37.617 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.600+0000 7fab5ffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fab60151950 0x7fab6014a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:37.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.600+0000 7fab5ffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fab60151950 0x7fab6014a360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43420/0 (socket says 172.21.15.72:43420) 2023-07-25T14:37:37.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.600+0000 7fab5ffff700 1 -- 172.21.15.72:0/4182714491 learned_addr learned my addr 172.21.15.72:0/4182714491 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:37:37.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.600+0000 7fab5effd700 1 --2- 172.21.15.72:0/4182714491 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fab600724c0 0x7fab6014d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:37.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.600+0000 7fab5f7fe700 1 --2- 172.21.15.72:0/4182714491 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fab6006a6d0 0x7fab601ed420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:37.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.600+0000 7fab5ffff700 1 -- 172.21.15.72:0/4182714491 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fab6006a6d0 msgr2=0x7fab601ed420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:37.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.600+0000 7fab5ffff700 1 --2- 172.21.15.72:0/4182714491 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fab6006a6d0 0x7fab601ed420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:37.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.600+0000 7fab5ffff700 1 -- 172.21.15.72:0/4182714491 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fab600724c0 msgr2=0x7fab6014d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:37.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.600+0000 7fab5ffff700 1 --2- 172.21.15.72:0/4182714491 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fab600724c0 0x7fab6014d1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:37.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.600+0000 7fab5ffff700 1 -- 172.21.15.72:0/4182714491 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab480094a0 con 0x7fab60151950 2023-07-25T14:37:37.620 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.600+0000 7fab5ffff700 1 --2- 172.21.15.72:0/4182714491 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fab60151950 0x7fab6014a360 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fab600728c0 tx=0x7fab58004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:37.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.601+0000 7fab57fff700 1 -- 172.21.15.72:0/4182714491 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab58012430 con 0x7fab60151950 2023-07-25T14:37:37.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.601+0000 7fab57fff700 1 -- 172.21.15.72:0/4182714491 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab58020070 con 0x7fab60151950 2023-07-25T14:37:37.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.601+0000 7fab57fff700 1 -- 172.21.15.72:0/4182714491 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab58004280 con 0x7fab60151950 2023-07-25T14:37:37.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.601+0000 7fab660f8700 1 -- 172.21.15.72:0/4182714491 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab58009a70 con 0x7fab60151950 2023-07-25T14:37:37.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.601+0000 7fab660f8700 1 -- 172.21.15.72:0/4182714491 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab601ed960 con 0x7fab60151950 2023-07-25T14:37:37.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.602+0000 7fab660f8700 1 -- 172.21.15.72:0/4182714491 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab601ea430 con 0x7fab60151950 2023-07-25T14:37:37.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.602+0000 7fab57fff700 1 -- 172.21.15.72:0/4182714491 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fab580043e0 con 0x7fab60151950 2023-07-25T14:37:37.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.603+0000 7fab57fff700 1 --2- 172.21.15.72:0/4182714491 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fab4006ace0 0x7fab4006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:37.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.603+0000 7fab57fff700 1 -- 172.21.15.72:0/4182714491 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5702+0+0 (secure 0 0 0) 0x7fab58022070 con 0x7fab60151950 2023-07-25T14:37:37.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.603+0000 7fab5f7fe700 1 --2- 172.21.15.72:0/4182714491 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fab4006ace0 0x7fab4006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:37.624 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.603+0000 7fab5f7fe700 1 --2- 172.21.15.72:0/4182714491 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fab4006ace0 0x7fab4006d1a0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fab48009c60 tx=0x7fab48008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:37.625 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.607+0000 7fab57fff700 1 -- 172.21.15.72:0/4182714491 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fab58056270 con 0x7fab60151950 2023-07-25T14:37:37.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.793+0000 7fab660f8700 1 -- 172.21.15.72:0/4182714491 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fab601e9f80 con 0x7fab60151950 2023-07-25T14:37:37.804 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.793+0000 7fab57fff700 1 -- 172.21.15.72:0/4182714491 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v49) v1 ==== 92+0+10 (secure 0 0 0) 0x7fab5802c0a0 con 0x7fab60151950 2023-07-25T14:37:37.805 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 8 2023-07-25T14:37:37.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.795+0000 7fab660f8700 1 -- 172.21.15.72:0/4182714491 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fab4006ace0 msgr2=0x7fab4006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:37.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.795+0000 7fab660f8700 1 --2- 172.21.15.72:0/4182714491 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fab4006ace0 0x7fab4006d1a0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fab48009c60 tx=0x7fab48008040 comp rx=0 tx=0).stop 2023-07-25T14:37:37.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.795+0000 7fab660f8700 1 -- 172.21.15.72:0/4182714491 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fab60151950 msgr2=0x7fab6014a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:37.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.795+0000 7fab660f8700 1 --2- 172.21.15.72:0/4182714491 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fab60151950 0x7fab6014a360 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fab600728c0 tx=0x7fab58004ad0 comp rx=0 tx=0).stop 2023-07-25T14:37:37.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.796+0000 7fab660f8700 1 -- 172.21.15.72:0/4182714491 shutdown_connections 2023-07-25T14:37:37.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.796+0000 7fab660f8700 1 --2- 172.21.15.72:0/4182714491 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fab4006ace0 0x7fab4006d1a0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:37.807 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.796+0000 7fab660f8700 1 --2- 172.21.15.72:0/4182714491 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fab6006a6d0 0x7fab601ed420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:37.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.796+0000 7fab660f8700 1 --2- 172.21.15.72:0/4182714491 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fab60151950 0x7fab6014a360 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:37.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.796+0000 7fab660f8700 1 --2- 172.21.15.72:0/4182714491 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fab600724c0 0x7fab6014d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:37.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.796+0000 7fab660f8700 1 -- 172.21.15.72:0/4182714491 >> 172.21.15.72:0/4182714491 conn(0x7fab600a87e0 msgr2=0x7fab600c45e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:37.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.796+0000 7fab660f8700 1 -- 172.21.15.72:0/4182714491 shutdown_connections 2023-07-25T14:37:37.808 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.796+0000 7fab660f8700 1 -- 172.21.15.72:0/4182714491 wait complete. 2023-07-25T14:37:37.818 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-25T14:37:37.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.930+0000 7fc50c250700 1 Processor -- start 2023-07-25T14:37:37.941 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.930+0000 7fc50c250700 1 -- start start 2023-07-25T14:37:37.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.931+0000 7fc50c250700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc5040662b0 0x7fc50406df50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:37.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.931+0000 7fc50c250700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc504158220 con 0x7fc504151990 2023-07-25T14:37:37.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.931+0000 7fc50c250700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5040abe50 con 0x7fc50406c910 2023-07-25T14:37:37.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.931+0000 7fc50c250700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc50406eba0 con 0x7fc5040662b0 2023-07-25T14:37:37.943 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.931+0000 7fc5097eb700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc5040662b0 0x7fc50406df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:37.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.931+0000 7fc509fec700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fc504151990 0x7fc5040bc4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:34160/0 (socket says 172.21.15.72:34160) 2023-07-25T14:37:37.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.931+0000 7fc5097eb700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc5040662b0 0x7fc50406df50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43426/0 (socket says 172.21.15.72:43426) 2023-07-25T14:37:37.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.931+0000 7fc509fec700 1 -- 172.21.15.72:0/1393366115 learned_addr learned my addr 172.21.15.72:0/1393366115 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:37:37.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.932+0000 7fc5097eb700 1 -- 172.21.15.72:0/1393366115 >> v1:172.21.15.92:6789/0 conn(0x7fc50406c910 legacy=0x7fc50406e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:37.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.932+0000 7fc5097eb700 1 -- 172.21.15.72:0/1393366115 >> v1:172.21.15.72:6789/0 conn(0x7fc504151990 legacy=0x7fc5040bc4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:37.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.932+0000 7fc5097eb700 1 -- 172.21.15.72:0/1393366115 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc50406f360 con 0x7fc5040662b0 2023-07-25T14:37:37.944 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.932+0000 7fc508fea700 1 -- 172.21.15.72:0/1393366115 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1364507549 0 0) 0x7fc504158220 con 0x7fc504151990 2023-07-25T14:37:37.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.932+0000 7fc5097eb700 1 --2- 172.21.15.72:0/1393366115 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc5040662b0 0x7fc50406df50 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fc500009840 tx=0x7fc500009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac5a4e5c8836ba38 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:37.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.932+0000 7fc508fea700 1 -- 172.21.15.72:0/1393366115 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc500011830 con 0x7fc5040662b0 2023-07-25T14:37:37.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.932+0000 7fc508fea700 1 -- 172.21.15.72:0/1393366115 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc500011990 con 0x7fc5040662b0 2023-07-25T14:37:37.945 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.932+0000 7fc508fea700 1 -- 172.21.15.72:0/1393366115 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc500011d20 con 0x7fc5040662b0 2023-07-25T14:37:37.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.933+0000 7fc50c250700 1 -- 172.21.15.72:0/1393366115 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc5040662b0 msgr2=0x7fc50406df50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:37.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.933+0000 7fc50c250700 1 --2- 172.21.15.72:0/1393366115 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc5040662b0 0x7fc50406df50 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fc500009840 tx=0x7fc500009b50 comp rx=0 tx=0).stop 2023-07-25T14:37:37.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.933+0000 7fc50c250700 1 -- 172.21.15.72:0/1393366115 shutdown_connections 2023-07-25T14:37:37.948 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.933+0000 7fc50c250700 1 --2- 172.21.15.72:0/1393366115 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc5040662b0 0x7fc50406df50 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:37.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.933+0000 7fc50c250700 1 -- 172.21.15.72:0/1393366115 >> 172.21.15.72:0/1393366115 conn(0x7fc504071bf0 msgr2=0x7fc50406a190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:37.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.933+0000 7fc50c250700 1 -- 172.21.15.72:0/1393366115 shutdown_connections 2023-07-25T14:37:37.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.933+0000 7fc50c250700 1 -- 172.21.15.72:0/1393366115 wait complete. 2023-07-25T14:37:37.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.934+0000 7fc50c250700 1 Processor -- start 2023-07-25T14:37:37.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.934+0000 7fc50c250700 1 -- start start 2023-07-25T14:37:37.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.935+0000 7fc50c250700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc5040662b0 0x7fc5040c5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:37.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.935+0000 7fc50c250700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc50406c910 0x7fc5040c5580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:37.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.935+0000 7fc50c250700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc504151990 0x7fc504144870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:37.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.935+0000 7fc50c250700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc50414a280 con 0x7fc504151990 2023-07-25T14:37:37.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.935+0000 7fc50c250700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc504145a40 con 0x7fc50406c910 2023-07-25T14:37:37.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.935+0000 7fc50c250700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5041ea640 con 0x7fc5040662b0 2023-07-25T14:37:37.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.935+0000 7fc50a7ed700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc504151990 0x7fc504144870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:37.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.935+0000 7fc50a7ed700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc504151990 0x7fc504144870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43434/0 (socket says 172.21.15.72:43434) 2023-07-25T14:37:37.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.935+0000 7fc50a7ed700 1 -- 172.21.15.72:0/4280795528 learned_addr learned my addr 172.21.15.72:0/4280795528 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:37:37.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.935+0000 7fc5097eb700 1 --2- 172.21.15.72:0/4280795528 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc50406c910 0x7fc5040c5580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:37.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.935+0000 7fc509fec700 1 --2- 172.21.15.72:0/4280795528 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc5040662b0 0x7fc5040c5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:37.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.935+0000 7fc50a7ed700 1 -- 172.21.15.72:0/4280795528 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc5040662b0 msgr2=0x7fc5040c5040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:37.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.935+0000 7fc50a7ed700 1 --2- 172.21.15.72:0/4280795528 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc5040662b0 0x7fc5040c5040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:37.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.935+0000 7fc50a7ed700 1 -- 172.21.15.72:0/4280795528 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc50406c910 msgr2=0x7fc5040c5580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:37.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.935+0000 7fc50a7ed700 1 --2- 172.21.15.72:0/4280795528 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc50406c910 0x7fc5040c5580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:37.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.935+0000 7fc50a7ed700 1 -- 172.21.15.72:0/4280795528 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5000094a0 con 0x7fc504151990 2023-07-25T14:37:37.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.935+0000 7fc50a7ed700 1 --2- 172.21.15.72:0/4280795528 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc504151990 0x7fc504144870 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7fc4fc00cc50 tx=0x7fc4fc00cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:37.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.935+0000 7fc4fa7fc700 1 -- 172.21.15.72:0/4280795528 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4fc003c00 con 0x7fc504151990 2023-07-25T14:37:37.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.935+0000 7fc4fa7fc700 1 -- 172.21.15.72:0/4280795528 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4fc003d60 con 0x7fc504151990 2023-07-25T14:37:37.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.935+0000 7fc50c250700 1 -- 172.21.15.72:0/4280795528 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc50414b230 con 0x7fc504151990 2023-07-25T14:37:37.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.935+0000 7fc4fa7fc700 1 -- 172.21.15.72:0/4280795528 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4fc00aab0 con 0x7fc504151990 2023-07-25T14:37:37.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.935+0000 7fc50c250700 1 -- 172.21.15.72:0/4280795528 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc504145760 con 0x7fc504151990 2023-07-25T14:37:37.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.936+0000 7fc50c250700 1 -- 172.21.15.72:0/4280795528 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5041455c0 con 0x7fc504151990 2023-07-25T14:37:37.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.937+0000 7fc4fa7fc700 1 -- 172.21.15.72:0/4280795528 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc4fc00ac10 con 0x7fc504151990 2023-07-25T14:37:37.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.937+0000 7fc4fa7fc700 1 --2- 172.21.15.72:0/4280795528 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fc4e806acb0 0x7fc4e806d170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:37.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.937+0000 7fc4fa7fc700 1 -- 172.21.15.72:0/4280795528 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5702+0+0 (secure 0 0 0) 0x7fc4fc089220 con 0x7fc504151990 2023-07-25T14:37:37.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.937+0000 7fc509fec700 1 --2- 172.21.15.72:0/4280795528 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fc4e806acb0 0x7fc4e806d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:37.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.938+0000 7fc509fec700 1 --2- 172.21.15.72:0/4280795528 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fc4e806acb0 0x7fc4e806d170 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fc4f4007c40 tx=0x7fc4f4007b90 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:37.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:37.942+0000 7fc4fa7fc700 1 -- 172.21.15.72:0/4280795528 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fc5041455c0 con 0x7fc504151990 2023-07-25T14:37:38.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:38.131+0000 7fc50c250700 1 -- 172.21.15.72:0/4280795528 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc5041455c0 con 0x7fc504151990 2023-07-25T14:37:38.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:38.131+0000 7fc4fa7fc700 1 -- 172.21.15.72:0/4280795528 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v49) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc5041455c0 con 0x7fc504151990 2023-07-25T14:37:38.142 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 1 2023-07-25T14:37:38.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:38.133+0000 7fc50c250700 1 -- 172.21.15.72:0/4280795528 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fc4e806acb0 msgr2=0x7fc4e806d170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:38.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:38.133+0000 7fc50c250700 1 --2- 172.21.15.72:0/4280795528 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fc4e806acb0 0x7fc4e806d170 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fc4f4007c40 tx=0x7fc4f4007b90 comp rx=0 tx=0).stop 2023-07-25T14:37:38.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:38.133+0000 7fc50c250700 1 -- 172.21.15.72:0/4280795528 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc504151990 msgr2=0x7fc504144870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:38.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:38.133+0000 7fc50c250700 1 --2- 172.21.15.72:0/4280795528 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc504151990 0x7fc504144870 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7fc4fc00cc50 tx=0x7fc4fc00cf60 comp rx=0 tx=0).stop 2023-07-25T14:37:38.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:38.133+0000 7fc50c250700 1 -- 172.21.15.72:0/4280795528 shutdown_connections 2023-07-25T14:37:38.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:38.133+0000 7fc50c250700 1 --2- 172.21.15.72:0/4280795528 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fc4e806acb0 0x7fc4e806d170 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:38.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:38.133+0000 7fc50c250700 1 --2- 172.21.15.72:0/4280795528 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc5040662b0 0x7fc5040c5040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:38.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:38.133+0000 7fc50c250700 1 --2- 172.21.15.72:0/4280795528 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc504151990 0x7fc504144870 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:38.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:38.133+0000 7fc50c250700 1 --2- 172.21.15.72:0/4280795528 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc50406c910 0x7fc5040c5580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:38.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:38.133+0000 7fc50c250700 1 -- 172.21.15.72:0/4280795528 >> 172.21.15.72:0/4280795528 conn(0x7fc504071bf0 msgr2=0x7fc50406de50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:38.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:38.133+0000 7fc50c250700 1 -- 172.21.15.72:0/4280795528 shutdown_connections 2023-07-25T14:37:38.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:38.133+0000 7fc50c250700 1 -- 172.21.15.72:0/4280795528 wait complete. 2023-07-25T14:37:38.156 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-07-25T14:37:38.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:38.268+0000 7f4e0a21e700 1 Processor -- start 2023-07-25T14:37:38.279 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:38.268+0000 7f4e0a21e700 1 -- start start 2023-07-25T14:37:38.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:38.269+0000 7f4e0a21e700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f4e040c4930 0x7f4e040c3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:38.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:38.269+0000 7f4e0a21e700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e040c2fe0 con 0x7f4e040724c0 2023-07-25T14:37:38.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:38.269+0000 7f4e0a21e700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e04155070 con 0x7f4e04151950 2023-07-25T14:37:38.282 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:38.269+0000 7f4e0a21e700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e04071a60 con 0x7f4e040c4930 2023-07-25T14:37:38.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:38.269+0000 7f4e02ffd700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f4e040724c0 0x7f4e040c34c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:34176/0 (socket says 172.21.15.72:34176) 2023-07-25T14:37:38.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:38.269+0000 7f4e02ffd700 1 -- 172.21.15.72:0/3190841339 learned_addr learned my addr 172.21.15.72:0/3190841339 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:37:38.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:38.269+0000 7f4e03fff700 1 --2- 172.21.15.72:0/3190841339 >> v2:172.21.15.92:3300/0 conn(0x7f4e040c4930 0x7f4e040c3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:38.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:38.269+0000 7f4e027fc700 1 -- 172.21.15.72:0/3190841339 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1821598162 0 0) 0x7f4e040c2fe0 con 0x7f4e040724c0 2023-07-25T14:37:38.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:38.269+0000 7f4e027fc700 1 -- 172.21.15.72:0/3190841339 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4df00035b0 con 0x7f4e040724c0 2023-07-25T14:37:38.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:38.269+0000 7f4e027fc700 1 -- 172.21.15.72:0/3190841339 <== mon.1 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3511282594 0 0) 0x7f4e04155070 con 0x7f4e04151950 2023-07-25T14:37:38.283 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:38.269+0000 7f4e027fc700 1 -- 172.21.15.72:0/3190841339 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4e040c2fe0 con 0x7f4e04151950 2023-07-25T14:37:38.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:38.269+0000 7f4e027fc700 1 -- 172.21.15.72:0/3190841339 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2584843652 0 0) 0x7f4df00035b0 con 0x7f4e040724c0 2023-07-25T14:37:38.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:38.269+0000 7f4e027fc700 1 -- 172.21.15.72:0/3190841339 >> v2:172.21.15.92:3300/0 conn(0x7f4e040c4930 msgr2=0x7f4e040c3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:38.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:38.269+0000 7f4e027fc700 1 --2- 172.21.15.72:0/3190841339 >> v2:172.21.15.92:3300/0 conn(0x7f4e040c4930 0x7f4e040c3bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:38.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:38.269+0000 7f4e027fc700 1 -- 172.21.15.72:0/3190841339 >> v1:172.21.15.92:6789/0 conn(0x7f4e04151950 legacy=0x7f4e0406a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:38.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:38.269+0000 7f4e027fc700 1 -- 172.21.15.72:0/3190841339 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e040c15c0 con 0x7f4e040724c0 2023-07-25T14:37:38.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:38.269+0000 7f4e027fc700 1 -- 172.21.15.72:0/3190841339 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2559588315 0 0) 0x7f4dec001670 con 0x7f4e040724c0 2023-07-25T14:37:38.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:38.269+0000 7f4e027fc700 1 -- 172.21.15.72:0/3190841339 >> v1:172.21.15.72:6789/0 conn(0x7f4e040724c0 legacy=0x7f4e040c34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:38.284 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:38.270+0000 7f4e027fc700 1 --2- 172.21.15.72:0/3190841339 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4df0003be0 0x7f4df0003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:38.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:38.270+0000 7f4e027fc700 1 --2- 172.21.15.72:0/3190841339 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4df0004850 0x7f4df0004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:38.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:38.270+0000 7f4e027fc700 1 --2- 172.21.15.72:0/3190841339 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4df0005260 0x7f4df000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:38.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:38.270+0000 7f4e027fc700 1 -- 172.21.15.72:0/3190841339 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e04071a60 con 0x7f4df0004850 2023-07-25T14:37:38.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:38.270+0000 7f4e027fc700 1 -- 172.21.15.72:0/3190841339 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4df000c190 con 0x7f4df0005260 2023-07-25T14:37:38.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:38.270+0000 7f4e027fc700 1 -- 172.21.15.72:0/3190841339 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4df000c350 con 0x7f4df0003be0 2023-07-25T14:37:38.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:38.270+0000 7f4e02ffd700 1 --2- 172.21.15.72:0/3190841339 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4df0004850 0x7f4df0004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:38.285 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:38.270+0000 7f4e037fe700 1 --2- 172.21.15.72:0/3190841339 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4df0003be0 0x7f4df0003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:38.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:38.270+0000 7f4e03fff700 1 --2- 172.21.15.72:0/3190841339 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4df0005260 0x7f4df000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:38.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:38.270+0000 7f4e02ffd700 1 -- 172.21.15.72:0/3190841339 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4df0003be0 msgr2=0x7f4df0003fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:38.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:38.270+0000 7f4e02ffd700 1 --2- 172.21.15.72:0/3190841339 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4df0003be0 0x7f4df0003fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:38.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:38.270+0000 7f4e02ffd700 1 -- 172.21.15.72:0/3190841339 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4df0005260 msgr2=0x7f4df000ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:38.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:38.270+0000 7f4e02ffd700 1 --2- 172.21.15.72:0/3190841339 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4df0005260 0x7f4df000ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:38.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:38.270+0000 7f4e02ffd700 1 -- 172.21.15.72:0/3190841339 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4df00035b0 con 0x7f4df0004850 2023-07-25T14:37:38.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:38.270+0000 7f4e037fe700 1 --2- 172.21.15.72:0/3190841339 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4df0003be0 0x7f4df0003fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-25T14:37:38.286 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:38.270+0000 7f4e03fff700 1 --2- 172.21.15.72:0/3190841339 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4df0005260 0x7f4df000ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-25T14:37:38.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:38.270+0000 7f4e03fff700 1 -- 172.21.15.72:0/3190841339 reap_dead start 2023-07-25T14:37:38.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:38.270+0000 7f4e02ffd700 1 --2- 172.21.15.72:0/3190841339 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4df0004850 0x7f4df0004cd0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f4dec00c160 tx=0x7f4df0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51540e8105b98e4f server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:38.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:38.270+0000 7f4e027fc700 1 -- 172.21.15.72:0/3190841339 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dec00cca0 con 0x7f4df0004850 2023-07-25T14:37:38.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:38.270+0000 7f4e027fc700 1 -- 172.21.15.72:0/3190841339 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dec00ce20 con 0x7f4df0004850 2023-07-25T14:37:38.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:38.270+0000 7f4e027fc700 1 -- 172.21.15.72:0/3190841339 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dec005ba0 con 0x7f4df0004850 2023-07-25T14:37:38.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:38.271+0000 7f4e0a21e700 1 -- 172.21.15.72:0/3190841339 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4df0004850 msgr2=0x7f4df0004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:38.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:38.271+0000 7f4e0a21e700 1 --2- 172.21.15.72:0/3190841339 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4df0004850 0x7f4df0004cd0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f4dec00c160 tx=0x7f4df0005880 comp rx=0 tx=0).stop 2023-07-25T14:37:38.287 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:38.271+0000 7f4e0a21e700 1 -- 172.21.15.72:0/3190841339 shutdown_connections 2023-07-25T14:37:38.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:38.271+0000 7f4e0a21e700 1 --2- 172.21.15.72:0/3190841339 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4df0004850 0x7f4df0004cd0 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:38.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:38.271+0000 7f4e0a21e700 1 -- 172.21.15.72:0/3190841339 >> 172.21.15.72:0/3190841339 conn(0x7f4e040a87e0 msgr2=0x7f4e040a8bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:38.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:38.271+0000 7f4e0a21e700 1 -- 172.21.15.72:0/3190841339 shutdown_connections 2023-07-25T14:37:38.288 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:38.271+0000 7f4e0a21e700 1 -- 172.21.15.72:0/3190841339 wait complete. 2023-07-25T14:37:38.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:38.272+0000 7f4e0a21e700 1 Processor -- start 2023-07-25T14:37:38.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:38.272+0000 7f4e0a21e700 1 -- start start 2023-07-25T14:37:38.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:38.273+0000 7f4e0a21e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4df0004850 0x7f4e041ed380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:38.290 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:38.273+0000 7f4e0a21e700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4e041534d0 0x7f4e0406f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:38.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:38.273+0000 7f4e0a21e700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4e041ea8c0 0x7f4e041528f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:38.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:38.273+0000 7f4e0a21e700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e041ed8c0 con 0x7f4df0004850 2023-07-25T14:37:38.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:38.273+0000 7f4e0a21e700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e0414b3c0 con 0x7f4e041534d0 2023-07-25T14:37:38.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:38.273+0000 7f4e0a21e700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e04153960 con 0x7f4e041ea8c0 2023-07-25T14:37:38.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:38.273+0000 7f4e037fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4df0004850 0x7f4e041ed380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:38.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:38.273+0000 7f4e037fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4df0004850 0x7f4e041ed380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43450/0 (socket says 172.21.15.72:43450) 2023-07-25T14:37:38.291 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:38.273+0000 7f4e037fe700 1 -- 172.21.15.72:0/1635330869 learned_addr learned my addr 172.21.15.72:0/1635330869 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:37:38.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:38.274+0000 7f4e02ffd700 1 --2- 172.21.15.72:0/1635330869 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4e041534d0 0x7f4e0406f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:38.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:38.274+0000 7f4e03fff700 1 --2- 172.21.15.72:0/1635330869 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4e041ea8c0 0x7f4e041528f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:38.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:38.274+0000 7f4e037fe700 1 -- 172.21.15.72:0/1635330869 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4e041ea8c0 msgr2=0x7f4e041528f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:38.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:38.274+0000 7f4e037fe700 1 --2- 172.21.15.72:0/1635330869 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4e041ea8c0 0x7f4e041528f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:38.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:38.274+0000 7f4e037fe700 1 -- 172.21.15.72:0/1635330869 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4e041534d0 msgr2=0x7f4e0406f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:38.292 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:38.274+0000 7f4e037fe700 1 --2- 172.21.15.72:0/1635330869 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4e041534d0 0x7f4e0406f420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:38.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:38.274+0000 7f4e037fe700 1 -- 172.21.15.72:0/1635330869 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e04153c40 con 0x7f4df0004850 2023-07-25T14:37:38.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:38.274+0000 7f4e03fff700 1 --2- 172.21.15.72:0/1635330869 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4e041ea8c0 0x7f4e041528f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-25T14:37:38.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:38.274+0000 7f4e037fe700 1 --2- 172.21.15.72:0/1635330869 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4df0004850 0x7f4e041ed380 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f4df400e730 tx=0x7f4df400eaf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:38.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:38.274+0000 7f4dfbfff700 1 -- 172.21.15.72:0/1635330869 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4df4017070 con 0x7f4df0004850 2023-07-25T14:37:38.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:38.274+0000 7f4dfbfff700 1 -- 172.21.15.72:0/1635330869 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4df40052e0 con 0x7f4df0004850 2023-07-25T14:37:38.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:38.274+0000 7f4e0a21e700 1 -- 172.21.15.72:0/1635330869 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e04153f20 con 0x7f4df0004850 2023-07-25T14:37:38.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:38.274+0000 7f4dfbfff700 1 -- 172.21.15.72:0/1635330869 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4df4005450 con 0x7f4df0004850 2023-07-25T14:37:38.293 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:38.274+0000 7f4e0a21e700 1 -- 172.21.15.72:0/1635330869 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e041523d0 con 0x7f4df0004850 2023-07-25T14:37:38.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:38.275+0000 7f4e0a21e700 1 -- 172.21.15.72:0/1635330869 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e0404e470 con 0x7f4df0004850 2023-07-25T14:37:38.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:38.275+0000 7f4dfbfff700 1 -- 172.21.15.72:0/1635330869 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4df4006860 con 0x7f4df0004850 2023-07-25T14:37:38.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:38.276+0000 7f4dfbfff700 1 --2- 172.21.15.72:0/1635330869 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f4de406ace0 0x7f4de406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:38.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:38.276+0000 7f4dfbfff700 1 -- 172.21.15.72:0/1635330869 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5702+0+0 (secure 0 0 0) 0x7f4df4088ab0 con 0x7f4df0004850 2023-07-25T14:37:38.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:38.276+0000 7f4e02ffd700 1 --2- 172.21.15.72:0/1635330869 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f4de406ace0 0x7f4de406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:38.294 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:38.276+0000 7f4e02ffd700 1 --2- 172.21.15.72:0/1635330869 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f4de406ace0 0x7f4de406d1a0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f4dec000c00 tx=0x7f4dec007000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:38.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:38.280+0000 7f4dfbfff700 1 -- 172.21.15.72:0/1635330869 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f4df4053d50 con 0x7f4df0004850 2023-07-25T14:37:38.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:38.470+0000 7f4e0a21e700 1 -- 172.21.15.72:0/1635330869 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f4e040722a0 con 0x7f4df0004850 2023-07-25T14:37:38.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:38.474+0000 7f4dfbfff700 1 -- 172.21.15.72:0/1635330869 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v12)=0 v12) v1 ==== 122+0+0 (secure 0 0 0) 0x7f4df4057370 con 0x7f4df0004850 2023-07-25T14:37:38.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:38.477+0000 7f4e0a21e700 1 -- 172.21.15.72:0/1635330869 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f4de406ace0 msgr2=0x7f4de406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:38.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:38.477+0000 7f4e0a21e700 1 --2- 172.21.15.72:0/1635330869 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f4de406ace0 0x7f4de406d1a0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f4dec000c00 tx=0x7f4dec007000 comp rx=0 tx=0).stop 2023-07-25T14:37:38.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:38.477+0000 7f4e0a21e700 1 -- 172.21.15.72:0/1635330869 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4df0004850 msgr2=0x7f4e041ed380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:38.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:38.477+0000 7f4e0a21e700 1 --2- 172.21.15.72:0/1635330869 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4df0004850 0x7f4e041ed380 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f4df400e730 tx=0x7f4df400eaf0 comp rx=0 tx=0).stop 2023-07-25T14:37:38.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:38.477+0000 7f4e0a21e700 1 -- 172.21.15.72:0/1635330869 shutdown_connections 2023-07-25T14:37:38.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:38.477+0000 7f4e0a21e700 1 --2- 172.21.15.72:0/1635330869 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f4de406ace0 0x7f4de406d1a0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:38.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:38.477+0000 7f4e0a21e700 1 --2- 172.21.15.72:0/1635330869 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4e041ea8c0 0x7f4e041528f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:38.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:38.477+0000 7f4e0a21e700 1 --2- 172.21.15.72:0/1635330869 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4df0004850 0x7f4e041ed380 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:38.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:38.477+0000 7f4e0a21e700 1 --2- 172.21.15.72:0/1635330869 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4e041534d0 0x7f4e0406f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:38.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:38.477+0000 7f4e0a21e700 1 -- 172.21.15.72:0/1635330869 >> 172.21.15.72:0/1635330869 conn(0x7f4e040a87e0 msgr2=0x7f4e040a6600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:38.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:38.477+0000 7f4e0a21e700 1 -- 172.21.15.72:0/1635330869 shutdown_connections 2023-07-25T14:37:38.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:38.477+0000 7f4e0a21e700 1 -- 172.21.15.72:0/1635330869 wait complete. 2023-07-25T14:37:38.499 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-25T14:37:38.500 DEBUG:teuthology.orchestra.run.smithi072:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-25T14:37:38.538 DEBUG:teuthology.orchestra.run.smithi092:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-25T14:37:38.595 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-25T14:37:38.596 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-07-25T14:37:38.596 DEBUG:teuthology.orchestra.run.smithi072:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-25T14:37:38.613 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284104k,nr_inodes=4071026,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=45,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16327 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260520k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 2023-07-25T14:37:38.613 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-07-25T14:37:38.614 DEBUG:teuthology.orchestra.run.smithi092:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-25T14:37:38.634 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284264k,nr_inodes=4071066,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=45,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19843 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260552k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 2023-07-25T14:37:38.635 INFO:tasks.cephfs.cephfs_test_case:[, ] 2023-07-25T14:37:38.635 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-25T14:37:38.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:38.762+0000 7fdaa2f93700 1 Processor -- start 2023-07-25T14:37:38.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:38.762+0000 7fdaa2f93700 1 -- start start 2023-07-25T14:37:38.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:38.763+0000 7fdaa2f93700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fda9c0724c0 0x7fda9c0c34c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:38.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:38.763+0000 7fdaa2f93700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda9c0c2fe0 con 0x7fda9c0c4930 2023-07-25T14:37:38.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:38.763+0000 7fdaa2f93700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda9c155070 con 0x7fda9c151950 2023-07-25T14:37:38.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:38.763+0000 7fdaa2f93700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda9c071a60 con 0x7fda9c0724c0 2023-07-25T14:37:38.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:38.763+0000 7fdaa1530700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fda9c0c4930 0x7fda9c0c3a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:34198/0 (socket says 172.21.15.72:34198) 2023-07-25T14:37:38.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:38.763+0000 7fdaa1530700 1 -- 172.21.15.72:0/2141380662 learned_addr learned my addr 172.21.15.72:0/2141380662 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:37:38.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:38.763+0000 7fda9bfff700 1 --2- 172.21.15.72:0/2141380662 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fda9c0724c0 0x7fda9c0c34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:38.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:38.763+0000 7fda9b7fe700 1 -- 172.21.15.72:0/2141380662 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1326018018 0 0) 0x7fda9c0c2fe0 con 0x7fda9c0c4930 2023-07-25T14:37:38.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:38.763+0000 7fda9b7fe700 1 -- 172.21.15.72:0/2141380662 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fda8c0035b0 con 0x7fda9c0c4930 2023-07-25T14:37:38.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:38.764+0000 7fda9b7fe700 1 -- 172.21.15.72:0/2141380662 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3100304902 0 0) 0x7fda8c0035b0 con 0x7fda9c0c4930 2023-07-25T14:37:38.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:38.764+0000 7fda9b7fe700 1 -- 172.21.15.72:0/2141380662 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fda9c0724c0 msgr2=0x7fda9c0c34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:38.777 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:38.764+0000 7fda9b7fe700 1 --2- 172.21.15.72:0/2141380662 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fda9c0724c0 0x7fda9c0c34c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:38.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:38.764+0000 7fda9b7fe700 1 -- 172.21.15.72:0/2141380662 >> v1:172.21.15.92:6789/0 conn(0x7fda9c151950 legacy=0x7fda9c06a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:38.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:38.764+0000 7fda9b7fe700 1 -- 172.21.15.72:0/2141380662 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda9c0c15c0 con 0x7fda9c0c4930 2023-07-25T14:37:38.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:38.764+0000 7fda9b7fe700 1 -- 172.21.15.72:0/2141380662 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2559588315 0 0) 0x7fda940019f0 con 0x7fda9c0c4930 2023-07-25T14:37:38.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:38.764+0000 7fda9b7fe700 1 -- 172.21.15.72:0/2141380662 >> v1:172.21.15.72:6789/0 conn(0x7fda9c0c4930 legacy=0x7fda9c0c3a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:38.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:38.764+0000 7fda9b7fe700 1 --2- 172.21.15.72:0/2141380662 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fda9c0724c0 0x7fda8c003a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:38.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:38.764+0000 7fda9b7fe700 1 --2- 172.21.15.72:0/2141380662 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fda8c003fb0 0x7fda8c004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:38.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:38.764+0000 7fda9b7fe700 1 --2- 172.21.15.72:0/2141380662 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fda8c004d90 0x7fda8c005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:38.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:38.764+0000 7fda9b7fe700 1 -- 172.21.15.72:0/2141380662 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda9c071a60 con 0x7fda8c004d90 2023-07-25T14:37:38.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:38.764+0000 7fda9b7fe700 1 -- 172.21.15.72:0/2141380662 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda8c00bba0 con 0x7fda8c003fb0 2023-07-25T14:37:38.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:38.764+0000 7fda9b7fe700 1 -- 172.21.15.72:0/2141380662 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda8c00bd60 con 0x7fda9c0724c0 2023-07-25T14:37:38.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:38.764+0000 7fdaa1530700 1 --2- 172.21.15.72:0/2141380662 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fda8c004d90 0x7fda8c005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:38.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:38.764+0000 7fdaa0d2f700 1 --2- 172.21.15.72:0/2141380662 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fda9c0724c0 0x7fda8c003a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:38.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:38.764+0000 7fda9bfff700 1 --2- 172.21.15.72:0/2141380662 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fda8c003fb0 0x7fda8c004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:38.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:38.764+0000 7fdaa1530700 1 -- 172.21.15.72:0/2141380662 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fda9c0724c0 msgr2=0x7fda8c003a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:38.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:38.764+0000 7fdaa1530700 1 --2- 172.21.15.72:0/2141380662 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fda9c0724c0 0x7fda8c003a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:38.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:38.764+0000 7fdaa1530700 1 -- 172.21.15.72:0/2141380662 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fda8c003fb0 msgr2=0x7fda8c004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:38.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:38.764+0000 7fdaa1530700 1 --2- 172.21.15.72:0/2141380662 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fda8c003fb0 0x7fda8c004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:38.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:38.764+0000 7fdaa1530700 1 -- 172.21.15.72:0/2141380662 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda8c0035b0 con 0x7fda8c004d90 2023-07-25T14:37:38.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:38.764+0000 7fdaa1530700 1 --2- 172.21.15.72:0/2141380662 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fda8c004d90 0x7fda8c005210 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fda9400a830 tx=0x7fda8c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e00dca46d28243d6 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:38.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:38.764+0000 7fda9b7fe700 1 -- 172.21.15.72:0/2141380662 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda9400a2f0 con 0x7fda8c004d90 2023-07-25T14:37:38.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:38.764+0000 7fda9b7fe700 1 -- 172.21.15.72:0/2141380662 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda94012620 con 0x7fda8c004d90 2023-07-25T14:37:38.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:38.764+0000 7fda9b7fe700 1 -- 172.21.15.72:0/2141380662 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda940129d0 con 0x7fda8c004d90 2023-07-25T14:37:38.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:38.765+0000 7fdaa2f93700 1 -- 172.21.15.72:0/2141380662 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fda8c004d90 msgr2=0x7fda8c005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:38.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:38.765+0000 7fdaa2f93700 1 --2- 172.21.15.72:0/2141380662 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fda8c004d90 0x7fda8c005210 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fda9400a830 tx=0x7fda8c005880 comp rx=0 tx=0).stop 2023-07-25T14:37:38.781 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:38.765+0000 7fdaa1530700 1 -- 172.21.15.72:0/2141380662 reap_dead start 2023-07-25T14:37:38.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:38.765+0000 7fdaa2f93700 1 -- 172.21.15.72:0/2141380662 shutdown_connections 2023-07-25T14:37:38.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:38.765+0000 7fdaa2f93700 1 -- 172.21.15.72:0/2141380662 >> 172.21.15.72:0/2141380662 conn(0x7fda9c0a87e0 msgr2=0x7fda9c0a8bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:38.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:38.765+0000 7fdaa2f93700 1 -- 172.21.15.72:0/2141380662 shutdown_connections 2023-07-25T14:37:38.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:38.765+0000 7fdaa2f93700 1 -- 172.21.15.72:0/2141380662 wait complete. 2023-07-25T14:37:38.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:38.766+0000 7fdaa2f93700 1 Processor -- start 2023-07-25T14:37:38.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:38.766+0000 7fdaa2f93700 1 -- start start 2023-07-25T14:37:38.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:38.767+0000 7fdaa2f93700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fda9c157780 0x7fda9c14d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:38.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:38.767+0000 7fdaa2f93700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fda9c1567f0 0x7fda9c156c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:38.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:38.767+0000 7fdaa2f93700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fda9c1ecf60 0x7fda9c1ed3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:38.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:38.767+0000 7fdaa2f93700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda9c1563d0 con 0x7fda9c1ecf60 2023-07-25T14:37:38.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:38.767+0000 7fdaa2f93700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda9c0bf8e0 con 0x7fda9c1567f0 2023-07-25T14:37:38.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:38.767+0000 7fdaa2f93700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda9c157190 con 0x7fda9c157780 2023-07-25T14:37:38.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:38.767+0000 7fdaa1530700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fda9c1ecf60 0x7fda9c1ed3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:38.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:38.767+0000 7fdaa1530700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fda9c1ecf60 0x7fda9c1ed3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43474/0 (socket says 172.21.15.72:43474) 2023-07-25T14:37:38.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:38.767+0000 7fdaa1530700 1 -- 172.21.15.72:0/3310373752 learned_addr learned my addr 172.21.15.72:0/3310373752 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:37:38.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:38.767+0000 7fdaa0d2f700 1 --2- 172.21.15.72:0/3310373752 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fda9c157780 0x7fda9c14d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:38.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:38.767+0000 7fda9bfff700 1 --2- 172.21.15.72:0/3310373752 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fda9c1567f0 0x7fda9c156c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:38.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:38.767+0000 7fdaa1530700 1 -- 172.21.15.72:0/3310373752 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fda9c157780 msgr2=0x7fda9c14d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:38.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:38.767+0000 7fdaa1530700 1 --2- 172.21.15.72:0/3310373752 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fda9c157780 0x7fda9c14d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:38.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:38.767+0000 7fdaa1530700 1 -- 172.21.15.72:0/3310373752 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fda9c1567f0 msgr2=0x7fda9c156c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:38.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:38.767+0000 7fdaa1530700 1 --2- 172.21.15.72:0/3310373752 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fda9c1567f0 0x7fda9c156c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:38.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:38.768+0000 7fdaa1530700 1 -- 172.21.15.72:0/3310373752 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda9c14d4a0 con 0x7fda9c1ecf60 2023-07-25T14:37:38.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:38.768+0000 7fda9bfff700 1 --2- 172.21.15.72:0/3310373752 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fda9c1567f0 0x7fda9c156c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-25T14:37:38.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:38.768+0000 7fdaa1530700 1 --2- 172.21.15.72:0/3310373752 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fda9c1ecf60 0x7fda9c1ed3f0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fda9400a800 tx=0x7fda94001d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:38.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:38.768+0000 7fda997fa700 1 -- 172.21.15.72:0/3310373752 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda9400a210 con 0x7fda9c1ecf60 2023-07-25T14:37:38.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:38.768+0000 7fda997fa700 1 -- 172.21.15.72:0/3310373752 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda940017f0 con 0x7fda9c1ecf60 2023-07-25T14:37:38.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:38.768+0000 7fdaa2f93700 1 -- 172.21.15.72:0/3310373752 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda9c0c08b0 con 0x7fda9c1ecf60 2023-07-25T14:37:38.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:38.768+0000 7fda997fa700 1 -- 172.21.15.72:0/3310373752 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda9401e670 con 0x7fda9c1ecf60 2023-07-25T14:37:38.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:38.768+0000 7fdaa2f93700 1 -- 172.21.15.72:0/3310373752 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda9c1582f0 con 0x7fda9c1ecf60 2023-07-25T14:37:38.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:38.769+0000 7fdaa2f93700 1 -- 172.21.15.72:0/3310373752 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda9c156510 con 0x7fda9c1ecf60 2023-07-25T14:37:38.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:38.769+0000 7fda997fa700 1 -- 172.21.15.72:0/3310373752 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fda9401e9e0 con 0x7fda9c1ecf60 2023-07-25T14:37:38.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:38.769+0000 7fda997fa700 1 --2- 172.21.15.72:0/3310373752 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fda8006ace0 0x7fda8006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:38.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:38.770+0000 7fda997fa700 1 -- 172.21.15.72:0/3310373752 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5702+0+0 (secure 0 0 0) 0x7fda9408b440 con 0x7fda9c1ecf60 2023-07-25T14:37:38.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:38.770+0000 7fdaa0d2f700 1 --2- 172.21.15.72:0/3310373752 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fda8006ace0 0x7fda8006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:38.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:38.770+0000 7fdaa0d2f700 1 --2- 172.21.15.72:0/3310373752 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fda8006ace0 0x7fda8006d1a0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fda90000c00 tx=0x7fda90009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:38.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:38.774+0000 7fda997fa700 1 -- 172.21.15.72:0/3310373752 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fda9c156510 con 0x7fda9c1ecf60 2023-07-25T14:37:39.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:39.004+0000 7fdaa2f93700 1 -- 172.21.15.72:0/3310373752 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fda9c156510 con 0x7fda9c1ecf60 2023-07-25T14:37:39.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:39.005+0000 7fda997fa700 1 -- 172.21.15.72:0/3310373752 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+3523 (secure 0 0 0) 0x7fda9c156510 con 0x7fda9c1ecf60 2023-07-25T14:37:39.016 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-25T14:37:39.016 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":26,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5092,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6834/3640355071","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":3640355071},{"type":"v1","addr":"172.21.15.92:6834","nonce":3640355071}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5095,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/936080292","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6833","nonce":936080292},{"type":"v1","addr":"172.21.15.92:6835","nonce":936080292}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5937,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6837/549993324","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6835","nonce":549993324},{"type":"v1","addr":"172.21.15.72:6837","nonce":549993324}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24},{"gid":6054,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6836/1586986779","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":1586986779},{"type":"v1","addr":"172.21.15.72:6836","nonce":1586986779}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26}],"filesystems":[]} 2023-07-25T14:37:39.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:39.007+0000 7fdaa2f93700 1 -- 172.21.15.72:0/3310373752 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fda8006ace0 msgr2=0x7fda8006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:39.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:39.007+0000 7fdaa2f93700 1 --2- 172.21.15.72:0/3310373752 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fda8006ace0 0x7fda8006d1a0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fda90000c00 tx=0x7fda90009040 comp rx=0 tx=0).stop 2023-07-25T14:37:39.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:39.007+0000 7fdaa2f93700 1 -- 172.21.15.72:0/3310373752 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fda9c1ecf60 msgr2=0x7fda9c1ed3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:39.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:39.007+0000 7fdaa2f93700 1 --2- 172.21.15.72:0/3310373752 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fda9c1ecf60 0x7fda9c1ed3f0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fda9400a800 tx=0x7fda94001d80 comp rx=0 tx=0).stop 2023-07-25T14:37:39.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:39.007+0000 7fdaa2f93700 1 -- 172.21.15.72:0/3310373752 shutdown_connections 2023-07-25T14:37:39.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:39.007+0000 7fdaa2f93700 1 --2- 172.21.15.72:0/3310373752 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fda8006ace0 0x7fda8006d1a0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:39.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:39.007+0000 7fdaa2f93700 1 --2- 172.21.15.72:0/3310373752 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fda9c157780 0x7fda9c14d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:39.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:39.007+0000 7fdaa2f93700 1 --2- 172.21.15.72:0/3310373752 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fda9c1ecf60 0x7fda9c1ed3f0 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:39.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:39.007+0000 7fdaa2f93700 1 --2- 172.21.15.72:0/3310373752 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fda9c1567f0 0x7fda9c156c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:39.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:39.007+0000 7fdaa2f93700 1 -- 172.21.15.72:0/3310373752 >> 172.21.15.72:0/3310373752 conn(0x7fda9c0a87e0 msgr2=0x7fda9c06e160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:39.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:39.007+0000 7fdaa2f93700 1 -- 172.21.15.72:0/3310373752 shutdown_connections 2023-07-25T14:37:39.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:39.007+0000 7fdaa2f93700 1 -- 172.21.15.72:0/3310373752 wait complete. 2023-07-25T14:37:39.020 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 26 2023-07-25T14:37:39.030 INFO:tasks.ceph.mds.a:Restarting daemon 2023-07-25T14:37:39.030 INFO:tasks.ceph.mds.a:Stopping old one... 2023-07-25T14:37:39.030 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-07-25T14:37:39.031 INFO:teuthology.orchestra.run:waiting for 300 2023-07-25T14:37:39.031 INFO:tasks.ceph.mds.c:Restarting daemon 2023-07-25T14:37:39.031 INFO:tasks.ceph.mds.c:Stopping old one... 2023-07-25T14:37:39.031 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-07-25T14:37:39.032 INFO:teuthology.orchestra.run:waiting for 300 2023-07-25T14:37:39.032 INFO:tasks.ceph.mds.b:Restarting daemon 2023-07-25T14:37:39.032 INFO:tasks.ceph.mds.b:Stopping old one... 2023-07-25T14:37:39.032 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-07-25T14:37:39.032 INFO:teuthology.orchestra.run:waiting for 300 2023-07-25T14:37:39.033 INFO:tasks.ceph.mds.d:Restarting daemon 2023-07-25T14:37:39.033 INFO:tasks.ceph.mds.d:Stopping old one... 2023-07-25T14:37:39.033 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-07-25T14:37:39.033 INFO:teuthology.orchestra.run:waiting for 300 2023-07-25T14:37:39.039 INFO:tasks.ceph.mds.a:Stopped 2023-07-25T14:37:39.039 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-07-25T14:37:39.040 INFO:tasks.ceph.mds.c:Stopped 2023-07-25T14:37:39.040 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-07-25T14:37:39.044 INFO:tasks.ceph.mds.d:Stopped 2023-07-25T14:37:39.044 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-07-25T14:37:39.045 INFO:tasks.ceph.mds.b:Stopped 2023-07-25T14:37:39.045 DEBUG:teuthology.orchestra.run.smithi092:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-07-25T14:37:39.081 INFO:tasks.ceph.mds.a:Started 2023-07-25T14:37:39.081 DEBUG:teuthology.parallel:result is None 2023-07-25T14:37:39.082 INFO:tasks.ceph.mds.c:Started 2023-07-25T14:37:39.082 DEBUG:teuthology.parallel:result is None 2023-07-25T14:37:39.086 INFO:tasks.ceph.mds.d:Started 2023-07-25T14:37:39.087 DEBUG:teuthology.parallel:result is None 2023-07-25T14:37:39.087 INFO:tasks.ceph.mds.b:Started 2023-07-25T14:37:39.088 DEBUG:teuthology.parallel:result is None 2023-07-25T14:37:39.089 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-07-25T14:37:39.160 INFO:tasks.ceph.mds.a.smithi072.stdout:starting mds.a at 2023-07-25T14:37:39.160 INFO:tasks.ceph.mds.c.smithi072.stdout:starting mds.c at 2023-07-25T14:37:39.178 INFO:tasks.ceph.mds.b.smithi092.stdout:starting mds.b at 2023-07-25T14:37:39.178 INFO:tasks.ceph.mds.d.smithi092.stdout:starting mds.d at 2023-07-25T14:37:39.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:39.206+0000 7f2bfcf0f700 1 Processor -- start 2023-07-25T14:37:39.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:39.206+0000 7f2bfcf0f700 1 -- start start 2023-07-25T14:37:39.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:39.207+0000 7f2bfcf0f700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f2bf80c42e0 0x7f2bf814f160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:39.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:39.207+0000 7f2bfcf0f700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2bf80c27f0 con 0x7f2bf80ad6c0 2023-07-25T14:37:39.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:39.207+0000 7f2bfcf0f700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2bf80c24a0 con 0x7f2bf80c58a0 2023-07-25T14:37:39.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:39.207+0000 7f2bfcf0f700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bf8152ec0 con 0x7f2bf80c42e0 2023-07-25T14:37:39.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:39.207+0000 7f2bf5d9b700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f2bf80ad6c0 0x7f2bf814f6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:34240/0 (socket says 172.21.15.72:34240) 2023-07-25T14:37:39.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:39.207+0000 7f2bf5d9b700 1 -- 172.21.15.72:0/1006376240 learned_addr learned my addr 172.21.15.72:0/1006376240 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:37:39.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:39.207+0000 7f2bf659c700 1 --2- 172.21.15.72:0/1006376240 >> v2:172.21.15.92:3300/0 conn(0x7f2bf80c42e0 0x7f2bf814f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:39.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:39.207+0000 7f2bf559a700 1 -- 172.21.15.72:0/1006376240 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 782392245 0 0) 0x7f2bf80c27f0 con 0x7f2bf80ad6c0 2023-07-25T14:37:39.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:39.207+0000 7f2bf559a700 1 -- 172.21.15.72:0/1006376240 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2be40035b0 con 0x7f2bf80ad6c0 2023-07-25T14:37:39.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:39.207+0000 7f2bf659c700 1 -- 172.21.15.72:0/1006376240 >> v1:172.21.15.92:6789/0 conn(0x7f2bf80c58a0 legacy=0x7f2bf80ac810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:39.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:39.207+0000 7f2bf659c700 1 -- 172.21.15.72:0/1006376240 >> v1:172.21.15.72:6789/0 conn(0x7f2bf80ad6c0 legacy=0x7f2bf814f6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:39.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:39.207+0000 7f2bf659c700 1 -- 172.21.15.72:0/1006376240 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bf8152b70 con 0x7f2bf80c42e0 2023-07-25T14:37:39.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:39.207+0000 7f2bf659c700 1 --2- 172.21.15.72:0/1006376240 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2bf80c42e0 0x7f2bf814f160 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f2bf0009d90 tx=0x7f2bf000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=99763454d8f50887 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:39.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:39.208+0000 7f2bf559a700 1 -- 172.21.15.72:0/1006376240 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bf000e070 con 0x7f2bf80c42e0 2023-07-25T14:37:39.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:39.208+0000 7f2bf559a700 1 -- 172.21.15.72:0/1006376240 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bf000bb20 con 0x7f2bf80c42e0 2023-07-25T14:37:39.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:39.208+0000 7f2bf559a700 1 -- 172.21.15.72:0/1006376240 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bf0012430 con 0x7f2bf80c42e0 2023-07-25T14:37:39.222 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:39.208+0000 7f2bfcf0f700 1 -- 172.21.15.72:0/1006376240 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2bf80c42e0 msgr2=0x7f2bf814f160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:39.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:39.208+0000 7f2bfcf0f700 1 --2- 172.21.15.72:0/1006376240 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2bf80c42e0 0x7f2bf814f160 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f2bf0009d90 tx=0x7f2bf000b330 comp rx=0 tx=0).stop 2023-07-25T14:37:39.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:39.208+0000 7f2bfcf0f700 1 -- 172.21.15.72:0/1006376240 shutdown_connections 2023-07-25T14:37:39.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:39.208+0000 7f2bfcf0f700 1 --2- 172.21.15.72:0/1006376240 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2bf80c42e0 0x7f2bf814f160 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:39.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:39.208+0000 7f2bfcf0f700 1 -- 172.21.15.72:0/1006376240 >> 172.21.15.72:0/1006376240 conn(0x7f2bf806a950 msgr2=0x7f2bf80a94b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:39.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:39.208+0000 7f2bfcf0f700 1 -- 172.21.15.72:0/1006376240 shutdown_connections 2023-07-25T14:37:39.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:39.208+0000 7f2bfcf0f700 1 -- 172.21.15.72:0/1006376240 wait complete. 2023-07-25T14:37:39.223 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:39.210+0000 7f2bfcf0f700 1 Processor -- start 2023-07-25T14:37:39.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:39.210+0000 7f2bfcf0f700 1 -- start start 2023-07-25T14:37:39.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:39.211+0000 7f2bfcf0f700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2bf80ad6c0 0x7f2bf80bffc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:39.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:39.211+0000 7f2bfcf0f700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2bf80c42e0 0x7f2bf81e8f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:39.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:39.211+0000 7f2bfcf0f700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2bf80c58a0 0x7f2bf81eb2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:39.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:39.211+0000 7f2bfcf0f700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bf80c0500 con 0x7f2bf80ad6c0 2023-07-25T14:37:39.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:39.211+0000 7f2bfcf0f700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bf80bfb30 con 0x7f2bf80c58a0 2023-07-25T14:37:39.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:39.211+0000 7f2bfcf0f700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bf80bf520 con 0x7f2bf80c42e0 2023-07-25T14:37:39.224 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:39.211+0000 7f2bf659c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2bf80ad6c0 0x7f2bf80bffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:39.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:39.211+0000 7f2bf659c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2bf80ad6c0 0x7f2bf80bffc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43508/0 (socket says 172.21.15.72:43508) 2023-07-25T14:37:39.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:39.211+0000 7f2bf659c700 1 -- 172.21.15.72:0/3834093321 learned_addr learned my addr 172.21.15.72:0/3834093321 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:37:39.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:39.211+0000 7f2bf659c700 1 -- 172.21.15.72:0/3834093321 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2bf80c42e0 msgr2=0x7f2bf81e8f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:39.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:39.211+0000 7f2bf6d9d700 1 --2- 172.21.15.72:0/3834093321 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2bf80c58a0 0x7f2bf81eb2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:39.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:39.211+0000 7f2bf5d9b700 1 --2- 172.21.15.72:0/3834093321 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2bf80c42e0 0x7f2bf81e8f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:39.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:39.211+0000 7f2bf659c700 1 --2- 172.21.15.72:0/3834093321 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2bf80c42e0 0x7f2bf81e8f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:39.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:39.211+0000 7f2bf659c700 1 -- 172.21.15.72:0/3834093321 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2bf80c58a0 msgr2=0x7f2bf81eb2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:39.225 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:39.211+0000 7f2bf659c700 1 --2- 172.21.15.72:0/3834093321 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2bf80c58a0 0x7f2bf81eb2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:39.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:39.211+0000 7f2bf659c700 1 -- 172.21.15.72:0/3834093321 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bf0009a70 con 0x7f2bf80ad6c0 2023-07-25T14:37:39.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:39.211+0000 7f2bf6d9d700 1 --2- 172.21.15.72:0/3834093321 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2bf80c58a0 0x7f2bf81eb2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-25T14:37:39.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:39.211+0000 7f2bf659c700 1 --2- 172.21.15.72:0/3834093321 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2bf80ad6c0 0x7f2bf80bffc0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f2bf0014040 tx=0x7f2bf0004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:39.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:39.211+0000 7f2beeffd700 1 -- 172.21.15.72:0/3834093321 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bf0012430 con 0x7f2bf80ad6c0 2023-07-25T14:37:39.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:39.211+0000 7f2beeffd700 1 -- 172.21.15.72:0/3834093321 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bf0020070 con 0x7f2bf80ad6c0 2023-07-25T14:37:39.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:39.211+0000 7f2bfcf0f700 1 -- 172.21.15.72:0/3834093321 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bf81ebc20 con 0x7f2bf80ad6c0 2023-07-25T14:37:39.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:39.211+0000 7f2beeffd700 1 -- 172.21.15.72:0/3834093321 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bf0004260 con 0x7f2bf80ad6c0 2023-07-25T14:37:39.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:39.212+0000 7f2bfcf0f700 1 -- 172.21.15.72:0/3834093321 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bf81ebf00 con 0x7f2bf80ad6c0 2023-07-25T14:37:39.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:39.212+0000 7f2bfcf0f700 1 -- 172.21.15.72:0/3834093321 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bf80a8440 con 0x7f2bf80ad6c0 2023-07-25T14:37:39.227 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:39.213+0000 7f2beeffd700 1 -- 172.21.15.72:0/3834093321 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2bf00043c0 con 0x7f2bf80ad6c0 2023-07-25T14:37:39.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:39.213+0000 7f2beeffd700 1 --2- 172.21.15.72:0/3834093321 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f2bd806ace0 0x7f2bd806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:39.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:39.213+0000 7f2beeffd700 1 -- 172.21.15.72:0/3834093321 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5702+0+0 (secure 0 0 0) 0x7f2bf0022070 con 0x7f2bf80ad6c0 2023-07-25T14:37:39.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:39.213+0000 7f2bf5d9b700 1 --2- 172.21.15.72:0/3834093321 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f2bd806ace0 0x7f2bd806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:39.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:39.214+0000 7f2bf5d9b700 1 --2- 172.21.15.72:0/3834093321 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f2bd806ace0 0x7f2bd806d1a0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f2bf80be6e0 tx=0x7f2be0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:39.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:39.217+0000 7f2beeffd700 1 -- 172.21.15.72:0/3834093321 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f2bf00566e0 con 0x7f2bf80ad6c0 2023-07-25T14:37:39.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:39.419+0000 7f2bfcf0f700 1 -- 172.21.15.72:0/3834093321 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f2bf804e470 con 0x7f2bf80ad6c0 2023-07-25T14:37:40.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:40.137+0000 7f2beeffd700 1 -- 172.21.15.72:0/3834093321 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v51) v1 ==== 97+0+0 (secure 0 0 0) 0x7f2bf0059d00 con 0x7f2bf80ad6c0 2023-07-25T14:37:40.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:40.140+0000 7f2bfcf0f700 1 -- 172.21.15.72:0/3834093321 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f2bd806ace0 msgr2=0x7f2bd806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:40.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:40.140+0000 7f2bfcf0f700 1 --2- 172.21.15.72:0/3834093321 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f2bd806ace0 0x7f2bd806d1a0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f2bf80be6e0 tx=0x7f2be0009040 comp rx=0 tx=0).stop 2023-07-25T14:37:40.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:40.140+0000 7f2bfcf0f700 1 -- 172.21.15.72:0/3834093321 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2bf80ad6c0 msgr2=0x7f2bf80bffc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:40.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:40.140+0000 7f2bfcf0f700 1 --2- 172.21.15.72:0/3834093321 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2bf80ad6c0 0x7f2bf80bffc0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f2bf0014040 tx=0x7f2bf0004ad0 comp rx=0 tx=0).stop 2023-07-25T14:37:40.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:40.140+0000 7f2bfcf0f700 1 -- 172.21.15.72:0/3834093321 shutdown_connections 2023-07-25T14:37:40.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:40.140+0000 7f2bfcf0f700 1 --2- 172.21.15.72:0/3834093321 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f2bd806ace0 0x7f2bd806d1a0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:40.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:40.140+0000 7f2bfcf0f700 1 --2- 172.21.15.72:0/3834093321 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2bf80c58a0 0x7f2bf81eb2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:40.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:40.140+0000 7f2bfcf0f700 1 --2- 172.21.15.72:0/3834093321 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2bf80ad6c0 0x7f2bf80bffc0 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:40.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:40.140+0000 7f2bfcf0f700 1 --2- 172.21.15.72:0/3834093321 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2bf80c42e0 0x7f2bf81e8f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:40.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:40.140+0000 7f2bfcf0f700 1 -- 172.21.15.72:0/3834093321 >> 172.21.15.72:0/3834093321 conn(0x7f2bf806a950 msgr2=0x7f2bf80c7980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:40.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:40.140+0000 7f2bfcf0f700 1 -- 172.21.15.72:0/3834093321 shutdown_connections 2023-07-25T14:37:40.153 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:40.140+0000 7f2bfcf0f700 1 -- 172.21.15.72:0/3834093321 wait complete. 2023-07-25T14:37:40.153 INFO:teuthology.orchestra.run.smithi072.stderr: removed all blocklist entries 2023-07-25T14:37:40.169 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-07-25T14:37:40.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:40.284+0000 7f110105b700 1 Processor -- start 2023-07-25T14:37:40.295 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:40.284+0000 7f110105b700 1 -- start start 2023-07-25T14:37:40.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:40.285+0000 7f110105b700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f10fc0c4930 0x7f10fc0c3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:40.298 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:40.285+0000 7f110105b700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10fc0c2fe0 con 0x7f10fc151950 2023-07-25T14:37:40.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:40.285+0000 7f110105b700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10fc155070 con 0x7f10fc0724c0 2023-07-25T14:37:40.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:40.285+0000 7f110105b700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10fc071a60 con 0x7f10fc0c4930 2023-07-25T14:37:40.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:40.285+0000 7f10fad9d700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f10fc151950 0x7f10fc06a190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:34254/0 (socket says 172.21.15.72:34254) 2023-07-25T14:37:40.299 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:40.285+0000 7f10fad9d700 1 -- 172.21.15.72:0/460644752 learned_addr learned my addr 172.21.15.72:0/460644752 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:37:40.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:40.285+0000 7f10fb59e700 1 --2- 172.21.15.72:0/460644752 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f10fc0c4930 0x7f10fc0c3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:40.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:40.285+0000 7f10f9d9b700 1 -- 172.21.15.72:0/460644752 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 254226911 0 0) 0x7f10fc0c2fe0 con 0x7f10fc151950 2023-07-25T14:37:40.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:40.285+0000 7f10f9d9b700 1 -- 172.21.15.72:0/460644752 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f10e80035b0 con 0x7f10fc151950 2023-07-25T14:37:40.300 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:40.286+0000 7f10f9d9b700 1 -- 172.21.15.72:0/460644752 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1542116871 0 0) 0x7f10e80035b0 con 0x7f10fc151950 2023-07-25T14:37:40.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:40.286+0000 7f10f9d9b700 1 -- 172.21.15.72:0/460644752 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f10fc0c4930 msgr2=0x7f10fc0c3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:40.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:40.286+0000 7f10f9d9b700 1 --2- 172.21.15.72:0/460644752 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f10fc0c4930 0x7f10fc0c3bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:40.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:40.286+0000 7f10f9d9b700 1 -- 172.21.15.72:0/460644752 >> v1:172.21.15.92:6789/0 conn(0x7f10fc0724c0 legacy=0x7f10fc0c34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:40.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:40.286+0000 7f10f9d9b700 1 -- 172.21.15.72:0/460644752 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10fc0c15c0 con 0x7f10fc151950 2023-07-25T14:37:40.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:40.286+0000 7f10f9d9b700 1 -- 172.21.15.72:0/460644752 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2559588315 0 0) 0x7f10e4001670 con 0x7f10fc151950 2023-07-25T14:37:40.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:40.286+0000 7f10f9d9b700 1 -- 172.21.15.72:0/460644752 >> v1:172.21.15.72:6789/0 conn(0x7f10fc151950 legacy=0x7f10fc06a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:40.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:40.286+0000 7f10f9d9b700 1 --2- 172.21.15.72:0/460644752 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f10e8003a30 0x7f10e8003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:40.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:40.286+0000 7f10f9d9b700 1 --2- 172.21.15.72:0/460644752 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f10e80043e0 0x7f10e80048b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:40.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:40.286+0000 7f10f9d9b700 1 --2- 172.21.15.72:0/460644752 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f10fc0c4930 0x7f10e80051b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:40.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:40.286+0000 7f10f9d9b700 1 -- 172.21.15.72:0/460644752 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10fc071a60 con 0x7f10e8003a30 2023-07-25T14:37:40.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:40.286+0000 7f10f9d9b700 1 -- 172.21.15.72:0/460644752 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10e800bac0 con 0x7f10e80043e0 2023-07-25T14:37:40.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:40.286+0000 7f10f9d9b700 1 -- 172.21.15.72:0/460644752 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10e800bc80 con 0x7f10fc0c4930 2023-07-25T14:37:40.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:40.286+0000 7f10fad9d700 1 --2- 172.21.15.72:0/460644752 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f10e8003a30 0x7f10e8003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:40.302 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:40.286+0000 7f10fa59c700 1 --2- 172.21.15.72:0/460644752 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f10e80043e0 0x7f10e80048b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:40.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:40.286+0000 7f10fb59e700 1 --2- 172.21.15.72:0/460644752 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f10fc0c4930 0x7f10e80051b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:40.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:40.286+0000 7f10fad9d700 1 -- 172.21.15.72:0/460644752 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f10fc0c4930 msgr2=0x7f10e80051b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:40.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:40.286+0000 7f10fad9d700 1 --2- 172.21.15.72:0/460644752 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f10fc0c4930 0x7f10e80051b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:40.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:40.286+0000 7f10fad9d700 1 -- 172.21.15.72:0/460644752 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f10e80043e0 msgr2=0x7f10e80048b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:40.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:40.286+0000 7f10fad9d700 1 --2- 172.21.15.72:0/460644752 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f10e80043e0 0x7f10e80048b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:40.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:40.286+0000 7f10fad9d700 1 -- 172.21.15.72:0/460644752 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10e80035b0 con 0x7f10e8003a30 2023-07-25T14:37:40.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:40.286+0000 7f10fb59e700 1 --2- 172.21.15.72:0/460644752 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f10fc0c4930 0x7f10e80051b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-25T14:37:40.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:40.286+0000 7f10fa59c700 1 --2- 172.21.15.72:0/460644752 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f10e80043e0 0x7f10e80048b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-25T14:37:40.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:40.286+0000 7f10fad9d700 1 --2- 172.21.15.72:0/460644752 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f10e8003a30 0x7f10e8003e10 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f10e400c2f0 tx=0x7f10e8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=721cd2e7bc436c5c server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:40.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:40.286+0000 7f10f9d9b700 1 -- 172.21.15.72:0/460644752 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10e400ce30 con 0x7f10e8003a30 2023-07-25T14:37:40.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:40.286+0000 7f10f9d9b700 1 -- 172.21.15.72:0/460644752 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10e4005960 con 0x7f10e8003a30 2023-07-25T14:37:40.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:40.286+0000 7f10f9d9b700 1 -- 172.21.15.72:0/460644752 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10e4005cf0 con 0x7f10e8003a30 2023-07-25T14:37:40.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:40.287+0000 7f110105b700 1 -- 172.21.15.72:0/460644752 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f10e8003a30 msgr2=0x7f10e8003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:40.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:40.287+0000 7f110105b700 1 --2- 172.21.15.72:0/460644752 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f10e8003a30 0x7f10e8003e10 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f10e400c2f0 tx=0x7f10e8005880 comp rx=0 tx=0).stop 2023-07-25T14:37:40.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:40.287+0000 7f10fb59e700 1 -- 172.21.15.72:0/460644752 reap_dead start 2023-07-25T14:37:40.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:40.287+0000 7f110105b700 1 -- 172.21.15.72:0/460644752 shutdown_connections 2023-07-25T14:37:40.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:40.287+0000 7f110105b700 1 -- 172.21.15.72:0/460644752 >> 172.21.15.72:0/460644752 conn(0x7f10fc0a87e0 msgr2=0x7f10fc0a8bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:40.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:40.287+0000 7f110105b700 1 -- 172.21.15.72:0/460644752 shutdown_connections 2023-07-25T14:37:40.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:40.287+0000 7f110105b700 1 -- 172.21.15.72:0/460644752 wait complete. 2023-07-25T14:37:40.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:40.288+0000 7f110105b700 1 Processor -- start 2023-07-25T14:37:40.307 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:40.288+0000 7f110105b700 1 -- start start 2023-07-25T14:37:40.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:40.289+0000 7f110105b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f10e8003a30 0x7f10fc1539f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:40.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:40.289+0000 7f110105b700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f10fc155670 0x7f10fc0a5200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:40.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:40.289+0000 7f110105b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f10fc0a5740 0x7f10fc156f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:40.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:40.289+0000 7f110105b700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10fc156120 con 0x7f10e8003a30 2023-07-25T14:37:40.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:40.289+0000 7f110105b700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10fc0a5bf0 con 0x7f10fc0a5740 2023-07-25T14:37:40.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:40.289+0000 7f110105b700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10fc158100 con 0x7f10fc155670 2023-07-25T14:37:40.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:40.289+0000 7f10fad9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f10e8003a30 0x7f10fc1539f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:40.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:40.289+0000 7f10fad9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f10e8003a30 0x7f10fc1539f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43530/0 (socket says 172.21.15.72:43530) 2023-07-25T14:37:40.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:40.289+0000 7f10fad9d700 1 -- 172.21.15.72:0/2765137796 learned_addr learned my addr 172.21.15.72:0/2765137796 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:37:40.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:40.289+0000 7f10fa59c700 1 --2- 172.21.15.72:0/2765137796 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f10fc155670 0x7f10fc0a5200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:40.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:40.289+0000 7f10fb59e700 1 --2- 172.21.15.72:0/2765137796 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f10fc0a5740 0x7f10fc156f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:40.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:40.289+0000 7f10fad9d700 1 -- 172.21.15.72:0/2765137796 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f10fc155670 msgr2=0x7f10fc0a5200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:40.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:40.289+0000 7f10fad9d700 1 --2- 172.21.15.72:0/2765137796 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f10fc155670 0x7f10fc0a5200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:40.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:40.289+0000 7f10fad9d700 1 -- 172.21.15.72:0/2765137796 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f10fc0a5740 msgr2=0x7f10fc156f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:40.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:40.289+0000 7f10fad9d700 1 --2- 172.21.15.72:0/2765137796 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f10fc0a5740 0x7f10fc156f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:40.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:40.289+0000 7f10fad9d700 1 -- 172.21.15.72:0/2765137796 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10fc158350 con 0x7f10e8003a30 2023-07-25T14:37:40.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:40.289+0000 7f10fa59c700 1 --2- 172.21.15.72:0/2765137796 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f10fc155670 0x7f10fc0a5200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-25T14:37:40.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:40.290+0000 7f10fad9d700 1 --2- 172.21.15.72:0/2765137796 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f10e8003a30 0x7f10fc1539f0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f10e4005d80 tx=0x7f10e4001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:40.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:40.290+0000 7f10f37fe700 1 -- 172.21.15.72:0/2765137796 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10e4001660 con 0x7f10e8003a30 2023-07-25T14:37:40.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:40.290+0000 7f10f37fe700 1 -- 172.21.15.72:0/2765137796 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10e4001060 con 0x7f10e8003a30 2023-07-25T14:37:40.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:40.290+0000 7f110105b700 1 -- 172.21.15.72:0/2765137796 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10fc1ea030 con 0x7f10e8003a30 2023-07-25T14:37:40.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:40.290+0000 7f10f37fe700 1 -- 172.21.15.72:0/2765137796 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10e4004ca0 con 0x7f10e8003a30 2023-07-25T14:37:40.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:40.290+0000 7f110105b700 1 -- 172.21.15.72:0/2765137796 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10fc0be0c0 con 0x7f10e8003a30 2023-07-25T14:37:40.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:40.291+0000 7f110105b700 1 -- 172.21.15.72:0/2765137796 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10fc0be280 con 0x7f10e8003a30 2023-07-25T14:37:40.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:40.291+0000 7f10f37fe700 1 -- 172.21.15.72:0/2765137796 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f10e40070d0 con 0x7f10e8003a30 2023-07-25T14:37:40.313 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:40.292+0000 7f10f37fe700 1 --2- 172.21.15.72:0/2765137796 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f10dc06ace0 0x7f10dc06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:40.313 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:40.292+0000 7f10fa59c700 1 --2- 172.21.15.72:0/2765137796 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f10dc06ace0 0x7f10dc06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:40.313 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:40.292+0000 7f10f37fe700 1 -- 172.21.15.72:0/2765137796 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f10e408a960 con 0x7f10e8003a30 2023-07-25T14:37:40.313 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:40.292+0000 7f10fa59c700 1 --2- 172.21.15.72:0/2765137796 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f10dc06ace0 0x7f10dc06d1a0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f10ec007fd0 tx=0x7f10ec009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:40.313 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:40.296+0000 7f10f37fe700 1 -- 172.21.15.72:0/2765137796 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f10e4055c10 con 0x7f10e8003a30 2023-07-25T14:37:40.568 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:40.558+0000 7f110105b700 1 -- 172.21.15.72:0/2765137796 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f10fc06a850 con 0x7f10e8003a30 2023-07-25T14:37:40.569 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:40.558+0000 7f10f37fe700 1 -- 172.21.15.72:0/2765137796 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v15) v1 ==== 80+0+5021 (secure 0 0 0) 0x7f10e4017090 con 0x7f10e8003a30 2023-07-25T14:37:40.569 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-25T14:37:40.569 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-07-25T14:37:40.570 INFO:teuthology.orchestra.run.smithi072.stdout: "auth_dump": [ 2023-07-25T14:37:40.570 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-07-25T14:37:40.570 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "mds.a", 2023-07-25T14:37:40.570 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQCI3b9kxN0HEBAAnEgyrSmMgSmqg52QCBBAXg==", 2023-07-25T14:37:40.570 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-07-25T14:37:40.570 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": "allow", 2023-07-25T14:37:40.570 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow *", 2023-07-25T14:37:40.571 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow *", 2023-07-25T14:37:40.571 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-07-25T14:37:40.571 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-07-25T14:37:40.571 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-07-25T14:37:40.571 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-07-25T14:37:40.571 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "mds.b", 2023-07-25T14:37:40.571 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQCI3b9k9E1QHBAAtQ3+KQ2iWS4MWp8ydNmXwg==", 2023-07-25T14:37:40.571 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-07-25T14:37:40.572 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": "allow", 2023-07-25T14:37:40.572 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow *", 2023-07-25T14:37:40.572 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow *", 2023-07-25T14:37:40.572 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-07-25T14:37:40.572 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-07-25T14:37:40.572 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-07-25T14:37:40.572 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-07-25T14:37:40.573 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "mds.c", 2023-07-25T14:37:40.573 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQCI3b9kKrguFxAAIA8EagIfMcMVROAL3rEetg==", 2023-07-25T14:37:40.573 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-07-25T14:37:40.573 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": "allow", 2023-07-25T14:37:40.573 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow *", 2023-07-25T14:37:40.573 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow *", 2023-07-25T14:37:40.573 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-07-25T14:37:40.573 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-07-25T14:37:40.574 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-07-25T14:37:40.574 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-07-25T14:37:40.574 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "mds.d", 2023-07-25T14:37:40.574 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQCI3b9k0n2mIxAA+ga0Z55EygoBenB3JZfndQ==", 2023-07-25T14:37:40.574 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-07-25T14:37:40.574 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": "allow", 2023-07-25T14:37:40.574 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow *", 2023-07-25T14:37:40.574 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow *", 2023-07-25T14:37:40.575 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-07-25T14:37:40.575 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-07-25T14:37:40.575 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-07-25T14:37:40.575 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-07-25T14:37:40.575 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "osd.0", 2023-07-25T14:37:40.575 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQCL3b9kt8KrNhAATMANux0x8pqETvHcwfe+jA==", 2023-07-25T14:37:40.575 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-07-25T14:37:40.576 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow profile osd", 2023-07-25T14:37:40.576 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile osd", 2023-07-25T14:37:40.576 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-07-25T14:37:40.576 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-07-25T14:37:40.576 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-07-25T14:37:40.576 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-07-25T14:37:40.576 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "osd.1", 2023-07-25T14:37:40.577 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQCO3b9kKZqoNRAAPhEAV8i8LjCRlsHUWWzgGg==", 2023-07-25T14:37:40.577 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-07-25T14:37:40.577 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow profile osd", 2023-07-25T14:37:40.577 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile osd", 2023-07-25T14:37:40.577 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-07-25T14:37:40.577 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-07-25T14:37:40.577 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-07-25T14:37:40.577 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-07-25T14:37:40.578 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "osd.2", 2023-07-25T14:37:40.578 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQCR3b9kOgUONRAA05jvcIlbYBtNnlMryBUsEw==", 2023-07-25T14:37:40.578 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-07-25T14:37:40.578 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow profile osd", 2023-07-25T14:37:40.578 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile osd", 2023-07-25T14:37:40.578 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-07-25T14:37:40.578 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-07-25T14:37:40.578 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-07-25T14:37:40.579 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-07-25T14:37:40.579 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "osd.3", 2023-07-25T14:37:40.579 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQCU3b9kiCNMNBAAIGnnWPs/tzjDMMViNWOgpg==", 2023-07-25T14:37:40.579 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-07-25T14:37:40.579 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow profile osd", 2023-07-25T14:37:40.579 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile osd", 2023-07-25T14:37:40.579 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-07-25T14:37:40.580 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-07-25T14:37:40.580 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-07-25T14:37:40.580 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-07-25T14:37:40.580 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "osd.4", 2023-07-25T14:37:40.580 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQCa3b9kOuNDORAAhqs3jZIKDxp08d/R0MbnrQ==", 2023-07-25T14:37:40.580 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-07-25T14:37:40.580 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow profile osd", 2023-07-25T14:37:40.580 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile osd", 2023-07-25T14:37:40.581 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-07-25T14:37:40.581 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-07-25T14:37:40.581 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-07-25T14:37:40.581 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-07-25T14:37:40.581 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "osd.5", 2023-07-25T14:37:40.581 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQCd3b9kMvn/OBAAj8R00HLAH23ld0/0A6e5XA==", 2023-07-25T14:37:40.581 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-07-25T14:37:40.581 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow profile osd", 2023-07-25T14:37:40.582 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile osd", 2023-07-25T14:37:40.582 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-07-25T14:37:40.582 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-07-25T14:37:40.582 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-07-25T14:37:40.582 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-07-25T14:37:40.582 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "osd.6", 2023-07-25T14:37:40.582 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQCg3b9kXWwUOBAAKyB6jtX1TMOe4daeeVH67A==", 2023-07-25T14:37:40.583 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-07-25T14:37:40.583 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow profile osd", 2023-07-25T14:37:40.583 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile osd", 2023-07-25T14:37:40.583 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-07-25T14:37:40.583 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-07-25T14:37:40.583 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-07-25T14:37:40.583 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-07-25T14:37:40.584 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "osd.7", 2023-07-25T14:37:40.584 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQCj3b9kp0GXNxAAMZEzI57maI7h3DJpHtlGyg==", 2023-07-25T14:37:40.584 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-07-25T14:37:40.584 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow profile osd", 2023-07-25T14:37:40.585 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile osd", 2023-07-25T14:37:40.585 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-07-25T14:37:40.585 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-07-25T14:37:40.586 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-07-25T14:37:40.586 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-07-25T14:37:40.586 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "client.0", 2023-07-25T14:37:40.586 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQCI3b9k9P3nJxAAF+MNeILdw3WF8ZQhKpISew==", 2023-07-25T14:37:40.586 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-07-25T14:37:40.586 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": "allow", 2023-07-25T14:37:40.586 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow r", 2023-07-25T14:37:40.587 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-07-25T14:37:40.587 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-07-25T14:37:40.587 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-07-25T14:37:40.587 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-07-25T14:37:40.587 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "client.1", 2023-07-25T14:37:40.587 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQCI3b9kRPMxKxAAACbj386PGidKwcHoe2J57A==", 2023-07-25T14:37:40.588 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-07-25T14:37:40.588 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": "allow", 2023-07-25T14:37:40.588 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow r", 2023-07-25T14:37:40.588 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow rw pool=cephfs2_data" 2023-07-25T14:37:40.588 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-07-25T14:37:40.588 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-07-25T14:37:40.588 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-07-25T14:37:40.589 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "client.admin", 2023-07-25T14:37:40.589 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQCH3b9kWMr/LBAA5l6Yw5McXUOEpgcrhT86RQ==", 2023-07-25T14:37:40.589 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-07-25T14:37:40.589 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": "allow *", 2023-07-25T14:37:40.589 INFO:teuthology.orchestra.run.smithi072.stdout: "mgr": "allow *", 2023-07-25T14:37:40.589 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow *", 2023-07-25T14:37:40.589 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-07-25T14:37:40.589 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-07-25T14:37:40.590 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-07-25T14:37:40.590 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-07-25T14:37:40.590 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "client.testuser", 2023-07-25T14:37:40.590 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQAY3r9kYc2CKRAA4brFhJzECz/5INyzrXGiVw==", 2023-07-25T14:37:40.590 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-07-25T14:37:40.590 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": "allow rw fsname=cephfs", 2023-07-25T14:37:40.590 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow r fsname=cephfs", 2023-07-25T14:37:40.590 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-07-25T14:37:40.591 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-07-25T14:37:40.591 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-07-25T14:37:40.591 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-07-25T14:37:40.591 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "mgr.x", 2023-07-25T14:37:40.591 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQCI3b9kGgynDBAA7I0mBcwS0zmXAN9uxn4LCQ==", 2023-07-25T14:37:40.591 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-07-25T14:37:40.591 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": "allow *", 2023-07-25T14:37:40.591 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile mgr", 2023-07-25T14:37:40.592 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-07-25T14:37:40.592 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-07-25T14:37:40.592 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-07-25T14:37:40.592 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-07-25T14:37:40.592 INFO:teuthology.orchestra.run.smithi072.stdout: "entity": "mgr.y", 2023-07-25T14:37:40.592 INFO:teuthology.orchestra.run.smithi072.stdout: "key": "AQCI3b9k5aWABxAAzNuS36Orii6Hxg/6h9cx8Q==", 2023-07-25T14:37:40.592 INFO:teuthology.orchestra.run.smithi072.stdout: "caps": { 2023-07-25T14:37:40.593 INFO:teuthology.orchestra.run.smithi072.stdout: "mds": "allow *", 2023-07-25T14:37:40.593 INFO:teuthology.orchestra.run.smithi072.stdout: "mon": "allow profile mgr", 2023-07-25T14:37:40.593 INFO:teuthology.orchestra.run.smithi072.stdout: "osd": "allow *" 2023-07-25T14:37:40.593 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-07-25T14:37:40.593 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-07-25T14:37:40.593 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-07-25T14:37:40.593 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-07-25T14:37:40.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:40.560+0000 7f110105b700 1 -- 172.21.15.72:0/2765137796 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f10dc06ace0 msgr2=0x7f10dc06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:40.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:40.560+0000 7f110105b700 1 --2- 172.21.15.72:0/2765137796 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f10dc06ace0 0x7f10dc06d1a0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f10ec007fd0 tx=0x7f10ec009040 comp rx=0 tx=0).stop 2023-07-25T14:37:40.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:40.560+0000 7f110105b700 1 -- 172.21.15.72:0/2765137796 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f10e8003a30 msgr2=0x7f10fc1539f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:40.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:40.560+0000 7f110105b700 1 --2- 172.21.15.72:0/2765137796 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f10e8003a30 0x7f10fc1539f0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f10e4005d80 tx=0x7f10e4001a00 comp rx=0 tx=0).stop 2023-07-25T14:37:40.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:40.560+0000 7f110105b700 1 -- 172.21.15.72:0/2765137796 shutdown_connections 2023-07-25T14:37:40.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:40.560+0000 7f110105b700 1 --2- 172.21.15.72:0/2765137796 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f10dc06ace0 0x7f10dc06d1a0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:40.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:40.560+0000 7f110105b700 1 --2- 172.21.15.72:0/2765137796 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f10fc0a5740 0x7f10fc156f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:40.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:40.560+0000 7f110105b700 1 --2- 172.21.15.72:0/2765137796 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f10e8003a30 0x7f10fc1539f0 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:40.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:40.560+0000 7f110105b700 1 --2- 172.21.15.72:0/2765137796 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f10fc155670 0x7f10fc0a5200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:40.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:40.560+0000 7f110105b700 1 -- 172.21.15.72:0/2765137796 >> 172.21.15.72:0/2765137796 conn(0x7f10fc0a87e0 msgr2=0x7f10fc0c53e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:40.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:40.560+0000 7f110105b700 1 -- 172.21.15.72:0/2765137796 shutdown_connections 2023-07-25T14:37:40.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:40.560+0000 7f110105b700 1 -- 172.21.15.72:0/2765137796 wait complete. 2023-07-25T14:37:40.597 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.testuser 2023-07-25T14:37:40.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:40.706+0000 7f310f276700 1 Processor -- start 2023-07-25T14:37:40.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:40.706+0000 7f310f276700 1 -- start start 2023-07-25T14:37:40.718 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:40.707+0000 7f310f276700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3108072140 0x7f310806a190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:40.718 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:40.707+0000 7f310f276700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31081553e0 con 0x7f31080bf6a0 2023-07-25T14:37:40.718 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:40.707+0000 7f310f276700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3108154640 con 0x7f31080c0370 2023-07-25T14:37:40.718 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:40.707+0000 7f310f276700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31080660c0 con 0x7f3108072140 2023-07-25T14:37:40.718 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:40.707+0000 7f310d012700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f31080bf6a0 0x7f31081515a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:34274/0 (socket says 172.21.15.72:34274) 2023-07-25T14:37:40.718 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:40.707+0000 7f310d012700 1 -- 172.21.15.72:0/2377006589 learned_addr learned my addr 172.21.15.72:0/2377006589 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:37:40.720 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:40.707+0000 7f310c811700 1 --2- 172.21.15.72:0/2377006589 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3108072140 0x7f310806a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:40.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:40.707+0000 7f30fffff700 1 -- 172.21.15.72:0/2377006589 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2548630035 0 0) 0x7f31081553e0 con 0x7f31080bf6a0 2023-07-25T14:37:40.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:40.707+0000 7f30fffff700 1 -- 172.21.15.72:0/2377006589 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f30f40035b0 con 0x7f31080bf6a0 2023-07-25T14:37:40.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:40.708+0000 7f30fffff700 1 -- 172.21.15.72:0/2377006589 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3745973926 0 0) 0x7f30f40035b0 con 0x7f31080bf6a0 2023-07-25T14:37:40.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:40.708+0000 7f30fffff700 1 -- 172.21.15.72:0/2377006589 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3108072140 msgr2=0x7f310806a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:40.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:40.708+0000 7f30fffff700 1 --2- 172.21.15.72:0/2377006589 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3108072140 0x7f310806a190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:40.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:40.708+0000 7f30fffff700 1 -- 172.21.15.72:0/2377006589 >> v1:172.21.15.92:6789/0 conn(0x7f31080c0370 legacy=0x7f310806a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:40.721 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:40.708+0000 7f30fffff700 1 -- 172.21.15.72:0/2377006589 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3108154920 con 0x7f31080bf6a0 2023-07-25T14:37:40.722 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:40.708+0000 7f30fffff700 1 -- 172.21.15.72:0/2377006589 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2559588315 0 0) 0x7f30f8001670 con 0x7f31080bf6a0 2023-07-25T14:37:40.722 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:40.708+0000 7f30fffff700 1 -- 172.21.15.72:0/2377006589 >> v1:172.21.15.72:6789/0 conn(0x7f31080bf6a0 legacy=0x7f31081515a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:40.722 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:40.708+0000 7f30fffff700 1 --2- 172.21.15.72:0/2377006589 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f30f4003a30 0x7f30f4003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:40.722 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:40.708+0000 7f30fffff700 1 --2- 172.21.15.72:0/2377006589 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3108072140 0x7f30f4004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:40.722 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:40.708+0000 7f30fffff700 1 --2- 172.21.15.72:0/2377006589 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f30f4004d90 0x7f30f4005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:40.722 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:40.708+0000 7f30fffff700 1 -- 172.21.15.72:0/2377006589 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30f400bac0 con 0x7f30f4004d90 2023-07-25T14:37:40.722 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:40.708+0000 7f30fffff700 1 -- 172.21.15.72:0/2377006589 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30f400bc30 con 0x7f30f4003a30 2023-07-25T14:37:40.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:40.708+0000 7f30fffff700 1 -- 172.21.15.72:0/2377006589 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30f400bdf0 con 0x7f3108072140 2023-07-25T14:37:40.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:40.708+0000 7f310d813700 1 --2- 172.21.15.72:0/2377006589 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f30f4004d90 0x7f30f4005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:40.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:40.708+0000 7f310d012700 1 --2- 172.21.15.72:0/2377006589 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f30f4003a30 0x7f30f4003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:40.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:40.708+0000 7f310c811700 1 --2- 172.21.15.72:0/2377006589 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3108072140 0x7f30f4004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:40.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:40.708+0000 7f310d813700 1 -- 172.21.15.72:0/2377006589 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3108072140 msgr2=0x7f30f4004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:40.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:40.708+0000 7f310d813700 1 --2- 172.21.15.72:0/2377006589 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3108072140 0x7f30f4004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:40.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:40.708+0000 7f310d813700 1 -- 172.21.15.72:0/2377006589 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f30f4003a30 msgr2=0x7f30f4003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:40.723 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:40.708+0000 7f310d813700 1 --2- 172.21.15.72:0/2377006589 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f30f4003a30 0x7f30f4003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:40.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:40.708+0000 7f310d813700 1 -- 172.21.15.72:0/2377006589 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30f40035b0 con 0x7f30f4004d90 2023-07-25T14:37:40.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:40.708+0000 7f310d813700 1 --2- 172.21.15.72:0/2377006589 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f30f4004d90 0x7f30f4005210 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f310000c210 tx=0x7f30f4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=911b161ace275a3 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:40.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:40.708+0000 7f30fffff700 1 -- 172.21.15.72:0/2377006589 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3100001e70 con 0x7f30f4004d90 2023-07-25T14:37:40.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:40.708+0000 7f30fffff700 1 -- 172.21.15.72:0/2377006589 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f310000cdb0 con 0x7f30f4004d90 2023-07-25T14:37:40.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:40.708+0000 7f30fffff700 1 -- 172.21.15.72:0/2377006589 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3100012660 con 0x7f30f4004d90 2023-07-25T14:37:40.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:40.709+0000 7f310f276700 1 -- 172.21.15.72:0/2377006589 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f30f4004d90 msgr2=0x7f30f4005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:40.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:40.709+0000 7f310f276700 1 --2- 172.21.15.72:0/2377006589 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f30f4004d90 0x7f30f4005210 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f310000c210 tx=0x7f30f4005880 comp rx=0 tx=0).stop 2023-07-25T14:37:40.724 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:40.709+0000 7f310d813700 1 -- 172.21.15.72:0/2377006589 reap_dead start 2023-07-25T14:37:40.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:40.709+0000 7f310f276700 1 -- 172.21.15.72:0/2377006589 shutdown_connections 2023-07-25T14:37:40.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:40.709+0000 7f310f276700 1 -- 172.21.15.72:0/2377006589 >> 172.21.15.72:0/2377006589 conn(0x7f310806dd10 msgr2=0x7f310806e120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:40.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:40.709+0000 7f310f276700 1 -- 172.21.15.72:0/2377006589 shutdown_connections 2023-07-25T14:37:40.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:40.709+0000 7f310f276700 1 -- 172.21.15.72:0/2377006589 wait complete. 2023-07-25T14:37:40.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:40.710+0000 7f310f276700 1 Processor -- start 2023-07-25T14:37:40.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:40.710+0000 7f310f276700 1 -- start start 2023-07-25T14:37:40.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:40.711+0000 7f310f276700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f30f4004d90 0x7f31081539b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:40.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:40.711+0000 7f310f276700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f31081df630 0x7f3108144800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:40.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:40.711+0000 7f310f276700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3108144d40 0x7f31081ecc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:40.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:40.711+0000 7f310f276700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f310814e560 con 0x7f3108144d40 2023-07-25T14:37:40.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:40.711+0000 7f310f276700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f310814dd00 con 0x7f30f4004d90 2023-07-25T14:37:40.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:40.711+0000 7f310f276700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f310814da20 con 0x7f31081df630 2023-07-25T14:37:40.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:40.711+0000 7f310d813700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3108144d40 0x7f31081ecc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:40.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:40.711+0000 7f310d813700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3108144d40 0x7f31081ecc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43554/0 (socket says 172.21.15.72:43554) 2023-07-25T14:37:40.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:40.711+0000 7f310d813700 1 -- 172.21.15.72:0/588938714 learned_addr learned my addr 172.21.15.72:0/588938714 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:37:40.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:40.711+0000 7f310d012700 1 --2- 172.21.15.72:0/588938714 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f30f4004d90 0x7f31081539b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:40.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:40.711+0000 7f310c811700 1 --2- 172.21.15.72:0/588938714 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f31081df630 0x7f3108144800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:40.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:40.711+0000 7f310d813700 1 -- 172.21.15.72:0/588938714 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f31081df630 msgr2=0x7f3108144800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:40.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:40.711+0000 7f310d813700 1 --2- 172.21.15.72:0/588938714 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f31081df630 0x7f3108144800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:40.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:40.711+0000 7f310d813700 1 -- 172.21.15.72:0/588938714 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f30f4004d90 msgr2=0x7f31081539b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:40.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:40.711+0000 7f310d813700 1 --2- 172.21.15.72:0/588938714 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f30f4004d90 0x7f31081539b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:40.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:40.711+0000 7f310d813700 1 -- 172.21.15.72:0/588938714 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31081dea30 con 0x7f3108144d40 2023-07-25T14:37:40.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:40.711+0000 7f310d813700 1 --2- 172.21.15.72:0/588938714 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3108144d40 0x7f31081ecc10 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f30f400bc00 tx=0x7f3100001490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:40.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:40.711+0000 7f30fdffb700 1 -- 172.21.15.72:0/588938714 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3100003e10 con 0x7f3108144d40 2023-07-25T14:37:40.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:40.712+0000 7f30fdffb700 1 -- 172.21.15.72:0/588938714 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31000050c0 con 0x7f3108144d40 2023-07-25T14:37:40.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:40.712+0000 7f310f276700 1 -- 172.21.15.72:0/588938714 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f310814e800 con 0x7f3108144d40 2023-07-25T14:37:40.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:40.712+0000 7f30fdffb700 1 -- 172.21.15.72:0/588938714 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31000054b0 con 0x7f3108144d40 2023-07-25T14:37:40.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:40.712+0000 7f310f276700 1 -- 172.21.15.72:0/588938714 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3108153ef0 con 0x7f3108144d40 2023-07-25T14:37:40.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:40.713+0000 7f310f276700 1 -- 172.21.15.72:0/588938714 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f310804e470 con 0x7f3108144d40 2023-07-25T14:37:40.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:40.713+0000 7f30fdffb700 1 -- 172.21.15.72:0/588938714 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3100023070 con 0x7f3108144d40 2023-07-25T14:37:40.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:40.714+0000 7f30fdffb700 1 --2- 172.21.15.72:0/588938714 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f30ec06ace0 0x7f30ec06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:40.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:40.714+0000 7f310d012700 1 --2- 172.21.15.72:0/588938714 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f30ec06ace0 0x7f30ec06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:40.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:40.714+0000 7f30fdffb700 1 -- 172.21.15.72:0/588938714 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f310008aab0 con 0x7f3108144d40 2023-07-25T14:37:40.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:40.714+0000 7f310d012700 1 --2- 172.21.15.72:0/588938714 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f30ec06ace0 0x7f30ec06d1a0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f30f8000c00 tx=0x7f30f8000f80 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:40.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:40.718+0000 7f30fdffb700 1 -- 172.21.15.72:0/588938714 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f3100056000 con 0x7f3108144d40 2023-07-25T14:37:40.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:40.980+0000 7f310f276700 1 -- 172.21.15.72:0/588938714 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.testuser"} v 0) v1 -- 0x7f310806f480 con 0x7f3108144d40 2023-07-25T14:37:40.994 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:40.984+0000 7f30fdffb700 1 -- 172.21.15.72:0/588938714 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.testuser"}]=0 v16) v1 ==== 85+0+0 (secure 0 0 0) 0x7f3100059620 con 0x7f3108144d40 2023-07-25T14:37:40.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:40.986+0000 7f310f276700 1 -- 172.21.15.72:0/588938714 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f30ec06ace0 msgr2=0x7f30ec06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:40.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:40.986+0000 7f310f276700 1 --2- 172.21.15.72:0/588938714 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f30ec06ace0 0x7f30ec06d1a0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f30f8000c00 tx=0x7f30f8000f80 comp rx=0 tx=0).stop 2023-07-25T14:37:40.997 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:40.986+0000 7f310f276700 1 -- 172.21.15.72:0/588938714 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3108144d40 msgr2=0x7f31081ecc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:40.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:40.986+0000 7f310f276700 1 --2- 172.21.15.72:0/588938714 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3108144d40 0x7f31081ecc10 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f30f400bc00 tx=0x7f3100001490 comp rx=0 tx=0).stop 2023-07-25T14:37:40.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:40.986+0000 7f310f276700 1 -- 172.21.15.72:0/588938714 shutdown_connections 2023-07-25T14:37:40.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:40.986+0000 7f310f276700 1 --2- 172.21.15.72:0/588938714 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f30ec06ace0 0x7f30ec06d1a0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:40.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:40.986+0000 7f310f276700 1 --2- 172.21.15.72:0/588938714 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3108144d40 0x7f31081ecc10 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:40.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:40.986+0000 7f310f276700 1 --2- 172.21.15.72:0/588938714 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f30f4004d90 0x7f31081539b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:40.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:40.986+0000 7f310f276700 1 --2- 172.21.15.72:0/588938714 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f31081df630 0x7f3108144800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:40.998 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:40.986+0000 7f310f276700 1 -- 172.21.15.72:0/588938714 >> 172.21.15.72:0/588938714 conn(0x7f310806dd10 msgr2=0x7f3108152dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:40.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:40.986+0000 7f310f276700 1 -- 172.21.15.72:0/588938714 shutdown_connections 2023-07-25T14:37:40.999 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:40.986+0000 7f310f276700 1 -- 172.21.15.72:0/588938714 wait complete. 2023-07-25T14:37:41.009 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-25T14:37:41.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.118+0000 7f9d62f9d700 1 Processor -- start 2023-07-25T14:37:41.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.118+0000 7f9d62f9d700 1 -- start start 2023-07-25T14:37:41.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.119+0000 7f9d62f9d700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9d5c0a9cc0 0x7f9d5c1525e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:41.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.119+0000 7f9d62f9d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f9d5c0bb0b0 0x7f9d5c152b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:41.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.119+0000 7f9d62f9d700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d5c0c5890 con 0x7f9d5c14f810 2023-07-25T14:37:41.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.119+0000 7f9d62f9d700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d5c152150 con 0x7f9d5c0bb0b0 2023-07-25T14:37:41.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.119+0000 7f9d62f9d700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d5c14fbf0 con 0x7f9d5c0a9cc0 2023-07-25T14:37:41.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.119+0000 7f9d6153a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f9d5c0bb0b0 0x7f9d5c152b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:41.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.119+0000 7f9d60d39700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f9d5c14f810 0x7f9d5c0c4370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:34294/0 (socket says 172.21.15.72:34294) 2023-07-25T14:37:41.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.119+0000 7f9d60d39700 1 -- 172.21.15.72:0/799147690 learned_addr learned my addr 172.21.15.72:0/799147690 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:37:41.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.119+0000 7f9d5bfff700 1 --2- 172.21.15.72:0/799147690 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9d5c0a9cc0 0x7f9d5c1525e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:41.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.120+0000 7f9d6153a700 1 -- 172.21.15.72:0/799147690 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9d5c0a9cc0 msgr2=0x7f9d5c1525e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:41.132 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.120+0000 7f9d6153a700 1 --2- 172.21.15.72:0/799147690 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9d5c0a9cc0 0x7f9d5c1525e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:41.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.120+0000 7f9d6153a700 1 -- 172.21.15.72:0/799147690 >> v1:172.21.15.72:6789/0 conn(0x7f9d5c14f810 legacy=0x7f9d5c0c4370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:41.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.120+0000 7f9d5b7fe700 1 -- 172.21.15.72:0/799147690 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3821235796 0 0) 0x7f9d5c0c5890 con 0x7f9d5c14f810 2023-07-25T14:37:41.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.120+0000 7f9d6153a700 1 -- 172.21.15.72:0/799147690 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d5c1566a0 con 0x7f9d5c0bb0b0 2023-07-25T14:37:41.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.120+0000 7f9d6153a700 1 --2- 172.21.15.72:0/799147690 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9d5c0bb0b0 0x7f9d5c152b20 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f9d54009d90 tx=0x7f9d5400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a14a19e78ac25e7 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:41.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.120+0000 7f9d5b7fe700 1 -- 172.21.15.72:0/799147690 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d5400e070 con 0x7f9d5c0bb0b0 2023-07-25T14:37:41.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.122+0000 7f9d5b7fe700 1 -- 172.21.15.72:0/799147690 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d5400bb20 con 0x7f9d5c0bb0b0 2023-07-25T14:37:41.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.122+0000 7f9d5b7fe700 1 -- 172.21.15.72:0/799147690 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d54012430 con 0x7f9d5c0bb0b0 2023-07-25T14:37:41.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.123+0000 7f9d62f9d700 1 -- 172.21.15.72:0/799147690 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9d5c0bb0b0 msgr2=0x7f9d5c152b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:41.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.123+0000 7f9d62f9d700 1 --2- 172.21.15.72:0/799147690 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9d5c0bb0b0 0x7f9d5c152b20 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f9d54009d90 tx=0x7f9d5400b330 comp rx=0 tx=0).stop 2023-07-25T14:37:41.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.123+0000 7f9d62f9d700 1 -- 172.21.15.72:0/799147690 shutdown_connections 2023-07-25T14:37:41.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.123+0000 7f9d62f9d700 1 --2- 172.21.15.72:0/799147690 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9d5c0bb0b0 0x7f9d5c152b20 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:41.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.123+0000 7f9d62f9d700 1 --2- 172.21.15.72:0/799147690 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9d5c0a9cc0 0x7f9d5c1525e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:41.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.123+0000 7f9d62f9d700 1 -- 172.21.15.72:0/799147690 >> 172.21.15.72:0/799147690 conn(0x7f9d5c06a8d0 msgr2=0x7f9d5c0a94e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:41.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.123+0000 7f9d62f9d700 1 -- 172.21.15.72:0/799147690 shutdown_connections 2023-07-25T14:37:41.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.123+0000 7f9d62f9d700 1 -- 172.21.15.72:0/799147690 wait complete. 2023-07-25T14:37:41.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.124+0000 7f9d62f9d700 1 Processor -- start 2023-07-25T14:37:41.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.124+0000 7f9d62f9d700 1 -- start start 2023-07-25T14:37:41.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.125+0000 7f9d62f9d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9d5c0a9cc0 0x7f9d5c0c0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:41.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.125+0000 7f9d62f9d700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9d5c0bb0b0 0x7f9d5c0bea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:41.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.125+0000 7f9d62f9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9d5c14f810 0x7f9d5c0befa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:41.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.125+0000 7f9d62f9d700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d5c0aaf80 con 0x7f9d5c14f810 2023-07-25T14:37:41.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.125+0000 7f9d62f9d700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d5c0acb20 con 0x7f9d5c0a9cc0 2023-07-25T14:37:41.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.125+0000 7f9d62f9d700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d5c0ab4d0 con 0x7f9d5c0bb0b0 2023-07-25T14:37:41.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.125+0000 7f9d6153a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9d5c14f810 0x7f9d5c0befa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:41.138 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.125+0000 7f9d6153a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9d5c14f810 0x7f9d5c0befa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43568/0 (socket says 172.21.15.72:43568) 2023-07-25T14:37:41.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.125+0000 7f9d6153a700 1 -- 172.21.15.72:0/60690494 learned_addr learned my addr 172.21.15.72:0/60690494 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:37:41.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.125+0000 7f9d60d39700 1 --2- 172.21.15.72:0/60690494 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9d5c0a9cc0 0x7f9d5c0c0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:41.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.125+0000 7f9d5bfff700 1 --2- 172.21.15.72:0/60690494 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9d5c0bb0b0 0x7f9d5c0bea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:41.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.125+0000 7f9d6153a700 1 -- 172.21.15.72:0/60690494 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9d5c0bb0b0 msgr2=0x7f9d5c0bea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:41.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.125+0000 7f9d6153a700 1 --2- 172.21.15.72:0/60690494 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9d5c0bb0b0 0x7f9d5c0bea60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:41.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.125+0000 7f9d6153a700 1 -- 172.21.15.72:0/60690494 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9d5c0a9cc0 msgr2=0x7f9d5c0c0ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:41.139 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.125+0000 7f9d6153a700 1 --2- 172.21.15.72:0/60690494 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9d5c0a9cc0 0x7f9d5c0c0ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:41.140 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.125+0000 7f9d6153a700 1 -- 172.21.15.72:0/60690494 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d54009a70 con 0x7f9d5c14f810 2023-07-25T14:37:41.140 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.125+0000 7f9d6153a700 1 --2- 172.21.15.72:0/60690494 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9d5c14f810 0x7f9d5c0befa0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f9d54014040 tx=0x7f9d54004b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:41.140 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.125+0000 7f9d597fa700 1 -- 172.21.15.72:0/60690494 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d54012430 con 0x7f9d5c14f810 2023-07-25T14:37:41.140 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.125+0000 7f9d597fa700 1 -- 172.21.15.72:0/60690494 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d54020070 con 0x7f9d5c14f810 2023-07-25T14:37:41.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.125+0000 7f9d597fa700 1 -- 172.21.15.72:0/60690494 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d54004280 con 0x7f9d5c14f810 2023-07-25T14:37:41.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.126+0000 7f9d62f9d700 1 -- 172.21.15.72:0/60690494 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d5c0aced0 con 0x7f9d5c14f810 2023-07-25T14:37:41.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.126+0000 7f9d62f9d700 1 -- 172.21.15.72:0/60690494 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d5c0ad490 con 0x7f9d5c14f810 2023-07-25T14:37:41.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.126+0000 7f9d62f9d700 1 -- 172.21.15.72:0/60690494 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d5c0ab680 con 0x7f9d5c14f810 2023-07-25T14:37:41.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.127+0000 7f9d597fa700 1 -- 172.21.15.72:0/60690494 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9d540043e0 con 0x7f9d5c14f810 2023-07-25T14:37:41.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.127+0000 7f9d597fa700 1 --2- 172.21.15.72:0/60690494 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f9d4006ace0 0x7f9d4006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:41.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.127+0000 7f9d597fa700 1 -- 172.21.15.72:0/60690494 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f9d54022070 con 0x7f9d5c14f810 2023-07-25T14:37:41.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.127+0000 7f9d60d39700 1 --2- 172.21.15.72:0/60690494 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f9d4006ace0 0x7f9d4006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:41.142 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.128+0000 7f9d60d39700 1 --2- 172.21.15.72:0/60690494 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f9d4006ace0 0x7f9d4006d1a0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f9d50007fd0 tx=0x7f9d50007de0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:41.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.132+0000 7f9d597fa700 1 -- 172.21.15.72:0/60690494 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f9d5c0ab680 con 0x7f9d5c14f810 2023-07-25T14:37:41.333 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.322+0000 7f9d62f9d700 1 -- 172.21.15.72:0/60690494 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9d5c0ab680 con 0x7f9d5c14f810 2023-07-25T14:37:41.334 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.323+0000 7f9d597fa700 1 -- 172.21.15.72:0/60690494 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v53) v1 ==== 74+0+14738 (secure 0 0 0) 0x7f9d5c0ab680 con 0x7f9d5c14f810 2023-07-25T14:37:41.334 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-25T14:37:41.335 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":53,"fsid":"9170db48-9170-43e8-8ccb-9813e6240906","created":"2023-07-25T14:35:21.733262+0000","modified":"2023-07-25T14:37:40.144548+0000","last_up_change":"2023-07-25T14:35:31.355010+0000","last_in_change":"2023-07-25T14:35:24.195785+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-25T14:35:32.983457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-25T14:35:33.326342+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d517fdad-0bfe-49f0-89f2-9421c3761839","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6801","nonce":2475407414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6803","nonce":2475407414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6807","nonce":2475407414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6805","nonce":2475407414}]},"public_addr":"172.21.15.72:6801/2475407414","cluster_addr":"172.21.15.72:6803/2475407414","heartbeat_back_addr":"172.21.15.72:6807/2475407414","heartbeat_front_addr":"172.21.15.72:6805/2475407414","state":["exists","up"]},{"osd":1,"uuid":"e1564be3-f209-47e5-a8d0-32fc618a474f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6822","nonce":870954016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6825","nonce":870954016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6831","nonce":870954016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6827","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6829","nonce":870954016}]},"public_addr":"172.21.15.72:6822/870954016","cluster_addr":"172.21.15.72:6825/870954016","heartbeat_back_addr":"172.21.15.72:6831/870954016","heartbeat_front_addr":"172.21.15.72:6829/870954016","state":["exists","up"]},{"osd":2,"uuid":"c4647d30-ffa6-417a-9026-ef530c75910e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6809","nonce":2143129442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6811","nonce":2143129442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6815","nonce":2143129442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6813","nonce":2143129442}]},"public_addr":"172.21.15.72:6809/2143129442","cluster_addr":"172.21.15.72:6811/2143129442","heartbeat_back_addr":"172.21.15.72:6815/2143129442","heartbeat_front_addr":"172.21.15.72:6813/2143129442","state":["exists","up"]},{"osd":3,"uuid":"76c9d9a7-c2e2-4612-a58b-d6882dd76b58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6817","nonce":3404066311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6819","nonce":3404066311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6828","nonce":3404066311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6821","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6823","nonce":3404066311}]},"public_addr":"172.21.15.72:6817/3404066311","cluster_addr":"172.21.15.72:6819/3404066311","heartbeat_back_addr":"172.21.15.72:6828/3404066311","heartbeat_front_addr":"172.21.15.72:6823/3404066311","state":["exists","up"]},{"osd":4,"uuid":"7f8920dc-0ad4-4a73-ab40-65408f83eadd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6817","nonce":2381008739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6819","nonce":2381008739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6825","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6827","nonce":2381008739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6822","nonce":2381008739}]},"public_addr":"172.21.15.92:6817/2381008739","cluster_addr":"172.21.15.92:6819/2381008739","heartbeat_back_addr":"172.21.15.92:6827/2381008739","heartbeat_front_addr":"172.21.15.92:6822/2381008739","state":["exists","up"]},{"osd":5,"uuid":"56257e7c-31eb-44c5-9ec7-1318a4e0bb35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6801","nonce":2161935604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6803","nonce":2161935604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6807","nonce":2161935604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6805","nonce":2161935604}]},"public_addr":"172.21.15.92:6801/2161935604","cluster_addr":"172.21.15.92:6803/2161935604","heartbeat_back_addr":"172.21.15.92:6807/2161935604","heartbeat_front_addr":"172.21.15.92:6805/2161935604","state":["exists","up"]},{"osd":6,"uuid":"a150d3d8-a0c9-4955-968a-8d98eff4ffb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6809","nonce":3770163493}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6811","nonce":3770163493}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6815","nonce":3770163493}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6813","nonce":3770163493}]},"public_addr":"172.21.15.92:6809/3770163493","cluster_addr":"172.21.15.92:6811/3770163493","heartbeat_back_addr":"172.21.15.92:6815/3770163493","heartbeat_front_addr":"172.21.15.92:6813/3770163493","state":["exists","up"]},{"osd":7,"uuid":"07799c27-54ee-4591-a42d-a978d6b32065","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6821","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6823","nonce":2135777609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6826","nonce":2135777609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6831","nonce":2135777609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6829","nonce":2135777609}]},"public_addr":"172.21.15.92:6823/2135777609","cluster_addr":"172.21.15.92:6826/2135777609","heartbeat_back_addr":"172.21.15.92:6831/2135777609","heartbeat_front_addr":"172.21.15.92:6829/2135777609","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.345365+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.378150+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.146566+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.372172+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:30.398421+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.385632+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.465611+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.443583+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-25T14:37:41.336 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.325+0000 7f9d62f9d700 1 -- 172.21.15.72:0/60690494 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f9d4006ace0 msgr2=0x7f9d4006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:41.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.325+0000 7f9d62f9d700 1 --2- 172.21.15.72:0/60690494 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f9d4006ace0 0x7f9d4006d1a0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f9d50007fd0 tx=0x7f9d50007de0 comp rx=0 tx=0).stop 2023-07-25T14:37:41.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.325+0000 7f9d62f9d700 1 -- 172.21.15.72:0/60690494 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9d5c14f810 msgr2=0x7f9d5c0befa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:41.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.325+0000 7f9d62f9d700 1 --2- 172.21.15.72:0/60690494 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9d5c14f810 0x7f9d5c0befa0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f9d54014040 tx=0x7f9d54004b20 comp rx=0 tx=0).stop 2023-07-25T14:37:41.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.326+0000 7f9d62f9d700 1 -- 172.21.15.72:0/60690494 shutdown_connections 2023-07-25T14:37:41.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.326+0000 7f9d62f9d700 1 --2- 172.21.15.72:0/60690494 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f9d4006ace0 0x7f9d4006d1a0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:41.337 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.326+0000 7f9d62f9d700 1 --2- 172.21.15.72:0/60690494 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9d5c14f810 0x7f9d5c0befa0 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:41.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.326+0000 7f9d62f9d700 1 --2- 172.21.15.72:0/60690494 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9d5c0a9cc0 0x7f9d5c0c0ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:41.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.326+0000 7f9d62f9d700 1 --2- 172.21.15.72:0/60690494 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9d5c0bb0b0 0x7f9d5c0bea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:41.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.326+0000 7f9d62f9d700 1 -- 172.21.15.72:0/60690494 >> 172.21.15.72:0/60690494 conn(0x7f9d5c06a8d0 msgr2=0x7f9d5c155850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:41.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.326+0000 7f9d62f9d700 1 -- 172.21.15.72:0/60690494 shutdown_connections 2023-07-25T14:37:41.338 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.326+0000 7f9d62f9d700 1 -- 172.21.15.72:0/60690494 wait complete. 2023-07-25T14:37:41.349 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-07-25T14:35:32.983457+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-07-25T14:35:33.326342+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-25T14:37:41.350 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-25T14:37:41.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.462+0000 7f8291350700 1 Processor -- start 2023-07-25T14:37:41.473 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.462+0000 7f8291350700 1 -- start start 2023-07-25T14:37:41.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.463+0000 7f8291350700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f828c154490 0x7f828c0c0470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:41.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.463+0000 7f8291350700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f828c151f20 con 0x7f828c0c09b0 2023-07-25T14:37:41.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.463+0000 7f8291350700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f828c0bebb0 con 0x7f828c151b40 2023-07-25T14:37:41.476 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.463+0000 7f8291350700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f828c0c6340 con 0x7f828c154490 2023-07-25T14:37:41.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.463+0000 7f828b7fe700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f828c0c09b0 0x7f828c157e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:34314/0 (socket says 172.21.15.72:34314) 2023-07-25T14:37:41.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.463+0000 7f828b7fe700 1 -- 172.21.15.72:0/947191936 learned_addr learned my addr 172.21.15.72:0/947191936 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:37:41.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.463+0000 7f828a7fc700 1 --2- 172.21.15.72:0/947191936 >> v2:172.21.15.92:3300/0 conn(0x7f828c154490 0x7f828c0c0470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:41.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.463+0000 7f8289ffb700 1 -- 172.21.15.72:0/947191936 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4012931455 0 0) 0x7f828c151f20 con 0x7f828c0c09b0 2023-07-25T14:37:41.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.463+0000 7f8289ffb700 1 -- 172.21.15.72:0/947191936 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f82740035b0 con 0x7f828c0c09b0 2023-07-25T14:37:41.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.463+0000 7f8289ffb700 1 -- 172.21.15.72:0/947191936 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3672078702 0 0) 0x7f82740035b0 con 0x7f828c0c09b0 2023-07-25T14:37:41.477 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.463+0000 7f8289ffb700 1 -- 172.21.15.72:0/947191936 >> v2:172.21.15.92:3300/0 conn(0x7f828c154490 msgr2=0x7f828c0c0470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:41.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.463+0000 7f8289ffb700 1 --2- 172.21.15.72:0/947191936 >> v2:172.21.15.92:3300/0 conn(0x7f828c154490 0x7f828c0c0470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:41.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.463+0000 7f8289ffb700 1 -- 172.21.15.72:0/947191936 >> v1:172.21.15.92:6789/0 conn(0x7f828c151b40 legacy=0x7f828c0c5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:41.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.463+0000 7f8289ffb700 1 -- 172.21.15.72:0/947191936 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f828c154950 con 0x7f828c0c09b0 2023-07-25T14:37:41.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.463+0000 7f8289ffb700 1 -- 172.21.15.72:0/947191936 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2559588315 0 0) 0x7f82840019f0 con 0x7f828c0c09b0 2023-07-25T14:37:41.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.463+0000 7f8289ffb700 1 -- 172.21.15.72:0/947191936 >> v1:172.21.15.72:6789/0 conn(0x7f828c0c09b0 legacy=0x7f828c157e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:41.478 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.464+0000 7f8289ffb700 1 --2- 172.21.15.72:0/947191936 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8274003a00 0x7f8274003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:41.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.464+0000 7f8289ffb700 1 --2- 172.21.15.72:0/947191936 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8274004400 0x7f82740048d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:41.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.464+0000 7f8289ffb700 1 --2- 172.21.15.72:0/947191936 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8274005170 0x7f827400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:41.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.464+0000 7f8289ffb700 1 -- 172.21.15.72:0/947191936 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f828c0c6340 con 0x7f8274003a00 2023-07-25T14:37:41.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.464+0000 7f8289ffb700 1 -- 172.21.15.72:0/947191936 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f827400c0b0 con 0x7f8274005170 2023-07-25T14:37:41.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.464+0000 7f8289ffb700 1 -- 172.21.15.72:0/947191936 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f827400c270 con 0x7f8274004400 2023-07-25T14:37:41.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.464+0000 7f828affd700 1 --2- 172.21.15.72:0/947191936 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8274003a00 0x7f8274003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:41.479 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.464+0000 7f828a7fc700 1 --2- 172.21.15.72:0/947191936 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8274004400 0x7f82740048d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:41.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.464+0000 7f828b7fe700 1 --2- 172.21.15.72:0/947191936 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8274005170 0x7f827400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:41.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.464+0000 7f828affd700 1 -- 172.21.15.72:0/947191936 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8274004400 msgr2=0x7f82740048d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:41.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.464+0000 7f828affd700 1 --2- 172.21.15.72:0/947191936 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8274004400 0x7f82740048d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:41.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.464+0000 7f828affd700 1 -- 172.21.15.72:0/947191936 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8274005170 msgr2=0x7f827400ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:41.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.464+0000 7f828affd700 1 --2- 172.21.15.72:0/947191936 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8274005170 0x7f827400ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:41.480 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.464+0000 7f828affd700 1 -- 172.21.15.72:0/947191936 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82740035b0 con 0x7f8274003a00 2023-07-25T14:37:41.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.464+0000 7f828b7fe700 1 --2- 172.21.15.72:0/947191936 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8274005170 0x7f827400ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-25T14:37:41.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.464+0000 7f828b7fe700 1 -- 172.21.15.72:0/947191936 reap_dead start 2023-07-25T14:37:41.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.464+0000 7f828affd700 1 --2- 172.21.15.72:0/947191936 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8274003a00 0x7f8274003de0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f82800018b0 tx=0x7f8274005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d5584e2bdbaff8c server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:41.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.464+0000 7f8289ffb700 1 -- 172.21.15.72:0/947191936 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8280001370 con 0x7f8274003a00 2023-07-25T14:37:41.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.464+0000 7f8289ffb700 1 -- 172.21.15.72:0/947191936 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82800052f0 con 0x7f8274003a00 2023-07-25T14:37:41.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.464+0000 7f8289ffb700 1 -- 172.21.15.72:0/947191936 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8280003680 con 0x7f8274003a00 2023-07-25T14:37:41.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.465+0000 7f8291350700 1 -- 172.21.15.72:0/947191936 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8274003a00 msgr2=0x7f8274003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:41.481 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.465+0000 7f8291350700 1 --2- 172.21.15.72:0/947191936 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8274003a00 0x7f8274003de0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f82800018b0 tx=0x7f8274005880 comp rx=0 tx=0).stop 2023-07-25T14:37:41.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.465+0000 7f8291350700 1 -- 172.21.15.72:0/947191936 shutdown_connections 2023-07-25T14:37:41.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.465+0000 7f8291350700 1 --2- 172.21.15.72:0/947191936 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8274003a00 0x7f8274003de0 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:41.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.465+0000 7f8291350700 1 -- 172.21.15.72:0/947191936 >> 172.21.15.72:0/947191936 conn(0x7f828c06c410 msgr2=0x7f828c06c820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:41.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.465+0000 7f8291350700 1 -- 172.21.15.72:0/947191936 shutdown_connections 2023-07-25T14:37:41.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.465+0000 7f8291350700 1 -- 172.21.15.72:0/947191936 wait complete. 2023-07-25T14:37:41.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.466+0000 7f8291350700 1 Processor -- start 2023-07-25T14:37:41.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.466+0000 7f8291350700 1 -- start start 2023-07-25T14:37:41.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.467+0000 7f8291350700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8274003a00 0x7f828c0a9e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:41.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.467+0000 7f8291350700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f828c155680 0x7f828c14c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:41.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.467+0000 7f8291350700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f828c0aede0 0x7f828c14cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:41.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.467+0000 7f8291350700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f828c14fa20 con 0x7f8274003a00 2023-07-25T14:37:41.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.467+0000 7f8291350700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f828c1ea2f0 con 0x7f828c155680 2023-07-25T14:37:41.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.467+0000 7f8291350700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f828c1ea5d0 con 0x7f828c0aede0 2023-07-25T14:37:41.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.467+0000 7f828affd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8274003a00 0x7f828c0a9e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:41.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.467+0000 7f828affd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8274003a00 0x7f828c0a9e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43586/0 (socket says 172.21.15.72:43586) 2023-07-25T14:37:41.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.467+0000 7f828affd700 1 -- 172.21.15.72:0/3586638611 learned_addr learned my addr 172.21.15.72:0/3586638611 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:37:41.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.467+0000 7f828b7fe700 1 --2- 172.21.15.72:0/3586638611 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f828c0aede0 0x7f828c14cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:41.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.467+0000 7f828a7fc700 1 --2- 172.21.15.72:0/3586638611 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f828c155680 0x7f828c14c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:41.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.467+0000 7f828affd700 1 -- 172.21.15.72:0/3586638611 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f828c0aede0 msgr2=0x7f828c14cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:41.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.467+0000 7f828affd700 1 --2- 172.21.15.72:0/3586638611 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f828c0aede0 0x7f828c14cb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:41.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.467+0000 7f828affd700 1 -- 172.21.15.72:0/3586638611 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f828c155680 msgr2=0x7f828c14c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:41.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.467+0000 7f828affd700 1 --2- 172.21.15.72:0/3586638611 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f828c155680 0x7f828c14c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:41.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.467+0000 7f828affd700 1 -- 172.21.15.72:0/3586638611 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f828c14f3d0 con 0x7f8274003a00 2023-07-25T14:37:41.487 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.467+0000 7f828affd700 1 --2- 172.21.15.72:0/3586638611 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8274003a00 0x7f828c0a9e10 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f82800011a0 tx=0x7f8280001110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:41.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.467+0000 7f82737fe700 1 -- 172.21.15.72:0/3586638611 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8280005190 con 0x7f8274003a00 2023-07-25T14:37:41.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.467+0000 7f82737fe700 1 -- 172.21.15.72:0/3586638611 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f828000c690 con 0x7f8274003a00 2023-07-25T14:37:41.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.467+0000 7f8291350700 1 -- 172.21.15.72:0/3586638611 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f828c14f6b0 con 0x7f8274003a00 2023-07-25T14:37:41.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.467+0000 7f82737fe700 1 -- 172.21.15.72:0/3586638611 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f828000ca40 con 0x7f8274003a00 2023-07-25T14:37:41.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.467+0000 7f8291350700 1 -- 172.21.15.72:0/3586638611 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f828c150f80 con 0x7f8274003a00 2023-07-25T14:37:41.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.468+0000 7f8291350700 1 -- 172.21.15.72:0/3586638611 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f828c14fd00 con 0x7f8274003a00 2023-07-25T14:37:41.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.469+0000 7f82737fe700 1 -- 172.21.15.72:0/3586638611 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f828000cba0 con 0x7f8274003a00 2023-07-25T14:37:41.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.469+0000 7f82737fe700 1 --2- 172.21.15.72:0/3586638611 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f827806ace0 0x7f827806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:41.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.469+0000 7f828a7fc700 1 --2- 172.21.15.72:0/3586638611 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f827806ace0 0x7f827806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:41.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.469+0000 7f82737fe700 1 -- 172.21.15.72:0/3586638611 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f828008a1d0 con 0x7f8274003a00 2023-07-25T14:37:41.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.470+0000 7f828a7fc700 1 --2- 172.21.15.72:0/3586638611 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f827806ace0 0x7f827806d1a0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f828c155a80 tx=0x7f827c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:41.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.474+0000 7f82737fe700 1 -- 172.21.15.72:0/3586638611 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f82800554a0 con 0x7f8274003a00 2023-07-25T14:37:41.673 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.662+0000 7f8291350700 1 -- 172.21.15.72:0/3586638611 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f828c04e470 con 0x7f8274003a00 2023-07-25T14:37:41.674 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.663+0000 7f82737fe700 1 -- 172.21.15.72:0/3586638611 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v53) v1 ==== 92+0+10 (secure 0 0 0) 0x7f8280058ac0 con 0x7f8274003a00 2023-07-25T14:37:41.674 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 8 2023-07-25T14:37:41.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.665+0000 7f8291350700 1 -- 172.21.15.72:0/3586638611 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f827806ace0 msgr2=0x7f827806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:41.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.665+0000 7f8291350700 1 --2- 172.21.15.72:0/3586638611 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f827806ace0 0x7f827806d1a0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f828c155a80 tx=0x7f827c008040 comp rx=0 tx=0).stop 2023-07-25T14:37:41.676 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.665+0000 7f8291350700 1 -- 172.21.15.72:0/3586638611 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8274003a00 msgr2=0x7f828c0a9e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:41.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.665+0000 7f8291350700 1 --2- 172.21.15.72:0/3586638611 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8274003a00 0x7f828c0a9e10 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f82800011a0 tx=0x7f8280001110 comp rx=0 tx=0).stop 2023-07-25T14:37:41.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.665+0000 7f8291350700 1 -- 172.21.15.72:0/3586638611 shutdown_connections 2023-07-25T14:37:41.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.665+0000 7f8291350700 1 --2- 172.21.15.72:0/3586638611 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f827806ace0 0x7f827806d1a0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:41.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.665+0000 7f8291350700 1 --2- 172.21.15.72:0/3586638611 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f828c0aede0 0x7f828c14cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:41.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.665+0000 7f8291350700 1 --2- 172.21.15.72:0/3586638611 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8274003a00 0x7f828c0a9e10 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:41.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.665+0000 7f8291350700 1 --2- 172.21.15.72:0/3586638611 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f828c155680 0x7f828c14c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:41.677 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.665+0000 7f8291350700 1 -- 172.21.15.72:0/3586638611 >> 172.21.15.72:0/3586638611 conn(0x7f828c06c410 msgr2=0x7f828c14dab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:41.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.665+0000 7f8291350700 1 -- 172.21.15.72:0/3586638611 shutdown_connections 2023-07-25T14:37:41.678 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.665+0000 7f8291350700 1 -- 172.21.15.72:0/3586638611 wait complete. 2023-07-25T14:37:41.688 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-25T14:37:41.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.800+0000 7f0c748fe700 1 Processor -- start 2023-07-25T14:37:41.811 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.800+0000 7f0c748fe700 1 -- start start 2023-07-25T14:37:41.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.801+0000 7f0c748fe700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0c700c5f40 0x7f0c70154640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:41.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.801+0000 7f0c748fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0c700ba0e0 0x7f0c70154b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:41.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.801+0000 7f0c748fe700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c700c54f0 con 0x7f0c70151ba0 2023-07-25T14:37:41.813 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.801+0000 7f0c748fe700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c700c6670 con 0x7f0c700ba0e0 2023-07-25T14:37:41.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.801+0000 7f0c748fe700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c700c5740 con 0x7f0c700c5f40 2023-07-25T14:37:41.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.801+0000 7f0c6ed9d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0c700ba0e0 0x7f0c70154b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:41.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.801+0000 7f0c6ed9d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f0c700ba0e0 0x7f0c70154b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43598/0 (socket says 172.21.15.72:43598) 2023-07-25T14:37:41.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.801+0000 7f0c6ed9d700 1 -- 172.21.15.72:0/58634083 learned_addr learned my addr 172.21.15.72:0/58634083 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:37:41.814 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.801+0000 7f0c6dd9b700 1 --2- 172.21.15.72:0/58634083 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0c700c5f40 0x7f0c70154640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:41.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.801+0000 7f0c6ed9d700 1 -- 172.21.15.72:0/58634083 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0c700c5f40 msgr2=0x7f0c70154640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:41.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.801+0000 7f0c6ed9d700 1 --2- 172.21.15.72:0/58634083 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0c700c5f40 0x7f0c70154640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:41.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.801+0000 7f0c6ed9d700 1 -- 172.21.15.72:0/58634083 >> v1:172.21.15.92:6789/0 conn(0x7f0c70151ba0 legacy=0x7f0c700c2230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:41.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.801+0000 7f0c6ed9d700 1 -- 172.21.15.72:0/58634083 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c700c5a20 con 0x7f0c700ba0e0 2023-07-25T14:37:41.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.802+0000 7f0c6ed9d700 1 --2- 172.21.15.72:0/58634083 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0c700ba0e0 0x7f0c70154b80 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f0c68009e50 tx=0x7f0c6800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=955d44ace71cc5c3 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:41.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.802+0000 7f0c6d59a700 1 -- 172.21.15.72:0/58634083 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c6800e070 con 0x7f0c700ba0e0 2023-07-25T14:37:41.815 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.802+0000 7f0c6d59a700 1 -- 172.21.15.72:0/58634083 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c68003a20 con 0x7f0c700ba0e0 2023-07-25T14:37:41.816 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.802+0000 7f0c6d59a700 1 -- 172.21.15.72:0/58634083 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c68003dd0 con 0x7f0c700ba0e0 2023-07-25T14:37:41.818 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.802+0000 7f0c748fe700 1 -- 172.21.15.72:0/58634083 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0c700ba0e0 msgr2=0x7f0c70154b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:41.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.802+0000 7f0c748fe700 1 --2- 172.21.15.72:0/58634083 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0c700ba0e0 0x7f0c70154b80 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f0c68009e50 tx=0x7f0c6800b330 comp rx=0 tx=0).stop 2023-07-25T14:37:41.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.802+0000 7f0c748fe700 1 -- 172.21.15.72:0/58634083 shutdown_connections 2023-07-25T14:37:41.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.802+0000 7f0c748fe700 1 --2- 172.21.15.72:0/58634083 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0c700ba0e0 0x7f0c70154b80 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:41.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.802+0000 7f0c748fe700 1 --2- 172.21.15.72:0/58634083 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0c700c5f40 0x7f0c70154640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:41.819 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.802+0000 7f0c748fe700 1 -- 172.21.15.72:0/58634083 >> 172.21.15.72:0/58634083 conn(0x7f0c700a87e0 msgr2=0x7f0c700a8bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:41.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.802+0000 7f0c748fe700 1 -- 172.21.15.72:0/58634083 shutdown_connections 2023-07-25T14:37:41.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.802+0000 7f0c748fe700 1 -- 172.21.15.72:0/58634083 wait complete. 2023-07-25T14:37:41.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.804+0000 7f0c748fe700 1 Processor -- start 2023-07-25T14:37:41.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.804+0000 7f0c748fe700 1 -- start start 2023-07-25T14:37:41.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.804+0000 7f0c748fe700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0c700ba0e0 0x7f0c70153670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:41.820 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.804+0000 7f0c748fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0c700c5f40 0x7f0c701e9dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:41.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.804+0000 7f0c748fe700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0c70151ba0 0x7f0c701ea300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:41.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.804+0000 7f0c748fe700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c700bbea0 con 0x7f0c700c5f40 2023-07-25T14:37:41.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.804+0000 7f0c748fe700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c700bc280 con 0x7f0c700ba0e0 2023-07-25T14:37:41.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.804+0000 7f0c748fe700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c700bc8b0 con 0x7f0c70151ba0 2023-07-25T14:37:41.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.804+0000 7f0c6dd9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0c700c5f40 0x7f0c701e9dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:41.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.804+0000 7f0c6dd9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0c700c5f40 0x7f0c701e9dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43602/0 (socket says 172.21.15.72:43602) 2023-07-25T14:37:41.821 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.805+0000 7f0c6dd9b700 1 -- 172.21.15.72:0/3052046711 learned_addr learned my addr 172.21.15.72:0/3052046711 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:37:41.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.805+0000 7f0c6ed9d700 1 --2- 172.21.15.72:0/3052046711 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0c70151ba0 0x7f0c701ea300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:41.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.805+0000 7f0c6e59c700 1 --2- 172.21.15.72:0/3052046711 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0c700ba0e0 0x7f0c70153670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:41.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.805+0000 7f0c6dd9b700 1 -- 172.21.15.72:0/3052046711 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0c70151ba0 msgr2=0x7f0c701ea300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:41.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.805+0000 7f0c6dd9b700 1 --2- 172.21.15.72:0/3052046711 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0c70151ba0 0x7f0c701ea300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:41.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.805+0000 7f0c6dd9b700 1 -- 172.21.15.72:0/3052046711 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0c700ba0e0 msgr2=0x7f0c70153670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:41.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.805+0000 7f0c6dd9b700 1 --2- 172.21.15.72:0/3052046711 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0c700ba0e0 0x7f0c70153670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:41.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.805+0000 7f0c6dd9b700 1 -- 172.21.15.72:0/3052046711 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c68009b30 con 0x7f0c700c5f40 2023-07-25T14:37:41.822 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.805+0000 7f0c6e59c700 1 --2- 172.21.15.72:0/3052046711 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0c700ba0e0 0x7f0c70153670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-25T14:37:41.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.805+0000 7f0c6dd9b700 1 --2- 172.21.15.72:0/3052046711 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0c700c5f40 0x7f0c701e9dc0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f0c6000eb20 tx=0x7f0c6000eee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:41.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.805+0000 7f0c5effd700 1 -- 172.21.15.72:0/3052046711 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c60004220 con 0x7f0c700c5f40 2023-07-25T14:37:41.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.805+0000 7f0c5effd700 1 -- 172.21.15.72:0/3052046711 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c60004380 con 0x7f0c700c5f40 2023-07-25T14:37:41.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.805+0000 7f0c5effd700 1 -- 172.21.15.72:0/3052046711 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c600078a0 con 0x7f0c700c5f40 2023-07-25T14:37:41.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.805+0000 7f0c748fe700 1 -- 172.21.15.72:0/3052046711 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c700bcb90 con 0x7f0c700c5f40 2023-07-25T14:37:41.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.805+0000 7f0c748fe700 1 -- 172.21.15.72:0/3052046711 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c700bd150 con 0x7f0c700c5f40 2023-07-25T14:37:41.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.806+0000 7f0c748fe700 1 -- 172.21.15.72:0/3052046711 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c7004e470 con 0x7f0c700c5f40 2023-07-25T14:37:41.823 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.806+0000 7f0c5effd700 1 -- 172.21.15.72:0/3052046711 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0c60007a00 con 0x7f0c700c5f40 2023-07-25T14:37:41.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.807+0000 7f0c5effd700 1 --2- 172.21.15.72:0/3052046711 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f0c5006ace0 0x7f0c5006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:41.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.807+0000 7f0c5effd700 1 -- 172.21.15.72:0/3052046711 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f0c60014070 con 0x7f0c700c5f40 2023-07-25T14:37:41.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.807+0000 7f0c6e59c700 1 --2- 172.21.15.72:0/3052046711 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f0c5006ace0 0x7f0c5006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:41.824 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.807+0000 7f0c6e59c700 1 --2- 172.21.15.72:0/3052046711 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f0c5006ace0 0x7f0c5006d1a0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f0c64009930 tx=0x7f0c64008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:41.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.811+0000 7f0c5effd700 1 -- 172.21.15.72:0/3052046711 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f0c6005a3f0 con 0x7f0c700c5f40 2023-07-25T14:37:42.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.995+0000 7f0c748fe700 1 -- 172.21.15.72:0/3052046711 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0c700bd7c0 con 0x7f0c700c5f40 2023-07-25T14:37:42.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.996+0000 7f0c5effd700 1 -- 172.21.15.72:0/3052046711 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v53) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0c60007cb0 con 0x7f0c700c5f40 2023-07-25T14:37:42.007 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 1 2023-07-25T14:37:42.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.998+0000 7f0c748fe700 1 -- 172.21.15.72:0/3052046711 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f0c5006ace0 msgr2=0x7f0c5006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:42.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.998+0000 7f0c748fe700 1 --2- 172.21.15.72:0/3052046711 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f0c5006ace0 0x7f0c5006d1a0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f0c64009930 tx=0x7f0c64008040 comp rx=0 tx=0).stop 2023-07-25T14:37:42.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.998+0000 7f0c748fe700 1 -- 172.21.15.72:0/3052046711 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0c700c5f40 msgr2=0x7f0c701e9dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:42.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.998+0000 7f0c748fe700 1 --2- 172.21.15.72:0/3052046711 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0c700c5f40 0x7f0c701e9dc0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f0c6000eb20 tx=0x7f0c6000eee0 comp rx=0 tx=0).stop 2023-07-25T14:37:42.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.998+0000 7f0c748fe700 1 -- 172.21.15.72:0/3052046711 shutdown_connections 2023-07-25T14:37:42.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.998+0000 7f0c748fe700 1 --2- 172.21.15.72:0/3052046711 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f0c5006ace0 0x7f0c5006d1a0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:42.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.998+0000 7f0c748fe700 1 --2- 172.21.15.72:0/3052046711 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0c70151ba0 0x7f0c701ea300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:42.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.998+0000 7f0c748fe700 1 --2- 172.21.15.72:0/3052046711 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0c700ba0e0 0x7f0c70153670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:42.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.998+0000 7f0c748fe700 1 --2- 172.21.15.72:0/3052046711 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f0c700c5f40 0x7f0c701e9dc0 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:42.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.998+0000 7f0c748fe700 1 -- 172.21.15.72:0/3052046711 >> 172.21.15.72:0/3052046711 conn(0x7f0c700a87e0 msgr2=0x7f0c700c4600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:42.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.998+0000 7f0c748fe700 1 -- 172.21.15.72:0/3052046711 shutdown_connections 2023-07-25T14:37:42.011 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:41.999+0000 7f0c748fe700 1 -- 172.21.15.72:0/3052046711 wait complete. 2023-07-25T14:37:42.021 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-07-25T14:37:42.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:42.130+0000 7f871f4ef700 1 Processor -- start 2023-07-25T14:37:42.141 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:42.130+0000 7f871f4ef700 1 -- start start 2023-07-25T14:37:42.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:42.131+0000 7f871f4ef700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f871806f4d0 0x7f871806f940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:42.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:42.131+0000 7f871f4ef700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87180a7360 con 0x7f87180a6ef0 2023-07-25T14:37:42.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:42.131+0000 7f871f4ef700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87180c4e80 con 0x7f87180a6b10 2023-07-25T14:37:42.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:42.131+0000 7f871f4ef700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87180c76b0 con 0x7f871806f4d0 2023-07-25T14:37:42.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:42.131+0000 7f871ca8a700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f87180a6ef0 0x7f87180c23b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:34344/0 (socket says 172.21.15.72:34344) 2023-07-25T14:37:42.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:42.131+0000 7f871da8c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f871806f4d0 0x7f871806f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:42.143 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:42.131+0000 7f871ca8a700 1 -- 172.21.15.72:0/1894603236 learned_addr learned my addr 172.21.15.72:0/1894603236 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:37:42.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:42.131+0000 7f871da8c700 1 -- 172.21.15.72:0/1894603236 >> v1:172.21.15.92:6789/0 conn(0x7f87180a6b10 legacy=0x7f8718152c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:42.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:42.131+0000 7f871da8c700 1 -- 172.21.15.72:0/1894603236 >> v1:172.21.15.72:6789/0 conn(0x7f87180a6ef0 legacy=0x7f87180c23b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:42.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:42.131+0000 7f871da8c700 1 -- 172.21.15.72:0/1894603236 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87180c45e0 con 0x7f871806f4d0 2023-07-25T14:37:42.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:42.131+0000 7f870ffff700 1 -- 172.21.15.72:0/1894603236 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2745313654 0 0) 0x7f87180a7360 con 0x7f87180a6ef0 2023-07-25T14:37:42.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:42.132+0000 7f871da8c700 1 --2- 172.21.15.72:0/1894603236 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f871806f4d0 0x7f871806f940 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f8710009d90 tx=0x7f871000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe3158bbbaafb138 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:42.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:42.132+0000 7f870ffff700 1 -- 172.21.15.72:0/1894603236 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f871000e070 con 0x7f871806f4d0 2023-07-25T14:37:42.144 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:42.132+0000 7f870ffff700 1 -- 172.21.15.72:0/1894603236 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f871000bbd0 con 0x7f871806f4d0 2023-07-25T14:37:42.145 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:42.132+0000 7f870ffff700 1 -- 172.21.15.72:0/1894603236 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8710012430 con 0x7f871806f4d0 2023-07-25T14:37:42.146 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:42.132+0000 7f871f4ef700 1 -- 172.21.15.72:0/1894603236 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f871806f4d0 msgr2=0x7f871806f940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:42.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:42.132+0000 7f871f4ef700 1 --2- 172.21.15.72:0/1894603236 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f871806f4d0 0x7f871806f940 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f8710009d90 tx=0x7f871000b330 comp rx=0 tx=0).stop 2023-07-25T14:37:42.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:42.132+0000 7f871f4ef700 1 -- 172.21.15.72:0/1894603236 shutdown_connections 2023-07-25T14:37:42.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:42.132+0000 7f871f4ef700 1 --2- 172.21.15.72:0/1894603236 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f871806f4d0 0x7f871806f940 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:42.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:42.132+0000 7f871f4ef700 1 -- 172.21.15.72:0/1894603236 >> 172.21.15.72:0/1894603236 conn(0x7f87180a95a0 msgr2=0x7f87180a9980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:42.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:42.132+0000 7f871f4ef700 1 -- 172.21.15.72:0/1894603236 shutdown_connections 2023-07-25T14:37:42.147 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:42.132+0000 7f871f4ef700 1 -- 172.21.15.72:0/1894603236 wait complete. 2023-07-25T14:37:42.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:42.134+0000 7f871f4ef700 1 Processor -- start 2023-07-25T14:37:42.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:42.134+0000 7f871f4ef700 1 -- start start 2023-07-25T14:37:42.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:42.134+0000 7f871f4ef700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f871806f4d0 0x7f87180c5bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:42.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:42.134+0000 7f871f4ef700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f87180a6b10 0x7f87181ecec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:42.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:42.134+0000 7f871f4ef700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f87180a6ef0 0x7f87181ed400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:42.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:42.134+0000 7f871f4ef700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87181ea3c0 con 0x7f87180a6ef0 2023-07-25T14:37:42.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:42.134+0000 7f871f4ef700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f871806c740 con 0x7f871806f4d0 2023-07-25T14:37:42.148 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:42.134+0000 7f871f4ef700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87181e9a20 con 0x7f87180a6b10 2023-07-25T14:37:42.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:42.134+0000 7f871da8c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f87180a6ef0 0x7f87181ed400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:42.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:42.134+0000 7f871da8c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f87180a6ef0 0x7f87181ed400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43616/0 (socket says 172.21.15.72:43616) 2023-07-25T14:37:42.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:42.134+0000 7f871da8c700 1 -- 172.21.15.72:0/4231276360 learned_addr learned my addr 172.21.15.72:0/4231276360 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:37:42.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:42.135+0000 7f871d28b700 1 --2- 172.21.15.72:0/4231276360 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f871806f4d0 0x7f87180c5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:42.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:42.135+0000 7f871ca8a700 1 --2- 172.21.15.72:0/4231276360 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f87180a6b10 0x7f87181ecec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:42.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:42.135+0000 7f871da8c700 1 -- 172.21.15.72:0/4231276360 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f87180a6b10 msgr2=0x7f87181ecec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:42.149 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:42.135+0000 7f871da8c700 1 --2- 172.21.15.72:0/4231276360 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f87180a6b10 0x7f87181ecec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:42.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:42.135+0000 7f871da8c700 1 -- 172.21.15.72:0/4231276360 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f871806f4d0 msgr2=0x7f87180c5bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:42.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:42.135+0000 7f871da8c700 1 --2- 172.21.15.72:0/4231276360 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f871806f4d0 0x7f87180c5bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:42.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:42.135+0000 7f871da8c700 1 -- 172.21.15.72:0/4231276360 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8710009a70 con 0x7f87180a6ef0 2023-07-25T14:37:42.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:42.135+0000 7f871da8c700 1 --2- 172.21.15.72:0/4231276360 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f87180a6ef0 0x7f87181ed400 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f8710014040 tx=0x7f8710004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:42.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:42.136+0000 7f870dffb700 1 -- 172.21.15.72:0/4231276360 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f871001b810 con 0x7f87180a6ef0 2023-07-25T14:37:42.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:42.136+0000 7f870dffb700 1 -- 172.21.15.72:0/4231276360 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8710020070 con 0x7f87180a6ef0 2023-07-25T14:37:42.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:42.136+0000 7f871f4ef700 1 -- 172.21.15.72:0/4231276360 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87181e9d00 con 0x7f87180a6ef0 2023-07-25T14:37:42.150 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:42.136+0000 7f870dffb700 1 -- 172.21.15.72:0/4231276360 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f871001bbb0 con 0x7f87180a6ef0 2023-07-25T14:37:42.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:42.136+0000 7f871f4ef700 1 -- 172.21.15.72:0/4231276360 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f871806d1c0 con 0x7f87180a6ef0 2023-07-25T14:37:42.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:42.137+0000 7f871f4ef700 1 -- 172.21.15.72:0/4231276360 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87181ea500 con 0x7f87180a6ef0 2023-07-25T14:37:42.151 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:42.137+0000 7f870dffb700 1 -- 172.21.15.72:0/4231276360 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f871001bd10 con 0x7f87180a6ef0 2023-07-25T14:37:42.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:42.137+0000 7f870dffb700 1 --2- 172.21.15.72:0/4231276360 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f86fc06ace0 0x7f86fc06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:42.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:42.138+0000 7f870dffb700 1 -- 172.21.15.72:0/4231276360 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f8710022070 con 0x7f87180a6ef0 2023-07-25T14:37:42.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:42.138+0000 7f871d28b700 1 --2- 172.21.15.72:0/4231276360 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f86fc06ace0 0x7f86fc06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:42.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:42.138+0000 7f871d28b700 1 --2- 172.21.15.72:0/4231276360 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f86fc06ace0 0x7f86fc06d1a0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f8708007fd0 tx=0x7f8708009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:42.152 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:42.142+0000 7f870dffb700 1 -- 172.21.15.72:0/4231276360 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f87181ea500 con 0x7f87180a6ef0 2023-07-25T14:37:42.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:42.332+0000 7f871f4ef700 1 -- 172.21.15.72:0/4231276360 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f87181ea500 con 0x7f87180a6ef0 2023-07-25T14:37:42.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:42.333+0000 7f870dffb700 1 -- 172.21.15.72:0/4231276360 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v53) v1 ==== 84+0+126 (secure 0 0 0) 0x7f87181ea500 con 0x7f87180a6ef0 2023-07-25T14:37:42.344 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-25T14:37:42.344 INFO:teuthology.orchestra.run.smithi072.stdout:[ 2023-07-25T14:37:42.345 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-07-25T14:37:42.345 INFO:teuthology.orchestra.run.smithi072.stdout: "poolnum": 1, 2023-07-25T14:37:42.345 INFO:teuthology.orchestra.run.smithi072.stdout: "poolname": "rbd" 2023-07-25T14:37:42.345 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-07-25T14:37:42.345 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-07-25T14:37:42.345 INFO:teuthology.orchestra.run.smithi072.stdout: "poolnum": 2, 2023-07-25T14:37:42.345 INFO:teuthology.orchestra.run.smithi072.stdout: "poolname": ".mgr" 2023-07-25T14:37:42.345 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-07-25T14:37:42.346 INFO:teuthology.orchestra.run.smithi072.stdout:] 2023-07-25T14:37:42.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:42.335+0000 7f871f4ef700 1 -- 172.21.15.72:0/4231276360 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f86fc06ace0 msgr2=0x7f86fc06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:42.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:42.335+0000 7f871f4ef700 1 --2- 172.21.15.72:0/4231276360 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f86fc06ace0 0x7f86fc06d1a0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f8708007fd0 tx=0x7f8708009040 comp rx=0 tx=0).stop 2023-07-25T14:37:42.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:42.335+0000 7f871f4ef700 1 -- 172.21.15.72:0/4231276360 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f87180a6ef0 msgr2=0x7f87181ed400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:42.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:42.335+0000 7f871f4ef700 1 --2- 172.21.15.72:0/4231276360 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f87180a6ef0 0x7f87181ed400 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f8710014040 tx=0x7f8710004ad0 comp rx=0 tx=0).stop 2023-07-25T14:37:42.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:42.335+0000 7f871f4ef700 1 -- 172.21.15.72:0/4231276360 shutdown_connections 2023-07-25T14:37:42.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:42.335+0000 7f871f4ef700 1 --2- 172.21.15.72:0/4231276360 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f86fc06ace0 0x7f86fc06d1a0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:42.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:42.335+0000 7f871f4ef700 1 --2- 172.21.15.72:0/4231276360 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f87180a6ef0 0x7f87181ed400 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:42.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:42.335+0000 7f871f4ef700 1 --2- 172.21.15.72:0/4231276360 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f871806f4d0 0x7f87180c5bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:42.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:42.335+0000 7f871f4ef700 1 --2- 172.21.15.72:0/4231276360 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f87180a6b10 0x7f87181ecec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:42.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:42.335+0000 7f871f4ef700 1 -- 172.21.15.72:0/4231276360 >> 172.21.15.72:0/4231276360 conn(0x7f87180a95a0 msgr2=0x7f8718152d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:42.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:42.335+0000 7f871f4ef700 1 -- 172.21.15.72:0/4231276360 shutdown_connections 2023-07-25T14:37:42.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:42.335+0000 7f871f4ef700 1 -- 172.21.15.72:0/4231276360 wait complete. 2023-07-25T14:37:42.358 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-07-25T14:37:42.358 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-07-25T14:37:42.488 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:42.471+0000 7f1fdde1d700 1 Processor -- start 2023-07-25T14:37:42.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:42.472+0000 7f1fdde1d700 1 -- start start 2023-07-25T14:37:42.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:42.472+0000 7f1fdde1d700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f1fd814aa60 0x7f1fd80c0a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:42.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:42.472+0000 7f1fdde1d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1fd8071e00 0x7f1fd8154b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:42.489 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:42.472+0000 7f1fdde1d700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fd81550c0 con 0x7f1fd806dc20 2023-07-25T14:37:42.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:42.472+0000 7f1fdde1d700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fd80c2530 con 0x7f1fd8071e00 2023-07-25T14:37:42.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:42.472+0000 7f1fdde1d700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fd80c2810 con 0x7f1fd814aa60 2023-07-25T14:37:42.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:42.472+0000 7f1fd7fff700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f1fd806dc20 0x7f1fd806b1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:34360/0 (socket says 172.21.15.72:34360) 2023-07-25T14:37:42.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:42.472+0000 7f1fd7fff700 1 -- 172.21.15.72:0/800229135 learned_addr learned my addr 172.21.15.72:0/800229135 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:37:42.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:42.472+0000 7f1fd6ffd700 1 --2- 172.21.15.72:0/800229135 >> v2:172.21.15.72:3300/0 conn(0x7f1fd8071e00 0x7f1fd8154b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:42.490 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:42.473+0000 7f1fd77fe700 1 --2- 172.21.15.72:0/800229135 >> v2:172.21.15.92:3300/0 conn(0x7f1fd814aa60 0x7f1fd80c0a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:42.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:42.473+0000 7f1fd6ffd700 1 -- 172.21.15.72:0/800229135 >> v2:172.21.15.92:3300/0 conn(0x7f1fd814aa60 msgr2=0x7f1fd80c0a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:42.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:42.473+0000 7f1fd6ffd700 1 --2- 172.21.15.72:0/800229135 >> v2:172.21.15.92:3300/0 conn(0x7f1fd814aa60 0x7f1fd80c0a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:42.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:42.473+0000 7f1fd6ffd700 1 -- 172.21.15.72:0/800229135 >> v1:172.21.15.72:6789/0 conn(0x7f1fd806dc20 legacy=0x7f1fd806b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:42.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:42.473+0000 7f1fd6ffd700 1 -- 172.21.15.72:0/800229135 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fd806d140 con 0x7f1fd8071e00 2023-07-25T14:37:42.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:42.473+0000 7f1fd67fc700 1 -- 172.21.15.72:0/800229135 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1449544943 0 0) 0x7f1fd81550c0 con 0x7f1fd806dc20 2023-07-25T14:37:42.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:42.473+0000 7f1fd6ffd700 1 --2- 172.21.15.72:0/800229135 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1fd8071e00 0x7f1fd8154b80 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f1fd806f670 tx=0x7f1fc8009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cd534022f3f11ec server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:42.491 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:42.473+0000 7f1fd67fc700 1 -- 172.21.15.72:0/800229135 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fc8011830 con 0x7f1fd8071e00 2023-07-25T14:37:42.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:42.473+0000 7f1fd67fc700 1 -- 172.21.15.72:0/800229135 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fc8011990 con 0x7f1fd8071e00 2023-07-25T14:37:42.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:42.473+0000 7f1fd67fc700 1 -- 172.21.15.72:0/800229135 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fc8011d20 con 0x7f1fd8071e00 2023-07-25T14:37:42.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:42.474+0000 7f1fdde1d700 1 -- 172.21.15.72:0/800229135 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1fd8071e00 msgr2=0x7f1fd8154b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:42.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:42.474+0000 7f1fdde1d700 1 --2- 172.21.15.72:0/800229135 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1fd8071e00 0x7f1fd8154b80 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f1fd806f670 tx=0x7f1fc8009b20 comp rx=0 tx=0).stop 2023-07-25T14:37:42.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:42.474+0000 7f1fdde1d700 1 -- 172.21.15.72:0/800229135 shutdown_connections 2023-07-25T14:37:42.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:42.474+0000 7f1fdde1d700 1 --2- 172.21.15.72:0/800229135 >> v2:172.21.15.92:3300/0 conn(0x7f1fd814aa60 0x7f1fd80c0a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:42.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:42.474+0000 7f1fdde1d700 1 --2- 172.21.15.72:0/800229135 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1fd8071e00 0x7f1fd8154b80 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:42.492 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:42.474+0000 7f1fdde1d700 1 -- 172.21.15.72:0/800229135 >> 172.21.15.72:0/800229135 conn(0x7f1fd8070c90 msgr2=0x7f1fd80710a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:42.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:42.474+0000 7f1fdde1d700 1 -- 172.21.15.72:0/800229135 shutdown_connections 2023-07-25T14:37:42.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:42.474+0000 7f1fdde1d700 1 -- 172.21.15.72:0/800229135 wait complete. 2023-07-25T14:37:42.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:42.475+0000 7f1fdde1d700 1 Processor -- start 2023-07-25T14:37:42.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:42.475+0000 7f1fdde1d700 1 -- start start 2023-07-25T14:37:42.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:42.476+0000 7f1fdde1d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1fd806dc20 0x7f1fd8157990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:42.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:42.476+0000 7f1fdde1d700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1fd8071e00 0x7f1fd814d820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:42.493 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:42.476+0000 7f1fdde1d700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1fd814aa60 0x7f1fd814dd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:42.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:42.476+0000 7f1fdde1d700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fd81edcc0 con 0x7f1fd806dc20 2023-07-25T14:37:42.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:42.476+0000 7f1fdde1d700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fd814d390 con 0x7f1fd8071e00 2023-07-25T14:37:42.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:42.476+0000 7f1fdde1d700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fd814b640 con 0x7f1fd814aa60 2023-07-25T14:37:42.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:42.476+0000 7f1fd77fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1fd806dc20 0x7f1fd8157990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:42.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:42.476+0000 7f1fd77fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1fd806dc20 0x7f1fd8157990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43626/0 (socket says 172.21.15.72:43626) 2023-07-25T14:37:42.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:42.476+0000 7f1fd77fe700 1 -- 172.21.15.72:0/1868991739 learned_addr learned my addr 172.21.15.72:0/1868991739 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:37:42.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:42.476+0000 7f1fd77fe700 1 -- 172.21.15.72:0/1868991739 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1fd814aa60 msgr2=0x7f1fd814dd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:42.494 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:42.476+0000 7f1fd77fe700 1 --2- 172.21.15.72:0/1868991739 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1fd814aa60 0x7f1fd814dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:42.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:42.476+0000 7f1fd77fe700 1 -- 172.21.15.72:0/1868991739 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1fd8071e00 msgr2=0x7f1fd814d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:42.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:42.476+0000 7f1fd77fe700 1 --2- 172.21.15.72:0/1868991739 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1fd8071e00 0x7f1fd814d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:42.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:42.476+0000 7f1fd77fe700 1 -- 172.21.15.72:0/1868991739 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fc80094a0 con 0x7f1fd806dc20 2023-07-25T14:37:42.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:42.476+0000 7f1fd77fe700 1 --2- 172.21.15.72:0/1868991739 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1fd806dc20 0x7f1fd8157990 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f1fcc00d800 tx=0x7f1fcc00dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:42.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:42.476+0000 7f1fbffff700 1 -- 172.21.15.72:0/1868991739 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fcc0125f0 con 0x7f1fd806dc20 2023-07-25T14:37:42.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:42.476+0000 7f1fbffff700 1 -- 172.21.15.72:0/1868991739 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fcc012750 con 0x7f1fd806dc20 2023-07-25T14:37:42.495 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:42.476+0000 7f1fdde1d700 1 -- 172.21.15.72:0/1868991739 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fd814b920 con 0x7f1fd806dc20 2023-07-25T14:37:42.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:42.476+0000 7f1fbffff700 1 -- 172.21.15.72:0/1868991739 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fcc012b00 con 0x7f1fd806dc20 2023-07-25T14:37:42.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:42.476+0000 7f1fdde1d700 1 -- 172.21.15.72:0/1868991739 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fd81585a0 con 0x7f1fd806dc20 2023-07-25T14:37:42.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:42.477+0000 7f1fdde1d700 1 -- 172.21.15.72:0/1868991739 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fd804e470 con 0x7f1fd806dc20 2023-07-25T14:37:42.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:42.478+0000 7f1fbffff700 1 -- 172.21.15.72:0/1868991739 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1fcc012c60 con 0x7f1fd806dc20 2023-07-25T14:37:42.496 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:42.478+0000 7f1fbffff700 1 --2- 172.21.15.72:0/1868991739 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f1fc406ace0 0x7f1fc406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:42.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:42.478+0000 7f1fbffff700 1 -- 172.21.15.72:0/1868991739 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f1fcc089600 con 0x7f1fd806dc20 2023-07-25T14:37:42.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:42.478+0000 7f1fd6ffd700 1 --2- 172.21.15.72:0/1868991739 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f1fc406ace0 0x7f1fc406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:42.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:42.478+0000 7f1fd6ffd700 1 --2- 172.21.15.72:0/1868991739 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f1fc406ace0 0x7f1fc406d1a0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f1fd806f670 tx=0x7f1fc8010000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:42.497 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:42.482+0000 7f1fbffff700 1 -- 172.21.15.72:0/1868991739 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f1fcc0548c0 con 0x7f1fd806dc20 2023-07-25T14:37:42.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:42.670+0000 7f1fdde1d700 1 -- 172.21.15.72:0/1868991739 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f1fd806cd10 con 0x7f1fd806dc20 2023-07-25T14:37:43.159 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:43.149+0000 7f1fbffff700 1 -- 172.21.15.72:0/1868991739 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v54) v1 ==== 138+0+0 (secure 0 0 0) 0x7f1fcc057ee0 con 0x7f1fd806dc20 2023-07-25T14:37:43.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:43.153+0000 7f1fdde1d700 1 -- 172.21.15.72:0/1868991739 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f1fc406ace0 msgr2=0x7f1fc406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:43.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:43.153+0000 7f1fdde1d700 1 --2- 172.21.15.72:0/1868991739 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f1fc406ace0 0x7f1fc406d1a0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f1fd806f670 tx=0x7f1fc8010000 comp rx=0 tx=0).stop 2023-07-25T14:37:43.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:43.153+0000 7f1fdde1d700 1 -- 172.21.15.72:0/1868991739 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1fd806dc20 msgr2=0x7f1fd8157990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:43.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:43.153+0000 7f1fdde1d700 1 --2- 172.21.15.72:0/1868991739 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1fd806dc20 0x7f1fd8157990 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f1fcc00d800 tx=0x7f1fcc00dbc0 comp rx=0 tx=0).stop 2023-07-25T14:37:43.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:43.153+0000 7f1fdde1d700 1 -- 172.21.15.72:0/1868991739 shutdown_connections 2023-07-25T14:37:43.164 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:43.153+0000 7f1fdde1d700 1 --2- 172.21.15.72:0/1868991739 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f1fc406ace0 0x7f1fc406d1a0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:43.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:43.153+0000 7f1fdde1d700 1 --2- 172.21.15.72:0/1868991739 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1fd814aa60 0x7f1fd814dd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:43.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:43.153+0000 7f1fdde1d700 1 --2- 172.21.15.72:0/1868991739 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1fd806dc20 0x7f1fd8157990 secure :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f1fcc00d800 tx=0x7f1fcc00dbc0 comp rx=0 tx=0).stop 2023-07-25T14:37:43.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:43.153+0000 7f1fdde1d700 1 --2- 172.21.15.72:0/1868991739 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1fd8071e00 0x7f1fd814d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:43.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:43.153+0000 7f1fdde1d700 1 -- 172.21.15.72:0/1868991739 >> 172.21.15.72:0/1868991739 conn(0x7f1fd8070c90 msgr2=0x7f1fd8071070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:43.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:43.153+0000 7f1fdde1d700 1 -- 172.21.15.72:0/1868991739 shutdown_connections 2023-07-25T14:37:43.165 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:43.153+0000 7f1fdde1d700 1 -- 172.21.15.72:0/1868991739 wait complete. 2023-07-25T14:37:43.166 INFO:teuthology.orchestra.run.smithi072.stderr:pool 'cephfs_metadata' created 2023-07-25T14:37:43.178 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-07-25T14:37:43.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:43.295+0000 7f9b05053700 1 Processor -- start 2023-07-25T14:37:43.306 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:43.295+0000 7f9b05053700 1 -- start start 2023-07-25T14:37:43.308 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:43.296+0000 7f9b05053700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9b000bbcf0 0x7f9b000bfed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:43.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:43.296+0000 7f9b05053700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f9b000bb350 0x7f9b0006c910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:43.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:43.296+0000 7f9b05053700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b000bc790 con 0x7f9b000bfaf0 2023-07-25T14:37:43.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:43.296+0000 7f9b05053700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b0006e1a0 con 0x7f9b000bb350 2023-07-25T14:37:43.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:43.296+0000 7f9b05053700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b0006f6b0 con 0x7f9b000bbcf0 2023-07-25T14:37:43.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:43.296+0000 7f9afed9d700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f9b000bfaf0 0x7f9b0006efa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:34370/0 (socket says 172.21.15.72:34370) 2023-07-25T14:37:43.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:43.296+0000 7f9afed9d700 1 -- 172.21.15.72:0/2612149380 learned_addr learned my addr 172.21.15.72:0/2612149380 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:37:43.309 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:43.296+0000 7f9afe59c700 1 --2- 172.21.15.72:0/2612149380 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9b000bbcf0 0x7f9b000bfed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:43.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:43.296+0000 7f9aff59e700 1 --2- 172.21.15.72:0/2612149380 >> v2:172.21.15.92:3300/0 conn(0x7f9b000bb350 0x7f9b0006c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:43.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:43.296+0000 7f9afdd9b700 1 -- 172.21.15.72:0/2612149380 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2358351618 0 0) 0x7f9b000bc790 con 0x7f9b000bfaf0 2023-07-25T14:37:43.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:43.296+0000 7f9afdd9b700 1 -- 172.21.15.72:0/2612149380 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ae80035b0 con 0x7f9b000bfaf0 2023-07-25T14:37:43.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:43.297+0000 7f9aff59e700 1 -- 172.21.15.72:0/2612149380 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9b000bbcf0 msgr2=0x7f9b000bfed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:43.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:43.297+0000 7f9afdd9b700 1 -- 172.21.15.72:0/2612149380 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 681289219 0 0) 0x7f9ae80035b0 con 0x7f9b000bfaf0 2023-07-25T14:37:43.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:43.297+0000 7f9aff59e700 1 --2- 172.21.15.72:0/2612149380 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9b000bbcf0 0x7f9b000bfed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:43.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:43.297+0000 7f9aff59e700 1 -- 172.21.15.72:0/2612149380 >> v1:172.21.15.72:6789/0 conn(0x7f9b000bfaf0 legacy=0x7f9b0006efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:43.310 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:43.297+0000 7f9aff59e700 1 -- 172.21.15.72:0/2612149380 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b000c0900 con 0x7f9b000bb350 2023-07-25T14:37:43.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:43.297+0000 7f9afe59c700 1 --2- 172.21.15.72:0/2612149380 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9b000bbcf0 0x7f9b000bfed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-25T14:37:43.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:43.297+0000 7f9aff59e700 1 --2- 172.21.15.72:0/2612149380 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9b000bb350 0x7f9b0006c910 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f9af800aea0 tx=0x7f9af800c330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e011b48d54860fbb server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:43.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:43.297+0000 7f9afdd9b700 1 -- 172.21.15.72:0/2612149380 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9af800f070 con 0x7f9b000bb350 2023-07-25T14:37:43.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:43.297+0000 7f9afdd9b700 1 -- 172.21.15.72:0/2612149380 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9af8003a20 con 0x7f9b000bb350 2023-07-25T14:37:43.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:43.297+0000 7f9afdd9b700 1 -- 172.21.15.72:0/2612149380 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9af4001670 con 0x7f9b000bb350 2023-07-25T14:37:43.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:43.298+0000 7f9b05053700 1 -- 172.21.15.72:0/2612149380 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9b000bb350 msgr2=0x7f9b0006c910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:43.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:43.298+0000 7f9b05053700 1 --2- 172.21.15.72:0/2612149380 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9b000bb350 0x7f9b0006c910 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f9af800aea0 tx=0x7f9af800c330 comp rx=0 tx=0).stop 2023-07-25T14:37:43.311 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:43.298+0000 7f9b05053700 1 -- 172.21.15.72:0/2612149380 shutdown_connections 2023-07-25T14:37:43.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:43.298+0000 7f9b05053700 1 --2- 172.21.15.72:0/2612149380 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9b000bb350 0x7f9b0006c910 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:43.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:43.298+0000 7f9b05053700 1 --2- 172.21.15.72:0/2612149380 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9b000bbcf0 0x7f9b000bfed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:43.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:43.298+0000 7f9b05053700 1 -- 172.21.15.72:0/2612149380 >> 172.21.15.72:0/2612149380 conn(0x7f9b00071bf0 msgr2=0x7f9b0006a190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:43.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:43.298+0000 7f9b05053700 1 -- 172.21.15.72:0/2612149380 shutdown_connections 2023-07-25T14:37:43.312 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:43.298+0000 7f9b05053700 1 -- 172.21.15.72:0/2612149380 wait complete. 2023-07-25T14:37:43.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:43.299+0000 7f9b05053700 1 Processor -- start 2023-07-25T14:37:43.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:43.299+0000 7f9b05053700 1 -- start start 2023-07-25T14:37:43.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:43.300+0000 7f9b05053700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9b000bb350 0x7f9b0014f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:43.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:43.300+0000 7f9b05053700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9b000bfaf0 0x7f9b000c5210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:43.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:43.300+0000 7f9b05053700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9b001485d0 0x7f9b000c5750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:43.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:43.300+0000 7f9b05053700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b00148090 con 0x7f9b000bfaf0 2023-07-25T14:37:43.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:43.300+0000 7f9b05053700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b000c4d80 con 0x7f9b001485d0 2023-07-25T14:37:43.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:43.300+0000 7f9b05053700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b00147df0 con 0x7f9b000bb350 2023-07-25T14:37:43.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:43.300+0000 7f9afe59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9b000bfaf0 0x7f9b000c5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:43.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:43.300+0000 7f9afe59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9b000bfaf0 0x7f9b000c5210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43642/0 (socket says 172.21.15.72:43642) 2023-07-25T14:37:43.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:43.300+0000 7f9afe59c700 1 -- 172.21.15.72:0/1100526293 learned_addr learned my addr 172.21.15.72:0/1100526293 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:37:43.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:43.300+0000 7f9aff59e700 1 --2- 172.21.15.72:0/1100526293 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9b001485d0 0x7f9b000c5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:43.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:43.300+0000 7f9afed9d700 1 --2- 172.21.15.72:0/1100526293 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9b000bb350 0x7f9b0014f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:43.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:43.300+0000 7f9afe59c700 1 -- 172.21.15.72:0/1100526293 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9b000bb350 msgr2=0x7f9b0014f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:43.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:43.300+0000 7f9afe59c700 1 --2- 172.21.15.72:0/1100526293 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9b000bb350 0x7f9b0014f470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:43.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:43.300+0000 7f9afe59c700 1 -- 172.21.15.72:0/1100526293 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9b001485d0 msgr2=0x7f9b000c5750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:43.316 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:43.300+0000 7f9afe59c700 1 --2- 172.21.15.72:0/1100526293 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9b001485d0 0x7f9b000c5750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:43.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:43.300+0000 7f9afe59c700 1 -- 172.21.15.72:0/1100526293 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9af00094a0 con 0x7f9b000bfaf0 2023-07-25T14:37:43.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:43.300+0000 7f9afe59c700 1 --2- 172.21.15.72:0/1100526293 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9b000bfaf0 0x7f9b000c5210 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f9af000ebe0 tx=0x7f9af000eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:43.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:43.300+0000 7f9ae77fe700 1 -- 172.21.15.72:0/1100526293 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9af00097a0 con 0x7f9b000bfaf0 2023-07-25T14:37:43.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:43.300+0000 7f9ae77fe700 1 -- 172.21.15.72:0/1100526293 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9af000c850 con 0x7f9b000bfaf0 2023-07-25T14:37:43.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:43.301+0000 7f9b05053700 1 -- 172.21.15.72:0/1100526293 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9af800ab80 con 0x7f9b000bfaf0 2023-07-25T14:37:43.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:43.301+0000 7f9ae77fe700 1 -- 172.21.15.72:0/1100526293 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9af000cbe0 con 0x7f9b000bfaf0 2023-07-25T14:37:43.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:43.301+0000 7f9b05053700 1 -- 172.21.15.72:0/1100526293 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b001daa80 con 0x7f9b000bfaf0 2023-07-25T14:37:43.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:43.301+0000 7f9b05053700 1 -- 172.21.15.72:0/1100526293 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b001da8e0 con 0x7f9b000bfaf0 2023-07-25T14:37:43.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:43.302+0000 7f9ae77fe700 1 -- 172.21.15.72:0/1100526293 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9af000cd40 con 0x7f9b000bfaf0 2023-07-25T14:37:43.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:43.302+0000 7f9ae77fe700 1 --2- 172.21.15.72:0/1100526293 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f9aec06ace0 0x7f9aec06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:43.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:43.302+0000 7f9ae77fe700 1 -- 172.21.15.72:0/1100526293 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5900+0+0 (secure 0 0 0) 0x7f9af0088fc0 con 0x7f9b000bfaf0 2023-07-25T14:37:43.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:43.302+0000 7f9afed9d700 1 --2- 172.21.15.72:0/1100526293 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f9aec06ace0 0x7f9aec06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:43.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:43.303+0000 7f9afed9d700 1 --2- 172.21.15.72:0/1100526293 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f9aec06ace0 0x7f9aec06d1a0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f9b00149730 tx=0x7f9af4001e40 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:43.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:43.307+0000 7f9ae77fe700 1 -- 172.21.15.72:0/1100526293 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f9af00bb310 con 0x7f9b000bfaf0 2023-07-25T14:37:43.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:43.493+0000 7f9b05053700 1 -- 172.21.15.72:0/1100526293 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f9b0004e470 con 0x7f9b000bfaf0 2023-07-25T14:37:44.162 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:44.151+0000 7f9ae77fe700 1 -- 172.21.15.72:0/1100526293 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v55) v1 ==== 170+0+0 (secure 0 0 0) 0x7f9b001da8e0 con 0x7f9b000bfaf0 2023-07-25T14:37:44.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:44.157+0000 7f9b05053700 1 -- 172.21.15.72:0/1100526293 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f9aec06ace0 msgr2=0x7f9aec06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:44.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:44.157+0000 7f9b05053700 1 --2- 172.21.15.72:0/1100526293 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f9aec06ace0 0x7f9aec06d1a0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f9b00149730 tx=0x7f9af4001e40 comp rx=0 tx=0).stop 2023-07-25T14:37:44.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:44.157+0000 7f9b05053700 1 -- 172.21.15.72:0/1100526293 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9b000bfaf0 msgr2=0x7f9b000c5210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:44.168 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:44.157+0000 7f9b05053700 1 --2- 172.21.15.72:0/1100526293 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9b000bfaf0 0x7f9b000c5210 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f9af000ebe0 tx=0x7f9af000eef0 comp rx=0 tx=0).stop 2023-07-25T14:37:44.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:44.157+0000 7f9b05053700 1 -- 172.21.15.72:0/1100526293 shutdown_connections 2023-07-25T14:37:44.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:44.157+0000 7f9b05053700 1 --2- 172.21.15.72:0/1100526293 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f9aec06ace0 0x7f9aec06d1a0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:44.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:44.157+0000 7f9b05053700 1 --2- 172.21.15.72:0/1100526293 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9b000bb350 0x7f9b0014f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:44.169 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:44.157+0000 7f9b05053700 1 --2- 172.21.15.72:0/1100526293 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9b001485d0 0x7f9b000c5750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:44.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:44.157+0000 7f9b05053700 1 --2- 172.21.15.72:0/1100526293 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9b000bfaf0 0x7f9b000c5210 secure :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f9af000ebe0 tx=0x7f9af000eef0 comp rx=0 tx=0).stop 2023-07-25T14:37:44.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:44.157+0000 7f9b05053700 1 -- 172.21.15.72:0/1100526293 >> 172.21.15.72:0/1100526293 conn(0x7f9b00071bf0 msgr2=0x7f9b0006c910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:44.170 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:44.159+0000 7f9b05053700 1 -- 172.21.15.72:0/1100526293 shutdown_connections 2023-07-25T14:37:44.171 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:44.160+0000 7f9b05053700 1 -- 172.21.15.72:0/1100526293 wait complete. 2023-07-25T14:37:44.176 INFO:teuthology.orchestra.run.smithi072.stderr:pool 'cephfs_data' created 2023-07-25T14:37:44.190 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-07-25T14:37:44.314 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:44.303+0000 7f3f531bc700 1 Processor -- start 2023-07-25T14:37:44.315 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:44.303+0000 7f3f531bc700 1 -- start start 2023-07-25T14:37:44.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:44.304+0000 7f3f531bc700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f3f4c14e6f0 0x7f3f4c0c67d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:44.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:44.304+0000 7f3f531bc700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3f4c06f280 0x7f3f4c0a8170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:44.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:44.304+0000 7f3f531bc700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f4c0ba1c0 con 0x7f3f4c0c11f0 2023-07-25T14:37:44.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:44.304+0000 7f3f531bc700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f4c0a7920 con 0x7f3f4c14e6f0 2023-07-25T14:37:44.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:44.304+0000 7f3f531bc700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f4c154640 con 0x7f3f4c06f280 2023-07-25T14:37:44.317 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:44.304+0000 7f3f51759700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f3f4c0c11f0 0x7f3f4c0a86b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:34386/0 (socket says 172.21.15.72:34386) 2023-07-25T14:37:44.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:44.304+0000 7f3f51759700 1 -- 172.21.15.72:0/3991097660 learned_addr learned my addr 172.21.15.72:0/3991097660 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:37:44.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:44.304+0000 7f3f4bfff700 1 --2- 172.21.15.72:0/3991097660 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3f4c06f280 0x7f3f4c0a8170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:44.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:44.304+0000 7f3f50f58700 1 --2- 172.21.15.72:0/3991097660 >> v2:172.21.15.92:3300/0 conn(0x7f3f4c14e6f0 0x7f3f4c0c67d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:44.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:44.305+0000 7f3f4b7fe700 1 -- 172.21.15.72:0/3991097660 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3223190096 0 0) 0x7f3f4c0ba1c0 con 0x7f3f4c0c11f0 2023-07-25T14:37:44.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:44.305+0000 7f3f4b7fe700 1 -- 172.21.15.72:0/3991097660 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3f3c0035b0 con 0x7f3f4c0c11f0 2023-07-25T14:37:44.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:44.305+0000 7f3f4b7fe700 1 -- 172.21.15.72:0/3991097660 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 628341055 0 0) 0x7f3f3c0035b0 con 0x7f3f4c0c11f0 2023-07-25T14:37:44.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:44.305+0000 7f3f50f58700 1 -- 172.21.15.72:0/3991097660 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3f4c06f280 msgr2=0x7f3f4c0a8170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:44.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:44.305+0000 7f3f50f58700 1 --2- 172.21.15.72:0/3991097660 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3f4c06f280 0x7f3f4c0a8170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:44.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:44.305+0000 7f3f50f58700 1 -- 172.21.15.72:0/3991097660 >> v1:172.21.15.72:6789/0 conn(0x7f3f4c0c11f0 legacy=0x7f3f4c0a86b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:44.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:44.305+0000 7f3f50f58700 1 -- 172.21.15.72:0/3991097660 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f4c154900 con 0x7f3f4c14e6f0 2023-07-25T14:37:44.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:44.305+0000 7f3f4bfff700 1 --2- 172.21.15.72:0/3991097660 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3f4c06f280 0x7f3f4c0a8170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-25T14:37:44.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:44.305+0000 7f3f50f58700 1 --2- 172.21.15.72:0/3991097660 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3f4c14e6f0 0x7f3f4c0c67d0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f3f40009840 tx=0x7f3f40009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3e00668a2097466f server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:44.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:44.305+0000 7f3f4b7fe700 1 -- 172.21.15.72:0/3991097660 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f440019f0 con 0x7f3f4c14e6f0 2023-07-25T14:37:44.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:44.305+0000 7f3f4b7fe700 1 -- 172.21.15.72:0/3991097660 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f40004030 con 0x7f3f4c14e6f0 2023-07-25T14:37:44.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:44.305+0000 7f3f4b7fe700 1 -- 172.21.15.72:0/3991097660 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f400043a0 con 0x7f3f4c14e6f0 2023-07-25T14:37:44.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:44.306+0000 7f3f531bc700 1 -- 172.21.15.72:0/3991097660 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3f4c14e6f0 msgr2=0x7f3f4c0c67d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:44.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:44.306+0000 7f3f531bc700 1 --2- 172.21.15.72:0/3991097660 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3f4c14e6f0 0x7f3f4c0c67d0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f3f40009840 tx=0x7f3f40009b50 comp rx=0 tx=0).stop 2023-07-25T14:37:44.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:44.306+0000 7f3f531bc700 1 -- 172.21.15.72:0/3991097660 shutdown_connections 2023-07-25T14:37:44.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:44.306+0000 7f3f531bc700 1 --2- 172.21.15.72:0/3991097660 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3f4c14e6f0 0x7f3f4c0c67d0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:44.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:44.306+0000 7f3f531bc700 1 --2- 172.21.15.72:0/3991097660 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3f4c06f280 0x7f3f4c0a8170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:44.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:44.306+0000 7f3f531bc700 1 -- 172.21.15.72:0/3991097660 >> 172.21.15.72:0/3991097660 conn(0x7f3f4c0714f0 msgr2=0x7f3f4c071900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:44.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:44.306+0000 7f3f531bc700 1 -- 172.21.15.72:0/3991097660 shutdown_connections 2023-07-25T14:37:44.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:44.306+0000 7f3f531bc700 1 -- 172.21.15.72:0/3991097660 wait complete. 2023-07-25T14:37:44.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:44.307+0000 7f3f531bc700 1 Processor -- start 2023-07-25T14:37:44.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:44.307+0000 7f3f531bc700 1 -- start start 2023-07-25T14:37:44.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:44.308+0000 7f3f531bc700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3f4c06f280 0x7f3f4c153640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:44.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:44.308+0000 7f3f531bc700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3f4c0c11f0 0x7f3f4c0bfa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:44.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:44.308+0000 7f3f531bc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3f4c14e6f0 0x7f3f4c0bffd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:44.323 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:44.308+0000 7f3f531bc700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f4c0bd3e0 con 0x7f3f4c14e6f0 2023-07-25T14:37:44.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:44.308+0000 7f3f531bc700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f4c0bf600 con 0x7f3f4c06f280 2023-07-25T14:37:44.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:44.308+0000 7f3f531bc700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f4c0bce20 con 0x7f3f4c0c11f0 2023-07-25T14:37:44.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:44.308+0000 7f3f51759700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3f4c14e6f0 0x7f3f4c0bffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:44.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:44.309+0000 7f3f51759700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3f4c14e6f0 0x7f3f4c0bffd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43656/0 (socket says 172.21.15.72:43656) 2023-07-25T14:37:44.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:44.309+0000 7f3f51759700 1 -- 172.21.15.72:0/2735296937 learned_addr learned my addr 172.21.15.72:0/2735296937 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:37:44.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:44.309+0000 7f3f50f58700 1 --2- 172.21.15.72:0/2735296937 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3f4c06f280 0x7f3f4c153640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:44.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:44.309+0000 7f3f4bfff700 1 --2- 172.21.15.72:0/2735296937 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3f4c0c11f0 0x7f3f4c0bfa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:44.325 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:44.309+0000 7f3f51759700 1 -- 172.21.15.72:0/2735296937 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3f4c0c11f0 msgr2=0x7f3f4c0bfa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:44.325 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:44.309+0000 7f3f51759700 1 --2- 172.21.15.72:0/2735296937 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3f4c0c11f0 0x7f3f4c0bfa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:44.325 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:44.309+0000 7f3f51759700 1 -- 172.21.15.72:0/2735296937 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3f4c06f280 msgr2=0x7f3f4c153640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:44.325 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:44.309+0000 7f3f51759700 1 --2- 172.21.15.72:0/2735296937 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3f4c06f280 0x7f3f4c153640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:44.325 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:44.309+0000 7f3f51759700 1 -- 172.21.15.72:0/2735296937 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f380094a0 con 0x7f3f4c14e6f0 2023-07-25T14:37:44.325 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:44.309+0000 7f3f51759700 1 --2- 172.21.15.72:0/2735296937 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3f4c14e6f0 0x7f3f4c0bffd0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f3f4400cc90 tx=0x7f3f4400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:44.325 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:44.309+0000 7f3f497fa700 1 -- 172.21.15.72:0/2735296937 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f4400aad0 con 0x7f3f4c14e6f0 2023-07-25T14:37:44.326 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:44.309+0000 7f3f497fa700 1 -- 172.21.15.72:0/2735296937 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f4400ac30 con 0x7f3f4c14e6f0 2023-07-25T14:37:44.326 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:44.309+0000 7f3f531bc700 1 -- 172.21.15.72:0/2735296937 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f400094a0 con 0x7f3f4c14e6f0 2023-07-25T14:37:44.326 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:44.309+0000 7f3f497fa700 1 -- 172.21.15.72:0/2735296937 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f440070d0 con 0x7f3f4c14e6f0 2023-07-25T14:37:44.326 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:44.309+0000 7f3f531bc700 1 -- 172.21.15.72:0/2735296937 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f4c0bf290 con 0x7f3f4c14e6f0 2023-07-25T14:37:44.326 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:44.310+0000 7f3f531bc700 1 -- 172.21.15.72:0/2735296937 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f4c0bf0f0 con 0x7f3f4c14e6f0 2023-07-25T14:37:44.326 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:44.310+0000 7f3f497fa700 1 -- 172.21.15.72:0/2735296937 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3f44007230 con 0x7f3f4c14e6f0 2023-07-25T14:37:44.326 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:44.311+0000 7f3f497fa700 1 --2- 172.21.15.72:0/2735296937 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f3f3006ace0 0x7f3f3006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:44.326 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:44.311+0000 7f3f497fa700 1 -- 172.21.15.72:0/2735296937 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6282+0+0 (secure 0 0 0) 0x7f3f440893d0 con 0x7f3f4c14e6f0 2023-07-25T14:37:44.327 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:44.311+0000 7f3f50f58700 1 --2- 172.21.15.72:0/2735296937 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f3f3006ace0 0x7f3f3006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:44.327 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:44.311+0000 7f3f50f58700 1 --2- 172.21.15.72:0/2735296937 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f3f3006ace0 0x7f3f3006d1a0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f3f400090b0 tx=0x7f3f40008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:44.327 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:44.315+0000 7f3f497fa700 1 -- 172.21.15.72:0/2735296937 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f3f4c0bf0f0 con 0x7f3f4c14e6f0 2023-07-25T14:37:44.555 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:44.544+0000 7f3f531bc700 1 -- 172.21.15.72:0/2735296937 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f3f4c0bf0f0 con 0x7f3f4c14e6f0 2023-07-25T14:37:45.200 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:45.190+0000 7f3f497fa700 1 -- 172.21.15.72:0/2735296937 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 10 and data pool 11 v29) v1 ==== 174+0+0 (secure 0 0 0) 0x7f3f4c0bf0f0 con 0x7f3f4c14e6f0 2023-07-25T14:37:45.207 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:45.197+0000 7f3f531bc700 1 -- 172.21.15.72:0/2735296937 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f3f3006ace0 msgr2=0x7f3f3006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:45.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:45.197+0000 7f3f531bc700 1 --2- 172.21.15.72:0/2735296937 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f3f3006ace0 0x7f3f3006d1a0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f3f400090b0 tx=0x7f3f40008030 comp rx=0 tx=0).stop 2023-07-25T14:37:45.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:45.197+0000 7f3f531bc700 1 -- 172.21.15.72:0/2735296937 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3f4c14e6f0 msgr2=0x7f3f4c0bffd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:45.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:45.197+0000 7f3f531bc700 1 --2- 172.21.15.72:0/2735296937 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3f4c14e6f0 0x7f3f4c0bffd0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f3f4400cc90 tx=0x7f3f4400a060 comp rx=0 tx=0).stop 2023-07-25T14:37:45.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:45.197+0000 7f3f531bc700 1 -- 172.21.15.72:0/2735296937 shutdown_connections 2023-07-25T14:37:45.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:45.197+0000 7f3f531bc700 1 --2- 172.21.15.72:0/2735296937 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f3f3006ace0 0x7f3f3006d1a0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:45.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:45.197+0000 7f3f531bc700 1 --2- 172.21.15.72:0/2735296937 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3f4c14e6f0 0x7f3f4c0bffd0 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:45.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:45.197+0000 7f3f531bc700 1 --2- 172.21.15.72:0/2735296937 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3f4c06f280 0x7f3f4c153640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:45.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:45.197+0000 7f3f531bc700 1 --2- 172.21.15.72:0/2735296937 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3f4c0c11f0 0x7f3f4c0bfa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:45.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:45.197+0000 7f3f531bc700 1 -- 172.21.15.72:0/2735296937 >> 172.21.15.72:0/2735296937 conn(0x7f3f4c0714f0 msgr2=0x7f3f4c150ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:45.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:45.198+0000 7f3f531bc700 1 -- 172.21.15.72:0/2735296937 shutdown_connections 2023-07-25T14:37:45.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:45.198+0000 7f3f531bc700 1 -- 172.21.15.72:0/2735296937 wait complete. 2023-07-25T14:37:45.213 INFO:teuthology.orchestra.run.smithi072.stderr:new fs with metadata pool 10 and data pool 11 2023-07-25T14:37:45.230 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-25T14:37:45.355 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:45.344+0000 7f6ed7491700 1 Processor -- start 2023-07-25T14:37:45.355 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:45.344+0000 7f6ed7491700 1 -- start start 2023-07-25T14:37:45.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:45.345+0000 7f6ed7491700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f6ed0151ba0 0x7f6ed00c2230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:45.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:45.345+0000 7f6ed7491700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6ed0154d50 0x7f6ed015b970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:45.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:45.345+0000 7f6ed7491700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ed00c54f0 con 0x7f6ed00c5f40 2023-07-25T14:37:45.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:45.345+0000 7f6ed7491700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ed00c6670 con 0x7f6ed0151ba0 2023-07-25T14:37:45.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:45.345+0000 7f6ed7491700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ed00c5740 con 0x7f6ed0154d50 2023-07-25T14:37:45.358 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:45.345+0000 7f6ed522d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f6ed0151ba0 0x7f6ed00c2230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:45.358 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:45.345+0000 7f6ed4a2c700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f6ed00c5f40 0x7f6ed0154640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:34398/0 (socket says 172.21.15.72:34398) 2023-07-25T14:37:45.358 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:45.345+0000 7f6ed4a2c700 1 -- 172.21.15.72:0/1548825574 learned_addr learned my addr 172.21.15.72:0/1548825574 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:37:45.358 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:45.345+0000 7f6ed5a2e700 1 --2- 172.21.15.72:0/1548825574 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6ed0154d50 0x7f6ed015b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:45.358 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:45.345+0000 7f6ed522d700 1 -- 172.21.15.72:0/1548825574 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6ed0154d50 msgr2=0x7f6ed015b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:45.358 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:45.345+0000 7f6ed522d700 1 --2- 172.21.15.72:0/1548825574 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6ed0154d50 0x7f6ed015b970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:45.358 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:45.345+0000 7f6ed522d700 1 -- 172.21.15.72:0/1548825574 >> v1:172.21.15.72:6789/0 conn(0x7f6ed00c5f40 legacy=0x7f6ed0154640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:45.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:45.345+0000 7f6ed522d700 1 -- 172.21.15.72:0/1548825574 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ed00c5a20 con 0x7f6ed0151ba0 2023-07-25T14:37:45.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:45.345+0000 7f6ec7fff700 1 -- 172.21.15.72:0/1548825574 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3748185625 0 0) 0x7f6ed00c54f0 con 0x7f6ed00c5f40 2023-07-25T14:37:45.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:45.345+0000 7f6ed522d700 1 --2- 172.21.15.72:0/1548825574 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6ed0151ba0 0x7f6ed00c2230 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f6ec0009840 tx=0x7f6ec0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d780a7e1a11c5939 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:45.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:45.346+0000 7f6ec7fff700 1 -- 172.21.15.72:0/1548825574 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ec0011830 con 0x7f6ed0151ba0 2023-07-25T14:37:45.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:45.346+0000 7f6ec7fff700 1 -- 172.21.15.72:0/1548825574 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ec0011990 con 0x7f6ed0151ba0 2023-07-25T14:37:45.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:45.346+0000 7f6ec7fff700 1 -- 172.21.15.72:0/1548825574 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ec0011d20 con 0x7f6ed0151ba0 2023-07-25T14:37:45.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:45.346+0000 7f6ed7491700 1 -- 172.21.15.72:0/1548825574 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6ed0151ba0 msgr2=0x7f6ed00c2230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:45.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:45.346+0000 7f6ed7491700 1 --2- 172.21.15.72:0/1548825574 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6ed0151ba0 0x7f6ed00c2230 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f6ec0009840 tx=0x7f6ec0009b50 comp rx=0 tx=0).stop 2023-07-25T14:37:45.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:45.346+0000 7f6ed7491700 1 -- 172.21.15.72:0/1548825574 shutdown_connections 2023-07-25T14:37:45.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:45.346+0000 7f6ed7491700 1 --2- 172.21.15.72:0/1548825574 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6ed0154d50 0x7f6ed015b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:45.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:45.346+0000 7f6ed7491700 1 --2- 172.21.15.72:0/1548825574 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6ed0151ba0 0x7f6ed00c2230 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:45.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:45.346+0000 7f6ed7491700 1 -- 172.21.15.72:0/1548825574 >> 172.21.15.72:0/1548825574 conn(0x7f6ed00a87e0 msgr2=0x7f6ed00a8bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:45.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:45.346+0000 7f6ed7491700 1 -- 172.21.15.72:0/1548825574 shutdown_connections 2023-07-25T14:37:45.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:45.346+0000 7f6ed7491700 1 -- 172.21.15.72:0/1548825574 wait complete. 2023-07-25T14:37:45.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:45.347+0000 7f6ed7491700 1 Processor -- start 2023-07-25T14:37:45.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:45.347+0000 7f6ed7491700 1 -- start start 2023-07-25T14:37:45.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:45.348+0000 7f6ed7491700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6ed00c5f40 0x7f6ed014b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:45.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:45.348+0000 7f6ed7491700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6ed0151ba0 0x7f6ed01ea4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:45.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:45.348+0000 7f6ed7491700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6ed00aa240 0x7f6ed00aac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:45.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:45.348+0000 7f6ed7491700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ed00ab730 con 0x7f6ed00c5f40 2023-07-25T14:37:45.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:45.348+0000 7f6ed7491700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ed01eaa30 con 0x7f6ed00aa240 2023-07-25T14:37:45.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:45.348+0000 7f6ed7491700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ed014d610 con 0x7f6ed0151ba0 2023-07-25T14:37:45.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:45.348+0000 7f6ed522d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6ed00c5f40 0x7f6ed014b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:45.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:45.348+0000 7f6ed522d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6ed00c5f40 0x7f6ed014b5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43666/0 (socket says 172.21.15.72:43666) 2023-07-25T14:37:45.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:45.348+0000 7f6ed522d700 1 -- 172.21.15.72:0/2909768700 learned_addr learned my addr 172.21.15.72:0/2909768700 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:37:45.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:45.348+0000 7f6ed4a2c700 1 --2- 172.21.15.72:0/2909768700 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6ed0151ba0 0x7f6ed01ea4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:45.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:45.348+0000 7f6ed5a2e700 1 --2- 172.21.15.72:0/2909768700 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6ed00aa240 0x7f6ed00aac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:45.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:45.348+0000 7f6ed522d700 1 -- 172.21.15.72:0/2909768700 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6ed0151ba0 msgr2=0x7f6ed01ea4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:45.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:45.348+0000 7f6ed522d700 1 --2- 172.21.15.72:0/2909768700 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6ed0151ba0 0x7f6ed01ea4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:45.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:45.348+0000 7f6ed522d700 1 -- 172.21.15.72:0/2909768700 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6ed00aa240 msgr2=0x7f6ed00aac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:45.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:45.348+0000 7f6ed522d700 1 --2- 172.21.15.72:0/2909768700 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6ed00aa240 0x7f6ed00aac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:45.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:45.348+0000 7f6ed522d700 1 -- 172.21.15.72:0/2909768700 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ec00094a0 con 0x7f6ed00c5f40 2023-07-25T14:37:45.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:45.348+0000 7f6ed5a2e700 1 --2- 172.21.15.72:0/2909768700 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6ed00aa240 0x7f6ed00aac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-25T14:37:45.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:45.348+0000 7f6ed4a2c700 1 --2- 172.21.15.72:0/2909768700 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6ed0151ba0 0x7f6ed01ea4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-25T14:37:45.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:45.348+0000 7f6ed522d700 1 --2- 172.21.15.72:0/2909768700 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6ed00c5f40 0x7f6ed014b5f0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f6ec00090b0 tx=0x7f6ec0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:45.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:45.349+0000 7f6ec5ffb700 1 -- 172.21.15.72:0/2909768700 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ec00038a0 con 0x7f6ed00c5f40 2023-07-25T14:37:45.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:45.349+0000 7f6ec5ffb700 1 -- 172.21.15.72:0/2909768700 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ec001f070 con 0x7f6ed00c5f40 2023-07-25T14:37:45.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:45.349+0000 7f6ed7491700 1 -- 172.21.15.72:0/2909768700 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ed014d8f0 con 0x7f6ed00c5f40 2023-07-25T14:37:45.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:45.349+0000 7f6ec5ffb700 1 -- 172.21.15.72:0/2909768700 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ec0003c20 con 0x7f6ed00c5f40 2023-07-25T14:37:45.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:45.349+0000 7f6ed7491700 1 -- 172.21.15.72:0/2909768700 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ed00a9a40 con 0x7f6ed00c5f40 2023-07-25T14:37:45.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:45.350+0000 7f6ed7491700 1 -- 172.21.15.72:0/2909768700 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ed004e470 con 0x7f6ed00c5f40 2023-07-25T14:37:45.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:45.350+0000 7f6ec5ffb700 1 -- 172.21.15.72:0/2909768700 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6ec001a430 con 0x7f6ed00c5f40 2023-07-25T14:37:45.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:45.351+0000 7f6ec5ffb700 1 --2- 172.21.15.72:0/2909768700 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f6eb406ace0 0x7f6eb406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:45.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:45.351+0000 7f6ec5ffb700 1 -- 172.21.15.72:0/2909768700 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f6ec0021070 con 0x7f6ed00c5f40 2023-07-25T14:37:45.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:45.351+0000 7f6ed4a2c700 1 --2- 172.21.15.72:0/2909768700 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f6eb406ace0 0x7f6eb406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:45.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:45.351+0000 7f6ed4a2c700 1 --2- 172.21.15.72:0/2909768700 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f6eb406ace0 0x7f6eb406d1a0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f6ed00c2cf0 tx=0x7f6ecc007ca0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:45.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:45.355+0000 7f6ec5ffb700 1 -- 172.21.15.72:0/2909768700 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f6ec0055fa0 con 0x7f6ed00c5f40 2023-07-25T14:37:45.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:45.546+0000 7f6ed7491700 1 -- 172.21.15.72:0/2909768700 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6ed01513a0 con 0x7f6ed00c5f40 2023-07-25T14:37:45.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:45.547+0000 7f6ec5ffb700 1 -- 172.21.15.72:0/2909768700 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v56) v1 ==== 74+0+18462 (secure 0 0 0) 0x7f6ec0015090 con 0x7f6ed00c5f40 2023-07-25T14:37:45.558 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-25T14:37:45.558 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":56,"fsid":"9170db48-9170-43e8-8ccb-9813e6240906","created":"2023-07-25T14:35:21.733262+0000","modified":"2023-07-25T14:37:44.546542+0000","last_up_change":"2023-07-25T14:35:31.355010+0000","last_in_change":"2023-07-25T14:35:24.195785+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-25T14:35:32.983457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-25T14:35:33.326342+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-07-25T14:37:42.689589+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-07-25T14:37:43.512214+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d517fdad-0bfe-49f0-89f2-9421c3761839","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6801","nonce":2475407414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6803","nonce":2475407414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6807","nonce":2475407414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6805","nonce":2475407414}]},"public_addr":"172.21.15.72:6801/2475407414","cluster_addr":"172.21.15.72:6803/2475407414","heartbeat_back_addr":"172.21.15.72:6807/2475407414","heartbeat_front_addr":"172.21.15.72:6805/2475407414","state":["exists","up"]},{"osd":1,"uuid":"e1564be3-f209-47e5-a8d0-32fc618a474f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6822","nonce":870954016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6825","nonce":870954016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6831","nonce":870954016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6827","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6829","nonce":870954016}]},"public_addr":"172.21.15.72:6822/870954016","cluster_addr":"172.21.15.72:6825/870954016","heartbeat_back_addr":"172.21.15.72:6831/870954016","heartbeat_front_addr":"172.21.15.72:6829/870954016","state":["exists","up"]},{"osd":2,"uuid":"c4647d30-ffa6-417a-9026-ef530c75910e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6809","nonce":2143129442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6811","nonce":2143129442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6815","nonce":2143129442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6813","nonce":2143129442}]},"public_addr":"172.21.15.72:6809/2143129442","cluster_addr":"172.21.15.72:6811/2143129442","heartbeat_back_addr":"172.21.15.72:6815/2143129442","heartbeat_front_addr":"172.21.15.72:6813/2143129442","state":["exists","up"]},{"osd":3,"uuid":"76c9d9a7-c2e2-4612-a58b-d6882dd76b58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6817","nonce":3404066311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6819","nonce":3404066311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6828","nonce":3404066311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6821","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6823","nonce":3404066311}]},"public_addr":"172.21.15.72:6817/3404066311","cluster_addr":"172.21.15.72:6819/3404066311","heartbeat_back_addr":"172.21.15.72:6828/3404066311","heartbeat_front_addr":"172.21.15.72:6823/3404066311","state":["exists","up"]},{"osd":4,"uuid":"7f8920dc-0ad4-4a73-ab40-65408f83eadd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6817","nonce":2381008739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6819","nonce":2381008739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6825","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6827","nonce":2381008739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6822","nonce":2381008739}]},"public_addr":"172.21.15.92:6817/2381008739","cluster_addr":"172.21.15.92:6819/2381008739","heartbeat_back_addr":"172.21.15.92:6827/2381008739","heartbeat_front_addr":"172.21.15.92:6822/2381008739","state":["exists","up"]},{"osd":5,"uuid":"56257e7c-31eb-44c5-9ec7-1318a4e0bb35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6801","nonce":2161935604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6803","nonce":2161935604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6807","nonce":2161935604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6805","nonce":2161935604}]},"public_addr":"172.21.15.92:6801/2161935604","cluster_addr":"172.21.15.92:6803/2161935604","heartbeat_back_addr":"172.21.15.92:6807/2161935604","heartbeat_front_addr":"172.21.15.92:6805/2161935604","state":["exists","up"]},{"osd":6,"uuid":"a150d3d8-a0c9-4955-968a-8d98eff4ffb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6809","nonce":3770163493}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6811","nonce":3770163493}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6815","nonce":3770163493}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6813","nonce":3770163493}]},"public_addr":"172.21.15.92:6809/3770163493","cluster_addr":"172.21.15.92:6811/3770163493","heartbeat_back_addr":"172.21.15.92:6815/3770163493","heartbeat_front_addr":"172.21.15.92:6813/3770163493","state":["exists","up"]},{"osd":7,"uuid":"07799c27-54ee-4591-a42d-a978d6b32065","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6821","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6823","nonce":2135777609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6826","nonce":2135777609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6831","nonce":2135777609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6829","nonce":2135777609}]},"public_addr":"172.21.15.92:6823/2135777609","cluster_addr":"172.21.15.92:6826/2135777609","heartbeat_back_addr":"172.21.15.92:6831/2135777609","heartbeat_front_addr":"172.21.15.92:6829/2135777609","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.345365+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.378150+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.146566+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.372172+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:30.398421+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.385632+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.465611+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.443583+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-25T14:37:45.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:45.549+0000 7f6ed7491700 1 -- 172.21.15.72:0/2909768700 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f6eb406ace0 msgr2=0x7f6eb406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:45.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:45.549+0000 7f6ed7491700 1 --2- 172.21.15.72:0/2909768700 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f6eb406ace0 0x7f6eb406d1a0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f6ed00c2cf0 tx=0x7f6ecc007ca0 comp rx=0 tx=0).stop 2023-07-25T14:37:45.560 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:45.549+0000 7f6ed7491700 1 -- 172.21.15.72:0/2909768700 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6ed00c5f40 msgr2=0x7f6ed014b5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:45.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:45.549+0000 7f6ed7491700 1 --2- 172.21.15.72:0/2909768700 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6ed00c5f40 0x7f6ed014b5f0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f6ec00090b0 tx=0x7f6ec0004750 comp rx=0 tx=0).stop 2023-07-25T14:37:45.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:45.549+0000 7f6ed7491700 1 -- 172.21.15.72:0/2909768700 shutdown_connections 2023-07-25T14:37:45.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:45.549+0000 7f6ed7491700 1 --2- 172.21.15.72:0/2909768700 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f6eb406ace0 0x7f6eb406d1a0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:45.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:45.549+0000 7f6ed7491700 1 --2- 172.21.15.72:0/2909768700 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6ed00aa240 0x7f6ed00aac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:45.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:45.549+0000 7f6ed7491700 1 --2- 172.21.15.72:0/2909768700 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6ed00c5f40 0x7f6ed014b5f0 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:45.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:45.549+0000 7f6ed7491700 1 --2- 172.21.15.72:0/2909768700 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6ed0151ba0 0x7f6ed01ea4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:45.561 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:45.549+0000 7f6ed7491700 1 -- 172.21.15.72:0/2909768700 >> 172.21.15.72:0/2909768700 conn(0x7f6ed00a87e0 msgr2=0x7f6ed00c4600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:45.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:45.549+0000 7f6ed7491700 1 -- 172.21.15.72:0/2909768700 shutdown_connections 2023-07-25T14:37:45.562 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:45.549+0000 7f6ed7491700 1 -- 172.21.15.72:0/2909768700 wait complete. 2023-07-25T14:37:45.572 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-25T14:37:45.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:45.681+0000 7f3aacb87700 1 Processor -- start 2023-07-25T14:37:45.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:45.681+0000 7f3aacb87700 1 -- start start 2023-07-25T14:37:45.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:45.682+0000 7f3aacb87700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f3aa814f810 0x7f3aa80c4370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:45.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:45.682+0000 7f3aacb87700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3aa80c5890 con 0x7f3aa80a9cc0 2023-07-25T14:37:45.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:45.682+0000 7f3aacb87700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3aa8152150 con 0x7f3aa80bb0b0 2023-07-25T14:37:45.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:45.682+0000 7f3aacb87700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3aa814fbf0 con 0x7f3aa814f810 2023-07-25T14:37:45.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:45.682+0000 7f3aa659c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f3aa814f810 0x7f3aa80c4370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:45.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:45.682+0000 7f3aa5d9b700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f3aa80a9cc0 0x7f3aa81525e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:34410/0 (socket says 172.21.15.72:34410) 2023-07-25T14:37:45.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:45.682+0000 7f3aa5d9b700 1 -- 172.21.15.72:0/2993055242 learned_addr learned my addr 172.21.15.72:0/2993055242 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:37:45.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:45.682+0000 7f3aa659c700 1 -- 172.21.15.72:0/2993055242 >> v1:172.21.15.92:6789/0 conn(0x7f3aa80bb0b0 legacy=0x7f3aa815cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:45.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:45.682+0000 7f3aa659c700 1 -- 172.21.15.72:0/2993055242 >> v1:172.21.15.72:6789/0 conn(0x7f3aa80a9cc0 legacy=0x7f3aa81525e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:45.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:45.682+0000 7f3aa559a700 1 -- 172.21.15.72:0/2993055242 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2313748381 0 0) 0x7f3aa80c5890 con 0x7f3aa80a9cc0 2023-07-25T14:37:45.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:45.682+0000 7f3aa659c700 1 -- 172.21.15.72:0/2993055242 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3aa81566a0 con 0x7f3aa814f810 2023-07-25T14:37:45.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:45.682+0000 7f3aa659c700 1 --2- 172.21.15.72:0/2993055242 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3aa814f810 0x7f3aa80c4370 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f3a9c009840 tx=0x7f3a9c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d65a786641c8fc6 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:45.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:45.683+0000 7f3aa559a700 1 -- 172.21.15.72:0/2993055242 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a9c011830 con 0x7f3aa814f810 2023-07-25T14:37:45.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:45.683+0000 7f3aa559a700 1 -- 172.21.15.72:0/2993055242 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a9c011990 con 0x7f3aa814f810 2023-07-25T14:37:45.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:45.683+0000 7f3aa559a700 1 -- 172.21.15.72:0/2993055242 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a9c011d20 con 0x7f3aa814f810 2023-07-25T14:37:45.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:45.683+0000 7f3aacb87700 1 -- 172.21.15.72:0/2993055242 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3aa814f810 msgr2=0x7f3aa80c4370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:45.696 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:45.683+0000 7f3aacb87700 1 --2- 172.21.15.72:0/2993055242 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3aa814f810 0x7f3aa80c4370 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f3a9c009840 tx=0x7f3a9c009b50 comp rx=0 tx=0).stop 2023-07-25T14:37:45.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:45.683+0000 7f3aacb87700 1 -- 172.21.15.72:0/2993055242 shutdown_connections 2023-07-25T14:37:45.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:45.683+0000 7f3aacb87700 1 --2- 172.21.15.72:0/2993055242 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3aa814f810 0x7f3aa80c4370 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:45.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:45.683+0000 7f3aacb87700 1 -- 172.21.15.72:0/2993055242 >> 172.21.15.72:0/2993055242 conn(0x7f3aa806a8d0 msgr2=0x7f3aa80a94e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:45.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:45.683+0000 7f3aacb87700 1 -- 172.21.15.72:0/2993055242 shutdown_connections 2023-07-25T14:37:45.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:45.683+0000 7f3aacb87700 1 -- 172.21.15.72:0/2993055242 wait complete. 2023-07-25T14:37:45.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:45.684+0000 7f3aacb87700 1 Processor -- start 2023-07-25T14:37:45.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:45.685+0000 7f3aacb87700 1 -- start start 2023-07-25T14:37:45.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:45.685+0000 7f3aacb87700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3aa80a9cc0 0x7f3aa80ac730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:45.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:45.685+0000 7f3aacb87700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3aa80bb0b0 0x7f3aa80c10f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:45.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:45.685+0000 7f3aacb87700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3aa814f810 0x7f3aa80bea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:45.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:45.685+0000 7f3aacb87700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3aa80abb40 con 0x7f3aa814f810 2023-07-25T14:37:45.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:45.685+0000 7f3aacb87700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3aa80ad460 con 0x7f3aa80a9cc0 2023-07-25T14:37:45.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:45.685+0000 7f3aacb87700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3aa80ab060 con 0x7f3aa80bb0b0 2023-07-25T14:37:45.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:45.685+0000 7f3aa6d9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3aa814f810 0x7f3aa80bea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:45.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:45.685+0000 7f3aa6d9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3aa814f810 0x7f3aa80bea60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43684/0 (socket says 172.21.15.72:43684) 2023-07-25T14:37:45.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:45.685+0000 7f3aa6d9d700 1 -- 172.21.15.72:0/3515038024 learned_addr learned my addr 172.21.15.72:0/3515038024 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:37:45.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:45.685+0000 7f3aa659c700 1 --2- 172.21.15.72:0/3515038024 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3aa80a9cc0 0x7f3aa80ac730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:45.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:45.685+0000 7f3aa5d9b700 1 --2- 172.21.15.72:0/3515038024 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3aa80bb0b0 0x7f3aa80c10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:45.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:45.686+0000 7f3aa6d9d700 1 -- 172.21.15.72:0/3515038024 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3aa80bb0b0 msgr2=0x7f3aa80c10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:45.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:45.686+0000 7f3aa6d9d700 1 --2- 172.21.15.72:0/3515038024 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3aa80bb0b0 0x7f3aa80c10f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:45.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:45.686+0000 7f3aa6d9d700 1 -- 172.21.15.72:0/3515038024 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3aa80a9cc0 msgr2=0x7f3aa80ac730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:45.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:45.686+0000 7f3aa6d9d700 1 --2- 172.21.15.72:0/3515038024 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3aa80a9cc0 0x7f3aa80ac730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:45.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:45.686+0000 7f3aa6d9d700 1 -- 172.21.15.72:0/3515038024 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a9c0094a0 con 0x7f3aa814f810 2023-07-25T14:37:45.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:45.686+0000 7f3aa6d9d700 1 --2- 172.21.15.72:0/3515038024 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3aa814f810 0x7f3aa80bea60 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f3aa000cc50 tx=0x7f3aa000cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:45.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:45.686+0000 7f3a96ffd700 1 -- 172.21.15.72:0/3515038024 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aa0003c50 con 0x7f3aa814f810 2023-07-25T14:37:45.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:45.686+0000 7f3a96ffd700 1 -- 172.21.15.72:0/3515038024 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3aa0003db0 con 0x7f3aa814f810 2023-07-25T14:37:45.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:45.686+0000 7f3aacb87700 1 -- 172.21.15.72:0/3515038024 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3aa80ab340 con 0x7f3aa814f810 2023-07-25T14:37:45.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:45.686+0000 7f3a96ffd700 1 -- 172.21.15.72:0/3515038024 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aa000aaf0 con 0x7f3aa814f810 2023-07-25T14:37:45.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:45.686+0000 7f3aacb87700 1 -- 172.21.15.72:0/3515038024 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3aa80acc70 con 0x7f3aa814f810 2023-07-25T14:37:45.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:45.687+0000 7f3aacb87700 1 -- 172.21.15.72:0/3515038024 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3aa80ad9a0 con 0x7f3aa814f810 2023-07-25T14:37:45.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:45.687+0000 7f3a96ffd700 1 -- 172.21.15.72:0/3515038024 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3aa000ac50 con 0x7f3aa814f810 2023-07-25T14:37:45.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:45.688+0000 7f3a96ffd700 1 --2- 172.21.15.72:0/3515038024 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f3a8806ace0 0x7f3a8806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:45.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:45.688+0000 7f3a96ffd700 1 -- 172.21.15.72:0/3515038024 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f3aa00895a0 con 0x7f3aa814f810 2023-07-25T14:37:45.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:45.688+0000 7f3aa659c700 1 --2- 172.21.15.72:0/3515038024 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f3a8806ace0 0x7f3a8806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:45.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:45.688+0000 7f3aa659c700 1 --2- 172.21.15.72:0/3515038024 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f3a8806ace0 0x7f3a8806d1a0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f3a9c0090b0 tx=0x7f3a9c01c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:45.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:45.692+0000 7f3a96ffd700 1 -- 172.21.15.72:0/3515038024 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f3aa00545a0 con 0x7f3aa814f810 2023-07-25T14:37:45.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:45.881+0000 7f3aacb87700 1 -- 172.21.15.72:0/3515038024 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3aa80ab860 con 0x7f3aa814f810 2023-07-25T14:37:45.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:45.882+0000 7f3a96ffd700 1 -- 172.21.15.72:0/3515038024 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v56) v1 ==== 74+0+18462 (secure 0 0 0) 0x7f3aa80ab860 con 0x7f3aa814f810 2023-07-25T14:37:45.894 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-25T14:37:45.894 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":56,"fsid":"9170db48-9170-43e8-8ccb-9813e6240906","created":"2023-07-25T14:35:21.733262+0000","modified":"2023-07-25T14:37:44.546542+0000","last_up_change":"2023-07-25T14:35:31.355010+0000","last_in_change":"2023-07-25T14:35:24.195785+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-25T14:35:32.983457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-25T14:35:33.326342+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-07-25T14:37:42.689589+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-07-25T14:37:43.512214+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d517fdad-0bfe-49f0-89f2-9421c3761839","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6801","nonce":2475407414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6803","nonce":2475407414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6807","nonce":2475407414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6805","nonce":2475407414}]},"public_addr":"172.21.15.72:6801/2475407414","cluster_addr":"172.21.15.72:6803/2475407414","heartbeat_back_addr":"172.21.15.72:6807/2475407414","heartbeat_front_addr":"172.21.15.72:6805/2475407414","state":["exists","up"]},{"osd":1,"uuid":"e1564be3-f209-47e5-a8d0-32fc618a474f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6822","nonce":870954016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6825","nonce":870954016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6831","nonce":870954016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6827","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6829","nonce":870954016}]},"public_addr":"172.21.15.72:6822/870954016","cluster_addr":"172.21.15.72:6825/870954016","heartbeat_back_addr":"172.21.15.72:6831/870954016","heartbeat_front_addr":"172.21.15.72:6829/870954016","state":["exists","up"]},{"osd":2,"uuid":"c4647d30-ffa6-417a-9026-ef530c75910e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6809","nonce":2143129442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6811","nonce":2143129442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6815","nonce":2143129442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6813","nonce":2143129442}]},"public_addr":"172.21.15.72:6809/2143129442","cluster_addr":"172.21.15.72:6811/2143129442","heartbeat_back_addr":"172.21.15.72:6815/2143129442","heartbeat_front_addr":"172.21.15.72:6813/2143129442","state":["exists","up"]},{"osd":3,"uuid":"76c9d9a7-c2e2-4612-a58b-d6882dd76b58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6817","nonce":3404066311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6819","nonce":3404066311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6828","nonce":3404066311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6821","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6823","nonce":3404066311}]},"public_addr":"172.21.15.72:6817/3404066311","cluster_addr":"172.21.15.72:6819/3404066311","heartbeat_back_addr":"172.21.15.72:6828/3404066311","heartbeat_front_addr":"172.21.15.72:6823/3404066311","state":["exists","up"]},{"osd":4,"uuid":"7f8920dc-0ad4-4a73-ab40-65408f83eadd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6817","nonce":2381008739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6819","nonce":2381008739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6825","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6827","nonce":2381008739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6822","nonce":2381008739}]},"public_addr":"172.21.15.92:6817/2381008739","cluster_addr":"172.21.15.92:6819/2381008739","heartbeat_back_addr":"172.21.15.92:6827/2381008739","heartbeat_front_addr":"172.21.15.92:6822/2381008739","state":["exists","up"]},{"osd":5,"uuid":"56257e7c-31eb-44c5-9ec7-1318a4e0bb35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6801","nonce":2161935604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6803","nonce":2161935604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6807","nonce":2161935604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6805","nonce":2161935604}]},"public_addr":"172.21.15.92:6801/2161935604","cluster_addr":"172.21.15.92:6803/2161935604","heartbeat_back_addr":"172.21.15.92:6807/2161935604","heartbeat_front_addr":"172.21.15.92:6805/2161935604","state":["exists","up"]},{"osd":6,"uuid":"a150d3d8-a0c9-4955-968a-8d98eff4ffb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6809","nonce":3770163493}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6811","nonce":3770163493}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6815","nonce":3770163493}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6813","nonce":3770163493}]},"public_addr":"172.21.15.92:6809/3770163493","cluster_addr":"172.21.15.92:6811/3770163493","heartbeat_back_addr":"172.21.15.92:6815/3770163493","heartbeat_front_addr":"172.21.15.92:6813/3770163493","state":["exists","up"]},{"osd":7,"uuid":"07799c27-54ee-4591-a42d-a978d6b32065","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6821","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6823","nonce":2135777609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6826","nonce":2135777609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6831","nonce":2135777609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6829","nonce":2135777609}]},"public_addr":"172.21.15.92:6823/2135777609","cluster_addr":"172.21.15.92:6826/2135777609","heartbeat_back_addr":"172.21.15.92:6831/2135777609","heartbeat_front_addr":"172.21.15.92:6829/2135777609","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.345365+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.378150+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.146566+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.372172+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:30.398421+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.385632+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.465611+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.443583+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-25T14:37:45.895 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:45.884+0000 7f3aacb87700 1 -- 172.21.15.72:0/3515038024 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f3a8806ace0 msgr2=0x7f3a8806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:45.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:45.884+0000 7f3aacb87700 1 --2- 172.21.15.72:0/3515038024 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f3a8806ace0 0x7f3a8806d1a0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f3a9c0090b0 tx=0x7f3a9c01c040 comp rx=0 tx=0).stop 2023-07-25T14:37:45.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:45.884+0000 7f3aacb87700 1 -- 172.21.15.72:0/3515038024 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3aa814f810 msgr2=0x7f3aa80bea60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:45.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:45.884+0000 7f3aacb87700 1 --2- 172.21.15.72:0/3515038024 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3aa814f810 0x7f3aa80bea60 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f3aa000cc50 tx=0x7f3aa000cf60 comp rx=0 tx=0).stop 2023-07-25T14:37:45.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:45.885+0000 7f3aacb87700 1 -- 172.21.15.72:0/3515038024 shutdown_connections 2023-07-25T14:37:45.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:45.885+0000 7f3aacb87700 1 --2- 172.21.15.72:0/3515038024 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f3a8806ace0 0x7f3a8806d1a0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:45.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:45.885+0000 7f3aacb87700 1 --2- 172.21.15.72:0/3515038024 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3aa814f810 0x7f3aa80bea60 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:45.896 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:45.885+0000 7f3aacb87700 1 --2- 172.21.15.72:0/3515038024 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3aa80a9cc0 0x7f3aa80ac730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:45.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:45.885+0000 7f3aacb87700 1 --2- 172.21.15.72:0/3515038024 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3aa80bb0b0 0x7f3aa80c10f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:45.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:45.885+0000 7f3aacb87700 1 -- 172.21.15.72:0/3515038024 >> 172.21.15.72:0/3515038024 conn(0x7f3aa806a8d0 msgr2=0x7f3aa806ee10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:45.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:45.885+0000 7f3aacb87700 1 -- 172.21.15.72:0/3515038024 shutdown_connections 2023-07-25T14:37:45.897 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:45.885+0000 7f3aacb87700 1 -- 172.21.15.72:0/3515038024 wait complete. 2023-07-25T14:37:45.908 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-07-25T14:37:45.959 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T14:37:45.961 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T14:37:46.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:46.025+0000 7f6cc4587700 1 Processor -- start 2023-07-25T14:37:46.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:46.025+0000 7f6cc4587700 1 -- start start 2023-07-25T14:37:46.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:46.026+0000 7f6cc4587700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f6cbc0ba0e0 0x7f6cbc0c5e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:46.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:46.026+0000 7f6cc4587700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6cbc0c4930 con 0x7f6cbc14faf0 2023-07-25T14:37:46.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:46.026+0000 7f6cc4587700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6cbc0c5670 con 0x7f6cbc0c3f10 2023-07-25T14:37:46.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:46.026+0000 7f6cc4587700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cbc0726e0 con 0x7f6cbc0ba0e0 2023-07-25T14:37:46.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:46.026+0000 7f6cc1b22700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f6cbc0ba0e0 0x7f6cbc0c5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:46.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:46.026+0000 7f6cc2323700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f6cbc14faf0 0x7f6cbc1558a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:34424/0 (socket says 172.21.15.72:34424) 2023-07-25T14:37:46.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:46.026+0000 7f6cc1b22700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f6cbc0ba0e0 0x7f6cbc0c5e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43690/0 (socket says 172.21.15.72:43690) 2023-07-25T14:37:46.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:46.026+0000 7f6cc2323700 1 -- 172.21.15.72:0/4034697328 learned_addr learned my addr 172.21.15.72:0/4034697328 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:37:46.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:46.026+0000 7f6cc1b22700 1 -- 172.21.15.72:0/4034697328 >> v1:172.21.15.92:6789/0 conn(0x7f6cbc0c3f10 legacy=0x7f6cbc071960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:46.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:46.026+0000 7f6cc1b22700 1 -- 172.21.15.72:0/4034697328 >> v1:172.21.15.72:6789/0 conn(0x7f6cbc14faf0 legacy=0x7f6cbc1558a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:46.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:46.026+0000 7f6cc1b22700 1 -- 172.21.15.72:0/4034697328 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cbc0c4b80 con 0x7f6cbc0ba0e0 2023-07-25T14:37:46.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:46.026+0000 7f6cc1321700 1 -- 172.21.15.72:0/4034697328 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2028488619 0 0) 0x7f6cbc0c4930 con 0x7f6cbc14faf0 2023-07-25T14:37:46.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:46.026+0000 7f6cc1b22700 1 --2- 172.21.15.72:0/4034697328 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6cbc0ba0e0 0x7f6cbc0c5e30 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f6cb8009840 tx=0x7f6cb8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=445dff59dcd7e918 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:46.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:46.027+0000 7f6cc1321700 1 -- 172.21.15.72:0/4034697328 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cb8004230 con 0x7f6cbc0ba0e0 2023-07-25T14:37:46.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:46.027+0000 7f6cc1321700 1 -- 172.21.15.72:0/4034697328 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cb8004390 con 0x7f6cbc0ba0e0 2023-07-25T14:37:46.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:46.027+0000 7f6cc1321700 1 -- 172.21.15.72:0/4034697328 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cb80036a0 con 0x7f6cbc0ba0e0 2023-07-25T14:37:46.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:46.027+0000 7f6cc4587700 1 -- 172.21.15.72:0/4034697328 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6cbc0ba0e0 msgr2=0x7f6cbc0c5e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:46.042 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:46.027+0000 7f6cc4587700 1 --2- 172.21.15.72:0/4034697328 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6cbc0ba0e0 0x7f6cbc0c5e30 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f6cb8009840 tx=0x7f6cb8009b50 comp rx=0 tx=0).stop 2023-07-25T14:37:46.042 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:46.027+0000 7f6cc4587700 1 -- 172.21.15.72:0/4034697328 shutdown_connections 2023-07-25T14:37:46.042 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:46.027+0000 7f6cc4587700 1 --2- 172.21.15.72:0/4034697328 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6cbc0ba0e0 0x7f6cbc0c5e30 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:46.042 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:46.027+0000 7f6cc4587700 1 -- 172.21.15.72:0/4034697328 >> 172.21.15.72:0/4034697328 conn(0x7f6cbc0a87e0 msgr2=0x7f6cbc0a8bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:46.042 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:46.027+0000 7f6cc4587700 1 -- 172.21.15.72:0/4034697328 shutdown_connections 2023-07-25T14:37:46.042 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:46.027+0000 7f6cc4587700 1 -- 172.21.15.72:0/4034697328 wait complete. 2023-07-25T14:37:46.042 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:46.028+0000 7f6cc4587700 1 Processor -- start 2023-07-25T14:37:46.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:46.028+0000 7f6cc4587700 1 -- start start 2023-07-25T14:37:46.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:46.029+0000 7f6cc4587700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6cbc0ba0e0 0x7f6cbc14b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:46.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:46.029+0000 7f6cc4587700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6cbc0c3f10 0x7f6cbc0a7b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:46.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:46.029+0000 7f6cc4587700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6cbc14faf0 0x7f6cbc0bb5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:46.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:46.029+0000 7f6cc4587700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cbc0bf6b0 con 0x7f6cbc14faf0 2023-07-25T14:37:46.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:46.029+0000 7f6cc4587700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cbc1e7cd0 con 0x7f6cbc0c3f10 2023-07-25T14:37:46.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:46.029+0000 7f6cc4587700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cbc1e8200 con 0x7f6cbc0ba0e0 2023-07-25T14:37:46.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:46.029+0000 7f6cc2b24700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6cbc14faf0 0x7f6cbc0bb5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:46.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:46.029+0000 7f6cc2b24700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6cbc14faf0 0x7f6cbc0bb5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43698/0 (socket says 172.21.15.72:43698) 2023-07-25T14:37:46.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:46.029+0000 7f6cc2b24700 1 -- 172.21.15.72:0/2563327548 learned_addr learned my addr 172.21.15.72:0/2563327548 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:37:46.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:46.029+0000 7f6cc1b22700 1 --2- 172.21.15.72:0/2563327548 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6cbc0c3f10 0x7f6cbc0a7b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:46.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:46.029+0000 7f6cc2323700 1 --2- 172.21.15.72:0/2563327548 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6cbc0ba0e0 0x7f6cbc14b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:46.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:46.029+0000 7f6cc2b24700 1 -- 172.21.15.72:0/2563327548 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6cbc0ba0e0 msgr2=0x7f6cbc14b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:46.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:46.029+0000 7f6cc2b24700 1 --2- 172.21.15.72:0/2563327548 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6cbc0ba0e0 0x7f6cbc14b1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:46.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:46.029+0000 7f6cc2b24700 1 -- 172.21.15.72:0/2563327548 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6cbc0c3f10 msgr2=0x7f6cbc0a7b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:46.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:46.029+0000 7f6cc2b24700 1 --2- 172.21.15.72:0/2563327548 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6cbc0c3f10 0x7f6cbc0a7b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:46.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:46.029+0000 7f6cc2b24700 1 -- 172.21.15.72:0/2563327548 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cb80094a0 con 0x7f6cbc14faf0 2023-07-25T14:37:46.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:46.029+0000 7f6cc2323700 1 --2- 172.21.15.72:0/2563327548 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6cbc0ba0e0 0x7f6cbc14b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-25T14:37:46.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:46.030+0000 7f6cc2b24700 1 --2- 172.21.15.72:0/2563327548 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6cbc14faf0 0x7f6cbc0bb5b0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f6cb400b9a0 tx=0x7f6cb400bcb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:46.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:46.030+0000 7f6cb2ffd700 1 -- 172.21.15.72:0/2563327548 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cb400c930 con 0x7f6cbc14faf0 2023-07-25T14:37:46.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:46.030+0000 7f6cb2ffd700 1 -- 172.21.15.72:0/2563327548 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cb400ca90 con 0x7f6cbc14faf0 2023-07-25T14:37:46.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:46.030+0000 7f6cb2ffd700 1 -- 172.21.15.72:0/2563327548 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cb400ce40 con 0x7f6cbc14faf0 2023-07-25T14:37:46.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:46.030+0000 7f6cc4587700 1 -- 172.21.15.72:0/2563327548 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cbc14f2d0 con 0x7f6cbc14faf0 2023-07-25T14:37:46.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:46.030+0000 7f6cc4587700 1 -- 172.21.15.72:0/2563327548 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cbc0bcb30 con 0x7f6cbc14faf0 2023-07-25T14:37:46.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:46.031+0000 7f6cc4587700 1 -- 172.21.15.72:0/2563327548 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6cbc04e470 con 0x7f6cbc14faf0 2023-07-25T14:37:46.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:46.031+0000 7f6cb2ffd700 1 -- 172.21.15.72:0/2563327548 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6cb401d3b0 con 0x7f6cbc14faf0 2023-07-25T14:37:46.047 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:46.032+0000 7f6cb2ffd700 1 --2- 172.21.15.72:0/2563327548 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f6ca006ace0 0x7f6ca006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:46.047 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:46.032+0000 7f6cc2323700 1 --2- 172.21.15.72:0/2563327548 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f6ca006ace0 0x7f6ca006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:46.047 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:46.032+0000 7f6cb2ffd700 1 -- 172.21.15.72:0/2563327548 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f6cb4089190 con 0x7f6cbc14faf0 2023-07-25T14:37:46.047 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:46.032+0000 7f6cc2323700 1 --2- 172.21.15.72:0/2563327548 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f6ca006ace0 0x7f6ca006d1a0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f6cac000f60 tx=0x7f6cac007d50 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:46.047 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:46.036+0000 7f6cb2ffd700 1 -- 172.21.15.72:0/2563327548 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f6cb4054100 con 0x7f6cbc14faf0 2023-07-25T14:37:46.280 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:46.269+0000 7f6cc4587700 1 -- 172.21.15.72:0/2563327548 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f6cbc071740 con 0x7f6cbc14faf0 2023-07-25T14:37:47.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:47.197+0000 7f6cb2ffd700 1 -- 172.21.15.72:0/2563327548 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v32) v1 ==== 118+0+0 (secure 0 0 0) 0x7f6cb4057720 con 0x7f6cbc14faf0 2023-07-25T14:37:47.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:47.200+0000 7f6cc4587700 1 -- 172.21.15.72:0/2563327548 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f6ca006ace0 msgr2=0x7f6ca006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:47.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:47.200+0000 7f6cc4587700 1 --2- 172.21.15.72:0/2563327548 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f6ca006ace0 0x7f6ca006d1a0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f6cac000f60 tx=0x7f6cac007d50 comp rx=0 tx=0).stop 2023-07-25T14:37:47.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:47.200+0000 7f6cc4587700 1 -- 172.21.15.72:0/2563327548 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6cbc14faf0 msgr2=0x7f6cbc0bb5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:47.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:47.200+0000 7f6cc4587700 1 --2- 172.21.15.72:0/2563327548 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6cbc14faf0 0x7f6cbc0bb5b0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f6cb400b9a0 tx=0x7f6cb400bcb0 comp rx=0 tx=0).stop 2023-07-25T14:37:47.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:47.200+0000 7f6cc4587700 1 -- 172.21.15.72:0/2563327548 shutdown_connections 2023-07-25T14:37:47.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:47.200+0000 7f6cc4587700 1 --2- 172.21.15.72:0/2563327548 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f6ca006ace0 0x7f6ca006d1a0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:47.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:47.200+0000 7f6cc4587700 1 --2- 172.21.15.72:0/2563327548 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6cbc0ba0e0 0x7f6cbc14b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:47.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:47.200+0000 7f6cc4587700 1 --2- 172.21.15.72:0/2563327548 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6cbc14faf0 0x7f6cbc0bb5b0 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:47.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:47.200+0000 7f6cc4587700 1 --2- 172.21.15.72:0/2563327548 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6cbc0c3f10 0x7f6cbc0a7b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:47.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:47.200+0000 7f6cc4587700 1 -- 172.21.15.72:0/2563327548 >> 172.21.15.72:0/2563327548 conn(0x7f6cbc0a87e0 msgr2=0x7f6cbc14ddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:47.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:47.200+0000 7f6cc4587700 1 -- 172.21.15.72:0/2563327548 shutdown_connections 2023-07-25T14:37:47.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:47.200+0000 7f6cc4587700 1 -- 172.21.15.72:0/2563327548 wait complete. 2023-07-25T14:37:47.225 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-07-25T14:37:47.226 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-07-25T14:37:47.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:47.385+0000 7f9f99230700 1 Processor -- start 2023-07-25T14:37:47.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:47.385+0000 7f9f99230700 1 -- start start 2023-07-25T14:37:47.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:47.386+0000 7f9f99230700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9f9406a190 0x7f9f9415fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:47.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:47.386+0000 7f9f99230700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f94066050 con 0x7f9f940bf5d0 2023-07-25T14:37:47.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:47.386+0000 7f9f99230700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f9406b560 con 0x7f9f9406ed70 2023-07-25T14:37:47.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:47.386+0000 7f9f99230700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f94151be0 con 0x7f9f9406a190 2023-07-25T14:37:47.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:47.386+0000 7f9f92d9d700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f9f940bf5d0 0x7f9f940a7490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:34438/0 (socket says 172.21.15.72:34438) 2023-07-25T14:37:47.399 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:47.386+0000 7f9f92d9d700 1 -- 172.21.15.72:0/4102596599 learned_addr learned my addr 172.21.15.72:0/4102596599 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:37:47.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:47.386+0000 7f9f9359e700 1 --2- 172.21.15.72:0/4102596599 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9f9406a190 0x7f9f9415fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:47.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:47.386+0000 7f9f91d9b700 1 -- 172.21.15.72:0/4102596599 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4085399208 0 0) 0x7f9f94066050 con 0x7f9f940bf5d0 2023-07-25T14:37:47.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:47.386+0000 7f9f91d9b700 1 -- 172.21.15.72:0/4102596599 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9f7c0035b0 con 0x7f9f940bf5d0 2023-07-25T14:37:47.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:47.386+0000 7f9f91d9b700 1 -- 172.21.15.72:0/4102596599 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3503426379 0 0) 0x7f9f7c0035b0 con 0x7f9f940bf5d0 2023-07-25T14:37:47.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:47.386+0000 7f9f91d9b700 1 -- 172.21.15.72:0/4102596599 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9f9406a190 msgr2=0x7f9f9415fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:47.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:47.386+0000 7f9f91d9b700 1 --2- 172.21.15.72:0/4102596599 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9f9406a190 0x7f9f9415fbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:47.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:47.386+0000 7f9f91d9b700 1 -- 172.21.15.72:0/4102596599 >> v1:172.21.15.92:6789/0 conn(0x7f9f9406ed70 legacy=0x7f9f940bf9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:47.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:47.386+0000 7f9f91d9b700 1 -- 172.21.15.72:0/4102596599 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f94154d60 con 0x7f9f940bf5d0 2023-07-25T14:37:47.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:47.386+0000 7f9f91d9b700 1 -- 172.21.15.72:0/4102596599 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2559588315 0 0) 0x7f9f88001670 con 0x7f9f940bf5d0 2023-07-25T14:37:47.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:47.386+0000 7f9f91d9b700 1 -- 172.21.15.72:0/4102596599 >> v1:172.21.15.72:6789/0 conn(0x7f9f940bf5d0 legacy=0x7f9f940a7490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:47.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:47.386+0000 7f9f91d9b700 1 --2- 172.21.15.72:0/4102596599 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9f7c003a30 0x7f9f7c003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:47.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:47.387+0000 7f9f91d9b700 1 --2- 172.21.15.72:0/4102596599 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9f9406a190 0x7f9f7c004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:47.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:47.387+0000 7f9f91d9b700 1 --2- 172.21.15.72:0/4102596599 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9f7c004d90 0x7f9f7c005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:47.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:47.387+0000 7f9f91d9b700 1 -- 172.21.15.72:0/4102596599 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f94151be0 con 0x7f9f7c003a30 2023-07-25T14:37:47.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:47.387+0000 7f9f91d9b700 1 -- 172.21.15.72:0/4102596599 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f7c00ba10 con 0x7f9f7c004d90 2023-07-25T14:37:47.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:47.387+0000 7f9f91d9b700 1 -- 172.21.15.72:0/4102596599 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f7c00bbd0 con 0x7f9f9406a190 2023-07-25T14:37:47.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:47.387+0000 7f9f92d9d700 1 --2- 172.21.15.72:0/4102596599 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9f7c003a30 0x7f9f7c003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:47.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:47.387+0000 7f9f9259c700 1 --2- 172.21.15.72:0/4102596599 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9f9406a190 0x7f9f7c004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:47.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:47.387+0000 7f9f9359e700 1 --2- 172.21.15.72:0/4102596599 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9f7c004d90 0x7f9f7c005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:47.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:47.387+0000 7f9f92d9d700 1 -- 172.21.15.72:0/4102596599 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9f9406a190 msgr2=0x7f9f7c004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:47.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:47.387+0000 7f9f92d9d700 1 --2- 172.21.15.72:0/4102596599 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9f9406a190 0x7f9f7c004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:47.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:47.387+0000 7f9f92d9d700 1 -- 172.21.15.72:0/4102596599 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9f7c004d90 msgr2=0x7f9f7c005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:47.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:47.387+0000 7f9f92d9d700 1 --2- 172.21.15.72:0/4102596599 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9f7c004d90 0x7f9f7c005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:47.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:47.387+0000 7f9f92d9d700 1 -- 172.21.15.72:0/4102596599 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f7c0035b0 con 0x7f9f7c003a30 2023-07-25T14:37:47.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:47.387+0000 7f9f9359e700 1 --2- 172.21.15.72:0/4102596599 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9f7c004d90 0x7f9f7c005210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-25T14:37:47.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:47.387+0000 7f9f92d9d700 1 --2- 172.21.15.72:0/4102596599 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9f7c003a30 0x7f9f7c003e10 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f9f8800c240 tx=0x7f9f7c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e056e381cf8cc02f server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:47.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:47.387+0000 7f9f91d9b700 1 -- 172.21.15.72:0/4102596599 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f8800ccc0 con 0x7f9f7c003a30 2023-07-25T14:37:47.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:47.387+0000 7f9f91d9b700 1 -- 172.21.15.72:0/4102596599 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f8800ce20 con 0x7f9f7c003a30 2023-07-25T14:37:47.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:47.387+0000 7f9f91d9b700 1 -- 172.21.15.72:0/4102596599 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f88005ba0 con 0x7f9f7c003a30 2023-07-25T14:37:47.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:47.388+0000 7f9f99230700 1 -- 172.21.15.72:0/4102596599 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9f7c003a30 msgr2=0x7f9f7c003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:47.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:47.388+0000 7f9f99230700 1 --2- 172.21.15.72:0/4102596599 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9f7c003a30 0x7f9f7c003e10 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f9f8800c240 tx=0x7f9f7c005880 comp rx=0 tx=0).stop 2023-07-25T14:37:47.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:47.388+0000 7f9f9359e700 1 -- 172.21.15.72:0/4102596599 reap_dead start 2023-07-25T14:37:47.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:47.388+0000 7f9f99230700 1 -- 172.21.15.72:0/4102596599 shutdown_connections 2023-07-25T14:37:47.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:47.388+0000 7f9f99230700 1 -- 172.21.15.72:0/4102596599 >> 172.21.15.72:0/4102596599 conn(0x7f9f9406def0 msgr2=0x7f9f9406e300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:47.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:47.388+0000 7f9f99230700 1 -- 172.21.15.72:0/4102596599 shutdown_connections 2023-07-25T14:37:47.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:47.388+0000 7f9f99230700 1 -- 172.21.15.72:0/4102596599 wait complete. 2023-07-25T14:37:47.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:47.389+0000 7f9f99230700 1 Processor -- start 2023-07-25T14:37:47.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:47.389+0000 7f9f99230700 1 -- start start 2023-07-25T14:37:47.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:47.390+0000 7f9f99230700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9f7c003a30 0x7f9f941570d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:47.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:47.390+0000 7f9f99230700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9f940a91b0 0x7f9f941eb230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:47.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:47.390+0000 7f9f99230700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9f941581d0 0x7f9f940c16d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:47.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:47.390+0000 7f9f99230700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f94156680 con 0x7f9f940a91b0 2023-07-25T14:37:47.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:47.390+0000 7f9f99230700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f94157610 con 0x7f9f7c003a30 2023-07-25T14:37:47.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:47.390+0000 7f9f99230700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f941ea8e0 con 0x7f9f941581d0 2023-07-25T14:37:47.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:47.390+0000 7f9f9259c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9f940a91b0 0x7f9f941eb230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:47.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:47.390+0000 7f9f9259c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9f940a91b0 0x7f9f941eb230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43716/0 (socket says 172.21.15.72:43716) 2023-07-25T14:37:47.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:47.390+0000 7f9f9259c700 1 -- 172.21.15.72:0/3628308276 learned_addr learned my addr 172.21.15.72:0/3628308276 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:37:47.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:47.390+0000 7f9f9259c700 1 -- 172.21.15.72:0/3628308276 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9f941581d0 msgr2=0x7f9f940c16d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:47.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:47.390+0000 7f9f9259c700 1 --2- 172.21.15.72:0/3628308276 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9f941581d0 0x7f9f940c16d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:47.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:47.390+0000 7f9f9259c700 1 -- 172.21.15.72:0/3628308276 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9f7c003a30 msgr2=0x7f9f941570d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:47.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:47.390+0000 7f9f9259c700 1 --2- 172.21.15.72:0/3628308276 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9f7c003a30 0x7f9f941570d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:47.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:47.390+0000 7f9f9259c700 1 -- 172.21.15.72:0/3628308276 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f941eabc0 con 0x7f9f940a91b0 2023-07-25T14:37:47.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:47.390+0000 7f9f9259c700 1 --2- 172.21.15.72:0/3628308276 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9f940a91b0 0x7f9f941eb230 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f9f8400f7a0 tx=0x7f9f8400fb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:47.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:47.391+0000 7f9f7b7fe700 1 -- 172.21.15.72:0/3628308276 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f840052e0 con 0x7f9f940a91b0 2023-07-25T14:37:47.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:47.391+0000 7f9f7b7fe700 1 -- 172.21.15.72:0/3628308276 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f84005460 con 0x7f9f940a91b0 2023-07-25T14:37:47.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:47.391+0000 7f9f7b7fe700 1 -- 172.21.15.72:0/3628308276 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f840038c0 con 0x7f9f940a91b0 2023-07-25T14:37:47.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:47.391+0000 7f9f99230700 1 -- 172.21.15.72:0/3628308276 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f941568d0 con 0x7f9f940a91b0 2023-07-25T14:37:47.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:47.391+0000 7f9f99230700 1 -- 172.21.15.72:0/3628308276 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f941eb770 con 0x7f9f940a91b0 2023-07-25T14:37:47.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:47.392+0000 7f9f99230700 1 -- 172.21.15.72:0/3628308276 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f941ead50 con 0x7f9f940a91b0 2023-07-25T14:37:47.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:47.392+0000 7f9f7b7fe700 1 -- 172.21.15.72:0/3628308276 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9f84003a20 con 0x7f9f940a91b0 2023-07-25T14:37:47.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:47.392+0000 7f9f7b7fe700 1 --2- 172.21.15.72:0/3628308276 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f9f8006ace0 0x7f9f8006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:47.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:47.392+0000 7f9f7b7fe700 1 -- 172.21.15.72:0/3628308276 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f9f840893d0 con 0x7f9f940a91b0 2023-07-25T14:37:47.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:47.392+0000 7f9f92d9d700 1 --2- 172.21.15.72:0/3628308276 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f9f8006ace0 0x7f9f8006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:47.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:47.393+0000 7f9f92d9d700 1 --2- 172.21.15.72:0/3628308276 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f9f8006ace0 0x7f9f8006d1a0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f9f880018b0 tx=0x7f9f88007f90 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:47.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:47.397+0000 7f9f7b7fe700 1 -- 172.21.15.72:0/3628308276 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f9f84054350 con 0x7f9f940a91b0 2023-07-25T14:37:47.636 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:47.626+0000 7f9f99230700 1 -- 172.21.15.72:0/3628308276 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f9f9404e470 con 0x7f9f940a91b0 2023-07-25T14:37:48.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.202+0000 7f9f7b7fe700 1 -- 172.21.15.72:0/3628308276 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v33) v1 ==== 122+0+0 (secure 0 0 0) 0x7f9f84057970 con 0x7f9f940a91b0 2023-07-25T14:37:48.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.205+0000 7f9f99230700 1 -- 172.21.15.72:0/3628308276 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f9f8006ace0 msgr2=0x7f9f8006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:48.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.205+0000 7f9f99230700 1 --2- 172.21.15.72:0/3628308276 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f9f8006ace0 0x7f9f8006d1a0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f9f880018b0 tx=0x7f9f88007f90 comp rx=0 tx=0).stop 2023-07-25T14:37:48.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.205+0000 7f9f99230700 1 -- 172.21.15.72:0/3628308276 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9f940a91b0 msgr2=0x7f9f941eb230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:48.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.205+0000 7f9f99230700 1 --2- 172.21.15.72:0/3628308276 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9f940a91b0 0x7f9f941eb230 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f9f8400f7a0 tx=0x7f9f8400fb60 comp rx=0 tx=0).stop 2023-07-25T14:37:48.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.205+0000 7f9f99230700 1 -- 172.21.15.72:0/3628308276 shutdown_connections 2023-07-25T14:37:48.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.205+0000 7f9f99230700 1 --2- 172.21.15.72:0/3628308276 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f9f8006ace0 0x7f9f8006d1a0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:48.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.205+0000 7f9f99230700 1 --2- 172.21.15.72:0/3628308276 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9f941581d0 0x7f9f940c16d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:48.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.205+0000 7f9f99230700 1 --2- 172.21.15.72:0/3628308276 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9f7c003a30 0x7f9f941570d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:48.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.205+0000 7f9f99230700 1 --2- 172.21.15.72:0/3628308276 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9f940a91b0 0x7f9f941eb230 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:48.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.205+0000 7f9f99230700 1 -- 172.21.15.72:0/3628308276 >> 172.21.15.72:0/3628308276 conn(0x7f9f9406def0 msgr2=0x7f9f94154300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:48.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.205+0000 7f9f99230700 1 -- 172.21.15.72:0/3628308276 shutdown_connections 2023-07-25T14:37:48.217 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.205+0000 7f9f99230700 1 -- 172.21.15.72:0/3628308276 wait complete. 2023-07-25T14:37:48.229 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-07-25T14:37:48.229 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-25T14:37:48.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.339+0000 7fe75739b700 1 Processor -- start 2023-07-25T14:37:48.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.339+0000 7fe75739b700 1 -- start start 2023-07-25T14:37:48.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.340+0000 7fe75739b700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe7500724c0 0x7fe7500c34c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:48.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.340+0000 7fe75739b700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7500c2fe0 con 0x7fe750151950 2023-07-25T14:37:48.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.340+0000 7fe75739b700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe750155070 con 0x7fe7500c4930 2023-07-25T14:37:48.354 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.340+0000 7fe75739b700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe750071a60 con 0x7fe7500724c0 2023-07-25T14:37:48.354 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.340+0000 7fe755137700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fe750151950 0x7fe75006a190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:34458/0 (socket says 172.21.15.72:34458) 2023-07-25T14:37:48.354 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.340+0000 7fe755137700 1 -- 172.21.15.72:0/4147670023 learned_addr learned my addr 172.21.15.72:0/4147670023 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:37:48.354 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.340+0000 7fe754936700 1 --2- 172.21.15.72:0/4147670023 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe7500724c0 0x7fe7500c34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:48.354 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.340+0000 7fe747fff700 1 -- 172.21.15.72:0/4147670023 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2702421959 0 0) 0x7fe7500c2fe0 con 0x7fe750151950 2023-07-25T14:37:48.354 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.340+0000 7fe747fff700 1 -- 172.21.15.72:0/4147670023 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe73c0035b0 con 0x7fe750151950 2023-07-25T14:37:48.354 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.340+0000 7fe747fff700 1 -- 172.21.15.72:0/4147670023 <== mon.1 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3381072467 0 0) 0x7fe750155070 con 0x7fe7500c4930 2023-07-25T14:37:48.355 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.340+0000 7fe747fff700 1 -- 172.21.15.72:0/4147670023 --> v1:172.21.15.92:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe7500c2fe0 con 0x7fe7500c4930 2023-07-25T14:37:48.355 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.340+0000 7fe747fff700 1 -- 172.21.15.72:0/4147670023 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4256677474 0 0) 0x7fe73c0035b0 con 0x7fe750151950 2023-07-25T14:37:48.355 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.340+0000 7fe747fff700 1 -- 172.21.15.72:0/4147670023 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe7500724c0 msgr2=0x7fe7500c34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:48.355 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.340+0000 7fe747fff700 1 --2- 172.21.15.72:0/4147670023 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe7500724c0 0x7fe7500c34c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:48.355 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.340+0000 7fe747fff700 1 -- 172.21.15.72:0/4147670023 >> v1:172.21.15.92:6789/0 conn(0x7fe7500c4930 legacy=0x7fe7500c3a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:48.355 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.340+0000 7fe747fff700 1 -- 172.21.15.72:0/4147670023 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7500c15c0 con 0x7fe750151950 2023-07-25T14:37:48.355 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.340+0000 7fe747fff700 1 -- 172.21.15.72:0/4147670023 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2559588315 0 0) 0x7fe74c001670 con 0x7fe750151950 2023-07-25T14:37:48.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.340+0000 7fe747fff700 1 -- 172.21.15.72:0/4147670023 >> v1:172.21.15.72:6789/0 conn(0x7fe750151950 legacy=0x7fe75006a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:48.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.340+0000 7fe747fff700 1 --2- 172.21.15.72:0/4147670023 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe73c003bc0 0x7fe73c003fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:48.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.340+0000 7fe747fff700 1 --2- 172.21.15.72:0/4147670023 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe7500724c0 0x7fe73c004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:48.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.340+0000 7fe747fff700 1 --2- 172.21.15.72:0/4147670023 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe73c004d90 0x7fe73c005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:48.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.340+0000 7fe747fff700 1 -- 172.21.15.72:0/4147670023 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe750071a60 con 0x7fe73c003bc0 2023-07-25T14:37:48.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.340+0000 7fe747fff700 1 -- 172.21.15.72:0/4147670023 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe73c00bb10 con 0x7fe73c004d90 2023-07-25T14:37:48.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.340+0000 7fe747fff700 1 -- 172.21.15.72:0/4147670023 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe73c00bcd0 con 0x7fe7500724c0 2023-07-25T14:37:48.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.341+0000 7fe755137700 1 --2- 172.21.15.72:0/4147670023 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe73c003bc0 0x7fe73c003fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:48.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.341+0000 7fe755938700 1 --2- 172.21.15.72:0/4147670023 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe73c004d90 0x7fe73c005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:48.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.341+0000 7fe754936700 1 --2- 172.21.15.72:0/4147670023 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe7500724c0 0x7fe73c004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:48.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.341+0000 7fe755137700 1 -- 172.21.15.72:0/4147670023 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe7500724c0 msgr2=0x7fe73c004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:48.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.341+0000 7fe755137700 1 --2- 172.21.15.72:0/4147670023 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe7500724c0 0x7fe73c004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:48.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.341+0000 7fe755137700 1 -- 172.21.15.72:0/4147670023 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe73c004d90 msgr2=0x7fe73c005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:48.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.341+0000 7fe755137700 1 --2- 172.21.15.72:0/4147670023 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe73c004d90 0x7fe73c005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:48.358 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.341+0000 7fe755137700 1 -- 172.21.15.72:0/4147670023 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe73c0035b0 con 0x7fe73c003bc0 2023-07-25T14:37:48.358 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.341+0000 7fe754936700 1 --2- 172.21.15.72:0/4147670023 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe7500724c0 0x7fe73c004850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-25T14:37:48.358 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.341+0000 7fe755938700 1 --2- 172.21.15.72:0/4147670023 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe73c004d90 0x7fe73c005210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-25T14:37:48.358 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.341+0000 7fe755137700 1 --2- 172.21.15.72:0/4147670023 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe73c003bc0 0x7fe73c003fc0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7fe74c00c210 tx=0x7fe73c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba99c2e31f2f8cdc server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:48.358 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.341+0000 7fe747fff700 1 -- 172.21.15.72:0/4147670023 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe74c00cdb0 con 0x7fe73c003bc0 2023-07-25T14:37:48.358 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.341+0000 7fe747fff700 1 -- 172.21.15.72:0/4147670023 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe74c001af0 con 0x7fe73c003bc0 2023-07-25T14:37:48.358 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.341+0000 7fe747fff700 1 -- 172.21.15.72:0/4147670023 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe74c005ba0 con 0x7fe73c003bc0 2023-07-25T14:37:48.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.341+0000 7fe75739b700 1 -- 172.21.15.72:0/4147670023 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe73c003bc0 msgr2=0x7fe73c003fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:48.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.341+0000 7fe75739b700 1 --2- 172.21.15.72:0/4147670023 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe73c003bc0 0x7fe73c003fc0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7fe74c00c210 tx=0x7fe73c005880 comp rx=0 tx=0).stop 2023-07-25T14:37:48.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.342+0000 7fe755938700 1 -- 172.21.15.72:0/4147670023 reap_dead start 2023-07-25T14:37:48.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.342+0000 7fe75739b700 1 -- 172.21.15.72:0/4147670023 shutdown_connections 2023-07-25T14:37:48.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.342+0000 7fe75739b700 1 -- 172.21.15.72:0/4147670023 >> 172.21.15.72:0/4147670023 conn(0x7fe7500a87e0 msgr2=0x7fe7500a8bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:48.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.342+0000 7fe75739b700 1 -- 172.21.15.72:0/4147670023 shutdown_connections 2023-07-25T14:37:48.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.342+0000 7fe75739b700 1 -- 172.21.15.72:0/4147670023 wait complete. 2023-07-25T14:37:48.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.343+0000 7fe75739b700 1 Processor -- start 2023-07-25T14:37:48.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.343+0000 7fe75739b700 1 -- start start 2023-07-25T14:37:48.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.343+0000 7fe75739b700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe73c003bc0 0x7fe75014d830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:48.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.343+0000 7fe75739b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe750157d10 0x7fe75014cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:48.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.344+0000 7fe75739b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe75014d120 0x7fe7500be260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:48.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.344+0000 7fe75739b700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe750156030 con 0x7fe75014d120 2023-07-25T14:37:48.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.344+0000 7fe75739b700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7501547a0 con 0x7fe750157d10 2023-07-25T14:37:48.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.344+0000 7fe75739b700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe750156280 con 0x7fe73c003bc0 2023-07-25T14:37:48.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.344+0000 7fe755938700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe75014d120 0x7fe7500be260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:48.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.344+0000 7fe755938700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe75014d120 0x7fe7500be260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43738/0 (socket says 172.21.15.72:43738) 2023-07-25T14:37:48.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.344+0000 7fe755938700 1 -- 172.21.15.72:0/4290480613 learned_addr learned my addr 172.21.15.72:0/4290480613 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:37:48.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.344+0000 7fe755137700 1 --2- 172.21.15.72:0/4290480613 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe73c003bc0 0x7fe75014d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:48.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.344+0000 7fe754936700 1 --2- 172.21.15.72:0/4290480613 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe750157d10 0x7fe75014cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:48.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.344+0000 7fe755938700 1 -- 172.21.15.72:0/4290480613 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe73c003bc0 msgr2=0x7fe75014d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:48.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.344+0000 7fe755938700 1 --2- 172.21.15.72:0/4290480613 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe73c003bc0 0x7fe75014d830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:48.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.344+0000 7fe755938700 1 -- 172.21.15.72:0/4290480613 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe750157d10 msgr2=0x7fe75014cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:48.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.344+0000 7fe755938700 1 --2- 172.21.15.72:0/4290480613 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe750157d10 0x7fe75014cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:48.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.344+0000 7fe755938700 1 -- 172.21.15.72:0/4290480613 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe750156560 con 0x7fe75014d120 2023-07-25T14:37:48.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.344+0000 7fe754936700 1 --2- 172.21.15.72:0/4290480613 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe750157d10 0x7fe75014cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-25T14:37:48.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.344+0000 7fe755938700 1 --2- 172.21.15.72:0/4290480613 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe75014d120 0x7fe7500be260 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7fe75006b1f0 tx=0x7fe74800c0e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:48.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.344+0000 7fe745ffb700 1 -- 172.21.15.72:0/4290480613 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe748003c10 con 0x7fe75014d120 2023-07-25T14:37:48.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.344+0000 7fe745ffb700 1 -- 172.21.15.72:0/4290480613 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe748003d70 con 0x7fe75014d120 2023-07-25T14:37:48.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.344+0000 7fe75739b700 1 -- 172.21.15.72:0/4290480613 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe750156840 con 0x7fe75014d120 2023-07-25T14:37:48.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.344+0000 7fe745ffb700 1 -- 172.21.15.72:0/4290480613 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe74800c9a0 con 0x7fe75014d120 2023-07-25T14:37:48.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.345+0000 7fe75739b700 1 -- 172.21.15.72:0/4290480613 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe750156e00 con 0x7fe75014d120 2023-07-25T14:37:48.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.345+0000 7fe75739b700 1 -- 172.21.15.72:0/4290480613 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7500be0d0 con 0x7fe75014d120 2023-07-25T14:37:48.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.346+0000 7fe745ffb700 1 -- 172.21.15.72:0/4290480613 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe74800cb00 con 0x7fe75014d120 2023-07-25T14:37:48.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.346+0000 7fe745ffb700 1 --2- 172.21.15.72:0/4290480613 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fe73406ace0 0x7fe73406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:48.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.346+0000 7fe745ffb700 1 -- 172.21.15.72:0/4290480613 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fe748089690 con 0x7fe75014d120 2023-07-25T14:37:48.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.346+0000 7fe755137700 1 --2- 172.21.15.72:0/4290480613 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fe73406ace0 0x7fe73406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:48.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.347+0000 7fe755137700 1 --2- 172.21.15.72:0/4290480613 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fe73406ace0 0x7fe73406d1a0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fe74c015040 tx=0x7fe74c00a000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:48.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.351+0000 7fe745ffb700 1 -- 172.21.15.72:0/4290480613 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fe748054690 con 0x7fe75014d120 2023-07-25T14:37:48.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.579+0000 7fe75739b700 1 -- 172.21.15.72:0/4290480613 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe750156fc0 con 0x7fe75014d120 2023-07-25T14:37:48.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.580+0000 7fe745ffb700 1 -- 172.21.15.72:0/4290480613 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) v1 ==== 94+0+4673 (secure 0 0 0) 0x7fe748057cb0 con 0x7fe75014d120 2023-07-25T14:37:48.591 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-25T14:37:48.591 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":33,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5698,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6834/2824839995","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":2824839995},{"type":"v1","addr":"172.21.15.92:6834","nonce":2824839995}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":6147,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6836/1970088937","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":1970088937},{"type":"v1","addr":"172.21.15.72:6836","nonce":1970088937}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":6150,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6837/2638708695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6835","nonce":2638708695},{"type":"v1","addr":"172.21.15.72:6837","nonce":2638708695}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-25T14:37:44.546871+0000","modified":"2023-07-25T14:37:48.197140+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6165},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6165":{"gid":6165,"name":"d","rank":0,"incarnation":29,"state":"up:active","state_seq":3,"addr":"172.21.15.92:6835/2035914134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6833","nonce":2035914134},{"type":"v1","addr":"172.21.15.92:6835","nonce":2035914134}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-07-25T14:37:48.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.582+0000 7fe75739b700 1 -- 172.21.15.72:0/4290480613 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fe73406ace0 msgr2=0x7fe73406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:48.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.582+0000 7fe75739b700 1 --2- 172.21.15.72:0/4290480613 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fe73406ace0 0x7fe73406d1a0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fe74c015040 tx=0x7fe74c00a000 comp rx=0 tx=0).stop 2023-07-25T14:37:48.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.582+0000 7fe75739b700 1 -- 172.21.15.72:0/4290480613 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe75014d120 msgr2=0x7fe7500be260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:48.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.582+0000 7fe75739b700 1 --2- 172.21.15.72:0/4290480613 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe75014d120 0x7fe7500be260 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7fe75006b1f0 tx=0x7fe74800c0e0 comp rx=0 tx=0).stop 2023-07-25T14:37:48.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.582+0000 7fe75739b700 1 -- 172.21.15.72:0/4290480613 shutdown_connections 2023-07-25T14:37:48.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.582+0000 7fe75739b700 1 --2- 172.21.15.72:0/4290480613 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fe73406ace0 0x7fe73406d1a0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:48.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.582+0000 7fe75739b700 1 --2- 172.21.15.72:0/4290480613 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe73c003bc0 0x7fe75014d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:48.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.582+0000 7fe75739b700 1 --2- 172.21.15.72:0/4290480613 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe75014d120 0x7fe7500be260 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:48.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.582+0000 7fe75739b700 1 --2- 172.21.15.72:0/4290480613 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe750157d10 0x7fe75014cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:48.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.582+0000 7fe75739b700 1 -- 172.21.15.72:0/4290480613 >> 172.21.15.72:0/4290480613 conn(0x7fe7500a87e0 msgr2=0x7fe7500c34c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:48.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.582+0000 7fe75739b700 1 -- 172.21.15.72:0/4290480613 shutdown_connections 2023-07-25T14:37:48.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.582+0000 7fe75739b700 1 -- 172.21.15.72:0/4290480613 wait complete. 2023-07-25T14:37:48.595 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 33 2023-07-25T14:37:48.605 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-25T14:37:48.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.714+0000 7f236a843700 1 Processor -- start 2023-07-25T14:37:48.725 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.714+0000 7f236a843700 1 -- start start 2023-07-25T14:37:48.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.715+0000 7f236a843700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2364151990 0x7f23640bc4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:48.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.715+0000 7f236a843700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f23640662b0 0x7f236406df50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:48.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.715+0000 7f236a843700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2364158220 con 0x7f23640bca20 2023-07-25T14:37:48.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.715+0000 7f236a843700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f236406eba0 con 0x7f23640662b0 2023-07-25T14:37:48.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.715+0000 7f236a843700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2364154220 con 0x7f2364151990 2023-07-25T14:37:48.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.715+0000 7f2368de0700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f23640bca20 0x7f236406e490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:34482/0 (socket says 172.21.15.72:34482) 2023-07-25T14:37:48.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.715+0000 7f2368de0700 1 -- 172.21.15.72:0/11343067 learned_addr learned my addr 172.21.15.72:0/11343067 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:37:48.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.715+0000 7f2363fff700 1 --2- 172.21.15.72:0/11343067 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2364151990 0x7f23640bc4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:48.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.715+0000 7f23637fe700 1 --2- 172.21.15.72:0/11343067 >> v2:172.21.15.92:3300/0 conn(0x7f23640662b0 0x7f236406df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:48.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.715+0000 7f2362ffd700 1 -- 172.21.15.72:0/11343067 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4186195807 0 0) 0x7f2364158220 con 0x7f23640bca20 2023-07-25T14:37:48.730 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.715+0000 7f2362ffd700 1 -- 172.21.15.72:0/11343067 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f234c0035b0 con 0x7f23640bca20 2023-07-25T14:37:48.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.715+0000 7f2362ffd700 1 -- 172.21.15.72:0/11343067 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2524779801 0 0) 0x7f234c0035b0 con 0x7f23640bca20 2023-07-25T14:37:48.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.715+0000 7f2362ffd700 1 -- 172.21.15.72:0/11343067 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2364151990 msgr2=0x7f23640bc4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:48.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.715+0000 7f2362ffd700 1 --2- 172.21.15.72:0/11343067 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2364151990 0x7f23640bc4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:48.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.715+0000 7f2362ffd700 1 -- 172.21.15.72:0/11343067 >> v2:172.21.15.92:3300/0 conn(0x7f23640662b0 msgr2=0x7f236406df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:48.731 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.715+0000 7f2362ffd700 1 --2- 172.21.15.72:0/11343067 >> v2:172.21.15.92:3300/0 conn(0x7f23640662b0 0x7f236406df50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:48.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.716+0000 7f2362ffd700 1 -- 172.21.15.72:0/11343067 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23640abe50 con 0x7f23640bca20 2023-07-25T14:37:48.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.716+0000 7f2362ffd700 1 -- 172.21.15.72:0/11343067 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2559588315 0 0) 0x7f235c0019f0 con 0x7f23640bca20 2023-07-25T14:37:48.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.716+0000 7f23637fe700 1 --2- 172.21.15.72:0/11343067 >> v2:172.21.15.92:3300/0 conn(0x7f23640662b0 0x7f236406df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-25T14:37:48.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.716+0000 7f2362ffd700 1 -- 172.21.15.72:0/11343067 >> v1:172.21.15.72:6789/0 conn(0x7f23640bca20 legacy=0x7f236406e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:48.732 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.716+0000 7f2362ffd700 1 --2- 172.21.15.72:0/11343067 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f234c003a00 0x7f234c003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:48.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.716+0000 7f2362ffd700 1 --2- 172.21.15.72:0/11343067 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2364151990 0x7f234c004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:48.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.716+0000 7f2362ffd700 1 --2- 172.21.15.72:0/11343067 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f234c004d90 0x7f234c005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:48.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.716+0000 7f2362ffd700 1 -- 172.21.15.72:0/11343067 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f236406eba0 con 0x7f234c003a00 2023-07-25T14:37:48.733 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.716+0000 7f2362ffd700 1 -- 172.21.15.72:0/11343067 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f234c00ba10 con 0x7f234c004d90 2023-07-25T14:37:48.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.716+0000 7f2362ffd700 1 -- 172.21.15.72:0/11343067 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f234c00bb50 con 0x7f2364151990 2023-07-25T14:37:48.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.716+0000 7f2363fff700 1 --2- 172.21.15.72:0/11343067 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f234c003a00 0x7f234c003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:48.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.716+0000 7f23637fe700 1 --2- 172.21.15.72:0/11343067 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2364151990 0x7f234c004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:48.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.716+0000 7f2368de0700 1 --2- 172.21.15.72:0/11343067 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f234c004d90 0x7f234c005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:48.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.716+0000 7f2363fff700 1 -- 172.21.15.72:0/11343067 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2364151990 msgr2=0x7f234c004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:48.734 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.716+0000 7f2363fff700 1 --2- 172.21.15.72:0/11343067 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2364151990 0x7f234c004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:48.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.716+0000 7f2363fff700 1 -- 172.21.15.72:0/11343067 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f234c004d90 msgr2=0x7f234c005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:48.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.716+0000 7f2363fff700 1 --2- 172.21.15.72:0/11343067 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f234c004d90 0x7f234c005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:48.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.716+0000 7f2363fff700 1 -- 172.21.15.72:0/11343067 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f234c0035b0 con 0x7f234c003a00 2023-07-25T14:37:48.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.716+0000 7f2368de0700 1 --2- 172.21.15.72:0/11343067 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f234c004d90 0x7f234c005210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-25T14:37:48.735 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.716+0000 7f2363fff700 1 --2- 172.21.15.72:0/11343067 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f234c003a00 0x7f234c003e20 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f2354009b60 tx=0x7f234c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6c9b6084e7864c4 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:48.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.716+0000 7f2362ffd700 1 -- 172.21.15.72:0/11343067 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f235400e6c0 con 0x7f234c003a00 2023-07-25T14:37:48.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.716+0000 7f2362ffd700 1 -- 172.21.15.72:0/11343067 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f235400e820 con 0x7f234c003a00 2023-07-25T14:37:48.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.716+0000 7f2362ffd700 1 -- 172.21.15.72:0/11343067 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f235400eb90 con 0x7f234c003a00 2023-07-25T14:37:48.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.717+0000 7f236a843700 1 -- 172.21.15.72:0/11343067 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f234c003a00 msgr2=0x7f234c003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:48.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.717+0000 7f236a843700 1 --2- 172.21.15.72:0/11343067 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f234c003a00 0x7f234c003e20 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f2354009b60 tx=0x7f234c005880 comp rx=0 tx=0).stop 2023-07-25T14:37:48.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.717+0000 7f2368de0700 1 -- 172.21.15.72:0/11343067 reap_dead start 2023-07-25T14:37:48.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.717+0000 7f236a843700 1 -- 172.21.15.72:0/11343067 shutdown_connections 2023-07-25T14:37:48.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.717+0000 7f236a843700 1 -- 172.21.15.72:0/11343067 >> 172.21.15.72:0/11343067 conn(0x7f2364071bf0 msgr2=0x7f236406a190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:48.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.717+0000 7f236a843700 1 -- 172.21.15.72:0/11343067 shutdown_connections 2023-07-25T14:37:48.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.717+0000 7f236a843700 1 -- 172.21.15.72:0/11343067 wait complete. 2023-07-25T14:37:48.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.718+0000 7f236a843700 1 Processor -- start 2023-07-25T14:37:48.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.718+0000 7f236a843700 1 -- start start 2023-07-25T14:37:48.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.719+0000 7f236a843700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f234c003a00 0x7f2364157af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:48.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.719+0000 7f236a843700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23641ed1e0 0x7f23641eb370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:48.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.719+0000 7f236a843700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f23641eb8b0 0x7f23641555b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:48.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.719+0000 7f236a843700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23641eaf50 con 0x7f23641ed1e0 2023-07-25T14:37:48.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.719+0000 7f236a843700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2364152940 con 0x7f234c003a00 2023-07-25T14:37:48.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.719+0000 7f236a843700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23641eda20 con 0x7f23641eb8b0 2023-07-25T14:37:48.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.719+0000 7f23637fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23641ed1e0 0x7f23641eb370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:48.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.719+0000 7f23637fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23641ed1e0 0x7f23641eb370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43756/0 (socket says 172.21.15.72:43756) 2023-07-25T14:37:48.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.719+0000 7f23637fe700 1 -- 172.21.15.72:0/2184395117 learned_addr learned my addr 172.21.15.72:0/2184395117 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:37:48.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.719+0000 7f2368de0700 1 --2- 172.21.15.72:0/2184395117 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f23641eb8b0 0x7f23641555b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:48.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.719+0000 7f2363fff700 1 --2- 172.21.15.72:0/2184395117 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f234c003a00 0x7f2364157af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:48.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.719+0000 7f23637fe700 1 -- 172.21.15.72:0/2184395117 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f23641eb8b0 msgr2=0x7f23641555b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:48.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.719+0000 7f23637fe700 1 --2- 172.21.15.72:0/2184395117 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f23641eb8b0 0x7f23641555b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:48.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.719+0000 7f23637fe700 1 -- 172.21.15.72:0/2184395117 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f234c003a00 msgr2=0x7f2364157af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:48.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.719+0000 7f23637fe700 1 --2- 172.21.15.72:0/2184395117 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f234c003a00 0x7f2364157af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:48.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.719+0000 7f23637fe700 1 -- 172.21.15.72:0/2184395117 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23640bd180 con 0x7f23641ed1e0 2023-07-25T14:37:48.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.719+0000 7f23637fe700 1 --2- 172.21.15.72:0/2184395117 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23641ed1e0 0x7f23641eb370 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f2358011cd0 tx=0x7f235800f520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:48.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.720+0000 7f2360ff9700 1 -- 172.21.15.72:0/2184395117 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2358011e70 con 0x7f23641ed1e0 2023-07-25T14:37:48.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.720+0000 7f2360ff9700 1 -- 172.21.15.72:0/2184395117 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f235800fd40 con 0x7f23641ed1e0 2023-07-25T14:37:48.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.720+0000 7f236a843700 1 -- 172.21.15.72:0/2184395117 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23641edcc0 con 0x7f23641ed1e0 2023-07-25T14:37:48.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.720+0000 7f2360ff9700 1 -- 172.21.15.72:0/2184395117 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2358004250 con 0x7f23641ed1e0 2023-07-25T14:37:48.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.720+0000 7f236a843700 1 -- 172.21.15.72:0/2184395117 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23641ed660 con 0x7f23641ed1e0 2023-07-25T14:37:48.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.720+0000 7f236a843700 1 -- 172.21.15.72:0/2184395117 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23640bc050 con 0x7f23641ed1e0 2023-07-25T14:37:48.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.721+0000 7f2360ff9700 1 -- 172.21.15.72:0/2184395117 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f23580043b0 con 0x7f23641ed1e0 2023-07-25T14:37:48.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.721+0000 7f2360ff9700 1 --2- 172.21.15.72:0/2184395117 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f235006ace0 0x7f235006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:48.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.721+0000 7f2360ff9700 1 -- 172.21.15.72:0/2184395117 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f2358089b50 con 0x7f23641ed1e0 2023-07-25T14:37:48.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.721+0000 7f2363fff700 1 --2- 172.21.15.72:0/2184395117 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f235006ace0 0x7f235006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:48.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.722+0000 7f2363fff700 1 --2- 172.21.15.72:0/2184395117 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f235006ace0 0x7f235006d1a0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f23540090b0 tx=0x7f2354008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:48.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.726+0000 7f2360ff9700 1 -- 172.21.15.72:0/2184395117 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f2358054b50 con 0x7f23641ed1e0 2023-07-25T14:37:48.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.915+0000 7f236a843700 1 -- 172.21.15.72:0/2184395117 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f23640c00f0 con 0x7f23641ed1e0 2023-07-25T14:37:48.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.916+0000 7f2360ff9700 1 -- 172.21.15.72:0/2184395117 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v57) v1 ==== 74+0+18449 (secure 0 0 0) 0x7f2358022020 con 0x7f23641ed1e0 2023-07-25T14:37:48.927 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-25T14:37:48.927 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":57,"fsid":"9170db48-9170-43e8-8ccb-9813e6240906","created":"2023-07-25T14:35:21.733262+0000","modified":"2023-07-25T14:37:46.187273+0000","last_up_change":"2023-07-25T14:35:31.355010+0000","last_in_change":"2023-07-25T14:35:24.195785+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-25T14:35:32.983457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-25T14:35:33.326342+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-07-25T14:37:42.689589+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-07-25T14:37:43.512214+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d517fdad-0bfe-49f0-89f2-9421c3761839","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6801","nonce":2475407414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6803","nonce":2475407414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6807","nonce":2475407414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6805","nonce":2475407414}]},"public_addr":"172.21.15.72:6801/2475407414","cluster_addr":"172.21.15.72:6803/2475407414","heartbeat_back_addr":"172.21.15.72:6807/2475407414","heartbeat_front_addr":"172.21.15.72:6805/2475407414","state":["exists","up"]},{"osd":1,"uuid":"e1564be3-f209-47e5-a8d0-32fc618a474f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6822","nonce":870954016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6825","nonce":870954016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6831","nonce":870954016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6827","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6829","nonce":870954016}]},"public_addr":"172.21.15.72:6822/870954016","cluster_addr":"172.21.15.72:6825/870954016","heartbeat_back_addr":"172.21.15.72:6831/870954016","heartbeat_front_addr":"172.21.15.72:6829/870954016","state":["exists","up"]},{"osd":2,"uuid":"c4647d30-ffa6-417a-9026-ef530c75910e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6809","nonce":2143129442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6811","nonce":2143129442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6815","nonce":2143129442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6813","nonce":2143129442}]},"public_addr":"172.21.15.72:6809/2143129442","cluster_addr":"172.21.15.72:6811/2143129442","heartbeat_back_addr":"172.21.15.72:6815/2143129442","heartbeat_front_addr":"172.21.15.72:6813/2143129442","state":["exists","up"]},{"osd":3,"uuid":"76c9d9a7-c2e2-4612-a58b-d6882dd76b58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6817","nonce":3404066311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6819","nonce":3404066311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6828","nonce":3404066311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6821","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6823","nonce":3404066311}]},"public_addr":"172.21.15.72:6817/3404066311","cluster_addr":"172.21.15.72:6819/3404066311","heartbeat_back_addr":"172.21.15.72:6828/3404066311","heartbeat_front_addr":"172.21.15.72:6823/3404066311","state":["exists","up"]},{"osd":4,"uuid":"7f8920dc-0ad4-4a73-ab40-65408f83eadd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6817","nonce":2381008739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6819","nonce":2381008739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6825","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6827","nonce":2381008739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6822","nonce":2381008739}]},"public_addr":"172.21.15.92:6817/2381008739","cluster_addr":"172.21.15.92:6819/2381008739","heartbeat_back_addr":"172.21.15.92:6827/2381008739","heartbeat_front_addr":"172.21.15.92:6822/2381008739","state":["exists","up"]},{"osd":5,"uuid":"56257e7c-31eb-44c5-9ec7-1318a4e0bb35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6801","nonce":2161935604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6803","nonce":2161935604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6807","nonce":2161935604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6805","nonce":2161935604}]},"public_addr":"172.21.15.92:6801/2161935604","cluster_addr":"172.21.15.92:6803/2161935604","heartbeat_back_addr":"172.21.15.92:6807/2161935604","heartbeat_front_addr":"172.21.15.92:6805/2161935604","state":["exists","up"]},{"osd":6,"uuid":"a150d3d8-a0c9-4955-968a-8d98eff4ffb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6809","nonce":3770163493}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6811","nonce":3770163493}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6815","nonce":3770163493}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6813","nonce":3770163493}]},"public_addr":"172.21.15.92:6809/3770163493","cluster_addr":"172.21.15.92:6811/3770163493","heartbeat_back_addr":"172.21.15.92:6815/3770163493","heartbeat_front_addr":"172.21.15.92:6813/3770163493","state":["exists","up"]},{"osd":7,"uuid":"07799c27-54ee-4591-a42d-a978d6b32065","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6821","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6823","nonce":2135777609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6826","nonce":2135777609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6831","nonce":2135777609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6829","nonce":2135777609}]},"public_addr":"172.21.15.92:6823/2135777609","cluster_addr":"172.21.15.92:6826/2135777609","heartbeat_back_addr":"172.21.15.92:6831/2135777609","heartbeat_front_addr":"172.21.15.92:6829/2135777609","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.345365+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.378150+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.146566+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.372172+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:30.398421+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.385632+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.465611+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.443583+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-25T14:37:48.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.918+0000 7f236a843700 1 -- 172.21.15.72:0/2184395117 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f235006ace0 msgr2=0x7f235006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:48.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.918+0000 7f236a843700 1 --2- 172.21.15.72:0/2184395117 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f235006ace0 0x7f235006d1a0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f23540090b0 tx=0x7f2354008030 comp rx=0 tx=0).stop 2023-07-25T14:37:48.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.918+0000 7f236a843700 1 -- 172.21.15.72:0/2184395117 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23641ed1e0 msgr2=0x7f23641eb370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:48.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.918+0000 7f236a843700 1 --2- 172.21.15.72:0/2184395117 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23641ed1e0 0x7f23641eb370 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f2358011cd0 tx=0x7f235800f520 comp rx=0 tx=0).stop 2023-07-25T14:37:48.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.918+0000 7f236a843700 1 -- 172.21.15.72:0/2184395117 shutdown_connections 2023-07-25T14:37:48.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.918+0000 7f236a843700 1 --2- 172.21.15.72:0/2184395117 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f235006ace0 0x7f235006d1a0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:48.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.918+0000 7f236a843700 1 --2- 172.21.15.72:0/2184395117 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f23641eb8b0 0x7f23641555b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:48.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.918+0000 7f236a843700 1 --2- 172.21.15.72:0/2184395117 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f234c003a00 0x7f2364157af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:48.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.918+0000 7f236a843700 1 --2- 172.21.15.72:0/2184395117 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f23641ed1e0 0x7f23641eb370 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:48.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.918+0000 7f236a843700 1 -- 172.21.15.72:0/2184395117 >> 172.21.15.72:0/2184395117 conn(0x7f2364071bf0 msgr2=0x7f23640c1c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:48.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.918+0000 7f236a843700 1 -- 172.21.15.72:0/2184395117 shutdown_connections 2023-07-25T14:37:48.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:48.918+0000 7f236a843700 1 -- 172.21.15.72:0/2184395117 wait complete. 2023-07-25T14:37:48.942 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-07-25T14:37:48.942 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-25T14:37:49.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.051+0000 7f3404fa1700 1 Processor -- start 2023-07-25T14:37:49.062 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.051+0000 7f3404fa1700 1 -- start start 2023-07-25T14:37:49.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.052+0000 7f3404fa1700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3400151950 0x7f340006a190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:49.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.052+0000 7f3404fa1700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f340006a6d0 0x7f34000c3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:49.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.052+0000 7f3404fa1700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34000c2fe0 con 0x7f34000724c0 2023-07-25T14:37:49.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.052+0000 7f3404fa1700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3400071a60 con 0x7f340006a6d0 2023-07-25T14:37:49.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.052+0000 7f3404fa1700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34000c2a70 con 0x7f3400151950 2023-07-25T14:37:49.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.052+0000 7f33fed9d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f340006a6d0 0x7f34000c3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:49.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.052+0000 7f33fdd9b700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f34000724c0 0x7f34000c34c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:34498/0 (socket says 172.21.15.72:34498) 2023-07-25T14:37:49.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.052+0000 7f33fdd9b700 1 -- 172.21.15.72:0/2973691205 learned_addr learned my addr 172.21.15.72:0/2973691205 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:37:49.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.053+0000 7f33fe59c700 1 --2- 172.21.15.72:0/2973691205 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3400151950 0x7f340006a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:49.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.053+0000 7f33fed9d700 1 -- 172.21.15.72:0/2973691205 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3400151950 msgr2=0x7f340006a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:49.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.053+0000 7f33fed9d700 1 --2- 172.21.15.72:0/2973691205 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3400151950 0x7f340006a190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:49.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.053+0000 7f33fed9d700 1 -- 172.21.15.72:0/2973691205 >> v1:172.21.15.72:6789/0 conn(0x7f34000724c0 legacy=0x7f34000c34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:49.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.053+0000 7f33fed9d700 1 -- 172.21.15.72:0/2973691205 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3400155070 con 0x7f340006a6d0 2023-07-25T14:37:49.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.053+0000 7f33fd59a700 1 -- 172.21.15.72:0/2973691205 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1152836548 0 0) 0x7f34000c2fe0 con 0x7f34000724c0 2023-07-25T14:37:49.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.053+0000 7f33fed9d700 1 --2- 172.21.15.72:0/2973691205 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f340006a6d0 0x7f34000c3bd0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f33f8009d90 tx=0x7f33f800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a533bb2c39be555d server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:49.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.053+0000 7f33fd59a700 1 -- 172.21.15.72:0/2973691205 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33f800e070 con 0x7f340006a6d0 2023-07-25T14:37:49.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.053+0000 7f33fd59a700 1 -- 172.21.15.72:0/2973691205 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33f800bbd0 con 0x7f340006a6d0 2023-07-25T14:37:49.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.053+0000 7f33fd59a700 1 -- 172.21.15.72:0/2973691205 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33f8012430 con 0x7f340006a6d0 2023-07-25T14:37:49.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.053+0000 7f3404fa1700 1 -- 172.21.15.72:0/2973691205 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f340006a6d0 msgr2=0x7f34000c3bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:49.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.053+0000 7f3404fa1700 1 --2- 172.21.15.72:0/2973691205 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f340006a6d0 0x7f34000c3bd0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f33f8009d90 tx=0x7f33f800b330 comp rx=0 tx=0).stop 2023-07-25T14:37:49.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.054+0000 7f3404fa1700 1 -- 172.21.15.72:0/2973691205 shutdown_connections 2023-07-25T14:37:49.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.054+0000 7f3404fa1700 1 --2- 172.21.15.72:0/2973691205 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f340006a6d0 0x7f34000c3bd0 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:49.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.054+0000 7f3404fa1700 1 --2- 172.21.15.72:0/2973691205 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3400151950 0x7f340006a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:49.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.054+0000 7f3404fa1700 1 -- 172.21.15.72:0/2973691205 >> 172.21.15.72:0/2973691205 conn(0x7f34000a87e0 msgr2=0x7f34000a8bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:49.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.054+0000 7f3404fa1700 1 -- 172.21.15.72:0/2973691205 shutdown_connections 2023-07-25T14:37:49.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.054+0000 7f3404fa1700 1 -- 172.21.15.72:0/2973691205 wait complete. 2023-07-25T14:37:49.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.055+0000 7f3404fa1700 1 Processor -- start 2023-07-25T14:37:49.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.055+0000 7f3404fa1700 1 -- start start 2023-07-25T14:37:49.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.056+0000 7f3404fa1700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f340006a6d0 0x7f340014cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:49.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.056+0000 7f3404fa1700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f34000724c0 0x7f340014a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:49.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.056+0000 7f3404fa1700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3400151950 0x7f340014ade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:49.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.056+0000 7f3404fa1700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34000a5ee0 con 0x7f3400151950 2023-07-25T14:37:49.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.056+0000 7f3404fa1700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f340014b320 con 0x7f34000724c0 2023-07-25T14:37:49.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.056+0000 7f3404fa1700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34000a8ca0 con 0x7f340006a6d0 2023-07-25T14:37:49.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.056+0000 7f33fed9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3400151950 0x7f340014ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:49.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.056+0000 7f33fed9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3400151950 0x7f340014ade0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43770/0 (socket says 172.21.15.72:43770) 2023-07-25T14:37:49.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.056+0000 7f33fed9d700 1 -- 172.21.15.72:0/2164902216 learned_addr learned my addr 172.21.15.72:0/2164902216 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:37:49.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.056+0000 7f33fdd9b700 1 --2- 172.21.15.72:0/2164902216 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f34000724c0 0x7f340014a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:49.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.056+0000 7f33fe59c700 1 --2- 172.21.15.72:0/2164902216 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f340006a6d0 0x7f340014cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:49.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.056+0000 7f33fed9d700 1 -- 172.21.15.72:0/2164902216 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f340006a6d0 msgr2=0x7f340014cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:49.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.056+0000 7f33fed9d700 1 --2- 172.21.15.72:0/2164902216 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f340006a6d0 0x7f340014cab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:49.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.056+0000 7f33fed9d700 1 -- 172.21.15.72:0/2164902216 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f34000724c0 msgr2=0x7f340014a8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:49.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.056+0000 7f33fed9d700 1 --2- 172.21.15.72:0/2164902216 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f34000724c0 0x7f340014a8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:49.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.056+0000 7f33fed9d700 1 -- 172.21.15.72:0/2164902216 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33f8009a70 con 0x7f3400151950 2023-07-25T14:37:49.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.056+0000 7f33fed9d700 1 --2- 172.21.15.72:0/2164902216 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3400151950 0x7f340014ade0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f33f800b730 tx=0x7f33f8004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:49.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.056+0000 7f33eeffd700 1 -- 172.21.15.72:0/2164902216 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33f8012430 con 0x7f3400151950 2023-07-25T14:37:49.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.056+0000 7f33eeffd700 1 -- 172.21.15.72:0/2164902216 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33f8020070 con 0x7f3400151950 2023-07-25T14:37:49.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.056+0000 7f3404fa1700 1 -- 172.21.15.72:0/2164902216 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3400144640 con 0x7f3400151950 2023-07-25T14:37:49.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.056+0000 7f33eeffd700 1 -- 172.21.15.72:0/2164902216 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33f8004280 con 0x7f3400151950 2023-07-25T14:37:49.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.056+0000 7f3404fa1700 1 -- 172.21.15.72:0/2164902216 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3400144410 con 0x7f3400151950 2023-07-25T14:37:49.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.057+0000 7f3404fa1700 1 -- 172.21.15.72:0/2164902216 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34000a90f0 con 0x7f3400151950 2023-07-25T14:37:49.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.058+0000 7f33eeffd700 1 -- 172.21.15.72:0/2164902216 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f33f80043e0 con 0x7f3400151950 2023-07-25T14:37:49.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.058+0000 7f33eeffd700 1 --2- 172.21.15.72:0/2164902216 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f33e006ace0 0x7f33e006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:49.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.058+0000 7f33eeffd700 1 -- 172.21.15.72:0/2164902216 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f33f8022070 con 0x7f3400151950 2023-07-25T14:37:49.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.058+0000 7f33fe59c700 1 --2- 172.21.15.72:0/2164902216 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f33e006ace0 0x7f33e006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:49.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.058+0000 7f33fe59c700 1 --2- 172.21.15.72:0/2164902216 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f33e006ace0 0x7f33e006d1a0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f33f400b9b0 tx=0x7f33f4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:49.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.062+0000 7f33eeffd700 1 -- 172.21.15.72:0/2164902216 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f33f8056b30 con 0x7f3400151950 2023-07-25T14:37:49.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.246+0000 7f3404fa1700 1 -- 172.21.15.72:0/2164902216 --> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f34000c18a0 con 0x7f33e006ace0 2023-07-25T14:37:49.265 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.254+0000 7f33eeffd700 1 -- 172.21.15.72:0/2164902216 <== mgr.4104 v2:172.21.15.72:6832/1171220306 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311635 (secure 0 0 0) 0x7f33f400be80 con 0x7f33e006ace0 2023-07-25T14:37:49.268 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-25T14:37:49.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.257+0000 7f3404fa1700 1 -- 172.21.15.72:0/2164902216 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f33e006ace0 msgr2=0x7f33e006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:49.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.257+0000 7f3404fa1700 1 --2- 172.21.15.72:0/2164902216 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f33e006ace0 0x7f33e006d1a0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f33f400b9b0 tx=0x7f33f4008040 comp rx=0 tx=0).stop 2023-07-25T14:37:49.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.257+0000 7f3404fa1700 1 -- 172.21.15.72:0/2164902216 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3400151950 msgr2=0x7f340014ade0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:49.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.257+0000 7f3404fa1700 1 --2- 172.21.15.72:0/2164902216 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3400151950 0x7f340014ade0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f33f800b730 tx=0x7f33f8004ad0 comp rx=0 tx=0).stop 2023-07-25T14:37:49.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.257+0000 7f3404fa1700 1 -- 172.21.15.72:0/2164902216 shutdown_connections 2023-07-25T14:37:49.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.257+0000 7f3404fa1700 1 --2- 172.21.15.72:0/2164902216 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f33e006ace0 0x7f33e006d1a0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:49.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.257+0000 7f3404fa1700 1 --2- 172.21.15.72:0/2164902216 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f340006a6d0 0x7f340014cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:49.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.257+0000 7f3404fa1700 1 --2- 172.21.15.72:0/2164902216 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3400151950 0x7f340014ade0 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:49.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.257+0000 7f3404fa1700 1 --2- 172.21.15.72:0/2164902216 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f34000724c0 0x7f340014a8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:49.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.257+0000 7f3404fa1700 1 -- 172.21.15.72:0/2164902216 >> 172.21.15.72:0/2164902216 conn(0x7f34000a87e0 msgr2=0x7f340014fbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:49.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.257+0000 7f3404fa1700 1 -- 172.21.15.72:0/2164902216 shutdown_connections 2023-07-25T14:37:49.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.258+0000 7f3404fa1700 1 -- 172.21.15.72:0/2164902216 wait complete. 2023-07-25T14:37:49.271 INFO:teuthology.orchestra.run.smithi072.stderr:dumped all 2023-07-25T14:37:49.280 INFO:teuthology.orchestra.run.smithi072.stdout:{"pg_ready":true,"pg_map":{"version":118,"stamp":"2023-07-25T14:37:47.311358+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":103,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":221668,"kb_used_data":5460,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754753052,"statfs":{"total":773094113280,"available":772867125248,"internally_reserved":0,"allocated":5591040,"data_stored":3741101,"data_compressed":64510,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":37,"apply_latency_ms":37,"commit_latency_ns":37000000,"apply_latency_ns":37000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.163078"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-07-25T14:37:45.203962+0000","last_change":"2023-07-25T14:37:45.195851+0000","last_active":"2023-07-25T14:37:45.203962+0000","last_peered":"2023-07-25T14:37:45.203962+0000","last_clean":"2023-07-25T14:37:45.203962+0000","last_became_active":"2023-07-25T14:37:45.195549+0000","last_became_peered":"2023-07-25T14:37:45.195549+0000","last_unstale":"2023-07-25T14:37:45.203962+0000","last_undegraded":"2023-07-25T14:37:45.203962+0000","last_fullsized":"2023-07-25T14:37:45.203962+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T19:46:54.340200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-07-25T14:37:45.215138+0000","last_change":"2023-07-25T14:37:45.209998+0000","last_active":"2023-07-25T14:37:45.215138+0000","last_peered":"2023-07-25T14:37:45.215138+0000","last_clean":"2023-07-25T14:37:45.215138+0000","last_became_active":"2023-07-25T14:37:45.209538+0000","last_became_peered":"2023-07-25T14:37:45.209538+0000","last_unstale":"2023-07-25T14:37:45.215138+0000","last_undegraded":"2023-07-25T14:37:45.215138+0000","last_fullsized":"2023-07-25T14:37:45.215138+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:30:00.868812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-25T14:37:46.193366+0000","last_change":"2023-07-25T14:37:45.186668+0000","last_active":"2023-07-25T14:37:46.193366+0000","last_peered":"2023-07-25T14:37:46.193366+0000","last_clean":"2023-07-25T14:37:46.193366+0000","last_became_active":"2023-07-25T14:37:45.186396+0000","last_became_peered":"2023-07-25T14:37:45.186396+0000","last_unstale":"2023-07-25T14:37:46.193366+0000","last_undegraded":"2023-07-25T14:37:46.193366+0000","last_fullsized":"2023-07-25T14:37:46.193366+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T14:50:53.134658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-25T14:37:46.194562+0000","last_change":"2023-07-25T14:37:45.197894+0000","last_active":"2023-07-25T14:37:46.194562+0000","last_peered":"2023-07-25T14:37:46.194562+0000","last_clean":"2023-07-25T14:37:46.194562+0000","last_became_active":"2023-07-25T14:37:45.197369+0000","last_became_peered":"2023-07-25T14:37:45.197369+0000","last_unstale":"2023-07-25T14:37:46.194562+0000","last_undegraded":"2023-07-25T14:37:46.194562+0000","last_fullsized":"2023-07-25T14:37:46.194562+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:09:57.961255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-07-25T14:37:45.208097+0000","last_change":"2023-07-25T14:37:45.204817+0000","last_active":"2023-07-25T14:37:45.208097+0000","last_peered":"2023-07-25T14:37:45.208097+0000","last_clean":"2023-07-25T14:37:45.208097+0000","last_became_active":"2023-07-25T14:37:45.204540+0000","last_became_peered":"2023-07-25T14:37:45.204540+0000","last_unstale":"2023-07-25T14:37:45.208097+0000","last_undegraded":"2023-07-25T14:37:45.208097+0000","last_fullsized":"2023-07-25T14:37:45.208097+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T17:58:45.096276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-07-25T14:37:45.215140+0000","last_change":"2023-07-25T14:37:45.212379+0000","last_active":"2023-07-25T14:37:45.215140+0000","last_peered":"2023-07-25T14:37:45.215140+0000","last_clean":"2023-07-25T14:37:45.215140+0000","last_became_active":"2023-07-25T14:37:45.210115+0000","last_became_peered":"2023-07-25T14:37:45.210115+0000","last_unstale":"2023-07-25T14:37:45.215140+0000","last_undegraded":"2023-07-25T14:37:45.215140+0000","last_fullsized":"2023-07-25T14:37:45.215140+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T17:43:53.383591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-25T14:37:46.194311+0000","last_change":"2023-07-25T14:37:45.197514+0000","last_active":"2023-07-25T14:37:46.194311+0000","last_peered":"2023-07-25T14:37:46.194311+0000","last_clean":"2023-07-25T14:37:46.194311+0000","last_became_active":"2023-07-25T14:37:45.197076+0000","last_became_peered":"2023-07-25T14:37:45.197076+0000","last_unstale":"2023-07-25T14:37:46.194311+0000","last_undegraded":"2023-07-25T14:37:46.194311+0000","last_fullsized":"2023-07-25T14:37:46.194311+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T21:27:16.247632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-07-25T14:37:45.208858+0000","last_change":"2023-07-25T14:37:45.199774+0000","last_active":"2023-07-25T14:37:45.208858+0000","last_peered":"2023-07-25T14:37:45.208858+0000","last_clean":"2023-07-25T14:37:45.208858+0000","last_became_active":"2023-07-25T14:37:45.199408+0000","last_became_peered":"2023-07-25T14:37:45.199408+0000","last_unstale":"2023-07-25T14:37:45.208858+0000","last_undegraded":"2023-07-25T14:37:45.208858+0000","last_fullsized":"2023-07-25T14:37:45.208858+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T21:00:10.932528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-07-25T14:37:45.199242+0000","last_change":"2023-07-25T14:37:45.196344+0000","last_active":"2023-07-25T14:37:45.199242+0000","last_peered":"2023-07-25T14:37:45.199242+0000","last_clean":"2023-07-25T14:37:45.199242+0000","last_became_active":"2023-07-25T14:37:45.196000+0000","last_became_peered":"2023-07-25T14:37:45.196000+0000","last_unstale":"2023-07-25T14:37:45.199242+0000","last_undegraded":"2023-07-25T14:37:45.199242+0000","last_fullsized":"2023-07-25T14:37:45.199242+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T20:07:06.102185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-07-25T14:37:45.204628+0000","last_change":"2023-07-25T14:37:45.199696+0000","last_active":"2023-07-25T14:37:45.204628+0000","last_peered":"2023-07-25T14:37:45.204628+0000","last_clean":"2023-07-25T14:37:45.204628+0000","last_became_active":"2023-07-25T14:37:45.199345+0000","last_became_peered":"2023-07-25T14:37:45.199345+0000","last_unstale":"2023-07-25T14:37:45.204628+0000","last_undegraded":"2023-07-25T14:37:45.204628+0000","last_fullsized":"2023-07-25T14:37:45.204628+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T02:17:17.385824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-07-25T14:37:45.212057+0000","last_change":"2023-07-25T14:37:45.206383+0000","last_active":"2023-07-25T14:37:45.212057+0000","last_peered":"2023-07-25T14:37:45.212057+0000","last_clean":"2023-07-25T14:37:45.212057+0000","last_became_active":"2023-07-25T14:37:45.204409+0000","last_became_peered":"2023-07-25T14:37:45.204409+0000","last_unstale":"2023-07-25T14:37:45.212057+0000","last_undegraded":"2023-07-25T14:37:45.212057+0000","last_fullsized":"2023-07-25T14:37:45.212057+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T19:19:00.222021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-25T14:37:46.194594+0000","last_change":"2023-07-25T14:37:45.198072+0000","last_active":"2023-07-25T14:37:46.194594+0000","last_peered":"2023-07-25T14:37:46.194594+0000","last_clean":"2023-07-25T14:37:46.194594+0000","last_became_active":"2023-07-25T14:37:45.197648+0000","last_became_peered":"2023-07-25T14:37:45.197648+0000","last_unstale":"2023-07-25T14:37:46.194594+0000","last_undegraded":"2023-07-25T14:37:46.194594+0000","last_fullsized":"2023-07-25T14:37:46.194594+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T19:43:31.627741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-07-25T14:37:45.190439+0000","last_change":"2023-07-25T14:37:45.188472+0000","last_active":"2023-07-25T14:37:45.190439+0000","last_peered":"2023-07-25T14:37:45.190439+0000","last_clean":"2023-07-25T14:37:45.190439+0000","last_became_active":"2023-07-25T14:37:45.188105+0000","last_became_peered":"2023-07-25T14:37:45.188105+0000","last_unstale":"2023-07-25T14:37:45.190439+0000","last_undegraded":"2023-07-25T14:37:45.190439+0000","last_fullsized":"2023-07-25T14:37:45.190439+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:05:52.257256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-07-25T14:37:45.194941+0000","last_change":"2023-07-25T14:37:45.191002+0000","last_active":"2023-07-25T14:37:45.194941+0000","last_peered":"2023-07-25T14:37:45.194941+0000","last_clean":"2023-07-25T14:37:45.194941+0000","last_became_active":"2023-07-25T14:37:45.190713+0000","last_became_peered":"2023-07-25T14:37:45.190713+0000","last_unstale":"2023-07-25T14:37:45.194941+0000","last_undegraded":"2023-07-25T14:37:45.194941+0000","last_fullsized":"2023-07-25T14:37:45.194941+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T15:38:05.005620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-07-25T14:37:45.199432+0000","last_change":"2023-07-25T14:37:45.192719+0000","last_active":"2023-07-25T14:37:45.199432+0000","last_peered":"2023-07-25T14:37:45.199432+0000","last_clean":"2023-07-25T14:37:45.199432+0000","last_became_active":"2023-07-25T14:37:45.192419+0000","last_became_peered":"2023-07-25T14:37:45.192419+0000","last_unstale":"2023-07-25T14:37:45.199432+0000","last_undegraded":"2023-07-25T14:37:45.199432+0000","last_fullsized":"2023-07-25T14:37:45.199432+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T19:46:54.340200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-07-25T14:37:45.211942+0000","last_change":"2023-07-25T14:37:45.210664+0000","last_active":"2023-07-25T14:37:45.211942+0000","last_peered":"2023-07-25T14:37:45.211942+0000","last_clean":"2023-07-25T14:37:45.211942+0000","last_became_active":"2023-07-25T14:37:45.210376+0000","last_became_peered":"2023-07-25T14:37:45.210376+0000","last_unstale":"2023-07-25T14:37:45.211942+0000","last_undegraded":"2023-07-25T14:37:45.211942+0000","last_fullsized":"2023-07-25T14:37:45.211942+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T18:35:56.643497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-07-25T14:37:45.195068+0000","last_change":"2023-07-25T14:37:45.191718+0000","last_active":"2023-07-25T14:37:45.195068+0000","last_peered":"2023-07-25T14:37:45.195068+0000","last_clean":"2023-07-25T14:37:45.195068+0000","last_became_active":"2023-07-25T14:37:45.191401+0000","last_became_peered":"2023-07-25T14:37:45.191401+0000","last_unstale":"2023-07-25T14:37:45.195068+0000","last_undegraded":"2023-07-25T14:37:45.195068+0000","last_fullsized":"2023-07-25T14:37:45.195068+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T15:02:19.241116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-25T14:37:46.194627+0000","last_change":"2023-07-25T14:37:45.197329+0000","last_active":"2023-07-25T14:37:46.194627+0000","last_peered":"2023-07-25T14:37:46.194627+0000","last_clean":"2023-07-25T14:37:46.194627+0000","last_became_active":"2023-07-25T14:37:45.197048+0000","last_became_peered":"2023-07-25T14:37:45.197048+0000","last_unstale":"2023-07-25T14:37:46.194627+0000","last_undegraded":"2023-07-25T14:37:46.194627+0000","last_fullsized":"2023-07-25T14:37:46.194627+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T23:57:12.537826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-07-25T14:37:45.214250+0000","last_change":"2023-07-25T14:37:45.205950+0000","last_active":"2023-07-25T14:37:45.214250+0000","last_peered":"2023-07-25T14:37:45.214250+0000","last_clean":"2023-07-25T14:37:45.214250+0000","last_became_active":"2023-07-25T14:37:45.199388+0000","last_became_peered":"2023-07-25T14:37:45.199388+0000","last_unstale":"2023-07-25T14:37:45.214250+0000","last_undegraded":"2023-07-25T14:37:45.214250+0000","last_fullsized":"2023-07-25T14:37:45.214250+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T18:26:45.013075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-07-25T14:37:45.190599+0000","last_change":"2023-07-25T14:37:45.188465+0000","last_active":"2023-07-25T14:37:45.190599+0000","last_peered":"2023-07-25T14:37:45.190599+0000","last_clean":"2023-07-25T14:37:45.190599+0000","last_became_active":"2023-07-25T14:37:45.188186+0000","last_became_peered":"2023-07-25T14:37:45.188186+0000","last_unstale":"2023-07-25T14:37:45.190599+0000","last_undegraded":"2023-07-25T14:37:45.190599+0000","last_fullsized":"2023-07-25T14:37:45.190599+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T02:24:58.237137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-07-25T14:37:45.205064+0000","last_change":"2023-07-25T14:37:45.201384+0000","last_active":"2023-07-25T14:37:45.205064+0000","last_peered":"2023-07-25T14:37:45.205064+0000","last_clean":"2023-07-25T14:37:45.205064+0000","last_became_active":"2023-07-25T14:37:45.200847+0000","last_became_peered":"2023-07-25T14:37:45.200847+0000","last_unstale":"2023-07-25T14:37:45.205064+0000","last_undegraded":"2023-07-25T14:37:45.205064+0000","last_fullsized":"2023-07-25T14:37:45.205064+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T01:47:30.829451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-07-25T14:37:45.209597+0000","last_change":"2023-07-25T14:37:45.201941+0000","last_active":"2023-07-25T14:37:45.209597+0000","last_peered":"2023-07-25T14:37:45.209597+0000","last_clean":"2023-07-25T14:37:45.209597+0000","last_became_active":"2023-07-25T14:37:45.201640+0000","last_became_peered":"2023-07-25T14:37:45.201640+0000","last_unstale":"2023-07-25T14:37:45.209597+0000","last_undegraded":"2023-07-25T14:37:45.209597+0000","last_fullsized":"2023-07-25T14:37:45.209597+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T16:32:28.258692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-07-25T14:37:45.211753+0000","last_change":"2023-07-25T14:37:45.204317+0000","last_active":"2023-07-25T14:37:45.211753+0000","last_peered":"2023-07-25T14:37:45.211753+0000","last_clean":"2023-07-25T14:37:45.211753+0000","last_became_active":"2023-07-25T14:37:45.203583+0000","last_became_peered":"2023-07-25T14:37:45.203583+0000","last_unstale":"2023-07-25T14:37:45.211753+0000","last_undegraded":"2023-07-25T14:37:45.211753+0000","last_fullsized":"2023-07-25T14:37:45.211753+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T16:32:28.258692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-07-25T14:37:45.211964+0000","last_change":"2023-07-25T14:37:45.207314+0000","last_active":"2023-07-25T14:37:45.211964+0000","last_peered":"2023-07-25T14:37:45.211964+0000","last_clean":"2023-07-25T14:37:45.211964+0000","last_became_active":"2023-07-25T14:37:45.207030+0000","last_became_peered":"2023-07-25T14:37:45.207030+0000","last_unstale":"2023-07-25T14:37:45.211964+0000","last_undegraded":"2023-07-25T14:37:45.211964+0000","last_fullsized":"2023-07-25T14:37:45.211964+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T17:38:56.431932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-07-25T14:37:45.211849+0000","last_change":"2023-07-25T14:37:45.210109+0000","last_active":"2023-07-25T14:37:45.211849+0000","last_peered":"2023-07-25T14:37:45.211849+0000","last_clean":"2023-07-25T14:37:45.211849+0000","last_became_active":"2023-07-25T14:37:45.205229+0000","last_became_peered":"2023-07-25T14:37:45.205229+0000","last_unstale":"2023-07-25T14:37:45.211849+0000","last_undegraded":"2023-07-25T14:37:45.211849+0000","last_fullsized":"2023-07-25T14:37:45.211849+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T23:12:55.259842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-25T14:37:46.194827+0000","last_change":"2023-07-25T14:37:45.188464+0000","last_active":"2023-07-25T14:37:46.194827+0000","last_peered":"2023-07-25T14:37:46.194827+0000","last_clean":"2023-07-25T14:37:46.194827+0000","last_became_active":"2023-07-25T14:37:45.188020+0000","last_became_peered":"2023-07-25T14:37:45.188020+0000","last_unstale":"2023-07-25T14:37:46.194827+0000","last_undegraded":"2023-07-25T14:37:46.194827+0000","last_fullsized":"2023-07-25T14:37:46.194827+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T18:05:49.493471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-25T14:37:46.193411+0000","last_change":"2023-07-25T14:37:45.205460+0000","last_active":"2023-07-25T14:37:46.193411+0000","last_peered":"2023-07-25T14:37:46.193411+0000","last_clean":"2023-07-25T14:37:46.193411+0000","last_became_active":"2023-07-25T14:37:45.205174+0000","last_became_peered":"2023-07-25T14:37:45.205174+0000","last_unstale":"2023-07-25T14:37:46.193411+0000","last_undegraded":"2023-07-25T14:37:46.193411+0000","last_fullsized":"2023-07-25T14:37:46.193411+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:12:48.565660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-07-25T14:37:45.203857+0000","last_change":"2023-07-25T14:37:45.199014+0000","last_active":"2023-07-25T14:37:45.203857+0000","last_peered":"2023-07-25T14:37:45.203857+0000","last_clean":"2023-07-25T14:37:45.203857+0000","last_became_active":"2023-07-25T14:37:45.198610+0000","last_became_peered":"2023-07-25T14:37:45.198610+0000","last_unstale":"2023-07-25T14:37:45.203857+0000","last_undegraded":"2023-07-25T14:37:45.203857+0000","last_fullsized":"2023-07-25T14:37:45.203857+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T20:38:09.568965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-25T14:37:46.193069+0000","last_change":"2023-07-25T14:37:45.190492+0000","last_active":"2023-07-25T14:37:46.193069+0000","last_peered":"2023-07-25T14:37:46.193069+0000","last_clean":"2023-07-25T14:37:46.193069+0000","last_became_active":"2023-07-25T14:37:45.190205+0000","last_became_peered":"2023-07-25T14:37:45.190205+0000","last_unstale":"2023-07-25T14:37:46.193069+0000","last_undegraded":"2023-07-25T14:37:46.193069+0000","last_fullsized":"2023-07-25T14:37:46.193069+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T18:04:35.337446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-25T14:37:46.194331+0000","last_change":"2023-07-25T14:37:45.189887+0000","last_active":"2023-07-25T14:37:46.194331+0000","last_peered":"2023-07-25T14:37:46.194331+0000","last_clean":"2023-07-25T14:37:46.194331+0000","last_became_active":"2023-07-25T14:37:45.189544+0000","last_became_peered":"2023-07-25T14:37:45.189544+0000","last_unstale":"2023-07-25T14:37:46.194331+0000","last_undegraded":"2023-07-25T14:37:46.194331+0000","last_fullsized":"2023-07-25T14:37:46.194331+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T22:28:14.590354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-25T14:37:46.194255+0000","last_change":"2023-07-25T14:37:45.197332+0000","last_active":"2023-07-25T14:37:46.194255+0000","last_peered":"2023-07-25T14:37:46.194255+0000","last_clean":"2023-07-25T14:37:46.194255+0000","last_became_active":"2023-07-25T14:37:45.196749+0000","last_became_peered":"2023-07-25T14:37:45.196749+0000","last_unstale":"2023-07-25T14:37:46.194255+0000","last_undegraded":"2023-07-25T14:37:46.194255+0000","last_fullsized":"2023-07-25T14:37:46.194255+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T19:06:17.677254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-07-25T14:37:45.206004+0000","last_change":"2023-07-25T14:37:45.191972+0000","last_active":"2023-07-25T14:37:45.206004+0000","last_peered":"2023-07-25T14:37:45.206004+0000","last_clean":"2023-07-25T14:37:45.206004+0000","last_became_active":"2023-07-25T14:37:45.191704+0000","last_became_peered":"2023-07-25T14:37:45.191704+0000","last_unstale":"2023-07-25T14:37:45.206004+0000","last_undegraded":"2023-07-25T14:37:45.206004+0000","last_fullsized":"2023-07-25T14:37:45.206004+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T19:19:19.975606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-07-25T14:37:45.214270+0000","last_change":"2023-07-25T14:37:45.213847+0000","last_active":"2023-07-25T14:37:45.214270+0000","last_peered":"2023-07-25T14:37:45.214270+0000","last_clean":"2023-07-25T14:37:45.214270+0000","last_became_active":"2023-07-25T14:37:45.213456+0000","last_became_peered":"2023-07-25T14:37:45.213456+0000","last_unstale":"2023-07-25T14:37:45.214270+0000","last_undegraded":"2023-07-25T14:37:45.214270+0000","last_fullsized":"2023-07-25T14:37:45.214270+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T18:35:56.643497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"56'4","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-07-25T14:37:45.212174+0000","last_change":"2023-07-25T14:37:44.164114+0000","last_active":"2023-07-25T14:37:45.212174+0000","last_peered":"2023-07-25T14:37:45.212174+0000","last_clean":"2023-07-25T14:37:45.212174+0000","last_became_active":"2023-07-25T14:37:44.163807+0000","last_became_peered":"2023-07-25T14:37:44.163807+0000","last_unstale":"2023-07-25T14:37:45.212174+0000","last_undegraded":"2023-07-25T14:37:45.212174+0000","last_fullsized":"2023-07-25T14:37:45.212174+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T02:17:16.384209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-07-25T14:37:45.195047+0000","last_change":"2023-07-25T14:37:45.191918+0000","last_active":"2023-07-25T14:37:45.195047+0000","last_peered":"2023-07-25T14:37:45.195047+0000","last_clean":"2023-07-25T14:37:45.195047+0000","last_became_active":"2023-07-25T14:37:45.191341+0000","last_became_peered":"2023-07-25T14:37:45.191341+0000","last_unstale":"2023-07-25T14:37:45.195047+0000","last_undegraded":"2023-07-25T14:37:45.195047+0000","last_fullsized":"2023-07-25T14:37:45.195047+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T19:51:22.044360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"56'1","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-07-25T14:37:45.211898+0000","last_change":"2023-07-25T14:37:44.174028+0000","last_active":"2023-07-25T14:37:45.211898+0000","last_peered":"2023-07-25T14:37:45.211898+0000","last_clean":"2023-07-25T14:37:45.211898+0000","last_became_active":"2023-07-25T14:37:44.173193+0000","last_became_peered":"2023-07-25T14:37:44.173193+0000","last_unstale":"2023-07-25T14:37:45.211898+0000","last_undegraded":"2023-07-25T14:37:45.211898+0000","last_fullsized":"2023-07-25T14:37:45.211898+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T20:03:55.706767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-07-25T14:37:45.215058+0000","last_change":"2023-07-25T14:37:45.209338+0000","last_active":"2023-07-25T14:37:45.215058+0000","last_peered":"2023-07-25T14:37:45.215058+0000","last_clean":"2023-07-25T14:37:45.215058+0000","last_became_active":"2023-07-25T14:37:45.207168+0000","last_became_peered":"2023-07-25T14:37:45.207168+0000","last_unstale":"2023-07-25T14:37:45.215058+0000","last_undegraded":"2023-07-25T14:37:45.215058+0000","last_fullsized":"2023-07-25T14:37:45.215058+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T23:13:44.190013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"56'2","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-07-25T14:37:45.214688+0000","last_change":"2023-07-25T14:37:44.168052+0000","last_active":"2023-07-25T14:37:45.214688+0000","last_peered":"2023-07-25T14:37:45.214688+0000","last_clean":"2023-07-25T14:37:45.214688+0000","last_became_active":"2023-07-25T14:37:44.167768+0000","last_became_peered":"2023-07-25T14:37:44.167768+0000","last_unstale":"2023-07-25T14:37:45.214688+0000","last_undegraded":"2023-07-25T14:37:45.214688+0000","last_fullsized":"2023-07-25T14:37:45.214688+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T20:57:49.399287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-07-25T14:37:45.212038+0000","last_change":"2023-07-25T14:37:45.204504+0000","last_active":"2023-07-25T14:37:45.212038+0000","last_peered":"2023-07-25T14:37:45.212038+0000","last_clean":"2023-07-25T14:37:45.212038+0000","last_became_active":"2023-07-25T14:37:45.203141+0000","last_became_peered":"2023-07-25T14:37:45.203141+0000","last_unstale":"2023-07-25T14:37:45.212038+0000","last_undegraded":"2023-07-25T14:37:45.212038+0000","last_fullsized":"2023-07-25T14:37:45.212038+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T20:10:51.069463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"56'2","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-07-25T14:37:45.214845+0000","last_change":"2023-07-25T14:37:44.167404+0000","last_active":"2023-07-25T14:37:45.214845+0000","last_peered":"2023-07-25T14:37:45.214845+0000","last_clean":"2023-07-25T14:37:45.214845+0000","last_became_active":"2023-07-25T14:37:44.167157+0000","last_became_peered":"2023-07-25T14:37:44.167157+0000","last_unstale":"2023-07-25T14:37:45.214845+0000","last_undegraded":"2023-07-25T14:37:45.214845+0000","last_fullsized":"2023-07-25T14:37:45.214845+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T18:56:55.544261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-25T14:37:46.194448+0000","last_change":"2023-07-25T14:37:45.192672+0000","last_active":"2023-07-25T14:37:46.194448+0000","last_peered":"2023-07-25T14:37:46.194448+0000","last_clean":"2023-07-25T14:37:46.194448+0000","last_became_active":"2023-07-25T14:37:45.192426+0000","last_became_peered":"2023-07-25T14:37:45.192426+0000","last_unstale":"2023-07-25T14:37:46.194448+0000","last_undegraded":"2023-07-25T14:37:46.194448+0000","last_fullsized":"2023-07-25T14:37:46.194448+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:11:12.088493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"56'1","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-25T14:37:46.193238+0000","last_change":"2023-07-25T14:37:44.165894+0000","last_active":"2023-07-25T14:37:46.193238+0000","last_peered":"2023-07-25T14:37:46.193238+0000","last_clean":"2023-07-25T14:37:46.193238+0000","last_became_active":"2023-07-25T14:37:44.165121+0000","last_became_peered":"2023-07-25T14:37:44.165121+0000","last_unstale":"2023-07-25T14:37:46.193238+0000","last_undegraded":"2023-07-25T14:37:46.193238+0000","last_fullsized":"2023-07-25T14:37:46.193238+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T17:17:04.204095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-07-25T14:37:45.211059+0000","last_change":"2023-07-25T14:37:45.204924+0000","last_active":"2023-07-25T14:37:45.211059+0000","last_peered":"2023-07-25T14:37:45.211059+0000","last_clean":"2023-07-25T14:37:45.211059+0000","last_became_active":"2023-07-25T14:37:45.204636+0000","last_became_peered":"2023-07-25T14:37:45.204636+0000","last_unstale":"2023-07-25T14:37:45.211059+0000","last_undegraded":"2023-07-25T14:37:45.211059+0000","last_fullsized":"2023-07-25T14:37:45.211059+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T19:19:00.222021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"56'1","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-07-25T14:37:45.212469+0000","last_change":"2023-07-25T14:37:44.165997+0000","last_active":"2023-07-25T14:37:45.212469+0000","last_peered":"2023-07-25T14:37:45.212469+0000","last_clean":"2023-07-25T14:37:45.212469+0000","last_became_active":"2023-07-25T14:37:44.165724+0000","last_became_peered":"2023-07-25T14:37:44.165724+0000","last_unstale":"2023-07-25T14:37:45.212469+0000","last_undegraded":"2023-07-25T14:37:45.212469+0000","last_fullsized":"2023-07-25T14:37:45.212469+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T01:41:29.372296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-07-25T14:37:45.204614+0000","last_change":"2023-07-25T14:37:45.200734+0000","last_active":"2023-07-25T14:37:45.204614+0000","last_peered":"2023-07-25T14:37:45.204614+0000","last_clean":"2023-07-25T14:37:45.204614+0000","last_became_active":"2023-07-25T14:37:45.200452+0000","last_became_peered":"2023-07-25T14:37:45.200452+0000","last_unstale":"2023-07-25T14:37:45.204614+0000","last_undegraded":"2023-07-25T14:37:45.204614+0000","last_fullsized":"2023-07-25T14:37:45.204614+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T20:08:05.454710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-25T14:37:46.194389+0000","last_change":"2023-07-25T14:37:44.163784+0000","last_active":"2023-07-25T14:37:46.194389+0000","last_peered":"2023-07-25T14:37:46.194389+0000","last_clean":"2023-07-25T14:37:46.194389+0000","last_became_active":"2023-07-25T14:37:44.163566+0000","last_became_peered":"2023-07-25T14:37:44.163566+0000","last_unstale":"2023-07-25T14:37:46.194389+0000","last_undegraded":"2023-07-25T14:37:46.194389+0000","last_fullsized":"2023-07-25T14:37:46.194389+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T19:51:04.703988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-07-25T14:37:45.206013+0000","last_change":"2023-07-25T14:37:45.205124+0000","last_active":"2023-07-25T14:37:45.206013+0000","last_peered":"2023-07-25T14:37:45.206013+0000","last_clean":"2023-07-25T14:37:45.206013+0000","last_became_active":"2023-07-25T14:37:45.204730+0000","last_became_peered":"2023-07-25T14:37:45.204730+0000","last_unstale":"2023-07-25T14:37:45.206013+0000","last_undegraded":"2023-07-25T14:37:45.206013+0000","last_fullsized":"2023-07-25T14:37:45.206013+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T14:59:46.990745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-07-25T14:37:45.182506+0000","last_change":"2023-07-25T14:37:44.171926+0000","last_active":"2023-07-25T14:37:45.182506+0000","last_peered":"2023-07-25T14:37:45.182506+0000","last_clean":"2023-07-25T14:37:45.182506+0000","last_became_active":"2023-07-25T14:37:44.171610+0000","last_became_peered":"2023-07-25T14:37:44.171610+0000","last_unstale":"2023-07-25T14:37:45.182506+0000","last_undegraded":"2023-07-25T14:37:45.182506+0000","last_fullsized":"2023-07-25T14:37:45.182506+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T21:45:13.571992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-25T14:37:46.194925+0000","last_change":"2023-07-25T14:37:45.208126+0000","last_active":"2023-07-25T14:37:46.194925+0000","last_peered":"2023-07-25T14:37:46.194925+0000","last_clean":"2023-07-25T14:37:46.194925+0000","last_became_active":"2023-07-25T14:37:45.207856+0000","last_became_peered":"2023-07-25T14:37:45.207856+0000","last_unstale":"2023-07-25T14:37:46.194925+0000","last_undegraded":"2023-07-25T14:37:46.194925+0000","last_fullsized":"2023-07-25T14:37:46.194925+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T15:53:04.508285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-07-25T14:37:45.189522+0000","last_change":"2023-07-25T14:37:44.164773+0000","last_active":"2023-07-25T14:37:45.189522+0000","last_peered":"2023-07-25T14:37:45.189522+0000","last_clean":"2023-07-25T14:37:45.189522+0000","last_became_active":"2023-07-25T14:37:44.164480+0000","last_became_peered":"2023-07-25T14:37:44.164480+0000","last_unstale":"2023-07-25T14:37:45.189522+0000","last_undegraded":"2023-07-25T14:37:45.189522+0000","last_fullsized":"2023-07-25T14:37:45.189522+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T17:56:58.870648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-07-25T14:37:45.203997+0000","last_change":"2023-07-25T14:37:45.196449+0000","last_active":"2023-07-25T14:37:45.203997+0000","last_peered":"2023-07-25T14:37:45.203997+0000","last_clean":"2023-07-25T14:37:45.203997+0000","last_became_active":"2023-07-25T14:37:45.196172+0000","last_became_peered":"2023-07-25T14:37:45.196172+0000","last_unstale":"2023-07-25T14:37:45.203997+0000","last_undegraded":"2023-07-25T14:37:45.203997+0000","last_fullsized":"2023-07-25T14:37:45.203997+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:59:02.205817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-07-25T14:37:45.181583+0000","last_change":"2023-07-25T14:37:44.162751+0000","last_active":"2023-07-25T14:37:45.181583+0000","last_peered":"2023-07-25T14:37:45.181583+0000","last_clean":"2023-07-25T14:37:45.181583+0000","last_became_active":"2023-07-25T14:37:44.162037+0000","last_became_peered":"2023-07-25T14:37:44.162037+0000","last_unstale":"2023-07-25T14:37:45.181583+0000","last_undegraded":"2023-07-25T14:37:45.181583+0000","last_fullsized":"2023-07-25T14:37:45.181583+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T18:48:45.781579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-07-25T14:37:45.214431+0000","last_change":"2023-07-25T14:37:45.206751+0000","last_active":"2023-07-25T14:37:45.214431+0000","last_peered":"2023-07-25T14:37:45.214431+0000","last_clean":"2023-07-25T14:37:45.214431+0000","last_became_active":"2023-07-25T14:37:45.206422+0000","last_became_peered":"2023-07-25T14:37:45.206422+0000","last_unstale":"2023-07-25T14:37:45.214431+0000","last_undegraded":"2023-07-25T14:37:45.214431+0000","last_fullsized":"2023-07-25T14:37:45.214431+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T23:32:22.668719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"56'3","reported_seq":16,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-25T14:37:46.193503+0000","last_change":"2023-07-25T14:37:44.161397+0000","last_active":"2023-07-25T14:37:46.193503+0000","last_peered":"2023-07-25T14:37:46.193503+0000","last_clean":"2023-07-25T14:37:46.193503+0000","last_became_active":"2023-07-25T14:37:44.161134+0000","last_became_peered":"2023-07-25T14:37:44.161134+0000","last_unstale":"2023-07-25T14:37:46.193503+0000","last_undegraded":"2023-07-25T14:37:46.193503+0000","last_fullsized":"2023-07-25T14:37:46.193503+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T18:45:35.063301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-07-25T14:37:45.204652+0000","last_change":"2023-07-25T14:37:45.199815+0000","last_active":"2023-07-25T14:37:45.204652+0000","last_peered":"2023-07-25T14:37:45.204652+0000","last_clean":"2023-07-25T14:37:45.204652+0000","last_became_active":"2023-07-25T14:37:45.199555+0000","last_became_peered":"2023-07-25T14:37:45.199555+0000","last_unstale":"2023-07-25T14:37:45.204652+0000","last_undegraded":"2023-07-25T14:37:45.204652+0000","last_fullsized":"2023-07-25T14:37:45.204652+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T21:40:43.802154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"56'6","reported_seq":19,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-25T14:37:46.194783+0000","last_change":"2023-07-25T14:37:44.173212+0000","last_active":"2023-07-25T14:37:46.194783+0000","last_peered":"2023-07-25T14:37:46.194783+0000","last_clean":"2023-07-25T14:37:46.194783+0000","last_became_active":"2023-07-25T14:37:44.172950+0000","last_became_peered":"2023-07-25T14:37:44.172950+0000","last_unstale":"2023-07-25T14:37:46.194783+0000","last_undegraded":"2023-07-25T14:37:46.194783+0000","last_fullsized":"2023-07-25T14:37:46.194783+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T15:10:32.966409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-07-25T14:37:45.211646+0000","last_change":"2023-07-25T14:37:45.203546+0000","last_active":"2023-07-25T14:37:45.211646+0000","last_peered":"2023-07-25T14:37:45.211646+0000","last_clean":"2023-07-25T14:37:45.211646+0000","last_became_active":"2023-07-25T14:37:45.203115+0000","last_became_peered":"2023-07-25T14:37:45.203115+0000","last_unstale":"2023-07-25T14:37:45.211646+0000","last_undegraded":"2023-07-25T14:37:45.211646+0000","last_fullsized":"2023-07-25T14:37:45.211646+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T19:31:09.394550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"56'2","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-25T14:37:46.194736+0000","last_change":"2023-07-25T14:37:44.164563+0000","last_active":"2023-07-25T14:37:46.194736+0000","last_peered":"2023-07-25T14:37:46.194736+0000","last_clean":"2023-07-25T14:37:46.194736+0000","last_became_active":"2023-07-25T14:37:44.164255+0000","last_became_peered":"2023-07-25T14:37:44.164255+0000","last_unstale":"2023-07-25T14:37:46.194736+0000","last_undegraded":"2023-07-25T14:37:46.194736+0000","last_fullsized":"2023-07-25T14:37:46.194736+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T02:17:19.154863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-25T14:37:46.194542+0000","last_change":"2023-07-25T14:37:45.201081+0000","last_active":"2023-07-25T14:37:46.194542+0000","last_peered":"2023-07-25T14:37:46.194542+0000","last_clean":"2023-07-25T14:37:46.194542+0000","last_became_active":"2023-07-25T14:37:45.200738+0000","last_became_peered":"2023-07-25T14:37:45.200738+0000","last_unstale":"2023-07-25T14:37:46.194542+0000","last_undegraded":"2023-07-25T14:37:46.194542+0000","last_fullsized":"2023-07-25T14:37:46.194542+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T23:49:32.119140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-07-25T14:37:45.184766+0000","last_change":"2023-07-25T14:37:44.173296+0000","last_active":"2023-07-25T14:37:45.184766+0000","last_peered":"2023-07-25T14:37:45.184766+0000","last_clean":"2023-07-25T14:37:45.184766+0000","last_became_active":"2023-07-25T14:37:44.172957+0000","last_became_peered":"2023-07-25T14:37:44.172957+0000","last_unstale":"2023-07-25T14:37:45.184766+0000","last_undegraded":"2023-07-25T14:37:45.184766+0000","last_fullsized":"2023-07-25T14:37:45.184766+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T02:13:31.491403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-07-25T14:37:45.200512+0000","last_change":"2023-07-25T14:37:45.195068+0000","last_active":"2023-07-25T14:37:45.200512+0000","last_peered":"2023-07-25T14:37:45.200512+0000","last_clean":"2023-07-25T14:37:45.200512+0000","last_became_active":"2023-07-25T14:37:45.194820+0000","last_became_peered":"2023-07-25T14:37:45.194820+0000","last_unstale":"2023-07-25T14:37:45.200512+0000","last_undegraded":"2023-07-25T14:37:45.200512+0000","last_fullsized":"2023-07-25T14:37:45.200512+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T16:00:47.353753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-25T14:37:46.194412+0000","last_change":"2023-07-25T14:37:44.166150+0000","last_active":"2023-07-25T14:37:46.194412+0000","last_peered":"2023-07-25T14:37:46.194412+0000","last_clean":"2023-07-25T14:37:46.194412+0000","last_became_active":"2023-07-25T14:37:44.165851+0000","last_became_peered":"2023-07-25T14:37:44.165851+0000","last_unstale":"2023-07-25T14:37:46.194412+0000","last_undegraded":"2023-07-25T14:37:46.194412+0000","last_fullsized":"2023-07-25T14:37:46.194412+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T22:41:47.199010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-07-25T14:37:45.197026+0000","last_change":"2023-07-25T14:37:45.193890+0000","last_active":"2023-07-25T14:37:45.197026+0000","last_peered":"2023-07-25T14:37:45.197026+0000","last_clean":"2023-07-25T14:37:45.197026+0000","last_became_active":"2023-07-25T14:37:45.193634+0000","last_became_peered":"2023-07-25T14:37:45.193634+0000","last_unstale":"2023-07-25T14:37:45.197026+0000","last_undegraded":"2023-07-25T14:37:45.197026+0000","last_fullsized":"2023-07-25T14:37:45.197026+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:46:08.647591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"56'8","reported_seq":19,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-07-25T14:37:45.212342+0000","last_change":"2023-07-25T14:37:44.164996+0000","last_active":"2023-07-25T14:37:45.212342+0000","last_peered":"2023-07-25T14:37:45.212342+0000","last_clean":"2023-07-25T14:37:45.212342+0000","last_became_active":"2023-07-25T14:37:44.164753+0000","last_became_peered":"2023-07-25T14:37:44.164753+0000","last_unstale":"2023-07-25T14:37:45.212342+0000","last_undegraded":"2023-07-25T14:37:45.212342+0000","last_fullsized":"2023-07-25T14:37:45.212342+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T15:59:02.577424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-07-25T14:37:45.199560+0000","last_change":"2023-07-25T14:37:45.192838+0000","last_active":"2023-07-25T14:37:45.199560+0000","last_peered":"2023-07-25T14:37:45.199560+0000","last_clean":"2023-07-25T14:37:45.199560+0000","last_became_active":"2023-07-25T14:37:45.192552+0000","last_became_peered":"2023-07-25T14:37:45.192552+0000","last_unstale":"2023-07-25T14:37:45.199560+0000","last_undegraded":"2023-07-25T14:37:45.199560+0000","last_fullsized":"2023-07-25T14:37:45.199560+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T02:34:56.357570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"56'2","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-07-25T14:37:45.214496+0000","last_change":"2023-07-25T14:37:44.163016+0000","last_active":"2023-07-25T14:37:45.214496+0000","last_peered":"2023-07-25T14:37:45.214496+0000","last_clean":"2023-07-25T14:37:45.214496+0000","last_became_active":"2023-07-25T14:37:44.161974+0000","last_became_peered":"2023-07-25T14:37:44.161974+0000","last_unstale":"2023-07-25T14:37:45.214496+0000","last_undegraded":"2023-07-25T14:37:45.214496+0000","last_fullsized":"2023-07-25T14:37:45.214496+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T15:03:37.728247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-25T14:37:46.194637+0000","last_change":"2023-07-25T14:37:45.198281+0000","last_active":"2023-07-25T14:37:46.194637+0000","last_peered":"2023-07-25T14:37:46.194637+0000","last_clean":"2023-07-25T14:37:46.194637+0000","last_became_active":"2023-07-25T14:37:45.197975+0000","last_became_peered":"2023-07-25T14:37:45.197975+0000","last_unstale":"2023-07-25T14:37:46.194637+0000","last_undegraded":"2023-07-25T14:37:46.194637+0000","last_fullsized":"2023-07-25T14:37:46.194637+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T21:35:18.900476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-25T14:37:46.195047+0000","last_change":"2023-07-25T14:37:44.166254+0000","last_active":"2023-07-25T14:37:46.195047+0000","last_peered":"2023-07-25T14:37:46.195047+0000","last_clean":"2023-07-25T14:37:46.195047+0000","last_became_active":"2023-07-25T14:37:44.165974+0000","last_became_peered":"2023-07-25T14:37:44.165974+0000","last_unstale":"2023-07-25T14:37:46.195047+0000","last_undegraded":"2023-07-25T14:37:46.195047+0000","last_fullsized":"2023-07-25T14:37:46.195047+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:39:29.780742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-07-25T14:37:45.212947+0000","last_change":"2023-07-25T14:37:45.209704+0000","last_active":"2023-07-25T14:37:45.212947+0000","last_peered":"2023-07-25T14:37:45.212947+0000","last_clean":"2023-07-25T14:37:45.212947+0000","last_became_active":"2023-07-25T14:37:45.209391+0000","last_became_peered":"2023-07-25T14:37:45.209391+0000","last_unstale":"2023-07-25T14:37:45.212947+0000","last_undegraded":"2023-07-25T14:37:45.212947+0000","last_fullsized":"2023-07-25T14:37:45.212947+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T01:47:30.829451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-07-25T14:37:45.182024+0000","last_change":"2023-07-25T14:37:44.166101+0000","last_active":"2023-07-25T14:37:45.182024+0000","last_peered":"2023-07-25T14:37:45.182024+0000","last_clean":"2023-07-25T14:37:45.182024+0000","last_became_active":"2023-07-25T14:37:44.165823+0000","last_became_peered":"2023-07-25T14:37:44.165823+0000","last_unstale":"2023-07-25T14:37:45.182024+0000","last_undegraded":"2023-07-25T14:37:45.182024+0000","last_fullsized":"2023-07-25T14:37:45.182024+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T01:57:00.819850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-07-25T14:37:45.212408+0000","last_change":"2023-07-25T14:37:45.207757+0000","last_active":"2023-07-25T14:37:45.212408+0000","last_peered":"2023-07-25T14:37:45.212408+0000","last_clean":"2023-07-25T14:37:45.212408+0000","last_became_active":"2023-07-25T14:37:45.204097+0000","last_became_peered":"2023-07-25T14:37:45.204097+0000","last_unstale":"2023-07-25T14:37:45.212408+0000","last_undegraded":"2023-07-25T14:37:45.212408+0000","last_fullsized":"2023-07-25T14:37:45.212408+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T01:27:38.547525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-07-25T14:37:45.182160+0000","last_change":"2023-07-25T14:37:44.170019+0000","last_active":"2023-07-25T14:37:45.182160+0000","last_peered":"2023-07-25T14:37:45.182160+0000","last_clean":"2023-07-25T14:37:45.182160+0000","last_became_active":"2023-07-25T14:37:44.169764+0000","last_became_peered":"2023-07-25T14:37:44.169764+0000","last_unstale":"2023-07-25T14:37:45.182160+0000","last_undegraded":"2023-07-25T14:37:45.182160+0000","last_fullsized":"2023-07-25T14:37:45.182160+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T18:16:16.739665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-07-25T14:37:45.196996+0000","last_change":"2023-07-25T14:37:45.192706+0000","last_active":"2023-07-25T14:37:45.196996+0000","last_peered":"2023-07-25T14:37:45.196996+0000","last_clean":"2023-07-25T14:37:45.196996+0000","last_became_active":"2023-07-25T14:37:45.191283+0000","last_became_peered":"2023-07-25T14:37:45.191283+0000","last_unstale":"2023-07-25T14:37:45.196996+0000","last_undegraded":"2023-07-25T14:37:45.196996+0000","last_fullsized":"2023-07-25T14:37:45.196996+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T18:40:52.285929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-07-25T14:37:45.181839+0000","last_change":"2023-07-25T14:37:44.171694+0000","last_active":"2023-07-25T14:37:45.181839+0000","last_peered":"2023-07-25T14:37:45.181839+0000","last_clean":"2023-07-25T14:37:45.181839+0000","last_became_active":"2023-07-25T14:37:44.171465+0000","last_became_peered":"2023-07-25T14:37:44.171465+0000","last_unstale":"2023-07-25T14:37:45.181839+0000","last_undegraded":"2023-07-25T14:37:45.181839+0000","last_fullsized":"2023-07-25T14:37:45.181839+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T01:50:20.811880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-07-25T14:37:45.214855+0000","last_change":"2023-07-25T14:37:45.208487+0000","last_active":"2023-07-25T14:37:45.214855+0000","last_peered":"2023-07-25T14:37:45.214855+0000","last_clean":"2023-07-25T14:37:45.214855+0000","last_became_active":"2023-07-25T14:37:45.207037+0000","last_became_peered":"2023-07-25T14:37:45.207037+0000","last_unstale":"2023-07-25T14:37:45.214855+0000","last_undegraded":"2023-07-25T14:37:45.214855+0000","last_fullsized":"2023-07-25T14:37:45.214855+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T02:27:18.369690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-25T14:37:46.194444+0000","last_change":"2023-07-25T14:37:44.165012+0000","last_active":"2023-07-25T14:37:46.194444+0000","last_peered":"2023-07-25T14:37:46.194444+0000","last_clean":"2023-07-25T14:37:46.194444+0000","last_became_active":"2023-07-25T14:37:44.164759+0000","last_became_peered":"2023-07-25T14:37:44.164759+0000","last_unstale":"2023-07-25T14:37:46.194444+0000","last_undegraded":"2023-07-25T14:37:46.194444+0000","last_fullsized":"2023-07-25T14:37:46.194444+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T18:31:17.913112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-25T14:37:46.194715+0000","last_change":"2023-07-25T14:37:45.191681+0000","last_active":"2023-07-25T14:37:46.194715+0000","last_peered":"2023-07-25T14:37:46.194715+0000","last_clean":"2023-07-25T14:37:46.194715+0000","last_became_active":"2023-07-25T14:37:45.188974+0000","last_became_peered":"2023-07-25T14:37:45.188974+0000","last_unstale":"2023-07-25T14:37:46.194715+0000","last_undegraded":"2023-07-25T14:37:46.194715+0000","last_fullsized":"2023-07-25T14:37:46.194715+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T15:58:36.814288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-07-25T14:37:45.189040+0000","last_change":"2023-07-25T14:37:44.164983+0000","last_active":"2023-07-25T14:37:45.189040+0000","last_peered":"2023-07-25T14:37:45.189040+0000","last_clean":"2023-07-25T14:37:45.189040+0000","last_became_active":"2023-07-25T14:37:44.164413+0000","last_became_peered":"2023-07-25T14:37:44.164413+0000","last_unstale":"2023-07-25T14:37:45.189040+0000","last_undegraded":"2023-07-25T14:37:45.189040+0000","last_fullsized":"2023-07-25T14:37:45.189040+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T16:46:50.016770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-07-25T14:37:45.205973+0000","last_change":"2023-07-25T14:37:45.192970+0000","last_active":"2023-07-25T14:37:45.205973+0000","last_peered":"2023-07-25T14:37:45.205973+0000","last_clean":"2023-07-25T14:37:45.205973+0000","last_became_active":"2023-07-25T14:37:45.192666+0000","last_became_peered":"2023-07-25T14:37:45.192666+0000","last_unstale":"2023-07-25T14:37:45.205973+0000","last_undegraded":"2023-07-25T14:37:45.205973+0000","last_fullsized":"2023-07-25T14:37:45.205973+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T20:26:22.473303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-07-25T14:37:45.185698+0000","last_change":"2023-07-25T14:37:44.168526+0000","last_active":"2023-07-25T14:37:45.185698+0000","last_peered":"2023-07-25T14:37:45.185698+0000","last_clean":"2023-07-25T14:37:45.185698+0000","last_became_active":"2023-07-25T14:37:44.168336+0000","last_became_peered":"2023-07-25T14:37:44.168336+0000","last_unstale":"2023-07-25T14:37:45.185698+0000","last_undegraded":"2023-07-25T14:37:45.185698+0000","last_fullsized":"2023-07-25T14:37:45.185698+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T20:47:12.483369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-07-25T14:37:45.204892+0000","last_change":"2023-07-25T14:37:45.202784+0000","last_active":"2023-07-25T14:37:45.204892+0000","last_peered":"2023-07-25T14:37:45.204892+0000","last_clean":"2023-07-25T14:37:45.204892+0000","last_became_active":"2023-07-25T14:37:45.202515+0000","last_became_peered":"2023-07-25T14:37:45.202515+0000","last_unstale":"2023-07-25T14:37:45.204892+0000","last_undegraded":"2023-07-25T14:37:45.204892+0000","last_fullsized":"2023-07-25T14:37:45.204892+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T16:50:40.287491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-07-25T14:37:45.192206+0000","last_change":"2023-07-25T14:37:44.170162+0000","last_active":"2023-07-25T14:37:45.192206+0000","last_peered":"2023-07-25T14:37:45.192206+0000","last_clean":"2023-07-25T14:37:45.192206+0000","last_became_active":"2023-07-25T14:37:44.169805+0000","last_became_peered":"2023-07-25T14:37:44.169805+0000","last_unstale":"2023-07-25T14:37:45.192206+0000","last_undegraded":"2023-07-25T14:37:45.192206+0000","last_fullsized":"2023-07-25T14:37:45.192206+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T23:12:54.258226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":82,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-07-25T14:37:45.182286+0000","last_change":"2023-07-25T14:35:34.370772+0000","last_active":"2023-07-25T14:37:45.182286+0000","last_peered":"2023-07-25T14:37:45.182286+0000","last_clean":"2023-07-25T14:37:45.182286+0000","last_became_active":"2023-07-25T14:35:34.370549+0000","last_became_peered":"2023-07-25T14:35:34.370549+0000","last_unstale":"2023-07-25T14:37:45.182286+0000","last_undegraded":"2023-07-25T14:37:45.182286+0000","last_fullsized":"2023-07-25T14:37:45.182286+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_clean_scrub_stamp":"2023-07-25T14:35:33.358525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T15:05:35.187618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-25T14:37:46.194747+0000","last_change":"2023-07-25T14:37:45.194744+0000","last_active":"2023-07-25T14:37:46.194747+0000","last_peered":"2023-07-25T14:37:46.194747+0000","last_clean":"2023-07-25T14:37:46.194747+0000","last_became_active":"2023-07-25T14:37:45.194393+0000","last_became_peered":"2023-07-25T14:37:45.194393+0000","last_unstale":"2023-07-25T14:37:46.194747+0000","last_undegraded":"2023-07-25T14:37:46.194747+0000","last_fullsized":"2023-07-25T14:37:46.194747+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:38:23.175060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"56'1","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-07-25T14:37:45.214855+0000","last_change":"2023-07-25T14:37:44.166450+0000","last_active":"2023-07-25T14:37:45.214855+0000","last_peered":"2023-07-25T14:37:45.214855+0000","last_clean":"2023-07-25T14:37:45.214855+0000","last_became_active":"2023-07-25T14:37:44.165513+0000","last_became_peered":"2023-07-25T14:37:44.165513+0000","last_unstale":"2023-07-25T14:37:45.214855+0000","last_undegraded":"2023-07-25T14:37:45.214855+0000","last_fullsized":"2023-07-25T14:37:45.214855+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T01:29:48.397100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":82,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-07-25T14:37:45.181223+0000","last_change":"2023-07-25T14:35:35.321055+0000","last_active":"2023-07-25T14:37:45.181223+0000","last_peered":"2023-07-25T14:37:45.181223+0000","last_clean":"2023-07-25T14:37:45.181223+0000","last_became_active":"2023-07-25T14:35:35.320739+0000","last_became_peered":"2023-07-25T14:35:35.320739+0000","last_unstale":"2023-07-25T14:37:45.181223+0000","last_undegraded":"2023-07-25T14:37:45.181223+0000","last_fullsized":"2023-07-25T14:37:45.181223+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_clean_scrub_stamp":"2023-07-25T14:35:33.358525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:46:08.478701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-25T14:37:46.193182+0000","last_change":"2023-07-25T14:37:45.197932+0000","last_active":"2023-07-25T14:37:46.193182+0000","last_peered":"2023-07-25T14:37:46.193182+0000","last_clean":"2023-07-25T14:37:46.193182+0000","last_became_active":"2023-07-25T14:37:45.197610+0000","last_became_peered":"2023-07-25T14:37:45.197610+0000","last_unstale":"2023-07-25T14:37:46.193182+0000","last_undegraded":"2023-07-25T14:37:46.193182+0000","last_fullsized":"2023-07-25T14:37:46.193182+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T23:27:34.225061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-07-25T14:37:45.184900+0000","last_change":"2023-07-25T14:37:44.166137+0000","last_active":"2023-07-25T14:37:45.184900+0000","last_peered":"2023-07-25T14:37:45.184900+0000","last_clean":"2023-07-25T14:37:45.184900+0000","last_became_active":"2023-07-25T14:37:44.165836+0000","last_became_peered":"2023-07-25T14:37:44.165836+0000","last_unstale":"2023-07-25T14:37:45.184900+0000","last_undegraded":"2023-07-25T14:37:45.184900+0000","last_fullsized":"2023-07-25T14:37:45.184900+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T21:37:27.151589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":92,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-25T14:37:46.195053+0000","last_change":"2023-07-25T14:35:35.321057+0000","last_active":"2023-07-25T14:37:46.195053+0000","last_peered":"2023-07-25T14:37:46.195053+0000","last_clean":"2023-07-25T14:37:46.195053+0000","last_became_active":"2023-07-25T14:35:35.320751+0000","last_became_peered":"2023-07-25T14:35:35.320751+0000","last_unstale":"2023-07-25T14:37:46.195053+0000","last_undegraded":"2023-07-25T14:37:46.195053+0000","last_fullsized":"2023-07-25T14:37:46.195053+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_clean_scrub_stamp":"2023-07-25T14:35:33.358525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T19:16:45.350885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-25T14:37:46.193205+0000","last_change":"2023-07-25T14:37:45.195875+0000","last_active":"2023-07-25T14:37:46.193205+0000","last_peered":"2023-07-25T14:37:46.193205+0000","last_clean":"2023-07-25T14:37:46.193205+0000","last_became_active":"2023-07-25T14:37:45.195516+0000","last_became_peered":"2023-07-25T14:37:45.195516+0000","last_unstale":"2023-07-25T14:37:46.193205+0000","last_undegraded":"2023-07-25T14:37:46.193205+0000","last_fullsized":"2023-07-25T14:37:46.193205+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T20:02:34.031523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"56'2","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-07-25T14:37:45.208861+0000","last_change":"2023-07-25T14:37:44.167253+0000","last_active":"2023-07-25T14:37:45.208861+0000","last_peered":"2023-07-25T14:37:45.208861+0000","last_clean":"2023-07-25T14:37:45.208861+0000","last_became_active":"2023-07-25T14:37:44.166775+0000","last_became_peered":"2023-07-25T14:37:44.166775+0000","last_unstale":"2023-07-25T14:37:45.208861+0000","last_undegraded":"2023-07-25T14:37:45.208861+0000","last_fullsized":"2023-07-25T14:37:45.208861+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T20:58:06.557150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":82,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-07-25T14:37:45.186603+0000","last_change":"2023-07-25T14:35:35.321201+0000","last_active":"2023-07-25T14:37:45.186603+0000","last_peered":"2023-07-25T14:37:45.186603+0000","last_clean":"2023-07-25T14:37:45.186603+0000","last_became_active":"2023-07-25T14:35:35.320728+0000","last_became_peered":"2023-07-25T14:35:35.320728+0000","last_unstale":"2023-07-25T14:37:45.186603+0000","last_undegraded":"2023-07-25T14:37:45.186603+0000","last_fullsized":"2023-07-25T14:37:45.186603+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_clean_scrub_stamp":"2023-07-25T14:35:33.358525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:39:58.844073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-25T14:37:46.193266+0000","last_change":"2023-07-25T14:37:45.209554+0000","last_active":"2023-07-25T14:37:46.193266+0000","last_peered":"2023-07-25T14:37:46.193266+0000","last_clean":"2023-07-25T14:37:46.193266+0000","last_became_active":"2023-07-25T14:37:45.209319+0000","last_became_peered":"2023-07-25T14:37:45.209319+0000","last_unstale":"2023-07-25T14:37:46.193266+0000","last_undegraded":"2023-07-25T14:37:46.193266+0000","last_fullsized":"2023-07-25T14:37:46.193266+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T17:58:09.953558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-25T14:37:46.195267+0000","last_change":"2023-07-25T14:37:44.172803+0000","last_active":"2023-07-25T14:37:46.195267+0000","last_peered":"2023-07-25T14:37:46.195267+0000","last_clean":"2023-07-25T14:37:46.195267+0000","last_became_active":"2023-07-25T14:37:44.172512+0000","last_became_peered":"2023-07-25T14:37:44.172512+0000","last_unstale":"2023-07-25T14:37:46.195267+0000","last_undegraded":"2023-07-25T14:37:46.195267+0000","last_fullsized":"2023-07-25T14:37:46.195267+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T23:11:40.579145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":82,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-07-25T14:37:45.192057+0000","last_change":"2023-07-25T14:35:35.321448+0000","last_active":"2023-07-25T14:37:45.192057+0000","last_peered":"2023-07-25T14:37:45.192057+0000","last_clean":"2023-07-25T14:37:45.192057+0000","last_became_active":"2023-07-25T14:35:35.320830+0000","last_became_peered":"2023-07-25T14:35:35.320830+0000","last_unstale":"2023-07-25T14:37:45.192057+0000","last_undegraded":"2023-07-25T14:37:45.192057+0000","last_fullsized":"2023-07-25T14:37:45.192057+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_clean_scrub_stamp":"2023-07-25T14:35:33.358525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T20:35:58.782356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-25T14:37:46.193206+0000","last_change":"2023-07-25T14:37:45.207283+0000","last_active":"2023-07-25T14:37:46.193206+0000","last_peered":"2023-07-25T14:37:46.193206+0000","last_clean":"2023-07-25T14:37:46.193206+0000","last_became_active":"2023-07-25T14:37:45.206954+0000","last_became_peered":"2023-07-25T14:37:45.206954+0000","last_unstale":"2023-07-25T14:37:46.193206+0000","last_undegraded":"2023-07-25T14:37:46.193206+0000","last_fullsized":"2023-07-25T14:37:46.193206+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T15:01:23.982072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-07-25T14:37:45.184370+0000","last_change":"2023-07-25T14:37:44.172365+0000","last_active":"2023-07-25T14:37:45.184370+0000","last_peered":"2023-07-25T14:37:45.184370+0000","last_clean":"2023-07-25T14:37:45.184370+0000","last_became_active":"2023-07-25T14:37:44.172127+0000","last_became_peered":"2023-07-25T14:37:44.172127+0000","last_unstale":"2023-07-25T14:37:45.184370+0000","last_undegraded":"2023-07-25T14:37:45.184370+0000","last_fullsized":"2023-07-25T14:37:45.184370+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:42:08.629066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":232,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-07-25T14:37:45.186468+0000","last_change":"2023-07-25T14:35:34.372381+0000","last_active":"2023-07-25T14:37:45.186468+0000","last_peered":"2023-07-25T14:37:45.186468+0000","last_clean":"2023-07-25T14:37:45.186468+0000","last_became_active":"2023-07-25T14:35:34.371110+0000","last_became_peered":"2023-07-25T14:35:34.371110+0000","last_unstale":"2023-07-25T14:37:45.186468+0000","last_undegraded":"2023-07-25T14:37:45.186468+0000","last_fullsized":"2023-07-25T14:37:45.186468+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_clean_scrub_stamp":"2023-07-25T14:35:33.358525+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T15:58:36.567145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":82,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-25T14:37:46.194610+0000","last_change":"2023-07-25T14:35:34.370121+0000","last_active":"2023-07-25T14:37:46.194610+0000","last_peered":"2023-07-25T14:37:46.194610+0000","last_clean":"2023-07-25T14:37:46.194610+0000","last_became_active":"2023-07-25T14:35:34.369795+0000","last_became_peered":"2023-07-25T14:35:34.369795+0000","last_unstale":"2023-07-25T14:37:46.194610+0000","last_undegraded":"2023-07-25T14:37:46.194610+0000","last_fullsized":"2023-07-25T14:37:46.194610+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_clean_scrub_stamp":"2023-07-25T14:35:33.358525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:09:02.653517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-07-25T14:37:45.210773+0000","last_change":"2023-07-25T14:37:45.204523+0000","last_active":"2023-07-25T14:37:45.210773+0000","last_peered":"2023-07-25T14:37:45.210773+0000","last_clean":"2023-07-25T14:37:45.210773+0000","last_became_active":"2023-07-25T14:37:45.204095+0000","last_became_peered":"2023-07-25T14:37:45.204095+0000","last_unstale":"2023-07-25T14:37:45.210773+0000","last_undegraded":"2023-07-25T14:37:45.210773+0000","last_fullsized":"2023-07-25T14:37:45.210773+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T01:27:38.547525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"56'1","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-07-25T14:37:45.208742+0000","last_change":"2023-07-25T14:37:44.164092+0000","last_active":"2023-07-25T14:37:45.208742+0000","last_peered":"2023-07-25T14:37:45.208742+0000","last_clean":"2023-07-25T14:37:45.208742+0000","last_became_active":"2023-07-25T14:37:44.163068+0000","last_became_peered":"2023-07-25T14:37:44.163068+0000","last_unstale":"2023-07-25T14:37:45.208742+0000","last_undegraded":"2023-07-25T14:37:45.208742+0000","last_fullsized":"2023-07-25T14:37:45.208742+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T01:56:18.402880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":84,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-25T14:37:46.193085+0000","last_change":"2023-07-25T14:35:34.371737+0000","last_active":"2023-07-25T14:37:46.193085+0000","last_peered":"2023-07-25T14:37:46.193085+0000","last_clean":"2023-07-25T14:37:46.193085+0000","last_became_active":"2023-07-25T14:35:34.371411+0000","last_became_peered":"2023-07-25T14:35:34.371411+0000","last_unstale":"2023-07-25T14:37:46.193085+0000","last_undegraded":"2023-07-25T14:37:46.193085+0000","last_fullsized":"2023-07-25T14:37:46.193085+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_clean_scrub_stamp":"2023-07-25T14:35:33.358525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T18:51:20.997555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-07-25T14:37:45.211833+0000","last_change":"2023-07-25T14:37:45.204043+0000","last_active":"2023-07-25T14:37:45.211833+0000","last_peered":"2023-07-25T14:37:45.211833+0000","last_clean":"2023-07-25T14:37:45.211833+0000","last_became_active":"2023-07-25T14:37:45.203102+0000","last_became_peered":"2023-07-25T14:37:45.203102+0000","last_unstale":"2023-07-25T14:37:45.211833+0000","last_undegraded":"2023-07-25T14:37:45.211833+0000","last_fullsized":"2023-07-25T14:37:45.211833+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T20:54:34.527996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"56'2","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-07-25T14:37:45.215457+0000","last_change":"2023-07-25T14:37:44.167732+0000","last_active":"2023-07-25T14:37:45.215457+0000","last_peered":"2023-07-25T14:37:45.215457+0000","last_clean":"2023-07-25T14:37:45.215457+0000","last_became_active":"2023-07-25T14:37:44.167418+0000","last_became_peered":"2023-07-25T14:37:44.167418+0000","last_unstale":"2023-07-25T14:37:45.215457+0000","last_undegraded":"2023-07-25T14:37:45.215457+0000","last_fullsized":"2023-07-25T14:37:45.215457+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T20:59:35.521705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":88,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-07-25T14:37:45.189437+0000","last_change":"2023-07-25T14:35:34.371347+0000","last_active":"2023-07-25T14:37:45.189437+0000","last_peered":"2023-07-25T14:37:45.189437+0000","last_clean":"2023-07-25T14:37:45.189437+0000","last_became_active":"2023-07-25T14:35:34.371044+0000","last_became_peered":"2023-07-25T14:35:34.371044+0000","last_unstale":"2023-07-25T14:37:45.189437+0000","last_undegraded":"2023-07-25T14:37:45.189437+0000","last_fullsized":"2023-07-25T14:37:45.189437+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_clean_scrub_stamp":"2023-07-25T14:35:33.358525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T18:15:08.127022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64510,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574879,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27752,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344088,"statfs":{"total":96636764160,"available":96608346112,"internally_reserved":0,"allocated":749568,"data_stored":910837,"data_compressed":32255,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jul 25 14:37:40 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.46999999999999997,"15min":0.46200000000000002},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.84299999999999997,"15min":0.90200000000000002},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.70699999999999996,"5min":9.1600000000000001,"15min":9.1600000000000001},"last":0.48299999999999998}]},{"osd":1,"last update":"Tue Jul 25 14:37:40 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.59299999999999997,"15min":0.60699999999999998},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.82699999999999996,"5min":1.5009999999999999,"15min":1.5009999999999999},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.61099999999999999,"15min":0.61799999999999999},"min":{"1min":0.45600000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.81100000000000005,"5min":1.526,"15min":1.526},"last":0.58699999999999997}]},{"osd":2,"last update":"Tue Jul 25 14:37:40 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.54500000000000004,"15min":0.55400000000000005},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.71599999999999997,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.82899999999999996,"15min":0.873},"min":{"1min":0.38300000000000001,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.95399999999999996,"5min":8.1739999999999995,"15min":8.1739999999999995},"last":0.71099999999999997}]},{"osd":3,"last update":"Tue Jul 25 14:37:40 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.82499999999999996,"15min":0.875},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.81599999999999995,"5min":7.2279999999999998,"15min":7.2279999999999998},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.89600000000000002,"15min":0.93999999999999995},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.0029999999999999,"5min":7.1870000000000003,"15min":7.1870000000000003},"last":0.56299999999999994}]},{"osd":4,"last update":"Tue Jul 25 14:37:40 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.57999999999999996,"15min":0.57799999999999996},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.76600000000000001,"5min":1.254,"15min":1.254},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.59299999999999997,"15min":0.59599999999999997},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.877,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.68300000000000005}]},{"osd":5,"last update":"Tue Jul 25 14:37:40 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.748},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.52600000000000002,"5min":0.501,"15min":0.501},"max":{"1min":0.84699999999999998,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.70099999999999996}]},{"osd":6,"last update":"Tue Jul 25 14:37:40 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.45800000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.88,"5min":1.286,"15min":1.286},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.64500000000000002,"15min":0.64400000000000002},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.72799999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574878,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27696,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344144,"statfs":{"total":96636764160,"available":96608403456,"internally_reserved":0,"allocated":684032,"data_stored":319945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jul 25 14:37:35 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.54200000000000004,"15min":0.54800000000000004},"min":{"1min":0.32300000000000001,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.73199999999999998,"5min":1.9370000000000001,"15min":1.9370000000000001},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.56000000000000005,"15min":0.56599999999999995},"min":{"1min":0.39700000000000002,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.77200000000000002,"5min":2.6779999999999999,"15min":2.6779999999999999},"last":0.59899999999999998}]},{"osd":1,"last update":"Tue Jul 25 14:37:35 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.53500000000000003,"15min":0.54100000000000004},"min":{"1min":0.34599999999999997,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.70799999999999996,"5min":2.5720000000000001,"15min":2.5720000000000001},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.503,"5min":0.54500000000000004,"15min":0.55200000000000005},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.64800000000000002,"5min":1.6259999999999999,"15min":1.6259999999999999},"last":0.45100000000000001}]},{"osd":2,"last update":"Tue Jul 25 14:37:35 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.52700000000000002,"15min":0.52100000000000002},"min":{"1min":0.34399999999999997,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.79000000000000004,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.50600000000000001,"15min":0.501},"min":{"1min":0.375,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.68799999999999994,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.51900000000000002}]},{"osd":3,"last update":"Tue Jul 25 14:37:35 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.64900000000000002,"15min":0.66300000000000003},"min":{"1min":0.38600000000000001,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.73499999999999999,"5min":3.5750000000000002,"15min":3.5750000000000002},"last":0.499},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.69899999999999995,"15min":0.71699999999999997},"min":{"1min":0.36499999999999999,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.77400000000000002,"5min":4.7190000000000003,"15min":4.7190000000000003},"last":0.623}]},{"osd":4,"last update":"Tue Jul 25 14:37:35 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.65700000000000003,"15min":0.67200000000000004},"min":{"1min":0.39100000000000001,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.79700000000000004,"5min":4.694,"15min":4.694},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.622,"15min":0.628},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.74099999999999999,"5min":2.7839999999999998,"15min":2.7839999999999998},"last":0.64300000000000002}]},{"osd":5,"last update":"Tue Jul 25 14:37:35 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.54500000000000004,"15min":0.54100000000000004},"min":{"1min":0.36199999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.752,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.624,"15min":0.627},"min":{"1min":0.376,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.82499999999999996,"5min":1.7310000000000001,"15min":1.7310000000000001},"last":0.58599999999999997}]},{"osd":7,"last update":"Tue Jul 25 14:37:35 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.68799999999999994,"15min":0.69799999999999995},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.81299999999999994,"5min":2.7290000000000001,"15min":2.7290000000000001},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.58999999999999997,"15min":0.58199999999999996},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.60799999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574878,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27764,"kb_used_data":744,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344076,"statfs":{"total":96636764160,"available":96608333824,"internally_reserved":0,"allocated":761856,"data_stored":912401,"data_compressed":32255,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jul 25 14:37:39 2023","interfaces":[{"interface":"back","average":{"1min":0.314,"5min":0.318,"15min":0.318},"min":{"1min":0.23999999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.44500000000000001,"5min":0.47099999999999997,"15min":0.47099999999999997},"last":0.222},{"interface":"front","average":{"1min":0.312,"5min":0.32800000000000001,"15min":0.33000000000000002},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.44700000000000001,"5min":0.48899999999999999,"15min":0.48899999999999999},"last":0.28499999999999998}]},{"osd":2,"last update":"Tue Jul 25 14:37:39 2023","interfaces":[{"interface":"back","average":{"1min":0.29799999999999999,"5min":0.30599999999999999,"15min":0.308},"min":{"1min":0.20100000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"last":0.29899999999999999},{"interface":"front","average":{"1min":0.35399999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"min":{"1min":0.27200000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.45800000000000002,"5min":0.56499999999999995,"15min":0.56499999999999995},"last":0.26800000000000002}]},{"osd":3,"last update":"Tue Jul 25 14:37:39 2023","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.371,"15min":0.373},"min":{"1min":0.29699999999999999,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.432,"5min":0.52900000000000003,"15min":0.52900000000000003},"last":0.316},{"interface":"front","average":{"1min":0.33000000000000002,"5min":0.34499999999999997,"15min":0.34699999999999998},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.46999999999999997,"5min":0.496,"15min":0.496},"last":0.32500000000000001}]},{"osd":4,"last update":"Tue Jul 25 14:37:39 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.55300000000000005,"15min":0.55100000000000005},"min":{"1min":0.44900000000000001,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.78400000000000003,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.55400000000000005,"15min":0.55800000000000005},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.65100000000000002,"5min":0.745,"15min":0.745},"last":0.48199999999999998}]},{"osd":5,"last update":"Tue Jul 25 14:37:39 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.56100000000000005,"15min":0.55900000000000005},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.754,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.56399999999999995,"15min":0.56499999999999995},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.496}]},{"osd":6,"last update":"Tue Jul 25 14:37:39 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.58099999999999996,"15min":0.58199999999999996},"min":{"1min":0.46000000000000002,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.70399999999999996,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.56899999999999995,"15min":0.57099999999999995},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.51900000000000002}]},{"osd":7,"last update":"Tue Jul 25 14:37:39 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.47699999999999998,"5min":0.443,"15min":0.443},"max":{"1min":0.71799999999999997,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.59599999999999997,"15min":0.59499999999999997},"min":{"1min":0.48399999999999999,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.74199999999999999,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.50700000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574878,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27684,"kb_used_data":656,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344156,"statfs":{"total":96636764160,"available":96608415744,"internally_reserved":0,"allocated":671744,"data_stored":318792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Jul 25 14:37:36 2023","interfaces":[{"interface":"back","average":{"1min":0.29899999999999999,"5min":0.35099999999999998,"15min":0.35899999999999999},"min":{"1min":0.17199999999999999,"5min":0.17199999999999999,"15min":0.17199999999999999},"max":{"1min":0.39000000000000001,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.28899999999999998,"5min":0.58899999999999997,"15min":0.63900000000000001},"min":{"1min":0.19600000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.37,"5min":6.5369999999999999,"15min":6.5369999999999999},"last":0.27800000000000002}]},{"osd":2,"last update":"Tue Jul 25 14:37:36 2023","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":0.36399999999999999,"15min":0.37},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.47599999999999998,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.23200000000000001},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.63,"15min":0.67600000000000005},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.439,"5min":6.5659999999999998,"15min":6.5659999999999998},"last":0.32700000000000001}]},{"osd":3,"last update":"Tue Jul 25 14:37:36 2023","interfaces":[{"interface":"back","average":{"1min":0.33100000000000002,"5min":0.88700000000000001,"15min":0.97899999999999998},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.48799999999999999,"5min":12.449,"15min":12.449},"last":0.29399999999999998},{"interface":"front","average":{"1min":0.36199999999999999,"5min":0.40999999999999998,"15min":0.41799999999999998},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.45100000000000001,"5min":1.079,"15min":1.079},"last":0.311}]},{"osd":4,"last update":"Tue Jul 25 14:37:36 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.79300000000000004,"15min":0.83199999999999996},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.71399999999999997,"5min":6.5099999999999998,"15min":6.5099999999999998},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.55600000000000005,"5min":1.0680000000000001,"15min":1.1539999999999999},"min":{"1min":0.35399999999999998,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.66100000000000003,"5min":12.35,"15min":12.35},"last":0.45700000000000002}]},{"osd":5,"last update":"Tue Jul 25 14:37:36 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.58699999999999997,"15min":0.58899999999999997},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.68100000000000005,"5min":1.107,"15min":1.107},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.82599999999999996,"15min":0.872},"min":{"1min":0.39000000000000001,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.76600000000000001,"5min":6.4349999999999996,"15min":6.4349999999999996},"last":0.56299999999999994}]},{"osd":6,"last update":"Tue Jul 25 14:37:36 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":1.0820000000000001,"15min":1.1679999999999999},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.74099999999999999,"5min":12.417,"15min":12.417},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.60799999999999998,"15min":0.61199999999999999},"min":{"1min":0.45000000000000001,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.68999999999999995,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.47299999999999998}]},{"osd":7,"last update":"Tue Jul 25 14:37:36 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.85799999999999998,"15min":0.90400000000000003},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.67200000000000004,"5min":6.4809999999999999,"15min":6.4809999999999999},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.57799999999999996,"5min":1.091,"15min":1.177},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.77500000000000002,"5min":12.388999999999999,"15min":12.388999999999999},"last":0.503}]}]},{"osd":2,"up_from":13,"seq":55834574878,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27696,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344144,"statfs":{"total":96636764160,"available":96608403456,"internally_reserved":0,"allocated":684032,"data_stored":320356,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jul 25 14:37:34 2023","interfaces":[{"interface":"back","average":{"1min":0.311,"5min":0.38200000000000001,"15min":0.39400000000000002},"min":{"1min":0.20399999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.39000000000000001,"5min":2.1030000000000002,"15min":2.1030000000000002},"last":0.217},{"interface":"front","average":{"1min":0.27600000000000002,"5min":0.92800000000000005,"15min":1.0369999999999999},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":0.32900000000000001,"5min":16.969000000000001,"15min":16.969000000000001},"last":0.318}]},{"osd":1,"last update":"Tue Jul 25 14:37:34 2023","interfaces":[{"interface":"back","average":{"1min":0.33400000000000002,"5min":0.35099999999999998,"15min":0.35399999999999998},"min":{"1min":0.26200000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.41899999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"last":0.27700000000000002},{"interface":"front","average":{"1min":0.34300000000000003,"5min":0.379,"15min":0.38500000000000001},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.50800000000000001,"5min":1.111,"15min":1.111},"last":0.36499999999999999}]},{"osd":3,"last update":"Tue Jul 25 14:37:34 2023","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.79700000000000004,"15min":0.876},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.36799999999999999,"5min":13.035,"15min":13.035},"last":0.30299999999999999},{"interface":"front","average":{"1min":0.376,"5min":0.40300000000000002,"15min":0.40699999999999997},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.61599999999999999,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.35299999999999998}]},{"osd":4,"last update":"Tue Jul 25 14:37:34 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.754,"15min":0.79200000000000004},"min":{"1min":0.39100000000000001,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.73099999999999998,"5min":6.165,"15min":6.165},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.55900000000000005,"5min":1.0069999999999999,"15min":1.0820000000000001},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.74199999999999999,"5min":13.004,"15min":13.004},"last":0.56200000000000006}]},{"osd":5,"last update":"Tue Jul 25 14:37:34 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.57199999999999995,"15min":0.57299999999999995},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.75800000000000001,"15min":0.79500000000000004},"min":{"1min":0.41299999999999998,"5min":0.378,"15min":0.378},"max":{"1min":0.69499999999999995,"5min":6.226,"15min":6.226},"last":0.623}]},{"osd":6,"last update":"Tue Jul 25 14:37:34 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":1.006,"15min":1.0840000000000001},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.77400000000000002,"5min":12.974,"15min":12.974},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.59499999999999997,"15min":0.59699999999999998},"min":{"1min":0.42599999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.77200000000000002,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.54000000000000004}]},{"osd":7,"last update":"Tue Jul 25 14:37:34 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.77900000000000003,"15min":0.81499999999999995},"min":{"1min":0.40899999999999997,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.70499999999999996,"5min":6.1989999999999998,"15min":6.1989999999999998},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.56699999999999995,"5min":1.026,"15min":1.1020000000000001},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.74199999999999999,"5min":12.936999999999999,"15min":12.936999999999999},"last":0.748}]}]},{"osd":3,"up_from":13,"seq":55834574878,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27692,"kb_used_data":664,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344148,"statfs":{"total":96636764160,"available":96608407552,"internally_reserved":0,"allocated":679936,"data_stored":318904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jul 25 14:37:36 2023","interfaces":[{"interface":"back","average":{"1min":0.29999999999999999,"5min":0.312,"15min":0.314},"min":{"1min":0.20300000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"last":0.254},{"interface":"front","average":{"1min":0.32100000000000001,"5min":0.309,"15min":0.307},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.45400000000000001,"5min":0.46300000000000002,"15min":0.46300000000000002},"last":0.22800000000000001}]},{"osd":1,"last update":"Tue Jul 25 14:37:36 2023","interfaces":[{"interface":"back","average":{"1min":0.315,"5min":0.308,"15min":0.307},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"last":0.27500000000000002},{"interface":"front","average":{"1min":0.34200000000000003,"5min":0.36899999999999999,"15min":0.373},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.496,"5min":0.59099999999999997,"15min":0.59099999999999997},"last":0.30199999999999999}]},{"osd":2,"last update":"Tue Jul 25 14:37:36 2023","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":0.37,"15min":0.374},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.441,"5min":0.502,"15min":0.502},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.35899999999999999,"5min":0.39300000000000002,"15min":0.39900000000000002},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.47299999999999998,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.33200000000000002}]},{"osd":4,"last update":"Tue Jul 25 14:37:36 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.57199999999999995,"15min":0.57399999999999995},"min":{"1min":0.42399999999999999,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.77000000000000002,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58799999999999997,"15min":0.58899999999999997},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.68999999999999995}]},{"osd":5,"last update":"Tue Jul 25 14:37:36 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.70999999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.625,"15min":0.63100000000000001},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.88100000000000001,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.63600000000000001}]},{"osd":6,"last update":"Tue Jul 25 14:37:36 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.61499999999999999,"15min":0.625},"min":{"1min":0.46300000000000002,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.68799999999999994,"5min":0.871,"15min":0.871},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.59399999999999997,"15min":0.59599999999999997},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.57799999999999996}]},{"osd":7,"last update":"Tue Jul 25 14:37:36 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.59099999999999997,"15min":0.58899999999999997},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.83599999999999997,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.60699999999999998,"15min":0.60899999999999999},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.70899999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574878,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27692,"kb_used_data":664,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344148,"statfs":{"total":96636764160,"available":96608407552,"internally_reserved":0,"allocated":679936,"data_stored":319923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jul 25 14:37:35 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.55500000000000005,"15min":0.56100000000000005},"min":{"1min":0.39600000000000002,"5min":0.31,"15min":0.31},"max":{"1min":0.75700000000000001,"5min":0.876,"15min":0.876},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.51100000000000001,"15min":0.51000000000000001},"min":{"1min":0.371,"5min":0.309,"15min":0.309},"max":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.49299999999999999}]},{"osd":1,"last update":"Tue Jul 25 14:37:35 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.69099999999999995,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.53600000000000003,"15min":0.53200000000000003},"min":{"1min":0.38900000000000001,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.70399999999999996,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.59899999999999998}]},{"osd":2,"last update":"Tue Jul 25 14:37:35 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.55500000000000005,"15min":0.54900000000000004},"min":{"1min":0.435,"5min":0.376,"15min":0.376},"max":{"1min":0.67600000000000005,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.54600000000000004,"15min":0.54200000000000004},"min":{"1min":0.41999999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.61699999999999999}]},{"osd":3,"last update":"Tue Jul 25 14:37:35 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.53600000000000003,"15min":0.53000000000000003},"min":{"1min":0.33000000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.73299999999999998,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.63,"15min":0.63800000000000001},"min":{"1min":0.47299999999999998,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.76100000000000001,"5min":1.8720000000000001,"15min":1.8720000000000001},"last":0.66400000000000003}]},{"osd":5,"last update":"Tue Jul 25 14:37:35 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.49099999999999999,"15min":0.47599999999999998},"min":{"1min":0.36399999999999999,"5min":0.317,"15min":0.317},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.61899999999999999,"15min":0.61599999999999999},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.748,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.71999999999999997}]},{"osd":6,"last update":"Tue Jul 25 14:37:35 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.54900000000000004,"15min":0.54100000000000004},"min":{"1min":0.41299999999999998,"5min":0.372,"15min":0.372},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.59899999999999998,"15min":0.60099999999999998},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.70699999999999996}]},{"osd":7,"last update":"Tue Jul 25 14:37:35 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.623,"15min":0.61899999999999999},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.79500000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.64600000000000002,"15min":0.64000000000000001},"min":{"1min":0.54900000000000004,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.67900000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574878,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27692,"kb_used_data":664,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344148,"statfs":{"total":96636764160,"available":96608407552,"internally_reserved":0,"allocated":679936,"data_stored":319943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jul 25 14:37:32 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.59799999999999998,"15min":0.60599999999999998},"min":{"1min":0.35399999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.83399999999999996,"5min":2.548,"15min":2.548},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.55700000000000005,"15min":0.56000000000000005},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.76500000000000001,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.63800000000000001}]},{"osd":1,"last update":"Tue Jul 25 14:37:32 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.58099999999999996,"15min":0.58499999999999996},"min":{"1min":0.39900000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.753,"5min":1.657,"15min":1.657},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.42599999999999999,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.79700000000000004,"5min":1.752,"15min":1.752},"last":0.61099999999999999}]},{"osd":2,"last update":"Tue Jul 25 14:37:32 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.56499999999999995,"15min":0.56699999999999995},"min":{"1min":0.38800000000000001,"5min":0.372,"15min":0.372},"max":{"1min":0.82899999999999996,"5min":0.872,"15min":0.872},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.54300000000000004,"15min":0.53400000000000003},"min":{"1min":0.46500000000000002,"5min":0.376,"15min":0.376},"max":{"1min":0.751,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.627}]},{"osd":3,"last update":"Tue Jul 25 14:37:32 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.56399999999999995,"15min":0.55800000000000005},"min":{"1min":0.39900000000000002,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.60899999999999999,"15min":0.60499999999999998},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.67200000000000004}]},{"osd":4,"last update":"Tue Jul 25 14:37:32 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.52900000000000003,"15min":0.52700000000000002},"min":{"1min":0.38900000000000001,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.56100000000000005,"15min":0.55900000000000005},"min":{"1min":0.35499999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.44600000000000001}]},{"osd":6,"last update":"Tue Jul 25 14:37:32 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.56299999999999994,"15min":0.55400000000000005},"min":{"1min":0.42499999999999999,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.57099999999999995,"15min":0.56799999999999995},"min":{"1min":0.35999999999999999,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.54600000000000004}]},{"osd":7,"last update":"Tue Jul 25 14:37:32 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.58799999999999997,"15min":0.58199999999999996},"min":{"1min":0.41899999999999998,"5min":0.375,"15min":0.375},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.627,"5min":0.64400000000000002,"15min":0.64700000000000002},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.81399999999999995,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.58199999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32255,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32255,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-25T14:37:49.288 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-25T14:37:49.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.429+0000 7f44939d2700 1 Processor -- start 2023-07-25T14:37:49.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.429+0000 7f44939d2700 1 -- start start 2023-07-25T14:37:49.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.430+0000 7f44939d2700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f448c152a50 0x7f448c0c1860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:49.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.430+0000 7f44939d2700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f448c0c0aa0 con 0x7f448c0ab8e0 2023-07-25T14:37:49.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.430+0000 7f44939d2700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f448c0c0d80 con 0x7f448c148bb0 2023-07-25T14:37:49.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.430+0000 7f44939d2700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f448c152fa0 con 0x7f448c152a50 2023-07-25T14:37:49.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.430+0000 7f4491f6f700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f448c0ab8e0 0x7f448c15c950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:34514/0 (socket says 172.21.15.72:34514) 2023-07-25T14:37:49.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.430+0000 7f4491f6f700 1 -- 172.21.15.72:0/2811619539 learned_addr learned my addr 172.21.15.72:0/2811619539 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:37:49.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.430+0000 7f4490f6d700 1 --2- 172.21.15.72:0/2811619539 >> v2:172.21.15.92:3300/0 conn(0x7f448c152a50 0x7f448c0c1860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:49.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.430+0000 7f4483fff700 1 -- 172.21.15.72:0/2811619539 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2797300841 0 0) 0x7f448c0c0aa0 con 0x7f448c0ab8e0 2023-07-25T14:37:49.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.430+0000 7f4483fff700 1 -- 172.21.15.72:0/2811619539 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f44780035b0 con 0x7f448c0ab8e0 2023-07-25T14:37:49.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.430+0000 7f4483fff700 1 -- 172.21.15.72:0/2811619539 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1992518430 0 0) 0x7f44780035b0 con 0x7f448c0ab8e0 2023-07-25T14:37:49.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.430+0000 7f4483fff700 1 -- 172.21.15.72:0/2811619539 >> v2:172.21.15.92:3300/0 conn(0x7f448c152a50 msgr2=0x7f448c0c1860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:49.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.430+0000 7f4483fff700 1 --2- 172.21.15.72:0/2811619539 >> v2:172.21.15.92:3300/0 conn(0x7f448c152a50 0x7f448c0c1860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:49.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.430+0000 7f4483fff700 1 -- 172.21.15.72:0/2811619539 >> v1:172.21.15.92:6789/0 conn(0x7f448c148bb0 legacy=0x7f448c06ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:49.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.430+0000 7f4483fff700 1 -- 172.21.15.72:0/2811619539 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f448c0c1060 con 0x7f448c0ab8e0 2023-07-25T14:37:49.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.430+0000 7f4483fff700 1 -- 172.21.15.72:0/2811619539 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2559588315 0 0) 0x7f44840019f0 con 0x7f448c0ab8e0 2023-07-25T14:37:49.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.431+0000 7f4483fff700 1 -- 172.21.15.72:0/2811619539 >> v1:172.21.15.72:6789/0 conn(0x7f448c0ab8e0 legacy=0x7f448c15c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:49.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.431+0000 7f4483fff700 1 --2- 172.21.15.72:0/2811619539 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4478003a00 0x7f4478003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:49.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.431+0000 7f4483fff700 1 --2- 172.21.15.72:0/2811619539 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4478004850 0x7f4478004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:49.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.431+0000 7f4483fff700 1 --2- 172.21.15.72:0/2811619539 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4478005210 0x7f447800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:49.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.431+0000 7f4483fff700 1 -- 172.21.15.72:0/2811619539 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f448c152fa0 con 0x7f4478003a00 2023-07-25T14:37:49.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.431+0000 7f4483fff700 1 -- 172.21.15.72:0/2811619539 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f447800c0b0 con 0x7f4478004850 2023-07-25T14:37:49.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.431+0000 7f4483fff700 1 -- 172.21.15.72:0/2811619539 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f447800c270 con 0x7f4478005210 2023-07-25T14:37:49.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.431+0000 7f449176e700 1 --2- 172.21.15.72:0/2811619539 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4478003a00 0x7f4478003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:49.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.431+0000 7f4490f6d700 1 --2- 172.21.15.72:0/2811619539 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4478004850 0x7f4478004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:49.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.431+0000 7f4491f6f700 1 --2- 172.21.15.72:0/2811619539 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4478005210 0x7f447800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:49.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.431+0000 7f449176e700 1 -- 172.21.15.72:0/2811619539 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4478005210 msgr2=0x7f447800ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:49.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.431+0000 7f449176e700 1 --2- 172.21.15.72:0/2811619539 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4478005210 0x7f447800ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:49.450 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.431+0000 7f449176e700 1 -- 172.21.15.72:0/2811619539 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4478004850 msgr2=0x7f4478004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:49.450 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.431+0000 7f449176e700 1 --2- 172.21.15.72:0/2811619539 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4478004850 0x7f4478004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:49.450 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.431+0000 7f449176e700 1 -- 172.21.15.72:0/2811619539 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44780035b0 con 0x7f4478003a00 2023-07-25T14:37:49.450 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.431+0000 7f4491f6f700 1 -- 172.21.15.72:0/2811619539 reap_dead start 2023-07-25T14:37:49.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.431+0000 7f449176e700 1 --2- 172.21.15.72:0/2811619539 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4478003a00 0x7f4478003e20 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f447c0017c0 tx=0x7f4478005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39d6b806983d4401 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:49.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.431+0000 7f4483fff700 1 -- 172.21.15.72:0/2811619539 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f447c0052d0 con 0x7f4478003a00 2023-07-25T14:37:49.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.431+0000 7f4483fff700 1 -- 172.21.15.72:0/2811619539 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f447c005450 con 0x7f4478003a00 2023-07-25T14:37:49.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.431+0000 7f4483fff700 1 -- 172.21.15.72:0/2811619539 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f447c0038c0 con 0x7f4478003a00 2023-07-25T14:37:49.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.432+0000 7f44939d2700 1 -- 172.21.15.72:0/2811619539 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4478003a00 msgr2=0x7f4478003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:49.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.432+0000 7f44939d2700 1 --2- 172.21.15.72:0/2811619539 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4478003a00 0x7f4478003e20 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f447c0017c0 tx=0x7f4478005880 comp rx=0 tx=0).stop 2023-07-25T14:37:49.452 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.432+0000 7f44939d2700 1 -- 172.21.15.72:0/2811619539 shutdown_connections 2023-07-25T14:37:49.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.432+0000 7f44939d2700 1 --2- 172.21.15.72:0/2811619539 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4478003a00 0x7f4478003e20 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:49.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.432+0000 7f44939d2700 1 -- 172.21.15.72:0/2811619539 >> 172.21.15.72:0/2811619539 conn(0x7f448c071bf0 msgr2=0x7f448c06a190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:49.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.432+0000 7f44939d2700 1 -- 172.21.15.72:0/2811619539 shutdown_connections 2023-07-25T14:37:49.453 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.432+0000 7f44939d2700 1 -- 172.21.15.72:0/2811619539 wait complete. 2023-07-25T14:37:49.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.433+0000 7f44939d2700 1 Processor -- start 2023-07-25T14:37:49.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.433+0000 7f44939d2700 1 -- start start 2023-07-25T14:37:49.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.434+0000 7f44939d2700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4478003a00 0x7f448c1ead90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:49.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.434+0000 7f44939d2700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f448c1eb2d0 0x7f448c1e9070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:49.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.434+0000 7f44939d2700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f448c1e95b0 0x7f448c154130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:49.457 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.434+0000 7f44939d2700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f448c1eba50 con 0x7f448c1eb2d0 2023-07-25T14:37:49.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.434+0000 7f44939d2700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f448c14c6a0 con 0x7f448c1e95b0 2023-07-25T14:37:49.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.434+0000 7f44939d2700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f448c14c980 con 0x7f4478003a00 2023-07-25T14:37:49.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.434+0000 7f4490f6d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f448c1eb2d0 0x7f448c1e9070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:49.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.434+0000 7f4490f6d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f448c1eb2d0 0x7f448c1e9070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43788/0 (socket says 172.21.15.72:43788) 2023-07-25T14:37:49.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.434+0000 7f4490f6d700 1 -- 172.21.15.72:0/2934984244 learned_addr learned my addr 172.21.15.72:0/2934984244 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:37:49.458 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.434+0000 7f449176e700 1 --2- 172.21.15.72:0/2934984244 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4478003a00 0x7f448c1ead90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:49.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.434+0000 7f4491f6f700 1 --2- 172.21.15.72:0/2934984244 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f448c1e95b0 0x7f448c154130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:49.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.434+0000 7f4490f6d700 1 -- 172.21.15.72:0/2934984244 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4478003a00 msgr2=0x7f448c1ead90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:49.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.434+0000 7f4490f6d700 1 --2- 172.21.15.72:0/2934984244 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4478003a00 0x7f448c1ead90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:49.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.434+0000 7f4490f6d700 1 -- 172.21.15.72:0/2934984244 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f448c1e95b0 msgr2=0x7f448c154130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:49.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.434+0000 7f4490f6d700 1 --2- 172.21.15.72:0/2934984244 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f448c1e95b0 0x7f448c154130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:49.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.434+0000 7f4490f6d700 1 -- 172.21.15.72:0/2934984244 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f448c14cc60 con 0x7f448c1eb2d0 2023-07-25T14:37:49.459 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.434+0000 7f4490f6d700 1 --2- 172.21.15.72:0/2934984244 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f448c1eb2d0 0x7f448c1e9070 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f4488011aa0 tx=0x7f4488011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:49.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.434+0000 7f4481ffb700 1 -- 172.21.15.72:0/2934984244 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f448800f980 con 0x7f448c1eb2d0 2023-07-25T14:37:49.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.434+0000 7f4481ffb700 1 -- 172.21.15.72:0/2934984244 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f448800fb00 con 0x7f448c1eb2d0 2023-07-25T14:37:49.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.434+0000 7f44939d2700 1 -- 172.21.15.72:0/2934984244 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f448c1e8b50 con 0x7f448c1eb2d0 2023-07-25T14:37:49.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.434+0000 7f4481ffb700 1 -- 172.21.15.72:0/2934984244 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f448800feb0 con 0x7f448c1eb2d0 2023-07-25T14:37:49.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.435+0000 7f44939d2700 1 -- 172.21.15.72:0/2934984244 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f448c1522e0 con 0x7f448c1eb2d0 2023-07-25T14:37:49.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.435+0000 7f44939d2700 1 -- 172.21.15.72:0/2934984244 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f448c1e8ec0 con 0x7f448c1eb2d0 2023-07-25T14:37:49.460 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.436+0000 7f4481ffb700 1 -- 172.21.15.72:0/2934984244 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f448801d400 con 0x7f448c1eb2d0 2023-07-25T14:37:49.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.436+0000 7f4481ffb700 1 --2- 172.21.15.72:0/2934984244 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f447006ace0 0x7f447006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:49.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.436+0000 7f4481ffb700 1 -- 172.21.15.72:0/2934984244 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f4488089cf0 con 0x7f448c1eb2d0 2023-07-25T14:37:49.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.436+0000 7f449176e700 1 --2- 172.21.15.72:0/2934984244 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f447006ace0 0x7f447006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:49.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.437+0000 7f449176e700 1 --2- 172.21.15.72:0/2934984244 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f447006ace0 0x7f447006d1a0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f447c000c00 tx=0x7f447c009030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:49.461 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.441+0000 7f4481ffb700 1 -- 172.21.15.72:0/2934984244 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f4488054d10 con 0x7f448c1eb2d0 2023-07-25T14:37:49.634 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.624+0000 7f44939d2700 1 -- 172.21.15.72:0/2934984244 --> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f448c0c1310 con 0x7f447006ace0 2023-07-25T14:37:49.643 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.632+0000 7f4481ffb700 1 -- 172.21.15.72:0/2934984244 <== mgr.4104 v2:172.21.15.72:6832/1171220306 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311635 (secure 0 0 0) 0x7f448c0c1310 con 0x7f447006ace0 2023-07-25T14:37:49.646 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-25T14:37:49.647 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.636+0000 7f44939d2700 1 -- 172.21.15.72:0/2934984244 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f447006ace0 msgr2=0x7f447006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:49.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.636+0000 7f44939d2700 1 --2- 172.21.15.72:0/2934984244 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f447006ace0 0x7f447006d1a0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f447c000c00 tx=0x7f447c009030 comp rx=0 tx=0).stop 2023-07-25T14:37:49.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.636+0000 7f44939d2700 1 -- 172.21.15.72:0/2934984244 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f448c1eb2d0 msgr2=0x7f448c1e9070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:49.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.636+0000 7f44939d2700 1 --2- 172.21.15.72:0/2934984244 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f448c1eb2d0 0x7f448c1e9070 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f4488011aa0 tx=0x7f4488011e60 comp rx=0 tx=0).stop 2023-07-25T14:37:49.648 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.636+0000 7f44939d2700 1 -- 172.21.15.72:0/2934984244 shutdown_connections 2023-07-25T14:37:49.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.636+0000 7f44939d2700 1 --2- 172.21.15.72:0/2934984244 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f447006ace0 0x7f447006d1a0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:49.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.636+0000 7f44939d2700 1 --2- 172.21.15.72:0/2934984244 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4478003a00 0x7f448c1ead90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:49.649 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.636+0000 7f44939d2700 1 --2- 172.21.15.72:0/2934984244 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f448c1e95b0 0x7f448c154130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:49.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.636+0000 7f44939d2700 1 --2- 172.21.15.72:0/2934984244 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f448c1eb2d0 0x7f448c1e9070 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:49.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.636+0000 7f44939d2700 1 -- 172.21.15.72:0/2934984244 >> 172.21.15.72:0/2934984244 conn(0x7f448c071bf0 msgr2=0x7f448c146c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:49.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.636+0000 7f44939d2700 1 -- 172.21.15.72:0/2934984244 shutdown_connections 2023-07-25T14:37:49.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.636+0000 7f44939d2700 1 -- 172.21.15.72:0/2934984244 wait complete. 2023-07-25T14:37:49.651 INFO:teuthology.orchestra.run.smithi072.stderr:dumped all 2023-07-25T14:37:49.658 INFO:teuthology.orchestra.run.smithi072.stdout:{"pg_ready":true,"pg_map":{"version":119,"stamp":"2023-07-25T14:37:49.311839+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":103,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":221668,"kb_used_data":5460,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754753052,"statfs":{"total":773094113280,"available":772867125248,"internally_reserved":0,"allocated":5591040,"data_stored":3741101,"data_compressed":64510,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":37,"apply_latency_ms":37,"commit_latency_ns":37000000,"apply_latency_ns":37000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001167"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-07-25T14:37:45.203962+0000","last_change":"2023-07-25T14:37:45.195851+0000","last_active":"2023-07-25T14:37:45.203962+0000","last_peered":"2023-07-25T14:37:45.203962+0000","last_clean":"2023-07-25T14:37:45.203962+0000","last_became_active":"2023-07-25T14:37:45.195549+0000","last_became_peered":"2023-07-25T14:37:45.195549+0000","last_unstale":"2023-07-25T14:37:45.203962+0000","last_undegraded":"2023-07-25T14:37:45.203962+0000","last_fullsized":"2023-07-25T14:37:45.203962+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T19:46:54.340200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-07-25T14:37:45.215138+0000","last_change":"2023-07-25T14:37:45.209998+0000","last_active":"2023-07-25T14:37:45.215138+0000","last_peered":"2023-07-25T14:37:45.215138+0000","last_clean":"2023-07-25T14:37:45.215138+0000","last_became_active":"2023-07-25T14:37:45.209538+0000","last_became_peered":"2023-07-25T14:37:45.209538+0000","last_unstale":"2023-07-25T14:37:45.215138+0000","last_undegraded":"2023-07-25T14:37:45.215138+0000","last_fullsized":"2023-07-25T14:37:45.215138+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:30:00.868812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-25T14:37:46.193366+0000","last_change":"2023-07-25T14:37:45.186668+0000","last_active":"2023-07-25T14:37:46.193366+0000","last_peered":"2023-07-25T14:37:46.193366+0000","last_clean":"2023-07-25T14:37:46.193366+0000","last_became_active":"2023-07-25T14:37:45.186396+0000","last_became_peered":"2023-07-25T14:37:45.186396+0000","last_unstale":"2023-07-25T14:37:46.193366+0000","last_undegraded":"2023-07-25T14:37:46.193366+0000","last_fullsized":"2023-07-25T14:37:46.193366+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T14:50:53.134658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-25T14:37:46.194562+0000","last_change":"2023-07-25T14:37:45.197894+0000","last_active":"2023-07-25T14:37:46.194562+0000","last_peered":"2023-07-25T14:37:46.194562+0000","last_clean":"2023-07-25T14:37:46.194562+0000","last_became_active":"2023-07-25T14:37:45.197369+0000","last_became_peered":"2023-07-25T14:37:45.197369+0000","last_unstale":"2023-07-25T14:37:46.194562+0000","last_undegraded":"2023-07-25T14:37:46.194562+0000","last_fullsized":"2023-07-25T14:37:46.194562+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:09:57.961255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-07-25T14:37:45.208097+0000","last_change":"2023-07-25T14:37:45.204817+0000","last_active":"2023-07-25T14:37:45.208097+0000","last_peered":"2023-07-25T14:37:45.208097+0000","last_clean":"2023-07-25T14:37:45.208097+0000","last_became_active":"2023-07-25T14:37:45.204540+0000","last_became_peered":"2023-07-25T14:37:45.204540+0000","last_unstale":"2023-07-25T14:37:45.208097+0000","last_undegraded":"2023-07-25T14:37:45.208097+0000","last_fullsized":"2023-07-25T14:37:45.208097+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T17:58:45.096276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-07-25T14:37:45.215140+0000","last_change":"2023-07-25T14:37:45.212379+0000","last_active":"2023-07-25T14:37:45.215140+0000","last_peered":"2023-07-25T14:37:45.215140+0000","last_clean":"2023-07-25T14:37:45.215140+0000","last_became_active":"2023-07-25T14:37:45.210115+0000","last_became_peered":"2023-07-25T14:37:45.210115+0000","last_unstale":"2023-07-25T14:37:45.215140+0000","last_undegraded":"2023-07-25T14:37:45.215140+0000","last_fullsized":"2023-07-25T14:37:45.215140+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T17:43:53.383591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-25T14:37:46.194311+0000","last_change":"2023-07-25T14:37:45.197514+0000","last_active":"2023-07-25T14:37:46.194311+0000","last_peered":"2023-07-25T14:37:46.194311+0000","last_clean":"2023-07-25T14:37:46.194311+0000","last_became_active":"2023-07-25T14:37:45.197076+0000","last_became_peered":"2023-07-25T14:37:45.197076+0000","last_unstale":"2023-07-25T14:37:46.194311+0000","last_undegraded":"2023-07-25T14:37:46.194311+0000","last_fullsized":"2023-07-25T14:37:46.194311+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T21:27:16.247632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-07-25T14:37:45.208858+0000","last_change":"2023-07-25T14:37:45.199774+0000","last_active":"2023-07-25T14:37:45.208858+0000","last_peered":"2023-07-25T14:37:45.208858+0000","last_clean":"2023-07-25T14:37:45.208858+0000","last_became_active":"2023-07-25T14:37:45.199408+0000","last_became_peered":"2023-07-25T14:37:45.199408+0000","last_unstale":"2023-07-25T14:37:45.208858+0000","last_undegraded":"2023-07-25T14:37:45.208858+0000","last_fullsized":"2023-07-25T14:37:45.208858+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T21:00:10.932528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-07-25T14:37:45.199242+0000","last_change":"2023-07-25T14:37:45.196344+0000","last_active":"2023-07-25T14:37:45.199242+0000","last_peered":"2023-07-25T14:37:45.199242+0000","last_clean":"2023-07-25T14:37:45.199242+0000","last_became_active":"2023-07-25T14:37:45.196000+0000","last_became_peered":"2023-07-25T14:37:45.196000+0000","last_unstale":"2023-07-25T14:37:45.199242+0000","last_undegraded":"2023-07-25T14:37:45.199242+0000","last_fullsized":"2023-07-25T14:37:45.199242+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T20:07:06.102185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-07-25T14:37:45.204628+0000","last_change":"2023-07-25T14:37:45.199696+0000","last_active":"2023-07-25T14:37:45.204628+0000","last_peered":"2023-07-25T14:37:45.204628+0000","last_clean":"2023-07-25T14:37:45.204628+0000","last_became_active":"2023-07-25T14:37:45.199345+0000","last_became_peered":"2023-07-25T14:37:45.199345+0000","last_unstale":"2023-07-25T14:37:45.204628+0000","last_undegraded":"2023-07-25T14:37:45.204628+0000","last_fullsized":"2023-07-25T14:37:45.204628+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T02:17:17.385824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-07-25T14:37:45.212057+0000","last_change":"2023-07-25T14:37:45.206383+0000","last_active":"2023-07-25T14:37:45.212057+0000","last_peered":"2023-07-25T14:37:45.212057+0000","last_clean":"2023-07-25T14:37:45.212057+0000","last_became_active":"2023-07-25T14:37:45.204409+0000","last_became_peered":"2023-07-25T14:37:45.204409+0000","last_unstale":"2023-07-25T14:37:45.212057+0000","last_undegraded":"2023-07-25T14:37:45.212057+0000","last_fullsized":"2023-07-25T14:37:45.212057+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T19:19:00.222021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-25T14:37:46.194594+0000","last_change":"2023-07-25T14:37:45.198072+0000","last_active":"2023-07-25T14:37:46.194594+0000","last_peered":"2023-07-25T14:37:46.194594+0000","last_clean":"2023-07-25T14:37:46.194594+0000","last_became_active":"2023-07-25T14:37:45.197648+0000","last_became_peered":"2023-07-25T14:37:45.197648+0000","last_unstale":"2023-07-25T14:37:46.194594+0000","last_undegraded":"2023-07-25T14:37:46.194594+0000","last_fullsized":"2023-07-25T14:37:46.194594+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T19:43:31.627741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-07-25T14:37:45.190439+0000","last_change":"2023-07-25T14:37:45.188472+0000","last_active":"2023-07-25T14:37:45.190439+0000","last_peered":"2023-07-25T14:37:45.190439+0000","last_clean":"2023-07-25T14:37:45.190439+0000","last_became_active":"2023-07-25T14:37:45.188105+0000","last_became_peered":"2023-07-25T14:37:45.188105+0000","last_unstale":"2023-07-25T14:37:45.190439+0000","last_undegraded":"2023-07-25T14:37:45.190439+0000","last_fullsized":"2023-07-25T14:37:45.190439+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:05:52.257256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-07-25T14:37:45.194941+0000","last_change":"2023-07-25T14:37:45.191002+0000","last_active":"2023-07-25T14:37:45.194941+0000","last_peered":"2023-07-25T14:37:45.194941+0000","last_clean":"2023-07-25T14:37:45.194941+0000","last_became_active":"2023-07-25T14:37:45.190713+0000","last_became_peered":"2023-07-25T14:37:45.190713+0000","last_unstale":"2023-07-25T14:37:45.194941+0000","last_undegraded":"2023-07-25T14:37:45.194941+0000","last_fullsized":"2023-07-25T14:37:45.194941+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T15:38:05.005620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-07-25T14:37:45.199432+0000","last_change":"2023-07-25T14:37:45.192719+0000","last_active":"2023-07-25T14:37:45.199432+0000","last_peered":"2023-07-25T14:37:45.199432+0000","last_clean":"2023-07-25T14:37:45.199432+0000","last_became_active":"2023-07-25T14:37:45.192419+0000","last_became_peered":"2023-07-25T14:37:45.192419+0000","last_unstale":"2023-07-25T14:37:45.199432+0000","last_undegraded":"2023-07-25T14:37:45.199432+0000","last_fullsized":"2023-07-25T14:37:45.199432+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T19:46:54.340200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-07-25T14:37:45.211942+0000","last_change":"2023-07-25T14:37:45.210664+0000","last_active":"2023-07-25T14:37:45.211942+0000","last_peered":"2023-07-25T14:37:45.211942+0000","last_clean":"2023-07-25T14:37:45.211942+0000","last_became_active":"2023-07-25T14:37:45.210376+0000","last_became_peered":"2023-07-25T14:37:45.210376+0000","last_unstale":"2023-07-25T14:37:45.211942+0000","last_undegraded":"2023-07-25T14:37:45.211942+0000","last_fullsized":"2023-07-25T14:37:45.211942+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T18:35:56.643497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-07-25T14:37:45.195068+0000","last_change":"2023-07-25T14:37:45.191718+0000","last_active":"2023-07-25T14:37:45.195068+0000","last_peered":"2023-07-25T14:37:45.195068+0000","last_clean":"2023-07-25T14:37:45.195068+0000","last_became_active":"2023-07-25T14:37:45.191401+0000","last_became_peered":"2023-07-25T14:37:45.191401+0000","last_unstale":"2023-07-25T14:37:45.195068+0000","last_undegraded":"2023-07-25T14:37:45.195068+0000","last_fullsized":"2023-07-25T14:37:45.195068+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T15:02:19.241116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-25T14:37:46.194627+0000","last_change":"2023-07-25T14:37:45.197329+0000","last_active":"2023-07-25T14:37:46.194627+0000","last_peered":"2023-07-25T14:37:46.194627+0000","last_clean":"2023-07-25T14:37:46.194627+0000","last_became_active":"2023-07-25T14:37:45.197048+0000","last_became_peered":"2023-07-25T14:37:45.197048+0000","last_unstale":"2023-07-25T14:37:46.194627+0000","last_undegraded":"2023-07-25T14:37:46.194627+0000","last_fullsized":"2023-07-25T14:37:46.194627+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T23:57:12.537826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-07-25T14:37:45.214250+0000","last_change":"2023-07-25T14:37:45.205950+0000","last_active":"2023-07-25T14:37:45.214250+0000","last_peered":"2023-07-25T14:37:45.214250+0000","last_clean":"2023-07-25T14:37:45.214250+0000","last_became_active":"2023-07-25T14:37:45.199388+0000","last_became_peered":"2023-07-25T14:37:45.199388+0000","last_unstale":"2023-07-25T14:37:45.214250+0000","last_undegraded":"2023-07-25T14:37:45.214250+0000","last_fullsized":"2023-07-25T14:37:45.214250+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T18:26:45.013075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-07-25T14:37:45.190599+0000","last_change":"2023-07-25T14:37:45.188465+0000","last_active":"2023-07-25T14:37:45.190599+0000","last_peered":"2023-07-25T14:37:45.190599+0000","last_clean":"2023-07-25T14:37:45.190599+0000","last_became_active":"2023-07-25T14:37:45.188186+0000","last_became_peered":"2023-07-25T14:37:45.188186+0000","last_unstale":"2023-07-25T14:37:45.190599+0000","last_undegraded":"2023-07-25T14:37:45.190599+0000","last_fullsized":"2023-07-25T14:37:45.190599+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T02:24:58.237137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-07-25T14:37:45.205064+0000","last_change":"2023-07-25T14:37:45.201384+0000","last_active":"2023-07-25T14:37:45.205064+0000","last_peered":"2023-07-25T14:37:45.205064+0000","last_clean":"2023-07-25T14:37:45.205064+0000","last_became_active":"2023-07-25T14:37:45.200847+0000","last_became_peered":"2023-07-25T14:37:45.200847+0000","last_unstale":"2023-07-25T14:37:45.205064+0000","last_undegraded":"2023-07-25T14:37:45.205064+0000","last_fullsized":"2023-07-25T14:37:45.205064+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T01:47:30.829451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-07-25T14:37:45.209597+0000","last_change":"2023-07-25T14:37:45.201941+0000","last_active":"2023-07-25T14:37:45.209597+0000","last_peered":"2023-07-25T14:37:45.209597+0000","last_clean":"2023-07-25T14:37:45.209597+0000","last_became_active":"2023-07-25T14:37:45.201640+0000","last_became_peered":"2023-07-25T14:37:45.201640+0000","last_unstale":"2023-07-25T14:37:45.209597+0000","last_undegraded":"2023-07-25T14:37:45.209597+0000","last_fullsized":"2023-07-25T14:37:45.209597+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T16:32:28.258692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-07-25T14:37:45.211753+0000","last_change":"2023-07-25T14:37:45.204317+0000","last_active":"2023-07-25T14:37:45.211753+0000","last_peered":"2023-07-25T14:37:45.211753+0000","last_clean":"2023-07-25T14:37:45.211753+0000","last_became_active":"2023-07-25T14:37:45.203583+0000","last_became_peered":"2023-07-25T14:37:45.203583+0000","last_unstale":"2023-07-25T14:37:45.211753+0000","last_undegraded":"2023-07-25T14:37:45.211753+0000","last_fullsized":"2023-07-25T14:37:45.211753+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T16:32:28.258692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-07-25T14:37:45.211964+0000","last_change":"2023-07-25T14:37:45.207314+0000","last_active":"2023-07-25T14:37:45.211964+0000","last_peered":"2023-07-25T14:37:45.211964+0000","last_clean":"2023-07-25T14:37:45.211964+0000","last_became_active":"2023-07-25T14:37:45.207030+0000","last_became_peered":"2023-07-25T14:37:45.207030+0000","last_unstale":"2023-07-25T14:37:45.211964+0000","last_undegraded":"2023-07-25T14:37:45.211964+0000","last_fullsized":"2023-07-25T14:37:45.211964+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T17:38:56.431932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-07-25T14:37:45.211849+0000","last_change":"2023-07-25T14:37:45.210109+0000","last_active":"2023-07-25T14:37:45.211849+0000","last_peered":"2023-07-25T14:37:45.211849+0000","last_clean":"2023-07-25T14:37:45.211849+0000","last_became_active":"2023-07-25T14:37:45.205229+0000","last_became_peered":"2023-07-25T14:37:45.205229+0000","last_unstale":"2023-07-25T14:37:45.211849+0000","last_undegraded":"2023-07-25T14:37:45.211849+0000","last_fullsized":"2023-07-25T14:37:45.211849+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T23:12:55.259842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-25T14:37:46.194827+0000","last_change":"2023-07-25T14:37:45.188464+0000","last_active":"2023-07-25T14:37:46.194827+0000","last_peered":"2023-07-25T14:37:46.194827+0000","last_clean":"2023-07-25T14:37:46.194827+0000","last_became_active":"2023-07-25T14:37:45.188020+0000","last_became_peered":"2023-07-25T14:37:45.188020+0000","last_unstale":"2023-07-25T14:37:46.194827+0000","last_undegraded":"2023-07-25T14:37:46.194827+0000","last_fullsized":"2023-07-25T14:37:46.194827+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T18:05:49.493471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-25T14:37:46.193411+0000","last_change":"2023-07-25T14:37:45.205460+0000","last_active":"2023-07-25T14:37:46.193411+0000","last_peered":"2023-07-25T14:37:46.193411+0000","last_clean":"2023-07-25T14:37:46.193411+0000","last_became_active":"2023-07-25T14:37:45.205174+0000","last_became_peered":"2023-07-25T14:37:45.205174+0000","last_unstale":"2023-07-25T14:37:46.193411+0000","last_undegraded":"2023-07-25T14:37:46.193411+0000","last_fullsized":"2023-07-25T14:37:46.193411+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:12:48.565660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-07-25T14:37:45.203857+0000","last_change":"2023-07-25T14:37:45.199014+0000","last_active":"2023-07-25T14:37:45.203857+0000","last_peered":"2023-07-25T14:37:45.203857+0000","last_clean":"2023-07-25T14:37:45.203857+0000","last_became_active":"2023-07-25T14:37:45.198610+0000","last_became_peered":"2023-07-25T14:37:45.198610+0000","last_unstale":"2023-07-25T14:37:45.203857+0000","last_undegraded":"2023-07-25T14:37:45.203857+0000","last_fullsized":"2023-07-25T14:37:45.203857+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T20:38:09.568965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-25T14:37:46.193069+0000","last_change":"2023-07-25T14:37:45.190492+0000","last_active":"2023-07-25T14:37:46.193069+0000","last_peered":"2023-07-25T14:37:46.193069+0000","last_clean":"2023-07-25T14:37:46.193069+0000","last_became_active":"2023-07-25T14:37:45.190205+0000","last_became_peered":"2023-07-25T14:37:45.190205+0000","last_unstale":"2023-07-25T14:37:46.193069+0000","last_undegraded":"2023-07-25T14:37:46.193069+0000","last_fullsized":"2023-07-25T14:37:46.193069+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T18:04:35.337446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-25T14:37:46.194331+0000","last_change":"2023-07-25T14:37:45.189887+0000","last_active":"2023-07-25T14:37:46.194331+0000","last_peered":"2023-07-25T14:37:46.194331+0000","last_clean":"2023-07-25T14:37:46.194331+0000","last_became_active":"2023-07-25T14:37:45.189544+0000","last_became_peered":"2023-07-25T14:37:45.189544+0000","last_unstale":"2023-07-25T14:37:46.194331+0000","last_undegraded":"2023-07-25T14:37:46.194331+0000","last_fullsized":"2023-07-25T14:37:46.194331+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T22:28:14.590354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-25T14:37:46.194255+0000","last_change":"2023-07-25T14:37:45.197332+0000","last_active":"2023-07-25T14:37:46.194255+0000","last_peered":"2023-07-25T14:37:46.194255+0000","last_clean":"2023-07-25T14:37:46.194255+0000","last_became_active":"2023-07-25T14:37:45.196749+0000","last_became_peered":"2023-07-25T14:37:45.196749+0000","last_unstale":"2023-07-25T14:37:46.194255+0000","last_undegraded":"2023-07-25T14:37:46.194255+0000","last_fullsized":"2023-07-25T14:37:46.194255+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T19:06:17.677254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-07-25T14:37:45.206004+0000","last_change":"2023-07-25T14:37:45.191972+0000","last_active":"2023-07-25T14:37:45.206004+0000","last_peered":"2023-07-25T14:37:45.206004+0000","last_clean":"2023-07-25T14:37:45.206004+0000","last_became_active":"2023-07-25T14:37:45.191704+0000","last_became_peered":"2023-07-25T14:37:45.191704+0000","last_unstale":"2023-07-25T14:37:45.206004+0000","last_undegraded":"2023-07-25T14:37:45.206004+0000","last_fullsized":"2023-07-25T14:37:45.206004+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T19:19:19.975606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-07-25T14:37:45.214270+0000","last_change":"2023-07-25T14:37:45.213847+0000","last_active":"2023-07-25T14:37:45.214270+0000","last_peered":"2023-07-25T14:37:45.214270+0000","last_clean":"2023-07-25T14:37:45.214270+0000","last_became_active":"2023-07-25T14:37:45.213456+0000","last_became_peered":"2023-07-25T14:37:45.213456+0000","last_unstale":"2023-07-25T14:37:45.214270+0000","last_undegraded":"2023-07-25T14:37:45.214270+0000","last_fullsized":"2023-07-25T14:37:45.214270+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T18:35:56.643497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"56'4","reported_seq":15,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-07-25T14:37:45.212174+0000","last_change":"2023-07-25T14:37:44.164114+0000","last_active":"2023-07-25T14:37:45.212174+0000","last_peered":"2023-07-25T14:37:45.212174+0000","last_clean":"2023-07-25T14:37:45.212174+0000","last_became_active":"2023-07-25T14:37:44.163807+0000","last_became_peered":"2023-07-25T14:37:44.163807+0000","last_unstale":"2023-07-25T14:37:45.212174+0000","last_undegraded":"2023-07-25T14:37:45.212174+0000","last_fullsized":"2023-07-25T14:37:45.212174+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T02:17:16.384209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-07-25T14:37:45.195047+0000","last_change":"2023-07-25T14:37:45.191918+0000","last_active":"2023-07-25T14:37:45.195047+0000","last_peered":"2023-07-25T14:37:45.195047+0000","last_clean":"2023-07-25T14:37:45.195047+0000","last_became_active":"2023-07-25T14:37:45.191341+0000","last_became_peered":"2023-07-25T14:37:45.191341+0000","last_unstale":"2023-07-25T14:37:45.195047+0000","last_undegraded":"2023-07-25T14:37:45.195047+0000","last_fullsized":"2023-07-25T14:37:45.195047+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T19:51:22.044360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"56'1","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-07-25T14:37:45.211898+0000","last_change":"2023-07-25T14:37:44.174028+0000","last_active":"2023-07-25T14:37:45.211898+0000","last_peered":"2023-07-25T14:37:45.211898+0000","last_clean":"2023-07-25T14:37:45.211898+0000","last_became_active":"2023-07-25T14:37:44.173193+0000","last_became_peered":"2023-07-25T14:37:44.173193+0000","last_unstale":"2023-07-25T14:37:45.211898+0000","last_undegraded":"2023-07-25T14:37:45.211898+0000","last_fullsized":"2023-07-25T14:37:45.211898+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T20:03:55.706767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-07-25T14:37:45.215058+0000","last_change":"2023-07-25T14:37:45.209338+0000","last_active":"2023-07-25T14:37:45.215058+0000","last_peered":"2023-07-25T14:37:45.215058+0000","last_clean":"2023-07-25T14:37:45.215058+0000","last_became_active":"2023-07-25T14:37:45.207168+0000","last_became_peered":"2023-07-25T14:37:45.207168+0000","last_unstale":"2023-07-25T14:37:45.215058+0000","last_undegraded":"2023-07-25T14:37:45.215058+0000","last_fullsized":"2023-07-25T14:37:45.215058+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T23:13:44.190013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"56'2","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-07-25T14:37:45.214688+0000","last_change":"2023-07-25T14:37:44.168052+0000","last_active":"2023-07-25T14:37:45.214688+0000","last_peered":"2023-07-25T14:37:45.214688+0000","last_clean":"2023-07-25T14:37:45.214688+0000","last_became_active":"2023-07-25T14:37:44.167768+0000","last_became_peered":"2023-07-25T14:37:44.167768+0000","last_unstale":"2023-07-25T14:37:45.214688+0000","last_undegraded":"2023-07-25T14:37:45.214688+0000","last_fullsized":"2023-07-25T14:37:45.214688+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T20:57:49.399287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-07-25T14:37:45.212038+0000","last_change":"2023-07-25T14:37:45.204504+0000","last_active":"2023-07-25T14:37:45.212038+0000","last_peered":"2023-07-25T14:37:45.212038+0000","last_clean":"2023-07-25T14:37:45.212038+0000","last_became_active":"2023-07-25T14:37:45.203141+0000","last_became_peered":"2023-07-25T14:37:45.203141+0000","last_unstale":"2023-07-25T14:37:45.212038+0000","last_undegraded":"2023-07-25T14:37:45.212038+0000","last_fullsized":"2023-07-25T14:37:45.212038+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T20:10:51.069463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"56'2","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-07-25T14:37:45.214845+0000","last_change":"2023-07-25T14:37:44.167404+0000","last_active":"2023-07-25T14:37:45.214845+0000","last_peered":"2023-07-25T14:37:45.214845+0000","last_clean":"2023-07-25T14:37:45.214845+0000","last_became_active":"2023-07-25T14:37:44.167157+0000","last_became_peered":"2023-07-25T14:37:44.167157+0000","last_unstale":"2023-07-25T14:37:45.214845+0000","last_undegraded":"2023-07-25T14:37:45.214845+0000","last_fullsized":"2023-07-25T14:37:45.214845+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T18:56:55.544261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-25T14:37:46.194448+0000","last_change":"2023-07-25T14:37:45.192672+0000","last_active":"2023-07-25T14:37:46.194448+0000","last_peered":"2023-07-25T14:37:46.194448+0000","last_clean":"2023-07-25T14:37:46.194448+0000","last_became_active":"2023-07-25T14:37:45.192426+0000","last_became_peered":"2023-07-25T14:37:45.192426+0000","last_unstale":"2023-07-25T14:37:46.194448+0000","last_undegraded":"2023-07-25T14:37:46.194448+0000","last_fullsized":"2023-07-25T14:37:46.194448+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:11:12.088493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"56'1","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-25T14:37:46.193238+0000","last_change":"2023-07-25T14:37:44.165894+0000","last_active":"2023-07-25T14:37:46.193238+0000","last_peered":"2023-07-25T14:37:46.193238+0000","last_clean":"2023-07-25T14:37:46.193238+0000","last_became_active":"2023-07-25T14:37:44.165121+0000","last_became_peered":"2023-07-25T14:37:44.165121+0000","last_unstale":"2023-07-25T14:37:46.193238+0000","last_undegraded":"2023-07-25T14:37:46.193238+0000","last_fullsized":"2023-07-25T14:37:46.193238+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T17:17:04.204095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-07-25T14:37:45.211059+0000","last_change":"2023-07-25T14:37:45.204924+0000","last_active":"2023-07-25T14:37:45.211059+0000","last_peered":"2023-07-25T14:37:45.211059+0000","last_clean":"2023-07-25T14:37:45.211059+0000","last_became_active":"2023-07-25T14:37:45.204636+0000","last_became_peered":"2023-07-25T14:37:45.204636+0000","last_unstale":"2023-07-25T14:37:45.211059+0000","last_undegraded":"2023-07-25T14:37:45.211059+0000","last_fullsized":"2023-07-25T14:37:45.211059+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T19:19:00.222021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"56'1","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-07-25T14:37:45.212469+0000","last_change":"2023-07-25T14:37:44.165997+0000","last_active":"2023-07-25T14:37:45.212469+0000","last_peered":"2023-07-25T14:37:45.212469+0000","last_clean":"2023-07-25T14:37:45.212469+0000","last_became_active":"2023-07-25T14:37:44.165724+0000","last_became_peered":"2023-07-25T14:37:44.165724+0000","last_unstale":"2023-07-25T14:37:45.212469+0000","last_undegraded":"2023-07-25T14:37:45.212469+0000","last_fullsized":"2023-07-25T14:37:45.212469+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T01:41:29.372296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-07-25T14:37:45.204614+0000","last_change":"2023-07-25T14:37:45.200734+0000","last_active":"2023-07-25T14:37:45.204614+0000","last_peered":"2023-07-25T14:37:45.204614+0000","last_clean":"2023-07-25T14:37:45.204614+0000","last_became_active":"2023-07-25T14:37:45.200452+0000","last_became_peered":"2023-07-25T14:37:45.200452+0000","last_unstale":"2023-07-25T14:37:45.204614+0000","last_undegraded":"2023-07-25T14:37:45.204614+0000","last_fullsized":"2023-07-25T14:37:45.204614+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T20:08:05.454710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-25T14:37:46.194389+0000","last_change":"2023-07-25T14:37:44.163784+0000","last_active":"2023-07-25T14:37:46.194389+0000","last_peered":"2023-07-25T14:37:46.194389+0000","last_clean":"2023-07-25T14:37:46.194389+0000","last_became_active":"2023-07-25T14:37:44.163566+0000","last_became_peered":"2023-07-25T14:37:44.163566+0000","last_unstale":"2023-07-25T14:37:46.194389+0000","last_undegraded":"2023-07-25T14:37:46.194389+0000","last_fullsized":"2023-07-25T14:37:46.194389+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T19:51:04.703988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-07-25T14:37:45.206013+0000","last_change":"2023-07-25T14:37:45.205124+0000","last_active":"2023-07-25T14:37:45.206013+0000","last_peered":"2023-07-25T14:37:45.206013+0000","last_clean":"2023-07-25T14:37:45.206013+0000","last_became_active":"2023-07-25T14:37:45.204730+0000","last_became_peered":"2023-07-25T14:37:45.204730+0000","last_unstale":"2023-07-25T14:37:45.206013+0000","last_undegraded":"2023-07-25T14:37:45.206013+0000","last_fullsized":"2023-07-25T14:37:45.206013+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T14:59:46.990745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-07-25T14:37:45.182506+0000","last_change":"2023-07-25T14:37:44.171926+0000","last_active":"2023-07-25T14:37:45.182506+0000","last_peered":"2023-07-25T14:37:45.182506+0000","last_clean":"2023-07-25T14:37:45.182506+0000","last_became_active":"2023-07-25T14:37:44.171610+0000","last_became_peered":"2023-07-25T14:37:44.171610+0000","last_unstale":"2023-07-25T14:37:45.182506+0000","last_undegraded":"2023-07-25T14:37:45.182506+0000","last_fullsized":"2023-07-25T14:37:45.182506+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T21:45:13.571992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-25T14:37:46.194925+0000","last_change":"2023-07-25T14:37:45.208126+0000","last_active":"2023-07-25T14:37:46.194925+0000","last_peered":"2023-07-25T14:37:46.194925+0000","last_clean":"2023-07-25T14:37:46.194925+0000","last_became_active":"2023-07-25T14:37:45.207856+0000","last_became_peered":"2023-07-25T14:37:45.207856+0000","last_unstale":"2023-07-25T14:37:46.194925+0000","last_undegraded":"2023-07-25T14:37:46.194925+0000","last_fullsized":"2023-07-25T14:37:46.194925+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T15:53:04.508285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-07-25T14:37:45.189522+0000","last_change":"2023-07-25T14:37:44.164773+0000","last_active":"2023-07-25T14:37:45.189522+0000","last_peered":"2023-07-25T14:37:45.189522+0000","last_clean":"2023-07-25T14:37:45.189522+0000","last_became_active":"2023-07-25T14:37:44.164480+0000","last_became_peered":"2023-07-25T14:37:44.164480+0000","last_unstale":"2023-07-25T14:37:45.189522+0000","last_undegraded":"2023-07-25T14:37:45.189522+0000","last_fullsized":"2023-07-25T14:37:45.189522+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T17:56:58.870648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-07-25T14:37:45.203997+0000","last_change":"2023-07-25T14:37:45.196449+0000","last_active":"2023-07-25T14:37:45.203997+0000","last_peered":"2023-07-25T14:37:45.203997+0000","last_clean":"2023-07-25T14:37:45.203997+0000","last_became_active":"2023-07-25T14:37:45.196172+0000","last_became_peered":"2023-07-25T14:37:45.196172+0000","last_unstale":"2023-07-25T14:37:45.203997+0000","last_undegraded":"2023-07-25T14:37:45.203997+0000","last_fullsized":"2023-07-25T14:37:45.203997+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:59:02.205817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-07-25T14:37:45.181583+0000","last_change":"2023-07-25T14:37:44.162751+0000","last_active":"2023-07-25T14:37:45.181583+0000","last_peered":"2023-07-25T14:37:45.181583+0000","last_clean":"2023-07-25T14:37:45.181583+0000","last_became_active":"2023-07-25T14:37:44.162037+0000","last_became_peered":"2023-07-25T14:37:44.162037+0000","last_unstale":"2023-07-25T14:37:45.181583+0000","last_undegraded":"2023-07-25T14:37:45.181583+0000","last_fullsized":"2023-07-25T14:37:45.181583+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T18:48:45.781579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-07-25T14:37:45.214431+0000","last_change":"2023-07-25T14:37:45.206751+0000","last_active":"2023-07-25T14:37:45.214431+0000","last_peered":"2023-07-25T14:37:45.214431+0000","last_clean":"2023-07-25T14:37:45.214431+0000","last_became_active":"2023-07-25T14:37:45.206422+0000","last_became_peered":"2023-07-25T14:37:45.206422+0000","last_unstale":"2023-07-25T14:37:45.214431+0000","last_undegraded":"2023-07-25T14:37:45.214431+0000","last_fullsized":"2023-07-25T14:37:45.214431+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T23:32:22.668719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"56'3","reported_seq":16,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-25T14:37:46.193503+0000","last_change":"2023-07-25T14:37:44.161397+0000","last_active":"2023-07-25T14:37:46.193503+0000","last_peered":"2023-07-25T14:37:46.193503+0000","last_clean":"2023-07-25T14:37:46.193503+0000","last_became_active":"2023-07-25T14:37:44.161134+0000","last_became_peered":"2023-07-25T14:37:44.161134+0000","last_unstale":"2023-07-25T14:37:46.193503+0000","last_undegraded":"2023-07-25T14:37:46.193503+0000","last_fullsized":"2023-07-25T14:37:46.193503+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T18:45:35.063301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-07-25T14:37:45.204652+0000","last_change":"2023-07-25T14:37:45.199815+0000","last_active":"2023-07-25T14:37:45.204652+0000","last_peered":"2023-07-25T14:37:45.204652+0000","last_clean":"2023-07-25T14:37:45.204652+0000","last_became_active":"2023-07-25T14:37:45.199555+0000","last_became_peered":"2023-07-25T14:37:45.199555+0000","last_unstale":"2023-07-25T14:37:45.204652+0000","last_undegraded":"2023-07-25T14:37:45.204652+0000","last_fullsized":"2023-07-25T14:37:45.204652+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T21:40:43.802154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"56'6","reported_seq":19,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-25T14:37:46.194783+0000","last_change":"2023-07-25T14:37:44.173212+0000","last_active":"2023-07-25T14:37:46.194783+0000","last_peered":"2023-07-25T14:37:46.194783+0000","last_clean":"2023-07-25T14:37:46.194783+0000","last_became_active":"2023-07-25T14:37:44.172950+0000","last_became_peered":"2023-07-25T14:37:44.172950+0000","last_unstale":"2023-07-25T14:37:46.194783+0000","last_undegraded":"2023-07-25T14:37:46.194783+0000","last_fullsized":"2023-07-25T14:37:46.194783+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T15:10:32.966409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-07-25T14:37:45.211646+0000","last_change":"2023-07-25T14:37:45.203546+0000","last_active":"2023-07-25T14:37:45.211646+0000","last_peered":"2023-07-25T14:37:45.211646+0000","last_clean":"2023-07-25T14:37:45.211646+0000","last_became_active":"2023-07-25T14:37:45.203115+0000","last_became_peered":"2023-07-25T14:37:45.203115+0000","last_unstale":"2023-07-25T14:37:45.211646+0000","last_undegraded":"2023-07-25T14:37:45.211646+0000","last_fullsized":"2023-07-25T14:37:45.211646+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T19:31:09.394550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"56'2","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-25T14:37:46.194736+0000","last_change":"2023-07-25T14:37:44.164563+0000","last_active":"2023-07-25T14:37:46.194736+0000","last_peered":"2023-07-25T14:37:46.194736+0000","last_clean":"2023-07-25T14:37:46.194736+0000","last_became_active":"2023-07-25T14:37:44.164255+0000","last_became_peered":"2023-07-25T14:37:44.164255+0000","last_unstale":"2023-07-25T14:37:46.194736+0000","last_undegraded":"2023-07-25T14:37:46.194736+0000","last_fullsized":"2023-07-25T14:37:46.194736+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T02:17:19.154863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-25T14:37:46.194542+0000","last_change":"2023-07-25T14:37:45.201081+0000","last_active":"2023-07-25T14:37:46.194542+0000","last_peered":"2023-07-25T14:37:46.194542+0000","last_clean":"2023-07-25T14:37:46.194542+0000","last_became_active":"2023-07-25T14:37:45.200738+0000","last_became_peered":"2023-07-25T14:37:45.200738+0000","last_unstale":"2023-07-25T14:37:46.194542+0000","last_undegraded":"2023-07-25T14:37:46.194542+0000","last_fullsized":"2023-07-25T14:37:46.194542+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T23:49:32.119140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-07-25T14:37:45.184766+0000","last_change":"2023-07-25T14:37:44.173296+0000","last_active":"2023-07-25T14:37:45.184766+0000","last_peered":"2023-07-25T14:37:45.184766+0000","last_clean":"2023-07-25T14:37:45.184766+0000","last_became_active":"2023-07-25T14:37:44.172957+0000","last_became_peered":"2023-07-25T14:37:44.172957+0000","last_unstale":"2023-07-25T14:37:45.184766+0000","last_undegraded":"2023-07-25T14:37:45.184766+0000","last_fullsized":"2023-07-25T14:37:45.184766+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T02:13:31.491403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-07-25T14:37:45.200512+0000","last_change":"2023-07-25T14:37:45.195068+0000","last_active":"2023-07-25T14:37:45.200512+0000","last_peered":"2023-07-25T14:37:45.200512+0000","last_clean":"2023-07-25T14:37:45.200512+0000","last_became_active":"2023-07-25T14:37:45.194820+0000","last_became_peered":"2023-07-25T14:37:45.194820+0000","last_unstale":"2023-07-25T14:37:45.200512+0000","last_undegraded":"2023-07-25T14:37:45.200512+0000","last_fullsized":"2023-07-25T14:37:45.200512+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T16:00:47.353753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-25T14:37:46.194412+0000","last_change":"2023-07-25T14:37:44.166150+0000","last_active":"2023-07-25T14:37:46.194412+0000","last_peered":"2023-07-25T14:37:46.194412+0000","last_clean":"2023-07-25T14:37:46.194412+0000","last_became_active":"2023-07-25T14:37:44.165851+0000","last_became_peered":"2023-07-25T14:37:44.165851+0000","last_unstale":"2023-07-25T14:37:46.194412+0000","last_undegraded":"2023-07-25T14:37:46.194412+0000","last_fullsized":"2023-07-25T14:37:46.194412+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T22:41:47.199010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-07-25T14:37:45.197026+0000","last_change":"2023-07-25T14:37:45.193890+0000","last_active":"2023-07-25T14:37:45.197026+0000","last_peered":"2023-07-25T14:37:45.197026+0000","last_clean":"2023-07-25T14:37:45.197026+0000","last_became_active":"2023-07-25T14:37:45.193634+0000","last_became_peered":"2023-07-25T14:37:45.193634+0000","last_unstale":"2023-07-25T14:37:45.197026+0000","last_undegraded":"2023-07-25T14:37:45.197026+0000","last_fullsized":"2023-07-25T14:37:45.197026+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:46:08.647591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"56'8","reported_seq":19,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-07-25T14:37:45.212342+0000","last_change":"2023-07-25T14:37:44.164996+0000","last_active":"2023-07-25T14:37:45.212342+0000","last_peered":"2023-07-25T14:37:45.212342+0000","last_clean":"2023-07-25T14:37:45.212342+0000","last_became_active":"2023-07-25T14:37:44.164753+0000","last_became_peered":"2023-07-25T14:37:44.164753+0000","last_unstale":"2023-07-25T14:37:45.212342+0000","last_undegraded":"2023-07-25T14:37:45.212342+0000","last_fullsized":"2023-07-25T14:37:45.212342+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T15:59:02.577424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-07-25T14:37:45.199560+0000","last_change":"2023-07-25T14:37:45.192838+0000","last_active":"2023-07-25T14:37:45.199560+0000","last_peered":"2023-07-25T14:37:45.199560+0000","last_clean":"2023-07-25T14:37:45.199560+0000","last_became_active":"2023-07-25T14:37:45.192552+0000","last_became_peered":"2023-07-25T14:37:45.192552+0000","last_unstale":"2023-07-25T14:37:45.199560+0000","last_undegraded":"2023-07-25T14:37:45.199560+0000","last_fullsized":"2023-07-25T14:37:45.199560+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T02:34:56.357570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"56'2","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-07-25T14:37:45.214496+0000","last_change":"2023-07-25T14:37:44.163016+0000","last_active":"2023-07-25T14:37:45.214496+0000","last_peered":"2023-07-25T14:37:45.214496+0000","last_clean":"2023-07-25T14:37:45.214496+0000","last_became_active":"2023-07-25T14:37:44.161974+0000","last_became_peered":"2023-07-25T14:37:44.161974+0000","last_unstale":"2023-07-25T14:37:45.214496+0000","last_undegraded":"2023-07-25T14:37:45.214496+0000","last_fullsized":"2023-07-25T14:37:45.214496+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T15:03:37.728247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-25T14:37:46.194637+0000","last_change":"2023-07-25T14:37:45.198281+0000","last_active":"2023-07-25T14:37:46.194637+0000","last_peered":"2023-07-25T14:37:46.194637+0000","last_clean":"2023-07-25T14:37:46.194637+0000","last_became_active":"2023-07-25T14:37:45.197975+0000","last_became_peered":"2023-07-25T14:37:45.197975+0000","last_unstale":"2023-07-25T14:37:46.194637+0000","last_undegraded":"2023-07-25T14:37:46.194637+0000","last_fullsized":"2023-07-25T14:37:46.194637+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T21:35:18.900476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-25T14:37:46.195047+0000","last_change":"2023-07-25T14:37:44.166254+0000","last_active":"2023-07-25T14:37:46.195047+0000","last_peered":"2023-07-25T14:37:46.195047+0000","last_clean":"2023-07-25T14:37:46.195047+0000","last_became_active":"2023-07-25T14:37:44.165974+0000","last_became_peered":"2023-07-25T14:37:44.165974+0000","last_unstale":"2023-07-25T14:37:46.195047+0000","last_undegraded":"2023-07-25T14:37:46.195047+0000","last_fullsized":"2023-07-25T14:37:46.195047+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:39:29.780742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-07-25T14:37:45.212947+0000","last_change":"2023-07-25T14:37:45.209704+0000","last_active":"2023-07-25T14:37:45.212947+0000","last_peered":"2023-07-25T14:37:45.212947+0000","last_clean":"2023-07-25T14:37:45.212947+0000","last_became_active":"2023-07-25T14:37:45.209391+0000","last_became_peered":"2023-07-25T14:37:45.209391+0000","last_unstale":"2023-07-25T14:37:45.212947+0000","last_undegraded":"2023-07-25T14:37:45.212947+0000","last_fullsized":"2023-07-25T14:37:45.212947+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T01:47:30.829451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-07-25T14:37:45.182024+0000","last_change":"2023-07-25T14:37:44.166101+0000","last_active":"2023-07-25T14:37:45.182024+0000","last_peered":"2023-07-25T14:37:45.182024+0000","last_clean":"2023-07-25T14:37:45.182024+0000","last_became_active":"2023-07-25T14:37:44.165823+0000","last_became_peered":"2023-07-25T14:37:44.165823+0000","last_unstale":"2023-07-25T14:37:45.182024+0000","last_undegraded":"2023-07-25T14:37:45.182024+0000","last_fullsized":"2023-07-25T14:37:45.182024+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T01:57:00.819850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-07-25T14:37:45.212408+0000","last_change":"2023-07-25T14:37:45.207757+0000","last_active":"2023-07-25T14:37:45.212408+0000","last_peered":"2023-07-25T14:37:45.212408+0000","last_clean":"2023-07-25T14:37:45.212408+0000","last_became_active":"2023-07-25T14:37:45.204097+0000","last_became_peered":"2023-07-25T14:37:45.204097+0000","last_unstale":"2023-07-25T14:37:45.212408+0000","last_undegraded":"2023-07-25T14:37:45.212408+0000","last_fullsized":"2023-07-25T14:37:45.212408+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T01:27:38.547525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-07-25T14:37:45.182160+0000","last_change":"2023-07-25T14:37:44.170019+0000","last_active":"2023-07-25T14:37:45.182160+0000","last_peered":"2023-07-25T14:37:45.182160+0000","last_clean":"2023-07-25T14:37:45.182160+0000","last_became_active":"2023-07-25T14:37:44.169764+0000","last_became_peered":"2023-07-25T14:37:44.169764+0000","last_unstale":"2023-07-25T14:37:45.182160+0000","last_undegraded":"2023-07-25T14:37:45.182160+0000","last_fullsized":"2023-07-25T14:37:45.182160+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T18:16:16.739665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-07-25T14:37:45.196996+0000","last_change":"2023-07-25T14:37:45.192706+0000","last_active":"2023-07-25T14:37:45.196996+0000","last_peered":"2023-07-25T14:37:45.196996+0000","last_clean":"2023-07-25T14:37:45.196996+0000","last_became_active":"2023-07-25T14:37:45.191283+0000","last_became_peered":"2023-07-25T14:37:45.191283+0000","last_unstale":"2023-07-25T14:37:45.196996+0000","last_undegraded":"2023-07-25T14:37:45.196996+0000","last_fullsized":"2023-07-25T14:37:45.196996+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T18:40:52.285929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-07-25T14:37:45.181839+0000","last_change":"2023-07-25T14:37:44.171694+0000","last_active":"2023-07-25T14:37:45.181839+0000","last_peered":"2023-07-25T14:37:45.181839+0000","last_clean":"2023-07-25T14:37:45.181839+0000","last_became_active":"2023-07-25T14:37:44.171465+0000","last_became_peered":"2023-07-25T14:37:44.171465+0000","last_unstale":"2023-07-25T14:37:45.181839+0000","last_undegraded":"2023-07-25T14:37:45.181839+0000","last_fullsized":"2023-07-25T14:37:45.181839+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T01:50:20.811880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-07-25T14:37:45.214855+0000","last_change":"2023-07-25T14:37:45.208487+0000","last_active":"2023-07-25T14:37:45.214855+0000","last_peered":"2023-07-25T14:37:45.214855+0000","last_clean":"2023-07-25T14:37:45.214855+0000","last_became_active":"2023-07-25T14:37:45.207037+0000","last_became_peered":"2023-07-25T14:37:45.207037+0000","last_unstale":"2023-07-25T14:37:45.214855+0000","last_undegraded":"2023-07-25T14:37:45.214855+0000","last_fullsized":"2023-07-25T14:37:45.214855+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T02:27:18.369690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-25T14:37:46.194444+0000","last_change":"2023-07-25T14:37:44.165012+0000","last_active":"2023-07-25T14:37:46.194444+0000","last_peered":"2023-07-25T14:37:46.194444+0000","last_clean":"2023-07-25T14:37:46.194444+0000","last_became_active":"2023-07-25T14:37:44.164759+0000","last_became_peered":"2023-07-25T14:37:44.164759+0000","last_unstale":"2023-07-25T14:37:46.194444+0000","last_undegraded":"2023-07-25T14:37:46.194444+0000","last_fullsized":"2023-07-25T14:37:46.194444+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T18:31:17.913112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-25T14:37:46.194715+0000","last_change":"2023-07-25T14:37:45.191681+0000","last_active":"2023-07-25T14:37:46.194715+0000","last_peered":"2023-07-25T14:37:46.194715+0000","last_clean":"2023-07-25T14:37:46.194715+0000","last_became_active":"2023-07-25T14:37:45.188974+0000","last_became_peered":"2023-07-25T14:37:45.188974+0000","last_unstale":"2023-07-25T14:37:46.194715+0000","last_undegraded":"2023-07-25T14:37:46.194715+0000","last_fullsized":"2023-07-25T14:37:46.194715+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T15:58:36.814288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-07-25T14:37:45.189040+0000","last_change":"2023-07-25T14:37:44.164983+0000","last_active":"2023-07-25T14:37:45.189040+0000","last_peered":"2023-07-25T14:37:45.189040+0000","last_clean":"2023-07-25T14:37:45.189040+0000","last_became_active":"2023-07-25T14:37:44.164413+0000","last_became_peered":"2023-07-25T14:37:44.164413+0000","last_unstale":"2023-07-25T14:37:45.189040+0000","last_undegraded":"2023-07-25T14:37:45.189040+0000","last_fullsized":"2023-07-25T14:37:45.189040+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T16:46:50.016770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-07-25T14:37:45.205973+0000","last_change":"2023-07-25T14:37:45.192970+0000","last_active":"2023-07-25T14:37:45.205973+0000","last_peered":"2023-07-25T14:37:45.205973+0000","last_clean":"2023-07-25T14:37:45.205973+0000","last_became_active":"2023-07-25T14:37:45.192666+0000","last_became_peered":"2023-07-25T14:37:45.192666+0000","last_unstale":"2023-07-25T14:37:45.205973+0000","last_undegraded":"2023-07-25T14:37:45.205973+0000","last_fullsized":"2023-07-25T14:37:45.205973+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T20:26:22.473303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-07-25T14:37:45.185698+0000","last_change":"2023-07-25T14:37:44.168526+0000","last_active":"2023-07-25T14:37:45.185698+0000","last_peered":"2023-07-25T14:37:45.185698+0000","last_clean":"2023-07-25T14:37:45.185698+0000","last_became_active":"2023-07-25T14:37:44.168336+0000","last_became_peered":"2023-07-25T14:37:44.168336+0000","last_unstale":"2023-07-25T14:37:45.185698+0000","last_undegraded":"2023-07-25T14:37:45.185698+0000","last_fullsized":"2023-07-25T14:37:45.185698+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T20:47:12.483369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-07-25T14:37:45.204892+0000","last_change":"2023-07-25T14:37:45.202784+0000","last_active":"2023-07-25T14:37:45.204892+0000","last_peered":"2023-07-25T14:37:45.204892+0000","last_clean":"2023-07-25T14:37:45.204892+0000","last_became_active":"2023-07-25T14:37:45.202515+0000","last_became_peered":"2023-07-25T14:37:45.202515+0000","last_unstale":"2023-07-25T14:37:45.204892+0000","last_undegraded":"2023-07-25T14:37:45.204892+0000","last_fullsized":"2023-07-25T14:37:45.204892+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T16:50:40.287491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-07-25T14:37:45.192206+0000","last_change":"2023-07-25T14:37:44.170162+0000","last_active":"2023-07-25T14:37:45.192206+0000","last_peered":"2023-07-25T14:37:45.192206+0000","last_clean":"2023-07-25T14:37:45.192206+0000","last_became_active":"2023-07-25T14:37:44.169805+0000","last_became_peered":"2023-07-25T14:37:44.169805+0000","last_unstale":"2023-07-25T14:37:45.192206+0000","last_undegraded":"2023-07-25T14:37:45.192206+0000","last_fullsized":"2023-07-25T14:37:45.192206+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T23:12:54.258226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":82,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-07-25T14:37:45.182286+0000","last_change":"2023-07-25T14:35:34.370772+0000","last_active":"2023-07-25T14:37:45.182286+0000","last_peered":"2023-07-25T14:37:45.182286+0000","last_clean":"2023-07-25T14:37:45.182286+0000","last_became_active":"2023-07-25T14:35:34.370549+0000","last_became_peered":"2023-07-25T14:35:34.370549+0000","last_unstale":"2023-07-25T14:37:45.182286+0000","last_undegraded":"2023-07-25T14:37:45.182286+0000","last_fullsized":"2023-07-25T14:37:45.182286+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_clean_scrub_stamp":"2023-07-25T14:35:33.358525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T15:05:35.187618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-25T14:37:46.194747+0000","last_change":"2023-07-25T14:37:45.194744+0000","last_active":"2023-07-25T14:37:46.194747+0000","last_peered":"2023-07-25T14:37:46.194747+0000","last_clean":"2023-07-25T14:37:46.194747+0000","last_became_active":"2023-07-25T14:37:45.194393+0000","last_became_peered":"2023-07-25T14:37:45.194393+0000","last_unstale":"2023-07-25T14:37:46.194747+0000","last_undegraded":"2023-07-25T14:37:46.194747+0000","last_fullsized":"2023-07-25T14:37:46.194747+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:38:23.175060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"56'1","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-07-25T14:37:45.214855+0000","last_change":"2023-07-25T14:37:44.166450+0000","last_active":"2023-07-25T14:37:45.214855+0000","last_peered":"2023-07-25T14:37:45.214855+0000","last_clean":"2023-07-25T14:37:45.214855+0000","last_became_active":"2023-07-25T14:37:44.165513+0000","last_became_peered":"2023-07-25T14:37:44.165513+0000","last_unstale":"2023-07-25T14:37:45.214855+0000","last_undegraded":"2023-07-25T14:37:45.214855+0000","last_fullsized":"2023-07-25T14:37:45.214855+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T01:29:48.397100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":82,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-07-25T14:37:45.181223+0000","last_change":"2023-07-25T14:35:35.321055+0000","last_active":"2023-07-25T14:37:45.181223+0000","last_peered":"2023-07-25T14:37:45.181223+0000","last_clean":"2023-07-25T14:37:45.181223+0000","last_became_active":"2023-07-25T14:35:35.320739+0000","last_became_peered":"2023-07-25T14:35:35.320739+0000","last_unstale":"2023-07-25T14:37:45.181223+0000","last_undegraded":"2023-07-25T14:37:45.181223+0000","last_fullsized":"2023-07-25T14:37:45.181223+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_clean_scrub_stamp":"2023-07-25T14:35:33.358525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:46:08.478701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-25T14:37:46.193182+0000","last_change":"2023-07-25T14:37:45.197932+0000","last_active":"2023-07-25T14:37:46.193182+0000","last_peered":"2023-07-25T14:37:46.193182+0000","last_clean":"2023-07-25T14:37:46.193182+0000","last_became_active":"2023-07-25T14:37:45.197610+0000","last_became_peered":"2023-07-25T14:37:45.197610+0000","last_unstale":"2023-07-25T14:37:46.193182+0000","last_undegraded":"2023-07-25T14:37:46.193182+0000","last_fullsized":"2023-07-25T14:37:46.193182+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T23:27:34.225061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-07-25T14:37:45.184900+0000","last_change":"2023-07-25T14:37:44.166137+0000","last_active":"2023-07-25T14:37:45.184900+0000","last_peered":"2023-07-25T14:37:45.184900+0000","last_clean":"2023-07-25T14:37:45.184900+0000","last_became_active":"2023-07-25T14:37:44.165836+0000","last_became_peered":"2023-07-25T14:37:44.165836+0000","last_unstale":"2023-07-25T14:37:45.184900+0000","last_undegraded":"2023-07-25T14:37:45.184900+0000","last_fullsized":"2023-07-25T14:37:45.184900+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T21:37:27.151589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":92,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-25T14:37:46.195053+0000","last_change":"2023-07-25T14:35:35.321057+0000","last_active":"2023-07-25T14:37:46.195053+0000","last_peered":"2023-07-25T14:37:46.195053+0000","last_clean":"2023-07-25T14:37:46.195053+0000","last_became_active":"2023-07-25T14:35:35.320751+0000","last_became_peered":"2023-07-25T14:35:35.320751+0000","last_unstale":"2023-07-25T14:37:46.195053+0000","last_undegraded":"2023-07-25T14:37:46.195053+0000","last_fullsized":"2023-07-25T14:37:46.195053+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_clean_scrub_stamp":"2023-07-25T14:35:33.358525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T19:16:45.350885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-25T14:37:46.193205+0000","last_change":"2023-07-25T14:37:45.195875+0000","last_active":"2023-07-25T14:37:46.193205+0000","last_peered":"2023-07-25T14:37:46.193205+0000","last_clean":"2023-07-25T14:37:46.193205+0000","last_became_active":"2023-07-25T14:37:45.195516+0000","last_became_peered":"2023-07-25T14:37:45.195516+0000","last_unstale":"2023-07-25T14:37:46.193205+0000","last_undegraded":"2023-07-25T14:37:46.193205+0000","last_fullsized":"2023-07-25T14:37:46.193205+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T20:02:34.031523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"56'2","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-07-25T14:37:45.208861+0000","last_change":"2023-07-25T14:37:44.167253+0000","last_active":"2023-07-25T14:37:45.208861+0000","last_peered":"2023-07-25T14:37:45.208861+0000","last_clean":"2023-07-25T14:37:45.208861+0000","last_became_active":"2023-07-25T14:37:44.166775+0000","last_became_peered":"2023-07-25T14:37:44.166775+0000","last_unstale":"2023-07-25T14:37:45.208861+0000","last_undegraded":"2023-07-25T14:37:45.208861+0000","last_fullsized":"2023-07-25T14:37:45.208861+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T20:58:06.557150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":82,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-07-25T14:37:45.186603+0000","last_change":"2023-07-25T14:35:35.321201+0000","last_active":"2023-07-25T14:37:45.186603+0000","last_peered":"2023-07-25T14:37:45.186603+0000","last_clean":"2023-07-25T14:37:45.186603+0000","last_became_active":"2023-07-25T14:35:35.320728+0000","last_became_peered":"2023-07-25T14:35:35.320728+0000","last_unstale":"2023-07-25T14:37:45.186603+0000","last_undegraded":"2023-07-25T14:37:45.186603+0000","last_fullsized":"2023-07-25T14:37:45.186603+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_clean_scrub_stamp":"2023-07-25T14:35:33.358525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:39:58.844073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-25T14:37:46.193266+0000","last_change":"2023-07-25T14:37:45.209554+0000","last_active":"2023-07-25T14:37:46.193266+0000","last_peered":"2023-07-25T14:37:46.193266+0000","last_clean":"2023-07-25T14:37:46.193266+0000","last_became_active":"2023-07-25T14:37:45.209319+0000","last_became_peered":"2023-07-25T14:37:45.209319+0000","last_unstale":"2023-07-25T14:37:46.193266+0000","last_undegraded":"2023-07-25T14:37:46.193266+0000","last_fullsized":"2023-07-25T14:37:46.193266+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T17:58:09.953558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-25T14:37:46.195267+0000","last_change":"2023-07-25T14:37:44.172803+0000","last_active":"2023-07-25T14:37:46.195267+0000","last_peered":"2023-07-25T14:37:46.195267+0000","last_clean":"2023-07-25T14:37:46.195267+0000","last_became_active":"2023-07-25T14:37:44.172512+0000","last_became_peered":"2023-07-25T14:37:44.172512+0000","last_unstale":"2023-07-25T14:37:46.195267+0000","last_undegraded":"2023-07-25T14:37:46.195267+0000","last_fullsized":"2023-07-25T14:37:46.195267+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T23:11:40.579145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":82,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-07-25T14:37:45.192057+0000","last_change":"2023-07-25T14:35:35.321448+0000","last_active":"2023-07-25T14:37:45.192057+0000","last_peered":"2023-07-25T14:37:45.192057+0000","last_clean":"2023-07-25T14:37:45.192057+0000","last_became_active":"2023-07-25T14:35:35.320830+0000","last_became_peered":"2023-07-25T14:35:35.320830+0000","last_unstale":"2023-07-25T14:37:45.192057+0000","last_undegraded":"2023-07-25T14:37:45.192057+0000","last_fullsized":"2023-07-25T14:37:45.192057+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_clean_scrub_stamp":"2023-07-25T14:35:33.358525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T20:35:58.782356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-25T14:37:46.193206+0000","last_change":"2023-07-25T14:37:45.207283+0000","last_active":"2023-07-25T14:37:46.193206+0000","last_peered":"2023-07-25T14:37:46.193206+0000","last_clean":"2023-07-25T14:37:46.193206+0000","last_became_active":"2023-07-25T14:37:45.206954+0000","last_became_peered":"2023-07-25T14:37:45.206954+0000","last_unstale":"2023-07-25T14:37:46.193206+0000","last_undegraded":"2023-07-25T14:37:46.193206+0000","last_fullsized":"2023-07-25T14:37:46.193206+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T15:01:23.982072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-07-25T14:37:45.184370+0000","last_change":"2023-07-25T14:37:44.172365+0000","last_active":"2023-07-25T14:37:45.184370+0000","last_peered":"2023-07-25T14:37:45.184370+0000","last_clean":"2023-07-25T14:37:45.184370+0000","last_became_active":"2023-07-25T14:37:44.172127+0000","last_became_peered":"2023-07-25T14:37:44.172127+0000","last_unstale":"2023-07-25T14:37:45.184370+0000","last_undegraded":"2023-07-25T14:37:45.184370+0000","last_fullsized":"2023-07-25T14:37:45.184370+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:42:08.629066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":232,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-07-25T14:37:45.186468+0000","last_change":"2023-07-25T14:35:34.372381+0000","last_active":"2023-07-25T14:37:45.186468+0000","last_peered":"2023-07-25T14:37:45.186468+0000","last_clean":"2023-07-25T14:37:45.186468+0000","last_became_active":"2023-07-25T14:35:34.371110+0000","last_became_peered":"2023-07-25T14:35:34.371110+0000","last_unstale":"2023-07-25T14:37:45.186468+0000","last_undegraded":"2023-07-25T14:37:45.186468+0000","last_fullsized":"2023-07-25T14:37:45.186468+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_clean_scrub_stamp":"2023-07-25T14:35:33.358525+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T15:58:36.567145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":82,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-25T14:37:46.194610+0000","last_change":"2023-07-25T14:35:34.370121+0000","last_active":"2023-07-25T14:37:46.194610+0000","last_peered":"2023-07-25T14:37:46.194610+0000","last_clean":"2023-07-25T14:37:46.194610+0000","last_became_active":"2023-07-25T14:35:34.369795+0000","last_became_peered":"2023-07-25T14:35:34.369795+0000","last_unstale":"2023-07-25T14:37:46.194610+0000","last_undegraded":"2023-07-25T14:37:46.194610+0000","last_fullsized":"2023-07-25T14:37:46.194610+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_clean_scrub_stamp":"2023-07-25T14:35:33.358525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:09:02.653517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-07-25T14:37:45.210773+0000","last_change":"2023-07-25T14:37:45.204523+0000","last_active":"2023-07-25T14:37:45.210773+0000","last_peered":"2023-07-25T14:37:45.210773+0000","last_clean":"2023-07-25T14:37:45.210773+0000","last_became_active":"2023-07-25T14:37:45.204095+0000","last_became_peered":"2023-07-25T14:37:45.204095+0000","last_unstale":"2023-07-25T14:37:45.210773+0000","last_undegraded":"2023-07-25T14:37:45.210773+0000","last_fullsized":"2023-07-25T14:37:45.210773+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T01:27:38.547525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"56'1","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-07-25T14:37:45.208742+0000","last_change":"2023-07-25T14:37:44.164092+0000","last_active":"2023-07-25T14:37:45.208742+0000","last_peered":"2023-07-25T14:37:45.208742+0000","last_clean":"2023-07-25T14:37:45.208742+0000","last_became_active":"2023-07-25T14:37:44.163068+0000","last_became_peered":"2023-07-25T14:37:44.163068+0000","last_unstale":"2023-07-25T14:37:45.208742+0000","last_undegraded":"2023-07-25T14:37:45.208742+0000","last_fullsized":"2023-07-25T14:37:45.208742+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T01:56:18.402880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":84,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-07-25T14:37:46.193085+0000","last_change":"2023-07-25T14:35:34.371737+0000","last_active":"2023-07-25T14:37:46.193085+0000","last_peered":"2023-07-25T14:37:46.193085+0000","last_clean":"2023-07-25T14:37:46.193085+0000","last_became_active":"2023-07-25T14:35:34.371411+0000","last_became_peered":"2023-07-25T14:35:34.371411+0000","last_unstale":"2023-07-25T14:37:46.193085+0000","last_undegraded":"2023-07-25T14:37:46.193085+0000","last_fullsized":"2023-07-25T14:37:46.193085+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_clean_scrub_stamp":"2023-07-25T14:35:33.358525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T18:51:20.997555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-07-25T14:37:45.211833+0000","last_change":"2023-07-25T14:37:45.204043+0000","last_active":"2023-07-25T14:37:45.211833+0000","last_peered":"2023-07-25T14:37:45.211833+0000","last_clean":"2023-07-25T14:37:45.211833+0000","last_became_active":"2023-07-25T14:37:45.203102+0000","last_became_peered":"2023-07-25T14:37:45.203102+0000","last_unstale":"2023-07-25T14:37:45.211833+0000","last_undegraded":"2023-07-25T14:37:45.211833+0000","last_fullsized":"2023-07-25T14:37:45.211833+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T20:54:34.527996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"56'2","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-07-25T14:37:45.215457+0000","last_change":"2023-07-25T14:37:44.167732+0000","last_active":"2023-07-25T14:37:45.215457+0000","last_peered":"2023-07-25T14:37:45.215457+0000","last_clean":"2023-07-25T14:37:45.215457+0000","last_became_active":"2023-07-25T14:37:44.167418+0000","last_became_peered":"2023-07-25T14:37:44.167418+0000","last_unstale":"2023-07-25T14:37:45.215457+0000","last_undegraded":"2023-07-25T14:37:45.215457+0000","last_fullsized":"2023-07-25T14:37:45.215457+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T20:59:35.521705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":88,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-07-25T14:37:45.189437+0000","last_change":"2023-07-25T14:35:34.371347+0000","last_active":"2023-07-25T14:37:45.189437+0000","last_peered":"2023-07-25T14:37:45.189437+0000","last_clean":"2023-07-25T14:37:45.189437+0000","last_became_active":"2023-07-25T14:35:34.371044+0000","last_became_peered":"2023-07-25T14:35:34.371044+0000","last_unstale":"2023-07-25T14:37:45.189437+0000","last_undegraded":"2023-07-25T14:37:45.189437+0000","last_fullsized":"2023-07-25T14:37:45.189437+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_clean_scrub_stamp":"2023-07-25T14:35:33.358525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T18:15:08.127022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64510,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574879,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27752,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344088,"statfs":{"total":96636764160,"available":96608346112,"internally_reserved":0,"allocated":749568,"data_stored":910837,"data_compressed":32255,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jul 25 14:37:40 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.46999999999999997,"15min":0.46200000000000002},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.84299999999999997,"15min":0.90200000000000002},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.70699999999999996,"5min":9.1600000000000001,"15min":9.1600000000000001},"last":0.48299999999999998}]},{"osd":1,"last update":"Tue Jul 25 14:37:40 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.59299999999999997,"15min":0.60699999999999998},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.82699999999999996,"5min":1.5009999999999999,"15min":1.5009999999999999},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.61099999999999999,"15min":0.61799999999999999},"min":{"1min":0.45600000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.81100000000000005,"5min":1.526,"15min":1.526},"last":0.58699999999999997}]},{"osd":2,"last update":"Tue Jul 25 14:37:40 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.54500000000000004,"15min":0.55400000000000005},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.71599999999999997,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.82899999999999996,"15min":0.873},"min":{"1min":0.38300000000000001,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.95399999999999996,"5min":8.1739999999999995,"15min":8.1739999999999995},"last":0.71099999999999997}]},{"osd":3,"last update":"Tue Jul 25 14:37:40 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.82499999999999996,"15min":0.875},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.81599999999999995,"5min":7.2279999999999998,"15min":7.2279999999999998},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.89600000000000002,"15min":0.93999999999999995},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.0029999999999999,"5min":7.1870000000000003,"15min":7.1870000000000003},"last":0.56299999999999994}]},{"osd":4,"last update":"Tue Jul 25 14:37:40 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.57999999999999996,"15min":0.57799999999999996},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.76600000000000001,"5min":1.254,"15min":1.254},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.59299999999999997,"15min":0.59599999999999997},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.877,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.68300000000000005}]},{"osd":5,"last update":"Tue Jul 25 14:37:40 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.748},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.52600000000000002,"5min":0.501,"15min":0.501},"max":{"1min":0.84699999999999998,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.70099999999999996}]},{"osd":6,"last update":"Tue Jul 25 14:37:40 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.45800000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.88,"5min":1.286,"15min":1.286},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.64500000000000002,"15min":0.64400000000000002},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.72799999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574878,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27696,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344144,"statfs":{"total":96636764160,"available":96608403456,"internally_reserved":0,"allocated":684032,"data_stored":319945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jul 25 14:37:35 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.54200000000000004,"15min":0.54800000000000004},"min":{"1min":0.32300000000000001,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.73199999999999998,"5min":1.9370000000000001,"15min":1.9370000000000001},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.56000000000000005,"15min":0.56599999999999995},"min":{"1min":0.39700000000000002,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.77200000000000002,"5min":2.6779999999999999,"15min":2.6779999999999999},"last":0.59899999999999998}]},{"osd":1,"last update":"Tue Jul 25 14:37:35 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.53500000000000003,"15min":0.54100000000000004},"min":{"1min":0.34599999999999997,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.70799999999999996,"5min":2.5720000000000001,"15min":2.5720000000000001},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.503,"5min":0.54500000000000004,"15min":0.55200000000000005},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.64800000000000002,"5min":1.6259999999999999,"15min":1.6259999999999999},"last":0.45100000000000001}]},{"osd":2,"last update":"Tue Jul 25 14:37:35 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.52700000000000002,"15min":0.52100000000000002},"min":{"1min":0.34399999999999997,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.79000000000000004,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.50600000000000001,"15min":0.501},"min":{"1min":0.375,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.68799999999999994,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.51900000000000002}]},{"osd":3,"last update":"Tue Jul 25 14:37:35 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.64900000000000002,"15min":0.66300000000000003},"min":{"1min":0.38600000000000001,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.73499999999999999,"5min":3.5750000000000002,"15min":3.5750000000000002},"last":0.499},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.69899999999999995,"15min":0.71699999999999997},"min":{"1min":0.36499999999999999,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.77400000000000002,"5min":4.7190000000000003,"15min":4.7190000000000003},"last":0.623}]},{"osd":4,"last update":"Tue Jul 25 14:37:35 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.65700000000000003,"15min":0.67200000000000004},"min":{"1min":0.39100000000000001,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.79700000000000004,"5min":4.694,"15min":4.694},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.622,"15min":0.628},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.74099999999999999,"5min":2.7839999999999998,"15min":2.7839999999999998},"last":0.64300000000000002}]},{"osd":5,"last update":"Tue Jul 25 14:37:35 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.54500000000000004,"15min":0.54100000000000004},"min":{"1min":0.36199999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.752,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.624,"15min":0.627},"min":{"1min":0.376,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.82499999999999996,"5min":1.7310000000000001,"15min":1.7310000000000001},"last":0.58599999999999997}]},{"osd":7,"last update":"Tue Jul 25 14:37:35 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.68799999999999994,"15min":0.69799999999999995},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.81299999999999994,"5min":2.7290000000000001,"15min":2.7290000000000001},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.58999999999999997,"15min":0.58199999999999996},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.60799999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574878,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27764,"kb_used_data":744,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344076,"statfs":{"total":96636764160,"available":96608333824,"internally_reserved":0,"allocated":761856,"data_stored":912401,"data_compressed":32255,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jul 25 14:37:39 2023","interfaces":[{"interface":"back","average":{"1min":0.314,"5min":0.318,"15min":0.318},"min":{"1min":0.23999999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.44500000000000001,"5min":0.47099999999999997,"15min":0.47099999999999997},"last":0.222},{"interface":"front","average":{"1min":0.312,"5min":0.32800000000000001,"15min":0.33000000000000002},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.44700000000000001,"5min":0.48899999999999999,"15min":0.48899999999999999},"last":0.28499999999999998}]},{"osd":2,"last update":"Tue Jul 25 14:37:39 2023","interfaces":[{"interface":"back","average":{"1min":0.29799999999999999,"5min":0.30599999999999999,"15min":0.308},"min":{"1min":0.20100000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"last":0.29899999999999999},{"interface":"front","average":{"1min":0.35399999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"min":{"1min":0.27200000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.45800000000000002,"5min":0.56499999999999995,"15min":0.56499999999999995},"last":0.26800000000000002}]},{"osd":3,"last update":"Tue Jul 25 14:37:39 2023","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.371,"15min":0.373},"min":{"1min":0.29699999999999999,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.432,"5min":0.52900000000000003,"15min":0.52900000000000003},"last":0.316},{"interface":"front","average":{"1min":0.33000000000000002,"5min":0.34499999999999997,"15min":0.34699999999999998},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.46999999999999997,"5min":0.496,"15min":0.496},"last":0.32500000000000001}]},{"osd":4,"last update":"Tue Jul 25 14:37:39 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.55300000000000005,"15min":0.55100000000000005},"min":{"1min":0.44900000000000001,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.78400000000000003,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.55400000000000005,"15min":0.55800000000000005},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.65100000000000002,"5min":0.745,"15min":0.745},"last":0.48199999999999998}]},{"osd":5,"last update":"Tue Jul 25 14:37:39 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.56100000000000005,"15min":0.55900000000000005},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.754,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.56399999999999995,"15min":0.56499999999999995},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.496}]},{"osd":6,"last update":"Tue Jul 25 14:37:39 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.58099999999999996,"15min":0.58199999999999996},"min":{"1min":0.46000000000000002,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.70399999999999996,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.56899999999999995,"15min":0.57099999999999995},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.51900000000000002}]},{"osd":7,"last update":"Tue Jul 25 14:37:39 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.47699999999999998,"5min":0.443,"15min":0.443},"max":{"1min":0.71799999999999997,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.59599999999999997,"15min":0.59499999999999997},"min":{"1min":0.48399999999999999,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.74199999999999999,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.50700000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574878,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27684,"kb_used_data":656,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344156,"statfs":{"total":96636764160,"available":96608415744,"internally_reserved":0,"allocated":671744,"data_stored":318792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Jul 25 14:37:36 2023","interfaces":[{"interface":"back","average":{"1min":0.29899999999999999,"5min":0.35099999999999998,"15min":0.35899999999999999},"min":{"1min":0.17199999999999999,"5min":0.17199999999999999,"15min":0.17199999999999999},"max":{"1min":0.39000000000000001,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.28899999999999998,"5min":0.58899999999999997,"15min":0.63900000000000001},"min":{"1min":0.19600000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.37,"5min":6.5369999999999999,"15min":6.5369999999999999},"last":0.27800000000000002}]},{"osd":2,"last update":"Tue Jul 25 14:37:36 2023","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":0.36399999999999999,"15min":0.37},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.47599999999999998,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.23200000000000001},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.63,"15min":0.67600000000000005},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.439,"5min":6.5659999999999998,"15min":6.5659999999999998},"last":0.32700000000000001}]},{"osd":3,"last update":"Tue Jul 25 14:37:36 2023","interfaces":[{"interface":"back","average":{"1min":0.33100000000000002,"5min":0.88700000000000001,"15min":0.97899999999999998},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.48799999999999999,"5min":12.449,"15min":12.449},"last":0.29399999999999998},{"interface":"front","average":{"1min":0.36199999999999999,"5min":0.40999999999999998,"15min":0.41799999999999998},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.45100000000000001,"5min":1.079,"15min":1.079},"last":0.311}]},{"osd":4,"last update":"Tue Jul 25 14:37:36 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.79300000000000004,"15min":0.83199999999999996},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.71399999999999997,"5min":6.5099999999999998,"15min":6.5099999999999998},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.55600000000000005,"5min":1.0680000000000001,"15min":1.1539999999999999},"min":{"1min":0.35399999999999998,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.66100000000000003,"5min":12.35,"15min":12.35},"last":0.45700000000000002}]},{"osd":5,"last update":"Tue Jul 25 14:37:36 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.58699999999999997,"15min":0.58899999999999997},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.68100000000000005,"5min":1.107,"15min":1.107},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.82599999999999996,"15min":0.872},"min":{"1min":0.39000000000000001,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.76600000000000001,"5min":6.4349999999999996,"15min":6.4349999999999996},"last":0.56299999999999994}]},{"osd":6,"last update":"Tue Jul 25 14:37:36 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":1.0820000000000001,"15min":1.1679999999999999},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.74099999999999999,"5min":12.417,"15min":12.417},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.60799999999999998,"15min":0.61199999999999999},"min":{"1min":0.45000000000000001,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.68999999999999995,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.47299999999999998}]},{"osd":7,"last update":"Tue Jul 25 14:37:36 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.85799999999999998,"15min":0.90400000000000003},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.67200000000000004,"5min":6.4809999999999999,"15min":6.4809999999999999},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.57799999999999996,"5min":1.091,"15min":1.177},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.77500000000000002,"5min":12.388999999999999,"15min":12.388999999999999},"last":0.503}]}]},{"osd":2,"up_from":13,"seq":55834574878,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27696,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344144,"statfs":{"total":96636764160,"available":96608403456,"internally_reserved":0,"allocated":684032,"data_stored":320356,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jul 25 14:37:34 2023","interfaces":[{"interface":"back","average":{"1min":0.311,"5min":0.38200000000000001,"15min":0.39400000000000002},"min":{"1min":0.20399999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.39000000000000001,"5min":2.1030000000000002,"15min":2.1030000000000002},"last":0.217},{"interface":"front","average":{"1min":0.27600000000000002,"5min":0.92800000000000005,"15min":1.0369999999999999},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":0.32900000000000001,"5min":16.969000000000001,"15min":16.969000000000001},"last":0.318}]},{"osd":1,"last update":"Tue Jul 25 14:37:34 2023","interfaces":[{"interface":"back","average":{"1min":0.33400000000000002,"5min":0.35099999999999998,"15min":0.35399999999999998},"min":{"1min":0.26200000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.41899999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"last":0.27700000000000002},{"interface":"front","average":{"1min":0.34300000000000003,"5min":0.379,"15min":0.38500000000000001},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.50800000000000001,"5min":1.111,"15min":1.111},"last":0.36499999999999999}]},{"osd":3,"last update":"Tue Jul 25 14:37:34 2023","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.79700000000000004,"15min":0.876},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.36799999999999999,"5min":13.035,"15min":13.035},"last":0.30299999999999999},{"interface":"front","average":{"1min":0.376,"5min":0.40300000000000002,"15min":0.40699999999999997},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.61599999999999999,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.35299999999999998}]},{"osd":4,"last update":"Tue Jul 25 14:37:34 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.754,"15min":0.79200000000000004},"min":{"1min":0.39100000000000001,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.73099999999999998,"5min":6.165,"15min":6.165},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.55900000000000005,"5min":1.0069999999999999,"15min":1.0820000000000001},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.74199999999999999,"5min":13.004,"15min":13.004},"last":0.56200000000000006}]},{"osd":5,"last update":"Tue Jul 25 14:37:34 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.57199999999999995,"15min":0.57299999999999995},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.75800000000000001,"15min":0.79500000000000004},"min":{"1min":0.41299999999999998,"5min":0.378,"15min":0.378},"max":{"1min":0.69499999999999995,"5min":6.226,"15min":6.226},"last":0.623}]},{"osd":6,"last update":"Tue Jul 25 14:37:34 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":1.006,"15min":1.0840000000000001},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.77400000000000002,"5min":12.974,"15min":12.974},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.59499999999999997,"15min":0.59699999999999998},"min":{"1min":0.42599999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.77200000000000002,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.54000000000000004}]},{"osd":7,"last update":"Tue Jul 25 14:37:34 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.77900000000000003,"15min":0.81499999999999995},"min":{"1min":0.40899999999999997,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.70499999999999996,"5min":6.1989999999999998,"15min":6.1989999999999998},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.56699999999999995,"5min":1.026,"15min":1.1020000000000001},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.74199999999999999,"5min":12.936999999999999,"15min":12.936999999999999},"last":0.748}]}]},{"osd":3,"up_from":13,"seq":55834574878,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27692,"kb_used_data":664,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344148,"statfs":{"total":96636764160,"available":96608407552,"internally_reserved":0,"allocated":679936,"data_stored":318904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jul 25 14:37:36 2023","interfaces":[{"interface":"back","average":{"1min":0.29999999999999999,"5min":0.312,"15min":0.314},"min":{"1min":0.20300000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"last":0.254},{"interface":"front","average":{"1min":0.32100000000000001,"5min":0.309,"15min":0.307},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.45400000000000001,"5min":0.46300000000000002,"15min":0.46300000000000002},"last":0.22800000000000001}]},{"osd":1,"last update":"Tue Jul 25 14:37:36 2023","interfaces":[{"interface":"back","average":{"1min":0.315,"5min":0.308,"15min":0.307},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"last":0.27500000000000002},{"interface":"front","average":{"1min":0.34200000000000003,"5min":0.36899999999999999,"15min":0.373},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.496,"5min":0.59099999999999997,"15min":0.59099999999999997},"last":0.30199999999999999}]},{"osd":2,"last update":"Tue Jul 25 14:37:36 2023","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":0.37,"15min":0.374},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.441,"5min":0.502,"15min":0.502},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.35899999999999999,"5min":0.39300000000000002,"15min":0.39900000000000002},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.47299999999999998,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.33200000000000002}]},{"osd":4,"last update":"Tue Jul 25 14:37:36 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.57199999999999995,"15min":0.57399999999999995},"min":{"1min":0.42399999999999999,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.77000000000000002,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58799999999999997,"15min":0.58899999999999997},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.68999999999999995}]},{"osd":5,"last update":"Tue Jul 25 14:37:36 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.70999999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.625,"15min":0.63100000000000001},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.88100000000000001,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.63600000000000001}]},{"osd":6,"last update":"Tue Jul 25 14:37:36 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.61499999999999999,"15min":0.625},"min":{"1min":0.46300000000000002,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.68799999999999994,"5min":0.871,"15min":0.871},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.59399999999999997,"15min":0.59599999999999997},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.57799999999999996}]},{"osd":7,"last update":"Tue Jul 25 14:37:36 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.59099999999999997,"15min":0.58899999999999997},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.83599999999999997,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.60699999999999998,"15min":0.60899999999999999},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.70899999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574878,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27692,"kb_used_data":664,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344148,"statfs":{"total":96636764160,"available":96608407552,"internally_reserved":0,"allocated":679936,"data_stored":319923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jul 25 14:37:35 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.55500000000000005,"15min":0.56100000000000005},"min":{"1min":0.39600000000000002,"5min":0.31,"15min":0.31},"max":{"1min":0.75700000000000001,"5min":0.876,"15min":0.876},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.51100000000000001,"15min":0.51000000000000001},"min":{"1min":0.371,"5min":0.309,"15min":0.309},"max":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.49299999999999999}]},{"osd":1,"last update":"Tue Jul 25 14:37:35 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.69099999999999995,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.53600000000000003,"15min":0.53200000000000003},"min":{"1min":0.38900000000000001,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.70399999999999996,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.59899999999999998}]},{"osd":2,"last update":"Tue Jul 25 14:37:35 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.55500000000000005,"15min":0.54900000000000004},"min":{"1min":0.435,"5min":0.376,"15min":0.376},"max":{"1min":0.67600000000000005,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.54600000000000004,"15min":0.54200000000000004},"min":{"1min":0.41999999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.61699999999999999}]},{"osd":3,"last update":"Tue Jul 25 14:37:35 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.53600000000000003,"15min":0.53000000000000003},"min":{"1min":0.33000000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.73299999999999998,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.63,"15min":0.63800000000000001},"min":{"1min":0.47299999999999998,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.76100000000000001,"5min":1.8720000000000001,"15min":1.8720000000000001},"last":0.66400000000000003}]},{"osd":5,"last update":"Tue Jul 25 14:37:35 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.49099999999999999,"15min":0.47599999999999998},"min":{"1min":0.36399999999999999,"5min":0.317,"15min":0.317},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.61899999999999999,"15min":0.61599999999999999},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.748,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.71999999999999997}]},{"osd":6,"last update":"Tue Jul 25 14:37:35 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.54900000000000004,"15min":0.54100000000000004},"min":{"1min":0.41299999999999998,"5min":0.372,"15min":0.372},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.59899999999999998,"15min":0.60099999999999998},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.70699999999999996}]},{"osd":7,"last update":"Tue Jul 25 14:37:35 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.623,"15min":0.61899999999999999},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.79500000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.64600000000000002,"15min":0.64000000000000001},"min":{"1min":0.54900000000000004,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.67900000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574878,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27692,"kb_used_data":664,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344148,"statfs":{"total":96636764160,"available":96608407552,"internally_reserved":0,"allocated":679936,"data_stored":319943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jul 25 14:37:32 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.59799999999999998,"15min":0.60599999999999998},"min":{"1min":0.35399999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.83399999999999996,"5min":2.548,"15min":2.548},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.55700000000000005,"15min":0.56000000000000005},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.76500000000000001,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.63800000000000001}]},{"osd":1,"last update":"Tue Jul 25 14:37:32 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.58099999999999996,"15min":0.58499999999999996},"min":{"1min":0.39900000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.753,"5min":1.657,"15min":1.657},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.42599999999999999,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.79700000000000004,"5min":1.752,"15min":1.752},"last":0.61099999999999999}]},{"osd":2,"last update":"Tue Jul 25 14:37:32 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.56499999999999995,"15min":0.56699999999999995},"min":{"1min":0.38800000000000001,"5min":0.372,"15min":0.372},"max":{"1min":0.82899999999999996,"5min":0.872,"15min":0.872},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.54300000000000004,"15min":0.53400000000000003},"min":{"1min":0.46500000000000002,"5min":0.376,"15min":0.376},"max":{"1min":0.751,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.627}]},{"osd":3,"last update":"Tue Jul 25 14:37:32 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.56399999999999995,"15min":0.55800000000000005},"min":{"1min":0.39900000000000002,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.60899999999999999,"15min":0.60499999999999998},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.67200000000000004}]},{"osd":4,"last update":"Tue Jul 25 14:37:32 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.52900000000000003,"15min":0.52700000000000002},"min":{"1min":0.38900000000000001,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.56100000000000005,"15min":0.55900000000000005},"min":{"1min":0.35499999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.44600000000000001}]},{"osd":6,"last update":"Tue Jul 25 14:37:32 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.56299999999999994,"15min":0.55400000000000005},"min":{"1min":0.42499999999999999,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.57099999999999995,"15min":0.56799999999999995},"min":{"1min":0.35999999999999999,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.54600000000000004}]},{"osd":7,"last update":"Tue Jul 25 14:37:32 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.58799999999999997,"15min":0.58199999999999996},"min":{"1min":0.41899999999999998,"5min":0.375,"15min":0.375},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.627,"5min":0.64400000000000002,"15min":0.64700000000000002},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.81399999999999995,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.58199999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32255,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32255,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-25T14:37:49.665 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-07-25T14:37:49.666 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-07-25T14:37:49.825 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.815+0000 7f5e555ff700 1 Processor -- start 2023-07-25T14:37:49.826 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.815+0000 7f5e555ff700 1 -- start start 2023-07-25T14:37:49.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.815+0000 7f5e555ff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f5e500c3a10 0x7f5e500c3e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:49.827 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.815+0000 7f5e555ff700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5e500bc3c0 0x7f5e500bc850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:49.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.815+0000 7f5e555ff700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e50072520 con 0x7f5e50151a00 2023-07-25T14:37:49.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.815+0000 7f5e555ff700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e500bbb70 con 0x7f5e500c3a10 2023-07-25T14:37:49.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.815+0000 7f5e555ff700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e500c26d0 con 0x7f5e500bc3c0 2023-07-25T14:37:49.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.815+0000 7f5e4e7fc700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f5e500c3a10 0x7f5e500c3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:49.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.815+0000 7f5e4effd700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f5e50151a00 0x7f5e500c1fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:34530/0 (socket says 172.21.15.72:34530) 2023-07-25T14:37:49.828 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.815+0000 7f5e4effd700 1 -- 172.21.15.72:0/4118573549 learned_addr learned my addr 172.21.15.72:0/4118573549 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:37:49.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.816+0000 7f5e4f7fe700 1 --2- 172.21.15.72:0/4118573549 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5e500bc3c0 0x7f5e500bc850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:49.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.816+0000 7f5e4e7fc700 1 -- 172.21.15.72:0/4118573549 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5e500bc3c0 msgr2=0x7f5e500bc850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:49.829 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.816+0000 7f5e4e7fc700 1 --2- 172.21.15.72:0/4118573549 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5e500bc3c0 0x7f5e500bc850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:49.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.816+0000 7f5e4e7fc700 1 -- 172.21.15.72:0/4118573549 >> v1:172.21.15.72:6789/0 conn(0x7f5e50151a00 legacy=0x7f5e500c1fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:49.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.816+0000 7f5e4dffb700 1 -- 172.21.15.72:0/4118573549 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 724051249 0 0) 0x7f5e50072520 con 0x7f5e50151a00 2023-07-25T14:37:49.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.816+0000 7f5e4e7fc700 1 -- 172.21.15.72:0/4118573549 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e50151de0 con 0x7f5e500c3a10 2023-07-25T14:37:49.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.816+0000 7f5e4e7fc700 1 --2- 172.21.15.72:0/4118573549 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5e500c3a10 0x7f5e500c3e90 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f5e40009840 tx=0x7f5e40009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28530572a3c9d742 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:49.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.816+0000 7f5e4dffb700 1 -- 172.21.15.72:0/4118573549 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e40011830 con 0x7f5e500c3a10 2023-07-25T14:37:49.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.816+0000 7f5e4dffb700 1 -- 172.21.15.72:0/4118573549 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e40011990 con 0x7f5e500c3a10 2023-07-25T14:37:49.830 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.816+0000 7f5e4dffb700 1 -- 172.21.15.72:0/4118573549 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e40011d20 con 0x7f5e500c3a10 2023-07-25T14:37:49.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.817+0000 7f5e555ff700 1 -- 172.21.15.72:0/4118573549 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5e500c3a10 msgr2=0x7f5e500c3e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:49.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.817+0000 7f5e555ff700 1 --2- 172.21.15.72:0/4118573549 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5e500c3a10 0x7f5e500c3e90 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f5e40009840 tx=0x7f5e40009b50 comp rx=0 tx=0).stop 2023-07-25T14:37:49.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.817+0000 7f5e555ff700 1 -- 172.21.15.72:0/4118573549 shutdown_connections 2023-07-25T14:37:49.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.817+0000 7f5e555ff700 1 --2- 172.21.15.72:0/4118573549 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5e500bc3c0 0x7f5e500bc850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:49.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.817+0000 7f5e555ff700 1 --2- 172.21.15.72:0/4118573549 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5e500c3a10 0x7f5e500c3e90 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:49.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.817+0000 7f5e555ff700 1 -- 172.21.15.72:0/4118573549 >> 172.21.15.72:0/4118573549 conn(0x7f5e500c6eb0 msgr2=0x7f5e500c3300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:49.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.817+0000 7f5e555ff700 1 -- 172.21.15.72:0/4118573549 shutdown_connections 2023-07-25T14:37:49.831 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.817+0000 7f5e555ff700 1 -- 172.21.15.72:0/4118573549 wait complete. 2023-07-25T14:37:49.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.818+0000 7f5e555ff700 1 Processor -- start 2023-07-25T14:37:49.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.818+0000 7f5e555ff700 1 -- start start 2023-07-25T14:37:49.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.819+0000 7f5e555ff700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5e500bc3c0 0x7f5e501e9500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:49.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.819+0000 7f5e555ff700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5e500c3a10 0x7f5e50148e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:49.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.819+0000 7f5e555ff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5e50151a00 0x7f5e501ea970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:49.834 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.819+0000 7f5e555ff700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e50149390 con 0x7f5e50151a00 2023-07-25T14:37:49.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.819+0000 7f5e555ff700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e500bdec0 con 0x7f5e500c3a10 2023-07-25T14:37:49.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.819+0000 7f5e555ff700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e500be1a0 con 0x7f5e500bc3c0 2023-07-25T14:37:49.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.819+0000 7f5e4f7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5e50151a00 0x7f5e501ea970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:49.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.819+0000 7f5e4f7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5e50151a00 0x7f5e501ea970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43804/0 (socket says 172.21.15.72:43804) 2023-07-25T14:37:49.835 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.819+0000 7f5e4f7fe700 1 -- 172.21.15.72:0/401255636 learned_addr learned my addr 172.21.15.72:0/401255636 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:37:49.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.819+0000 7f5e4effd700 1 --2- 172.21.15.72:0/401255636 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5e500bc3c0 0x7f5e501e9500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:49.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.819+0000 7f5e4e7fc700 1 --2- 172.21.15.72:0/401255636 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5e500c3a10 0x7f5e50148e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:49.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.820+0000 7f5e4f7fe700 1 -- 172.21.15.72:0/401255636 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5e500bc3c0 msgr2=0x7f5e501e9500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:49.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.820+0000 7f5e4f7fe700 1 --2- 172.21.15.72:0/401255636 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5e500bc3c0 0x7f5e501e9500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:49.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.820+0000 7f5e4f7fe700 1 -- 172.21.15.72:0/401255636 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5e500c3a10 msgr2=0x7f5e50148e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:49.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.820+0000 7f5e4f7fe700 1 --2- 172.21.15.72:0/401255636 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5e500c3a10 0x7f5e50148e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:49.836 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.820+0000 7f5e4f7fe700 1 -- 172.21.15.72:0/401255636 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e400094a0 con 0x7f5e50151a00 2023-07-25T14:37:49.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.820+0000 7f5e4f7fe700 1 --2- 172.21.15.72:0/401255636 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5e50151a00 0x7f5e501ea970 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f5e4800efc0 tx=0x7f5e4800c0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:49.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.820+0000 7f5e377fe700 1 -- 172.21.15.72:0/401255636 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e4800caa0 con 0x7f5e50151a00 2023-07-25T14:37:49.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.820+0000 7f5e377fe700 1 -- 172.21.15.72:0/401255636 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e4800f040 con 0x7f5e50151a00 2023-07-25T14:37:49.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.820+0000 7f5e555ff700 1 -- 172.21.15.72:0/401255636 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e500be480 con 0x7f5e50151a00 2023-07-25T14:37:49.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.820+0000 7f5e377fe700 1 -- 172.21.15.72:0/401255636 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e4800ce40 con 0x7f5e50151a00 2023-07-25T14:37:49.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.820+0000 7f5e555ff700 1 -- 172.21.15.72:0/401255636 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e500bea40 con 0x7f5e50151a00 2023-07-25T14:37:49.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.821+0000 7f5e555ff700 1 -- 172.21.15.72:0/401255636 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e500bec30 con 0x7f5e50151a00 2023-07-25T14:37:49.837 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.821+0000 7f5e377fe700 1 -- 172.21.15.72:0/401255636 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5e48014480 con 0x7f5e50151a00 2023-07-25T14:37:49.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.822+0000 7f5e377fe700 1 --2- 172.21.15.72:0/401255636 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f5e3c06ace0 0x7f5e3c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:49.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.822+0000 7f5e377fe700 1 -- 172.21.15.72:0/401255636 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f5e48089cd0 con 0x7f5e50151a00 2023-07-25T14:37:49.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.822+0000 7f5e4effd700 1 --2- 172.21.15.72:0/401255636 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f5e3c06ace0 0x7f5e3c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:49.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.822+0000 7f5e4effd700 1 --2- 172.21.15.72:0/401255636 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f5e3c06ace0 0x7f5e3c06d1a0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f5e44000f60 tx=0x7f5e44007e70 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:49.838 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:49.826+0000 7f5e377fe700 1 -- 172.21.15.72:0/401255636 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f5e48054cd0 con 0x7f5e50151a00 2023-07-25T14:37:50.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:50.090+0000 7f5e555ff700 1 -- 172.21.15.72:0/401255636 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f5e5004e470 con 0x7f5e50151a00 2023-07-25T14:37:50.105 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:50.094+0000 7f5e377fe700 1 -- 172.21.15.72:0/401255636 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v17) v1 ==== 190+0+147 (secure 0 0 0) 0x7f5e480180e0 con 0x7f5e50151a00 2023-07-25T14:37:50.105 INFO:teuthology.orchestra.run.smithi072.stdout:[client.0] 2023-07-25T14:37:50.105 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQCI3b9k9P3nJxAAF+MNeILdw3WF8ZQhKpISew== 2023-07-25T14:37:50.105 INFO:teuthology.orchestra.run.smithi072.stdout: caps mds = "allow" 2023-07-25T14:37:50.105 INFO:teuthology.orchestra.run.smithi072.stdout: caps mon = "allow r" 2023-07-25T14:37:50.106 INFO:teuthology.orchestra.run.smithi072.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-07-25T14:37:50.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:50.096+0000 7f5e555ff700 1 -- 172.21.15.72:0/401255636 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f5e3c06ace0 msgr2=0x7f5e3c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:50.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:50.096+0000 7f5e555ff700 1 --2- 172.21.15.72:0/401255636 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f5e3c06ace0 0x7f5e3c06d1a0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f5e44000f60 tx=0x7f5e44007e70 comp rx=0 tx=0).stop 2023-07-25T14:37:50.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:50.096+0000 7f5e555ff700 1 -- 172.21.15.72:0/401255636 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5e50151a00 msgr2=0x7f5e501ea970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:50.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:50.096+0000 7f5e555ff700 1 --2- 172.21.15.72:0/401255636 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5e50151a00 0x7f5e501ea970 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f5e4800efc0 tx=0x7f5e4800c0c0 comp rx=0 tx=0).stop 2023-07-25T14:37:50.108 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:50.096+0000 7f5e555ff700 1 -- 172.21.15.72:0/401255636 shutdown_connections 2023-07-25T14:37:50.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:50.096+0000 7f5e555ff700 1 --2- 172.21.15.72:0/401255636 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f5e3c06ace0 0x7f5e3c06d1a0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:50.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:50.097+0000 7f5e555ff700 1 --2- 172.21.15.72:0/401255636 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5e500bc3c0 0x7f5e501e9500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:50.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:50.097+0000 7f5e555ff700 1 --2- 172.21.15.72:0/401255636 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5e50151a00 0x7f5e501ea970 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:50.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:50.097+0000 7f5e555ff700 1 --2- 172.21.15.72:0/401255636 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5e500c3a10 0x7f5e50148e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:50.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:50.097+0000 7f5e555ff700 1 -- 172.21.15.72:0/401255636 >> 172.21.15.72:0/401255636 conn(0x7f5e500c6eb0 msgr2=0x7f5e50149ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:50.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:50.097+0000 7f5e555ff700 1 -- 172.21.15.72:0/401255636 shutdown_connections 2023-07-25T14:37:50.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:50.097+0000 7f5e555ff700 1 -- 172.21.15.72:0/401255636 wait complete. 2023-07-25T14:37:50.110 INFO:teuthology.orchestra.run.smithi072.stderr:updated caps for client.0 2023-07-25T14:37:50.120 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-25T14:37:50.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:50.231+0000 7f9589e8a700 1 Processor -- start 2023-07-25T14:37:50.242 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:50.231+0000 7f9589e8a700 1 -- start start 2023-07-25T14:37:50.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:50.231+0000 7f9589e8a700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f95840c4930 0x7f95840c3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:50.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:50.231+0000 7f9589e8a700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95840c2fe0 con 0x7f9584151950 2023-07-25T14:37:50.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:50.231+0000 7f9589e8a700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9584155070 con 0x7f95840724c0 2023-07-25T14:37:50.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:50.231+0000 7f9589e8a700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9584071a60 con 0x7f95840c4930 2023-07-25T14:37:50.247 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:50.231+0000 7f95837fe700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f9584151950 0x7f958406a190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:34544/0 (socket says 172.21.15.72:34544) 2023-07-25T14:37:50.247 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:50.231+0000 7f95837fe700 1 -- 172.21.15.72:0/2713638933 learned_addr learned my addr 172.21.15.72:0/2713638933 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:37:50.247 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:50.232+0000 7f95827fc700 1 -- 172.21.15.72:0/2713638933 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4259397417 0 0) 0x7f95840c2fe0 con 0x7f9584151950 2023-07-25T14:37:50.247 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:50.232+0000 7f9583fff700 1 --2- 172.21.15.72:0/2713638933 >> v2:172.21.15.92:3300/0 conn(0x7f95840c4930 0x7f95840c3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:50.248 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:50.232+0000 7f95827fc700 1 -- 172.21.15.72:0/2713638933 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f956c0035b0 con 0x7f9584151950 2023-07-25T14:37:50.248 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:50.232+0000 7f95827fc700 1 -- 172.21.15.72:0/2713638933 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3671594649 0 0) 0x7f956c0035b0 con 0x7f9584151950 2023-07-25T14:37:50.248 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:50.232+0000 7f95827fc700 1 -- 172.21.15.72:0/2713638933 >> v2:172.21.15.92:3300/0 conn(0x7f95840c4930 msgr2=0x7f95840c3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:50.248 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:50.232+0000 7f95827fc700 1 --2- 172.21.15.72:0/2713638933 >> v2:172.21.15.92:3300/0 conn(0x7f95840c4930 0x7f95840c3bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:50.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:50.232+0000 7f95827fc700 1 -- 172.21.15.72:0/2713638933 >> v1:172.21.15.92:6789/0 conn(0x7f95840724c0 legacy=0x7f95840c34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:50.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:50.232+0000 7f95827fc700 1 -- 172.21.15.72:0/2713638933 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95840c15c0 con 0x7f9584151950 2023-07-25T14:37:50.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:50.232+0000 7f95827fc700 1 -- 172.21.15.72:0/2713638933 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2559588315 0 0) 0x7f9574001670 con 0x7f9584151950 2023-07-25T14:37:50.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:50.232+0000 7f95827fc700 1 -- 172.21.15.72:0/2713638933 >> v1:172.21.15.72:6789/0 conn(0x7f9584151950 legacy=0x7f958406a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:50.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:50.232+0000 7f95827fc700 1 --2- 172.21.15.72:0/2713638933 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f956c003a00 0x7f956c003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:50.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:50.232+0000 7f95827fc700 1 --2- 172.21.15.72:0/2713638933 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f956c004850 0x7f956c004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:50.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:50.232+0000 7f95827fc700 1 --2- 172.21.15.72:0/2713638933 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f956c005210 0x7f956c00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:50.251 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:50.232+0000 7f95827fc700 1 -- 172.21.15.72:0/2713638933 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9584071a60 con 0x7f956c005210 2023-07-25T14:37:50.251 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:50.232+0000 7f95827fc700 1 -- 172.21.15.72:0/2713638933 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f956c00c1b0 con 0x7f956c004850 2023-07-25T14:37:50.251 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:50.232+0000 7f95827fc700 1 -- 172.21.15.72:0/2713638933 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f956c00c370 con 0x7f956c003a00 2023-07-25T14:37:50.251 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:50.232+0000 7f9583fff700 1 --2- 172.21.15.72:0/2713638933 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f956c005210 0x7f956c00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:50.251 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:50.232+0000 7f95837fe700 1 --2- 172.21.15.72:0/2713638933 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f956c003a00 0x7f956c003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:50.251 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:50.232+0000 7f9582ffd700 1 --2- 172.21.15.72:0/2713638933 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f956c004850 0x7f956c004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:50.252 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:50.232+0000 7f9583fff700 1 -- 172.21.15.72:0/2713638933 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f956c003a00 msgr2=0x7f956c003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:50.252 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:50.232+0000 7f9583fff700 1 --2- 172.21.15.72:0/2713638933 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f956c003a00 0x7f956c003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:50.252 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:50.232+0000 7f9583fff700 1 -- 172.21.15.72:0/2713638933 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f956c004850 msgr2=0x7f956c004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:50.252 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:50.232+0000 7f9583fff700 1 --2- 172.21.15.72:0/2713638933 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f956c004850 0x7f956c004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:50.252 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:50.233+0000 7f9583fff700 1 -- 172.21.15.72:0/2713638933 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f956c0035b0 con 0x7f956c005210 2023-07-25T14:37:50.252 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:50.233+0000 7f9583fff700 1 -- 172.21.15.72:0/2713638933 reap_dead start 2023-07-25T14:37:50.252 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:50.233+0000 7f9583fff700 1 --2- 172.21.15.72:0/2713638933 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f956c005210 0x7f956c00ba10 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f957c009fc0 tx=0x7f956c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad17ecb2470c4031 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:50.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:50.233+0000 7f95827fc700 1 -- 172.21.15.72:0/2713638933 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f957c003a20 con 0x7f956c005210 2023-07-25T14:37:50.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:50.233+0000 7f95827fc700 1 -- 172.21.15.72:0/2713638933 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f957c00f040 con 0x7f956c005210 2023-07-25T14:37:50.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:50.233+0000 7f95827fc700 1 -- 172.21.15.72:0/2713638933 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f957c003de0 con 0x7f956c005210 2023-07-25T14:37:50.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:50.233+0000 7f9589e8a700 1 -- 172.21.15.72:0/2713638933 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f956c005210 msgr2=0x7f956c00ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:50.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:50.233+0000 7f9589e8a700 1 --2- 172.21.15.72:0/2713638933 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f956c005210 0x7f956c00ba10 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f957c009fc0 tx=0x7f956c005880 comp rx=0 tx=0).stop 2023-07-25T14:37:50.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:50.233+0000 7f9589e8a700 1 -- 172.21.15.72:0/2713638933 shutdown_connections 2023-07-25T14:37:50.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:50.233+0000 7f9589e8a700 1 --2- 172.21.15.72:0/2713638933 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f956c005210 0x7f956c00ba10 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:50.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:50.233+0000 7f9589e8a700 1 -- 172.21.15.72:0/2713638933 >> 172.21.15.72:0/2713638933 conn(0x7f95840a87e0 msgr2=0x7f95840a8bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:50.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:50.233+0000 7f9589e8a700 1 -- 172.21.15.72:0/2713638933 shutdown_connections 2023-07-25T14:37:50.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:50.233+0000 7f9589e8a700 1 -- 172.21.15.72:0/2713638933 wait complete. 2023-07-25T14:37:50.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:50.234+0000 7f9589e8a700 1 Processor -- start 2023-07-25T14:37:50.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:50.235+0000 7f9589e8a700 1 -- start start 2023-07-25T14:37:50.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:50.235+0000 7f9589e8a700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f956c005210 0x7f958414cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:50.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:50.235+0000 7f9589e8a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9584153290 0x7f95840bf300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:50.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:50.235+0000 7f9589e8a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f95840bf840 0x7f95841523d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:50.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:50.235+0000 7f9589e8a700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95841ea140 con 0x7f95840bf840 2023-07-25T14:37:50.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:50.235+0000 7f9589e8a700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95841e94c0 con 0x7f9584153290 2023-07-25T14:37:50.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:50.235+0000 7f9589e8a700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95841e97a0 con 0x7f956c005210 2023-07-25T14:37:50.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:50.235+0000 7f9583fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f95840bf840 0x7f95841523d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:50.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:50.236+0000 7f9583fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f95840bf840 0x7f95841523d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43822/0 (socket says 172.21.15.72:43822) 2023-07-25T14:37:50.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:50.236+0000 7f9583fff700 1 -- 172.21.15.72:0/575589825 learned_addr learned my addr 172.21.15.72:0/575589825 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:37:50.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:50.236+0000 7f95837fe700 1 --2- 172.21.15.72:0/575589825 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f956c005210 0x7f958414cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:50.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:50.236+0000 7f9582ffd700 1 --2- 172.21.15.72:0/575589825 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9584153290 0x7f95840bf300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:50.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:50.236+0000 7f9583fff700 1 -- 172.21.15.72:0/575589825 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f956c005210 msgr2=0x7f958414cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:50.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:50.236+0000 7f9583fff700 1 --2- 172.21.15.72:0/575589825 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f956c005210 0x7f958414cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:50.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:50.236+0000 7f9583fff700 1 -- 172.21.15.72:0/575589825 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9584153290 msgr2=0x7f95840bf300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:50.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:50.236+0000 7f9583fff700 1 --2- 172.21.15.72:0/575589825 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9584153290 0x7f95840bf300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:50.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:50.236+0000 7f9583fff700 1 -- 172.21.15.72:0/575589825 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95841e9a80 con 0x7f95840bf840 2023-07-25T14:37:50.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:50.236+0000 7f9582ffd700 1 --2- 172.21.15.72:0/575589825 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9584153290 0x7f95840bf300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-25T14:37:50.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:50.236+0000 7f95837fe700 1 --2- 172.21.15.72:0/575589825 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f956c005210 0x7f958414cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-25T14:37:50.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:50.236+0000 7f9583fff700 1 --2- 172.21.15.72:0/575589825 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f95840bf840 0x7f95841523d0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f958406b0f0 tx=0x7f957c009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:50.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:50.236+0000 7f956bfff700 1 -- 172.21.15.72:0/575589825 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f957c003e90 con 0x7f95840bf840 2023-07-25T14:37:50.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:50.236+0000 7f956bfff700 1 -- 172.21.15.72:0/575589825 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f957c004230 con 0x7f95840bf840 2023-07-25T14:37:50.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:50.236+0000 7f956bfff700 1 -- 172.21.15.72:0/575589825 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f957c0045e0 con 0x7f95840bf840 2023-07-25T14:37:50.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:50.236+0000 7f9589e8a700 1 -- 172.21.15.72:0/575589825 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95841e9d60 con 0x7f95840bf840 2023-07-25T14:37:50.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:50.236+0000 7f9589e8a700 1 -- 172.21.15.72:0/575589825 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f958414b580 con 0x7f95840bf840 2023-07-25T14:37:50.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:50.237+0000 7f9589e8a700 1 -- 172.21.15.72:0/575589825 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95841520f0 con 0x7f95840bf840 2023-07-25T14:37:50.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:50.237+0000 7f956bfff700 1 -- 172.21.15.72:0/575589825 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f957c004740 con 0x7f95840bf840 2023-07-25T14:37:50.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:50.238+0000 7f956bfff700 1 --2- 172.21.15.72:0/575589825 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f957006ace0 0x7f957006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:50.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:50.238+0000 7f956bfff700 1 -- 172.21.15.72:0/575589825 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f957c08a7d0 con 0x7f95840bf840 2023-07-25T14:37:50.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:50.238+0000 7f95837fe700 1 --2- 172.21.15.72:0/575589825 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f957006ace0 0x7f957006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:50.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:50.238+0000 7f95837fe700 1 --2- 172.21.15.72:0/575589825 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f957006ace0 0x7f957006d1a0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f95740011e0 tx=0x7f9574009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:50.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:50.242+0000 7f956bfff700 1 -- 172.21.15.72:0/575589825 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f95841520f0 con 0x7f95840bf840 2023-07-25T14:37:50.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:50.471+0000 7f9589e8a700 1 -- 172.21.15.72:0/575589825 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f95841520f0 con 0x7f95840bf840 2023-07-25T14:37:50.482 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:50.472+0000 7f956bfff700 1 -- 172.21.15.72:0/575589825 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) v1 ==== 94+0+4673 (secure 0 0 0) 0x7f95841520f0 con 0x7f95840bf840 2023-07-25T14:37:50.483 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-25T14:37:50.483 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":33,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5698,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6834/2824839995","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":2824839995},{"type":"v1","addr":"172.21.15.92:6834","nonce":2824839995}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":6147,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6836/1970088937","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":1970088937},{"type":"v1","addr":"172.21.15.72:6836","nonce":1970088937}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":6150,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6837/2638708695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6835","nonce":2638708695},{"type":"v1","addr":"172.21.15.72:6837","nonce":2638708695}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-25T14:37:44.546871+0000","modified":"2023-07-25T14:37:48.197140+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6165},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6165":{"gid":6165,"name":"d","rank":0,"incarnation":29,"state":"up:active","state_seq":3,"addr":"172.21.15.92:6835/2035914134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6833","nonce":2035914134},{"type":"v1","addr":"172.21.15.92:6835","nonce":2035914134}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-07-25T14:37:50.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:50.474+0000 7f9589e8a700 1 -- 172.21.15.72:0/575589825 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f957006ace0 msgr2=0x7f957006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:50.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:50.474+0000 7f9589e8a700 1 --2- 172.21.15.72:0/575589825 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f957006ace0 0x7f957006d1a0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f95740011e0 tx=0x7f9574009040 comp rx=0 tx=0).stop 2023-07-25T14:37:50.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:50.474+0000 7f9589e8a700 1 -- 172.21.15.72:0/575589825 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f95840bf840 msgr2=0x7f95841523d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:50.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:50.474+0000 7f9589e8a700 1 --2- 172.21.15.72:0/575589825 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f95840bf840 0x7f95841523d0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f958406b0f0 tx=0x7f957c009750 comp rx=0 tx=0).stop 2023-07-25T14:37:50.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:50.474+0000 7f9589e8a700 1 -- 172.21.15.72:0/575589825 shutdown_connections 2023-07-25T14:37:50.485 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:50.474+0000 7f9589e8a700 1 --2- 172.21.15.72:0/575589825 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f957006ace0 0x7f957006d1a0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:50.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:50.474+0000 7f9589e8a700 1 --2- 172.21.15.72:0/575589825 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f956c005210 0x7f958414cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:50.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:50.474+0000 7f9589e8a700 1 --2- 172.21.15.72:0/575589825 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f95840bf840 0x7f95841523d0 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:50.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:50.474+0000 7f9589e8a700 1 --2- 172.21.15.72:0/575589825 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9584153290 0x7f95840bf300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:50.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:50.474+0000 7f9589e8a700 1 -- 172.21.15.72:0/575589825 >> 172.21.15.72:0/575589825 conn(0x7f95840a87e0 msgr2=0x7f95840c34c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:50.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:50.474+0000 7f9589e8a700 1 -- 172.21.15.72:0/575589825 shutdown_connections 2023-07-25T14:37:50.486 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:50.474+0000 7f9589e8a700 1 -- 172.21.15.72:0/575589825 wait complete. 2023-07-25T14:37:50.487 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 33 2023-07-25T14:37:50.900 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 33, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-07-25T14:37:44.546871+0000', 'modified': '2023-07-25T14:37:48.197140+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6165}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6165': {'gid': 6165, 'name': 'd', 'rank': 0, 'incarnation': 29, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.92:6835/2035914134', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.92:6833', 'nonce': 2035914134}, {'type': 'v1', 'addr': '172.21.15.92:6835', 'nonce': 2035914134}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [11], 'metadata_pool': 10, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-07-25T14:37:50.900 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-07-25T14:37:50.901 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-07-25T14:37:51.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.013+0000 7f95eab8c700 1 Processor -- start 2023-07-25T14:37:51.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.013+0000 7f95eab8c700 1 -- start start 2023-07-25T14:37:51.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.014+0000 7f95eab8c700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f95e4151980 0x7f95e40c12b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:51.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.014+0000 7f95eab8c700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f95e40c17f0 0x7f95e40c4c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:51.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.014+0000 7f95eab8c700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95e406eaf0 con 0x7f95e406e580 2023-07-25T14:37:51.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.014+0000 7f95eab8c700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95e406f770 con 0x7f95e40c17f0 2023-07-25T14:37:51.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.014+0000 7f95eab8c700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95e40c29e0 con 0x7f95e4151980 2023-07-25T14:37:51.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.014+0000 7f95e9129700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f95e406e580 0x7f95e40c51b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:34566/0 (socket says 172.21.15.72:34566) 2023-07-25T14:37:51.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.014+0000 7f95e9129700 1 -- 172.21.15.72:0/1288830862 learned_addr learned my addr 172.21.15.72:0/1288830862 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:37:51.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.014+0000 7f95e8928700 1 --2- 172.21.15.72:0/1288830862 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f95e4151980 0x7f95e40c12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:51.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.014+0000 7f95e37fe700 1 -- 172.21.15.72:0/1288830862 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 573617738 0 0) 0x7f95e406eaf0 con 0x7f95e406e580 2023-07-25T14:37:51.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.014+0000 7f95e3fff700 1 --2- 172.21.15.72:0/1288830862 >> v2:172.21.15.92:3300/0 conn(0x7f95e40c17f0 0x7f95e40c4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:51.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.014+0000 7f95e37fe700 1 -- 172.21.15.72:0/1288830862 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f95d40035b0 con 0x7f95e406e580 2023-07-25T14:37:51.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.014+0000 7f95e37fe700 1 -- 172.21.15.72:0/1288830862 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2174808954 0 0) 0x7f95d40035b0 con 0x7f95e406e580 2023-07-25T14:37:51.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.014+0000 7f95e37fe700 1 -- 172.21.15.72:0/1288830862 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f95e4151980 msgr2=0x7f95e40c12b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:51.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.014+0000 7f95e37fe700 1 --2- 172.21.15.72:0/1288830862 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f95e4151980 0x7f95e40c12b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:51.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.014+0000 7f95e37fe700 1 -- 172.21.15.72:0/1288830862 >> v2:172.21.15.92:3300/0 conn(0x7f95e40c17f0 msgr2=0x7f95e40c4c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:51.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.014+0000 7f95e37fe700 1 --2- 172.21.15.72:0/1288830862 >> v2:172.21.15.92:3300/0 conn(0x7f95e40c17f0 0x7f95e40c4c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:51.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.014+0000 7f95e37fe700 1 -- 172.21.15.72:0/1288830862 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95e406edd0 con 0x7f95e406e580 2023-07-25T14:37:51.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.014+0000 7f95e37fe700 1 -- 172.21.15.72:0/1288830862 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2559588315 0 0) 0x7f95dc0019f0 con 0x7f95e406e580 2023-07-25T14:37:51.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.014+0000 7f95e37fe700 1 -- 172.21.15.72:0/1288830862 >> v1:172.21.15.72:6789/0 conn(0x7f95e406e580 legacy=0x7f95e40c51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:51.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.014+0000 7f95e37fe700 1 --2- 172.21.15.72:0/1288830862 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f95d4003a00 0x7f95d4003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:51.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.014+0000 7f95e37fe700 1 --2- 172.21.15.72:0/1288830862 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f95d4004850 0x7f95d4004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:51.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.014+0000 7f95e37fe700 1 --2- 172.21.15.72:0/1288830862 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f95d4005210 0x7f95d400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:51.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.014+0000 7f95e37fe700 1 -- 172.21.15.72:0/1288830862 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95e406f770 con 0x7f95d4005210 2023-07-25T14:37:51.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.014+0000 7f95e37fe700 1 -- 172.21.15.72:0/1288830862 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95d400c110 con 0x7f95d4003a00 2023-07-25T14:37:51.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.014+0000 7f95e37fe700 1 -- 172.21.15.72:0/1288830862 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95d400c2d0 con 0x7f95d4004850 2023-07-25T14:37:51.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.014+0000 7f95e8928700 1 --2- 172.21.15.72:0/1288830862 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f95e4151980 0x7f95e40c12b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-25T14:37:51.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.014+0000 7f95e3fff700 1 --2- 172.21.15.72:0/1288830862 >> v2:172.21.15.92:3300/0 conn(0x7f95e40c17f0 0x7f95e40c4c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-25T14:37:51.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.014+0000 7f95e9129700 1 --2- 172.21.15.72:0/1288830862 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f95d4005210 0x7f95d400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:51.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.015+0000 7f95e3fff700 1 --2- 172.21.15.72:0/1288830862 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f95d4004850 0x7f95d4004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:51.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.015+0000 7f95e8928700 1 --2- 172.21.15.72:0/1288830862 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f95d4003a00 0x7f95d4003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:51.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.015+0000 7f95e9129700 1 -- 172.21.15.72:0/1288830862 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f95d4004850 msgr2=0x7f95d4004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:51.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.015+0000 7f95e9129700 1 --2- 172.21.15.72:0/1288830862 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f95d4004850 0x7f95d4004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:51.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.015+0000 7f95e9129700 1 -- 172.21.15.72:0/1288830862 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f95d4003a00 msgr2=0x7f95d4003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:51.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.015+0000 7f95e9129700 1 --2- 172.21.15.72:0/1288830862 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f95d4003a00 0x7f95d4003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:51.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.015+0000 7f95e9129700 1 -- 172.21.15.72:0/1288830862 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95d40035b0 con 0x7f95d4005210 2023-07-25T14:37:51.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.015+0000 7f95e9129700 1 --2- 172.21.15.72:0/1288830862 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f95d4005210 0x7f95d400ba10 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f95dc00a860 tx=0x7f95d4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d1a0068b7bb3f73 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:51.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.015+0000 7f95e37fe700 1 -- 172.21.15.72:0/1288830862 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95dc012600 con 0x7f95d4005210 2023-07-25T14:37:51.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.015+0000 7f95e37fe700 1 -- 172.21.15.72:0/1288830862 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95dc012780 con 0x7f95d4005210 2023-07-25T14:37:51.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.015+0000 7f95e37fe700 1 -- 172.21.15.72:0/1288830862 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95dc012b30 con 0x7f95d4005210 2023-07-25T14:37:51.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.015+0000 7f95eab8c700 1 -- 172.21.15.72:0/1288830862 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f95d4005210 msgr2=0x7f95d400ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:51.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.015+0000 7f95eab8c700 1 --2- 172.21.15.72:0/1288830862 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f95d4005210 0x7f95d400ba10 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f95dc00a860 tx=0x7f95d4005880 comp rx=0 tx=0).stop 2023-07-25T14:37:51.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.015+0000 7f95e9129700 1 -- 172.21.15.72:0/1288830862 reap_dead start 2023-07-25T14:37:51.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.015+0000 7f95eab8c700 1 -- 172.21.15.72:0/1288830862 shutdown_connections 2023-07-25T14:37:51.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.016+0000 7f95eab8c700 1 -- 172.21.15.72:0/1288830862 >> 172.21.15.72:0/1288830862 conn(0x7f95e40a8520 msgr2=0x7f95e40a8900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:51.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.016+0000 7f95eab8c700 1 -- 172.21.15.72:0/1288830862 shutdown_connections 2023-07-25T14:37:51.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.016+0000 7f95eab8c700 1 -- 172.21.15.72:0/1288830862 wait complete. 2023-07-25T14:37:51.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.017+0000 7f95eab8c700 1 Processor -- start 2023-07-25T14:37:51.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.017+0000 7f95eab8c700 1 -- start start 2023-07-25T14:37:51.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.018+0000 7f95eab8c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f95e40abed0 0x7f95e4154c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:51.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.018+0000 7f95eab8c700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f95e4150560 0x7f95e41509e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:51.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.018+0000 7f95eab8c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f95e40be280 0x7f95e40be700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:51.042 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.018+0000 7f95eab8c700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95e41540d0 con 0x7f95e40abed0 2023-07-25T14:37:51.042 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.018+0000 7f95eab8c700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95e41534c0 con 0x7f95e40be280 2023-07-25T14:37:51.042 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.018+0000 7f95eab8c700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95e41537a0 con 0x7f95e4150560 2023-07-25T14:37:51.042 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.018+0000 7f95e8928700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f95e40abed0 0x7f95e4154c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:51.042 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.018+0000 7f95e8928700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f95e40abed0 0x7f95e4154c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43838/0 (socket says 172.21.15.72:43838) 2023-07-25T14:37:51.042 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.018+0000 7f95e8928700 1 -- 172.21.15.72:0/2486652702 learned_addr learned my addr 172.21.15.72:0/2486652702 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:37:51.042 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.018+0000 7f95e9129700 1 --2- 172.21.15.72:0/2486652702 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f95e40be280 0x7f95e40be700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:51.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.018+0000 7f95e3fff700 1 --2- 172.21.15.72:0/2486652702 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f95e4150560 0x7f95e41509e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:51.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.018+0000 7f95e8928700 1 -- 172.21.15.72:0/2486652702 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f95e4150560 msgr2=0x7f95e41509e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:51.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.018+0000 7f95e8928700 1 --2- 172.21.15.72:0/2486652702 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f95e4150560 0x7f95e41509e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:51.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.018+0000 7f95e8928700 1 -- 172.21.15.72:0/2486652702 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f95e40be280 msgr2=0x7f95e40be700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:51.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.018+0000 7f95e8928700 1 --2- 172.21.15.72:0/2486652702 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f95e40be280 0x7f95e40be700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:51.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.018+0000 7f95e8928700 1 -- 172.21.15.72:0/2486652702 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95e4153a80 con 0x7f95e40abed0 2023-07-25T14:37:51.043 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.019+0000 7f95e8928700 1 --2- 172.21.15.72:0/2486652702 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f95e40abed0 0x7f95e4154c10 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f95d8010630 tx=0x7f95d80109f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:51.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.019+0000 7f95e17fa700 1 -- 172.21.15.72:0/2486652702 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95d8005a20 con 0x7f95e40abed0 2023-07-25T14:37:51.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.019+0000 7f95e17fa700 1 -- 172.21.15.72:0/2486652702 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95d800c070 con 0x7f95e40abed0 2023-07-25T14:37:51.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.019+0000 7f95e17fa700 1 -- 172.21.15.72:0/2486652702 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95d8005da0 con 0x7f95e40abed0 2023-07-25T14:37:51.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.019+0000 7f95eab8c700 1 -- 172.21.15.72:0/2486652702 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95e4153d60 con 0x7f95e40abed0 2023-07-25T14:37:51.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.019+0000 7f95eab8c700 1 -- 172.21.15.72:0/2486652702 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95e4155150 con 0x7f95e40abed0 2023-07-25T14:37:51.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.020+0000 7f95e17fa700 1 -- 172.21.15.72:0/2486652702 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f95d8015680 con 0x7f95e40abed0 2023-07-25T14:37:51.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.021+0000 7f95e17fa700 1 --2- 172.21.15.72:0/2486652702 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f95c806ad10 0x7f95c806d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:51.044 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.021+0000 7f95e17fa700 1 -- 172.21.15.72:0/2486652702 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f95d8089470 con 0x7f95e40abed0 2023-07-25T14:37:51.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.021+0000 7f95e3fff700 1 --2- 172.21.15.72:0/2486652702 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f95c806ad10 0x7f95c806d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:51.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.021+0000 7f95e3fff700 1 --2- 172.21.15.72:0/2486652702 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f95c806ad10 0x7f95c806d1d0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f95e406a320 tx=0x7f95d0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:51.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.022+0000 7f95f6d24b80 1 Processor -- start 2023-07-25T14:37:51.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.023+0000 7f95f6d24b80 1 -- start start 2023-07-25T14:37:51.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.023+0000 7f95f6d24b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558a85846910 0x558a858411c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:51.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.023+0000 7f95f6d24b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558a85847c90 0x558a85841700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:51.045 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.023+0000 7f95f6d24b80 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x558a85841c40 0x558a858642c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:51.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.023+0000 7f95f6d24b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a8573eb80 con 0x558a85847c90 2023-07-25T14:37:51.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.023+0000 7f95f6d24b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a8579e540 con 0x558a85846910 2023-07-25T14:37:51.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.023+0000 7f95f6d24b80 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x558a8579be60 con 0x558a85841c40 2023-07-25T14:37:51.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.023+0000 7f95e3fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558a85847c90 0x558a85841700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:51.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.023+0000 7f95e3fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558a85847c90 0x558a85841700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43848/0 (socket says 172.21.15.72:43848) 2023-07-25T14:37:51.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.023+0000 7f95e3fff700 1 -- 172.21.15.72:0/183675702 learned_addr learned my addr 172.21.15.72:0/183675702 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:37:51.046 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.023+0000 7f95e8928700 1 --2- 172.21.15.72:0/183675702 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558a85846910 0x558a858411c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:51.047 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.023+0000 7f95e9129700 1 --2- 172.21.15.72:0/183675702 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x558a85841c40 0x558a858642c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:51.047 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.024+0000 7f95e3fff700 1 -- 172.21.15.72:0/183675702 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x558a85841c40 msgr2=0x558a858642c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:51.047 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.024+0000 7f95e3fff700 1 --2- 172.21.15.72:0/183675702 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x558a85841c40 0x558a858642c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:51.047 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.024+0000 7f95e3fff700 1 -- 172.21.15.72:0/183675702 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558a85846910 msgr2=0x558a858411c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:51.047 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.024+0000 7f95e3fff700 1 --2- 172.21.15.72:0/183675702 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558a85846910 0x558a858411c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:51.047 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.024+0000 7f95e3fff700 1 -- 172.21.15.72:0/183675702 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558a856185e0 con 0x558a85847c90 2023-07-25T14:37:51.047 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.024+0000 7f95e3fff700 1 --2- 172.21.15.72:0/183675702 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558a85847c90 0x558a85841700 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f95d0012830 tx=0x7f95d0015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aff20c17382a0550 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:51.048 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.024+0000 7f95ce7fc700 1 -- 172.21.15.72:0/183675702 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95d0004230 con 0x558a85847c90 2023-07-25T14:37:51.048 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.024+0000 7f95ce7fc700 1 -- 172.21.15.72:0/183675702 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95d0004390 con 0x558a85847c90 2023-07-25T14:37:51.048 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.024+0000 7f95ce7fc700 1 -- 172.21.15.72:0/183675702 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95d00036a0 con 0x558a85847c90 2023-07-25T14:37:51.048 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.024+0000 7f95f6d24b80 1 -- 172.21.15.72:0/183675702 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558a85847c90 msgr2=0x558a85841700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:51.048 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.024+0000 7f95f6d24b80 1 --2- 172.21.15.72:0/183675702 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558a85847c90 0x558a85841700 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f95d0012830 tx=0x7f95d0015000 comp rx=0 tx=0).stop 2023-07-25T14:37:51.048 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.025+0000 7f95f6d24b80 1 -- 172.21.15.72:0/183675702 shutdown_connections 2023-07-25T14:37:51.048 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.025+0000 7f95f6d24b80 1 --2- 172.21.15.72:0/183675702 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x558a85841c40 0x558a858642c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:51.048 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.025+0000 7f95f6d24b80 1 --2- 172.21.15.72:0/183675702 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558a85846910 0x558a858411c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:51.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.025+0000 7f95f6d24b80 1 --2- 172.21.15.72:0/183675702 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558a85847c90 0x558a85841700 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:51.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.025+0000 7f95f6d24b80 1 -- 172.21.15.72:0/183675702 >> 172.21.15.72:0/183675702 conn(0x558a857a3c80 msgr2=0x558a85844570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:51.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.025+0000 7f95f6d24b80 1 -- 172.21.15.72:0/183675702 shutdown_connections 2023-07-25T14:37:51.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.025+0000 7f95f6d24b80 1 -- 172.21.15.72:0/183675702 wait complete. 2023-07-25T14:37:51.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.025+0000 7f95f6d24b80 1 -- start start 2023-07-25T14:37:51.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.025+0000 7f95f6d24b80 1 Processor -- start 2023-07-25T14:37:51.049 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.026+0000 7f95f6d24b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558a85841c40 0x558a85841530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:51.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.026+0000 7f95f6d24b80 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x558a85846910 0x558a85866b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:51.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.026+0000 7f95f6d24b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558a85847c90 0x558a85881aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:51.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.026+0000 7f95f6d24b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a85797750 con 0x558a85841c40 2023-07-25T14:37:51.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.026+0000 7f95f6d24b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a85736a70 con 0x558a85847c90 2023-07-25T14:37:51.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.026+0000 7f95f6d24b80 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x558a85736770 con 0x558a85846910 2023-07-25T14:37:51.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.026+0000 7f95f6d24b80 10 client.0 _ll_register_callbacks cb 0x558a85734630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-25T14:37:51.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.026+0000 7f95e8928700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558a85841c40 0x558a85841530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:51.050 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.026+0000 7f95e8928700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558a85841c40 0x558a85841530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43852/0 (socket says 172.21.15.72:43852) 2023-07-25T14:37:51.051 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.026+0000 7f95e8928700 1 -- 172.21.15.72:0/3125613011 learned_addr learned my addr 172.21.15.72:0/3125613011 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:37:51.051 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.026+0000 7f95e9129700 1 --2- 172.21.15.72:0/3125613011 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558a85847c90 0x558a85881aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:51.051 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.026+0000 7f95e3fff700 1 --2- 172.21.15.72:0/3125613011 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x558a85846910 0x558a85866b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:51.051 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.027+0000 7f95e8928700 1 -- 172.21.15.72:0/3125613011 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x558a85846910 msgr2=0x558a85866b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:51.051 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.027+0000 7f95e8928700 1 --2- 172.21.15.72:0/3125613011 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x558a85846910 0x558a85866b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:51.051 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.027+0000 7f95e8928700 1 -- 172.21.15.72:0/3125613011 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558a85847c90 msgr2=0x558a85881aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:51.051 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.027+0000 7f95e8928700 1 --2- 172.21.15.72:0/3125613011 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558a85847c90 0x558a85881aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:51.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.027+0000 7f95e8928700 1 -- 172.21.15.72:0/3125613011 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95d000e040 con 0x558a85841c40 2023-07-25T14:37:51.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.027+0000 7f95e8928700 1 --2- 172.21.15.72:0/3125613011 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558a85841c40 0x558a85841530 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f95d805fec0 tx=0x7f95d8057870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf53b69cc4a8858a server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:51.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.027+0000 7f95c37fe700 10 client.0 ms_handle_connect on v2:172.21.15.72:3300/0 2023-07-25T14:37:51.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.027+0000 7f95c37fe700 1 -- 172.21.15.72:0/3125613011 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95d80603f0 con 0x558a85841c40 2023-07-25T14:37:51.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.027+0000 7f95c37fe700 1 -- 172.21.15.72:0/3125613011 <== mon.0 v2:172.21.15.72:3300/0 2 ==== osd_map(57..57 src has 1..57) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f95d8089070 con 0x558a85841c40 2023-07-25T14:37:51.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.027+0000 7f95f6d24b80 1 -- 172.21.15.72:0/3125613011 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558a85815b40 con 0x558a85841c40 2023-07-25T14:37:51.052 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.027+0000 7f95c37fe700 1 -- 172.21.15.72:0/3125613011 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f95d8089230 con 0x558a85841c40 2023-07-25T14:37:51.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.027+0000 7f95f6d24b80 10 client.6321 fetch_fsmap learned FSMap version 33 2023-07-25T14:37:51.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.027+0000 7f95f6d24b80 1 -- 172.21.15.72:0/3125613011 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=2+}) v3 -- 0x558a855c4d90 con 0x558a85841c40 2023-07-25T14:37:51.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.027+0000 7f95c37fe700 1 -- 172.21.15.72:0/3125613011 <== mon.0 v2:172.21.15.72:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95d8073020 con 0x558a85841c40 2023-07-25T14:37:51.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.027+0000 7f95c37fe700 1 -- 172.21.15.72:0/3125613011 <== mon.0 v2:172.21.15.72:3300/0 5 ==== fsmap(e 33) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f95d8087250 con 0x558a85841c40 2023-07-25T14:37:51.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.027+0000 7f95f6d24b80 10 client.6321 fetch_fsmap finished waiting for FSMap version 33 2023-07-25T14:37:51.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.027+0000 7f95f6d24b80 10 client.6321 resolve_mds: resolved name 'd' to daemon mds.d 2023-07-25T14:37:51.053 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.027+0000 7f95f6d24b80 20 client.6321 populate_metadata read hostname 'smithi072' 2023-07-25T14:37:51.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.027+0000 7f95f6d24b80 1 --2- 172.21.15.72:0/3125613011 >> [v2:172.21.15.92:6833/2035914134,v1:172.21.15.92:6835/2035914134] conn(0x558a858821d0 0x558a8585d710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:51.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.027+0000 7f95f6d24b80 4 client.6321 mds_command: new command op to 6165 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-25T14:37:51.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.027+0000 7f95f6d24b80 1 -- 172.21.15.72:0/3125613011 --> [v2:172.21.15.92:6833/2035914134,v1:172.21.15.92:6835/2035914134] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558a857c1d40 con 0x558a858821d0 2023-07-25T14:37:51.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.027+0000 7f95e3fff700 1 --2- 172.21.15.72:0/3125613011 >> [v2:172.21.15.92:6833/2035914134,v1:172.21.15.92:6835/2035914134] conn(0x558a858821d0 0x558a8585d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:51.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.028+0000 7f95c37fe700 10 client.6321 ms_handle_connect on v2:172.21.15.92:6833/2035914134 2023-07-25T14:37:51.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.028+0000 7f95e3fff700 1 --2- 172.21.15.72:0/3125613011 >> [v2:172.21.15.92:6833/2035914134,v1:172.21.15.92:6835/2035914134] conn(0x558a858821d0 0x558a8585d710 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b22d6aad3eba629c server_cookie=78f2c5d9316d41ae in_seq=0 out_seq=0 2023-07-25T14:37:51.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.029+0000 7f95c37fe700 1 -- 172.21.15.72:0/3125613011 <== mds.0 v2:172.21.15.92:6833/2035914134 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x558a857c1d40 con 0x558a858821d0 2023-07-25T14:37:51.054 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.029+0000 7f95c37fe700 10 client.6321 handle_command_reply: tid=0 2023-07-25T14:37:51.055 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.029+0000 7f95f6d24b80 1 client.6321 shutdown 2023-07-25T14:37:51.055 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.029+0000 7f95f6d24b80 1 -- 172.21.15.72:0/3125613011 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558a85841c40 msgr2=0x558a85841530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:51.055 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.029+0000 7f95f6d24b80 1 --2- 172.21.15.72:0/3125613011 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558a85841c40 0x558a85841530 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f95d805fec0 tx=0x7f95d8057870 comp rx=0 tx=0).stop 2023-07-25T14:37:51.055 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.029+0000 7f95f6d24b80 1 -- 172.21.15.72:0/3125613011 shutdown_connections 2023-07-25T14:37:51.055 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.029+0000 7f95f6d24b80 1 --2- 172.21.15.72:0/3125613011 >> [v2:172.21.15.92:6833/2035914134,v1:172.21.15.92:6835/2035914134] conn(0x558a858821d0 0x558a8585d710 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:51.055 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.029+0000 7f95f6d24b80 1 --2- 172.21.15.72:0/3125613011 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558a85847c90 0x558a85881aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:51.055 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.029+0000 7f95f6d24b80 1 --2- 172.21.15.72:0/3125613011 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558a85841c40 0x558a85841530 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:51.056 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.029+0000 7f95c37fe700 0 client.6321 ms_handle_reset on v2:172.21.15.92:6833/2035914134 2023-07-25T14:37:51.056 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.029+0000 7f95f6d24b80 1 --2- 172.21.15.72:0/3125613011 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x558a85846910 0x558a85866b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:51.056 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.029+0000 7f95f6d24b80 1 -- 172.21.15.72:0/3125613011 >> 172.21.15.72:0/3125613011 conn(0x558a857a3c80 msgr2=0x558a8583fe70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:51.056 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.029+0000 7f95f6d24b80 1 -- 172.21.15.72:0/3125613011 shutdown_connections 2023-07-25T14:37:51.056 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.029+0000 7f95f6d24b80 1 -- 172.21.15.72:0/3125613011 wait complete. 2023-07-25T14:37:51.056 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.029+0000 7f95f6d24b80 20 client.6321 trim_cache size 0 max 16384 2023-07-25T14:37:51.057 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.047+0000 7f95f6d24b80 1 Processor -- start 2023-07-25T14:37:51.060 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.047+0000 7f95f6d24b80 1 -- start start 2023-07-25T14:37:51.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.047+0000 7f95f6d24b80 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x558a85841c40 0x558a858654a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:51.064 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.047+0000 7f95f6d24b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558a85846910 0x558a858659e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:51.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.047+0000 7f95f6d24b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558a85847c90 0x558a85863550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:51.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.047+0000 7f95f6d24b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a8561a8d0 con 0x558a85847c90 2023-07-25T14:37:51.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.047+0000 7f95f6d24b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a858a50c0 con 0x558a85846910 2023-07-25T14:37:51.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.047+0000 7f95f6d24b80 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x558a85843cd0 con 0x558a85841c40 2023-07-25T14:37:51.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.047+0000 7f95e9129700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558a85847c90 0x558a85863550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:51.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.047+0000 7f95e9129700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558a85847c90 0x558a85863550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43864/0 (socket says 172.21.15.72:43864) 2023-07-25T14:37:51.065 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.047+0000 7f95e9129700 1 -- 172.21.15.72:0/447078377 learned_addr learned my addr 172.21.15.72:0/447078377 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:37:51.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.047+0000 7f95e8928700 1 --2- 172.21.15.72:0/447078377 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x558a85841c40 0x558a858654a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:51.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.047+0000 7f95e3fff700 1 --2- 172.21.15.72:0/447078377 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558a85846910 0x558a858659e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:51.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.048+0000 7f95e9129700 1 -- 172.21.15.72:0/447078377 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x558a85841c40 msgr2=0x558a858654a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:51.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.048+0000 7f95e9129700 1 --2- 172.21.15.72:0/447078377 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x558a85841c40 0x558a858654a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:51.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.048+0000 7f95e9129700 1 -- 172.21.15.72:0/447078377 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558a85846910 msgr2=0x558a858659e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:51.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.048+0000 7f95e9129700 1 --2- 172.21.15.72:0/447078377 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558a85846910 0x558a858659e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:51.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.048+0000 7f95e9129700 1 -- 172.21.15.72:0/447078377 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558a855adc10 con 0x558a85847c90 2023-07-25T14:37:51.066 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.048+0000 7f95e9129700 1 --2- 172.21.15.72:0/447078377 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558a85847c90 0x558a85863550 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f95dc004c50 tx=0x7f95dc009030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbeafccb114c0346 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:51.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.048+0000 7f95ceffd700 1 -- 172.21.15.72:0/447078377 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95dc001360 con 0x558a85847c90 2023-07-25T14:37:51.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.048+0000 7f95ceffd700 1 -- 172.21.15.72:0/447078377 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95dc023040 con 0x558a85847c90 2023-07-25T14:37:51.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.048+0000 7f95ceffd700 1 -- 172.21.15.72:0/447078377 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95dc0019f0 con 0x558a85847c90 2023-07-25T14:37:51.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.048+0000 7f95f6d24b80 1 -- 172.21.15.72:0/447078377 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558a85847c90 msgr2=0x558a85863550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:51.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.048+0000 7f95f6d24b80 1 --2- 172.21.15.72:0/447078377 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558a85847c90 0x558a85863550 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f95dc004c50 tx=0x7f95dc009030 comp rx=0 tx=0).stop 2023-07-25T14:37:51.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.048+0000 7f95f6d24b80 1 -- 172.21.15.72:0/447078377 shutdown_connections 2023-07-25T14:37:51.067 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.048+0000 7f95f6d24b80 1 --2- 172.21.15.72:0/447078377 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x558a85841c40 0x558a858654a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:51.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.048+0000 7f95f6d24b80 1 --2- 172.21.15.72:0/447078377 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558a85847c90 0x558a85863550 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:51.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.048+0000 7f95f6d24b80 1 --2- 172.21.15.72:0/447078377 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558a85846910 0x558a858659e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:51.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.048+0000 7f95f6d24b80 1 -- 172.21.15.72:0/447078377 >> 172.21.15.72:0/447078377 conn(0x558a857a3c80 msgr2=0x558a85844570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:51.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.048+0000 7f95f6d24b80 1 -- 172.21.15.72:0/447078377 shutdown_connections 2023-07-25T14:37:51.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.048+0000 7f95f6d24b80 1 -- 172.21.15.72:0/447078377 wait complete. 2023-07-25T14:37:51.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.049+0000 7f95f6d24b80 1 -- start start 2023-07-25T14:37:51.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.049+0000 7f95f6d24b80 1 Processor -- start 2023-07-25T14:37:51.068 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.050+0000 7f95f6d24b80 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x558a85841c40 0x558a858e9e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:51.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.050+0000 7f95f6d24b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558a85846910 0x558a85856640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:51.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.050+0000 7f95f6d24b80 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558a85847c90 0x558a858e7240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:51.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.050+0000 7f95f6d24b80 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a85886e30 con 0x558a85847c90 2023-07-25T14:37:51.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.050+0000 7f95f6d24b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a858ea8a0 con 0x558a85846910 2023-07-25T14:37:51.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.050+0000 7f95f6d24b80 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x558a8588b310 con 0x558a85841c40 2023-07-25T14:37:51.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.050+0000 7f95f6d24b80 10 client.0 _ll_register_callbacks cb 0x558a85734630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-25T14:37:51.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.050+0000 7f95e9129700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558a85847c90 0x558a858e7240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:51.069 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.050+0000 7f95e9129700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558a85847c90 0x558a858e7240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43870/0 (socket says 172.21.15.72:43870) 2023-07-25T14:37:51.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.050+0000 7f95e9129700 1 -- 172.21.15.72:0/642247159 learned_addr learned my addr 172.21.15.72:0/642247159 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:37:51.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.050+0000 7f95e8928700 1 --2- 172.21.15.72:0/642247159 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x558a85841c40 0x558a858e9e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:51.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.050+0000 7f95e3fff700 1 --2- 172.21.15.72:0/642247159 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558a85846910 0x558a85856640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:51.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.050+0000 7f95e9129700 1 -- 172.21.15.72:0/642247159 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x558a85841c40 msgr2=0x558a858e9e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:51.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.050+0000 7f95e9129700 1 --2- 172.21.15.72:0/642247159 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x558a85841c40 0x558a858e9e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:51.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.050+0000 7f95e9129700 1 -- 172.21.15.72:0/642247159 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558a85846910 msgr2=0x558a85856640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:51.070 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.050+0000 7f95e9129700 1 --2- 172.21.15.72:0/642247159 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558a85846910 0x558a85856640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:51.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.050+0000 7f95e9129700 1 -- 172.21.15.72:0/642247159 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95d40035b0 con 0x558a85847c90 2023-07-25T14:37:51.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.050+0000 7f95e9129700 1 --2- 172.21.15.72:0/642247159 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558a85847c90 0x558a858e7240 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f95dc012000 tx=0x7f95dc001df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72e0ac9c2d47772c server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:51.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.050+0000 7f95c37fe700 10 client.0 ms_handle_connect on v2:172.21.15.72:3300/0 2023-07-25T14:37:51.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.051+0000 7f95c37fe700 1 -- 172.21.15.72:0/642247159 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95dc012af0 con 0x558a85847c90 2023-07-25T14:37:51.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.051+0000 7f95c37fe700 1 -- 172.21.15.72:0/642247159 <== mon.0 v2:172.21.15.72:3300/0 2 ==== osd_map(57..57 src has 1..57) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f95dc0019c0 con 0x558a85847c90 2023-07-25T14:37:51.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.051+0000 7f95f6d24b80 1 -- 172.21.15.72:0/642247159 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558a85838fe0 con 0x558a85847c90 2023-07-25T14:37:51.071 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.051+0000 7f95c37fe700 1 -- 172.21.15.72:0/642247159 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f95dc012c50 con 0x558a85847c90 2023-07-25T14:37:51.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.051+0000 7f95f6d24b80 10 client.6327 fetch_fsmap learned FSMap version 33 2023-07-25T14:37:51.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.051+0000 7f95f6d24b80 1 -- 172.21.15.72:0/642247159 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=2+}) v3 -- 0x558a855eb200 con 0x558a85847c90 2023-07-25T14:37:51.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.051+0000 7f95c37fe700 1 -- 172.21.15.72:0/642247159 <== mon.0 v2:172.21.15.72:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x558a85838fe0 con 0x558a85847c90 2023-07-25T14:37:51.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.051+0000 7f95c37fe700 1 -- 172.21.15.72:0/642247159 <== mon.0 v2:172.21.15.72:3300/0 5 ==== fsmap(e 33) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f95dc031410 con 0x558a85847c90 2023-07-25T14:37:51.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.051+0000 7f95f6d24b80 10 client.6327 fetch_fsmap finished waiting for FSMap version 33 2023-07-25T14:37:51.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.051+0000 7f95f6d24b80 10 client.6327 resolve_mds: resolved name 'd' to daemon mds.d 2023-07-25T14:37:51.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.051+0000 7f95f6d24b80 20 client.6327 populate_metadata read hostname 'smithi072' 2023-07-25T14:37:51.072 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.051+0000 7f95f6d24b80 1 --2- 172.21.15.72:0/642247159 >> [v2:172.21.15.92:6833/2035914134,v1:172.21.15.92:6835/2035914134] conn(0x558a85856b80 0x558a858678b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:51.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.051+0000 7f95f6d24b80 4 client.6327 mds_command: new command op to 6165 tid=0[{"prefix": "status"}] 2023-07-25T14:37:51.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.051+0000 7f95f6d24b80 1 -- 172.21.15.72:0/642247159 --> [v2:172.21.15.92:6833/2035914134,v1:172.21.15.92:6835/2035914134] -- command(tid 0: {"prefix": "status"}) v1 -- 0x558a85790730 con 0x558a85856b80 2023-07-25T14:37:51.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.051+0000 7f95e8928700 1 --2- 172.21.15.72:0/642247159 >> [v2:172.21.15.92:6833/2035914134,v1:172.21.15.92:6835/2035914134] conn(0x558a85856b80 0x558a858678b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:51.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.052+0000 7f95c37fe700 10 client.6327 ms_handle_connect on v2:172.21.15.92:6833/2035914134 2023-07-25T14:37:51.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.052+0000 7f95e8928700 1 --2- 172.21.15.72:0/642247159 >> [v2:172.21.15.92:6833/2035914134,v1:172.21.15.92:6835/2035914134] conn(0x558a85856b80 0x558a858678b0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9dc158af8a48203d server_cookie=6e612a48a0bb0bec in_seq=0 out_seq=0 2023-07-25T14:37:51.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.052+0000 7f95c37fe700 1 -- 172.21.15.72:0/642247159 <== mds.0 v2:172.21.15.92:6833/2035914134 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x558a85790730 con 0x558a85856b80 2023-07-25T14:37:51.073 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.052+0000 7f95c37fe700 10 client.6327 handle_command_reply: tid=0 2023-07-25T14:37:51.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.052+0000 7f95f6d24b80 1 client.6327 shutdown 2023-07-25T14:37:51.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.052+0000 7f95f6d24b80 1 -- 172.21.15.72:0/642247159 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558a85847c90 msgr2=0x558a858e7240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:51.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.052+0000 7f95f6d24b80 1 --2- 172.21.15.72:0/642247159 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558a85847c90 0x558a858e7240 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f95dc012000 tx=0x7f95dc001df0 comp rx=0 tx=0).stop 2023-07-25T14:37:51.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.052+0000 7f95f6d24b80 1 -- 172.21.15.72:0/642247159 shutdown_connections 2023-07-25T14:37:51.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.052+0000 7f95f6d24b80 1 --2- 172.21.15.72:0/642247159 >> [v2:172.21.15.92:6833/2035914134,v1:172.21.15.92:6835/2035914134] conn(0x558a85856b80 0x558a858678b0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:51.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.052+0000 7f95f6d24b80 1 --2- 172.21.15.72:0/642247159 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x558a85841c40 0x558a858e9e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:51.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.052+0000 7f95f6d24b80 1 --2- 172.21.15.72:0/642247159 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x558a85847c90 0x558a858e7240 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:51.074 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.052+0000 7f95c37fe700 0 client.6327 ms_handle_reset on v2:172.21.15.92:6833/2035914134 2023-07-25T14:37:51.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.052+0000 7f95f6d24b80 1 --2- 172.21.15.72:0/642247159 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558a85846910 0x558a85856640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:51.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.052+0000 7f95f6d24b80 1 -- 172.21.15.72:0/642247159 >> 172.21.15.72:0/642247159 conn(0x558a857a3c80 msgr2=0x558a85865100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:51.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.052+0000 7f95f6d24b80 1 -- 172.21.15.72:0/642247159 shutdown_connections 2023-07-25T14:37:51.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.052+0000 7f95f6d24b80 1 -- 172.21.15.72:0/642247159 wait complete. 2023-07-25T14:37:51.075 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.052+0000 7f95f6d24b80 20 client.6327 trim_cache size 0 max 16384 2023-07-25T14:37:51.075 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-07-25T14:37:51.076 INFO:teuthology.orchestra.run.smithi072.stdout: "cluster_fsid": "9170db48-9170-43e8-8ccb-9813e6240906", 2023-07-25T14:37:51.076 INFO:teuthology.orchestra.run.smithi072.stdout: "whoami": 0, 2023-07-25T14:37:51.076 INFO:teuthology.orchestra.run.smithi072.stdout: "id": 6165, 2023-07-25T14:37:51.076 INFO:teuthology.orchestra.run.smithi072.stdout: "want_state": "up:active", 2023-07-25T14:37:51.076 INFO:teuthology.orchestra.run.smithi072.stdout: "state": "up:active", 2023-07-25T14:37:51.076 INFO:teuthology.orchestra.run.smithi072.stdout: "fs_name": "cephfs", 2023-07-25T14:37:51.077 INFO:teuthology.orchestra.run.smithi072.stdout: "rank_uptime": 5.8607848169999999, 2023-07-25T14:37:51.077 INFO:teuthology.orchestra.run.smithi072.stdout: "mdsmap_epoch": 33, 2023-07-25T14:37:51.077 INFO:teuthology.orchestra.run.smithi072.stdout: "osdmap_epoch": 57, 2023-07-25T14:37:51.077 INFO:teuthology.orchestra.run.smithi072.stdout: "osdmap_epoch_barrier": 57, 2023-07-25T14:37:51.077 INFO:teuthology.orchestra.run.smithi072.stdout: "uptime": 11.883394123 2023-07-25T14:37:51.077 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-07-25T14:37:51.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.053+0000 7f95eab8c700 1 -- 172.21.15.72:0/2486652702 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f95c806ad10 msgr2=0x7f95c806d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:51.078 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.053+0000 7f95eab8c700 1 --2- 172.21.15.72:0/2486652702 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f95c806ad10 0x7f95c806d1d0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f95e406a320 tx=0x7f95d0008040 comp rx=0 tx=0).stop 2023-07-25T14:37:51.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.053+0000 7f95eab8c700 1 -- 172.21.15.72:0/2486652702 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f95e40abed0 msgr2=0x7f95e4154c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:51.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.053+0000 7f95eab8c700 1 --2- 172.21.15.72:0/2486652702 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f95e40abed0 0x7f95e4154c10 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f95d8010630 tx=0x7f95d80109f0 comp rx=0 tx=0).stop 2023-07-25T14:37:51.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.053+0000 7f95eab8c700 1 -- 172.21.15.72:0/2486652702 shutdown_connections 2023-07-25T14:37:51.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.053+0000 7f95eab8c700 1 --2- 172.21.15.72:0/2486652702 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f95c806ad10 0x7f95c806d1d0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:51.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.053+0000 7f95eab8c700 1 --2- 172.21.15.72:0/2486652702 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f95e40be280 0x7f95e40be700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:51.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.053+0000 7f95eab8c700 1 --2- 172.21.15.72:0/2486652702 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f95e40abed0 0x7f95e4154c10 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:51.079 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.053+0000 7f95eab8c700 1 --2- 172.21.15.72:0/2486652702 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f95e4150560 0x7f95e41509e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:51.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.053+0000 7f95eab8c700 1 -- 172.21.15.72:0/2486652702 >> 172.21.15.72:0/2486652702 conn(0x7f95e40a8520 msgr2=0x7f95e40c4b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:51.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.053+0000 7f95eab8c700 1 -- 172.21.15.72:0/2486652702 shutdown_connections 2023-07-25T14:37:51.080 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.053+0000 7f95eab8c700 1 -- 172.21.15.72:0/2486652702 wait complete. 2023-07-25T14:37:51.080 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-25T14:37:51.150 INFO:tasks.ceph.mds.d.smithi092.stderr:2023-07-25T14:37:51.140+0000 7f66e96b3700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-25T14:37:51.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.190+0000 7f84607b3700 1 Processor -- start 2023-07-25T14:37:51.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.190+0000 7f84607b3700 1 -- start start 2023-07-25T14:37:51.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.191+0000 7f84607b3700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8458151950 0x7f845806a190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:51.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.191+0000 7f84607b3700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f84580724c0 0x7f84580c34c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:51.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.191+0000 7f84607b3700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84580c2fe0 con 0x7f845806a6d0 2023-07-25T14:37:51.203 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.191+0000 7f84607b3700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8458071a60 con 0x7f8458151950 2023-07-25T14:37:51.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.191+0000 7f84607b3700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84580c2a70 con 0x7f84580724c0 2023-07-25T14:37:51.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.191+0000 7f845e54f700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8458151950 0x7f845806a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:51.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.191+0000 7f845e54f700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f8458151950 0x7f845806a190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43874/0 (socket says 172.21.15.72:43874) 2023-07-25T14:37:51.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.191+0000 7f845e54f700 1 -- 172.21.15.72:0/2566680744 learned_addr learned my addr 172.21.15.72:0/2566680744 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:37:51.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.191+0000 7f845dd4e700 1 --2- 172.21.15.72:0/2566680744 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f84580724c0 0x7f84580c34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:51.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.191+0000 7f845e54f700 1 -- 172.21.15.72:0/2566680744 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f84580724c0 msgr2=0x7f84580c34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:51.204 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.191+0000 7f845e54f700 1 --2- 172.21.15.72:0/2566680744 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f84580724c0 0x7f84580c34c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:51.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.191+0000 7f845e54f700 1 -- 172.21.15.72:0/2566680744 >> v1:172.21.15.92:6789/0 conn(0x7f845806a6d0 legacy=0x7f84580c3a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:51.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.191+0000 7f845e54f700 1 -- 172.21.15.72:0/2566680744 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8458155070 con 0x7f8458151950 2023-07-25T14:37:51.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.191+0000 7f845e54f700 1 --2- 172.21.15.72:0/2566680744 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8458151950 0x7f845806a190 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f84540098f0 tx=0x7f8454009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd67601d261747a server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:51.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.191+0000 7f845d54d700 1 -- 172.21.15.72:0/2566680744 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8454011830 con 0x7f8458151950 2023-07-25T14:37:51.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.191+0000 7f845d54d700 1 -- 172.21.15.72:0/2566680744 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8454011990 con 0x7f8458151950 2023-07-25T14:37:51.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.191+0000 7f845d54d700 1 -- 172.21.15.72:0/2566680744 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8454011d20 con 0x7f8458151950 2023-07-25T14:37:51.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.192+0000 7f84607b3700 1 -- 172.21.15.72:0/2566680744 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8458151950 msgr2=0x7f845806a190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:51.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.192+0000 7f84607b3700 1 --2- 172.21.15.72:0/2566680744 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8458151950 0x7f845806a190 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f84540098f0 tx=0x7f8454009c00 comp rx=0 tx=0).stop 2023-07-25T14:37:51.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.192+0000 7f84607b3700 1 -- 172.21.15.72:0/2566680744 shutdown_connections 2023-07-25T14:37:51.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.192+0000 7f84607b3700 1 --2- 172.21.15.72:0/2566680744 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8458151950 0x7f845806a190 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:51.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.192+0000 7f84607b3700 1 --2- 172.21.15.72:0/2566680744 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f84580724c0 0x7f84580c34c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:51.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.192+0000 7f84607b3700 1 -- 172.21.15.72:0/2566680744 >> 172.21.15.72:0/2566680744 conn(0x7f84580a87e0 msgr2=0x7f84580a8bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:51.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.192+0000 7f84607b3700 1 -- 172.21.15.72:0/2566680744 shutdown_connections 2023-07-25T14:37:51.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.192+0000 7f84607b3700 1 -- 172.21.15.72:0/2566680744 wait complete. 2023-07-25T14:37:51.208 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.193+0000 7f84607b3700 1 Processor -- start 2023-07-25T14:37:51.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.193+0000 7f84607b3700 1 -- start start 2023-07-25T14:37:51.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.194+0000 7f84607b3700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f845806a6d0 0x7f84581ecfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:51.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.194+0000 7f84607b3700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f84580724c0 0x7f84581eb0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:51.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.194+0000 7f84607b3700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8458151950 0x7f84581eb5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:51.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.194+0000 7f84607b3700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8458155eb0 con 0x7f845806a6d0 2023-07-25T14:37:51.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.194+0000 7f84607b3700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84581556a0 con 0x7f84580724c0 2023-07-25T14:37:51.209 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.194+0000 7f84607b3700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84580a5e60 con 0x7f8458151950 2023-07-25T14:37:51.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.194+0000 7f845e54f700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f845806a6d0 0x7f84581ecfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:51.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.194+0000 7f845e54f700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f845806a6d0 0x7f84581ecfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43880/0 (socket says 172.21.15.72:43880) 2023-07-25T14:37:51.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.194+0000 7f845e54f700 1 -- 172.21.15.72:0/4264589799 learned_addr learned my addr 172.21.15.72:0/4264589799 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:37:51.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.194+0000 7f845dd4e700 1 --2- 172.21.15.72:0/4264589799 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f84580724c0 0x7f84581eb0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:51.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.194+0000 7f845ed50700 1 --2- 172.21.15.72:0/4264589799 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8458151950 0x7f84581eb5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:51.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.194+0000 7f845e54f700 1 -- 172.21.15.72:0/4264589799 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8458151950 msgr2=0x7f84581eb5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:51.210 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.194+0000 7f845e54f700 1 --2- 172.21.15.72:0/4264589799 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8458151950 0x7f84581eb5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:51.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.194+0000 7f845e54f700 1 -- 172.21.15.72:0/4264589799 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f84580724c0 msgr2=0x7f84581eb0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:51.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.194+0000 7f845e54f700 1 --2- 172.21.15.72:0/4264589799 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f84580724c0 0x7f84581eb0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:51.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.194+0000 7f845e54f700 1 -- 172.21.15.72:0/4264589799 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8454009550 con 0x7f845806a6d0 2023-07-25T14:37:51.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.194+0000 7f845dd4e700 1 --2- 172.21.15.72:0/4264589799 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f84580724c0 0x7f84581eb0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-25T14:37:51.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.194+0000 7f845e54f700 1 --2- 172.21.15.72:0/4264589799 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f845806a6d0 0x7f84581ecfc0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f8454009c40 tx=0x7f8454004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:51.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.194+0000 7f844effd700 1 -- 172.21.15.72:0/4264589799 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84540036a0 con 0x7f845806a6d0 2023-07-25T14:37:51.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.194+0000 7f844effd700 1 -- 172.21.15.72:0/4264589799 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f845401e070 con 0x7f845806a6d0 2023-07-25T14:37:51.211 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.194+0000 7f844effd700 1 -- 172.21.15.72:0/4264589799 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8454003a60 con 0x7f845806a6d0 2023-07-25T14:37:51.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.194+0000 7f84607b3700 1 -- 172.21.15.72:0/4264589799 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84581edad0 con 0x7f845806a6d0 2023-07-25T14:37:51.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.195+0000 7f84607b3700 1 -- 172.21.15.72:0/4264589799 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8458155bd0 con 0x7f845806a6d0 2023-07-25T14:37:51.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.195+0000 7f84607b3700 1 -- 172.21.15.72:0/4264589799 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f845804e470 con 0x7f845806a6d0 2023-07-25T14:37:51.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.196+0000 7f844effd700 1 -- 172.21.15.72:0/4264589799 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8454003bc0 con 0x7f845806a6d0 2023-07-25T14:37:51.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.196+0000 7f844effd700 1 --2- 172.21.15.72:0/4264589799 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f843c06ace0 0x7f843c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:51.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.196+0000 7f844effd700 1 -- 172.21.15.72:0/4264589799 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f845408a560 con 0x7f845806a6d0 2023-07-25T14:37:51.212 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.196+0000 7f845dd4e700 1 --2- 172.21.15.72:0/4264589799 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f843c06ace0 0x7f843c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:51.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.197+0000 7f845dd4e700 1 --2- 172.21.15.72:0/4264589799 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f843c06ace0 0x7f843c06d1a0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f84580728c0 tx=0x7f8448008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:51.213 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.201+0000 7f844effd700 1 -- 172.21.15.72:0/4264589799 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f84540554c0 con 0x7f845806a6d0 2023-07-25T14:37:51.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.431+0000 7f84607b3700 1 -- 172.21.15.72:0/4264589799 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f84580722a0 con 0x7f845806a6d0 2023-07-25T14:37:51.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.432+0000 7f844effd700 1 -- 172.21.15.72:0/4264589799 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v33) v1 ==== 53+0+73 (secure 0 0 0) 0x7f8454058ae0 con 0x7f845806a6d0 2023-07-25T14:37:51.443 INFO:teuthology.orchestra.run.smithi072.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-25T14:37:51.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.434+0000 7f84607b3700 1 -- 172.21.15.72:0/4264589799 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f843c06ace0 msgr2=0x7f843c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:51.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.434+0000 7f84607b3700 1 --2- 172.21.15.72:0/4264589799 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f843c06ace0 0x7f843c06d1a0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f84580728c0 tx=0x7f8448008040 comp rx=0 tx=0).stop 2023-07-25T14:37:51.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.434+0000 7f84607b3700 1 -- 172.21.15.72:0/4264589799 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f845806a6d0 msgr2=0x7f84581ecfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:51.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.434+0000 7f84607b3700 1 --2- 172.21.15.72:0/4264589799 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f845806a6d0 0x7f84581ecfc0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f8454009c40 tx=0x7f8454004750 comp rx=0 tx=0).stop 2023-07-25T14:37:51.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.434+0000 7f84607b3700 1 -- 172.21.15.72:0/4264589799 shutdown_connections 2023-07-25T14:37:51.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.434+0000 7f84607b3700 1 --2- 172.21.15.72:0/4264589799 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f843c06ace0 0x7f843c06d1a0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:51.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.434+0000 7f84607b3700 1 --2- 172.21.15.72:0/4264589799 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f8458151950 0x7f84581eb5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:51.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.434+0000 7f84607b3700 1 --2- 172.21.15.72:0/4264589799 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f845806a6d0 0x7f84581ecfc0 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:51.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.434+0000 7f84607b3700 1 --2- 172.21.15.72:0/4264589799 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f84580724c0 0x7f84581eb0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:51.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.434+0000 7f84607b3700 1 -- 172.21.15.72:0/4264589799 >> 172.21.15.72:0/4264589799 conn(0x7f84580a87e0 msgr2=0x7f84580c5e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:51.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.434+0000 7f84607b3700 1 -- 172.21.15.72:0/4264589799 shutdown_connections 2023-07-25T14:37:51.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:51.434+0000 7f84607b3700 1 -- 172.21.15.72:0/4264589799 wait complete. 2023-07-25T14:37:51.456 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-07-25T14:37:51.457 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-25T14:37:51.457 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi072.front.sepia.ceph.com 2023-07-25T14:37:51.458 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-07-25T14:37:51.458 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-07-25T14:37:51.458 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-07-25T14:37:51.458 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-07-25T14:37:51.459 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-25T14:37:51.459 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-25T14:37:51.459 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-25T14:37:51.460 DEBUG:teuthology.orchestra.run.smithi072:> ip addr 2023-07-25T14:37:51.476 INFO:teuthology.orchestra.run.smithi072.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-25T14:37:51.477 INFO:teuthology.orchestra.run.smithi072.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-25T14:37:51.477 INFO:teuthology.orchestra.run.smithi072.stdout: inet 127.0.0.1/8 scope host lo 2023-07-25T14:37:51.477 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-07-25T14:37:51.477 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 ::1/128 scope host 2023-07-25T14:37:51.477 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-07-25T14:37:51.477 INFO:teuthology.orchestra.run.smithi072.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-25T14:37:51.478 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:d8:da:f4 brd ff:ff:ff:ff:ff:ff 2023-07-25T14:37:51.478 INFO:teuthology.orchestra.run.smithi072.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-25T14:37:51.478 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:d8:da:f5 brd ff:ff:ff:ff:ff:ff 2023-07-25T14:37:51.478 INFO:teuthology.orchestra.run.smithi072.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-25T14:37:51.478 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:8f:b7:64 brd ff:ff:ff:ff:ff:ff 2023-07-25T14:37:51.478 INFO:teuthology.orchestra.run.smithi072.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-25T14:37:51.478 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 0c:c4:7a:8f:b7:65 brd ff:ff:ff:ff:ff:ff 2023-07-25T14:37:51.479 INFO:teuthology.orchestra.run.smithi072.stdout: inet 172.21.15.72/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-07-25T14:37:51.479 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft 42167sec preferred_lft 42167sec 2023-07-25T14:37:51.479 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 fe80::3ce1:9f7:ed06:b425/64 scope link noprefixroute 2023-07-25T14:37:51.479 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-07-25T14:37:51.479 INFO:teuthology.orchestra.run.smithi072.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-25T14:37:51.479 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 16:a9:d8:9c:48:e3 brd ff:ff:ff:ff:ff:ff 2023-07-25T14:37:51.479 INFO:teuthology.orchestra.run.smithi072.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-25T14:37:51.480 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-07-25T14:37:51.480 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 fe80::3892:87ff:fee8:8d42/64 scope link 2023-07-25T14:37:51.480 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-07-25T14:37:51.480 INFO:teuthology.orchestra.run.smithi072.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-25T14:37:51.480 INFO:teuthology.orchestra.run.smithi072.stdout: link/ether 16:a9:d8:9c:48:e3 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-07-25T14:37:51.480 INFO:teuthology.orchestra.run.smithi072.stdout: inet6 fe80::14a9:d8ff:fe9c:48e3/64 scope link 2023-07-25T14:37:51.480 INFO:teuthology.orchestra.run.smithi072.stdout: valid_lft forever preferred_lft forever 2023-07-25T14:37:51.481 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-25T14:37:51.481 DEBUG:teuthology.orchestra.run.smithi072:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-25T14:37:51.542 INFO:teuthology.orchestra.run.smithi072.stdout:1 2023-07-25T14:37:51.543 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-25T14:37:51.544 DEBUG:teuthology.orchestra.run.smithi072:> route 2023-07-25T14:37:51.602 INFO:teuthology.orchestra.run.smithi072.stdout:Kernel IP routing table 2023-07-25T14:37:51.602 INFO:teuthology.orchestra.run.smithi072.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-25T14:37:51.602 INFO:teuthology.orchestra.run.smithi072.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-07-25T14:37:51.602 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-07-25T14:37:51.603 INFO:teuthology.orchestra.run.smithi072.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-25T14:37:51.603 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-25T14:37:51.603 DEBUG:teuthology.orchestra.run.smithi072:> (cd / && exec bash -c ' 2023-07-25T14:37:51.604 DEBUG:teuthology.orchestra.run.smithi072:> set -e 2023-07-25T14:37:51.604 DEBUG:teuthology.orchestra.run.smithi072:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-07-25T14:37:51.604 DEBUG:teuthology.orchestra.run.smithi072:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-07-25T14:37:51.605 DEBUG:teuthology.orchestra.run.smithi072:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-07-25T14:37:51.605 DEBUG:teuthology.orchestra.run.smithi072:> ') 2023-07-25T14:37:51.706 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-25T14:37:51.707 DEBUG:teuthology.orchestra.run.smithi072:> ip netns list 2023-07-25T14:37:51.724 INFO:teuthology.orchestra.run.smithi072.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-07-25T14:37:51.724 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-25T14:37:51.724 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-25T14:37:51.725 DEBUG:teuthology.orchestra.run.smithi072:> sudo ip link set brx.0 up 2023-07-25T14:37:51.789 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-25T14:37:51.790 DEBUG:teuthology.orchestra.run.smithi072:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-07-25T14:37:51.846 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-25T14:37:51.847 DEBUG:teuthology.orchestra.run.smithi072:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-07-25T14:37:51.902 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-07-25T14:37:51.903 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-25T14:37:51.903 DEBUG:teuthology.orchestra.run.smithi072:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-25T14:37:51.987 INFO:teuthology.orchestra.run.smithi072.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-25T14:37:51.988 INFO:teuthology.orchestra.run.smithi072.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-07-25T14:37:51.988 INFO:teuthology.orchestra.run.smithi072.stdout:invalid new device string format 2023-07-25T14:37:51.996 INFO:teuthology.orchestra.run.smithi072.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-25T14:37:51.996 INFO:teuthology.orchestra.run.smithi072.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-07-25T14:37:51.996 INFO:teuthology.orchestra.run.smithi072.stdout:invalid new device string format 2023-07-25T14:37:51.996 INFO:teuthology.orchestra.run.smithi072.stdout:mount.ceph: resolved to: "172.21.15.72:3300,172.21.15.92:3300,172.21.15.92:3301" 2023-07-25T14:37:51.997 INFO:teuthology.orchestra.run.smithi072.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-25T14:37:52.070 INFO:teuthology.orchestra.run.smithi072.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-07-25T14:37:52.071 INFO:teuthology.orchestra.run.smithi072.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-07-25T14:37:52.071 INFO:teuthology.orchestra.run.smithi072.stdout:invalid new device string format 2023-07-25T14:37:52.071 INFO:teuthology.orchestra.run.smithi072.stdout:mount.ceph: resolved to: "172.21.15.72:3300,172.21.15.92:3300,172.21.15.92:3301" 2023-07-25T14:37:52.071 INFO:teuthology.orchestra.run.smithi072.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-25T14:37:52.071 INFO:teuthology.orchestra.run.smithi072.stdout:mount.ceph: resolved to: "172.21.15.72:6789,172.21.15.92:6789,172.21.15.92:6790" 2023-07-25T14:37:52.071 INFO:teuthology.orchestra.run.smithi072.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.72:6789,172.21.15.92:6789,172.21.15.92:6790:/ 2023-07-25T14:37:52.071 INFO:teuthology.orchestra.run.smithi072.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=9170db48-9170-43e8-8ccb-9813e6240906" will pass to kernel 2023-07-25T14:37:52.072 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-25T14:37:52.073 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-25T14:37:52.073 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-07-25T14:37:52.100 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-25T14:37:52.101 DEBUG:teuthology.orchestra.run.smithi072:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-25T14:37:52.188 INFO:teuthology.orchestra.run.smithi072.stdout:client5393 2023-07-25T14:37:52.189 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-07-25T14:37:52.189 DEBUG:teuthology.orchestra.run.smithi072:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-25T14:37:52.206 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-25T14:37:52.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:52.356+0000 7f49f8d3c700 1 Processor -- start 2023-07-25T14:37:52.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:52.356+0000 7f49f8d3c700 1 -- start start 2023-07-25T14:37:52.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:52.357+0000 7f49f8d3c700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f49f4151ba0 0x7f49f40c2230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:52.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:52.357+0000 7f49f8d3c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f49f40c5f40 0x7f49f4154640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:52.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:52.357+0000 7f49f8d3c700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49f40c54f0 con 0x7f49f40ba0e0 2023-07-25T14:37:52.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:52.357+0000 7f49f8d3c700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49f40c6670 con 0x7f49f40c5f40 2023-07-25T14:37:52.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:52.357+0000 7f49f8d3c700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49f40c5740 con 0x7f49f4151ba0 2023-07-25T14:37:52.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:52.357+0000 7f49f1d9b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f49f40c5f40 0x7f49f4154640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:52.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:52.357+0000 7f49f2d9d700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f49f40ba0e0 0x7f49f4071740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:34630/0 (socket says 172.21.15.72:34630) 2023-07-25T14:37:52.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:52.357+0000 7f49f2d9d700 1 -- 172.21.15.72:0/3732520963 learned_addr learned my addr 172.21.15.72:0/3732520963 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:37:52.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:52.357+0000 7f49f1d9b700 1 -- 172.21.15.72:0/3732520963 >> v2:172.21.15.92:3300/0 conn(0x7f49f4151ba0 msgr2=0x7f49f40c2230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:52.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:52.357+0000 7f49f1d9b700 1 --2- 172.21.15.72:0/3732520963 >> v2:172.21.15.92:3300/0 conn(0x7f49f4151ba0 0x7f49f40c2230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:52.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:52.357+0000 7f49f1d9b700 1 -- 172.21.15.72:0/3732520963 >> v1:172.21.15.72:6789/0 conn(0x7f49f40ba0e0 legacy=0x7f49f4071740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:52.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:52.357+0000 7f49f1d9b700 1 -- 172.21.15.72:0/3732520963 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49f40c5a20 con 0x7f49f40c5f40 2023-07-25T14:37:52.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:52.357+0000 7f49f159a700 1 -- 172.21.15.72:0/3732520963 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 288213449 0 0) 0x7f49f40c54f0 con 0x7f49f40ba0e0 2023-07-25T14:37:52.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:52.357+0000 7f49f1d9b700 1 --2- 172.21.15.72:0/3732520963 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f49f40c5f40 0x7f49f4154640 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f49f40c52a0 tx=0x7f49e4009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c313d4d809a96707 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:52.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:52.358+0000 7f49f159a700 1 -- 172.21.15.72:0/3732520963 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49e4011830 con 0x7f49f40c5f40 2023-07-25T14:37:52.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:52.358+0000 7f49f159a700 1 -- 172.21.15.72:0/3732520963 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49e4011990 con 0x7f49f40c5f40 2023-07-25T14:37:52.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:52.358+0000 7f49f159a700 1 -- 172.21.15.72:0/3732520963 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49e4011d20 con 0x7f49f40c5f40 2023-07-25T14:37:52.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:52.358+0000 7f49f8d3c700 1 -- 172.21.15.72:0/3732520963 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f49f40c5f40 msgr2=0x7f49f4154640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:52.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:52.358+0000 7f49f8d3c700 1 --2- 172.21.15.72:0/3732520963 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f49f40c5f40 0x7f49f4154640 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f49f40c52a0 tx=0x7f49e4009b20 comp rx=0 tx=0).stop 2023-07-25T14:37:52.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:52.358+0000 7f49f8d3c700 1 -- 172.21.15.72:0/3732520963 shutdown_connections 2023-07-25T14:37:52.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:52.358+0000 7f49f8d3c700 1 --2- 172.21.15.72:0/3732520963 >> v2:172.21.15.92:3300/0 conn(0x7f49f4151ba0 0x7f49f40c2230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:52.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:52.358+0000 7f49f8d3c700 1 --2- 172.21.15.72:0/3732520963 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f49f40c5f40 0x7f49f4154640 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:52.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:52.358+0000 7f49f8d3c700 1 -- 172.21.15.72:0/3732520963 >> 172.21.15.72:0/3732520963 conn(0x7f49f40a87e0 msgr2=0x7f49f40a8bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:52.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:52.358+0000 7f49f8d3c700 1 -- 172.21.15.72:0/3732520963 shutdown_connections 2023-07-25T14:37:52.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:52.358+0000 7f49f8d3c700 1 -- 172.21.15.72:0/3732520963 wait complete. 2023-07-25T14:37:52.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:52.359+0000 7f49f8d3c700 1 Processor -- start 2023-07-25T14:37:52.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:52.360+0000 7f49f8d3c700 1 -- start start 2023-07-25T14:37:52.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:52.360+0000 7f49f8d3c700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f49f40ba0e0 0x7f49f40aa470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:52.374 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:52.360+0000 7f49f8d3c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f49f40c5f40 0x7f49f414ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:52.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:52.360+0000 7f49f8d3c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f49f4151ba0 0x7f49f41e9c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:52.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:52.360+0000 7f49f8d3c700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49f40a9fe0 con 0x7f49f40c5f40 2023-07-25T14:37:52.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:52.360+0000 7f49f8d3c700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49f40a7a70 con 0x7f49f4151ba0 2023-07-25T14:37:52.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:52.360+0000 7f49f8d3c700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49f40a8d60 con 0x7f49f40ba0e0 2023-07-25T14:37:52.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:52.360+0000 7f49f1d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f49f40c5f40 0x7f49f414ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:52.375 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:52.360+0000 7f49f1d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f49f40c5f40 0x7f49f414ead0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43898/0 (socket says 172.21.15.72:43898) 2023-07-25T14:37:52.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:52.360+0000 7f49f1d9b700 1 -- 172.21.15.72:0/3394129536 learned_addr learned my addr 172.21.15.72:0/3394129536 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:37:52.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:52.360+0000 7f49f2d9d700 1 --2- 172.21.15.72:0/3394129536 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f49f4151ba0 0x7f49f41e9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:52.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:52.360+0000 7f49f259c700 1 --2- 172.21.15.72:0/3394129536 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f49f40ba0e0 0x7f49f40aa470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:52.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:52.361+0000 7f49f1d9b700 1 -- 172.21.15.72:0/3394129536 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f49f40ba0e0 msgr2=0x7f49f40aa470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:52.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:52.361+0000 7f49f1d9b700 1 --2- 172.21.15.72:0/3394129536 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f49f40ba0e0 0x7f49f40aa470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:52.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:52.361+0000 7f49f1d9b700 1 -- 172.21.15.72:0/3394129536 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f49f4151ba0 msgr2=0x7f49f41e9c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:52.376 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:52.361+0000 7f49f1d9b700 1 --2- 172.21.15.72:0/3394129536 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f49f4151ba0 0x7f49f41e9c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:52.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:52.361+0000 7f49f1d9b700 1 -- 172.21.15.72:0/3394129536 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49e40094a0 con 0x7f49f40c5f40 2023-07-25T14:37:52.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:52.361+0000 7f49f2d9d700 1 --2- 172.21.15.72:0/3394129536 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f49f4151ba0 0x7f49f41e9c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-25T14:37:52.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:52.361+0000 7f49f1d9b700 1 --2- 172.21.15.72:0/3394129536 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f49f40c5f40 0x7f49f414ead0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f49e40090b0 tx=0x7f49e4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:52.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:52.361+0000 7f49e2ffd700 1 -- 172.21.15.72:0/3394129536 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49e4004520 con 0x7f49f40c5f40 2023-07-25T14:37:52.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:52.361+0000 7f49e2ffd700 1 -- 172.21.15.72:0/3394129536 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49e401f070 con 0x7f49f40c5f40 2023-07-25T14:37:52.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:52.361+0000 7f49f8d3c700 1 -- 172.21.15.72:0/3394129536 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49f40ac780 con 0x7f49f40c5f40 2023-07-25T14:37:52.377 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:52.361+0000 7f49e2ffd700 1 -- 172.21.15.72:0/3394129536 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49e40038e0 con 0x7f49f40c5f40 2023-07-25T14:37:52.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:52.361+0000 7f49f8d3c700 1 -- 172.21.15.72:0/3394129536 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49f4151220 con 0x7f49f40c5f40 2023-07-25T14:37:52.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:52.362+0000 7f49f8d3c700 1 -- 172.21.15.72:0/3394129536 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49f41513e0 con 0x7f49f40c5f40 2023-07-25T14:37:52.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:52.362+0000 7f49e2ffd700 1 -- 172.21.15.72:0/3394129536 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f49e4021030 con 0x7f49f40c5f40 2023-07-25T14:37:52.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:52.363+0000 7f49e2ffd700 1 --2- 172.21.15.72:0/3394129536 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f49d406ace0 0x7f49d406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:52.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:52.363+0000 7f49e2ffd700 1 -- 172.21.15.72:0/3394129536 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f49e408aa20 con 0x7f49f40c5f40 2023-07-25T14:37:52.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:52.363+0000 7f49f259c700 1 --2- 172.21.15.72:0/3394129536 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f49d406ace0 0x7f49d406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:52.378 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:52.363+0000 7f49f259c700 1 --2- 172.21.15.72:0/3394129536 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f49d406ace0 0x7f49d406d1a0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f49e8006fd0 tx=0x7f49e8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:52.379 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:52.367+0000 7f49e2ffd700 1 -- 172.21.15.72:0/3394129536 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f49e4055b40 con 0x7f49f40c5f40 2023-07-25T14:37:52.609 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:52.598+0000 7f49f8d3c700 1 -- 172.21.15.72:0/3394129536 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f49f406ca00 con 0x7f49f40c5f40 2023-07-25T14:37:52.610 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:52.598+0000 7f49e2ffd700 1 -- 172.21.15.72:0/3394129536 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v33) v1 ==== 53+0+73 (secure 0 0 0) 0x7f49e4059160 con 0x7f49f40c5f40 2023-07-25T14:37:52.610 INFO:teuthology.orchestra.run.smithi072.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-25T14:37:52.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:52.600+0000 7f49f8d3c700 1 -- 172.21.15.72:0/3394129536 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f49d406ace0 msgr2=0x7f49d406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:52.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:52.600+0000 7f49f8d3c700 1 --2- 172.21.15.72:0/3394129536 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f49d406ace0 0x7f49d406d1a0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f49e8006fd0 tx=0x7f49e8008040 comp rx=0 tx=0).stop 2023-07-25T14:37:52.611 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:52.600+0000 7f49f8d3c700 1 -- 172.21.15.72:0/3394129536 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f49f40c5f40 msgr2=0x7f49f414ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:52.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:52.600+0000 7f49f8d3c700 1 --2- 172.21.15.72:0/3394129536 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f49f40c5f40 0x7f49f414ead0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f49e40090b0 tx=0x7f49e4004750 comp rx=0 tx=0).stop 2023-07-25T14:37:52.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:52.600+0000 7f49f8d3c700 1 -- 172.21.15.72:0/3394129536 shutdown_connections 2023-07-25T14:37:52.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:52.600+0000 7f49f8d3c700 1 --2- 172.21.15.72:0/3394129536 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f49d406ace0 0x7f49d406d1a0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:52.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:52.600+0000 7f49f8d3c700 1 --2- 172.21.15.72:0/3394129536 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f49f40ba0e0 0x7f49f40aa470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:52.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:52.600+0000 7f49f8d3c700 1 --2- 172.21.15.72:0/3394129536 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f49f4151ba0 0x7f49f41e9c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:52.612 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:52.600+0000 7f49f8d3c700 1 --2- 172.21.15.72:0/3394129536 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f49f40c5f40 0x7f49f414ead0 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:52.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:52.600+0000 7f49f8d3c700 1 -- 172.21.15.72:0/3394129536 >> 172.21.15.72:0/3394129536 conn(0x7f49f40a87e0 msgr2=0x7f49f4071640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:52.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:52.600+0000 7f49f8d3c700 1 -- 172.21.15.72:0/3394129536 shutdown_connections 2023-07-25T14:37:52.613 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:52.600+0000 7f49f8d3c700 1 -- 172.21.15.72:0/3394129536 wait complete. 2023-07-25T14:37:52.623 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-07-25T14:37:52.624 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-25T14:37:52.624 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi092.front.sepia.ceph.com 2023-07-25T14:37:52.624 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-07-25T14:37:52.625 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-07-25T14:37:52.625 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-07-25T14:37:52.626 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-07-25T14:37:52.626 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-25T14:37:52.626 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-07-25T14:37:52.627 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-25T14:37:52.627 DEBUG:teuthology.orchestra.run.smithi092:> ip addr 2023-07-25T14:37:52.647 INFO:teuthology.orchestra.run.smithi092.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-25T14:37:52.648 INFO:teuthology.orchestra.run.smithi092.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-25T14:37:52.648 INFO:teuthology.orchestra.run.smithi092.stdout: inet 127.0.0.1/8 scope host lo 2023-07-25T14:37:52.648 INFO:teuthology.orchestra.run.smithi092.stdout: valid_lft forever preferred_lft forever 2023-07-25T14:37:52.648 INFO:teuthology.orchestra.run.smithi092.stdout: inet6 ::1/128 scope host 2023-07-25T14:37:52.648 INFO:teuthology.orchestra.run.smithi092.stdout: valid_lft forever preferred_lft forever 2023-07-25T14:37:52.649 INFO:teuthology.orchestra.run.smithi092.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-25T14:37:52.649 INFO:teuthology.orchestra.run.smithi092.stdout: link/ether 0c:c4:7a:d8:a1:b2 brd ff:ff:ff:ff:ff:ff 2023-07-25T14:37:52.649 INFO:teuthology.orchestra.run.smithi092.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-25T14:37:52.649 INFO:teuthology.orchestra.run.smithi092.stdout: link/ether 0c:c4:7a:d8:a1:b3 brd ff:ff:ff:ff:ff:ff 2023-07-25T14:37:52.650 INFO:teuthology.orchestra.run.smithi092.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-25T14:37:52.650 INFO:teuthology.orchestra.run.smithi092.stdout: link/ether 0c:c4:7a:8f:cd:44 brd ff:ff:ff:ff:ff:ff 2023-07-25T14:37:52.650 INFO:teuthology.orchestra.run.smithi092.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-25T14:37:52.650 INFO:teuthology.orchestra.run.smithi092.stdout: link/ether 0c:c4:7a:8f:cd:45 brd ff:ff:ff:ff:ff:ff 2023-07-25T14:37:52.650 INFO:teuthology.orchestra.run.smithi092.stdout: inet 172.21.15.92/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-07-25T14:37:52.651 INFO:teuthology.orchestra.run.smithi092.stdout: valid_lft 42121sec preferred_lft 42121sec 2023-07-25T14:37:52.651 INFO:teuthology.orchestra.run.smithi092.stdout: inet6 fe80::c8ab:79f5:f80b:16b/64 scope link noprefixroute 2023-07-25T14:37:52.651 INFO:teuthology.orchestra.run.smithi092.stdout: valid_lft forever preferred_lft forever 2023-07-25T14:37:52.651 INFO:teuthology.orchestra.run.smithi092.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-25T14:37:52.651 INFO:teuthology.orchestra.run.smithi092.stdout: link/ether 0e:6e:1c:1c:77:0f brd ff:ff:ff:ff:ff:ff 2023-07-25T14:37:52.651 INFO:teuthology.orchestra.run.smithi092.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-25T14:37:52.651 INFO:teuthology.orchestra.run.smithi092.stdout: valid_lft forever preferred_lft forever 2023-07-25T14:37:52.652 INFO:teuthology.orchestra.run.smithi092.stdout: inet6 fe80::5099:6cff:fecf:8811/64 scope link 2023-07-25T14:37:52.652 INFO:teuthology.orchestra.run.smithi092.stdout: valid_lft forever preferred_lft forever 2023-07-25T14:37:52.652 INFO:teuthology.orchestra.run.smithi092.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-25T14:37:52.652 INFO:teuthology.orchestra.run.smithi092.stdout: link/ether 0e:6e:1c:1c:77:0f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-07-25T14:37:52.652 INFO:teuthology.orchestra.run.smithi092.stdout: inet6 fe80::c6e:1cff:fe1c:770f/64 scope link 2023-07-25T14:37:52.652 INFO:teuthology.orchestra.run.smithi092.stdout: valid_lft forever preferred_lft forever 2023-07-25T14:37:52.653 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-25T14:37:52.653 DEBUG:teuthology.orchestra.run.smithi092:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-25T14:37:52.719 INFO:teuthology.orchestra.run.smithi092.stdout:1 2023-07-25T14:37:52.720 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-25T14:37:52.720 DEBUG:teuthology.orchestra.run.smithi092:> route 2023-07-25T14:37:52.781 INFO:teuthology.orchestra.run.smithi092.stdout:Kernel IP routing table 2023-07-25T14:37:52.781 INFO:teuthology.orchestra.run.smithi092.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-25T14:37:52.781 INFO:teuthology.orchestra.run.smithi092.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-07-25T14:37:52.781 INFO:teuthology.orchestra.run.smithi092.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-07-25T14:37:52.782 INFO:teuthology.orchestra.run.smithi092.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-25T14:37:52.782 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-25T14:37:52.782 DEBUG:teuthology.orchestra.run.smithi092:> (cd / && exec bash -c ' 2023-07-25T14:37:52.783 DEBUG:teuthology.orchestra.run.smithi092:> set -e 2023-07-25T14:37:52.783 DEBUG:teuthology.orchestra.run.smithi092:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-07-25T14:37:52.783 DEBUG:teuthology.orchestra.run.smithi092:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-07-25T14:37:52.784 DEBUG:teuthology.orchestra.run.smithi092:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-07-25T14:37:52.784 DEBUG:teuthology.orchestra.run.smithi092:> ') 2023-07-25T14:37:52.891 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-25T14:37:52.892 DEBUG:teuthology.orchestra.run.smithi092:> ip netns list 2023-07-25T14:37:52.909 INFO:teuthology.orchestra.run.smithi092.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-07-25T14:37:52.910 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-07-25T14:37:52.910 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-25T14:37:52.910 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip link set brx.0 up 2023-07-25T14:37:52.976 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-25T14:37:52.976 DEBUG:teuthology.orchestra.run.smithi092:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-07-25T14:37:53.033 INFO:teuthology.orchestra.run.smithi092.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-07-25T14:37:53.033 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-25T14:37:53.034 DEBUG:teuthology.orchestra.run.smithi092:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-07-25T14:37:53.092 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-07-25T14:37:53.093 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-25T14:37:53.093 DEBUG:teuthology.orchestra.run.smithi092:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-07-25T14:37:53.177 INFO:teuthology.orchestra.run.smithi092.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-07-25T14:37:53.177 INFO:teuthology.orchestra.run.smithi092.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-07-25T14:37:53.179 INFO:teuthology.orchestra.run.smithi092.stdout:invalid new device string format 2023-07-25T14:37:53.185 INFO:teuthology.orchestra.run.smithi092.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-07-25T14:37:53.186 INFO:teuthology.orchestra.run.smithi092.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-07-25T14:37:53.186 INFO:teuthology.orchestra.run.smithi092.stdout:invalid new device string format 2023-07-25T14:37:53.186 INFO:teuthology.orchestra.run.smithi092.stdout:mount.ceph: resolved to: "172.21.15.72:3300,172.21.15.92:3300,172.21.15.92:3301" 2023-07-25T14:37:53.186 INFO:teuthology.orchestra.run.smithi092.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-25T14:37:53.211 INFO:teuthology.orchestra.run.smithi092.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-07-25T14:37:53.212 INFO:teuthology.orchestra.run.smithi092.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-07-25T14:37:53.212 INFO:teuthology.orchestra.run.smithi092.stdout:invalid new device string format 2023-07-25T14:37:53.212 INFO:teuthology.orchestra.run.smithi092.stdout:mount.ceph: resolved to: "172.21.15.72:3300,172.21.15.92:3300,172.21.15.92:3301" 2023-07-25T14:37:53.212 INFO:teuthology.orchestra.run.smithi092.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-25T14:37:53.212 INFO:teuthology.orchestra.run.smithi092.stdout:mount.ceph: resolved to: "172.21.15.72:6789,172.21.15.92:6789,172.21.15.92:6790" 2023-07-25T14:37:53.212 INFO:teuthology.orchestra.run.smithi092.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.72:6789,172.21.15.92:6789,172.21.15.92:6790:/ 2023-07-25T14:37:53.212 INFO:teuthology.orchestra.run.smithi092.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=9170db48-9170-43e8-8ccb-9813e6240906" will pass to kernel 2023-07-25T14:37:53.215 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-25T14:37:53.215 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-25T14:37:53.215 DEBUG:teuthology.orchestra.run.smithi092:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-07-25T14:37:53.245 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-25T14:37:53.245 DEBUG:teuthology.orchestra.run.smithi092:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-25T14:37:53.316 INFO:teuthology.orchestra.run.smithi092.stdout:client5399 2023-07-25T14:37:53.317 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-07-25T14:37:53.317 DEBUG:teuthology.orchestra.run.smithi092:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-25T14:37:53.374 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth rm client.testuser 2023-07-25T14:37:53.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:53.489+0000 7f347bf0c700 1 Processor -- start 2023-07-25T14:37:53.500 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:53.489+0000 7f347bf0c700 1 -- start start 2023-07-25T14:37:53.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:53.490+0000 7f347bf0c700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f34740c42e0 0x7f347414f160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:53.502 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:53.490+0000 7f347bf0c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f34740ad6c0 0x7f347414f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:53.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:53.490+0000 7f347bf0c700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34740c27f0 con 0x7f34740c58a0 2023-07-25T14:37:53.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:53.490+0000 7f347bf0c700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f347414fbe0 con 0x7f34740ad6c0 2023-07-25T14:37:53.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:53.490+0000 7f347bf0c700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34740c24a0 con 0x7f34740c42e0 2023-07-25T14:37:53.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:53.490+0000 7f34794a7700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f34740ad6c0 0x7f347414f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:53.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:53.490+0000 7f34794a7700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f34740ad6c0 0x7f347414f6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43904/0 (socket says 172.21.15.72:43904) 2023-07-25T14:37:53.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:53.490+0000 7f34794a7700 1 -- 172.21.15.72:0/2120741607 learned_addr learned my addr 172.21.15.72:0/2120741607 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:37:53.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:53.490+0000 7f3479ca8700 1 --2- 172.21.15.72:0/2120741607 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f34740c42e0 0x7f347414f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:53.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:53.491+0000 7f34794a7700 1 -- 172.21.15.72:0/2120741607 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f34740c42e0 msgr2=0x7f347414f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:53.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:53.491+0000 7f34794a7700 1 --2- 172.21.15.72:0/2120741607 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f34740c42e0 0x7f347414f160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:53.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:53.491+0000 7f34794a7700 1 -- 172.21.15.72:0/2120741607 >> v1:172.21.15.92:6789/0 conn(0x7f34740c58a0 legacy=0x7f34740ac810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:53.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:53.491+0000 7f34794a7700 1 -- 172.21.15.72:0/2120741607 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3474152ec0 con 0x7f34740ad6c0 2023-07-25T14:37:53.504 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:53.491+0000 7f3479ca8700 1 --2- 172.21.15.72:0/2120741607 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f34740c42e0 0x7f347414f160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-25T14:37:53.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:53.491+0000 7f34794a7700 1 --2- 172.21.15.72:0/2120741607 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f34740ad6c0 0x7f347414f6a0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f34700098f0 tx=0x7f3470009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abea87ce354c6914 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:53.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:53.491+0000 7f3478ca6700 1 -- 172.21.15.72:0/2120741607 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f347000b8a0 con 0x7f34740ad6c0 2023-07-25T14:37:53.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:53.491+0000 7f3478ca6700 1 -- 172.21.15.72:0/2120741607 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f347000ba00 con 0x7f34740ad6c0 2023-07-25T14:37:53.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:53.491+0000 7f3478ca6700 1 -- 172.21.15.72:0/2120741607 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f347000bd90 con 0x7f34740ad6c0 2023-07-25T14:37:53.505 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:53.491+0000 7f347bf0c700 1 -- 172.21.15.72:0/2120741607 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f34740ad6c0 msgr2=0x7f347414f6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:53.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:53.491+0000 7f347bf0c700 1 --2- 172.21.15.72:0/2120741607 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f34740ad6c0 0x7f347414f6a0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f34700098f0 tx=0x7f3470009c00 comp rx=0 tx=0).stop 2023-07-25T14:37:53.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:53.491+0000 7f347bf0c700 1 -- 172.21.15.72:0/2120741607 shutdown_connections 2023-07-25T14:37:53.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:53.491+0000 7f347bf0c700 1 --2- 172.21.15.72:0/2120741607 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f34740c42e0 0x7f347414f160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:53.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:53.491+0000 7f347bf0c700 1 --2- 172.21.15.72:0/2120741607 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f34740ad6c0 0x7f347414f6a0 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:53.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:53.491+0000 7f347bf0c700 1 -- 172.21.15.72:0/2120741607 >> 172.21.15.72:0/2120741607 conn(0x7f347406a950 msgr2=0x7f34740a94b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:53.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:53.492+0000 7f347bf0c700 1 -- 172.21.15.72:0/2120741607 shutdown_connections 2023-07-25T14:37:53.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:53.492+0000 7f347bf0c700 1 -- 172.21.15.72:0/2120741607 wait complete. 2023-07-25T14:37:53.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:53.493+0000 7f347bf0c700 1 Processor -- start 2023-07-25T14:37:53.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:53.493+0000 7f347bf0c700 1 -- start start 2023-07-25T14:37:53.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:53.493+0000 7f347bf0c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f34740ad6c0 0x7f34740acf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:53.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:53.493+0000 7f347bf0c700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f34740c42e0 0x7f34740bf740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:53.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:53.493+0000 7f347bf0c700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f34740c58a0 0x7f34741488f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:53.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:53.493+0000 7f347bf0c700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34740bec10 con 0x7f34740ad6c0 2023-07-25T14:37:53.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:53.493+0000 7f347bf0c700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34740c5070 con 0x7f34740c42e0 2023-07-25T14:37:53.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:53.493+0000 7f347bf0c700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34740c1550 con 0x7f34740c58a0 2023-07-25T14:37:53.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:53.493+0000 7f3479ca8700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f34740ad6c0 0x7f34740acf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:53.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:53.493+0000 7f3479ca8700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f34740ad6c0 0x7f34740acf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43910/0 (socket says 172.21.15.72:43910) 2023-07-25T14:37:53.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:53.494+0000 7f3479ca8700 1 -- 172.21.15.72:0/4113650320 learned_addr learned my addr 172.21.15.72:0/4113650320 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:37:53.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:53.494+0000 7f347a4a9700 1 --2- 172.21.15.72:0/4113650320 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f34740c58a0 0x7f34741488f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:53.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:53.494+0000 7f34794a7700 1 --2- 172.21.15.72:0/4113650320 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f34740c42e0 0x7f34740bf740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:53.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:53.494+0000 7f3479ca8700 1 -- 172.21.15.72:0/4113650320 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f34740c58a0 msgr2=0x7f34741488f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:53.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:53.494+0000 7f3479ca8700 1 --2- 172.21.15.72:0/4113650320 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f34740c58a0 0x7f34741488f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:53.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:53.494+0000 7f3479ca8700 1 -- 172.21.15.72:0/4113650320 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f34740c42e0 msgr2=0x7f34740bf740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:53.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:53.494+0000 7f3479ca8700 1 --2- 172.21.15.72:0/4113650320 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f34740c42e0 0x7f34740bf740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:53.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:53.494+0000 7f3479ca8700 1 -- 172.21.15.72:0/4113650320 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3470009550 con 0x7f34740ad6c0 2023-07-25T14:37:53.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:53.494+0000 7f34794a7700 1 --2- 172.21.15.72:0/4113650320 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f34740c42e0 0x7f34740bf740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-25T14:37:53.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:53.494+0000 7f3479ca8700 1 --2- 172.21.15.72:0/4113650320 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f34740ad6c0 0x7f34740acf70 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f346400e810 tx=0x7f346400ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:53.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:53.494+0000 7f346a7fc700 1 -- 172.21.15.72:0/4113650320 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3464004230 con 0x7f34740ad6c0 2023-07-25T14:37:53.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:53.494+0000 7f346a7fc700 1 -- 172.21.15.72:0/4113650320 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3464004390 con 0x7f34740ad6c0 2023-07-25T14:37:53.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:53.494+0000 7f347bf0c700 1 -- 172.21.15.72:0/4113650320 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3474150bb0 con 0x7f34740ad6c0 2023-07-25T14:37:53.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:53.494+0000 7f346a7fc700 1 -- 172.21.15.72:0/4113650320 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34640036a0 con 0x7f34740ad6c0 2023-07-25T14:37:53.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:53.494+0000 7f347bf0c700 1 -- 172.21.15.72:0/4113650320 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34740c52c0 con 0x7f34740ad6c0 2023-07-25T14:37:53.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:53.495+0000 7f347bf0c700 1 -- 172.21.15.72:0/4113650320 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f347404e470 con 0x7f34740ad6c0 2023-07-25T14:37:53.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:53.496+0000 7f346a7fc700 1 -- 172.21.15.72:0/4113650320 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3464003800 con 0x7f34740ad6c0 2023-07-25T14:37:53.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:53.496+0000 7f346a7fc700 1 --2- 172.21.15.72:0/4113650320 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f345806ace0 0x7f345806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:53.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:53.496+0000 7f34794a7700 1 --2- 172.21.15.72:0/4113650320 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f345806ace0 0x7f345806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:53.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:53.496+0000 7f346a7fc700 1 -- 172.21.15.72:0/4113650320 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f3464089070 con 0x7f34740ad6c0 2023-07-25T14:37:53.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:53.496+0000 7f34794a7700 1 --2- 172.21.15.72:0/4113650320 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f345806ace0 0x7f345806d1a0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f34740ad690 tx=0x7f3470008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:53.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:53.500+0000 7f346a7fc700 1 -- 172.21.15.72:0/4113650320 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f3464054070 con 0x7f34740ad6c0 2023-07-25T14:37:53.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:53.769+0000 7f347bf0c700 1 -- 172.21.15.72:0/4113650320 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "auth rm", "entity": "client.testuser"} v 0) v1 -- 0x7f3474150d40 con 0x7f34740ad6c0 2023-07-25T14:37:53.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:53.769+0000 7f346a7fc700 1 -- 172.21.15.72:0/4113650320 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "auth rm", "entity": "client.testuser"}]=0 v17) v1 ==== 84+0+0 (secure 0 0 0) 0x7f3464057690 con 0x7f34740ad6c0 2023-07-25T14:37:53.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:53.771+0000 7f347bf0c700 1 -- 172.21.15.72:0/4113650320 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f345806ace0 msgr2=0x7f345806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:53.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:53.771+0000 7f347bf0c700 1 --2- 172.21.15.72:0/4113650320 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f345806ace0 0x7f345806d1a0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f34740ad690 tx=0x7f3470008030 comp rx=0 tx=0).stop 2023-07-25T14:37:53.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:53.771+0000 7f347bf0c700 1 -- 172.21.15.72:0/4113650320 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f34740ad6c0 msgr2=0x7f34740acf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:53.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:53.771+0000 7f347bf0c700 1 --2- 172.21.15.72:0/4113650320 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f34740ad6c0 0x7f34740acf70 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f346400e810 tx=0x7f346400ebd0 comp rx=0 tx=0).stop 2023-07-25T14:37:53.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:53.771+0000 7f347bf0c700 1 -- 172.21.15.72:0/4113650320 shutdown_connections 2023-07-25T14:37:53.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:53.771+0000 7f347bf0c700 1 --2- 172.21.15.72:0/4113650320 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f345806ace0 0x7f345806d1a0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:53.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:53.771+0000 7f347bf0c700 1 --2- 172.21.15.72:0/4113650320 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f34740c58a0 0x7f34741488f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:53.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:53.771+0000 7f347bf0c700 1 --2- 172.21.15.72:0/4113650320 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f34740ad6c0 0x7f34740acf70 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:53.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:53.771+0000 7f347bf0c700 1 --2- 172.21.15.72:0/4113650320 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f34740c42e0 0x7f34740bf740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:53.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:53.771+0000 7f347bf0c700 1 -- 172.21.15.72:0/4113650320 >> 172.21.15.72:0/4113650320 conn(0x7f347406a950 msgr2=0x7f34740a88b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:53.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:53.771+0000 7f347bf0c700 1 -- 172.21.15.72:0/4113650320 shutdown_connections 2023-07-25T14:37:53.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:53.771+0000 7f347bf0c700 1 -- 172.21.15.72:0/4113650320 wait complete. 2023-07-25T14:37:53.794 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-25T14:37:53.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:53.902+0000 7eff93a36700 1 Processor -- start 2023-07-25T14:37:53.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:53.902+0000 7eff93a36700 1 -- start start 2023-07-25T14:37:53.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:53.903+0000 7eff93a36700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7eff8c06b510 0x7eff8c151c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:53.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:53.903+0000 7eff93a36700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff8c152190 con 0x7eff8c06ea10 2023-07-25T14:37:53.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:53.903+0000 7eff93a36700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff8c0ac350 con 0x7eff8c0a7490 2023-07-25T14:37:53.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:53.903+0000 7eff93a36700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff8c0c1670 con 0x7eff8c06b510 2023-07-25T14:37:53.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:53.903+0000 7eff90fd1700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7eff8c06ea10 0x7eff8c14e5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:34654/0 (socket says 172.21.15.72:34654) 2023-07-25T14:37:53.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:53.903+0000 7eff90fd1700 1 -- 172.21.15.72:0/1399473056 learned_addr learned my addr 172.21.15.72:0/1399473056 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:37:53.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:53.903+0000 7eff917d2700 1 --2- 172.21.15.72:0/1399473056 >> v2:172.21.15.92:3300/0 conn(0x7eff8c06b510 0x7eff8c151c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:53.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:53.904+0000 7eff83fff700 1 -- 172.21.15.72:0/1399473056 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4254144659 0 0) 0x7eff88001110 con 0x7eff8c06ea10 2023-07-25T14:37:53.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:53.904+0000 7eff83fff700 1 -- 172.21.15.72:0/1399473056 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7eff780035b0 con 0x7eff8c06ea10 2023-07-25T14:37:53.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:53.904+0000 7eff917d2700 1 -- 172.21.15.72:0/1399473056 >> v1:172.21.15.92:6789/0 conn(0x7eff8c0a7490 legacy=0x7eff8c0a7940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:53.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:53.904+0000 7eff917d2700 1 -- 172.21.15.72:0/1399473056 >> v1:172.21.15.72:6789/0 conn(0x7eff8c06ea10 legacy=0x7eff8c14e5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:53.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:53.904+0000 7eff917d2700 1 -- 172.21.15.72:0/1399473056 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff8c066480 con 0x7eff8c06b510 2023-07-25T14:37:53.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:53.904+0000 7eff917d2700 1 --2- 172.21.15.72:0/1399473056 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7eff8c06b510 0x7eff8c151c50 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7eff7c009840 tx=0x7eff7c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=db533bc27da73f2f server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:53.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:53.904+0000 7eff83fff700 1 -- 172.21.15.72:0/1399473056 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff7c011830 con 0x7eff8c06b510 2023-07-25T14:37:53.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:53.904+0000 7eff83fff700 1 -- 172.21.15.72:0/1399473056 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff7c011990 con 0x7eff8c06b510 2023-07-25T14:37:53.917 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:53.904+0000 7eff83fff700 1 -- 172.21.15.72:0/1399473056 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff7c011d00 con 0x7eff8c06b510 2023-07-25T14:37:53.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:53.905+0000 7eff93a36700 1 -- 172.21.15.72:0/1399473056 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7eff8c06b510 msgr2=0x7eff8c151c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:53.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:53.905+0000 7eff93a36700 1 --2- 172.21.15.72:0/1399473056 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7eff8c06b510 0x7eff8c151c50 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7eff7c009840 tx=0x7eff7c009b50 comp rx=0 tx=0).stop 2023-07-25T14:37:53.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:53.905+0000 7eff93a36700 1 -- 172.21.15.72:0/1399473056 shutdown_connections 2023-07-25T14:37:53.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:53.905+0000 7eff93a36700 1 --2- 172.21.15.72:0/1399473056 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7eff8c06b510 0x7eff8c151c50 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:53.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:53.905+0000 7eff93a36700 1 -- 172.21.15.72:0/1399473056 >> 172.21.15.72:0/1399473056 conn(0x7eff8c06def0 msgr2=0x7eff8c06e300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:53.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:53.905+0000 7eff93a36700 1 -- 172.21.15.72:0/1399473056 shutdown_connections 2023-07-25T14:37:53.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:53.905+0000 7eff93a36700 1 -- 172.21.15.72:0/1399473056 wait complete. 2023-07-25T14:37:53.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:53.906+0000 7eff93a36700 1 Processor -- start 2023-07-25T14:37:53.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:53.906+0000 7eff93a36700 1 -- start start 2023-07-25T14:37:53.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:53.907+0000 7eff93a36700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7eff8c06b510 0x7eff8c151290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:53.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:53.907+0000 7eff93a36700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7eff8c06ea10 0x7eff8c14b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:53.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:53.907+0000 7eff93a36700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7eff8c0a7490 0x7eff8c14f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:53.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:53.907+0000 7eff93a36700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff8c150760 con 0x7eff8c0a7490 2023-07-25T14:37:53.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:53.907+0000 7eff93a36700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff8c1554f0 con 0x7eff8c06b510 2023-07-25T14:37:53.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:53.907+0000 7eff93a36700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff8c0abc10 con 0x7eff8c06ea10 2023-07-25T14:37:53.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:53.907+0000 7eff91fd3700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7eff8c0a7490 0x7eff8c14f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:53.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:53.907+0000 7eff91fd3700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7eff8c0a7490 0x7eff8c14f0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43928/0 (socket says 172.21.15.72:43928) 2023-07-25T14:37:53.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:53.907+0000 7eff91fd3700 1 -- 172.21.15.72:0/3969657561 learned_addr learned my addr 172.21.15.72:0/3969657561 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:37:53.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:53.907+0000 7eff917d2700 1 --2- 172.21.15.72:0/3969657561 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7eff8c06b510 0x7eff8c151290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:53.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:53.907+0000 7eff90fd1700 1 --2- 172.21.15.72:0/3969657561 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7eff8c06ea10 0x7eff8c14b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:53.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:53.908+0000 7eff91fd3700 1 -- 172.21.15.72:0/3969657561 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7eff8c06ea10 msgr2=0x7eff8c14b650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:53.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:53.908+0000 7eff91fd3700 1 --2- 172.21.15.72:0/3969657561 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7eff8c06ea10 0x7eff8c14b650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:53.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:53.908+0000 7eff91fd3700 1 -- 172.21.15.72:0/3969657561 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7eff8c06b510 msgr2=0x7eff8c151290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:53.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:53.908+0000 7eff91fd3700 1 --2- 172.21.15.72:0/3969657561 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7eff8c06b510 0x7eff8c151290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:53.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:53.908+0000 7eff91fd3700 1 -- 172.21.15.72:0/3969657561 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff7c0094a0 con 0x7eff8c0a7490 2023-07-25T14:37:53.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:53.908+0000 7eff90fd1700 1 --2- 172.21.15.72:0/3969657561 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7eff8c06ea10 0x7eff8c14b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-25T14:37:53.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:53.908+0000 7eff91fd3700 1 --2- 172.21.15.72:0/3969657561 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7eff8c0a7490 0x7eff8c14f0e0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7eff8400cc50 tx=0x7eff8400cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:53.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:53.908+0000 7eff81ffb700 1 -- 172.21.15.72:0/3969657561 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff84003c00 con 0x7eff8c0a7490 2023-07-25T14:37:53.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:53.908+0000 7eff81ffb700 1 -- 172.21.15.72:0/3969657561 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff84003d60 con 0x7eff8c0a7490 2023-07-25T14:37:53.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:53.908+0000 7eff93a36700 1 -- 172.21.15.72:0/3969657561 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff8c1e9f60 con 0x7eff8c0a7490 2023-07-25T14:37:53.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:53.908+0000 7eff81ffb700 1 -- 172.21.15.72:0/3969657561 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff8400ab60 con 0x7eff8c0a7490 2023-07-25T14:37:53.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:53.908+0000 7eff93a36700 1 -- 172.21.15.72:0/3969657561 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff8c155180 con 0x7eff8c0a7490 2023-07-25T14:37:53.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:53.909+0000 7eff93a36700 1 -- 172.21.15.72:0/3969657561 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff8c04e470 con 0x7eff8c0a7490 2023-07-25T14:37:53.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:53.909+0000 7eff81ffb700 1 -- 172.21.15.72:0/3969657561 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7eff8400acc0 con 0x7eff8c0a7490 2023-07-25T14:37:53.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:53.910+0000 7eff81ffb700 1 --2- 172.21.15.72:0/3969657561 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7eff7006ace0 0x7eff7006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:53.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:53.910+0000 7eff81ffb700 1 -- 172.21.15.72:0/3969657561 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6382+0+0 (secure 0 0 0) 0x7eff84089600 con 0x7eff8c0a7490 2023-07-25T14:37:53.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:53.910+0000 7eff917d2700 1 --2- 172.21.15.72:0/3969657561 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7eff7006ace0 0x7eff7006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:53.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:53.910+0000 7eff917d2700 1 --2- 172.21.15.72:0/3969657561 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7eff7006ace0 0x7eff7006d1a0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7eff7c009fd0 tx=0x7eff7c01c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:53.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:53.914+0000 7eff81ffb700 1 -- 172.21.15.72:0/3969657561 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7eff84054570 con 0x7eff8c0a7490 2023-07-25T14:37:54.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.100+0000 7eff93a36700 1 -- 172.21.15.72:0/3969657561 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7eff8c14bb90 con 0x7eff8c0a7490 2023-07-25T14:37:54.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.101+0000 7eff81ffb700 1 -- 172.21.15.72:0/3969657561 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v57) v1 ==== 74+0+18449 (secure 0 0 0) 0x7eff84057b90 con 0x7eff8c0a7490 2023-07-25T14:37:54.112 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-25T14:37:54.112 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":57,"fsid":"9170db48-9170-43e8-8ccb-9813e6240906","created":"2023-07-25T14:35:21.733262+0000","modified":"2023-07-25T14:37:46.187273+0000","last_up_change":"2023-07-25T14:35:31.355010+0000","last_in_change":"2023-07-25T14:35:24.195785+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-25T14:35:32.983457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-25T14:35:33.326342+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-07-25T14:37:42.689589+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-07-25T14:37:43.512214+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d517fdad-0bfe-49f0-89f2-9421c3761839","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6801","nonce":2475407414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6803","nonce":2475407414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6807","nonce":2475407414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6805","nonce":2475407414}]},"public_addr":"172.21.15.72:6801/2475407414","cluster_addr":"172.21.15.72:6803/2475407414","heartbeat_back_addr":"172.21.15.72:6807/2475407414","heartbeat_front_addr":"172.21.15.72:6805/2475407414","state":["exists","up"]},{"osd":1,"uuid":"e1564be3-f209-47e5-a8d0-32fc618a474f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6822","nonce":870954016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6825","nonce":870954016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6831","nonce":870954016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6827","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6829","nonce":870954016}]},"public_addr":"172.21.15.72:6822/870954016","cluster_addr":"172.21.15.72:6825/870954016","heartbeat_back_addr":"172.21.15.72:6831/870954016","heartbeat_front_addr":"172.21.15.72:6829/870954016","state":["exists","up"]},{"osd":2,"uuid":"c4647d30-ffa6-417a-9026-ef530c75910e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6809","nonce":2143129442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6811","nonce":2143129442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6815","nonce":2143129442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6813","nonce":2143129442}]},"public_addr":"172.21.15.72:6809/2143129442","cluster_addr":"172.21.15.72:6811/2143129442","heartbeat_back_addr":"172.21.15.72:6815/2143129442","heartbeat_front_addr":"172.21.15.72:6813/2143129442","state":["exists","up"]},{"osd":3,"uuid":"76c9d9a7-c2e2-4612-a58b-d6882dd76b58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6817","nonce":3404066311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6819","nonce":3404066311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6828","nonce":3404066311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6821","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6823","nonce":3404066311}]},"public_addr":"172.21.15.72:6817/3404066311","cluster_addr":"172.21.15.72:6819/3404066311","heartbeat_back_addr":"172.21.15.72:6828/3404066311","heartbeat_front_addr":"172.21.15.72:6823/3404066311","state":["exists","up"]},{"osd":4,"uuid":"7f8920dc-0ad4-4a73-ab40-65408f83eadd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6817","nonce":2381008739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6819","nonce":2381008739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6825","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6827","nonce":2381008739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6822","nonce":2381008739}]},"public_addr":"172.21.15.92:6817/2381008739","cluster_addr":"172.21.15.92:6819/2381008739","heartbeat_back_addr":"172.21.15.92:6827/2381008739","heartbeat_front_addr":"172.21.15.92:6822/2381008739","state":["exists","up"]},{"osd":5,"uuid":"56257e7c-31eb-44c5-9ec7-1318a4e0bb35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6801","nonce":2161935604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6803","nonce":2161935604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6807","nonce":2161935604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6805","nonce":2161935604}]},"public_addr":"172.21.15.92:6801/2161935604","cluster_addr":"172.21.15.92:6803/2161935604","heartbeat_back_addr":"172.21.15.92:6807/2161935604","heartbeat_front_addr":"172.21.15.92:6805/2161935604","state":["exists","up"]},{"osd":6,"uuid":"a150d3d8-a0c9-4955-968a-8d98eff4ffb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6809","nonce":3770163493}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6811","nonce":3770163493}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6815","nonce":3770163493}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6813","nonce":3770163493}]},"public_addr":"172.21.15.92:6809/3770163493","cluster_addr":"172.21.15.92:6811/3770163493","heartbeat_back_addr":"172.21.15.92:6815/3770163493","heartbeat_front_addr":"172.21.15.92:6813/3770163493","state":["exists","up"]},{"osd":7,"uuid":"07799c27-54ee-4591-a42d-a978d6b32065","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6821","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6823","nonce":2135777609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6826","nonce":2135777609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6831","nonce":2135777609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6829","nonce":2135777609}]},"public_addr":"172.21.15.92:6823/2135777609","cluster_addr":"172.21.15.92:6826/2135777609","heartbeat_back_addr":"172.21.15.92:6831/2135777609","heartbeat_front_addr":"172.21.15.92:6829/2135777609","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.345365+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.378150+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.146566+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.372172+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:30.398421+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.385632+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.465611+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.443583+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-25T14:37:54.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.103+0000 7eff93a36700 1 -- 172.21.15.72:0/3969657561 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7eff7006ace0 msgr2=0x7eff7006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:54.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.103+0000 7eff93a36700 1 --2- 172.21.15.72:0/3969657561 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7eff7006ace0 0x7eff7006d1a0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7eff7c009fd0 tx=0x7eff7c01c040 comp rx=0 tx=0).stop 2023-07-25T14:37:54.114 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.103+0000 7eff93a36700 1 -- 172.21.15.72:0/3969657561 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7eff8c0a7490 msgr2=0x7eff8c14f0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:54.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.103+0000 7eff93a36700 1 --2- 172.21.15.72:0/3969657561 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7eff8c0a7490 0x7eff8c14f0e0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7eff8400cc50 tx=0x7eff8400cf60 comp rx=0 tx=0).stop 2023-07-25T14:37:54.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.103+0000 7eff93a36700 1 -- 172.21.15.72:0/3969657561 shutdown_connections 2023-07-25T14:37:54.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.103+0000 7eff93a36700 1 --2- 172.21.15.72:0/3969657561 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7eff7006ace0 0x7eff7006d1a0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:54.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.103+0000 7eff93a36700 1 --2- 172.21.15.72:0/3969657561 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7eff8c0a7490 0x7eff8c14f0e0 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:54.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.103+0000 7eff93a36700 1 --2- 172.21.15.72:0/3969657561 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7eff8c06b510 0x7eff8c151290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:54.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.103+0000 7eff93a36700 1 --2- 172.21.15.72:0/3969657561 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7eff8c06ea10 0x7eff8c14b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:54.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.103+0000 7eff93a36700 1 -- 172.21.15.72:0/3969657561 >> 172.21.15.72:0/3969657561 conn(0x7eff8c06def0 msgr2=0x7eff8c070d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:54.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.103+0000 7eff93a36700 1 -- 172.21.15.72:0/3969657561 shutdown_connections 2023-07-25T14:37:54.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.103+0000 7eff93a36700 1 -- 172.21.15.72:0/3969657561 wait complete. 2023-07-25T14:37:54.126 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-07-25T14:35:32.983457+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-07-25T14:35:33.326342+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-25T14:37:42.689589+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '56', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs_data', 'create_time': '2023-07-25T14:37:43.512214+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '57', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-25T14:37:54.127 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-25T14:37:54.250 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.240+0000 7f9aa74de700 1 Processor -- start 2023-07-25T14:37:54.251 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.240+0000 7f9aa74de700 1 -- start start 2023-07-25T14:37:54.252 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.241+0000 7f9aa74de700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f9aa0151950 0x7f9aa006a190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:54.252 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.241+0000 7f9aa74de700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9aa00c2fe0 con 0x7f9aa00724c0 2023-07-25T14:37:54.252 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.241+0000 7f9aa74de700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9aa0155070 con 0x7f9aa006a6d0 2023-07-25T14:37:54.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.241+0000 7f9aa74de700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9aa0071a60 con 0x7f9aa0151950 2023-07-25T14:37:54.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.241+0000 7f9aa527a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f9aa0151950 0x7f9aa006a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:54.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.241+0000 7f9aa4a79700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f9aa00724c0 0x7f9aa00c34c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:34670/0 (socket says 172.21.15.72:34670) 2023-07-25T14:37:54.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.241+0000 7f9aa4a79700 1 -- 172.21.15.72:0/977701109 learned_addr learned my addr 172.21.15.72:0/977701109 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:37:54.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.241+0000 7f9a97fff700 1 -- 172.21.15.72:0/977701109 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 645129848 0 0) 0x7f9aa00c2fe0 con 0x7f9aa00724c0 2023-07-25T14:37:54.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.241+0000 7f9a97fff700 1 -- 172.21.15.72:0/977701109 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9a8c0035b0 con 0x7f9aa00724c0 2023-07-25T14:37:54.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.241+0000 7f9aa527a700 1 -- 172.21.15.72:0/977701109 >> v1:172.21.15.92:6789/0 conn(0x7f9aa006a6d0 legacy=0x7f9aa00c3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:54.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.241+0000 7f9aa527a700 1 -- 172.21.15.72:0/977701109 >> v1:172.21.15.72:6789/0 conn(0x7f9aa00724c0 legacy=0x7f9aa00c34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:54.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.241+0000 7f9aa527a700 1 -- 172.21.15.72:0/977701109 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9aa00c15c0 con 0x7f9aa0151950 2023-07-25T14:37:54.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.241+0000 7f9aa527a700 1 --2- 172.21.15.72:0/977701109 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9aa0151950 0x7f9aa006a190 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f9a9c009840 tx=0x7f9a9c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ff275126dff0354 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:54.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.241+0000 7f9a97fff700 1 -- 172.21.15.72:0/977701109 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a9c004230 con 0x7f9aa0151950 2023-07-25T14:37:54.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.241+0000 7f9a97fff700 1 -- 172.21.15.72:0/977701109 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a9c004390 con 0x7f9aa0151950 2023-07-25T14:37:54.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.241+0000 7f9a97fff700 1 -- 172.21.15.72:0/977701109 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a9c0036c0 con 0x7f9aa0151950 2023-07-25T14:37:54.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.242+0000 7f9aa74de700 1 -- 172.21.15.72:0/977701109 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9aa0151950 msgr2=0x7f9aa006a190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:54.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.242+0000 7f9aa74de700 1 --2- 172.21.15.72:0/977701109 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9aa0151950 0x7f9aa006a190 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f9a9c009840 tx=0x7f9a9c009b50 comp rx=0 tx=0).stop 2023-07-25T14:37:54.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.242+0000 7f9aa74de700 1 -- 172.21.15.72:0/977701109 shutdown_connections 2023-07-25T14:37:54.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.242+0000 7f9aa74de700 1 --2- 172.21.15.72:0/977701109 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9aa0151950 0x7f9aa006a190 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:54.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.242+0000 7f9aa74de700 1 -- 172.21.15.72:0/977701109 >> 172.21.15.72:0/977701109 conn(0x7f9aa00a87e0 msgr2=0x7f9aa00a8bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:54.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.242+0000 7f9aa74de700 1 -- 172.21.15.72:0/977701109 shutdown_connections 2023-07-25T14:37:54.257 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.242+0000 7f9aa74de700 1 -- 172.21.15.72:0/977701109 wait complete. 2023-07-25T14:37:54.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.243+0000 7f9aa74de700 1 Processor -- start 2023-07-25T14:37:54.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.243+0000 7f9aa74de700 1 -- start start 2023-07-25T14:37:54.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.244+0000 7f9aa74de700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9aa006a6d0 0x7f9aa00a7540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:54.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.244+0000 7f9aa74de700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9aa00724c0 0x7f9aa00c0590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:54.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.244+0000 7f9aa74de700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9aa0151950 0x7f9aa006f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:54.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.244+0000 7f9aa74de700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9aa00a81e0 con 0x7f9aa00724c0 2023-07-25T14:37:54.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.244+0000 7f9aa74de700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9aa00c0ad0 con 0x7f9aa0151950 2023-07-25T14:37:54.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.244+0000 7f9aa74de700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9aa00bfb60 con 0x7f9aa006a6d0 2023-07-25T14:37:54.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.244+0000 7f9aa4a79700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9aa00724c0 0x7f9aa00c0590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:54.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.244+0000 7f9aa4a79700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9aa00724c0 0x7f9aa00c0590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43940/0 (socket says 172.21.15.72:43940) 2023-07-25T14:37:54.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.244+0000 7f9aa4a79700 1 -- 172.21.15.72:0/4220182593 learned_addr learned my addr 172.21.15.72:0/4220182593 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:37:54.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.244+0000 7f9aa527a700 1 --2- 172.21.15.72:0/4220182593 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9aa006a6d0 0x7f9aa00a7540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:54.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.244+0000 7f9aa4a79700 1 -- 172.21.15.72:0/4220182593 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9aa006a6d0 msgr2=0x7f9aa00a7540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:54.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.244+0000 7f9aa5a7b700 1 --2- 172.21.15.72:0/4220182593 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9aa0151950 0x7f9aa006f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:54.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.244+0000 7f9aa4a79700 1 --2- 172.21.15.72:0/4220182593 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9aa006a6d0 0x7f9aa00a7540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:54.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.244+0000 7f9aa4a79700 1 -- 172.21.15.72:0/4220182593 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9aa0151950 msgr2=0x7f9aa006f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:54.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.244+0000 7f9aa4a79700 1 --2- 172.21.15.72:0/4220182593 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9aa0151950 0x7f9aa006f550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:54.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.244+0000 7f9aa4a79700 1 -- 172.21.15.72:0/4220182593 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a9c0094a0 con 0x7f9aa00724c0 2023-07-25T14:37:54.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.244+0000 7f9aa4a79700 1 --2- 172.21.15.72:0/4220182593 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9aa00724c0 0x7f9aa00c0590 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f9a9000c500 tx=0x7f9a9000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:54.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.245+0000 7f9a95ffb700 1 -- 172.21.15.72:0/4220182593 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a90005d70 con 0x7f9aa00724c0 2023-07-25T14:37:54.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.245+0000 7f9a95ffb700 1 -- 172.21.15.72:0/4220182593 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a900070d0 con 0x7f9aa00724c0 2023-07-25T14:37:54.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.245+0000 7f9a95ffb700 1 -- 172.21.15.72:0/4220182593 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a90007440 con 0x7f9aa00724c0 2023-07-25T14:37:54.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.245+0000 7f9aa74de700 1 -- 172.21.15.72:0/4220182593 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9aa00c0100 con 0x7f9aa00724c0 2023-07-25T14:37:54.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.245+0000 7f9aa74de700 1 -- 172.21.15.72:0/4220182593 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9aa00a7f00 con 0x7f9aa00724c0 2023-07-25T14:37:54.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.246+0000 7f9aa74de700 1 -- 172.21.15.72:0/4220182593 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9aa004e470 con 0x7f9aa00724c0 2023-07-25T14:37:54.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.246+0000 7f9a95ffb700 1 -- 172.21.15.72:0/4220182593 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9a900075a0 con 0x7f9aa00724c0 2023-07-25T14:37:54.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.246+0000 7f9a95ffb700 1 --2- 172.21.15.72:0/4220182593 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f9a8406ace0 0x7f9a8406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:54.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.247+0000 7f9aa527a700 1 --2- 172.21.15.72:0/4220182593 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f9a8406ace0 0x7f9a8406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:54.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.247+0000 7f9a95ffb700 1 -- 172.21.15.72:0/4220182593 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f9a90088930 con 0x7f9aa00724c0 2023-07-25T14:37:54.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.247+0000 7f9aa527a700 1 --2- 172.21.15.72:0/4220182593 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f9a8406ace0 0x7f9a8406d1a0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f9a9c000c00 tx=0x7f9a9c010000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:54.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.251+0000 7f9a95ffb700 1 -- 172.21.15.72:0/4220182593 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f9a900539e0 con 0x7f9aa00724c0 2023-07-25T14:37:54.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.435+0000 7f9aa74de700 1 -- 172.21.15.72:0/4220182593 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f9aa00ac9a0 con 0x7f9aa00724c0 2023-07-25T14:37:54.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.435+0000 7f9a95ffb700 1 -- 172.21.15.72:0/4220182593 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v57) v1 ==== 92+0+10 (secure 0 0 0) 0x7f9a90017020 con 0x7f9aa00724c0 2023-07-25T14:37:54.446 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 8 2023-07-25T14:37:54.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.437+0000 7f9aa74de700 1 -- 172.21.15.72:0/4220182593 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f9a8406ace0 msgr2=0x7f9a8406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:54.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.437+0000 7f9aa74de700 1 --2- 172.21.15.72:0/4220182593 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f9a8406ace0 0x7f9a8406d1a0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f9a9c000c00 tx=0x7f9a9c010000 comp rx=0 tx=0).stop 2023-07-25T14:37:54.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.437+0000 7f9aa74de700 1 -- 172.21.15.72:0/4220182593 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9aa00724c0 msgr2=0x7f9aa00c0590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:54.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.437+0000 7f9aa74de700 1 --2- 172.21.15.72:0/4220182593 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9aa00724c0 0x7f9aa00c0590 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f9a9000c500 tx=0x7f9a9000c8c0 comp rx=0 tx=0).stop 2023-07-25T14:37:54.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.437+0000 7f9aa74de700 1 -- 172.21.15.72:0/4220182593 shutdown_connections 2023-07-25T14:37:54.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.437+0000 7f9aa74de700 1 --2- 172.21.15.72:0/4220182593 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f9a8406ace0 0x7f9a8406d1a0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:54.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.437+0000 7f9aa74de700 1 --2- 172.21.15.72:0/4220182593 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f9aa006a6d0 0x7f9aa00a7540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:54.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.437+0000 7f9aa74de700 1 --2- 172.21.15.72:0/4220182593 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9aa0151950 0x7f9aa006f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:54.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.437+0000 7f9aa74de700 1 --2- 172.21.15.72:0/4220182593 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9aa00724c0 0x7f9aa00c0590 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:54.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.437+0000 7f9aa74de700 1 -- 172.21.15.72:0/4220182593 >> 172.21.15.72:0/4220182593 conn(0x7f9aa00a87e0 msgr2=0x7f9aa0152a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:54.450 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.437+0000 7f9aa74de700 1 -- 172.21.15.72:0/4220182593 shutdown_connections 2023-07-25T14:37:54.450 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.438+0000 7f9aa74de700 1 -- 172.21.15.72:0/4220182593 wait complete. 2023-07-25T14:37:54.460 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-25T14:37:54.582 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.572+0000 7f02373ee700 1 Processor -- start 2023-07-25T14:37:54.583 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.572+0000 7f02373ee700 1 -- start start 2023-07-25T14:37:54.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.573+0000 7f02373ee700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0230148bb0 0x7f023006ed20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:54.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.573+0000 7f02373ee700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f02300c1f70 0x7f023015c950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:54.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.573+0000 7f02373ee700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02300c0aa0 con 0x7f0230152a50 2023-07-25T14:37:54.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.573+0000 7f02373ee700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0230152fa0 con 0x7f02300c1f70 2023-07-25T14:37:54.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.573+0000 7f02373ee700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02300c0d80 con 0x7f0230148bb0 2023-07-25T14:37:54.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.573+0000 7f023598b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f02300c1f70 0x7f023015c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:54.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.573+0000 7f0234989700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f0230152a50 0x7f02300c1860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:34684/0 (socket says 172.21.15.72:34684) 2023-07-25T14:37:54.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.573+0000 7f0234989700 1 -- 172.21.15.72:0/4170363094 learned_addr learned my addr 172.21.15.72:0/4170363094 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:37:54.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.573+0000 7f023518a700 1 --2- 172.21.15.72:0/4170363094 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0230148bb0 0x7f023006ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:54.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.573+0000 7f023598b700 1 -- 172.21.15.72:0/4170363094 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0230148bb0 msgr2=0x7f023006ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:54.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.573+0000 7f023598b700 1 --2- 172.21.15.72:0/4170363094 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0230148bb0 0x7f023006ed20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:54.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.573+0000 7f023598b700 1 -- 172.21.15.72:0/4170363094 >> v1:172.21.15.72:6789/0 conn(0x7f0230152a50 legacy=0x7f02300c1860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:54.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.573+0000 7f023598b700 1 -- 172.21.15.72:0/4170363094 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02300c1060 con 0x7f02300c1f70 2023-07-25T14:37:54.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.573+0000 7f0227fff700 1 -- 172.21.15.72:0/4170363094 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2767293554 0 0) 0x7f02300c0aa0 con 0x7f0230152a50 2023-07-25T14:37:54.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.573+0000 7f023598b700 1 --2- 172.21.15.72:0/4170363094 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f02300c1f70 0x7f023015c950 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f0228009d90 tx=0x7f022800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cdfbc4d960a20e2 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:54.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.573+0000 7f0227fff700 1 -- 172.21.15.72:0/4170363094 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f022800e070 con 0x7f02300c1f70 2023-07-25T14:37:54.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.573+0000 7f0227fff700 1 -- 172.21.15.72:0/4170363094 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f022800bbd0 con 0x7f02300c1f70 2023-07-25T14:37:54.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.573+0000 7f0227fff700 1 -- 172.21.15.72:0/4170363094 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0228012430 con 0x7f02300c1f70 2023-07-25T14:37:54.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.574+0000 7f02373ee700 1 -- 172.21.15.72:0/4170363094 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f02300c1f70 msgr2=0x7f023015c950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:54.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.574+0000 7f02373ee700 1 --2- 172.21.15.72:0/4170363094 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f02300c1f70 0x7f023015c950 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f0228009d90 tx=0x7f022800b330 comp rx=0 tx=0).stop 2023-07-25T14:37:54.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.574+0000 7f02373ee700 1 -- 172.21.15.72:0/4170363094 shutdown_connections 2023-07-25T14:37:54.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.574+0000 7f02373ee700 1 --2- 172.21.15.72:0/4170363094 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f02300c1f70 0x7f023015c950 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:54.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.574+0000 7f02373ee700 1 --2- 172.21.15.72:0/4170363094 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0230148bb0 0x7f023006ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:54.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.574+0000 7f02373ee700 1 -- 172.21.15.72:0/4170363094 >> 172.21.15.72:0/4170363094 conn(0x7f0230071bf0 msgr2=0x7f023006a190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:54.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.574+0000 7f02373ee700 1 -- 172.21.15.72:0/4170363094 shutdown_connections 2023-07-25T14:37:54.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.574+0000 7f02373ee700 1 -- 172.21.15.72:0/4170363094 wait complete. 2023-07-25T14:37:54.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.575+0000 7f02373ee700 1 Processor -- start 2023-07-25T14:37:54.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.575+0000 7f02373ee700 1 -- start start 2023-07-25T14:37:54.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.576+0000 7f02373ee700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f02300c1f70 0x7f02301eac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:54.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.576+0000 7f02373ee700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0230148bb0 0x7f02301e8c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:54.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.576+0000 7f02373ee700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0230152a50 0x7f02301e9160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:54.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.576+0000 7f02373ee700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02301eb910 con 0x7f02300c1f70 2023-07-25T14:37:54.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.576+0000 7f02373ee700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02301497a0 con 0x7f0230148bb0 2023-07-25T14:37:54.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.576+0000 7f02373ee700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f023014d040 con 0x7f0230152a50 2023-07-25T14:37:54.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.576+0000 7f023518a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f02300c1f70 0x7f02301eac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:54.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.576+0000 7f023518a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f02300c1f70 0x7f02301eac40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43952/0 (socket says 172.21.15.72:43952) 2023-07-25T14:37:54.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.576+0000 7f023518a700 1 -- 172.21.15.72:0/525879616 learned_addr learned my addr 172.21.15.72:0/525879616 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:37:54.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.576+0000 7f023518a700 1 -- 172.21.15.72:0/525879616 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0230152a50 msgr2=0x7f02301e9160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:54.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.576+0000 7f023518a700 1 --2- 172.21.15.72:0/525879616 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0230152a50 0x7f02301e9160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:54.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.576+0000 7f023518a700 1 -- 172.21.15.72:0/525879616 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0230148bb0 msgr2=0x7f02301e8c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:54.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.576+0000 7f023518a700 1 --2- 172.21.15.72:0/525879616 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0230148bb0 0x7f02301e8c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:54.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.576+0000 7f023518a700 1 -- 172.21.15.72:0/525879616 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0228009a70 con 0x7f02300c1f70 2023-07-25T14:37:54.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.576+0000 7f023518a700 1 --2- 172.21.15.72:0/525879616 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f02300c1f70 0x7f02301eac40 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f022c00c820 tx=0x7f022c00cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:54.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.576+0000 7f0225ffb700 1 -- 172.21.15.72:0/525879616 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f022c011800 con 0x7f02300c1f70 2023-07-25T14:37:54.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.576+0000 7f0225ffb700 1 -- 172.21.15.72:0/525879616 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f022c011960 con 0x7f02300c1f70 2023-07-25T14:37:54.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.576+0000 7f02373ee700 1 -- 172.21.15.72:0/525879616 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02301eb630 con 0x7f02300c1f70 2023-07-25T14:37:54.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.576+0000 7f0225ffb700 1 -- 172.21.15.72:0/525879616 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f022c011d10 con 0x7f02300c1f70 2023-07-25T14:37:54.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.577+0000 7f02373ee700 1 -- 172.21.15.72:0/525879616 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0230149430 con 0x7f02300c1f70 2023-07-25T14:37:54.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.578+0000 7f02373ee700 1 -- 172.21.15.72:0/525879616 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f023004e470 con 0x7f02300c1f70 2023-07-25T14:37:54.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.578+0000 7f0225ffb700 1 -- 172.21.15.72:0/525879616 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f022c018360 con 0x7f02300c1f70 2023-07-25T14:37:54.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.578+0000 7f0225ffb700 1 --2- 172.21.15.72:0/525879616 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f021406ace0 0x7f021406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:54.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.578+0000 7f0225ffb700 1 -- 172.21.15.72:0/525879616 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f022c089530 con 0x7f02300c1f70 2023-07-25T14:37:54.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.578+0000 7f0234989700 1 --2- 172.21.15.72:0/525879616 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f021406ace0 0x7f021406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:54.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.579+0000 7f0234989700 1 --2- 172.21.15.72:0/525879616 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f021406ace0 0x7f021406d1a0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f02301ea930 tx=0x7f02200079f0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:54.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.582+0000 7f0225ffb700 1 -- 172.21.15.72:0/525879616 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f022c054530 con 0x7f02300c1f70 2023-07-25T14:37:54.779 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.769+0000 7f02373ee700 1 -- 172.21.15.72:0/525879616 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0230146a20 con 0x7f02300c1f70 2023-07-25T14:37:54.780 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.769+0000 7f0225ffb700 1 -- 172.21.15.72:0/525879616 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v57) v1 ==== 93+0+10 (secure 0 0 0) 0x7f022c057b50 con 0x7f02300c1f70 2023-07-25T14:37:54.780 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 1 2023-07-25T14:37:54.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.771+0000 7f02373ee700 1 -- 172.21.15.72:0/525879616 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f021406ace0 msgr2=0x7f021406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:54.782 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.771+0000 7f02373ee700 1 --2- 172.21.15.72:0/525879616 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f021406ace0 0x7f021406d1a0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f02301ea930 tx=0x7f02200079f0 comp rx=0 tx=0).stop 2023-07-25T14:37:54.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.771+0000 7f02373ee700 1 -- 172.21.15.72:0/525879616 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f02300c1f70 msgr2=0x7f02301eac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:54.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.771+0000 7f02373ee700 1 --2- 172.21.15.72:0/525879616 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f02300c1f70 0x7f02301eac40 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f022c00c820 tx=0x7f022c00cbe0 comp rx=0 tx=0).stop 2023-07-25T14:37:54.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.771+0000 7f02373ee700 1 -- 172.21.15.72:0/525879616 shutdown_connections 2023-07-25T14:37:54.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.771+0000 7f02373ee700 1 --2- 172.21.15.72:0/525879616 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f021406ace0 0x7f021406d1a0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:54.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.771+0000 7f02373ee700 1 --2- 172.21.15.72:0/525879616 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f0230152a50 0x7f02301e9160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:54.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.771+0000 7f02373ee700 1 --2- 172.21.15.72:0/525879616 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f02300c1f70 0x7f02301eac40 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:54.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.771+0000 7f02373ee700 1 --2- 172.21.15.72:0/525879616 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0230148bb0 0x7f02301e8c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:54.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.771+0000 7f02373ee700 1 -- 172.21.15.72:0/525879616 >> 172.21.15.72:0/525879616 conn(0x7f0230071bf0 msgr2=0x7f023006ed20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:54.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.771+0000 7f02373ee700 1 -- 172.21.15.72:0/525879616 shutdown_connections 2023-07-25T14:37:54.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.771+0000 7f02373ee700 1 -- 172.21.15.72:0/525879616 wait complete. 2023-07-25T14:37:54.794 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-25T14:37:54.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.905+0000 7fba26fa3700 1 Processor -- start 2023-07-25T14:37:54.916 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.905+0000 7fba26fa3700 1 -- start start 2023-07-25T14:37:54.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.906+0000 7fba26fa3700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fba2014faf0 0x7fba200c5e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:54.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.906+0000 7fba26fa3700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba200c4930 con 0x7fba200c3f10 2023-07-25T14:37:54.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.906+0000 7fba26fa3700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba200c5670 con 0x7fba200ba0e0 2023-07-25T14:37:54.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.906+0000 7fba26fa3700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba200726e0 con 0x7fba2014faf0 2023-07-25T14:37:54.919 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.906+0000 7fba25540700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fba200c3f10 0x7fba20071960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:34700/0 (socket says 172.21.15.72:34700) 2023-07-25T14:37:54.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.906+0000 7fba25540700 1 -- 172.21.15.72:0/1045880819 learned_addr learned my addr 172.21.15.72:0/1045880819 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:37:54.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.906+0000 7fba24d3f700 1 --2- 172.21.15.72:0/1045880819 >> v2:172.21.15.92:3300/0 conn(0x7fba2014faf0 0x7fba200c5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:54.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.906+0000 7fba1f7fe700 1 -- 172.21.15.72:0/1045880819 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 548662057 0 0) 0x7fba200c4930 con 0x7fba200c3f10 2023-07-25T14:37:54.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.906+0000 7fba1f7fe700 1 -- 172.21.15.72:0/1045880819 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba100035b0 con 0x7fba200c3f10 2023-07-25T14:37:54.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.907+0000 7fba1f7fe700 1 -- 172.21.15.72:0/1045880819 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 636971205 0 0) 0x7fba100035b0 con 0x7fba200c3f10 2023-07-25T14:37:54.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.907+0000 7fba1f7fe700 1 -- 172.21.15.72:0/1045880819 >> v2:172.21.15.92:3300/0 conn(0x7fba2014faf0 msgr2=0x7fba200c5e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:54.920 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.907+0000 7fba1f7fe700 1 --2- 172.21.15.72:0/1045880819 >> v2:172.21.15.92:3300/0 conn(0x7fba2014faf0 0x7fba200c5e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:54.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.907+0000 7fba1f7fe700 1 -- 172.21.15.72:0/1045880819 >> v1:172.21.15.92:6789/0 conn(0x7fba200ba0e0 legacy=0x7fba201558a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:54.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.907+0000 7fba1f7fe700 1 -- 172.21.15.72:0/1045880819 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba200c4b80 con 0x7fba200c3f10 2023-07-25T14:37:54.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.907+0000 7fba1f7fe700 1 -- 172.21.15.72:0/1045880819 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2559588315 0 0) 0x7fba180019f0 con 0x7fba200c3f10 2023-07-25T14:37:54.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.907+0000 7fba1f7fe700 1 -- 172.21.15.72:0/1045880819 >> v1:172.21.15.72:6789/0 conn(0x7fba200c3f10 legacy=0x7fba20071960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:54.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.907+0000 7fba1f7fe700 1 --2- 172.21.15.72:0/1045880819 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fba10003a00 0x7fba10003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:54.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.907+0000 7fba1f7fe700 1 --2- 172.21.15.72:0/1045880819 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fba10004850 0x7fba10004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:54.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.907+0000 7fba1f7fe700 1 --2- 172.21.15.72:0/1045880819 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fba10005210 0x7fba1000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:54.921 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.907+0000 7fba1f7fe700 1 -- 172.21.15.72:0/1045880819 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba200726e0 con 0x7fba10005210 2023-07-25T14:37:54.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.907+0000 7fba1f7fe700 1 -- 172.21.15.72:0/1045880819 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba1000c1b0 con 0x7fba10004850 2023-07-25T14:37:54.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.907+0000 7fba1f7fe700 1 -- 172.21.15.72:0/1045880819 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba1000c370 con 0x7fba10003a00 2023-07-25T14:37:54.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.907+0000 7fba25540700 1 --2- 172.21.15.72:0/1045880819 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fba10005210 0x7fba1000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:54.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.907+0000 7fba1ffff700 1 --2- 172.21.15.72:0/1045880819 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fba10004850 0x7fba10004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:54.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.907+0000 7fba24d3f700 1 --2- 172.21.15.72:0/1045880819 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fba10003a00 0x7fba10003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:54.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.907+0000 7fba25540700 1 -- 172.21.15.72:0/1045880819 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fba10003a00 msgr2=0x7fba10003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:54.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.907+0000 7fba25540700 1 --2- 172.21.15.72:0/1045880819 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fba10003a00 0x7fba10003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:54.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.907+0000 7fba25540700 1 -- 172.21.15.72:0/1045880819 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fba10004850 msgr2=0x7fba10004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:54.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.907+0000 7fba25540700 1 --2- 172.21.15.72:0/1045880819 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fba10004850 0x7fba10004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:54.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.907+0000 7fba25540700 1 -- 172.21.15.72:0/1045880819 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba100035b0 con 0x7fba10005210 2023-07-25T14:37:54.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.907+0000 7fba25540700 1 -- 172.21.15.72:0/1045880819 reap_dead start 2023-07-25T14:37:54.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.907+0000 7fba25540700 1 --2- 172.21.15.72:0/1045880819 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fba10005210 0x7fba1000ba10 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7fba1800a820 tx=0x7fba10005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ed51d02d7744354 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:54.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.907+0000 7fba1f7fe700 1 -- 172.21.15.72:0/1045880819 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba1800a2f0 con 0x7fba10005210 2023-07-25T14:37:54.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.907+0000 7fba1f7fe700 1 -- 172.21.15.72:0/1045880819 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba18012620 con 0x7fba10005210 2023-07-25T14:37:54.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.907+0000 7fba1f7fe700 1 -- 172.21.15.72:0/1045880819 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba180129d0 con 0x7fba10005210 2023-07-25T14:37:54.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.908+0000 7fba26fa3700 1 -- 172.21.15.72:0/1045880819 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fba10005210 msgr2=0x7fba1000ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:54.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.908+0000 7fba26fa3700 1 --2- 172.21.15.72:0/1045880819 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fba10005210 0x7fba1000ba10 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7fba1800a820 tx=0x7fba10005880 comp rx=0 tx=0).stop 2023-07-25T14:37:54.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.908+0000 7fba26fa3700 1 -- 172.21.15.72:0/1045880819 shutdown_connections 2023-07-25T14:37:54.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.908+0000 7fba26fa3700 1 --2- 172.21.15.72:0/1045880819 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fba10005210 0x7fba1000ba10 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:54.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.908+0000 7fba26fa3700 1 -- 172.21.15.72:0/1045880819 >> 172.21.15.72:0/1045880819 conn(0x7fba200a87e0 msgr2=0x7fba200a8bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:54.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.908+0000 7fba26fa3700 1 -- 172.21.15.72:0/1045880819 shutdown_connections 2023-07-25T14:37:54.924 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.908+0000 7fba26fa3700 1 -- 172.21.15.72:0/1045880819 wait complete. 2023-07-25T14:37:54.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.909+0000 7fba26fa3700 1 Processor -- start 2023-07-25T14:37:54.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.909+0000 7fba26fa3700 1 -- start start 2023-07-25T14:37:54.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.910+0000 7fba26fa3700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fba10005210 0x7fba200a6450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:54.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.910+0000 7fba26fa3700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fba200a7df0 0x7fba200bce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:54.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.910+0000 7fba26fa3700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fba200bd350 0x7fba2006f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:54.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.910+0000 7fba26fa3700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba200bb9c0 con 0x7fba200a7df0 2023-07-25T14:37:54.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.910+0000 7fba26fa3700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba200bc9f0 con 0x7fba200bd350 2023-07-25T14:37:54.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.910+0000 7fba26fa3700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba200a7510 con 0x7fba10005210 2023-07-25T14:37:54.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.910+0000 7fba1ffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fba200a7df0 0x7fba200bce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:54.928 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.910+0000 7fba1ffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fba200a7df0 0x7fba200bce10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43974/0 (socket says 172.21.15.72:43974) 2023-07-25T14:37:54.928 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.910+0000 7fba1ffff700 1 -- 172.21.15.72:0/848752203 learned_addr learned my addr 172.21.15.72:0/848752203 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:37:54.928 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.910+0000 7fba24d3f700 1 --2- 172.21.15.72:0/848752203 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fba10005210 0x7fba200a6450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:54.928 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.910+0000 7fba25540700 1 --2- 172.21.15.72:0/848752203 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fba200bd350 0x7fba2006f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:54.928 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.910+0000 7fba1ffff700 1 -- 172.21.15.72:0/848752203 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fba10005210 msgr2=0x7fba200a6450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:54.928 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.910+0000 7fba1ffff700 1 --2- 172.21.15.72:0/848752203 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fba10005210 0x7fba200a6450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:54.928 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.910+0000 7fba1ffff700 1 -- 172.21.15.72:0/848752203 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fba200bd350 msgr2=0x7fba2006f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:54.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.910+0000 7fba1ffff700 1 --2- 172.21.15.72:0/848752203 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fba200bd350 0x7fba2006f1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:54.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.910+0000 7fba1ffff700 1 -- 172.21.15.72:0/848752203 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba200ba8d0 con 0x7fba200a7df0 2023-07-25T14:37:54.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.911+0000 7fba1ffff700 1 --2- 172.21.15.72:0/848752203 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fba200a7df0 0x7fba200bce10 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7fba0c00f640 tx=0x7fba0c00f950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:54.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.911+0000 7fba1d7fa700 1 -- 172.21.15.72:0/848752203 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba0c0052e0 con 0x7fba200a7df0 2023-07-25T14:37:54.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.911+0000 7fba1d7fa700 1 -- 172.21.15.72:0/848752203 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba0c005440 con 0x7fba200a7df0 2023-07-25T14:37:54.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.911+0000 7fba1d7fa700 1 -- 172.21.15.72:0/848752203 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba0c0038a0 con 0x7fba200a7df0 2023-07-25T14:37:54.929 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.911+0000 7fba26fa3700 1 -- 172.21.15.72:0/848752203 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba200babb0 con 0x7fba200a7df0 2023-07-25T14:37:54.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.911+0000 7fba26fa3700 1 -- 172.21.15.72:0/848752203 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba200bb170 con 0x7fba200a7df0 2023-07-25T14:37:54.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.912+0000 7fba26fa3700 1 -- 172.21.15.72:0/848752203 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba200bcb30 con 0x7fba200a7df0 2023-07-25T14:37:54.930 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.912+0000 7fba1d7fa700 1 -- 172.21.15.72:0/848752203 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fba0c003a00 con 0x7fba200a7df0 2023-07-25T14:37:54.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.912+0000 7fba1d7fa700 1 --2- 172.21.15.72:0/848752203 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fba0406ace0 0x7fba0406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:54.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.913+0000 7fba1d7fa700 1 -- 172.21.15.72:0/848752203 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fba0c0891a0 con 0x7fba200a7df0 2023-07-25T14:37:54.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.913+0000 7fba24d3f700 1 --2- 172.21.15.72:0/848752203 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fba0406ace0 0x7fba0406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:54.979 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.913+0000 7fba24d3f700 1 --2- 172.21.15.72:0/848752203 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fba0406ace0 0x7fba0406d1a0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fba140045f0 tx=0x7fba14008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:54.980 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:54.917+0000 7fba1d7fa700 1 -- 172.21.15.72:0/848752203 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fba200bcb30 con 0x7fba200a7df0 2023-07-25T14:37:55.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.102+0000 7fba26fa3700 1 -- 172.21.15.72:0/848752203 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fba2004e470 con 0x7fba200a7df0 2023-07-25T14:37:55.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.102+0000 7fba1d7fa700 1 -- 172.21.15.72:0/848752203 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v57) v1 ==== 104+0+11 (secure 0 0 0) 0x7fba0c054110 con 0x7fba200a7df0 2023-07-25T14:37:55.113 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2023-07-25T14:37:55.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.104+0000 7fba26fa3700 1 -- 172.21.15.72:0/848752203 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fba0406ace0 msgr2=0x7fba0406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:55.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.104+0000 7fba26fa3700 1 --2- 172.21.15.72:0/848752203 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fba0406ace0 0x7fba0406d1a0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fba140045f0 tx=0x7fba14008040 comp rx=0 tx=0).stop 2023-07-25T14:37:55.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.104+0000 7fba26fa3700 1 -- 172.21.15.72:0/848752203 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fba200a7df0 msgr2=0x7fba200bce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:55.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.104+0000 7fba26fa3700 1 --2- 172.21.15.72:0/848752203 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fba200a7df0 0x7fba200bce10 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7fba0c00f640 tx=0x7fba0c00f950 comp rx=0 tx=0).stop 2023-07-25T14:37:55.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.104+0000 7fba26fa3700 1 -- 172.21.15.72:0/848752203 shutdown_connections 2023-07-25T14:37:55.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.104+0000 7fba26fa3700 1 --2- 172.21.15.72:0/848752203 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fba0406ace0 0x7fba0406d1a0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:55.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.104+0000 7fba26fa3700 1 --2- 172.21.15.72:0/848752203 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fba10005210 0x7fba200a6450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:55.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.104+0000 7fba26fa3700 1 --2- 172.21.15.72:0/848752203 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fba200bd350 0x7fba2006f1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:55.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.104+0000 7fba26fa3700 1 --2- 172.21.15.72:0/848752203 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fba200a7df0 0x7fba200bce10 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:55.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.104+0000 7fba26fa3700 1 -- 172.21.15.72:0/848752203 >> 172.21.15.72:0/848752203 conn(0x7fba200a87e0 msgr2=0x7fba20071960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:55.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.104+0000 7fba26fa3700 1 -- 172.21.15.72:0/848752203 shutdown_connections 2023-07-25T14:37:55.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.104+0000 7fba26fa3700 1 -- 172.21.15.72:0/848752203 wait complete. 2023-07-25T14:37:55.127 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-25T14:37:55.251 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.240+0000 7ff5f551b700 1 Processor -- start 2023-07-25T14:37:55.251 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.240+0000 7ff5f551b700 1 -- start start 2023-07-25T14:37:55.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.241+0000 7ff5f551b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff5f00bead0 0x7ff5f00c0350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:55.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.241+0000 7ff5f551b700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5f00bfeb0 con 0x7ff5f00c0890 2023-07-25T14:37:55.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.241+0000 7ff5f551b700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5f00bf2e0 con 0x7ff5f0151a90 2023-07-25T14:37:55.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.241+0000 7ff5f551b700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5f00c10b0 con 0x7ff5f00bead0 2023-07-25T14:37:55.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.241+0000 7ff5ee7fc700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7ff5f00bead0 0x7ff5f00c0350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:55.253 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.241+0000 7ff5ef7fe700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7ff5f00c0890 0x7ff5f00c44d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:34720/0 (socket says 172.21.15.72:34720) 2023-07-25T14:37:55.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.241+0000 7ff5ef7fe700 1 -- 172.21.15.72:0/913569558 learned_addr learned my addr 172.21.15.72:0/913569558 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:37:55.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.241+0000 7ff5ee7fc700 1 -- 172.21.15.72:0/913569558 >> v1:172.21.15.92:6789/0 conn(0x7ff5f0151a90 legacy=0x7ff5f0154d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:55.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.241+0000 7ff5ee7fc700 1 -- 172.21.15.72:0/913569558 >> v1:172.21.15.72:6789/0 conn(0x7ff5f00c0890 legacy=0x7ff5f00c44d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:55.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.241+0000 7ff5edffb700 1 -- 172.21.15.72:0/913569558 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 442004724 0 0) 0x7ff5f00bfeb0 con 0x7ff5f00c0890 2023-07-25T14:37:55.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.241+0000 7ff5ee7fc700 1 -- 172.21.15.72:0/913569558 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5f00bf580 con 0x7ff5f00bead0 2023-07-25T14:37:55.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.241+0000 7ff5ee7fc700 1 --2- 172.21.15.72:0/913569558 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff5f00bead0 0x7ff5f00c0350 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7ff5e0009840 tx=0x7ff5e0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33bb92af7048ed98 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:55.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.242+0000 7ff5edffb700 1 -- 172.21.15.72:0/913569558 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5e0011830 con 0x7ff5f00bead0 2023-07-25T14:37:55.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.242+0000 7ff5edffb700 1 -- 172.21.15.72:0/913569558 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5e0011990 con 0x7ff5f00bead0 2023-07-25T14:37:55.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.242+0000 7ff5edffb700 1 -- 172.21.15.72:0/913569558 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5e0011d20 con 0x7ff5f00bead0 2023-07-25T14:37:55.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.242+0000 7ff5f551b700 1 -- 172.21.15.72:0/913569558 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff5f00bead0 msgr2=0x7ff5f00c0350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:55.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.242+0000 7ff5f551b700 1 --2- 172.21.15.72:0/913569558 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff5f00bead0 0x7ff5f00c0350 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7ff5e0009840 tx=0x7ff5e0009b50 comp rx=0 tx=0).stop 2023-07-25T14:37:55.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.242+0000 7ff5f551b700 1 -- 172.21.15.72:0/913569558 shutdown_connections 2023-07-25T14:37:55.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.242+0000 7ff5f551b700 1 --2- 172.21.15.72:0/913569558 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff5f00bead0 0x7ff5f00c0350 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:55.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.242+0000 7ff5f551b700 1 -- 172.21.15.72:0/913569558 >> 172.21.15.72:0/913569558 conn(0x7ff5f006c3a0 msgr2=0x7ff5f006c780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:55.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.242+0000 7ff5f551b700 1 -- 172.21.15.72:0/913569558 shutdown_connections 2023-07-25T14:37:55.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.242+0000 7ff5f551b700 1 -- 172.21.15.72:0/913569558 wait complete. 2023-07-25T14:37:55.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.243+0000 7ff5f551b700 1 Processor -- start 2023-07-25T14:37:55.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.244+0000 7ff5f551b700 1 -- start start 2023-07-25T14:37:55.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.244+0000 7ff5f551b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff5f00bead0 0x7ff5f0158240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:55.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.244+0000 7ff5f551b700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff5f00c0890 0x7ff5f01509f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:55.258 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.244+0000 7ff5f551b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff5f0151a90 0x7ff5f01e6d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:55.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.244+0000 7ff5f551b700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5f01ea380 con 0x7ff5f0151a90 2023-07-25T14:37:55.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.244+0000 7ff5f551b700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5f00c96b0 con 0x7ff5f00bead0 2023-07-25T14:37:55.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.244+0000 7ff5f551b700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5f01e99e0 con 0x7ff5f00c0890 2023-07-25T14:37:55.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.244+0000 7ff5ef7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff5f0151a90 0x7ff5f01e6d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:55.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.244+0000 7ff5ef7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff5f0151a90 0x7ff5f01e6d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43988/0 (socket says 172.21.15.72:43988) 2023-07-25T14:37:55.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.244+0000 7ff5ef7fe700 1 -- 172.21.15.72:0/3525501539 learned_addr learned my addr 172.21.15.72:0/3525501539 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:37:55.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.244+0000 7ff5eeffd700 1 --2- 172.21.15.72:0/3525501539 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff5f00bead0 0x7ff5f0158240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:55.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.244+0000 7ff5ee7fc700 1 --2- 172.21.15.72:0/3525501539 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff5f00c0890 0x7ff5f01509f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:55.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.245+0000 7ff5ef7fe700 1 -- 172.21.15.72:0/3525501539 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff5f00c0890 msgr2=0x7ff5f01509f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:55.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.245+0000 7ff5ef7fe700 1 --2- 172.21.15.72:0/3525501539 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff5f00c0890 0x7ff5f01509f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:55.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.245+0000 7ff5ef7fe700 1 -- 172.21.15.72:0/3525501539 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff5f00bead0 msgr2=0x7ff5f0158240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:55.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.245+0000 7ff5ef7fe700 1 --2- 172.21.15.72:0/3525501539 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff5f00bead0 0x7ff5f0158240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:55.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.245+0000 7ff5ef7fe700 1 -- 172.21.15.72:0/3525501539 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5e00094a0 con 0x7ff5f0151a90 2023-07-25T14:37:55.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.245+0000 7ff5ef7fe700 1 --2- 172.21.15.72:0/3525501539 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff5f0151a90 0x7ff5f01e6d00 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7ff5e8002230 tx=0x7ff5e800cf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:55.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.245+0000 7ff5d77fe700 1 -- 172.21.15.72:0/3525501539 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5e800aac0 con 0x7ff5f0151a90 2023-07-25T14:37:55.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.245+0000 7ff5d77fe700 1 -- 172.21.15.72:0/3525501539 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5e800ac40 con 0x7ff5f0151a90 2023-07-25T14:37:55.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.245+0000 7ff5f551b700 1 -- 172.21.15.72:0/3525501539 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5f01e9cc0 con 0x7ff5f0151a90 2023-07-25T14:37:55.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.245+0000 7ff5d77fe700 1 -- 172.21.15.72:0/3525501539 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5e80070d0 con 0x7ff5f0151a90 2023-07-25T14:37:55.261 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.245+0000 7ff5f551b700 1 -- 172.21.15.72:0/3525501539 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5f0150f30 con 0x7ff5f0151a90 2023-07-25T14:37:55.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.246+0000 7ff5f551b700 1 -- 172.21.15.72:0/3525501539 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5f01ea4c0 con 0x7ff5f0151a90 2023-07-25T14:37:55.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.246+0000 7ff5d77fe700 1 -- 172.21.15.72:0/3525501539 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff5e8007250 con 0x7ff5f0151a90 2023-07-25T14:37:55.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.247+0000 7ff5d77fe700 1 --2- 172.21.15.72:0/3525501539 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7ff5dc06ace0 0x7ff5dc06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:55.262 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.247+0000 7ff5d77fe700 1 -- 172.21.15.72:0/3525501539 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6382+0+0 (secure 0 0 0) 0x7ff5e8089080 con 0x7ff5f0151a90 2023-07-25T14:37:55.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.247+0000 7ff5eeffd700 1 --2- 172.21.15.72:0/3525501539 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7ff5dc06ace0 0x7ff5dc06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:55.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.247+0000 7ff5eeffd700 1 --2- 172.21.15.72:0/3525501539 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7ff5dc06ace0 0x7ff5dc06d1a0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7ff5e4007fd0 tx=0x7ff5e4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:55.263 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.251+0000 7ff5d77fe700 1 -- 172.21.15.72:0/3525501539 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7ff5f01ea4c0 con 0x7ff5f0151a90 2023-07-25T14:37:55.450 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.440+0000 7ff5f551b700 1 -- 172.21.15.72:0/3525501539 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff5f01ea4c0 con 0x7ff5f0151a90 2023-07-25T14:37:55.451 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.440+0000 7ff5d77fe700 1 -- 172.21.15.72:0/3525501539 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v57) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff5f01ea4c0 con 0x7ff5f0151a90 2023-07-25T14:37:55.451 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 64 2023-07-25T14:37:55.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.442+0000 7ff5f551b700 1 -- 172.21.15.72:0/3525501539 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7ff5dc06ace0 msgr2=0x7ff5dc06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:55.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.442+0000 7ff5f551b700 1 --2- 172.21.15.72:0/3525501539 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7ff5dc06ace0 0x7ff5dc06d1a0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7ff5e4007fd0 tx=0x7ff5e4009040 comp rx=0 tx=0).stop 2023-07-25T14:37:55.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.442+0000 7ff5f551b700 1 -- 172.21.15.72:0/3525501539 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff5f0151a90 msgr2=0x7ff5f01e6d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:55.454 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.442+0000 7ff5f551b700 1 --2- 172.21.15.72:0/3525501539 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff5f0151a90 0x7ff5f01e6d00 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7ff5e8002230 tx=0x7ff5e800cf50 comp rx=0 tx=0).stop 2023-07-25T14:37:55.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.442+0000 7ff5f551b700 1 -- 172.21.15.72:0/3525501539 shutdown_connections 2023-07-25T14:37:55.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.442+0000 7ff5f551b700 1 --2- 172.21.15.72:0/3525501539 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7ff5dc06ace0 0x7ff5dc06d1a0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:55.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.442+0000 7ff5f551b700 1 --2- 172.21.15.72:0/3525501539 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7ff5f0151a90 0x7ff5f01e6d00 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:55.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.442+0000 7ff5f551b700 1 --2- 172.21.15.72:0/3525501539 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff5f00bead0 0x7ff5f0158240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:55.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.442+0000 7ff5f551b700 1 --2- 172.21.15.72:0/3525501539 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7ff5f00c0890 0x7ff5f01509f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:55.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.442+0000 7ff5f551b700 1 -- 172.21.15.72:0/3525501539 >> 172.21.15.72:0/3525501539 conn(0x7ff5f006c3a0 msgr2=0x7ff5f0153320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:55.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.442+0000 7ff5f551b700 1 -- 172.21.15.72:0/3525501539 shutdown_connections 2023-07-25T14:37:55.455 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.442+0000 7ff5f551b700 1 -- 172.21.15.72:0/3525501539 wait complete. 2023-07-25T14:37:55.465 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-07-25T14:37:55.585 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.575+0000 7f98ddc47700 1 Processor -- start 2023-07-25T14:37:55.586 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.575+0000 7f98ddc47700 1 -- start start 2023-07-25T14:37:55.587 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.575+0000 7f98ddc47700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f98d8151ba0 0x7f98d80c2230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:55.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.575+0000 7f98ddc47700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f98d80c5f40 0x7f98d8154640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:55.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.575+0000 7f98ddc47700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98d80c54f0 con 0x7f98d80ba0e0 2023-07-25T14:37:55.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.575+0000 7f98ddc47700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98d80c6670 con 0x7f98d80c5f40 2023-07-25T14:37:55.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.575+0000 7f98ddc47700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98d80c5740 con 0x7f98d8151ba0 2023-07-25T14:37:55.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.575+0000 7f98d6ffd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f98d80c5f40 0x7f98d8154640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:55.588 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.575+0000 7f98d6ffd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f98d80c5f40 0x7f98d8154640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:43996/0 (socket says 172.21.15.72:43996) 2023-07-25T14:37:55.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.575+0000 7f98d6ffd700 1 -- 172.21.15.72:0/2537568661 learned_addr learned my addr 172.21.15.72:0/2537568661 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:37:55.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.576+0000 7f98d77fe700 1 --2- 172.21.15.72:0/2537568661 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f98d8151ba0 0x7f98d80c2230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:55.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.576+0000 7f98d6ffd700 1 -- 172.21.15.72:0/2537568661 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f98d8151ba0 msgr2=0x7f98d80c2230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:55.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.576+0000 7f98d6ffd700 1 --2- 172.21.15.72:0/2537568661 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f98d8151ba0 0x7f98d80c2230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:55.589 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.576+0000 7f98d6ffd700 1 -- 172.21.15.72:0/2537568661 >> v1:172.21.15.92:6789/0 conn(0x7f98d80ba0e0 legacy=0x7f98d8071740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:55.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.576+0000 7f98d6ffd700 1 -- 172.21.15.72:0/2537568661 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98d80c5a20 con 0x7f98d80c5f40 2023-07-25T14:37:55.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.576+0000 7f98d6ffd700 1 --2- 172.21.15.72:0/2537568661 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f98d80c5f40 0x7f98d8154640 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f98cc0098f0 tx=0x7f98cc009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae83e9e7f2d61543 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:55.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.576+0000 7f98d67fc700 1 -- 172.21.15.72:0/2537568661 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98cc011830 con 0x7f98d80c5f40 2023-07-25T14:37:55.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.576+0000 7f98d67fc700 1 -- 172.21.15.72:0/2537568661 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98cc011990 con 0x7f98d80c5f40 2023-07-25T14:37:55.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.576+0000 7f98d67fc700 1 -- 172.21.15.72:0/2537568661 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98cc011d20 con 0x7f98d80c5f40 2023-07-25T14:37:55.590 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.577+0000 7f98ddc47700 1 -- 172.21.15.72:0/2537568661 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f98d80c5f40 msgr2=0x7f98d8154640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:55.591 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.577+0000 7f98ddc47700 1 --2- 172.21.15.72:0/2537568661 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f98d80c5f40 0x7f98d8154640 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f98cc0098f0 tx=0x7f98cc009c00 comp rx=0 tx=0).stop 2023-07-25T14:37:55.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.577+0000 7f98ddc47700 1 -- 172.21.15.72:0/2537568661 shutdown_connections 2023-07-25T14:37:55.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.577+0000 7f98ddc47700 1 --2- 172.21.15.72:0/2537568661 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f98d8151ba0 0x7f98d80c2230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:55.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.577+0000 7f98ddc47700 1 --2- 172.21.15.72:0/2537568661 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f98d80c5f40 0x7f98d8154640 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:55.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.577+0000 7f98ddc47700 1 -- 172.21.15.72:0/2537568661 >> 172.21.15.72:0/2537568661 conn(0x7f98d80a87e0 msgr2=0x7f98d80a8bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:55.592 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.577+0000 7f98ddc47700 1 -- 172.21.15.72:0/2537568661 shutdown_connections 2023-07-25T14:37:55.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.577+0000 7f98ddc47700 1 -- 172.21.15.72:0/2537568661 wait complete. 2023-07-25T14:37:55.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.578+0000 7f98ddc47700 1 Processor -- start 2023-07-25T14:37:55.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.578+0000 7f98ddc47700 1 -- start start 2023-07-25T14:37:55.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.579+0000 7f98ddc47700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f98d80ba0e0 0x7f98d80bf210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:55.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.579+0000 7f98ddc47700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f98d80c5f40 0x7f98d81e8280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:55.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.579+0000 7f98ddc47700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f98d8151ba0 0x7f98d80bc0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:55.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.579+0000 7f98ddc47700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98d806a6f0 con 0x7f98d8151ba0 2023-07-25T14:37:55.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.579+0000 7f98ddc47700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98d80bf750 con 0x7f98d80c5f40 2023-07-25T14:37:55.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.579+0000 7f98ddc47700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98d81e87c0 con 0x7f98d80ba0e0 2023-07-25T14:37:55.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.579+0000 7f98d7fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f98d8151ba0 0x7f98d80bc0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:55.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.579+0000 7f98d7fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f98d8151ba0 0x7f98d80bc0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:44004/0 (socket says 172.21.15.72:44004) 2023-07-25T14:37:55.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.579+0000 7f98d7fff700 1 -- 172.21.15.72:0/1431009322 learned_addr learned my addr 172.21.15.72:0/1431009322 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:37:55.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.579+0000 7f98d77fe700 1 --2- 172.21.15.72:0/1431009322 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f98d80ba0e0 0x7f98d80bf210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:55.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.579+0000 7f98d6ffd700 1 --2- 172.21.15.72:0/1431009322 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f98d80c5f40 0x7f98d81e8280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:55.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.579+0000 7f98d7fff700 1 -- 172.21.15.72:0/1431009322 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f98d80ba0e0 msgr2=0x7f98d80bf210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:55.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.579+0000 7f98d7fff700 1 --2- 172.21.15.72:0/1431009322 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f98d80ba0e0 0x7f98d80bf210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:55.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.579+0000 7f98d7fff700 1 -- 172.21.15.72:0/1431009322 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f98d80c5f40 msgr2=0x7f98d81e8280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:55.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.579+0000 7f98d7fff700 1 --2- 172.21.15.72:0/1431009322 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f98d80c5f40 0x7f98d81e8280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:55.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.579+0000 7f98d7fff700 1 -- 172.21.15.72:0/1431009322 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98cc009550 con 0x7f98d8151ba0 2023-07-25T14:37:55.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.579+0000 7f98d6ffd700 1 --2- 172.21.15.72:0/1431009322 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f98d80c5f40 0x7f98d81e8280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-25T14:37:55.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.579+0000 7f98d7fff700 1 --2- 172.21.15.72:0/1431009322 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f98d8151ba0 0x7f98d80bc0b0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f98d000cbf0 tx=0x7f98d000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:55.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.579+0000 7f98bffff700 1 -- 172.21.15.72:0/1431009322 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98d0003c00 con 0x7f98d8151ba0 2023-07-25T14:37:55.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.579+0000 7f98bffff700 1 -- 172.21.15.72:0/1431009322 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98d0003d60 con 0x7f98d8151ba0 2023-07-25T14:37:55.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.579+0000 7f98bffff700 1 -- 172.21.15.72:0/1431009322 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98d000ac20 con 0x7f98d8151ba0 2023-07-25T14:37:55.599 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.579+0000 7f98ddc47700 1 -- 172.21.15.72:0/1431009322 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98d806af00 con 0x7f98d8151ba0 2023-07-25T14:37:55.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.579+0000 7f98ddc47700 1 -- 172.21.15.72:0/1431009322 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98d806ac20 con 0x7f98d8151ba0 2023-07-25T14:37:55.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.580+0000 7f98ddc47700 1 -- 172.21.15.72:0/1431009322 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98d804e470 con 0x7f98d8151ba0 2023-07-25T14:37:55.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.581+0000 7f98bffff700 1 -- 172.21.15.72:0/1431009322 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f98d00050d0 con 0x7f98d8151ba0 2023-07-25T14:37:55.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.581+0000 7f98bffff700 1 --2- 172.21.15.72:0/1431009322 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f98c406ad10 0x7f98c406d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:55.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.581+0000 7f98bffff700 1 -- 172.21.15.72:0/1431009322 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f98d00895f0 con 0x7f98d8151ba0 2023-07-25T14:37:55.600 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.581+0000 7f98d77fe700 1 --2- 172.21.15.72:0/1431009322 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f98c406ad10 0x7f98c406d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:55.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.582+0000 7f98d77fe700 1 --2- 172.21.15.72:0/1431009322 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f98c406ad10 0x7f98c406d1d0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f98c8009ad0 tx=0x7f98c8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:55.601 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.585+0000 7f98bffff700 1 -- 172.21.15.72:0/1431009322 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f98d00545f0 con 0x7f98d8151ba0 2023-07-25T14:37:55.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.773+0000 7f98ddc47700 1 -- 172.21.15.72:0/1431009322 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f98d80b9ec0 con 0x7f98d8151ba0 2023-07-25T14:37:55.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.774+0000 7f98bffff700 1 -- 172.21.15.72:0/1431009322 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v57) v1 ==== 84+0+270 (secure 0 0 0) 0x7f98d0057c10 con 0x7f98d8151ba0 2023-07-25T14:37:55.785 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-25T14:37:55.785 INFO:teuthology.orchestra.run.smithi072.stdout:[ 2023-07-25T14:37:55.785 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-07-25T14:37:55.785 INFO:teuthology.orchestra.run.smithi072.stdout: "poolnum": 1, 2023-07-25T14:37:55.785 INFO:teuthology.orchestra.run.smithi072.stdout: "poolname": "rbd" 2023-07-25T14:37:55.786 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-07-25T14:37:55.786 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-07-25T14:37:55.786 INFO:teuthology.orchestra.run.smithi072.stdout: "poolnum": 2, 2023-07-25T14:37:55.786 INFO:teuthology.orchestra.run.smithi072.stdout: "poolname": ".mgr" 2023-07-25T14:37:55.786 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-07-25T14:37:55.786 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-07-25T14:37:55.786 INFO:teuthology.orchestra.run.smithi072.stdout: "poolnum": 10, 2023-07-25T14:37:55.786 INFO:teuthology.orchestra.run.smithi072.stdout: "poolname": "cephfs_metadata" 2023-07-25T14:37:55.787 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-07-25T14:37:55.787 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-07-25T14:37:55.787 INFO:teuthology.orchestra.run.smithi072.stdout: "poolnum": 11, 2023-07-25T14:37:55.787 INFO:teuthology.orchestra.run.smithi072.stdout: "poolname": "cephfs_data" 2023-07-25T14:37:55.787 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-07-25T14:37:55.787 INFO:teuthology.orchestra.run.smithi072.stdout:] 2023-07-25T14:37:55.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.776+0000 7f98ddc47700 1 -- 172.21.15.72:0/1431009322 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f98c406ad10 msgr2=0x7f98c406d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:55.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.776+0000 7f98ddc47700 1 --2- 172.21.15.72:0/1431009322 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f98c406ad10 0x7f98c406d1d0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f98c8009ad0 tx=0x7f98c8008040 comp rx=0 tx=0).stop 2023-07-25T14:37:55.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.776+0000 7f98ddc47700 1 -- 172.21.15.72:0/1431009322 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f98d8151ba0 msgr2=0x7f98d80bc0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:55.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.776+0000 7f98ddc47700 1 --2- 172.21.15.72:0/1431009322 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f98d8151ba0 0x7f98d80bc0b0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f98d000cbf0 tx=0x7f98d000a060 comp rx=0 tx=0).stop 2023-07-25T14:37:55.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.776+0000 7f98ddc47700 1 -- 172.21.15.72:0/1431009322 shutdown_connections 2023-07-25T14:37:55.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.776+0000 7f98ddc47700 1 --2- 172.21.15.72:0/1431009322 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f98c406ad10 0x7f98c406d1d0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:55.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.776+0000 7f98ddc47700 1 --2- 172.21.15.72:0/1431009322 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f98d80ba0e0 0x7f98d80bf210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:55.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.776+0000 7f98ddc47700 1 --2- 172.21.15.72:0/1431009322 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f98d8151ba0 0x7f98d80bc0b0 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:55.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.776+0000 7f98ddc47700 1 --2- 172.21.15.72:0/1431009322 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f98d80c5f40 0x7f98d81e8280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:55.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.776+0000 7f98ddc47700 1 -- 172.21.15.72:0/1431009322 >> 172.21.15.72:0/1431009322 conn(0x7f98d80a87e0 msgr2=0x7f98d814fc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:55.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.776+0000 7f98ddc47700 1 -- 172.21.15.72:0/1431009322 shutdown_connections 2023-07-25T14:37:55.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.776+0000 7f98ddc47700 1 -- 172.21.15.72:0/1431009322 wait complete. 2023-07-25T14:37:55.798 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs2' 2023-07-25T14:37:55.799 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs2_metadata --pg_num_min 64 2023-07-25T14:37:55.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.912+0000 7f2d548ca700 1 Processor -- start 2023-07-25T14:37:55.923 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.912+0000 7f2d548ca700 1 -- start start 2023-07-25T14:37:55.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.914+0000 7f2d548ca700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f2d500c5b90 0x7f2d500c6d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:55.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.914+0000 7f2d548ca700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2d500c49d0 0x7f2d5006db00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:55.925 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.914+0000 7f2d548ca700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d500c5250 con 0x7f2d5006e040 2023-07-25T14:37:55.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.914+0000 7f2d548ca700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d500c5530 con 0x7f2d500c5b90 2023-07-25T14:37:55.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.914+0000 7f2d548ca700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d500c6520 con 0x7f2d500c49d0 2023-07-25T14:37:55.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.914+0000 7f2d4ed9d700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f2d5006e040 0x7f2d50154c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:34748/0 (socket says 172.21.15.72:34748) 2023-07-25T14:37:55.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.914+0000 7f2d4ed9d700 1 -- 172.21.15.72:0/1789043533 learned_addr learned my addr 172.21.15.72:0/1789043533 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:37:55.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.914+0000 7f2d4dd9b700 1 --2- 172.21.15.72:0/1789043533 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2d500c49d0 0x7f2d5006db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:55.926 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.914+0000 7f2d4e59c700 1 --2- 172.21.15.72:0/1789043533 >> v2:172.21.15.92:3300/0 conn(0x7f2d500c5b90 0x7f2d500c6d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:55.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.914+0000 7f2d4d59a700 1 -- 172.21.15.72:0/1789043533 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3449942279 0 0) 0x7f2d500c5250 con 0x7f2d5006e040 2023-07-25T14:37:55.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.914+0000 7f2d4d59a700 1 -- 172.21.15.72:0/1789043533 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2d380035b0 con 0x7f2d5006e040 2023-07-25T14:37:55.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.914+0000 7f2d4e59c700 1 -- 172.21.15.72:0/1789043533 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2d500c49d0 msgr2=0x7f2d5006db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:55.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.914+0000 7f2d4e59c700 1 --2- 172.21.15.72:0/1789043533 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2d500c49d0 0x7f2d5006db00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:55.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.914+0000 7f2d4e59c700 1 -- 172.21.15.72:0/1789043533 >> v1:172.21.15.72:6789/0 conn(0x7f2d5006e040 legacy=0x7f2d50154c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:55.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.914+0000 7f2d4d59a700 1 -- 172.21.15.72:0/1789043533 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1945477515 0 0) 0x7f2d380035b0 con 0x7f2d5006e040 2023-07-25T14:37:55.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.914+0000 7f2d4e59c700 1 -- 172.21.15.72:0/1789043533 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d500c6800 con 0x7f2d500c5b90 2023-07-25T14:37:55.927 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.914+0000 7f2d4e59c700 1 --2- 172.21.15.72:0/1789043533 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2d500c5b90 0x7f2d500c6d20 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f2d44009840 tx=0x7f2d44009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2446a7cfa44c58fd server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:55.928 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.915+0000 7f2d4d59a700 1 -- 172.21.15.72:0/1789043533 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d480019f0 con 0x7f2d500c5b90 2023-07-25T14:37:55.928 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.915+0000 7f2d4d59a700 1 -- 172.21.15.72:0/1789043533 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d44004030 con 0x7f2d500c5b90 2023-07-25T14:37:55.928 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.915+0000 7f2d4d59a700 1 -- 172.21.15.72:0/1789043533 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d440043c0 con 0x7f2d500c5b90 2023-07-25T14:37:55.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.915+0000 7f2d548ca700 1 -- 172.21.15.72:0/1789043533 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2d500c5b90 msgr2=0x7f2d500c6d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:55.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.915+0000 7f2d548ca700 1 --2- 172.21.15.72:0/1789043533 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2d500c5b90 0x7f2d500c6d20 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f2d44009840 tx=0x7f2d44009b50 comp rx=0 tx=0).stop 2023-07-25T14:37:55.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.915+0000 7f2d548ca700 1 -- 172.21.15.72:0/1789043533 shutdown_connections 2023-07-25T14:37:55.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.915+0000 7f2d548ca700 1 --2- 172.21.15.72:0/1789043533 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2d500c5b90 0x7f2d500c6d20 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:55.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.915+0000 7f2d548ca700 1 --2- 172.21.15.72:0/1789043533 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2d500c49d0 0x7f2d5006db00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:55.931 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.915+0000 7f2d548ca700 1 -- 172.21.15.72:0/1789043533 >> 172.21.15.72:0/1789043533 conn(0x7f2d5006bbc0 msgr2=0x7f2d500a8590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:55.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.915+0000 7f2d548ca700 1 -- 172.21.15.72:0/1789043533 shutdown_connections 2023-07-25T14:37:55.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.915+0000 7f2d548ca700 1 -- 172.21.15.72:0/1789043533 wait complete. 2023-07-25T14:37:55.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.916+0000 7f2d548ca700 1 Processor -- start 2023-07-25T14:37:55.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.917+0000 7f2d548ca700 1 -- start start 2023-07-25T14:37:55.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.917+0000 7f2d548ca700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2d5006e040 0x7f2d5015d920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:55.932 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.917+0000 7f2d548ca700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2d500c49d0 0x7f2d501ed4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:55.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.917+0000 7f2d548ca700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2d500c5b90 0x7f2d500c3480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:55.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.917+0000 7f2d548ca700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d5014aa40 con 0x7f2d5006e040 2023-07-25T14:37:55.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.917+0000 7f2d548ca700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d5015de60 con 0x7f2d500c49d0 2023-07-25T14:37:55.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.917+0000 7f2d548ca700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d501ed9f0 con 0x7f2d500c5b90 2023-07-25T14:37:55.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.917+0000 7f2d4e59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2d5006e040 0x7f2d5015d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:55.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.917+0000 7f2d4e59c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2d5006e040 0x7f2d5015d920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:44014/0 (socket says 172.21.15.72:44014) 2023-07-25T14:37:55.933 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.917+0000 7f2d4e59c700 1 -- 172.21.15.72:0/752771135 learned_addr learned my addr 172.21.15.72:0/752771135 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:37:55.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.917+0000 7f2d4ed9d700 1 --2- 172.21.15.72:0/752771135 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2d500c5b90 0x7f2d500c3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:55.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.917+0000 7f2d4dd9b700 1 --2- 172.21.15.72:0/752771135 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2d500c49d0 0x7f2d501ed4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:55.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.918+0000 7f2d4e59c700 1 -- 172.21.15.72:0/752771135 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2d500c5b90 msgr2=0x7f2d500c3480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:55.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.918+0000 7f2d4e59c700 1 --2- 172.21.15.72:0/752771135 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2d500c5b90 0x7f2d500c3480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:55.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.918+0000 7f2d4e59c700 1 -- 172.21.15.72:0/752771135 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2d500c49d0 msgr2=0x7f2d501ed4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:55.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.918+0000 7f2d4e59c700 1 --2- 172.21.15.72:0/752771135 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2d500c49d0 0x7f2d501ed4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:55.934 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.918+0000 7f2d4e59c700 1 -- 172.21.15.72:0/752771135 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d440094a0 con 0x7f2d5006e040 2023-07-25T14:37:55.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.918+0000 7f2d4e59c700 1 --2- 172.21.15.72:0/752771135 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2d5006e040 0x7f2d5015d920 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f2d4400a010 tx=0x7f2d44004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:55.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.918+0000 7f2d3effd700 1 -- 172.21.15.72:0/752771135 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d44003ae0 con 0x7f2d5006e040 2023-07-25T14:37:55.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.918+0000 7f2d3effd700 1 -- 172.21.15.72:0/752771135 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d4401f070 con 0x7f2d5006e040 2023-07-25T14:37:55.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.918+0000 7f2d548ca700 1 -- 172.21.15.72:0/752771135 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d50149200 con 0x7f2d5006e040 2023-07-25T14:37:55.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.918+0000 7f2d3effd700 1 -- 172.21.15.72:0/752771135 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d44003ea0 con 0x7f2d5006e040 2023-07-25T14:37:55.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.918+0000 7f2d548ca700 1 -- 172.21.15.72:0/752771135 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d501eccb0 con 0x7f2d5006e040 2023-07-25T14:37:55.935 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.919+0000 7f2d548ca700 1 -- 172.21.15.72:0/752771135 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d500abe00 con 0x7f2d5006e040 2023-07-25T14:37:55.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.919+0000 7f2d3effd700 1 -- 172.21.15.72:0/752771135 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2d44021030 con 0x7f2d5006e040 2023-07-25T14:37:55.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.920+0000 7f2d3effd700 1 --2- 172.21.15.72:0/752771135 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f2d3006ace0 0x7f2d3006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:55.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.920+0000 7f2d3effd700 1 -- 172.21.15.72:0/752771135 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f2d4408a7a0 con 0x7f2d5006e040 2023-07-25T14:37:55.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.920+0000 7f2d4dd9b700 1 --2- 172.21.15.72:0/752771135 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f2d3006ace0 0x7f2d3006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:55.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.920+0000 7f2d4dd9b700 1 --2- 172.21.15.72:0/752771135 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f2d3006ace0 0x7f2d3006d1a0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f2d500c3ca0 tx=0x7f2d40009210 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:55.937 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:55.924+0000 7f2d3effd700 1 -- 172.21.15.72:0/752771135 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f2d440557a0 con 0x7f2d5006e040 2023-07-25T14:37:56.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:56.111+0000 7f2d548ca700 1 -- 172.21.15.72:0/752771135 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs2_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f2d50149720 con 0x7f2d5006e040 2023-07-25T14:37:56.241 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:56.231+0000 7f2d3effd700 1 -- 172.21.15.72:0/752771135 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs2_metadata", "pg_num_min": 64}]=0 pool 'cephfs2_metadata' created v58) v1 ==== 140+0+0 (secure 0 0 0) 0x7f2d44058dc0 con 0x7f2d5006e040 2023-07-25T14:37:56.244 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:56.234+0000 7f2d548ca700 1 -- 172.21.15.72:0/752771135 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f2d3006ace0 msgr2=0x7f2d3006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:56.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:56.234+0000 7f2d548ca700 1 --2- 172.21.15.72:0/752771135 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f2d3006ace0 0x7f2d3006d1a0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f2d500c3ca0 tx=0x7f2d40009210 comp rx=0 tx=0).stop 2023-07-25T14:37:56.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:56.234+0000 7f2d548ca700 1 -- 172.21.15.72:0/752771135 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2d5006e040 msgr2=0x7f2d5015d920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:56.245 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:56.234+0000 7f2d548ca700 1 --2- 172.21.15.72:0/752771135 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2d5006e040 0x7f2d5015d920 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f2d4400a010 tx=0x7f2d44004750 comp rx=0 tx=0).stop 2023-07-25T14:37:56.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:56.234+0000 7f2d548ca700 1 -- 172.21.15.72:0/752771135 shutdown_connections 2023-07-25T14:37:56.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:56.234+0000 7f2d548ca700 1 --2- 172.21.15.72:0/752771135 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f2d3006ace0 0x7f2d3006d1a0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:56.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:56.234+0000 7f2d548ca700 1 --2- 172.21.15.72:0/752771135 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f2d500c5b90 0x7f2d500c3480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:56.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:56.234+0000 7f2d548ca700 1 --2- 172.21.15.72:0/752771135 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2d5006e040 0x7f2d5015d920 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:56.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:56.234+0000 7f2d548ca700 1 --2- 172.21.15.72:0/752771135 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2d500c49d0 0x7f2d501ed4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:56.246 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:56.234+0000 7f2d548ca700 1 -- 172.21.15.72:0/752771135 >> 172.21.15.72:0/752771135 conn(0x7f2d5006bbc0 msgr2=0x7f2d50154a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:56.247 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:56.235+0000 7f2d548ca700 1 -- 172.21.15.72:0/752771135 shutdown_connections 2023-07-25T14:37:56.247 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:56.235+0000 7f2d548ca700 1 -- 172.21.15.72:0/752771135 wait complete. 2023-07-25T14:37:56.251 INFO:teuthology.orchestra.run.smithi072.stderr:pool 'cephfs2_metadata' created 2023-07-25T14:37:56.263 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs2_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-07-25T14:37:56.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:56.381+0000 7feb7acee700 1 Processor -- start 2023-07-25T14:37:56.392 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:56.381+0000 7feb7acee700 1 -- start start 2023-07-25T14:37:56.394 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:56.382+0000 7feb7acee700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7feb740a5d10 0x7feb74155c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:56.394 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:56.382+0000 7feb7acee700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7feb741561b0 0x7feb7415ca80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:56.394 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:56.382+0000 7feb7acee700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb740c74b0 con 0x7feb740a8910 2023-07-25T14:37:56.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:56.382+0000 7feb7acee700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb740c1c90 con 0x7feb741561b0 2023-07-25T14:37:56.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:56.382+0000 7feb7acee700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb741557e0 con 0x7feb740a5d10 2023-07-25T14:37:56.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:56.382+0000 7feb7928b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7feb741561b0 0x7feb7415ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:56.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:56.382+0000 7feb7928b700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7feb741561b0 0x7feb7415ca80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:44026/0 (socket says 172.21.15.72:44026) 2023-07-25T14:37:56.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:56.382+0000 7feb7928b700 1 -- 172.21.15.72:0/3621447322 learned_addr learned my addr 172.21.15.72:0/3621447322 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:37:56.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:56.382+0000 7feb73fff700 1 --2- 172.21.15.72:0/3621447322 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7feb740a5d10 0x7feb74155c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:56.395 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:56.382+0000 7feb7928b700 1 -- 172.21.15.72:0/3621447322 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7feb740a5d10 msgr2=0x7feb74155c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:56.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:56.382+0000 7feb7928b700 1 --2- 172.21.15.72:0/3621447322 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7feb740a5d10 0x7feb74155c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:56.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:56.382+0000 7feb7928b700 1 -- 172.21.15.72:0/3621447322 >> v1:172.21.15.92:6789/0 conn(0x7feb740a8910 legacy=0x7feb7414f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:56.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:56.382+0000 7feb7928b700 1 -- 172.21.15.72:0/3621447322 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb74156640 con 0x7feb741561b0 2023-07-25T14:37:56.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:56.382+0000 7feb7928b700 1 --2- 172.21.15.72:0/3621447322 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feb741561b0 0x7feb7415ca80 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7feb6c009e50 tx=0x7feb6c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=969b606d0b43caf server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:56.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:56.383+0000 7feb737fe700 1 -- 172.21.15.72:0/3621447322 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb6c00e070 con 0x7feb741561b0 2023-07-25T14:37:56.396 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:56.383+0000 7feb737fe700 1 -- 172.21.15.72:0/3621447322 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb6c00b910 con 0x7feb741561b0 2023-07-25T14:37:56.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:56.383+0000 7feb737fe700 1 -- 172.21.15.72:0/3621447322 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb6c00bcc0 con 0x7feb741561b0 2023-07-25T14:37:56.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:56.383+0000 7feb7acee700 1 -- 172.21.15.72:0/3621447322 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feb741561b0 msgr2=0x7feb7415ca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:56.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:56.383+0000 7feb7acee700 1 --2- 172.21.15.72:0/3621447322 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feb741561b0 0x7feb7415ca80 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7feb6c009e50 tx=0x7feb6c00b330 comp rx=0 tx=0).stop 2023-07-25T14:37:56.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:56.383+0000 7feb7acee700 1 -- 172.21.15.72:0/3621447322 shutdown_connections 2023-07-25T14:37:56.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:56.383+0000 7feb7acee700 1 --2- 172.21.15.72:0/3621447322 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feb741561b0 0x7feb7415ca80 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:56.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:56.383+0000 7feb7acee700 1 --2- 172.21.15.72:0/3621447322 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7feb740a5d10 0x7feb74155c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:56.397 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:56.383+0000 7feb7acee700 1 -- 172.21.15.72:0/3621447322 >> 172.21.15.72:0/3621447322 conn(0x7feb740714f0 msgr2=0x7feb74071900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:56.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:56.383+0000 7feb7acee700 1 -- 172.21.15.72:0/3621447322 shutdown_connections 2023-07-25T14:37:56.398 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:56.383+0000 7feb7acee700 1 -- 172.21.15.72:0/3621447322 wait complete. 2023-07-25T14:37:56.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:56.384+0000 7feb7acee700 1 Processor -- start 2023-07-25T14:37:56.400 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:56.384+0000 7feb7acee700 1 -- start start 2023-07-25T14:37:56.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:56.385+0000 7feb7acee700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feb740a5d10 0x7feb740a6cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:56.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:56.385+0000 7feb7acee700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7feb740a8910 0x7feb740c5a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:56.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:56.385+0000 7feb7acee700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feb741561b0 0x7feb740be7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:56.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:56.385+0000 7feb7acee700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb741ecb60 con 0x7feb740a5d10 2023-07-25T14:37:56.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:56.385+0000 7feb7acee700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb741ece00 con 0x7feb741561b0 2023-07-25T14:37:56.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:56.385+0000 7feb7acee700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb740bd9e0 con 0x7feb740a8910 2023-07-25T14:37:56.401 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:56.385+0000 7feb78a8a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feb740a5d10 0x7feb740a6cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:56.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:56.385+0000 7feb78a8a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feb740a5d10 0x7feb740a6cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:44028/0 (socket says 172.21.15.72:44028) 2023-07-25T14:37:56.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:56.385+0000 7feb78a8a700 1 -- 172.21.15.72:0/1089434917 learned_addr learned my addr 172.21.15.72:0/1089434917 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:37:56.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:56.385+0000 7feb73fff700 1 --2- 172.21.15.72:0/1089434917 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7feb740a8910 0x7feb740c5a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:56.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:56.385+0000 7feb7928b700 1 --2- 172.21.15.72:0/1089434917 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feb741561b0 0x7feb740be7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:56.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:56.385+0000 7feb78a8a700 1 -- 172.21.15.72:0/1089434917 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7feb740a8910 msgr2=0x7feb740c5a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:56.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:56.385+0000 7feb78a8a700 1 --2- 172.21.15.72:0/1089434917 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7feb740a8910 0x7feb740c5a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:56.402 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:56.385+0000 7feb78a8a700 1 -- 172.21.15.72:0/1089434917 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feb741561b0 msgr2=0x7feb740be7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:56.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:56.385+0000 7feb78a8a700 1 --2- 172.21.15.72:0/1089434917 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feb741561b0 0x7feb740be7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:56.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:56.385+0000 7feb78a8a700 1 -- 172.21.15.72:0/1089434917 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb6c009b30 con 0x7feb740a5d10 2023-07-25T14:37:56.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:56.385+0000 7feb7928b700 1 --2- 172.21.15.72:0/1089434917 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feb741561b0 0x7feb740be7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-25T14:37:56.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:56.386+0000 7feb78a8a700 1 --2- 172.21.15.72:0/1089434917 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feb740a5d10 0x7feb740a6cd0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7feb6800c4e0 tx=0x7feb6800c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:56.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:56.386+0000 7feb717fa700 1 -- 172.21.15.72:0/1089434917 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb680052d0 con 0x7feb740a5d10 2023-07-25T14:37:56.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:56.386+0000 7feb717fa700 1 -- 172.21.15.72:0/1089434917 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb68005430 con 0x7feb740a5d10 2023-07-25T14:37:56.403 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:56.386+0000 7feb717fa700 1 -- 172.21.15.72:0/1089434917 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb680038c0 con 0x7feb740a5d10 2023-07-25T14:37:56.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:56.386+0000 7feb7acee700 1 -- 172.21.15.72:0/1089434917 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb740bdcc0 con 0x7feb740a5d10 2023-07-25T14:37:56.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:56.386+0000 7feb7acee700 1 -- 172.21.15.72:0/1089434917 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb740be280 con 0x7feb740a5d10 2023-07-25T14:37:56.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:56.387+0000 7feb7acee700 1 -- 172.21.15.72:0/1089434917 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb7404e470 con 0x7feb740a5d10 2023-07-25T14:37:56.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:56.387+0000 7feb717fa700 1 -- 172.21.15.72:0/1089434917 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7feb68003a20 con 0x7feb740a5d10 2023-07-25T14:37:56.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:56.388+0000 7feb717fa700 1 --2- 172.21.15.72:0/1089434917 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7feb5806ace0 0x7feb5806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:56.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:56.388+0000 7feb717fa700 1 -- 172.21.15.72:0/1089434917 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6753+0+0 (secure 0 0 0) 0x7feb68088bf0 con 0x7feb740a5d10 2023-07-25T14:37:56.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:56.388+0000 7feb73fff700 1 --2- 172.21.15.72:0/1089434917 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7feb5806ace0 0x7feb5806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:56.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:56.388+0000 7feb73fff700 1 --2- 172.21.15.72:0/1089434917 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7feb5806ace0 0x7feb5806d1a0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7feb74154670 tx=0x7feb60009210 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:56.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:56.392+0000 7feb717fa700 1 -- 172.21.15.72:0/1089434917 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7feb680539d0 con 0x7feb740a5d10 2023-07-25T14:37:56.595 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:56.584+0000 7feb7acee700 1 -- 172.21.15.72:0/1089434917 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs2_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7feb740c76a0 con 0x7feb740a5d10 2023-07-25T14:37:57.249 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:57.239+0000 7feb717fa700 1 -- 172.21.15.72:0/1089434917 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs2_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs2_data' created v59) v1 ==== 172+0+0 (secure 0 0 0) 0x7feb68056ff0 con 0x7feb740a5d10 2023-07-25T14:37:57.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:57.243+0000 7feb7acee700 1 -- 172.21.15.72:0/1089434917 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7feb5806ace0 msgr2=0x7feb5806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:57.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:57.243+0000 7feb7acee700 1 --2- 172.21.15.72:0/1089434917 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7feb5806ace0 0x7feb5806d1a0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7feb74154670 tx=0x7feb60009210 comp rx=0 tx=0).stop 2023-07-25T14:37:57.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:57.243+0000 7feb7acee700 1 -- 172.21.15.72:0/1089434917 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feb740a5d10 msgr2=0x7feb740a6cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:57.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:57.243+0000 7feb7acee700 1 --2- 172.21.15.72:0/1089434917 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feb740a5d10 0x7feb740a6cd0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7feb6800c4e0 tx=0x7feb6800c7f0 comp rx=0 tx=0).stop 2023-07-25T14:37:57.254 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:57.243+0000 7feb7acee700 1 -- 172.21.15.72:0/1089434917 shutdown_connections 2023-07-25T14:37:57.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:57.243+0000 7feb7acee700 1 --2- 172.21.15.72:0/1089434917 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7feb5806ace0 0x7feb5806d1a0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:57.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:57.243+0000 7feb7acee700 1 --2- 172.21.15.72:0/1089434917 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feb741561b0 0x7feb740be7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:57.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:57.243+0000 7feb7acee700 1 --2- 172.21.15.72:0/1089434917 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feb740a5d10 0x7feb740a6cd0 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:57.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:57.243+0000 7feb7acee700 1 --2- 172.21.15.72:0/1089434917 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7feb740a8910 0x7feb740c5a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:57.255 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:57.244+0000 7feb7acee700 1 -- 172.21.15.72:0/1089434917 >> 172.21.15.72:0/1089434917 conn(0x7feb740714f0 msgr2=0x7feb74153e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:57.256 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:57.244+0000 7feb7acee700 1 -- 172.21.15.72:0/1089434917 shutdown_connections 2023-07-25T14:37:57.259 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:57.246+0000 7feb7acee700 1 -- 172.21.15.72:0/1089434917 wait complete. 2023-07-25T14:37:57.265 INFO:teuthology.orchestra.run.smithi072.stderr:pool 'cephfs2_data' created 2023-07-25T14:37:57.279 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs2 cephfs2_metadata cephfs2_data 2023-07-25T14:37:57.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:57.393+0000 7f4f7984b700 1 Processor -- start 2023-07-25T14:37:57.404 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:57.393+0000 7f4f7984b700 1 -- start start 2023-07-25T14:37:57.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:57.394+0000 7f4f7984b700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4f74151a90 0x7f4f74154d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:57.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:57.394+0000 7f4f7984b700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f4f740bead0 0x7f4f740c0350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:57.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:57.394+0000 7f4f7984b700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f740bfeb0 con 0x7f4f740c0890 2023-07-25T14:37:57.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:57.394+0000 7f4f7984b700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f740c10b0 con 0x7f4f740bead0 2023-07-25T14:37:57.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:57.394+0000 7f4f7984b700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f740c1940 con 0x7f4f74151a90 2023-07-25T14:37:57.405 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:57.394+0000 7f4f727fc700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f4f740bead0 0x7f4f740c0350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:57.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:57.394+0000 7f4f737fe700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f4f740c0890 0x7f4f740c44d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.72:58350/0 (socket says 172.21.15.72:58350) 2023-07-25T14:37:57.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:57.394+0000 7f4f72ffd700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4f74151a90 0x7f4f74154d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:57.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:57.394+0000 7f4f727fc700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f4f740bead0 0x7f4f740c0350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.72:39608/0 (socket says 172.21.15.72:39608) 2023-07-25T14:37:57.406 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:57.394+0000 7f4f737fe700 1 -- 172.21.15.72:0/1817585452 learned_addr learned my addr 172.21.15.72:0/1817585452 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:37:57.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:57.395+0000 7f4f72ffd700 1 -- 172.21.15.72:0/1817585452 >> v2:172.21.15.92:3300/0 conn(0x7f4f740bead0 msgr2=0x7f4f740c0350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:57.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:57.395+0000 7f4f72ffd700 1 --2- 172.21.15.72:0/1817585452 >> v2:172.21.15.92:3300/0 conn(0x7f4f740bead0 0x7f4f740c0350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:57.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:57.395+0000 7f4f72ffd700 1 -- 172.21.15.72:0/1817585452 >> v1:172.21.15.92:6789/0 conn(0x7f4f740c0890 legacy=0x7f4f740c44d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:57.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:57.395+0000 7f4f72ffd700 1 -- 172.21.15.72:0/1817585452 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f740bf2e0 con 0x7f4f74151a90 2023-07-25T14:37:57.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:57.395+0000 7f4f71ffb700 1 -- 172.21.15.72:0/1817585452 <== mon.1 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1013824579 0 0) 0x7f4f740bfeb0 con 0x7f4f740c0890 2023-07-25T14:37:57.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:57.395+0000 7f4f727fc700 1 --2- 172.21.15.72:0/1817585452 >> v2:172.21.15.92:3300/0 conn(0x7f4f740bead0 0x7f4f740c0350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-25T14:37:57.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:57.395+0000 7f4f72ffd700 1 --2- 172.21.15.72:0/1817585452 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4f74151a90 0x7f4f74154d10 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f4f68009840 tx=0x7f4f68009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=637b31ebcc299edc server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:57.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:57.395+0000 7f4f71ffb700 1 -- 172.21.15.72:0/1817585452 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f68011830 con 0x7f4f74151a90 2023-07-25T14:37:57.408 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:57.395+0000 7f4f71ffb700 1 -- 172.21.15.72:0/1817585452 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f68011990 con 0x7f4f74151a90 2023-07-25T14:37:57.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:57.395+0000 7f4f71ffb700 1 -- 172.21.15.72:0/1817585452 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f68011d20 con 0x7f4f74151a90 2023-07-25T14:37:57.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:57.396+0000 7f4f7984b700 1 -- 172.21.15.72:0/1817585452 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4f74151a90 msgr2=0x7f4f74154d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:57.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:57.396+0000 7f4f7984b700 1 --2- 172.21.15.72:0/1817585452 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4f74151a90 0x7f4f74154d10 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f4f68009840 tx=0x7f4f68009b50 comp rx=0 tx=0).stop 2023-07-25T14:37:57.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:57.396+0000 7f4f7984b700 1 -- 172.21.15.72:0/1817585452 shutdown_connections 2023-07-25T14:37:57.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:57.396+0000 7f4f7984b700 1 --2- 172.21.15.72:0/1817585452 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4f74151a90 0x7f4f74154d10 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:57.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:57.396+0000 7f4f7984b700 1 --2- 172.21.15.72:0/1817585452 >> v2:172.21.15.92:3300/0 conn(0x7f4f740bead0 0x7f4f740c0350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:57.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:57.396+0000 7f4f7984b700 1 -- 172.21.15.72:0/1817585452 >> 172.21.15.72:0/1817585452 conn(0x7f4f7406c3a0 msgr2=0x7f4f7406c780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:57.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:57.396+0000 7f4f7984b700 1 -- 172.21.15.72:0/1817585452 shutdown_connections 2023-07-25T14:37:57.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:57.396+0000 7f4f7984b700 1 -- 172.21.15.72:0/1817585452 wait complete. 2023-07-25T14:37:57.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:57.397+0000 7f4f7984b700 1 Processor -- start 2023-07-25T14:37:57.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:57.397+0000 7f4f7984b700 1 -- start start 2023-07-25T14:37:57.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:57.398+0000 7f4f7984b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4f740bead0 0x7f4f741e9ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:57.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:57.398+0000 7f4f7984b700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4f740c0890 0x7f4f74157d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:57.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:57.398+0000 7f4f7984b700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4f74151a90 0x7f4f74146f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:57.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:57.398+0000 7f4f7984b700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f741ea430 con 0x7f4f740bead0 2023-07-25T14:37:57.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:57.398+0000 7f4f7984b700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f74155a00 con 0x7f4f74151a90 2023-07-25T14:37:57.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:57.398+0000 7f4f7984b700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f741556b0 con 0x7f4f740c0890 2023-07-25T14:37:57.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:57.398+0000 7f4f72ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4f740bead0 0x7f4f741e9ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:57.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:57.398+0000 7f4f72ffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4f740bead0 0x7f4f741e9ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:44042/0 (socket says 172.21.15.72:44042) 2023-07-25T14:37:57.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:57.398+0000 7f4f72ffd700 1 -- 172.21.15.72:0/1211727230 learned_addr learned my addr 172.21.15.72:0/1211727230 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:37:57.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:57.398+0000 7f4f737fe700 1 --2- 172.21.15.72:0/1211727230 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4f74151a90 0x7f4f74146f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:57.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:57.398+0000 7f4f727fc700 1 --2- 172.21.15.72:0/1211727230 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4f740c0890 0x7f4f74157d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:57.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:57.398+0000 7f4f72ffd700 1 -- 172.21.15.72:0/1211727230 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4f740c0890 msgr2=0x7f4f74157d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:57.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:57.398+0000 7f4f72ffd700 1 --2- 172.21.15.72:0/1211727230 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4f740c0890 0x7f4f74157d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:57.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:57.398+0000 7f4f72ffd700 1 -- 172.21.15.72:0/1211727230 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4f74151a90 msgr2=0x7f4f74146f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:57.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:57.398+0000 7f4f72ffd700 1 --2- 172.21.15.72:0/1211727230 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4f74151a90 0x7f4f74146f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:57.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:57.398+0000 7f4f72ffd700 1 -- 172.21.15.72:0/1211727230 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f640094a0 con 0x7f4f740bead0 2023-07-25T14:37:57.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:57.398+0000 7f4f72ffd700 1 --2- 172.21.15.72:0/1211727230 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4f740bead0 0x7f4f741e9ef0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f4f68009fd0 tx=0x7f4f68004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:57.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:57.398+0000 7f4f5bfff700 1 -- 172.21.15.72:0/1211727230 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f68004570 con 0x7f4f740bead0 2023-07-25T14:37:57.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:57.398+0000 7f4f5bfff700 1 -- 172.21.15.72:0/1211727230 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f6801f070 con 0x7f4f740bead0 2023-07-25T14:37:57.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:57.398+0000 7f4f7984b700 1 -- 172.21.15.72:0/1211727230 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f680094a0 con 0x7f4f740bead0 2023-07-25T14:37:57.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:57.398+0000 7f4f5bfff700 1 -- 172.21.15.72:0/1211727230 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f680038e0 con 0x7f4f740bead0 2023-07-25T14:37:57.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:57.398+0000 7f4f7984b700 1 -- 172.21.15.72:0/1211727230 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f7414abd0 con 0x7f4f740bead0 2023-07-25T14:37:57.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:57.399+0000 7f4f7984b700 1 -- 172.21.15.72:0/1211727230 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f7404e470 con 0x7f4f740bead0 2023-07-25T14:37:57.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:57.400+0000 7f4f5bfff700 1 -- 172.21.15.72:0/1211727230 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4f68021030 con 0x7f4f740bead0 2023-07-25T14:37:57.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:57.400+0000 7f4f5bfff700 1 --2- 172.21.15.72:0/1211727230 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f4f6006ace0 0x7f4f6006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:57.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:57.400+0000 7f4f5bfff700 1 -- 172.21.15.72:0/1211727230 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 7136+0+0 (secure 0 0 0) 0x7f4f6808abc0 con 0x7f4f740bead0 2023-07-25T14:37:57.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:57.400+0000 7f4f727fc700 1 --2- 172.21.15.72:0/1211727230 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f4f6006ace0 0x7f4f6006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:57.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:57.401+0000 7f4f727fc700 1 --2- 172.21.15.72:0/1211727230 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f4f6006ace0 0x7f4f6006d1a0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f4f740cabe0 tx=0x7f4f64008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:57.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:57.405+0000 7f4f5bfff700 1 -- 172.21.15.72:0/1211727230 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f4f68055850 con 0x7f4f740bead0 2023-07-25T14:37:57.646 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:57.634+0000 7f4f7984b700 1 -- 172.21.15.72:0/1211727230 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs2", "metadata": "cephfs2_metadata", "data": "cephfs2_data"} v 0) v1 -- 0x7f4f740c6c20 con 0x7f4f740bead0 2023-07-25T14:37:58.260 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:58.249+0000 7f4f5bfff700 1 -- 172.21.15.72:0/1211727230 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs2", "metadata": "cephfs2_metadata", "data": "cephfs2_data"}]=0 new fs with metadata pool 12 and data pool 13 v34) v1 ==== 177+0+0 (secure 0 0 0) 0x7f4f68058e70 con 0x7f4f740bead0 2023-07-25T14:37:58.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:58.255+0000 7f4f7984b700 1 -- 172.21.15.72:0/1211727230 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f4f6006ace0 msgr2=0x7f4f6006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:58.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:58.255+0000 7f4f7984b700 1 --2- 172.21.15.72:0/1211727230 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f4f6006ace0 0x7f4f6006d1a0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f4f740cabe0 tx=0x7f4f64008040 comp rx=0 tx=0).stop 2023-07-25T14:37:58.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:58.255+0000 7f4f7984b700 1 -- 172.21.15.72:0/1211727230 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4f740bead0 msgr2=0x7f4f741e9ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:58.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:58.255+0000 7f4f7984b700 1 --2- 172.21.15.72:0/1211727230 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4f740bead0 0x7f4f741e9ef0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f4f68009fd0 tx=0x7f4f68004750 comp rx=0 tx=0).stop 2023-07-25T14:37:58.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:58.255+0000 7f4f7984b700 1 -- 172.21.15.72:0/1211727230 shutdown_connections 2023-07-25T14:37:58.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:58.255+0000 7f4f7984b700 1 --2- 172.21.15.72:0/1211727230 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f4f6006ace0 0x7f4f6006d1a0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:58.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:58.255+0000 7f4f7984b700 1 --2- 172.21.15.72:0/1211727230 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4f74151a90 0x7f4f74146f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:58.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:58.255+0000 7f4f7984b700 1 --2- 172.21.15.72:0/1211727230 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f4f740bead0 0x7f4f741e9ef0 secure :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f4f68009fd0 tx=0x7f4f68004750 comp rx=0 tx=0).stop 2023-07-25T14:37:58.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:58.255+0000 7f4f7984b700 1 --2- 172.21.15.72:0/1211727230 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f4f740c0890 0x7f4f74157d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:58.267 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:58.255+0000 7f4f7984b700 1 -- 172.21.15.72:0/1211727230 >> 172.21.15.72:0/1211727230 conn(0x7f4f7406c3a0 msgr2=0x7f4f74152130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:58.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:58.256+0000 7f4f7984b700 1 -- 172.21.15.72:0/1211727230 shutdown_connections 2023-07-25T14:37:58.268 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:58.256+0000 7f4f7984b700 1 -- 172.21.15.72:0/1211727230 wait complete. 2023-07-25T14:37:58.280 INFO:teuthology.orchestra.run.smithi072.stderr:new fs with metadata pool 12 and data pool 13 2023-07-25T14:37:58.296 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-25T14:37:58.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:58.407+0000 7f6ff41f9700 1 Processor -- start 2023-07-25T14:37:58.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:58.408+0000 7f6ff41f9700 1 -- start start 2023-07-25T14:37:58.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:58.408+0000 7f6ff41f9700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f6fec151950 0x7f6fec06a190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:58.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:58.408+0000 7f6ff41f9700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6fec06a6d0 0x7f6fec0c3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:58.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:58.408+0000 7f6ff41f9700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fec0c2fe0 con 0x7f6fec0724c0 2023-07-25T14:37:58.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:58.408+0000 7f6ff41f9700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fec071a60 con 0x7f6fec151950 2023-07-25T14:37:58.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:58.408+0000 7f6ff41f9700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fec0c2a70 con 0x7f6fec06a6d0 2023-07-25T14:37:58.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:58.409+0000 7f6ff1794700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f6fec0724c0 0x7f6fec0c34c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:34802/0 (socket says 172.21.15.72:34802) 2023-07-25T14:37:58.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:58.409+0000 7f6ff1794700 1 -- 172.21.15.72:0/1925211397 learned_addr learned my addr 172.21.15.72:0/1925211397 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:37:58.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:58.409+0000 7f6ff0f93700 1 -- 172.21.15.72:0/1925211397 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1032831802 0 0) 0x7f6fec0c2fe0 con 0x7f6fec0724c0 2023-07-25T14:37:58.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:58.409+0000 7f6ff0f93700 1 -- 172.21.15.72:0/1925211397 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6fd80035b0 con 0x7f6fec0724c0 2023-07-25T14:37:58.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:58.409+0000 7f6ff1f95700 1 --2- 172.21.15.72:0/1925211397 >> v2:172.21.15.92:3300/0 conn(0x7f6fec151950 0x7f6fec06a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:58.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:58.409+0000 7f6ff2796700 1 --2- 172.21.15.72:0/1925211397 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6fec06a6d0 0x7f6fec0c3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:58.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:58.409+0000 7f6ff0f93700 1 -- 172.21.15.72:0/1925211397 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 410832758 0 0) 0x7f6fd80035b0 con 0x7f6fec0724c0 2023-07-25T14:37:58.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:58.409+0000 7f6ff0f93700 1 -- 172.21.15.72:0/1925211397 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6fec06a6d0 msgr2=0x7f6fec0c3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:58.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:58.409+0000 7f6ff0f93700 1 --2- 172.21.15.72:0/1925211397 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6fec06a6d0 0x7f6fec0c3bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:58.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:58.409+0000 7f6ff0f93700 1 -- 172.21.15.72:0/1925211397 >> v2:172.21.15.92:3300/0 conn(0x7f6fec151950 msgr2=0x7f6fec06a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:58.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:58.409+0000 7f6ff0f93700 1 --2- 172.21.15.72:0/1925211397 >> v2:172.21.15.92:3300/0 conn(0x7f6fec151950 0x7f6fec06a190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:58.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:58.409+0000 7f6ff0f93700 1 -- 172.21.15.72:0/1925211397 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fec155070 con 0x7f6fec0724c0 2023-07-25T14:37:58.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:58.409+0000 7f6ff0f93700 1 -- 172.21.15.72:0/1925211397 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2559588315 0 0) 0x7f6fdc001670 con 0x7f6fec0724c0 2023-07-25T14:37:58.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:58.409+0000 7f6ff0f93700 1 -- 172.21.15.72:0/1925211397 >> v1:172.21.15.72:6789/0 conn(0x7f6fec0724c0 legacy=0x7f6fec0c34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:58.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:58.409+0000 7f6ff0f93700 1 --2- 172.21.15.72:0/1925211397 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6fd8003a00 0x7f6fd8003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:58.430 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:58.409+0000 7f6ff0f93700 1 --2- 172.21.15.72:0/1925211397 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6fd8004850 0x7f6fd8004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:58.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:58.409+0000 7f6ff0f93700 1 --2- 172.21.15.72:0/1925211397 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6fec06a6d0 0x7f6fd8005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:58.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:58.409+0000 7f6ff0f93700 1 -- 172.21.15.72:0/1925211397 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fec071a60 con 0x7f6fd8004850 2023-07-25T14:37:58.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:58.409+0000 7f6ff0f93700 1 -- 172.21.15.72:0/1925211397 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fd800ba40 con 0x7f6fd8003a00 2023-07-25T14:37:58.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:58.409+0000 7f6ff0f93700 1 -- 172.21.15.72:0/1925211397 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fd800bc00 con 0x7f6fec06a6d0 2023-07-25T14:37:58.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:58.409+0000 7f6ff1794700 1 --2- 172.21.15.72:0/1925211397 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6fd8004850 0x7f6fd8004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:58.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:58.409+0000 7f6ff1f95700 1 --2- 172.21.15.72:0/1925211397 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6fd8003a00 0x7f6fd8003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:58.431 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:58.409+0000 7f6ff2796700 1 --2- 172.21.15.72:0/1925211397 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6fec06a6d0 0x7f6fd8005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:58.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:58.410+0000 7f6ff1794700 1 -- 172.21.15.72:0/1925211397 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6fec06a6d0 msgr2=0x7f6fd8005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:58.432 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:58.410+0000 7f6ff1794700 1 --2- 172.21.15.72:0/1925211397 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6fec06a6d0 0x7f6fd8005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:58.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:58.410+0000 7f6ff1794700 1 -- 172.21.15.72:0/1925211397 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6fd8003a00 msgr2=0x7f6fd8003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:58.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:58.410+0000 7f6ff1794700 1 --2- 172.21.15.72:0/1925211397 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6fd8003a00 0x7f6fd8003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:58.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:58.410+0000 7f6ff1794700 1 -- 172.21.15.72:0/1925211397 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fd80035b0 con 0x7f6fd8004850 2023-07-25T14:37:58.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:58.410+0000 7f6ff1794700 1 --2- 172.21.15.72:0/1925211397 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6fd8004850 0x7f6fd8004cd0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f6fdc001050 tx=0x7f6fd8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d1b86301fa00b71 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:58.433 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:58.410+0000 7f6ff0f93700 1 -- 172.21.15.72:0/1925211397 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fdc007c60 con 0x7f6fd8004850 2023-07-25T14:37:58.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:58.410+0000 7f6ff0f93700 1 -- 172.21.15.72:0/1925211397 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fdc00cdc0 con 0x7f6fd8004850 2023-07-25T14:37:58.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:58.410+0000 7f6ff0f93700 1 -- 172.21.15.72:0/1925211397 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fdc005ba0 con 0x7f6fd8004850 2023-07-25T14:37:58.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:58.410+0000 7f6ff41f9700 1 -- 172.21.15.72:0/1925211397 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6fd8004850 msgr2=0x7f6fd8004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:58.434 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:58.410+0000 7f6ff41f9700 1 --2- 172.21.15.72:0/1925211397 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6fd8004850 0x7f6fd8004cd0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f6fdc001050 tx=0x7f6fd8005880 comp rx=0 tx=0).stop 2023-07-25T14:37:58.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:58.410+0000 7f6ff2796700 1 -- 172.21.15.72:0/1925211397 reap_dead start 2023-07-25T14:37:58.435 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:58.410+0000 7f6ff41f9700 1 -- 172.21.15.72:0/1925211397 shutdown_connections 2023-07-25T14:37:58.436 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:58.410+0000 7f6ff41f9700 1 -- 172.21.15.72:0/1925211397 >> 172.21.15.72:0/1925211397 conn(0x7f6fec0a87e0 msgr2=0x7f6fec0a8bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:58.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:58.411+0000 7f6ff41f9700 1 -- 172.21.15.72:0/1925211397 shutdown_connections 2023-07-25T14:37:58.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:58.411+0000 7f6ff41f9700 1 -- 172.21.15.72:0/1925211397 wait complete. 2023-07-25T14:37:58.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:58.412+0000 7f6ff41f9700 1 Processor -- start 2023-07-25T14:37:58.437 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:58.412+0000 7f6ff41f9700 1 -- start start 2023-07-25T14:37:58.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:58.412+0000 7f6ff41f9700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6fd8004850 0x7f6fec153510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:58.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:58.412+0000 7f6ff41f9700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6fec0ab3e0 0x7f6fec0a7130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:58.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:58.412+0000 7f6ff41f9700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6fec0a7670 0x7f6fec14a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:58.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:58.412+0000 7f6ff41f9700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fec151000 con 0x7f6fec0ab3e0 2023-07-25T14:37:58.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:58.412+0000 7f6ff41f9700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fec14af00 con 0x7f6fd8004850 2023-07-25T14:37:58.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:58.412+0000 7f6ff41f9700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fec0aaf50 con 0x7f6fec0a7670 2023-07-25T14:37:58.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:58.412+0000 7f6ff1794700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6fec0ab3e0 0x7f6fec0a7130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:58.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:58.412+0000 7f6ff1794700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6fec0ab3e0 0x7f6fec0a7130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:44078/0 (socket says 172.21.15.72:44078) 2023-07-25T14:37:58.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:58.412+0000 7f6ff1794700 1 -- 172.21.15.72:0/3461907898 learned_addr learned my addr 172.21.15.72:0/3461907898 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:37:58.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:58.413+0000 7f6ff1f95700 1 --2- 172.21.15.72:0/3461907898 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6fd8004850 0x7f6fec153510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:58.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:58.413+0000 7f6ff2796700 1 --2- 172.21.15.72:0/3461907898 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6fec0a7670 0x7f6fec14a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:58.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:58.413+0000 7f6ff1794700 1 -- 172.21.15.72:0/3461907898 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6fec0a7670 msgr2=0x7f6fec14a1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:58.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:58.413+0000 7f6ff1794700 1 --2- 172.21.15.72:0/3461907898 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6fec0a7670 0x7f6fec14a1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:58.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:58.413+0000 7f6ff1794700 1 -- 172.21.15.72:0/3461907898 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6fd8004850 msgr2=0x7f6fec153510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:58.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:58.413+0000 7f6ff1794700 1 --2- 172.21.15.72:0/3461907898 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6fd8004850 0x7f6fec153510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:58.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:58.413+0000 7f6ff1794700 1 -- 172.21.15.72:0/3461907898 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fec1e9d70 con 0x7f6fec0ab3e0 2023-07-25T14:37:58.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:58.413+0000 7f6ff1794700 1 --2- 172.21.15.72:0/3461907898 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6fec0ab3e0 0x7f6fec0a7130 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f6fdc00c930 tx=0x7f6fdc000fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:58.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:58.413+0000 7f6fe27fc700 1 -- 172.21.15.72:0/3461907898 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fdc0070d0 con 0x7f6fec0ab3e0 2023-07-25T14:37:58.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:58.413+0000 7f6fe27fc700 1 -- 172.21.15.72:0/3461907898 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fdc007250 con 0x7f6fec0ab3e0 2023-07-25T14:37:58.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:58.413+0000 7f6ff41f9700 1 -- 172.21.15.72:0/3461907898 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fec1ea050 con 0x7f6fec0ab3e0 2023-07-25T14:37:58.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:58.413+0000 7f6fe27fc700 1 -- 172.21.15.72:0/3461907898 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fdc007600 con 0x7f6fec0ab3e0 2023-07-25T14:37:58.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:58.413+0000 7f6ff41f9700 1 -- 172.21.15.72:0/3461907898 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fec14d470 con 0x7f6fec0ab3e0 2023-07-25T14:37:58.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:58.414+0000 7f6ff41f9700 1 -- 172.21.15.72:0/3461907898 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fec0ab0c0 con 0x7f6fec0ab3e0 2023-07-25T14:37:58.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:58.414+0000 7f6fe27fc700 1 -- 172.21.15.72:0/3461907898 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6fdc01e430 con 0x7f6fec0ab3e0 2023-07-25T14:37:58.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:58.415+0000 7f6fe27fc700 1 --2- 172.21.15.72:0/3461907898 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f6fd006ace0 0x7f6fd006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:58.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:58.415+0000 7f6fe27fc700 1 -- 172.21.15.72:0/3461907898 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 7238+0+0 (secure 0 0 0) 0x7f6fdc08adb0 con 0x7f6fec0ab3e0 2023-07-25T14:37:58.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:58.415+0000 7f6ff1f95700 1 --2- 172.21.15.72:0/3461907898 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f6fd006ace0 0x7f6fd006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:58.443 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:58.415+0000 7f6ff1f95700 1 --2- 172.21.15.72:0/3461907898 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f6fd006ace0 0x7f6fd006d1a0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f6fe8009c60 tx=0x7f6fe8009210 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:58.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:58.419+0000 7f6fe27fc700 1 -- 172.21.15.72:0/3461907898 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f6fdc055a50 con 0x7f6fec0ab3e0 2023-07-25T14:37:58.618 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:58.607+0000 7f6ff41f9700 1 -- 172.21.15.72:0/3461907898 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6fec04e470 con 0x7f6fec0ab3e0 2023-07-25T14:37:58.619 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:58.609+0000 7f6fe27fc700 1 -- 172.21.15.72:0/3461907898 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v60) v1 ==== 74+0+22168 (secure 0 0 0) 0x7f6fdc007dc0 con 0x7f6fec0ab3e0 2023-07-25T14:37:58.620 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-25T14:37:58.620 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":60,"fsid":"9170db48-9170-43e8-8ccb-9813e6240906","created":"2023-07-25T14:35:21.733262+0000","modified":"2023-07-25T14:37:57.636177+0000","last_up_change":"2023-07-25T14:35:31.355010+0000","last_in_change":"2023-07-25T14:35:24.195785+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-25T14:35:32.983457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-25T14:35:33.326342+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-07-25T14:37:42.689589+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-07-25T14:37:43.512214+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs2_metadata","create_time":"2023-07-25T14:37:56.130030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs2_data","create_time":"2023-07-25T14:37:56.603570+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d517fdad-0bfe-49f0-89f2-9421c3761839","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6801","nonce":2475407414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6803","nonce":2475407414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6807","nonce":2475407414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6805","nonce":2475407414}]},"public_addr":"172.21.15.72:6801/2475407414","cluster_addr":"172.21.15.72:6803/2475407414","heartbeat_back_addr":"172.21.15.72:6807/2475407414","heartbeat_front_addr":"172.21.15.72:6805/2475407414","state":["exists","up"]},{"osd":1,"uuid":"e1564be3-f209-47e5-a8d0-32fc618a474f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6822","nonce":870954016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6825","nonce":870954016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6831","nonce":870954016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6827","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6829","nonce":870954016}]},"public_addr":"172.21.15.72:6822/870954016","cluster_addr":"172.21.15.72:6825/870954016","heartbeat_back_addr":"172.21.15.72:6831/870954016","heartbeat_front_addr":"172.21.15.72:6829/870954016","state":["exists","up"]},{"osd":2,"uuid":"c4647d30-ffa6-417a-9026-ef530c75910e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6809","nonce":2143129442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6811","nonce":2143129442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6815","nonce":2143129442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6813","nonce":2143129442}]},"public_addr":"172.21.15.72:6809/2143129442","cluster_addr":"172.21.15.72:6811/2143129442","heartbeat_back_addr":"172.21.15.72:6815/2143129442","heartbeat_front_addr":"172.21.15.72:6813/2143129442","state":["exists","up"]},{"osd":3,"uuid":"76c9d9a7-c2e2-4612-a58b-d6882dd76b58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6817","nonce":3404066311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6819","nonce":3404066311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6828","nonce":3404066311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6821","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6823","nonce":3404066311}]},"public_addr":"172.21.15.72:6817/3404066311","cluster_addr":"172.21.15.72:6819/3404066311","heartbeat_back_addr":"172.21.15.72:6828/3404066311","heartbeat_front_addr":"172.21.15.72:6823/3404066311","state":["exists","up"]},{"osd":4,"uuid":"7f8920dc-0ad4-4a73-ab40-65408f83eadd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6817","nonce":2381008739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6819","nonce":2381008739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6825","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6827","nonce":2381008739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6822","nonce":2381008739}]},"public_addr":"172.21.15.92:6817/2381008739","cluster_addr":"172.21.15.92:6819/2381008739","heartbeat_back_addr":"172.21.15.92:6827/2381008739","heartbeat_front_addr":"172.21.15.92:6822/2381008739","state":["exists","up"]},{"osd":5,"uuid":"56257e7c-31eb-44c5-9ec7-1318a4e0bb35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6801","nonce":2161935604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6803","nonce":2161935604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6807","nonce":2161935604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6805","nonce":2161935604}]},"public_addr":"172.21.15.92:6801/2161935604","cluster_addr":"172.21.15.92:6803/2161935604","heartbeat_back_addr":"172.21.15.92:6807/2161935604","heartbeat_front_addr":"172.21.15.92:6805/2161935604","state":["exists","up"]},{"osd":6,"uuid":"a150d3d8-a0c9-4955-968a-8d98eff4ffb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6809","nonce":3770163493}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6811","nonce":3770163493}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6815","nonce":3770163493}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6813","nonce":3770163493}]},"public_addr":"172.21.15.92:6809/3770163493","cluster_addr":"172.21.15.92:6811/3770163493","heartbeat_back_addr":"172.21.15.92:6815/3770163493","heartbeat_front_addr":"172.21.15.92:6813/3770163493","state":["exists","up"]},{"osd":7,"uuid":"07799c27-54ee-4591-a42d-a978d6b32065","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6821","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6823","nonce":2135777609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6826","nonce":2135777609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6831","nonce":2135777609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6829","nonce":2135777609}]},"public_addr":"172.21.15.92:6823/2135777609","cluster_addr":"172.21.15.92:6826/2135777609","heartbeat_back_addr":"172.21.15.92:6831/2135777609","heartbeat_front_addr":"172.21.15.92:6829/2135777609","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.345365+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.378150+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.146566+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.372172+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:30.398421+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.385632+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.465611+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.443583+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-25T14:37:58.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:58.610+0000 7f6ff41f9700 1 -- 172.21.15.72:0/3461907898 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f6fd006ace0 msgr2=0x7f6fd006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:58.621 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:58.611+0000 7f6ff41f9700 1 --2- 172.21.15.72:0/3461907898 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f6fd006ace0 0x7f6fd006d1a0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f6fe8009c60 tx=0x7f6fe8009210 comp rx=0 tx=0).stop 2023-07-25T14:37:58.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:58.611+0000 7f6ff41f9700 1 -- 172.21.15.72:0/3461907898 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6fec0ab3e0 msgr2=0x7f6fec0a7130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:58.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:58.611+0000 7f6ff41f9700 1 --2- 172.21.15.72:0/3461907898 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6fec0ab3e0 0x7f6fec0a7130 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f6fdc00c930 tx=0x7f6fdc000fe0 comp rx=0 tx=0).stop 2023-07-25T14:37:58.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:58.611+0000 7f6ff41f9700 1 -- 172.21.15.72:0/3461907898 shutdown_connections 2023-07-25T14:37:58.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:58.611+0000 7f6ff41f9700 1 --2- 172.21.15.72:0/3461907898 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f6fd006ace0 0x7f6fd006d1a0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:58.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:58.611+0000 7f6ff41f9700 1 --2- 172.21.15.72:0/3461907898 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f6fec0a7670 0x7f6fec14a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:58.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:58.611+0000 7f6ff41f9700 1 --2- 172.21.15.72:0/3461907898 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6fd8004850 0x7f6fec153510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:58.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:58.611+0000 7f6ff41f9700 1 --2- 172.21.15.72:0/3461907898 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f6fec0ab3e0 0x7f6fec0a7130 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:58.622 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:58.611+0000 7f6ff41f9700 1 -- 172.21.15.72:0/3461907898 >> 172.21.15.72:0/3461907898 conn(0x7f6fec0a87e0 msgr2=0x7f6fec1542b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:58.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:58.611+0000 7f6ff41f9700 1 -- 172.21.15.72:0/3461907898 shutdown_connections 2023-07-25T14:37:58.623 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:58.611+0000 7f6ff41f9700 1 -- 172.21.15.72:0/3461907898 wait complete. 2023-07-25T14:37:58.634 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-25T14:37:58.753 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:58.743+0000 7fcfe5cd6700 1 Processor -- start 2023-07-25T14:37:58.754 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:58.743+0000 7fcfe5cd6700 1 -- start start 2023-07-25T14:37:58.756 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:58.743+0000 7fcfe5cd6700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fcfe014f900 0x7fcfe00ab5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:58.757 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:58.743+0000 7fcfe5cd6700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fcfe006b6d0 0x7fcfe0155750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:58.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:58.743+0000 7fcfe5cd6700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fcfe00abb10 0x7fcfe0155c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:58.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:58.743+0000 7fcfe5cd6700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfe006ed90 con 0x7fcfe014f900 2023-07-25T14:37:58.758 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:58.743+0000 7fcfe5cd6700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfe014fce0 con 0x7fcfe006b6d0 2023-07-25T14:37:58.759 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:58.743+0000 7fcfe5cd6700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfe0066060 con 0x7fcfe00abb10 2023-07-25T14:37:58.759 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:58.744+0000 7fcfdf7fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fcfe014f900 0x7fcfe00ab5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:58.759 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:58.744+0000 7fcfdf7fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fcfe014f900 0x7fcfe00ab5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:44084/0 (socket says 172.21.15.72:44084) 2023-07-25T14:37:58.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:58.744+0000 7fcfdf7fe700 1 -- 172.21.15.72:0/368270474 learned_addr learned my addr 172.21.15.72:0/368270474 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:37:58.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:58.744+0000 7fcfdf7fe700 1 -- 172.21.15.72:0/368270474 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fcfe00abb10 msgr2=0x7fcfe0155c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:58.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:58.744+0000 7fcfdffff700 1 --2- 172.21.15.72:0/368270474 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fcfe00abb10 0x7fcfe0155c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:58.760 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:58.744+0000 7fcfdeffd700 1 --2- 172.21.15.72:0/368270474 >> v2:172.21.15.92:3300/0 conn(0x7fcfe006b6d0 0x7fcfe0155750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:58.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:58.744+0000 7fcfdf7fe700 1 --2- 172.21.15.72:0/368270474 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fcfe00abb10 0x7fcfe0155c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:58.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:58.744+0000 7fcfdf7fe700 1 -- 172.21.15.72:0/368270474 >> v2:172.21.15.92:3300/0 conn(0x7fcfe006b6d0 msgr2=0x7fcfe0155750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:58.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:58.744+0000 7fcfdf7fe700 1 --2- 172.21.15.72:0/368270474 >> v2:172.21.15.92:3300/0 conn(0x7fcfe006b6d0 0x7fcfe0155750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:58.761 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:58.744+0000 7fcfdf7fe700 1 -- 172.21.15.72:0/368270474 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfe00664f0 con 0x7fcfe014f900 2023-07-25T14:37:58.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:58.744+0000 7fcfdf7fe700 1 --2- 172.21.15.72:0/368270474 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcfe014f900 0x7fcfe00ab5d0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7fcfe00a8980 tx=0x7fcfd0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c0994a401d64869 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:58.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:58.744+0000 7fcfde7fc700 1 -- 172.21.15.72:0/368270474 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfd000b870 con 0x7fcfe014f900 2023-07-25T14:37:58.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:58.744+0000 7fcfde7fc700 1 -- 172.21.15.72:0/368270474 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfd000b9d0 con 0x7fcfe014f900 2023-07-25T14:37:58.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:58.744+0000 7fcfde7fc700 1 -- 172.21.15.72:0/368270474 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfd000bd60 con 0x7fcfe014f900 2023-07-25T14:37:58.762 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:58.745+0000 7fcfe5cd6700 1 -- 172.21.15.72:0/368270474 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcfe014f900 msgr2=0x7fcfe00ab5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:58.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:58.745+0000 7fcfe5cd6700 1 --2- 172.21.15.72:0/368270474 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcfe014f900 0x7fcfe00ab5d0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7fcfe00a8980 tx=0x7fcfd0009bd0 comp rx=0 tx=0).stop 2023-07-25T14:37:58.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:58.745+0000 7fcfe5cd6700 1 -- 172.21.15.72:0/368270474 shutdown_connections 2023-07-25T14:37:58.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:58.745+0000 7fcfe5cd6700 1 --2- 172.21.15.72:0/368270474 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fcfe00abb10 0x7fcfe0155c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:58.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:58.745+0000 7fcfe5cd6700 1 --2- 172.21.15.72:0/368270474 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcfe014f900 0x7fcfe00ab5d0 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:58.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:58.745+0000 7fcfe5cd6700 1 --2- 172.21.15.72:0/368270474 >> v2:172.21.15.92:3300/0 conn(0x7fcfe006b6d0 0x7fcfe0155750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:58.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:58.745+0000 7fcfe5cd6700 1 -- 172.21.15.72:0/368270474 >> 172.21.15.72:0/368270474 conn(0x7fcfe006def0 msgr2=0x7fcfe006e300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:58.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:58.745+0000 7fcfe5cd6700 1 -- 172.21.15.72:0/368270474 shutdown_connections 2023-07-25T14:37:58.763 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:58.745+0000 7fcfe5cd6700 1 -- 172.21.15.72:0/368270474 wait complete. 2023-07-25T14:37:58.764 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:58.746+0000 7fcfe5cd6700 1 Processor -- start 2023-07-25T14:37:58.764 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:58.746+0000 7fcfe5cd6700 1 -- start start 2023-07-25T14:37:58.768 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:58.747+0000 7fcfe5cd6700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcfe006b6d0 0x7fcfe0156000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:58.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:58.747+0000 7fcfe5cd6700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcfe00abb10 0x7fcfe0146b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:58.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:58.747+0000 7fcfe5cd6700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fcfe014f900 0x7fcfe01eb010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:58.769 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:58.747+0000 7fcfe5cd6700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfe0153f30 con 0x7fcfe00abb10 2023-07-25T14:37:58.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:58.747+0000 7fcfe5cd6700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfe0151980 con 0x7fcfe006b6d0 2023-07-25T14:37:58.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:58.747+0000 7fcfe5cd6700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfe0150540 con 0x7fcfe014f900 2023-07-25T14:37:58.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:58.747+0000 7fcfdeffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcfe00abb10 0x7fcfe0146b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:58.770 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:58.747+0000 7fcfdeffd700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcfe00abb10 0x7fcfe0146b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:44090/0 (socket says 172.21.15.72:44090) 2023-07-25T14:37:58.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:58.747+0000 7fcfdeffd700 1 -- 172.21.15.72:0/3544372290 learned_addr learned my addr 172.21.15.72:0/3544372290 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:37:58.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:58.747+0000 7fcfdf7fe700 1 --2- 172.21.15.72:0/3544372290 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcfe006b6d0 0x7fcfe0156000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:58.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:58.747+0000 7fcfdffff700 1 --2- 172.21.15.72:0/3544372290 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fcfe014f900 0x7fcfe01eb010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:58.771 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:58.747+0000 7fcfdeffd700 1 -- 172.21.15.72:0/3544372290 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fcfe014f900 msgr2=0x7fcfe01eb010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:58.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:58.747+0000 7fcfdeffd700 1 --2- 172.21.15.72:0/3544372290 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fcfe014f900 0x7fcfe01eb010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:58.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:58.747+0000 7fcfdeffd700 1 -- 172.21.15.72:0/3544372290 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcfe006b6d0 msgr2=0x7fcfe0156000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:58.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:58.747+0000 7fcfdeffd700 1 --2- 172.21.15.72:0/3544372290 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcfe006b6d0 0x7fcfe0156000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:58.772 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:58.747+0000 7fcfdeffd700 1 -- 172.21.15.72:0/3544372290 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfd0009550 con 0x7fcfe00abb10 2023-07-25T14:37:58.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:58.747+0000 7fcfdeffd700 1 --2- 172.21.15.72:0/3544372290 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcfe00abb10 0x7fcfe0146b10 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7fcfd400c820 tx=0x7fcfd400cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:58.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:58.747+0000 7fcfc7fff700 1 -- 172.21.15.72:0/3544372290 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfd4011800 con 0x7fcfe00abb10 2023-07-25T14:37:58.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:58.747+0000 7fcfc7fff700 1 -- 172.21.15.72:0/3544372290 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfd4011960 con 0x7fcfe00abb10 2023-07-25T14:37:58.773 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:58.747+0000 7fcfe5cd6700 1 -- 172.21.15.72:0/3544372290 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfe01e8460 con 0x7fcfe00abb10 2023-07-25T14:37:58.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:58.747+0000 7fcfc7fff700 1 -- 172.21.15.72:0/3544372290 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfd4011cf0 con 0x7fcfe00abb10 2023-07-25T14:37:58.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:58.747+0000 7fcfe5cd6700 1 -- 172.21.15.72:0/3544372290 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfe0150a70 con 0x7fcfe00abb10 2023-07-25T14:37:58.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:58.748+0000 7fcfe5cd6700 1 -- 172.21.15.72:0/3544372290 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfe0061da0 con 0x7fcfe00abb10 2023-07-25T14:37:58.774 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:58.749+0000 7fcfc7fff700 1 -- 172.21.15.72:0/3544372290 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fcfd4018360 con 0x7fcfe00abb10 2023-07-25T14:37:58.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:58.749+0000 7fcfc7fff700 1 --2- 172.21.15.72:0/3544372290 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fcfcc06ace0 0x7fcfcc06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:58.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:58.749+0000 7fcfc7fff700 1 -- 172.21.15.72:0/3544372290 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 7238+0+0 (secure 0 0 0) 0x7fcfd4089820 con 0x7fcfe00abb10 2023-07-25T14:37:58.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:58.749+0000 7fcfdf7fe700 1 --2- 172.21.15.72:0/3544372290 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fcfcc06ace0 0x7fcfcc06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:58.775 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:58.750+0000 7fcfdf7fe700 1 --2- 172.21.15.72:0/3544372290 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fcfcc06ace0 0x7fcfcc06d1a0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fcfd0014040 tx=0x7fcfd0008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:58.776 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:58.753+0000 7fcfc7fff700 1 -- 172.21.15.72:0/3544372290 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fcfd4057f50 con 0x7fcfe00abb10 2023-07-25T14:37:58.949 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:58.939+0000 7fcfe5cd6700 1 -- 172.21.15.72:0/3544372290 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcfe004e470 con 0x7fcfe00abb10 2023-07-25T14:37:58.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:58.940+0000 7fcfc7fff700 1 -- 172.21.15.72:0/3544372290 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v60) v1 ==== 74+0+22168 (secure 0 0 0) 0x7fcfd4057ae0 con 0x7fcfe00abb10 2023-07-25T14:37:58.951 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-25T14:37:58.951 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":60,"fsid":"9170db48-9170-43e8-8ccb-9813e6240906","created":"2023-07-25T14:35:21.733262+0000","modified":"2023-07-25T14:37:57.636177+0000","last_up_change":"2023-07-25T14:35:31.355010+0000","last_in_change":"2023-07-25T14:35:24.195785+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-25T14:35:32.983457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-25T14:35:33.326342+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-07-25T14:37:42.689589+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-07-25T14:37:43.512214+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs2_metadata","create_time":"2023-07-25T14:37:56.130030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs2_data","create_time":"2023-07-25T14:37:56.603570+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d517fdad-0bfe-49f0-89f2-9421c3761839","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6801","nonce":2475407414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6803","nonce":2475407414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6807","nonce":2475407414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6805","nonce":2475407414}]},"public_addr":"172.21.15.72:6801/2475407414","cluster_addr":"172.21.15.72:6803/2475407414","heartbeat_back_addr":"172.21.15.72:6807/2475407414","heartbeat_front_addr":"172.21.15.72:6805/2475407414","state":["exists","up"]},{"osd":1,"uuid":"e1564be3-f209-47e5-a8d0-32fc618a474f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6822","nonce":870954016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6825","nonce":870954016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6831","nonce":870954016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6827","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6829","nonce":870954016}]},"public_addr":"172.21.15.72:6822/870954016","cluster_addr":"172.21.15.72:6825/870954016","heartbeat_back_addr":"172.21.15.72:6831/870954016","heartbeat_front_addr":"172.21.15.72:6829/870954016","state":["exists","up"]},{"osd":2,"uuid":"c4647d30-ffa6-417a-9026-ef530c75910e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6809","nonce":2143129442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6811","nonce":2143129442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6815","nonce":2143129442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6813","nonce":2143129442}]},"public_addr":"172.21.15.72:6809/2143129442","cluster_addr":"172.21.15.72:6811/2143129442","heartbeat_back_addr":"172.21.15.72:6815/2143129442","heartbeat_front_addr":"172.21.15.72:6813/2143129442","state":["exists","up"]},{"osd":3,"uuid":"76c9d9a7-c2e2-4612-a58b-d6882dd76b58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6817","nonce":3404066311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6819","nonce":3404066311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6828","nonce":3404066311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6821","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6823","nonce":3404066311}]},"public_addr":"172.21.15.72:6817/3404066311","cluster_addr":"172.21.15.72:6819/3404066311","heartbeat_back_addr":"172.21.15.72:6828/3404066311","heartbeat_front_addr":"172.21.15.72:6823/3404066311","state":["exists","up"]},{"osd":4,"uuid":"7f8920dc-0ad4-4a73-ab40-65408f83eadd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6817","nonce":2381008739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6819","nonce":2381008739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6825","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6827","nonce":2381008739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6822","nonce":2381008739}]},"public_addr":"172.21.15.92:6817/2381008739","cluster_addr":"172.21.15.92:6819/2381008739","heartbeat_back_addr":"172.21.15.92:6827/2381008739","heartbeat_front_addr":"172.21.15.92:6822/2381008739","state":["exists","up"]},{"osd":5,"uuid":"56257e7c-31eb-44c5-9ec7-1318a4e0bb35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6801","nonce":2161935604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6803","nonce":2161935604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6807","nonce":2161935604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6805","nonce":2161935604}]},"public_addr":"172.21.15.92:6801/2161935604","cluster_addr":"172.21.15.92:6803/2161935604","heartbeat_back_addr":"172.21.15.92:6807/2161935604","heartbeat_front_addr":"172.21.15.92:6805/2161935604","state":["exists","up"]},{"osd":6,"uuid":"a150d3d8-a0c9-4955-968a-8d98eff4ffb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6809","nonce":3770163493}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6811","nonce":3770163493}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6815","nonce":3770163493}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6813","nonce":3770163493}]},"public_addr":"172.21.15.92:6809/3770163493","cluster_addr":"172.21.15.92:6811/3770163493","heartbeat_back_addr":"172.21.15.92:6815/3770163493","heartbeat_front_addr":"172.21.15.92:6813/3770163493","state":["exists","up"]},{"osd":7,"uuid":"07799c27-54ee-4591-a42d-a978d6b32065","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6821","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6823","nonce":2135777609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6826","nonce":2135777609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6831","nonce":2135777609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6829","nonce":2135777609}]},"public_addr":"172.21.15.92:6823/2135777609","cluster_addr":"172.21.15.92:6826/2135777609","heartbeat_back_addr":"172.21.15.92:6831/2135777609","heartbeat_front_addr":"172.21.15.92:6829/2135777609","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.345365+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.378150+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.146566+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.372172+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:30.398421+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.385632+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.465611+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.443583+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-25T14:37:58.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:58.942+0000 7fcfe5cd6700 1 -- 172.21.15.72:0/3544372290 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fcfcc06ace0 msgr2=0x7fcfcc06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:58.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:58.942+0000 7fcfe5cd6700 1 --2- 172.21.15.72:0/3544372290 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fcfcc06ace0 0x7fcfcc06d1a0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fcfd0014040 tx=0x7fcfd0008030 comp rx=0 tx=0).stop 2023-07-25T14:37:58.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:58.942+0000 7fcfe5cd6700 1 -- 172.21.15.72:0/3544372290 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcfe00abb10 msgr2=0x7fcfe0146b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:58.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:58.942+0000 7fcfe5cd6700 1 --2- 172.21.15.72:0/3544372290 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcfe00abb10 0x7fcfe0146b10 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7fcfd400c820 tx=0x7fcfd400cbe0 comp rx=0 tx=0).stop 2023-07-25T14:37:58.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:58.942+0000 7fcfe5cd6700 1 -- 172.21.15.72:0/3544372290 shutdown_connections 2023-07-25T14:37:58.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:58.942+0000 7fcfe5cd6700 1 --2- 172.21.15.72:0/3544372290 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fcfcc06ace0 0x7fcfcc06d1a0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:58.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:58.942+0000 7fcfe5cd6700 1 --2- 172.21.15.72:0/3544372290 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fcfe014f900 0x7fcfe01eb010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:58.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:58.942+0000 7fcfe5cd6700 1 --2- 172.21.15.72:0/3544372290 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fcfe006b6d0 0x7fcfe0156000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:58.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:58.942+0000 7fcfe5cd6700 1 --2- 172.21.15.72:0/3544372290 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fcfe00abb10 0x7fcfe0146b10 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:58.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:58.943+0000 7fcfe5cd6700 1 -- 172.21.15.72:0/3544372290 >> 172.21.15.72:0/3544372290 conn(0x7fcfe006def0 msgr2=0x7fcfe00c1260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:58.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:58.943+0000 7fcfe5cd6700 1 -- 172.21.15.72:0/3544372290 shutdown_connections 2023-07-25T14:37:58.955 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:58.943+0000 7fcfe5cd6700 1 -- 172.21.15.72:0/3544372290 wait complete. 2023-07-25T14:37:58.966 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs2 standby_count_wanted 0 2023-07-25T14:37:59.088 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:59.078+0000 7f9956748700 1 Processor -- start 2023-07-25T14:37:59.089 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:59.078+0000 7f9956748700 1 -- start start 2023-07-25T14:37:59.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:59.078+0000 7f9956748700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f9950151950 0x7f995006a190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:59.091 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:59.079+0000 7f9956748700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f99500724c0 0x7f99500c34c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:59.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:59.079+0000 7f9956748700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99500c2fe0 con 0x7f995006a6d0 2023-07-25T14:37:59.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:59.079+0000 7f9956748700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9950071a60 con 0x7f9950151950 2023-07-25T14:37:59.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:59.079+0000 7f9956748700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99500c2a70 con 0x7f99500724c0 2023-07-25T14:37:59.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:59.079+0000 7f9954ce5700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f995006a6d0 0x7f99500c3a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:34836/0 (socket says 172.21.15.72:34836) 2023-07-25T14:37:59.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:59.079+0000 7f9954ce5700 1 -- 172.21.15.72:0/3744102538 learned_addr learned my addr 172.21.15.72:0/3744102538 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:37:59.092 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:59.079+0000 7f994f7fe700 1 --2- 172.21.15.72:0/3744102538 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f99500724c0 0x7f99500c34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:59.093 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:59.079+0000 7f994ffff700 1 --2- 172.21.15.72:0/3744102538 >> v2:172.21.15.92:3300/0 conn(0x7f9950151950 0x7f995006a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:59.093 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:59.079+0000 7f994effd700 1 -- 172.21.15.72:0/3744102538 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 945730265 0 0) 0x7f99500c2fe0 con 0x7f995006a6d0 2023-07-25T14:37:59.093 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:59.079+0000 7f994effd700 1 -- 172.21.15.72:0/3744102538 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f99380035b0 con 0x7f995006a6d0 2023-07-25T14:37:59.093 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:59.079+0000 7f994effd700 1 -- 172.21.15.72:0/3744102538 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2762124277 0 0) 0x7f99380035b0 con 0x7f995006a6d0 2023-07-25T14:37:59.093 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:59.079+0000 7f994effd700 1 -- 172.21.15.72:0/3744102538 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f99500724c0 msgr2=0x7f99500c34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:59.093 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:59.079+0000 7f994effd700 1 --2- 172.21.15.72:0/3744102538 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f99500724c0 0x7f99500c34c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:59.093 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:59.079+0000 7f994effd700 1 -- 172.21.15.72:0/3744102538 >> v2:172.21.15.92:3300/0 conn(0x7f9950151950 msgr2=0x7f995006a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:59.093 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:59.079+0000 7f994effd700 1 --2- 172.21.15.72:0/3744102538 >> v2:172.21.15.92:3300/0 conn(0x7f9950151950 0x7f995006a190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:59.094 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:59.079+0000 7f994effd700 1 -- 172.21.15.72:0/3744102538 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9950155070 con 0x7f995006a6d0 2023-07-25T14:37:59.094 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:59.079+0000 7f994effd700 1 -- 172.21.15.72:0/3744102538 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2559588315 0 0) 0x7f99480019f0 con 0x7f995006a6d0 2023-07-25T14:37:59.094 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:59.079+0000 7f994effd700 1 -- 172.21.15.72:0/3744102538 >> v1:172.21.15.72:6789/0 conn(0x7f995006a6d0 legacy=0x7f99500c3a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:59.094 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:59.079+0000 7f994effd700 1 --2- 172.21.15.72:0/3744102538 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f99500724c0 0x7f9938003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:59.094 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:59.079+0000 7f994effd700 1 --2- 172.21.15.72:0/3744102538 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9938003f80 0x7f9938004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:59.094 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:59.079+0000 7f994effd700 1 --2- 172.21.15.72:0/3744102538 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9938004d90 0x7f9938005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:59.094 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:59.079+0000 7f994effd700 1 -- 172.21.15.72:0/3744102538 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9950071a60 con 0x7f9938004d90 2023-07-25T14:37:59.095 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:59.079+0000 7f994effd700 1 -- 172.21.15.72:0/3744102538 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f993800ba10 con 0x7f9938003f80 2023-07-25T14:37:59.095 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:59.079+0000 7f994effd700 1 -- 172.21.15.72:0/3744102538 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f993800bba0 con 0x7f99500724c0 2023-07-25T14:37:59.095 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:59.079+0000 7f9954ce5700 1 --2- 172.21.15.72:0/3744102538 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9938004d90 0x7f9938005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:59.095 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:59.080+0000 7f994ffff700 1 --2- 172.21.15.72:0/3744102538 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f99500724c0 0x7f9938003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:59.095 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:59.080+0000 7f994f7fe700 1 --2- 172.21.15.72:0/3744102538 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9938003f80 0x7f9938004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:59.095 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:59.080+0000 7f9954ce5700 1 -- 172.21.15.72:0/3744102538 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f99500724c0 msgr2=0x7f9938003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:59.095 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:59.080+0000 7f9954ce5700 1 --2- 172.21.15.72:0/3744102538 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f99500724c0 0x7f9938003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:59.095 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:59.080+0000 7f9954ce5700 1 -- 172.21.15.72:0/3744102538 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9938003f80 msgr2=0x7f9938004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:37:59.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:59.080+0000 7f9954ce5700 1 --2- 172.21.15.72:0/3744102538 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9938003f80 0x7f9938004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:59.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:59.080+0000 7f9954ce5700 1 -- 172.21.15.72:0/3744102538 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99380035b0 con 0x7f9938004d90 2023-07-25T14:37:59.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:59.080+0000 7f9954ce5700 1 --2- 172.21.15.72:0/3744102538 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9938004d90 0x7f9938005210 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f994800a900 tx=0x7f9938005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be3bb1ba8936e161 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:59.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:59.080+0000 7f994effd700 1 -- 172.21.15.72:0/3744102538 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f994800a340 con 0x7f9938004d90 2023-07-25T14:37:59.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:59.080+0000 7f994effd700 1 -- 172.21.15.72:0/3744102538 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9948012620 con 0x7f9938004d90 2023-07-25T14:37:59.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:59.080+0000 7f994effd700 1 -- 172.21.15.72:0/3744102538 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99480129d0 con 0x7f9938004d90 2023-07-25T14:37:59.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:59.080+0000 7f9956748700 1 -- 172.21.15.72:0/3744102538 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9938004d90 msgr2=0x7f9938005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:59.096 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:59.080+0000 7f9956748700 1 --2- 172.21.15.72:0/3744102538 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f9938004d90 0x7f9938005210 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f994800a900 tx=0x7f9938005880 comp rx=0 tx=0).stop 2023-07-25T14:37:59.097 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:59.081+0000 7f9954ce5700 1 -- 172.21.15.72:0/3744102538 reap_dead start 2023-07-25T14:37:59.097 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:59.081+0000 7f9956748700 1 -- 172.21.15.72:0/3744102538 shutdown_connections 2023-07-25T14:37:59.097 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:59.081+0000 7f9956748700 1 -- 172.21.15.72:0/3744102538 >> 172.21.15.72:0/3744102538 conn(0x7f99500a87e0 msgr2=0x7f99500a8bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:37:59.097 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:59.081+0000 7f9956748700 1 -- 172.21.15.72:0/3744102538 shutdown_connections 2023-07-25T14:37:59.097 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:59.081+0000 7f9956748700 1 -- 172.21.15.72:0/3744102538 wait complete. 2023-07-25T14:37:59.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:59.082+0000 7f9956748700 1 Processor -- start 2023-07-25T14:37:59.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:59.082+0000 7f9956748700 1 -- start start 2023-07-25T14:37:59.099 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:59.083+0000 7f9956748700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f99500a79e0 0x7f99501ea350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:59.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:59.083+0000 7f9956748700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f99500ac4d0 0x7f99501ecdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:59.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:59.083+0000 7f9956748700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f99500abd90 0x7f99501e6b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:59.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:59.083+0000 7f9956748700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99500a96f0 con 0x7f99500ac4d0 2023-07-25T14:37:59.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:59.083+0000 7f9956748700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99500a9940 con 0x7f99500abd90 2023-07-25T14:37:59.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:59.083+0000 7f9956748700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99500a9c20 con 0x7f99500a79e0 2023-07-25T14:37:59.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:59.083+0000 7f994f7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f99500ac4d0 0x7f99501ecdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:59.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:59.083+0000 7f994f7fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f99500ac4d0 0x7f99501ecdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:44110/0 (socket says 172.21.15.72:44110) 2023-07-25T14:37:59.100 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:59.083+0000 7f994f7fe700 1 -- 172.21.15.72:0/478141115 learned_addr learned my addr 172.21.15.72:0/478141115 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:37:59.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:59.083+0000 7f9954ce5700 1 --2- 172.21.15.72:0/478141115 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f99500abd90 0x7f99501e6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:59.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:59.083+0000 7f994ffff700 1 --2- 172.21.15.72:0/478141115 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f99500a79e0 0x7f99501ea350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:59.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:59.083+0000 7f994f7fe700 1 -- 172.21.15.72:0/478141115 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f99500a79e0 msgr2=0x7f99501ea350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:59.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:59.083+0000 7f994f7fe700 1 --2- 172.21.15.72:0/478141115 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f99500a79e0 0x7f99501ea350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:59.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:59.083+0000 7f994f7fe700 1 -- 172.21.15.72:0/478141115 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f99500abd90 msgr2=0x7f99501e6b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:37:59.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:59.083+0000 7f994f7fe700 1 --2- 172.21.15.72:0/478141115 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f99500abd90 0x7f99501e6b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:37:59.101 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:59.083+0000 7f994f7fe700 1 -- 172.21.15.72:0/478141115 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99501e9b50 con 0x7f99500ac4d0 2023-07-25T14:37:59.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:59.083+0000 7f994ffff700 1 --2- 172.21.15.72:0/478141115 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f99500a79e0 0x7f99501ea350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-25T14:37:59.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:59.083+0000 7f994f7fe700 1 --2- 172.21.15.72:0/478141115 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f99500ac4d0 0x7f99501ecdb0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f9940011940 tx=0x7f9940011c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:59.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:59.083+0000 7f994cff9700 1 -- 172.21.15.72:0/478141115 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9940011e90 con 0x7f99500ac4d0 2023-07-25T14:37:59.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:59.083+0000 7f994cff9700 1 -- 172.21.15.72:0/478141115 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9940004240 con 0x7f99500ac4d0 2023-07-25T14:37:59.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:59.083+0000 7f994cff9700 1 -- 172.21.15.72:0/478141115 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f994000f730 con 0x7f99500ac4d0 2023-07-25T14:37:59.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:59.083+0000 7f9956748700 1 -- 172.21.15.72:0/478141115 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99501e9e30 con 0x7f99500ac4d0 2023-07-25T14:37:59.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:59.083+0000 7f9956748700 1 -- 172.21.15.72:0/478141115 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99501e9800 con 0x7f99500ac4d0 2023-07-25T14:37:59.102 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:59.084+0000 7f9956748700 1 -- 172.21.15.72:0/478141115 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99501ea1a0 con 0x7f99500ac4d0 2023-07-25T14:37:59.103 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:59.085+0000 7f994cff9700 1 -- 172.21.15.72:0/478141115 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f994000f890 con 0x7f99500ac4d0 2023-07-25T14:37:59.103 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:59.085+0000 7f994cff9700 1 --2- 172.21.15.72:0/478141115 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f993c06ace0 0x7f993c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:37:59.103 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:59.085+0000 7f994ffff700 1 --2- 172.21.15.72:0/478141115 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f993c06ace0 0x7f993c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:37:59.103 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:59.085+0000 7f994cff9700 1 -- 172.21.15.72:0/478141115 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 7238+0+0 (secure 0 0 0) 0x7f994008a0c0 con 0x7f99500ac4d0 2023-07-25T14:37:59.103 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:59.086+0000 7f994ffff700 1 --2- 172.21.15.72:0/478141115 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f993c06ace0 0x7f993c06d1a0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f9944009ce0 tx=0x7f9944008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:37:59.103 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:59.090+0000 7f994cff9700 1 -- 172.21.15.72:0/478141115 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f9940054d60 con 0x7f99500ac4d0 2023-07-25T14:37:59.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:37:59.324+0000 7f9956748700 1 -- 172.21.15.72:0/478141115 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs2", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f9950150ae0 con 0x7f99500ac4d0 2023-07-25T14:38:00.266 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:00.256+0000 7f994cff9700 1 -- 172.21.15.72:0/478141115 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs2", "var": "standby_count_wanted", "val": "0"}]=0 v37) v1 ==== 119+0+0 (secure 0 0 0) 0x7f9940058380 con 0x7f99500ac4d0 2023-07-25T14:38:00.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:00.258+0000 7f9956748700 1 -- 172.21.15.72:0/478141115 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f993c06ace0 msgr2=0x7f993c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:38:00.269 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:00.258+0000 7f9956748700 1 --2- 172.21.15.72:0/478141115 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f993c06ace0 0x7f993c06d1a0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f9944009ce0 tx=0x7f9944008040 comp rx=0 tx=0).stop 2023-07-25T14:38:00.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:00.258+0000 7f9956748700 1 -- 172.21.15.72:0/478141115 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f99500ac4d0 msgr2=0x7f99501ecdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:38:00.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:00.258+0000 7f9956748700 1 --2- 172.21.15.72:0/478141115 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f99500ac4d0 0x7f99501ecdb0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f9940011940 tx=0x7f9940011c50 comp rx=0 tx=0).stop 2023-07-25T14:38:00.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:00.259+0000 7f9956748700 1 -- 172.21.15.72:0/478141115 shutdown_connections 2023-07-25T14:38:00.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:00.259+0000 7f9956748700 1 --2- 172.21.15.72:0/478141115 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f993c06ace0 0x7f993c06d1a0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:38:00.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:00.259+0000 7f9956748700 1 --2- 172.21.15.72:0/478141115 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f99500a79e0 0x7f99501ea350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:38:00.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:00.259+0000 7f9956748700 1 --2- 172.21.15.72:0/478141115 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f99500abd90 0x7f99501e6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:38:00.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:00.259+0000 7f9956748700 1 --2- 172.21.15.72:0/478141115 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f99500ac4d0 0x7f99501ecdb0 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:38:00.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:00.259+0000 7f9956748700 1 -- 172.21.15.72:0/478141115 >> 172.21.15.72:0/478141115 conn(0x7f99500a87e0 msgr2=0x7f995006e160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:38:00.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:00.259+0000 7f9956748700 1 -- 172.21.15.72:0/478141115 shutdown_connections 2023-07-25T14:38:00.271 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:00.259+0000 7f9956748700 1 -- 172.21.15.72:0/478141115 wait complete. 2023-07-25T14:38:00.284 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-07-25T14:38:00.285 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs2 allow_standby_replay false 2023-07-25T14:38:00.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:00.403+0000 7f534efd4700 1 Processor -- start 2023-07-25T14:38:00.414 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:00.403+0000 7f534efd4700 1 -- start start 2023-07-25T14:38:00.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:00.404+0000 7f534efd4700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f53480724c0 0x7f53480c34c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:38:00.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:00.404+0000 7f534efd4700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53480c2fe0 con 0x7f5348151950 2023-07-25T14:38:00.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:00.404+0000 7f534efd4700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5348155070 con 0x7f53480c4930 2023-07-25T14:38:00.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:00.404+0000 7f534efd4700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5348071a60 con 0x7f53480724c0 2023-07-25T14:38:00.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:00.404+0000 7f534cd70700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f5348151950 0x7f534806a190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:34852/0 (socket says 172.21.15.72:34852) 2023-07-25T14:38:00.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:00.404+0000 7f534cd70700 1 -- 172.21.15.72:0/1355094958 learned_addr learned my addr 172.21.15.72:0/1355094958 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:38:00.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:00.404+0000 7f5347fff700 1 --2- 172.21.15.72:0/1355094958 >> v2:172.21.15.92:3300/0 conn(0x7f53480724c0 0x7f53480c34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:38:00.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:00.404+0000 7f53477fe700 1 -- 172.21.15.72:0/1355094958 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2577458123 0 0) 0x7f53480c2fe0 con 0x7f5348151950 2023-07-25T14:38:00.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:00.404+0000 7f53477fe700 1 -- 172.21.15.72:0/1355094958 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f53380035b0 con 0x7f5348151950 2023-07-25T14:38:00.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:00.405+0000 7f53477fe700 1 -- 172.21.15.72:0/1355094958 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3157218201 0 0) 0x7f53380035b0 con 0x7f5348151950 2023-07-25T14:38:00.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:00.405+0000 7f53477fe700 1 -- 172.21.15.72:0/1355094958 >> v2:172.21.15.92:3300/0 conn(0x7f53480724c0 msgr2=0x7f53480c34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:38:00.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:00.405+0000 7f53477fe700 1 --2- 172.21.15.72:0/1355094958 >> v2:172.21.15.92:3300/0 conn(0x7f53480724c0 0x7f53480c34c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:38:00.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:00.405+0000 7f53477fe700 1 -- 172.21.15.72:0/1355094958 >> v1:172.21.15.92:6789/0 conn(0x7f53480c4930 legacy=0x7f53480c3a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:38:00.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:00.405+0000 7f53477fe700 1 -- 172.21.15.72:0/1355094958 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53480c15c0 con 0x7f5348151950 2023-07-25T14:38:00.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:00.405+0000 7f53477fe700 1 -- 172.21.15.72:0/1355094958 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2559588315 0 0) 0x7f533c001670 con 0x7f5348151950 2023-07-25T14:38:00.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:00.405+0000 7f53477fe700 1 -- 172.21.15.72:0/1355094958 >> v1:172.21.15.72:6789/0 conn(0x7f5348151950 legacy=0x7f534806a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:38:00.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:00.405+0000 7f53477fe700 1 --2- 172.21.15.72:0/1355094958 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5338003a00 0x7f5338003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:38:00.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:00.405+0000 7f53477fe700 1 --2- 172.21.15.72:0/1355094958 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5338004400 0x7f53380048d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:38:00.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:00.405+0000 7f53477fe700 1 --2- 172.21.15.72:0/1355094958 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5338005170 0x7f533800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:38:00.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:00.405+0000 7f53477fe700 1 -- 172.21.15.72:0/1355094958 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5348071a60 con 0x7f5338005170 2023-07-25T14:38:00.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:00.405+0000 7f53477fe700 1 -- 172.21.15.72:0/1355094958 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f533800c0b0 con 0x7f5338003a00 2023-07-25T14:38:00.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:00.405+0000 7f53477fe700 1 -- 172.21.15.72:0/1355094958 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f533800c270 con 0x7f5338004400 2023-07-25T14:38:00.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:00.405+0000 7f534d571700 1 --2- 172.21.15.72:0/1355094958 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5338005170 0x7f533800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:38:00.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:00.405+0000 7f534cd70700 1 --2- 172.21.15.72:0/1355094958 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5338003a00 0x7f5338003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:38:00.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:00.405+0000 7f5347fff700 1 --2- 172.21.15.72:0/1355094958 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5338004400 0x7f53380048d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:38:00.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:00.405+0000 7f534d571700 1 -- 172.21.15.72:0/1355094958 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5338004400 msgr2=0x7f53380048d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:38:00.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:00.405+0000 7f534d571700 1 --2- 172.21.15.72:0/1355094958 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5338004400 0x7f53380048d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:38:00.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:00.405+0000 7f534d571700 1 -- 172.21.15.72:0/1355094958 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5338003a00 msgr2=0x7f5338003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:38:00.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:00.405+0000 7f534d571700 1 --2- 172.21.15.72:0/1355094958 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5338003a00 0x7f5338003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:38:00.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:00.405+0000 7f534d571700 1 -- 172.21.15.72:0/1355094958 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53380035b0 con 0x7f5338005170 2023-07-25T14:38:00.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:00.405+0000 7f5347fff700 1 --2- 172.21.15.72:0/1355094958 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5338004400 0x7f53380048d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-25T14:38:00.421 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:00.405+0000 7f534d571700 1 -- 172.21.15.72:0/1355094958 reap_dead start 2023-07-25T14:38:00.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:00.405+0000 7f534d571700 1 --2- 172.21.15.72:0/1355094958 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5338005170 0x7f533800ba10 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f534000c240 tx=0x7f5338005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69530cf071a2834d server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:38:00.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:00.405+0000 7f53477fe700 1 -- 172.21.15.72:0/1355094958 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5340001e70 con 0x7f5338005170 2023-07-25T14:38:00.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:00.406+0000 7f53477fe700 1 -- 172.21.15.72:0/1355094958 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f534000ce00 con 0x7f5338005170 2023-07-25T14:38:00.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:00.406+0000 7f53477fe700 1 -- 172.21.15.72:0/1355094958 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5340003c40 con 0x7f5338005170 2023-07-25T14:38:00.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:00.406+0000 7f534efd4700 1 -- 172.21.15.72:0/1355094958 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5338005170 msgr2=0x7f533800ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:38:00.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:00.406+0000 7f534efd4700 1 --2- 172.21.15.72:0/1355094958 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5338005170 0x7f533800ba10 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f534000c240 tx=0x7f5338005880 comp rx=0 tx=0).stop 2023-07-25T14:38:00.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:00.406+0000 7f534efd4700 1 -- 172.21.15.72:0/1355094958 shutdown_connections 2023-07-25T14:38:00.422 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:00.406+0000 7f534efd4700 1 --2- 172.21.15.72:0/1355094958 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5338005170 0x7f533800ba10 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:38:00.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:00.406+0000 7f534efd4700 1 -- 172.21.15.72:0/1355094958 >> 172.21.15.72:0/1355094958 conn(0x7f53480a87e0 msgr2=0x7f53480a8bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:38:00.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:00.406+0000 7f534efd4700 1 -- 172.21.15.72:0/1355094958 shutdown_connections 2023-07-25T14:38:00.423 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:00.406+0000 7f534efd4700 1 -- 172.21.15.72:0/1355094958 wait complete. 2023-07-25T14:38:00.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:00.407+0000 7f534efd4700 1 Processor -- start 2023-07-25T14:38:00.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:00.407+0000 7f534efd4700 1 -- start start 2023-07-25T14:38:00.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:00.408+0000 7f534efd4700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5338005170 0x7f534814cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:38:00.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:00.408+0000 7f534efd4700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5348153460 0x7f5348152950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:38:00.425 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:00.408+0000 7f534efd4700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5348153d00 0x7f5348152e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:38:00.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:00.408+0000 7f534efd4700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5348152190 con 0x7f5348153d00 2023-07-25T14:38:00.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:00.408+0000 7f534efd4700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53481ea320 con 0x7f5338005170 2023-07-25T14:38:00.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:00.408+0000 7f534efd4700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5348152430 con 0x7f5348153460 2023-07-25T14:38:00.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:00.408+0000 7f534d571700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5348153d00 0x7f5348152e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:38:00.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:00.408+0000 7f534d571700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5348153d00 0x7f5348152e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:44132/0 (socket says 172.21.15.72:44132) 2023-07-25T14:38:00.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:00.408+0000 7f534d571700 1 -- 172.21.15.72:0/1120097042 learned_addr learned my addr 172.21.15.72:0/1120097042 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:38:00.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:00.408+0000 7f534cd70700 1 --2- 172.21.15.72:0/1120097042 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5338005170 0x7f534814cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:38:00.426 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:00.408+0000 7f5347fff700 1 --2- 172.21.15.72:0/1120097042 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5348153460 0x7f5348152950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:38:00.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:00.409+0000 7f534d571700 1 -- 172.21.15.72:0/1120097042 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5348153460 msgr2=0x7f5348152950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:38:00.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:00.409+0000 7f534d571700 1 --2- 172.21.15.72:0/1120097042 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5348153460 0x7f5348152950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:38:00.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:00.409+0000 7f534d571700 1 -- 172.21.15.72:0/1120097042 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5338005170 msgr2=0x7f534814cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:38:00.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:00.409+0000 7f534d571700 1 --2- 172.21.15.72:0/1120097042 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5338005170 0x7f534814cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:38:00.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:00.409+0000 7f534d571700 1 -- 172.21.15.72:0/1120097042 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f534814d440 con 0x7f5348153d00 2023-07-25T14:38:00.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:00.409+0000 7f534d571700 1 --2- 172.21.15.72:0/1120097042 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5348153d00 0x7f5348152e90 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f534806b0f0 tx=0x7f5340001490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:38:00.427 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:00.409+0000 7f53457fa700 1 -- 172.21.15.72:0/1120097042 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5340017070 con 0x7f5348153d00 2023-07-25T14:38:00.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:00.409+0000 7f53457fa700 1 -- 172.21.15.72:0/1120097042 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53400050d0 con 0x7f5348153d00 2023-07-25T14:38:00.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:00.409+0000 7f534efd4700 1 -- 172.21.15.72:0/1120097042 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53481ea600 con 0x7f5348153d00 2023-07-25T14:38:00.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:00.409+0000 7f53457fa700 1 -- 172.21.15.72:0/1120097042 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5340005480 con 0x7f5348153d00 2023-07-25T14:38:00.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:00.409+0000 7f534efd4700 1 -- 172.21.15.72:0/1120097042 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53480bdea0 con 0x7f5348153d00 2023-07-25T14:38:00.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:00.410+0000 7f534efd4700 1 -- 172.21.15.72:0/1120097042 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f534814f120 con 0x7f5348153d00 2023-07-25T14:38:00.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:00.410+0000 7f53457fa700 1 -- 172.21.15.72:0/1120097042 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f53400055e0 con 0x7f5348153d00 2023-07-25T14:38:00.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:00.411+0000 7f53457fa700 1 --2- 172.21.15.72:0/1120097042 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f532c06ace0 0x7f532c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:38:00.428 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:00.411+0000 7f53457fa700 1 -- 172.21.15.72:0/1120097042 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 7238+0+0 (secure 0 0 0) 0x7f534001a040 con 0x7f5348153d00 2023-07-25T14:38:00.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:00.411+0000 7f534cd70700 1 --2- 172.21.15.72:0/1120097042 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f532c06ace0 0x7f532c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:38:00.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:00.411+0000 7f534cd70700 1 --2- 172.21.15.72:0/1120097042 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f532c06ace0 0x7f532c06d1a0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f53480bd7f0 tx=0x7f533c000fe0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:38:00.429 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:00.415+0000 7f53457fa700 1 -- 172.21.15.72:0/1120097042 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f5340054f70 con 0x7f5348153d00 2023-07-25T14:38:00.657 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:00.647+0000 7f534efd4700 1 -- 172.21.15.72:0/1120097042 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs2", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f534804e470 con 0x7f5348153d00 2023-07-25T14:38:01.149 INFO:tasks.ceph.mds.c.smithi072.stderr:2023-07-25T14:38:01.139+0000 7feef89e0700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-25T14:38:01.270 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:01.259+0000 7f53457fa700 1 -- 172.21.15.72:0/1120097042 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs2", "var": "allow_standby_replay", "val": "false"}]=0 v38) v1 ==== 123+0+0 (secure 0 0 0) 0x7f5340058590 con 0x7f5348153d00 2023-07-25T14:38:01.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:01.262+0000 7f534efd4700 1 -- 172.21.15.72:0/1120097042 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f532c06ace0 msgr2=0x7f532c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:38:01.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:01.262+0000 7f534efd4700 1 --2- 172.21.15.72:0/1120097042 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f532c06ace0 0x7f532c06d1a0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f53480bd7f0 tx=0x7f533c000fe0 comp rx=0 tx=0).stop 2023-07-25T14:38:01.273 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:01.262+0000 7f534efd4700 1 -- 172.21.15.72:0/1120097042 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5348153d00 msgr2=0x7f5348152e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:38:01.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:01.262+0000 7f534efd4700 1 --2- 172.21.15.72:0/1120097042 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5348153d00 0x7f5348152e90 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f534806b0f0 tx=0x7f5340001490 comp rx=0 tx=0).stop 2023-07-25T14:38:01.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:01.262+0000 7f534efd4700 1 -- 172.21.15.72:0/1120097042 shutdown_connections 2023-07-25T14:38:01.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:01.262+0000 7f534efd4700 1 --2- 172.21.15.72:0/1120097042 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f532c06ace0 0x7f532c06d1a0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:38:01.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:01.262+0000 7f534efd4700 1 --2- 172.21.15.72:0/1120097042 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f5348153d00 0x7f5348152e90 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:38:01.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:01.262+0000 7f534efd4700 1 --2- 172.21.15.72:0/1120097042 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5338005170 0x7f534814cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:38:01.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:01.262+0000 7f534efd4700 1 --2- 172.21.15.72:0/1120097042 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f5348153460 0x7f5348152950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:38:01.274 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:01.262+0000 7f534efd4700 1 -- 172.21.15.72:0/1120097042 >> 172.21.15.72:0/1120097042 conn(0x7f53480a87e0 msgr2=0x7f5348150130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:38:01.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:01.262+0000 7f534efd4700 1 -- 172.21.15.72:0/1120097042 shutdown_connections 2023-07-25T14:38:01.275 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:01.262+0000 7f534efd4700 1 -- 172.21.15.72:0/1120097042 wait complete. 2023-07-25T14:38:01.285 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs2' 2023-07-25T14:38:01.286 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-25T14:38:01.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:01.396+0000 7fc9a2d6e700 1 Processor -- start 2023-07-25T14:38:01.407 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:01.397+0000 7fc9a2d6e700 1 -- start start 2023-07-25T14:38:01.409 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:01.397+0000 7fc9a2d6e700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc99c151950 0x7fc99c06a190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:38:01.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:01.397+0000 7fc9a2d6e700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc99c0724c0 0x7fc99c0c34c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:38:01.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:01.397+0000 7fc9a2d6e700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc99c0c2fe0 con 0x7fc99c06a6d0 2023-07-25T14:38:01.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:01.397+0000 7fc9a2d6e700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc99c071a60 con 0x7fc99c0724c0 2023-07-25T14:38:01.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:01.397+0000 7fc9a2d6e700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc99c0c2a70 con 0x7fc99c151950 2023-07-25T14:38:01.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:01.397+0000 7fc99bfff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fc99c0724c0 0x7fc99c0c34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:38:01.410 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:01.397+0000 7fc9a130b700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fc99c06a6d0 0x7fc99c0c3a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:34876/0 (socket says 172.21.15.72:34876) 2023-07-25T14:38:01.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:01.397+0000 7fc9a130b700 1 -- 172.21.15.72:0/2658118497 learned_addr learned my addr 172.21.15.72:0/2658118497 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:38:01.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:01.398+0000 7fc9a0b0a700 1 --2- 172.21.15.72:0/2658118497 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc99c151950 0x7fc99c06a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:38:01.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:01.398+0000 7fc99bfff700 1 -- 172.21.15.72:0/2658118497 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc99c151950 msgr2=0x7fc99c06a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:38:01.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:01.398+0000 7fc99bfff700 1 --2- 172.21.15.72:0/2658118497 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc99c151950 0x7fc99c06a190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:38:01.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:01.398+0000 7fc99bfff700 1 -- 172.21.15.72:0/2658118497 >> v1:172.21.15.72:6789/0 conn(0x7fc99c06a6d0 legacy=0x7fc99c0c3a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:38:01.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:01.398+0000 7fc99b7fe700 1 -- 172.21.15.72:0/2658118497 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 372404405 0 0) 0x7fc99c0c2fe0 con 0x7fc99c06a6d0 2023-07-25T14:38:01.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:01.398+0000 7fc99bfff700 1 -- 172.21.15.72:0/2658118497 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc99c155070 con 0x7fc99c0724c0 2023-07-25T14:38:01.411 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:01.398+0000 7fc99bfff700 1 --2- 172.21.15.72:0/2658118497 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc99c0724c0 0x7fc99c0c34c0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7fc988009840 tx=0x7fc988009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cef2f84627641c9 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:38:01.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:01.398+0000 7fc99b7fe700 1 -- 172.21.15.72:0/2658118497 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc988011830 con 0x7fc99c0724c0 2023-07-25T14:38:01.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:01.398+0000 7fc99b7fe700 1 -- 172.21.15.72:0/2658118497 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc988011990 con 0x7fc99c0724c0 2023-07-25T14:38:01.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:01.398+0000 7fc99b7fe700 1 -- 172.21.15.72:0/2658118497 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc988011d20 con 0x7fc99c0724c0 2023-07-25T14:38:01.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:01.398+0000 7fc9a2d6e700 1 -- 172.21.15.72:0/2658118497 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc99c0724c0 msgr2=0x7fc99c0c34c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:38:01.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:01.398+0000 7fc9a2d6e700 1 --2- 172.21.15.72:0/2658118497 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc99c0724c0 0x7fc99c0c34c0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7fc988009840 tx=0x7fc988009b50 comp rx=0 tx=0).stop 2023-07-25T14:38:01.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:01.399+0000 7fc9a2d6e700 1 -- 172.21.15.72:0/2658118497 shutdown_connections 2023-07-25T14:38:01.412 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:01.399+0000 7fc9a2d6e700 1 --2- 172.21.15.72:0/2658118497 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc99c151950 0x7fc99c06a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:38:01.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:01.399+0000 7fc9a2d6e700 1 --2- 172.21.15.72:0/2658118497 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc99c0724c0 0x7fc99c0c34c0 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:38:01.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:01.399+0000 7fc9a2d6e700 1 -- 172.21.15.72:0/2658118497 >> 172.21.15.72:0/2658118497 conn(0x7fc99c0a87e0 msgr2=0x7fc99c0a8bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:38:01.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:01.399+0000 7fc9a2d6e700 1 -- 172.21.15.72:0/2658118497 shutdown_connections 2023-07-25T14:38:01.413 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:01.399+0000 7fc9a2d6e700 1 -- 172.21.15.72:0/2658118497 wait complete. 2023-07-25T14:38:01.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:01.400+0000 7fc9a2d6e700 1 Processor -- start 2023-07-25T14:38:01.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:01.400+0000 7fc9a2d6e700 1 -- start start 2023-07-25T14:38:01.415 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:01.401+0000 7fc9a2d6e700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc99c06a6d0 0x7fc99c158380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:38:01.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:01.401+0000 7fc9a2d6e700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc99c0724c0 0x7fc99c153a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:38:01.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:01.401+0000 7fc9a2d6e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc99c151950 0x7fc99c14d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:38:01.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:01.401+0000 7fc9a2d6e700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc99c0bf710 con 0x7fc99c151950 2023-07-25T14:38:01.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:01.401+0000 7fc9a2d6e700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc99c0c0ed0 con 0x7fc99c0724c0 2023-07-25T14:38:01.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:01.401+0000 7fc9a2d6e700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc99c0befa0 con 0x7fc99c06a6d0 2023-07-25T14:38:01.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:01.401+0000 7fc9a130b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc99c151950 0x7fc99c14d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:38:01.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:01.401+0000 7fc9a130b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc99c151950 0x7fc99c14d530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:44146/0 (socket says 172.21.15.72:44146) 2023-07-25T14:38:01.416 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:01.401+0000 7fc9a130b700 1 -- 172.21.15.72:0/196379869 learned_addr learned my addr 172.21.15.72:0/196379869 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:38:01.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:01.401+0000 7fc9a0b0a700 1 --2- 172.21.15.72:0/196379869 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc99c06a6d0 0x7fc99c158380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:38:01.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:01.401+0000 7fc99bfff700 1 --2- 172.21.15.72:0/196379869 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc99c0724c0 0x7fc99c153a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:38:01.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:01.401+0000 7fc9a130b700 1 -- 172.21.15.72:0/196379869 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc99c06a6d0 msgr2=0x7fc99c158380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:38:01.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:01.401+0000 7fc9a130b700 1 --2- 172.21.15.72:0/196379869 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc99c06a6d0 0x7fc99c158380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:38:01.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:01.401+0000 7fc9a130b700 1 -- 172.21.15.72:0/196379869 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc99c0724c0 msgr2=0x7fc99c153a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:38:01.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:01.401+0000 7fc9a130b700 1 --2- 172.21.15.72:0/196379869 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc99c0724c0 0x7fc99c153a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:38:01.417 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:01.401+0000 7fc9a130b700 1 -- 172.21.15.72:0/196379869 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9880094a0 con 0x7fc99c151950 2023-07-25T14:38:01.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:01.401+0000 7fc9a130b700 1 --2- 172.21.15.72:0/196379869 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc99c151950 0x7fc99c14d530 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7fc994002230 tx=0x7fc99400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:38:01.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:01.401+0000 7fc9997fa700 1 -- 172.21.15.72:0/196379869 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc99400ac20 con 0x7fc99c151950 2023-07-25T14:38:01.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:01.401+0000 7fc9997fa700 1 -- 172.21.15.72:0/196379869 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc99400ada0 con 0x7fc99c151950 2023-07-25T14:38:01.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:01.401+0000 7fc9a2d6e700 1 -- 172.21.15.72:0/196379869 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc99c14f3b0 con 0x7fc99c151950 2023-07-25T14:38:01.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:01.401+0000 7fc9997fa700 1 -- 172.21.15.72:0/196379869 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc994007310 con 0x7fc99c151950 2023-07-25T14:38:01.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:01.401+0000 7fc9a2d6e700 1 -- 172.21.15.72:0/196379869 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc99c0be950 con 0x7fc99c151950 2023-07-25T14:38:01.418 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:01.402+0000 7fc9a2d6e700 1 -- 172.21.15.72:0/196379869 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc99c0bf110 con 0x7fc99c151950 2023-07-25T14:38:01.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:01.403+0000 7fc9997fa700 1 -- 172.21.15.72:0/196379869 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc994007470 con 0x7fc99c151950 2023-07-25T14:38:01.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:01.403+0000 7fc9997fa700 1 --2- 172.21.15.72:0/196379869 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fc98006ace0 0x7fc98006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:38:01.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:01.403+0000 7fc9997fa700 1 -- 172.21.15.72:0/196379869 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 7238+0+0 (secure 0 0 0) 0x7fc9940897b0 con 0x7fc99c151950 2023-07-25T14:38:01.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:01.403+0000 7fc9a0b0a700 1 --2- 172.21.15.72:0/196379869 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fc98006ace0 0x7fc98006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:38:01.419 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:01.404+0000 7fc9a0b0a700 1 --2- 172.21.15.72:0/196379869 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fc98006ace0 0x7fc98006d1a0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fc99000b9b0 tx=0x7fc990008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:38:01.420 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:01.407+0000 7fc9997fa700 1 -- 172.21.15.72:0/196379869 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fc994054450 con 0x7fc99c151950 2023-07-25T14:38:01.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:01.639+0000 7fc9a2d6e700 1 -- 172.21.15.72:0/196379869 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc99c04e470 con 0x7fc99c151950 2023-07-25T14:38:01.650 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:01.640+0000 7fc9997fa700 1 -- 172.21.15.72:0/196379869 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+5820 (secure 0 0 0) 0x7fc994057a70 con 0x7fc99c151950 2023-07-25T14:38:01.651 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-25T14:38:01.651 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":38,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5698,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6834/2824839995","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":2824839995},{"type":"v1","addr":"172.21.15.92:6834","nonce":2824839995}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":6147,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.72:6836/1970088937","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6834","nonce":1970088937},{"type":"v1","addr":"172.21.15.72:6836","nonce":1970088937}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-25T14:37:44.546871+0000","modified":"2023-07-25T14:37:48.197140+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6165},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6165":{"gid":6165,"name":"d","rank":0,"incarnation":29,"state":"up:active","state_seq":3,"addr":"172.21.15.92:6835/2035914134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6833","nonce":2035914134},{"type":"v1","addr":"172.21.15.92:6835","nonce":2035914134}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4},{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-25T14:37:57.636527+0000","modified":"2023-07-25T14:38:01.255435+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6150},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6150":{"gid":6150,"name":"c","rank":0,"incarnation":34,"state":"up:active","state_seq":6,"addr":"172.21.15.72:6837/2638708695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6835","nonce":2638708695},{"type":"v1","addr":"172.21.15.72:6837","nonce":2638708695}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-07-25T14:38:01.652 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:01.642+0000 7fc9a2d6e700 1 -- 172.21.15.72:0/196379869 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fc98006ace0 msgr2=0x7fc98006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:38:01.653 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:01.642+0000 7fc9a2d6e700 1 --2- 172.21.15.72:0/196379869 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fc98006ace0 0x7fc98006d1a0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fc99000b9b0 tx=0x7fc990008040 comp rx=0 tx=0).stop 2023-07-25T14:38:01.653 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:01.642+0000 7fc9a2d6e700 1 -- 172.21.15.72:0/196379869 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc99c151950 msgr2=0x7fc99c14d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:38:01.653 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:01.642+0000 7fc9a2d6e700 1 --2- 172.21.15.72:0/196379869 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc99c151950 0x7fc99c14d530 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7fc994002230 tx=0x7fc99400a060 comp rx=0 tx=0).stop 2023-07-25T14:38:01.653 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:01.642+0000 7fc9a2d6e700 1 -- 172.21.15.72:0/196379869 shutdown_connections 2023-07-25T14:38:01.653 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:01.642+0000 7fc9a2d6e700 1 --2- 172.21.15.72:0/196379869 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fc98006ace0 0x7fc98006d1a0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:38:01.653 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:01.642+0000 7fc9a2d6e700 1 --2- 172.21.15.72:0/196379869 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc99c06a6d0 0x7fc99c158380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:38:01.653 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:01.642+0000 7fc9a2d6e700 1 --2- 172.21.15.72:0/196379869 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc99c151950 0x7fc99c14d530 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:38:01.654 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:01.642+0000 7fc9a2d6e700 1 --2- 172.21.15.72:0/196379869 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc99c0724c0 0x7fc99c153a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:38:01.654 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:01.642+0000 7fc9a2d6e700 1 -- 172.21.15.72:0/196379869 >> 172.21.15.72:0/196379869 conn(0x7fc99c0a87e0 msgr2=0x7fc99c0c45e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:38:01.654 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:01.642+0000 7fc9a2d6e700 1 -- 172.21.15.72:0/196379869 shutdown_connections 2023-07-25T14:38:01.654 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:01.642+0000 7fc9a2d6e700 1 -- 172.21.15.72:0/196379869 wait complete. 2023-07-25T14:38:01.654 INFO:teuthology.orchestra.run.smithi072.stderr:dumped fsmap epoch 38 2023-07-25T14:38:01.665 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-25T14:38:01.784 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:01.774+0000 7f1d0c780700 1 Processor -- start 2023-07-25T14:38:01.785 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:01.774+0000 7f1d0c780700 1 -- start start 2023-07-25T14:38:01.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:01.775+0000 7f1d0c780700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f1d041518c0 0x7f1d0406b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:38:01.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:01.775+0000 7f1d0c780700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1d040c4370 0x7f1d040c47a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:38:01.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:01.775+0000 7f1d0c780700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d04157cd0 con 0x7f1d04154df0 2023-07-25T14:38:01.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:01.775+0000 7f1d0c780700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d040c2310 con 0x7f1d040c4370 2023-07-25T14:38:01.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:01.775+0000 7f1d0c780700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d04158870 con 0x7f1d041518c0 2023-07-25T14:38:01.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:01.775+0000 7f1d0ad1d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1d040c4370 0x7f1d040c47a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:38:01.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:01.775+0000 7f1d09d1b700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f1d04154df0 0x7f1d04158160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:34886/0 (socket says 172.21.15.72:34886) 2023-07-25T14:38:01.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:01.775+0000 7f1d0ad1d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f1d040c4370 0x7f1d040c47a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:44150/0 (socket says 172.21.15.72:44150) 2023-07-25T14:38:01.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:01.775+0000 7f1d09d1b700 1 -- 172.21.15.72:0/2627052796 learned_addr learned my addr 172.21.15.72:0/2627052796 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:38:01.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:01.775+0000 7f1d0ad1d700 1 -- 172.21.15.72:0/2627052796 >> v2:172.21.15.92:3300/0 conn(0x7f1d041518c0 msgr2=0x7f1d0406b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:38:01.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:01.775+0000 7f1d0a51c700 1 --2- 172.21.15.72:0/2627052796 >> v2:172.21.15.92:3300/0 conn(0x7f1d041518c0 0x7f1d0406b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:38:01.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:01.775+0000 7f1d0ad1d700 1 --2- 172.21.15.72:0/2627052796 >> v2:172.21.15.92:3300/0 conn(0x7f1d041518c0 0x7f1d0406b2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:38:01.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:01.775+0000 7f1d0951a700 1 -- 172.21.15.72:0/2627052796 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3632313475 0 0) 0x7f1d04157cd0 con 0x7f1d04154df0 2023-07-25T14:38:01.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:01.775+0000 7f1d0ad1d700 1 -- 172.21.15.72:0/2627052796 >> v1:172.21.15.72:6789/0 conn(0x7f1d04154df0 legacy=0x7f1d04158160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:38:01.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:01.775+0000 7f1d0ad1d700 1 -- 172.21.15.72:0/2627052796 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d04155280 con 0x7f1d040c4370 2023-07-25T14:38:01.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:01.775+0000 7f1d0a51c700 1 --2- 172.21.15.72:0/2627052796 >> v2:172.21.15.92:3300/0 conn(0x7f1d041518c0 0x7f1d0406b2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-25T14:38:01.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:01.775+0000 7f1d0ad1d700 1 --2- 172.21.15.72:0/2627052796 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1d040c4370 0x7f1d040c47a0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f1d040c4eb0 tx=0x7f1cfc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7227eea7eeacb1e7 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:38:01.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:01.775+0000 7f1d0951a700 1 -- 172.21.15.72:0/2627052796 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cfc00e070 con 0x7f1d040c4370 2023-07-25T14:38:01.789 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:01.775+0000 7f1d0951a700 1 -- 172.21.15.72:0/2627052796 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cfc00bbd0 con 0x7f1d040c4370 2023-07-25T14:38:01.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:01.775+0000 7f1d0951a700 1 -- 172.21.15.72:0/2627052796 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cfc012430 con 0x7f1d040c4370 2023-07-25T14:38:01.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:01.776+0000 7f1d0c780700 1 -- 172.21.15.72:0/2627052796 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1d040c4370 msgr2=0x7f1d040c47a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:38:01.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:01.776+0000 7f1d0c780700 1 --2- 172.21.15.72:0/2627052796 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1d040c4370 0x7f1d040c47a0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f1d040c4eb0 tx=0x7f1cfc00b330 comp rx=0 tx=0).stop 2023-07-25T14:38:01.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:01.776+0000 7f1d0c780700 1 -- 172.21.15.72:0/2627052796 shutdown_connections 2023-07-25T14:38:01.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:01.776+0000 7f1d0c780700 1 --2- 172.21.15.72:0/2627052796 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1d040c4370 0x7f1d040c47a0 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:38:01.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:01.776+0000 7f1d0c780700 1 --2- 172.21.15.72:0/2627052796 >> v2:172.21.15.92:3300/0 conn(0x7f1d041518c0 0x7f1d0406b2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:38:01.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:01.776+0000 7f1d0c780700 1 -- 172.21.15.72:0/2627052796 >> 172.21.15.72:0/2627052796 conn(0x7f1d0406a8d0 msgr2=0x7f1d040a94e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:38:01.790 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:01.776+0000 7f1d0c780700 1 -- 172.21.15.72:0/2627052796 shutdown_connections 2023-07-25T14:38:01.791 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:01.776+0000 7f1d0c780700 1 -- 172.21.15.72:0/2627052796 wait complete. 2023-07-25T14:38:01.792 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:01.777+0000 7f1d0c780700 1 Processor -- start 2023-07-25T14:38:01.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:01.777+0000 7f1d0c780700 1 -- start start 2023-07-25T14:38:01.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:01.778+0000 7f1d0c780700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1d040c4370 0x7f1d040ac340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:38:01.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:01.778+0000 7f1d0c780700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1d041518c0 0x7f1d04153230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:38:01.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:01.778+0000 7f1d0c780700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1d04154df0 0x7f1d041e9a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:38:01.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:01.778+0000 7f1d0c780700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d040c1390 con 0x7f1d041518c0 2023-07-25T14:38:01.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:01.778+0000 7f1d0c780700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d040c0f00 con 0x7f1d04154df0 2023-07-25T14:38:01.793 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:01.778+0000 7f1d0c780700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d040c0080 con 0x7f1d040c4370 2023-07-25T14:38:01.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:01.778+0000 7f1d09d1b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1d041518c0 0x7f1d04153230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:38:01.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:01.778+0000 7f1d09d1b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1d041518c0 0x7f1d04153230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:44158/0 (socket says 172.21.15.72:44158) 2023-07-25T14:38:01.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:01.778+0000 7f1d09d1b700 1 -- 172.21.15.72:0/1742277033 learned_addr learned my addr 172.21.15.72:0/1742277033 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:38:01.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:01.778+0000 7f1d09d1b700 1 -- 172.21.15.72:0/1742277033 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1d040c4370 msgr2=0x7f1d040ac340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:38:01.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:01.778+0000 7f1d09d1b700 1 --2- 172.21.15.72:0/1742277033 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1d040c4370 0x7f1d040ac340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:38:01.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:01.778+0000 7f1d09d1b700 1 -- 172.21.15.72:0/1742277033 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1d04154df0 msgr2=0x7f1d041e9a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:38:01.794 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:01.778+0000 7f1d09d1b700 1 --2- 172.21.15.72:0/1742277033 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1d04154df0 0x7f1d041e9a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:38:01.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:01.778+0000 7f1d09d1b700 1 -- 172.21.15.72:0/1742277033 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cfc009a70 con 0x7f1d041518c0 2023-07-25T14:38:01.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:01.778+0000 7f1d09d1b700 1 --2- 172.21.15.72:0/1742277033 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1d041518c0 0x7f1d04153230 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f1cf400c580 tx=0x7f1cf400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:38:01.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:01.779+0000 7f1cfaffd700 1 -- 172.21.15.72:0/1742277033 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cf4004c80 con 0x7f1d041518c0 2023-07-25T14:38:01.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:01.779+0000 7f1cfaffd700 1 -- 172.21.15.72:0/1742277033 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cf4004e00 con 0x7f1d041518c0 2023-07-25T14:38:01.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:01.779+0000 7f1d0c780700 1 -- 172.21.15.72:0/1742277033 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d040c05d0 con 0x7f1d041518c0 2023-07-25T14:38:01.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:01.779+0000 7f1cfaffd700 1 -- 172.21.15.72:0/1742277033 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cf4007310 con 0x7f1d041518c0 2023-07-25T14:38:01.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:01.779+0000 7f1d0c780700 1 -- 172.21.15.72:0/1742277033 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d040c0b90 con 0x7f1d041518c0 2023-07-25T14:38:01.795 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:01.780+0000 7f1d0c780700 1 -- 172.21.15.72:0/1742277033 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d040c8900 con 0x7f1d041518c0 2023-07-25T14:38:01.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:01.780+0000 7f1cfaffd700 1 -- 172.21.15.72:0/1742277033 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1cf4007470 con 0x7f1d041518c0 2023-07-25T14:38:01.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:01.780+0000 7f1cfaffd700 1 --2- 172.21.15.72:0/1742277033 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f1ce806ace0 0x7f1ce806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:38:01.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:01.781+0000 7f1d0a51c700 1 --2- 172.21.15.72:0/1742277033 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f1ce806ace0 0x7f1ce806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:38:01.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:01.781+0000 7f1cfaffd700 1 -- 172.21.15.72:0/1742277033 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 7238+0+0 (secure 0 0 0) 0x7f1cf4089560 con 0x7f1d041518c0 2023-07-25T14:38:01.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:01.781+0000 7f1d0a51c700 1 --2- 172.21.15.72:0/1742277033 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f1ce806ace0 0x7f1ce806d1a0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f1d00007920 tx=0x7f1d00008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:38:01.796 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:01.785+0000 7f1cfaffd700 1 -- 172.21.15.72:0/1742277033 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f1cf4054200 con 0x7f1d041518c0 2023-07-25T14:38:01.986 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:01.975+0000 7f1d0c780700 1 -- 172.21.15.72:0/1742277033 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1d0404e470 con 0x7f1d041518c0 2023-07-25T14:38:01.987 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:01.976+0000 7f1cfaffd700 1 -- 172.21.15.72:0/1742277033 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v61) v1 ==== 74+0+22155 (secure 0 0 0) 0x7f1cf4057820 con 0x7f1d041518c0 2023-07-25T14:38:01.987 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-25T14:38:01.988 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":61,"fsid":"9170db48-9170-43e8-8ccb-9813e6240906","created":"2023-07-25T14:35:21.733262+0000","modified":"2023-07-25T14:37:59.246173+0000","last_up_change":"2023-07-25T14:35:31.355010+0000","last_in_change":"2023-07-25T14:35:24.195785+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-25T14:35:32.983457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-25T14:35:33.326342+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-07-25T14:37:42.689589+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-07-25T14:37:43.512214+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs2_metadata","create_time":"2023-07-25T14:37:56.130030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs2_data","create_time":"2023-07-25T14:37:56.603570+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d517fdad-0bfe-49f0-89f2-9421c3761839","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6801","nonce":2475407414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6803","nonce":2475407414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6807","nonce":2475407414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6805","nonce":2475407414}]},"public_addr":"172.21.15.72:6801/2475407414","cluster_addr":"172.21.15.72:6803/2475407414","heartbeat_back_addr":"172.21.15.72:6807/2475407414","heartbeat_front_addr":"172.21.15.72:6805/2475407414","state":["exists","up"]},{"osd":1,"uuid":"e1564be3-f209-47e5-a8d0-32fc618a474f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6822","nonce":870954016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6825","nonce":870954016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6831","nonce":870954016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6827","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6829","nonce":870954016}]},"public_addr":"172.21.15.72:6822/870954016","cluster_addr":"172.21.15.72:6825/870954016","heartbeat_back_addr":"172.21.15.72:6831/870954016","heartbeat_front_addr":"172.21.15.72:6829/870954016","state":["exists","up"]},{"osd":2,"uuid":"c4647d30-ffa6-417a-9026-ef530c75910e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6809","nonce":2143129442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6811","nonce":2143129442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6815","nonce":2143129442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6813","nonce":2143129442}]},"public_addr":"172.21.15.72:6809/2143129442","cluster_addr":"172.21.15.72:6811/2143129442","heartbeat_back_addr":"172.21.15.72:6815/2143129442","heartbeat_front_addr":"172.21.15.72:6813/2143129442","state":["exists","up"]},{"osd":3,"uuid":"76c9d9a7-c2e2-4612-a58b-d6882dd76b58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6817","nonce":3404066311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6819","nonce":3404066311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6828","nonce":3404066311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6821","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6823","nonce":3404066311}]},"public_addr":"172.21.15.72:6817/3404066311","cluster_addr":"172.21.15.72:6819/3404066311","heartbeat_back_addr":"172.21.15.72:6828/3404066311","heartbeat_front_addr":"172.21.15.72:6823/3404066311","state":["exists","up"]},{"osd":4,"uuid":"7f8920dc-0ad4-4a73-ab40-65408f83eadd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6817","nonce":2381008739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6819","nonce":2381008739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6825","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6827","nonce":2381008739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6822","nonce":2381008739}]},"public_addr":"172.21.15.92:6817/2381008739","cluster_addr":"172.21.15.92:6819/2381008739","heartbeat_back_addr":"172.21.15.92:6827/2381008739","heartbeat_front_addr":"172.21.15.92:6822/2381008739","state":["exists","up"]},{"osd":5,"uuid":"56257e7c-31eb-44c5-9ec7-1318a4e0bb35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6801","nonce":2161935604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6803","nonce":2161935604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6807","nonce":2161935604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6805","nonce":2161935604}]},"public_addr":"172.21.15.92:6801/2161935604","cluster_addr":"172.21.15.92:6803/2161935604","heartbeat_back_addr":"172.21.15.92:6807/2161935604","heartbeat_front_addr":"172.21.15.92:6805/2161935604","state":["exists","up"]},{"osd":6,"uuid":"a150d3d8-a0c9-4955-968a-8d98eff4ffb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6809","nonce":3770163493}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6811","nonce":3770163493}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6815","nonce":3770163493}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6813","nonce":3770163493}]},"public_addr":"172.21.15.92:6809/3770163493","cluster_addr":"172.21.15.92:6811/3770163493","heartbeat_back_addr":"172.21.15.92:6815/3770163493","heartbeat_front_addr":"172.21.15.92:6813/3770163493","state":["exists","up"]},{"osd":7,"uuid":"07799c27-54ee-4591-a42d-a978d6b32065","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6821","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6823","nonce":2135777609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6826","nonce":2135777609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6831","nonce":2135777609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6829","nonce":2135777609}]},"public_addr":"172.21.15.92:6823/2135777609","cluster_addr":"172.21.15.92:6826/2135777609","heartbeat_back_addr":"172.21.15.92:6831/2135777609","heartbeat_front_addr":"172.21.15.92:6829/2135777609","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.345365+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.378150+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.146566+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.372172+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:30.398421+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.385632+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.465611+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.443583+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-25T14:38:01.989 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:01.979+0000 7f1d0c780700 1 -- 172.21.15.72:0/1742277033 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f1ce806ace0 msgr2=0x7f1ce806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:38:01.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:01.979+0000 7f1d0c780700 1 --2- 172.21.15.72:0/1742277033 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f1ce806ace0 0x7f1ce806d1a0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f1d00007920 tx=0x7f1d00008040 comp rx=0 tx=0).stop 2023-07-25T14:38:01.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:01.979+0000 7f1d0c780700 1 -- 172.21.15.72:0/1742277033 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1d041518c0 msgr2=0x7f1d04153230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:38:01.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:01.979+0000 7f1d0c780700 1 --2- 172.21.15.72:0/1742277033 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1d041518c0 0x7f1d04153230 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f1cf400c580 tx=0x7f1cf400c940 comp rx=0 tx=0).stop 2023-07-25T14:38:01.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:01.979+0000 7f1d0c780700 1 -- 172.21.15.72:0/1742277033 shutdown_connections 2023-07-25T14:38:01.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:01.979+0000 7f1d0c780700 1 --2- 172.21.15.72:0/1742277033 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f1ce806ace0 0x7f1ce806d1a0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:38:01.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:01.979+0000 7f1d0c780700 1 --2- 172.21.15.72:0/1742277033 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f1d040c4370 0x7f1d040ac340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:38:01.990 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:01.979+0000 7f1d0c780700 1 --2- 172.21.15.72:0/1742277033 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1d04154df0 0x7f1d041e9a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:38:01.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:01.979+0000 7f1d0c780700 1 --2- 172.21.15.72:0/1742277033 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f1d041518c0 0x7f1d04153230 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:38:01.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:01.979+0000 7f1d0c780700 1 -- 172.21.15.72:0/1742277033 >> 172.21.15.72:0/1742277033 conn(0x7f1d0406a8d0 msgr2=0x7f1d041562f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:38:01.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:01.979+0000 7f1d0c780700 1 -- 172.21.15.72:0/1742277033 shutdown_connections 2023-07-25T14:38:01.991 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:01.979+0000 7f1d0c780700 1 -- 172.21.15.72:0/1742277033 wait complete. 2023-07-25T14:38:02.002 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-07-25T14:38:02.002 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-25T14:38:02.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.111+0000 7f56e774e700 1 Processor -- start 2023-07-25T14:38:02.122 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.111+0000 7f56e774e700 1 -- start start 2023-07-25T14:38:02.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.112+0000 7f56e774e700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f56e0151950 0x7f56e006a190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:38:02.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.112+0000 7f56e774e700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f56e006a6d0 0x7f56e00c3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:38:02.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.112+0000 7f56e774e700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56e00c2fe0 con 0x7f56e00724c0 2023-07-25T14:38:02.125 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.112+0000 7f56e774e700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56e0071a60 con 0x7f56e0151950 2023-07-25T14:38:02.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.112+0000 7f56e774e700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56e00c2a70 con 0x7f56e006a6d0 2023-07-25T14:38:02.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.112+0000 7f56e4ce9700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f56e00724c0 0x7f56e00c34c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:34900/0 (socket says 172.21.15.72:34900) 2023-07-25T14:38:02.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.112+0000 7f56e4ce9700 1 -- 172.21.15.72:0/1118702728 learned_addr learned my addr 172.21.15.72:0/1118702728 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:38:02.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.112+0000 7f56e5ceb700 1 --2- 172.21.15.72:0/1118702728 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f56e006a6d0 0x7f56e00c3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:38:02.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.112+0000 7f56e54ea700 1 --2- 172.21.15.72:0/1118702728 >> v2:172.21.15.92:3300/0 conn(0x7f56e0151950 0x7f56e006a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:38:02.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.112+0000 7f56d7fff700 1 -- 172.21.15.72:0/1118702728 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4135052088 0 0) 0x7f56e00c2fe0 con 0x7f56e00724c0 2023-07-25T14:38:02.126 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.112+0000 7f56d7fff700 1 -- 172.21.15.72:0/1118702728 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f56cc0035b0 con 0x7f56e00724c0 2023-07-25T14:38:02.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.113+0000 7f56d7fff700 1 -- 172.21.15.72:0/1118702728 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1215598351 0 0) 0x7f56cc0035b0 con 0x7f56e00724c0 2023-07-25T14:38:02.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.113+0000 7f56d7fff700 1 -- 172.21.15.72:0/1118702728 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f56e006a6d0 msgr2=0x7f56e00c3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:38:02.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.113+0000 7f56d7fff700 1 --2- 172.21.15.72:0/1118702728 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f56e006a6d0 0x7f56e00c3bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:38:02.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.113+0000 7f56d7fff700 1 -- 172.21.15.72:0/1118702728 >> v2:172.21.15.92:3300/0 conn(0x7f56e0151950 msgr2=0x7f56e006a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:38:02.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.113+0000 7f56d7fff700 1 --2- 172.21.15.72:0/1118702728 >> v2:172.21.15.92:3300/0 conn(0x7f56e0151950 0x7f56e006a190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:38:02.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.113+0000 7f56d7fff700 1 -- 172.21.15.72:0/1118702728 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56e0155070 con 0x7f56e00724c0 2023-07-25T14:38:02.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.113+0000 7f56d7fff700 1 -- 172.21.15.72:0/1118702728 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2559588315 0 0) 0x7f56dc001670 con 0x7f56e00724c0 2023-07-25T14:38:02.127 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.113+0000 7f56d7fff700 1 -- 172.21.15.72:0/1118702728 >> v1:172.21.15.72:6789/0 conn(0x7f56e00724c0 legacy=0x7f56e00c34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:38:02.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.113+0000 7f56d7fff700 1 --2- 172.21.15.72:0/1118702728 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f56cc003a00 0x7f56cc003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:38:02.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.113+0000 7f56d7fff700 1 --2- 172.21.15.72:0/1118702728 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f56cc004850 0x7f56cc004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:38:02.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.113+0000 7f56d7fff700 1 --2- 172.21.15.72:0/1118702728 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f56e006a6d0 0x7f56cc005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:38:02.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.113+0000 7f56d7fff700 1 -- 172.21.15.72:0/1118702728 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56e0071a60 con 0x7f56cc004850 2023-07-25T14:38:02.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.113+0000 7f56d7fff700 1 -- 172.21.15.72:0/1118702728 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56cc00ba10 con 0x7f56cc003a00 2023-07-25T14:38:02.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.113+0000 7f56d7fff700 1 -- 172.21.15.72:0/1118702728 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56cc00bb50 con 0x7f56e006a6d0 2023-07-25T14:38:02.128 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.113+0000 7f56e4ce9700 1 --2- 172.21.15.72:0/1118702728 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f56cc004850 0x7f56cc004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:38:02.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.113+0000 7f56e54ea700 1 --2- 172.21.15.72:0/1118702728 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f56cc003a00 0x7f56cc003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:38:02.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.113+0000 7f56e5ceb700 1 --2- 172.21.15.72:0/1118702728 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f56e006a6d0 0x7f56cc005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:38:02.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.113+0000 7f56e4ce9700 1 -- 172.21.15.72:0/1118702728 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f56e006a6d0 msgr2=0x7f56cc005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:38:02.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.113+0000 7f56e4ce9700 1 --2- 172.21.15.72:0/1118702728 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f56e006a6d0 0x7f56cc005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:38:02.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.113+0000 7f56e4ce9700 1 -- 172.21.15.72:0/1118702728 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f56cc003a00 msgr2=0x7f56cc003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:38:02.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.113+0000 7f56e4ce9700 1 --2- 172.21.15.72:0/1118702728 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f56cc003a00 0x7f56cc003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:38:02.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.113+0000 7f56e4ce9700 1 -- 172.21.15.72:0/1118702728 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56cc0035b0 con 0x7f56cc004850 2023-07-25T14:38:02.129 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.113+0000 7f56e4ce9700 1 --2- 172.21.15.72:0/1118702728 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f56cc004850 0x7f56cc004cd0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f56dc00c3a0 tx=0x7f56cc005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46e0a490f1271437 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:38:02.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.113+0000 7f56d7fff700 1 -- 172.21.15.72:0/1118702728 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56dc007c60 con 0x7f56cc004850 2023-07-25T14:38:02.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.113+0000 7f56d7fff700 1 -- 172.21.15.72:0/1118702728 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56dc005960 con 0x7f56cc004850 2023-07-25T14:38:02.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.113+0000 7f56d7fff700 1 -- 172.21.15.72:0/1118702728 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56dc00cea0 con 0x7f56cc004850 2023-07-25T14:38:02.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.114+0000 7f56e774e700 1 -- 172.21.15.72:0/1118702728 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f56cc004850 msgr2=0x7f56cc004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:38:02.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.114+0000 7f56e774e700 1 --2- 172.21.15.72:0/1118702728 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f56cc004850 0x7f56cc004cd0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f56dc00c3a0 tx=0x7f56cc005880 comp rx=0 tx=0).stop 2023-07-25T14:38:02.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.114+0000 7f56e5ceb700 1 -- 172.21.15.72:0/1118702728 reap_dead start 2023-07-25T14:38:02.130 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.114+0000 7f56e774e700 1 -- 172.21.15.72:0/1118702728 shutdown_connections 2023-07-25T14:38:02.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.114+0000 7f56e774e700 1 -- 172.21.15.72:0/1118702728 >> 172.21.15.72:0/1118702728 conn(0x7f56e00a87e0 msgr2=0x7f56e00a8bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:38:02.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.114+0000 7f56e774e700 1 -- 172.21.15.72:0/1118702728 shutdown_connections 2023-07-25T14:38:02.131 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.114+0000 7f56e774e700 1 -- 172.21.15.72:0/1118702728 wait complete. 2023-07-25T14:38:02.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.115+0000 7f56e774e700 1 Processor -- start 2023-07-25T14:38:02.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.115+0000 7f56e774e700 1 -- start start 2023-07-25T14:38:02.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.116+0000 7f56e774e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f56cc004850 0x7f56e0153510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:38:02.133 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.116+0000 7f56e774e700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f56e00ab3e0 0x7f56e00a7130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:38:02.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.116+0000 7f56e774e700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f56e00a7670 0x7f56e014a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:38:02.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.116+0000 7f56e774e700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56e0151000 con 0x7f56cc004850 2023-07-25T14:38:02.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.116+0000 7f56e774e700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56e014af00 con 0x7f56e00a7670 2023-07-25T14:38:02.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.116+0000 7f56e774e700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56e00aaf50 con 0x7f56e00ab3e0 2023-07-25T14:38:02.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.116+0000 7f56e54ea700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f56cc004850 0x7f56e0153510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:38:02.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.116+0000 7f56e54ea700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f56cc004850 0x7f56e0153510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:44176/0 (socket says 172.21.15.72:44176) 2023-07-25T14:38:02.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.116+0000 7f56e54ea700 1 -- 172.21.15.72:0/1020693180 learned_addr learned my addr 172.21.15.72:0/1020693180 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:38:02.134 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.116+0000 7f56e4ce9700 1 --2- 172.21.15.72:0/1020693180 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f56e00ab3e0 0x7f56e00a7130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:38:02.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.116+0000 7f56e5ceb700 1 --2- 172.21.15.72:0/1020693180 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f56e00a7670 0x7f56e014a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:38:02.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.116+0000 7f56e54ea700 1 -- 172.21.15.72:0/1020693180 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f56e00ab3e0 msgr2=0x7f56e00a7130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:38:02.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.116+0000 7f56e54ea700 1 --2- 172.21.15.72:0/1020693180 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f56e00ab3e0 0x7f56e00a7130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:38:02.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.116+0000 7f56e54ea700 1 -- 172.21.15.72:0/1020693180 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f56e00a7670 msgr2=0x7f56e014a1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:38:02.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.116+0000 7f56e54ea700 1 --2- 172.21.15.72:0/1020693180 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f56e00a7670 0x7f56e014a1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:38:02.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.116+0000 7f56e54ea700 1 -- 172.21.15.72:0/1020693180 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56e01e9d70 con 0x7f56cc004850 2023-07-25T14:38:02.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.117+0000 7f56e54ea700 1 --2- 172.21.15.72:0/1020693180 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f56cc004850 0x7f56e0153510 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f56d0011aa0 tx=0x7f56d0011db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:38:02.135 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.117+0000 7f56d5ffb700 1 -- 172.21.15.72:0/1020693180 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56d0011ee0 con 0x7f56cc004850 2023-07-25T14:38:02.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.117+0000 7f56d5ffb700 1 -- 172.21.15.72:0/1020693180 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56d000f940 con 0x7f56cc004850 2023-07-25T14:38:02.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.117+0000 7f56e774e700 1 -- 172.21.15.72:0/1020693180 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56e01ea050 con 0x7f56cc004850 2023-07-25T14:38:02.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.117+0000 7f56d5ffb700 1 -- 172.21.15.72:0/1020693180 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56d000fcd0 con 0x7f56cc004850 2023-07-25T14:38:02.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.117+0000 7f56e774e700 1 -- 172.21.15.72:0/1020693180 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56e014d470 con 0x7f56cc004850 2023-07-25T14:38:02.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.118+0000 7f56e774e700 1 -- 172.21.15.72:0/1020693180 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56e00ab0c0 con 0x7f56cc004850 2023-07-25T14:38:02.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.119+0000 7f56d5ffb700 1 -- 172.21.15.72:0/1020693180 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f56d0014440 con 0x7f56cc004850 2023-07-25T14:38:02.136 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.119+0000 7f56d5ffb700 1 --2- 172.21.15.72:0/1020693180 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f56c406ace0 0x7f56c406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:38:02.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.119+0000 7f56d5ffb700 1 -- 172.21.15.72:0/1020693180 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 7238+0+0 (secure 0 0 0) 0x7f56d008a300 con 0x7f56cc004850 2023-07-25T14:38:02.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.119+0000 7f56e4ce9700 1 --2- 172.21.15.72:0/1020693180 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f56c406ace0 0x7f56c406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:38:02.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.120+0000 7f56e4ce9700 1 --2- 172.21.15.72:0/1020693180 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f56c406ace0 0x7f56c406d1a0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f56e00aadb0 tx=0x7f56dc00a000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:38:02.137 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.123+0000 7f56d5ffb700 1 -- 172.21.15.72:0/1020693180 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f56d0058ad0 con 0x7f56cc004850 2023-07-25T14:38:02.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.311+0000 7f56e774e700 1 -- 172.21.15.72:0/1020693180 --> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f56e00c18a0 con 0x7f56c406ace0 2023-07-25T14:38:02.335 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.325+0000 7f56d5ffb700 1 -- 172.21.15.72:0/1020693180 <== mgr.4104 v2:172.21.15.72:6832/1171220306 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+538395 (secure 0 0 0) 0x7f56dc023070 con 0x7f56c406ace0 2023-07-25T14:38:02.341 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-25T14:38:02.344 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.329+0000 7f56e774e700 1 -- 172.21.15.72:0/1020693180 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f56c406ace0 msgr2=0x7f56c406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:38:02.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.329+0000 7f56e774e700 1 --2- 172.21.15.72:0/1020693180 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f56c406ace0 0x7f56c406d1a0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f56e00aadb0 tx=0x7f56dc00a000 comp rx=0 tx=0).stop 2023-07-25T14:38:02.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.329+0000 7f56e774e700 1 -- 172.21.15.72:0/1020693180 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f56cc004850 msgr2=0x7f56e0153510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:38:02.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.329+0000 7f56e774e700 1 --2- 172.21.15.72:0/1020693180 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f56cc004850 0x7f56e0153510 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f56d0011aa0 tx=0x7f56d0011db0 comp rx=0 tx=0).stop 2023-07-25T14:38:02.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.329+0000 7f56e774e700 1 -- 172.21.15.72:0/1020693180 shutdown_connections 2023-07-25T14:38:02.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.329+0000 7f56e774e700 1 --2- 172.21.15.72:0/1020693180 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f56c406ace0 0x7f56c406d1a0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:38:02.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.329+0000 7f56e774e700 1 --2- 172.21.15.72:0/1020693180 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f56e00a7670 0x7f56e014a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:38:02.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.329+0000 7f56e774e700 1 --2- 172.21.15.72:0/1020693180 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f56cc004850 0x7f56e0153510 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:38:02.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.329+0000 7f56e774e700 1 --2- 172.21.15.72:0/1020693180 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f56e00ab3e0 0x7f56e00a7130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:38:02.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.329+0000 7f56e774e700 1 -- 172.21.15.72:0/1020693180 >> 172.21.15.72:0/1020693180 conn(0x7f56e00a87e0 msgr2=0x7f56e01542b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:38:02.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.330+0000 7f56e774e700 1 -- 172.21.15.72:0/1020693180 shutdown_connections 2023-07-25T14:38:02.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.330+0000 7f56e774e700 1 -- 172.21.15.72:0/1020693180 wait complete. 2023-07-25T14:38:02.346 INFO:teuthology.orchestra.run.smithi072.stderr:dumped all 2023-07-25T14:38:02.352 INFO:teuthology.orchestra.run.smithi072.stdout:{"pg_ready":true,"pg_map":{"version":129,"stamp":"2023-07-25T14:38:01.314237+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594237,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":206,"num_write_kb":2433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":158,"ondisk_log_size":158,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":215,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":221712,"kb_used_data":5556,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754753008,"statfs":{"total":773094113280,"available":772867080192,"internally_reserved":0,"allocated":5689344,"data_stored":3799899,"data_compressed":64510,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1507,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.083545"},"pg_stats":[{"pgid":"13.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-25T14:37:57.230919+0000","last_change":"2023-07-25T14:37:57.230919+0000","last_active":"2023-07-25T14:37:57.230919+0000","last_peered":"2023-07-25T14:37:57.230919+0000","last_clean":"2023-07-25T14:37:57.230919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:57.230919+0000","last_undegraded":"2023-07-25T14:37:57.230919+0000","last_fullsized":"2023-07-25T14:37:57.230919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3f","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.242052+0000","last_change":"2023-07-25T14:37:45.195851+0000","last_active":"2023-07-25T14:37:56.242052+0000","last_peered":"2023-07-25T14:37:56.242052+0000","last_clean":"2023-07-25T14:37:56.242052+0000","last_became_active":"2023-07-25T14:37:45.195549+0000","last_became_peered":"2023-07-25T14:37:45.195549+0000","last_unstale":"2023-07-25T14:37:56.242052+0000","last_undegraded":"2023-07-25T14:37:56.242052+0000","last_fullsized":"2023-07-25T14:37:56.242052+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T18:04:35.337446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-25T14:37:57.230919+0000","last_change":"2023-07-25T14:37:57.230919+0000","last_active":"2023-07-25T14:37:57.230919+0000","last_peered":"2023-07-25T14:37:57.230919+0000","last_clean":"2023-07-25T14:37:57.230919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:57.230919+0000","last_undegraded":"2023-07-25T14:37:57.230919+0000","last_fullsized":"2023-07-25T14:37:57.230919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.236361+0000","last_change":"2023-07-25T14:37:45.209998+0000","last_active":"2023-07-25T14:37:56.236361+0000","last_peered":"2023-07-25T14:37:56.236361+0000","last_clean":"2023-07-25T14:37:56.236361+0000","last_became_active":"2023-07-25T14:37:45.209538+0000","last_became_peered":"2023-07-25T14:37:45.209538+0000","last_unstale":"2023-07-25T14:37:56.236361+0000","last_undegraded":"2023-07-25T14:37:56.236361+0000","last_fullsized":"2023-07-25T14:37:56.236361+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T01:48:32.892039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-25T14:37:57.230919+0000","last_change":"2023-07-25T14:37:57.230919+0000","last_active":"2023-07-25T14:37:57.230919+0000","last_peered":"2023-07-25T14:37:57.230919+0000","last_clean":"2023-07-25T14:37:57.230919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:57.230919+0000","last_undegraded":"2023-07-25T14:37:57.230919+0000","last_fullsized":"2023-07-25T14:37:57.230919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.237479+0000","last_change":"2023-07-25T14:37:45.186668+0000","last_active":"2023-07-25T14:37:56.237479+0000","last_peered":"2023-07-25T14:37:56.237479+0000","last_clean":"2023-07-25T14:37:56.237479+0000","last_became_active":"2023-07-25T14:37:45.186396+0000","last_became_peered":"2023-07-25T14:37:45.186396+0000","last_unstale":"2023-07-25T14:37:56.237479+0000","last_undegraded":"2023-07-25T14:37:56.237479+0000","last_fullsized":"2023-07-25T14:37:56.237479+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T19:14:48.003695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-25T14:37:57.230919+0000","last_change":"2023-07-25T14:37:57.230919+0000","last_active":"2023-07-25T14:37:57.230919+0000","last_peered":"2023-07-25T14:37:57.230919+0000","last_clean":"2023-07-25T14:37:57.230919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:57.230919+0000","last_undegraded":"2023-07-25T14:37:57.230919+0000","last_fullsized":"2023-07-25T14:37:57.230919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.238649+0000","last_change":"2023-07-25T14:37:45.197894+0000","last_active":"2023-07-25T14:37:56.238649+0000","last_peered":"2023-07-25T14:37:56.238649+0000","last_clean":"2023-07-25T14:37:56.238649+0000","last_became_active":"2023-07-25T14:37:45.197369+0000","last_became_peered":"2023-07-25T14:37:45.197369+0000","last_unstale":"2023-07-25T14:37:56.238649+0000","last_undegraded":"2023-07-25T14:37:56.238649+0000","last_fullsized":"2023-07-25T14:37:56.238649+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T21:00:10.932528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-25T14:37:57.230919+0000","last_change":"2023-07-25T14:37:57.230919+0000","last_active":"2023-07-25T14:37:57.230919+0000","last_peered":"2023-07-25T14:37:57.230919+0000","last_clean":"2023-07-25T14:37:57.230919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:57.230919+0000","last_undegraded":"2023-07-25T14:37:57.230919+0000","last_fullsized":"2023-07-25T14:37:57.230919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.236750+0000","last_change":"2023-07-25T14:37:45.204817+0000","last_active":"2023-07-25T14:37:56.236750+0000","last_peered":"2023-07-25T14:37:56.236750+0000","last_clean":"2023-07-25T14:37:56.236750+0000","last_became_active":"2023-07-25T14:37:45.204540+0000","last_became_peered":"2023-07-25T14:37:45.204540+0000","last_unstale":"2023-07-25T14:37:56.236750+0000","last_undegraded":"2023-07-25T14:37:56.236750+0000","last_fullsized":"2023-07-25T14:37:56.236750+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T17:45:44.822234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-25T14:37:57.230919+0000","last_change":"2023-07-25T14:37:57.230919+0000","last_active":"2023-07-25T14:37:57.230919+0000","last_peered":"2023-07-25T14:37:57.230919+0000","last_clean":"2023-07-25T14:37:57.230919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:57.230919+0000","last_undegraded":"2023-07-25T14:37:57.230919+0000","last_fullsized":"2023-07-25T14:37:57.230919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.235387+0000","last_change":"2023-07-25T14:37:45.212379+0000","last_active":"2023-07-25T14:37:56.235387+0000","last_peered":"2023-07-25T14:37:56.235387+0000","last_clean":"2023-07-25T14:37:56.235387+0000","last_became_active":"2023-07-25T14:37:45.210115+0000","last_became_peered":"2023-07-25T14:37:45.210115+0000","last_unstale":"2023-07-25T14:37:56.235387+0000","last_undegraded":"2023-07-25T14:37:56.235387+0000","last_fullsized":"2023-07-25T14:37:56.235387+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T23:42:45.180792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-25T14:37:57.230919+0000","last_change":"2023-07-25T14:37:57.230919+0000","last_active":"2023-07-25T14:37:57.230919+0000","last_peered":"2023-07-25T14:37:57.230919+0000","last_clean":"2023-07-25T14:37:57.230919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:57.230919+0000","last_undegraded":"2023-07-25T14:37:57.230919+0000","last_fullsized":"2023-07-25T14:37:57.230919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.241798+0000","last_change":"2023-07-25T14:37:45.197514+0000","last_active":"2023-07-25T14:37:56.241798+0000","last_peered":"2023-07-25T14:37:56.241798+0000","last_clean":"2023-07-25T14:37:56.241798+0000","last_became_active":"2023-07-25T14:37:45.197076+0000","last_became_peered":"2023-07-25T14:37:45.197076+0000","last_unstale":"2023-07-25T14:37:56.241798+0000","last_undegraded":"2023-07-25T14:37:56.241798+0000","last_fullsized":"2023-07-25T14:37:56.241798+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T01:45:53.297713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-25T14:37:57.230919+0000","last_change":"2023-07-25T14:37:57.230919+0000","last_active":"2023-07-25T14:37:57.230919+0000","last_peered":"2023-07-25T14:37:57.230919+0000","last_clean":"2023-07-25T14:37:57.230919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:57.230919+0000","last_undegraded":"2023-07-25T14:37:57.230919+0000","last_fullsized":"2023-07-25T14:37:57.230919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.235241+0000","last_change":"2023-07-25T14:37:45.199774+0000","last_active":"2023-07-25T14:37:56.235241+0000","last_peered":"2023-07-25T14:37:56.235241+0000","last_clean":"2023-07-25T14:37:56.235241+0000","last_became_active":"2023-07-25T14:37:45.199408+0000","last_became_peered":"2023-07-25T14:37:45.199408+0000","last_unstale":"2023-07-25T14:37:56.235241+0000","last_undegraded":"2023-07-25T14:37:56.235241+0000","last_fullsized":"2023-07-25T14:37:56.235241+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T21:56:21.217589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-25T14:37:57.230919+0000","last_change":"2023-07-25T14:37:57.230919+0000","last_active":"2023-07-25T14:37:57.230919+0000","last_peered":"2023-07-25T14:37:57.230919+0000","last_clean":"2023-07-25T14:37:57.230919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:57.230919+0000","last_undegraded":"2023-07-25T14:37:57.230919+0000","last_fullsized":"2023-07-25T14:37:57.230919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.239129+0000","last_change":"2023-07-25T14:37:45.196344+0000","last_active":"2023-07-25T14:37:56.239129+0000","last_peered":"2023-07-25T14:37:56.239129+0000","last_clean":"2023-07-25T14:37:56.239129+0000","last_became_active":"2023-07-25T14:37:45.196000+0000","last_became_peered":"2023-07-25T14:37:45.196000+0000","last_unstale":"2023-07-25T14:37:56.239129+0000","last_undegraded":"2023-07-25T14:37:56.239129+0000","last_fullsized":"2023-07-25T14:37:56.239129+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T01:13:14.798538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-25T14:37:57.230919+0000","last_change":"2023-07-25T14:37:57.230919+0000","last_active":"2023-07-25T14:37:57.230919+0000","last_peered":"2023-07-25T14:37:57.230919+0000","last_clean":"2023-07-25T14:37:57.230919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:57.230919+0000","last_undegraded":"2023-07-25T14:37:57.230919+0000","last_fullsized":"2023-07-25T14:37:57.230919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.240251+0000","last_change":"2023-07-25T14:37:45.199696+0000","last_active":"2023-07-25T14:37:56.240251+0000","last_peered":"2023-07-25T14:37:56.240251+0000","last_clean":"2023-07-25T14:37:56.240251+0000","last_became_active":"2023-07-25T14:37:45.199345+0000","last_became_peered":"2023-07-25T14:37:45.199345+0000","last_unstale":"2023-07-25T14:37:56.240251+0000","last_undegraded":"2023-07-25T14:37:56.240251+0000","last_fullsized":"2023-07-25T14:37:56.240251+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T16:03:21.851226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-25T14:37:57.230919+0000","last_change":"2023-07-25T14:37:57.230919+0000","last_active":"2023-07-25T14:37:57.230919+0000","last_peered":"2023-07-25T14:37:57.230919+0000","last_clean":"2023-07-25T14:37:57.230919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:57.230919+0000","last_undegraded":"2023-07-25T14:37:57.230919+0000","last_fullsized":"2023-07-25T14:37:57.230919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.242969+0000","last_change":"2023-07-25T14:37:45.206383+0000","last_active":"2023-07-25T14:37:56.242969+0000","last_peered":"2023-07-25T14:37:56.242969+0000","last_clean":"2023-07-25T14:37:56.242969+0000","last_became_active":"2023-07-25T14:37:45.204409+0000","last_became_peered":"2023-07-25T14:37:45.204409+0000","last_unstale":"2023-07-25T14:37:56.242969+0000","last_undegraded":"2023-07-25T14:37:56.242969+0000","last_fullsized":"2023-07-25T14:37:56.242969+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T20:02:34.031523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-25T14:37:57.230919+0000","last_change":"2023-07-25T14:37:57.230919+0000","last_active":"2023-07-25T14:37:57.230919+0000","last_peered":"2023-07-25T14:37:57.230919+0000","last_clean":"2023-07-25T14:37:57.230919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:57.230919+0000","last_undegraded":"2023-07-25T14:37:57.230919+0000","last_fullsized":"2023-07-25T14:37:57.230919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.238726+0000","last_change":"2023-07-25T14:37:45.198072+0000","last_active":"2023-07-25T14:37:56.238726+0000","last_peered":"2023-07-25T14:37:56.238726+0000","last_clean":"2023-07-25T14:37:56.238726+0000","last_became_active":"2023-07-25T14:37:45.197648+0000","last_became_peered":"2023-07-25T14:37:45.197648+0000","last_unstale":"2023-07-25T14:37:56.238726+0000","last_undegraded":"2023-07-25T14:37:56.238726+0000","last_fullsized":"2023-07-25T14:37:56.238726+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T17:43:53.383591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-25T14:37:57.230919+0000","last_change":"2023-07-25T14:37:57.230919+0000","last_active":"2023-07-25T14:37:57.230919+0000","last_peered":"2023-07-25T14:37:57.230919+0000","last_clean":"2023-07-25T14:37:57.230919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:57.230919+0000","last_undegraded":"2023-07-25T14:37:57.230919+0000","last_fullsized":"2023-07-25T14:37:57.230919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.242371+0000","last_change":"2023-07-25T14:37:45.188472+0000","last_active":"2023-07-25T14:37:56.242371+0000","last_peered":"2023-07-25T14:37:56.242371+0000","last_clean":"2023-07-25T14:37:56.242371+0000","last_became_active":"2023-07-25T14:37:45.188105+0000","last_became_peered":"2023-07-25T14:37:45.188105+0000","last_unstale":"2023-07-25T14:37:56.242371+0000","last_undegraded":"2023-07-25T14:37:56.242371+0000","last_fullsized":"2023-07-25T14:37:56.242371+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T02:23:43.183873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-25T14:37:57.230919+0000","last_change":"2023-07-25T14:37:57.230919+0000","last_active":"2023-07-25T14:37:57.230919+0000","last_peered":"2023-07-25T14:37:57.230919+0000","last_clean":"2023-07-25T14:37:57.230919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:57.230919+0000","last_undegraded":"2023-07-25T14:37:57.230919+0000","last_fullsized":"2023-07-25T14:37:57.230919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.237009+0000","last_change":"2023-07-25T14:37:45.191002+0000","last_active":"2023-07-25T14:37:56.237009+0000","last_peered":"2023-07-25T14:37:56.237009+0000","last_clean":"2023-07-25T14:37:56.237009+0000","last_became_active":"2023-07-25T14:37:45.190713+0000","last_became_peered":"2023-07-25T14:37:45.190713+0000","last_unstale":"2023-07-25T14:37:56.237009+0000","last_undegraded":"2023-07-25T14:37:56.237009+0000","last_fullsized":"2023-07-25T14:37:56.237009+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T19:09:13.845620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-25T14:37:57.230919+0000","last_change":"2023-07-25T14:37:57.230919+0000","last_active":"2023-07-25T14:37:57.230919+0000","last_peered":"2023-07-25T14:37:57.230919+0000","last_clean":"2023-07-25T14:37:57.230919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:57.230919+0000","last_undegraded":"2023-07-25T14:37:57.230919+0000","last_fullsized":"2023-07-25T14:37:57.230919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.242126+0000","last_change":"2023-07-25T14:37:45.192719+0000","last_active":"2023-07-25T14:37:56.242126+0000","last_peered":"2023-07-25T14:37:56.242126+0000","last_clean":"2023-07-25T14:37:56.242126+0000","last_became_active":"2023-07-25T14:37:45.192419+0000","last_became_peered":"2023-07-25T14:37:45.192419+0000","last_unstale":"2023-07-25T14:37:56.242126+0000","last_undegraded":"2023-07-25T14:37:56.242126+0000","last_fullsized":"2023-07-25T14:37:56.242126+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T20:57:30.620624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-25T14:37:57.230919+0000","last_change":"2023-07-25T14:37:57.230919+0000","last_active":"2023-07-25T14:37:57.230919+0000","last_peered":"2023-07-25T14:37:57.230919+0000","last_clean":"2023-07-25T14:37:57.230919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:57.230919+0000","last_undegraded":"2023-07-25T14:37:57.230919+0000","last_fullsized":"2023-07-25T14:37:57.230919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.239446+0000","last_change":"2023-07-25T14:37:45.210664+0000","last_active":"2023-07-25T14:37:56.239446+0000","last_peered":"2023-07-25T14:37:56.239446+0000","last_clean":"2023-07-25T14:37:56.239446+0000","last_became_active":"2023-07-25T14:37:45.210376+0000","last_became_peered":"2023-07-25T14:37:45.210376+0000","last_unstale":"2023-07-25T14:37:56.239446+0000","last_undegraded":"2023-07-25T14:37:56.239446+0000","last_fullsized":"2023-07-25T14:37:56.239446+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T21:36:29.587198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-25T14:37:57.230919+0000","last_change":"2023-07-25T14:37:57.230919+0000","last_active":"2023-07-25T14:37:57.230919+0000","last_peered":"2023-07-25T14:37:57.230919+0000","last_clean":"2023-07-25T14:37:57.230919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:57.230919+0000","last_undegraded":"2023-07-25T14:37:57.230919+0000","last_fullsized":"2023-07-25T14:37:57.230919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.239301+0000","last_change":"2023-07-25T14:37:45.191718+0000","last_active":"2023-07-25T14:37:56.239301+0000","last_peered":"2023-07-25T14:37:56.239301+0000","last_clean":"2023-07-25T14:37:56.239301+0000","last_became_active":"2023-07-25T14:37:45.191401+0000","last_became_peered":"2023-07-25T14:37:45.191401+0000","last_unstale":"2023-07-25T14:37:56.239301+0000","last_undegraded":"2023-07-25T14:37:56.239301+0000","last_fullsized":"2023-07-25T14:37:56.239301+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:15:03.390799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-25T14:37:57.230919+0000","last_change":"2023-07-25T14:37:57.230919+0000","last_active":"2023-07-25T14:37:57.230919+0000","last_peered":"2023-07-25T14:37:57.230919+0000","last_clean":"2023-07-25T14:37:57.230919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:57.230919+0000","last_undegraded":"2023-07-25T14:37:57.230919+0000","last_fullsized":"2023-07-25T14:37:57.230919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.239364+0000","last_change":"2023-07-25T14:37:45.197329+0000","last_active":"2023-07-25T14:37:56.239364+0000","last_peered":"2023-07-25T14:37:56.239364+0000","last_clean":"2023-07-25T14:37:56.239364+0000","last_became_active":"2023-07-25T14:37:45.197048+0000","last_became_peered":"2023-07-25T14:37:45.197048+0000","last_unstale":"2023-07-25T14:37:56.239364+0000","last_undegraded":"2023-07-25T14:37:56.239364+0000","last_fullsized":"2023-07-25T14:37:56.239364+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T21:37:28.153205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-25T14:37:57.230919+0000","last_change":"2023-07-25T14:37:57.230919+0000","last_active":"2023-07-25T14:37:57.230919+0000","last_peered":"2023-07-25T14:37:57.230919+0000","last_clean":"2023-07-25T14:37:57.230919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:57.230919+0000","last_undegraded":"2023-07-25T14:37:57.230919+0000","last_fullsized":"2023-07-25T14:37:57.230919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.236278+0000","last_change":"2023-07-25T14:37:45.205950+0000","last_active":"2023-07-25T14:37:56.236278+0000","last_peered":"2023-07-25T14:37:56.236278+0000","last_clean":"2023-07-25T14:37:56.236278+0000","last_became_active":"2023-07-25T14:37:45.199388+0000","last_became_peered":"2023-07-25T14:37:45.199388+0000","last_unstale":"2023-07-25T14:37:56.236278+0000","last_undegraded":"2023-07-25T14:37:56.236278+0000","last_fullsized":"2023-07-25T14:37:56.236278+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T21:01:07.274086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-25T14:37:57.230919+0000","last_change":"2023-07-25T14:37:57.230919+0000","last_active":"2023-07-25T14:37:57.230919+0000","last_peered":"2023-07-25T14:37:57.230919+0000","last_clean":"2023-07-25T14:37:57.230919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:57.230919+0000","last_undegraded":"2023-07-25T14:37:57.230919+0000","last_fullsized":"2023-07-25T14:37:57.230919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.242668+0000","last_change":"2023-07-25T14:37:45.188465+0000","last_active":"2023-07-25T14:37:56.242668+0000","last_peered":"2023-07-25T14:37:56.242668+0000","last_clean":"2023-07-25T14:37:56.242668+0000","last_became_active":"2023-07-25T14:37:45.188186+0000","last_became_peered":"2023-07-25T14:37:45.188186+0000","last_unstale":"2023-07-25T14:37:56.242668+0000","last_undegraded":"2023-07-25T14:37:56.242668+0000","last_fullsized":"2023-07-25T14:37:56.242668+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T15:46:46.392473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-25T14:37:57.230919+0000","last_change":"2023-07-25T14:37:57.230919+0000","last_active":"2023-07-25T14:37:57.230919+0000","last_peered":"2023-07-25T14:37:57.230919+0000","last_clean":"2023-07-25T14:37:57.230919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:57.230919+0000","last_undegraded":"2023-07-25T14:37:57.230919+0000","last_fullsized":"2023-07-25T14:37:57.230919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.240257+0000","last_change":"2023-07-25T14:37:45.201384+0000","last_active":"2023-07-25T14:37:56.240257+0000","last_peered":"2023-07-25T14:37:56.240257+0000","last_clean":"2023-07-25T14:37:56.240257+0000","last_became_active":"2023-07-25T14:37:45.200847+0000","last_became_peered":"2023-07-25T14:37:45.200847+0000","last_unstale":"2023-07-25T14:37:56.240257+0000","last_undegraded":"2023-07-25T14:37:56.240257+0000","last_fullsized":"2023-07-25T14:37:56.240257+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:01:15.664248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-25T14:37:57.230919+0000","last_change":"2023-07-25T14:37:57.230919+0000","last_active":"2023-07-25T14:37:57.230919+0000","last_peered":"2023-07-25T14:37:57.230919+0000","last_clean":"2023-07-25T14:37:57.230919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:57.230919+0000","last_undegraded":"2023-07-25T14:37:57.230919+0000","last_fullsized":"2023-07-25T14:37:57.230919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.241115+0000","last_change":"2023-07-25T14:37:45.201941+0000","last_active":"2023-07-25T14:37:56.241115+0000","last_peered":"2023-07-25T14:37:56.241115+0000","last_clean":"2023-07-25T14:37:56.241115+0000","last_became_active":"2023-07-25T14:37:45.201640+0000","last_became_peered":"2023-07-25T14:37:45.201640+0000","last_unstale":"2023-07-25T14:37:56.241115+0000","last_undegraded":"2023-07-25T14:37:56.241115+0000","last_fullsized":"2023-07-25T14:37:56.241115+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T23:27:34.225061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-25T14:37:57.230919+0000","last_change":"2023-07-25T14:37:57.230919+0000","last_active":"2023-07-25T14:37:57.230919+0000","last_peered":"2023-07-25T14:37:57.230919+0000","last_clean":"2023-07-25T14:37:57.230919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:57.230919+0000","last_undegraded":"2023-07-25T14:37:57.230919+0000","last_fullsized":"2023-07-25T14:37:57.230919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.241029+0000","last_change":"2023-07-25T14:37:45.204317+0000","last_active":"2023-07-25T14:37:56.241029+0000","last_peered":"2023-07-25T14:37:56.241029+0000","last_clean":"2023-07-25T14:37:56.241029+0000","last_became_active":"2023-07-25T14:37:45.203583+0000","last_became_peered":"2023-07-25T14:37:45.203583+0000","last_unstale":"2023-07-25T14:37:56.241029+0000","last_undegraded":"2023-07-25T14:37:56.241029+0000","last_fullsized":"2023-07-25T14:37:56.241029+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T21:36:29.587198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-25T14:37:57.230919+0000","last_change":"2023-07-25T14:37:57.230919+0000","last_active":"2023-07-25T14:37:57.230919+0000","last_peered":"2023-07-25T14:37:57.230919+0000","last_clean":"2023-07-25T14:37:57.230919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:57.230919+0000","last_undegraded":"2023-07-25T14:37:57.230919+0000","last_fullsized":"2023-07-25T14:37:57.230919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.240236+0000","last_change":"2023-07-25T14:37:45.207314+0000","last_active":"2023-07-25T14:37:56.240236+0000","last_peered":"2023-07-25T14:37:56.240236+0000","last_clean":"2023-07-25T14:37:56.240236+0000","last_became_active":"2023-07-25T14:37:45.207030+0000","last_became_peered":"2023-07-25T14:37:45.207030+0000","last_unstale":"2023-07-25T14:37:56.240236+0000","last_undegraded":"2023-07-25T14:37:56.240236+0000","last_fullsized":"2023-07-25T14:37:56.240236+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T18:15:13.886467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-25T14:37:57.230919+0000","last_change":"2023-07-25T14:37:57.230919+0000","last_active":"2023-07-25T14:37:57.230919+0000","last_peered":"2023-07-25T14:37:57.230919+0000","last_clean":"2023-07-25T14:37:57.230919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:57.230919+0000","last_undegraded":"2023-07-25T14:37:57.230919+0000","last_fullsized":"2023-07-25T14:37:57.230919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.238899+0000","last_change":"2023-07-25T14:37:45.210109+0000","last_active":"2023-07-25T14:37:56.238899+0000","last_peered":"2023-07-25T14:37:56.238899+0000","last_clean":"2023-07-25T14:37:56.238899+0000","last_became_active":"2023-07-25T14:37:45.205229+0000","last_became_peered":"2023-07-25T14:37:45.205229+0000","last_unstale":"2023-07-25T14:37:56.238899+0000","last_undegraded":"2023-07-25T14:37:56.238899+0000","last_fullsized":"2023-07-25T14:37:56.238899+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T18:15:13.886467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-25T14:37:57.230919+0000","last_change":"2023-07-25T14:37:57.230919+0000","last_active":"2023-07-25T14:37:57.230919+0000","last_peered":"2023-07-25T14:37:57.230919+0000","last_clean":"2023-07-25T14:37:57.230919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:57.230919+0000","last_undegraded":"2023-07-25T14:37:57.230919+0000","last_fullsized":"2023-07-25T14:37:57.230919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.242267+0000","last_change":"2023-07-25T14:37:45.188464+0000","last_active":"2023-07-25T14:37:56.242267+0000","last_peered":"2023-07-25T14:37:56.242267+0000","last_clean":"2023-07-25T14:37:56.242267+0000","last_became_active":"2023-07-25T14:37:45.188020+0000","last_became_peered":"2023-07-25T14:37:45.188020+0000","last_unstale":"2023-07-25T14:37:56.242267+0000","last_undegraded":"2023-07-25T14:37:56.242267+0000","last_fullsized":"2023-07-25T14:37:56.242267+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T16:59:37.902539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-25T14:37:57.230919+0000","last_change":"2023-07-25T14:37:57.230919+0000","last_active":"2023-07-25T14:37:57.230919+0000","last_peered":"2023-07-25T14:37:57.230919+0000","last_clean":"2023-07-25T14:37:57.230919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:57.230919+0000","last_undegraded":"2023-07-25T14:37:57.230919+0000","last_fullsized":"2023-07-25T14:37:57.230919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.237576+0000","last_change":"2023-07-25T14:37:45.205460+0000","last_active":"2023-07-25T14:37:56.237576+0000","last_peered":"2023-07-25T14:37:56.237576+0000","last_clean":"2023-07-25T14:37:56.237576+0000","last_became_active":"2023-07-25T14:37:45.205174+0000","last_became_peered":"2023-07-25T14:37:45.205174+0000","last_unstale":"2023-07-25T14:37:56.237576+0000","last_undegraded":"2023-07-25T14:37:56.237576+0000","last_fullsized":"2023-07-25T14:37:56.237576+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:52:10.216139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-25T14:37:57.230919+0000","last_change":"2023-07-25T14:37:57.230919+0000","last_active":"2023-07-25T14:37:57.230919+0000","last_peered":"2023-07-25T14:37:57.230919+0000","last_clean":"2023-07-25T14:37:57.230919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:57.230919+0000","last_undegraded":"2023-07-25T14:37:57.230919+0000","last_fullsized":"2023-07-25T14:37:57.230919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.240725+0000","last_change":"2023-07-25T14:37:45.199014+0000","last_active":"2023-07-25T14:37:56.240725+0000","last_peered":"2023-07-25T14:37:56.240725+0000","last_clean":"2023-07-25T14:37:56.240725+0000","last_became_active":"2023-07-25T14:37:45.198610+0000","last_became_peered":"2023-07-25T14:37:45.198610+0000","last_unstale":"2023-07-25T14:37:56.240725+0000","last_undegraded":"2023-07-25T14:37:56.240725+0000","last_fullsized":"2023-07-25T14:37:56.240725+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T18:53:31.784163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-25T14:37:57.230919+0000","last_change":"2023-07-25T14:37:57.230919+0000","last_active":"2023-07-25T14:37:57.230919+0000","last_peered":"2023-07-25T14:37:57.230919+0000","last_clean":"2023-07-25T14:37:57.230919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:57.230919+0000","last_undegraded":"2023-07-25T14:37:57.230919+0000","last_fullsized":"2023-07-25T14:37:57.230919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.237801+0000","last_change":"2023-07-25T14:37:45.190492+0000","last_active":"2023-07-25T14:37:56.237801+0000","last_peered":"2023-07-25T14:37:56.237801+0000","last_clean":"2023-07-25T14:37:56.237801+0000","last_became_active":"2023-07-25T14:37:45.190205+0000","last_became_peered":"2023-07-25T14:37:45.190205+0000","last_unstale":"2023-07-25T14:37:56.237801+0000","last_undegraded":"2023-07-25T14:37:56.237801+0000","last_fullsized":"2023-07-25T14:37:56.237801+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T16:38:19.522810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-25T14:37:57.230919+0000","last_change":"2023-07-25T14:37:57.230919+0000","last_active":"2023-07-25T14:37:57.230919+0000","last_peered":"2023-07-25T14:37:57.230919+0000","last_clean":"2023-07-25T14:37:57.230919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:57.230919+0000","last_undegraded":"2023-07-25T14:37:57.230919+0000","last_fullsized":"2023-07-25T14:37:57.230919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.241947+0000","last_change":"2023-07-25T14:37:45.189887+0000","last_active":"2023-07-25T14:37:56.241947+0000","last_peered":"2023-07-25T14:37:56.241947+0000","last_clean":"2023-07-25T14:37:56.241947+0000","last_became_active":"2023-07-25T14:37:45.189544+0000","last_became_peered":"2023-07-25T14:37:45.189544+0000","last_unstale":"2023-07-25T14:37:56.241947+0000","last_undegraded":"2023-07-25T14:37:56.241947+0000","last_fullsized":"2023-07-25T14:37:56.241947+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T14:57:36.427060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-25T14:37:57.230919+0000","last_change":"2023-07-25T14:37:57.230919+0000","last_active":"2023-07-25T14:37:57.230919+0000","last_peered":"2023-07-25T14:37:57.230919+0000","last_clean":"2023-07-25T14:37:57.230919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:57.230919+0000","last_undegraded":"2023-07-25T14:37:57.230919+0000","last_fullsized":"2023-07-25T14:37:57.230919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.241859+0000","last_change":"2023-07-25T14:37:45.197332+0000","last_active":"2023-07-25T14:37:56.241859+0000","last_peered":"2023-07-25T14:37:56.241859+0000","last_clean":"2023-07-25T14:37:56.241859+0000","last_became_active":"2023-07-25T14:37:45.196749+0000","last_became_peered":"2023-07-25T14:37:45.196749+0000","last_unstale":"2023-07-25T14:37:56.241859+0000","last_undegraded":"2023-07-25T14:37:56.241859+0000","last_fullsized":"2023-07-25T14:37:56.241859+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:22:33.272266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-25T14:37:57.230919+0000","last_change":"2023-07-25T14:37:57.230919+0000","last_active":"2023-07-25T14:37:57.230919+0000","last_peered":"2023-07-25T14:37:57.230919+0000","last_clean":"2023-07-25T14:37:57.230919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:57.230919+0000","last_undegraded":"2023-07-25T14:37:57.230919+0000","last_fullsized":"2023-07-25T14:37:57.230919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.235254+0000","last_change":"2023-07-25T14:37:45.191972+0000","last_active":"2023-07-25T14:37:56.235254+0000","last_peered":"2023-07-25T14:37:56.235254+0000","last_clean":"2023-07-25T14:37:56.235254+0000","last_became_active":"2023-07-25T14:37:45.191704+0000","last_became_peered":"2023-07-25T14:37:45.191704+0000","last_unstale":"2023-07-25T14:37:56.235254+0000","last_undegraded":"2023-07-25T14:37:56.235254+0000","last_fullsized":"2023-07-25T14:37:56.235254+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T21:11:54.570394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-25T14:37:57.230919+0000","last_change":"2023-07-25T14:37:57.230919+0000","last_active":"2023-07-25T14:37:57.230919+0000","last_peered":"2023-07-25T14:37:57.230919+0000","last_clean":"2023-07-25T14:37:57.230919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:57.230919+0000","last_undegraded":"2023-07-25T14:37:57.230919+0000","last_fullsized":"2023-07-25T14:37:57.230919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2023-07-25T14:37:56.240395+0000","last_change":"2023-07-25T14:37:56.240395+0000","last_active":"2023-07-25T14:37:56.225499+0000","last_peered":"2023-07-25T14:37:56.225499+0000","last_clean":"2023-07-25T14:37:56.225499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:56.240395+0000","last_undegraded":"2023-07-25T14:37:56.240395+0000","last_fullsized":"2023-07-25T14:37:56.240395+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_clean_scrub_stamp":"2023-07-25T14:37:56.225499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.241936+0000","last_change":"2023-07-25T14:37:45.213847+0000","last_active":"2023-07-25T14:37:56.241936+0000","last_peered":"2023-07-25T14:37:56.241936+0000","last_clean":"2023-07-25T14:37:56.241936+0000","last_became_active":"2023-07-25T14:37:45.213456+0000","last_became_peered":"2023-07-25T14:37:45.213456+0000","last_unstale":"2023-07-25T14:37:56.241936+0000","last_undegraded":"2023-07-25T14:37:56.241936+0000","last_fullsized":"2023-07-25T14:37:56.241936+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T19:07:32.745444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"56'4","reported_seq":19,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.242852+0000","last_change":"2023-07-25T14:37:44.164114+0000","last_active":"2023-07-25T14:37:56.242852+0000","last_peered":"2023-07-25T14:37:56.242852+0000","last_clean":"2023-07-25T14:37:56.242852+0000","last_became_active":"2023-07-25T14:37:44.163807+0000","last_became_peered":"2023-07-25T14:37:44.163807+0000","last_unstale":"2023-07-25T14:37:56.242852+0000","last_undegraded":"2023-07-25T14:37:56.242852+0000","last_fullsized":"2023-07-25T14:37:56.242852+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T17:17:04.204095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-25T14:37:57.230919+0000","last_change":"2023-07-25T14:37:57.230919+0000","last_active":"2023-07-25T14:37:57.230919+0000","last_peered":"2023-07-25T14:37:57.230919+0000","last_clean":"2023-07-25T14:37:57.230919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:57.230919+0000","last_undegraded":"2023-07-25T14:37:57.230919+0000","last_fullsized":"2023-07-25T14:37:57.230919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2023-07-25T14:37:56.237722+0000","last_change":"2023-07-25T14:37:56.237722+0000","last_active":"2023-07-25T14:37:56.225499+0000","last_peered":"2023-07-25T14:37:56.225499+0000","last_clean":"2023-07-25T14:37:56.225499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:56.237722+0000","last_undegraded":"2023-07-25T14:37:56.237722+0000","last_fullsized":"2023-07-25T14:37:56.237722+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_clean_scrub_stamp":"2023-07-25T14:37:56.225499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.239259+0000","last_change":"2023-07-25T14:37:45.191918+0000","last_active":"2023-07-25T14:37:56.239259+0000","last_peered":"2023-07-25T14:37:56.239259+0000","last_clean":"2023-07-25T14:37:56.239259+0000","last_became_active":"2023-07-25T14:37:45.191341+0000","last_became_peered":"2023-07-25T14:37:45.191341+0000","last_unstale":"2023-07-25T14:37:56.239259+0000","last_undegraded":"2023-07-25T14:37:56.239259+0000","last_fullsized":"2023-07-25T14:37:56.239259+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T16:42:35.382617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"56'1","reported_seq":16,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.242725+0000","last_change":"2023-07-25T14:37:44.174028+0000","last_active":"2023-07-25T14:37:56.242725+0000","last_peered":"2023-07-25T14:37:56.242725+0000","last_clean":"2023-07-25T14:37:56.242725+0000","last_became_active":"2023-07-25T14:37:44.173193+0000","last_became_peered":"2023-07-25T14:37:44.173193+0000","last_unstale":"2023-07-25T14:37:56.242725+0000","last_undegraded":"2023-07-25T14:37:56.242725+0000","last_fullsized":"2023-07-25T14:37:56.242725+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T21:08:18.872035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-25T14:37:57.230919+0000","last_change":"2023-07-25T14:37:57.230919+0000","last_active":"2023-07-25T14:37:57.230919+0000","last_peered":"2023-07-25T14:37:57.230919+0000","last_clean":"2023-07-25T14:37:57.230919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:57.230919+0000","last_undegraded":"2023-07-25T14:37:57.230919+0000","last_fullsized":"2023-07-25T14:37:57.230919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2023-07-25T14:37:56.239988+0000","last_change":"2023-07-25T14:37:56.239988+0000","last_active":"2023-07-25T14:37:56.225499+0000","last_peered":"2023-07-25T14:37:56.225499+0000","last_clean":"2023-07-25T14:37:56.225499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:56.239988+0000","last_undegraded":"2023-07-25T14:37:56.239988+0000","last_fullsized":"2023-07-25T14:37:56.239988+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_clean_scrub_stamp":"2023-07-25T14:37:56.225499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.235574+0000","last_change":"2023-07-25T14:37:45.209338+0000","last_active":"2023-07-25T14:37:56.235574+0000","last_peered":"2023-07-25T14:37:56.235574+0000","last_clean":"2023-07-25T14:37:56.235574+0000","last_became_active":"2023-07-25T14:37:45.207168+0000","last_became_peered":"2023-07-25T14:37:45.207168+0000","last_unstale":"2023-07-25T14:37:56.235574+0000","last_undegraded":"2023-07-25T14:37:56.235574+0000","last_fullsized":"2023-07-25T14:37:56.235574+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T17:43:05.618873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"56'2","reported_seq":17,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.239162+0000","last_change":"2023-07-25T14:37:44.168052+0000","last_active":"2023-07-25T14:37:56.239162+0000","last_peered":"2023-07-25T14:37:56.239162+0000","last_clean":"2023-07-25T14:37:56.239162+0000","last_became_active":"2023-07-25T14:37:44.167768+0000","last_became_peered":"2023-07-25T14:37:44.167768+0000","last_unstale":"2023-07-25T14:37:56.239162+0000","last_undegraded":"2023-07-25T14:37:56.239162+0000","last_fullsized":"2023-07-25T14:37:56.239162+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T17:02:30.931160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-25T14:37:57.230919+0000","last_change":"2023-07-25T14:37:57.230919+0000","last_active":"2023-07-25T14:37:57.230919+0000","last_peered":"2023-07-25T14:37:57.230919+0000","last_clean":"2023-07-25T14:37:57.230919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:57.230919+0000","last_undegraded":"2023-07-25T14:37:57.230919+0000","last_fullsized":"2023-07-25T14:37:57.230919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2023-07-25T14:37:56.240262+0000","last_change":"2023-07-25T14:37:56.240262+0000","last_active":"2023-07-25T14:37:56.225499+0000","last_peered":"2023-07-25T14:37:56.225499+0000","last_clean":"2023-07-25T14:37:56.225499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:56.240262+0000","last_undegraded":"2023-07-25T14:37:56.240262+0000","last_fullsized":"2023-07-25T14:37:56.240262+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_clean_scrub_stamp":"2023-07-25T14:37:56.225499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.241866+0000","last_change":"2023-07-25T14:37:45.204504+0000","last_active":"2023-07-25T14:37:56.241866+0000","last_peered":"2023-07-25T14:37:56.241866+0000","last_clean":"2023-07-25T14:37:56.241866+0000","last_became_active":"2023-07-25T14:37:45.203141+0000","last_became_peered":"2023-07-25T14:37:45.203141+0000","last_unstale":"2023-07-25T14:37:56.241866+0000","last_undegraded":"2023-07-25T14:37:56.241866+0000","last_fullsized":"2023-07-25T14:37:56.241866+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:01:15.664248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"56'2","reported_seq":17,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.235855+0000","last_change":"2023-07-25T14:37:44.167404+0000","last_active":"2023-07-25T14:37:56.235855+0000","last_peered":"2023-07-25T14:37:56.235855+0000","last_clean":"2023-07-25T14:37:56.235855+0000","last_became_active":"2023-07-25T14:37:44.167157+0000","last_became_peered":"2023-07-25T14:37:44.167157+0000","last_unstale":"2023-07-25T14:37:56.235855+0000","last_undegraded":"2023-07-25T14:37:56.235855+0000","last_fullsized":"2023-07-25T14:37:56.235855+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T15:31:28.702869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-25T14:37:57.230919+0000","last_change":"2023-07-25T14:37:57.230919+0000","last_active":"2023-07-25T14:37:57.230919+0000","last_peered":"2023-07-25T14:37:57.230919+0000","last_clean":"2023-07-25T14:37:57.230919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:57.230919+0000","last_undegraded":"2023-07-25T14:37:57.230919+0000","last_fullsized":"2023-07-25T14:37:57.230919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2023-07-25T14:37:56.240853+0000","last_change":"2023-07-25T14:37:56.240853+0000","last_active":"2023-07-25T14:37:56.225499+0000","last_peered":"2023-07-25T14:37:56.225499+0000","last_clean":"2023-07-25T14:37:56.225499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:56.240853+0000","last_undegraded":"2023-07-25T14:37:56.240853+0000","last_fullsized":"2023-07-25T14:37:56.240853+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_clean_scrub_stamp":"2023-07-25T14:37:56.225499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.241986+0000","last_change":"2023-07-25T14:37:45.192672+0000","last_active":"2023-07-25T14:37:56.241986+0000","last_peered":"2023-07-25T14:37:56.241986+0000","last_clean":"2023-07-25T14:37:56.241986+0000","last_became_active":"2023-07-25T14:37:45.192426+0000","last_became_peered":"2023-07-25T14:37:45.192426+0000","last_unstale":"2023-07-25T14:37:56.241986+0000","last_undegraded":"2023-07-25T14:37:56.241986+0000","last_fullsized":"2023-07-25T14:37:56.241986+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T23:33:22.019151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"56'1","reported_seq":16,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.238075+0000","last_change":"2023-07-25T14:37:44.165894+0000","last_active":"2023-07-25T14:37:56.238075+0000","last_peered":"2023-07-25T14:37:56.238075+0000","last_clean":"2023-07-25T14:37:56.238075+0000","last_became_active":"2023-07-25T14:37:44.165121+0000","last_became_peered":"2023-07-25T14:37:44.165121+0000","last_unstale":"2023-07-25T14:37:56.238075+0000","last_undegraded":"2023-07-25T14:37:56.238075+0000","last_fullsized":"2023-07-25T14:37:56.238075+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T02:26:32.270431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-25T14:37:57.230919+0000","last_change":"2023-07-25T14:37:57.230919+0000","last_active":"2023-07-25T14:37:57.230919+0000","last_peered":"2023-07-25T14:37:57.230919+0000","last_clean":"2023-07-25T14:37:57.230919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:57.230919+0000","last_undegraded":"2023-07-25T14:37:57.230919+0000","last_fullsized":"2023-07-25T14:37:57.230919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2023-07-25T14:37:56.240918+0000","last_change":"2023-07-25T14:37:56.240918+0000","last_active":"2023-07-25T14:37:56.225499+0000","last_peered":"2023-07-25T14:37:56.225499+0000","last_clean":"2023-07-25T14:37:56.225499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:56.240918+0000","last_undegraded":"2023-07-25T14:37:56.240918+0000","last_fullsized":"2023-07-25T14:37:56.240918+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_clean_scrub_stamp":"2023-07-25T14:37:56.225499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.240434+0000","last_change":"2023-07-25T14:37:45.204924+0000","last_active":"2023-07-25T14:37:56.240434+0000","last_peered":"2023-07-25T14:37:56.240434+0000","last_clean":"2023-07-25T14:37:56.240434+0000","last_became_active":"2023-07-25T14:37:45.204636+0000","last_became_peered":"2023-07-25T14:37:45.204636+0000","last_unstale":"2023-07-25T14:37:56.240434+0000","last_undegraded":"2023-07-25T14:37:56.240434+0000","last_fullsized":"2023-07-25T14:37:56.240434+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T15:01:23.982072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"56'1","reported_seq":16,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.235502+0000","last_change":"2023-07-25T14:37:44.165997+0000","last_active":"2023-07-25T14:37:56.235502+0000","last_peered":"2023-07-25T14:37:56.235502+0000","last_clean":"2023-07-25T14:37:56.235502+0000","last_became_active":"2023-07-25T14:37:44.165724+0000","last_became_peered":"2023-07-25T14:37:44.165724+0000","last_unstale":"2023-07-25T14:37:56.235502+0000","last_undegraded":"2023-07-25T14:37:56.235502+0000","last_fullsized":"2023-07-25T14:37:56.235502+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T16:55:35.317643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-25T14:37:57.230919+0000","last_change":"2023-07-25T14:37:57.230919+0000","last_active":"2023-07-25T14:37:57.230919+0000","last_peered":"2023-07-25T14:37:57.230919+0000","last_clean":"2023-07-25T14:37:57.230919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:57.230919+0000","last_undegraded":"2023-07-25T14:37:57.230919+0000","last_fullsized":"2023-07-25T14:37:57.230919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2023-07-25T14:37:56.234775+0000","last_change":"2023-07-25T14:37:56.234775+0000","last_active":"2023-07-25T14:37:56.225499+0000","last_peered":"2023-07-25T14:37:56.225499+0000","last_clean":"2023-07-25T14:37:56.225499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:56.234775+0000","last_undegraded":"2023-07-25T14:37:56.234775+0000","last_fullsized":"2023-07-25T14:37:56.234775+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_clean_scrub_stamp":"2023-07-25T14:37:56.225499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.235953+0000","last_change":"2023-07-25T14:37:45.200734+0000","last_active":"2023-07-25T14:37:56.235953+0000","last_peered":"2023-07-25T14:37:56.235953+0000","last_clean":"2023-07-25T14:37:56.235953+0000","last_became_active":"2023-07-25T14:37:45.200452+0000","last_became_peered":"2023-07-25T14:37:45.200452+0000","last_unstale":"2023-07-25T14:37:56.235953+0000","last_undegraded":"2023-07-25T14:37:56.235953+0000","last_fullsized":"2023-07-25T14:37:56.235953+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T15:59:17.536216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.238125+0000","last_change":"2023-07-25T14:37:44.163784+0000","last_active":"2023-07-25T14:37:56.238125+0000","last_peered":"2023-07-25T14:37:56.238125+0000","last_clean":"2023-07-25T14:37:56.238125+0000","last_became_active":"2023-07-25T14:37:44.163566+0000","last_became_peered":"2023-07-25T14:37:44.163566+0000","last_unstale":"2023-07-25T14:37:56.238125+0000","last_undegraded":"2023-07-25T14:37:56.238125+0000","last_fullsized":"2023-07-25T14:37:56.238125+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T15:07:44.972611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-25T14:37:57.230919+0000","last_change":"2023-07-25T14:37:57.230919+0000","last_active":"2023-07-25T14:37:57.230919+0000","last_peered":"2023-07-25T14:37:57.230919+0000","last_clean":"2023-07-25T14:37:57.230919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:57.230919+0000","last_undegraded":"2023-07-25T14:37:57.230919+0000","last_fullsized":"2023-07-25T14:37:57.230919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2023-07-25T14:37:56.239932+0000","last_change":"2023-07-25T14:37:56.239932+0000","last_active":"2023-07-25T14:37:56.225499+0000","last_peered":"2023-07-25T14:37:56.225499+0000","last_clean":"2023-07-25T14:37:56.225499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:56.239932+0000","last_undegraded":"2023-07-25T14:37:56.239932+0000","last_fullsized":"2023-07-25T14:37:56.239932+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_clean_scrub_stamp":"2023-07-25T14:37:56.225499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.242251+0000","last_change":"2023-07-25T14:37:45.205124+0000","last_active":"2023-07-25T14:37:56.242251+0000","last_peered":"2023-07-25T14:37:56.242251+0000","last_clean":"2023-07-25T14:37:56.242251+0000","last_became_active":"2023-07-25T14:37:45.204730+0000","last_became_peered":"2023-07-25T14:37:45.204730+0000","last_unstale":"2023-07-25T14:37:56.242251+0000","last_undegraded":"2023-07-25T14:37:56.242251+0000","last_fullsized":"2023-07-25T14:37:56.242251+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T20:41:03.818352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.236611+0000","last_change":"2023-07-25T14:37:44.171926+0000","last_active":"2023-07-25T14:37:56.236611+0000","last_peered":"2023-07-25T14:37:56.236611+0000","last_clean":"2023-07-25T14:37:56.236611+0000","last_became_active":"2023-07-25T14:37:44.171610+0000","last_became_peered":"2023-07-25T14:37:44.171610+0000","last_unstale":"2023-07-25T14:37:56.236611+0000","last_undegraded":"2023-07-25T14:37:56.236611+0000","last_fullsized":"2023-07-25T14:37:56.236611+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:06:37.927385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-25T14:37:57.230919+0000","last_change":"2023-07-25T14:37:57.230919+0000","last_active":"2023-07-25T14:37:57.230919+0000","last_peered":"2023-07-25T14:37:57.230919+0000","last_clean":"2023-07-25T14:37:57.230919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:57.230919+0000","last_undegraded":"2023-07-25T14:37:57.230919+0000","last_fullsized":"2023-07-25T14:37:57.230919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2023-07-25T14:37:56.238867+0000","last_change":"2023-07-25T14:37:56.238867+0000","last_active":"2023-07-25T14:37:56.225499+0000","last_peered":"2023-07-25T14:37:56.225499+0000","last_clean":"2023-07-25T14:37:56.225499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:56.238867+0000","last_undegraded":"2023-07-25T14:37:56.238867+0000","last_fullsized":"2023-07-25T14:37:56.238867+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_clean_scrub_stamp":"2023-07-25T14:37:56.225499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.242382+0000","last_change":"2023-07-25T14:37:45.208126+0000","last_active":"2023-07-25T14:37:56.242382+0000","last_peered":"2023-07-25T14:37:56.242382+0000","last_clean":"2023-07-25T14:37:56.242382+0000","last_became_active":"2023-07-25T14:37:45.207856+0000","last_became_peered":"2023-07-25T14:37:45.207856+0000","last_unstale":"2023-07-25T14:37:56.242382+0000","last_undegraded":"2023-07-25T14:37:56.242382+0000","last_fullsized":"2023-07-25T14:37:56.242382+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T16:35:40.438338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.241158+0000","last_change":"2023-07-25T14:37:44.164773+0000","last_active":"2023-07-25T14:37:56.241158+0000","last_peered":"2023-07-25T14:37:56.241158+0000","last_clean":"2023-07-25T14:37:56.241158+0000","last_became_active":"2023-07-25T14:37:44.164480+0000","last_became_peered":"2023-07-25T14:37:44.164480+0000","last_unstale":"2023-07-25T14:37:56.241158+0000","last_undegraded":"2023-07-25T14:37:56.241158+0000","last_fullsized":"2023-07-25T14:37:56.241158+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T17:17:04.204095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-25T14:37:57.230919+0000","last_change":"2023-07-25T14:37:57.230919+0000","last_active":"2023-07-25T14:37:57.230919+0000","last_peered":"2023-07-25T14:37:57.230919+0000","last_clean":"2023-07-25T14:37:57.230919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:57.230919+0000","last_undegraded":"2023-07-25T14:37:57.230919+0000","last_fullsized":"2023-07-25T14:37:57.230919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2023-07-25T14:37:56.240388+0000","last_change":"2023-07-25T14:37:56.240388+0000","last_active":"2023-07-25T14:37:56.225499+0000","last_peered":"2023-07-25T14:37:56.225499+0000","last_clean":"2023-07-25T14:37:56.225499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:56.240388+0000","last_undegraded":"2023-07-25T14:37:56.240388+0000","last_fullsized":"2023-07-25T14:37:56.240388+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_clean_scrub_stamp":"2023-07-25T14:37:56.225499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.242712+0000","last_change":"2023-07-25T14:37:45.196449+0000","last_active":"2023-07-25T14:37:56.242712+0000","last_peered":"2023-07-25T14:37:56.242712+0000","last_clean":"2023-07-25T14:37:56.242712+0000","last_became_active":"2023-07-25T14:37:45.196172+0000","last_became_peered":"2023-07-25T14:37:45.196172+0000","last_unstale":"2023-07-25T14:37:56.242712+0000","last_undegraded":"2023-07-25T14:37:56.242712+0000","last_fullsized":"2023-07-25T14:37:56.242712+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T23:27:34.225061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.236341+0000","last_change":"2023-07-25T14:37:44.162751+0000","last_active":"2023-07-25T14:37:56.236341+0000","last_peered":"2023-07-25T14:37:56.236341+0000","last_clean":"2023-07-25T14:37:56.236341+0000","last_became_active":"2023-07-25T14:37:44.162037+0000","last_became_peered":"2023-07-25T14:37:44.162037+0000","last_unstale":"2023-07-25T14:37:56.236341+0000","last_undegraded":"2023-07-25T14:37:56.236341+0000","last_fullsized":"2023-07-25T14:37:56.236341+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T16:48:43.337902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-25T14:37:57.230919+0000","last_change":"2023-07-25T14:37:57.230919+0000","last_active":"2023-07-25T14:37:57.230919+0000","last_peered":"2023-07-25T14:37:57.230919+0000","last_clean":"2023-07-25T14:37:57.230919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:57.230919+0000","last_undegraded":"2023-07-25T14:37:57.230919+0000","last_fullsized":"2023-07-25T14:37:57.230919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2023-07-25T14:37:56.237456+0000","last_change":"2023-07-25T14:37:56.237456+0000","last_active":"2023-07-25T14:37:56.225499+0000","last_peered":"2023-07-25T14:37:56.225499+0000","last_clean":"2023-07-25T14:37:56.225499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:56.237456+0000","last_undegraded":"2023-07-25T14:37:56.237456+0000","last_fullsized":"2023-07-25T14:37:56.237456+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_clean_scrub_stamp":"2023-07-25T14:37:56.225499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.235625+0000","last_change":"2023-07-25T14:37:45.206751+0000","last_active":"2023-07-25T14:37:56.235625+0000","last_peered":"2023-07-25T14:37:56.235625+0000","last_clean":"2023-07-25T14:37:56.235625+0000","last_became_active":"2023-07-25T14:37:45.206422+0000","last_became_peered":"2023-07-25T14:37:45.206422+0000","last_unstale":"2023-07-25T14:37:56.235625+0000","last_undegraded":"2023-07-25T14:37:56.235625+0000","last_fullsized":"2023-07-25T14:37:56.235625+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T20:19:02.577921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"56'3","reported_seq":18,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.237595+0000","last_change":"2023-07-25T14:37:44.161397+0000","last_active":"2023-07-25T14:37:56.237595+0000","last_peered":"2023-07-25T14:37:56.237595+0000","last_clean":"2023-07-25T14:37:56.237595+0000","last_became_active":"2023-07-25T14:37:44.161134+0000","last_became_peered":"2023-07-25T14:37:44.161134+0000","last_unstale":"2023-07-25T14:37:56.237595+0000","last_undegraded":"2023-07-25T14:37:56.237595+0000","last_fullsized":"2023-07-25T14:37:56.237595+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T02:02:52.433473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-25T14:37:57.230919+0000","last_change":"2023-07-25T14:37:57.230919+0000","last_active":"2023-07-25T14:37:57.230919+0000","last_peered":"2023-07-25T14:37:57.230919+0000","last_clean":"2023-07-25T14:37:57.230919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:57.230919+0000","last_undegraded":"2023-07-25T14:37:57.230919+0000","last_fullsized":"2023-07-25T14:37:57.230919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2023-07-25T14:37:56.235761+0000","last_change":"2023-07-25T14:37:56.235761+0000","last_active":"2023-07-25T14:37:56.225499+0000","last_peered":"2023-07-25T14:37:56.225499+0000","last_clean":"2023-07-25T14:37:56.225499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:56.235761+0000","last_undegraded":"2023-07-25T14:37:56.235761+0000","last_fullsized":"2023-07-25T14:37:56.235761+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_clean_scrub_stamp":"2023-07-25T14:37:56.225499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.238822+0000","last_change":"2023-07-25T14:37:45.199815+0000","last_active":"2023-07-25T14:37:56.238822+0000","last_peered":"2023-07-25T14:37:56.238822+0000","last_clean":"2023-07-25T14:37:56.238822+0000","last_became_active":"2023-07-25T14:37:45.199555+0000","last_became_peered":"2023-07-25T14:37:45.199555+0000","last_unstale":"2023-07-25T14:37:56.238822+0000","last_undegraded":"2023-07-25T14:37:56.238822+0000","last_fullsized":"2023-07-25T14:37:56.238822+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T22:21:33.713509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"57'8","reported_seq":23,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.238853+0000","last_change":"2023-07-25T14:37:44.173212+0000","last_active":"2023-07-25T14:37:56.238853+0000","last_peered":"2023-07-25T14:37:56.238853+0000","last_clean":"2023-07-25T14:37:56.238853+0000","last_became_active":"2023-07-25T14:37:44.172950+0000","last_became_peered":"2023-07-25T14:37:44.172950+0000","last_unstale":"2023-07-25T14:37:56.238853+0000","last_undegraded":"2023-07-25T14:37:56.238853+0000","last_fullsized":"2023-07-25T14:37:56.238853+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T02:13:31.491403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3071,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-25T14:37:57.230919+0000","last_change":"2023-07-25T14:37:57.230919+0000","last_active":"2023-07-25T14:37:57.230919+0000","last_peered":"2023-07-25T14:37:57.230919+0000","last_clean":"2023-07-25T14:37:57.230919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:57.230919+0000","last_undegraded":"2023-07-25T14:37:57.230919+0000","last_fullsized":"2023-07-25T14:37:57.230919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2023-07-25T14:37:56.234389+0000","last_change":"2023-07-25T14:37:56.234389+0000","last_active":"2023-07-25T14:37:56.225499+0000","last_peered":"2023-07-25T14:37:56.225499+0000","last_clean":"2023-07-25T14:37:56.225499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:56.234389+0000","last_undegraded":"2023-07-25T14:37:56.234389+0000","last_fullsized":"2023-07-25T14:37:56.234389+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_clean_scrub_stamp":"2023-07-25T14:37:56.225499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.240020+0000","last_change":"2023-07-25T14:37:45.203546+0000","last_active":"2023-07-25T14:37:56.240020+0000","last_peered":"2023-07-25T14:37:56.240020+0000","last_clean":"2023-07-25T14:37:56.240020+0000","last_became_active":"2023-07-25T14:37:45.203115+0000","last_became_peered":"2023-07-25T14:37:45.203115+0000","last_unstale":"2023-07-25T14:37:56.240020+0000","last_undegraded":"2023-07-25T14:37:56.240020+0000","last_fullsized":"2023-07-25T14:37:56.240020+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T14:55:58.159337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"56'2","reported_seq":17,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.238541+0000","last_change":"2023-07-25T14:37:44.164563+0000","last_active":"2023-07-25T14:37:56.238541+0000","last_peered":"2023-07-25T14:37:56.238541+0000","last_clean":"2023-07-25T14:37:56.238541+0000","last_became_active":"2023-07-25T14:37:44.164255+0000","last_became_peered":"2023-07-25T14:37:44.164255+0000","last_unstale":"2023-07-25T14:37:56.238541+0000","last_undegraded":"2023-07-25T14:37:56.238541+0000","last_fullsized":"2023-07-25T14:37:56.238541+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T23:32:21.667103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-25T14:37:57.230919+0000","last_change":"2023-07-25T14:37:57.230919+0000","last_active":"2023-07-25T14:37:57.230919+0000","last_peered":"2023-07-25T14:37:57.230919+0000","last_clean":"2023-07-25T14:37:57.230919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:57.230919+0000","last_undegraded":"2023-07-25T14:37:57.230919+0000","last_fullsized":"2023-07-25T14:37:57.230919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2023-07-25T14:37:56.239470+0000","last_change":"2023-07-25T14:37:56.239470+0000","last_active":"2023-07-25T14:37:56.225499+0000","last_peered":"2023-07-25T14:37:56.225499+0000","last_clean":"2023-07-25T14:37:56.225499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:56.239470+0000","last_undegraded":"2023-07-25T14:37:56.239470+0000","last_fullsized":"2023-07-25T14:37:56.239470+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_clean_scrub_stamp":"2023-07-25T14:37:56.225499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.242146+0000","last_change":"2023-07-25T14:37:45.201081+0000","last_active":"2023-07-25T14:37:56.242146+0000","last_peered":"2023-07-25T14:37:56.242146+0000","last_clean":"2023-07-25T14:37:56.242146+0000","last_became_active":"2023-07-25T14:37:45.200738+0000","last_became_peered":"2023-07-25T14:37:45.200738+0000","last_unstale":"2023-07-25T14:37:56.242146+0000","last_undegraded":"2023-07-25T14:37:56.242146+0000","last_fullsized":"2023-07-25T14:37:56.242146+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T22:46:25.594575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.235589+0000","last_change":"2023-07-25T14:37:44.173296+0000","last_active":"2023-07-25T14:37:56.235589+0000","last_peered":"2023-07-25T14:37:56.235589+0000","last_clean":"2023-07-25T14:37:56.235589+0000","last_became_active":"2023-07-25T14:37:44.172957+0000","last_became_peered":"2023-07-25T14:37:44.172957+0000","last_unstale":"2023-07-25T14:37:56.235589+0000","last_undegraded":"2023-07-25T14:37:56.235589+0000","last_fullsized":"2023-07-25T14:37:56.235589+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T18:19:14.410236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-25T14:37:57.230919+0000","last_change":"2023-07-25T14:37:57.230919+0000","last_active":"2023-07-25T14:37:57.230919+0000","last_peered":"2023-07-25T14:37:57.230919+0000","last_clean":"2023-07-25T14:37:57.230919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:57.230919+0000","last_undegraded":"2023-07-25T14:37:57.230919+0000","last_fullsized":"2023-07-25T14:37:57.230919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2023-07-25T14:37:56.234329+0000","last_change":"2023-07-25T14:37:56.234329+0000","last_active":"2023-07-25T14:37:56.225499+0000","last_peered":"2023-07-25T14:37:56.225499+0000","last_clean":"2023-07-25T14:37:56.225499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:56.234329+0000","last_undegraded":"2023-07-25T14:37:56.234329+0000","last_fullsized":"2023-07-25T14:37:56.234329+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_clean_scrub_stamp":"2023-07-25T14:37:56.225499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.242076+0000","last_change":"2023-07-25T14:37:45.195068+0000","last_active":"2023-07-25T14:37:56.242076+0000","last_peered":"2023-07-25T14:37:56.242076+0000","last_clean":"2023-07-25T14:37:56.242076+0000","last_became_active":"2023-07-25T14:37:45.194820+0000","last_became_peered":"2023-07-25T14:37:45.194820+0000","last_unstale":"2023-07-25T14:37:56.242076+0000","last_undegraded":"2023-07-25T14:37:56.242076+0000","last_fullsized":"2023-07-25T14:37:56.242076+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T17:02:30.222184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.241962+0000","last_change":"2023-07-25T14:37:44.166150+0000","last_active":"2023-07-25T14:37:56.241962+0000","last_peered":"2023-07-25T14:37:56.241962+0000","last_clean":"2023-07-25T14:37:56.241962+0000","last_became_active":"2023-07-25T14:37:44.165851+0000","last_became_peered":"2023-07-25T14:37:44.165851+0000","last_unstale":"2023-07-25T14:37:56.241962+0000","last_undegraded":"2023-07-25T14:37:56.241962+0000","last_fullsized":"2023-07-25T14:37:56.241962+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T15:56:52.490461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-25T14:37:57.230919+0000","last_change":"2023-07-25T14:37:57.230919+0000","last_active":"2023-07-25T14:37:57.230919+0000","last_peered":"2023-07-25T14:37:57.230919+0000","last_clean":"2023-07-25T14:37:57.230919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:57.230919+0000","last_undegraded":"2023-07-25T14:37:57.230919+0000","last_fullsized":"2023-07-25T14:37:57.230919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2023-07-25T14:37:56.233850+0000","last_change":"2023-07-25T14:37:56.233850+0000","last_active":"2023-07-25T14:37:56.225499+0000","last_peered":"2023-07-25T14:37:56.225499+0000","last_clean":"2023-07-25T14:37:56.225499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:56.233850+0000","last_undegraded":"2023-07-25T14:37:56.233850+0000","last_fullsized":"2023-07-25T14:37:56.233850+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_clean_scrub_stamp":"2023-07-25T14:37:56.225499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.236821+0000","last_change":"2023-07-25T14:37:45.193890+0000","last_active":"2023-07-25T14:37:56.236821+0000","last_peered":"2023-07-25T14:37:56.236821+0000","last_clean":"2023-07-25T14:37:56.236821+0000","last_became_active":"2023-07-25T14:37:45.193634+0000","last_became_peered":"2023-07-25T14:37:45.193634+0000","last_unstale":"2023-07-25T14:37:56.236821+0000","last_undegraded":"2023-07-25T14:37:56.236821+0000","last_fullsized":"2023-07-25T14:37:56.236821+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T16:23:52.632199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"56'8","reported_seq":23,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.242948+0000","last_change":"2023-07-25T14:37:44.164996+0000","last_active":"2023-07-25T14:37:56.242948+0000","last_peered":"2023-07-25T14:37:56.242948+0000","last_clean":"2023-07-25T14:37:56.242948+0000","last_became_active":"2023-07-25T14:37:44.164753+0000","last_became_peered":"2023-07-25T14:37:44.164753+0000","last_unstale":"2023-07-25T14:37:56.242948+0000","last_undegraded":"2023-07-25T14:37:56.242948+0000","last_fullsized":"2023-07-25T14:37:56.242948+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T20:02:33.029907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-25T14:37:57.230919+0000","last_change":"2023-07-25T14:37:57.230919+0000","last_active":"2023-07-25T14:37:57.230919+0000","last_peered":"2023-07-25T14:37:57.230919+0000","last_clean":"2023-07-25T14:37:57.230919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:57.230919+0000","last_undegraded":"2023-07-25T14:37:57.230919+0000","last_fullsized":"2023-07-25T14:37:57.230919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2023-07-25T14:37:56.233730+0000","last_change":"2023-07-25T14:37:56.233730+0000","last_active":"2023-07-25T14:37:56.225499+0000","last_peered":"2023-07-25T14:37:56.225499+0000","last_clean":"2023-07-25T14:37:56.225499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:56.233730+0000","last_undegraded":"2023-07-25T14:37:56.233730+0000","last_fullsized":"2023-07-25T14:37:56.233730+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_clean_scrub_stamp":"2023-07-25T14:37:56.225499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.242531+0000","last_change":"2023-07-25T14:37:45.192838+0000","last_active":"2023-07-25T14:37:56.242531+0000","last_peered":"2023-07-25T14:37:56.242531+0000","last_clean":"2023-07-25T14:37:56.242531+0000","last_became_active":"2023-07-25T14:37:45.192552+0000","last_became_peered":"2023-07-25T14:37:45.192552+0000","last_unstale":"2023-07-25T14:37:56.242531+0000","last_undegraded":"2023-07-25T14:37:56.242531+0000","last_fullsized":"2023-07-25T14:37:56.242531+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T01:50:14.013418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"56'2","reported_seq":17,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.236250+0000","last_change":"2023-07-25T14:37:44.163016+0000","last_active":"2023-07-25T14:37:56.236250+0000","last_peered":"2023-07-25T14:37:56.236250+0000","last_clean":"2023-07-25T14:37:56.236250+0000","last_became_active":"2023-07-25T14:37:44.161974+0000","last_became_peered":"2023-07-25T14:37:44.161974+0000","last_unstale":"2023-07-25T14:37:56.236250+0000","last_undegraded":"2023-07-25T14:37:56.236250+0000","last_fullsized":"2023-07-25T14:37:56.236250+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T16:44:38.539954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-25T14:37:57.230919+0000","last_change":"2023-07-25T14:37:57.230919+0000","last_active":"2023-07-25T14:37:57.230919+0000","last_peered":"2023-07-25T14:37:57.230919+0000","last_clean":"2023-07-25T14:37:57.230919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:57.230919+0000","last_undegraded":"2023-07-25T14:37:57.230919+0000","last_fullsized":"2023-07-25T14:37:57.230919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2023-07-25T14:37:56.239090+0000","last_change":"2023-07-25T14:37:56.239090+0000","last_active":"2023-07-25T14:37:56.225499+0000","last_peered":"2023-07-25T14:37:56.225499+0000","last_clean":"2023-07-25T14:37:56.225499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:56.239090+0000","last_undegraded":"2023-07-25T14:37:56.239090+0000","last_fullsized":"2023-07-25T14:37:56.239090+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_clean_scrub_stamp":"2023-07-25T14:37:56.225499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.242222+0000","last_change":"2023-07-25T14:37:45.198281+0000","last_active":"2023-07-25T14:37:56.242222+0000","last_peered":"2023-07-25T14:37:56.242222+0000","last_clean":"2023-07-25T14:37:56.242222+0000","last_became_active":"2023-07-25T14:37:45.197975+0000","last_became_peered":"2023-07-25T14:37:45.197975+0000","last_unstale":"2023-07-25T14:37:56.242222+0000","last_undegraded":"2023-07-25T14:37:56.242222+0000","last_fullsized":"2023-07-25T14:37:56.242222+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T19:23:52.464351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"57'1","reported_seq":16,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.242513+0000","last_change":"2023-07-25T14:37:44.166254+0000","last_active":"2023-07-25T14:37:56.242513+0000","last_peered":"2023-07-25T14:37:56.242513+0000","last_clean":"2023-07-25T14:37:56.242513+0000","last_became_active":"2023-07-25T14:37:44.165974+0000","last_became_peered":"2023-07-25T14:37:44.165974+0000","last_unstale":"2023-07-25T14:37:56.242513+0000","last_undegraded":"2023-07-25T14:37:56.242513+0000","last_fullsized":"2023-07-25T14:37:56.242513+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T23:57:11.656266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-25T14:37:57.230919+0000","last_change":"2023-07-25T14:37:57.230919+0000","last_active":"2023-07-25T14:37:57.230919+0000","last_peered":"2023-07-25T14:37:57.230919+0000","last_clean":"2023-07-25T14:37:57.230919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:57.230919+0000","last_undegraded":"2023-07-25T14:37:57.230919+0000","last_fullsized":"2023-07-25T14:37:57.230919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2023-07-25T14:37:56.241742+0000","last_change":"2023-07-25T14:37:56.241742+0000","last_active":"2023-07-25T14:37:56.225499+0000","last_peered":"2023-07-25T14:37:56.225499+0000","last_clean":"2023-07-25T14:37:56.225499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:56.241742+0000","last_undegraded":"2023-07-25T14:37:56.241742+0000","last_fullsized":"2023-07-25T14:37:56.241742+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_clean_scrub_stamp":"2023-07-25T14:37:56.225499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.241475+0000","last_change":"2023-07-25T14:37:45.209704+0000","last_active":"2023-07-25T14:37:56.241475+0000","last_peered":"2023-07-25T14:37:56.241475+0000","last_clean":"2023-07-25T14:37:56.241475+0000","last_became_active":"2023-07-25T14:37:45.209391+0000","last_became_peered":"2023-07-25T14:37:45.209391+0000","last_unstale":"2023-07-25T14:37:56.241475+0000","last_undegraded":"2023-07-25T14:37:56.241475+0000","last_fullsized":"2023-07-25T14:37:56.241475+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:47:46.269974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.238952+0000","last_change":"2023-07-25T14:37:44.166101+0000","last_active":"2023-07-25T14:37:56.238952+0000","last_peered":"2023-07-25T14:37:56.238952+0000","last_clean":"2023-07-25T14:37:56.238952+0000","last_became_active":"2023-07-25T14:37:44.165823+0000","last_became_peered":"2023-07-25T14:37:44.165823+0000","last_unstale":"2023-07-25T14:37:56.238952+0000","last_undegraded":"2023-07-25T14:37:56.238952+0000","last_fullsized":"2023-07-25T14:37:56.238952+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T19:40:08.768720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-25T14:37:57.230919+0000","last_change":"2023-07-25T14:37:57.230919+0000","last_active":"2023-07-25T14:37:57.230919+0000","last_peered":"2023-07-25T14:37:57.230919+0000","last_clean":"2023-07-25T14:37:57.230919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:57.230919+0000","last_undegraded":"2023-07-25T14:37:57.230919+0000","last_fullsized":"2023-07-25T14:37:57.230919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2023-07-25T14:37:56.239766+0000","last_change":"2023-07-25T14:37:56.239766+0000","last_active":"2023-07-25T14:37:56.225499+0000","last_peered":"2023-07-25T14:37:56.225499+0000","last_clean":"2023-07-25T14:37:56.225499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:56.239766+0000","last_undegraded":"2023-07-25T14:37:56.239766+0000","last_fullsized":"2023-07-25T14:37:56.239766+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_clean_scrub_stamp":"2023-07-25T14:37:56.225499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.241992+0000","last_change":"2023-07-25T14:37:45.207757+0000","last_active":"2023-07-25T14:37:56.241992+0000","last_peered":"2023-07-25T14:37:56.241992+0000","last_clean":"2023-07-25T14:37:56.241992+0000","last_became_active":"2023-07-25T14:37:45.204097+0000","last_became_peered":"2023-07-25T14:37:45.204097+0000","last_unstale":"2023-07-25T14:37:56.241992+0000","last_undegraded":"2023-07-25T14:37:56.241992+0000","last_fullsized":"2023-07-25T14:37:56.241992+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T15:01:23.982072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.242439+0000","last_change":"2023-07-25T14:37:44.170019+0000","last_active":"2023-07-25T14:37:56.242439+0000","last_peered":"2023-07-25T14:37:56.242439+0000","last_clean":"2023-07-25T14:37:56.242439+0000","last_became_active":"2023-07-25T14:37:44.169764+0000","last_became_peered":"2023-07-25T14:37:44.169764+0000","last_unstale":"2023-07-25T14:37:56.242439+0000","last_undegraded":"2023-07-25T14:37:56.242439+0000","last_fullsized":"2023-07-25T14:37:56.242439+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T23:03:53.386487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-25T14:37:57.230919+0000","last_change":"2023-07-25T14:37:57.230919+0000","last_active":"2023-07-25T14:37:57.230919+0000","last_peered":"2023-07-25T14:37:57.230919+0000","last_clean":"2023-07-25T14:37:57.230919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:57.230919+0000","last_undegraded":"2023-07-25T14:37:57.230919+0000","last_fullsized":"2023-07-25T14:37:57.230919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2023-07-25T14:37:56.233790+0000","last_change":"2023-07-25T14:37:56.233790+0000","last_active":"2023-07-25T14:37:56.225499+0000","last_peered":"2023-07-25T14:37:56.225499+0000","last_clean":"2023-07-25T14:37:56.225499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:56.233790+0000","last_undegraded":"2023-07-25T14:37:56.233790+0000","last_fullsized":"2023-07-25T14:37:56.233790+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_clean_scrub_stamp":"2023-07-25T14:37:56.225499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.237171+0000","last_change":"2023-07-25T14:37:45.192706+0000","last_active":"2023-07-25T14:37:56.237171+0000","last_peered":"2023-07-25T14:37:56.237171+0000","last_clean":"2023-07-25T14:37:56.237171+0000","last_became_active":"2023-07-25T14:37:45.191283+0000","last_became_peered":"2023-07-25T14:37:45.191283+0000","last_unstale":"2023-07-25T14:37:56.237171+0000","last_undegraded":"2023-07-25T14:37:56.237171+0000","last_fullsized":"2023-07-25T14:37:56.237171+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T16:47:10.040613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.236854+0000","last_change":"2023-07-25T14:37:44.171694+0000","last_active":"2023-07-25T14:37:56.236854+0000","last_peered":"2023-07-25T14:37:56.236854+0000","last_clean":"2023-07-25T14:37:56.236854+0000","last_became_active":"2023-07-25T14:37:44.171465+0000","last_became_peered":"2023-07-25T14:37:44.171465+0000","last_unstale":"2023-07-25T14:37:56.236854+0000","last_undegraded":"2023-07-25T14:37:56.236854+0000","last_fullsized":"2023-07-25T14:37:56.236854+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T02:37:00.422225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-25T14:37:57.230919+0000","last_change":"2023-07-25T14:37:57.230919+0000","last_active":"2023-07-25T14:37:57.230919+0000","last_peered":"2023-07-25T14:37:57.230919+0000","last_clean":"2023-07-25T14:37:57.230919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:57.230919+0000","last_undegraded":"2023-07-25T14:37:57.230919+0000","last_fullsized":"2023-07-25T14:37:57.230919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2023-07-25T14:37:56.233794+0000","last_change":"2023-07-25T14:37:56.233794+0000","last_active":"2023-07-25T14:37:56.225499+0000","last_peered":"2023-07-25T14:37:56.225499+0000","last_clean":"2023-07-25T14:37:56.225499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:56.233794+0000","last_undegraded":"2023-07-25T14:37:56.233794+0000","last_fullsized":"2023-07-25T14:37:56.233794+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_clean_scrub_stamp":"2023-07-25T14:37:56.225499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.235432+0000","last_change":"2023-07-25T14:37:45.208487+0000","last_active":"2023-07-25T14:37:56.235432+0000","last_peered":"2023-07-25T14:37:56.235432+0000","last_clean":"2023-07-25T14:37:56.235432+0000","last_became_active":"2023-07-25T14:37:45.207037+0000","last_became_peered":"2023-07-25T14:37:45.207037+0000","last_unstale":"2023-07-25T14:37:56.235432+0000","last_undegraded":"2023-07-25T14:37:56.235432+0000","last_fullsized":"2023-07-25T14:37:56.235432+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T19:32:42.982355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.238099+0000","last_change":"2023-07-25T14:37:44.165012+0000","last_active":"2023-07-25T14:37:56.238099+0000","last_peered":"2023-07-25T14:37:56.238099+0000","last_clean":"2023-07-25T14:37:56.238099+0000","last_became_active":"2023-07-25T14:37:44.164759+0000","last_became_peered":"2023-07-25T14:37:44.164759+0000","last_unstale":"2023-07-25T14:37:56.238099+0000","last_undegraded":"2023-07-25T14:37:56.238099+0000","last_fullsized":"2023-07-25T14:37:56.238099+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T15:03:37.728247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-25T14:37:57.230919+0000","last_change":"2023-07-25T14:37:57.230919+0000","last_active":"2023-07-25T14:37:57.230919+0000","last_peered":"2023-07-25T14:37:57.230919+0000","last_clean":"2023-07-25T14:37:57.230919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:57.230919+0000","last_undegraded":"2023-07-25T14:37:57.230919+0000","last_fullsized":"2023-07-25T14:37:57.230919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2023-07-25T14:37:56.237604+0000","last_change":"2023-07-25T14:37:56.237604+0000","last_active":"2023-07-25T14:37:56.225499+0000","last_peered":"2023-07-25T14:37:56.225499+0000","last_clean":"2023-07-25T14:37:56.225499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:56.237604+0000","last_undegraded":"2023-07-25T14:37:56.237604+0000","last_fullsized":"2023-07-25T14:37:56.237604+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_clean_scrub_stamp":"2023-07-25T14:37:56.225499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.238472+0000","last_change":"2023-07-25T14:37:45.191681+0000","last_active":"2023-07-25T14:37:56.238472+0000","last_peered":"2023-07-25T14:37:56.238472+0000","last_clean":"2023-07-25T14:37:56.238472+0000","last_became_active":"2023-07-25T14:37:45.188974+0000","last_became_peered":"2023-07-25T14:37:45.188974+0000","last_unstale":"2023-07-25T14:37:56.238472+0000","last_undegraded":"2023-07-25T14:37:56.238472+0000","last_fullsized":"2023-07-25T14:37:56.238472+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T01:29:49.398716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.238871+0000","last_change":"2023-07-25T14:37:44.164983+0000","last_active":"2023-07-25T14:37:56.238871+0000","last_peered":"2023-07-25T14:37:56.238871+0000","last_clean":"2023-07-25T14:37:56.238871+0000","last_became_active":"2023-07-25T14:37:44.164413+0000","last_became_peered":"2023-07-25T14:37:44.164413+0000","last_unstale":"2023-07-25T14:37:56.238871+0000","last_undegraded":"2023-07-25T14:37:56.238871+0000","last_fullsized":"2023-07-25T14:37:56.238871+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T19:33:45.354123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-25T14:37:57.230919+0000","last_change":"2023-07-25T14:37:57.230919+0000","last_active":"2023-07-25T14:37:57.230919+0000","last_peered":"2023-07-25T14:37:57.230919+0000","last_clean":"2023-07-25T14:37:57.230919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:57.230919+0000","last_undegraded":"2023-07-25T14:37:57.230919+0000","last_fullsized":"2023-07-25T14:37:57.230919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2023-07-25T14:37:56.237505+0000","last_change":"2023-07-25T14:37:56.237505+0000","last_active":"2023-07-25T14:37:56.225499+0000","last_peered":"2023-07-25T14:37:56.225499+0000","last_clean":"2023-07-25T14:37:56.225499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:56.237505+0000","last_undegraded":"2023-07-25T14:37:56.237505+0000","last_fullsized":"2023-07-25T14:37:56.237505+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_clean_scrub_stamp":"2023-07-25T14:37:56.225499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.235269+0000","last_change":"2023-07-25T14:37:45.192970+0000","last_active":"2023-07-25T14:37:56.235269+0000","last_peered":"2023-07-25T14:37:56.235269+0000","last_clean":"2023-07-25T14:37:56.235269+0000","last_became_active":"2023-07-25T14:37:45.192666+0000","last_became_peered":"2023-07-25T14:37:45.192666+0000","last_unstale":"2023-07-25T14:37:56.235269+0000","last_undegraded":"2023-07-25T14:37:56.235269+0000","last_fullsized":"2023-07-25T14:37:56.235269+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T01:13:02.903330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.235440+0000","last_change":"2023-07-25T14:37:44.168526+0000","last_active":"2023-07-25T14:37:56.235440+0000","last_peered":"2023-07-25T14:37:56.235440+0000","last_clean":"2023-07-25T14:37:56.235440+0000","last_became_active":"2023-07-25T14:37:44.168336+0000","last_became_peered":"2023-07-25T14:37:44.168336+0000","last_unstale":"2023-07-25T14:37:56.235440+0000","last_undegraded":"2023-07-25T14:37:56.235440+0000","last_fullsized":"2023-07-25T14:37:56.235440+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:51:48.991901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-25T14:37:57.230919+0000","last_change":"2023-07-25T14:37:57.230919+0000","last_active":"2023-07-25T14:37:57.230919+0000","last_peered":"2023-07-25T14:37:57.230919+0000","last_clean":"2023-07-25T14:37:57.230919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:57.230919+0000","last_undegraded":"2023-07-25T14:37:57.230919+0000","last_fullsized":"2023-07-25T14:37:57.230919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2023-07-25T14:37:56.235599+0000","last_change":"2023-07-25T14:37:56.235599+0000","last_active":"2023-07-25T14:37:56.225499+0000","last_peered":"2023-07-25T14:37:56.225499+0000","last_clean":"2023-07-25T14:37:56.225499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:56.235599+0000","last_undegraded":"2023-07-25T14:37:56.235599+0000","last_fullsized":"2023-07-25T14:37:56.235599+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_clean_scrub_stamp":"2023-07-25T14:37:56.225499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.238911+0000","last_change":"2023-07-25T14:37:45.202784+0000","last_active":"2023-07-25T14:37:56.238911+0000","last_peered":"2023-07-25T14:37:56.238911+0000","last_clean":"2023-07-25T14:37:56.238911+0000","last_became_active":"2023-07-25T14:37:45.202515+0000","last_became_peered":"2023-07-25T14:37:45.202515+0000","last_unstale":"2023-07-25T14:37:56.238911+0000","last_undegraded":"2023-07-25T14:37:56.238911+0000","last_fullsized":"2023-07-25T14:37:56.238911+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T18:18:15.313003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.241632+0000","last_change":"2023-07-25T14:37:44.170162+0000","last_active":"2023-07-25T14:37:56.241632+0000","last_peered":"2023-07-25T14:37:56.241632+0000","last_clean":"2023-07-25T14:37:56.241632+0000","last_became_active":"2023-07-25T14:37:44.169805+0000","last_became_peered":"2023-07-25T14:37:44.169805+0000","last_unstale":"2023-07-25T14:37:56.241632+0000","last_undegraded":"2023-07-25T14:37:56.241632+0000","last_fullsized":"2023-07-25T14:37:56.241632+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T16:03:20.849610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":86,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.236146+0000","last_change":"2023-07-25T14:35:34.370772+0000","last_active":"2023-07-25T14:37:56.236146+0000","last_peered":"2023-07-25T14:37:56.236146+0000","last_clean":"2023-07-25T14:37:56.236146+0000","last_became_active":"2023-07-25T14:35:34.370549+0000","last_became_peered":"2023-07-25T14:35:34.370549+0000","last_unstale":"2023-07-25T14:37:56.236146+0000","last_undegraded":"2023-07-25T14:37:56.236146+0000","last_fullsized":"2023-07-25T14:37:56.236146+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_clean_scrub_stamp":"2023-07-25T14:35:33.358525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T01:59:55.322786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-25T14:37:57.230919+0000","last_change":"2023-07-25T14:37:57.230919+0000","last_active":"2023-07-25T14:37:57.230919+0000","last_peered":"2023-07-25T14:37:57.230919+0000","last_clean":"2023-07-25T14:37:57.230919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:57.230919+0000","last_undegraded":"2023-07-25T14:37:57.230919+0000","last_fullsized":"2023-07-25T14:37:57.230919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2023-07-25T14:37:56.235410+0000","last_change":"2023-07-25T14:37:56.235410+0000","last_active":"2023-07-25T14:37:56.225499+0000","last_peered":"2023-07-25T14:37:56.225499+0000","last_clean":"2023-07-25T14:37:56.225499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:56.235410+0000","last_undegraded":"2023-07-25T14:37:56.235410+0000","last_fullsized":"2023-07-25T14:37:56.235410+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_clean_scrub_stamp":"2023-07-25T14:37:56.225499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.238766+0000","last_change":"2023-07-25T14:37:45.194744+0000","last_active":"2023-07-25T14:37:56.238766+0000","last_peered":"2023-07-25T14:37:56.238766+0000","last_clean":"2023-07-25T14:37:56.238766+0000","last_became_active":"2023-07-25T14:37:45.194393+0000","last_became_peered":"2023-07-25T14:37:45.194393+0000","last_unstale":"2023-07-25T14:37:56.238766+0000","last_undegraded":"2023-07-25T14:37:56.238766+0000","last_fullsized":"2023-07-25T14:37:56.238766+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T01:41:30.373912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"56'1","reported_seq":16,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.236115+0000","last_change":"2023-07-25T14:37:44.166450+0000","last_active":"2023-07-25T14:37:56.236115+0000","last_peered":"2023-07-25T14:37:56.236115+0000","last_clean":"2023-07-25T14:37:56.236115+0000","last_became_active":"2023-07-25T14:37:44.165513+0000","last_became_peered":"2023-07-25T14:37:44.165513+0000","last_unstale":"2023-07-25T14:37:56.236115+0000","last_undegraded":"2023-07-25T14:37:56.236115+0000","last_fullsized":"2023-07-25T14:37:56.236115+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T02:03:11.976899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":86,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.236198+0000","last_change":"2023-07-25T14:35:35.321055+0000","last_active":"2023-07-25T14:37:56.236198+0000","last_peered":"2023-07-25T14:37:56.236198+0000","last_clean":"2023-07-25T14:37:56.236198+0000","last_became_active":"2023-07-25T14:35:35.320739+0000","last_became_peered":"2023-07-25T14:35:35.320739+0000","last_unstale":"2023-07-25T14:37:56.236198+0000","last_undegraded":"2023-07-25T14:37:56.236198+0000","last_fullsized":"2023-07-25T14:37:56.236198+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_clean_scrub_stamp":"2023-07-25T14:35:33.358525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T23:11:47.873574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-25T14:37:57.230919+0000","last_change":"2023-07-25T14:37:57.230919+0000","last_active":"2023-07-25T14:37:57.230919+0000","last_peered":"2023-07-25T14:37:57.230919+0000","last_clean":"2023-07-25T14:37:57.230919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:57.230919+0000","last_undegraded":"2023-07-25T14:37:57.230919+0000","last_fullsized":"2023-07-25T14:37:57.230919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2023-07-25T14:37:56.240548+0000","last_change":"2023-07-25T14:37:56.240548+0000","last_active":"2023-07-25T14:37:56.225499+0000","last_peered":"2023-07-25T14:37:56.225499+0000","last_clean":"2023-07-25T14:37:56.225499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:56.240548+0000","last_undegraded":"2023-07-25T14:37:56.240548+0000","last_fullsized":"2023-07-25T14:37:56.240548+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_clean_scrub_stamp":"2023-07-25T14:37:56.225499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.237936+0000","last_change":"2023-07-25T14:37:45.197932+0000","last_active":"2023-07-25T14:37:56.237936+0000","last_peered":"2023-07-25T14:37:56.237936+0000","last_clean":"2023-07-25T14:37:56.237936+0000","last_became_active":"2023-07-25T14:37:45.197610+0000","last_became_peered":"2023-07-25T14:37:45.197610+0000","last_unstale":"2023-07-25T14:37:56.237936+0000","last_undegraded":"2023-07-25T14:37:56.237936+0000","last_fullsized":"2023-07-25T14:37:56.237936+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T17:21:58.816449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.235698+0000","last_change":"2023-07-25T14:37:44.166137+0000","last_active":"2023-07-25T14:37:56.235698+0000","last_peered":"2023-07-25T14:37:56.235698+0000","last_clean":"2023-07-25T14:37:56.235698+0000","last_became_active":"2023-07-25T14:37:44.165836+0000","last_became_peered":"2023-07-25T14:37:44.165836+0000","last_unstale":"2023-07-25T14:37:56.235698+0000","last_undegraded":"2023-07-25T14:37:56.235698+0000","last_fullsized":"2023-07-25T14:37:56.235698+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T22:13:50.667407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":94,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.242261+0000","last_change":"2023-07-25T14:35:35.321057+0000","last_active":"2023-07-25T14:37:56.242261+0000","last_peered":"2023-07-25T14:37:56.242261+0000","last_clean":"2023-07-25T14:37:56.242261+0000","last_became_active":"2023-07-25T14:35:35.320751+0000","last_became_peered":"2023-07-25T14:35:35.320751+0000","last_unstale":"2023-07-25T14:37:56.242261+0000","last_undegraded":"2023-07-25T14:37:56.242261+0000","last_fullsized":"2023-07-25T14:37:56.242261+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_clean_scrub_stamp":"2023-07-25T14:35:33.358525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T18:48:18.863459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-25T14:37:57.230919+0000","last_change":"2023-07-25T14:37:57.230919+0000","last_active":"2023-07-25T14:37:57.230919+0000","last_peered":"2023-07-25T14:37:57.230919+0000","last_clean":"2023-07-25T14:37:57.230919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:57.230919+0000","last_undegraded":"2023-07-25T14:37:57.230919+0000","last_fullsized":"2023-07-25T14:37:57.230919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2023-07-25T14:37:56.239538+0000","last_change":"2023-07-25T14:37:56.239538+0000","last_active":"2023-07-25T14:37:56.225499+0000","last_peered":"2023-07-25T14:37:56.225499+0000","last_clean":"2023-07-25T14:37:56.225499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:56.239538+0000","last_undegraded":"2023-07-25T14:37:56.239538+0000","last_fullsized":"2023-07-25T14:37:56.239538+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_clean_scrub_stamp":"2023-07-25T14:37:56.225499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.237322+0000","last_change":"2023-07-25T14:37:45.195875+0000","last_active":"2023-07-25T14:37:56.237322+0000","last_peered":"2023-07-25T14:37:56.237322+0000","last_clean":"2023-07-25T14:37:56.237322+0000","last_became_active":"2023-07-25T14:37:45.195516+0000","last_became_peered":"2023-07-25T14:37:45.195516+0000","last_unstale":"2023-07-25T14:37:56.237322+0000","last_undegraded":"2023-07-25T14:37:56.237322+0000","last_fullsized":"2023-07-25T14:37:56.237322+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:37:15.728996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"56'2","reported_seq":17,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.235795+0000","last_change":"2023-07-25T14:37:44.167253+0000","last_active":"2023-07-25T14:37:56.235795+0000","last_peered":"2023-07-25T14:37:56.235795+0000","last_clean":"2023-07-25T14:37:56.235795+0000","last_became_active":"2023-07-25T14:37:44.166775+0000","last_became_peered":"2023-07-25T14:37:44.166775+0000","last_unstale":"2023-07-25T14:37:56.235795+0000","last_undegraded":"2023-07-25T14:37:56.235795+0000","last_fullsized":"2023-07-25T14:37:56.235795+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T15:57:42.466633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":86,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.240370+0000","last_change":"2023-07-25T14:35:35.321201+0000","last_active":"2023-07-25T14:37:56.240370+0000","last_peered":"2023-07-25T14:37:56.240370+0000","last_clean":"2023-07-25T14:37:56.240370+0000","last_became_active":"2023-07-25T14:35:35.320728+0000","last_became_peered":"2023-07-25T14:35:35.320728+0000","last_unstale":"2023-07-25T14:37:56.240370+0000","last_undegraded":"2023-07-25T14:37:56.240370+0000","last_fullsized":"2023-07-25T14:37:56.240370+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_clean_scrub_stamp":"2023-07-25T14:35:33.358525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T17:00:21.146168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-25T14:37:57.230919+0000","last_change":"2023-07-25T14:37:57.230919+0000","last_active":"2023-07-25T14:37:57.230919+0000","last_peered":"2023-07-25T14:37:57.230919+0000","last_clean":"2023-07-25T14:37:57.230919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:57.230919+0000","last_undegraded":"2023-07-25T14:37:57.230919+0000","last_fullsized":"2023-07-25T14:37:57.230919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2023-07-25T14:37:56.233775+0000","last_change":"2023-07-25T14:37:56.233775+0000","last_active":"2023-07-25T14:37:56.225499+0000","last_peered":"2023-07-25T14:37:56.225499+0000","last_clean":"2023-07-25T14:37:56.225499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:56.233775+0000","last_undegraded":"2023-07-25T14:37:56.233775+0000","last_fullsized":"2023-07-25T14:37:56.233775+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_clean_scrub_stamp":"2023-07-25T14:37:56.225499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.237169+0000","last_change":"2023-07-25T14:37:45.209554+0000","last_active":"2023-07-25T14:37:56.237169+0000","last_peered":"2023-07-25T14:37:56.237169+0000","last_clean":"2023-07-25T14:37:56.237169+0000","last_became_active":"2023-07-25T14:37:45.209319+0000","last_became_peered":"2023-07-25T14:37:45.209319+0000","last_unstale":"2023-07-25T14:37:56.237169+0000","last_undegraded":"2023-07-25T14:37:56.237169+0000","last_fullsized":"2023-07-25T14:37:56.237169+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:16:02.561651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.242024+0000","last_change":"2023-07-25T14:37:44.172803+0000","last_active":"2023-07-25T14:37:56.242024+0000","last_peered":"2023-07-25T14:37:56.242024+0000","last_clean":"2023-07-25T14:37:56.242024+0000","last_became_active":"2023-07-25T14:37:44.172512+0000","last_became_peered":"2023-07-25T14:37:44.172512+0000","last_unstale":"2023-07-25T14:37:56.242024+0000","last_undegraded":"2023-07-25T14:37:56.242024+0000","last_fullsized":"2023-07-25T14:37:56.242024+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T19:26:08.957564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":86,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.240143+0000","last_change":"2023-07-25T14:35:35.321448+0000","last_active":"2023-07-25T14:37:56.240143+0000","last_peered":"2023-07-25T14:37:56.240143+0000","last_clean":"2023-07-25T14:37:56.240143+0000","last_became_active":"2023-07-25T14:35:35.320830+0000","last_became_peered":"2023-07-25T14:35:35.320830+0000","last_unstale":"2023-07-25T14:37:56.240143+0000","last_undegraded":"2023-07-25T14:37:56.240143+0000","last_fullsized":"2023-07-25T14:37:56.240143+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_clean_scrub_stamp":"2023-07-25T14:35:33.358525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T19:31:35.569131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-25T14:37:57.230919+0000","last_change":"2023-07-25T14:37:57.230919+0000","last_active":"2023-07-25T14:37:57.230919+0000","last_peered":"2023-07-25T14:37:57.230919+0000","last_clean":"2023-07-25T14:37:57.230919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:57.230919+0000","last_undegraded":"2023-07-25T14:37:57.230919+0000","last_fullsized":"2023-07-25T14:37:57.230919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2023-07-25T14:37:56.241309+0000","last_change":"2023-07-25T14:37:56.241309+0000","last_active":"2023-07-25T14:37:56.225499+0000","last_peered":"2023-07-25T14:37:56.225499+0000","last_clean":"2023-07-25T14:37:56.225499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:56.241309+0000","last_undegraded":"2023-07-25T14:37:56.241309+0000","last_fullsized":"2023-07-25T14:37:56.241309+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_clean_scrub_stamp":"2023-07-25T14:37:56.225499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.236943+0000","last_change":"2023-07-25T14:37:45.207283+0000","last_active":"2023-07-25T14:37:56.236943+0000","last_peered":"2023-07-25T14:37:56.236943+0000","last_clean":"2023-07-25T14:37:56.236943+0000","last_became_active":"2023-07-25T14:37:45.206954+0000","last_became_peered":"2023-07-25T14:37:45.206954+0000","last_unstale":"2023-07-25T14:37:56.236943+0000","last_undegraded":"2023-07-25T14:37:56.236943+0000","last_fullsized":"2023-07-25T14:37:56.236943+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T22:12:27.941354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.242209+0000","last_change":"2023-07-25T14:37:44.172365+0000","last_active":"2023-07-25T14:37:56.242209+0000","last_peered":"2023-07-25T14:37:56.242209+0000","last_clean":"2023-07-25T14:37:56.242209+0000","last_became_active":"2023-07-25T14:37:44.172127+0000","last_became_peered":"2023-07-25T14:37:44.172127+0000","last_unstale":"2023-07-25T14:37:56.242209+0000","last_undegraded":"2023-07-25T14:37:56.242209+0000","last_fullsized":"2023-07-25T14:37:56.242209+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T01:35:45.274384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":236,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.240023+0000","last_change":"2023-07-25T14:35:34.372381+0000","last_active":"2023-07-25T14:37:56.240023+0000","last_peered":"2023-07-25T14:37:56.240023+0000","last_clean":"2023-07-25T14:37:56.240023+0000","last_became_active":"2023-07-25T14:35:34.371110+0000","last_became_peered":"2023-07-25T14:35:34.371110+0000","last_unstale":"2023-07-25T14:37:56.240023+0000","last_undegraded":"2023-07-25T14:37:56.240023+0000","last_fullsized":"2023-07-25T14:37:56.240023+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_clean_scrub_stamp":"2023-07-25T14:35:33.358525+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T01:20:46.377691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":84,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.238545+0000","last_change":"2023-07-25T14:35:34.370121+0000","last_active":"2023-07-25T14:37:56.238545+0000","last_peered":"2023-07-25T14:37:56.238545+0000","last_clean":"2023-07-25T14:37:56.238545+0000","last_became_active":"2023-07-25T14:35:34.369795+0000","last_became_peered":"2023-07-25T14:35:34.369795+0000","last_unstale":"2023-07-25T14:37:56.238545+0000","last_undegraded":"2023-07-25T14:37:56.238545+0000","last_fullsized":"2023-07-25T14:37:56.238545+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_clean_scrub_stamp":"2023-07-25T14:35:33.358525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:27:50.082204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-25T14:37:57.230919+0000","last_change":"2023-07-25T14:37:57.230919+0000","last_active":"2023-07-25T14:37:57.230919+0000","last_peered":"2023-07-25T14:37:57.230919+0000","last_clean":"2023-07-25T14:37:57.230919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:57.230919+0000","last_undegraded":"2023-07-25T14:37:57.230919+0000","last_fullsized":"2023-07-25T14:37:57.230919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2023-07-25T14:37:56.235573+0000","last_change":"2023-07-25T14:37:56.235573+0000","last_active":"2023-07-25T14:37:56.225499+0000","last_peered":"2023-07-25T14:37:56.225499+0000","last_clean":"2023-07-25T14:37:56.225499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:56.235573+0000","last_undegraded":"2023-07-25T14:37:56.235573+0000","last_fullsized":"2023-07-25T14:37:56.235573+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_clean_scrub_stamp":"2023-07-25T14:37:56.225499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.240395+0000","last_change":"2023-07-25T14:37:45.204523+0000","last_active":"2023-07-25T14:37:56.240395+0000","last_peered":"2023-07-25T14:37:56.240395+0000","last_clean":"2023-07-25T14:37:56.240395+0000","last_became_active":"2023-07-25T14:37:45.204095+0000","last_became_peered":"2023-07-25T14:37:45.204095+0000","last_unstale":"2023-07-25T14:37:56.240395+0000","last_undegraded":"2023-07-25T14:37:56.240395+0000","last_fullsized":"2023-07-25T14:37:56.240395+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T19:07:32.745444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"56'1","reported_seq":16,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.236521+0000","last_change":"2023-07-25T14:37:44.164092+0000","last_active":"2023-07-25T14:37:56.236521+0000","last_peered":"2023-07-25T14:37:56.236521+0000","last_clean":"2023-07-25T14:37:56.236521+0000","last_became_active":"2023-07-25T14:37:44.163068+0000","last_became_peered":"2023-07-25T14:37:44.163068+0000","last_unstale":"2023-07-25T14:37:56.236521+0000","last_undegraded":"2023-07-25T14:37:56.236521+0000","last_fullsized":"2023-07-25T14:37:56.236521+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T19:06:16.675638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":86,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.237280+0000","last_change":"2023-07-25T14:35:34.371737+0000","last_active":"2023-07-25T14:37:56.237280+0000","last_peered":"2023-07-25T14:37:56.237280+0000","last_clean":"2023-07-25T14:37:56.237280+0000","last_became_active":"2023-07-25T14:35:34.371411+0000","last_became_peered":"2023-07-25T14:35:34.371411+0000","last_unstale":"2023-07-25T14:37:56.237280+0000","last_undegraded":"2023-07-25T14:37:56.237280+0000","last_fullsized":"2023-07-25T14:37:56.237280+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_clean_scrub_stamp":"2023-07-25T14:35:33.358525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T14:39:57.304690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-25T14:37:57.230919+0000","last_change":"2023-07-25T14:37:57.230919+0000","last_active":"2023-07-25T14:37:57.230919+0000","last_peered":"2023-07-25T14:37:57.230919+0000","last_clean":"2023-07-25T14:37:57.230919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:57.230919+0000","last_undegraded":"2023-07-25T14:37:57.230919+0000","last_fullsized":"2023-07-25T14:37:57.230919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2023-07-25T14:37:56.235675+0000","last_change":"2023-07-25T14:37:56.235675+0000","last_active":"2023-07-25T14:37:56.225499+0000","last_peered":"2023-07-25T14:37:56.225499+0000","last_clean":"2023-07-25T14:37:56.225499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:56.235675+0000","last_undegraded":"2023-07-25T14:37:56.235675+0000","last_fullsized":"2023-07-25T14:37:56.235675+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_clean_scrub_stamp":"2023-07-25T14:37:56.225499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.242702+0000","last_change":"2023-07-25T14:37:45.204043+0000","last_active":"2023-07-25T14:37:56.242702+0000","last_peered":"2023-07-25T14:37:56.242702+0000","last_clean":"2023-07-25T14:37:56.242702+0000","last_became_active":"2023-07-25T14:37:45.203102+0000","last_became_peered":"2023-07-25T14:37:45.203102+0000","last_unstale":"2023-07-25T14:37:56.242702+0000","last_undegraded":"2023-07-25T14:37:56.242702+0000","last_fullsized":"2023-07-25T14:37:56.242702+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T18:53:31.784163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"56'2","reported_seq":17,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.240533+0000","last_change":"2023-07-25T14:37:44.167732+0000","last_active":"2023-07-25T14:37:56.240533+0000","last_peered":"2023-07-25T14:37:56.240533+0000","last_clean":"2023-07-25T14:37:56.240533+0000","last_became_active":"2023-07-25T14:37:44.167418+0000","last_became_peered":"2023-07-25T14:37:44.167418+0000","last_unstale":"2023-07-25T14:37:56.240533+0000","last_undegraded":"2023-07-25T14:37:56.240533+0000","last_fullsized":"2023-07-25T14:37:56.240533+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T18:04:34.335830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":92,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.239714+0000","last_change":"2023-07-25T14:35:34.371347+0000","last_active":"2023-07-25T14:37:56.239714+0000","last_peered":"2023-07-25T14:37:56.239714+0000","last_clean":"2023-07-25T14:37:56.239714+0000","last_became_active":"2023-07-25T14:35:34.371044+0000","last_became_peered":"2023-07-25T14:35:34.371044+0000","last_unstale":"2023-07-25T14:37:56.239714+0000","last_undegraded":"2023-07-25T14:37:56.239714+0000","last_fullsized":"2023-07-25T14:37:56.239714+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_clean_scrub_stamp":"2023-07-25T14:35:33.358525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:45:35.483366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":3869,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64510,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574881,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27768,"kb_used_data":744,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344072,"statfs":{"total":96636764160,"available":96608329728,"internally_reserved":0,"allocated":761856,"data_stored":917810,"data_compressed":32255,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jul 25 14:37:40 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.46999999999999997,"15min":0.46200000000000002},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.84299999999999997,"15min":0.90200000000000002},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.70699999999999996,"5min":9.1600000000000001,"15min":9.1600000000000001},"last":0.36199999999999999}]},{"osd":1,"last update":"Tue Jul 25 14:37:40 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.59299999999999997,"15min":0.60699999999999998},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.82699999999999996,"5min":1.5009999999999999,"15min":1.5009999999999999},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.61099999999999999,"15min":0.61799999999999999},"min":{"1min":0.45600000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.81100000000000005,"5min":1.526,"15min":1.526},"last":0.505}]},{"osd":2,"last update":"Tue Jul 25 14:37:40 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.54500000000000004,"15min":0.55400000000000005},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.71599999999999997,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.82899999999999996,"15min":0.873},"min":{"1min":0.38300000000000001,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.95399999999999996,"5min":8.1739999999999995,"15min":8.1739999999999995},"last":0.39400000000000002}]},{"osd":3,"last update":"Tue Jul 25 14:37:40 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.82499999999999996,"15min":0.875},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.81599999999999995,"5min":7.2279999999999998,"15min":7.2279999999999998},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.89600000000000002,"15min":0.93999999999999995},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.0029999999999999,"5min":7.1870000000000003,"15min":7.1870000000000003},"last":0.46400000000000002}]},{"osd":4,"last update":"Tue Jul 25 14:37:40 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.57999999999999996,"15min":0.57799999999999996},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.76600000000000001,"5min":1.254,"15min":1.254},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.59299999999999997,"15min":0.59599999999999997},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.877,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.58399999999999996}]},{"osd":5,"last update":"Tue Jul 25 14:37:40 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.52600000000000002,"5min":0.501,"15min":0.501},"max":{"1min":0.84699999999999998,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.55300000000000005}]},{"osd":6,"last update":"Tue Jul 25 14:37:40 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.45800000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.88,"5min":1.286,"15min":1.286},"last":0.621},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.64500000000000002,"15min":0.64400000000000002},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.63300000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574880,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27700,"kb_used_data":680,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344140,"statfs":{"total":96636764160,"available":96608399360,"internally_reserved":0,"allocated":696320,"data_stored":326918,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jul 25 14:37:35 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.54200000000000004,"15min":0.54800000000000004},"min":{"1min":0.32300000000000001,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.73199999999999998,"5min":1.9370000000000001,"15min":1.9370000000000001},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.56000000000000005,"15min":0.56599999999999995},"min":{"1min":0.39700000000000002,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.77200000000000002,"5min":2.6779999999999999,"15min":2.6779999999999999},"last":0.45300000000000001}]},{"osd":1,"last update":"Tue Jul 25 14:37:35 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.53500000000000003,"15min":0.54100000000000004},"min":{"1min":0.34599999999999997,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.70799999999999996,"5min":2.5720000000000001,"15min":2.5720000000000001},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.503,"5min":0.54500000000000004,"15min":0.55200000000000005},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.64800000000000002,"5min":1.6259999999999999,"15min":1.6259999999999999},"last":0.38100000000000001}]},{"osd":2,"last update":"Tue Jul 25 14:37:35 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.52700000000000002,"15min":0.52100000000000002},"min":{"1min":0.34399999999999997,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.79000000000000004,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.50600000000000001,"15min":0.501},"min":{"1min":0.375,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.68799999999999994,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.50600000000000001}]},{"osd":3,"last update":"Tue Jul 25 14:37:35 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.64900000000000002,"15min":0.66300000000000003},"min":{"1min":0.38600000000000001,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.73499999999999999,"5min":3.5750000000000002,"15min":3.5750000000000002},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.69899999999999995,"15min":0.71699999999999997},"min":{"1min":0.36499999999999999,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.77400000000000002,"5min":4.7190000000000003,"15min":4.7190000000000003},"last":0.59399999999999997}]},{"osd":4,"last update":"Tue Jul 25 14:37:35 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.65700000000000003,"15min":0.67200000000000004},"min":{"1min":0.39100000000000001,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.79700000000000004,"5min":4.694,"15min":4.694},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.622,"15min":0.628},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.74099999999999999,"5min":2.7839999999999998,"15min":2.7839999999999998},"last":0.496}]},{"osd":5,"last update":"Tue Jul 25 14:37:35 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.54500000000000004,"15min":0.54100000000000004},"min":{"1min":0.36199999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.752,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.624,"15min":0.627},"min":{"1min":0.376,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.82499999999999996,"5min":1.7310000000000001,"15min":1.7310000000000001},"last":0.623}]},{"osd":7,"last update":"Tue Jul 25 14:37:35 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.68799999999999994,"15min":0.69799999999999995},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.81299999999999994,"5min":2.7290000000000001,"15min":2.7290000000000001},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.58999999999999997,"15min":0.58199999999999996},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.60899999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574880,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27772,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344068,"statfs":{"total":96636764160,"available":96608325632,"internally_reserved":0,"allocated":774144,"data_stored":920881,"data_compressed":32255,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jul 25 14:37:39 2023","interfaces":[{"interface":"back","average":{"1min":0.314,"5min":0.318,"15min":0.318},"min":{"1min":0.23999999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.44500000000000001,"5min":0.47099999999999997,"15min":0.47099999999999997},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.312,"5min":0.32800000000000001,"15min":0.33000000000000002},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.44700000000000001,"5min":0.48899999999999999,"15min":0.48899999999999999},"last":0.23300000000000001}]},{"osd":2,"last update":"Tue Jul 25 14:37:39 2023","interfaces":[{"interface":"back","average":{"1min":0.29799999999999999,"5min":0.30599999999999999,"15min":0.308},"min":{"1min":0.20100000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"last":0.27300000000000002},{"interface":"front","average":{"1min":0.35399999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"min":{"1min":0.27200000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.45800000000000002,"5min":0.56499999999999995,"15min":0.56499999999999995},"last":0.38100000000000001}]},{"osd":3,"last update":"Tue Jul 25 14:37:39 2023","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.371,"15min":0.373},"min":{"1min":0.29699999999999999,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.432,"5min":0.52900000000000003,"15min":0.52900000000000003},"last":0.308},{"interface":"front","average":{"1min":0.33000000000000002,"5min":0.34499999999999997,"15min":0.34699999999999998},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.46999999999999997,"5min":0.496,"15min":0.496},"last":0.32400000000000001}]},{"osd":4,"last update":"Tue Jul 25 14:37:39 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.55300000000000005,"15min":0.55100000000000005},"min":{"1min":0.44900000000000001,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.78400000000000003,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.498},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.55400000000000005,"15min":0.55800000000000005},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.65100000000000002,"5min":0.745,"15min":0.745},"last":0.68799999999999994}]},{"osd":5,"last update":"Tue Jul 25 14:37:39 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.56100000000000005,"15min":0.55900000000000005},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.754,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.56399999999999995,"15min":0.56499999999999995},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.64800000000000002}]},{"osd":6,"last update":"Tue Jul 25 14:37:39 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.58099999999999996,"15min":0.58199999999999996},"min":{"1min":0.46000000000000002,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.70399999999999996,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.56899999999999995,"15min":0.57099999999999995},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.54300000000000004}]},{"osd":7,"last update":"Tue Jul 25 14:37:39 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.47699999999999998,"5min":0.443,"15min":0.443},"max":{"1min":0.71799999999999997,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.59599999999999997,"15min":0.59499999999999997},"min":{"1min":0.48399999999999999,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.74199999999999999,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.66100000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574880,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27688,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344152,"statfs":{"total":96636764160,"available":96608411648,"internally_reserved":0,"allocated":684032,"data_stored":325765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Jul 25 14:37:36 2023","interfaces":[{"interface":"back","average":{"1min":0.29899999999999999,"5min":0.35099999999999998,"15min":0.35899999999999999},"min":{"1min":0.17199999999999999,"5min":0.17199999999999999,"15min":0.17199999999999999},"max":{"1min":0.39000000000000001,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.26900000000000002},{"interface":"front","average":{"1min":0.28899999999999998,"5min":0.58899999999999997,"15min":0.63900000000000001},"min":{"1min":0.19600000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.37,"5min":6.5369999999999999,"15min":6.5369999999999999},"last":0.35499999999999998}]},{"osd":2,"last update":"Tue Jul 25 14:37:36 2023","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":0.36399999999999999,"15min":0.37},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.47599999999999998,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.37},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.63,"15min":0.67600000000000005},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.439,"5min":6.5659999999999998,"15min":6.5659999999999998},"last":0.38800000000000001}]},{"osd":3,"last update":"Tue Jul 25 14:37:36 2023","interfaces":[{"interface":"back","average":{"1min":0.33100000000000002,"5min":0.88700000000000001,"15min":0.97899999999999998},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.48799999999999999,"5min":12.449,"15min":12.449},"last":0.29899999999999999},{"interface":"front","average":{"1min":0.36199999999999999,"5min":0.40999999999999998,"15min":0.41799999999999998},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.45100000000000001,"5min":1.079,"15min":1.079},"last":0.32200000000000001}]},{"osd":4,"last update":"Tue Jul 25 14:37:36 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.79300000000000004,"15min":0.83199999999999996},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.71399999999999997,"5min":6.5099999999999998,"15min":6.5099999999999998},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.55600000000000005,"5min":1.0680000000000001,"15min":1.1539999999999999},"min":{"1min":0.35399999999999998,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.66100000000000003,"5min":12.35,"15min":12.35},"last":0.65700000000000003}]},{"osd":5,"last update":"Tue Jul 25 14:37:36 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.58699999999999997,"15min":0.58899999999999997},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.68100000000000005,"5min":1.107,"15min":1.107},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.82599999999999996,"15min":0.872},"min":{"1min":0.39000000000000001,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.76600000000000001,"5min":6.4349999999999996,"15min":6.4349999999999996},"last":0.67000000000000004}]},{"osd":6,"last update":"Tue Jul 25 14:37:36 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":1.0820000000000001,"15min":1.1679999999999999},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.74099999999999999,"5min":12.417,"15min":12.417},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.60799999999999998,"15min":0.61199999999999999},"min":{"1min":0.45000000000000001,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.68999999999999995,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.621}]},{"osd":7,"last update":"Tue Jul 25 14:37:36 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.85799999999999998,"15min":0.90400000000000003},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.67200000000000004,"5min":6.4809999999999999,"15min":6.4809999999999999},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.57799999999999996,"5min":1.091,"15min":1.177},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.77500000000000002,"5min":12.388999999999999,"15min":12.388999999999999},"last":0.60799999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574880,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27696,"kb_used_data":680,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344144,"statfs":{"total":96636764160,"available":96608403456,"internally_reserved":0,"allocated":696320,"data_stored":328836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jul 25 14:37:34 2023","interfaces":[{"interface":"back","average":{"1min":0.311,"5min":0.38200000000000001,"15min":0.39400000000000002},"min":{"1min":0.20399999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.39000000000000001,"5min":2.1030000000000002,"15min":2.1030000000000002},"last":0.22600000000000001},{"interface":"front","average":{"1min":0.27600000000000002,"5min":0.92800000000000005,"15min":1.0369999999999999},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":0.32900000000000001,"5min":16.969000000000001,"15min":16.969000000000001},"last":0.32000000000000001}]},{"osd":1,"last update":"Tue Jul 25 14:37:34 2023","interfaces":[{"interface":"back","average":{"1min":0.33400000000000002,"5min":0.35099999999999998,"15min":0.35399999999999998},"min":{"1min":0.26200000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.41899999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.34300000000000003,"5min":0.379,"15min":0.38500000000000001},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.50800000000000001,"5min":1.111,"15min":1.111},"last":0.251}]},{"osd":3,"last update":"Tue Jul 25 14:37:34 2023","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.79700000000000004,"15min":0.876},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.36799999999999999,"5min":13.035,"15min":13.035},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.376,"5min":0.40300000000000002,"15min":0.40699999999999997},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.61599999999999999,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.35799999999999998}]},{"osd":4,"last update":"Tue Jul 25 14:37:34 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.754,"15min":0.79200000000000004},"min":{"1min":0.39100000000000001,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.73099999999999998,"5min":6.165,"15min":6.165},"last":0.439},{"interface":"front","average":{"1min":0.55900000000000005,"5min":1.0069999999999999,"15min":1.0820000000000001},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.74199999999999999,"5min":13.004,"15min":13.004},"last":0.51300000000000001}]},{"osd":5,"last update":"Tue Jul 25 14:37:34 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.57199999999999995,"15min":0.57299999999999995},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.75800000000000001,"15min":0.79500000000000004},"min":{"1min":0.41299999999999998,"5min":0.378,"15min":0.378},"max":{"1min":0.69499999999999995,"5min":6.226,"15min":6.226},"last":0.46800000000000003}]},{"osd":6,"last update":"Tue Jul 25 14:37:34 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":1.006,"15min":1.0840000000000001},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.77400000000000002,"5min":12.974,"15min":12.974},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.59499999999999997,"15min":0.59699999999999998},"min":{"1min":0.42599999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.77200000000000002,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.501}]},{"osd":7,"last update":"Tue Jul 25 14:37:34 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.77900000000000003,"15min":0.81499999999999995},"min":{"1min":0.40899999999999997,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.70499999999999996,"5min":6.1989999999999998,"15min":6.1989999999999998},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.56699999999999995,"5min":1.026,"15min":1.1020000000000001},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.74199999999999999,"5min":12.936999999999999,"15min":12.936999999999999},"last":0.42899999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574880,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27696,"kb_used_data":676,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344144,"statfs":{"total":96636764160,"available":96608403456,"internally_reserved":0,"allocated":692224,"data_stored":325877,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jul 25 14:37:36 2023","interfaces":[{"interface":"back","average":{"1min":0.29999999999999999,"5min":0.312,"15min":0.314},"min":{"1min":0.20300000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"last":0.307},{"interface":"front","average":{"1min":0.32100000000000001,"5min":0.309,"15min":0.307},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.45400000000000001,"5min":0.46300000000000002,"15min":0.46300000000000002},"last":0.28399999999999997}]},{"osd":1,"last update":"Tue Jul 25 14:37:36 2023","interfaces":[{"interface":"back","average":{"1min":0.315,"5min":0.308,"15min":0.307},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"last":0.29799999999999999},{"interface":"front","average":{"1min":0.34200000000000003,"5min":0.36899999999999999,"15min":0.373},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.496,"5min":0.59099999999999997,"15min":0.59099999999999997},"last":0.35399999999999998}]},{"osd":2,"last update":"Tue Jul 25 14:37:36 2023","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":0.37,"15min":0.374},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.441,"5min":0.502,"15min":0.502},"last":0.26000000000000001},{"interface":"front","average":{"1min":0.35899999999999999,"5min":0.39300000000000002,"15min":0.39900000000000002},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.47299999999999998,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.41299999999999998}]},{"osd":4,"last update":"Tue Jul 25 14:37:36 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.57199999999999995,"15min":0.57399999999999995},"min":{"1min":0.42399999999999999,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.77000000000000002,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58799999999999997,"15min":0.58899999999999997},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.65400000000000003}]},{"osd":5,"last update":"Tue Jul 25 14:37:36 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.70999999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.625,"15min":0.63100000000000001},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.88100000000000001,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.60899999999999999}]},{"osd":6,"last update":"Tue Jul 25 14:37:36 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.61499999999999999,"15min":0.625},"min":{"1min":0.46300000000000002,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.68799999999999994,"5min":0.871,"15min":0.871},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.59399999999999997,"15min":0.59599999999999997},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.68300000000000005}]},{"osd":7,"last update":"Tue Jul 25 14:37:36 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.59099999999999997,"15min":0.58899999999999997},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.83599999999999997,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.628},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.60699999999999998,"15min":0.60899999999999999},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.55700000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574880,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27696,"kb_used_data":676,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344144,"statfs":{"total":96636764160,"available":96608403456,"internally_reserved":0,"allocated":692224,"data_stored":326896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jul 25 14:37:35 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.55500000000000005,"15min":0.56100000000000005},"min":{"1min":0.39600000000000002,"5min":0.31,"15min":0.31},"max":{"1min":0.75700000000000001,"5min":0.876,"15min":0.876},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.51100000000000001,"15min":0.51000000000000001},"min":{"1min":0.371,"5min":0.309,"15min":0.309},"max":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.48299999999999998}]},{"osd":1,"last update":"Tue Jul 25 14:37:35 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.69099999999999995,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.53600000000000003,"15min":0.53200000000000003},"min":{"1min":0.38900000000000001,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.70399999999999996,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.46300000000000002}]},{"osd":2,"last update":"Tue Jul 25 14:37:35 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.55500000000000005,"15min":0.54900000000000004},"min":{"1min":0.435,"5min":0.376,"15min":0.376},"max":{"1min":0.67600000000000005,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.54600000000000004,"15min":0.54200000000000004},"min":{"1min":0.41999999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.60999999999999999}]},{"osd":3,"last update":"Tue Jul 25 14:37:35 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.53600000000000003,"15min":0.53000000000000003},"min":{"1min":0.33000000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.73299999999999998,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.63,"15min":0.63800000000000001},"min":{"1min":0.47299999999999998,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.76100000000000001,"5min":1.8720000000000001,"15min":1.8720000000000001},"last":0.57699999999999996}]},{"osd":5,"last update":"Tue Jul 25 14:37:35 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.49099999999999999,"15min":0.47599999999999998},"min":{"1min":0.36399999999999999,"5min":0.317,"15min":0.317},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.61899999999999999,"15min":0.61599999999999999},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.748,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.58899999999999997}]},{"osd":6,"last update":"Tue Jul 25 14:37:35 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.54900000000000004,"15min":0.54100000000000004},"min":{"1min":0.41299999999999998,"5min":0.372,"15min":0.372},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.59899999999999998,"15min":0.60099999999999998},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.68999999999999995}]},{"osd":7,"last update":"Tue Jul 25 14:37:35 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.623,"15min":0.61899999999999999},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.79500000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.64600000000000002,"15min":0.64000000000000001},"min":{"1min":0.54900000000000004,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.63100000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574880,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27696,"kb_used_data":676,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344144,"statfs":{"total":96636764160,"available":96608403456,"internally_reserved":0,"allocated":692224,"data_stored":326916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jul 25 14:37:32 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.59799999999999998,"15min":0.60599999999999998},"min":{"1min":0.35399999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.83399999999999996,"5min":2.548,"15min":2.548},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.55700000000000005,"15min":0.56000000000000005},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.76500000000000001,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.51800000000000002}]},{"osd":1,"last update":"Tue Jul 25 14:37:32 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.58099999999999996,"15min":0.58499999999999996},"min":{"1min":0.39900000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.753,"5min":1.657,"15min":1.657},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.42599999999999999,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.79700000000000004,"5min":1.752,"15min":1.752},"last":0.56999999999999995}]},{"osd":2,"last update":"Tue Jul 25 14:37:32 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.56499999999999995,"15min":0.56699999999999995},"min":{"1min":0.38800000000000001,"5min":0.372,"15min":0.372},"max":{"1min":0.82899999999999996,"5min":0.872,"15min":0.872},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.54300000000000004,"15min":0.53400000000000003},"min":{"1min":0.46500000000000002,"5min":0.376,"15min":0.376},"max":{"1min":0.751,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.47199999999999998}]},{"osd":3,"last update":"Tue Jul 25 14:37:32 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.56399999999999995,"15min":0.55800000000000005},"min":{"1min":0.39900000000000002,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.504},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.60899999999999999,"15min":0.60499999999999998},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.49199999999999999}]},{"osd":4,"last update":"Tue Jul 25 14:37:32 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.52900000000000003,"15min":0.52700000000000002},"min":{"1min":0.38900000000000001,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.56100000000000005,"15min":0.55900000000000005},"min":{"1min":0.35499999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.55300000000000005}]},{"osd":6,"last update":"Tue Jul 25 14:37:32 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.56299999999999994,"15min":0.55400000000000005},"min":{"1min":0.42499999999999999,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.57099999999999995,"15min":0.56799999999999995},"min":{"1min":0.35999999999999999,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.44500000000000001}]},{"osd":7,"last update":"Tue Jul 25 14:37:32 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.58799999999999997,"15min":0.58199999999999996},"min":{"1min":0.41899999999999998,"5min":0.375,"15min":0.375},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.627,"5min":0.64400000000000002,"15min":0.64700000000000002},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.81399999999999995,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.46100000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32255,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32255,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3071,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-25T14:38:02.364 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-25T14:38:02.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.501+0000 7fc7a13ad700 1 Processor -- start 2023-07-25T14:38:02.512 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.502+0000 7fc7a13ad700 1 -- start start 2023-07-25T14:38:02.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.502+0000 7fc7a13ad700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fc79c1518c0 0x7fc79c06b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:38:02.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.502+0000 7fc7a13ad700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc79c157cd0 con 0x7fc79c0c4370 2023-07-25T14:38:02.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.502+0000 7fc7a13ad700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc79c158870 con 0x7fc79c154df0 2023-07-25T14:38:02.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.502+0000 7fc7a13ad700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc79c0c2310 con 0x7fc79c1518c0 2023-07-25T14:38:02.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.502+0000 7fc79b7fe700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fc79c0c4370 0x7fc79c15ecf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:34924/0 (socket says 172.21.15.72:34924) 2023-07-25T14:38:02.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.502+0000 7fc79b7fe700 1 -- 172.21.15.72:0/1644052797 learned_addr learned my addr 172.21.15.72:0/1644052797 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:38:02.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.503+0000 7fc79affd700 1 --2- 172.21.15.72:0/1644052797 >> v2:172.21.15.92:3300/0 conn(0x7fc79c1518c0 0x7fc79c06b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:38:02.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.503+0000 7fc799ffb700 1 -- 172.21.15.72:0/1644052797 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 227932822 0 0) 0x7fc79c157cd0 con 0x7fc79c0c4370 2023-07-25T14:38:02.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.503+0000 7fc799ffb700 1 -- 172.21.15.72:0/1644052797 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc7880035b0 con 0x7fc79c0c4370 2023-07-25T14:38:02.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.503+0000 7fc79affd700 1 -- 172.21.15.72:0/1644052797 >> v1:172.21.15.92:6789/0 conn(0x7fc79c154df0 legacy=0x7fc79c158160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:38:02.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.503+0000 7fc79affd700 1 -- 172.21.15.72:0/1644052797 >> v1:172.21.15.72:6789/0 conn(0x7fc79c0c4370 legacy=0x7fc79c15ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:38:02.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.503+0000 7fc799ffb700 1 -- 172.21.15.72:0/1644052797 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1187389793 0 0) 0x7fc7880035b0 con 0x7fc79c0c4370 2023-07-25T14:38:02.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.503+0000 7fc79affd700 1 -- 172.21.15.72:0/1644052797 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc79c155280 con 0x7fc79c1518c0 2023-07-25T14:38:02.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.503+0000 7fc79affd700 1 --2- 172.21.15.72:0/1644052797 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc79c1518c0 0x7fc79c06b2a0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fc784009840 tx=0x7fc784009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=32ad6e84e5b0b8ba server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:38:02.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.503+0000 7fc799ffb700 1 -- 172.21.15.72:0/1644052797 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc794001a40 con 0x7fc79c1518c0 2023-07-25T14:38:02.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.503+0000 7fc799ffb700 1 -- 172.21.15.72:0/1644052797 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc784004030 con 0x7fc79c1518c0 2023-07-25T14:38:02.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.503+0000 7fc799ffb700 1 -- 172.21.15.72:0/1644052797 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7840043c0 con 0x7fc79c1518c0 2023-07-25T14:38:02.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.504+0000 7fc7a13ad700 1 -- 172.21.15.72:0/1644052797 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc79c1518c0 msgr2=0x7fc79c06b2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:38:02.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.504+0000 7fc7a13ad700 1 --2- 172.21.15.72:0/1644052797 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc79c1518c0 0x7fc79c06b2a0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fc784009840 tx=0x7fc784009b50 comp rx=0 tx=0).stop 2023-07-25T14:38:02.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.504+0000 7fc7a13ad700 1 -- 172.21.15.72:0/1644052797 shutdown_connections 2023-07-25T14:38:02.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.504+0000 7fc7a13ad700 1 --2- 172.21.15.72:0/1644052797 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc79c1518c0 0x7fc79c06b2a0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:38:02.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.504+0000 7fc7a13ad700 1 -- 172.21.15.72:0/1644052797 >> 172.21.15.72:0/1644052797 conn(0x7fc79c06a8d0 msgr2=0x7fc79c0a94e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:38:02.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.504+0000 7fc7a13ad700 1 -- 172.21.15.72:0/1644052797 shutdown_connections 2023-07-25T14:38:02.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.504+0000 7fc7a13ad700 1 -- 172.21.15.72:0/1644052797 wait complete. 2023-07-25T14:38:02.519 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.505+0000 7fc7a13ad700 1 Processor -- start 2023-07-25T14:38:02.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.505+0000 7fc7a13ad700 1 -- start start 2023-07-25T14:38:02.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.506+0000 7fc7a13ad700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc79c0c4370 0x7fc79c0a7d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:38:02.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.506+0000 7fc7a13ad700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc79c1518c0 0x7fc79c0ac770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:38:02.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.506+0000 7fc7a13ad700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc79c154df0 0x7fc79c1ed2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:38:02.520 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.506+0000 7fc7a13ad700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc79c1eddb0 con 0x7fc79c1518c0 2023-07-25T14:38:02.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.506+0000 7fc7a13ad700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc79c0a6860 con 0x7fc79c154df0 2023-07-25T14:38:02.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.506+0000 7fc7a13ad700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc79c152290 con 0x7fc79c0c4370 2023-07-25T14:38:02.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.506+0000 7fc79a7fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc79c1518c0 0x7fc79c0ac770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:38:02.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.506+0000 7fc79a7fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc79c1518c0 0x7fc79c0ac770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:44192/0 (socket says 172.21.15.72:44192) 2023-07-25T14:38:02.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.506+0000 7fc79a7fc700 1 -- 172.21.15.72:0/4019273158 learned_addr learned my addr 172.21.15.72:0/4019273158 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:38:02.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.506+0000 7fc79affd700 1 --2- 172.21.15.72:0/4019273158 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc79c0c4370 0x7fc79c0a7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:38:02.521 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.506+0000 7fc79b7fe700 1 --2- 172.21.15.72:0/4019273158 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc79c154df0 0x7fc79c1ed2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:38:02.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.506+0000 7fc79a7fc700 1 -- 172.21.15.72:0/4019273158 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc79c0c4370 msgr2=0x7fc79c0a7d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:38:02.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.506+0000 7fc79a7fc700 1 --2- 172.21.15.72:0/4019273158 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc79c0c4370 0x7fc79c0a7d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:38:02.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.506+0000 7fc79a7fc700 1 -- 172.21.15.72:0/4019273158 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc79c154df0 msgr2=0x7fc79c1ed2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:38:02.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.506+0000 7fc79a7fc700 1 --2- 172.21.15.72:0/4019273158 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc79c154df0 0x7fc79c1ed2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:38:02.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.506+0000 7fc79a7fc700 1 -- 172.21.15.72:0/4019273158 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7840094a0 con 0x7fc79c1518c0 2023-07-25T14:38:02.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.506+0000 7fc79affd700 1 --2- 172.21.15.72:0/4019273158 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc79c0c4370 0x7fc79c0a7d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-25T14:38:02.522 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.506+0000 7fc79a7fc700 1 --2- 172.21.15.72:0/4019273158 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc79c1518c0 0x7fc79c0ac770 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7fc78c00c450 tx=0x7fc78c00c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:38:02.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.506+0000 7fc7937fe700 1 -- 172.21.15.72:0/4019273158 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc78c0052d0 con 0x7fc79c1518c0 2023-07-25T14:38:02.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.506+0000 7fc7937fe700 1 -- 172.21.15.72:0/4019273158 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc78c005430 con 0x7fc79c1518c0 2023-07-25T14:38:02.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.506+0000 7fc7937fe700 1 -- 172.21.15.72:0/4019273158 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc78c0038c0 con 0x7fc79c1518c0 2023-07-25T14:38:02.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.507+0000 7fc7a13ad700 1 -- 172.21.15.72:0/4019273158 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc79c0a9ff0 con 0x7fc79c1518c0 2023-07-25T14:38:02.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.507+0000 7fc7a13ad700 1 -- 172.21.15.72:0/4019273158 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc79c0ab0d0 con 0x7fc79c1518c0 2023-07-25T14:38:02.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.507+0000 7fc7a13ad700 1 -- 172.21.15.72:0/4019273158 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc79c1524b0 con 0x7fc79c1518c0 2023-07-25T14:38:02.523 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.508+0000 7fc7937fe700 1 -- 172.21.15.72:0/4019273158 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc78c003a20 con 0x7fc79c1518c0 2023-07-25T14:38:02.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.508+0000 7fc7937fe700 1 --2- 172.21.15.72:0/4019273158 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fc77c06ace0 0x7fc77c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:38:02.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.508+0000 7fc7937fe700 1 -- 172.21.15.72:0/4019273158 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 7238+0+0 (secure 0 0 0) 0x7fc78c088ca0 con 0x7fc79c1518c0 2023-07-25T14:38:02.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.508+0000 7fc79affd700 1 --2- 172.21.15.72:0/4019273158 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fc77c06ace0 0x7fc77c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:38:02.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.509+0000 7fc79affd700 1 --2- 172.21.15.72:0/4019273158 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fc77c06ace0 0x7fc77c06d1a0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fc7840090b0 tx=0x7fc784008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:38:02.524 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.512+0000 7fc7937fe700 1 -- 172.21.15.72:0/4019273158 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fc79c1524b0 con 0x7fc79c1518c0 2023-07-25T14:38:02.704 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.694+0000 7fc7a13ad700 1 -- 172.21.15.72:0/4019273158 --> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc79c0c2800 con 0x7fc77c06ace0 2023-07-25T14:38:02.718 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.707+0000 7fc7937fe700 1 -- 172.21.15.72:0/4019273158 <== mgr.4104 v2:172.21.15.72:6832/1171220306 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+538395 (secure 0 0 0) 0x7fc7840036a0 con 0x7fc77c06ace0 2023-07-25T14:38:02.723 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-25T14:38:02.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.712+0000 7fc7a13ad700 1 -- 172.21.15.72:0/4019273158 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fc77c06ace0 msgr2=0x7fc77c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:38:02.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.712+0000 7fc7a13ad700 1 --2- 172.21.15.72:0/4019273158 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fc77c06ace0 0x7fc77c06d1a0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fc7840090b0 tx=0x7fc784008030 comp rx=0 tx=0).stop 2023-07-25T14:38:02.726 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.712+0000 7fc7a13ad700 1 -- 172.21.15.72:0/4019273158 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc79c1518c0 msgr2=0x7fc79c0ac770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:38:02.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.712+0000 7fc7a13ad700 1 --2- 172.21.15.72:0/4019273158 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc79c1518c0 0x7fc79c0ac770 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7fc78c00c450 tx=0x7fc78c00c810 comp rx=0 tx=0).stop 2023-07-25T14:38:02.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.712+0000 7fc7a13ad700 1 -- 172.21.15.72:0/4019273158 shutdown_connections 2023-07-25T14:38:02.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.712+0000 7fc7a13ad700 1 --2- 172.21.15.72:0/4019273158 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fc77c06ace0 0x7fc77c06d1a0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:38:02.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.712+0000 7fc7a13ad700 1 --2- 172.21.15.72:0/4019273158 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fc79c0c4370 0x7fc79c0a7d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:38:02.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.712+0000 7fc7a13ad700 1 --2- 172.21.15.72:0/4019273158 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc79c154df0 0x7fc79c1ed2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:38:02.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.712+0000 7fc7a13ad700 1 --2- 172.21.15.72:0/4019273158 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fc79c1518c0 0x7fc79c0ac770 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:38:02.727 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.712+0000 7fc7a13ad700 1 -- 172.21.15.72:0/4019273158 >> 172.21.15.72:0/4019273158 conn(0x7fc79c06a8d0 msgr2=0x7fc79c1506d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:38:02.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.712+0000 7fc7a13ad700 1 -- 172.21.15.72:0/4019273158 shutdown_connections 2023-07-25T14:38:02.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.712+0000 7fc7a13ad700 1 -- 172.21.15.72:0/4019273158 wait complete. 2023-07-25T14:38:02.728 INFO:teuthology.orchestra.run.smithi072.stderr:dumped all 2023-07-25T14:38:02.734 INFO:teuthology.orchestra.run.smithi072.stdout:{"pg_ready":true,"pg_map":{"version":129,"stamp":"2023-07-25T14:38:01.314237+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594237,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":206,"num_write_kb":2433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":158,"ondisk_log_size":158,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":215,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":221712,"kb_used_data":5556,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754753008,"statfs":{"total":773094113280,"available":772867080192,"internally_reserved":0,"allocated":5689344,"data_stored":3799899,"data_compressed":64510,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1507,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.083545"},"pg_stats":[{"pgid":"13.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-25T14:37:57.230919+0000","last_change":"2023-07-25T14:37:57.230919+0000","last_active":"2023-07-25T14:37:57.230919+0000","last_peered":"2023-07-25T14:37:57.230919+0000","last_clean":"2023-07-25T14:37:57.230919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:57.230919+0000","last_undegraded":"2023-07-25T14:37:57.230919+0000","last_fullsized":"2023-07-25T14:37:57.230919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3f","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.242052+0000","last_change":"2023-07-25T14:37:45.195851+0000","last_active":"2023-07-25T14:37:56.242052+0000","last_peered":"2023-07-25T14:37:56.242052+0000","last_clean":"2023-07-25T14:37:56.242052+0000","last_became_active":"2023-07-25T14:37:45.195549+0000","last_became_peered":"2023-07-25T14:37:45.195549+0000","last_unstale":"2023-07-25T14:37:56.242052+0000","last_undegraded":"2023-07-25T14:37:56.242052+0000","last_fullsized":"2023-07-25T14:37:56.242052+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T18:04:35.337446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-25T14:37:57.230919+0000","last_change":"2023-07-25T14:37:57.230919+0000","last_active":"2023-07-25T14:37:57.230919+0000","last_peered":"2023-07-25T14:37:57.230919+0000","last_clean":"2023-07-25T14:37:57.230919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:57.230919+0000","last_undegraded":"2023-07-25T14:37:57.230919+0000","last_fullsized":"2023-07-25T14:37:57.230919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.236361+0000","last_change":"2023-07-25T14:37:45.209998+0000","last_active":"2023-07-25T14:37:56.236361+0000","last_peered":"2023-07-25T14:37:56.236361+0000","last_clean":"2023-07-25T14:37:56.236361+0000","last_became_active":"2023-07-25T14:37:45.209538+0000","last_became_peered":"2023-07-25T14:37:45.209538+0000","last_unstale":"2023-07-25T14:37:56.236361+0000","last_undegraded":"2023-07-25T14:37:56.236361+0000","last_fullsized":"2023-07-25T14:37:56.236361+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T01:48:32.892039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-25T14:37:57.230919+0000","last_change":"2023-07-25T14:37:57.230919+0000","last_active":"2023-07-25T14:37:57.230919+0000","last_peered":"2023-07-25T14:37:57.230919+0000","last_clean":"2023-07-25T14:37:57.230919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:57.230919+0000","last_undegraded":"2023-07-25T14:37:57.230919+0000","last_fullsized":"2023-07-25T14:37:57.230919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.237479+0000","last_change":"2023-07-25T14:37:45.186668+0000","last_active":"2023-07-25T14:37:56.237479+0000","last_peered":"2023-07-25T14:37:56.237479+0000","last_clean":"2023-07-25T14:37:56.237479+0000","last_became_active":"2023-07-25T14:37:45.186396+0000","last_became_peered":"2023-07-25T14:37:45.186396+0000","last_unstale":"2023-07-25T14:37:56.237479+0000","last_undegraded":"2023-07-25T14:37:56.237479+0000","last_fullsized":"2023-07-25T14:37:56.237479+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T19:14:48.003695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-25T14:37:57.230919+0000","last_change":"2023-07-25T14:37:57.230919+0000","last_active":"2023-07-25T14:37:57.230919+0000","last_peered":"2023-07-25T14:37:57.230919+0000","last_clean":"2023-07-25T14:37:57.230919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:57.230919+0000","last_undegraded":"2023-07-25T14:37:57.230919+0000","last_fullsized":"2023-07-25T14:37:57.230919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.238649+0000","last_change":"2023-07-25T14:37:45.197894+0000","last_active":"2023-07-25T14:37:56.238649+0000","last_peered":"2023-07-25T14:37:56.238649+0000","last_clean":"2023-07-25T14:37:56.238649+0000","last_became_active":"2023-07-25T14:37:45.197369+0000","last_became_peered":"2023-07-25T14:37:45.197369+0000","last_unstale":"2023-07-25T14:37:56.238649+0000","last_undegraded":"2023-07-25T14:37:56.238649+0000","last_fullsized":"2023-07-25T14:37:56.238649+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T21:00:10.932528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-25T14:37:57.230919+0000","last_change":"2023-07-25T14:37:57.230919+0000","last_active":"2023-07-25T14:37:57.230919+0000","last_peered":"2023-07-25T14:37:57.230919+0000","last_clean":"2023-07-25T14:37:57.230919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:57.230919+0000","last_undegraded":"2023-07-25T14:37:57.230919+0000","last_fullsized":"2023-07-25T14:37:57.230919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.236750+0000","last_change":"2023-07-25T14:37:45.204817+0000","last_active":"2023-07-25T14:37:56.236750+0000","last_peered":"2023-07-25T14:37:56.236750+0000","last_clean":"2023-07-25T14:37:56.236750+0000","last_became_active":"2023-07-25T14:37:45.204540+0000","last_became_peered":"2023-07-25T14:37:45.204540+0000","last_unstale":"2023-07-25T14:37:56.236750+0000","last_undegraded":"2023-07-25T14:37:56.236750+0000","last_fullsized":"2023-07-25T14:37:56.236750+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T17:45:44.822234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-25T14:37:57.230919+0000","last_change":"2023-07-25T14:37:57.230919+0000","last_active":"2023-07-25T14:37:57.230919+0000","last_peered":"2023-07-25T14:37:57.230919+0000","last_clean":"2023-07-25T14:37:57.230919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:57.230919+0000","last_undegraded":"2023-07-25T14:37:57.230919+0000","last_fullsized":"2023-07-25T14:37:57.230919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.235387+0000","last_change":"2023-07-25T14:37:45.212379+0000","last_active":"2023-07-25T14:37:56.235387+0000","last_peered":"2023-07-25T14:37:56.235387+0000","last_clean":"2023-07-25T14:37:56.235387+0000","last_became_active":"2023-07-25T14:37:45.210115+0000","last_became_peered":"2023-07-25T14:37:45.210115+0000","last_unstale":"2023-07-25T14:37:56.235387+0000","last_undegraded":"2023-07-25T14:37:56.235387+0000","last_fullsized":"2023-07-25T14:37:56.235387+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T23:42:45.180792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-25T14:37:57.230919+0000","last_change":"2023-07-25T14:37:57.230919+0000","last_active":"2023-07-25T14:37:57.230919+0000","last_peered":"2023-07-25T14:37:57.230919+0000","last_clean":"2023-07-25T14:37:57.230919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:57.230919+0000","last_undegraded":"2023-07-25T14:37:57.230919+0000","last_fullsized":"2023-07-25T14:37:57.230919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.241798+0000","last_change":"2023-07-25T14:37:45.197514+0000","last_active":"2023-07-25T14:37:56.241798+0000","last_peered":"2023-07-25T14:37:56.241798+0000","last_clean":"2023-07-25T14:37:56.241798+0000","last_became_active":"2023-07-25T14:37:45.197076+0000","last_became_peered":"2023-07-25T14:37:45.197076+0000","last_unstale":"2023-07-25T14:37:56.241798+0000","last_undegraded":"2023-07-25T14:37:56.241798+0000","last_fullsized":"2023-07-25T14:37:56.241798+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T01:45:53.297713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-25T14:37:57.230919+0000","last_change":"2023-07-25T14:37:57.230919+0000","last_active":"2023-07-25T14:37:57.230919+0000","last_peered":"2023-07-25T14:37:57.230919+0000","last_clean":"2023-07-25T14:37:57.230919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:57.230919+0000","last_undegraded":"2023-07-25T14:37:57.230919+0000","last_fullsized":"2023-07-25T14:37:57.230919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.235241+0000","last_change":"2023-07-25T14:37:45.199774+0000","last_active":"2023-07-25T14:37:56.235241+0000","last_peered":"2023-07-25T14:37:56.235241+0000","last_clean":"2023-07-25T14:37:56.235241+0000","last_became_active":"2023-07-25T14:37:45.199408+0000","last_became_peered":"2023-07-25T14:37:45.199408+0000","last_unstale":"2023-07-25T14:37:56.235241+0000","last_undegraded":"2023-07-25T14:37:56.235241+0000","last_fullsized":"2023-07-25T14:37:56.235241+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T21:56:21.217589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-25T14:37:57.230919+0000","last_change":"2023-07-25T14:37:57.230919+0000","last_active":"2023-07-25T14:37:57.230919+0000","last_peered":"2023-07-25T14:37:57.230919+0000","last_clean":"2023-07-25T14:37:57.230919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:57.230919+0000","last_undegraded":"2023-07-25T14:37:57.230919+0000","last_fullsized":"2023-07-25T14:37:57.230919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.239129+0000","last_change":"2023-07-25T14:37:45.196344+0000","last_active":"2023-07-25T14:37:56.239129+0000","last_peered":"2023-07-25T14:37:56.239129+0000","last_clean":"2023-07-25T14:37:56.239129+0000","last_became_active":"2023-07-25T14:37:45.196000+0000","last_became_peered":"2023-07-25T14:37:45.196000+0000","last_unstale":"2023-07-25T14:37:56.239129+0000","last_undegraded":"2023-07-25T14:37:56.239129+0000","last_fullsized":"2023-07-25T14:37:56.239129+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T01:13:14.798538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-25T14:37:57.230919+0000","last_change":"2023-07-25T14:37:57.230919+0000","last_active":"2023-07-25T14:37:57.230919+0000","last_peered":"2023-07-25T14:37:57.230919+0000","last_clean":"2023-07-25T14:37:57.230919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:57.230919+0000","last_undegraded":"2023-07-25T14:37:57.230919+0000","last_fullsized":"2023-07-25T14:37:57.230919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.240251+0000","last_change":"2023-07-25T14:37:45.199696+0000","last_active":"2023-07-25T14:37:56.240251+0000","last_peered":"2023-07-25T14:37:56.240251+0000","last_clean":"2023-07-25T14:37:56.240251+0000","last_became_active":"2023-07-25T14:37:45.199345+0000","last_became_peered":"2023-07-25T14:37:45.199345+0000","last_unstale":"2023-07-25T14:37:56.240251+0000","last_undegraded":"2023-07-25T14:37:56.240251+0000","last_fullsized":"2023-07-25T14:37:56.240251+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T16:03:21.851226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-25T14:37:57.230919+0000","last_change":"2023-07-25T14:37:57.230919+0000","last_active":"2023-07-25T14:37:57.230919+0000","last_peered":"2023-07-25T14:37:57.230919+0000","last_clean":"2023-07-25T14:37:57.230919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:57.230919+0000","last_undegraded":"2023-07-25T14:37:57.230919+0000","last_fullsized":"2023-07-25T14:37:57.230919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.242969+0000","last_change":"2023-07-25T14:37:45.206383+0000","last_active":"2023-07-25T14:37:56.242969+0000","last_peered":"2023-07-25T14:37:56.242969+0000","last_clean":"2023-07-25T14:37:56.242969+0000","last_became_active":"2023-07-25T14:37:45.204409+0000","last_became_peered":"2023-07-25T14:37:45.204409+0000","last_unstale":"2023-07-25T14:37:56.242969+0000","last_undegraded":"2023-07-25T14:37:56.242969+0000","last_fullsized":"2023-07-25T14:37:56.242969+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T20:02:34.031523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-25T14:37:57.230919+0000","last_change":"2023-07-25T14:37:57.230919+0000","last_active":"2023-07-25T14:37:57.230919+0000","last_peered":"2023-07-25T14:37:57.230919+0000","last_clean":"2023-07-25T14:37:57.230919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:57.230919+0000","last_undegraded":"2023-07-25T14:37:57.230919+0000","last_fullsized":"2023-07-25T14:37:57.230919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.238726+0000","last_change":"2023-07-25T14:37:45.198072+0000","last_active":"2023-07-25T14:37:56.238726+0000","last_peered":"2023-07-25T14:37:56.238726+0000","last_clean":"2023-07-25T14:37:56.238726+0000","last_became_active":"2023-07-25T14:37:45.197648+0000","last_became_peered":"2023-07-25T14:37:45.197648+0000","last_unstale":"2023-07-25T14:37:56.238726+0000","last_undegraded":"2023-07-25T14:37:56.238726+0000","last_fullsized":"2023-07-25T14:37:56.238726+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T17:43:53.383591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-25T14:37:57.230919+0000","last_change":"2023-07-25T14:37:57.230919+0000","last_active":"2023-07-25T14:37:57.230919+0000","last_peered":"2023-07-25T14:37:57.230919+0000","last_clean":"2023-07-25T14:37:57.230919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:57.230919+0000","last_undegraded":"2023-07-25T14:37:57.230919+0000","last_fullsized":"2023-07-25T14:37:57.230919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.242371+0000","last_change":"2023-07-25T14:37:45.188472+0000","last_active":"2023-07-25T14:37:56.242371+0000","last_peered":"2023-07-25T14:37:56.242371+0000","last_clean":"2023-07-25T14:37:56.242371+0000","last_became_active":"2023-07-25T14:37:45.188105+0000","last_became_peered":"2023-07-25T14:37:45.188105+0000","last_unstale":"2023-07-25T14:37:56.242371+0000","last_undegraded":"2023-07-25T14:37:56.242371+0000","last_fullsized":"2023-07-25T14:37:56.242371+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T02:23:43.183873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-25T14:37:57.230919+0000","last_change":"2023-07-25T14:37:57.230919+0000","last_active":"2023-07-25T14:37:57.230919+0000","last_peered":"2023-07-25T14:37:57.230919+0000","last_clean":"2023-07-25T14:37:57.230919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:57.230919+0000","last_undegraded":"2023-07-25T14:37:57.230919+0000","last_fullsized":"2023-07-25T14:37:57.230919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.237009+0000","last_change":"2023-07-25T14:37:45.191002+0000","last_active":"2023-07-25T14:37:56.237009+0000","last_peered":"2023-07-25T14:37:56.237009+0000","last_clean":"2023-07-25T14:37:56.237009+0000","last_became_active":"2023-07-25T14:37:45.190713+0000","last_became_peered":"2023-07-25T14:37:45.190713+0000","last_unstale":"2023-07-25T14:37:56.237009+0000","last_undegraded":"2023-07-25T14:37:56.237009+0000","last_fullsized":"2023-07-25T14:37:56.237009+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T19:09:13.845620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-25T14:37:57.230919+0000","last_change":"2023-07-25T14:37:57.230919+0000","last_active":"2023-07-25T14:37:57.230919+0000","last_peered":"2023-07-25T14:37:57.230919+0000","last_clean":"2023-07-25T14:37:57.230919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:57.230919+0000","last_undegraded":"2023-07-25T14:37:57.230919+0000","last_fullsized":"2023-07-25T14:37:57.230919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.242126+0000","last_change":"2023-07-25T14:37:45.192719+0000","last_active":"2023-07-25T14:37:56.242126+0000","last_peered":"2023-07-25T14:37:56.242126+0000","last_clean":"2023-07-25T14:37:56.242126+0000","last_became_active":"2023-07-25T14:37:45.192419+0000","last_became_peered":"2023-07-25T14:37:45.192419+0000","last_unstale":"2023-07-25T14:37:56.242126+0000","last_undegraded":"2023-07-25T14:37:56.242126+0000","last_fullsized":"2023-07-25T14:37:56.242126+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T20:57:30.620624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-25T14:37:57.230919+0000","last_change":"2023-07-25T14:37:57.230919+0000","last_active":"2023-07-25T14:37:57.230919+0000","last_peered":"2023-07-25T14:37:57.230919+0000","last_clean":"2023-07-25T14:37:57.230919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:57.230919+0000","last_undegraded":"2023-07-25T14:37:57.230919+0000","last_fullsized":"2023-07-25T14:37:57.230919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.239446+0000","last_change":"2023-07-25T14:37:45.210664+0000","last_active":"2023-07-25T14:37:56.239446+0000","last_peered":"2023-07-25T14:37:56.239446+0000","last_clean":"2023-07-25T14:37:56.239446+0000","last_became_active":"2023-07-25T14:37:45.210376+0000","last_became_peered":"2023-07-25T14:37:45.210376+0000","last_unstale":"2023-07-25T14:37:56.239446+0000","last_undegraded":"2023-07-25T14:37:56.239446+0000","last_fullsized":"2023-07-25T14:37:56.239446+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T21:36:29.587198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-25T14:37:57.230919+0000","last_change":"2023-07-25T14:37:57.230919+0000","last_active":"2023-07-25T14:37:57.230919+0000","last_peered":"2023-07-25T14:37:57.230919+0000","last_clean":"2023-07-25T14:37:57.230919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:57.230919+0000","last_undegraded":"2023-07-25T14:37:57.230919+0000","last_fullsized":"2023-07-25T14:37:57.230919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.239301+0000","last_change":"2023-07-25T14:37:45.191718+0000","last_active":"2023-07-25T14:37:56.239301+0000","last_peered":"2023-07-25T14:37:56.239301+0000","last_clean":"2023-07-25T14:37:56.239301+0000","last_became_active":"2023-07-25T14:37:45.191401+0000","last_became_peered":"2023-07-25T14:37:45.191401+0000","last_unstale":"2023-07-25T14:37:56.239301+0000","last_undegraded":"2023-07-25T14:37:56.239301+0000","last_fullsized":"2023-07-25T14:37:56.239301+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:15:03.390799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-25T14:37:57.230919+0000","last_change":"2023-07-25T14:37:57.230919+0000","last_active":"2023-07-25T14:37:57.230919+0000","last_peered":"2023-07-25T14:37:57.230919+0000","last_clean":"2023-07-25T14:37:57.230919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:57.230919+0000","last_undegraded":"2023-07-25T14:37:57.230919+0000","last_fullsized":"2023-07-25T14:37:57.230919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.239364+0000","last_change":"2023-07-25T14:37:45.197329+0000","last_active":"2023-07-25T14:37:56.239364+0000","last_peered":"2023-07-25T14:37:56.239364+0000","last_clean":"2023-07-25T14:37:56.239364+0000","last_became_active":"2023-07-25T14:37:45.197048+0000","last_became_peered":"2023-07-25T14:37:45.197048+0000","last_unstale":"2023-07-25T14:37:56.239364+0000","last_undegraded":"2023-07-25T14:37:56.239364+0000","last_fullsized":"2023-07-25T14:37:56.239364+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T21:37:28.153205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-25T14:37:57.230919+0000","last_change":"2023-07-25T14:37:57.230919+0000","last_active":"2023-07-25T14:37:57.230919+0000","last_peered":"2023-07-25T14:37:57.230919+0000","last_clean":"2023-07-25T14:37:57.230919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:57.230919+0000","last_undegraded":"2023-07-25T14:37:57.230919+0000","last_fullsized":"2023-07-25T14:37:57.230919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.236278+0000","last_change":"2023-07-25T14:37:45.205950+0000","last_active":"2023-07-25T14:37:56.236278+0000","last_peered":"2023-07-25T14:37:56.236278+0000","last_clean":"2023-07-25T14:37:56.236278+0000","last_became_active":"2023-07-25T14:37:45.199388+0000","last_became_peered":"2023-07-25T14:37:45.199388+0000","last_unstale":"2023-07-25T14:37:56.236278+0000","last_undegraded":"2023-07-25T14:37:56.236278+0000","last_fullsized":"2023-07-25T14:37:56.236278+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T21:01:07.274086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-25T14:37:57.230919+0000","last_change":"2023-07-25T14:37:57.230919+0000","last_active":"2023-07-25T14:37:57.230919+0000","last_peered":"2023-07-25T14:37:57.230919+0000","last_clean":"2023-07-25T14:37:57.230919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:57.230919+0000","last_undegraded":"2023-07-25T14:37:57.230919+0000","last_fullsized":"2023-07-25T14:37:57.230919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.242668+0000","last_change":"2023-07-25T14:37:45.188465+0000","last_active":"2023-07-25T14:37:56.242668+0000","last_peered":"2023-07-25T14:37:56.242668+0000","last_clean":"2023-07-25T14:37:56.242668+0000","last_became_active":"2023-07-25T14:37:45.188186+0000","last_became_peered":"2023-07-25T14:37:45.188186+0000","last_unstale":"2023-07-25T14:37:56.242668+0000","last_undegraded":"2023-07-25T14:37:56.242668+0000","last_fullsized":"2023-07-25T14:37:56.242668+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T15:46:46.392473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-25T14:37:57.230919+0000","last_change":"2023-07-25T14:37:57.230919+0000","last_active":"2023-07-25T14:37:57.230919+0000","last_peered":"2023-07-25T14:37:57.230919+0000","last_clean":"2023-07-25T14:37:57.230919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:57.230919+0000","last_undegraded":"2023-07-25T14:37:57.230919+0000","last_fullsized":"2023-07-25T14:37:57.230919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.240257+0000","last_change":"2023-07-25T14:37:45.201384+0000","last_active":"2023-07-25T14:37:56.240257+0000","last_peered":"2023-07-25T14:37:56.240257+0000","last_clean":"2023-07-25T14:37:56.240257+0000","last_became_active":"2023-07-25T14:37:45.200847+0000","last_became_peered":"2023-07-25T14:37:45.200847+0000","last_unstale":"2023-07-25T14:37:56.240257+0000","last_undegraded":"2023-07-25T14:37:56.240257+0000","last_fullsized":"2023-07-25T14:37:56.240257+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:01:15.664248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-25T14:37:57.230919+0000","last_change":"2023-07-25T14:37:57.230919+0000","last_active":"2023-07-25T14:37:57.230919+0000","last_peered":"2023-07-25T14:37:57.230919+0000","last_clean":"2023-07-25T14:37:57.230919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:57.230919+0000","last_undegraded":"2023-07-25T14:37:57.230919+0000","last_fullsized":"2023-07-25T14:37:57.230919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.241115+0000","last_change":"2023-07-25T14:37:45.201941+0000","last_active":"2023-07-25T14:37:56.241115+0000","last_peered":"2023-07-25T14:37:56.241115+0000","last_clean":"2023-07-25T14:37:56.241115+0000","last_became_active":"2023-07-25T14:37:45.201640+0000","last_became_peered":"2023-07-25T14:37:45.201640+0000","last_unstale":"2023-07-25T14:37:56.241115+0000","last_undegraded":"2023-07-25T14:37:56.241115+0000","last_fullsized":"2023-07-25T14:37:56.241115+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T23:27:34.225061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-25T14:37:57.230919+0000","last_change":"2023-07-25T14:37:57.230919+0000","last_active":"2023-07-25T14:37:57.230919+0000","last_peered":"2023-07-25T14:37:57.230919+0000","last_clean":"2023-07-25T14:37:57.230919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:57.230919+0000","last_undegraded":"2023-07-25T14:37:57.230919+0000","last_fullsized":"2023-07-25T14:37:57.230919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.241029+0000","last_change":"2023-07-25T14:37:45.204317+0000","last_active":"2023-07-25T14:37:56.241029+0000","last_peered":"2023-07-25T14:37:56.241029+0000","last_clean":"2023-07-25T14:37:56.241029+0000","last_became_active":"2023-07-25T14:37:45.203583+0000","last_became_peered":"2023-07-25T14:37:45.203583+0000","last_unstale":"2023-07-25T14:37:56.241029+0000","last_undegraded":"2023-07-25T14:37:56.241029+0000","last_fullsized":"2023-07-25T14:37:56.241029+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T21:36:29.587198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-25T14:37:57.230919+0000","last_change":"2023-07-25T14:37:57.230919+0000","last_active":"2023-07-25T14:37:57.230919+0000","last_peered":"2023-07-25T14:37:57.230919+0000","last_clean":"2023-07-25T14:37:57.230919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:57.230919+0000","last_undegraded":"2023-07-25T14:37:57.230919+0000","last_fullsized":"2023-07-25T14:37:57.230919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.240236+0000","last_change":"2023-07-25T14:37:45.207314+0000","last_active":"2023-07-25T14:37:56.240236+0000","last_peered":"2023-07-25T14:37:56.240236+0000","last_clean":"2023-07-25T14:37:56.240236+0000","last_became_active":"2023-07-25T14:37:45.207030+0000","last_became_peered":"2023-07-25T14:37:45.207030+0000","last_unstale":"2023-07-25T14:37:56.240236+0000","last_undegraded":"2023-07-25T14:37:56.240236+0000","last_fullsized":"2023-07-25T14:37:56.240236+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T18:15:13.886467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-25T14:37:57.230919+0000","last_change":"2023-07-25T14:37:57.230919+0000","last_active":"2023-07-25T14:37:57.230919+0000","last_peered":"2023-07-25T14:37:57.230919+0000","last_clean":"2023-07-25T14:37:57.230919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:57.230919+0000","last_undegraded":"2023-07-25T14:37:57.230919+0000","last_fullsized":"2023-07-25T14:37:57.230919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.238899+0000","last_change":"2023-07-25T14:37:45.210109+0000","last_active":"2023-07-25T14:37:56.238899+0000","last_peered":"2023-07-25T14:37:56.238899+0000","last_clean":"2023-07-25T14:37:56.238899+0000","last_became_active":"2023-07-25T14:37:45.205229+0000","last_became_peered":"2023-07-25T14:37:45.205229+0000","last_unstale":"2023-07-25T14:37:56.238899+0000","last_undegraded":"2023-07-25T14:37:56.238899+0000","last_fullsized":"2023-07-25T14:37:56.238899+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T18:15:13.886467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-25T14:37:57.230919+0000","last_change":"2023-07-25T14:37:57.230919+0000","last_active":"2023-07-25T14:37:57.230919+0000","last_peered":"2023-07-25T14:37:57.230919+0000","last_clean":"2023-07-25T14:37:57.230919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:57.230919+0000","last_undegraded":"2023-07-25T14:37:57.230919+0000","last_fullsized":"2023-07-25T14:37:57.230919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.242267+0000","last_change":"2023-07-25T14:37:45.188464+0000","last_active":"2023-07-25T14:37:56.242267+0000","last_peered":"2023-07-25T14:37:56.242267+0000","last_clean":"2023-07-25T14:37:56.242267+0000","last_became_active":"2023-07-25T14:37:45.188020+0000","last_became_peered":"2023-07-25T14:37:45.188020+0000","last_unstale":"2023-07-25T14:37:56.242267+0000","last_undegraded":"2023-07-25T14:37:56.242267+0000","last_fullsized":"2023-07-25T14:37:56.242267+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T16:59:37.902539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-25T14:37:57.230919+0000","last_change":"2023-07-25T14:37:57.230919+0000","last_active":"2023-07-25T14:37:57.230919+0000","last_peered":"2023-07-25T14:37:57.230919+0000","last_clean":"2023-07-25T14:37:57.230919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:57.230919+0000","last_undegraded":"2023-07-25T14:37:57.230919+0000","last_fullsized":"2023-07-25T14:37:57.230919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.237576+0000","last_change":"2023-07-25T14:37:45.205460+0000","last_active":"2023-07-25T14:37:56.237576+0000","last_peered":"2023-07-25T14:37:56.237576+0000","last_clean":"2023-07-25T14:37:56.237576+0000","last_became_active":"2023-07-25T14:37:45.205174+0000","last_became_peered":"2023-07-25T14:37:45.205174+0000","last_unstale":"2023-07-25T14:37:56.237576+0000","last_undegraded":"2023-07-25T14:37:56.237576+0000","last_fullsized":"2023-07-25T14:37:56.237576+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:52:10.216139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-25T14:37:57.230919+0000","last_change":"2023-07-25T14:37:57.230919+0000","last_active":"2023-07-25T14:37:57.230919+0000","last_peered":"2023-07-25T14:37:57.230919+0000","last_clean":"2023-07-25T14:37:57.230919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:57.230919+0000","last_undegraded":"2023-07-25T14:37:57.230919+0000","last_fullsized":"2023-07-25T14:37:57.230919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.240725+0000","last_change":"2023-07-25T14:37:45.199014+0000","last_active":"2023-07-25T14:37:56.240725+0000","last_peered":"2023-07-25T14:37:56.240725+0000","last_clean":"2023-07-25T14:37:56.240725+0000","last_became_active":"2023-07-25T14:37:45.198610+0000","last_became_peered":"2023-07-25T14:37:45.198610+0000","last_unstale":"2023-07-25T14:37:56.240725+0000","last_undegraded":"2023-07-25T14:37:56.240725+0000","last_fullsized":"2023-07-25T14:37:56.240725+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T18:53:31.784163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-25T14:37:57.230919+0000","last_change":"2023-07-25T14:37:57.230919+0000","last_active":"2023-07-25T14:37:57.230919+0000","last_peered":"2023-07-25T14:37:57.230919+0000","last_clean":"2023-07-25T14:37:57.230919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:57.230919+0000","last_undegraded":"2023-07-25T14:37:57.230919+0000","last_fullsized":"2023-07-25T14:37:57.230919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.237801+0000","last_change":"2023-07-25T14:37:45.190492+0000","last_active":"2023-07-25T14:37:56.237801+0000","last_peered":"2023-07-25T14:37:56.237801+0000","last_clean":"2023-07-25T14:37:56.237801+0000","last_became_active":"2023-07-25T14:37:45.190205+0000","last_became_peered":"2023-07-25T14:37:45.190205+0000","last_unstale":"2023-07-25T14:37:56.237801+0000","last_undegraded":"2023-07-25T14:37:56.237801+0000","last_fullsized":"2023-07-25T14:37:56.237801+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T16:38:19.522810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-25T14:37:57.230919+0000","last_change":"2023-07-25T14:37:57.230919+0000","last_active":"2023-07-25T14:37:57.230919+0000","last_peered":"2023-07-25T14:37:57.230919+0000","last_clean":"2023-07-25T14:37:57.230919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:57.230919+0000","last_undegraded":"2023-07-25T14:37:57.230919+0000","last_fullsized":"2023-07-25T14:37:57.230919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.241947+0000","last_change":"2023-07-25T14:37:45.189887+0000","last_active":"2023-07-25T14:37:56.241947+0000","last_peered":"2023-07-25T14:37:56.241947+0000","last_clean":"2023-07-25T14:37:56.241947+0000","last_became_active":"2023-07-25T14:37:45.189544+0000","last_became_peered":"2023-07-25T14:37:45.189544+0000","last_unstale":"2023-07-25T14:37:56.241947+0000","last_undegraded":"2023-07-25T14:37:56.241947+0000","last_fullsized":"2023-07-25T14:37:56.241947+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T14:57:36.427060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-25T14:37:57.230919+0000","last_change":"2023-07-25T14:37:57.230919+0000","last_active":"2023-07-25T14:37:57.230919+0000","last_peered":"2023-07-25T14:37:57.230919+0000","last_clean":"2023-07-25T14:37:57.230919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:57.230919+0000","last_undegraded":"2023-07-25T14:37:57.230919+0000","last_fullsized":"2023-07-25T14:37:57.230919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.241859+0000","last_change":"2023-07-25T14:37:45.197332+0000","last_active":"2023-07-25T14:37:56.241859+0000","last_peered":"2023-07-25T14:37:56.241859+0000","last_clean":"2023-07-25T14:37:56.241859+0000","last_became_active":"2023-07-25T14:37:45.196749+0000","last_became_peered":"2023-07-25T14:37:45.196749+0000","last_unstale":"2023-07-25T14:37:56.241859+0000","last_undegraded":"2023-07-25T14:37:56.241859+0000","last_fullsized":"2023-07-25T14:37:56.241859+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:22:33.272266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-25T14:37:57.230919+0000","last_change":"2023-07-25T14:37:57.230919+0000","last_active":"2023-07-25T14:37:57.230919+0000","last_peered":"2023-07-25T14:37:57.230919+0000","last_clean":"2023-07-25T14:37:57.230919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:57.230919+0000","last_undegraded":"2023-07-25T14:37:57.230919+0000","last_fullsized":"2023-07-25T14:37:57.230919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.235254+0000","last_change":"2023-07-25T14:37:45.191972+0000","last_active":"2023-07-25T14:37:56.235254+0000","last_peered":"2023-07-25T14:37:56.235254+0000","last_clean":"2023-07-25T14:37:56.235254+0000","last_became_active":"2023-07-25T14:37:45.191704+0000","last_became_peered":"2023-07-25T14:37:45.191704+0000","last_unstale":"2023-07-25T14:37:56.235254+0000","last_undegraded":"2023-07-25T14:37:56.235254+0000","last_fullsized":"2023-07-25T14:37:56.235254+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T21:11:54.570394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-25T14:37:57.230919+0000","last_change":"2023-07-25T14:37:57.230919+0000","last_active":"2023-07-25T14:37:57.230919+0000","last_peered":"2023-07-25T14:37:57.230919+0000","last_clean":"2023-07-25T14:37:57.230919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:57.230919+0000","last_undegraded":"2023-07-25T14:37:57.230919+0000","last_fullsized":"2023-07-25T14:37:57.230919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2023-07-25T14:37:56.240395+0000","last_change":"2023-07-25T14:37:56.240395+0000","last_active":"2023-07-25T14:37:56.225499+0000","last_peered":"2023-07-25T14:37:56.225499+0000","last_clean":"2023-07-25T14:37:56.225499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:56.240395+0000","last_undegraded":"2023-07-25T14:37:56.240395+0000","last_fullsized":"2023-07-25T14:37:56.240395+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_clean_scrub_stamp":"2023-07-25T14:37:56.225499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.241936+0000","last_change":"2023-07-25T14:37:45.213847+0000","last_active":"2023-07-25T14:37:56.241936+0000","last_peered":"2023-07-25T14:37:56.241936+0000","last_clean":"2023-07-25T14:37:56.241936+0000","last_became_active":"2023-07-25T14:37:45.213456+0000","last_became_peered":"2023-07-25T14:37:45.213456+0000","last_unstale":"2023-07-25T14:37:56.241936+0000","last_undegraded":"2023-07-25T14:37:56.241936+0000","last_fullsized":"2023-07-25T14:37:56.241936+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T19:07:32.745444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"56'4","reported_seq":19,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.242852+0000","last_change":"2023-07-25T14:37:44.164114+0000","last_active":"2023-07-25T14:37:56.242852+0000","last_peered":"2023-07-25T14:37:56.242852+0000","last_clean":"2023-07-25T14:37:56.242852+0000","last_became_active":"2023-07-25T14:37:44.163807+0000","last_became_peered":"2023-07-25T14:37:44.163807+0000","last_unstale":"2023-07-25T14:37:56.242852+0000","last_undegraded":"2023-07-25T14:37:56.242852+0000","last_fullsized":"2023-07-25T14:37:56.242852+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T17:17:04.204095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-25T14:37:57.230919+0000","last_change":"2023-07-25T14:37:57.230919+0000","last_active":"2023-07-25T14:37:57.230919+0000","last_peered":"2023-07-25T14:37:57.230919+0000","last_clean":"2023-07-25T14:37:57.230919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:57.230919+0000","last_undegraded":"2023-07-25T14:37:57.230919+0000","last_fullsized":"2023-07-25T14:37:57.230919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2023-07-25T14:37:56.237722+0000","last_change":"2023-07-25T14:37:56.237722+0000","last_active":"2023-07-25T14:37:56.225499+0000","last_peered":"2023-07-25T14:37:56.225499+0000","last_clean":"2023-07-25T14:37:56.225499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:56.237722+0000","last_undegraded":"2023-07-25T14:37:56.237722+0000","last_fullsized":"2023-07-25T14:37:56.237722+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_clean_scrub_stamp":"2023-07-25T14:37:56.225499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.239259+0000","last_change":"2023-07-25T14:37:45.191918+0000","last_active":"2023-07-25T14:37:56.239259+0000","last_peered":"2023-07-25T14:37:56.239259+0000","last_clean":"2023-07-25T14:37:56.239259+0000","last_became_active":"2023-07-25T14:37:45.191341+0000","last_became_peered":"2023-07-25T14:37:45.191341+0000","last_unstale":"2023-07-25T14:37:56.239259+0000","last_undegraded":"2023-07-25T14:37:56.239259+0000","last_fullsized":"2023-07-25T14:37:56.239259+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T16:42:35.382617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"56'1","reported_seq":16,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.242725+0000","last_change":"2023-07-25T14:37:44.174028+0000","last_active":"2023-07-25T14:37:56.242725+0000","last_peered":"2023-07-25T14:37:56.242725+0000","last_clean":"2023-07-25T14:37:56.242725+0000","last_became_active":"2023-07-25T14:37:44.173193+0000","last_became_peered":"2023-07-25T14:37:44.173193+0000","last_unstale":"2023-07-25T14:37:56.242725+0000","last_undegraded":"2023-07-25T14:37:56.242725+0000","last_fullsized":"2023-07-25T14:37:56.242725+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T21:08:18.872035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-25T14:37:57.230919+0000","last_change":"2023-07-25T14:37:57.230919+0000","last_active":"2023-07-25T14:37:57.230919+0000","last_peered":"2023-07-25T14:37:57.230919+0000","last_clean":"2023-07-25T14:37:57.230919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:57.230919+0000","last_undegraded":"2023-07-25T14:37:57.230919+0000","last_fullsized":"2023-07-25T14:37:57.230919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2023-07-25T14:37:56.239988+0000","last_change":"2023-07-25T14:37:56.239988+0000","last_active":"2023-07-25T14:37:56.225499+0000","last_peered":"2023-07-25T14:37:56.225499+0000","last_clean":"2023-07-25T14:37:56.225499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:56.239988+0000","last_undegraded":"2023-07-25T14:37:56.239988+0000","last_fullsized":"2023-07-25T14:37:56.239988+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_clean_scrub_stamp":"2023-07-25T14:37:56.225499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.235574+0000","last_change":"2023-07-25T14:37:45.209338+0000","last_active":"2023-07-25T14:37:56.235574+0000","last_peered":"2023-07-25T14:37:56.235574+0000","last_clean":"2023-07-25T14:37:56.235574+0000","last_became_active":"2023-07-25T14:37:45.207168+0000","last_became_peered":"2023-07-25T14:37:45.207168+0000","last_unstale":"2023-07-25T14:37:56.235574+0000","last_undegraded":"2023-07-25T14:37:56.235574+0000","last_fullsized":"2023-07-25T14:37:56.235574+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T17:43:05.618873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"56'2","reported_seq":17,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.239162+0000","last_change":"2023-07-25T14:37:44.168052+0000","last_active":"2023-07-25T14:37:56.239162+0000","last_peered":"2023-07-25T14:37:56.239162+0000","last_clean":"2023-07-25T14:37:56.239162+0000","last_became_active":"2023-07-25T14:37:44.167768+0000","last_became_peered":"2023-07-25T14:37:44.167768+0000","last_unstale":"2023-07-25T14:37:56.239162+0000","last_undegraded":"2023-07-25T14:37:56.239162+0000","last_fullsized":"2023-07-25T14:37:56.239162+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T17:02:30.931160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-25T14:37:57.230919+0000","last_change":"2023-07-25T14:37:57.230919+0000","last_active":"2023-07-25T14:37:57.230919+0000","last_peered":"2023-07-25T14:37:57.230919+0000","last_clean":"2023-07-25T14:37:57.230919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:57.230919+0000","last_undegraded":"2023-07-25T14:37:57.230919+0000","last_fullsized":"2023-07-25T14:37:57.230919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2023-07-25T14:37:56.240262+0000","last_change":"2023-07-25T14:37:56.240262+0000","last_active":"2023-07-25T14:37:56.225499+0000","last_peered":"2023-07-25T14:37:56.225499+0000","last_clean":"2023-07-25T14:37:56.225499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:56.240262+0000","last_undegraded":"2023-07-25T14:37:56.240262+0000","last_fullsized":"2023-07-25T14:37:56.240262+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_clean_scrub_stamp":"2023-07-25T14:37:56.225499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.241866+0000","last_change":"2023-07-25T14:37:45.204504+0000","last_active":"2023-07-25T14:37:56.241866+0000","last_peered":"2023-07-25T14:37:56.241866+0000","last_clean":"2023-07-25T14:37:56.241866+0000","last_became_active":"2023-07-25T14:37:45.203141+0000","last_became_peered":"2023-07-25T14:37:45.203141+0000","last_unstale":"2023-07-25T14:37:56.241866+0000","last_undegraded":"2023-07-25T14:37:56.241866+0000","last_fullsized":"2023-07-25T14:37:56.241866+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:01:15.664248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"56'2","reported_seq":17,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.235855+0000","last_change":"2023-07-25T14:37:44.167404+0000","last_active":"2023-07-25T14:37:56.235855+0000","last_peered":"2023-07-25T14:37:56.235855+0000","last_clean":"2023-07-25T14:37:56.235855+0000","last_became_active":"2023-07-25T14:37:44.167157+0000","last_became_peered":"2023-07-25T14:37:44.167157+0000","last_unstale":"2023-07-25T14:37:56.235855+0000","last_undegraded":"2023-07-25T14:37:56.235855+0000","last_fullsized":"2023-07-25T14:37:56.235855+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T15:31:28.702869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-25T14:37:57.230919+0000","last_change":"2023-07-25T14:37:57.230919+0000","last_active":"2023-07-25T14:37:57.230919+0000","last_peered":"2023-07-25T14:37:57.230919+0000","last_clean":"2023-07-25T14:37:57.230919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:57.230919+0000","last_undegraded":"2023-07-25T14:37:57.230919+0000","last_fullsized":"2023-07-25T14:37:57.230919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2023-07-25T14:37:56.240853+0000","last_change":"2023-07-25T14:37:56.240853+0000","last_active":"2023-07-25T14:37:56.225499+0000","last_peered":"2023-07-25T14:37:56.225499+0000","last_clean":"2023-07-25T14:37:56.225499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:56.240853+0000","last_undegraded":"2023-07-25T14:37:56.240853+0000","last_fullsized":"2023-07-25T14:37:56.240853+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_clean_scrub_stamp":"2023-07-25T14:37:56.225499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.241986+0000","last_change":"2023-07-25T14:37:45.192672+0000","last_active":"2023-07-25T14:37:56.241986+0000","last_peered":"2023-07-25T14:37:56.241986+0000","last_clean":"2023-07-25T14:37:56.241986+0000","last_became_active":"2023-07-25T14:37:45.192426+0000","last_became_peered":"2023-07-25T14:37:45.192426+0000","last_unstale":"2023-07-25T14:37:56.241986+0000","last_undegraded":"2023-07-25T14:37:56.241986+0000","last_fullsized":"2023-07-25T14:37:56.241986+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T23:33:22.019151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"56'1","reported_seq":16,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.238075+0000","last_change":"2023-07-25T14:37:44.165894+0000","last_active":"2023-07-25T14:37:56.238075+0000","last_peered":"2023-07-25T14:37:56.238075+0000","last_clean":"2023-07-25T14:37:56.238075+0000","last_became_active":"2023-07-25T14:37:44.165121+0000","last_became_peered":"2023-07-25T14:37:44.165121+0000","last_unstale":"2023-07-25T14:37:56.238075+0000","last_undegraded":"2023-07-25T14:37:56.238075+0000","last_fullsized":"2023-07-25T14:37:56.238075+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T02:26:32.270431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-25T14:37:57.230919+0000","last_change":"2023-07-25T14:37:57.230919+0000","last_active":"2023-07-25T14:37:57.230919+0000","last_peered":"2023-07-25T14:37:57.230919+0000","last_clean":"2023-07-25T14:37:57.230919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:57.230919+0000","last_undegraded":"2023-07-25T14:37:57.230919+0000","last_fullsized":"2023-07-25T14:37:57.230919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2023-07-25T14:37:56.240918+0000","last_change":"2023-07-25T14:37:56.240918+0000","last_active":"2023-07-25T14:37:56.225499+0000","last_peered":"2023-07-25T14:37:56.225499+0000","last_clean":"2023-07-25T14:37:56.225499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:56.240918+0000","last_undegraded":"2023-07-25T14:37:56.240918+0000","last_fullsized":"2023-07-25T14:37:56.240918+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_clean_scrub_stamp":"2023-07-25T14:37:56.225499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.240434+0000","last_change":"2023-07-25T14:37:45.204924+0000","last_active":"2023-07-25T14:37:56.240434+0000","last_peered":"2023-07-25T14:37:56.240434+0000","last_clean":"2023-07-25T14:37:56.240434+0000","last_became_active":"2023-07-25T14:37:45.204636+0000","last_became_peered":"2023-07-25T14:37:45.204636+0000","last_unstale":"2023-07-25T14:37:56.240434+0000","last_undegraded":"2023-07-25T14:37:56.240434+0000","last_fullsized":"2023-07-25T14:37:56.240434+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T15:01:23.982072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"56'1","reported_seq":16,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.235502+0000","last_change":"2023-07-25T14:37:44.165997+0000","last_active":"2023-07-25T14:37:56.235502+0000","last_peered":"2023-07-25T14:37:56.235502+0000","last_clean":"2023-07-25T14:37:56.235502+0000","last_became_active":"2023-07-25T14:37:44.165724+0000","last_became_peered":"2023-07-25T14:37:44.165724+0000","last_unstale":"2023-07-25T14:37:56.235502+0000","last_undegraded":"2023-07-25T14:37:56.235502+0000","last_fullsized":"2023-07-25T14:37:56.235502+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T16:55:35.317643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-25T14:37:57.230919+0000","last_change":"2023-07-25T14:37:57.230919+0000","last_active":"2023-07-25T14:37:57.230919+0000","last_peered":"2023-07-25T14:37:57.230919+0000","last_clean":"2023-07-25T14:37:57.230919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:57.230919+0000","last_undegraded":"2023-07-25T14:37:57.230919+0000","last_fullsized":"2023-07-25T14:37:57.230919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2023-07-25T14:37:56.234775+0000","last_change":"2023-07-25T14:37:56.234775+0000","last_active":"2023-07-25T14:37:56.225499+0000","last_peered":"2023-07-25T14:37:56.225499+0000","last_clean":"2023-07-25T14:37:56.225499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:56.234775+0000","last_undegraded":"2023-07-25T14:37:56.234775+0000","last_fullsized":"2023-07-25T14:37:56.234775+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_clean_scrub_stamp":"2023-07-25T14:37:56.225499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.235953+0000","last_change":"2023-07-25T14:37:45.200734+0000","last_active":"2023-07-25T14:37:56.235953+0000","last_peered":"2023-07-25T14:37:56.235953+0000","last_clean":"2023-07-25T14:37:56.235953+0000","last_became_active":"2023-07-25T14:37:45.200452+0000","last_became_peered":"2023-07-25T14:37:45.200452+0000","last_unstale":"2023-07-25T14:37:56.235953+0000","last_undegraded":"2023-07-25T14:37:56.235953+0000","last_fullsized":"2023-07-25T14:37:56.235953+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T15:59:17.536216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.238125+0000","last_change":"2023-07-25T14:37:44.163784+0000","last_active":"2023-07-25T14:37:56.238125+0000","last_peered":"2023-07-25T14:37:56.238125+0000","last_clean":"2023-07-25T14:37:56.238125+0000","last_became_active":"2023-07-25T14:37:44.163566+0000","last_became_peered":"2023-07-25T14:37:44.163566+0000","last_unstale":"2023-07-25T14:37:56.238125+0000","last_undegraded":"2023-07-25T14:37:56.238125+0000","last_fullsized":"2023-07-25T14:37:56.238125+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T15:07:44.972611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-25T14:37:57.230919+0000","last_change":"2023-07-25T14:37:57.230919+0000","last_active":"2023-07-25T14:37:57.230919+0000","last_peered":"2023-07-25T14:37:57.230919+0000","last_clean":"2023-07-25T14:37:57.230919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:57.230919+0000","last_undegraded":"2023-07-25T14:37:57.230919+0000","last_fullsized":"2023-07-25T14:37:57.230919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2023-07-25T14:37:56.239932+0000","last_change":"2023-07-25T14:37:56.239932+0000","last_active":"2023-07-25T14:37:56.225499+0000","last_peered":"2023-07-25T14:37:56.225499+0000","last_clean":"2023-07-25T14:37:56.225499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:56.239932+0000","last_undegraded":"2023-07-25T14:37:56.239932+0000","last_fullsized":"2023-07-25T14:37:56.239932+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_clean_scrub_stamp":"2023-07-25T14:37:56.225499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.242251+0000","last_change":"2023-07-25T14:37:45.205124+0000","last_active":"2023-07-25T14:37:56.242251+0000","last_peered":"2023-07-25T14:37:56.242251+0000","last_clean":"2023-07-25T14:37:56.242251+0000","last_became_active":"2023-07-25T14:37:45.204730+0000","last_became_peered":"2023-07-25T14:37:45.204730+0000","last_unstale":"2023-07-25T14:37:56.242251+0000","last_undegraded":"2023-07-25T14:37:56.242251+0000","last_fullsized":"2023-07-25T14:37:56.242251+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T20:41:03.818352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.236611+0000","last_change":"2023-07-25T14:37:44.171926+0000","last_active":"2023-07-25T14:37:56.236611+0000","last_peered":"2023-07-25T14:37:56.236611+0000","last_clean":"2023-07-25T14:37:56.236611+0000","last_became_active":"2023-07-25T14:37:44.171610+0000","last_became_peered":"2023-07-25T14:37:44.171610+0000","last_unstale":"2023-07-25T14:37:56.236611+0000","last_undegraded":"2023-07-25T14:37:56.236611+0000","last_fullsized":"2023-07-25T14:37:56.236611+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:06:37.927385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-25T14:37:57.230919+0000","last_change":"2023-07-25T14:37:57.230919+0000","last_active":"2023-07-25T14:37:57.230919+0000","last_peered":"2023-07-25T14:37:57.230919+0000","last_clean":"2023-07-25T14:37:57.230919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:57.230919+0000","last_undegraded":"2023-07-25T14:37:57.230919+0000","last_fullsized":"2023-07-25T14:37:57.230919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2023-07-25T14:37:56.238867+0000","last_change":"2023-07-25T14:37:56.238867+0000","last_active":"2023-07-25T14:37:56.225499+0000","last_peered":"2023-07-25T14:37:56.225499+0000","last_clean":"2023-07-25T14:37:56.225499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:56.238867+0000","last_undegraded":"2023-07-25T14:37:56.238867+0000","last_fullsized":"2023-07-25T14:37:56.238867+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_clean_scrub_stamp":"2023-07-25T14:37:56.225499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.242382+0000","last_change":"2023-07-25T14:37:45.208126+0000","last_active":"2023-07-25T14:37:56.242382+0000","last_peered":"2023-07-25T14:37:56.242382+0000","last_clean":"2023-07-25T14:37:56.242382+0000","last_became_active":"2023-07-25T14:37:45.207856+0000","last_became_peered":"2023-07-25T14:37:45.207856+0000","last_unstale":"2023-07-25T14:37:56.242382+0000","last_undegraded":"2023-07-25T14:37:56.242382+0000","last_fullsized":"2023-07-25T14:37:56.242382+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T16:35:40.438338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.241158+0000","last_change":"2023-07-25T14:37:44.164773+0000","last_active":"2023-07-25T14:37:56.241158+0000","last_peered":"2023-07-25T14:37:56.241158+0000","last_clean":"2023-07-25T14:37:56.241158+0000","last_became_active":"2023-07-25T14:37:44.164480+0000","last_became_peered":"2023-07-25T14:37:44.164480+0000","last_unstale":"2023-07-25T14:37:56.241158+0000","last_undegraded":"2023-07-25T14:37:56.241158+0000","last_fullsized":"2023-07-25T14:37:56.241158+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T17:17:04.204095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-25T14:37:57.230919+0000","last_change":"2023-07-25T14:37:57.230919+0000","last_active":"2023-07-25T14:37:57.230919+0000","last_peered":"2023-07-25T14:37:57.230919+0000","last_clean":"2023-07-25T14:37:57.230919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:57.230919+0000","last_undegraded":"2023-07-25T14:37:57.230919+0000","last_fullsized":"2023-07-25T14:37:57.230919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2023-07-25T14:37:56.240388+0000","last_change":"2023-07-25T14:37:56.240388+0000","last_active":"2023-07-25T14:37:56.225499+0000","last_peered":"2023-07-25T14:37:56.225499+0000","last_clean":"2023-07-25T14:37:56.225499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:56.240388+0000","last_undegraded":"2023-07-25T14:37:56.240388+0000","last_fullsized":"2023-07-25T14:37:56.240388+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_clean_scrub_stamp":"2023-07-25T14:37:56.225499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.242712+0000","last_change":"2023-07-25T14:37:45.196449+0000","last_active":"2023-07-25T14:37:56.242712+0000","last_peered":"2023-07-25T14:37:56.242712+0000","last_clean":"2023-07-25T14:37:56.242712+0000","last_became_active":"2023-07-25T14:37:45.196172+0000","last_became_peered":"2023-07-25T14:37:45.196172+0000","last_unstale":"2023-07-25T14:37:56.242712+0000","last_undegraded":"2023-07-25T14:37:56.242712+0000","last_fullsized":"2023-07-25T14:37:56.242712+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T23:27:34.225061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.236341+0000","last_change":"2023-07-25T14:37:44.162751+0000","last_active":"2023-07-25T14:37:56.236341+0000","last_peered":"2023-07-25T14:37:56.236341+0000","last_clean":"2023-07-25T14:37:56.236341+0000","last_became_active":"2023-07-25T14:37:44.162037+0000","last_became_peered":"2023-07-25T14:37:44.162037+0000","last_unstale":"2023-07-25T14:37:56.236341+0000","last_undegraded":"2023-07-25T14:37:56.236341+0000","last_fullsized":"2023-07-25T14:37:56.236341+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T16:48:43.337902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-25T14:37:57.230919+0000","last_change":"2023-07-25T14:37:57.230919+0000","last_active":"2023-07-25T14:37:57.230919+0000","last_peered":"2023-07-25T14:37:57.230919+0000","last_clean":"2023-07-25T14:37:57.230919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:57.230919+0000","last_undegraded":"2023-07-25T14:37:57.230919+0000","last_fullsized":"2023-07-25T14:37:57.230919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2023-07-25T14:37:56.237456+0000","last_change":"2023-07-25T14:37:56.237456+0000","last_active":"2023-07-25T14:37:56.225499+0000","last_peered":"2023-07-25T14:37:56.225499+0000","last_clean":"2023-07-25T14:37:56.225499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:56.237456+0000","last_undegraded":"2023-07-25T14:37:56.237456+0000","last_fullsized":"2023-07-25T14:37:56.237456+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_clean_scrub_stamp":"2023-07-25T14:37:56.225499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.235625+0000","last_change":"2023-07-25T14:37:45.206751+0000","last_active":"2023-07-25T14:37:56.235625+0000","last_peered":"2023-07-25T14:37:56.235625+0000","last_clean":"2023-07-25T14:37:56.235625+0000","last_became_active":"2023-07-25T14:37:45.206422+0000","last_became_peered":"2023-07-25T14:37:45.206422+0000","last_unstale":"2023-07-25T14:37:56.235625+0000","last_undegraded":"2023-07-25T14:37:56.235625+0000","last_fullsized":"2023-07-25T14:37:56.235625+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T20:19:02.577921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"56'3","reported_seq":18,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.237595+0000","last_change":"2023-07-25T14:37:44.161397+0000","last_active":"2023-07-25T14:37:56.237595+0000","last_peered":"2023-07-25T14:37:56.237595+0000","last_clean":"2023-07-25T14:37:56.237595+0000","last_became_active":"2023-07-25T14:37:44.161134+0000","last_became_peered":"2023-07-25T14:37:44.161134+0000","last_unstale":"2023-07-25T14:37:56.237595+0000","last_undegraded":"2023-07-25T14:37:56.237595+0000","last_fullsized":"2023-07-25T14:37:56.237595+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T02:02:52.433473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-25T14:37:57.230919+0000","last_change":"2023-07-25T14:37:57.230919+0000","last_active":"2023-07-25T14:37:57.230919+0000","last_peered":"2023-07-25T14:37:57.230919+0000","last_clean":"2023-07-25T14:37:57.230919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:57.230919+0000","last_undegraded":"2023-07-25T14:37:57.230919+0000","last_fullsized":"2023-07-25T14:37:57.230919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2023-07-25T14:37:56.235761+0000","last_change":"2023-07-25T14:37:56.235761+0000","last_active":"2023-07-25T14:37:56.225499+0000","last_peered":"2023-07-25T14:37:56.225499+0000","last_clean":"2023-07-25T14:37:56.225499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:56.235761+0000","last_undegraded":"2023-07-25T14:37:56.235761+0000","last_fullsized":"2023-07-25T14:37:56.235761+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_clean_scrub_stamp":"2023-07-25T14:37:56.225499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.238822+0000","last_change":"2023-07-25T14:37:45.199815+0000","last_active":"2023-07-25T14:37:56.238822+0000","last_peered":"2023-07-25T14:37:56.238822+0000","last_clean":"2023-07-25T14:37:56.238822+0000","last_became_active":"2023-07-25T14:37:45.199555+0000","last_became_peered":"2023-07-25T14:37:45.199555+0000","last_unstale":"2023-07-25T14:37:56.238822+0000","last_undegraded":"2023-07-25T14:37:56.238822+0000","last_fullsized":"2023-07-25T14:37:56.238822+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T22:21:33.713509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"57'8","reported_seq":23,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.238853+0000","last_change":"2023-07-25T14:37:44.173212+0000","last_active":"2023-07-25T14:37:56.238853+0000","last_peered":"2023-07-25T14:37:56.238853+0000","last_clean":"2023-07-25T14:37:56.238853+0000","last_became_active":"2023-07-25T14:37:44.172950+0000","last_became_peered":"2023-07-25T14:37:44.172950+0000","last_unstale":"2023-07-25T14:37:56.238853+0000","last_undegraded":"2023-07-25T14:37:56.238853+0000","last_fullsized":"2023-07-25T14:37:56.238853+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T02:13:31.491403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3071,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-25T14:37:57.230919+0000","last_change":"2023-07-25T14:37:57.230919+0000","last_active":"2023-07-25T14:37:57.230919+0000","last_peered":"2023-07-25T14:37:57.230919+0000","last_clean":"2023-07-25T14:37:57.230919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:57.230919+0000","last_undegraded":"2023-07-25T14:37:57.230919+0000","last_fullsized":"2023-07-25T14:37:57.230919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2023-07-25T14:37:56.234389+0000","last_change":"2023-07-25T14:37:56.234389+0000","last_active":"2023-07-25T14:37:56.225499+0000","last_peered":"2023-07-25T14:37:56.225499+0000","last_clean":"2023-07-25T14:37:56.225499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:56.234389+0000","last_undegraded":"2023-07-25T14:37:56.234389+0000","last_fullsized":"2023-07-25T14:37:56.234389+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_clean_scrub_stamp":"2023-07-25T14:37:56.225499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.240020+0000","last_change":"2023-07-25T14:37:45.203546+0000","last_active":"2023-07-25T14:37:56.240020+0000","last_peered":"2023-07-25T14:37:56.240020+0000","last_clean":"2023-07-25T14:37:56.240020+0000","last_became_active":"2023-07-25T14:37:45.203115+0000","last_became_peered":"2023-07-25T14:37:45.203115+0000","last_unstale":"2023-07-25T14:37:56.240020+0000","last_undegraded":"2023-07-25T14:37:56.240020+0000","last_fullsized":"2023-07-25T14:37:56.240020+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T14:55:58.159337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"56'2","reported_seq":17,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.238541+0000","last_change":"2023-07-25T14:37:44.164563+0000","last_active":"2023-07-25T14:37:56.238541+0000","last_peered":"2023-07-25T14:37:56.238541+0000","last_clean":"2023-07-25T14:37:56.238541+0000","last_became_active":"2023-07-25T14:37:44.164255+0000","last_became_peered":"2023-07-25T14:37:44.164255+0000","last_unstale":"2023-07-25T14:37:56.238541+0000","last_undegraded":"2023-07-25T14:37:56.238541+0000","last_fullsized":"2023-07-25T14:37:56.238541+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T23:32:21.667103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-25T14:37:57.230919+0000","last_change":"2023-07-25T14:37:57.230919+0000","last_active":"2023-07-25T14:37:57.230919+0000","last_peered":"2023-07-25T14:37:57.230919+0000","last_clean":"2023-07-25T14:37:57.230919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:57.230919+0000","last_undegraded":"2023-07-25T14:37:57.230919+0000","last_fullsized":"2023-07-25T14:37:57.230919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2023-07-25T14:37:56.239470+0000","last_change":"2023-07-25T14:37:56.239470+0000","last_active":"2023-07-25T14:37:56.225499+0000","last_peered":"2023-07-25T14:37:56.225499+0000","last_clean":"2023-07-25T14:37:56.225499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:56.239470+0000","last_undegraded":"2023-07-25T14:37:56.239470+0000","last_fullsized":"2023-07-25T14:37:56.239470+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_clean_scrub_stamp":"2023-07-25T14:37:56.225499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.242146+0000","last_change":"2023-07-25T14:37:45.201081+0000","last_active":"2023-07-25T14:37:56.242146+0000","last_peered":"2023-07-25T14:37:56.242146+0000","last_clean":"2023-07-25T14:37:56.242146+0000","last_became_active":"2023-07-25T14:37:45.200738+0000","last_became_peered":"2023-07-25T14:37:45.200738+0000","last_unstale":"2023-07-25T14:37:56.242146+0000","last_undegraded":"2023-07-25T14:37:56.242146+0000","last_fullsized":"2023-07-25T14:37:56.242146+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T22:46:25.594575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.235589+0000","last_change":"2023-07-25T14:37:44.173296+0000","last_active":"2023-07-25T14:37:56.235589+0000","last_peered":"2023-07-25T14:37:56.235589+0000","last_clean":"2023-07-25T14:37:56.235589+0000","last_became_active":"2023-07-25T14:37:44.172957+0000","last_became_peered":"2023-07-25T14:37:44.172957+0000","last_unstale":"2023-07-25T14:37:56.235589+0000","last_undegraded":"2023-07-25T14:37:56.235589+0000","last_fullsized":"2023-07-25T14:37:56.235589+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T18:19:14.410236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-25T14:37:57.230919+0000","last_change":"2023-07-25T14:37:57.230919+0000","last_active":"2023-07-25T14:37:57.230919+0000","last_peered":"2023-07-25T14:37:57.230919+0000","last_clean":"2023-07-25T14:37:57.230919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:57.230919+0000","last_undegraded":"2023-07-25T14:37:57.230919+0000","last_fullsized":"2023-07-25T14:37:57.230919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2023-07-25T14:37:56.234329+0000","last_change":"2023-07-25T14:37:56.234329+0000","last_active":"2023-07-25T14:37:56.225499+0000","last_peered":"2023-07-25T14:37:56.225499+0000","last_clean":"2023-07-25T14:37:56.225499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:56.234329+0000","last_undegraded":"2023-07-25T14:37:56.234329+0000","last_fullsized":"2023-07-25T14:37:56.234329+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_clean_scrub_stamp":"2023-07-25T14:37:56.225499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.242076+0000","last_change":"2023-07-25T14:37:45.195068+0000","last_active":"2023-07-25T14:37:56.242076+0000","last_peered":"2023-07-25T14:37:56.242076+0000","last_clean":"2023-07-25T14:37:56.242076+0000","last_became_active":"2023-07-25T14:37:45.194820+0000","last_became_peered":"2023-07-25T14:37:45.194820+0000","last_unstale":"2023-07-25T14:37:56.242076+0000","last_undegraded":"2023-07-25T14:37:56.242076+0000","last_fullsized":"2023-07-25T14:37:56.242076+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T17:02:30.222184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.241962+0000","last_change":"2023-07-25T14:37:44.166150+0000","last_active":"2023-07-25T14:37:56.241962+0000","last_peered":"2023-07-25T14:37:56.241962+0000","last_clean":"2023-07-25T14:37:56.241962+0000","last_became_active":"2023-07-25T14:37:44.165851+0000","last_became_peered":"2023-07-25T14:37:44.165851+0000","last_unstale":"2023-07-25T14:37:56.241962+0000","last_undegraded":"2023-07-25T14:37:56.241962+0000","last_fullsized":"2023-07-25T14:37:56.241962+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T15:56:52.490461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-25T14:37:57.230919+0000","last_change":"2023-07-25T14:37:57.230919+0000","last_active":"2023-07-25T14:37:57.230919+0000","last_peered":"2023-07-25T14:37:57.230919+0000","last_clean":"2023-07-25T14:37:57.230919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:57.230919+0000","last_undegraded":"2023-07-25T14:37:57.230919+0000","last_fullsized":"2023-07-25T14:37:57.230919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2023-07-25T14:37:56.233850+0000","last_change":"2023-07-25T14:37:56.233850+0000","last_active":"2023-07-25T14:37:56.225499+0000","last_peered":"2023-07-25T14:37:56.225499+0000","last_clean":"2023-07-25T14:37:56.225499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:56.233850+0000","last_undegraded":"2023-07-25T14:37:56.233850+0000","last_fullsized":"2023-07-25T14:37:56.233850+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_clean_scrub_stamp":"2023-07-25T14:37:56.225499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.236821+0000","last_change":"2023-07-25T14:37:45.193890+0000","last_active":"2023-07-25T14:37:56.236821+0000","last_peered":"2023-07-25T14:37:56.236821+0000","last_clean":"2023-07-25T14:37:56.236821+0000","last_became_active":"2023-07-25T14:37:45.193634+0000","last_became_peered":"2023-07-25T14:37:45.193634+0000","last_unstale":"2023-07-25T14:37:56.236821+0000","last_undegraded":"2023-07-25T14:37:56.236821+0000","last_fullsized":"2023-07-25T14:37:56.236821+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T16:23:52.632199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"56'8","reported_seq":23,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.242948+0000","last_change":"2023-07-25T14:37:44.164996+0000","last_active":"2023-07-25T14:37:56.242948+0000","last_peered":"2023-07-25T14:37:56.242948+0000","last_clean":"2023-07-25T14:37:56.242948+0000","last_became_active":"2023-07-25T14:37:44.164753+0000","last_became_peered":"2023-07-25T14:37:44.164753+0000","last_unstale":"2023-07-25T14:37:56.242948+0000","last_undegraded":"2023-07-25T14:37:56.242948+0000","last_fullsized":"2023-07-25T14:37:56.242948+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T20:02:33.029907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-25T14:37:57.230919+0000","last_change":"2023-07-25T14:37:57.230919+0000","last_active":"2023-07-25T14:37:57.230919+0000","last_peered":"2023-07-25T14:37:57.230919+0000","last_clean":"2023-07-25T14:37:57.230919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:57.230919+0000","last_undegraded":"2023-07-25T14:37:57.230919+0000","last_fullsized":"2023-07-25T14:37:57.230919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2023-07-25T14:37:56.233730+0000","last_change":"2023-07-25T14:37:56.233730+0000","last_active":"2023-07-25T14:37:56.225499+0000","last_peered":"2023-07-25T14:37:56.225499+0000","last_clean":"2023-07-25T14:37:56.225499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:56.233730+0000","last_undegraded":"2023-07-25T14:37:56.233730+0000","last_fullsized":"2023-07-25T14:37:56.233730+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_clean_scrub_stamp":"2023-07-25T14:37:56.225499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.242531+0000","last_change":"2023-07-25T14:37:45.192838+0000","last_active":"2023-07-25T14:37:56.242531+0000","last_peered":"2023-07-25T14:37:56.242531+0000","last_clean":"2023-07-25T14:37:56.242531+0000","last_became_active":"2023-07-25T14:37:45.192552+0000","last_became_peered":"2023-07-25T14:37:45.192552+0000","last_unstale":"2023-07-25T14:37:56.242531+0000","last_undegraded":"2023-07-25T14:37:56.242531+0000","last_fullsized":"2023-07-25T14:37:56.242531+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T01:50:14.013418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"56'2","reported_seq":17,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.236250+0000","last_change":"2023-07-25T14:37:44.163016+0000","last_active":"2023-07-25T14:37:56.236250+0000","last_peered":"2023-07-25T14:37:56.236250+0000","last_clean":"2023-07-25T14:37:56.236250+0000","last_became_active":"2023-07-25T14:37:44.161974+0000","last_became_peered":"2023-07-25T14:37:44.161974+0000","last_unstale":"2023-07-25T14:37:56.236250+0000","last_undegraded":"2023-07-25T14:37:56.236250+0000","last_fullsized":"2023-07-25T14:37:56.236250+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T16:44:38.539954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-25T14:37:57.230919+0000","last_change":"2023-07-25T14:37:57.230919+0000","last_active":"2023-07-25T14:37:57.230919+0000","last_peered":"2023-07-25T14:37:57.230919+0000","last_clean":"2023-07-25T14:37:57.230919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:57.230919+0000","last_undegraded":"2023-07-25T14:37:57.230919+0000","last_fullsized":"2023-07-25T14:37:57.230919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2023-07-25T14:37:56.239090+0000","last_change":"2023-07-25T14:37:56.239090+0000","last_active":"2023-07-25T14:37:56.225499+0000","last_peered":"2023-07-25T14:37:56.225499+0000","last_clean":"2023-07-25T14:37:56.225499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:56.239090+0000","last_undegraded":"2023-07-25T14:37:56.239090+0000","last_fullsized":"2023-07-25T14:37:56.239090+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_clean_scrub_stamp":"2023-07-25T14:37:56.225499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.242222+0000","last_change":"2023-07-25T14:37:45.198281+0000","last_active":"2023-07-25T14:37:56.242222+0000","last_peered":"2023-07-25T14:37:56.242222+0000","last_clean":"2023-07-25T14:37:56.242222+0000","last_became_active":"2023-07-25T14:37:45.197975+0000","last_became_peered":"2023-07-25T14:37:45.197975+0000","last_unstale":"2023-07-25T14:37:56.242222+0000","last_undegraded":"2023-07-25T14:37:56.242222+0000","last_fullsized":"2023-07-25T14:37:56.242222+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T19:23:52.464351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"57'1","reported_seq":16,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.242513+0000","last_change":"2023-07-25T14:37:44.166254+0000","last_active":"2023-07-25T14:37:56.242513+0000","last_peered":"2023-07-25T14:37:56.242513+0000","last_clean":"2023-07-25T14:37:56.242513+0000","last_became_active":"2023-07-25T14:37:44.165974+0000","last_became_peered":"2023-07-25T14:37:44.165974+0000","last_unstale":"2023-07-25T14:37:56.242513+0000","last_undegraded":"2023-07-25T14:37:56.242513+0000","last_fullsized":"2023-07-25T14:37:56.242513+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T23:57:11.656266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-25T14:37:57.230919+0000","last_change":"2023-07-25T14:37:57.230919+0000","last_active":"2023-07-25T14:37:57.230919+0000","last_peered":"2023-07-25T14:37:57.230919+0000","last_clean":"2023-07-25T14:37:57.230919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:57.230919+0000","last_undegraded":"2023-07-25T14:37:57.230919+0000","last_fullsized":"2023-07-25T14:37:57.230919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2023-07-25T14:37:56.241742+0000","last_change":"2023-07-25T14:37:56.241742+0000","last_active":"2023-07-25T14:37:56.225499+0000","last_peered":"2023-07-25T14:37:56.225499+0000","last_clean":"2023-07-25T14:37:56.225499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:56.241742+0000","last_undegraded":"2023-07-25T14:37:56.241742+0000","last_fullsized":"2023-07-25T14:37:56.241742+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_clean_scrub_stamp":"2023-07-25T14:37:56.225499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.241475+0000","last_change":"2023-07-25T14:37:45.209704+0000","last_active":"2023-07-25T14:37:56.241475+0000","last_peered":"2023-07-25T14:37:56.241475+0000","last_clean":"2023-07-25T14:37:56.241475+0000","last_became_active":"2023-07-25T14:37:45.209391+0000","last_became_peered":"2023-07-25T14:37:45.209391+0000","last_unstale":"2023-07-25T14:37:56.241475+0000","last_undegraded":"2023-07-25T14:37:56.241475+0000","last_fullsized":"2023-07-25T14:37:56.241475+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:47:46.269974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.238952+0000","last_change":"2023-07-25T14:37:44.166101+0000","last_active":"2023-07-25T14:37:56.238952+0000","last_peered":"2023-07-25T14:37:56.238952+0000","last_clean":"2023-07-25T14:37:56.238952+0000","last_became_active":"2023-07-25T14:37:44.165823+0000","last_became_peered":"2023-07-25T14:37:44.165823+0000","last_unstale":"2023-07-25T14:37:56.238952+0000","last_undegraded":"2023-07-25T14:37:56.238952+0000","last_fullsized":"2023-07-25T14:37:56.238952+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T19:40:08.768720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-25T14:37:57.230919+0000","last_change":"2023-07-25T14:37:57.230919+0000","last_active":"2023-07-25T14:37:57.230919+0000","last_peered":"2023-07-25T14:37:57.230919+0000","last_clean":"2023-07-25T14:37:57.230919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:57.230919+0000","last_undegraded":"2023-07-25T14:37:57.230919+0000","last_fullsized":"2023-07-25T14:37:57.230919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2023-07-25T14:37:56.239766+0000","last_change":"2023-07-25T14:37:56.239766+0000","last_active":"2023-07-25T14:37:56.225499+0000","last_peered":"2023-07-25T14:37:56.225499+0000","last_clean":"2023-07-25T14:37:56.225499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:56.239766+0000","last_undegraded":"2023-07-25T14:37:56.239766+0000","last_fullsized":"2023-07-25T14:37:56.239766+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_clean_scrub_stamp":"2023-07-25T14:37:56.225499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.241992+0000","last_change":"2023-07-25T14:37:45.207757+0000","last_active":"2023-07-25T14:37:56.241992+0000","last_peered":"2023-07-25T14:37:56.241992+0000","last_clean":"2023-07-25T14:37:56.241992+0000","last_became_active":"2023-07-25T14:37:45.204097+0000","last_became_peered":"2023-07-25T14:37:45.204097+0000","last_unstale":"2023-07-25T14:37:56.241992+0000","last_undegraded":"2023-07-25T14:37:56.241992+0000","last_fullsized":"2023-07-25T14:37:56.241992+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T15:01:23.982072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.242439+0000","last_change":"2023-07-25T14:37:44.170019+0000","last_active":"2023-07-25T14:37:56.242439+0000","last_peered":"2023-07-25T14:37:56.242439+0000","last_clean":"2023-07-25T14:37:56.242439+0000","last_became_active":"2023-07-25T14:37:44.169764+0000","last_became_peered":"2023-07-25T14:37:44.169764+0000","last_unstale":"2023-07-25T14:37:56.242439+0000","last_undegraded":"2023-07-25T14:37:56.242439+0000","last_fullsized":"2023-07-25T14:37:56.242439+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T23:03:53.386487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-25T14:37:57.230919+0000","last_change":"2023-07-25T14:37:57.230919+0000","last_active":"2023-07-25T14:37:57.230919+0000","last_peered":"2023-07-25T14:37:57.230919+0000","last_clean":"2023-07-25T14:37:57.230919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:57.230919+0000","last_undegraded":"2023-07-25T14:37:57.230919+0000","last_fullsized":"2023-07-25T14:37:57.230919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2023-07-25T14:37:56.233790+0000","last_change":"2023-07-25T14:37:56.233790+0000","last_active":"2023-07-25T14:37:56.225499+0000","last_peered":"2023-07-25T14:37:56.225499+0000","last_clean":"2023-07-25T14:37:56.225499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:56.233790+0000","last_undegraded":"2023-07-25T14:37:56.233790+0000","last_fullsized":"2023-07-25T14:37:56.233790+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_clean_scrub_stamp":"2023-07-25T14:37:56.225499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.237171+0000","last_change":"2023-07-25T14:37:45.192706+0000","last_active":"2023-07-25T14:37:56.237171+0000","last_peered":"2023-07-25T14:37:56.237171+0000","last_clean":"2023-07-25T14:37:56.237171+0000","last_became_active":"2023-07-25T14:37:45.191283+0000","last_became_peered":"2023-07-25T14:37:45.191283+0000","last_unstale":"2023-07-25T14:37:56.237171+0000","last_undegraded":"2023-07-25T14:37:56.237171+0000","last_fullsized":"2023-07-25T14:37:56.237171+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T16:47:10.040613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.236854+0000","last_change":"2023-07-25T14:37:44.171694+0000","last_active":"2023-07-25T14:37:56.236854+0000","last_peered":"2023-07-25T14:37:56.236854+0000","last_clean":"2023-07-25T14:37:56.236854+0000","last_became_active":"2023-07-25T14:37:44.171465+0000","last_became_peered":"2023-07-25T14:37:44.171465+0000","last_unstale":"2023-07-25T14:37:56.236854+0000","last_undegraded":"2023-07-25T14:37:56.236854+0000","last_fullsized":"2023-07-25T14:37:56.236854+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T02:37:00.422225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-25T14:37:57.230919+0000","last_change":"2023-07-25T14:37:57.230919+0000","last_active":"2023-07-25T14:37:57.230919+0000","last_peered":"2023-07-25T14:37:57.230919+0000","last_clean":"2023-07-25T14:37:57.230919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:57.230919+0000","last_undegraded":"2023-07-25T14:37:57.230919+0000","last_fullsized":"2023-07-25T14:37:57.230919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2023-07-25T14:37:56.233794+0000","last_change":"2023-07-25T14:37:56.233794+0000","last_active":"2023-07-25T14:37:56.225499+0000","last_peered":"2023-07-25T14:37:56.225499+0000","last_clean":"2023-07-25T14:37:56.225499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:56.233794+0000","last_undegraded":"2023-07-25T14:37:56.233794+0000","last_fullsized":"2023-07-25T14:37:56.233794+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_clean_scrub_stamp":"2023-07-25T14:37:56.225499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.235432+0000","last_change":"2023-07-25T14:37:45.208487+0000","last_active":"2023-07-25T14:37:56.235432+0000","last_peered":"2023-07-25T14:37:56.235432+0000","last_clean":"2023-07-25T14:37:56.235432+0000","last_became_active":"2023-07-25T14:37:45.207037+0000","last_became_peered":"2023-07-25T14:37:45.207037+0000","last_unstale":"2023-07-25T14:37:56.235432+0000","last_undegraded":"2023-07-25T14:37:56.235432+0000","last_fullsized":"2023-07-25T14:37:56.235432+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T19:32:42.982355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.238099+0000","last_change":"2023-07-25T14:37:44.165012+0000","last_active":"2023-07-25T14:37:56.238099+0000","last_peered":"2023-07-25T14:37:56.238099+0000","last_clean":"2023-07-25T14:37:56.238099+0000","last_became_active":"2023-07-25T14:37:44.164759+0000","last_became_peered":"2023-07-25T14:37:44.164759+0000","last_unstale":"2023-07-25T14:37:56.238099+0000","last_undegraded":"2023-07-25T14:37:56.238099+0000","last_fullsized":"2023-07-25T14:37:56.238099+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T15:03:37.728247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-25T14:37:57.230919+0000","last_change":"2023-07-25T14:37:57.230919+0000","last_active":"2023-07-25T14:37:57.230919+0000","last_peered":"2023-07-25T14:37:57.230919+0000","last_clean":"2023-07-25T14:37:57.230919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:57.230919+0000","last_undegraded":"2023-07-25T14:37:57.230919+0000","last_fullsized":"2023-07-25T14:37:57.230919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2023-07-25T14:37:56.237604+0000","last_change":"2023-07-25T14:37:56.237604+0000","last_active":"2023-07-25T14:37:56.225499+0000","last_peered":"2023-07-25T14:37:56.225499+0000","last_clean":"2023-07-25T14:37:56.225499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:56.237604+0000","last_undegraded":"2023-07-25T14:37:56.237604+0000","last_fullsized":"2023-07-25T14:37:56.237604+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_clean_scrub_stamp":"2023-07-25T14:37:56.225499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.238472+0000","last_change":"2023-07-25T14:37:45.191681+0000","last_active":"2023-07-25T14:37:56.238472+0000","last_peered":"2023-07-25T14:37:56.238472+0000","last_clean":"2023-07-25T14:37:56.238472+0000","last_became_active":"2023-07-25T14:37:45.188974+0000","last_became_peered":"2023-07-25T14:37:45.188974+0000","last_unstale":"2023-07-25T14:37:56.238472+0000","last_undegraded":"2023-07-25T14:37:56.238472+0000","last_fullsized":"2023-07-25T14:37:56.238472+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T01:29:49.398716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.238871+0000","last_change":"2023-07-25T14:37:44.164983+0000","last_active":"2023-07-25T14:37:56.238871+0000","last_peered":"2023-07-25T14:37:56.238871+0000","last_clean":"2023-07-25T14:37:56.238871+0000","last_became_active":"2023-07-25T14:37:44.164413+0000","last_became_peered":"2023-07-25T14:37:44.164413+0000","last_unstale":"2023-07-25T14:37:56.238871+0000","last_undegraded":"2023-07-25T14:37:56.238871+0000","last_fullsized":"2023-07-25T14:37:56.238871+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T19:33:45.354123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-25T14:37:57.230919+0000","last_change":"2023-07-25T14:37:57.230919+0000","last_active":"2023-07-25T14:37:57.230919+0000","last_peered":"2023-07-25T14:37:57.230919+0000","last_clean":"2023-07-25T14:37:57.230919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:57.230919+0000","last_undegraded":"2023-07-25T14:37:57.230919+0000","last_fullsized":"2023-07-25T14:37:57.230919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2023-07-25T14:37:56.237505+0000","last_change":"2023-07-25T14:37:56.237505+0000","last_active":"2023-07-25T14:37:56.225499+0000","last_peered":"2023-07-25T14:37:56.225499+0000","last_clean":"2023-07-25T14:37:56.225499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:56.237505+0000","last_undegraded":"2023-07-25T14:37:56.237505+0000","last_fullsized":"2023-07-25T14:37:56.237505+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_clean_scrub_stamp":"2023-07-25T14:37:56.225499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.235269+0000","last_change":"2023-07-25T14:37:45.192970+0000","last_active":"2023-07-25T14:37:56.235269+0000","last_peered":"2023-07-25T14:37:56.235269+0000","last_clean":"2023-07-25T14:37:56.235269+0000","last_became_active":"2023-07-25T14:37:45.192666+0000","last_became_peered":"2023-07-25T14:37:45.192666+0000","last_unstale":"2023-07-25T14:37:56.235269+0000","last_undegraded":"2023-07-25T14:37:56.235269+0000","last_fullsized":"2023-07-25T14:37:56.235269+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T01:13:02.903330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.235440+0000","last_change":"2023-07-25T14:37:44.168526+0000","last_active":"2023-07-25T14:37:56.235440+0000","last_peered":"2023-07-25T14:37:56.235440+0000","last_clean":"2023-07-25T14:37:56.235440+0000","last_became_active":"2023-07-25T14:37:44.168336+0000","last_became_peered":"2023-07-25T14:37:44.168336+0000","last_unstale":"2023-07-25T14:37:56.235440+0000","last_undegraded":"2023-07-25T14:37:56.235440+0000","last_fullsized":"2023-07-25T14:37:56.235440+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:51:48.991901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-25T14:37:57.230919+0000","last_change":"2023-07-25T14:37:57.230919+0000","last_active":"2023-07-25T14:37:57.230919+0000","last_peered":"2023-07-25T14:37:57.230919+0000","last_clean":"2023-07-25T14:37:57.230919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:57.230919+0000","last_undegraded":"2023-07-25T14:37:57.230919+0000","last_fullsized":"2023-07-25T14:37:57.230919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2023-07-25T14:37:56.235599+0000","last_change":"2023-07-25T14:37:56.235599+0000","last_active":"2023-07-25T14:37:56.225499+0000","last_peered":"2023-07-25T14:37:56.225499+0000","last_clean":"2023-07-25T14:37:56.225499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:56.235599+0000","last_undegraded":"2023-07-25T14:37:56.235599+0000","last_fullsized":"2023-07-25T14:37:56.235599+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_clean_scrub_stamp":"2023-07-25T14:37:56.225499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.238911+0000","last_change":"2023-07-25T14:37:45.202784+0000","last_active":"2023-07-25T14:37:56.238911+0000","last_peered":"2023-07-25T14:37:56.238911+0000","last_clean":"2023-07-25T14:37:56.238911+0000","last_became_active":"2023-07-25T14:37:45.202515+0000","last_became_peered":"2023-07-25T14:37:45.202515+0000","last_unstale":"2023-07-25T14:37:56.238911+0000","last_undegraded":"2023-07-25T14:37:56.238911+0000","last_fullsized":"2023-07-25T14:37:56.238911+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T18:18:15.313003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.241632+0000","last_change":"2023-07-25T14:37:44.170162+0000","last_active":"2023-07-25T14:37:56.241632+0000","last_peered":"2023-07-25T14:37:56.241632+0000","last_clean":"2023-07-25T14:37:56.241632+0000","last_became_active":"2023-07-25T14:37:44.169805+0000","last_became_peered":"2023-07-25T14:37:44.169805+0000","last_unstale":"2023-07-25T14:37:56.241632+0000","last_undegraded":"2023-07-25T14:37:56.241632+0000","last_fullsized":"2023-07-25T14:37:56.241632+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T16:03:20.849610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":86,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.236146+0000","last_change":"2023-07-25T14:35:34.370772+0000","last_active":"2023-07-25T14:37:56.236146+0000","last_peered":"2023-07-25T14:37:56.236146+0000","last_clean":"2023-07-25T14:37:56.236146+0000","last_became_active":"2023-07-25T14:35:34.370549+0000","last_became_peered":"2023-07-25T14:35:34.370549+0000","last_unstale":"2023-07-25T14:37:56.236146+0000","last_undegraded":"2023-07-25T14:37:56.236146+0000","last_fullsized":"2023-07-25T14:37:56.236146+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_clean_scrub_stamp":"2023-07-25T14:35:33.358525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T01:59:55.322786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-25T14:37:57.230919+0000","last_change":"2023-07-25T14:37:57.230919+0000","last_active":"2023-07-25T14:37:57.230919+0000","last_peered":"2023-07-25T14:37:57.230919+0000","last_clean":"2023-07-25T14:37:57.230919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:57.230919+0000","last_undegraded":"2023-07-25T14:37:57.230919+0000","last_fullsized":"2023-07-25T14:37:57.230919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2023-07-25T14:37:56.235410+0000","last_change":"2023-07-25T14:37:56.235410+0000","last_active":"2023-07-25T14:37:56.225499+0000","last_peered":"2023-07-25T14:37:56.225499+0000","last_clean":"2023-07-25T14:37:56.225499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:56.235410+0000","last_undegraded":"2023-07-25T14:37:56.235410+0000","last_fullsized":"2023-07-25T14:37:56.235410+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_clean_scrub_stamp":"2023-07-25T14:37:56.225499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.238766+0000","last_change":"2023-07-25T14:37:45.194744+0000","last_active":"2023-07-25T14:37:56.238766+0000","last_peered":"2023-07-25T14:37:56.238766+0000","last_clean":"2023-07-25T14:37:56.238766+0000","last_became_active":"2023-07-25T14:37:45.194393+0000","last_became_peered":"2023-07-25T14:37:45.194393+0000","last_unstale":"2023-07-25T14:37:56.238766+0000","last_undegraded":"2023-07-25T14:37:56.238766+0000","last_fullsized":"2023-07-25T14:37:56.238766+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T01:41:30.373912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"56'1","reported_seq":16,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.236115+0000","last_change":"2023-07-25T14:37:44.166450+0000","last_active":"2023-07-25T14:37:56.236115+0000","last_peered":"2023-07-25T14:37:56.236115+0000","last_clean":"2023-07-25T14:37:56.236115+0000","last_became_active":"2023-07-25T14:37:44.165513+0000","last_became_peered":"2023-07-25T14:37:44.165513+0000","last_unstale":"2023-07-25T14:37:56.236115+0000","last_undegraded":"2023-07-25T14:37:56.236115+0000","last_fullsized":"2023-07-25T14:37:56.236115+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T02:03:11.976899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":86,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.236198+0000","last_change":"2023-07-25T14:35:35.321055+0000","last_active":"2023-07-25T14:37:56.236198+0000","last_peered":"2023-07-25T14:37:56.236198+0000","last_clean":"2023-07-25T14:37:56.236198+0000","last_became_active":"2023-07-25T14:35:35.320739+0000","last_became_peered":"2023-07-25T14:35:35.320739+0000","last_unstale":"2023-07-25T14:37:56.236198+0000","last_undegraded":"2023-07-25T14:37:56.236198+0000","last_fullsized":"2023-07-25T14:37:56.236198+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_clean_scrub_stamp":"2023-07-25T14:35:33.358525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T23:11:47.873574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-25T14:37:57.230919+0000","last_change":"2023-07-25T14:37:57.230919+0000","last_active":"2023-07-25T14:37:57.230919+0000","last_peered":"2023-07-25T14:37:57.230919+0000","last_clean":"2023-07-25T14:37:57.230919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:57.230919+0000","last_undegraded":"2023-07-25T14:37:57.230919+0000","last_fullsized":"2023-07-25T14:37:57.230919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2023-07-25T14:37:56.240548+0000","last_change":"2023-07-25T14:37:56.240548+0000","last_active":"2023-07-25T14:37:56.225499+0000","last_peered":"2023-07-25T14:37:56.225499+0000","last_clean":"2023-07-25T14:37:56.225499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:56.240548+0000","last_undegraded":"2023-07-25T14:37:56.240548+0000","last_fullsized":"2023-07-25T14:37:56.240548+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_clean_scrub_stamp":"2023-07-25T14:37:56.225499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.237936+0000","last_change":"2023-07-25T14:37:45.197932+0000","last_active":"2023-07-25T14:37:56.237936+0000","last_peered":"2023-07-25T14:37:56.237936+0000","last_clean":"2023-07-25T14:37:56.237936+0000","last_became_active":"2023-07-25T14:37:45.197610+0000","last_became_peered":"2023-07-25T14:37:45.197610+0000","last_unstale":"2023-07-25T14:37:56.237936+0000","last_undegraded":"2023-07-25T14:37:56.237936+0000","last_fullsized":"2023-07-25T14:37:56.237936+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T17:21:58.816449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.235698+0000","last_change":"2023-07-25T14:37:44.166137+0000","last_active":"2023-07-25T14:37:56.235698+0000","last_peered":"2023-07-25T14:37:56.235698+0000","last_clean":"2023-07-25T14:37:56.235698+0000","last_became_active":"2023-07-25T14:37:44.165836+0000","last_became_peered":"2023-07-25T14:37:44.165836+0000","last_unstale":"2023-07-25T14:37:56.235698+0000","last_undegraded":"2023-07-25T14:37:56.235698+0000","last_fullsized":"2023-07-25T14:37:56.235698+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T22:13:50.667407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":94,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.242261+0000","last_change":"2023-07-25T14:35:35.321057+0000","last_active":"2023-07-25T14:37:56.242261+0000","last_peered":"2023-07-25T14:37:56.242261+0000","last_clean":"2023-07-25T14:37:56.242261+0000","last_became_active":"2023-07-25T14:35:35.320751+0000","last_became_peered":"2023-07-25T14:35:35.320751+0000","last_unstale":"2023-07-25T14:37:56.242261+0000","last_undegraded":"2023-07-25T14:37:56.242261+0000","last_fullsized":"2023-07-25T14:37:56.242261+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_clean_scrub_stamp":"2023-07-25T14:35:33.358525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T18:48:18.863459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-25T14:37:57.230919+0000","last_change":"2023-07-25T14:37:57.230919+0000","last_active":"2023-07-25T14:37:57.230919+0000","last_peered":"2023-07-25T14:37:57.230919+0000","last_clean":"2023-07-25T14:37:57.230919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:57.230919+0000","last_undegraded":"2023-07-25T14:37:57.230919+0000","last_fullsized":"2023-07-25T14:37:57.230919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2023-07-25T14:37:56.239538+0000","last_change":"2023-07-25T14:37:56.239538+0000","last_active":"2023-07-25T14:37:56.225499+0000","last_peered":"2023-07-25T14:37:56.225499+0000","last_clean":"2023-07-25T14:37:56.225499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:56.239538+0000","last_undegraded":"2023-07-25T14:37:56.239538+0000","last_fullsized":"2023-07-25T14:37:56.239538+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_clean_scrub_stamp":"2023-07-25T14:37:56.225499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.237322+0000","last_change":"2023-07-25T14:37:45.195875+0000","last_active":"2023-07-25T14:37:56.237322+0000","last_peered":"2023-07-25T14:37:56.237322+0000","last_clean":"2023-07-25T14:37:56.237322+0000","last_became_active":"2023-07-25T14:37:45.195516+0000","last_became_peered":"2023-07-25T14:37:45.195516+0000","last_unstale":"2023-07-25T14:37:56.237322+0000","last_undegraded":"2023-07-25T14:37:56.237322+0000","last_fullsized":"2023-07-25T14:37:56.237322+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:37:15.728996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"56'2","reported_seq":17,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.235795+0000","last_change":"2023-07-25T14:37:44.167253+0000","last_active":"2023-07-25T14:37:56.235795+0000","last_peered":"2023-07-25T14:37:56.235795+0000","last_clean":"2023-07-25T14:37:56.235795+0000","last_became_active":"2023-07-25T14:37:44.166775+0000","last_became_peered":"2023-07-25T14:37:44.166775+0000","last_unstale":"2023-07-25T14:37:56.235795+0000","last_undegraded":"2023-07-25T14:37:56.235795+0000","last_fullsized":"2023-07-25T14:37:56.235795+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T15:57:42.466633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":86,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.240370+0000","last_change":"2023-07-25T14:35:35.321201+0000","last_active":"2023-07-25T14:37:56.240370+0000","last_peered":"2023-07-25T14:37:56.240370+0000","last_clean":"2023-07-25T14:37:56.240370+0000","last_became_active":"2023-07-25T14:35:35.320728+0000","last_became_peered":"2023-07-25T14:35:35.320728+0000","last_unstale":"2023-07-25T14:37:56.240370+0000","last_undegraded":"2023-07-25T14:37:56.240370+0000","last_fullsized":"2023-07-25T14:37:56.240370+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_clean_scrub_stamp":"2023-07-25T14:35:33.358525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T17:00:21.146168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-25T14:37:57.230919+0000","last_change":"2023-07-25T14:37:57.230919+0000","last_active":"2023-07-25T14:37:57.230919+0000","last_peered":"2023-07-25T14:37:57.230919+0000","last_clean":"2023-07-25T14:37:57.230919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:57.230919+0000","last_undegraded":"2023-07-25T14:37:57.230919+0000","last_fullsized":"2023-07-25T14:37:57.230919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2023-07-25T14:37:56.233775+0000","last_change":"2023-07-25T14:37:56.233775+0000","last_active":"2023-07-25T14:37:56.225499+0000","last_peered":"2023-07-25T14:37:56.225499+0000","last_clean":"2023-07-25T14:37:56.225499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:56.233775+0000","last_undegraded":"2023-07-25T14:37:56.233775+0000","last_fullsized":"2023-07-25T14:37:56.233775+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_clean_scrub_stamp":"2023-07-25T14:37:56.225499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.237169+0000","last_change":"2023-07-25T14:37:45.209554+0000","last_active":"2023-07-25T14:37:56.237169+0000","last_peered":"2023-07-25T14:37:56.237169+0000","last_clean":"2023-07-25T14:37:56.237169+0000","last_became_active":"2023-07-25T14:37:45.209319+0000","last_became_peered":"2023-07-25T14:37:45.209319+0000","last_unstale":"2023-07-25T14:37:56.237169+0000","last_undegraded":"2023-07-25T14:37:56.237169+0000","last_fullsized":"2023-07-25T14:37:56.237169+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:16:02.561651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.242024+0000","last_change":"2023-07-25T14:37:44.172803+0000","last_active":"2023-07-25T14:37:56.242024+0000","last_peered":"2023-07-25T14:37:56.242024+0000","last_clean":"2023-07-25T14:37:56.242024+0000","last_became_active":"2023-07-25T14:37:44.172512+0000","last_became_peered":"2023-07-25T14:37:44.172512+0000","last_unstale":"2023-07-25T14:37:56.242024+0000","last_undegraded":"2023-07-25T14:37:56.242024+0000","last_fullsized":"2023-07-25T14:37:56.242024+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T19:26:08.957564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":86,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.240143+0000","last_change":"2023-07-25T14:35:35.321448+0000","last_active":"2023-07-25T14:37:56.240143+0000","last_peered":"2023-07-25T14:37:56.240143+0000","last_clean":"2023-07-25T14:37:56.240143+0000","last_became_active":"2023-07-25T14:35:35.320830+0000","last_became_peered":"2023-07-25T14:35:35.320830+0000","last_unstale":"2023-07-25T14:37:56.240143+0000","last_undegraded":"2023-07-25T14:37:56.240143+0000","last_fullsized":"2023-07-25T14:37:56.240143+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_clean_scrub_stamp":"2023-07-25T14:35:33.358525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T19:31:35.569131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-25T14:37:57.230919+0000","last_change":"2023-07-25T14:37:57.230919+0000","last_active":"2023-07-25T14:37:57.230919+0000","last_peered":"2023-07-25T14:37:57.230919+0000","last_clean":"2023-07-25T14:37:57.230919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:57.230919+0000","last_undegraded":"2023-07-25T14:37:57.230919+0000","last_fullsized":"2023-07-25T14:37:57.230919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2023-07-25T14:37:56.241309+0000","last_change":"2023-07-25T14:37:56.241309+0000","last_active":"2023-07-25T14:37:56.225499+0000","last_peered":"2023-07-25T14:37:56.225499+0000","last_clean":"2023-07-25T14:37:56.225499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:56.241309+0000","last_undegraded":"2023-07-25T14:37:56.241309+0000","last_fullsized":"2023-07-25T14:37:56.241309+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_clean_scrub_stamp":"2023-07-25T14:37:56.225499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.236943+0000","last_change":"2023-07-25T14:37:45.207283+0000","last_active":"2023-07-25T14:37:56.236943+0000","last_peered":"2023-07-25T14:37:56.236943+0000","last_clean":"2023-07-25T14:37:56.236943+0000","last_became_active":"2023-07-25T14:37:45.206954+0000","last_became_peered":"2023-07-25T14:37:45.206954+0000","last_unstale":"2023-07-25T14:37:56.236943+0000","last_undegraded":"2023-07-25T14:37:56.236943+0000","last_fullsized":"2023-07-25T14:37:56.236943+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T22:12:27.941354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.242209+0000","last_change":"2023-07-25T14:37:44.172365+0000","last_active":"2023-07-25T14:37:56.242209+0000","last_peered":"2023-07-25T14:37:56.242209+0000","last_clean":"2023-07-25T14:37:56.242209+0000","last_became_active":"2023-07-25T14:37:44.172127+0000","last_became_peered":"2023-07-25T14:37:44.172127+0000","last_unstale":"2023-07-25T14:37:56.242209+0000","last_undegraded":"2023-07-25T14:37:56.242209+0000","last_fullsized":"2023-07-25T14:37:56.242209+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T01:35:45.274384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":236,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.240023+0000","last_change":"2023-07-25T14:35:34.372381+0000","last_active":"2023-07-25T14:37:56.240023+0000","last_peered":"2023-07-25T14:37:56.240023+0000","last_clean":"2023-07-25T14:37:56.240023+0000","last_became_active":"2023-07-25T14:35:34.371110+0000","last_became_peered":"2023-07-25T14:35:34.371110+0000","last_unstale":"2023-07-25T14:37:56.240023+0000","last_undegraded":"2023-07-25T14:37:56.240023+0000","last_fullsized":"2023-07-25T14:37:56.240023+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_clean_scrub_stamp":"2023-07-25T14:35:33.358525+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T01:20:46.377691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":84,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.238545+0000","last_change":"2023-07-25T14:35:34.370121+0000","last_active":"2023-07-25T14:37:56.238545+0000","last_peered":"2023-07-25T14:37:56.238545+0000","last_clean":"2023-07-25T14:37:56.238545+0000","last_became_active":"2023-07-25T14:35:34.369795+0000","last_became_peered":"2023-07-25T14:35:34.369795+0000","last_unstale":"2023-07-25T14:37:56.238545+0000","last_undegraded":"2023-07-25T14:37:56.238545+0000","last_fullsized":"2023-07-25T14:37:56.238545+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_clean_scrub_stamp":"2023-07-25T14:35:33.358525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:27:50.082204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-25T14:37:57.230919+0000","last_change":"2023-07-25T14:37:57.230919+0000","last_active":"2023-07-25T14:37:57.230919+0000","last_peered":"2023-07-25T14:37:57.230919+0000","last_clean":"2023-07-25T14:37:57.230919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:57.230919+0000","last_undegraded":"2023-07-25T14:37:57.230919+0000","last_fullsized":"2023-07-25T14:37:57.230919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2023-07-25T14:37:56.235573+0000","last_change":"2023-07-25T14:37:56.235573+0000","last_active":"2023-07-25T14:37:56.225499+0000","last_peered":"2023-07-25T14:37:56.225499+0000","last_clean":"2023-07-25T14:37:56.225499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:56.235573+0000","last_undegraded":"2023-07-25T14:37:56.235573+0000","last_fullsized":"2023-07-25T14:37:56.235573+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_clean_scrub_stamp":"2023-07-25T14:37:56.225499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.240395+0000","last_change":"2023-07-25T14:37:45.204523+0000","last_active":"2023-07-25T14:37:56.240395+0000","last_peered":"2023-07-25T14:37:56.240395+0000","last_clean":"2023-07-25T14:37:56.240395+0000","last_became_active":"2023-07-25T14:37:45.204095+0000","last_became_peered":"2023-07-25T14:37:45.204095+0000","last_unstale":"2023-07-25T14:37:56.240395+0000","last_undegraded":"2023-07-25T14:37:56.240395+0000","last_fullsized":"2023-07-25T14:37:56.240395+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T19:07:32.745444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"56'1","reported_seq":16,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.236521+0000","last_change":"2023-07-25T14:37:44.164092+0000","last_active":"2023-07-25T14:37:56.236521+0000","last_peered":"2023-07-25T14:37:56.236521+0000","last_clean":"2023-07-25T14:37:56.236521+0000","last_became_active":"2023-07-25T14:37:44.163068+0000","last_became_peered":"2023-07-25T14:37:44.163068+0000","last_unstale":"2023-07-25T14:37:56.236521+0000","last_undegraded":"2023-07-25T14:37:56.236521+0000","last_fullsized":"2023-07-25T14:37:56.236521+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T19:06:16.675638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":86,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.237280+0000","last_change":"2023-07-25T14:35:34.371737+0000","last_active":"2023-07-25T14:37:56.237280+0000","last_peered":"2023-07-25T14:37:56.237280+0000","last_clean":"2023-07-25T14:37:56.237280+0000","last_became_active":"2023-07-25T14:35:34.371411+0000","last_became_peered":"2023-07-25T14:35:34.371411+0000","last_unstale":"2023-07-25T14:37:56.237280+0000","last_undegraded":"2023-07-25T14:37:56.237280+0000","last_fullsized":"2023-07-25T14:37:56.237280+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_clean_scrub_stamp":"2023-07-25T14:35:33.358525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T14:39:57.304690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-25T14:37:57.230919+0000","last_change":"2023-07-25T14:37:57.230919+0000","last_active":"2023-07-25T14:37:57.230919+0000","last_peered":"2023-07-25T14:37:57.230919+0000","last_clean":"2023-07-25T14:37:57.230919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:57.230919+0000","last_undegraded":"2023-07-25T14:37:57.230919+0000","last_fullsized":"2023-07-25T14:37:57.230919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2023-07-25T14:37:56.235675+0000","last_change":"2023-07-25T14:37:56.235675+0000","last_active":"2023-07-25T14:37:56.225499+0000","last_peered":"2023-07-25T14:37:56.225499+0000","last_clean":"2023-07-25T14:37:56.225499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:56.235675+0000","last_undegraded":"2023-07-25T14:37:56.235675+0000","last_fullsized":"2023-07-25T14:37:56.235675+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_clean_scrub_stamp":"2023-07-25T14:37:56.225499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.242702+0000","last_change":"2023-07-25T14:37:45.204043+0000","last_active":"2023-07-25T14:37:56.242702+0000","last_peered":"2023-07-25T14:37:56.242702+0000","last_clean":"2023-07-25T14:37:56.242702+0000","last_became_active":"2023-07-25T14:37:45.203102+0000","last_became_peered":"2023-07-25T14:37:45.203102+0000","last_unstale":"2023-07-25T14:37:56.242702+0000","last_undegraded":"2023-07-25T14:37:56.242702+0000","last_fullsized":"2023-07-25T14:37:56.242702+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T18:53:31.784163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"56'2","reported_seq":17,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.240533+0000","last_change":"2023-07-25T14:37:44.167732+0000","last_active":"2023-07-25T14:37:56.240533+0000","last_peered":"2023-07-25T14:37:56.240533+0000","last_clean":"2023-07-25T14:37:56.240533+0000","last_became_active":"2023-07-25T14:37:44.167418+0000","last_became_peered":"2023-07-25T14:37:44.167418+0000","last_unstale":"2023-07-25T14:37:56.240533+0000","last_undegraded":"2023-07-25T14:37:56.240533+0000","last_fullsized":"2023-07-25T14:37:56.240533+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T18:04:34.335830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":92,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.239714+0000","last_change":"2023-07-25T14:35:34.371347+0000","last_active":"2023-07-25T14:37:56.239714+0000","last_peered":"2023-07-25T14:37:56.239714+0000","last_clean":"2023-07-25T14:37:56.239714+0000","last_became_active":"2023-07-25T14:35:34.371044+0000","last_became_peered":"2023-07-25T14:35:34.371044+0000","last_unstale":"2023-07-25T14:37:56.239714+0000","last_undegraded":"2023-07-25T14:37:56.239714+0000","last_fullsized":"2023-07-25T14:37:56.239714+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_clean_scrub_stamp":"2023-07-25T14:35:33.358525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:45:35.483366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":3869,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64510,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574881,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27768,"kb_used_data":744,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344072,"statfs":{"total":96636764160,"available":96608329728,"internally_reserved":0,"allocated":761856,"data_stored":917810,"data_compressed":32255,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jul 25 14:37:40 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.46999999999999997,"15min":0.46200000000000002},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.84299999999999997,"15min":0.90200000000000002},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.70699999999999996,"5min":9.1600000000000001,"15min":9.1600000000000001},"last":0.36199999999999999}]},{"osd":1,"last update":"Tue Jul 25 14:37:40 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.59299999999999997,"15min":0.60699999999999998},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.82699999999999996,"5min":1.5009999999999999,"15min":1.5009999999999999},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.61099999999999999,"15min":0.61799999999999999},"min":{"1min":0.45600000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.81100000000000005,"5min":1.526,"15min":1.526},"last":0.505}]},{"osd":2,"last update":"Tue Jul 25 14:37:40 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.54500000000000004,"15min":0.55400000000000005},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.71599999999999997,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.82899999999999996,"15min":0.873},"min":{"1min":0.38300000000000001,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.95399999999999996,"5min":8.1739999999999995,"15min":8.1739999999999995},"last":0.39400000000000002}]},{"osd":3,"last update":"Tue Jul 25 14:37:40 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.82499999999999996,"15min":0.875},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.81599999999999995,"5min":7.2279999999999998,"15min":7.2279999999999998},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.89600000000000002,"15min":0.93999999999999995},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.0029999999999999,"5min":7.1870000000000003,"15min":7.1870000000000003},"last":0.46400000000000002}]},{"osd":4,"last update":"Tue Jul 25 14:37:40 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.57999999999999996,"15min":0.57799999999999996},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.76600000000000001,"5min":1.254,"15min":1.254},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.59299999999999997,"15min":0.59599999999999997},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.877,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.58399999999999996}]},{"osd":5,"last update":"Tue Jul 25 14:37:40 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.52600000000000002,"5min":0.501,"15min":0.501},"max":{"1min":0.84699999999999998,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.55300000000000005}]},{"osd":6,"last update":"Tue Jul 25 14:37:40 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.45800000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.88,"5min":1.286,"15min":1.286},"last":0.621},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.64500000000000002,"15min":0.64400000000000002},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.63300000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574880,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27700,"kb_used_data":680,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344140,"statfs":{"total":96636764160,"available":96608399360,"internally_reserved":0,"allocated":696320,"data_stored":326918,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jul 25 14:37:35 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.54200000000000004,"15min":0.54800000000000004},"min":{"1min":0.32300000000000001,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.73199999999999998,"5min":1.9370000000000001,"15min":1.9370000000000001},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.56000000000000005,"15min":0.56599999999999995},"min":{"1min":0.39700000000000002,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.77200000000000002,"5min":2.6779999999999999,"15min":2.6779999999999999},"last":0.45300000000000001}]},{"osd":1,"last update":"Tue Jul 25 14:37:35 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.53500000000000003,"15min":0.54100000000000004},"min":{"1min":0.34599999999999997,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.70799999999999996,"5min":2.5720000000000001,"15min":2.5720000000000001},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.503,"5min":0.54500000000000004,"15min":0.55200000000000005},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.64800000000000002,"5min":1.6259999999999999,"15min":1.6259999999999999},"last":0.38100000000000001}]},{"osd":2,"last update":"Tue Jul 25 14:37:35 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.52700000000000002,"15min":0.52100000000000002},"min":{"1min":0.34399999999999997,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.79000000000000004,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.50600000000000001,"15min":0.501},"min":{"1min":0.375,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.68799999999999994,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.50600000000000001}]},{"osd":3,"last update":"Tue Jul 25 14:37:35 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.64900000000000002,"15min":0.66300000000000003},"min":{"1min":0.38600000000000001,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.73499999999999999,"5min":3.5750000000000002,"15min":3.5750000000000002},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.69899999999999995,"15min":0.71699999999999997},"min":{"1min":0.36499999999999999,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.77400000000000002,"5min":4.7190000000000003,"15min":4.7190000000000003},"last":0.59399999999999997}]},{"osd":4,"last update":"Tue Jul 25 14:37:35 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.65700000000000003,"15min":0.67200000000000004},"min":{"1min":0.39100000000000001,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.79700000000000004,"5min":4.694,"15min":4.694},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.622,"15min":0.628},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.74099999999999999,"5min":2.7839999999999998,"15min":2.7839999999999998},"last":0.496}]},{"osd":5,"last update":"Tue Jul 25 14:37:35 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.54500000000000004,"15min":0.54100000000000004},"min":{"1min":0.36199999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.752,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.624,"15min":0.627},"min":{"1min":0.376,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.82499999999999996,"5min":1.7310000000000001,"15min":1.7310000000000001},"last":0.623}]},{"osd":7,"last update":"Tue Jul 25 14:37:35 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.68799999999999994,"15min":0.69799999999999995},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.81299999999999994,"5min":2.7290000000000001,"15min":2.7290000000000001},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.58999999999999997,"15min":0.58199999999999996},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.60899999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574880,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27772,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344068,"statfs":{"total":96636764160,"available":96608325632,"internally_reserved":0,"allocated":774144,"data_stored":920881,"data_compressed":32255,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jul 25 14:37:39 2023","interfaces":[{"interface":"back","average":{"1min":0.314,"5min":0.318,"15min":0.318},"min":{"1min":0.23999999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.44500000000000001,"5min":0.47099999999999997,"15min":0.47099999999999997},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.312,"5min":0.32800000000000001,"15min":0.33000000000000002},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.44700000000000001,"5min":0.48899999999999999,"15min":0.48899999999999999},"last":0.23300000000000001}]},{"osd":2,"last update":"Tue Jul 25 14:37:39 2023","interfaces":[{"interface":"back","average":{"1min":0.29799999999999999,"5min":0.30599999999999999,"15min":0.308},"min":{"1min":0.20100000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"last":0.27300000000000002},{"interface":"front","average":{"1min":0.35399999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"min":{"1min":0.27200000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.45800000000000002,"5min":0.56499999999999995,"15min":0.56499999999999995},"last":0.38100000000000001}]},{"osd":3,"last update":"Tue Jul 25 14:37:39 2023","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.371,"15min":0.373},"min":{"1min":0.29699999999999999,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.432,"5min":0.52900000000000003,"15min":0.52900000000000003},"last":0.308},{"interface":"front","average":{"1min":0.33000000000000002,"5min":0.34499999999999997,"15min":0.34699999999999998},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.46999999999999997,"5min":0.496,"15min":0.496},"last":0.32400000000000001}]},{"osd":4,"last update":"Tue Jul 25 14:37:39 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.55300000000000005,"15min":0.55100000000000005},"min":{"1min":0.44900000000000001,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.78400000000000003,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.498},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.55400000000000005,"15min":0.55800000000000005},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.65100000000000002,"5min":0.745,"15min":0.745},"last":0.68799999999999994}]},{"osd":5,"last update":"Tue Jul 25 14:37:39 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.56100000000000005,"15min":0.55900000000000005},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.754,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.56399999999999995,"15min":0.56499999999999995},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.64800000000000002}]},{"osd":6,"last update":"Tue Jul 25 14:37:39 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.58099999999999996,"15min":0.58199999999999996},"min":{"1min":0.46000000000000002,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.70399999999999996,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.56899999999999995,"15min":0.57099999999999995},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.54300000000000004}]},{"osd":7,"last update":"Tue Jul 25 14:37:39 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.47699999999999998,"5min":0.443,"15min":0.443},"max":{"1min":0.71799999999999997,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.59599999999999997,"15min":0.59499999999999997},"min":{"1min":0.48399999999999999,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.74199999999999999,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.66100000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574880,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27688,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344152,"statfs":{"total":96636764160,"available":96608411648,"internally_reserved":0,"allocated":684032,"data_stored":325765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Jul 25 14:37:36 2023","interfaces":[{"interface":"back","average":{"1min":0.29899999999999999,"5min":0.35099999999999998,"15min":0.35899999999999999},"min":{"1min":0.17199999999999999,"5min":0.17199999999999999,"15min":0.17199999999999999},"max":{"1min":0.39000000000000001,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.26900000000000002},{"interface":"front","average":{"1min":0.28899999999999998,"5min":0.58899999999999997,"15min":0.63900000000000001},"min":{"1min":0.19600000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.37,"5min":6.5369999999999999,"15min":6.5369999999999999},"last":0.35499999999999998}]},{"osd":2,"last update":"Tue Jul 25 14:37:36 2023","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":0.36399999999999999,"15min":0.37},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.47599999999999998,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.37},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.63,"15min":0.67600000000000005},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.439,"5min":6.5659999999999998,"15min":6.5659999999999998},"last":0.38800000000000001}]},{"osd":3,"last update":"Tue Jul 25 14:37:36 2023","interfaces":[{"interface":"back","average":{"1min":0.33100000000000002,"5min":0.88700000000000001,"15min":0.97899999999999998},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.48799999999999999,"5min":12.449,"15min":12.449},"last":0.29899999999999999},{"interface":"front","average":{"1min":0.36199999999999999,"5min":0.40999999999999998,"15min":0.41799999999999998},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.45100000000000001,"5min":1.079,"15min":1.079},"last":0.32200000000000001}]},{"osd":4,"last update":"Tue Jul 25 14:37:36 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.79300000000000004,"15min":0.83199999999999996},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.71399999999999997,"5min":6.5099999999999998,"15min":6.5099999999999998},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.55600000000000005,"5min":1.0680000000000001,"15min":1.1539999999999999},"min":{"1min":0.35399999999999998,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.66100000000000003,"5min":12.35,"15min":12.35},"last":0.65700000000000003}]},{"osd":5,"last update":"Tue Jul 25 14:37:36 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.58699999999999997,"15min":0.58899999999999997},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.68100000000000005,"5min":1.107,"15min":1.107},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.82599999999999996,"15min":0.872},"min":{"1min":0.39000000000000001,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.76600000000000001,"5min":6.4349999999999996,"15min":6.4349999999999996},"last":0.67000000000000004}]},{"osd":6,"last update":"Tue Jul 25 14:37:36 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":1.0820000000000001,"15min":1.1679999999999999},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.74099999999999999,"5min":12.417,"15min":12.417},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.60799999999999998,"15min":0.61199999999999999},"min":{"1min":0.45000000000000001,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.68999999999999995,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.621}]},{"osd":7,"last update":"Tue Jul 25 14:37:36 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.85799999999999998,"15min":0.90400000000000003},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.67200000000000004,"5min":6.4809999999999999,"15min":6.4809999999999999},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.57799999999999996,"5min":1.091,"15min":1.177},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.77500000000000002,"5min":12.388999999999999,"15min":12.388999999999999},"last":0.60799999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574880,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27696,"kb_used_data":680,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344144,"statfs":{"total":96636764160,"available":96608403456,"internally_reserved":0,"allocated":696320,"data_stored":328836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jul 25 14:37:34 2023","interfaces":[{"interface":"back","average":{"1min":0.311,"5min":0.38200000000000001,"15min":0.39400000000000002},"min":{"1min":0.20399999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.39000000000000001,"5min":2.1030000000000002,"15min":2.1030000000000002},"last":0.22600000000000001},{"interface":"front","average":{"1min":0.27600000000000002,"5min":0.92800000000000005,"15min":1.0369999999999999},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":0.32900000000000001,"5min":16.969000000000001,"15min":16.969000000000001},"last":0.32000000000000001}]},{"osd":1,"last update":"Tue Jul 25 14:37:34 2023","interfaces":[{"interface":"back","average":{"1min":0.33400000000000002,"5min":0.35099999999999998,"15min":0.35399999999999998},"min":{"1min":0.26200000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.41899999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.34300000000000003,"5min":0.379,"15min":0.38500000000000001},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.50800000000000001,"5min":1.111,"15min":1.111},"last":0.251}]},{"osd":3,"last update":"Tue Jul 25 14:37:34 2023","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.79700000000000004,"15min":0.876},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.36799999999999999,"5min":13.035,"15min":13.035},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.376,"5min":0.40300000000000002,"15min":0.40699999999999997},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.61599999999999999,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.35799999999999998}]},{"osd":4,"last update":"Tue Jul 25 14:37:34 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.754,"15min":0.79200000000000004},"min":{"1min":0.39100000000000001,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.73099999999999998,"5min":6.165,"15min":6.165},"last":0.439},{"interface":"front","average":{"1min":0.55900000000000005,"5min":1.0069999999999999,"15min":1.0820000000000001},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.74199999999999999,"5min":13.004,"15min":13.004},"last":0.51300000000000001}]},{"osd":5,"last update":"Tue Jul 25 14:37:34 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.57199999999999995,"15min":0.57299999999999995},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.75800000000000001,"15min":0.79500000000000004},"min":{"1min":0.41299999999999998,"5min":0.378,"15min":0.378},"max":{"1min":0.69499999999999995,"5min":6.226,"15min":6.226},"last":0.46800000000000003}]},{"osd":6,"last update":"Tue Jul 25 14:37:34 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":1.006,"15min":1.0840000000000001},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.77400000000000002,"5min":12.974,"15min":12.974},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.59499999999999997,"15min":0.59699999999999998},"min":{"1min":0.42599999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.77200000000000002,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.501}]},{"osd":7,"last update":"Tue Jul 25 14:37:34 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.77900000000000003,"15min":0.81499999999999995},"min":{"1min":0.40899999999999997,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.70499999999999996,"5min":6.1989999999999998,"15min":6.1989999999999998},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.56699999999999995,"5min":1.026,"15min":1.1020000000000001},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.74199999999999999,"5min":12.936999999999999,"15min":12.936999999999999},"last":0.42899999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574880,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27696,"kb_used_data":676,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344144,"statfs":{"total":96636764160,"available":96608403456,"internally_reserved":0,"allocated":692224,"data_stored":325877,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jul 25 14:37:36 2023","interfaces":[{"interface":"back","average":{"1min":0.29999999999999999,"5min":0.312,"15min":0.314},"min":{"1min":0.20300000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"last":0.307},{"interface":"front","average":{"1min":0.32100000000000001,"5min":0.309,"15min":0.307},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.45400000000000001,"5min":0.46300000000000002,"15min":0.46300000000000002},"last":0.28399999999999997}]},{"osd":1,"last update":"Tue Jul 25 14:37:36 2023","interfaces":[{"interface":"back","average":{"1min":0.315,"5min":0.308,"15min":0.307},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"last":0.29799999999999999},{"interface":"front","average":{"1min":0.34200000000000003,"5min":0.36899999999999999,"15min":0.373},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.496,"5min":0.59099999999999997,"15min":0.59099999999999997},"last":0.35399999999999998}]},{"osd":2,"last update":"Tue Jul 25 14:37:36 2023","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":0.37,"15min":0.374},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.441,"5min":0.502,"15min":0.502},"last":0.26000000000000001},{"interface":"front","average":{"1min":0.35899999999999999,"5min":0.39300000000000002,"15min":0.39900000000000002},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.47299999999999998,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.41299999999999998}]},{"osd":4,"last update":"Tue Jul 25 14:37:36 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.57199999999999995,"15min":0.57399999999999995},"min":{"1min":0.42399999999999999,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.77000000000000002,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58799999999999997,"15min":0.58899999999999997},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.65400000000000003}]},{"osd":5,"last update":"Tue Jul 25 14:37:36 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.70999999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.625,"15min":0.63100000000000001},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.88100000000000001,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.60899999999999999}]},{"osd":6,"last update":"Tue Jul 25 14:37:36 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.61499999999999999,"15min":0.625},"min":{"1min":0.46300000000000002,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.68799999999999994,"5min":0.871,"15min":0.871},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.59399999999999997,"15min":0.59599999999999997},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.68300000000000005}]},{"osd":7,"last update":"Tue Jul 25 14:37:36 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.59099999999999997,"15min":0.58899999999999997},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.83599999999999997,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.628},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.60699999999999998,"15min":0.60899999999999999},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.55700000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574880,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27696,"kb_used_data":676,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344144,"statfs":{"total":96636764160,"available":96608403456,"internally_reserved":0,"allocated":692224,"data_stored":326896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jul 25 14:37:35 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.55500000000000005,"15min":0.56100000000000005},"min":{"1min":0.39600000000000002,"5min":0.31,"15min":0.31},"max":{"1min":0.75700000000000001,"5min":0.876,"15min":0.876},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.51100000000000001,"15min":0.51000000000000001},"min":{"1min":0.371,"5min":0.309,"15min":0.309},"max":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.48299999999999998}]},{"osd":1,"last update":"Tue Jul 25 14:37:35 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.69099999999999995,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.53600000000000003,"15min":0.53200000000000003},"min":{"1min":0.38900000000000001,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.70399999999999996,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.46300000000000002}]},{"osd":2,"last update":"Tue Jul 25 14:37:35 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.55500000000000005,"15min":0.54900000000000004},"min":{"1min":0.435,"5min":0.376,"15min":0.376},"max":{"1min":0.67600000000000005,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.54600000000000004,"15min":0.54200000000000004},"min":{"1min":0.41999999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.60999999999999999}]},{"osd":3,"last update":"Tue Jul 25 14:37:35 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.53600000000000003,"15min":0.53000000000000003},"min":{"1min":0.33000000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.73299999999999998,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.63,"15min":0.63800000000000001},"min":{"1min":0.47299999999999998,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.76100000000000001,"5min":1.8720000000000001,"15min":1.8720000000000001},"last":0.57699999999999996}]},{"osd":5,"last update":"Tue Jul 25 14:37:35 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.49099999999999999,"15min":0.47599999999999998},"min":{"1min":0.36399999999999999,"5min":0.317,"15min":0.317},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.61899999999999999,"15min":0.61599999999999999},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.748,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.58899999999999997}]},{"osd":6,"last update":"Tue Jul 25 14:37:35 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.54900000000000004,"15min":0.54100000000000004},"min":{"1min":0.41299999999999998,"5min":0.372,"15min":0.372},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.59899999999999998,"15min":0.60099999999999998},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.68999999999999995}]},{"osd":7,"last update":"Tue Jul 25 14:37:35 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.623,"15min":0.61899999999999999},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.79500000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.64600000000000002,"15min":0.64000000000000001},"min":{"1min":0.54900000000000004,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.63100000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574880,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27696,"kb_used_data":676,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344144,"statfs":{"total":96636764160,"available":96608403456,"internally_reserved":0,"allocated":692224,"data_stored":326916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jul 25 14:37:32 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.59799999999999998,"15min":0.60599999999999998},"min":{"1min":0.35399999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.83399999999999996,"5min":2.548,"15min":2.548},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.55700000000000005,"15min":0.56000000000000005},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.76500000000000001,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.51800000000000002}]},{"osd":1,"last update":"Tue Jul 25 14:37:32 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.58099999999999996,"15min":0.58499999999999996},"min":{"1min":0.39900000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.753,"5min":1.657,"15min":1.657},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.42599999999999999,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.79700000000000004,"5min":1.752,"15min":1.752},"last":0.56999999999999995}]},{"osd":2,"last update":"Tue Jul 25 14:37:32 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.56499999999999995,"15min":0.56699999999999995},"min":{"1min":0.38800000000000001,"5min":0.372,"15min":0.372},"max":{"1min":0.82899999999999996,"5min":0.872,"15min":0.872},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.54300000000000004,"15min":0.53400000000000003},"min":{"1min":0.46500000000000002,"5min":0.376,"15min":0.376},"max":{"1min":0.751,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.47199999999999998}]},{"osd":3,"last update":"Tue Jul 25 14:37:32 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.56399999999999995,"15min":0.55800000000000005},"min":{"1min":0.39900000000000002,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.504},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.60899999999999999,"15min":0.60499999999999998},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.49199999999999999}]},{"osd":4,"last update":"Tue Jul 25 14:37:32 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.52900000000000003,"15min":0.52700000000000002},"min":{"1min":0.38900000000000001,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.56100000000000005,"15min":0.55900000000000005},"min":{"1min":0.35499999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.55300000000000005}]},{"osd":6,"last update":"Tue Jul 25 14:37:32 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.56299999999999994,"15min":0.55400000000000005},"min":{"1min":0.42499999999999999,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.57099999999999995,"15min":0.56799999999999995},"min":{"1min":0.35999999999999999,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.44500000000000001}]},{"osd":7,"last update":"Tue Jul 25 14:37:32 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.58799999999999997,"15min":0.58199999999999996},"min":{"1min":0.41899999999999998,"5min":0.375,"15min":0.375},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.627,"5min":0.64400000000000002,"15min":0.64700000000000002},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.81399999999999995,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.46100000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32255,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32255,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3071,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-25T14:38:02.746 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-25T14:38:02.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.882+0000 7fe2582df700 1 Processor -- start 2023-07-25T14:38:02.894 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.883+0000 7fe2582df700 1 -- start start 2023-07-25T14:38:02.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.883+0000 7fe2582df700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe250155e60 0x7fe25015da90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:38:02.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.883+0000 7fe2582df700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe250066060 con 0x7fe25014f900 2023-07-25T14:38:02.900 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.883+0000 7fe2582df700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2501562d0 con 0x7fe25006b6d0 2023-07-25T14:38:02.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.883+0000 7fe2582df700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe25006ed90 con 0x7fe250155e60 2023-07-25T14:38:02.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.884+0000 7fe25687c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fe250155e60 0x7fe25015da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:38:02.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.884+0000 7fe25607b700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fe25014f900 0x7fe2500ab5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:34934/0 (socket says 172.21.15.72:34934) 2023-07-25T14:38:02.902 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.884+0000 7fe25607b700 1 -- 172.21.15.72:0/2576866441 learned_addr learned my addr 172.21.15.72:0/2576866441 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:38:02.902 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.884+0000 7fe25687c700 1 -- 172.21.15.72:0/2576866441 >> v1:172.21.15.92:6789/0 conn(0x7fe25006b6d0 legacy=0x7fe250155750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:38:02.902 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.884+0000 7fe25687c700 1 -- 172.21.15.72:0/2576866441 >> v1:172.21.15.72:6789/0 conn(0x7fe25014f900 legacy=0x7fe2500ab5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:38:02.902 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.884+0000 7fe255079700 1 -- 172.21.15.72:0/2576866441 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1198098341 0 0) 0x7fe250066060 con 0x7fe25014f900 2023-07-25T14:38:02.903 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.884+0000 7fe25687c700 1 -- 172.21.15.72:0/2576866441 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2500664f0 con 0x7fe250155e60 2023-07-25T14:38:02.903 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.884+0000 7fe25687c700 1 --2- 172.21.15.72:0/2576866441 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe250155e60 0x7fe25015da90 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7fe248009d90 tx=0x7fe24800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6375d1100a0b4ce4 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:38:02.903 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.884+0000 7fe255079700 1 -- 172.21.15.72:0/2576866441 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe24800e070 con 0x7fe250155e60 2023-07-25T14:38:02.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.884+0000 7fe255079700 1 -- 172.21.15.72:0/2576866441 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe24800bbd0 con 0x7fe250155e60 2023-07-25T14:38:02.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.884+0000 7fe255079700 1 -- 172.21.15.72:0/2576866441 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe248003a20 con 0x7fe250155e60 2023-07-25T14:38:02.904 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.885+0000 7fe2582df700 1 -- 172.21.15.72:0/2576866441 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe250155e60 msgr2=0x7fe25015da90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:38:02.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.885+0000 7fe2582df700 1 --2- 172.21.15.72:0/2576866441 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe250155e60 0x7fe25015da90 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7fe248009d90 tx=0x7fe24800b330 comp rx=0 tx=0).stop 2023-07-25T14:38:02.905 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.885+0000 7fe2582df700 1 -- 172.21.15.72:0/2576866441 shutdown_connections 2023-07-25T14:38:02.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.885+0000 7fe2582df700 1 --2- 172.21.15.72:0/2576866441 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe250155e60 0x7fe25015da90 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:38:02.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.885+0000 7fe2582df700 1 -- 172.21.15.72:0/2576866441 >> 172.21.15.72:0/2576866441 conn(0x7fe25006def0 msgr2=0x7fe25006e300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:38:02.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.885+0000 7fe2582df700 1 -- 172.21.15.72:0/2576866441 shutdown_connections 2023-07-25T14:38:02.906 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.885+0000 7fe2582df700 1 -- 172.21.15.72:0/2576866441 wait complete. 2023-07-25T14:38:02.907 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.886+0000 7fe2582df700 1 Processor -- start 2023-07-25T14:38:02.907 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.886+0000 7fe2582df700 1 -- start start 2023-07-25T14:38:02.907 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.886+0000 7fe2582df700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe25006b6d0 0x7fe2501e9e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:38:02.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.886+0000 7fe2582df700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe25014f900 0x7fe2500c5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:38:02.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.886+0000 7fe2582df700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe250155e60 0x7fe2500aaa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:38:02.908 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.886+0000 7fe2582df700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2501eaf00 con 0x7fe250155e60 2023-07-25T14:38:02.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.886+0000 7fe2582df700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2501ea3c0 con 0x7fe25006b6d0 2023-07-25T14:38:02.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.886+0000 7fe2582df700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2501ea660 con 0x7fe25014f900 2023-07-25T14:38:02.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.887+0000 7fe25687c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe250155e60 0x7fe2500aaa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:38:02.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.887+0000 7fe25687c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe250155e60 0x7fe2500aaa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:44206/0 (socket says 172.21.15.72:44206) 2023-07-25T14:38:02.909 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.887+0000 7fe25687c700 1 -- 172.21.15.72:0/4050506514 learned_addr learned my addr 172.21.15.72:0/4050506514 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:38:02.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.887+0000 7fe25607b700 1 --2- 172.21.15.72:0/4050506514 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe25006b6d0 0x7fe2501e9e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:38:02.910 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.887+0000 7fe25587a700 1 --2- 172.21.15.72:0/4050506514 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe25014f900 0x7fe2500c5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:38:02.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.887+0000 7fe25687c700 1 -- 172.21.15.72:0/4050506514 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe25014f900 msgr2=0x7fe2500c5810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:38:02.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.887+0000 7fe25687c700 1 --2- 172.21.15.72:0/4050506514 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe25014f900 0x7fe2500c5810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:38:02.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.887+0000 7fe25687c700 1 -- 172.21.15.72:0/4050506514 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe25006b6d0 msgr2=0x7fe2501e9e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:38:02.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.887+0000 7fe25687c700 1 --2- 172.21.15.72:0/4050506514 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe25006b6d0 0x7fe2501e9e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:38:02.911 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.887+0000 7fe25687c700 1 -- 172.21.15.72:0/4050506514 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe248009a70 con 0x7fe250155e60 2023-07-25T14:38:02.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.887+0000 7fe25607b700 1 --2- 172.21.15.72:0/4050506514 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe25006b6d0 0x7fe2501e9e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-25T14:38:02.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.887+0000 7fe25587a700 1 --2- 172.21.15.72:0/4050506514 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe25014f900 0x7fe2500c5810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-25T14:38:02.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.887+0000 7fe25687c700 1 --2- 172.21.15.72:0/4050506514 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe250155e60 0x7fe2500aaa30 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7fe250072820 tx=0x7fe248004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:38:02.912 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.887+0000 7fe246ffd700 1 -- 172.21.15.72:0/4050506514 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe248012630 con 0x7fe250155e60 2023-07-25T14:38:02.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.887+0000 7fe246ffd700 1 -- 172.21.15.72:0/4050506514 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2480127b0 con 0x7fe250155e60 2023-07-25T14:38:02.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.887+0000 7fe2582df700 1 -- 172.21.15.72:0/4050506514 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2501ea940 con 0x7fe250155e60 2023-07-25T14:38:02.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.887+0000 7fe246ffd700 1 -- 172.21.15.72:0/4050506514 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe248012b60 con 0x7fe250155e60 2023-07-25T14:38:02.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.887+0000 7fe2582df700 1 -- 172.21.15.72:0/4050506514 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2500aa510 con 0x7fe250155e60 2023-07-25T14:38:02.913 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.888+0000 7fe2582df700 1 -- 172.21.15.72:0/4050506514 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2500aa370 con 0x7fe250155e60 2023-07-25T14:38:02.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.889+0000 7fe246ffd700 1 -- 172.21.15.72:0/4050506514 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe248012cc0 con 0x7fe250155e60 2023-07-25T14:38:02.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.889+0000 7fe246ffd700 1 --2- 172.21.15.72:0/4050506514 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fe23406ace0 0x7fe23406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:38:02.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.889+0000 7fe246ffd700 1 -- 172.21.15.72:0/4050506514 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 7238+0+0 (secure 0 0 0) 0x7fe24808bf80 con 0x7fe250155e60 2023-07-25T14:38:02.914 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.889+0000 7fe25607b700 1 --2- 172.21.15.72:0/4050506514 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fe23406ace0 0x7fe23406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:38:02.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.889+0000 7fe25607b700 1 --2- 172.21.15.72:0/4050506514 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fe23406ace0 0x7fe23406d1a0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fe240000f60 tx=0x7fe240009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:38:02.915 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:02.893+0000 7fe246ffd700 1 -- 172.21.15.72:0/4050506514 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fe2500aa370 con 0x7fe250155e60 2023-07-25T14:38:03.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:03.074+0000 7fe2582df700 1 -- 172.21.15.72:0/4050506514 --> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe25006eab0 con 0x7fe23406ace0 2023-07-25T14:38:03.098 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:03.088+0000 7fe246ffd700 1 -- 172.21.15.72:0/4050506514 <== mgr.4104 v2:172.21.15.72:6832/1171220306 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+538395 (secure 0 0 0) 0x7fe240001cc0 con 0x7fe23406ace0 2023-07-25T14:38:03.104 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-25T14:38:03.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:03.092+0000 7fe2582df700 1 -- 172.21.15.72:0/4050506514 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fe23406ace0 msgr2=0x7fe23406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:38:03.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:03.092+0000 7fe2582df700 1 --2- 172.21.15.72:0/4050506514 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fe23406ace0 0x7fe23406d1a0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fe240000f60 tx=0x7fe240009040 comp rx=0 tx=0).stop 2023-07-25T14:38:03.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:03.092+0000 7fe2582df700 1 -- 172.21.15.72:0/4050506514 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe250155e60 msgr2=0x7fe2500aaa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:38:03.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:03.092+0000 7fe2582df700 1 --2- 172.21.15.72:0/4050506514 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe250155e60 0x7fe2500aaa30 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7fe250072820 tx=0x7fe248004ad0 comp rx=0 tx=0).stop 2023-07-25T14:38:03.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:03.092+0000 7fe2582df700 1 -- 172.21.15.72:0/4050506514 shutdown_connections 2023-07-25T14:38:03.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:03.092+0000 7fe2582df700 1 --2- 172.21.15.72:0/4050506514 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fe23406ace0 0x7fe23406d1a0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:38:03.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:03.092+0000 7fe2582df700 1 --2- 172.21.15.72:0/4050506514 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fe250155e60 0x7fe2500aaa30 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:38:03.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:03.092+0000 7fe2582df700 1 --2- 172.21.15.72:0/4050506514 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe25006b6d0 0x7fe2501e9e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:38:03.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:03.092+0000 7fe2582df700 1 --2- 172.21.15.72:0/4050506514 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fe25014f900 0x7fe2500c5810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:38:03.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:03.092+0000 7fe2582df700 1 -- 172.21.15.72:0/4050506514 >> 172.21.15.72:0/4050506514 conn(0x7fe25006def0 msgr2=0x7fe2500ab5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:38:03.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:03.092+0000 7fe2582df700 1 -- 172.21.15.72:0/4050506514 shutdown_connections 2023-07-25T14:38:03.112 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:03.092+0000 7fe2582df700 1 -- 172.21.15.72:0/4050506514 wait complete. 2023-07-25T14:38:03.112 INFO:teuthology.orchestra.run.smithi072.stderr:dumped all 2023-07-25T14:38:03.115 INFO:teuthology.orchestra.run.smithi072.stdout:{"pg_ready":true,"pg_map":{"version":129,"stamp":"2023-07-25T14:38:01.314237+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594237,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":206,"num_write_kb":2433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":158,"ondisk_log_size":158,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":215,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":221712,"kb_used_data":5556,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754753008,"statfs":{"total":773094113280,"available":772867080192,"internally_reserved":0,"allocated":5689344,"data_stored":3799899,"data_compressed":64510,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1507,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.083545"},"pg_stats":[{"pgid":"13.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-25T14:37:57.230919+0000","last_change":"2023-07-25T14:37:57.230919+0000","last_active":"2023-07-25T14:37:57.230919+0000","last_peered":"2023-07-25T14:37:57.230919+0000","last_clean":"2023-07-25T14:37:57.230919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:57.230919+0000","last_undegraded":"2023-07-25T14:37:57.230919+0000","last_fullsized":"2023-07-25T14:37:57.230919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3f","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.242052+0000","last_change":"2023-07-25T14:37:45.195851+0000","last_active":"2023-07-25T14:37:56.242052+0000","last_peered":"2023-07-25T14:37:56.242052+0000","last_clean":"2023-07-25T14:37:56.242052+0000","last_became_active":"2023-07-25T14:37:45.195549+0000","last_became_peered":"2023-07-25T14:37:45.195549+0000","last_unstale":"2023-07-25T14:37:56.242052+0000","last_undegraded":"2023-07-25T14:37:56.242052+0000","last_fullsized":"2023-07-25T14:37:56.242052+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T18:04:35.337446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-25T14:37:57.230919+0000","last_change":"2023-07-25T14:37:57.230919+0000","last_active":"2023-07-25T14:37:57.230919+0000","last_peered":"2023-07-25T14:37:57.230919+0000","last_clean":"2023-07-25T14:37:57.230919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:57.230919+0000","last_undegraded":"2023-07-25T14:37:57.230919+0000","last_fullsized":"2023-07-25T14:37:57.230919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.236361+0000","last_change":"2023-07-25T14:37:45.209998+0000","last_active":"2023-07-25T14:37:56.236361+0000","last_peered":"2023-07-25T14:37:56.236361+0000","last_clean":"2023-07-25T14:37:56.236361+0000","last_became_active":"2023-07-25T14:37:45.209538+0000","last_became_peered":"2023-07-25T14:37:45.209538+0000","last_unstale":"2023-07-25T14:37:56.236361+0000","last_undegraded":"2023-07-25T14:37:56.236361+0000","last_fullsized":"2023-07-25T14:37:56.236361+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T01:48:32.892039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-25T14:37:57.230919+0000","last_change":"2023-07-25T14:37:57.230919+0000","last_active":"2023-07-25T14:37:57.230919+0000","last_peered":"2023-07-25T14:37:57.230919+0000","last_clean":"2023-07-25T14:37:57.230919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:57.230919+0000","last_undegraded":"2023-07-25T14:37:57.230919+0000","last_fullsized":"2023-07-25T14:37:57.230919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.237479+0000","last_change":"2023-07-25T14:37:45.186668+0000","last_active":"2023-07-25T14:37:56.237479+0000","last_peered":"2023-07-25T14:37:56.237479+0000","last_clean":"2023-07-25T14:37:56.237479+0000","last_became_active":"2023-07-25T14:37:45.186396+0000","last_became_peered":"2023-07-25T14:37:45.186396+0000","last_unstale":"2023-07-25T14:37:56.237479+0000","last_undegraded":"2023-07-25T14:37:56.237479+0000","last_fullsized":"2023-07-25T14:37:56.237479+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T19:14:48.003695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-25T14:37:57.230919+0000","last_change":"2023-07-25T14:37:57.230919+0000","last_active":"2023-07-25T14:37:57.230919+0000","last_peered":"2023-07-25T14:37:57.230919+0000","last_clean":"2023-07-25T14:37:57.230919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:57.230919+0000","last_undegraded":"2023-07-25T14:37:57.230919+0000","last_fullsized":"2023-07-25T14:37:57.230919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.238649+0000","last_change":"2023-07-25T14:37:45.197894+0000","last_active":"2023-07-25T14:37:56.238649+0000","last_peered":"2023-07-25T14:37:56.238649+0000","last_clean":"2023-07-25T14:37:56.238649+0000","last_became_active":"2023-07-25T14:37:45.197369+0000","last_became_peered":"2023-07-25T14:37:45.197369+0000","last_unstale":"2023-07-25T14:37:56.238649+0000","last_undegraded":"2023-07-25T14:37:56.238649+0000","last_fullsized":"2023-07-25T14:37:56.238649+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T21:00:10.932528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-25T14:37:57.230919+0000","last_change":"2023-07-25T14:37:57.230919+0000","last_active":"2023-07-25T14:37:57.230919+0000","last_peered":"2023-07-25T14:37:57.230919+0000","last_clean":"2023-07-25T14:37:57.230919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:57.230919+0000","last_undegraded":"2023-07-25T14:37:57.230919+0000","last_fullsized":"2023-07-25T14:37:57.230919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.236750+0000","last_change":"2023-07-25T14:37:45.204817+0000","last_active":"2023-07-25T14:37:56.236750+0000","last_peered":"2023-07-25T14:37:56.236750+0000","last_clean":"2023-07-25T14:37:56.236750+0000","last_became_active":"2023-07-25T14:37:45.204540+0000","last_became_peered":"2023-07-25T14:37:45.204540+0000","last_unstale":"2023-07-25T14:37:56.236750+0000","last_undegraded":"2023-07-25T14:37:56.236750+0000","last_fullsized":"2023-07-25T14:37:56.236750+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T17:45:44.822234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-25T14:37:57.230919+0000","last_change":"2023-07-25T14:37:57.230919+0000","last_active":"2023-07-25T14:37:57.230919+0000","last_peered":"2023-07-25T14:37:57.230919+0000","last_clean":"2023-07-25T14:37:57.230919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:57.230919+0000","last_undegraded":"2023-07-25T14:37:57.230919+0000","last_fullsized":"2023-07-25T14:37:57.230919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.235387+0000","last_change":"2023-07-25T14:37:45.212379+0000","last_active":"2023-07-25T14:37:56.235387+0000","last_peered":"2023-07-25T14:37:56.235387+0000","last_clean":"2023-07-25T14:37:56.235387+0000","last_became_active":"2023-07-25T14:37:45.210115+0000","last_became_peered":"2023-07-25T14:37:45.210115+0000","last_unstale":"2023-07-25T14:37:56.235387+0000","last_undegraded":"2023-07-25T14:37:56.235387+0000","last_fullsized":"2023-07-25T14:37:56.235387+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T23:42:45.180792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-25T14:37:57.230919+0000","last_change":"2023-07-25T14:37:57.230919+0000","last_active":"2023-07-25T14:37:57.230919+0000","last_peered":"2023-07-25T14:37:57.230919+0000","last_clean":"2023-07-25T14:37:57.230919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:57.230919+0000","last_undegraded":"2023-07-25T14:37:57.230919+0000","last_fullsized":"2023-07-25T14:37:57.230919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.241798+0000","last_change":"2023-07-25T14:37:45.197514+0000","last_active":"2023-07-25T14:37:56.241798+0000","last_peered":"2023-07-25T14:37:56.241798+0000","last_clean":"2023-07-25T14:37:56.241798+0000","last_became_active":"2023-07-25T14:37:45.197076+0000","last_became_peered":"2023-07-25T14:37:45.197076+0000","last_unstale":"2023-07-25T14:37:56.241798+0000","last_undegraded":"2023-07-25T14:37:56.241798+0000","last_fullsized":"2023-07-25T14:37:56.241798+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T01:45:53.297713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-25T14:37:57.230919+0000","last_change":"2023-07-25T14:37:57.230919+0000","last_active":"2023-07-25T14:37:57.230919+0000","last_peered":"2023-07-25T14:37:57.230919+0000","last_clean":"2023-07-25T14:37:57.230919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:57.230919+0000","last_undegraded":"2023-07-25T14:37:57.230919+0000","last_fullsized":"2023-07-25T14:37:57.230919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.235241+0000","last_change":"2023-07-25T14:37:45.199774+0000","last_active":"2023-07-25T14:37:56.235241+0000","last_peered":"2023-07-25T14:37:56.235241+0000","last_clean":"2023-07-25T14:37:56.235241+0000","last_became_active":"2023-07-25T14:37:45.199408+0000","last_became_peered":"2023-07-25T14:37:45.199408+0000","last_unstale":"2023-07-25T14:37:56.235241+0000","last_undegraded":"2023-07-25T14:37:56.235241+0000","last_fullsized":"2023-07-25T14:37:56.235241+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T21:56:21.217589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-25T14:37:57.230919+0000","last_change":"2023-07-25T14:37:57.230919+0000","last_active":"2023-07-25T14:37:57.230919+0000","last_peered":"2023-07-25T14:37:57.230919+0000","last_clean":"2023-07-25T14:37:57.230919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:57.230919+0000","last_undegraded":"2023-07-25T14:37:57.230919+0000","last_fullsized":"2023-07-25T14:37:57.230919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.239129+0000","last_change":"2023-07-25T14:37:45.196344+0000","last_active":"2023-07-25T14:37:56.239129+0000","last_peered":"2023-07-25T14:37:56.239129+0000","last_clean":"2023-07-25T14:37:56.239129+0000","last_became_active":"2023-07-25T14:37:45.196000+0000","last_became_peered":"2023-07-25T14:37:45.196000+0000","last_unstale":"2023-07-25T14:37:56.239129+0000","last_undegraded":"2023-07-25T14:37:56.239129+0000","last_fullsized":"2023-07-25T14:37:56.239129+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T01:13:14.798538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-25T14:37:57.230919+0000","last_change":"2023-07-25T14:37:57.230919+0000","last_active":"2023-07-25T14:37:57.230919+0000","last_peered":"2023-07-25T14:37:57.230919+0000","last_clean":"2023-07-25T14:37:57.230919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:57.230919+0000","last_undegraded":"2023-07-25T14:37:57.230919+0000","last_fullsized":"2023-07-25T14:37:57.230919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.240251+0000","last_change":"2023-07-25T14:37:45.199696+0000","last_active":"2023-07-25T14:37:56.240251+0000","last_peered":"2023-07-25T14:37:56.240251+0000","last_clean":"2023-07-25T14:37:56.240251+0000","last_became_active":"2023-07-25T14:37:45.199345+0000","last_became_peered":"2023-07-25T14:37:45.199345+0000","last_unstale":"2023-07-25T14:37:56.240251+0000","last_undegraded":"2023-07-25T14:37:56.240251+0000","last_fullsized":"2023-07-25T14:37:56.240251+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T16:03:21.851226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-25T14:37:57.230919+0000","last_change":"2023-07-25T14:37:57.230919+0000","last_active":"2023-07-25T14:37:57.230919+0000","last_peered":"2023-07-25T14:37:57.230919+0000","last_clean":"2023-07-25T14:37:57.230919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:57.230919+0000","last_undegraded":"2023-07-25T14:37:57.230919+0000","last_fullsized":"2023-07-25T14:37:57.230919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.242969+0000","last_change":"2023-07-25T14:37:45.206383+0000","last_active":"2023-07-25T14:37:56.242969+0000","last_peered":"2023-07-25T14:37:56.242969+0000","last_clean":"2023-07-25T14:37:56.242969+0000","last_became_active":"2023-07-25T14:37:45.204409+0000","last_became_peered":"2023-07-25T14:37:45.204409+0000","last_unstale":"2023-07-25T14:37:56.242969+0000","last_undegraded":"2023-07-25T14:37:56.242969+0000","last_fullsized":"2023-07-25T14:37:56.242969+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T20:02:34.031523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-25T14:37:57.230919+0000","last_change":"2023-07-25T14:37:57.230919+0000","last_active":"2023-07-25T14:37:57.230919+0000","last_peered":"2023-07-25T14:37:57.230919+0000","last_clean":"2023-07-25T14:37:57.230919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:57.230919+0000","last_undegraded":"2023-07-25T14:37:57.230919+0000","last_fullsized":"2023-07-25T14:37:57.230919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.238726+0000","last_change":"2023-07-25T14:37:45.198072+0000","last_active":"2023-07-25T14:37:56.238726+0000","last_peered":"2023-07-25T14:37:56.238726+0000","last_clean":"2023-07-25T14:37:56.238726+0000","last_became_active":"2023-07-25T14:37:45.197648+0000","last_became_peered":"2023-07-25T14:37:45.197648+0000","last_unstale":"2023-07-25T14:37:56.238726+0000","last_undegraded":"2023-07-25T14:37:56.238726+0000","last_fullsized":"2023-07-25T14:37:56.238726+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T17:43:53.383591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-25T14:37:57.230919+0000","last_change":"2023-07-25T14:37:57.230919+0000","last_active":"2023-07-25T14:37:57.230919+0000","last_peered":"2023-07-25T14:37:57.230919+0000","last_clean":"2023-07-25T14:37:57.230919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:57.230919+0000","last_undegraded":"2023-07-25T14:37:57.230919+0000","last_fullsized":"2023-07-25T14:37:57.230919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.242371+0000","last_change":"2023-07-25T14:37:45.188472+0000","last_active":"2023-07-25T14:37:56.242371+0000","last_peered":"2023-07-25T14:37:56.242371+0000","last_clean":"2023-07-25T14:37:56.242371+0000","last_became_active":"2023-07-25T14:37:45.188105+0000","last_became_peered":"2023-07-25T14:37:45.188105+0000","last_unstale":"2023-07-25T14:37:56.242371+0000","last_undegraded":"2023-07-25T14:37:56.242371+0000","last_fullsized":"2023-07-25T14:37:56.242371+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T02:23:43.183873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-25T14:37:57.230919+0000","last_change":"2023-07-25T14:37:57.230919+0000","last_active":"2023-07-25T14:37:57.230919+0000","last_peered":"2023-07-25T14:37:57.230919+0000","last_clean":"2023-07-25T14:37:57.230919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:57.230919+0000","last_undegraded":"2023-07-25T14:37:57.230919+0000","last_fullsized":"2023-07-25T14:37:57.230919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.237009+0000","last_change":"2023-07-25T14:37:45.191002+0000","last_active":"2023-07-25T14:37:56.237009+0000","last_peered":"2023-07-25T14:37:56.237009+0000","last_clean":"2023-07-25T14:37:56.237009+0000","last_became_active":"2023-07-25T14:37:45.190713+0000","last_became_peered":"2023-07-25T14:37:45.190713+0000","last_unstale":"2023-07-25T14:37:56.237009+0000","last_undegraded":"2023-07-25T14:37:56.237009+0000","last_fullsized":"2023-07-25T14:37:56.237009+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T19:09:13.845620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-25T14:37:57.230919+0000","last_change":"2023-07-25T14:37:57.230919+0000","last_active":"2023-07-25T14:37:57.230919+0000","last_peered":"2023-07-25T14:37:57.230919+0000","last_clean":"2023-07-25T14:37:57.230919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:57.230919+0000","last_undegraded":"2023-07-25T14:37:57.230919+0000","last_fullsized":"2023-07-25T14:37:57.230919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.242126+0000","last_change":"2023-07-25T14:37:45.192719+0000","last_active":"2023-07-25T14:37:56.242126+0000","last_peered":"2023-07-25T14:37:56.242126+0000","last_clean":"2023-07-25T14:37:56.242126+0000","last_became_active":"2023-07-25T14:37:45.192419+0000","last_became_peered":"2023-07-25T14:37:45.192419+0000","last_unstale":"2023-07-25T14:37:56.242126+0000","last_undegraded":"2023-07-25T14:37:56.242126+0000","last_fullsized":"2023-07-25T14:37:56.242126+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T20:57:30.620624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-25T14:37:57.230919+0000","last_change":"2023-07-25T14:37:57.230919+0000","last_active":"2023-07-25T14:37:57.230919+0000","last_peered":"2023-07-25T14:37:57.230919+0000","last_clean":"2023-07-25T14:37:57.230919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:57.230919+0000","last_undegraded":"2023-07-25T14:37:57.230919+0000","last_fullsized":"2023-07-25T14:37:57.230919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.239446+0000","last_change":"2023-07-25T14:37:45.210664+0000","last_active":"2023-07-25T14:37:56.239446+0000","last_peered":"2023-07-25T14:37:56.239446+0000","last_clean":"2023-07-25T14:37:56.239446+0000","last_became_active":"2023-07-25T14:37:45.210376+0000","last_became_peered":"2023-07-25T14:37:45.210376+0000","last_unstale":"2023-07-25T14:37:56.239446+0000","last_undegraded":"2023-07-25T14:37:56.239446+0000","last_fullsized":"2023-07-25T14:37:56.239446+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T21:36:29.587198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-25T14:37:57.230919+0000","last_change":"2023-07-25T14:37:57.230919+0000","last_active":"2023-07-25T14:37:57.230919+0000","last_peered":"2023-07-25T14:37:57.230919+0000","last_clean":"2023-07-25T14:37:57.230919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:57.230919+0000","last_undegraded":"2023-07-25T14:37:57.230919+0000","last_fullsized":"2023-07-25T14:37:57.230919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.239301+0000","last_change":"2023-07-25T14:37:45.191718+0000","last_active":"2023-07-25T14:37:56.239301+0000","last_peered":"2023-07-25T14:37:56.239301+0000","last_clean":"2023-07-25T14:37:56.239301+0000","last_became_active":"2023-07-25T14:37:45.191401+0000","last_became_peered":"2023-07-25T14:37:45.191401+0000","last_unstale":"2023-07-25T14:37:56.239301+0000","last_undegraded":"2023-07-25T14:37:56.239301+0000","last_fullsized":"2023-07-25T14:37:56.239301+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:15:03.390799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-25T14:37:57.230919+0000","last_change":"2023-07-25T14:37:57.230919+0000","last_active":"2023-07-25T14:37:57.230919+0000","last_peered":"2023-07-25T14:37:57.230919+0000","last_clean":"2023-07-25T14:37:57.230919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:57.230919+0000","last_undegraded":"2023-07-25T14:37:57.230919+0000","last_fullsized":"2023-07-25T14:37:57.230919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.239364+0000","last_change":"2023-07-25T14:37:45.197329+0000","last_active":"2023-07-25T14:37:56.239364+0000","last_peered":"2023-07-25T14:37:56.239364+0000","last_clean":"2023-07-25T14:37:56.239364+0000","last_became_active":"2023-07-25T14:37:45.197048+0000","last_became_peered":"2023-07-25T14:37:45.197048+0000","last_unstale":"2023-07-25T14:37:56.239364+0000","last_undegraded":"2023-07-25T14:37:56.239364+0000","last_fullsized":"2023-07-25T14:37:56.239364+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T21:37:28.153205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-25T14:37:57.230919+0000","last_change":"2023-07-25T14:37:57.230919+0000","last_active":"2023-07-25T14:37:57.230919+0000","last_peered":"2023-07-25T14:37:57.230919+0000","last_clean":"2023-07-25T14:37:57.230919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:57.230919+0000","last_undegraded":"2023-07-25T14:37:57.230919+0000","last_fullsized":"2023-07-25T14:37:57.230919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.236278+0000","last_change":"2023-07-25T14:37:45.205950+0000","last_active":"2023-07-25T14:37:56.236278+0000","last_peered":"2023-07-25T14:37:56.236278+0000","last_clean":"2023-07-25T14:37:56.236278+0000","last_became_active":"2023-07-25T14:37:45.199388+0000","last_became_peered":"2023-07-25T14:37:45.199388+0000","last_unstale":"2023-07-25T14:37:56.236278+0000","last_undegraded":"2023-07-25T14:37:56.236278+0000","last_fullsized":"2023-07-25T14:37:56.236278+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T21:01:07.274086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-25T14:37:57.230919+0000","last_change":"2023-07-25T14:37:57.230919+0000","last_active":"2023-07-25T14:37:57.230919+0000","last_peered":"2023-07-25T14:37:57.230919+0000","last_clean":"2023-07-25T14:37:57.230919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:57.230919+0000","last_undegraded":"2023-07-25T14:37:57.230919+0000","last_fullsized":"2023-07-25T14:37:57.230919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.242668+0000","last_change":"2023-07-25T14:37:45.188465+0000","last_active":"2023-07-25T14:37:56.242668+0000","last_peered":"2023-07-25T14:37:56.242668+0000","last_clean":"2023-07-25T14:37:56.242668+0000","last_became_active":"2023-07-25T14:37:45.188186+0000","last_became_peered":"2023-07-25T14:37:45.188186+0000","last_unstale":"2023-07-25T14:37:56.242668+0000","last_undegraded":"2023-07-25T14:37:56.242668+0000","last_fullsized":"2023-07-25T14:37:56.242668+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T15:46:46.392473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-25T14:37:57.230919+0000","last_change":"2023-07-25T14:37:57.230919+0000","last_active":"2023-07-25T14:37:57.230919+0000","last_peered":"2023-07-25T14:37:57.230919+0000","last_clean":"2023-07-25T14:37:57.230919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:57.230919+0000","last_undegraded":"2023-07-25T14:37:57.230919+0000","last_fullsized":"2023-07-25T14:37:57.230919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.240257+0000","last_change":"2023-07-25T14:37:45.201384+0000","last_active":"2023-07-25T14:37:56.240257+0000","last_peered":"2023-07-25T14:37:56.240257+0000","last_clean":"2023-07-25T14:37:56.240257+0000","last_became_active":"2023-07-25T14:37:45.200847+0000","last_became_peered":"2023-07-25T14:37:45.200847+0000","last_unstale":"2023-07-25T14:37:56.240257+0000","last_undegraded":"2023-07-25T14:37:56.240257+0000","last_fullsized":"2023-07-25T14:37:56.240257+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:01:15.664248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-25T14:37:57.230919+0000","last_change":"2023-07-25T14:37:57.230919+0000","last_active":"2023-07-25T14:37:57.230919+0000","last_peered":"2023-07-25T14:37:57.230919+0000","last_clean":"2023-07-25T14:37:57.230919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:57.230919+0000","last_undegraded":"2023-07-25T14:37:57.230919+0000","last_fullsized":"2023-07-25T14:37:57.230919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.241115+0000","last_change":"2023-07-25T14:37:45.201941+0000","last_active":"2023-07-25T14:37:56.241115+0000","last_peered":"2023-07-25T14:37:56.241115+0000","last_clean":"2023-07-25T14:37:56.241115+0000","last_became_active":"2023-07-25T14:37:45.201640+0000","last_became_peered":"2023-07-25T14:37:45.201640+0000","last_unstale":"2023-07-25T14:37:56.241115+0000","last_undegraded":"2023-07-25T14:37:56.241115+0000","last_fullsized":"2023-07-25T14:37:56.241115+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T23:27:34.225061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-25T14:37:57.230919+0000","last_change":"2023-07-25T14:37:57.230919+0000","last_active":"2023-07-25T14:37:57.230919+0000","last_peered":"2023-07-25T14:37:57.230919+0000","last_clean":"2023-07-25T14:37:57.230919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:57.230919+0000","last_undegraded":"2023-07-25T14:37:57.230919+0000","last_fullsized":"2023-07-25T14:37:57.230919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.241029+0000","last_change":"2023-07-25T14:37:45.204317+0000","last_active":"2023-07-25T14:37:56.241029+0000","last_peered":"2023-07-25T14:37:56.241029+0000","last_clean":"2023-07-25T14:37:56.241029+0000","last_became_active":"2023-07-25T14:37:45.203583+0000","last_became_peered":"2023-07-25T14:37:45.203583+0000","last_unstale":"2023-07-25T14:37:56.241029+0000","last_undegraded":"2023-07-25T14:37:56.241029+0000","last_fullsized":"2023-07-25T14:37:56.241029+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T21:36:29.587198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-25T14:37:57.230919+0000","last_change":"2023-07-25T14:37:57.230919+0000","last_active":"2023-07-25T14:37:57.230919+0000","last_peered":"2023-07-25T14:37:57.230919+0000","last_clean":"2023-07-25T14:37:57.230919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:57.230919+0000","last_undegraded":"2023-07-25T14:37:57.230919+0000","last_fullsized":"2023-07-25T14:37:57.230919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.240236+0000","last_change":"2023-07-25T14:37:45.207314+0000","last_active":"2023-07-25T14:37:56.240236+0000","last_peered":"2023-07-25T14:37:56.240236+0000","last_clean":"2023-07-25T14:37:56.240236+0000","last_became_active":"2023-07-25T14:37:45.207030+0000","last_became_peered":"2023-07-25T14:37:45.207030+0000","last_unstale":"2023-07-25T14:37:56.240236+0000","last_undegraded":"2023-07-25T14:37:56.240236+0000","last_fullsized":"2023-07-25T14:37:56.240236+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T18:15:13.886467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-25T14:37:57.230919+0000","last_change":"2023-07-25T14:37:57.230919+0000","last_active":"2023-07-25T14:37:57.230919+0000","last_peered":"2023-07-25T14:37:57.230919+0000","last_clean":"2023-07-25T14:37:57.230919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:57.230919+0000","last_undegraded":"2023-07-25T14:37:57.230919+0000","last_fullsized":"2023-07-25T14:37:57.230919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.238899+0000","last_change":"2023-07-25T14:37:45.210109+0000","last_active":"2023-07-25T14:37:56.238899+0000","last_peered":"2023-07-25T14:37:56.238899+0000","last_clean":"2023-07-25T14:37:56.238899+0000","last_became_active":"2023-07-25T14:37:45.205229+0000","last_became_peered":"2023-07-25T14:37:45.205229+0000","last_unstale":"2023-07-25T14:37:56.238899+0000","last_undegraded":"2023-07-25T14:37:56.238899+0000","last_fullsized":"2023-07-25T14:37:56.238899+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T18:15:13.886467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-25T14:37:57.230919+0000","last_change":"2023-07-25T14:37:57.230919+0000","last_active":"2023-07-25T14:37:57.230919+0000","last_peered":"2023-07-25T14:37:57.230919+0000","last_clean":"2023-07-25T14:37:57.230919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:57.230919+0000","last_undegraded":"2023-07-25T14:37:57.230919+0000","last_fullsized":"2023-07-25T14:37:57.230919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.242267+0000","last_change":"2023-07-25T14:37:45.188464+0000","last_active":"2023-07-25T14:37:56.242267+0000","last_peered":"2023-07-25T14:37:56.242267+0000","last_clean":"2023-07-25T14:37:56.242267+0000","last_became_active":"2023-07-25T14:37:45.188020+0000","last_became_peered":"2023-07-25T14:37:45.188020+0000","last_unstale":"2023-07-25T14:37:56.242267+0000","last_undegraded":"2023-07-25T14:37:56.242267+0000","last_fullsized":"2023-07-25T14:37:56.242267+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T16:59:37.902539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-25T14:37:57.230919+0000","last_change":"2023-07-25T14:37:57.230919+0000","last_active":"2023-07-25T14:37:57.230919+0000","last_peered":"2023-07-25T14:37:57.230919+0000","last_clean":"2023-07-25T14:37:57.230919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:57.230919+0000","last_undegraded":"2023-07-25T14:37:57.230919+0000","last_fullsized":"2023-07-25T14:37:57.230919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.237576+0000","last_change":"2023-07-25T14:37:45.205460+0000","last_active":"2023-07-25T14:37:56.237576+0000","last_peered":"2023-07-25T14:37:56.237576+0000","last_clean":"2023-07-25T14:37:56.237576+0000","last_became_active":"2023-07-25T14:37:45.205174+0000","last_became_peered":"2023-07-25T14:37:45.205174+0000","last_unstale":"2023-07-25T14:37:56.237576+0000","last_undegraded":"2023-07-25T14:37:56.237576+0000","last_fullsized":"2023-07-25T14:37:56.237576+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:52:10.216139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-25T14:37:57.230919+0000","last_change":"2023-07-25T14:37:57.230919+0000","last_active":"2023-07-25T14:37:57.230919+0000","last_peered":"2023-07-25T14:37:57.230919+0000","last_clean":"2023-07-25T14:37:57.230919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:57.230919+0000","last_undegraded":"2023-07-25T14:37:57.230919+0000","last_fullsized":"2023-07-25T14:37:57.230919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.240725+0000","last_change":"2023-07-25T14:37:45.199014+0000","last_active":"2023-07-25T14:37:56.240725+0000","last_peered":"2023-07-25T14:37:56.240725+0000","last_clean":"2023-07-25T14:37:56.240725+0000","last_became_active":"2023-07-25T14:37:45.198610+0000","last_became_peered":"2023-07-25T14:37:45.198610+0000","last_unstale":"2023-07-25T14:37:56.240725+0000","last_undegraded":"2023-07-25T14:37:56.240725+0000","last_fullsized":"2023-07-25T14:37:56.240725+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T18:53:31.784163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-25T14:37:57.230919+0000","last_change":"2023-07-25T14:37:57.230919+0000","last_active":"2023-07-25T14:37:57.230919+0000","last_peered":"2023-07-25T14:37:57.230919+0000","last_clean":"2023-07-25T14:37:57.230919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:57.230919+0000","last_undegraded":"2023-07-25T14:37:57.230919+0000","last_fullsized":"2023-07-25T14:37:57.230919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.237801+0000","last_change":"2023-07-25T14:37:45.190492+0000","last_active":"2023-07-25T14:37:56.237801+0000","last_peered":"2023-07-25T14:37:56.237801+0000","last_clean":"2023-07-25T14:37:56.237801+0000","last_became_active":"2023-07-25T14:37:45.190205+0000","last_became_peered":"2023-07-25T14:37:45.190205+0000","last_unstale":"2023-07-25T14:37:56.237801+0000","last_undegraded":"2023-07-25T14:37:56.237801+0000","last_fullsized":"2023-07-25T14:37:56.237801+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T16:38:19.522810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-25T14:37:57.230919+0000","last_change":"2023-07-25T14:37:57.230919+0000","last_active":"2023-07-25T14:37:57.230919+0000","last_peered":"2023-07-25T14:37:57.230919+0000","last_clean":"2023-07-25T14:37:57.230919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:57.230919+0000","last_undegraded":"2023-07-25T14:37:57.230919+0000","last_fullsized":"2023-07-25T14:37:57.230919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.241947+0000","last_change":"2023-07-25T14:37:45.189887+0000","last_active":"2023-07-25T14:37:56.241947+0000","last_peered":"2023-07-25T14:37:56.241947+0000","last_clean":"2023-07-25T14:37:56.241947+0000","last_became_active":"2023-07-25T14:37:45.189544+0000","last_became_peered":"2023-07-25T14:37:45.189544+0000","last_unstale":"2023-07-25T14:37:56.241947+0000","last_undegraded":"2023-07-25T14:37:56.241947+0000","last_fullsized":"2023-07-25T14:37:56.241947+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T14:57:36.427060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-25T14:37:57.230919+0000","last_change":"2023-07-25T14:37:57.230919+0000","last_active":"2023-07-25T14:37:57.230919+0000","last_peered":"2023-07-25T14:37:57.230919+0000","last_clean":"2023-07-25T14:37:57.230919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:57.230919+0000","last_undegraded":"2023-07-25T14:37:57.230919+0000","last_fullsized":"2023-07-25T14:37:57.230919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.241859+0000","last_change":"2023-07-25T14:37:45.197332+0000","last_active":"2023-07-25T14:37:56.241859+0000","last_peered":"2023-07-25T14:37:56.241859+0000","last_clean":"2023-07-25T14:37:56.241859+0000","last_became_active":"2023-07-25T14:37:45.196749+0000","last_became_peered":"2023-07-25T14:37:45.196749+0000","last_unstale":"2023-07-25T14:37:56.241859+0000","last_undegraded":"2023-07-25T14:37:56.241859+0000","last_fullsized":"2023-07-25T14:37:56.241859+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:22:33.272266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-25T14:37:57.230919+0000","last_change":"2023-07-25T14:37:57.230919+0000","last_active":"2023-07-25T14:37:57.230919+0000","last_peered":"2023-07-25T14:37:57.230919+0000","last_clean":"2023-07-25T14:37:57.230919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:57.230919+0000","last_undegraded":"2023-07-25T14:37:57.230919+0000","last_fullsized":"2023-07-25T14:37:57.230919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.235254+0000","last_change":"2023-07-25T14:37:45.191972+0000","last_active":"2023-07-25T14:37:56.235254+0000","last_peered":"2023-07-25T14:37:56.235254+0000","last_clean":"2023-07-25T14:37:56.235254+0000","last_became_active":"2023-07-25T14:37:45.191704+0000","last_became_peered":"2023-07-25T14:37:45.191704+0000","last_unstale":"2023-07-25T14:37:56.235254+0000","last_undegraded":"2023-07-25T14:37:56.235254+0000","last_fullsized":"2023-07-25T14:37:56.235254+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T21:11:54.570394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-25T14:37:57.230919+0000","last_change":"2023-07-25T14:37:57.230919+0000","last_active":"2023-07-25T14:37:57.230919+0000","last_peered":"2023-07-25T14:37:57.230919+0000","last_clean":"2023-07-25T14:37:57.230919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:57.230919+0000","last_undegraded":"2023-07-25T14:37:57.230919+0000","last_fullsized":"2023-07-25T14:37:57.230919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2023-07-25T14:37:56.240395+0000","last_change":"2023-07-25T14:37:56.240395+0000","last_active":"2023-07-25T14:37:56.225499+0000","last_peered":"2023-07-25T14:37:56.225499+0000","last_clean":"2023-07-25T14:37:56.225499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:56.240395+0000","last_undegraded":"2023-07-25T14:37:56.240395+0000","last_fullsized":"2023-07-25T14:37:56.240395+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_clean_scrub_stamp":"2023-07-25T14:37:56.225499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.241936+0000","last_change":"2023-07-25T14:37:45.213847+0000","last_active":"2023-07-25T14:37:56.241936+0000","last_peered":"2023-07-25T14:37:56.241936+0000","last_clean":"2023-07-25T14:37:56.241936+0000","last_became_active":"2023-07-25T14:37:45.213456+0000","last_became_peered":"2023-07-25T14:37:45.213456+0000","last_unstale":"2023-07-25T14:37:56.241936+0000","last_undegraded":"2023-07-25T14:37:56.241936+0000","last_fullsized":"2023-07-25T14:37:56.241936+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T19:07:32.745444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"56'4","reported_seq":19,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.242852+0000","last_change":"2023-07-25T14:37:44.164114+0000","last_active":"2023-07-25T14:37:56.242852+0000","last_peered":"2023-07-25T14:37:56.242852+0000","last_clean":"2023-07-25T14:37:56.242852+0000","last_became_active":"2023-07-25T14:37:44.163807+0000","last_became_peered":"2023-07-25T14:37:44.163807+0000","last_unstale":"2023-07-25T14:37:56.242852+0000","last_undegraded":"2023-07-25T14:37:56.242852+0000","last_fullsized":"2023-07-25T14:37:56.242852+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T17:17:04.204095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-25T14:37:57.230919+0000","last_change":"2023-07-25T14:37:57.230919+0000","last_active":"2023-07-25T14:37:57.230919+0000","last_peered":"2023-07-25T14:37:57.230919+0000","last_clean":"2023-07-25T14:37:57.230919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:57.230919+0000","last_undegraded":"2023-07-25T14:37:57.230919+0000","last_fullsized":"2023-07-25T14:37:57.230919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2023-07-25T14:37:56.237722+0000","last_change":"2023-07-25T14:37:56.237722+0000","last_active":"2023-07-25T14:37:56.225499+0000","last_peered":"2023-07-25T14:37:56.225499+0000","last_clean":"2023-07-25T14:37:56.225499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:56.237722+0000","last_undegraded":"2023-07-25T14:37:56.237722+0000","last_fullsized":"2023-07-25T14:37:56.237722+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_clean_scrub_stamp":"2023-07-25T14:37:56.225499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.239259+0000","last_change":"2023-07-25T14:37:45.191918+0000","last_active":"2023-07-25T14:37:56.239259+0000","last_peered":"2023-07-25T14:37:56.239259+0000","last_clean":"2023-07-25T14:37:56.239259+0000","last_became_active":"2023-07-25T14:37:45.191341+0000","last_became_peered":"2023-07-25T14:37:45.191341+0000","last_unstale":"2023-07-25T14:37:56.239259+0000","last_undegraded":"2023-07-25T14:37:56.239259+0000","last_fullsized":"2023-07-25T14:37:56.239259+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T16:42:35.382617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"56'1","reported_seq":16,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.242725+0000","last_change":"2023-07-25T14:37:44.174028+0000","last_active":"2023-07-25T14:37:56.242725+0000","last_peered":"2023-07-25T14:37:56.242725+0000","last_clean":"2023-07-25T14:37:56.242725+0000","last_became_active":"2023-07-25T14:37:44.173193+0000","last_became_peered":"2023-07-25T14:37:44.173193+0000","last_unstale":"2023-07-25T14:37:56.242725+0000","last_undegraded":"2023-07-25T14:37:56.242725+0000","last_fullsized":"2023-07-25T14:37:56.242725+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T21:08:18.872035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-25T14:37:57.230919+0000","last_change":"2023-07-25T14:37:57.230919+0000","last_active":"2023-07-25T14:37:57.230919+0000","last_peered":"2023-07-25T14:37:57.230919+0000","last_clean":"2023-07-25T14:37:57.230919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:57.230919+0000","last_undegraded":"2023-07-25T14:37:57.230919+0000","last_fullsized":"2023-07-25T14:37:57.230919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2023-07-25T14:37:56.239988+0000","last_change":"2023-07-25T14:37:56.239988+0000","last_active":"2023-07-25T14:37:56.225499+0000","last_peered":"2023-07-25T14:37:56.225499+0000","last_clean":"2023-07-25T14:37:56.225499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:56.239988+0000","last_undegraded":"2023-07-25T14:37:56.239988+0000","last_fullsized":"2023-07-25T14:37:56.239988+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_clean_scrub_stamp":"2023-07-25T14:37:56.225499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.235574+0000","last_change":"2023-07-25T14:37:45.209338+0000","last_active":"2023-07-25T14:37:56.235574+0000","last_peered":"2023-07-25T14:37:56.235574+0000","last_clean":"2023-07-25T14:37:56.235574+0000","last_became_active":"2023-07-25T14:37:45.207168+0000","last_became_peered":"2023-07-25T14:37:45.207168+0000","last_unstale":"2023-07-25T14:37:56.235574+0000","last_undegraded":"2023-07-25T14:37:56.235574+0000","last_fullsized":"2023-07-25T14:37:56.235574+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T17:43:05.618873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"56'2","reported_seq":17,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.239162+0000","last_change":"2023-07-25T14:37:44.168052+0000","last_active":"2023-07-25T14:37:56.239162+0000","last_peered":"2023-07-25T14:37:56.239162+0000","last_clean":"2023-07-25T14:37:56.239162+0000","last_became_active":"2023-07-25T14:37:44.167768+0000","last_became_peered":"2023-07-25T14:37:44.167768+0000","last_unstale":"2023-07-25T14:37:56.239162+0000","last_undegraded":"2023-07-25T14:37:56.239162+0000","last_fullsized":"2023-07-25T14:37:56.239162+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T17:02:30.931160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-25T14:37:57.230919+0000","last_change":"2023-07-25T14:37:57.230919+0000","last_active":"2023-07-25T14:37:57.230919+0000","last_peered":"2023-07-25T14:37:57.230919+0000","last_clean":"2023-07-25T14:37:57.230919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:57.230919+0000","last_undegraded":"2023-07-25T14:37:57.230919+0000","last_fullsized":"2023-07-25T14:37:57.230919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2023-07-25T14:37:56.240262+0000","last_change":"2023-07-25T14:37:56.240262+0000","last_active":"2023-07-25T14:37:56.225499+0000","last_peered":"2023-07-25T14:37:56.225499+0000","last_clean":"2023-07-25T14:37:56.225499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:56.240262+0000","last_undegraded":"2023-07-25T14:37:56.240262+0000","last_fullsized":"2023-07-25T14:37:56.240262+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_clean_scrub_stamp":"2023-07-25T14:37:56.225499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.241866+0000","last_change":"2023-07-25T14:37:45.204504+0000","last_active":"2023-07-25T14:37:56.241866+0000","last_peered":"2023-07-25T14:37:56.241866+0000","last_clean":"2023-07-25T14:37:56.241866+0000","last_became_active":"2023-07-25T14:37:45.203141+0000","last_became_peered":"2023-07-25T14:37:45.203141+0000","last_unstale":"2023-07-25T14:37:56.241866+0000","last_undegraded":"2023-07-25T14:37:56.241866+0000","last_fullsized":"2023-07-25T14:37:56.241866+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:01:15.664248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"56'2","reported_seq":17,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.235855+0000","last_change":"2023-07-25T14:37:44.167404+0000","last_active":"2023-07-25T14:37:56.235855+0000","last_peered":"2023-07-25T14:37:56.235855+0000","last_clean":"2023-07-25T14:37:56.235855+0000","last_became_active":"2023-07-25T14:37:44.167157+0000","last_became_peered":"2023-07-25T14:37:44.167157+0000","last_unstale":"2023-07-25T14:37:56.235855+0000","last_undegraded":"2023-07-25T14:37:56.235855+0000","last_fullsized":"2023-07-25T14:37:56.235855+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T15:31:28.702869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-25T14:37:57.230919+0000","last_change":"2023-07-25T14:37:57.230919+0000","last_active":"2023-07-25T14:37:57.230919+0000","last_peered":"2023-07-25T14:37:57.230919+0000","last_clean":"2023-07-25T14:37:57.230919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:57.230919+0000","last_undegraded":"2023-07-25T14:37:57.230919+0000","last_fullsized":"2023-07-25T14:37:57.230919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2023-07-25T14:37:56.240853+0000","last_change":"2023-07-25T14:37:56.240853+0000","last_active":"2023-07-25T14:37:56.225499+0000","last_peered":"2023-07-25T14:37:56.225499+0000","last_clean":"2023-07-25T14:37:56.225499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:56.240853+0000","last_undegraded":"2023-07-25T14:37:56.240853+0000","last_fullsized":"2023-07-25T14:37:56.240853+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_clean_scrub_stamp":"2023-07-25T14:37:56.225499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.241986+0000","last_change":"2023-07-25T14:37:45.192672+0000","last_active":"2023-07-25T14:37:56.241986+0000","last_peered":"2023-07-25T14:37:56.241986+0000","last_clean":"2023-07-25T14:37:56.241986+0000","last_became_active":"2023-07-25T14:37:45.192426+0000","last_became_peered":"2023-07-25T14:37:45.192426+0000","last_unstale":"2023-07-25T14:37:56.241986+0000","last_undegraded":"2023-07-25T14:37:56.241986+0000","last_fullsized":"2023-07-25T14:37:56.241986+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T23:33:22.019151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"56'1","reported_seq":16,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.238075+0000","last_change":"2023-07-25T14:37:44.165894+0000","last_active":"2023-07-25T14:37:56.238075+0000","last_peered":"2023-07-25T14:37:56.238075+0000","last_clean":"2023-07-25T14:37:56.238075+0000","last_became_active":"2023-07-25T14:37:44.165121+0000","last_became_peered":"2023-07-25T14:37:44.165121+0000","last_unstale":"2023-07-25T14:37:56.238075+0000","last_undegraded":"2023-07-25T14:37:56.238075+0000","last_fullsized":"2023-07-25T14:37:56.238075+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T02:26:32.270431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-25T14:37:57.230919+0000","last_change":"2023-07-25T14:37:57.230919+0000","last_active":"2023-07-25T14:37:57.230919+0000","last_peered":"2023-07-25T14:37:57.230919+0000","last_clean":"2023-07-25T14:37:57.230919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:57.230919+0000","last_undegraded":"2023-07-25T14:37:57.230919+0000","last_fullsized":"2023-07-25T14:37:57.230919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2023-07-25T14:37:56.240918+0000","last_change":"2023-07-25T14:37:56.240918+0000","last_active":"2023-07-25T14:37:56.225499+0000","last_peered":"2023-07-25T14:37:56.225499+0000","last_clean":"2023-07-25T14:37:56.225499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:56.240918+0000","last_undegraded":"2023-07-25T14:37:56.240918+0000","last_fullsized":"2023-07-25T14:37:56.240918+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_clean_scrub_stamp":"2023-07-25T14:37:56.225499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.240434+0000","last_change":"2023-07-25T14:37:45.204924+0000","last_active":"2023-07-25T14:37:56.240434+0000","last_peered":"2023-07-25T14:37:56.240434+0000","last_clean":"2023-07-25T14:37:56.240434+0000","last_became_active":"2023-07-25T14:37:45.204636+0000","last_became_peered":"2023-07-25T14:37:45.204636+0000","last_unstale":"2023-07-25T14:37:56.240434+0000","last_undegraded":"2023-07-25T14:37:56.240434+0000","last_fullsized":"2023-07-25T14:37:56.240434+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T15:01:23.982072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"56'1","reported_seq":16,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.235502+0000","last_change":"2023-07-25T14:37:44.165997+0000","last_active":"2023-07-25T14:37:56.235502+0000","last_peered":"2023-07-25T14:37:56.235502+0000","last_clean":"2023-07-25T14:37:56.235502+0000","last_became_active":"2023-07-25T14:37:44.165724+0000","last_became_peered":"2023-07-25T14:37:44.165724+0000","last_unstale":"2023-07-25T14:37:56.235502+0000","last_undegraded":"2023-07-25T14:37:56.235502+0000","last_fullsized":"2023-07-25T14:37:56.235502+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T16:55:35.317643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-25T14:37:57.230919+0000","last_change":"2023-07-25T14:37:57.230919+0000","last_active":"2023-07-25T14:37:57.230919+0000","last_peered":"2023-07-25T14:37:57.230919+0000","last_clean":"2023-07-25T14:37:57.230919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:57.230919+0000","last_undegraded":"2023-07-25T14:37:57.230919+0000","last_fullsized":"2023-07-25T14:37:57.230919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2023-07-25T14:37:56.234775+0000","last_change":"2023-07-25T14:37:56.234775+0000","last_active":"2023-07-25T14:37:56.225499+0000","last_peered":"2023-07-25T14:37:56.225499+0000","last_clean":"2023-07-25T14:37:56.225499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:56.234775+0000","last_undegraded":"2023-07-25T14:37:56.234775+0000","last_fullsized":"2023-07-25T14:37:56.234775+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_clean_scrub_stamp":"2023-07-25T14:37:56.225499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.235953+0000","last_change":"2023-07-25T14:37:45.200734+0000","last_active":"2023-07-25T14:37:56.235953+0000","last_peered":"2023-07-25T14:37:56.235953+0000","last_clean":"2023-07-25T14:37:56.235953+0000","last_became_active":"2023-07-25T14:37:45.200452+0000","last_became_peered":"2023-07-25T14:37:45.200452+0000","last_unstale":"2023-07-25T14:37:56.235953+0000","last_undegraded":"2023-07-25T14:37:56.235953+0000","last_fullsized":"2023-07-25T14:37:56.235953+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T15:59:17.536216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.238125+0000","last_change":"2023-07-25T14:37:44.163784+0000","last_active":"2023-07-25T14:37:56.238125+0000","last_peered":"2023-07-25T14:37:56.238125+0000","last_clean":"2023-07-25T14:37:56.238125+0000","last_became_active":"2023-07-25T14:37:44.163566+0000","last_became_peered":"2023-07-25T14:37:44.163566+0000","last_unstale":"2023-07-25T14:37:56.238125+0000","last_undegraded":"2023-07-25T14:37:56.238125+0000","last_fullsized":"2023-07-25T14:37:56.238125+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T15:07:44.972611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-25T14:37:57.230919+0000","last_change":"2023-07-25T14:37:57.230919+0000","last_active":"2023-07-25T14:37:57.230919+0000","last_peered":"2023-07-25T14:37:57.230919+0000","last_clean":"2023-07-25T14:37:57.230919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:57.230919+0000","last_undegraded":"2023-07-25T14:37:57.230919+0000","last_fullsized":"2023-07-25T14:37:57.230919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2023-07-25T14:37:56.239932+0000","last_change":"2023-07-25T14:37:56.239932+0000","last_active":"2023-07-25T14:37:56.225499+0000","last_peered":"2023-07-25T14:37:56.225499+0000","last_clean":"2023-07-25T14:37:56.225499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:56.239932+0000","last_undegraded":"2023-07-25T14:37:56.239932+0000","last_fullsized":"2023-07-25T14:37:56.239932+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_clean_scrub_stamp":"2023-07-25T14:37:56.225499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.242251+0000","last_change":"2023-07-25T14:37:45.205124+0000","last_active":"2023-07-25T14:37:56.242251+0000","last_peered":"2023-07-25T14:37:56.242251+0000","last_clean":"2023-07-25T14:37:56.242251+0000","last_became_active":"2023-07-25T14:37:45.204730+0000","last_became_peered":"2023-07-25T14:37:45.204730+0000","last_unstale":"2023-07-25T14:37:56.242251+0000","last_undegraded":"2023-07-25T14:37:56.242251+0000","last_fullsized":"2023-07-25T14:37:56.242251+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T20:41:03.818352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.236611+0000","last_change":"2023-07-25T14:37:44.171926+0000","last_active":"2023-07-25T14:37:56.236611+0000","last_peered":"2023-07-25T14:37:56.236611+0000","last_clean":"2023-07-25T14:37:56.236611+0000","last_became_active":"2023-07-25T14:37:44.171610+0000","last_became_peered":"2023-07-25T14:37:44.171610+0000","last_unstale":"2023-07-25T14:37:56.236611+0000","last_undegraded":"2023-07-25T14:37:56.236611+0000","last_fullsized":"2023-07-25T14:37:56.236611+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:06:37.927385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-25T14:37:57.230919+0000","last_change":"2023-07-25T14:37:57.230919+0000","last_active":"2023-07-25T14:37:57.230919+0000","last_peered":"2023-07-25T14:37:57.230919+0000","last_clean":"2023-07-25T14:37:57.230919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:57.230919+0000","last_undegraded":"2023-07-25T14:37:57.230919+0000","last_fullsized":"2023-07-25T14:37:57.230919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2023-07-25T14:37:56.238867+0000","last_change":"2023-07-25T14:37:56.238867+0000","last_active":"2023-07-25T14:37:56.225499+0000","last_peered":"2023-07-25T14:37:56.225499+0000","last_clean":"2023-07-25T14:37:56.225499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:56.238867+0000","last_undegraded":"2023-07-25T14:37:56.238867+0000","last_fullsized":"2023-07-25T14:37:56.238867+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_clean_scrub_stamp":"2023-07-25T14:37:56.225499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.242382+0000","last_change":"2023-07-25T14:37:45.208126+0000","last_active":"2023-07-25T14:37:56.242382+0000","last_peered":"2023-07-25T14:37:56.242382+0000","last_clean":"2023-07-25T14:37:56.242382+0000","last_became_active":"2023-07-25T14:37:45.207856+0000","last_became_peered":"2023-07-25T14:37:45.207856+0000","last_unstale":"2023-07-25T14:37:56.242382+0000","last_undegraded":"2023-07-25T14:37:56.242382+0000","last_fullsized":"2023-07-25T14:37:56.242382+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T16:35:40.438338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.241158+0000","last_change":"2023-07-25T14:37:44.164773+0000","last_active":"2023-07-25T14:37:56.241158+0000","last_peered":"2023-07-25T14:37:56.241158+0000","last_clean":"2023-07-25T14:37:56.241158+0000","last_became_active":"2023-07-25T14:37:44.164480+0000","last_became_peered":"2023-07-25T14:37:44.164480+0000","last_unstale":"2023-07-25T14:37:56.241158+0000","last_undegraded":"2023-07-25T14:37:56.241158+0000","last_fullsized":"2023-07-25T14:37:56.241158+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T17:17:04.204095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-25T14:37:57.230919+0000","last_change":"2023-07-25T14:37:57.230919+0000","last_active":"2023-07-25T14:37:57.230919+0000","last_peered":"2023-07-25T14:37:57.230919+0000","last_clean":"2023-07-25T14:37:57.230919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:57.230919+0000","last_undegraded":"2023-07-25T14:37:57.230919+0000","last_fullsized":"2023-07-25T14:37:57.230919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2023-07-25T14:37:56.240388+0000","last_change":"2023-07-25T14:37:56.240388+0000","last_active":"2023-07-25T14:37:56.225499+0000","last_peered":"2023-07-25T14:37:56.225499+0000","last_clean":"2023-07-25T14:37:56.225499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:56.240388+0000","last_undegraded":"2023-07-25T14:37:56.240388+0000","last_fullsized":"2023-07-25T14:37:56.240388+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_clean_scrub_stamp":"2023-07-25T14:37:56.225499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.242712+0000","last_change":"2023-07-25T14:37:45.196449+0000","last_active":"2023-07-25T14:37:56.242712+0000","last_peered":"2023-07-25T14:37:56.242712+0000","last_clean":"2023-07-25T14:37:56.242712+0000","last_became_active":"2023-07-25T14:37:45.196172+0000","last_became_peered":"2023-07-25T14:37:45.196172+0000","last_unstale":"2023-07-25T14:37:56.242712+0000","last_undegraded":"2023-07-25T14:37:56.242712+0000","last_fullsized":"2023-07-25T14:37:56.242712+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T23:27:34.225061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.236341+0000","last_change":"2023-07-25T14:37:44.162751+0000","last_active":"2023-07-25T14:37:56.236341+0000","last_peered":"2023-07-25T14:37:56.236341+0000","last_clean":"2023-07-25T14:37:56.236341+0000","last_became_active":"2023-07-25T14:37:44.162037+0000","last_became_peered":"2023-07-25T14:37:44.162037+0000","last_unstale":"2023-07-25T14:37:56.236341+0000","last_undegraded":"2023-07-25T14:37:56.236341+0000","last_fullsized":"2023-07-25T14:37:56.236341+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T16:48:43.337902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-25T14:37:57.230919+0000","last_change":"2023-07-25T14:37:57.230919+0000","last_active":"2023-07-25T14:37:57.230919+0000","last_peered":"2023-07-25T14:37:57.230919+0000","last_clean":"2023-07-25T14:37:57.230919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:57.230919+0000","last_undegraded":"2023-07-25T14:37:57.230919+0000","last_fullsized":"2023-07-25T14:37:57.230919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2023-07-25T14:37:56.237456+0000","last_change":"2023-07-25T14:37:56.237456+0000","last_active":"2023-07-25T14:37:56.225499+0000","last_peered":"2023-07-25T14:37:56.225499+0000","last_clean":"2023-07-25T14:37:56.225499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:56.237456+0000","last_undegraded":"2023-07-25T14:37:56.237456+0000","last_fullsized":"2023-07-25T14:37:56.237456+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_clean_scrub_stamp":"2023-07-25T14:37:56.225499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.235625+0000","last_change":"2023-07-25T14:37:45.206751+0000","last_active":"2023-07-25T14:37:56.235625+0000","last_peered":"2023-07-25T14:37:56.235625+0000","last_clean":"2023-07-25T14:37:56.235625+0000","last_became_active":"2023-07-25T14:37:45.206422+0000","last_became_peered":"2023-07-25T14:37:45.206422+0000","last_unstale":"2023-07-25T14:37:56.235625+0000","last_undegraded":"2023-07-25T14:37:56.235625+0000","last_fullsized":"2023-07-25T14:37:56.235625+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T20:19:02.577921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"56'3","reported_seq":18,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.237595+0000","last_change":"2023-07-25T14:37:44.161397+0000","last_active":"2023-07-25T14:37:56.237595+0000","last_peered":"2023-07-25T14:37:56.237595+0000","last_clean":"2023-07-25T14:37:56.237595+0000","last_became_active":"2023-07-25T14:37:44.161134+0000","last_became_peered":"2023-07-25T14:37:44.161134+0000","last_unstale":"2023-07-25T14:37:56.237595+0000","last_undegraded":"2023-07-25T14:37:56.237595+0000","last_fullsized":"2023-07-25T14:37:56.237595+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T02:02:52.433473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-25T14:37:57.230919+0000","last_change":"2023-07-25T14:37:57.230919+0000","last_active":"2023-07-25T14:37:57.230919+0000","last_peered":"2023-07-25T14:37:57.230919+0000","last_clean":"2023-07-25T14:37:57.230919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:57.230919+0000","last_undegraded":"2023-07-25T14:37:57.230919+0000","last_fullsized":"2023-07-25T14:37:57.230919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2023-07-25T14:37:56.235761+0000","last_change":"2023-07-25T14:37:56.235761+0000","last_active":"2023-07-25T14:37:56.225499+0000","last_peered":"2023-07-25T14:37:56.225499+0000","last_clean":"2023-07-25T14:37:56.225499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:56.235761+0000","last_undegraded":"2023-07-25T14:37:56.235761+0000","last_fullsized":"2023-07-25T14:37:56.235761+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_clean_scrub_stamp":"2023-07-25T14:37:56.225499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.238822+0000","last_change":"2023-07-25T14:37:45.199815+0000","last_active":"2023-07-25T14:37:56.238822+0000","last_peered":"2023-07-25T14:37:56.238822+0000","last_clean":"2023-07-25T14:37:56.238822+0000","last_became_active":"2023-07-25T14:37:45.199555+0000","last_became_peered":"2023-07-25T14:37:45.199555+0000","last_unstale":"2023-07-25T14:37:56.238822+0000","last_undegraded":"2023-07-25T14:37:56.238822+0000","last_fullsized":"2023-07-25T14:37:56.238822+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T22:21:33.713509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"57'8","reported_seq":23,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.238853+0000","last_change":"2023-07-25T14:37:44.173212+0000","last_active":"2023-07-25T14:37:56.238853+0000","last_peered":"2023-07-25T14:37:56.238853+0000","last_clean":"2023-07-25T14:37:56.238853+0000","last_became_active":"2023-07-25T14:37:44.172950+0000","last_became_peered":"2023-07-25T14:37:44.172950+0000","last_unstale":"2023-07-25T14:37:56.238853+0000","last_undegraded":"2023-07-25T14:37:56.238853+0000","last_fullsized":"2023-07-25T14:37:56.238853+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T02:13:31.491403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3071,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-25T14:37:57.230919+0000","last_change":"2023-07-25T14:37:57.230919+0000","last_active":"2023-07-25T14:37:57.230919+0000","last_peered":"2023-07-25T14:37:57.230919+0000","last_clean":"2023-07-25T14:37:57.230919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:57.230919+0000","last_undegraded":"2023-07-25T14:37:57.230919+0000","last_fullsized":"2023-07-25T14:37:57.230919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2023-07-25T14:37:56.234389+0000","last_change":"2023-07-25T14:37:56.234389+0000","last_active":"2023-07-25T14:37:56.225499+0000","last_peered":"2023-07-25T14:37:56.225499+0000","last_clean":"2023-07-25T14:37:56.225499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:56.234389+0000","last_undegraded":"2023-07-25T14:37:56.234389+0000","last_fullsized":"2023-07-25T14:37:56.234389+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_clean_scrub_stamp":"2023-07-25T14:37:56.225499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.240020+0000","last_change":"2023-07-25T14:37:45.203546+0000","last_active":"2023-07-25T14:37:56.240020+0000","last_peered":"2023-07-25T14:37:56.240020+0000","last_clean":"2023-07-25T14:37:56.240020+0000","last_became_active":"2023-07-25T14:37:45.203115+0000","last_became_peered":"2023-07-25T14:37:45.203115+0000","last_unstale":"2023-07-25T14:37:56.240020+0000","last_undegraded":"2023-07-25T14:37:56.240020+0000","last_fullsized":"2023-07-25T14:37:56.240020+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T14:55:58.159337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"56'2","reported_seq":17,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.238541+0000","last_change":"2023-07-25T14:37:44.164563+0000","last_active":"2023-07-25T14:37:56.238541+0000","last_peered":"2023-07-25T14:37:56.238541+0000","last_clean":"2023-07-25T14:37:56.238541+0000","last_became_active":"2023-07-25T14:37:44.164255+0000","last_became_peered":"2023-07-25T14:37:44.164255+0000","last_unstale":"2023-07-25T14:37:56.238541+0000","last_undegraded":"2023-07-25T14:37:56.238541+0000","last_fullsized":"2023-07-25T14:37:56.238541+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T23:32:21.667103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-25T14:37:57.230919+0000","last_change":"2023-07-25T14:37:57.230919+0000","last_active":"2023-07-25T14:37:57.230919+0000","last_peered":"2023-07-25T14:37:57.230919+0000","last_clean":"2023-07-25T14:37:57.230919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:57.230919+0000","last_undegraded":"2023-07-25T14:37:57.230919+0000","last_fullsized":"2023-07-25T14:37:57.230919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2023-07-25T14:37:56.239470+0000","last_change":"2023-07-25T14:37:56.239470+0000","last_active":"2023-07-25T14:37:56.225499+0000","last_peered":"2023-07-25T14:37:56.225499+0000","last_clean":"2023-07-25T14:37:56.225499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:56.239470+0000","last_undegraded":"2023-07-25T14:37:56.239470+0000","last_fullsized":"2023-07-25T14:37:56.239470+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_clean_scrub_stamp":"2023-07-25T14:37:56.225499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.242146+0000","last_change":"2023-07-25T14:37:45.201081+0000","last_active":"2023-07-25T14:37:56.242146+0000","last_peered":"2023-07-25T14:37:56.242146+0000","last_clean":"2023-07-25T14:37:56.242146+0000","last_became_active":"2023-07-25T14:37:45.200738+0000","last_became_peered":"2023-07-25T14:37:45.200738+0000","last_unstale":"2023-07-25T14:37:56.242146+0000","last_undegraded":"2023-07-25T14:37:56.242146+0000","last_fullsized":"2023-07-25T14:37:56.242146+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T22:46:25.594575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.235589+0000","last_change":"2023-07-25T14:37:44.173296+0000","last_active":"2023-07-25T14:37:56.235589+0000","last_peered":"2023-07-25T14:37:56.235589+0000","last_clean":"2023-07-25T14:37:56.235589+0000","last_became_active":"2023-07-25T14:37:44.172957+0000","last_became_peered":"2023-07-25T14:37:44.172957+0000","last_unstale":"2023-07-25T14:37:56.235589+0000","last_undegraded":"2023-07-25T14:37:56.235589+0000","last_fullsized":"2023-07-25T14:37:56.235589+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T18:19:14.410236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-25T14:37:57.230919+0000","last_change":"2023-07-25T14:37:57.230919+0000","last_active":"2023-07-25T14:37:57.230919+0000","last_peered":"2023-07-25T14:37:57.230919+0000","last_clean":"2023-07-25T14:37:57.230919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:57.230919+0000","last_undegraded":"2023-07-25T14:37:57.230919+0000","last_fullsized":"2023-07-25T14:37:57.230919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2023-07-25T14:37:56.234329+0000","last_change":"2023-07-25T14:37:56.234329+0000","last_active":"2023-07-25T14:37:56.225499+0000","last_peered":"2023-07-25T14:37:56.225499+0000","last_clean":"2023-07-25T14:37:56.225499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:56.234329+0000","last_undegraded":"2023-07-25T14:37:56.234329+0000","last_fullsized":"2023-07-25T14:37:56.234329+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_clean_scrub_stamp":"2023-07-25T14:37:56.225499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.242076+0000","last_change":"2023-07-25T14:37:45.195068+0000","last_active":"2023-07-25T14:37:56.242076+0000","last_peered":"2023-07-25T14:37:56.242076+0000","last_clean":"2023-07-25T14:37:56.242076+0000","last_became_active":"2023-07-25T14:37:45.194820+0000","last_became_peered":"2023-07-25T14:37:45.194820+0000","last_unstale":"2023-07-25T14:37:56.242076+0000","last_undegraded":"2023-07-25T14:37:56.242076+0000","last_fullsized":"2023-07-25T14:37:56.242076+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T17:02:30.222184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.241962+0000","last_change":"2023-07-25T14:37:44.166150+0000","last_active":"2023-07-25T14:37:56.241962+0000","last_peered":"2023-07-25T14:37:56.241962+0000","last_clean":"2023-07-25T14:37:56.241962+0000","last_became_active":"2023-07-25T14:37:44.165851+0000","last_became_peered":"2023-07-25T14:37:44.165851+0000","last_unstale":"2023-07-25T14:37:56.241962+0000","last_undegraded":"2023-07-25T14:37:56.241962+0000","last_fullsized":"2023-07-25T14:37:56.241962+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T15:56:52.490461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-25T14:37:57.230919+0000","last_change":"2023-07-25T14:37:57.230919+0000","last_active":"2023-07-25T14:37:57.230919+0000","last_peered":"2023-07-25T14:37:57.230919+0000","last_clean":"2023-07-25T14:37:57.230919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:57.230919+0000","last_undegraded":"2023-07-25T14:37:57.230919+0000","last_fullsized":"2023-07-25T14:37:57.230919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2023-07-25T14:37:56.233850+0000","last_change":"2023-07-25T14:37:56.233850+0000","last_active":"2023-07-25T14:37:56.225499+0000","last_peered":"2023-07-25T14:37:56.225499+0000","last_clean":"2023-07-25T14:37:56.225499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:56.233850+0000","last_undegraded":"2023-07-25T14:37:56.233850+0000","last_fullsized":"2023-07-25T14:37:56.233850+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_clean_scrub_stamp":"2023-07-25T14:37:56.225499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.236821+0000","last_change":"2023-07-25T14:37:45.193890+0000","last_active":"2023-07-25T14:37:56.236821+0000","last_peered":"2023-07-25T14:37:56.236821+0000","last_clean":"2023-07-25T14:37:56.236821+0000","last_became_active":"2023-07-25T14:37:45.193634+0000","last_became_peered":"2023-07-25T14:37:45.193634+0000","last_unstale":"2023-07-25T14:37:56.236821+0000","last_undegraded":"2023-07-25T14:37:56.236821+0000","last_fullsized":"2023-07-25T14:37:56.236821+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T16:23:52.632199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"56'8","reported_seq":23,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.242948+0000","last_change":"2023-07-25T14:37:44.164996+0000","last_active":"2023-07-25T14:37:56.242948+0000","last_peered":"2023-07-25T14:37:56.242948+0000","last_clean":"2023-07-25T14:37:56.242948+0000","last_became_active":"2023-07-25T14:37:44.164753+0000","last_became_peered":"2023-07-25T14:37:44.164753+0000","last_unstale":"2023-07-25T14:37:56.242948+0000","last_undegraded":"2023-07-25T14:37:56.242948+0000","last_fullsized":"2023-07-25T14:37:56.242948+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T20:02:33.029907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-25T14:37:57.230919+0000","last_change":"2023-07-25T14:37:57.230919+0000","last_active":"2023-07-25T14:37:57.230919+0000","last_peered":"2023-07-25T14:37:57.230919+0000","last_clean":"2023-07-25T14:37:57.230919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:57.230919+0000","last_undegraded":"2023-07-25T14:37:57.230919+0000","last_fullsized":"2023-07-25T14:37:57.230919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2023-07-25T14:37:56.233730+0000","last_change":"2023-07-25T14:37:56.233730+0000","last_active":"2023-07-25T14:37:56.225499+0000","last_peered":"2023-07-25T14:37:56.225499+0000","last_clean":"2023-07-25T14:37:56.225499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:56.233730+0000","last_undegraded":"2023-07-25T14:37:56.233730+0000","last_fullsized":"2023-07-25T14:37:56.233730+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_clean_scrub_stamp":"2023-07-25T14:37:56.225499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.242531+0000","last_change":"2023-07-25T14:37:45.192838+0000","last_active":"2023-07-25T14:37:56.242531+0000","last_peered":"2023-07-25T14:37:56.242531+0000","last_clean":"2023-07-25T14:37:56.242531+0000","last_became_active":"2023-07-25T14:37:45.192552+0000","last_became_peered":"2023-07-25T14:37:45.192552+0000","last_unstale":"2023-07-25T14:37:56.242531+0000","last_undegraded":"2023-07-25T14:37:56.242531+0000","last_fullsized":"2023-07-25T14:37:56.242531+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T01:50:14.013418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"56'2","reported_seq":17,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.236250+0000","last_change":"2023-07-25T14:37:44.163016+0000","last_active":"2023-07-25T14:37:56.236250+0000","last_peered":"2023-07-25T14:37:56.236250+0000","last_clean":"2023-07-25T14:37:56.236250+0000","last_became_active":"2023-07-25T14:37:44.161974+0000","last_became_peered":"2023-07-25T14:37:44.161974+0000","last_unstale":"2023-07-25T14:37:56.236250+0000","last_undegraded":"2023-07-25T14:37:56.236250+0000","last_fullsized":"2023-07-25T14:37:56.236250+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T16:44:38.539954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-25T14:37:57.230919+0000","last_change":"2023-07-25T14:37:57.230919+0000","last_active":"2023-07-25T14:37:57.230919+0000","last_peered":"2023-07-25T14:37:57.230919+0000","last_clean":"2023-07-25T14:37:57.230919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:57.230919+0000","last_undegraded":"2023-07-25T14:37:57.230919+0000","last_fullsized":"2023-07-25T14:37:57.230919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2023-07-25T14:37:56.239090+0000","last_change":"2023-07-25T14:37:56.239090+0000","last_active":"2023-07-25T14:37:56.225499+0000","last_peered":"2023-07-25T14:37:56.225499+0000","last_clean":"2023-07-25T14:37:56.225499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:56.239090+0000","last_undegraded":"2023-07-25T14:37:56.239090+0000","last_fullsized":"2023-07-25T14:37:56.239090+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_clean_scrub_stamp":"2023-07-25T14:37:56.225499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.242222+0000","last_change":"2023-07-25T14:37:45.198281+0000","last_active":"2023-07-25T14:37:56.242222+0000","last_peered":"2023-07-25T14:37:56.242222+0000","last_clean":"2023-07-25T14:37:56.242222+0000","last_became_active":"2023-07-25T14:37:45.197975+0000","last_became_peered":"2023-07-25T14:37:45.197975+0000","last_unstale":"2023-07-25T14:37:56.242222+0000","last_undegraded":"2023-07-25T14:37:56.242222+0000","last_fullsized":"2023-07-25T14:37:56.242222+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T19:23:52.464351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"57'1","reported_seq":16,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.242513+0000","last_change":"2023-07-25T14:37:44.166254+0000","last_active":"2023-07-25T14:37:56.242513+0000","last_peered":"2023-07-25T14:37:56.242513+0000","last_clean":"2023-07-25T14:37:56.242513+0000","last_became_active":"2023-07-25T14:37:44.165974+0000","last_became_peered":"2023-07-25T14:37:44.165974+0000","last_unstale":"2023-07-25T14:37:56.242513+0000","last_undegraded":"2023-07-25T14:37:56.242513+0000","last_fullsized":"2023-07-25T14:37:56.242513+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T23:57:11.656266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-25T14:37:57.230919+0000","last_change":"2023-07-25T14:37:57.230919+0000","last_active":"2023-07-25T14:37:57.230919+0000","last_peered":"2023-07-25T14:37:57.230919+0000","last_clean":"2023-07-25T14:37:57.230919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:57.230919+0000","last_undegraded":"2023-07-25T14:37:57.230919+0000","last_fullsized":"2023-07-25T14:37:57.230919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2023-07-25T14:37:56.241742+0000","last_change":"2023-07-25T14:37:56.241742+0000","last_active":"2023-07-25T14:37:56.225499+0000","last_peered":"2023-07-25T14:37:56.225499+0000","last_clean":"2023-07-25T14:37:56.225499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:56.241742+0000","last_undegraded":"2023-07-25T14:37:56.241742+0000","last_fullsized":"2023-07-25T14:37:56.241742+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_clean_scrub_stamp":"2023-07-25T14:37:56.225499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.241475+0000","last_change":"2023-07-25T14:37:45.209704+0000","last_active":"2023-07-25T14:37:56.241475+0000","last_peered":"2023-07-25T14:37:56.241475+0000","last_clean":"2023-07-25T14:37:56.241475+0000","last_became_active":"2023-07-25T14:37:45.209391+0000","last_became_peered":"2023-07-25T14:37:45.209391+0000","last_unstale":"2023-07-25T14:37:56.241475+0000","last_undegraded":"2023-07-25T14:37:56.241475+0000","last_fullsized":"2023-07-25T14:37:56.241475+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:47:46.269974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.238952+0000","last_change":"2023-07-25T14:37:44.166101+0000","last_active":"2023-07-25T14:37:56.238952+0000","last_peered":"2023-07-25T14:37:56.238952+0000","last_clean":"2023-07-25T14:37:56.238952+0000","last_became_active":"2023-07-25T14:37:44.165823+0000","last_became_peered":"2023-07-25T14:37:44.165823+0000","last_unstale":"2023-07-25T14:37:56.238952+0000","last_undegraded":"2023-07-25T14:37:56.238952+0000","last_fullsized":"2023-07-25T14:37:56.238952+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T19:40:08.768720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-25T14:37:57.230919+0000","last_change":"2023-07-25T14:37:57.230919+0000","last_active":"2023-07-25T14:37:57.230919+0000","last_peered":"2023-07-25T14:37:57.230919+0000","last_clean":"2023-07-25T14:37:57.230919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:57.230919+0000","last_undegraded":"2023-07-25T14:37:57.230919+0000","last_fullsized":"2023-07-25T14:37:57.230919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2023-07-25T14:37:56.239766+0000","last_change":"2023-07-25T14:37:56.239766+0000","last_active":"2023-07-25T14:37:56.225499+0000","last_peered":"2023-07-25T14:37:56.225499+0000","last_clean":"2023-07-25T14:37:56.225499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:56.239766+0000","last_undegraded":"2023-07-25T14:37:56.239766+0000","last_fullsized":"2023-07-25T14:37:56.239766+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_clean_scrub_stamp":"2023-07-25T14:37:56.225499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.241992+0000","last_change":"2023-07-25T14:37:45.207757+0000","last_active":"2023-07-25T14:37:56.241992+0000","last_peered":"2023-07-25T14:37:56.241992+0000","last_clean":"2023-07-25T14:37:56.241992+0000","last_became_active":"2023-07-25T14:37:45.204097+0000","last_became_peered":"2023-07-25T14:37:45.204097+0000","last_unstale":"2023-07-25T14:37:56.241992+0000","last_undegraded":"2023-07-25T14:37:56.241992+0000","last_fullsized":"2023-07-25T14:37:56.241992+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T15:01:23.982072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.242439+0000","last_change":"2023-07-25T14:37:44.170019+0000","last_active":"2023-07-25T14:37:56.242439+0000","last_peered":"2023-07-25T14:37:56.242439+0000","last_clean":"2023-07-25T14:37:56.242439+0000","last_became_active":"2023-07-25T14:37:44.169764+0000","last_became_peered":"2023-07-25T14:37:44.169764+0000","last_unstale":"2023-07-25T14:37:56.242439+0000","last_undegraded":"2023-07-25T14:37:56.242439+0000","last_fullsized":"2023-07-25T14:37:56.242439+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T23:03:53.386487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-25T14:37:57.230919+0000","last_change":"2023-07-25T14:37:57.230919+0000","last_active":"2023-07-25T14:37:57.230919+0000","last_peered":"2023-07-25T14:37:57.230919+0000","last_clean":"2023-07-25T14:37:57.230919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:57.230919+0000","last_undegraded":"2023-07-25T14:37:57.230919+0000","last_fullsized":"2023-07-25T14:37:57.230919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2023-07-25T14:37:56.233790+0000","last_change":"2023-07-25T14:37:56.233790+0000","last_active":"2023-07-25T14:37:56.225499+0000","last_peered":"2023-07-25T14:37:56.225499+0000","last_clean":"2023-07-25T14:37:56.225499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:56.233790+0000","last_undegraded":"2023-07-25T14:37:56.233790+0000","last_fullsized":"2023-07-25T14:37:56.233790+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_clean_scrub_stamp":"2023-07-25T14:37:56.225499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.237171+0000","last_change":"2023-07-25T14:37:45.192706+0000","last_active":"2023-07-25T14:37:56.237171+0000","last_peered":"2023-07-25T14:37:56.237171+0000","last_clean":"2023-07-25T14:37:56.237171+0000","last_became_active":"2023-07-25T14:37:45.191283+0000","last_became_peered":"2023-07-25T14:37:45.191283+0000","last_unstale":"2023-07-25T14:37:56.237171+0000","last_undegraded":"2023-07-25T14:37:56.237171+0000","last_fullsized":"2023-07-25T14:37:56.237171+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T16:47:10.040613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.236854+0000","last_change":"2023-07-25T14:37:44.171694+0000","last_active":"2023-07-25T14:37:56.236854+0000","last_peered":"2023-07-25T14:37:56.236854+0000","last_clean":"2023-07-25T14:37:56.236854+0000","last_became_active":"2023-07-25T14:37:44.171465+0000","last_became_peered":"2023-07-25T14:37:44.171465+0000","last_unstale":"2023-07-25T14:37:56.236854+0000","last_undegraded":"2023-07-25T14:37:56.236854+0000","last_fullsized":"2023-07-25T14:37:56.236854+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T02:37:00.422225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-25T14:37:57.230919+0000","last_change":"2023-07-25T14:37:57.230919+0000","last_active":"2023-07-25T14:37:57.230919+0000","last_peered":"2023-07-25T14:37:57.230919+0000","last_clean":"2023-07-25T14:37:57.230919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:57.230919+0000","last_undegraded":"2023-07-25T14:37:57.230919+0000","last_fullsized":"2023-07-25T14:37:57.230919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2023-07-25T14:37:56.233794+0000","last_change":"2023-07-25T14:37:56.233794+0000","last_active":"2023-07-25T14:37:56.225499+0000","last_peered":"2023-07-25T14:37:56.225499+0000","last_clean":"2023-07-25T14:37:56.225499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:56.233794+0000","last_undegraded":"2023-07-25T14:37:56.233794+0000","last_fullsized":"2023-07-25T14:37:56.233794+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_clean_scrub_stamp":"2023-07-25T14:37:56.225499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.235432+0000","last_change":"2023-07-25T14:37:45.208487+0000","last_active":"2023-07-25T14:37:56.235432+0000","last_peered":"2023-07-25T14:37:56.235432+0000","last_clean":"2023-07-25T14:37:56.235432+0000","last_became_active":"2023-07-25T14:37:45.207037+0000","last_became_peered":"2023-07-25T14:37:45.207037+0000","last_unstale":"2023-07-25T14:37:56.235432+0000","last_undegraded":"2023-07-25T14:37:56.235432+0000","last_fullsized":"2023-07-25T14:37:56.235432+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T19:32:42.982355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.238099+0000","last_change":"2023-07-25T14:37:44.165012+0000","last_active":"2023-07-25T14:37:56.238099+0000","last_peered":"2023-07-25T14:37:56.238099+0000","last_clean":"2023-07-25T14:37:56.238099+0000","last_became_active":"2023-07-25T14:37:44.164759+0000","last_became_peered":"2023-07-25T14:37:44.164759+0000","last_unstale":"2023-07-25T14:37:56.238099+0000","last_undegraded":"2023-07-25T14:37:56.238099+0000","last_fullsized":"2023-07-25T14:37:56.238099+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T15:03:37.728247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-25T14:37:57.230919+0000","last_change":"2023-07-25T14:37:57.230919+0000","last_active":"2023-07-25T14:37:57.230919+0000","last_peered":"2023-07-25T14:37:57.230919+0000","last_clean":"2023-07-25T14:37:57.230919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:57.230919+0000","last_undegraded":"2023-07-25T14:37:57.230919+0000","last_fullsized":"2023-07-25T14:37:57.230919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2023-07-25T14:37:56.237604+0000","last_change":"2023-07-25T14:37:56.237604+0000","last_active":"2023-07-25T14:37:56.225499+0000","last_peered":"2023-07-25T14:37:56.225499+0000","last_clean":"2023-07-25T14:37:56.225499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:56.237604+0000","last_undegraded":"2023-07-25T14:37:56.237604+0000","last_fullsized":"2023-07-25T14:37:56.237604+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_clean_scrub_stamp":"2023-07-25T14:37:56.225499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.238472+0000","last_change":"2023-07-25T14:37:45.191681+0000","last_active":"2023-07-25T14:37:56.238472+0000","last_peered":"2023-07-25T14:37:56.238472+0000","last_clean":"2023-07-25T14:37:56.238472+0000","last_became_active":"2023-07-25T14:37:45.188974+0000","last_became_peered":"2023-07-25T14:37:45.188974+0000","last_unstale":"2023-07-25T14:37:56.238472+0000","last_undegraded":"2023-07-25T14:37:56.238472+0000","last_fullsized":"2023-07-25T14:37:56.238472+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T01:29:49.398716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.238871+0000","last_change":"2023-07-25T14:37:44.164983+0000","last_active":"2023-07-25T14:37:56.238871+0000","last_peered":"2023-07-25T14:37:56.238871+0000","last_clean":"2023-07-25T14:37:56.238871+0000","last_became_active":"2023-07-25T14:37:44.164413+0000","last_became_peered":"2023-07-25T14:37:44.164413+0000","last_unstale":"2023-07-25T14:37:56.238871+0000","last_undegraded":"2023-07-25T14:37:56.238871+0000","last_fullsized":"2023-07-25T14:37:56.238871+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T19:33:45.354123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-25T14:37:57.230919+0000","last_change":"2023-07-25T14:37:57.230919+0000","last_active":"2023-07-25T14:37:57.230919+0000","last_peered":"2023-07-25T14:37:57.230919+0000","last_clean":"2023-07-25T14:37:57.230919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:57.230919+0000","last_undegraded":"2023-07-25T14:37:57.230919+0000","last_fullsized":"2023-07-25T14:37:57.230919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2023-07-25T14:37:56.237505+0000","last_change":"2023-07-25T14:37:56.237505+0000","last_active":"2023-07-25T14:37:56.225499+0000","last_peered":"2023-07-25T14:37:56.225499+0000","last_clean":"2023-07-25T14:37:56.225499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:56.237505+0000","last_undegraded":"2023-07-25T14:37:56.237505+0000","last_fullsized":"2023-07-25T14:37:56.237505+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_clean_scrub_stamp":"2023-07-25T14:37:56.225499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.235269+0000","last_change":"2023-07-25T14:37:45.192970+0000","last_active":"2023-07-25T14:37:56.235269+0000","last_peered":"2023-07-25T14:37:56.235269+0000","last_clean":"2023-07-25T14:37:56.235269+0000","last_became_active":"2023-07-25T14:37:45.192666+0000","last_became_peered":"2023-07-25T14:37:45.192666+0000","last_unstale":"2023-07-25T14:37:56.235269+0000","last_undegraded":"2023-07-25T14:37:56.235269+0000","last_fullsized":"2023-07-25T14:37:56.235269+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T01:13:02.903330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.235440+0000","last_change":"2023-07-25T14:37:44.168526+0000","last_active":"2023-07-25T14:37:56.235440+0000","last_peered":"2023-07-25T14:37:56.235440+0000","last_clean":"2023-07-25T14:37:56.235440+0000","last_became_active":"2023-07-25T14:37:44.168336+0000","last_became_peered":"2023-07-25T14:37:44.168336+0000","last_unstale":"2023-07-25T14:37:56.235440+0000","last_undegraded":"2023-07-25T14:37:56.235440+0000","last_fullsized":"2023-07-25T14:37:56.235440+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:51:48.991901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-25T14:37:57.230919+0000","last_change":"2023-07-25T14:37:57.230919+0000","last_active":"2023-07-25T14:37:57.230919+0000","last_peered":"2023-07-25T14:37:57.230919+0000","last_clean":"2023-07-25T14:37:57.230919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:57.230919+0000","last_undegraded":"2023-07-25T14:37:57.230919+0000","last_fullsized":"2023-07-25T14:37:57.230919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2023-07-25T14:37:56.235599+0000","last_change":"2023-07-25T14:37:56.235599+0000","last_active":"2023-07-25T14:37:56.225499+0000","last_peered":"2023-07-25T14:37:56.225499+0000","last_clean":"2023-07-25T14:37:56.225499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:56.235599+0000","last_undegraded":"2023-07-25T14:37:56.235599+0000","last_fullsized":"2023-07-25T14:37:56.235599+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_clean_scrub_stamp":"2023-07-25T14:37:56.225499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.238911+0000","last_change":"2023-07-25T14:37:45.202784+0000","last_active":"2023-07-25T14:37:56.238911+0000","last_peered":"2023-07-25T14:37:56.238911+0000","last_clean":"2023-07-25T14:37:56.238911+0000","last_became_active":"2023-07-25T14:37:45.202515+0000","last_became_peered":"2023-07-25T14:37:45.202515+0000","last_unstale":"2023-07-25T14:37:56.238911+0000","last_undegraded":"2023-07-25T14:37:56.238911+0000","last_fullsized":"2023-07-25T14:37:56.238911+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T18:18:15.313003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.241632+0000","last_change":"2023-07-25T14:37:44.170162+0000","last_active":"2023-07-25T14:37:56.241632+0000","last_peered":"2023-07-25T14:37:56.241632+0000","last_clean":"2023-07-25T14:37:56.241632+0000","last_became_active":"2023-07-25T14:37:44.169805+0000","last_became_peered":"2023-07-25T14:37:44.169805+0000","last_unstale":"2023-07-25T14:37:56.241632+0000","last_undegraded":"2023-07-25T14:37:56.241632+0000","last_fullsized":"2023-07-25T14:37:56.241632+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T16:03:20.849610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":86,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.236146+0000","last_change":"2023-07-25T14:35:34.370772+0000","last_active":"2023-07-25T14:37:56.236146+0000","last_peered":"2023-07-25T14:37:56.236146+0000","last_clean":"2023-07-25T14:37:56.236146+0000","last_became_active":"2023-07-25T14:35:34.370549+0000","last_became_peered":"2023-07-25T14:35:34.370549+0000","last_unstale":"2023-07-25T14:37:56.236146+0000","last_undegraded":"2023-07-25T14:37:56.236146+0000","last_fullsized":"2023-07-25T14:37:56.236146+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_clean_scrub_stamp":"2023-07-25T14:35:33.358525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T01:59:55.322786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-25T14:37:57.230919+0000","last_change":"2023-07-25T14:37:57.230919+0000","last_active":"2023-07-25T14:37:57.230919+0000","last_peered":"2023-07-25T14:37:57.230919+0000","last_clean":"2023-07-25T14:37:57.230919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:57.230919+0000","last_undegraded":"2023-07-25T14:37:57.230919+0000","last_fullsized":"2023-07-25T14:37:57.230919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2023-07-25T14:37:56.235410+0000","last_change":"2023-07-25T14:37:56.235410+0000","last_active":"2023-07-25T14:37:56.225499+0000","last_peered":"2023-07-25T14:37:56.225499+0000","last_clean":"2023-07-25T14:37:56.225499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:56.235410+0000","last_undegraded":"2023-07-25T14:37:56.235410+0000","last_fullsized":"2023-07-25T14:37:56.235410+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_clean_scrub_stamp":"2023-07-25T14:37:56.225499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.238766+0000","last_change":"2023-07-25T14:37:45.194744+0000","last_active":"2023-07-25T14:37:56.238766+0000","last_peered":"2023-07-25T14:37:56.238766+0000","last_clean":"2023-07-25T14:37:56.238766+0000","last_became_active":"2023-07-25T14:37:45.194393+0000","last_became_peered":"2023-07-25T14:37:45.194393+0000","last_unstale":"2023-07-25T14:37:56.238766+0000","last_undegraded":"2023-07-25T14:37:56.238766+0000","last_fullsized":"2023-07-25T14:37:56.238766+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T01:41:30.373912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"56'1","reported_seq":16,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.236115+0000","last_change":"2023-07-25T14:37:44.166450+0000","last_active":"2023-07-25T14:37:56.236115+0000","last_peered":"2023-07-25T14:37:56.236115+0000","last_clean":"2023-07-25T14:37:56.236115+0000","last_became_active":"2023-07-25T14:37:44.165513+0000","last_became_peered":"2023-07-25T14:37:44.165513+0000","last_unstale":"2023-07-25T14:37:56.236115+0000","last_undegraded":"2023-07-25T14:37:56.236115+0000","last_fullsized":"2023-07-25T14:37:56.236115+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T02:03:11.976899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":86,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.236198+0000","last_change":"2023-07-25T14:35:35.321055+0000","last_active":"2023-07-25T14:37:56.236198+0000","last_peered":"2023-07-25T14:37:56.236198+0000","last_clean":"2023-07-25T14:37:56.236198+0000","last_became_active":"2023-07-25T14:35:35.320739+0000","last_became_peered":"2023-07-25T14:35:35.320739+0000","last_unstale":"2023-07-25T14:37:56.236198+0000","last_undegraded":"2023-07-25T14:37:56.236198+0000","last_fullsized":"2023-07-25T14:37:56.236198+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_clean_scrub_stamp":"2023-07-25T14:35:33.358525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T23:11:47.873574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-25T14:37:57.230919+0000","last_change":"2023-07-25T14:37:57.230919+0000","last_active":"2023-07-25T14:37:57.230919+0000","last_peered":"2023-07-25T14:37:57.230919+0000","last_clean":"2023-07-25T14:37:57.230919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:57.230919+0000","last_undegraded":"2023-07-25T14:37:57.230919+0000","last_fullsized":"2023-07-25T14:37:57.230919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2023-07-25T14:37:56.240548+0000","last_change":"2023-07-25T14:37:56.240548+0000","last_active":"2023-07-25T14:37:56.225499+0000","last_peered":"2023-07-25T14:37:56.225499+0000","last_clean":"2023-07-25T14:37:56.225499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:56.240548+0000","last_undegraded":"2023-07-25T14:37:56.240548+0000","last_fullsized":"2023-07-25T14:37:56.240548+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_clean_scrub_stamp":"2023-07-25T14:37:56.225499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.237936+0000","last_change":"2023-07-25T14:37:45.197932+0000","last_active":"2023-07-25T14:37:56.237936+0000","last_peered":"2023-07-25T14:37:56.237936+0000","last_clean":"2023-07-25T14:37:56.237936+0000","last_became_active":"2023-07-25T14:37:45.197610+0000","last_became_peered":"2023-07-25T14:37:45.197610+0000","last_unstale":"2023-07-25T14:37:56.237936+0000","last_undegraded":"2023-07-25T14:37:56.237936+0000","last_fullsized":"2023-07-25T14:37:56.237936+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T17:21:58.816449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.235698+0000","last_change":"2023-07-25T14:37:44.166137+0000","last_active":"2023-07-25T14:37:56.235698+0000","last_peered":"2023-07-25T14:37:56.235698+0000","last_clean":"2023-07-25T14:37:56.235698+0000","last_became_active":"2023-07-25T14:37:44.165836+0000","last_became_peered":"2023-07-25T14:37:44.165836+0000","last_unstale":"2023-07-25T14:37:56.235698+0000","last_undegraded":"2023-07-25T14:37:56.235698+0000","last_fullsized":"2023-07-25T14:37:56.235698+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T22:13:50.667407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":94,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.242261+0000","last_change":"2023-07-25T14:35:35.321057+0000","last_active":"2023-07-25T14:37:56.242261+0000","last_peered":"2023-07-25T14:37:56.242261+0000","last_clean":"2023-07-25T14:37:56.242261+0000","last_became_active":"2023-07-25T14:35:35.320751+0000","last_became_peered":"2023-07-25T14:35:35.320751+0000","last_unstale":"2023-07-25T14:37:56.242261+0000","last_undegraded":"2023-07-25T14:37:56.242261+0000","last_fullsized":"2023-07-25T14:37:56.242261+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_clean_scrub_stamp":"2023-07-25T14:35:33.358525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T18:48:18.863459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-25T14:37:57.230919+0000","last_change":"2023-07-25T14:37:57.230919+0000","last_active":"2023-07-25T14:37:57.230919+0000","last_peered":"2023-07-25T14:37:57.230919+0000","last_clean":"2023-07-25T14:37:57.230919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:57.230919+0000","last_undegraded":"2023-07-25T14:37:57.230919+0000","last_fullsized":"2023-07-25T14:37:57.230919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2023-07-25T14:37:56.239538+0000","last_change":"2023-07-25T14:37:56.239538+0000","last_active":"2023-07-25T14:37:56.225499+0000","last_peered":"2023-07-25T14:37:56.225499+0000","last_clean":"2023-07-25T14:37:56.225499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:56.239538+0000","last_undegraded":"2023-07-25T14:37:56.239538+0000","last_fullsized":"2023-07-25T14:37:56.239538+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_clean_scrub_stamp":"2023-07-25T14:37:56.225499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.237322+0000","last_change":"2023-07-25T14:37:45.195875+0000","last_active":"2023-07-25T14:37:56.237322+0000","last_peered":"2023-07-25T14:37:56.237322+0000","last_clean":"2023-07-25T14:37:56.237322+0000","last_became_active":"2023-07-25T14:37:45.195516+0000","last_became_peered":"2023-07-25T14:37:45.195516+0000","last_unstale":"2023-07-25T14:37:56.237322+0000","last_undegraded":"2023-07-25T14:37:56.237322+0000","last_fullsized":"2023-07-25T14:37:56.237322+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:37:15.728996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"56'2","reported_seq":17,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.235795+0000","last_change":"2023-07-25T14:37:44.167253+0000","last_active":"2023-07-25T14:37:56.235795+0000","last_peered":"2023-07-25T14:37:56.235795+0000","last_clean":"2023-07-25T14:37:56.235795+0000","last_became_active":"2023-07-25T14:37:44.166775+0000","last_became_peered":"2023-07-25T14:37:44.166775+0000","last_unstale":"2023-07-25T14:37:56.235795+0000","last_undegraded":"2023-07-25T14:37:56.235795+0000","last_fullsized":"2023-07-25T14:37:56.235795+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T15:57:42.466633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":86,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.240370+0000","last_change":"2023-07-25T14:35:35.321201+0000","last_active":"2023-07-25T14:37:56.240370+0000","last_peered":"2023-07-25T14:37:56.240370+0000","last_clean":"2023-07-25T14:37:56.240370+0000","last_became_active":"2023-07-25T14:35:35.320728+0000","last_became_peered":"2023-07-25T14:35:35.320728+0000","last_unstale":"2023-07-25T14:37:56.240370+0000","last_undegraded":"2023-07-25T14:37:56.240370+0000","last_fullsized":"2023-07-25T14:37:56.240370+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_clean_scrub_stamp":"2023-07-25T14:35:33.358525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T17:00:21.146168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-25T14:37:57.230919+0000","last_change":"2023-07-25T14:37:57.230919+0000","last_active":"2023-07-25T14:37:57.230919+0000","last_peered":"2023-07-25T14:37:57.230919+0000","last_clean":"2023-07-25T14:37:57.230919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:57.230919+0000","last_undegraded":"2023-07-25T14:37:57.230919+0000","last_fullsized":"2023-07-25T14:37:57.230919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2023-07-25T14:37:56.233775+0000","last_change":"2023-07-25T14:37:56.233775+0000","last_active":"2023-07-25T14:37:56.225499+0000","last_peered":"2023-07-25T14:37:56.225499+0000","last_clean":"2023-07-25T14:37:56.225499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:56.233775+0000","last_undegraded":"2023-07-25T14:37:56.233775+0000","last_fullsized":"2023-07-25T14:37:56.233775+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_clean_scrub_stamp":"2023-07-25T14:37:56.225499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.237169+0000","last_change":"2023-07-25T14:37:45.209554+0000","last_active":"2023-07-25T14:37:56.237169+0000","last_peered":"2023-07-25T14:37:56.237169+0000","last_clean":"2023-07-25T14:37:56.237169+0000","last_became_active":"2023-07-25T14:37:45.209319+0000","last_became_peered":"2023-07-25T14:37:45.209319+0000","last_unstale":"2023-07-25T14:37:56.237169+0000","last_undegraded":"2023-07-25T14:37:56.237169+0000","last_fullsized":"2023-07-25T14:37:56.237169+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:16:02.561651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.242024+0000","last_change":"2023-07-25T14:37:44.172803+0000","last_active":"2023-07-25T14:37:56.242024+0000","last_peered":"2023-07-25T14:37:56.242024+0000","last_clean":"2023-07-25T14:37:56.242024+0000","last_became_active":"2023-07-25T14:37:44.172512+0000","last_became_peered":"2023-07-25T14:37:44.172512+0000","last_unstale":"2023-07-25T14:37:56.242024+0000","last_undegraded":"2023-07-25T14:37:56.242024+0000","last_fullsized":"2023-07-25T14:37:56.242024+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T19:26:08.957564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":86,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.240143+0000","last_change":"2023-07-25T14:35:35.321448+0000","last_active":"2023-07-25T14:37:56.240143+0000","last_peered":"2023-07-25T14:37:56.240143+0000","last_clean":"2023-07-25T14:37:56.240143+0000","last_became_active":"2023-07-25T14:35:35.320830+0000","last_became_peered":"2023-07-25T14:35:35.320830+0000","last_unstale":"2023-07-25T14:37:56.240143+0000","last_undegraded":"2023-07-25T14:37:56.240143+0000","last_fullsized":"2023-07-25T14:37:56.240143+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_clean_scrub_stamp":"2023-07-25T14:35:33.358525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T19:31:35.569131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-25T14:37:57.230919+0000","last_change":"2023-07-25T14:37:57.230919+0000","last_active":"2023-07-25T14:37:57.230919+0000","last_peered":"2023-07-25T14:37:57.230919+0000","last_clean":"2023-07-25T14:37:57.230919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:57.230919+0000","last_undegraded":"2023-07-25T14:37:57.230919+0000","last_fullsized":"2023-07-25T14:37:57.230919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2023-07-25T14:37:56.241309+0000","last_change":"2023-07-25T14:37:56.241309+0000","last_active":"2023-07-25T14:37:56.225499+0000","last_peered":"2023-07-25T14:37:56.225499+0000","last_clean":"2023-07-25T14:37:56.225499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:56.241309+0000","last_undegraded":"2023-07-25T14:37:56.241309+0000","last_fullsized":"2023-07-25T14:37:56.241309+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_clean_scrub_stamp":"2023-07-25T14:37:56.225499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.236943+0000","last_change":"2023-07-25T14:37:45.207283+0000","last_active":"2023-07-25T14:37:56.236943+0000","last_peered":"2023-07-25T14:37:56.236943+0000","last_clean":"2023-07-25T14:37:56.236943+0000","last_became_active":"2023-07-25T14:37:45.206954+0000","last_became_peered":"2023-07-25T14:37:45.206954+0000","last_unstale":"2023-07-25T14:37:56.236943+0000","last_undegraded":"2023-07-25T14:37:56.236943+0000","last_fullsized":"2023-07-25T14:37:56.236943+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T22:12:27.941354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.242209+0000","last_change":"2023-07-25T14:37:44.172365+0000","last_active":"2023-07-25T14:37:56.242209+0000","last_peered":"2023-07-25T14:37:56.242209+0000","last_clean":"2023-07-25T14:37:56.242209+0000","last_became_active":"2023-07-25T14:37:44.172127+0000","last_became_peered":"2023-07-25T14:37:44.172127+0000","last_unstale":"2023-07-25T14:37:56.242209+0000","last_undegraded":"2023-07-25T14:37:56.242209+0000","last_fullsized":"2023-07-25T14:37:56.242209+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T01:35:45.274384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":236,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.240023+0000","last_change":"2023-07-25T14:35:34.372381+0000","last_active":"2023-07-25T14:37:56.240023+0000","last_peered":"2023-07-25T14:37:56.240023+0000","last_clean":"2023-07-25T14:37:56.240023+0000","last_became_active":"2023-07-25T14:35:34.371110+0000","last_became_peered":"2023-07-25T14:35:34.371110+0000","last_unstale":"2023-07-25T14:37:56.240023+0000","last_undegraded":"2023-07-25T14:37:56.240023+0000","last_fullsized":"2023-07-25T14:37:56.240023+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_clean_scrub_stamp":"2023-07-25T14:35:33.358525+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T01:20:46.377691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":84,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.238545+0000","last_change":"2023-07-25T14:35:34.370121+0000","last_active":"2023-07-25T14:37:56.238545+0000","last_peered":"2023-07-25T14:37:56.238545+0000","last_clean":"2023-07-25T14:37:56.238545+0000","last_became_active":"2023-07-25T14:35:34.369795+0000","last_became_peered":"2023-07-25T14:35:34.369795+0000","last_unstale":"2023-07-25T14:37:56.238545+0000","last_undegraded":"2023-07-25T14:37:56.238545+0000","last_fullsized":"2023-07-25T14:37:56.238545+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_clean_scrub_stamp":"2023-07-25T14:35:33.358525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:27:50.082204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-25T14:37:57.230919+0000","last_change":"2023-07-25T14:37:57.230919+0000","last_active":"2023-07-25T14:37:57.230919+0000","last_peered":"2023-07-25T14:37:57.230919+0000","last_clean":"2023-07-25T14:37:57.230919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:57.230919+0000","last_undegraded":"2023-07-25T14:37:57.230919+0000","last_fullsized":"2023-07-25T14:37:57.230919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2023-07-25T14:37:56.235573+0000","last_change":"2023-07-25T14:37:56.235573+0000","last_active":"2023-07-25T14:37:56.225499+0000","last_peered":"2023-07-25T14:37:56.225499+0000","last_clean":"2023-07-25T14:37:56.225499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:56.235573+0000","last_undegraded":"2023-07-25T14:37:56.235573+0000","last_fullsized":"2023-07-25T14:37:56.235573+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_clean_scrub_stamp":"2023-07-25T14:37:56.225499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.240395+0000","last_change":"2023-07-25T14:37:45.204523+0000","last_active":"2023-07-25T14:37:56.240395+0000","last_peered":"2023-07-25T14:37:56.240395+0000","last_clean":"2023-07-25T14:37:56.240395+0000","last_became_active":"2023-07-25T14:37:45.204095+0000","last_became_peered":"2023-07-25T14:37:45.204095+0000","last_unstale":"2023-07-25T14:37:56.240395+0000","last_undegraded":"2023-07-25T14:37:56.240395+0000","last_fullsized":"2023-07-25T14:37:56.240395+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T19:07:32.745444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"56'1","reported_seq":16,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.236521+0000","last_change":"2023-07-25T14:37:44.164092+0000","last_active":"2023-07-25T14:37:56.236521+0000","last_peered":"2023-07-25T14:37:56.236521+0000","last_clean":"2023-07-25T14:37:56.236521+0000","last_became_active":"2023-07-25T14:37:44.163068+0000","last_became_peered":"2023-07-25T14:37:44.163068+0000","last_unstale":"2023-07-25T14:37:56.236521+0000","last_undegraded":"2023-07-25T14:37:56.236521+0000","last_fullsized":"2023-07-25T14:37:56.236521+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T19:06:16.675638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":86,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.237280+0000","last_change":"2023-07-25T14:35:34.371737+0000","last_active":"2023-07-25T14:37:56.237280+0000","last_peered":"2023-07-25T14:37:56.237280+0000","last_clean":"2023-07-25T14:37:56.237280+0000","last_became_active":"2023-07-25T14:35:34.371411+0000","last_became_peered":"2023-07-25T14:35:34.371411+0000","last_unstale":"2023-07-25T14:37:56.237280+0000","last_undegraded":"2023-07-25T14:37:56.237280+0000","last_fullsized":"2023-07-25T14:37:56.237280+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_clean_scrub_stamp":"2023-07-25T14:35:33.358525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T14:39:57.304690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-07-25T14:37:57.230919+0000","last_change":"2023-07-25T14:37:57.230919+0000","last_active":"2023-07-25T14:37:57.230919+0000","last_peered":"2023-07-25T14:37:57.230919+0000","last_clean":"2023-07-25T14:37:57.230919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:57.230919+0000","last_undegraded":"2023-07-25T14:37:57.230919+0000","last_fullsized":"2023-07-25T14:37:57.230919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":1,"reported_epoch":58,"state":"creating+peering","last_fresh":"2023-07-25T14:37:56.235675+0000","last_change":"2023-07-25T14:37:56.235675+0000","last_active":"2023-07-25T14:37:56.225499+0000","last_peered":"2023-07-25T14:37:56.225499+0000","last_clean":"2023-07-25T14:37:56.225499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-25T14:37:56.235675+0000","last_undegraded":"2023-07-25T14:37:56.235675+0000","last_fullsized":"2023-07-25T14:37:56.235675+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_clean_scrub_stamp":"2023-07-25T14:37:56.225499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.242702+0000","last_change":"2023-07-25T14:37:45.204043+0000","last_active":"2023-07-25T14:37:56.242702+0000","last_peered":"2023-07-25T14:37:56.242702+0000","last_clean":"2023-07-25T14:37:56.242702+0000","last_became_active":"2023-07-25T14:37:45.203102+0000","last_became_peered":"2023-07-25T14:37:45.203102+0000","last_unstale":"2023-07-25T14:37:56.242702+0000","last_undegraded":"2023-07-25T14:37:56.242702+0000","last_fullsized":"2023-07-25T14:37:56.242702+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T18:53:31.784163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"56'2","reported_seq":17,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.240533+0000","last_change":"2023-07-25T14:37:44.167732+0000","last_active":"2023-07-25T14:37:56.240533+0000","last_peered":"2023-07-25T14:37:56.240533+0000","last_clean":"2023-07-25T14:37:56.240533+0000","last_became_active":"2023-07-25T14:37:44.167418+0000","last_became_peered":"2023-07-25T14:37:44.167418+0000","last_unstale":"2023-07-25T14:37:56.240533+0000","last_undegraded":"2023-07-25T14:37:56.240533+0000","last_fullsized":"2023-07-25T14:37:56.240533+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T18:04:34.335830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":92,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-07-25T14:37:56.239714+0000","last_change":"2023-07-25T14:35:34.371347+0000","last_active":"2023-07-25T14:37:56.239714+0000","last_peered":"2023-07-25T14:37:56.239714+0000","last_clean":"2023-07-25T14:37:56.239714+0000","last_became_active":"2023-07-25T14:35:34.371044+0000","last_became_peered":"2023-07-25T14:35:34.371044+0000","last_unstale":"2023-07-25T14:37:56.239714+0000","last_undegraded":"2023-07-25T14:37:56.239714+0000","last_fullsized":"2023-07-25T14:37:56.239714+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_clean_scrub_stamp":"2023-07-25T14:35:33.358525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:45:35.483366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":3869,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64510,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574881,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27768,"kb_used_data":744,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344072,"statfs":{"total":96636764160,"available":96608329728,"internally_reserved":0,"allocated":761856,"data_stored":917810,"data_compressed":32255,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jul 25 14:37:40 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.46999999999999997,"15min":0.46200000000000002},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.84299999999999997,"15min":0.90200000000000002},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.70699999999999996,"5min":9.1600000000000001,"15min":9.1600000000000001},"last":0.36199999999999999}]},{"osd":1,"last update":"Tue Jul 25 14:37:40 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.59299999999999997,"15min":0.60699999999999998},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.82699999999999996,"5min":1.5009999999999999,"15min":1.5009999999999999},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.61099999999999999,"15min":0.61799999999999999},"min":{"1min":0.45600000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.81100000000000005,"5min":1.526,"15min":1.526},"last":0.505}]},{"osd":2,"last update":"Tue Jul 25 14:37:40 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.54500000000000004,"15min":0.55400000000000005},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.71599999999999997,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.82899999999999996,"15min":0.873},"min":{"1min":0.38300000000000001,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.95399999999999996,"5min":8.1739999999999995,"15min":8.1739999999999995},"last":0.39400000000000002}]},{"osd":3,"last update":"Tue Jul 25 14:37:40 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.82499999999999996,"15min":0.875},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.81599999999999995,"5min":7.2279999999999998,"15min":7.2279999999999998},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.89600000000000002,"15min":0.93999999999999995},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.0029999999999999,"5min":7.1870000000000003,"15min":7.1870000000000003},"last":0.46400000000000002}]},{"osd":4,"last update":"Tue Jul 25 14:37:40 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.57999999999999996,"15min":0.57799999999999996},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.76600000000000001,"5min":1.254,"15min":1.254},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.59299999999999997,"15min":0.59599999999999997},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.877,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.58399999999999996}]},{"osd":5,"last update":"Tue Jul 25 14:37:40 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.52600000000000002,"5min":0.501,"15min":0.501},"max":{"1min":0.84699999999999998,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.55300000000000005}]},{"osd":6,"last update":"Tue Jul 25 14:37:40 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.45800000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.88,"5min":1.286,"15min":1.286},"last":0.621},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.64500000000000002,"15min":0.64400000000000002},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.63300000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574880,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27700,"kb_used_data":680,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344140,"statfs":{"total":96636764160,"available":96608399360,"internally_reserved":0,"allocated":696320,"data_stored":326918,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jul 25 14:37:35 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.54200000000000004,"15min":0.54800000000000004},"min":{"1min":0.32300000000000001,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.73199999999999998,"5min":1.9370000000000001,"15min":1.9370000000000001},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.56000000000000005,"15min":0.56599999999999995},"min":{"1min":0.39700000000000002,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.77200000000000002,"5min":2.6779999999999999,"15min":2.6779999999999999},"last":0.45300000000000001}]},{"osd":1,"last update":"Tue Jul 25 14:37:35 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.53500000000000003,"15min":0.54100000000000004},"min":{"1min":0.34599999999999997,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.70799999999999996,"5min":2.5720000000000001,"15min":2.5720000000000001},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.503,"5min":0.54500000000000004,"15min":0.55200000000000005},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.64800000000000002,"5min":1.6259999999999999,"15min":1.6259999999999999},"last":0.38100000000000001}]},{"osd":2,"last update":"Tue Jul 25 14:37:35 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.52700000000000002,"15min":0.52100000000000002},"min":{"1min":0.34399999999999997,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.79000000000000004,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.50600000000000001,"15min":0.501},"min":{"1min":0.375,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.68799999999999994,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.50600000000000001}]},{"osd":3,"last update":"Tue Jul 25 14:37:35 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.64900000000000002,"15min":0.66300000000000003},"min":{"1min":0.38600000000000001,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.73499999999999999,"5min":3.5750000000000002,"15min":3.5750000000000002},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.69899999999999995,"15min":0.71699999999999997},"min":{"1min":0.36499999999999999,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.77400000000000002,"5min":4.7190000000000003,"15min":4.7190000000000003},"last":0.59399999999999997}]},{"osd":4,"last update":"Tue Jul 25 14:37:35 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.65700000000000003,"15min":0.67200000000000004},"min":{"1min":0.39100000000000001,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.79700000000000004,"5min":4.694,"15min":4.694},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.622,"15min":0.628},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.74099999999999999,"5min":2.7839999999999998,"15min":2.7839999999999998},"last":0.496}]},{"osd":5,"last update":"Tue Jul 25 14:37:35 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.54500000000000004,"15min":0.54100000000000004},"min":{"1min":0.36199999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.752,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.624,"15min":0.627},"min":{"1min":0.376,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.82499999999999996,"5min":1.7310000000000001,"15min":1.7310000000000001},"last":0.623}]},{"osd":7,"last update":"Tue Jul 25 14:37:35 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.68799999999999994,"15min":0.69799999999999995},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.81299999999999994,"5min":2.7290000000000001,"15min":2.7290000000000001},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.58999999999999997,"15min":0.58199999999999996},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.60899999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574880,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27772,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344068,"statfs":{"total":96636764160,"available":96608325632,"internally_reserved":0,"allocated":774144,"data_stored":920881,"data_compressed":32255,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jul 25 14:37:39 2023","interfaces":[{"interface":"back","average":{"1min":0.314,"5min":0.318,"15min":0.318},"min":{"1min":0.23999999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.44500000000000001,"5min":0.47099999999999997,"15min":0.47099999999999997},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.312,"5min":0.32800000000000001,"15min":0.33000000000000002},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.44700000000000001,"5min":0.48899999999999999,"15min":0.48899999999999999},"last":0.23300000000000001}]},{"osd":2,"last update":"Tue Jul 25 14:37:39 2023","interfaces":[{"interface":"back","average":{"1min":0.29799999999999999,"5min":0.30599999999999999,"15min":0.308},"min":{"1min":0.20100000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"last":0.27300000000000002},{"interface":"front","average":{"1min":0.35399999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"min":{"1min":0.27200000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.45800000000000002,"5min":0.56499999999999995,"15min":0.56499999999999995},"last":0.38100000000000001}]},{"osd":3,"last update":"Tue Jul 25 14:37:39 2023","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.371,"15min":0.373},"min":{"1min":0.29699999999999999,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.432,"5min":0.52900000000000003,"15min":0.52900000000000003},"last":0.308},{"interface":"front","average":{"1min":0.33000000000000002,"5min":0.34499999999999997,"15min":0.34699999999999998},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.46999999999999997,"5min":0.496,"15min":0.496},"last":0.32400000000000001}]},{"osd":4,"last update":"Tue Jul 25 14:37:39 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.55300000000000005,"15min":0.55100000000000005},"min":{"1min":0.44900000000000001,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.78400000000000003,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.498},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.55400000000000005,"15min":0.55800000000000005},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.65100000000000002,"5min":0.745,"15min":0.745},"last":0.68799999999999994}]},{"osd":5,"last update":"Tue Jul 25 14:37:39 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.56100000000000005,"15min":0.55900000000000005},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.754,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.56399999999999995,"15min":0.56499999999999995},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.64800000000000002}]},{"osd":6,"last update":"Tue Jul 25 14:37:39 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.58099999999999996,"15min":0.58199999999999996},"min":{"1min":0.46000000000000002,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.70399999999999996,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.56899999999999995,"15min":0.57099999999999995},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.54300000000000004}]},{"osd":7,"last update":"Tue Jul 25 14:37:39 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.47699999999999998,"5min":0.443,"15min":0.443},"max":{"1min":0.71799999999999997,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.59599999999999997,"15min":0.59499999999999997},"min":{"1min":0.48399999999999999,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.74199999999999999,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.66100000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574880,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27688,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344152,"statfs":{"total":96636764160,"available":96608411648,"internally_reserved":0,"allocated":684032,"data_stored":325765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Jul 25 14:37:36 2023","interfaces":[{"interface":"back","average":{"1min":0.29899999999999999,"5min":0.35099999999999998,"15min":0.35899999999999999},"min":{"1min":0.17199999999999999,"5min":0.17199999999999999,"15min":0.17199999999999999},"max":{"1min":0.39000000000000001,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.26900000000000002},{"interface":"front","average":{"1min":0.28899999999999998,"5min":0.58899999999999997,"15min":0.63900000000000001},"min":{"1min":0.19600000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.37,"5min":6.5369999999999999,"15min":6.5369999999999999},"last":0.35499999999999998}]},{"osd":2,"last update":"Tue Jul 25 14:37:36 2023","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":0.36399999999999999,"15min":0.37},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.47599999999999998,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.37},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.63,"15min":0.67600000000000005},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.439,"5min":6.5659999999999998,"15min":6.5659999999999998},"last":0.38800000000000001}]},{"osd":3,"last update":"Tue Jul 25 14:37:36 2023","interfaces":[{"interface":"back","average":{"1min":0.33100000000000002,"5min":0.88700000000000001,"15min":0.97899999999999998},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.48799999999999999,"5min":12.449,"15min":12.449},"last":0.29899999999999999},{"interface":"front","average":{"1min":0.36199999999999999,"5min":0.40999999999999998,"15min":0.41799999999999998},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.45100000000000001,"5min":1.079,"15min":1.079},"last":0.32200000000000001}]},{"osd":4,"last update":"Tue Jul 25 14:37:36 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.79300000000000004,"15min":0.83199999999999996},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.71399999999999997,"5min":6.5099999999999998,"15min":6.5099999999999998},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.55600000000000005,"5min":1.0680000000000001,"15min":1.1539999999999999},"min":{"1min":0.35399999999999998,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.66100000000000003,"5min":12.35,"15min":12.35},"last":0.65700000000000003}]},{"osd":5,"last update":"Tue Jul 25 14:37:36 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.58699999999999997,"15min":0.58899999999999997},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.68100000000000005,"5min":1.107,"15min":1.107},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.82599999999999996,"15min":0.872},"min":{"1min":0.39000000000000001,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.76600000000000001,"5min":6.4349999999999996,"15min":6.4349999999999996},"last":0.67000000000000004}]},{"osd":6,"last update":"Tue Jul 25 14:37:36 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":1.0820000000000001,"15min":1.1679999999999999},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.74099999999999999,"5min":12.417,"15min":12.417},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.60799999999999998,"15min":0.61199999999999999},"min":{"1min":0.45000000000000001,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.68999999999999995,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.621}]},{"osd":7,"last update":"Tue Jul 25 14:37:36 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.85799999999999998,"15min":0.90400000000000003},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.67200000000000004,"5min":6.4809999999999999,"15min":6.4809999999999999},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.57799999999999996,"5min":1.091,"15min":1.177},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.77500000000000002,"5min":12.388999999999999,"15min":12.388999999999999},"last":0.60799999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574880,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27696,"kb_used_data":680,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344144,"statfs":{"total":96636764160,"available":96608403456,"internally_reserved":0,"allocated":696320,"data_stored":328836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jul 25 14:37:34 2023","interfaces":[{"interface":"back","average":{"1min":0.311,"5min":0.38200000000000001,"15min":0.39400000000000002},"min":{"1min":0.20399999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.39000000000000001,"5min":2.1030000000000002,"15min":2.1030000000000002},"last":0.22600000000000001},{"interface":"front","average":{"1min":0.27600000000000002,"5min":0.92800000000000005,"15min":1.0369999999999999},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":0.32900000000000001,"5min":16.969000000000001,"15min":16.969000000000001},"last":0.32000000000000001}]},{"osd":1,"last update":"Tue Jul 25 14:37:34 2023","interfaces":[{"interface":"back","average":{"1min":0.33400000000000002,"5min":0.35099999999999998,"15min":0.35399999999999998},"min":{"1min":0.26200000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.41899999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.34300000000000003,"5min":0.379,"15min":0.38500000000000001},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.50800000000000001,"5min":1.111,"15min":1.111},"last":0.251}]},{"osd":3,"last update":"Tue Jul 25 14:37:34 2023","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.79700000000000004,"15min":0.876},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.36799999999999999,"5min":13.035,"15min":13.035},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.376,"5min":0.40300000000000002,"15min":0.40699999999999997},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.61599999999999999,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.35799999999999998}]},{"osd":4,"last update":"Tue Jul 25 14:37:34 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.754,"15min":0.79200000000000004},"min":{"1min":0.39100000000000001,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.73099999999999998,"5min":6.165,"15min":6.165},"last":0.439},{"interface":"front","average":{"1min":0.55900000000000005,"5min":1.0069999999999999,"15min":1.0820000000000001},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.74199999999999999,"5min":13.004,"15min":13.004},"last":0.51300000000000001}]},{"osd":5,"last update":"Tue Jul 25 14:37:34 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.57199999999999995,"15min":0.57299999999999995},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.75800000000000001,"15min":0.79500000000000004},"min":{"1min":0.41299999999999998,"5min":0.378,"15min":0.378},"max":{"1min":0.69499999999999995,"5min":6.226,"15min":6.226},"last":0.46800000000000003}]},{"osd":6,"last update":"Tue Jul 25 14:37:34 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":1.006,"15min":1.0840000000000001},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.77400000000000002,"5min":12.974,"15min":12.974},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.59499999999999997,"15min":0.59699999999999998},"min":{"1min":0.42599999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.77200000000000002,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.501}]},{"osd":7,"last update":"Tue Jul 25 14:37:34 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.77900000000000003,"15min":0.81499999999999995},"min":{"1min":0.40899999999999997,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.70499999999999996,"5min":6.1989999999999998,"15min":6.1989999999999998},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.56699999999999995,"5min":1.026,"15min":1.1020000000000001},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.74199999999999999,"5min":12.936999999999999,"15min":12.936999999999999},"last":0.42899999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574880,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27696,"kb_used_data":676,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344144,"statfs":{"total":96636764160,"available":96608403456,"internally_reserved":0,"allocated":692224,"data_stored":325877,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jul 25 14:37:36 2023","interfaces":[{"interface":"back","average":{"1min":0.29999999999999999,"5min":0.312,"15min":0.314},"min":{"1min":0.20300000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"last":0.307},{"interface":"front","average":{"1min":0.32100000000000001,"5min":0.309,"15min":0.307},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.45400000000000001,"5min":0.46300000000000002,"15min":0.46300000000000002},"last":0.28399999999999997}]},{"osd":1,"last update":"Tue Jul 25 14:37:36 2023","interfaces":[{"interface":"back","average":{"1min":0.315,"5min":0.308,"15min":0.307},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"last":0.29799999999999999},{"interface":"front","average":{"1min":0.34200000000000003,"5min":0.36899999999999999,"15min":0.373},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.496,"5min":0.59099999999999997,"15min":0.59099999999999997},"last":0.35399999999999998}]},{"osd":2,"last update":"Tue Jul 25 14:37:36 2023","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":0.37,"15min":0.374},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.441,"5min":0.502,"15min":0.502},"last":0.26000000000000001},{"interface":"front","average":{"1min":0.35899999999999999,"5min":0.39300000000000002,"15min":0.39900000000000002},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.47299999999999998,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.41299999999999998}]},{"osd":4,"last update":"Tue Jul 25 14:37:36 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.57199999999999995,"15min":0.57399999999999995},"min":{"1min":0.42399999999999999,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.77000000000000002,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58799999999999997,"15min":0.58899999999999997},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.65400000000000003}]},{"osd":5,"last update":"Tue Jul 25 14:37:36 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.70999999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.625,"15min":0.63100000000000001},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.88100000000000001,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.60899999999999999}]},{"osd":6,"last update":"Tue Jul 25 14:37:36 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.61499999999999999,"15min":0.625},"min":{"1min":0.46300000000000002,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.68799999999999994,"5min":0.871,"15min":0.871},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.59399999999999997,"15min":0.59599999999999997},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.68300000000000005}]},{"osd":7,"last update":"Tue Jul 25 14:37:36 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.59099999999999997,"15min":0.58899999999999997},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.83599999999999997,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.628},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.60699999999999998,"15min":0.60899999999999999},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.55700000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574880,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27696,"kb_used_data":676,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344144,"statfs":{"total":96636764160,"available":96608403456,"internally_reserved":0,"allocated":692224,"data_stored":326896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jul 25 14:37:35 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.55500000000000005,"15min":0.56100000000000005},"min":{"1min":0.39600000000000002,"5min":0.31,"15min":0.31},"max":{"1min":0.75700000000000001,"5min":0.876,"15min":0.876},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.51100000000000001,"15min":0.51000000000000001},"min":{"1min":0.371,"5min":0.309,"15min":0.309},"max":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.48299999999999998}]},{"osd":1,"last update":"Tue Jul 25 14:37:35 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.69099999999999995,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.53600000000000003,"15min":0.53200000000000003},"min":{"1min":0.38900000000000001,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.70399999999999996,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.46300000000000002}]},{"osd":2,"last update":"Tue Jul 25 14:37:35 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.55500000000000005,"15min":0.54900000000000004},"min":{"1min":0.435,"5min":0.376,"15min":0.376},"max":{"1min":0.67600000000000005,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.54600000000000004,"15min":0.54200000000000004},"min":{"1min":0.41999999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.60999999999999999}]},{"osd":3,"last update":"Tue Jul 25 14:37:35 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.53600000000000003,"15min":0.53000000000000003},"min":{"1min":0.33000000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.73299999999999998,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.63,"15min":0.63800000000000001},"min":{"1min":0.47299999999999998,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.76100000000000001,"5min":1.8720000000000001,"15min":1.8720000000000001},"last":0.57699999999999996}]},{"osd":5,"last update":"Tue Jul 25 14:37:35 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.49099999999999999,"15min":0.47599999999999998},"min":{"1min":0.36399999999999999,"5min":0.317,"15min":0.317},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.61899999999999999,"15min":0.61599999999999999},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.748,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.58899999999999997}]},{"osd":6,"last update":"Tue Jul 25 14:37:35 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.54900000000000004,"15min":0.54100000000000004},"min":{"1min":0.41299999999999998,"5min":0.372,"15min":0.372},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.59899999999999998,"15min":0.60099999999999998},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.68999999999999995}]},{"osd":7,"last update":"Tue Jul 25 14:37:35 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.623,"15min":0.61899999999999999},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.79500000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.64600000000000002,"15min":0.64000000000000001},"min":{"1min":0.54900000000000004,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.63100000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574880,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27696,"kb_used_data":676,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344144,"statfs":{"total":96636764160,"available":96608403456,"internally_reserved":0,"allocated":692224,"data_stored":326916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jul 25 14:37:32 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.59799999999999998,"15min":0.60599999999999998},"min":{"1min":0.35399999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.83399999999999996,"5min":2.548,"15min":2.548},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.55700000000000005,"15min":0.56000000000000005},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.76500000000000001,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.51800000000000002}]},{"osd":1,"last update":"Tue Jul 25 14:37:32 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.58099999999999996,"15min":0.58499999999999996},"min":{"1min":0.39900000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.753,"5min":1.657,"15min":1.657},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.42599999999999999,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.79700000000000004,"5min":1.752,"15min":1.752},"last":0.56999999999999995}]},{"osd":2,"last update":"Tue Jul 25 14:37:32 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.56499999999999995,"15min":0.56699999999999995},"min":{"1min":0.38800000000000001,"5min":0.372,"15min":0.372},"max":{"1min":0.82899999999999996,"5min":0.872,"15min":0.872},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.54300000000000004,"15min":0.53400000000000003},"min":{"1min":0.46500000000000002,"5min":0.376,"15min":0.376},"max":{"1min":0.751,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.47199999999999998}]},{"osd":3,"last update":"Tue Jul 25 14:37:32 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.56399999999999995,"15min":0.55800000000000005},"min":{"1min":0.39900000000000002,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.504},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.60899999999999999,"15min":0.60499999999999998},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.49199999999999999}]},{"osd":4,"last update":"Tue Jul 25 14:37:32 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.52900000000000003,"15min":0.52700000000000002},"min":{"1min":0.38900000000000001,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.56100000000000005,"15min":0.55900000000000005},"min":{"1min":0.35499999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.55300000000000005}]},{"osd":6,"last update":"Tue Jul 25 14:37:32 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.56299999999999994,"15min":0.55400000000000005},"min":{"1min":0.42499999999999999,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.57099999999999995,"15min":0.56799999999999995},"min":{"1min":0.35999999999999999,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.44500000000000001}]},{"osd":7,"last update":"Tue Jul 25 14:37:32 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.58799999999999997,"15min":0.58199999999999996},"min":{"1min":0.41899999999999998,"5min":0.375,"15min":0.375},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.627,"5min":0.64400000000000002,"15min":0.64700000000000002},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.81399999999999995,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.46100000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32255,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32255,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3071,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-25T14:38:03.127 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.39 is not active+clean 2023-07-25T14:38:03.127 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-25T14:37:57.230919+0000', 'last_change': '2023-07-25T14:37:57.230919+0000', 'last_active': '2023-07-25T14:37:57.230919+0000', 'last_peered': '2023-07-25T14:37:57.230919+0000', 'last_clean': '2023-07-25T14:37:57.230919+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-25T14:37:57.230919+0000', 'last_undegraded': '2023-07-25T14:37:57.230919+0000', 'last_fullsized': '2023-07-25T14:37:57.230919+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-25T14:37:57.230919+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-25T14:37:57.230919+0000', 'last_clean_scrub_stamp': '2023-07-25T14:37:57.230919+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-25T14:38:03.128 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.38 is not active+clean 2023-07-25T14:38:03.128 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-25T14:37:57.230919+0000', 'last_change': '2023-07-25T14:37:57.230919+0000', 'last_active': '2023-07-25T14:37:57.230919+0000', 'last_peered': '2023-07-25T14:37:57.230919+0000', 'last_clean': '2023-07-25T14:37:57.230919+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-25T14:37:57.230919+0000', 'last_undegraded': '2023-07-25T14:37:57.230919+0000', 'last_fullsized': '2023-07-25T14:37:57.230919+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-25T14:37:57.230919+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-25T14:37:57.230919+0000', 'last_clean_scrub_stamp': '2023-07-25T14:37:57.230919+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-25T14:38:03.128 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.3b is not active+clean 2023-07-25T14:38:03.129 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-25T14:37:57.230919+0000', 'last_change': '2023-07-25T14:37:57.230919+0000', 'last_active': '2023-07-25T14:37:57.230919+0000', 'last_peered': '2023-07-25T14:37:57.230919+0000', 'last_clean': '2023-07-25T14:37:57.230919+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-25T14:37:57.230919+0000', 'last_undegraded': '2023-07-25T14:37:57.230919+0000', 'last_fullsized': '2023-07-25T14:37:57.230919+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-25T14:37:57.230919+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-25T14:37:57.230919+0000', 'last_clean_scrub_stamp': '2023-07-25T14:37:57.230919+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-25T14:38:03.129 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.3a is not active+clean 2023-07-25T14:38:03.129 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-25T14:37:57.230919+0000', 'last_change': '2023-07-25T14:37:57.230919+0000', 'last_active': '2023-07-25T14:37:57.230919+0000', 'last_peered': '2023-07-25T14:37:57.230919+0000', 'last_clean': '2023-07-25T14:37:57.230919+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-25T14:37:57.230919+0000', 'last_undegraded': '2023-07-25T14:37:57.230919+0000', 'last_fullsized': '2023-07-25T14:37:57.230919+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-25T14:37:57.230919+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-25T14:37:57.230919+0000', 'last_clean_scrub_stamp': '2023-07-25T14:37:57.230919+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-25T14:38:03.130 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.3d is not active+clean 2023-07-25T14:38:03.130 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-25T14:37:57.230919+0000', 'last_change': '2023-07-25T14:37:57.230919+0000', 'last_active': '2023-07-25T14:37:57.230919+0000', 'last_peered': '2023-07-25T14:37:57.230919+0000', 'last_clean': '2023-07-25T14:37:57.230919+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-25T14:37:57.230919+0000', 'last_undegraded': '2023-07-25T14:37:57.230919+0000', 'last_fullsized': '2023-07-25T14:37:57.230919+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-25T14:37:57.230919+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-25T14:37:57.230919+0000', 'last_clean_scrub_stamp': '2023-07-25T14:37:57.230919+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-25T14:38:03.130 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.3c is not active+clean 2023-07-25T14:38:03.131 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-25T14:37:57.230919+0000', 'last_change': '2023-07-25T14:37:57.230919+0000', 'last_active': '2023-07-25T14:37:57.230919+0000', 'last_peered': '2023-07-25T14:37:57.230919+0000', 'last_clean': '2023-07-25T14:37:57.230919+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-25T14:37:57.230919+0000', 'last_undegraded': '2023-07-25T14:37:57.230919+0000', 'last_fullsized': '2023-07-25T14:37:57.230919+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-25T14:37:57.230919+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-25T14:37:57.230919+0000', 'last_clean_scrub_stamp': '2023-07-25T14:37:57.230919+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-25T14:38:03.131 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.3f is not active+clean 2023-07-25T14:38:03.131 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-25T14:37:57.230919+0000', 'last_change': '2023-07-25T14:37:57.230919+0000', 'last_active': '2023-07-25T14:37:57.230919+0000', 'last_peered': '2023-07-25T14:37:57.230919+0000', 'last_clean': '2023-07-25T14:37:57.230919+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-25T14:37:57.230919+0000', 'last_undegraded': '2023-07-25T14:37:57.230919+0000', 'last_fullsized': '2023-07-25T14:37:57.230919+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-25T14:37:57.230919+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-25T14:37:57.230919+0000', 'last_clean_scrub_stamp': '2023-07-25T14:37:57.230919+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-25T14:38:03.132 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.3e is not active+clean 2023-07-25T14:38:03.132 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-25T14:37:57.230919+0000', 'last_change': '2023-07-25T14:37:57.230919+0000', 'last_active': '2023-07-25T14:37:57.230919+0000', 'last_peered': '2023-07-25T14:37:57.230919+0000', 'last_clean': '2023-07-25T14:37:57.230919+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-25T14:37:57.230919+0000', 'last_undegraded': '2023-07-25T14:37:57.230919+0000', 'last_fullsized': '2023-07-25T14:37:57.230919+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-25T14:37:57.230919+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-25T14:37:57.230919+0000', 'last_clean_scrub_stamp': '2023-07-25T14:37:57.230919+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-25T14:38:03.132 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.31 is not active+clean 2023-07-25T14:38:03.133 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-25T14:37:57.230919+0000', 'last_change': '2023-07-25T14:37:57.230919+0000', 'last_active': '2023-07-25T14:37:57.230919+0000', 'last_peered': '2023-07-25T14:37:57.230919+0000', 'last_clean': '2023-07-25T14:37:57.230919+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-25T14:37:57.230919+0000', 'last_undegraded': '2023-07-25T14:37:57.230919+0000', 'last_fullsized': '2023-07-25T14:37:57.230919+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-25T14:37:57.230919+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-25T14:37:57.230919+0000', 'last_clean_scrub_stamp': '2023-07-25T14:37:57.230919+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-25T14:38:03.133 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.30 is not active+clean 2023-07-25T14:38:03.133 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-25T14:37:57.230919+0000', 'last_change': '2023-07-25T14:37:57.230919+0000', 'last_active': '2023-07-25T14:37:57.230919+0000', 'last_peered': '2023-07-25T14:37:57.230919+0000', 'last_clean': '2023-07-25T14:37:57.230919+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-25T14:37:57.230919+0000', 'last_undegraded': '2023-07-25T14:37:57.230919+0000', 'last_fullsized': '2023-07-25T14:37:57.230919+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-25T14:37:57.230919+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-25T14:37:57.230919+0000', 'last_clean_scrub_stamp': '2023-07-25T14:37:57.230919+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-25T14:38:03.134 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.33 is not active+clean 2023-07-25T14:38:03.134 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-25T14:37:57.230919+0000', 'last_change': '2023-07-25T14:37:57.230919+0000', 'last_active': '2023-07-25T14:37:57.230919+0000', 'last_peered': '2023-07-25T14:37:57.230919+0000', 'last_clean': '2023-07-25T14:37:57.230919+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-25T14:37:57.230919+0000', 'last_undegraded': '2023-07-25T14:37:57.230919+0000', 'last_fullsized': '2023-07-25T14:37:57.230919+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-25T14:37:57.230919+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-25T14:37:57.230919+0000', 'last_clean_scrub_stamp': '2023-07-25T14:37:57.230919+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-25T14:38:03.134 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.32 is not active+clean 2023-07-25T14:38:03.134 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-25T14:37:57.230919+0000', 'last_change': '2023-07-25T14:37:57.230919+0000', 'last_active': '2023-07-25T14:37:57.230919+0000', 'last_peered': '2023-07-25T14:37:57.230919+0000', 'last_clean': '2023-07-25T14:37:57.230919+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-25T14:37:57.230919+0000', 'last_undegraded': '2023-07-25T14:37:57.230919+0000', 'last_fullsized': '2023-07-25T14:37:57.230919+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-25T14:37:57.230919+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-25T14:37:57.230919+0000', 'last_clean_scrub_stamp': '2023-07-25T14:37:57.230919+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-25T14:38:03.135 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.35 is not active+clean 2023-07-25T14:38:03.135 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-25T14:37:57.230919+0000', 'last_change': '2023-07-25T14:37:57.230919+0000', 'last_active': '2023-07-25T14:37:57.230919+0000', 'last_peered': '2023-07-25T14:37:57.230919+0000', 'last_clean': '2023-07-25T14:37:57.230919+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-25T14:37:57.230919+0000', 'last_undegraded': '2023-07-25T14:37:57.230919+0000', 'last_fullsized': '2023-07-25T14:37:57.230919+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-25T14:37:57.230919+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-25T14:37:57.230919+0000', 'last_clean_scrub_stamp': '2023-07-25T14:37:57.230919+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-25T14:38:03.135 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.34 is not active+clean 2023-07-25T14:38:03.136 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-25T14:37:57.230919+0000', 'last_change': '2023-07-25T14:37:57.230919+0000', 'last_active': '2023-07-25T14:37:57.230919+0000', 'last_peered': '2023-07-25T14:37:57.230919+0000', 'last_clean': '2023-07-25T14:37:57.230919+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-25T14:37:57.230919+0000', 'last_undegraded': '2023-07-25T14:37:57.230919+0000', 'last_fullsized': '2023-07-25T14:37:57.230919+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-25T14:37:57.230919+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-25T14:37:57.230919+0000', 'last_clean_scrub_stamp': '2023-07-25T14:37:57.230919+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-25T14:38:03.136 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.37 is not active+clean 2023-07-25T14:38:03.136 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-25T14:37:57.230919+0000', 'last_change': '2023-07-25T14:37:57.230919+0000', 'last_active': '2023-07-25T14:37:57.230919+0000', 'last_peered': '2023-07-25T14:37:57.230919+0000', 'last_clean': '2023-07-25T14:37:57.230919+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-25T14:37:57.230919+0000', 'last_undegraded': '2023-07-25T14:37:57.230919+0000', 'last_fullsized': '2023-07-25T14:37:57.230919+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-25T14:37:57.230919+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-25T14:37:57.230919+0000', 'last_clean_scrub_stamp': '2023-07-25T14:37:57.230919+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-25T14:38:03.137 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.36 is not active+clean 2023-07-25T14:38:03.137 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-25T14:37:57.230919+0000', 'last_change': '2023-07-25T14:37:57.230919+0000', 'last_active': '2023-07-25T14:37:57.230919+0000', 'last_peered': '2023-07-25T14:37:57.230919+0000', 'last_clean': '2023-07-25T14:37:57.230919+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-25T14:37:57.230919+0000', 'last_undegraded': '2023-07-25T14:37:57.230919+0000', 'last_fullsized': '2023-07-25T14:37:57.230919+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-25T14:37:57.230919+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-25T14:37:57.230919+0000', 'last_clean_scrub_stamp': '2023-07-25T14:37:57.230919+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-25T14:38:03.137 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.29 is not active+clean 2023-07-25T14:38:03.138 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-25T14:37:57.230919+0000', 'last_change': '2023-07-25T14:37:57.230919+0000', 'last_active': '2023-07-25T14:37:57.230919+0000', 'last_peered': '2023-07-25T14:37:57.230919+0000', 'last_clean': '2023-07-25T14:37:57.230919+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-25T14:37:57.230919+0000', 'last_undegraded': '2023-07-25T14:37:57.230919+0000', 'last_fullsized': '2023-07-25T14:37:57.230919+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-25T14:37:57.230919+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-25T14:37:57.230919+0000', 'last_clean_scrub_stamp': '2023-07-25T14:37:57.230919+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-25T14:38:03.138 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.28 is not active+clean 2023-07-25T14:38:03.138 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-25T14:37:57.230919+0000', 'last_change': '2023-07-25T14:37:57.230919+0000', 'last_active': '2023-07-25T14:37:57.230919+0000', 'last_peered': '2023-07-25T14:37:57.230919+0000', 'last_clean': '2023-07-25T14:37:57.230919+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-25T14:37:57.230919+0000', 'last_undegraded': '2023-07-25T14:37:57.230919+0000', 'last_fullsized': '2023-07-25T14:37:57.230919+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-25T14:37:57.230919+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-25T14:37:57.230919+0000', 'last_clean_scrub_stamp': '2023-07-25T14:37:57.230919+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-25T14:38:03.138 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.2b is not active+clean 2023-07-25T14:38:03.139 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-25T14:37:57.230919+0000', 'last_change': '2023-07-25T14:37:57.230919+0000', 'last_active': '2023-07-25T14:37:57.230919+0000', 'last_peered': '2023-07-25T14:37:57.230919+0000', 'last_clean': '2023-07-25T14:37:57.230919+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-25T14:37:57.230919+0000', 'last_undegraded': '2023-07-25T14:37:57.230919+0000', 'last_fullsized': '2023-07-25T14:37:57.230919+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-25T14:37:57.230919+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-25T14:37:57.230919+0000', 'last_clean_scrub_stamp': '2023-07-25T14:37:57.230919+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-25T14:38:03.139 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.2a is not active+clean 2023-07-25T14:38:03.139 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-25T14:37:57.230919+0000', 'last_change': '2023-07-25T14:37:57.230919+0000', 'last_active': '2023-07-25T14:37:57.230919+0000', 'last_peered': '2023-07-25T14:37:57.230919+0000', 'last_clean': '2023-07-25T14:37:57.230919+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-25T14:37:57.230919+0000', 'last_undegraded': '2023-07-25T14:37:57.230919+0000', 'last_fullsized': '2023-07-25T14:37:57.230919+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-25T14:37:57.230919+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-25T14:37:57.230919+0000', 'last_clean_scrub_stamp': '2023-07-25T14:37:57.230919+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-25T14:38:03.140 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.2d is not active+clean 2023-07-25T14:38:03.140 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-25T14:37:57.230919+0000', 'last_change': '2023-07-25T14:37:57.230919+0000', 'last_active': '2023-07-25T14:37:57.230919+0000', 'last_peered': '2023-07-25T14:37:57.230919+0000', 'last_clean': '2023-07-25T14:37:57.230919+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-25T14:37:57.230919+0000', 'last_undegraded': '2023-07-25T14:37:57.230919+0000', 'last_fullsized': '2023-07-25T14:37:57.230919+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-25T14:37:57.230919+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-25T14:37:57.230919+0000', 'last_clean_scrub_stamp': '2023-07-25T14:37:57.230919+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-25T14:38:03.140 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.2c is not active+clean 2023-07-25T14:38:03.141 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-25T14:37:57.230919+0000', 'last_change': '2023-07-25T14:37:57.230919+0000', 'last_active': '2023-07-25T14:37:57.230919+0000', 'last_peered': '2023-07-25T14:37:57.230919+0000', 'last_clean': '2023-07-25T14:37:57.230919+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-25T14:37:57.230919+0000', 'last_undegraded': '2023-07-25T14:37:57.230919+0000', 'last_fullsized': '2023-07-25T14:37:57.230919+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-25T14:37:57.230919+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-25T14:37:57.230919+0000', 'last_clean_scrub_stamp': '2023-07-25T14:37:57.230919+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-25T14:38:03.141 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.2f is not active+clean 2023-07-25T14:38:03.141 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-25T14:37:57.230919+0000', 'last_change': '2023-07-25T14:37:57.230919+0000', 'last_active': '2023-07-25T14:37:57.230919+0000', 'last_peered': '2023-07-25T14:37:57.230919+0000', 'last_clean': '2023-07-25T14:37:57.230919+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-25T14:37:57.230919+0000', 'last_undegraded': '2023-07-25T14:37:57.230919+0000', 'last_fullsized': '2023-07-25T14:37:57.230919+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-25T14:37:57.230919+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-25T14:37:57.230919+0000', 'last_clean_scrub_stamp': '2023-07-25T14:37:57.230919+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-25T14:38:03.142 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.2e is not active+clean 2023-07-25T14:38:03.142 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-25T14:37:57.230919+0000', 'last_change': '2023-07-25T14:37:57.230919+0000', 'last_active': '2023-07-25T14:37:57.230919+0000', 'last_peered': '2023-07-25T14:37:57.230919+0000', 'last_clean': '2023-07-25T14:37:57.230919+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-25T14:37:57.230919+0000', 'last_undegraded': '2023-07-25T14:37:57.230919+0000', 'last_fullsized': '2023-07-25T14:37:57.230919+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-25T14:37:57.230919+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-25T14:37:57.230919+0000', 'last_clean_scrub_stamp': '2023-07-25T14:37:57.230919+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-25T14:38:03.142 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.21 is not active+clean 2023-07-25T14:38:03.142 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-25T14:37:57.230919+0000', 'last_change': '2023-07-25T14:37:57.230919+0000', 'last_active': '2023-07-25T14:37:57.230919+0000', 'last_peered': '2023-07-25T14:37:57.230919+0000', 'last_clean': '2023-07-25T14:37:57.230919+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-25T14:37:57.230919+0000', 'last_undegraded': '2023-07-25T14:37:57.230919+0000', 'last_fullsized': '2023-07-25T14:37:57.230919+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-25T14:37:57.230919+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-25T14:37:57.230919+0000', 'last_clean_scrub_stamp': '2023-07-25T14:37:57.230919+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-25T14:38:03.143 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.20 is not active+clean 2023-07-25T14:38:03.143 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-25T14:37:57.230919+0000', 'last_change': '2023-07-25T14:37:57.230919+0000', 'last_active': '2023-07-25T14:37:57.230919+0000', 'last_peered': '2023-07-25T14:37:57.230919+0000', 'last_clean': '2023-07-25T14:37:57.230919+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-25T14:37:57.230919+0000', 'last_undegraded': '2023-07-25T14:37:57.230919+0000', 'last_fullsized': '2023-07-25T14:37:57.230919+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-25T14:37:57.230919+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-25T14:37:57.230919+0000', 'last_clean_scrub_stamp': '2023-07-25T14:37:57.230919+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-25T14:38:03.143 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.23 is not active+clean 2023-07-25T14:38:03.144 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-25T14:37:57.230919+0000', 'last_change': '2023-07-25T14:37:57.230919+0000', 'last_active': '2023-07-25T14:37:57.230919+0000', 'last_peered': '2023-07-25T14:37:57.230919+0000', 'last_clean': '2023-07-25T14:37:57.230919+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-25T14:37:57.230919+0000', 'last_undegraded': '2023-07-25T14:37:57.230919+0000', 'last_fullsized': '2023-07-25T14:37:57.230919+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-25T14:37:57.230919+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-25T14:37:57.230919+0000', 'last_clean_scrub_stamp': '2023-07-25T14:37:57.230919+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-25T14:38:03.144 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.22 is not active+clean 2023-07-25T14:38:03.144 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-25T14:37:57.230919+0000', 'last_change': '2023-07-25T14:37:57.230919+0000', 'last_active': '2023-07-25T14:37:57.230919+0000', 'last_peered': '2023-07-25T14:37:57.230919+0000', 'last_clean': '2023-07-25T14:37:57.230919+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-25T14:37:57.230919+0000', 'last_undegraded': '2023-07-25T14:37:57.230919+0000', 'last_fullsized': '2023-07-25T14:37:57.230919+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-25T14:37:57.230919+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-25T14:37:57.230919+0000', 'last_clean_scrub_stamp': '2023-07-25T14:37:57.230919+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-25T14:38:03.145 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.25 is not active+clean 2023-07-25T14:38:03.145 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-25T14:37:57.230919+0000', 'last_change': '2023-07-25T14:37:57.230919+0000', 'last_active': '2023-07-25T14:37:57.230919+0000', 'last_peered': '2023-07-25T14:37:57.230919+0000', 'last_clean': '2023-07-25T14:37:57.230919+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-25T14:37:57.230919+0000', 'last_undegraded': '2023-07-25T14:37:57.230919+0000', 'last_fullsized': '2023-07-25T14:37:57.230919+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-25T14:37:57.230919+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-25T14:37:57.230919+0000', 'last_clean_scrub_stamp': '2023-07-25T14:37:57.230919+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-25T14:38:03.145 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.24 is not active+clean 2023-07-25T14:38:03.146 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-25T14:37:57.230919+0000', 'last_change': '2023-07-25T14:37:57.230919+0000', 'last_active': '2023-07-25T14:37:57.230919+0000', 'last_peered': '2023-07-25T14:37:57.230919+0000', 'last_clean': '2023-07-25T14:37:57.230919+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-25T14:37:57.230919+0000', 'last_undegraded': '2023-07-25T14:37:57.230919+0000', 'last_fullsized': '2023-07-25T14:37:57.230919+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-25T14:37:57.230919+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-25T14:37:57.230919+0000', 'last_clean_scrub_stamp': '2023-07-25T14:37:57.230919+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-25T14:38:03.147 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.27 is not active+clean 2023-07-25T14:38:03.147 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-25T14:37:57.230919+0000', 'last_change': '2023-07-25T14:37:57.230919+0000', 'last_active': '2023-07-25T14:37:57.230919+0000', 'last_peered': '2023-07-25T14:37:57.230919+0000', 'last_clean': '2023-07-25T14:37:57.230919+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-25T14:37:57.230919+0000', 'last_undegraded': '2023-07-25T14:37:57.230919+0000', 'last_fullsized': '2023-07-25T14:37:57.230919+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-25T14:37:57.230919+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-25T14:37:57.230919+0000', 'last_clean_scrub_stamp': '2023-07-25T14:37:57.230919+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-25T14:38:03.147 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.26 is not active+clean 2023-07-25T14:38:03.148 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-25T14:37:57.230919+0000', 'last_change': '2023-07-25T14:37:57.230919+0000', 'last_active': '2023-07-25T14:37:57.230919+0000', 'last_peered': '2023-07-25T14:37:57.230919+0000', 'last_clean': '2023-07-25T14:37:57.230919+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-25T14:37:57.230919+0000', 'last_undegraded': '2023-07-25T14:37:57.230919+0000', 'last_fullsized': '2023-07-25T14:37:57.230919+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-25T14:37:57.230919+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-25T14:37:57.230919+0000', 'last_clean_scrub_stamp': '2023-07-25T14:37:57.230919+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-25T14:38:03.148 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.18 is not active+clean 2023-07-25T14:38:03.148 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-25T14:37:57.230919+0000', 'last_change': '2023-07-25T14:37:57.230919+0000', 'last_active': '2023-07-25T14:37:57.230919+0000', 'last_peered': '2023-07-25T14:37:57.230919+0000', 'last_clean': '2023-07-25T14:37:57.230919+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-25T14:37:57.230919+0000', 'last_undegraded': '2023-07-25T14:37:57.230919+0000', 'last_fullsized': '2023-07-25T14:37:57.230919+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-25T14:37:57.230919+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-25T14:37:57.230919+0000', 'last_clean_scrub_stamp': '2023-07-25T14:37:57.230919+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-25T14:38:03.149 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.19 is not active+clean 2023-07-25T14:38:03.149 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 58, 'state': 'creating+peering', 'last_fresh': '2023-07-25T14:37:56.240395+0000', 'last_change': '2023-07-25T14:37:56.240395+0000', 'last_active': '2023-07-25T14:37:56.225499+0000', 'last_peered': '2023-07-25T14:37:56.225499+0000', 'last_clean': '2023-07-25T14:37:56.225499+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-25T14:37:56.240395+0000', 'last_undegraded': '2023-07-25T14:37:56.240395+0000', 'last_fullsized': '2023-07-25T14:37:56.240395+0000', 'mapping_epoch': 58, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 58, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-25T14:37:56.225499+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-25T14:37:56.225499+0000', 'last_clean_scrub_stamp': '2023-07-25T14:37:56.225499+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-25T14:38:03.149 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.19 is not active+clean 2023-07-25T14:38:03.149 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-25T14:37:57.230919+0000', 'last_change': '2023-07-25T14:37:57.230919+0000', 'last_active': '2023-07-25T14:37:57.230919+0000', 'last_peered': '2023-07-25T14:37:57.230919+0000', 'last_clean': '2023-07-25T14:37:57.230919+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-25T14:37:57.230919+0000', 'last_undegraded': '2023-07-25T14:37:57.230919+0000', 'last_fullsized': '2023-07-25T14:37:57.230919+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-25T14:37:57.230919+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-25T14:37:57.230919+0000', 'last_clean_scrub_stamp': '2023-07-25T14:37:57.230919+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-25T14:38:03.150 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.18 is not active+clean 2023-07-25T14:38:03.150 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 58, 'state': 'creating+peering', 'last_fresh': '2023-07-25T14:37:56.237722+0000', 'last_change': '2023-07-25T14:37:56.237722+0000', 'last_active': '2023-07-25T14:37:56.225499+0000', 'last_peered': '2023-07-25T14:37:56.225499+0000', 'last_clean': '2023-07-25T14:37:56.225499+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-25T14:37:56.237722+0000', 'last_undegraded': '2023-07-25T14:37:56.237722+0000', 'last_fullsized': '2023-07-25T14:37:56.237722+0000', 'mapping_epoch': 58, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 58, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-25T14:37:56.225499+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-25T14:37:56.225499+0000', 'last_clean_scrub_stamp': '2023-07-25T14:37:56.225499+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-25T14:38:03.150 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.1a is not active+clean 2023-07-25T14:38:03.151 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-25T14:37:57.230919+0000', 'last_change': '2023-07-25T14:37:57.230919+0000', 'last_active': '2023-07-25T14:37:57.230919+0000', 'last_peered': '2023-07-25T14:37:57.230919+0000', 'last_clean': '2023-07-25T14:37:57.230919+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-25T14:37:57.230919+0000', 'last_undegraded': '2023-07-25T14:37:57.230919+0000', 'last_fullsized': '2023-07-25T14:37:57.230919+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-25T14:37:57.230919+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-25T14:37:57.230919+0000', 'last_clean_scrub_stamp': '2023-07-25T14:37:57.230919+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-25T14:38:03.151 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.1b is not active+clean 2023-07-25T14:38:03.151 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 58, 'state': 'creating+peering', 'last_fresh': '2023-07-25T14:37:56.239988+0000', 'last_change': '2023-07-25T14:37:56.239988+0000', 'last_active': '2023-07-25T14:37:56.225499+0000', 'last_peered': '2023-07-25T14:37:56.225499+0000', 'last_clean': '2023-07-25T14:37:56.225499+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-25T14:37:56.239988+0000', 'last_undegraded': '2023-07-25T14:37:56.239988+0000', 'last_fullsized': '2023-07-25T14:37:56.239988+0000', 'mapping_epoch': 58, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 58, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-25T14:37:56.225499+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-25T14:37:56.225499+0000', 'last_clean_scrub_stamp': '2023-07-25T14:37:56.225499+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-25T14:38:03.152 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.1b is not active+clean 2023-07-25T14:38:03.152 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-25T14:37:57.230919+0000', 'last_change': '2023-07-25T14:37:57.230919+0000', 'last_active': '2023-07-25T14:37:57.230919+0000', 'last_peered': '2023-07-25T14:37:57.230919+0000', 'last_clean': '2023-07-25T14:37:57.230919+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-25T14:37:57.230919+0000', 'last_undegraded': '2023-07-25T14:37:57.230919+0000', 'last_fullsized': '2023-07-25T14:37:57.230919+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-25T14:37:57.230919+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-25T14:37:57.230919+0000', 'last_clean_scrub_stamp': '2023-07-25T14:37:57.230919+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-25T14:38:03.152 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.1a is not active+clean 2023-07-25T14:38:03.156 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 58, 'state': 'creating+peering', 'last_fresh': '2023-07-25T14:37:56.240262+0000', 'last_change': '2023-07-25T14:37:56.240262+0000', 'last_active': '2023-07-25T14:37:56.225499+0000', 'last_peered': '2023-07-25T14:37:56.225499+0000', 'last_clean': '2023-07-25T14:37:56.225499+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-25T14:37:56.240262+0000', 'last_undegraded': '2023-07-25T14:37:56.240262+0000', 'last_fullsized': '2023-07-25T14:37:56.240262+0000', 'mapping_epoch': 58, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 58, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-25T14:37:56.225499+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-25T14:37:56.225499+0000', 'last_clean_scrub_stamp': '2023-07-25T14:37:56.225499+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-25T14:38:03.156 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.1c is not active+clean 2023-07-25T14:38:03.157 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-25T14:37:57.230919+0000', 'last_change': '2023-07-25T14:37:57.230919+0000', 'last_active': '2023-07-25T14:37:57.230919+0000', 'last_peered': '2023-07-25T14:37:57.230919+0000', 'last_clean': '2023-07-25T14:37:57.230919+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-25T14:37:57.230919+0000', 'last_undegraded': '2023-07-25T14:37:57.230919+0000', 'last_fullsized': '2023-07-25T14:37:57.230919+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-25T14:37:57.230919+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-25T14:37:57.230919+0000', 'last_clean_scrub_stamp': '2023-07-25T14:37:57.230919+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-25T14:38:03.157 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.1d is not active+clean 2023-07-25T14:38:03.157 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 58, 'state': 'creating+peering', 'last_fresh': '2023-07-25T14:37:56.240853+0000', 'last_change': '2023-07-25T14:37:56.240853+0000', 'last_active': '2023-07-25T14:37:56.225499+0000', 'last_peered': '2023-07-25T14:37:56.225499+0000', 'last_clean': '2023-07-25T14:37:56.225499+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-25T14:37:56.240853+0000', 'last_undegraded': '2023-07-25T14:37:56.240853+0000', 'last_fullsized': '2023-07-25T14:37:56.240853+0000', 'mapping_epoch': 58, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 58, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-25T14:37:56.225499+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-25T14:37:56.225499+0000', 'last_clean_scrub_stamp': '2023-07-25T14:37:56.225499+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-25T14:38:03.158 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.1d is not active+clean 2023-07-25T14:38:03.158 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-25T14:37:57.230919+0000', 'last_change': '2023-07-25T14:37:57.230919+0000', 'last_active': '2023-07-25T14:37:57.230919+0000', 'last_peered': '2023-07-25T14:37:57.230919+0000', 'last_clean': '2023-07-25T14:37:57.230919+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-25T14:37:57.230919+0000', 'last_undegraded': '2023-07-25T14:37:57.230919+0000', 'last_fullsized': '2023-07-25T14:37:57.230919+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-25T14:37:57.230919+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-25T14:37:57.230919+0000', 'last_clean_scrub_stamp': '2023-07-25T14:37:57.230919+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-25T14:38:03.158 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.1c is not active+clean 2023-07-25T14:38:03.159 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 58, 'state': 'creating+peering', 'last_fresh': '2023-07-25T14:37:56.240918+0000', 'last_change': '2023-07-25T14:37:56.240918+0000', 'last_active': '2023-07-25T14:37:56.225499+0000', 'last_peered': '2023-07-25T14:37:56.225499+0000', 'last_clean': '2023-07-25T14:37:56.225499+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-25T14:37:56.240918+0000', 'last_undegraded': '2023-07-25T14:37:56.240918+0000', 'last_fullsized': '2023-07-25T14:37:56.240918+0000', 'mapping_epoch': 58, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 58, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-25T14:37:56.225499+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-25T14:37:56.225499+0000', 'last_clean_scrub_stamp': '2023-07-25T14:37:56.225499+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-25T14:38:03.159 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.1e is not active+clean 2023-07-25T14:38:03.159 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-25T14:37:57.230919+0000', 'last_change': '2023-07-25T14:37:57.230919+0000', 'last_active': '2023-07-25T14:37:57.230919+0000', 'last_peered': '2023-07-25T14:37:57.230919+0000', 'last_clean': '2023-07-25T14:37:57.230919+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-25T14:37:57.230919+0000', 'last_undegraded': '2023-07-25T14:37:57.230919+0000', 'last_fullsized': '2023-07-25T14:37:57.230919+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-25T14:37:57.230919+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-25T14:37:57.230919+0000', 'last_clean_scrub_stamp': '2023-07-25T14:37:57.230919+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-25T14:38:03.160 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.1f is not active+clean 2023-07-25T14:38:03.160 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 58, 'state': 'creating+peering', 'last_fresh': '2023-07-25T14:37:56.234775+0000', 'last_change': '2023-07-25T14:37:56.234775+0000', 'last_active': '2023-07-25T14:37:56.225499+0000', 'last_peered': '2023-07-25T14:37:56.225499+0000', 'last_clean': '2023-07-25T14:37:56.225499+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-25T14:37:56.234775+0000', 'last_undegraded': '2023-07-25T14:37:56.234775+0000', 'last_fullsized': '2023-07-25T14:37:56.234775+0000', 'mapping_epoch': 58, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 58, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-25T14:37:56.225499+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-25T14:37:56.225499+0000', 'last_clean_scrub_stamp': '2023-07-25T14:37:56.225499+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-25T14:38:03.160 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.1f is not active+clean 2023-07-25T14:38:03.161 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-25T14:37:57.230919+0000', 'last_change': '2023-07-25T14:37:57.230919+0000', 'last_active': '2023-07-25T14:37:57.230919+0000', 'last_peered': '2023-07-25T14:37:57.230919+0000', 'last_clean': '2023-07-25T14:37:57.230919+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-25T14:37:57.230919+0000', 'last_undegraded': '2023-07-25T14:37:57.230919+0000', 'last_fullsized': '2023-07-25T14:37:57.230919+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-25T14:37:57.230919+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-25T14:37:57.230919+0000', 'last_clean_scrub_stamp': '2023-07-25T14:37:57.230919+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-25T14:38:03.161 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.1e is not active+clean 2023-07-25T14:38:03.161 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 58, 'state': 'creating+peering', 'last_fresh': '2023-07-25T14:37:56.239932+0000', 'last_change': '2023-07-25T14:37:56.239932+0000', 'last_active': '2023-07-25T14:37:56.225499+0000', 'last_peered': '2023-07-25T14:37:56.225499+0000', 'last_clean': '2023-07-25T14:37:56.225499+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-25T14:37:56.239932+0000', 'last_undegraded': '2023-07-25T14:37:56.239932+0000', 'last_fullsized': '2023-07-25T14:37:56.239932+0000', 'mapping_epoch': 58, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 58, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-25T14:37:56.225499+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-25T14:37:56.225499+0000', 'last_clean_scrub_stamp': '2023-07-25T14:37:56.225499+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-25T14:38:03.162 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.10 is not active+clean 2023-07-25T14:38:03.162 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-25T14:37:57.230919+0000', 'last_change': '2023-07-25T14:37:57.230919+0000', 'last_active': '2023-07-25T14:37:57.230919+0000', 'last_peered': '2023-07-25T14:37:57.230919+0000', 'last_clean': '2023-07-25T14:37:57.230919+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-25T14:37:57.230919+0000', 'last_undegraded': '2023-07-25T14:37:57.230919+0000', 'last_fullsized': '2023-07-25T14:37:57.230919+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-25T14:37:57.230919+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-25T14:37:57.230919+0000', 'last_clean_scrub_stamp': '2023-07-25T14:37:57.230919+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-25T14:38:03.162 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.11 is not active+clean 2023-07-25T14:38:03.163 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 58, 'state': 'creating+peering', 'last_fresh': '2023-07-25T14:37:56.238867+0000', 'last_change': '2023-07-25T14:37:56.238867+0000', 'last_active': '2023-07-25T14:37:56.225499+0000', 'last_peered': '2023-07-25T14:37:56.225499+0000', 'last_clean': '2023-07-25T14:37:56.225499+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-25T14:37:56.238867+0000', 'last_undegraded': '2023-07-25T14:37:56.238867+0000', 'last_fullsized': '2023-07-25T14:37:56.238867+0000', 'mapping_epoch': 58, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 58, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-25T14:37:56.225499+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-25T14:37:56.225499+0000', 'last_clean_scrub_stamp': '2023-07-25T14:37:56.225499+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-25T14:38:03.163 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.11 is not active+clean 2023-07-25T14:38:03.163 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-25T14:37:57.230919+0000', 'last_change': '2023-07-25T14:37:57.230919+0000', 'last_active': '2023-07-25T14:37:57.230919+0000', 'last_peered': '2023-07-25T14:37:57.230919+0000', 'last_clean': '2023-07-25T14:37:57.230919+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-25T14:37:57.230919+0000', 'last_undegraded': '2023-07-25T14:37:57.230919+0000', 'last_fullsized': '2023-07-25T14:37:57.230919+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-25T14:37:57.230919+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-25T14:37:57.230919+0000', 'last_clean_scrub_stamp': '2023-07-25T14:37:57.230919+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-25T14:38:03.164 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.10 is not active+clean 2023-07-25T14:38:03.164 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 58, 'state': 'creating+peering', 'last_fresh': '2023-07-25T14:37:56.240388+0000', 'last_change': '2023-07-25T14:37:56.240388+0000', 'last_active': '2023-07-25T14:37:56.225499+0000', 'last_peered': '2023-07-25T14:37:56.225499+0000', 'last_clean': '2023-07-25T14:37:56.225499+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-25T14:37:56.240388+0000', 'last_undegraded': '2023-07-25T14:37:56.240388+0000', 'last_fullsized': '2023-07-25T14:37:56.240388+0000', 'mapping_epoch': 58, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 58, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-25T14:37:56.225499+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-25T14:37:56.225499+0000', 'last_clean_scrub_stamp': '2023-07-25T14:37:56.225499+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-25T14:38:03.164 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.12 is not active+clean 2023-07-25T14:38:03.165 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-25T14:37:57.230919+0000', 'last_change': '2023-07-25T14:37:57.230919+0000', 'last_active': '2023-07-25T14:37:57.230919+0000', 'last_peered': '2023-07-25T14:37:57.230919+0000', 'last_clean': '2023-07-25T14:37:57.230919+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-25T14:37:57.230919+0000', 'last_undegraded': '2023-07-25T14:37:57.230919+0000', 'last_fullsized': '2023-07-25T14:37:57.230919+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-25T14:37:57.230919+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-25T14:37:57.230919+0000', 'last_clean_scrub_stamp': '2023-07-25T14:37:57.230919+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-25T14:38:03.165 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.13 is not active+clean 2023-07-25T14:38:03.165 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 58, 'state': 'creating+peering', 'last_fresh': '2023-07-25T14:37:56.237456+0000', 'last_change': '2023-07-25T14:37:56.237456+0000', 'last_active': '2023-07-25T14:37:56.225499+0000', 'last_peered': '2023-07-25T14:37:56.225499+0000', 'last_clean': '2023-07-25T14:37:56.225499+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-25T14:37:56.237456+0000', 'last_undegraded': '2023-07-25T14:37:56.237456+0000', 'last_fullsized': '2023-07-25T14:37:56.237456+0000', 'mapping_epoch': 58, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 58, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-25T14:37:56.225499+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-25T14:37:56.225499+0000', 'last_clean_scrub_stamp': '2023-07-25T14:37:56.225499+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-25T14:38:03.165 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.13 is not active+clean 2023-07-25T14:38:03.166 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-25T14:37:57.230919+0000', 'last_change': '2023-07-25T14:37:57.230919+0000', 'last_active': '2023-07-25T14:37:57.230919+0000', 'last_peered': '2023-07-25T14:37:57.230919+0000', 'last_clean': '2023-07-25T14:37:57.230919+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-25T14:37:57.230919+0000', 'last_undegraded': '2023-07-25T14:37:57.230919+0000', 'last_fullsized': '2023-07-25T14:37:57.230919+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-25T14:37:57.230919+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-25T14:37:57.230919+0000', 'last_clean_scrub_stamp': '2023-07-25T14:37:57.230919+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-25T14:38:03.166 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.12 is not active+clean 2023-07-25T14:38:03.166 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 58, 'state': 'creating+peering', 'last_fresh': '2023-07-25T14:37:56.235761+0000', 'last_change': '2023-07-25T14:37:56.235761+0000', 'last_active': '2023-07-25T14:37:56.225499+0000', 'last_peered': '2023-07-25T14:37:56.225499+0000', 'last_clean': '2023-07-25T14:37:56.225499+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-25T14:37:56.235761+0000', 'last_undegraded': '2023-07-25T14:37:56.235761+0000', 'last_fullsized': '2023-07-25T14:37:56.235761+0000', 'mapping_epoch': 58, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 58, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-25T14:37:56.225499+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-25T14:37:56.225499+0000', 'last_clean_scrub_stamp': '2023-07-25T14:37:56.225499+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-25T14:38:03.167 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.14 is not active+clean 2023-07-25T14:38:03.167 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-25T14:37:57.230919+0000', 'last_change': '2023-07-25T14:37:57.230919+0000', 'last_active': '2023-07-25T14:37:57.230919+0000', 'last_peered': '2023-07-25T14:37:57.230919+0000', 'last_clean': '2023-07-25T14:37:57.230919+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-25T14:37:57.230919+0000', 'last_undegraded': '2023-07-25T14:37:57.230919+0000', 'last_fullsized': '2023-07-25T14:37:57.230919+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-25T14:37:57.230919+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-25T14:37:57.230919+0000', 'last_clean_scrub_stamp': '2023-07-25T14:37:57.230919+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-25T14:38:03.168 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.15 is not active+clean 2023-07-25T14:38:03.168 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 58, 'state': 'creating+peering', 'last_fresh': '2023-07-25T14:37:56.234389+0000', 'last_change': '2023-07-25T14:37:56.234389+0000', 'last_active': '2023-07-25T14:37:56.225499+0000', 'last_peered': '2023-07-25T14:37:56.225499+0000', 'last_clean': '2023-07-25T14:37:56.225499+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-25T14:37:56.234389+0000', 'last_undegraded': '2023-07-25T14:37:56.234389+0000', 'last_fullsized': '2023-07-25T14:37:56.234389+0000', 'mapping_epoch': 58, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 58, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-25T14:37:56.225499+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-25T14:37:56.225499+0000', 'last_clean_scrub_stamp': '2023-07-25T14:37:56.225499+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-25T14:38:03.168 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.15 is not active+clean 2023-07-25T14:38:03.169 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-25T14:37:57.230919+0000', 'last_change': '2023-07-25T14:37:57.230919+0000', 'last_active': '2023-07-25T14:37:57.230919+0000', 'last_peered': '2023-07-25T14:37:57.230919+0000', 'last_clean': '2023-07-25T14:37:57.230919+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-25T14:37:57.230919+0000', 'last_undegraded': '2023-07-25T14:37:57.230919+0000', 'last_fullsized': '2023-07-25T14:37:57.230919+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-25T14:37:57.230919+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-25T14:37:57.230919+0000', 'last_clean_scrub_stamp': '2023-07-25T14:37:57.230919+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-25T14:38:03.169 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.14 is not active+clean 2023-07-25T14:38:03.170 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 58, 'state': 'creating+peering', 'last_fresh': '2023-07-25T14:37:56.239470+0000', 'last_change': '2023-07-25T14:37:56.239470+0000', 'last_active': '2023-07-25T14:37:56.225499+0000', 'last_peered': '2023-07-25T14:37:56.225499+0000', 'last_clean': '2023-07-25T14:37:56.225499+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-25T14:37:56.239470+0000', 'last_undegraded': '2023-07-25T14:37:56.239470+0000', 'last_fullsized': '2023-07-25T14:37:56.239470+0000', 'mapping_epoch': 58, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 58, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-25T14:37:56.225499+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-25T14:37:56.225499+0000', 'last_clean_scrub_stamp': '2023-07-25T14:37:56.225499+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-25T14:38:03.170 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.16 is not active+clean 2023-07-25T14:38:03.170 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-25T14:37:57.230919+0000', 'last_change': '2023-07-25T14:37:57.230919+0000', 'last_active': '2023-07-25T14:37:57.230919+0000', 'last_peered': '2023-07-25T14:37:57.230919+0000', 'last_clean': '2023-07-25T14:37:57.230919+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-25T14:37:57.230919+0000', 'last_undegraded': '2023-07-25T14:37:57.230919+0000', 'last_fullsized': '2023-07-25T14:37:57.230919+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-25T14:37:57.230919+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-25T14:37:57.230919+0000', 'last_clean_scrub_stamp': '2023-07-25T14:37:57.230919+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-25T14:38:03.171 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.17 is not active+clean 2023-07-25T14:38:03.171 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 58, 'state': 'creating+peering', 'last_fresh': '2023-07-25T14:37:56.234329+0000', 'last_change': '2023-07-25T14:37:56.234329+0000', 'last_active': '2023-07-25T14:37:56.225499+0000', 'last_peered': '2023-07-25T14:37:56.225499+0000', 'last_clean': '2023-07-25T14:37:56.225499+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-25T14:37:56.234329+0000', 'last_undegraded': '2023-07-25T14:37:56.234329+0000', 'last_fullsized': '2023-07-25T14:37:56.234329+0000', 'mapping_epoch': 58, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 58, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-25T14:37:56.225499+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-25T14:37:56.225499+0000', 'last_clean_scrub_stamp': '2023-07-25T14:37:56.225499+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-25T14:38:03.171 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.17 is not active+clean 2023-07-25T14:38:03.172 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-25T14:37:57.230919+0000', 'last_change': '2023-07-25T14:37:57.230919+0000', 'last_active': '2023-07-25T14:37:57.230919+0000', 'last_peered': '2023-07-25T14:37:57.230919+0000', 'last_clean': '2023-07-25T14:37:57.230919+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-25T14:37:57.230919+0000', 'last_undegraded': '2023-07-25T14:37:57.230919+0000', 'last_fullsized': '2023-07-25T14:37:57.230919+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-25T14:37:57.230919+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-25T14:37:57.230919+0000', 'last_clean_scrub_stamp': '2023-07-25T14:37:57.230919+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-25T14:38:03.172 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.16 is not active+clean 2023-07-25T14:38:03.172 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 58, 'state': 'creating+peering', 'last_fresh': '2023-07-25T14:37:56.233850+0000', 'last_change': '2023-07-25T14:37:56.233850+0000', 'last_active': '2023-07-25T14:37:56.225499+0000', 'last_peered': '2023-07-25T14:37:56.225499+0000', 'last_clean': '2023-07-25T14:37:56.225499+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-25T14:37:56.233850+0000', 'last_undegraded': '2023-07-25T14:37:56.233850+0000', 'last_fullsized': '2023-07-25T14:37:56.233850+0000', 'mapping_epoch': 58, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 58, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-25T14:37:56.225499+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-25T14:37:56.225499+0000', 'last_clean_scrub_stamp': '2023-07-25T14:37:56.225499+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-25T14:38:03.173 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.0 is not active+clean 2023-07-25T14:38:03.173 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-25T14:37:57.230919+0000', 'last_change': '2023-07-25T14:37:57.230919+0000', 'last_active': '2023-07-25T14:37:57.230919+0000', 'last_peered': '2023-07-25T14:37:57.230919+0000', 'last_clean': '2023-07-25T14:37:57.230919+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-25T14:37:57.230919+0000', 'last_undegraded': '2023-07-25T14:37:57.230919+0000', 'last_fullsized': '2023-07-25T14:37:57.230919+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-25T14:37:57.230919+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-25T14:37:57.230919+0000', 'last_clean_scrub_stamp': '2023-07-25T14:37:57.230919+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-25T14:38:03.173 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.1 is not active+clean 2023-07-25T14:38:03.174 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 58, 'state': 'creating+peering', 'last_fresh': '2023-07-25T14:37:56.233730+0000', 'last_change': '2023-07-25T14:37:56.233730+0000', 'last_active': '2023-07-25T14:37:56.225499+0000', 'last_peered': '2023-07-25T14:37:56.225499+0000', 'last_clean': '2023-07-25T14:37:56.225499+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-25T14:37:56.233730+0000', 'last_undegraded': '2023-07-25T14:37:56.233730+0000', 'last_fullsized': '2023-07-25T14:37:56.233730+0000', 'mapping_epoch': 58, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 58, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-25T14:37:56.225499+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-25T14:37:56.225499+0000', 'last_clean_scrub_stamp': '2023-07-25T14:37:56.225499+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-25T14:38:03.174 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.1 is not active+clean 2023-07-25T14:38:03.174 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-25T14:37:57.230919+0000', 'last_change': '2023-07-25T14:37:57.230919+0000', 'last_active': '2023-07-25T14:37:57.230919+0000', 'last_peered': '2023-07-25T14:37:57.230919+0000', 'last_clean': '2023-07-25T14:37:57.230919+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-25T14:37:57.230919+0000', 'last_undegraded': '2023-07-25T14:37:57.230919+0000', 'last_fullsized': '2023-07-25T14:37:57.230919+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-25T14:37:57.230919+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-25T14:37:57.230919+0000', 'last_clean_scrub_stamp': '2023-07-25T14:37:57.230919+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-25T14:38:03.175 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.0 is not active+clean 2023-07-25T14:38:03.175 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 58, 'state': 'creating+peering', 'last_fresh': '2023-07-25T14:37:56.239090+0000', 'last_change': '2023-07-25T14:37:56.239090+0000', 'last_active': '2023-07-25T14:37:56.225499+0000', 'last_peered': '2023-07-25T14:37:56.225499+0000', 'last_clean': '2023-07-25T14:37:56.225499+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-25T14:37:56.239090+0000', 'last_undegraded': '2023-07-25T14:37:56.239090+0000', 'last_fullsized': '2023-07-25T14:37:56.239090+0000', 'mapping_epoch': 58, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 58, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-25T14:37:56.225499+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-25T14:37:56.225499+0000', 'last_clean_scrub_stamp': '2023-07-25T14:37:56.225499+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-25T14:38:03.175 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.2 is not active+clean 2023-07-25T14:38:03.175 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-25T14:37:57.230919+0000', 'last_change': '2023-07-25T14:37:57.230919+0000', 'last_active': '2023-07-25T14:37:57.230919+0000', 'last_peered': '2023-07-25T14:37:57.230919+0000', 'last_clean': '2023-07-25T14:37:57.230919+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-25T14:37:57.230919+0000', 'last_undegraded': '2023-07-25T14:37:57.230919+0000', 'last_fullsized': '2023-07-25T14:37:57.230919+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-25T14:37:57.230919+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-25T14:37:57.230919+0000', 'last_clean_scrub_stamp': '2023-07-25T14:37:57.230919+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-25T14:38:03.176 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.3 is not active+clean 2023-07-25T14:38:03.176 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 58, 'state': 'creating+peering', 'last_fresh': '2023-07-25T14:37:56.241742+0000', 'last_change': '2023-07-25T14:37:56.241742+0000', 'last_active': '2023-07-25T14:37:56.225499+0000', 'last_peered': '2023-07-25T14:37:56.225499+0000', 'last_clean': '2023-07-25T14:37:56.225499+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-25T14:37:56.241742+0000', 'last_undegraded': '2023-07-25T14:37:56.241742+0000', 'last_fullsized': '2023-07-25T14:37:56.241742+0000', 'mapping_epoch': 58, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 58, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-25T14:37:56.225499+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-25T14:37:56.225499+0000', 'last_clean_scrub_stamp': '2023-07-25T14:37:56.225499+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-25T14:38:03.176 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.3 is not active+clean 2023-07-25T14:38:03.177 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-25T14:37:57.230919+0000', 'last_change': '2023-07-25T14:37:57.230919+0000', 'last_active': '2023-07-25T14:37:57.230919+0000', 'last_peered': '2023-07-25T14:37:57.230919+0000', 'last_clean': '2023-07-25T14:37:57.230919+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-25T14:37:57.230919+0000', 'last_undegraded': '2023-07-25T14:37:57.230919+0000', 'last_fullsized': '2023-07-25T14:37:57.230919+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-25T14:37:57.230919+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-25T14:37:57.230919+0000', 'last_clean_scrub_stamp': '2023-07-25T14:37:57.230919+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-25T14:38:03.177 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.2 is not active+clean 2023-07-25T14:38:03.177 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 58, 'state': 'creating+peering', 'last_fresh': '2023-07-25T14:37:56.239766+0000', 'last_change': '2023-07-25T14:37:56.239766+0000', 'last_active': '2023-07-25T14:37:56.225499+0000', 'last_peered': '2023-07-25T14:37:56.225499+0000', 'last_clean': '2023-07-25T14:37:56.225499+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-25T14:37:56.239766+0000', 'last_undegraded': '2023-07-25T14:37:56.239766+0000', 'last_fullsized': '2023-07-25T14:37:56.239766+0000', 'mapping_epoch': 58, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 58, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-25T14:37:56.225499+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-25T14:37:56.225499+0000', 'last_clean_scrub_stamp': '2023-07-25T14:37:56.225499+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-25T14:38:03.178 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.4 is not active+clean 2023-07-25T14:38:03.178 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-25T14:37:57.230919+0000', 'last_change': '2023-07-25T14:37:57.230919+0000', 'last_active': '2023-07-25T14:37:57.230919+0000', 'last_peered': '2023-07-25T14:37:57.230919+0000', 'last_clean': '2023-07-25T14:37:57.230919+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-25T14:37:57.230919+0000', 'last_undegraded': '2023-07-25T14:37:57.230919+0000', 'last_fullsized': '2023-07-25T14:37:57.230919+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-25T14:37:57.230919+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-25T14:37:57.230919+0000', 'last_clean_scrub_stamp': '2023-07-25T14:37:57.230919+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-25T14:38:03.178 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.5 is not active+clean 2023-07-25T14:38:03.179 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 58, 'state': 'creating+peering', 'last_fresh': '2023-07-25T14:37:56.233790+0000', 'last_change': '2023-07-25T14:37:56.233790+0000', 'last_active': '2023-07-25T14:37:56.225499+0000', 'last_peered': '2023-07-25T14:37:56.225499+0000', 'last_clean': '2023-07-25T14:37:56.225499+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-25T14:37:56.233790+0000', 'last_undegraded': '2023-07-25T14:37:56.233790+0000', 'last_fullsized': '2023-07-25T14:37:56.233790+0000', 'mapping_epoch': 58, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 58, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-25T14:37:56.225499+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-25T14:37:56.225499+0000', 'last_clean_scrub_stamp': '2023-07-25T14:37:56.225499+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-25T14:38:03.179 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.5 is not active+clean 2023-07-25T14:38:03.179 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-25T14:37:57.230919+0000', 'last_change': '2023-07-25T14:37:57.230919+0000', 'last_active': '2023-07-25T14:37:57.230919+0000', 'last_peered': '2023-07-25T14:37:57.230919+0000', 'last_clean': '2023-07-25T14:37:57.230919+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-25T14:37:57.230919+0000', 'last_undegraded': '2023-07-25T14:37:57.230919+0000', 'last_fullsized': '2023-07-25T14:37:57.230919+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-25T14:37:57.230919+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-25T14:37:57.230919+0000', 'last_clean_scrub_stamp': '2023-07-25T14:37:57.230919+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-25T14:38:03.180 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.4 is not active+clean 2023-07-25T14:38:03.180 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 58, 'state': 'creating+peering', 'last_fresh': '2023-07-25T14:37:56.233794+0000', 'last_change': '2023-07-25T14:37:56.233794+0000', 'last_active': '2023-07-25T14:37:56.225499+0000', 'last_peered': '2023-07-25T14:37:56.225499+0000', 'last_clean': '2023-07-25T14:37:56.225499+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-25T14:37:56.233794+0000', 'last_undegraded': '2023-07-25T14:37:56.233794+0000', 'last_fullsized': '2023-07-25T14:37:56.233794+0000', 'mapping_epoch': 58, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 58, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-25T14:37:56.225499+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-25T14:37:56.225499+0000', 'last_clean_scrub_stamp': '2023-07-25T14:37:56.225499+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-25T14:38:03.180 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.6 is not active+clean 2023-07-25T14:38:03.181 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-25T14:37:57.230919+0000', 'last_change': '2023-07-25T14:37:57.230919+0000', 'last_active': '2023-07-25T14:37:57.230919+0000', 'last_peered': '2023-07-25T14:37:57.230919+0000', 'last_clean': '2023-07-25T14:37:57.230919+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-25T14:37:57.230919+0000', 'last_undegraded': '2023-07-25T14:37:57.230919+0000', 'last_fullsized': '2023-07-25T14:37:57.230919+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-25T14:37:57.230919+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-25T14:37:57.230919+0000', 'last_clean_scrub_stamp': '2023-07-25T14:37:57.230919+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-25T14:38:03.181 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.7 is not active+clean 2023-07-25T14:38:03.181 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 58, 'state': 'creating+peering', 'last_fresh': '2023-07-25T14:37:56.237604+0000', 'last_change': '2023-07-25T14:37:56.237604+0000', 'last_active': '2023-07-25T14:37:56.225499+0000', 'last_peered': '2023-07-25T14:37:56.225499+0000', 'last_clean': '2023-07-25T14:37:56.225499+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-25T14:37:56.237604+0000', 'last_undegraded': '2023-07-25T14:37:56.237604+0000', 'last_fullsized': '2023-07-25T14:37:56.237604+0000', 'mapping_epoch': 58, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 58, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-25T14:37:56.225499+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-25T14:37:56.225499+0000', 'last_clean_scrub_stamp': '2023-07-25T14:37:56.225499+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-25T14:38:03.182 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.7 is not active+clean 2023-07-25T14:38:03.182 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-25T14:37:57.230919+0000', 'last_change': '2023-07-25T14:37:57.230919+0000', 'last_active': '2023-07-25T14:37:57.230919+0000', 'last_peered': '2023-07-25T14:37:57.230919+0000', 'last_clean': '2023-07-25T14:37:57.230919+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-25T14:37:57.230919+0000', 'last_undegraded': '2023-07-25T14:37:57.230919+0000', 'last_fullsized': '2023-07-25T14:37:57.230919+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-25T14:37:57.230919+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-25T14:37:57.230919+0000', 'last_clean_scrub_stamp': '2023-07-25T14:37:57.230919+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-25T14:38:03.182 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.6 is not active+clean 2023-07-25T14:38:03.183 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 58, 'state': 'creating+peering', 'last_fresh': '2023-07-25T14:37:56.237505+0000', 'last_change': '2023-07-25T14:37:56.237505+0000', 'last_active': '2023-07-25T14:37:56.225499+0000', 'last_peered': '2023-07-25T14:37:56.225499+0000', 'last_clean': '2023-07-25T14:37:56.225499+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-25T14:37:56.237505+0000', 'last_undegraded': '2023-07-25T14:37:56.237505+0000', 'last_fullsized': '2023-07-25T14:37:56.237505+0000', 'mapping_epoch': 58, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 58, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-25T14:37:56.225499+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-25T14:37:56.225499+0000', 'last_clean_scrub_stamp': '2023-07-25T14:37:56.225499+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-25T14:38:03.183 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.b is not active+clean 2023-07-25T14:38:03.184 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-25T14:37:57.230919+0000', 'last_change': '2023-07-25T14:37:57.230919+0000', 'last_active': '2023-07-25T14:37:57.230919+0000', 'last_peered': '2023-07-25T14:37:57.230919+0000', 'last_clean': '2023-07-25T14:37:57.230919+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-25T14:37:57.230919+0000', 'last_undegraded': '2023-07-25T14:37:57.230919+0000', 'last_fullsized': '2023-07-25T14:37:57.230919+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-25T14:37:57.230919+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-25T14:37:57.230919+0000', 'last_clean_scrub_stamp': '2023-07-25T14:37:57.230919+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-25T14:38:03.184 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.a is not active+clean 2023-07-25T14:38:03.184 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 58, 'state': 'creating+peering', 'last_fresh': '2023-07-25T14:37:56.235599+0000', 'last_change': '2023-07-25T14:37:56.235599+0000', 'last_active': '2023-07-25T14:37:56.225499+0000', 'last_peered': '2023-07-25T14:37:56.225499+0000', 'last_clean': '2023-07-25T14:37:56.225499+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-25T14:37:56.235599+0000', 'last_undegraded': '2023-07-25T14:37:56.235599+0000', 'last_fullsized': '2023-07-25T14:37:56.235599+0000', 'mapping_epoch': 58, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 58, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-25T14:37:56.225499+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-25T14:37:56.225499+0000', 'last_clean_scrub_stamp': '2023-07-25T14:37:56.225499+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-25T14:38:03.185 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.a is not active+clean 2023-07-25T14:38:03.185 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-25T14:37:57.230919+0000', 'last_change': '2023-07-25T14:37:57.230919+0000', 'last_active': '2023-07-25T14:37:57.230919+0000', 'last_peered': '2023-07-25T14:37:57.230919+0000', 'last_clean': '2023-07-25T14:37:57.230919+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-25T14:37:57.230919+0000', 'last_undegraded': '2023-07-25T14:37:57.230919+0000', 'last_fullsized': '2023-07-25T14:37:57.230919+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-25T14:37:57.230919+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-25T14:37:57.230919+0000', 'last_clean_scrub_stamp': '2023-07-25T14:37:57.230919+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-25T14:38:03.185 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.b is not active+clean 2023-07-25T14:38:03.186 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 58, 'state': 'creating+peering', 'last_fresh': '2023-07-25T14:37:56.235410+0000', 'last_change': '2023-07-25T14:37:56.235410+0000', 'last_active': '2023-07-25T14:37:56.225499+0000', 'last_peered': '2023-07-25T14:37:56.225499+0000', 'last_clean': '2023-07-25T14:37:56.225499+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-25T14:37:56.235410+0000', 'last_undegraded': '2023-07-25T14:37:56.235410+0000', 'last_fullsized': '2023-07-25T14:37:56.235410+0000', 'mapping_epoch': 58, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 58, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-25T14:37:56.225499+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-25T14:37:56.225499+0000', 'last_clean_scrub_stamp': '2023-07-25T14:37:56.225499+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-25T14:38:03.186 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.d is not active+clean 2023-07-25T14:38:03.186 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-25T14:37:57.230919+0000', 'last_change': '2023-07-25T14:37:57.230919+0000', 'last_active': '2023-07-25T14:37:57.230919+0000', 'last_peered': '2023-07-25T14:37:57.230919+0000', 'last_clean': '2023-07-25T14:37:57.230919+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-25T14:37:57.230919+0000', 'last_undegraded': '2023-07-25T14:37:57.230919+0000', 'last_fullsized': '2023-07-25T14:37:57.230919+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-25T14:37:57.230919+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-25T14:37:57.230919+0000', 'last_clean_scrub_stamp': '2023-07-25T14:37:57.230919+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-25T14:38:03.187 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.c is not active+clean 2023-07-25T14:38:03.187 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 58, 'state': 'creating+peering', 'last_fresh': '2023-07-25T14:37:56.240548+0000', 'last_change': '2023-07-25T14:37:56.240548+0000', 'last_active': '2023-07-25T14:37:56.225499+0000', 'last_peered': '2023-07-25T14:37:56.225499+0000', 'last_clean': '2023-07-25T14:37:56.225499+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-25T14:37:56.240548+0000', 'last_undegraded': '2023-07-25T14:37:56.240548+0000', 'last_fullsized': '2023-07-25T14:37:56.240548+0000', 'mapping_epoch': 58, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 58, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-25T14:37:56.225499+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-25T14:37:56.225499+0000', 'last_clean_scrub_stamp': '2023-07-25T14:37:56.225499+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-25T14:38:03.188 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.c is not active+clean 2023-07-25T14:38:03.188 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-25T14:37:57.230919+0000', 'last_change': '2023-07-25T14:37:57.230919+0000', 'last_active': '2023-07-25T14:37:57.230919+0000', 'last_peered': '2023-07-25T14:37:57.230919+0000', 'last_clean': '2023-07-25T14:37:57.230919+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-25T14:37:57.230919+0000', 'last_undegraded': '2023-07-25T14:37:57.230919+0000', 'last_fullsized': '2023-07-25T14:37:57.230919+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-25T14:37:57.230919+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-25T14:37:57.230919+0000', 'last_clean_scrub_stamp': '2023-07-25T14:37:57.230919+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-25T14:38:03.189 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.d is not active+clean 2023-07-25T14:38:03.189 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 58, 'state': 'creating+peering', 'last_fresh': '2023-07-25T14:37:56.239538+0000', 'last_change': '2023-07-25T14:37:56.239538+0000', 'last_active': '2023-07-25T14:37:56.225499+0000', 'last_peered': '2023-07-25T14:37:56.225499+0000', 'last_clean': '2023-07-25T14:37:56.225499+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-25T14:37:56.239538+0000', 'last_undegraded': '2023-07-25T14:37:56.239538+0000', 'last_fullsized': '2023-07-25T14:37:56.239538+0000', 'mapping_epoch': 58, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 58, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-25T14:37:56.225499+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-25T14:37:56.225499+0000', 'last_clean_scrub_stamp': '2023-07-25T14:37:56.225499+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-25T14:38:03.189 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.e is not active+clean 2023-07-25T14:38:03.189 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-25T14:37:57.230919+0000', 'last_change': '2023-07-25T14:37:57.230919+0000', 'last_active': '2023-07-25T14:37:57.230919+0000', 'last_peered': '2023-07-25T14:37:57.230919+0000', 'last_clean': '2023-07-25T14:37:57.230919+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-25T14:37:57.230919+0000', 'last_undegraded': '2023-07-25T14:37:57.230919+0000', 'last_fullsized': '2023-07-25T14:37:57.230919+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-25T14:37:57.230919+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-25T14:37:57.230919+0000', 'last_clean_scrub_stamp': '2023-07-25T14:37:57.230919+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-25T14:38:03.190 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.f is not active+clean 2023-07-25T14:38:03.190 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 58, 'state': 'creating+peering', 'last_fresh': '2023-07-25T14:37:56.233775+0000', 'last_change': '2023-07-25T14:37:56.233775+0000', 'last_active': '2023-07-25T14:37:56.225499+0000', 'last_peered': '2023-07-25T14:37:56.225499+0000', 'last_clean': '2023-07-25T14:37:56.225499+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-25T14:37:56.233775+0000', 'last_undegraded': '2023-07-25T14:37:56.233775+0000', 'last_fullsized': '2023-07-25T14:37:56.233775+0000', 'mapping_epoch': 58, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 58, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-25T14:37:56.225499+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-25T14:37:56.225499+0000', 'last_clean_scrub_stamp': '2023-07-25T14:37:56.225499+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-25T14:38:03.191 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.f is not active+clean 2023-07-25T14:38:03.191 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-25T14:37:57.230919+0000', 'last_change': '2023-07-25T14:37:57.230919+0000', 'last_active': '2023-07-25T14:37:57.230919+0000', 'last_peered': '2023-07-25T14:37:57.230919+0000', 'last_clean': '2023-07-25T14:37:57.230919+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-25T14:37:57.230919+0000', 'last_undegraded': '2023-07-25T14:37:57.230919+0000', 'last_fullsized': '2023-07-25T14:37:57.230919+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-25T14:37:57.230919+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-25T14:37:57.230919+0000', 'last_clean_scrub_stamp': '2023-07-25T14:37:57.230919+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-25T14:38:03.191 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.e is not active+clean 2023-07-25T14:38:03.191 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 58, 'state': 'creating+peering', 'last_fresh': '2023-07-25T14:37:56.241309+0000', 'last_change': '2023-07-25T14:37:56.241309+0000', 'last_active': '2023-07-25T14:37:56.225499+0000', 'last_peered': '2023-07-25T14:37:56.225499+0000', 'last_clean': '2023-07-25T14:37:56.225499+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-25T14:37:56.241309+0000', 'last_undegraded': '2023-07-25T14:37:56.241309+0000', 'last_fullsized': '2023-07-25T14:37:56.241309+0000', 'mapping_epoch': 58, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 58, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-25T14:37:56.225499+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-25T14:37:56.225499+0000', 'last_clean_scrub_stamp': '2023-07-25T14:37:56.225499+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-25T14:38:03.192 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.8 is not active+clean 2023-07-25T14:38:03.192 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-25T14:37:57.230919+0000', 'last_change': '2023-07-25T14:37:57.230919+0000', 'last_active': '2023-07-25T14:37:57.230919+0000', 'last_peered': '2023-07-25T14:37:57.230919+0000', 'last_clean': '2023-07-25T14:37:57.230919+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-25T14:37:57.230919+0000', 'last_undegraded': '2023-07-25T14:37:57.230919+0000', 'last_fullsized': '2023-07-25T14:37:57.230919+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-25T14:37:57.230919+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-25T14:37:57.230919+0000', 'last_clean_scrub_stamp': '2023-07-25T14:37:57.230919+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-25T14:38:03.193 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.9 is not active+clean 2023-07-25T14:38:03.193 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 58, 'state': 'creating+peering', 'last_fresh': '2023-07-25T14:37:56.235573+0000', 'last_change': '2023-07-25T14:37:56.235573+0000', 'last_active': '2023-07-25T14:37:56.225499+0000', 'last_peered': '2023-07-25T14:37:56.225499+0000', 'last_clean': '2023-07-25T14:37:56.225499+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-25T14:37:56.235573+0000', 'last_undegraded': '2023-07-25T14:37:56.235573+0000', 'last_fullsized': '2023-07-25T14:37:56.235573+0000', 'mapping_epoch': 58, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 58, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-25T14:37:56.225499+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-25T14:37:56.225499+0000', 'last_clean_scrub_stamp': '2023-07-25T14:37:56.225499+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-25T14:38:03.193 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.9 is not active+clean 2023-07-25T14:38:03.194 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-07-25T14:37:57.230919+0000', 'last_change': '2023-07-25T14:37:57.230919+0000', 'last_active': '2023-07-25T14:37:57.230919+0000', 'last_peered': '2023-07-25T14:37:57.230919+0000', 'last_clean': '2023-07-25T14:37:57.230919+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-25T14:37:57.230919+0000', 'last_undegraded': '2023-07-25T14:37:57.230919+0000', 'last_fullsized': '2023-07-25T14:37:57.230919+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-25T14:37:57.230919+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-25T14:37:57.230919+0000', 'last_clean_scrub_stamp': '2023-07-25T14:37:57.230919+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-07-25T14:38:03.194 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.8 is not active+clean 2023-07-25T14:38:03.195 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 58, 'state': 'creating+peering', 'last_fresh': '2023-07-25T14:37:56.235675+0000', 'last_change': '2023-07-25T14:37:56.235675+0000', 'last_active': '2023-07-25T14:37:56.225499+0000', 'last_peered': '2023-07-25T14:37:56.225499+0000', 'last_clean': '2023-07-25T14:37:56.225499+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-25T14:37:56.235675+0000', 'last_undegraded': '2023-07-25T14:37:56.235675+0000', 'last_fullsized': '2023-07-25T14:37:56.235675+0000', 'mapping_epoch': 58, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 58, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-25T14:37:56.225499+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-25T14:37:56.225499+0000', 'last_clean_scrub_stamp': '2023-07-25T14:37:56.225499+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-25T14:38:03.197 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-07-25T14:38:03.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:03.307+0000 7fb70e4da700 1 Processor -- start 2023-07-25T14:38:03.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:03.307+0000 7fb70e4da700 1 -- start start 2023-07-25T14:38:03.319 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:03.308+0000 7fb70e4da700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb70806b510 0x7fb708151c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:38:03.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:03.308+0000 7fb70e4da700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fb7080a7490 0x7fb7080a7940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:38:03.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:03.308+0000 7fb70e4da700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb708152190 con 0x7fb70806ea10 2023-07-25T14:38:03.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:03.308+0000 7fb70e4da700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7080ac350 con 0x7fb70806b510 2023-07-25T14:38:03.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:03.308+0000 7fb70e4da700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7080c1670 con 0x7fb7080a7490 2023-07-25T14:38:03.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:03.308+0000 7fb707fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb70806b510 0x7fb708151c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:38:03.320 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:03.308+0000 7fb707fff700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fb70806b510 0x7fb708151c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:44210/0 (socket says 172.21.15.72:44210) 2023-07-25T14:38:03.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:03.308+0000 7fb707fff700 1 -- 172.21.15.72:0/2388962158 learned_addr learned my addr 172.21.15.72:0/2388962158 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:38:03.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:03.308+0000 7fb70ca77700 1 --2- 172.21.15.72:0/2388962158 >> v2:172.21.15.92:3300/0 conn(0x7fb7080a7490 0x7fb7080a7940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:38:03.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:03.309+0000 7fb707fff700 1 -- 172.21.15.72:0/2388962158 >> v2:172.21.15.92:3300/0 conn(0x7fb7080a7490 msgr2=0x7fb7080a7940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:38:03.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:03.309+0000 7fb707fff700 1 --2- 172.21.15.72:0/2388962158 >> v2:172.21.15.92:3300/0 conn(0x7fb7080a7490 0x7fb7080a7940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:38:03.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:03.309+0000 7fb707fff700 1 -- 172.21.15.72:0/2388962158 >> v1:172.21.15.92:6789/0 conn(0x7fb70806ea10 legacy=0x7fb70814e5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:38:03.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:03.309+0000 7fb707fff700 1 -- 172.21.15.72:0/2388962158 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb708066480 con 0x7fb70806b510 2023-07-25T14:38:03.321 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:03.309+0000 7fb707fff700 1 --2- 172.21.15.72:0/2388962158 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb70806b510 0x7fb708151c50 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7fb7080c72a0 tx=0x7fb6fc00be70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7f3b365414143a9 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:38:03.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:03.309+0000 7fb706ffd700 1 -- 172.21.15.72:0/2388962158 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6fc00dc70 con 0x7fb70806b510 2023-07-25T14:38:03.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:03.309+0000 7fb706ffd700 1 -- 172.21.15.72:0/2388962158 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6fc00ddd0 con 0x7fb70806b510 2023-07-25T14:38:03.322 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:03.309+0000 7fb706ffd700 1 -- 172.21.15.72:0/2388962158 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6fc010690 con 0x7fb70806b510 2023-07-25T14:38:03.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:03.309+0000 7fb70e4da700 1 -- 172.21.15.72:0/2388962158 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb70806b510 msgr2=0x7fb708151c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:38:03.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:03.309+0000 7fb70e4da700 1 --2- 172.21.15.72:0/2388962158 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb70806b510 0x7fb708151c50 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7fb7080c72a0 tx=0x7fb6fc00be70 comp rx=0 tx=0).stop 2023-07-25T14:38:03.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:03.310+0000 7fb70e4da700 1 -- 172.21.15.72:0/2388962158 shutdown_connections 2023-07-25T14:38:03.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:03.310+0000 7fb70e4da700 1 --2- 172.21.15.72:0/2388962158 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb70806b510 0x7fb708151c50 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:38:03.324 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:03.310+0000 7fb70e4da700 1 --2- 172.21.15.72:0/2388962158 >> v2:172.21.15.92:3300/0 conn(0x7fb7080a7490 0x7fb7080a7940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:38:03.325 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:03.310+0000 7fb70e4da700 1 -- 172.21.15.72:0/2388962158 >> 172.21.15.72:0/2388962158 conn(0x7fb70806def0 msgr2=0x7fb70806e300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:38:03.325 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:03.310+0000 7fb70e4da700 1 -- 172.21.15.72:0/2388962158 shutdown_connections 2023-07-25T14:38:03.325 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:03.310+0000 7fb70e4da700 1 -- 172.21.15.72:0/2388962158 wait complete. 2023-07-25T14:38:03.325 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:03.311+0000 7fb70e4da700 1 Processor -- start 2023-07-25T14:38:03.325 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:03.311+0000 7fb70e4da700 1 -- start start 2023-07-25T14:38:03.325 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:03.311+0000 7fb70e4da700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb70806b510 0x7fb70814ba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:38:03.325 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:03.311+0000 7fb70e4da700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb70806ea10 0x7fb708149510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:38:03.325 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:03.312+0000 7fb70e4da700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb7080a7490 0x7fb7081e4f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:38:03.326 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:03.312+0000 7fb70e4da700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7081e5c70 con 0x7fb70806b510 2023-07-25T14:38:03.326 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:03.312+0000 7fb70e4da700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb70814b610 con 0x7fb70806ea10 2023-07-25T14:38:03.326 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:03.312+0000 7fb70e4da700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb708151680 con 0x7fb7080a7490 2023-07-25T14:38:03.326 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:03.312+0000 7fb707fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb70806b510 0x7fb70814ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:38:03.326 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:03.312+0000 7fb707fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb70806b510 0x7fb70814ba60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:44216/0 (socket says 172.21.15.72:44216) 2023-07-25T14:38:03.326 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:03.312+0000 7fb707fff700 1 -- 172.21.15.72:0/3952477820 learned_addr learned my addr 172.21.15.72:0/3952477820 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:38:03.327 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:03.312+0000 7fb707fff700 1 -- 172.21.15.72:0/3952477820 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb7080a7490 msgr2=0x7fb7081e4f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:38:03.327 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:03.312+0000 7fb707fff700 1 --2- 172.21.15.72:0/3952477820 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb7080a7490 0x7fb7081e4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:38:03.327 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:03.312+0000 7fb707fff700 1 -- 172.21.15.72:0/3952477820 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb70806ea10 msgr2=0x7fb708149510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:38:03.327 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:03.312+0000 7fb707fff700 1 --2- 172.21.15.72:0/3952477820 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb70806ea10 0x7fb708149510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:38:03.327 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:03.312+0000 7fb707fff700 1 -- 172.21.15.72:0/3952477820 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6fc00b7f0 con 0x7fb70806b510 2023-07-25T14:38:03.327 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:03.312+0000 7fb707fff700 1 --2- 172.21.15.72:0/3952477820 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb70806b510 0x7fb70814ba60 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7fb6fc00beb0 tx=0x7fb6fc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:38:03.327 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:03.312+0000 7fb704ff9700 1 -- 172.21.15.72:0/3952477820 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6fc01f070 con 0x7fb70806b510 2023-07-25T14:38:03.328 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:03.312+0000 7fb704ff9700 1 -- 172.21.15.72:0/3952477820 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6fc003970 con 0x7fb70806b510 2023-07-25T14:38:03.328 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:03.312+0000 7fb70e4da700 1 -- 172.21.15.72:0/3952477820 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb708155090 con 0x7fb70806b510 2023-07-25T14:38:03.328 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:03.312+0000 7fb704ff9700 1 -- 172.21.15.72:0/3952477820 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6fc003d00 con 0x7fb70806b510 2023-07-25T14:38:03.328 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:03.312+0000 7fb70e4da700 1 -- 172.21.15.72:0/3952477820 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7081e5990 con 0x7fb70806b510 2023-07-25T14:38:03.328 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:03.313+0000 7fb70e4da700 1 -- 172.21.15.72:0/3952477820 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb70814b780 con 0x7fb70806b510 2023-07-25T14:38:03.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:03.314+0000 7fb704ff9700 1 -- 172.21.15.72:0/3952477820 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb6fc019400 con 0x7fb70806b510 2023-07-25T14:38:03.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:03.314+0000 7fb704ff9700 1 --2- 172.21.15.72:0/3952477820 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fb6f406ace0 0x7fb6f406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:38:03.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:03.314+0000 7fb7077fe700 1 --2- 172.21.15.72:0/3952477820 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fb6f406ace0 0x7fb6f406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:38:03.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:03.314+0000 7fb704ff9700 1 -- 172.21.15.72:0/3952477820 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 7238+0+0 (secure 0 0 0) 0x7fb6fc08cc30 con 0x7fb70806b510 2023-07-25T14:38:03.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:03.315+0000 7fb7077fe700 1 --2- 172.21.15.72:0/3952477820 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fb6f406ace0 0x7fb6f406d1a0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fb6f8000f60 tx=0x7fb6f8007a40 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:38:03.330 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:03.318+0000 7fb704ff9700 1 -- 172.21.15.72:0/3952477820 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fb6fc0578b0 con 0x7fb70806b510 2023-07-25T14:38:03.593 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:03.582+0000 7fb70e4da700 1 -- 172.21.15.72:0/3952477820 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fb70814b780 con 0x7fb70806b510 2023-07-25T14:38:03.594 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:03.583+0000 7fb704ff9700 1 -- 172.21.15.72:0/3952477820 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1695 (secure 0 0 0) 0x7fb70814b780 con 0x7fb70806b510 2023-07-25T14:38:03.594 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-25T14:38:03.595 INFO:teuthology.orchestra.run.smithi072.stdout:{"fsid":"9170db48-9170-43e8-8ccb-9813e6240906","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":161,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":61,"num_osds":8,"num_up_osds":8,"osd_up_since":1690295731,"num_in_osds":8,"osd_in_since":1690295724,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":105},{"state_name":"unknown","count":64},{"state_name":"creating+peering","count":32}],"num_pgs":201,"num_pools":6,"num_objects":24,"data_bytes":594237,"bytes_used":227033088,"bytes_avail":772867080192,"bytes_total":773094113280,"unknown_pgs_ratio":0.31840795278549194,"inactive_pgs_ratio":0.15920397639274597,"write_bytes_sec":604,"read_op_per_sec":0,"write_op_per_sec":0},"fsmap":{"epoch":38,"id":4,"up":1,"in":1,"max":1,"id":5,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":5,"rank":0,"name":"c","status":"up:active","gid":6150},{"filesystem_id":4,"rank":0,"name":"d","status":"up:active","gid":6165}],"up:standby":2},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":6,"modified":"2023-07-25T14:37:25.307720+0000","services":{"mds":{"daemons":{"summary":"","b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-07-25T14:38:03.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:03.585+0000 7fb70e4da700 1 -- 172.21.15.72:0/3952477820 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fb6f406ace0 msgr2=0x7fb6f406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:38:03.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:03.585+0000 7fb70e4da700 1 --2- 172.21.15.72:0/3952477820 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fb6f406ace0 0x7fb6f406d1a0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fb6f8000f60 tx=0x7fb6f8007a40 comp rx=0 tx=0).stop 2023-07-25T14:38:03.596 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:03.585+0000 7fb70e4da700 1 -- 172.21.15.72:0/3952477820 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb70806b510 msgr2=0x7fb70814ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:38:03.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:03.585+0000 7fb70e4da700 1 --2- 172.21.15.72:0/3952477820 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb70806b510 0x7fb70814ba60 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7fb6fc00beb0 tx=0x7fb6fc004750 comp rx=0 tx=0).stop 2023-07-25T14:38:03.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:03.585+0000 7fb70e4da700 1 -- 172.21.15.72:0/3952477820 shutdown_connections 2023-07-25T14:38:03.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:03.585+0000 7fb70e4da700 1 --2- 172.21.15.72:0/3952477820 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fb6f406ace0 0x7fb6f406d1a0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:38:03.597 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:03.585+0000 7fb70e4da700 1 --2- 172.21.15.72:0/3952477820 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fb7080a7490 0x7fb7081e4f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:38:03.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:03.585+0000 7fb70e4da700 1 --2- 172.21.15.72:0/3952477820 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fb70806b510 0x7fb70814ba60 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:38:03.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:03.585+0000 7fb70e4da700 1 --2- 172.21.15.72:0/3952477820 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb70806ea10 0x7fb708149510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:38:03.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:03.585+0000 7fb70e4da700 1 -- 172.21.15.72:0/3952477820 >> 172.21.15.72:0/3952477820 conn(0x7fb70806def0 msgr2=0x7fb7080c4040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:38:03.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:03.585+0000 7fb70e4da700 1 -- 172.21.15.72:0/3952477820 shutdown_connections 2023-07-25T14:38:03.598 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:03.585+0000 7fb70e4da700 1 -- 172.21.15.72:0/3952477820 wait complete. 2023-07-25T14:38:03.607 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-07-25T14:38:03.608 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-25T14:38:03.728 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:03.717+0000 7f4783006700 1 Processor -- start 2023-07-25T14:38:03.729 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:03.718+0000 7f4783006700 1 -- start start 2023-07-25T14:38:03.736 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:03.718+0000 7f4783006700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f477c0bead0 0x7f477c0c0350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:38:03.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:03.718+0000 7f4783006700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f477c0c0890 0x7f477c0c44d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:38:03.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:03.718+0000 7f4783006700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f477c0bfeb0 con 0x7f477c151a90 2023-07-25T14:38:03.737 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:03.718+0000 7f4783006700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f477c0c10b0 con 0x7f477c0bead0 2023-07-25T14:38:03.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:03.718+0000 7f4783006700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f477c0c1940 con 0x7f477c0c0890 2023-07-25T14:38:03.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:03.719+0000 7f47815a3700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f477c0c0890 0x7f477c0c44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:38:03.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:03.719+0000 7f4780da2700 1 --1- >> v1:172.21.15.92:6789/0 conn(0x7f477c151a90 0x7f477c154d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.92:6789/0 says I am v1:172.21.15.72:58532/0 (socket says 172.21.15.72:58532) 2023-07-25T14:38:03.738 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:03.719+0000 7f47815a3700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f477c0c0890 0x7f477c0c44d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3301/0 says I am v2:172.21.15.72:49454/0 (socket says 172.21.15.72:49454) 2023-07-25T14:38:03.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:03.719+0000 7f4780da2700 1 -- 172.21.15.72:0/2703051509 learned_addr learned my addr 172.21.15.72:0/2703051509 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:38:03.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:03.719+0000 7f477bfff700 1 --2- 172.21.15.72:0/2703051509 >> v2:172.21.15.92:3300/0 conn(0x7f477c0bead0 0x7f477c0c0350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:38:03.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:03.719+0000 7f47815a3700 1 -- 172.21.15.72:0/2703051509 >> v2:172.21.15.92:3300/0 conn(0x7f477c0bead0 msgr2=0x7f477c0c0350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:38:03.739 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:03.719+0000 7f47815a3700 1 --2- 172.21.15.72:0/2703051509 >> v2:172.21.15.92:3300/0 conn(0x7f477c0bead0 0x7f477c0c0350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:38:03.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:03.719+0000 7f47815a3700 1 -- 172.21.15.72:0/2703051509 >> v1:172.21.15.92:6789/0 conn(0x7f477c151a90 legacy=0x7f477c154d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:38:03.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:03.719+0000 7f47815a3700 1 -- 172.21.15.72:0/2703051509 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f477c0bf2e0 con 0x7f477c0c0890 2023-07-25T14:38:03.740 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:03.719+0000 7f477b7fe700 1 -- 172.21.15.72:0/2703051509 <== mon.1 v1:172.21.15.92:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1363902795 0 0) 0x7f477c0bfeb0 con 0x7f477c151a90 2023-07-25T14:38:03.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:03.719+0000 7f477bfff700 1 --2- 172.21.15.72:0/2703051509 >> v2:172.21.15.92:3300/0 conn(0x7f477c0bead0 0x7f477c0c0350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-25T14:38:03.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:03.719+0000 7f47815a3700 1 --2- 172.21.15.72:0/2703051509 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f477c0c0890 0x7f477c0c44d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f4774009d90 tx=0x7f477400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1c5e7bbf8ca3229b server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:38:03.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:03.719+0000 7f477b7fe700 1 -- 172.21.15.72:0/2703051509 <== mon.2 v2:172.21.15.92:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f477400e070 con 0x7f477c0c0890 2023-07-25T14:38:03.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:03.719+0000 7f477b7fe700 1 -- 172.21.15.72:0/2703051509 <== mon.2 v2:172.21.15.92:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f477400bb20 con 0x7f477c0c0890 2023-07-25T14:38:03.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:03.719+0000 7f477b7fe700 1 -- 172.21.15.72:0/2703051509 <== mon.2 v2:172.21.15.92:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4774012430 con 0x7f477c0c0890 2023-07-25T14:38:03.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:03.720+0000 7f4783006700 1 -- 172.21.15.72:0/2703051509 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f477c0c0890 msgr2=0x7f477c0c44d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:38:03.741 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:03.720+0000 7f4783006700 1 --2- 172.21.15.72:0/2703051509 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f477c0c0890 0x7f477c0c44d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f4774009d90 tx=0x7f477400b330 comp rx=0 tx=0).stop 2023-07-25T14:38:03.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:03.720+0000 7f4783006700 1 -- 172.21.15.72:0/2703051509 shutdown_connections 2023-07-25T14:38:03.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:03.720+0000 7f4783006700 1 --2- 172.21.15.72:0/2703051509 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f477c0c0890 0x7f477c0c44d0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:38:03.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:03.720+0000 7f4783006700 1 --2- 172.21.15.72:0/2703051509 >> v2:172.21.15.92:3300/0 conn(0x7f477c0bead0 0x7f477c0c0350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:38:03.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:03.720+0000 7f4783006700 1 -- 172.21.15.72:0/2703051509 >> 172.21.15.72:0/2703051509 conn(0x7f477c06c3a0 msgr2=0x7f477c06c780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:38:03.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:03.720+0000 7f4783006700 1 -- 172.21.15.72:0/2703051509 shutdown_connections 2023-07-25T14:38:03.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:03.720+0000 7f4783006700 1 -- 172.21.15.72:0/2703051509 wait complete. 2023-07-25T14:38:03.742 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:03.721+0000 7f4783006700 1 Processor -- start 2023-07-25T14:38:03.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:03.721+0000 7f4783006700 1 -- start start 2023-07-25T14:38:03.743 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:03.722+0000 7f4783006700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f477c0bead0 0x7f477c150860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:38:03.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:03.722+0000 7f4783006700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f477c0c0890 0x7f477c1eab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:38:03.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:03.722+0000 7f4783006700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f477c151a90 0x7f477c1ed640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:38:03.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:03.722+0000 7f4783006700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f477c0ca1a0 con 0x7f477c151a90 2023-07-25T14:38:03.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:03.722+0000 7f4783006700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f477c144570 con 0x7f477c0bead0 2023-07-25T14:38:03.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:03.722+0000 7f4783006700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f477c1eb050 con 0x7f477c0c0890 2023-07-25T14:38:03.744 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:03.722+0000 7f47815a3700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f477c151a90 0x7f477c1ed640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:38:03.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:03.722+0000 7f47815a3700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f477c151a90 0x7f477c1ed640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:44232/0 (socket says 172.21.15.72:44232) 2023-07-25T14:38:03.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:03.722+0000 7f47815a3700 1 -- 172.21.15.72:0/2364164312 learned_addr learned my addr 172.21.15.72:0/2364164312 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:38:03.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:03.722+0000 7f477bfff700 1 --2- 172.21.15.72:0/2364164312 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f477c0c0890 0x7f477c1eab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:38:03.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:03.722+0000 7f4780da2700 1 --2- 172.21.15.72:0/2364164312 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f477c0bead0 0x7f477c150860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:38:03.745 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:03.722+0000 7f47815a3700 1 -- 172.21.15.72:0/2364164312 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f477c0c0890 msgr2=0x7f477c1eab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:38:03.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:03.722+0000 7f47815a3700 1 --2- 172.21.15.72:0/2364164312 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f477c0c0890 0x7f477c1eab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:38:03.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:03.722+0000 7f47815a3700 1 -- 172.21.15.72:0/2364164312 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f477c0bead0 msgr2=0x7f477c150860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:38:03.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:03.722+0000 7f47815a3700 1 --2- 172.21.15.72:0/2364164312 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f477c0bead0 0x7f477c150860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:38:03.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:03.722+0000 7f47815a3700 1 -- 172.21.15.72:0/2364164312 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47680094a0 con 0x7f477c151a90 2023-07-25T14:38:03.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:03.723+0000 7f47815a3700 1 --2- 172.21.15.72:0/2364164312 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f477c151a90 0x7f477c1ed640 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f477c06b490 tx=0x7f4774004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:38:03.746 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:03.723+0000 7f47797fa700 1 -- 172.21.15.72:0/2364164312 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4774012430 con 0x7f477c151a90 2023-07-25T14:38:03.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:03.723+0000 7f47797fa700 1 -- 172.21.15.72:0/2364164312 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4774020070 con 0x7f477c151a90 2023-07-25T14:38:03.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:03.723+0000 7f47797fa700 1 -- 172.21.15.72:0/2364164312 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4774004480 con 0x7f477c151a90 2023-07-25T14:38:03.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:03.723+0000 7f4783006700 1 -- 172.21.15.72:0/2364164312 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4774009a70 con 0x7f477c151a90 2023-07-25T14:38:03.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:03.723+0000 7f4783006700 1 -- 172.21.15.72:0/2364164312 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f477c151240 con 0x7f477c151a90 2023-07-25T14:38:03.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:03.724+0000 7f4783006700 1 -- 172.21.15.72:0/2364164312 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f477c04e470 con 0x7f477c151a90 2023-07-25T14:38:03.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:03.724+0000 7f47797fa700 1 -- 172.21.15.72:0/2364164312 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f47740045e0 con 0x7f477c151a90 2023-07-25T14:38:03.747 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:03.724+0000 7f47797fa700 1 --2- 172.21.15.72:0/2364164312 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f476006ace0 0x7f476006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:38:03.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:03.725+0000 7f47797fa700 1 -- 172.21.15.72:0/2364164312 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 7238+0+0 (secure 0 0 0) 0x7f4774022070 con 0x7f477c151a90 2023-07-25T14:38:03.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:03.725+0000 7f4780da2700 1 --2- 172.21.15.72:0/2364164312 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f476006ace0 0x7f476006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:38:03.748 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:03.725+0000 7f4780da2700 1 --2- 172.21.15.72:0/2364164312 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f476006ace0 0x7f476006d1a0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f4770000f60 tx=0x7f4770007be0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:38:03.749 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:03.729+0000 7f47797fa700 1 -- 172.21.15.72:0/2364164312 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f47740562d0 con 0x7f477c151a90 2023-07-25T14:38:03.922 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:03.911+0000 7f4783006700 1 -- 172.21.15.72:0/2364164312 --> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f477c0bf860 con 0x7f476006ace0 2023-07-25T14:38:03.936 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:03.925+0000 7f47797fa700 1 -- 172.21.15.72:0/2364164312 <== mgr.4104 v2:172.21.15.72:6832/1171220306 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+550319 (secure 0 0 0) 0x7f47700012b0 con 0x7f476006ace0 2023-07-25T14:38:03.945 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-25T14:38:03.950 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:03.929+0000 7f4783006700 1 -- 172.21.15.72:0/2364164312 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f476006ace0 msgr2=0x7f476006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:38:03.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:03.929+0000 7f4783006700 1 --2- 172.21.15.72:0/2364164312 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f476006ace0 0x7f476006d1a0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f4770000f60 tx=0x7f4770007be0 comp rx=0 tx=0).stop 2023-07-25T14:38:03.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:03.929+0000 7f4783006700 1 -- 172.21.15.72:0/2364164312 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f477c151a90 msgr2=0x7f477c1ed640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:38:03.951 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:03.929+0000 7f4783006700 1 --2- 172.21.15.72:0/2364164312 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f477c151a90 0x7f477c1ed640 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f477c06b490 tx=0x7f4774004ad0 comp rx=0 tx=0).stop 2023-07-25T14:38:03.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:03.930+0000 7f4783006700 1 -- 172.21.15.72:0/2364164312 shutdown_connections 2023-07-25T14:38:03.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:03.930+0000 7f4783006700 1 --2- 172.21.15.72:0/2364164312 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f476006ace0 0x7f476006d1a0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:38:03.952 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:03.930+0000 7f4783006700 1 --2- 172.21.15.72:0/2364164312 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f477c151a90 0x7f477c1ed640 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:38:03.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:03.930+0000 7f4783006700 1 --2- 172.21.15.72:0/2364164312 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f477c0bead0 0x7f477c150860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:38:03.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:03.930+0000 7f4783006700 1 --2- 172.21.15.72:0/2364164312 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f477c0c0890 0x7f477c1eab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:38:03.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:03.930+0000 7f4783006700 1 -- 172.21.15.72:0/2364164312 >> 172.21.15.72:0/2364164312 conn(0x7f477c06c3a0 msgr2=0x7f477c154ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:38:03.953 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:03.930+0000 7f4783006700 1 -- 172.21.15.72:0/2364164312 shutdown_connections 2023-07-25T14:38:03.954 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:03.930+0000 7f4783006700 1 -- 172.21.15.72:0/2364164312 wait complete. 2023-07-25T14:38:03.954 INFO:teuthology.orchestra.run.smithi072.stderr:dumped all 2023-07-25T14:38:03.956 INFO:teuthology.orchestra.run.smithi072.stdout:{"pg_ready":true,"pg_map":{"version":130,"stamp":"2023-07-25T14:38:03.314565+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596599,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":250,"num_write_kb":2447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":402,"acting":402,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":357,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":222204,"kb_used_data":6004,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754752516,"statfs":{"total":773094113280,"available":772866576384,"internally_reserved":0,"allocated":6148096,"data_stored":4054887,"data_compressed":64510,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":38,"apply_latency_ms":38,"commit_latency_ns":38000000,"apply_latency_ns":38000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.076601"},"pg_stats":[{"pgid":"13.39","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.254839+0000","last_change":"2023-07-25T14:37:58.267397+0000","last_active":"2023-07-25T14:37:59.254839+0000","last_peered":"2023-07-25T14:37:59.254839+0000","last_clean":"2023-07-25T14:37:59.254839+0000","last_became_active":"2023-07-25T14:37:58.267134+0000","last_became_peered":"2023-07-25T14:37:58.267134+0000","last_unstale":"2023-07-25T14:37:59.254839+0000","last_undegraded":"2023-07-25T14:37:59.254839+0000","last_fullsized":"2023-07-25T14:37:59.254839+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T22:52:49.177607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3f","version":"0'0","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.355249+0000","last_change":"2023-07-25T14:37:45.195851+0000","last_active":"2023-07-25T14:37:59.355249+0000","last_peered":"2023-07-25T14:37:59.355249+0000","last_clean":"2023-07-25T14:37:59.355249+0000","last_became_active":"2023-07-25T14:37:45.195549+0000","last_became_peered":"2023-07-25T14:37:45.195549+0000","last_unstale":"2023-07-25T14:37:59.355249+0000","last_undegraded":"2023-07-25T14:37:59.355249+0000","last_fullsized":"2023-07-25T14:37:59.355249+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T18:09:47.450177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.254794+0000","last_change":"2023-07-25T14:37:58.265618+0000","last_active":"2023-07-25T14:37:59.254794+0000","last_peered":"2023-07-25T14:37:59.254794+0000","last_clean":"2023-07-25T14:37:59.254794+0000","last_became_active":"2023-07-25T14:37:58.265298+0000","last_became_peered":"2023-07-25T14:37:58.265298+0000","last_unstale":"2023-07-25T14:37:59.254794+0000","last_undegraded":"2023-07-25T14:37:59.254794+0000","last_fullsized":"2023-07-25T14:37:59.254794+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T23:04:07.473888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.354992+0000","last_change":"2023-07-25T14:37:45.209998+0000","last_active":"2023-07-25T14:37:59.354992+0000","last_peered":"2023-07-25T14:37:59.354992+0000","last_clean":"2023-07-25T14:37:59.354992+0000","last_became_active":"2023-07-25T14:37:45.209538+0000","last_became_peered":"2023-07-25T14:37:45.209538+0000","last_unstale":"2023-07-25T14:37:59.354992+0000","last_undegraded":"2023-07-25T14:37:59.354992+0000","last_fullsized":"2023-07-25T14:37:59.354992+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T19:07:32.745444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.254696+0000","last_change":"2023-07-25T14:37:58.272833+0000","last_active":"2023-07-25T14:37:59.254696+0000","last_peered":"2023-07-25T14:37:59.254696+0000","last_clean":"2023-07-25T14:37:59.254696+0000","last_became_active":"2023-07-25T14:37:58.272524+0000","last_became_peered":"2023-07-25T14:37:58.272524+0000","last_unstale":"2023-07-25T14:37:59.254696+0000","last_undegraded":"2023-07-25T14:37:59.254696+0000","last_fullsized":"2023-07-25T14:37:59.254696+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T20:11:57.396339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.352738+0000","last_change":"2023-07-25T14:37:45.186668+0000","last_active":"2023-07-25T14:37:59.352738+0000","last_peered":"2023-07-25T14:37:59.352738+0000","last_clean":"2023-07-25T14:37:59.352738+0000","last_became_active":"2023-07-25T14:37:45.186396+0000","last_became_peered":"2023-07-25T14:37:45.186396+0000","last_unstale":"2023-07-25T14:37:59.352738+0000","last_undegraded":"2023-07-25T14:37:59.352738+0000","last_fullsized":"2023-07-25T14:37:59.352738+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T20:15:25.491350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.255352+0000","last_change":"2023-07-25T14:37:58.252740+0000","last_active":"2023-07-25T14:37:59.255352+0000","last_peered":"2023-07-25T14:37:59.255352+0000","last_clean":"2023-07-25T14:37:59.255352+0000","last_became_active":"2023-07-25T14:37:58.252422+0000","last_became_peered":"2023-07-25T14:37:58.252422+0000","last_unstale":"2023-07-25T14:37:59.255352+0000","last_undegraded":"2023-07-25T14:37:59.255352+0000","last_fullsized":"2023-07-25T14:37:59.255352+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T18:48:11.765057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.355194+0000","last_change":"2023-07-25T14:37:45.197894+0000","last_active":"2023-07-25T14:37:59.355194+0000","last_peered":"2023-07-25T14:37:59.355194+0000","last_clean":"2023-07-25T14:37:59.355194+0000","last_became_active":"2023-07-25T14:37:45.197369+0000","last_became_peered":"2023-07-25T14:37:45.197369+0000","last_unstale":"2023-07-25T14:37:59.355194+0000","last_undegraded":"2023-07-25T14:37:59.355194+0000","last_fullsized":"2023-07-25T14:37:59.355194+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T02:03:12.978515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.354578+0000","last_change":"2023-07-25T14:37:58.264663+0000","last_active":"2023-07-25T14:37:59.354578+0000","last_peered":"2023-07-25T14:37:59.354578+0000","last_clean":"2023-07-25T14:37:59.354578+0000","last_became_active":"2023-07-25T14:37:58.264407+0000","last_became_peered":"2023-07-25T14:37:58.264407+0000","last_unstale":"2023-07-25T14:37:59.354578+0000","last_undegraded":"2023-07-25T14:37:59.354578+0000","last_fullsized":"2023-07-25T14:37:59.354578+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T21:50:12.129185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.255151+0000","last_change":"2023-07-25T14:37:45.204817+0000","last_active":"2023-07-25T14:37:59.255151+0000","last_peered":"2023-07-25T14:37:59.255151+0000","last_clean":"2023-07-25T14:37:59.255151+0000","last_became_active":"2023-07-25T14:37:45.204540+0000","last_became_peered":"2023-07-25T14:37:45.204540+0000","last_unstale":"2023-07-25T14:37:59.255151+0000","last_undegraded":"2023-07-25T14:37:59.255151+0000","last_fullsized":"2023-07-25T14:37:59.255151+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T18:31:18.914728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.255061+0000","last_change":"2023-07-25T14:37:58.273141+0000","last_active":"2023-07-25T14:37:59.255061+0000","last_peered":"2023-07-25T14:37:59.255061+0000","last_clean":"2023-07-25T14:37:59.255061+0000","last_became_active":"2023-07-25T14:37:58.272881+0000","last_became_peered":"2023-07-25T14:37:58.272881+0000","last_unstale":"2023-07-25T14:37:59.255061+0000","last_undegraded":"2023-07-25T14:37:59.255061+0000","last_fullsized":"2023-07-25T14:37:59.255061+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T20:49:27.945811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.353873+0000","last_change":"2023-07-25T14:37:45.212379+0000","last_active":"2023-07-25T14:37:59.353873+0000","last_peered":"2023-07-25T14:37:59.353873+0000","last_clean":"2023-07-25T14:37:59.353873+0000","last_became_active":"2023-07-25T14:37:45.210115+0000","last_became_peered":"2023-07-25T14:37:45.210115+0000","last_unstale":"2023-07-25T14:37:59.353873+0000","last_undegraded":"2023-07-25T14:37:59.353873+0000","last_fullsized":"2023-07-25T14:37:59.353873+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T17:04:57.323478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3f","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.354667+0000","last_change":"2023-07-25T14:37:58.264269+0000","last_active":"2023-07-25T14:37:59.354667+0000","last_peered":"2023-07-25T14:37:59.354667+0000","last_clean":"2023-07-25T14:37:59.354667+0000","last_became_active":"2023-07-25T14:37:58.263597+0000","last_became_peered":"2023-07-25T14:37:58.263597+0000","last_unstale":"2023-07-25T14:37:59.354667+0000","last_undegraded":"2023-07-25T14:37:59.354667+0000","last_fullsized":"2023-07-25T14:37:59.354667+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T19:33:59.441524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.255599+0000","last_change":"2023-07-25T14:37:45.197514+0000","last_active":"2023-07-25T14:37:59.255599+0000","last_peered":"2023-07-25T14:37:59.255599+0000","last_clean":"2023-07-25T14:37:59.255599+0000","last_became_active":"2023-07-25T14:37:45.197076+0000","last_became_peered":"2023-07-25T14:37:45.197076+0000","last_unstale":"2023-07-25T14:37:59.255599+0000","last_undegraded":"2023-07-25T14:37:59.255599+0000","last_fullsized":"2023-07-25T14:37:59.255599+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T16:59:27.610742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.355508+0000","last_change":"2023-07-25T14:37:58.273492+0000","last_active":"2023-07-25T14:37:59.355508+0000","last_peered":"2023-07-25T14:37:59.355508+0000","last_clean":"2023-07-25T14:37:59.355508+0000","last_became_active":"2023-07-25T14:37:58.272529+0000","last_became_peered":"2023-07-25T14:37:58.272529+0000","last_unstale":"2023-07-25T14:37:59.355508+0000","last_undegraded":"2023-07-25T14:37:59.355508+0000","last_fullsized":"2023-07-25T14:37:59.355508+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T21:27:29.333418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.353344+0000","last_change":"2023-07-25T14:37:45.199774+0000","last_active":"2023-07-25T14:37:59.353344+0000","last_peered":"2023-07-25T14:37:59.353344+0000","last_clean":"2023-07-25T14:37:59.353344+0000","last_became_active":"2023-07-25T14:37:45.199408+0000","last_became_peered":"2023-07-25T14:37:45.199408+0000","last_unstale":"2023-07-25T14:37:59.353344+0000","last_undegraded":"2023-07-25T14:37:59.353344+0000","last_fullsized":"2023-07-25T14:37:59.353344+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T20:41:03.818352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.352936+0000","last_change":"2023-07-25T14:37:58.261043+0000","last_active":"2023-07-25T14:37:59.352936+0000","last_peered":"2023-07-25T14:37:59.352936+0000","last_clean":"2023-07-25T14:37:59.352936+0000","last_became_active":"2023-07-25T14:37:58.260777+0000","last_became_peered":"2023-07-25T14:37:58.260777+0000","last_unstale":"2023-07-25T14:37:59.352936+0000","last_undegraded":"2023-07-25T14:37:59.352936+0000","last_fullsized":"2023-07-25T14:37:59.352936+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:22:35.512164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.255837+0000","last_change":"2023-07-25T14:37:45.196344+0000","last_active":"2023-07-25T14:37:59.255837+0000","last_peered":"2023-07-25T14:37:59.255837+0000","last_clean":"2023-07-25T14:37:59.255837+0000","last_became_active":"2023-07-25T14:37:45.196000+0000","last_became_peered":"2023-07-25T14:37:45.196000+0000","last_unstale":"2023-07-25T14:37:59.255837+0000","last_undegraded":"2023-07-25T14:37:59.255837+0000","last_fullsized":"2023-07-25T14:37:59.255837+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T21:28:34.013756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.253261+0000","last_change":"2023-07-25T14:37:58.256573+0000","last_active":"2023-07-25T14:37:59.253261+0000","last_peered":"2023-07-25T14:37:59.253261+0000","last_clean":"2023-07-25T14:37:59.253261+0000","last_became_active":"2023-07-25T14:37:58.256294+0000","last_became_peered":"2023-07-25T14:37:58.256294+0000","last_unstale":"2023-07-25T14:37:59.253261+0000","last_undegraded":"2023-07-25T14:37:59.253261+0000","last_fullsized":"2023-07-25T14:37:59.253261+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T20:45:43.373603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.254755+0000","last_change":"2023-07-25T14:37:45.199696+0000","last_active":"2023-07-25T14:37:59.254755+0000","last_peered":"2023-07-25T14:37:59.254755+0000","last_clean":"2023-07-25T14:37:59.254755+0000","last_became_active":"2023-07-25T14:37:45.199345+0000","last_became_peered":"2023-07-25T14:37:45.199345+0000","last_unstale":"2023-07-25T14:37:59.254755+0000","last_undegraded":"2023-07-25T14:37:59.254755+0000","last_fullsized":"2023-07-25T14:37:59.254755+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T17:11:08.224142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.353379+0000","last_change":"2023-07-25T14:37:58.263524+0000","last_active":"2023-07-25T14:37:59.353379+0000","last_peered":"2023-07-25T14:37:59.353379+0000","last_clean":"2023-07-25T14:37:59.353379+0000","last_became_active":"2023-07-25T14:37:58.263192+0000","last_became_peered":"2023-07-25T14:37:58.263192+0000","last_unstale":"2023-07-25T14:37:59.353379+0000","last_undegraded":"2023-07-25T14:37:59.353379+0000","last_fullsized":"2023-07-25T14:37:59.353379+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T02:08:04.137385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.354742+0000","last_change":"2023-07-25T14:37:45.206383+0000","last_active":"2023-07-25T14:37:59.354742+0000","last_peered":"2023-07-25T14:37:59.354742+0000","last_clean":"2023-07-25T14:37:59.354742+0000","last_became_active":"2023-07-25T14:37:45.204409+0000","last_became_peered":"2023-07-25T14:37:45.204409+0000","last_unstale":"2023-07-25T14:37:59.354742+0000","last_undegraded":"2023-07-25T14:37:59.354742+0000","last_fullsized":"2023-07-25T14:37:59.354742+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T17:39:59.896444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.255165+0000","last_change":"2023-07-25T14:37:58.276707+0000","last_active":"2023-07-25T14:37:59.255165+0000","last_peered":"2023-07-25T14:37:59.255165+0000","last_clean":"2023-07-25T14:37:59.255165+0000","last_became_active":"2023-07-25T14:37:58.276102+0000","last_became_peered":"2023-07-25T14:37:58.276102+0000","last_unstale":"2023-07-25T14:37:59.255165+0000","last_undegraded":"2023-07-25T14:37:59.255165+0000","last_fullsized":"2023-07-25T14:37:59.255165+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T19:51:18.791389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.355259+0000","last_change":"2023-07-25T14:37:45.198072+0000","last_active":"2023-07-25T14:37:59.355259+0000","last_peered":"2023-07-25T14:37:59.355259+0000","last_clean":"2023-07-25T14:37:59.355259+0000","last_became_active":"2023-07-25T14:37:45.197648+0000","last_became_peered":"2023-07-25T14:37:45.197648+0000","last_unstale":"2023-07-25T14:37:59.355259+0000","last_undegraded":"2023-07-25T14:37:59.355259+0000","last_fullsized":"2023-07-25T14:37:59.355259+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T23:13:58.660182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.355347+0000","last_change":"2023-07-25T14:37:58.270365+0000","last_active":"2023-07-25T14:37:59.355347+0000","last_peered":"2023-07-25T14:37:59.355347+0000","last_clean":"2023-07-25T14:37:59.355347+0000","last_became_active":"2023-07-25T14:37:58.269974+0000","last_became_peered":"2023-07-25T14:37:58.269974+0000","last_unstale":"2023-07-25T14:37:59.355347+0000","last_undegraded":"2023-07-25T14:37:59.355347+0000","last_fullsized":"2023-07-25T14:37:59.355347+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T16:44:52.627355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.353009+0000","last_change":"2023-07-25T14:37:45.188472+0000","last_active":"2023-07-25T14:37:59.353009+0000","last_peered":"2023-07-25T14:37:59.353009+0000","last_clean":"2023-07-25T14:37:59.353009+0000","last_became_active":"2023-07-25T14:37:45.188105+0000","last_became_peered":"2023-07-25T14:37:45.188105+0000","last_unstale":"2023-07-25T14:37:59.353009+0000","last_undegraded":"2023-07-25T14:37:59.353009+0000","last_fullsized":"2023-07-25T14:37:59.353009+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T14:42:08.091298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.355271+0000","last_change":"2023-07-25T14:37:58.268905+0000","last_active":"2023-07-25T14:37:59.355271+0000","last_peered":"2023-07-25T14:37:59.355271+0000","last_clean":"2023-07-25T14:37:59.355271+0000","last_became_active":"2023-07-25T14:37:58.268602+0000","last_became_peered":"2023-07-25T14:37:58.268602+0000","last_unstale":"2023-07-25T14:37:59.355271+0000","last_undegraded":"2023-07-25T14:37:59.355271+0000","last_fullsized":"2023-07-25T14:37:59.355271+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T17:17:18.291496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.255485+0000","last_change":"2023-07-25T14:37:45.191002+0000","last_active":"2023-07-25T14:37:59.255485+0000","last_peered":"2023-07-25T14:37:59.255485+0000","last_clean":"2023-07-25T14:37:59.255485+0000","last_became_active":"2023-07-25T14:37:45.190713+0000","last_became_peered":"2023-07-25T14:37:45.190713+0000","last_unstale":"2023-07-25T14:37:59.255485+0000","last_undegraded":"2023-07-25T14:37:59.255485+0000","last_fullsized":"2023-07-25T14:37:59.255485+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:11:13.440125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.255548+0000","last_change":"2023-07-25T14:37:58.261591+0000","last_active":"2023-07-25T14:37:59.255548+0000","last_peered":"2023-07-25T14:37:59.255548+0000","last_clean":"2023-07-25T14:37:59.255548+0000","last_became_active":"2023-07-25T14:37:58.260099+0000","last_became_peered":"2023-07-25T14:37:58.260099+0000","last_unstale":"2023-07-25T14:37:59.255548+0000","last_undegraded":"2023-07-25T14:37:59.255548+0000","last_fullsized":"2023-07-25T14:37:59.255548+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T17:20:07.455837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.353046+0000","last_change":"2023-07-25T14:37:45.192719+0000","last_active":"2023-07-25T14:37:59.353046+0000","last_peered":"2023-07-25T14:37:59.353046+0000","last_clean":"2023-07-25T14:37:59.353046+0000","last_became_active":"2023-07-25T14:37:45.192419+0000","last_became_peered":"2023-07-25T14:37:45.192419+0000","last_unstale":"2023-07-25T14:37:59.353046+0000","last_undegraded":"2023-07-25T14:37:59.353046+0000","last_fullsized":"2023-07-25T14:37:59.353046+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:37:15.728996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.353963+0000","last_change":"2023-07-25T14:37:58.266211+0000","last_active":"2023-07-25T14:37:59.353963+0000","last_peered":"2023-07-25T14:37:59.353963+0000","last_clean":"2023-07-25T14:37:59.353963+0000","last_became_active":"2023-07-25T14:37:58.265951+0000","last_became_peered":"2023-07-25T14:37:58.265951+0000","last_unstale":"2023-07-25T14:37:59.353963+0000","last_undegraded":"2023-07-25T14:37:59.353963+0000","last_fullsized":"2023-07-25T14:37:59.353963+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:21:18.689386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.253081+0000","last_change":"2023-07-25T14:37:45.210664+0000","last_active":"2023-07-25T14:37:59.253081+0000","last_peered":"2023-07-25T14:37:59.253081+0000","last_clean":"2023-07-25T14:37:59.253081+0000","last_became_active":"2023-07-25T14:37:45.210376+0000","last_became_peered":"2023-07-25T14:37:45.210376+0000","last_unstale":"2023-07-25T14:37:59.253081+0000","last_undegraded":"2023-07-25T14:37:59.253081+0000","last_fullsized":"2023-07-25T14:37:59.253081+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T23:48:52.142431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.353805+0000","last_change":"2023-07-25T14:37:58.269617+0000","last_active":"2023-07-25T14:37:59.353805+0000","last_peered":"2023-07-25T14:37:59.353805+0000","last_clean":"2023-07-25T14:37:59.353805+0000","last_became_active":"2023-07-25T14:37:58.269335+0000","last_became_peered":"2023-07-25T14:37:58.269335+0000","last_unstale":"2023-07-25T14:37:59.353805+0000","last_undegraded":"2023-07-25T14:37:59.353805+0000","last_fullsized":"2023-07-25T14:37:59.353805+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T18:48:11.765057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.255924+0000","last_change":"2023-07-25T14:37:45.191718+0000","last_active":"2023-07-25T14:37:59.255924+0000","last_peered":"2023-07-25T14:37:59.255924+0000","last_clean":"2023-07-25T14:37:59.255924+0000","last_became_active":"2023-07-25T14:37:45.191401+0000","last_became_peered":"2023-07-25T14:37:45.191401+0000","last_unstale":"2023-07-25T14:37:59.255924+0000","last_undegraded":"2023-07-25T14:37:59.255924+0000","last_fullsized":"2023-07-25T14:37:59.255924+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T16:54:19.121146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.254845+0000","last_change":"2023-07-25T14:37:58.264343+0000","last_active":"2023-07-25T14:37:59.254845+0000","last_peered":"2023-07-25T14:37:59.254845+0000","last_clean":"2023-07-25T14:37:59.254845+0000","last_became_active":"2023-07-25T14:37:58.264080+0000","last_became_peered":"2023-07-25T14:37:58.264080+0000","last_unstale":"2023-07-25T14:37:59.254845+0000","last_undegraded":"2023-07-25T14:37:59.254845+0000","last_fullsized":"2023-07-25T14:37:59.254845+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T23:18:58.192091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.355647+0000","last_change":"2023-07-25T14:37:45.197329+0000","last_active":"2023-07-25T14:37:59.355647+0000","last_peered":"2023-07-25T14:37:59.355647+0000","last_clean":"2023-07-25T14:37:59.355647+0000","last_became_active":"2023-07-25T14:37:45.197048+0000","last_became_peered":"2023-07-25T14:37:45.197048+0000","last_unstale":"2023-07-25T14:37:59.355647+0000","last_undegraded":"2023-07-25T14:37:59.355647+0000","last_fullsized":"2023-07-25T14:37:59.355647+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T18:05:49.493471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.255073+0000","last_change":"2023-07-25T14:37:58.259867+0000","last_active":"2023-07-25T14:37:59.255073+0000","last_peered":"2023-07-25T14:37:59.255073+0000","last_clean":"2023-07-25T14:37:59.255073+0000","last_became_active":"2023-07-25T14:37:58.259564+0000","last_became_peered":"2023-07-25T14:37:58.259564+0000","last_unstale":"2023-07-25T14:37:59.255073+0000","last_undegraded":"2023-07-25T14:37:59.255073+0000","last_fullsized":"2023-07-25T14:37:59.255073+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T15:49:26.736019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.354423+0000","last_change":"2023-07-25T14:37:45.205950+0000","last_active":"2023-07-25T14:37:59.354423+0000","last_peered":"2023-07-25T14:37:59.354423+0000","last_clean":"2023-07-25T14:37:59.354423+0000","last_became_active":"2023-07-25T14:37:45.199388+0000","last_became_peered":"2023-07-25T14:37:45.199388+0000","last_unstale":"2023-07-25T14:37:59.354423+0000","last_undegraded":"2023-07-25T14:37:59.354423+0000","last_fullsized":"2023-07-25T14:37:59.354423+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T23:02:47.104299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.354947+0000","last_change":"2023-07-25T14:37:58.279141+0000","last_active":"2023-07-25T14:37:59.354947+0000","last_peered":"2023-07-25T14:37:59.354947+0000","last_clean":"2023-07-25T14:37:59.354947+0000","last_became_active":"2023-07-25T14:37:58.278646+0000","last_became_peered":"2023-07-25T14:37:58.278646+0000","last_unstale":"2023-07-25T14:37:59.354947+0000","last_undegraded":"2023-07-25T14:37:59.354947+0000","last_fullsized":"2023-07-25T14:37:59.354947+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T18:19:28.497638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.353811+0000","last_change":"2023-07-25T14:37:45.188465+0000","last_active":"2023-07-25T14:37:59.353811+0000","last_peered":"2023-07-25T14:37:59.353811+0000","last_clean":"2023-07-25T14:37:59.353811+0000","last_became_active":"2023-07-25T14:37:45.188186+0000","last_became_peered":"2023-07-25T14:37:45.188186+0000","last_unstale":"2023-07-25T14:37:59.353811+0000","last_undegraded":"2023-07-25T14:37:59.353811+0000","last_fullsized":"2023-07-25T14:37:59.353811+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T23:16:23.351954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.353783+0000","last_change":"2023-07-25T14:37:58.269523+0000","last_active":"2023-07-25T14:37:59.353783+0000","last_peered":"2023-07-25T14:37:59.353783+0000","last_clean":"2023-07-25T14:37:59.353783+0000","last_became_active":"2023-07-25T14:37:58.269114+0000","last_became_peered":"2023-07-25T14:37:58.269114+0000","last_unstale":"2023-07-25T14:37:59.353783+0000","last_undegraded":"2023-07-25T14:37:59.353783+0000","last_fullsized":"2023-07-25T14:37:59.353783+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T20:05:23.800908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.255225+0000","last_change":"2023-07-25T14:37:45.201384+0000","last_active":"2023-07-25T14:37:59.255225+0000","last_peered":"2023-07-25T14:37:59.255225+0000","last_clean":"2023-07-25T14:37:59.255225+0000","last_became_active":"2023-07-25T14:37:45.200847+0000","last_became_peered":"2023-07-25T14:37:45.200847+0000","last_unstale":"2023-07-25T14:37:59.255225+0000","last_undegraded":"2023-07-25T14:37:59.255225+0000","last_fullsized":"2023-07-25T14:37:59.255225+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T17:44:10.141375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.255308+0000","last_change":"2023-07-25T14:37:58.259812+0000","last_active":"2023-07-25T14:37:59.255308+0000","last_peered":"2023-07-25T14:37:59.255308+0000","last_clean":"2023-07-25T14:37:59.255308+0000","last_became_active":"2023-07-25T14:37:58.259499+0000","last_became_peered":"2023-07-25T14:37:58.259499+0000","last_unstale":"2023-07-25T14:37:59.255308+0000","last_undegraded":"2023-07-25T14:37:59.255308+0000","last_fullsized":"2023-07-25T14:37:59.255308+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:10:11.047040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.253932+0000","last_change":"2023-07-25T14:37:45.201941+0000","last_active":"2023-07-25T14:37:59.253932+0000","last_peered":"2023-07-25T14:37:59.253932+0000","last_clean":"2023-07-25T14:37:59.253932+0000","last_became_active":"2023-07-25T14:37:45.201640+0000","last_became_peered":"2023-07-25T14:37:45.201640+0000","last_unstale":"2023-07-25T14:37:59.253932+0000","last_undegraded":"2023-07-25T14:37:59.253932+0000","last_fullsized":"2023-07-25T14:37:59.253932+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T17:39:59.896444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.254155+0000","last_change":"2023-07-25T14:37:58.253701+0000","last_active":"2023-07-25T14:37:59.254155+0000","last_peered":"2023-07-25T14:37:59.254155+0000","last_clean":"2023-07-25T14:37:59.254155+0000","last_became_active":"2023-07-25T14:37:58.253402+0000","last_became_peered":"2023-07-25T14:37:58.253402+0000","last_unstale":"2023-07-25T14:37:59.254155+0000","last_undegraded":"2023-07-25T14:37:59.254155+0000","last_fullsized":"2023-07-25T14:37:59.254155+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T18:10:00.535963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.353537+0000","last_change":"2023-07-25T14:37:45.204317+0000","last_active":"2023-07-25T14:37:59.353537+0000","last_peered":"2023-07-25T14:37:59.353537+0000","last_clean":"2023-07-25T14:37:59.353537+0000","last_became_active":"2023-07-25T14:37:45.203583+0000","last_became_peered":"2023-07-25T14:37:45.203583+0000","last_unstale":"2023-07-25T14:37:59.353537+0000","last_undegraded":"2023-07-25T14:37:59.353537+0000","last_fullsized":"2023-07-25T14:37:59.353537+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T01:40:53.247781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.255550+0000","last_change":"2023-07-25T14:37:58.256414+0000","last_active":"2023-07-25T14:37:59.255550+0000","last_peered":"2023-07-25T14:37:59.255550+0000","last_clean":"2023-07-25T14:37:59.255550+0000","last_became_active":"2023-07-25T14:37:58.256111+0000","last_became_peered":"2023-07-25T14:37:58.256111+0000","last_unstale":"2023-07-25T14:37:59.255550+0000","last_undegraded":"2023-07-25T14:37:59.255550+0000","last_fullsized":"2023-07-25T14:37:59.255550+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T15:58:49.900074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.353875+0000","last_change":"2023-07-25T14:37:45.207314+0000","last_active":"2023-07-25T14:37:59.353875+0000","last_peered":"2023-07-25T14:37:59.353875+0000","last_clean":"2023-07-25T14:37:59.353875+0000","last_became_active":"2023-07-25T14:37:45.207030+0000","last_became_peered":"2023-07-25T14:37:45.207030+0000","last_unstale":"2023-07-25T14:37:59.353875+0000","last_undegraded":"2023-07-25T14:37:59.353875+0000","last_fullsized":"2023-07-25T14:37:59.353875+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T16:25:07.919077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.253271+0000","last_change":"2023-07-25T14:37:58.261074+0000","last_active":"2023-07-25T14:37:59.253271+0000","last_peered":"2023-07-25T14:37:59.253271+0000","last_clean":"2023-07-25T14:37:59.253271+0000","last_became_active":"2023-07-25T14:37:58.260853+0000","last_became_peered":"2023-07-25T14:37:58.260853+0000","last_unstale":"2023-07-25T14:37:59.253271+0000","last_undegraded":"2023-07-25T14:37:59.253271+0000","last_fullsized":"2023-07-25T14:37:59.253271+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T16:25:21.004862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.254106+0000","last_change":"2023-07-25T14:37:45.210109+0000","last_active":"2023-07-25T14:37:59.254106+0000","last_peered":"2023-07-25T14:37:59.254106+0000","last_clean":"2023-07-25T14:37:59.254106+0000","last_became_active":"2023-07-25T14:37:45.205229+0000","last_became_peered":"2023-07-25T14:37:45.205229+0000","last_unstale":"2023-07-25T14:37:59.254106+0000","last_undegraded":"2023-07-25T14:37:59.254106+0000","last_fullsized":"2023-07-25T14:37:59.254106+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T20:37:48.433030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.353189+0000","last_change":"2023-07-25T14:37:58.272769+0000","last_active":"2023-07-25T14:37:59.353189+0000","last_peered":"2023-07-25T14:37:59.353189+0000","last_clean":"2023-07-25T14:37:59.353189+0000","last_became_active":"2023-07-25T14:37:58.272512+0000","last_became_peered":"2023-07-25T14:37:58.272512+0000","last_unstale":"2023-07-25T14:37:59.353189+0000","last_undegraded":"2023-07-25T14:37:59.353189+0000","last_fullsized":"2023-07-25T14:37:59.353189+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T01:35:59.361785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.255491+0000","last_change":"2023-07-25T14:37:45.188464+0000","last_active":"2023-07-25T14:37:59.255491+0000","last_peered":"2023-07-25T14:37:59.255491+0000","last_clean":"2023-07-25T14:37:59.255491+0000","last_became_active":"2023-07-25T14:37:45.188020+0000","last_became_peered":"2023-07-25T14:37:45.188020+0000","last_unstale":"2023-07-25T14:37:59.255491+0000","last_undegraded":"2023-07-25T14:37:59.255491+0000","last_fullsized":"2023-07-25T14:37:59.255491+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T15:54:51.725869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.355144+0000","last_change":"2023-07-25T14:37:58.273903+0000","last_active":"2023-07-25T14:37:59.355144+0000","last_peered":"2023-07-25T14:37:59.355144+0000","last_clean":"2023-07-25T14:37:59.355144+0000","last_became_active":"2023-07-25T14:37:58.273670+0000","last_became_peered":"2023-07-25T14:37:58.273670+0000","last_unstale":"2023-07-25T14:37:59.355144+0000","last_undegraded":"2023-07-25T14:37:59.355144+0000","last_fullsized":"2023-07-25T14:37:59.355144+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T15:31:42.790271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.352915+0000","last_change":"2023-07-25T14:37:45.205460+0000","last_active":"2023-07-25T14:37:59.352915+0000","last_peered":"2023-07-25T14:37:59.352915+0000","last_clean":"2023-07-25T14:37:59.352915+0000","last_became_active":"2023-07-25T14:37:45.205174+0000","last_became_peered":"2023-07-25T14:37:45.205174+0000","last_unstale":"2023-07-25T14:37:59.352915+0000","last_undegraded":"2023-07-25T14:37:59.352915+0000","last_fullsized":"2023-07-25T14:37:59.352915+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T15:08:21.539614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.355282+0000","last_change":"2023-07-25T14:37:58.274595+0000","last_active":"2023-07-25T14:37:59.355282+0000","last_peered":"2023-07-25T14:37:59.355282+0000","last_clean":"2023-07-25T14:37:59.355282+0000","last_became_active":"2023-07-25T14:37:58.274339+0000","last_became_peered":"2023-07-25T14:37:58.274339+0000","last_unstale":"2023-07-25T14:37:59.355282+0000","last_undegraded":"2023-07-25T14:37:59.355282+0000","last_fullsized":"2023-07-25T14:37:59.355282+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T02:02:19.195180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.253439+0000","last_change":"2023-07-25T14:37:45.199014+0000","last_active":"2023-07-25T14:37:59.253439+0000","last_peered":"2023-07-25T14:37:59.253439+0000","last_clean":"2023-07-25T14:37:59.253439+0000","last_became_active":"2023-07-25T14:37:45.198610+0000","last_became_peered":"2023-07-25T14:37:45.198610+0000","last_unstale":"2023-07-25T14:37:59.253439+0000","last_undegraded":"2023-07-25T14:37:59.253439+0000","last_fullsized":"2023-07-25T14:37:59.253439+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T20:16:20.476125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.253805+0000","last_change":"2023-07-25T14:37:58.262112+0000","last_active":"2023-07-25T14:37:59.253805+0000","last_peered":"2023-07-25T14:37:59.253805+0000","last_clean":"2023-07-25T14:37:59.253805+0000","last_became_active":"2023-07-25T14:37:58.261790+0000","last_became_peered":"2023-07-25T14:37:58.261790+0000","last_unstale":"2023-07-25T14:37:59.253805+0000","last_undegraded":"2023-07-25T14:37:59.253805+0000","last_fullsized":"2023-07-25T14:37:59.253805+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T18:39:54.194269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.353336+0000","last_change":"2023-07-25T14:37:45.190492+0000","last_active":"2023-07-25T14:37:59.353336+0000","last_peered":"2023-07-25T14:37:59.353336+0000","last_clean":"2023-07-25T14:37:59.353336+0000","last_became_active":"2023-07-25T14:37:45.190205+0000","last_became_peered":"2023-07-25T14:37:45.190205+0000","last_unstale":"2023-07-25T14:37:59.353336+0000","last_undegraded":"2023-07-25T14:37:59.353336+0000","last_fullsized":"2023-07-25T14:37:59.353336+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T15:19:19.734194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.353566+0000","last_change":"2023-07-25T14:37:58.265370+0000","last_active":"2023-07-25T14:37:59.353566+0000","last_peered":"2023-07-25T14:37:59.353566+0000","last_clean":"2023-07-25T14:37:59.353566+0000","last_became_active":"2023-07-25T14:37:58.264772+0000","last_became_peered":"2023-07-25T14:37:58.264772+0000","last_unstale":"2023-07-25T14:37:59.353566+0000","last_undegraded":"2023-07-25T14:37:59.353566+0000","last_fullsized":"2023-07-25T14:37:59.353566+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T23:04:07.473888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.255306+0000","last_change":"2023-07-25T14:37:45.189887+0000","last_active":"2023-07-25T14:37:59.255306+0000","last_peered":"2023-07-25T14:37:59.255306+0000","last_clean":"2023-07-25T14:37:59.255306+0000","last_became_active":"2023-07-25T14:37:45.189544+0000","last_became_peered":"2023-07-25T14:37:45.189544+0000","last_unstale":"2023-07-25T14:37:59.255306+0000","last_undegraded":"2023-07-25T14:37:59.255306+0000","last_fullsized":"2023-07-25T14:37:59.255306+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T15:25:10.256493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.355592+0000","last_change":"2023-07-25T14:37:58.273603+0000","last_active":"2023-07-25T14:37:59.355592+0000","last_peered":"2023-07-25T14:37:59.355592+0000","last_clean":"2023-07-25T14:37:59.355592+0000","last_became_active":"2023-07-25T14:37:58.272546+0000","last_became_peered":"2023-07-25T14:37:58.272546+0000","last_unstale":"2023-07-25T14:37:59.355592+0000","last_undegraded":"2023-07-25T14:37:59.355592+0000","last_fullsized":"2023-07-25T14:37:59.355592+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:11:25.174278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.255785+0000","last_change":"2023-07-25T14:37:45.197332+0000","last_active":"2023-07-25T14:37:59.255785+0000","last_peered":"2023-07-25T14:37:59.255785+0000","last_clean":"2023-07-25T14:37:59.255785+0000","last_became_active":"2023-07-25T14:37:45.196749+0000","last_became_peered":"2023-07-25T14:37:45.196749+0000","last_unstale":"2023-07-25T14:37:59.255785+0000","last_undegraded":"2023-07-25T14:37:59.255785+0000","last_fullsized":"2023-07-25T14:37:59.255785+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T14:55:58.159337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.354401+0000","last_change":"2023-07-25T14:37:58.276058+0000","last_active":"2023-07-25T14:37:59.354401+0000","last_peered":"2023-07-25T14:37:59.354401+0000","last_clean":"2023-07-25T14:37:59.354401+0000","last_became_active":"2023-07-25T14:37:58.275828+0000","last_became_peered":"2023-07-25T14:37:58.275828+0000","last_unstale":"2023-07-25T14:37:59.354401+0000","last_undegraded":"2023-07-25T14:37:59.354401+0000","last_fullsized":"2023-07-25T14:37:59.354401+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T23:50:15.511943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.353370+0000","last_change":"2023-07-25T14:37:45.191972+0000","last_active":"2023-07-25T14:37:59.353370+0000","last_peered":"2023-07-25T14:37:59.353370+0000","last_clean":"2023-07-25T14:37:59.353370+0000","last_became_active":"2023-07-25T14:37:45.191704+0000","last_became_peered":"2023-07-25T14:37:45.191704+0000","last_unstale":"2023-07-25T14:37:59.353370+0000","last_undegraded":"2023-07-25T14:37:59.353370+0000","last_fullsized":"2023-07-25T14:37:59.353370+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T02:23:43.183873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.353202+0000","last_change":"2023-07-25T14:37:58.274924+0000","last_active":"2023-07-25T14:37:59.353202+0000","last_peered":"2023-07-25T14:37:59.353202+0000","last_clean":"2023-07-25T14:37:59.353202+0000","last_became_active":"2023-07-25T14:37:58.274620+0000","last_became_peered":"2023-07-25T14:37:58.274620+0000","last_unstale":"2023-07-25T14:37:59.353202+0000","last_undegraded":"2023-07-25T14:37:59.353202+0000","last_fullsized":"2023-07-25T14:37:59.353202+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T15:22:16.316397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.352671+0000","last_change":"2023-07-25T14:37:57.258106+0000","last_active":"2023-07-25T14:37:59.352671+0000","last_peered":"2023-07-25T14:37:59.352671+0000","last_clean":"2023-07-25T14:37:59.352671+0000","last_became_active":"2023-07-25T14:37:57.257771+0000","last_became_peered":"2023-07-25T14:37:57.257771+0000","last_unstale":"2023-07-25T14:37:59.352671+0000","last_undegraded":"2023-07-25T14:37:59.352671+0000","last_fullsized":"2023-07-25T14:37:59.352671+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_clean_scrub_stamp":"2023-07-25T14:37:56.225499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T22:46:36.416127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.354496+0000","last_change":"2023-07-25T14:37:45.213847+0000","last_active":"2023-07-25T14:37:59.354496+0000","last_peered":"2023-07-25T14:37:59.354496+0000","last_clean":"2023-07-25T14:37:59.354496+0000","last_became_active":"2023-07-25T14:37:45.213456+0000","last_became_peered":"2023-07-25T14:37:45.213456+0000","last_unstale":"2023-07-25T14:37:59.354496+0000","last_undegraded":"2023-07-25T14:37:59.354496+0000","last_fullsized":"2023-07-25T14:37:59.354496+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T18:39:41.108484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"56'4","reported_seq":25,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.354975+0000","last_change":"2023-07-25T14:37:44.164114+0000","last_active":"2023-07-25T14:37:59.354975+0000","last_peered":"2023-07-25T14:37:59.354975+0000","last_clean":"2023-07-25T14:37:59.354975+0000","last_became_active":"2023-07-25T14:37:44.163807+0000","last_became_peered":"2023-07-25T14:37:44.163807+0000","last_unstale":"2023-07-25T14:37:59.354975+0000","last_undegraded":"2023-07-25T14:37:59.354975+0000","last_fullsized":"2023-07-25T14:37:59.354975+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T15:08:20.537998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.352807+0000","last_change":"2023-07-25T14:37:58.267265+0000","last_active":"2023-07-25T14:37:59.352807+0000","last_peered":"2023-07-25T14:37:59.352807+0000","last_clean":"2023-07-25T14:37:59.352807+0000","last_became_active":"2023-07-25T14:37:58.266994+0000","last_became_peered":"2023-07-25T14:37:58.266994+0000","last_unstale":"2023-07-25T14:37:59.352807+0000","last_undegraded":"2023-07-25T14:37:59.352807+0000","last_fullsized":"2023-07-25T14:37:59.352807+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T18:39:54.194269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.354729+0000","last_change":"2023-07-25T14:37:57.262903+0000","last_active":"2023-07-25T14:37:59.354729+0000","last_peered":"2023-07-25T14:37:59.354729+0000","last_clean":"2023-07-25T14:37:59.354729+0000","last_became_active":"2023-07-25T14:37:57.262633+0000","last_became_peered":"2023-07-25T14:37:57.262633+0000","last_unstale":"2023-07-25T14:37:59.354729+0000","last_undegraded":"2023-07-25T14:37:59.354729+0000","last_fullsized":"2023-07-25T14:37:59.354729+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_clean_scrub_stamp":"2023-07-25T14:37:56.225499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:52:02.073882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.255485+0000","last_change":"2023-07-25T14:37:45.191918+0000","last_active":"2023-07-25T14:37:59.255485+0000","last_peered":"2023-07-25T14:37:59.255485+0000","last_clean":"2023-07-25T14:37:59.255485+0000","last_became_active":"2023-07-25T14:37:45.191341+0000","last_became_peered":"2023-07-25T14:37:45.191341+0000","last_unstale":"2023-07-25T14:37:59.255485+0000","last_undegraded":"2023-07-25T14:37:59.255485+0000","last_fullsized":"2023-07-25T14:37:59.255485+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T18:10:50.908131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"56'1","reported_seq":22,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.353801+0000","last_change":"2023-07-25T14:37:44.174028+0000","last_active":"2023-07-25T14:37:59.353801+0000","last_peered":"2023-07-25T14:37:59.353801+0000","last_clean":"2023-07-25T14:37:59.353801+0000","last_became_active":"2023-07-25T14:37:44.173193+0000","last_became_peered":"2023-07-25T14:37:44.173193+0000","last_unstale":"2023-07-25T14:37:59.353801+0000","last_undegraded":"2023-07-25T14:37:59.353801+0000","last_fullsized":"2023-07-25T14:37:59.353801+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T21:37:45.453864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.355094+0000","last_change":"2023-07-25T14:37:58.274251+0000","last_active":"2023-07-25T14:37:59.355094+0000","last_peered":"2023-07-25T14:37:59.355094+0000","last_clean":"2023-07-25T14:37:59.355094+0000","last_became_active":"2023-07-25T14:37:58.274080+0000","last_became_peered":"2023-07-25T14:37:58.274080+0000","last_unstale":"2023-07-25T14:37:59.355094+0000","last_undegraded":"2023-07-25T14:37:59.355094+0000","last_fullsized":"2023-07-25T14:37:59.355094+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T22:14:04.754808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"60'1","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.255087+0000","last_change":"2023-07-25T14:37:57.263153+0000","last_active":"2023-07-25T14:37:59.255087+0000","last_peered":"2023-07-25T14:37:59.255087+0000","last_clean":"2023-07-25T14:37:59.255087+0000","last_became_active":"2023-07-25T14:37:57.262683+0000","last_became_peered":"2023-07-25T14:37:57.262683+0000","last_unstale":"2023-07-25T14:37:59.255087+0000","last_undegraded":"2023-07-25T14:37:59.255087+0000","last_fullsized":"2023-07-25T14:37:59.255087+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_clean_scrub_stamp":"2023-07-25T14:37:56.225499+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T01:18:45.274260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.355011+0000","last_change":"2023-07-25T14:37:45.209338+0000","last_active":"2023-07-25T14:37:59.355011+0000","last_peered":"2023-07-25T14:37:59.355011+0000","last_clean":"2023-07-25T14:37:59.355011+0000","last_became_active":"2023-07-25T14:37:45.207168+0000","last_became_peered":"2023-07-25T14:37:45.207168+0000","last_unstale":"2023-07-25T14:37:59.355011+0000","last_undegraded":"2023-07-25T14:37:59.355011+0000","last_fullsized":"2023-07-25T14:37:59.355011+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T15:01:23.982072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"56'2","reported_seq":23,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.254033+0000","last_change":"2023-07-25T14:37:44.168052+0000","last_active":"2023-07-25T14:37:59.254033+0000","last_peered":"2023-07-25T14:37:59.254033+0000","last_clean":"2023-07-25T14:37:59.254033+0000","last_became_active":"2023-07-25T14:37:44.167768+0000","last_became_peered":"2023-07-25T14:37:44.167768+0000","last_unstale":"2023-07-25T14:37:59.254033+0000","last_undegraded":"2023-07-25T14:37:59.254033+0000","last_fullsized":"2023-07-25T14:37:59.254033+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T15:08:20.537998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.255418+0000","last_change":"2023-07-25T14:37:58.252199+0000","last_active":"2023-07-25T14:37:59.255418+0000","last_peered":"2023-07-25T14:37:59.255418+0000","last_clean":"2023-07-25T14:37:59.255418+0000","last_became_active":"2023-07-25T14:37:58.251930+0000","last_became_peered":"2023-07-25T14:37:58.251930+0000","last_unstale":"2023-07-25T14:37:59.255418+0000","last_undegraded":"2023-07-25T14:37:59.255418+0000","last_fullsized":"2023-07-25T14:37:59.255418+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T20:48:38.981381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"60'1","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.253401+0000","last_change":"2023-07-25T14:37:57.261540+0000","last_active":"2023-07-25T14:37:59.253401+0000","last_peered":"2023-07-25T14:37:59.253401+0000","last_clean":"2023-07-25T14:37:59.253401+0000","last_became_active":"2023-07-25T14:37:57.261265+0000","last_became_peered":"2023-07-25T14:37:57.261265+0000","last_unstale":"2023-07-25T14:37:59.253401+0000","last_undegraded":"2023-07-25T14:37:59.253401+0000","last_fullsized":"2023-07-25T14:37:59.253401+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_clean_scrub_stamp":"2023-07-25T14:37:56.225499+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T23:25:22.309808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.354465+0000","last_change":"2023-07-25T14:37:45.204504+0000","last_active":"2023-07-25T14:37:59.354465+0000","last_peered":"2023-07-25T14:37:59.354465+0000","last_clean":"2023-07-25T14:37:59.354465+0000","last_became_active":"2023-07-25T14:37:45.203141+0000","last_became_peered":"2023-07-25T14:37:45.203141+0000","last_unstale":"2023-07-25T14:37:59.354465+0000","last_undegraded":"2023-07-25T14:37:59.354465+0000","last_fullsized":"2023-07-25T14:37:59.354465+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T20:15:25.491350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"56'2","reported_seq":23,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.354580+0000","last_change":"2023-07-25T14:37:44.167404+0000","last_active":"2023-07-25T14:37:59.354580+0000","last_peered":"2023-07-25T14:37:59.354580+0000","last_clean":"2023-07-25T14:37:59.354580+0000","last_became_active":"2023-07-25T14:37:44.167157+0000","last_became_peered":"2023-07-25T14:37:44.167157+0000","last_unstale":"2023-07-25T14:37:59.354580+0000","last_undegraded":"2023-07-25T14:37:59.354580+0000","last_fullsized":"2023-07-25T14:37:59.354580+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T14:55:57.157721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.353737+0000","last_change":"2023-07-25T14:37:58.266893+0000","last_active":"2023-07-25T14:37:59.353737+0000","last_peered":"2023-07-25T14:37:59.353737+0000","last_clean":"2023-07-25T14:37:59.353737+0000","last_became_active":"2023-07-25T14:37:58.266636+0000","last_became_peered":"2023-07-25T14:37:58.266636+0000","last_unstale":"2023-07-25T14:37:59.353737+0000","last_undegraded":"2023-07-25T14:37:59.353737+0000","last_fullsized":"2023-07-25T14:37:59.353737+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:11:45.159867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"60'2","reported_seq":15,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.353604+0000","last_change":"2023-07-25T14:37:57.248386+0000","last_active":"2023-07-25T14:37:59.353604+0000","last_peered":"2023-07-25T14:37:59.353604+0000","last_clean":"2023-07-25T14:37:59.353604+0000","last_became_active":"2023-07-25T14:37:57.248115+0000","last_became_peered":"2023-07-25T14:37:57.248115+0000","last_unstale":"2023-07-25T14:37:59.353604+0000","last_undegraded":"2023-07-25T14:37:59.353604+0000","last_fullsized":"2023-07-25T14:37:59.353604+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_clean_scrub_stamp":"2023-07-25T14:37:56.225499+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T02:03:05.515454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.255456+0000","last_change":"2023-07-25T14:37:45.192672+0000","last_active":"2023-07-25T14:37:59.255456+0000","last_peered":"2023-07-25T14:37:59.255456+0000","last_clean":"2023-07-25T14:37:59.255456+0000","last_became_active":"2023-07-25T14:37:45.192426+0000","last_became_peered":"2023-07-25T14:37:45.192426+0000","last_unstale":"2023-07-25T14:37:59.255456+0000","last_undegraded":"2023-07-25T14:37:59.255456+0000","last_fullsized":"2023-07-25T14:37:59.255456+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T17:04:57.323478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"56'1","reported_seq":22,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.353439+0000","last_change":"2023-07-25T14:37:44.165894+0000","last_active":"2023-07-25T14:37:59.353439+0000","last_peered":"2023-07-25T14:37:59.353439+0000","last_clean":"2023-07-25T14:37:59.353439+0000","last_became_active":"2023-07-25T14:37:44.165121+0000","last_became_peered":"2023-07-25T14:37:44.165121+0000","last_unstale":"2023-07-25T14:37:59.353439+0000","last_undegraded":"2023-07-25T14:37:59.353439+0000","last_fullsized":"2023-07-25T14:37:59.353439+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T23:45:30.075158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.354219+0000","last_change":"2023-07-25T14:37:58.266399+0000","last_active":"2023-07-25T14:37:59.354219+0000","last_peered":"2023-07-25T14:37:59.354219+0000","last_clean":"2023-07-25T14:37:59.354219+0000","last_became_active":"2023-07-25T14:37:58.266136+0000","last_became_peered":"2023-07-25T14:37:58.266136+0000","last_unstale":"2023-07-25T14:37:59.354219+0000","last_undegraded":"2023-07-25T14:37:59.354219+0000","last_fullsized":"2023-07-25T14:37:59.354219+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T02:13:09.943612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"60'2","reported_seq":15,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.354166+0000","last_change":"2023-07-25T14:37:57.256744+0000","last_active":"2023-07-25T14:37:59.354166+0000","last_peered":"2023-07-25T14:37:59.354166+0000","last_clean":"2023-07-25T14:37:59.354166+0000","last_became_active":"2023-07-25T14:37:57.256503+0000","last_became_peered":"2023-07-25T14:37:57.256503+0000","last_unstale":"2023-07-25T14:37:59.354166+0000","last_undegraded":"2023-07-25T14:37:59.354166+0000","last_fullsized":"2023-07-25T14:37:59.354166+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_clean_scrub_stamp":"2023-07-25T14:37:56.225499+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T15:02:48.422214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.254941+0000","last_change":"2023-07-25T14:37:45.204924+0000","last_active":"2023-07-25T14:37:59.254941+0000","last_peered":"2023-07-25T14:37:59.254941+0000","last_clean":"2023-07-25T14:37:59.254941+0000","last_became_active":"2023-07-25T14:37:45.204636+0000","last_became_peered":"2023-07-25T14:37:45.204636+0000","last_unstale":"2023-07-25T14:37:59.254941+0000","last_undegraded":"2023-07-25T14:37:59.254941+0000","last_fullsized":"2023-07-25T14:37:59.254941+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T19:58:11.434033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"56'1","reported_seq":22,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.354092+0000","last_change":"2023-07-25T14:37:44.165997+0000","last_active":"2023-07-25T14:37:59.354092+0000","last_peered":"2023-07-25T14:37:59.354092+0000","last_clean":"2023-07-25T14:37:59.354092+0000","last_became_active":"2023-07-25T14:37:44.165724+0000","last_became_peered":"2023-07-25T14:37:44.165724+0000","last_unstale":"2023-07-25T14:37:59.354092+0000","last_undegraded":"2023-07-25T14:37:59.354092+0000","last_fullsized":"2023-07-25T14:37:59.354092+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T16:59:26.609126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.254524+0000","last_change":"2023-07-25T14:37:58.257104+0000","last_active":"2023-07-25T14:37:59.254524+0000","last_peered":"2023-07-25T14:37:59.254524+0000","last_clean":"2023-07-25T14:37:59.254524+0000","last_became_active":"2023-07-25T14:37:58.256857+0000","last_became_peered":"2023-07-25T14:37:58.256857+0000","last_unstale":"2023-07-25T14:37:59.254524+0000","last_undegraded":"2023-07-25T14:37:59.254524+0000","last_fullsized":"2023-07-25T14:37:59.254524+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T23:45:44.162560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"60'4","reported_seq":17,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.355043+0000","last_change":"2023-07-25T14:37:57.254601+0000","last_active":"2023-07-25T14:37:59.355043+0000","last_peered":"2023-07-25T14:37:59.355043+0000","last_clean":"2023-07-25T14:37:59.355043+0000","last_became_active":"2023-07-25T14:37:57.254128+0000","last_became_peered":"2023-07-25T14:37:57.254128+0000","last_unstale":"2023-07-25T14:37:59.355043+0000","last_undegraded":"2023-07-25T14:37:59.355043+0000","last_fullsized":"2023-07-25T14:37:59.355043+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_clean_scrub_stamp":"2023-07-25T14:37:56.225499+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T18:04:47.417812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.254888+0000","last_change":"2023-07-25T14:37:45.200734+0000","last_active":"2023-07-25T14:37:59.254888+0000","last_peered":"2023-07-25T14:37:59.254888+0000","last_clean":"2023-07-25T14:37:59.254888+0000","last_became_active":"2023-07-25T14:37:45.200452+0000","last_became_peered":"2023-07-25T14:37:45.200452+0000","last_unstale":"2023-07-25T14:37:59.254888+0000","last_undegraded":"2023-07-25T14:37:59.254888+0000","last_fullsized":"2023-07-25T14:37:59.254888+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T23:06:28.083990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":21,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.354833+0000","last_change":"2023-07-25T14:37:44.163784+0000","last_active":"2023-07-25T14:37:59.354833+0000","last_peered":"2023-07-25T14:37:59.354833+0000","last_clean":"2023-07-25T14:37:59.354833+0000","last_became_active":"2023-07-25T14:37:44.163566+0000","last_became_peered":"2023-07-25T14:37:44.163566+0000","last_unstale":"2023-07-25T14:37:59.354833+0000","last_undegraded":"2023-07-25T14:37:59.354833+0000","last_fullsized":"2023-07-25T14:37:59.354833+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T17:43:04.617257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.354934+0000","last_change":"2023-07-25T14:37:58.272389+0000","last_active":"2023-07-25T14:37:59.354934+0000","last_peered":"2023-07-25T14:37:59.354934+0000","last_clean":"2023-07-25T14:37:59.354934+0000","last_became_active":"2023-07-25T14:37:58.272172+0000","last_became_peered":"2023-07-25T14:37:58.272172+0000","last_unstale":"2023-07-25T14:37:59.354934+0000","last_undegraded":"2023-07-25T14:37:59.354934+0000","last_fullsized":"2023-07-25T14:37:59.354934+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:01:28.750034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"60'1","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.254282+0000","last_change":"2023-07-25T14:37:57.266582+0000","last_active":"2023-07-25T14:37:59.254282+0000","last_peered":"2023-07-25T14:37:59.254282+0000","last_clean":"2023-07-25T14:37:59.254282+0000","last_became_active":"2023-07-25T14:37:57.266257+0000","last_became_peered":"2023-07-25T14:37:57.266257+0000","last_unstale":"2023-07-25T14:37:59.254282+0000","last_undegraded":"2023-07-25T14:37:59.254282+0000","last_fullsized":"2023-07-25T14:37:59.254282+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_clean_scrub_stamp":"2023-07-25T14:37:56.225499+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T15:19:31.814559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.352932+0000","last_change":"2023-07-25T14:37:45.205124+0000","last_active":"2023-07-25T14:37:59.352932+0000","last_peered":"2023-07-25T14:37:59.352932+0000","last_clean":"2023-07-25T14:37:59.352932+0000","last_became_active":"2023-07-25T14:37:45.204730+0000","last_became_peered":"2023-07-25T14:37:45.204730+0000","last_unstale":"2023-07-25T14:37:59.352932+0000","last_undegraded":"2023-07-25T14:37:59.352932+0000","last_fullsized":"2023-07-25T14:37:59.352932+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:16:02.561651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":21,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.254665+0000","last_change":"2023-07-25T14:37:44.171926+0000","last_active":"2023-07-25T14:37:59.254665+0000","last_peered":"2023-07-25T14:37:59.254665+0000","last_clean":"2023-07-25T14:37:59.254665+0000","last_became_active":"2023-07-25T14:37:44.171610+0000","last_became_peered":"2023-07-25T14:37:44.171610+0000","last_unstale":"2023-07-25T14:37:59.254665+0000","last_undegraded":"2023-07-25T14:37:59.254665+0000","last_fullsized":"2023-07-25T14:37:59.254665+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T19:35:54.989248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.354760+0000","last_change":"2023-07-25T14:37:58.273479+0000","last_active":"2023-07-25T14:37:59.354760+0000","last_peered":"2023-07-25T14:37:59.354760+0000","last_clean":"2023-07-25T14:37:59.354760+0000","last_became_active":"2023-07-25T14:37:58.272406+0000","last_became_peered":"2023-07-25T14:37:58.272406+0000","last_unstale":"2023-07-25T14:37:59.354760+0000","last_undegraded":"2023-07-25T14:37:59.354760+0000","last_fullsized":"2023-07-25T14:37:59.354760+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T19:32:56.068141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.255553+0000","last_change":"2023-07-25T14:37:57.263209+0000","last_active":"2023-07-25T14:37:59.255553+0000","last_peered":"2023-07-25T14:37:59.255553+0000","last_clean":"2023-07-25T14:37:59.255553+0000","last_became_active":"2023-07-25T14:37:57.262677+0000","last_became_peered":"2023-07-25T14:37:57.262677+0000","last_unstale":"2023-07-25T14:37:59.255553+0000","last_undegraded":"2023-07-25T14:37:59.255553+0000","last_fullsized":"2023-07-25T14:37:59.255553+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_clean_scrub_stamp":"2023-07-25T14:37:56.225499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T17:02:33.760834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.255620+0000","last_change":"2023-07-25T14:37:45.208126+0000","last_active":"2023-07-25T14:37:59.255620+0000","last_peered":"2023-07-25T14:37:59.255620+0000","last_clean":"2023-07-25T14:37:59.255620+0000","last_became_active":"2023-07-25T14:37:45.207856+0000","last_became_peered":"2023-07-25T14:37:45.207856+0000","last_unstale":"2023-07-25T14:37:59.255620+0000","last_undegraded":"2023-07-25T14:37:59.255620+0000","last_fullsized":"2023-07-25T14:37:59.255620+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T15:04:38.410166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":21,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.254265+0000","last_change":"2023-07-25T14:37:44.164773+0000","last_active":"2023-07-25T14:37:59.254265+0000","last_peered":"2023-07-25T14:37:59.254265+0000","last_clean":"2023-07-25T14:37:59.254265+0000","last_became_active":"2023-07-25T14:37:44.164480+0000","last_became_peered":"2023-07-25T14:37:44.164480+0000","last_unstale":"2023-07-25T14:37:59.254265+0000","last_undegraded":"2023-07-25T14:37:59.254265+0000","last_fullsized":"2023-07-25T14:37:59.254265+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T15:59:59.981639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.354816+0000","last_change":"2023-07-25T14:37:58.273504+0000","last_active":"2023-07-25T14:37:59.354816+0000","last_peered":"2023-07-25T14:37:59.354816+0000","last_clean":"2023-07-25T14:37:59.354816+0000","last_became_active":"2023-07-25T14:37:58.272498+0000","last_became_peered":"2023-07-25T14:37:58.272498+0000","last_unstale":"2023-07-25T14:37:59.354816+0000","last_undegraded":"2023-07-25T14:37:59.354816+0000","last_fullsized":"2023-07-25T14:37:59.354816+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T16:55:49.405044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"60'8","reported_seq":21,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.352582+0000","last_change":"2023-07-25T14:37:57.257465+0000","last_active":"2023-07-25T14:37:59.352582+0000","last_peered":"2023-07-25T14:37:59.352582+0000","last_clean":"2023-07-25T14:37:59.352582+0000","last_became_active":"2023-07-25T14:37:57.257172+0000","last_became_peered":"2023-07-25T14:37:57.257172+0000","last_unstale":"2023-07-25T14:37:59.352582+0000","last_undegraded":"2023-07-25T14:37:59.352582+0000","last_fullsized":"2023-07-25T14:37:59.352582+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_clean_scrub_stamp":"2023-07-25T14:37:56.225499+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T20:46:02.598993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.355167+0000","last_change":"2023-07-25T14:37:45.196449+0000","last_active":"2023-07-25T14:37:59.355167+0000","last_peered":"2023-07-25T14:37:59.355167+0000","last_clean":"2023-07-25T14:37:59.355167+0000","last_became_active":"2023-07-25T14:37:45.196172+0000","last_became_peered":"2023-07-25T14:37:45.196172+0000","last_unstale":"2023-07-25T14:37:59.355167+0000","last_undegraded":"2023-07-25T14:37:59.355167+0000","last_fullsized":"2023-07-25T14:37:59.355167+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T20:37:48.433030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":21,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.355084+0000","last_change":"2023-07-25T14:37:44.162751+0000","last_active":"2023-07-25T14:37:59.355084+0000","last_peered":"2023-07-25T14:37:59.355084+0000","last_clean":"2023-07-25T14:37:59.355084+0000","last_became_active":"2023-07-25T14:37:44.162037+0000","last_became_peered":"2023-07-25T14:37:44.162037+0000","last_unstale":"2023-07-25T14:37:59.355084+0000","last_undegraded":"2023-07-25T14:37:59.355084+0000","last_fullsized":"2023-07-25T14:37:59.355084+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T18:53:30.782548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.353395+0000","last_change":"2023-07-25T14:37:58.263069+0000","last_active":"2023-07-25T14:37:59.353395+0000","last_peered":"2023-07-25T14:37:59.353395+0000","last_clean":"2023-07-25T14:37:59.353395+0000","last_became_active":"2023-07-25T14:37:58.262816+0000","last_became_peered":"2023-07-25T14:37:58.262816+0000","last_unstale":"2023-07-25T14:37:59.353395+0000","last_undegraded":"2023-07-25T14:37:59.353395+0000","last_fullsized":"2023-07-25T14:37:59.353395+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T19:15:01.089481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"60'2","reported_seq":15,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.355594+0000","last_change":"2023-07-25T14:37:57.264233+0000","last_active":"2023-07-25T14:37:59.355594+0000","last_peered":"2023-07-25T14:37:59.355594+0000","last_clean":"2023-07-25T14:37:59.355594+0000","last_became_active":"2023-07-25T14:37:57.263944+0000","last_became_peered":"2023-07-25T14:37:57.263944+0000","last_unstale":"2023-07-25T14:37:59.355594+0000","last_undegraded":"2023-07-25T14:37:59.355594+0000","last_fullsized":"2023-07-25T14:37:59.355594+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_clean_scrub_stamp":"2023-07-25T14:37:56.225499+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T21:35:30.980842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.354834+0000","last_change":"2023-07-25T14:37:45.206751+0000","last_active":"2023-07-25T14:37:59.354834+0000","last_peered":"2023-07-25T14:37:59.354834+0000","last_clean":"2023-07-25T14:37:59.354834+0000","last_became_active":"2023-07-25T14:37:45.206422+0000","last_became_peered":"2023-07-25T14:37:45.206422+0000","last_unstale":"2023-07-25T14:37:59.354834+0000","last_undegraded":"2023-07-25T14:37:59.354834+0000","last_fullsized":"2023-07-25T14:37:59.354834+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T16:03:21.851226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"56'3","reported_seq":24,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.353115+0000","last_change":"2023-07-25T14:37:44.161397+0000","last_active":"2023-07-25T14:37:59.353115+0000","last_peered":"2023-07-25T14:37:59.353115+0000","last_clean":"2023-07-25T14:37:59.353115+0000","last_became_active":"2023-07-25T14:37:44.161134+0000","last_became_peered":"2023-07-25T14:37:44.161134+0000","last_unstale":"2023-07-25T14:37:59.353115+0000","last_undegraded":"2023-07-25T14:37:59.353115+0000","last_fullsized":"2023-07-25T14:37:59.353115+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T23:19:20.504472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.353506+0000","last_change":"2023-07-25T14:37:58.273268+0000","last_active":"2023-07-25T14:37:59.353506+0000","last_peered":"2023-07-25T14:37:59.353506+0000","last_clean":"2023-07-25T14:37:59.353506+0000","last_became_active":"2023-07-25T14:37:58.272950+0000","last_became_peered":"2023-07-25T14:37:58.272950+0000","last_unstale":"2023-07-25T14:37:59.353506+0000","last_undegraded":"2023-07-25T14:37:59.353506+0000","last_fullsized":"2023-07-25T14:37:59.353506+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T18:45:07.995927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.353005+0000","last_change":"2023-07-25T14:37:57.257276+0000","last_active":"2023-07-25T14:37:59.353005+0000","last_peered":"2023-07-25T14:37:59.353005+0000","last_clean":"2023-07-25T14:37:59.353005+0000","last_became_active":"2023-07-25T14:37:57.256993+0000","last_became_peered":"2023-07-25T14:37:57.256993+0000","last_unstale":"2023-07-25T14:37:59.353005+0000","last_undegraded":"2023-07-25T14:37:59.353005+0000","last_fullsized":"2023-07-25T14:37:59.353005+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_clean_scrub_stamp":"2023-07-25T14:37:56.225499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T17:40:11.976810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.255720+0000","last_change":"2023-07-25T14:37:45.199815+0000","last_active":"2023-07-25T14:37:59.255720+0000","last_peered":"2023-07-25T14:37:59.255720+0000","last_clean":"2023-07-25T14:37:59.255720+0000","last_became_active":"2023-07-25T14:37:45.199555+0000","last_became_peered":"2023-07-25T14:37:45.199555+0000","last_unstale":"2023-07-25T14:37:59.255720+0000","last_undegraded":"2023-07-25T14:37:59.255720+0000","last_fullsized":"2023-07-25T14:37:59.255720+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:27:37.618593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"57'8","reported_seq":29,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.355396+0000","last_change":"2023-07-25T14:37:44.173212+0000","last_active":"2023-07-25T14:37:59.355396+0000","last_peered":"2023-07-25T14:37:59.355396+0000","last_clean":"2023-07-25T14:37:59.355396+0000","last_became_active":"2023-07-25T14:37:44.172950+0000","last_became_peered":"2023-07-25T14:37:44.172950+0000","last_unstale":"2023-07-25T14:37:59.355396+0000","last_undegraded":"2023-07-25T14:37:59.355396+0000","last_fullsized":"2023-07-25T14:37:59.355396+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T19:06:16.675638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3071,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.353476+0000","last_change":"2023-07-25T14:37:58.267921+0000","last_active":"2023-07-25T14:37:59.353476+0000","last_peered":"2023-07-25T14:37:59.353476+0000","last_clean":"2023-07-25T14:37:59.353476+0000","last_became_active":"2023-07-25T14:37:58.263495+0000","last_became_peered":"2023-07-25T14:37:58.263495+0000","last_unstale":"2023-07-25T14:37:59.353476+0000","last_undegraded":"2023-07-25T14:37:59.353476+0000","last_fullsized":"2023-07-25T14:37:59.353476+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:52:23.301924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"60'3","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.353656+0000","last_change":"2023-07-25T14:37:57.258129+0000","last_active":"2023-07-25T14:37:59.353656+0000","last_peered":"2023-07-25T14:37:59.353656+0000","last_clean":"2023-07-25T14:37:59.353656+0000","last_became_active":"2023-07-25T14:37:57.257770+0000","last_became_peered":"2023-07-25T14:37:57.257770+0000","last_unstale":"2023-07-25T14:37:59.353656+0000","last_undegraded":"2023-07-25T14:37:59.353656+0000","last_fullsized":"2023-07-25T14:37:59.353656+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_clean_scrub_stamp":"2023-07-25T14:37:56.225499+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T21:08:31.954016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.353459+0000","last_change":"2023-07-25T14:37:45.203546+0000","last_active":"2023-07-25T14:37:59.353459+0000","last_peered":"2023-07-25T14:37:59.353459+0000","last_clean":"2023-07-25T14:37:59.353459+0000","last_became_active":"2023-07-25T14:37:45.203115+0000","last_became_peered":"2023-07-25T14:37:45.203115+0000","last_unstale":"2023-07-25T14:37:59.353459+0000","last_undegraded":"2023-07-25T14:37:59.353459+0000","last_fullsized":"2023-07-25T14:37:59.353459+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:23:42.852496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"56'2","reported_seq":23,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.355344+0000","last_change":"2023-07-25T14:37:44.164563+0000","last_active":"2023-07-25T14:37:59.355344+0000","last_peered":"2023-07-25T14:37:59.355344+0000","last_clean":"2023-07-25T14:37:59.355344+0000","last_became_active":"2023-07-25T14:37:44.164255+0000","last_became_peered":"2023-07-25T14:37:44.164255+0000","last_unstale":"2023-07-25T14:37:59.355344+0000","last_undegraded":"2023-07-25T14:37:59.355344+0000","last_fullsized":"2023-07-25T14:37:59.355344+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T16:48:43.337902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.253856+0000","last_change":"2023-07-25T14:37:58.261845+0000","last_active":"2023-07-25T14:37:59.253856+0000","last_peered":"2023-07-25T14:37:59.253856+0000","last_clean":"2023-07-25T14:37:59.253856+0000","last_became_active":"2023-07-25T14:37:58.261043+0000","last_became_peered":"2023-07-25T14:37:58.261043+0000","last_unstale":"2023-07-25T14:37:59.253856+0000","last_undegraded":"2023-07-25T14:37:59.253856+0000","last_fullsized":"2023-07-25T14:37:59.253856+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:22:35.512164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"60'6","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.255681+0000","last_change":"2023-07-25T14:37:57.252569+0000","last_active":"2023-07-25T14:37:59.255681+0000","last_peered":"2023-07-25T14:37:59.255681+0000","last_clean":"2023-07-25T14:37:59.255681+0000","last_became_active":"2023-07-25T14:37:57.252285+0000","last_became_peered":"2023-07-25T14:37:57.252285+0000","last_unstale":"2023-07-25T14:37:59.255681+0000","last_undegraded":"2023-07-25T14:37:59.255681+0000","last_fullsized":"2023-07-25T14:37:59.255681+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_clean_scrub_stamp":"2023-07-25T14:37:56.225499+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T01:12:06.057938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.255189+0000","last_change":"2023-07-25T14:37:45.201081+0000","last_active":"2023-07-25T14:37:59.255189+0000","last_peered":"2023-07-25T14:37:59.255189+0000","last_clean":"2023-07-25T14:37:59.255189+0000","last_became_active":"2023-07-25T14:37:45.200738+0000","last_became_peered":"2023-07-25T14:37:45.200738+0000","last_unstale":"2023-07-25T14:37:59.255189+0000","last_undegraded":"2023-07-25T14:37:59.255189+0000","last_fullsized":"2023-07-25T14:37:59.255189+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:11:32.074082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":21,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.354657+0000","last_change":"2023-07-25T14:37:44.173296+0000","last_active":"2023-07-25T14:37:59.354657+0000","last_peered":"2023-07-25T14:37:59.354657+0000","last_clean":"2023-07-25T14:37:59.354657+0000","last_became_active":"2023-07-25T14:37:44.172957+0000","last_became_peered":"2023-07-25T14:37:44.172957+0000","last_unstale":"2023-07-25T14:37:59.354657+0000","last_undegraded":"2023-07-25T14:37:59.354657+0000","last_fullsized":"2023-07-25T14:37:59.354657+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T18:15:12.884852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.352923+0000","last_change":"2023-07-25T14:37:58.264626+0000","last_active":"2023-07-25T14:37:59.352923+0000","last_peered":"2023-07-25T14:37:59.352923+0000","last_clean":"2023-07-25T14:37:59.352923+0000","last_became_active":"2023-07-25T14:37:58.264350+0000","last_became_peered":"2023-07-25T14:37:58.264350+0000","last_unstale":"2023-07-25T14:37:59.352923+0000","last_undegraded":"2023-07-25T14:37:59.352923+0000","last_fullsized":"2023-07-25T14:37:59.352923+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T21:50:12.129185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.355339+0000","last_change":"2023-07-25T14:37:57.254528+0000","last_active":"2023-07-25T14:37:59.355339+0000","last_peered":"2023-07-25T14:37:59.355339+0000","last_clean":"2023-07-25T14:37:59.355339+0000","last_became_active":"2023-07-25T14:37:57.254073+0000","last_became_peered":"2023-07-25T14:37:57.254073+0000","last_unstale":"2023-07-25T14:37:59.355339+0000","last_undegraded":"2023-07-25T14:37:59.355339+0000","last_fullsized":"2023-07-25T14:37:59.355339+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_clean_scrub_stamp":"2023-07-25T14:37:56.225499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T17:58:22.033923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.352715+0000","last_change":"2023-07-25T14:37:45.195068+0000","last_active":"2023-07-25T14:37:59.352715+0000","last_peered":"2023-07-25T14:37:59.352715+0000","last_clean":"2023-07-25T14:37:59.352715+0000","last_became_active":"2023-07-25T14:37:45.194820+0000","last_became_peered":"2023-07-25T14:37:45.194820+0000","last_unstale":"2023-07-25T14:37:59.352715+0000","last_undegraded":"2023-07-25T14:37:59.352715+0000","last_fullsized":"2023-07-25T14:37:59.352715+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T23:27:14.922188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":21,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.255797+0000","last_change":"2023-07-25T14:37:44.166150+0000","last_active":"2023-07-25T14:37:59.255797+0000","last_peered":"2023-07-25T14:37:59.255797+0000","last_clean":"2023-07-25T14:37:59.255797+0000","last_became_active":"2023-07-25T14:37:44.165851+0000","last_became_peered":"2023-07-25T14:37:44.165851+0000","last_unstale":"2023-07-25T14:37:59.255797+0000","last_undegraded":"2023-07-25T14:37:59.255797+0000","last_fullsized":"2023-07-25T14:37:59.255797+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T19:02:49.906914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.255552+0000","last_change":"2023-07-25T14:37:58.252027+0000","last_active":"2023-07-25T14:37:59.255552+0000","last_peered":"2023-07-25T14:37:59.255552+0000","last_clean":"2023-07-25T14:37:59.255552+0000","last_became_active":"2023-07-25T14:37:58.251719+0000","last_became_peered":"2023-07-25T14:37:58.251719+0000","last_unstale":"2023-07-25T14:37:59.255552+0000","last_undegraded":"2023-07-25T14:37:59.255552+0000","last_fullsized":"2023-07-25T14:37:59.255552+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:21:18.689386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.354073+0000","last_change":"2023-07-25T14:37:57.264390+0000","last_active":"2023-07-25T14:37:59.354073+0000","last_peered":"2023-07-25T14:37:59.354073+0000","last_clean":"2023-07-25T14:37:59.354073+0000","last_became_active":"2023-07-25T14:37:57.264110+0000","last_became_peered":"2023-07-25T14:37:57.264110+0000","last_unstale":"2023-07-25T14:37:59.354073+0000","last_undegraded":"2023-07-25T14:37:59.354073+0000","last_fullsized":"2023-07-25T14:37:59.354073+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_clean_scrub_stamp":"2023-07-25T14:37:56.225499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T17:02:33.760834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.254875+0000","last_change":"2023-07-25T14:37:45.193890+0000","last_active":"2023-07-25T14:37:59.254875+0000","last_peered":"2023-07-25T14:37:59.254875+0000","last_clean":"2023-07-25T14:37:59.254875+0000","last_became_active":"2023-07-25T14:37:45.193634+0000","last_became_peered":"2023-07-25T14:37:45.193634+0000","last_unstale":"2023-07-25T14:37:59.254875+0000","last_undegraded":"2023-07-25T14:37:59.254875+0000","last_fullsized":"2023-07-25T14:37:59.254875+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T02:11:14.139374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"56'8","reported_seq":29,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.253486+0000","last_change":"2023-07-25T14:37:44.164996+0000","last_active":"2023-07-25T14:37:59.253486+0000","last_peered":"2023-07-25T14:37:59.253486+0000","last_clean":"2023-07-25T14:37:59.253486+0000","last_became_active":"2023-07-25T14:37:44.164753+0000","last_became_peered":"2023-07-25T14:37:44.164753+0000","last_unstale":"2023-07-25T14:37:59.253486+0000","last_undegraded":"2023-07-25T14:37:59.253486+0000","last_fullsized":"2023-07-25T14:37:59.253486+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T22:19:43.486777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.353210+0000","last_change":"2023-07-25T14:37:58.276220+0000","last_active":"2023-07-25T14:37:59.353210+0000","last_peered":"2023-07-25T14:37:59.353210+0000","last_clean":"2023-07-25T14:37:59.353210+0000","last_became_active":"2023-07-25T14:37:58.275959+0000","last_became_peered":"2023-07-25T14:37:58.275959+0000","last_unstale":"2023-07-25T14:37:59.353210+0000","last_undegraded":"2023-07-25T14:37:59.353210+0000","last_fullsized":"2023-07-25T14:37:59.353210+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T02:24:24.354419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.353590+0000","last_change":"2023-07-25T14:37:57.261183+0000","last_active":"2023-07-25T14:37:59.353590+0000","last_peered":"2023-07-25T14:37:59.353590+0000","last_clean":"2023-07-25T14:37:59.353590+0000","last_became_active":"2023-07-25T14:37:57.260897+0000","last_became_peered":"2023-07-25T14:37:57.260897+0000","last_unstale":"2023-07-25T14:37:59.353590+0000","last_undegraded":"2023-07-25T14:37:59.353590+0000","last_fullsized":"2023-07-25T14:37:59.353590+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_clean_scrub_stamp":"2023-07-25T14:37:56.225499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T01:50:26.093784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.353681+0000","last_change":"2023-07-25T14:37:45.192838+0000","last_active":"2023-07-25T14:37:59.353681+0000","last_peered":"2023-07-25T14:37:59.353681+0000","last_clean":"2023-07-25T14:37:59.353681+0000","last_became_active":"2023-07-25T14:37:45.192552+0000","last_became_peered":"2023-07-25T14:37:45.192552+0000","last_unstale":"2023-07-25T14:37:59.353681+0000","last_undegraded":"2023-07-25T14:37:59.353681+0000","last_fullsized":"2023-07-25T14:37:59.353681+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T17:21:58.816449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"56'2","reported_seq":23,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.355211+0000","last_change":"2023-07-25T14:37:44.163016+0000","last_active":"2023-07-25T14:37:59.355211+0000","last_peered":"2023-07-25T14:37:59.355211+0000","last_clean":"2023-07-25T14:37:59.355211+0000","last_became_active":"2023-07-25T14:37:44.161974+0000","last_became_peered":"2023-07-25T14:37:44.161974+0000","last_unstale":"2023-07-25T14:37:59.355211+0000","last_undegraded":"2023-07-25T14:37:59.355211+0000","last_fullsized":"2023-07-25T14:37:59.355211+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T20:02:33.029907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.353945+0000","last_change":"2023-07-25T14:37:58.255940+0000","last_active":"2023-07-25T14:37:59.353945+0000","last_peered":"2023-07-25T14:37:59.353945+0000","last_clean":"2023-07-25T14:37:59.353945+0000","last_became_active":"2023-07-25T14:37:58.254944+0000","last_became_peered":"2023-07-25T14:37:58.254944+0000","last_unstale":"2023-07-25T14:37:59.353945+0000","last_undegraded":"2023-07-25T14:37:59.353945+0000","last_fullsized":"2023-07-25T14:37:59.353945+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T15:25:23.342278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.253270+0000","last_change":"2023-07-25T14:37:57.261245+0000","last_active":"2023-07-25T14:37:59.253270+0000","last_peered":"2023-07-25T14:37:59.253270+0000","last_clean":"2023-07-25T14:37:59.253270+0000","last_became_active":"2023-07-25T14:37:57.259735+0000","last_became_peered":"2023-07-25T14:37:57.259735+0000","last_unstale":"2023-07-25T14:37:59.253270+0000","last_undegraded":"2023-07-25T14:37:59.253270+0000","last_fullsized":"2023-07-25T14:37:59.253270+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_clean_scrub_stamp":"2023-07-25T14:37:56.225499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T23:37:53.349690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.255714+0000","last_change":"2023-07-25T14:37:45.198281+0000","last_active":"2023-07-25T14:37:59.255714+0000","last_peered":"2023-07-25T14:37:59.255714+0000","last_clean":"2023-07-25T14:37:59.255714+0000","last_became_active":"2023-07-25T14:37:45.197975+0000","last_became_peered":"2023-07-25T14:37:45.197975+0000","last_unstale":"2023-07-25T14:37:59.255714+0000","last_undegraded":"2023-07-25T14:37:59.255714+0000","last_fullsized":"2023-07-25T14:37:59.255714+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T01:34:38.725451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"57'1","reported_seq":22,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.255679+0000","last_change":"2023-07-25T14:37:44.166254+0000","last_active":"2023-07-25T14:37:59.255679+0000","last_peered":"2023-07-25T14:37:59.255679+0000","last_clean":"2023-07-25T14:37:59.255679+0000","last_became_active":"2023-07-25T14:37:44.165974+0000","last_became_peered":"2023-07-25T14:37:44.165974+0000","last_unstale":"2023-07-25T14:37:59.255679+0000","last_undegraded":"2023-07-25T14:37:59.255679+0000","last_fullsized":"2023-07-25T14:37:59.255679+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T23:02:46.102683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.255069+0000","last_change":"2023-07-25T14:37:58.263394+0000","last_active":"2023-07-25T14:37:59.255069+0000","last_peered":"2023-07-25T14:37:59.255069+0000","last_clean":"2023-07-25T14:37:59.255069+0000","last_became_active":"2023-07-25T14:37:58.263113+0000","last_became_peered":"2023-07-25T14:37:58.263113+0000","last_unstale":"2023-07-25T14:37:59.255069+0000","last_undegraded":"2023-07-25T14:37:59.255069+0000","last_fullsized":"2023-07-25T14:37:59.255069+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T21:08:32.959436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.352880+0000","last_change":"2023-07-25T14:37:57.257509+0000","last_active":"2023-07-25T14:37:59.352880+0000","last_peered":"2023-07-25T14:37:59.352880+0000","last_clean":"2023-07-25T14:37:59.352880+0000","last_became_active":"2023-07-25T14:37:57.257227+0000","last_became_peered":"2023-07-25T14:37:57.257227+0000","last_unstale":"2023-07-25T14:37:59.352880+0000","last_undegraded":"2023-07-25T14:37:59.352880+0000","last_fullsized":"2023-07-25T14:37:59.352880+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_clean_scrub_stamp":"2023-07-25T14:37:56.225499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T22:12:40.021720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.354153+0000","last_change":"2023-07-25T14:37:45.209704+0000","last_active":"2023-07-25T14:37:59.354153+0000","last_peered":"2023-07-25T14:37:59.354153+0000","last_clean":"2023-07-25T14:37:59.354153+0000","last_became_active":"2023-07-25T14:37:45.209391+0000","last_became_peered":"2023-07-25T14:37:45.209391+0000","last_unstale":"2023-07-25T14:37:59.354153+0000","last_undegraded":"2023-07-25T14:37:59.354153+0000","last_fullsized":"2023-07-25T14:37:59.354153+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T23:37:41.269324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":21,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.255506+0000","last_change":"2023-07-25T14:37:44.166101+0000","last_active":"2023-07-25T14:37:59.255506+0000","last_peered":"2023-07-25T14:37:59.255506+0000","last_clean":"2023-07-25T14:37:59.255506+0000","last_became_active":"2023-07-25T14:37:44.165823+0000","last_became_peered":"2023-07-25T14:37:44.165823+0000","last_unstale":"2023-07-25T14:37:59.255506+0000","last_undegraded":"2023-07-25T14:37:59.255506+0000","last_fullsized":"2023-07-25T14:37:59.255506+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:38:22.173444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.352802+0000","last_change":"2023-07-25T14:37:58.269040+0000","last_active":"2023-07-25T14:37:59.352802+0000","last_peered":"2023-07-25T14:37:59.352802+0000","last_clean":"2023-07-25T14:37:59.352802+0000","last_became_active":"2023-07-25T14:37:58.268758+0000","last_became_peered":"2023-07-25T14:37:58.268758+0000","last_unstale":"2023-07-25T14:37:59.352802+0000","last_undegraded":"2023-07-25T14:37:59.352802+0000","last_fullsized":"2023-07-25T14:37:59.352802+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T19:20:13.436831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.253749+0000","last_change":"2023-07-25T14:37:57.260967+0000","last_active":"2023-07-25T14:37:59.253749+0000","last_peered":"2023-07-25T14:37:59.253749+0000","last_clean":"2023-07-25T14:37:59.253749+0000","last_became_active":"2023-07-25T14:37:57.259766+0000","last_became_peered":"2023-07-25T14:37:57.259766+0000","last_unstale":"2023-07-25T14:37:59.253749+0000","last_undegraded":"2023-07-25T14:37:59.253749+0000","last_fullsized":"2023-07-25T14:37:59.253749+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_clean_scrub_stamp":"2023-07-25T14:37:56.225499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T21:50:11.123765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.354678+0000","last_change":"2023-07-25T14:37:45.207757+0000","last_active":"2023-07-25T14:37:59.354678+0000","last_peered":"2023-07-25T14:37:59.354678+0000","last_clean":"2023-07-25T14:37:59.354678+0000","last_became_active":"2023-07-25T14:37:45.204097+0000","last_became_peered":"2023-07-25T14:37:45.204097+0000","last_unstale":"2023-07-25T14:37:59.354678+0000","last_undegraded":"2023-07-25T14:37:59.354678+0000","last_fullsized":"2023-07-25T14:37:59.354678+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:22:22.426378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":21,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.353919+0000","last_change":"2023-07-25T14:37:44.170019+0000","last_active":"2023-07-25T14:37:59.353919+0000","last_peered":"2023-07-25T14:37:59.353919+0000","last_clean":"2023-07-25T14:37:59.353919+0000","last_became_active":"2023-07-25T14:37:44.169764+0000","last_became_peered":"2023-07-25T14:37:44.169764+0000","last_unstale":"2023-07-25T14:37:59.353919+0000","last_undegraded":"2023-07-25T14:37:59.353919+0000","last_fullsized":"2023-07-25T14:37:59.353919+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T22:44:30.774104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.354543+0000","last_change":"2023-07-25T14:37:58.255540+0000","last_active":"2023-07-25T14:37:59.354543+0000","last_peered":"2023-07-25T14:37:59.354543+0000","last_clean":"2023-07-25T14:37:59.354543+0000","last_became_active":"2023-07-25T14:37:58.255227+0000","last_became_peered":"2023-07-25T14:37:58.255227+0000","last_unstale":"2023-07-25T14:37:59.354543+0000","last_undegraded":"2023-07-25T14:37:59.354543+0000","last_fullsized":"2023-07-25T14:37:59.354543+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T01:12:07.063358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.354037+0000","last_change":"2023-07-25T14:37:57.252733+0000","last_active":"2023-07-25T14:37:59.354037+0000","last_peered":"2023-07-25T14:37:59.354037+0000","last_clean":"2023-07-25T14:37:59.354037+0000","last_became_active":"2023-07-25T14:37:57.252027+0000","last_became_peered":"2023-07-25T14:37:57.252027+0000","last_unstale":"2023-07-25T14:37:59.354037+0000","last_undegraded":"2023-07-25T14:37:59.354037+0000","last_fullsized":"2023-07-25T14:37:59.354037+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_clean_scrub_stamp":"2023-07-25T14:37:56.225499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T15:55:03.806235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.255759+0000","last_change":"2023-07-25T14:37:45.192706+0000","last_active":"2023-07-25T14:37:59.255759+0000","last_peered":"2023-07-25T14:37:59.255759+0000","last_clean":"2023-07-25T14:37:59.255759+0000","last_became_active":"2023-07-25T14:37:45.191283+0000","last_became_peered":"2023-07-25T14:37:45.191283+0000","last_unstale":"2023-07-25T14:37:59.255759+0000","last_undegraded":"2023-07-25T14:37:59.255759+0000","last_fullsized":"2023-07-25T14:37:59.255759+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T01:09:03.425047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":21,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.255260+0000","last_change":"2023-07-25T14:37:44.171694+0000","last_active":"2023-07-25T14:37:59.255260+0000","last_peered":"2023-07-25T14:37:59.255260+0000","last_clean":"2023-07-25T14:37:59.255260+0000","last_became_active":"2023-07-25T14:37:44.171465+0000","last_became_peered":"2023-07-25T14:37:44.171465+0000","last_unstale":"2023-07-25T14:37:59.255260+0000","last_undegraded":"2023-07-25T14:37:59.255260+0000","last_fullsized":"2023-07-25T14:37:59.255260+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T19:43:30.626125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.253582+0000","last_change":"2023-07-25T14:37:58.262039+0000","last_active":"2023-07-25T14:37:59.253582+0000","last_peered":"2023-07-25T14:37:59.253582+0000","last_clean":"2023-07-25T14:37:59.253582+0000","last_became_active":"2023-07-25T14:37:58.261440+0000","last_became_peered":"2023-07-25T14:37:58.261440+0000","last_unstale":"2023-07-25T14:37:59.253582+0000","last_undegraded":"2023-07-25T14:37:59.253582+0000","last_fullsized":"2023-07-25T14:37:59.253582+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T23:50:15.511943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.354786+0000","last_change":"2023-07-25T14:37:57.253502+0000","last_active":"2023-07-25T14:37:59.354786+0000","last_peered":"2023-07-25T14:37:59.354786+0000","last_clean":"2023-07-25T14:37:59.354786+0000","last_became_active":"2023-07-25T14:37:57.253160+0000","last_became_peered":"2023-07-25T14:37:57.253160+0000","last_unstale":"2023-07-25T14:37:59.354786+0000","last_undegraded":"2023-07-25T14:37:59.354786+0000","last_fullsized":"2023-07-25T14:37:59.354786+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_clean_scrub_stamp":"2023-07-25T14:37:56.225499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T21:36:41.667564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.353986+0000","last_change":"2023-07-25T14:37:45.208487+0000","last_active":"2023-07-25T14:37:59.353986+0000","last_peered":"2023-07-25T14:37:59.353986+0000","last_clean":"2023-07-25T14:37:59.353986+0000","last_became_active":"2023-07-25T14:37:45.207037+0000","last_became_peered":"2023-07-25T14:37:45.207037+0000","last_unstale":"2023-07-25T14:37:59.353986+0000","last_undegraded":"2023-07-25T14:37:59.353986+0000","last_fullsized":"2023-07-25T14:37:59.353986+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T17:19:54.370051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":21,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.355360+0000","last_change":"2023-07-25T14:37:44.165012+0000","last_active":"2023-07-25T14:37:59.355360+0000","last_peered":"2023-07-25T14:37:59.355360+0000","last_clean":"2023-07-25T14:37:59.355360+0000","last_became_active":"2023-07-25T14:37:44.164759+0000","last_became_peered":"2023-07-25T14:37:44.164759+0000","last_unstale":"2023-07-25T14:37:59.355360+0000","last_undegraded":"2023-07-25T14:37:59.355360+0000","last_fullsized":"2023-07-25T14:37:59.355360+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T01:48:31.890423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.254189+0000","last_change":"2023-07-25T14:37:58.255039+0000","last_active":"2023-07-25T14:37:59.254189+0000","last_peered":"2023-07-25T14:37:59.254189+0000","last_clean":"2023-07-25T14:37:59.254189+0000","last_became_active":"2023-07-25T14:37:58.254784+0000","last_became_peered":"2023-07-25T14:37:58.254784+0000","last_unstale":"2023-07-25T14:37:59.254189+0000","last_undegraded":"2023-07-25T14:37:59.254189+0000","last_fullsized":"2023-07-25T14:37:59.254189+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T19:28:19.281913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"60'2","reported_seq":15,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.355538+0000","last_change":"2023-07-25T14:37:57.261057+0000","last_active":"2023-07-25T14:37:59.355538+0000","last_peered":"2023-07-25T14:37:59.355538+0000","last_clean":"2023-07-25T14:37:59.355538+0000","last_became_active":"2023-07-25T14:37:57.260773+0000","last_became_peered":"2023-07-25T14:37:57.260773+0000","last_unstale":"2023-07-25T14:37:59.355538+0000","last_undegraded":"2023-07-25T14:37:59.355538+0000","last_fullsized":"2023-07-25T14:37:59.355538+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_clean_scrub_stamp":"2023-07-25T14:37:56.225499+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T22:28:26.670719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.355030+0000","last_change":"2023-07-25T14:37:45.191681+0000","last_active":"2023-07-25T14:37:59.355030+0000","last_peered":"2023-07-25T14:37:59.355030+0000","last_clean":"2023-07-25T14:37:59.355030+0000","last_became_active":"2023-07-25T14:37:45.188974+0000","last_became_peered":"2023-07-25T14:37:45.188974+0000","last_unstale":"2023-07-25T14:37:59.355030+0000","last_undegraded":"2023-07-25T14:37:59.355030+0000","last_fullsized":"2023-07-25T14:37:59.355030+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T20:19:02.577921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":21,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.253413+0000","last_change":"2023-07-25T14:37:44.164983+0000","last_active":"2023-07-25T14:37:59.253413+0000","last_peered":"2023-07-25T14:37:59.253413+0000","last_clean":"2023-07-25T14:37:59.253413+0000","last_became_active":"2023-07-25T14:37:44.164413+0000","last_became_peered":"2023-07-25T14:37:44.164413+0000","last_unstale":"2023-07-25T14:37:59.253413+0000","last_undegraded":"2023-07-25T14:37:59.253413+0000","last_fullsized":"2023-07-25T14:37:59.253413+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T20:15:24.489734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.355326+0000","last_change":"2023-07-25T14:37:58.267676+0000","last_active":"2023-07-25T14:37:59.355326+0000","last_peered":"2023-07-25T14:37:59.355326+0000","last_clean":"2023-07-25T14:37:59.355326+0000","last_became_active":"2023-07-25T14:37:58.267393+0000","last_became_peered":"2023-07-25T14:37:58.267393+0000","last_unstale":"2023-07-25T14:37:59.355326+0000","last_undegraded":"2023-07-25T14:37:59.355326+0000","last_fullsized":"2023-07-25T14:37:59.355326+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T19:28:19.281913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.355568+0000","last_change":"2023-07-25T14:37:57.264182+0000","last_active":"2023-07-25T14:37:59.355568+0000","last_peered":"2023-07-25T14:37:59.355568+0000","last_clean":"2023-07-25T14:37:59.355568+0000","last_became_active":"2023-07-25T14:37:57.263876+0000","last_became_peered":"2023-07-25T14:37:57.263876+0000","last_unstale":"2023-07-25T14:37:59.355568+0000","last_undegraded":"2023-07-25T14:37:59.355568+0000","last_fullsized":"2023-07-25T14:37:59.355568+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_clean_scrub_stamp":"2023-07-25T14:37:56.225499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T22:42:00.280992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.353985+0000","last_change":"2023-07-25T14:37:45.192970+0000","last_active":"2023-07-25T14:37:59.353985+0000","last_peered":"2023-07-25T14:37:59.353985+0000","last_clean":"2023-07-25T14:37:59.353985+0000","last_became_active":"2023-07-25T14:37:45.192666+0000","last_became_peered":"2023-07-25T14:37:45.192666+0000","last_unstale":"2023-07-25T14:37:59.353985+0000","last_undegraded":"2023-07-25T14:37:59.353985+0000","last_fullsized":"2023-07-25T14:37:59.353985+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T19:02:50.908530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":21,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.353632+0000","last_change":"2023-07-25T14:37:44.168526+0000","last_active":"2023-07-25T14:37:59.353632+0000","last_peered":"2023-07-25T14:37:59.353632+0000","last_clean":"2023-07-25T14:37:59.353632+0000","last_became_active":"2023-07-25T14:37:44.168336+0000","last_became_peered":"2023-07-25T14:37:44.168336+0000","last_unstale":"2023-07-25T14:37:59.353632+0000","last_undegraded":"2023-07-25T14:37:59.353632+0000","last_fullsized":"2023-07-25T14:37:59.353632+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T15:46:45.390857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.254942+0000","last_change":"2023-07-25T14:37:58.266220+0000","last_active":"2023-07-25T14:37:59.254942+0000","last_peered":"2023-07-25T14:37:59.254942+0000","last_clean":"2023-07-25T14:37:59.254942+0000","last_became_active":"2023-07-25T14:37:58.265981+0000","last_became_peered":"2023-07-25T14:37:58.265981+0000","last_unstale":"2023-07-25T14:37:59.254942+0000","last_undegraded":"2023-07-25T14:37:59.254942+0000","last_fullsized":"2023-07-25T14:37:59.254942+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T01:50:27.099203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.255399+0000","last_change":"2023-07-25T14:37:57.250015+0000","last_active":"2023-07-25T14:37:59.255399+0000","last_peered":"2023-07-25T14:37:59.255399+0000","last_clean":"2023-07-25T14:37:59.255399+0000","last_became_active":"2023-07-25T14:37:57.249747+0000","last_became_peered":"2023-07-25T14:37:57.249747+0000","last_unstale":"2023-07-25T14:37:59.255399+0000","last_undegraded":"2023-07-25T14:37:59.255399+0000","last_fullsized":"2023-07-25T14:37:59.255399+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_clean_scrub_stamp":"2023-07-25T14:37:56.225499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T23:57:24.618192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.255604+0000","last_change":"2023-07-25T14:37:45.202784+0000","last_active":"2023-07-25T14:37:59.255604+0000","last_peered":"2023-07-25T14:37:59.255604+0000","last_clean":"2023-07-25T14:37:59.255604+0000","last_became_active":"2023-07-25T14:37:45.202515+0000","last_became_peered":"2023-07-25T14:37:45.202515+0000","last_unstale":"2023-07-25T14:37:59.255604+0000","last_undegraded":"2023-07-25T14:37:59.255604+0000","last_fullsized":"2023-07-25T14:37:59.255604+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T02:17:20.156479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":21,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.354227+0000","last_change":"2023-07-25T14:37:44.170162+0000","last_active":"2023-07-25T14:37:59.354227+0000","last_peered":"2023-07-25T14:37:59.354227+0000","last_clean":"2023-07-25T14:37:59.354227+0000","last_became_active":"2023-07-25T14:37:44.169805+0000","last_became_peered":"2023-07-25T14:37:44.169805+0000","last_unstale":"2023-07-25T14:37:59.354227+0000","last_undegraded":"2023-07-25T14:37:59.354227+0000","last_fullsized":"2023-07-25T14:37:59.354227+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T23:25:09.227827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":92,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.355191+0000","last_change":"2023-07-25T14:35:34.370772+0000","last_active":"2023-07-25T14:37:59.355191+0000","last_peered":"2023-07-25T14:37:59.355191+0000","last_clean":"2023-07-25T14:37:59.355191+0000","last_became_active":"2023-07-25T14:35:34.370549+0000","last_became_peered":"2023-07-25T14:35:34.370549+0000","last_unstale":"2023-07-25T14:37:59.355191+0000","last_undegraded":"2023-07-25T14:37:59.355191+0000","last_fullsized":"2023-07-25T14:37:59.355191+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_clean_scrub_stamp":"2023-07-25T14:35:33.358525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T23:25:23.438453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.255659+0000","last_change":"2023-07-25T14:37:58.276530+0000","last_active":"2023-07-25T14:37:59.255659+0000","last_peered":"2023-07-25T14:37:59.255659+0000","last_clean":"2023-07-25T14:37:59.255659+0000","last_became_active":"2023-07-25T14:37:58.275948+0000","last_became_peered":"2023-07-25T14:37:58.275948+0000","last_unstale":"2023-07-25T14:37:59.255659+0000","last_undegraded":"2023-07-25T14:37:59.255659+0000","last_fullsized":"2023-07-25T14:37:59.255659+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T15:10:47.053810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"60'2","reported_seq":15,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.353203+0000","last_change":"2023-07-25T14:37:57.254095+0000","last_active":"2023-07-25T14:37:59.353203+0000","last_peered":"2023-07-25T14:37:59.353203+0000","last_clean":"2023-07-25T14:37:59.353203+0000","last_became_active":"2023-07-25T14:37:57.253803+0000","last_became_peered":"2023-07-25T14:37:57.253803+0000","last_unstale":"2023-07-25T14:37:59.353203+0000","last_undegraded":"2023-07-25T14:37:59.353203+0000","last_fullsized":"2023-07-25T14:37:59.353203+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_clean_scrub_stamp":"2023-07-25T14:37:56.225499+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T19:28:18.276493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.355313+0000","last_change":"2023-07-25T14:37:45.194744+0000","last_active":"2023-07-25T14:37:59.355313+0000","last_peered":"2023-07-25T14:37:59.355313+0000","last_clean":"2023-07-25T14:37:59.355313+0000","last_became_active":"2023-07-25T14:37:45.194393+0000","last_became_peered":"2023-07-25T14:37:45.194393+0000","last_unstale":"2023-07-25T14:37:59.355313+0000","last_undegraded":"2023-07-25T14:37:59.355313+0000","last_fullsized":"2023-07-25T14:37:59.355313+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T21:01:07.274086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"56'1","reported_seq":22,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.354423+0000","last_change":"2023-07-25T14:37:44.166450+0000","last_active":"2023-07-25T14:37:59.354423+0000","last_peered":"2023-07-25T14:37:59.354423+0000","last_clean":"2023-07-25T14:37:59.354423+0000","last_became_active":"2023-07-25T14:37:44.165513+0000","last_became_peered":"2023-07-25T14:37:44.165513+0000","last_unstale":"2023-07-25T14:37:59.354423+0000","last_undegraded":"2023-07-25T14:37:59.354423+0000","last_fullsized":"2023-07-25T14:37:59.354423+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T01:34:37.723835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":92,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.354605+0000","last_change":"2023-07-25T14:35:35.321055+0000","last_active":"2023-07-25T14:37:59.354605+0000","last_peered":"2023-07-25T14:37:59.354605+0000","last_clean":"2023-07-25T14:37:59.354605+0000","last_became_active":"2023-07-25T14:35:35.320739+0000","last_became_peered":"2023-07-25T14:35:35.320739+0000","last_unstale":"2023-07-25T14:37:59.354605+0000","last_undegraded":"2023-07-25T14:37:59.354605+0000","last_fullsized":"2023-07-25T14:37:59.354605+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_clean_scrub_stamp":"2023-07-25T14:35:33.358525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T01:20:46.377691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.253424+0000","last_change":"2023-07-25T14:37:58.268807+0000","last_active":"2023-07-25T14:37:59.253424+0000","last_peered":"2023-07-25T14:37:59.253424+0000","last_clean":"2023-07-25T14:37:59.253424+0000","last_became_active":"2023-07-25T14:37:58.268383+0000","last_became_peered":"2023-07-25T14:37:58.268383+0000","last_unstale":"2023-07-25T14:37:59.253424+0000","last_undegraded":"2023-07-25T14:37:59.253424+0000","last_fullsized":"2023-07-25T14:37:59.253424+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T02:13:09.943612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.353687+0000","last_change":"2023-07-25T14:37:57.252413+0000","last_active":"2023-07-25T14:37:59.353687+0000","last_peered":"2023-07-25T14:37:59.353687+0000","last_clean":"2023-07-25T14:37:59.353687+0000","last_became_active":"2023-07-25T14:37:57.252131+0000","last_became_peered":"2023-07-25T14:37:57.252131+0000","last_unstale":"2023-07-25T14:37:59.353687+0000","last_undegraded":"2023-07-25T14:37:59.353687+0000","last_fullsized":"2023-07-25T14:37:59.353687+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_clean_scrub_stamp":"2023-07-25T14:37:56.225499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T02:26:45.352413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.353339+0000","last_change":"2023-07-25T14:37:45.197932+0000","last_active":"2023-07-25T14:37:59.353339+0000","last_peered":"2023-07-25T14:37:59.353339+0000","last_clean":"2023-07-25T14:37:59.353339+0000","last_became_active":"2023-07-25T14:37:45.197610+0000","last_became_peered":"2023-07-25T14:37:45.197610+0000","last_unstale":"2023-07-25T14:37:59.353339+0000","last_undegraded":"2023-07-25T14:37:59.353339+0000","last_fullsized":"2023-07-25T14:37:59.353339+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T16:00:00.983255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":21,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.354806+0000","last_change":"2023-07-25T14:37:44.166137+0000","last_active":"2023-07-25T14:37:59.354806+0000","last_peered":"2023-07-25T14:37:59.354806+0000","last_clean":"2023-07-25T14:37:59.354806+0000","last_became_active":"2023-07-25T14:37:44.165836+0000","last_became_peered":"2023-07-25T14:37:44.165836+0000","last_unstale":"2023-07-25T14:37:59.354806+0000","last_undegraded":"2023-07-25T14:37:59.354806+0000","last_fullsized":"2023-07-25T14:37:59.354806+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:47:45.268358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":100,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.256021+0000","last_change":"2023-07-25T14:35:35.321057+0000","last_active":"2023-07-25T14:37:59.256021+0000","last_peered":"2023-07-25T14:37:59.256021+0000","last_clean":"2023-07-25T14:37:59.256021+0000","last_became_active":"2023-07-25T14:35:35.320751+0000","last_became_peered":"2023-07-25T14:35:35.320751+0000","last_unstale":"2023-07-25T14:37:59.256021+0000","last_undegraded":"2023-07-25T14:37:59.256021+0000","last_fullsized":"2023-07-25T14:37:59.256021+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_clean_scrub_stamp":"2023-07-25T14:35:33.358525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T19:31:35.569131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.355119+0000","last_change":"2023-07-25T14:37:58.269302+0000","last_active":"2023-07-25T14:37:59.355119+0000","last_peered":"2023-07-25T14:37:59.355119+0000","last_clean":"2023-07-25T14:37:59.355119+0000","last_became_active":"2023-07-25T14:37:58.269050+0000","last_became_peered":"2023-07-25T14:37:58.269050+0000","last_unstale":"2023-07-25T14:37:59.355119+0000","last_undegraded":"2023-07-25T14:37:59.355119+0000","last_fullsized":"2023-07-25T14:37:59.355119+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T15:57:56.554035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"60'1","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.354312+0000","last_change":"2023-07-25T14:37:57.260989+0000","last_active":"2023-07-25T14:37:59.354312+0000","last_peered":"2023-07-25T14:37:59.354312+0000","last_clean":"2023-07-25T14:37:59.354312+0000","last_became_active":"2023-07-25T14:37:57.260668+0000","last_became_peered":"2023-07-25T14:37:57.260668+0000","last_unstale":"2023-07-25T14:37:59.354312+0000","last_undegraded":"2023-07-25T14:37:59.354312+0000","last_fullsized":"2023-07-25T14:37:59.354312+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_clean_scrub_stamp":"2023-07-25T14:37:56.225499+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T20:16:32.556491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.353208+0000","last_change":"2023-07-25T14:37:45.195875+0000","last_active":"2023-07-25T14:37:59.353208+0000","last_peered":"2023-07-25T14:37:59.353208+0000","last_clean":"2023-07-25T14:37:59.353208+0000","last_became_active":"2023-07-25T14:37:45.195516+0000","last_became_peered":"2023-07-25T14:37:45.195516+0000","last_unstale":"2023-07-25T14:37:59.353208+0000","last_undegraded":"2023-07-25T14:37:59.353208+0000","last_fullsized":"2023-07-25T14:37:59.353208+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T18:09:47.450177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"56'2","reported_seq":23,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.354374+0000","last_change":"2023-07-25T14:37:44.167253+0000","last_active":"2023-07-25T14:37:59.354374+0000","last_peered":"2023-07-25T14:37:59.354374+0000","last_clean":"2023-07-25T14:37:59.354374+0000","last_became_active":"2023-07-25T14:37:44.166775+0000","last_became_peered":"2023-07-25T14:37:44.166775+0000","last_unstale":"2023-07-25T14:37:59.354374+0000","last_undegraded":"2023-07-25T14:37:59.354374+0000","last_fullsized":"2023-07-25T14:37:59.354374+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T15:04:37.408551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":92,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.353876+0000","last_change":"2023-07-25T14:35:35.321201+0000","last_active":"2023-07-25T14:37:59.353876+0000","last_peered":"2023-07-25T14:37:59.353876+0000","last_clean":"2023-07-25T14:37:59.353876+0000","last_became_active":"2023-07-25T14:35:35.320728+0000","last_became_peered":"2023-07-25T14:35:35.320728+0000","last_unstale":"2023-07-25T14:37:59.353876+0000","last_undegraded":"2023-07-25T14:37:59.353876+0000","last_fullsized":"2023-07-25T14:37:59.353876+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_clean_scrub_stamp":"2023-07-25T14:35:33.358525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T20:43:19.501209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.354369+0000","last_change":"2023-07-25T14:37:58.260726+0000","last_active":"2023-07-25T14:37:59.354369+0000","last_peered":"2023-07-25T14:37:59.354369+0000","last_clean":"2023-07-25T14:37:59.354369+0000","last_became_active":"2023-07-25T14:37:58.260402+0000","last_became_peered":"2023-07-25T14:37:58.260402+0000","last_unstale":"2023-07-25T14:37:59.354369+0000","last_undegraded":"2023-07-25T14:37:59.354369+0000","last_fullsized":"2023-07-25T14:37:59.354369+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T22:19:57.574178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"60'1","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.355524+0000","last_change":"2023-07-25T14:37:57.254343+0000","last_active":"2023-07-25T14:37:59.355524+0000","last_peered":"2023-07-25T14:37:59.355524+0000","last_clean":"2023-07-25T14:37:59.355524+0000","last_became_active":"2023-07-25T14:37:57.253567+0000","last_became_peered":"2023-07-25T14:37:57.253567+0000","last_unstale":"2023-07-25T14:37:59.355524+0000","last_undegraded":"2023-07-25T14:37:59.355524+0000","last_fullsized":"2023-07-25T14:37:59.355524+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_clean_scrub_stamp":"2023-07-25T14:37:56.225499+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:13:00.646026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.352565+0000","last_change":"2023-07-25T14:37:45.209554+0000","last_active":"2023-07-25T14:37:59.352565+0000","last_peered":"2023-07-25T14:37:59.352565+0000","last_clean":"2023-07-25T14:37:59.352565+0000","last_became_active":"2023-07-25T14:37:45.209319+0000","last_became_peered":"2023-07-25T14:37:45.209319+0000","last_unstale":"2023-07-25T14:37:59.352565+0000","last_undegraded":"2023-07-25T14:37:59.352565+0000","last_fullsized":"2023-07-25T14:37:59.352565+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T23:50:02.426158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":21,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.255956+0000","last_change":"2023-07-25T14:37:44.172803+0000","last_active":"2023-07-25T14:37:59.255956+0000","last_peered":"2023-07-25T14:37:59.255956+0000","last_clean":"2023-07-25T14:37:59.255956+0000","last_became_active":"2023-07-25T14:37:44.172512+0000","last_became_peered":"2023-07-25T14:37:44.172512+0000","last_unstale":"2023-07-25T14:37:59.255956+0000","last_undegraded":"2023-07-25T14:37:59.255956+0000","last_fullsized":"2023-07-25T14:37:59.255956+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T01:22:56.162683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":92,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.353366+0000","last_change":"2023-07-25T14:35:35.321448+0000","last_active":"2023-07-25T14:37:59.353366+0000","last_peered":"2023-07-25T14:37:59.353366+0000","last_clean":"2023-07-25T14:37:59.353366+0000","last_became_active":"2023-07-25T14:35:35.320830+0000","last_became_peered":"2023-07-25T14:35:35.320830+0000","last_unstale":"2023-07-25T14:37:59.353366+0000","last_undegraded":"2023-07-25T14:37:59.353366+0000","last_fullsized":"2023-07-25T14:37:59.353366+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_clean_scrub_stamp":"2023-07-25T14:35:33.358525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T15:24:16.390167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.355106+0000","last_change":"2023-07-25T14:37:58.264469+0000","last_active":"2023-07-25T14:37:59.355106+0000","last_peered":"2023-07-25T14:37:59.355106+0000","last_clean":"2023-07-25T14:37:59.355106+0000","last_became_active":"2023-07-25T14:37:58.263999+0000","last_became_peered":"2023-07-25T14:37:58.263999+0000","last_unstale":"2023-07-25T14:37:59.355106+0000","last_undegraded":"2023-07-25T14:37:59.355106+0000","last_fullsized":"2023-07-25T14:37:59.355106+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T17:02:45.018562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"60'2","reported_seq":15,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.353632+0000","last_change":"2023-07-25T14:37:57.264239+0000","last_active":"2023-07-25T14:37:59.353632+0000","last_peered":"2023-07-25T14:37:59.353632+0000","last_clean":"2023-07-25T14:37:59.353632+0000","last_became_active":"2023-07-25T14:37:57.263940+0000","last_became_peered":"2023-07-25T14:37:57.263940+0000","last_unstale":"2023-07-25T14:37:59.353632+0000","last_undegraded":"2023-07-25T14:37:59.353632+0000","last_fullsized":"2023-07-25T14:37:59.353632+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_clean_scrub_stamp":"2023-07-25T14:37:56.225499+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T16:38:31.603176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.353149+0000","last_change":"2023-07-25T14:37:45.207283+0000","last_active":"2023-07-25T14:37:59.353149+0000","last_peered":"2023-07-25T14:37:59.353149+0000","last_clean":"2023-07-25T14:37:59.353149+0000","last_became_active":"2023-07-25T14:37:45.206954+0000","last_became_peered":"2023-07-25T14:37:45.206954+0000","last_unstale":"2023-07-25T14:37:59.353149+0000","last_undegraded":"2023-07-25T14:37:59.353149+0000","last_fullsized":"2023-07-25T14:37:59.353149+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T20:37:48.433030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":21,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.352835+0000","last_change":"2023-07-25T14:37:44.172365+0000","last_active":"2023-07-25T14:37:59.352835+0000","last_peered":"2023-07-25T14:37:59.352835+0000","last_clean":"2023-07-25T14:37:59.352835+0000","last_became_active":"2023-07-25T14:37:44.172127+0000","last_became_peered":"2023-07-25T14:37:44.172127+0000","last_unstale":"2023-07-25T14:37:59.352835+0000","last_undegraded":"2023-07-25T14:37:59.352835+0000","last_fullsized":"2023-07-25T14:37:59.352835+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T23:04:37.348348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":242,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.353735+0000","last_change":"2023-07-25T14:35:34.372381+0000","last_active":"2023-07-25T14:37:59.353735+0000","last_peered":"2023-07-25T14:37:59.353735+0000","last_clean":"2023-07-25T14:37:59.353735+0000","last_became_active":"2023-07-25T14:35:34.371110+0000","last_became_peered":"2023-07-25T14:35:34.371110+0000","last_unstale":"2023-07-25T14:37:59.353735+0000","last_undegraded":"2023-07-25T14:37:59.353735+0000","last_fullsized":"2023-07-25T14:37:59.353735+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_clean_scrub_stamp":"2023-07-25T14:35:33.358525+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T23:46:41.355823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":90,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.355212+0000","last_change":"2023-07-25T14:35:34.370121+0000","last_active":"2023-07-25T14:37:59.355212+0000","last_peered":"2023-07-25T14:37:59.355212+0000","last_clean":"2023-07-25T14:37:59.355212+0000","last_became_active":"2023-07-25T14:35:34.369795+0000","last_became_peered":"2023-07-25T14:35:34.369795+0000","last_unstale":"2023-07-25T14:37:59.355212+0000","last_undegraded":"2023-07-25T14:37:59.355212+0000","last_fullsized":"2023-07-25T14:37:59.355212+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_clean_scrub_stamp":"2023-07-25T14:35:33.358525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T23:47:21.332532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.254963+0000","last_change":"2023-07-25T14:37:58.252372+0000","last_active":"2023-07-25T14:37:59.254963+0000","last_peered":"2023-07-25T14:37:59.254963+0000","last_clean":"2023-07-25T14:37:59.254963+0000","last_became_active":"2023-07-25T14:37:58.252088+0000","last_became_peered":"2023-07-25T14:37:58.252088+0000","last_unstale":"2023-07-25T14:37:59.254963+0000","last_undegraded":"2023-07-25T14:37:59.254963+0000","last_fullsized":"2023-07-25T14:37:59.254963+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:00:12.125505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.254923+0000","last_change":"2023-07-25T14:37:57.252650+0000","last_active":"2023-07-25T14:37:59.254923+0000","last_peered":"2023-07-25T14:37:59.254923+0000","last_clean":"2023-07-25T14:37:59.254923+0000","last_became_active":"2023-07-25T14:37:57.252334+0000","last_became_peered":"2023-07-25T14:37:57.252334+0000","last_unstale":"2023-07-25T14:37:59.254923+0000","last_undegraded":"2023-07-25T14:37:59.254923+0000","last_fullsized":"2023-07-25T14:37:59.254923+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_clean_scrub_stamp":"2023-07-25T14:37:56.225499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T22:08:17.759332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.254874+0000","last_change":"2023-07-25T14:37:45.204523+0000","last_active":"2023-07-25T14:37:59.254874+0000","last_peered":"2023-07-25T14:37:59.254874+0000","last_clean":"2023-07-25T14:37:59.254874+0000","last_became_active":"2023-07-25T14:37:45.204095+0000","last_became_peered":"2023-07-25T14:37:45.204095+0000","last_unstale":"2023-07-25T14:37:59.254874+0000","last_undegraded":"2023-07-25T14:37:59.254874+0000","last_fullsized":"2023-07-25T14:37:59.254874+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:29:50.162252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"56'1","reported_seq":22,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.355427+0000","last_change":"2023-07-25T14:37:44.164092+0000","last_active":"2023-07-25T14:37:59.355427+0000","last_peered":"2023-07-25T14:37:59.355427+0000","last_clean":"2023-07-25T14:37:59.355427+0000","last_became_active":"2023-07-25T14:37:44.163068+0000","last_became_peered":"2023-07-25T14:37:44.163068+0000","last_unstale":"2023-07-25T14:37:59.355427+0000","last_undegraded":"2023-07-25T14:37:59.355427+0000","last_fullsized":"2023-07-25T14:37:59.355427+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T14:50:52.133043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":92,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.354041+0000","last_change":"2023-07-25T14:35:34.371737+0000","last_active":"2023-07-25T14:37:59.354041+0000","last_peered":"2023-07-25T14:37:59.354041+0000","last_clean":"2023-07-25T14:37:59.354041+0000","last_became_active":"2023-07-25T14:35:34.371411+0000","last_became_peered":"2023-07-25T14:35:34.371411+0000","last_unstale":"2023-07-25T14:37:59.354041+0000","last_undegraded":"2023-07-25T14:37:59.354041+0000","last_fullsized":"2023-07-25T14:37:59.354041+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_clean_scrub_stamp":"2023-07-25T14:35:33.358525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T20:09:33.523945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.254942+0000","last_change":"2023-07-25T14:37:58.260030+0000","last_active":"2023-07-25T14:37:59.254942+0000","last_peered":"2023-07-25T14:37:59.254942+0000","last_clean":"2023-07-25T14:37:59.254942+0000","last_became_active":"2023-07-25T14:37:58.259717+0000","last_became_peered":"2023-07-25T14:37:58.259717+0000","last_unstale":"2023-07-25T14:37:59.254942+0000","last_undegraded":"2023-07-25T14:37:59.254942+0000","last_fullsized":"2023-07-25T14:37:59.254942+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T15:46:59.478258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.352433+0000","last_change":"2023-07-25T14:37:57.253988+0000","last_active":"2023-07-25T14:37:59.352433+0000","last_peered":"2023-07-25T14:37:59.352433+0000","last_clean":"2023-07-25T14:37:59.352433+0000","last_became_active":"2023-07-25T14:37:57.253709+0000","last_became_peered":"2023-07-25T14:37:57.253709+0000","last_unstale":"2023-07-25T14:37:59.352433+0000","last_undegraded":"2023-07-25T14:37:59.352433+0000","last_fullsized":"2023-07-25T14:37:59.352433+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_clean_scrub_stamp":"2023-07-25T14:37:56.225499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T22:19:56.568758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.355003+0000","last_change":"2023-07-25T14:37:45.204043+0000","last_active":"2023-07-25T14:37:59.355003+0000","last_peered":"2023-07-25T14:37:59.355003+0000","last_clean":"2023-07-25T14:37:59.355003+0000","last_became_active":"2023-07-25T14:37:45.203102+0000","last_became_peered":"2023-07-25T14:37:45.203102+0000","last_unstale":"2023-07-25T14:37:59.355003+0000","last_undegraded":"2023-07-25T14:37:59.355003+0000","last_fullsized":"2023-07-25T14:37:59.355003+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T23:19:21.506088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"56'2","reported_seq":23,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.255012+0000","last_change":"2023-07-25T14:37:44.167732+0000","last_active":"2023-07-25T14:37:59.255012+0000","last_peered":"2023-07-25T14:37:59.255012+0000","last_clean":"2023-07-25T14:37:59.255012+0000","last_became_active":"2023-07-25T14:37:44.167418+0000","last_became_peered":"2023-07-25T14:37:44.167418+0000","last_unstale":"2023-07-25T14:37:59.255012+0000","last_undegraded":"2023-07-25T14:37:59.255012+0000","last_fullsized":"2023-07-25T14:37:59.255012+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T16:41:14.128972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":98,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.254088+0000","last_change":"2023-07-25T14:35:34.371347+0000","last_active":"2023-07-25T14:37:59.254088+0000","last_peered":"2023-07-25T14:37:59.254088+0000","last_clean":"2023-07-25T14:37:59.254088+0000","last_became_active":"2023-07-25T14:35:34.371044+0000","last_became_peered":"2023-07-25T14:35:34.371044+0000","last_unstale":"2023-07-25T14:37:59.254088+0000","last_undegraded":"2023-07-25T14:37:59.254088+0000","last_fullsized":"2023-07-25T14:37:59.254088+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_clean_scrub_stamp":"2023-07-25T14:35:33.358525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T23:17:10.719479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":3869,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64510,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574882,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":815104,"data_stored":949163,"data_compressed":32255,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jul 25 14:37:40 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.46999999999999997,"15min":0.46200000000000002},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.84299999999999997,"15min":0.90200000000000002},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.70699999999999996,"5min":9.1600000000000001,"15min":9.1600000000000001},"last":0.63100000000000001}]},{"osd":1,"last update":"Tue Jul 25 14:37:40 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.59299999999999997,"15min":0.60699999999999998},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.82699999999999996,"5min":1.5009999999999999,"15min":1.5009999999999999},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.61099999999999999,"15min":0.61799999999999999},"min":{"1min":0.45600000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.81100000000000005,"5min":1.526,"15min":1.526},"last":0.67600000000000005}]},{"osd":2,"last update":"Tue Jul 25 14:37:40 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.54500000000000004,"15min":0.55400000000000005},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.71599999999999997,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.82899999999999996,"15min":0.873},"min":{"1min":0.38300000000000001,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.95399999999999996,"5min":8.1739999999999995,"15min":8.1739999999999995},"last":0.65800000000000003}]},{"osd":3,"last update":"Tue Jul 25 14:37:40 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.82499999999999996,"15min":0.875},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.81599999999999995,"5min":7.2279999999999998,"15min":7.2279999999999998},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.89600000000000002,"15min":0.93999999999999995},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.0029999999999999,"5min":7.1870000000000003,"15min":7.1870000000000003},"last":0.70499999999999996}]},{"osd":4,"last update":"Tue Jul 25 14:37:40 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.57999999999999996,"15min":0.57799999999999996},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.76600000000000001,"5min":1.254,"15min":1.254},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.59299999999999997,"15min":0.59599999999999997},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.877,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.48199999999999998}]},{"osd":5,"last update":"Tue Jul 25 14:37:40 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.441},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.52600000000000002,"5min":0.501,"15min":0.501},"max":{"1min":0.84699999999999998,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.52900000000000003}]},{"osd":6,"last update":"Tue Jul 25 14:37:40 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.45800000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.88,"5min":1.286,"15min":1.286},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.64500000000000002,"15min":0.64400000000000002},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.59199999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574881,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27764,"kb_used_data":740,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344076,"statfs":{"total":96636764160,"available":96608333824,"internally_reserved":0,"allocated":757760,"data_stored":358895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jul 25 14:37:35 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.54200000000000004,"15min":0.54800000000000004},"min":{"1min":0.32300000000000001,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.73199999999999998,"5min":1.9370000000000001,"15min":1.9370000000000001},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.56000000000000005,"15min":0.56599999999999995},"min":{"1min":0.39700000000000002,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.77200000000000002,"5min":2.6779999999999999,"15min":2.6779999999999999},"last":0.41399999999999998}]},{"osd":1,"last update":"Tue Jul 25 14:37:35 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.53500000000000003,"15min":0.54100000000000004},"min":{"1min":0.34599999999999997,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.70799999999999996,"5min":2.5720000000000001,"15min":2.5720000000000001},"last":0.505},{"interface":"front","average":{"1min":0.503,"5min":0.54500000000000004,"15min":0.55200000000000005},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.64800000000000002,"5min":1.6259999999999999,"15min":1.6259999999999999},"last":0.437}]},{"osd":2,"last update":"Tue Jul 25 14:37:35 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.52700000000000002,"15min":0.52100000000000002},"min":{"1min":0.34399999999999997,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.79000000000000004,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.50600000000000001,"15min":0.501},"min":{"1min":0.375,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.68799999999999994,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.39700000000000002}]},{"osd":3,"last update":"Tue Jul 25 14:37:35 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.64900000000000002,"15min":0.66300000000000003},"min":{"1min":0.38600000000000001,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.73499999999999999,"5min":3.5750000000000002,"15min":3.5750000000000002},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.69899999999999995,"15min":0.71699999999999997},"min":{"1min":0.36499999999999999,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.77400000000000002,"5min":4.7190000000000003,"15min":4.7190000000000003},"last":0.60299999999999998}]},{"osd":4,"last update":"Tue Jul 25 14:37:35 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.65700000000000003,"15min":0.67200000000000004},"min":{"1min":0.39100000000000001,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.79700000000000004,"5min":4.694,"15min":4.694},"last":0.37},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.622,"15min":0.628},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.74099999999999999,"5min":2.7839999999999998,"15min":2.7839999999999998},"last":0.46200000000000002}]},{"osd":5,"last update":"Tue Jul 25 14:37:35 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.54500000000000004,"15min":0.54100000000000004},"min":{"1min":0.36199999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.752,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.624,"15min":0.627},"min":{"1min":0.376,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.82499999999999996,"5min":1.7310000000000001,"15min":1.7310000000000001},"last":0.56999999999999995}]},{"osd":7,"last update":"Tue Jul 25 14:37:35 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.68799999999999994,"15min":0.69799999999999995},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.81299999999999994,"5min":2.7290000000000001,"15min":2.7290000000000001},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.58999999999999997,"15min":0.58199999999999996},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.53600000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574881,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27844,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343996,"statfs":{"total":96636764160,"available":96608251904,"internally_reserved":0,"allocated":835584,"data_stored":952358,"data_compressed":32255,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jul 25 14:37:39 2023","interfaces":[{"interface":"back","average":{"1min":0.314,"5min":0.318,"15min":0.318},"min":{"1min":0.23999999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.44500000000000001,"5min":0.47099999999999997,"15min":0.47099999999999997},"last":0.22700000000000001},{"interface":"front","average":{"1min":0.312,"5min":0.32800000000000001,"15min":0.33000000000000002},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.44700000000000001,"5min":0.48899999999999999,"15min":0.48899999999999999},"last":0.32800000000000001}]},{"osd":2,"last update":"Tue Jul 25 14:37:39 2023","interfaces":[{"interface":"back","average":{"1min":0.29799999999999999,"5min":0.30599999999999999,"15min":0.308},"min":{"1min":0.20100000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.35399999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"min":{"1min":0.27200000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.45800000000000002,"5min":0.56499999999999995,"15min":0.56499999999999995},"last":0.28299999999999997}]},{"osd":3,"last update":"Tue Jul 25 14:37:39 2023","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.371,"15min":0.373},"min":{"1min":0.29699999999999999,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.432,"5min":0.52900000000000003,"15min":0.52900000000000003},"last":0.311},{"interface":"front","average":{"1min":0.33000000000000002,"5min":0.34499999999999997,"15min":0.34699999999999998},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.46999999999999997,"5min":0.496,"15min":0.496},"last":0.36599999999999999}]},{"osd":4,"last update":"Tue Jul 25 14:37:39 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.55300000000000005,"15min":0.55100000000000005},"min":{"1min":0.44900000000000001,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.78400000000000003,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.55400000000000005,"15min":0.55800000000000005},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.65100000000000002,"5min":0.745,"15min":0.745},"last":0.57599999999999996}]},{"osd":5,"last update":"Tue Jul 25 14:37:39 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.56100000000000005,"15min":0.55900000000000005},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.754,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.56399999999999995,"15min":0.56499999999999995},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.67400000000000004}]},{"osd":6,"last update":"Tue Jul 25 14:37:39 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.58099999999999996,"15min":0.58199999999999996},"min":{"1min":0.46000000000000002,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.70399999999999996,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.56899999999999995,"15min":0.57099999999999995},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.56599999999999995}]},{"osd":7,"last update":"Tue Jul 25 14:37:39 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.47699999999999998,"5min":0.443,"15min":0.443},"max":{"1min":0.71799999999999997,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.59599999999999997,"15min":0.59499999999999997},"min":{"1min":0.48399999999999999,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.74199999999999999,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.66500000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574881,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27744,"kb_used_data":720,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344096,"statfs":{"total":96636764160,"available":96608354304,"internally_reserved":0,"allocated":737280,"data_stored":357082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Jul 25 14:37:36 2023","interfaces":[{"interface":"back","average":{"1min":0.29899999999999999,"5min":0.35099999999999998,"15min":0.35899999999999999},"min":{"1min":0.17199999999999999,"5min":0.17199999999999999,"15min":0.17199999999999999},"max":{"1min":0.39000000000000001,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.29899999999999999},{"interface":"front","average":{"1min":0.28899999999999998,"5min":0.58899999999999997,"15min":0.63900000000000001},"min":{"1min":0.19600000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.37,"5min":6.5369999999999999,"15min":6.5369999999999999},"last":0.22700000000000001}]},{"osd":2,"last update":"Tue Jul 25 14:37:36 2023","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":0.36399999999999999,"15min":0.37},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.47599999999999998,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.245},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.63,"15min":0.67600000000000005},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.439,"5min":6.5659999999999998,"15min":6.5659999999999998},"last":0.316}]},{"osd":3,"last update":"Tue Jul 25 14:37:36 2023","interfaces":[{"interface":"back","average":{"1min":0.33100000000000002,"5min":0.88700000000000001,"15min":0.97899999999999998},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.48799999999999999,"5min":12.449,"15min":12.449},"last":0.28899999999999998},{"interface":"front","average":{"1min":0.36199999999999999,"5min":0.40999999999999998,"15min":0.41799999999999998},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.45100000000000001,"5min":1.079,"15min":1.079},"last":0.33200000000000002}]},{"osd":4,"last update":"Tue Jul 25 14:37:36 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.79300000000000004,"15min":0.83199999999999996},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.71399999999999997,"5min":6.5099999999999998,"15min":6.5099999999999998},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.55600000000000005,"5min":1.0680000000000001,"15min":1.1539999999999999},"min":{"1min":0.35399999999999998,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.66100000000000003,"5min":12.35,"15min":12.35},"last":0.48899999999999999}]},{"osd":5,"last update":"Tue Jul 25 14:37:36 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.58699999999999997,"15min":0.58899999999999997},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.68100000000000005,"5min":1.107,"15min":1.107},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.82599999999999996,"15min":0.872},"min":{"1min":0.39000000000000001,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.76600000000000001,"5min":6.4349999999999996,"15min":6.4349999999999996},"last":0.38700000000000001}]},{"osd":6,"last update":"Tue Jul 25 14:37:36 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":1.0820000000000001,"15min":1.1679999999999999},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.74099999999999999,"5min":12.417,"15min":12.417},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.60799999999999998,"15min":0.61199999999999999},"min":{"1min":0.45000000000000001,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.68999999999999995,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.51400000000000001}]},{"osd":7,"last update":"Tue Jul 25 14:37:36 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.85799999999999998,"15min":0.90400000000000003},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.67200000000000004,"5min":6.4809999999999999,"15min":6.4809999999999999},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.57799999999999996,"5min":1.091,"15min":1.177},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.77500000000000002,"5min":12.388999999999999,"15min":12.388999999999999},"last":0.39900000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574881,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27756,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344084,"statfs":{"total":96636764160,"available":96608342016,"internally_reserved":0,"allocated":749568,"data_stored":360701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jul 25 14:37:34 2023","interfaces":[{"interface":"back","average":{"1min":0.311,"5min":0.38200000000000001,"15min":0.39400000000000002},"min":{"1min":0.20399999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.39000000000000001,"5min":2.1030000000000002,"15min":2.1030000000000002},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.27600000000000002,"5min":0.92800000000000005,"15min":1.0369999999999999},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":0.32900000000000001,"5min":16.969000000000001,"15min":16.969000000000001},"last":0.39100000000000001}]},{"osd":1,"last update":"Tue Jul 25 14:37:34 2023","interfaces":[{"interface":"back","average":{"1min":0.33400000000000002,"5min":0.35099999999999998,"15min":0.35399999999999998},"min":{"1min":0.26200000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.41899999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"last":0.25600000000000001},{"interface":"front","average":{"1min":0.34300000000000003,"5min":0.379,"15min":0.38500000000000001},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.50800000000000001,"5min":1.111,"15min":1.111},"last":0.32300000000000001}]},{"osd":3,"last update":"Tue Jul 25 14:37:34 2023","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.79700000000000004,"15min":0.876},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.36799999999999999,"5min":13.035,"15min":13.035},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.376,"5min":0.40300000000000002,"15min":0.40699999999999997},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.61599999999999999,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.40799999999999997}]},{"osd":4,"last update":"Tue Jul 25 14:37:34 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.754,"15min":0.79200000000000004},"min":{"1min":0.39100000000000001,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.73099999999999998,"5min":6.165,"15min":6.165},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.55900000000000005,"5min":1.0069999999999999,"15min":1.0820000000000001},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.74199999999999999,"5min":13.004,"15min":13.004},"last":0.64800000000000002}]},{"osd":5,"last update":"Tue Jul 25 14:37:34 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.57199999999999995,"15min":0.57299999999999995},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.75800000000000001,"15min":0.79500000000000004},"min":{"1min":0.41299999999999998,"5min":0.378,"15min":0.378},"max":{"1min":0.69499999999999995,"5min":6.226,"15min":6.226},"last":0.51700000000000002}]},{"osd":6,"last update":"Tue Jul 25 14:37:34 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":1.006,"15min":1.0840000000000001},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.77400000000000002,"5min":12.974,"15min":12.974},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.59499999999999997,"15min":0.59699999999999998},"min":{"1min":0.42599999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.77200000000000002,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.68600000000000005}]},{"osd":7,"last update":"Tue Jul 25 14:37:34 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.77900000000000003,"15min":0.81499999999999995},"min":{"1min":0.40899999999999997,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.70499999999999996,"5min":6.1989999999999998,"15min":6.1989999999999998},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.56699999999999995,"5min":1.026,"15min":1.1020000000000001},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.74199999999999999,"5min":12.936999999999999,"15min":12.936999999999999},"last":0.53300000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574881,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27760,"kb_used_data":736,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344080,"statfs":{"total":96636764160,"available":96608337920,"internally_reserved":0,"allocated":753664,"data_stored":358724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jul 25 14:37:36 2023","interfaces":[{"interface":"back","average":{"1min":0.29999999999999999,"5min":0.312,"15min":0.314},"min":{"1min":0.20300000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.32100000000000001,"5min":0.309,"15min":0.307},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.45400000000000001,"5min":0.46300000000000002,"15min":0.46300000000000002},"last":0.25800000000000001}]},{"osd":1,"last update":"Tue Jul 25 14:37:36 2023","interfaces":[{"interface":"back","average":{"1min":0.315,"5min":0.308,"15min":0.307},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"last":0.27700000000000002},{"interface":"front","average":{"1min":0.34200000000000003,"5min":0.36899999999999999,"15min":0.373},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.496,"5min":0.59099999999999997,"15min":0.59099999999999997},"last":0.30199999999999999}]},{"osd":2,"last update":"Tue Jul 25 14:37:36 2023","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":0.37,"15min":0.374},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.441,"5min":0.502,"15min":0.502},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.35899999999999999,"5min":0.39300000000000002,"15min":0.39900000000000002},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.47299999999999998,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.38200000000000001}]},{"osd":4,"last update":"Tue Jul 25 14:37:36 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.57199999999999995,"15min":0.57399999999999995},"min":{"1min":0.42399999999999999,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.77000000000000002,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.62},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58799999999999997,"15min":0.58899999999999997},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.69399999999999995}]},{"osd":5,"last update":"Tue Jul 25 14:37:36 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.70999999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.625,"15min":0.63100000000000001},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.88100000000000001,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.68200000000000005}]},{"osd":6,"last update":"Tue Jul 25 14:37:36 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.61499999999999999,"15min":0.625},"min":{"1min":0.46300000000000002,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.68799999999999994,"5min":0.871,"15min":0.871},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.59399999999999997,"15min":0.59599999999999997},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.70599999999999996}]},{"osd":7,"last update":"Tue Jul 25 14:37:36 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.59099999999999997,"15min":0.58899999999999997},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.83599999999999997,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.60699999999999998,"15min":0.60899999999999999},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.64400000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574881,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27748,"kb_used_data":724,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344092,"statfs":{"total":96636764160,"available":96608350208,"internally_reserved":0,"allocated":741376,"data_stored":358179,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jul 25 14:37:35 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.55500000000000005,"15min":0.56100000000000005},"min":{"1min":0.39600000000000002,"5min":0.31,"15min":0.31},"max":{"1min":0.75700000000000001,"5min":0.876,"15min":0.876},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.51100000000000001,"15min":0.51000000000000001},"min":{"1min":0.371,"5min":0.309,"15min":0.309},"max":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.48299999999999998}]},{"osd":1,"last update":"Tue Jul 25 14:37:35 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.69099999999999995,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.53600000000000003,"15min":0.53200000000000003},"min":{"1min":0.38900000000000001,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.70399999999999996,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.46300000000000002}]},{"osd":2,"last update":"Tue Jul 25 14:37:35 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.55500000000000005,"15min":0.54900000000000004},"min":{"1min":0.435,"5min":0.376,"15min":0.376},"max":{"1min":0.67600000000000005,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.54600000000000004,"15min":0.54200000000000004},"min":{"1min":0.41999999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.60999999999999999}]},{"osd":3,"last update":"Tue Jul 25 14:37:35 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.53600000000000003,"15min":0.53000000000000003},"min":{"1min":0.33000000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.73299999999999998,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.63,"15min":0.63800000000000001},"min":{"1min":0.47299999999999998,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.76100000000000001,"5min":1.8720000000000001,"15min":1.8720000000000001},"last":0.57699999999999996}]},{"osd":5,"last update":"Tue Jul 25 14:37:35 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.49099999999999999,"15min":0.47599999999999998},"min":{"1min":0.36399999999999999,"5min":0.317,"15min":0.317},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.61899999999999999,"15min":0.61599999999999999},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.748,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.58899999999999997}]},{"osd":6,"last update":"Tue Jul 25 14:37:35 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.54900000000000004,"15min":0.54100000000000004},"min":{"1min":0.41299999999999998,"5min":0.372,"15min":0.372},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.59899999999999998,"15min":0.60099999999999998},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.68999999999999995}]},{"osd":7,"last update":"Tue Jul 25 14:37:35 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.623,"15min":0.61899999999999999},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.79500000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.64600000000000002,"15min":0.64000000000000001},"min":{"1min":0.54900000000000004,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.63100000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574881,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27764,"kb_used_data":740,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344076,"statfs":{"total":96636764160,"available":96608333824,"internally_reserved":0,"allocated":757760,"data_stored":359785,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jul 25 14:37:32 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.59799999999999998,"15min":0.60599999999999998},"min":{"1min":0.35399999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.83399999999999996,"5min":2.548,"15min":2.548},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.55700000000000005,"15min":0.56000000000000005},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.76500000000000001,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.64100000000000001}]},{"osd":1,"last update":"Tue Jul 25 14:37:32 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.58099999999999996,"15min":0.58499999999999996},"min":{"1min":0.39900000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.753,"5min":1.657,"15min":1.657},"last":0.625},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.42599999999999999,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.79700000000000004,"5min":1.752,"15min":1.752},"last":0.58299999999999996}]},{"osd":2,"last update":"Tue Jul 25 14:37:32 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.56499999999999995,"15min":0.56699999999999995},"min":{"1min":0.38800000000000001,"5min":0.372,"15min":0.372},"max":{"1min":0.82899999999999996,"5min":0.872,"15min":0.872},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.54300000000000004,"15min":0.53400000000000003},"min":{"1min":0.46500000000000002,"5min":0.376,"15min":0.376},"max":{"1min":0.751,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.67400000000000004}]},{"osd":3,"last update":"Tue Jul 25 14:37:32 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.56399999999999995,"15min":0.55800000000000005},"min":{"1min":0.39900000000000002,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.60899999999999999,"15min":0.60499999999999998},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.68999999999999995}]},{"osd":4,"last update":"Tue Jul 25 14:37:32 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.52900000000000003,"15min":0.52700000000000002},"min":{"1min":0.38900000000000001,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.56100000000000005,"15min":0.55900000000000005},"min":{"1min":0.35499999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.41199999999999998}]},{"osd":6,"last update":"Tue Jul 25 14:37:32 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.56299999999999994,"15min":0.55400000000000005},"min":{"1min":0.42499999999999999,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.57099999999999995,"15min":0.56799999999999995},"min":{"1min":0.35999999999999999,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.52500000000000002}]},{"osd":7,"last update":"Tue Jul 25 14:37:32 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.58799999999999997,"15min":0.58199999999999996},"min":{"1min":0.41899999999999998,"5min":0.375,"15min":0.375},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.496},{"interface":"front","average":{"1min":0.627,"5min":0.64400000000000002,"15min":0.64700000000000002},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.81399999999999995,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.56100000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32255,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32255,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3071,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-25T14:38:06.976 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-25T14:38:07.109 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.099+0000 7f38a0ad7700 1 Processor -- start 2023-07-25T14:38:07.110 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.099+0000 7f38a0ad7700 1 -- start start 2023-07-25T14:38:07.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.100+0000 7f38a0ad7700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f389c14e610 0x7f389c150f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:38:07.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.100+0000 7f38a0ad7700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f389c0bc090 0x7f389c0ab770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:38:07.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.100+0000 7f38a0ad7700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f389c06c9b0 con 0x7f389c066160 2023-07-25T14:38:07.111 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.100+0000 7f38a0ad7700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f389c14e9f0 con 0x7f389c14e610 2023-07-25T14:38:07.112 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.100+0000 7f38a0ad7700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f389c0bc4a0 con 0x7f389c0bc090 2023-07-25T14:38:07.112 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.100+0000 7f389a59c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f389c14e610 0x7f389c150f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:38:07.112 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.100+0000 7f389a59c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f389c14e610 0x7f389c150f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:44236/0 (socket says 172.21.15.72:44236) 2023-07-25T14:38:07.112 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.100+0000 7f389a59c700 1 -- 172.21.15.72:0/2617199733 learned_addr learned my addr 172.21.15.72:0/2617199733 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:38:07.112 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.100+0000 7f389a59c700 1 -- 172.21.15.72:0/2617199733 >> v2:172.21.15.92:3300/0 conn(0x7f389c0bc090 msgr2=0x7f389c0ab770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:38:07.112 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.100+0000 7f389ad9d700 1 --2- 172.21.15.72:0/2617199733 >> v2:172.21.15.92:3300/0 conn(0x7f389c0bc090 0x7f389c0ab770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:38:07.112 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.100+0000 7f389a59c700 1 --2- 172.21.15.72:0/2617199733 >> v2:172.21.15.92:3300/0 conn(0x7f389c0bc090 0x7f389c0ab770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:38:07.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.100+0000 7f389a59c700 1 -- 172.21.15.72:0/2617199733 >> v1:172.21.15.92:6789/0 conn(0x7f389c066160 legacy=0x7f389c06ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:38:07.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.100+0000 7f389a59c700 1 -- 172.21.15.72:0/2617199733 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f389c06d970 con 0x7f389c14e610 2023-07-25T14:38:07.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.100+0000 7f389a59c700 1 --2- 172.21.15.72:0/2617199733 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f389c14e610 0x7f389c150f80 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f389c0c03b0 tx=0x7f388c00be70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ceb8320002eff38 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:38:07.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.100+0000 7f389959a700 1 -- 172.21.15.72:0/2617199733 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f388c00dcf0 con 0x7f389c14e610 2023-07-25T14:38:07.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.100+0000 7f389959a700 1 -- 172.21.15.72:0/2617199733 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f388c00de50 con 0x7f389c14e610 2023-07-25T14:38:07.113 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.100+0000 7f389959a700 1 -- 172.21.15.72:0/2617199733 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f388c004250 con 0x7f389c14e610 2023-07-25T14:38:07.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.101+0000 7f38a0ad7700 1 -- 172.21.15.72:0/2617199733 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f389c14e610 msgr2=0x7f389c150f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:38:07.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.101+0000 7f38a0ad7700 1 --2- 172.21.15.72:0/2617199733 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f389c14e610 0x7f389c150f80 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f389c0c03b0 tx=0x7f388c00be70 comp rx=0 tx=0).stop 2023-07-25T14:38:07.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.101+0000 7f38a0ad7700 1 -- 172.21.15.72:0/2617199733 shutdown_connections 2023-07-25T14:38:07.115 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.101+0000 7f38a0ad7700 1 --2- 172.21.15.72:0/2617199733 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f389c14e610 0x7f389c150f80 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:38:07.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.101+0000 7f38a0ad7700 1 --2- 172.21.15.72:0/2617199733 >> v2:172.21.15.92:3300/0 conn(0x7f389c0bc090 0x7f389c0ab770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:38:07.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.101+0000 7f38a0ad7700 1 -- 172.21.15.72:0/2617199733 >> 172.21.15.72:0/2617199733 conn(0x7f389c071bf0 msgr2=0x7f389c06a190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:38:07.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.101+0000 7f38a0ad7700 1 -- 172.21.15.72:0/2617199733 shutdown_connections 2023-07-25T14:38:07.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.101+0000 7f38a0ad7700 1 -- 172.21.15.72:0/2617199733 wait complete. 2023-07-25T14:38:07.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.102+0000 7f38a0ad7700 1 Processor -- start 2023-07-25T14:38:07.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.102+0000 7f38a0ad7700 1 -- start start 2023-07-25T14:38:07.116 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.103+0000 7f38a0ad7700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f389c066160 0x7f389c0be080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:38:07.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.103+0000 7f38a0ad7700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f389c0bc090 0x7f389c150160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:38:07.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.103+0000 7f38a0ad7700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f389c14e610 0x7f389c1e8d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:38:07.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.103+0000 7f38a0ad7700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f389c0be5c0 con 0x7f389c0bc090 2023-07-25T14:38:07.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.103+0000 7f38a0ad7700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f389c14f7b0 con 0x7f389c14e610 2023-07-25T14:38:07.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.103+0000 7f38a0ad7700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f389c1e9a30 con 0x7f389c066160 2023-07-25T14:38:07.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.103+0000 7f3899d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f389c0bc090 0x7f389c150160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:38:07.117 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.103+0000 7f3899d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f389c0bc090 0x7f389c150160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:44244/0 (socket says 172.21.15.72:44244) 2023-07-25T14:38:07.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.103+0000 7f3899d9b700 1 -- 172.21.15.72:0/2249565520 learned_addr learned my addr 172.21.15.72:0/2249565520 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:38:07.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.103+0000 7f389a59c700 1 --2- 172.21.15.72:0/2249565520 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f389c066160 0x7f389c0be080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:38:07.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.103+0000 7f389ad9d700 1 --2- 172.21.15.72:0/2249565520 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f389c14e610 0x7f389c1e8d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:38:07.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.104+0000 7f3899d9b700 1 -- 172.21.15.72:0/2249565520 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f389c066160 msgr2=0x7f389c0be080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:38:07.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.104+0000 7f3899d9b700 1 --2- 172.21.15.72:0/2249565520 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f389c066160 0x7f389c0be080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:38:07.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.104+0000 7f3899d9b700 1 -- 172.21.15.72:0/2249565520 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f389c14e610 msgr2=0x7f389c1e8d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:38:07.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.104+0000 7f3899d9b700 1 --2- 172.21.15.72:0/2249565520 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f389c14e610 0x7f389c1e8d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:38:07.118 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.104+0000 7f3899d9b700 1 -- 172.21.15.72:0/2249565520 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f388c00b7f0 con 0x7f389c0bc090 2023-07-25T14:38:07.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.104+0000 7f3899d9b700 1 --2- 172.21.15.72:0/2249565520 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f389c0bc090 0x7f389c150160 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f389000b4d0 tx=0x7f389000b7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:38:07.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.104+0000 7f388affd700 1 -- 172.21.15.72:0/2249565520 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f389000bea0 con 0x7f389c0bc090 2023-07-25T14:38:07.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.104+0000 7f388affd700 1 -- 172.21.15.72:0/2249565520 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3890011830 con 0x7f389c0bc090 2023-07-25T14:38:07.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.104+0000 7f38a0ad7700 1 -- 172.21.15.72:0/2249565520 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f389c14fcd0 con 0x7f389c0bc090 2023-07-25T14:38:07.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.104+0000 7f388affd700 1 -- 172.21.15.72:0/2249565520 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3890011be0 con 0x7f389c0bc090 2023-07-25T14:38:07.119 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.104+0000 7f38a0ad7700 1 -- 172.21.15.72:0/2249565520 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f389c14f9a0 con 0x7f389c0bc090 2023-07-25T14:38:07.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.105+0000 7f38a0ad7700 1 -- 172.21.15.72:0/2249565520 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f389c14fe60 con 0x7f389c0bc090 2023-07-25T14:38:07.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.105+0000 7f388affd700 1 -- 172.21.15.72:0/2249565520 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3890011d40 con 0x7f389c0bc090 2023-07-25T14:38:07.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.106+0000 7f388affd700 1 --2- 172.21.15.72:0/2249565520 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f387c06ace0 0x7f387c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:38:07.120 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.106+0000 7f388affd700 1 -- 172.21.15.72:0/2249565520 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 7238+0+0 (secure 0 0 0) 0x7f3890089420 con 0x7f389c0bc090 2023-07-25T14:38:07.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.106+0000 7f389a59c700 1 --2- 172.21.15.72:0/2249565520 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f387c06ace0 0x7f387c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:38:07.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.106+0000 7f389a59c700 1 --2- 172.21.15.72:0/2249565520 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f387c06ace0 0x7f387c06d1a0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f388c00b340 tx=0x7f388c01d040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:38:07.121 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.110+0000 7f388affd700 1 -- 172.21.15.72:0/2249565520 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f38900540c0 con 0x7f389c0bc090 2023-07-25T14:38:07.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.294+0000 7f38a0ad7700 1 -- 172.21.15.72:0/2249565520 --> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f389c06df30 con 0x7f387c06ace0 2023-07-25T14:38:07.318 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.308+0000 7f388affd700 1 -- 172.21.15.72:0/2249565520 <== mgr.4104 v2:172.21.15.72:6832/1171220306 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+550319 (secure 0 0 0) 0x7f388c021040 con 0x7f387c06ace0 2023-07-25T14:38:07.324 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-25T14:38:07.327 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.312+0000 7f38a0ad7700 1 -- 172.21.15.72:0/2249565520 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f387c06ace0 msgr2=0x7f387c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:38:07.327 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.312+0000 7f38a0ad7700 1 --2- 172.21.15.72:0/2249565520 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f387c06ace0 0x7f387c06d1a0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f388c00b340 tx=0x7f388c01d040 comp rx=0 tx=0).stop 2023-07-25T14:38:07.327 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.312+0000 7f38a0ad7700 1 -- 172.21.15.72:0/2249565520 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f389c0bc090 msgr2=0x7f389c150160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:38:07.328 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.312+0000 7f38a0ad7700 1 --2- 172.21.15.72:0/2249565520 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f389c0bc090 0x7f389c150160 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f389000b4d0 tx=0x7f389000b7e0 comp rx=0 tx=0).stop 2023-07-25T14:38:07.328 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.312+0000 7f38a0ad7700 1 -- 172.21.15.72:0/2249565520 shutdown_connections 2023-07-25T14:38:07.328 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.312+0000 7f38a0ad7700 1 --2- 172.21.15.72:0/2249565520 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f387c06ace0 0x7f387c06d1a0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:38:07.328 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.312+0000 7f38a0ad7700 1 --2- 172.21.15.72:0/2249565520 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f389c066160 0x7f389c0be080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:38:07.328 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.312+0000 7f38a0ad7700 1 --2- 172.21.15.72:0/2249565520 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f389c14e610 0x7f389c1e8d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:38:07.328 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.312+0000 7f38a0ad7700 1 --2- 172.21.15.72:0/2249565520 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f389c0bc090 0x7f389c150160 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:38:07.328 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.312+0000 7f38a0ad7700 1 -- 172.21.15.72:0/2249565520 >> 172.21.15.72:0/2249565520 conn(0x7f389c071bf0 msgr2=0x7f389c0c0800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:38:07.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.313+0000 7f38a0ad7700 1 -- 172.21.15.72:0/2249565520 shutdown_connections 2023-07-25T14:38:07.329 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.313+0000 7f38a0ad7700 1 -- 172.21.15.72:0/2249565520 wait complete. 2023-07-25T14:38:07.329 INFO:teuthology.orchestra.run.smithi072.stderr:dumped all 2023-07-25T14:38:07.335 INFO:teuthology.orchestra.run.smithi072.stdout:{"pg_ready":true,"pg_map":{"version":131,"stamp":"2023-07-25T14:38:05.315438+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596599,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":250,"num_write_kb":2447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":402,"acting":402,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":357,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":222204,"kb_used_data":6004,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754752516,"statfs":{"total":773094113280,"available":772866576384,"internally_reserved":0,"allocated":6148096,"data_stored":4054887,"data_compressed":64510,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":38,"apply_latency_ms":38,"commit_latency_ns":38000000,"apply_latency_ns":38000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001927"},"pg_stats":[{"pgid":"13.39","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.254839+0000","last_change":"2023-07-25T14:37:58.267397+0000","last_active":"2023-07-25T14:37:59.254839+0000","last_peered":"2023-07-25T14:37:59.254839+0000","last_clean":"2023-07-25T14:37:59.254839+0000","last_became_active":"2023-07-25T14:37:58.267134+0000","last_became_peered":"2023-07-25T14:37:58.267134+0000","last_unstale":"2023-07-25T14:37:59.254839+0000","last_undegraded":"2023-07-25T14:37:59.254839+0000","last_fullsized":"2023-07-25T14:37:59.254839+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T22:52:49.177607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3f","version":"0'0","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.355249+0000","last_change":"2023-07-25T14:37:45.195851+0000","last_active":"2023-07-25T14:37:59.355249+0000","last_peered":"2023-07-25T14:37:59.355249+0000","last_clean":"2023-07-25T14:37:59.355249+0000","last_became_active":"2023-07-25T14:37:45.195549+0000","last_became_peered":"2023-07-25T14:37:45.195549+0000","last_unstale":"2023-07-25T14:37:59.355249+0000","last_undegraded":"2023-07-25T14:37:59.355249+0000","last_fullsized":"2023-07-25T14:37:59.355249+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T18:09:47.450177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.254794+0000","last_change":"2023-07-25T14:37:58.265618+0000","last_active":"2023-07-25T14:37:59.254794+0000","last_peered":"2023-07-25T14:37:59.254794+0000","last_clean":"2023-07-25T14:37:59.254794+0000","last_became_active":"2023-07-25T14:37:58.265298+0000","last_became_peered":"2023-07-25T14:37:58.265298+0000","last_unstale":"2023-07-25T14:37:59.254794+0000","last_undegraded":"2023-07-25T14:37:59.254794+0000","last_fullsized":"2023-07-25T14:37:59.254794+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T23:04:07.473888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.354992+0000","last_change":"2023-07-25T14:37:45.209998+0000","last_active":"2023-07-25T14:37:59.354992+0000","last_peered":"2023-07-25T14:37:59.354992+0000","last_clean":"2023-07-25T14:37:59.354992+0000","last_became_active":"2023-07-25T14:37:45.209538+0000","last_became_peered":"2023-07-25T14:37:45.209538+0000","last_unstale":"2023-07-25T14:37:59.354992+0000","last_undegraded":"2023-07-25T14:37:59.354992+0000","last_fullsized":"2023-07-25T14:37:59.354992+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T19:07:32.745444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.254696+0000","last_change":"2023-07-25T14:37:58.272833+0000","last_active":"2023-07-25T14:37:59.254696+0000","last_peered":"2023-07-25T14:37:59.254696+0000","last_clean":"2023-07-25T14:37:59.254696+0000","last_became_active":"2023-07-25T14:37:58.272524+0000","last_became_peered":"2023-07-25T14:37:58.272524+0000","last_unstale":"2023-07-25T14:37:59.254696+0000","last_undegraded":"2023-07-25T14:37:59.254696+0000","last_fullsized":"2023-07-25T14:37:59.254696+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T20:11:57.396339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.352738+0000","last_change":"2023-07-25T14:37:45.186668+0000","last_active":"2023-07-25T14:37:59.352738+0000","last_peered":"2023-07-25T14:37:59.352738+0000","last_clean":"2023-07-25T14:37:59.352738+0000","last_became_active":"2023-07-25T14:37:45.186396+0000","last_became_peered":"2023-07-25T14:37:45.186396+0000","last_unstale":"2023-07-25T14:37:59.352738+0000","last_undegraded":"2023-07-25T14:37:59.352738+0000","last_fullsized":"2023-07-25T14:37:59.352738+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T20:15:25.491350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.255352+0000","last_change":"2023-07-25T14:37:58.252740+0000","last_active":"2023-07-25T14:37:59.255352+0000","last_peered":"2023-07-25T14:37:59.255352+0000","last_clean":"2023-07-25T14:37:59.255352+0000","last_became_active":"2023-07-25T14:37:58.252422+0000","last_became_peered":"2023-07-25T14:37:58.252422+0000","last_unstale":"2023-07-25T14:37:59.255352+0000","last_undegraded":"2023-07-25T14:37:59.255352+0000","last_fullsized":"2023-07-25T14:37:59.255352+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T18:48:11.765057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.355194+0000","last_change":"2023-07-25T14:37:45.197894+0000","last_active":"2023-07-25T14:37:59.355194+0000","last_peered":"2023-07-25T14:37:59.355194+0000","last_clean":"2023-07-25T14:37:59.355194+0000","last_became_active":"2023-07-25T14:37:45.197369+0000","last_became_peered":"2023-07-25T14:37:45.197369+0000","last_unstale":"2023-07-25T14:37:59.355194+0000","last_undegraded":"2023-07-25T14:37:59.355194+0000","last_fullsized":"2023-07-25T14:37:59.355194+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T02:03:12.978515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.354578+0000","last_change":"2023-07-25T14:37:58.264663+0000","last_active":"2023-07-25T14:37:59.354578+0000","last_peered":"2023-07-25T14:37:59.354578+0000","last_clean":"2023-07-25T14:37:59.354578+0000","last_became_active":"2023-07-25T14:37:58.264407+0000","last_became_peered":"2023-07-25T14:37:58.264407+0000","last_unstale":"2023-07-25T14:37:59.354578+0000","last_undegraded":"2023-07-25T14:37:59.354578+0000","last_fullsized":"2023-07-25T14:37:59.354578+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T21:50:12.129185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.255151+0000","last_change":"2023-07-25T14:37:45.204817+0000","last_active":"2023-07-25T14:37:59.255151+0000","last_peered":"2023-07-25T14:37:59.255151+0000","last_clean":"2023-07-25T14:37:59.255151+0000","last_became_active":"2023-07-25T14:37:45.204540+0000","last_became_peered":"2023-07-25T14:37:45.204540+0000","last_unstale":"2023-07-25T14:37:59.255151+0000","last_undegraded":"2023-07-25T14:37:59.255151+0000","last_fullsized":"2023-07-25T14:37:59.255151+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T18:31:18.914728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.255061+0000","last_change":"2023-07-25T14:37:58.273141+0000","last_active":"2023-07-25T14:37:59.255061+0000","last_peered":"2023-07-25T14:37:59.255061+0000","last_clean":"2023-07-25T14:37:59.255061+0000","last_became_active":"2023-07-25T14:37:58.272881+0000","last_became_peered":"2023-07-25T14:37:58.272881+0000","last_unstale":"2023-07-25T14:37:59.255061+0000","last_undegraded":"2023-07-25T14:37:59.255061+0000","last_fullsized":"2023-07-25T14:37:59.255061+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T20:49:27.945811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.353873+0000","last_change":"2023-07-25T14:37:45.212379+0000","last_active":"2023-07-25T14:37:59.353873+0000","last_peered":"2023-07-25T14:37:59.353873+0000","last_clean":"2023-07-25T14:37:59.353873+0000","last_became_active":"2023-07-25T14:37:45.210115+0000","last_became_peered":"2023-07-25T14:37:45.210115+0000","last_unstale":"2023-07-25T14:37:59.353873+0000","last_undegraded":"2023-07-25T14:37:59.353873+0000","last_fullsized":"2023-07-25T14:37:59.353873+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T17:04:57.323478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3f","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.354667+0000","last_change":"2023-07-25T14:37:58.264269+0000","last_active":"2023-07-25T14:37:59.354667+0000","last_peered":"2023-07-25T14:37:59.354667+0000","last_clean":"2023-07-25T14:37:59.354667+0000","last_became_active":"2023-07-25T14:37:58.263597+0000","last_became_peered":"2023-07-25T14:37:58.263597+0000","last_unstale":"2023-07-25T14:37:59.354667+0000","last_undegraded":"2023-07-25T14:37:59.354667+0000","last_fullsized":"2023-07-25T14:37:59.354667+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T19:33:59.441524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.255599+0000","last_change":"2023-07-25T14:37:45.197514+0000","last_active":"2023-07-25T14:37:59.255599+0000","last_peered":"2023-07-25T14:37:59.255599+0000","last_clean":"2023-07-25T14:37:59.255599+0000","last_became_active":"2023-07-25T14:37:45.197076+0000","last_became_peered":"2023-07-25T14:37:45.197076+0000","last_unstale":"2023-07-25T14:37:59.255599+0000","last_undegraded":"2023-07-25T14:37:59.255599+0000","last_fullsized":"2023-07-25T14:37:59.255599+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T16:59:27.610742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.355508+0000","last_change":"2023-07-25T14:37:58.273492+0000","last_active":"2023-07-25T14:37:59.355508+0000","last_peered":"2023-07-25T14:37:59.355508+0000","last_clean":"2023-07-25T14:37:59.355508+0000","last_became_active":"2023-07-25T14:37:58.272529+0000","last_became_peered":"2023-07-25T14:37:58.272529+0000","last_unstale":"2023-07-25T14:37:59.355508+0000","last_undegraded":"2023-07-25T14:37:59.355508+0000","last_fullsized":"2023-07-25T14:37:59.355508+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T21:27:29.333418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.353344+0000","last_change":"2023-07-25T14:37:45.199774+0000","last_active":"2023-07-25T14:37:59.353344+0000","last_peered":"2023-07-25T14:37:59.353344+0000","last_clean":"2023-07-25T14:37:59.353344+0000","last_became_active":"2023-07-25T14:37:45.199408+0000","last_became_peered":"2023-07-25T14:37:45.199408+0000","last_unstale":"2023-07-25T14:37:59.353344+0000","last_undegraded":"2023-07-25T14:37:59.353344+0000","last_fullsized":"2023-07-25T14:37:59.353344+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T20:41:03.818352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.352936+0000","last_change":"2023-07-25T14:37:58.261043+0000","last_active":"2023-07-25T14:37:59.352936+0000","last_peered":"2023-07-25T14:37:59.352936+0000","last_clean":"2023-07-25T14:37:59.352936+0000","last_became_active":"2023-07-25T14:37:58.260777+0000","last_became_peered":"2023-07-25T14:37:58.260777+0000","last_unstale":"2023-07-25T14:37:59.352936+0000","last_undegraded":"2023-07-25T14:37:59.352936+0000","last_fullsized":"2023-07-25T14:37:59.352936+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:22:35.512164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.255837+0000","last_change":"2023-07-25T14:37:45.196344+0000","last_active":"2023-07-25T14:37:59.255837+0000","last_peered":"2023-07-25T14:37:59.255837+0000","last_clean":"2023-07-25T14:37:59.255837+0000","last_became_active":"2023-07-25T14:37:45.196000+0000","last_became_peered":"2023-07-25T14:37:45.196000+0000","last_unstale":"2023-07-25T14:37:59.255837+0000","last_undegraded":"2023-07-25T14:37:59.255837+0000","last_fullsized":"2023-07-25T14:37:59.255837+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T21:28:34.013756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.253261+0000","last_change":"2023-07-25T14:37:58.256573+0000","last_active":"2023-07-25T14:37:59.253261+0000","last_peered":"2023-07-25T14:37:59.253261+0000","last_clean":"2023-07-25T14:37:59.253261+0000","last_became_active":"2023-07-25T14:37:58.256294+0000","last_became_peered":"2023-07-25T14:37:58.256294+0000","last_unstale":"2023-07-25T14:37:59.253261+0000","last_undegraded":"2023-07-25T14:37:59.253261+0000","last_fullsized":"2023-07-25T14:37:59.253261+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T20:45:43.373603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.254755+0000","last_change":"2023-07-25T14:37:45.199696+0000","last_active":"2023-07-25T14:37:59.254755+0000","last_peered":"2023-07-25T14:37:59.254755+0000","last_clean":"2023-07-25T14:37:59.254755+0000","last_became_active":"2023-07-25T14:37:45.199345+0000","last_became_peered":"2023-07-25T14:37:45.199345+0000","last_unstale":"2023-07-25T14:37:59.254755+0000","last_undegraded":"2023-07-25T14:37:59.254755+0000","last_fullsized":"2023-07-25T14:37:59.254755+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T17:11:08.224142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.353379+0000","last_change":"2023-07-25T14:37:58.263524+0000","last_active":"2023-07-25T14:37:59.353379+0000","last_peered":"2023-07-25T14:37:59.353379+0000","last_clean":"2023-07-25T14:37:59.353379+0000","last_became_active":"2023-07-25T14:37:58.263192+0000","last_became_peered":"2023-07-25T14:37:58.263192+0000","last_unstale":"2023-07-25T14:37:59.353379+0000","last_undegraded":"2023-07-25T14:37:59.353379+0000","last_fullsized":"2023-07-25T14:37:59.353379+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T02:08:04.137385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.354742+0000","last_change":"2023-07-25T14:37:45.206383+0000","last_active":"2023-07-25T14:37:59.354742+0000","last_peered":"2023-07-25T14:37:59.354742+0000","last_clean":"2023-07-25T14:37:59.354742+0000","last_became_active":"2023-07-25T14:37:45.204409+0000","last_became_peered":"2023-07-25T14:37:45.204409+0000","last_unstale":"2023-07-25T14:37:59.354742+0000","last_undegraded":"2023-07-25T14:37:59.354742+0000","last_fullsized":"2023-07-25T14:37:59.354742+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T17:39:59.896444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.255165+0000","last_change":"2023-07-25T14:37:58.276707+0000","last_active":"2023-07-25T14:37:59.255165+0000","last_peered":"2023-07-25T14:37:59.255165+0000","last_clean":"2023-07-25T14:37:59.255165+0000","last_became_active":"2023-07-25T14:37:58.276102+0000","last_became_peered":"2023-07-25T14:37:58.276102+0000","last_unstale":"2023-07-25T14:37:59.255165+0000","last_undegraded":"2023-07-25T14:37:59.255165+0000","last_fullsized":"2023-07-25T14:37:59.255165+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T19:51:18.791389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.355259+0000","last_change":"2023-07-25T14:37:45.198072+0000","last_active":"2023-07-25T14:37:59.355259+0000","last_peered":"2023-07-25T14:37:59.355259+0000","last_clean":"2023-07-25T14:37:59.355259+0000","last_became_active":"2023-07-25T14:37:45.197648+0000","last_became_peered":"2023-07-25T14:37:45.197648+0000","last_unstale":"2023-07-25T14:37:59.355259+0000","last_undegraded":"2023-07-25T14:37:59.355259+0000","last_fullsized":"2023-07-25T14:37:59.355259+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T23:13:58.660182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.355347+0000","last_change":"2023-07-25T14:37:58.270365+0000","last_active":"2023-07-25T14:37:59.355347+0000","last_peered":"2023-07-25T14:37:59.355347+0000","last_clean":"2023-07-25T14:37:59.355347+0000","last_became_active":"2023-07-25T14:37:58.269974+0000","last_became_peered":"2023-07-25T14:37:58.269974+0000","last_unstale":"2023-07-25T14:37:59.355347+0000","last_undegraded":"2023-07-25T14:37:59.355347+0000","last_fullsized":"2023-07-25T14:37:59.355347+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T16:44:52.627355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.353009+0000","last_change":"2023-07-25T14:37:45.188472+0000","last_active":"2023-07-25T14:37:59.353009+0000","last_peered":"2023-07-25T14:37:59.353009+0000","last_clean":"2023-07-25T14:37:59.353009+0000","last_became_active":"2023-07-25T14:37:45.188105+0000","last_became_peered":"2023-07-25T14:37:45.188105+0000","last_unstale":"2023-07-25T14:37:59.353009+0000","last_undegraded":"2023-07-25T14:37:59.353009+0000","last_fullsized":"2023-07-25T14:37:59.353009+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T14:42:08.091298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.355271+0000","last_change":"2023-07-25T14:37:58.268905+0000","last_active":"2023-07-25T14:37:59.355271+0000","last_peered":"2023-07-25T14:37:59.355271+0000","last_clean":"2023-07-25T14:37:59.355271+0000","last_became_active":"2023-07-25T14:37:58.268602+0000","last_became_peered":"2023-07-25T14:37:58.268602+0000","last_unstale":"2023-07-25T14:37:59.355271+0000","last_undegraded":"2023-07-25T14:37:59.355271+0000","last_fullsized":"2023-07-25T14:37:59.355271+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T17:17:18.291496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.255485+0000","last_change":"2023-07-25T14:37:45.191002+0000","last_active":"2023-07-25T14:37:59.255485+0000","last_peered":"2023-07-25T14:37:59.255485+0000","last_clean":"2023-07-25T14:37:59.255485+0000","last_became_active":"2023-07-25T14:37:45.190713+0000","last_became_peered":"2023-07-25T14:37:45.190713+0000","last_unstale":"2023-07-25T14:37:59.255485+0000","last_undegraded":"2023-07-25T14:37:59.255485+0000","last_fullsized":"2023-07-25T14:37:59.255485+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:11:13.440125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.255548+0000","last_change":"2023-07-25T14:37:58.261591+0000","last_active":"2023-07-25T14:37:59.255548+0000","last_peered":"2023-07-25T14:37:59.255548+0000","last_clean":"2023-07-25T14:37:59.255548+0000","last_became_active":"2023-07-25T14:37:58.260099+0000","last_became_peered":"2023-07-25T14:37:58.260099+0000","last_unstale":"2023-07-25T14:37:59.255548+0000","last_undegraded":"2023-07-25T14:37:59.255548+0000","last_fullsized":"2023-07-25T14:37:59.255548+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T17:20:07.455837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.353046+0000","last_change":"2023-07-25T14:37:45.192719+0000","last_active":"2023-07-25T14:37:59.353046+0000","last_peered":"2023-07-25T14:37:59.353046+0000","last_clean":"2023-07-25T14:37:59.353046+0000","last_became_active":"2023-07-25T14:37:45.192419+0000","last_became_peered":"2023-07-25T14:37:45.192419+0000","last_unstale":"2023-07-25T14:37:59.353046+0000","last_undegraded":"2023-07-25T14:37:59.353046+0000","last_fullsized":"2023-07-25T14:37:59.353046+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:37:15.728996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.353963+0000","last_change":"2023-07-25T14:37:58.266211+0000","last_active":"2023-07-25T14:37:59.353963+0000","last_peered":"2023-07-25T14:37:59.353963+0000","last_clean":"2023-07-25T14:37:59.353963+0000","last_became_active":"2023-07-25T14:37:58.265951+0000","last_became_peered":"2023-07-25T14:37:58.265951+0000","last_unstale":"2023-07-25T14:37:59.353963+0000","last_undegraded":"2023-07-25T14:37:59.353963+0000","last_fullsized":"2023-07-25T14:37:59.353963+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:21:18.689386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.253081+0000","last_change":"2023-07-25T14:37:45.210664+0000","last_active":"2023-07-25T14:37:59.253081+0000","last_peered":"2023-07-25T14:37:59.253081+0000","last_clean":"2023-07-25T14:37:59.253081+0000","last_became_active":"2023-07-25T14:37:45.210376+0000","last_became_peered":"2023-07-25T14:37:45.210376+0000","last_unstale":"2023-07-25T14:37:59.253081+0000","last_undegraded":"2023-07-25T14:37:59.253081+0000","last_fullsized":"2023-07-25T14:37:59.253081+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T23:48:52.142431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.353805+0000","last_change":"2023-07-25T14:37:58.269617+0000","last_active":"2023-07-25T14:37:59.353805+0000","last_peered":"2023-07-25T14:37:59.353805+0000","last_clean":"2023-07-25T14:37:59.353805+0000","last_became_active":"2023-07-25T14:37:58.269335+0000","last_became_peered":"2023-07-25T14:37:58.269335+0000","last_unstale":"2023-07-25T14:37:59.353805+0000","last_undegraded":"2023-07-25T14:37:59.353805+0000","last_fullsized":"2023-07-25T14:37:59.353805+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T18:48:11.765057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.255924+0000","last_change":"2023-07-25T14:37:45.191718+0000","last_active":"2023-07-25T14:37:59.255924+0000","last_peered":"2023-07-25T14:37:59.255924+0000","last_clean":"2023-07-25T14:37:59.255924+0000","last_became_active":"2023-07-25T14:37:45.191401+0000","last_became_peered":"2023-07-25T14:37:45.191401+0000","last_unstale":"2023-07-25T14:37:59.255924+0000","last_undegraded":"2023-07-25T14:37:59.255924+0000","last_fullsized":"2023-07-25T14:37:59.255924+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T16:54:19.121146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.254845+0000","last_change":"2023-07-25T14:37:58.264343+0000","last_active":"2023-07-25T14:37:59.254845+0000","last_peered":"2023-07-25T14:37:59.254845+0000","last_clean":"2023-07-25T14:37:59.254845+0000","last_became_active":"2023-07-25T14:37:58.264080+0000","last_became_peered":"2023-07-25T14:37:58.264080+0000","last_unstale":"2023-07-25T14:37:59.254845+0000","last_undegraded":"2023-07-25T14:37:59.254845+0000","last_fullsized":"2023-07-25T14:37:59.254845+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T23:18:58.192091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.355647+0000","last_change":"2023-07-25T14:37:45.197329+0000","last_active":"2023-07-25T14:37:59.355647+0000","last_peered":"2023-07-25T14:37:59.355647+0000","last_clean":"2023-07-25T14:37:59.355647+0000","last_became_active":"2023-07-25T14:37:45.197048+0000","last_became_peered":"2023-07-25T14:37:45.197048+0000","last_unstale":"2023-07-25T14:37:59.355647+0000","last_undegraded":"2023-07-25T14:37:59.355647+0000","last_fullsized":"2023-07-25T14:37:59.355647+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T18:05:49.493471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.255073+0000","last_change":"2023-07-25T14:37:58.259867+0000","last_active":"2023-07-25T14:37:59.255073+0000","last_peered":"2023-07-25T14:37:59.255073+0000","last_clean":"2023-07-25T14:37:59.255073+0000","last_became_active":"2023-07-25T14:37:58.259564+0000","last_became_peered":"2023-07-25T14:37:58.259564+0000","last_unstale":"2023-07-25T14:37:59.255073+0000","last_undegraded":"2023-07-25T14:37:59.255073+0000","last_fullsized":"2023-07-25T14:37:59.255073+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T15:49:26.736019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.354423+0000","last_change":"2023-07-25T14:37:45.205950+0000","last_active":"2023-07-25T14:37:59.354423+0000","last_peered":"2023-07-25T14:37:59.354423+0000","last_clean":"2023-07-25T14:37:59.354423+0000","last_became_active":"2023-07-25T14:37:45.199388+0000","last_became_peered":"2023-07-25T14:37:45.199388+0000","last_unstale":"2023-07-25T14:37:59.354423+0000","last_undegraded":"2023-07-25T14:37:59.354423+0000","last_fullsized":"2023-07-25T14:37:59.354423+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T23:02:47.104299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.354947+0000","last_change":"2023-07-25T14:37:58.279141+0000","last_active":"2023-07-25T14:37:59.354947+0000","last_peered":"2023-07-25T14:37:59.354947+0000","last_clean":"2023-07-25T14:37:59.354947+0000","last_became_active":"2023-07-25T14:37:58.278646+0000","last_became_peered":"2023-07-25T14:37:58.278646+0000","last_unstale":"2023-07-25T14:37:59.354947+0000","last_undegraded":"2023-07-25T14:37:59.354947+0000","last_fullsized":"2023-07-25T14:37:59.354947+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T18:19:28.497638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.353811+0000","last_change":"2023-07-25T14:37:45.188465+0000","last_active":"2023-07-25T14:37:59.353811+0000","last_peered":"2023-07-25T14:37:59.353811+0000","last_clean":"2023-07-25T14:37:59.353811+0000","last_became_active":"2023-07-25T14:37:45.188186+0000","last_became_peered":"2023-07-25T14:37:45.188186+0000","last_unstale":"2023-07-25T14:37:59.353811+0000","last_undegraded":"2023-07-25T14:37:59.353811+0000","last_fullsized":"2023-07-25T14:37:59.353811+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T23:16:23.351954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.353783+0000","last_change":"2023-07-25T14:37:58.269523+0000","last_active":"2023-07-25T14:37:59.353783+0000","last_peered":"2023-07-25T14:37:59.353783+0000","last_clean":"2023-07-25T14:37:59.353783+0000","last_became_active":"2023-07-25T14:37:58.269114+0000","last_became_peered":"2023-07-25T14:37:58.269114+0000","last_unstale":"2023-07-25T14:37:59.353783+0000","last_undegraded":"2023-07-25T14:37:59.353783+0000","last_fullsized":"2023-07-25T14:37:59.353783+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T20:05:23.800908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.255225+0000","last_change":"2023-07-25T14:37:45.201384+0000","last_active":"2023-07-25T14:37:59.255225+0000","last_peered":"2023-07-25T14:37:59.255225+0000","last_clean":"2023-07-25T14:37:59.255225+0000","last_became_active":"2023-07-25T14:37:45.200847+0000","last_became_peered":"2023-07-25T14:37:45.200847+0000","last_unstale":"2023-07-25T14:37:59.255225+0000","last_undegraded":"2023-07-25T14:37:59.255225+0000","last_fullsized":"2023-07-25T14:37:59.255225+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T17:44:10.141375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.255308+0000","last_change":"2023-07-25T14:37:58.259812+0000","last_active":"2023-07-25T14:37:59.255308+0000","last_peered":"2023-07-25T14:37:59.255308+0000","last_clean":"2023-07-25T14:37:59.255308+0000","last_became_active":"2023-07-25T14:37:58.259499+0000","last_became_peered":"2023-07-25T14:37:58.259499+0000","last_unstale":"2023-07-25T14:37:59.255308+0000","last_undegraded":"2023-07-25T14:37:59.255308+0000","last_fullsized":"2023-07-25T14:37:59.255308+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:10:11.047040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.253932+0000","last_change":"2023-07-25T14:37:45.201941+0000","last_active":"2023-07-25T14:37:59.253932+0000","last_peered":"2023-07-25T14:37:59.253932+0000","last_clean":"2023-07-25T14:37:59.253932+0000","last_became_active":"2023-07-25T14:37:45.201640+0000","last_became_peered":"2023-07-25T14:37:45.201640+0000","last_unstale":"2023-07-25T14:37:59.253932+0000","last_undegraded":"2023-07-25T14:37:59.253932+0000","last_fullsized":"2023-07-25T14:37:59.253932+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T17:39:59.896444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.254155+0000","last_change":"2023-07-25T14:37:58.253701+0000","last_active":"2023-07-25T14:37:59.254155+0000","last_peered":"2023-07-25T14:37:59.254155+0000","last_clean":"2023-07-25T14:37:59.254155+0000","last_became_active":"2023-07-25T14:37:58.253402+0000","last_became_peered":"2023-07-25T14:37:58.253402+0000","last_unstale":"2023-07-25T14:37:59.254155+0000","last_undegraded":"2023-07-25T14:37:59.254155+0000","last_fullsized":"2023-07-25T14:37:59.254155+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T18:10:00.535963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.353537+0000","last_change":"2023-07-25T14:37:45.204317+0000","last_active":"2023-07-25T14:37:59.353537+0000","last_peered":"2023-07-25T14:37:59.353537+0000","last_clean":"2023-07-25T14:37:59.353537+0000","last_became_active":"2023-07-25T14:37:45.203583+0000","last_became_peered":"2023-07-25T14:37:45.203583+0000","last_unstale":"2023-07-25T14:37:59.353537+0000","last_undegraded":"2023-07-25T14:37:59.353537+0000","last_fullsized":"2023-07-25T14:37:59.353537+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T01:40:53.247781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.255550+0000","last_change":"2023-07-25T14:37:58.256414+0000","last_active":"2023-07-25T14:37:59.255550+0000","last_peered":"2023-07-25T14:37:59.255550+0000","last_clean":"2023-07-25T14:37:59.255550+0000","last_became_active":"2023-07-25T14:37:58.256111+0000","last_became_peered":"2023-07-25T14:37:58.256111+0000","last_unstale":"2023-07-25T14:37:59.255550+0000","last_undegraded":"2023-07-25T14:37:59.255550+0000","last_fullsized":"2023-07-25T14:37:59.255550+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T15:58:49.900074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.353875+0000","last_change":"2023-07-25T14:37:45.207314+0000","last_active":"2023-07-25T14:37:59.353875+0000","last_peered":"2023-07-25T14:37:59.353875+0000","last_clean":"2023-07-25T14:37:59.353875+0000","last_became_active":"2023-07-25T14:37:45.207030+0000","last_became_peered":"2023-07-25T14:37:45.207030+0000","last_unstale":"2023-07-25T14:37:59.353875+0000","last_undegraded":"2023-07-25T14:37:59.353875+0000","last_fullsized":"2023-07-25T14:37:59.353875+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T16:25:07.919077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.253271+0000","last_change":"2023-07-25T14:37:58.261074+0000","last_active":"2023-07-25T14:37:59.253271+0000","last_peered":"2023-07-25T14:37:59.253271+0000","last_clean":"2023-07-25T14:37:59.253271+0000","last_became_active":"2023-07-25T14:37:58.260853+0000","last_became_peered":"2023-07-25T14:37:58.260853+0000","last_unstale":"2023-07-25T14:37:59.253271+0000","last_undegraded":"2023-07-25T14:37:59.253271+0000","last_fullsized":"2023-07-25T14:37:59.253271+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T16:25:21.004862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.254106+0000","last_change":"2023-07-25T14:37:45.210109+0000","last_active":"2023-07-25T14:37:59.254106+0000","last_peered":"2023-07-25T14:37:59.254106+0000","last_clean":"2023-07-25T14:37:59.254106+0000","last_became_active":"2023-07-25T14:37:45.205229+0000","last_became_peered":"2023-07-25T14:37:45.205229+0000","last_unstale":"2023-07-25T14:37:59.254106+0000","last_undegraded":"2023-07-25T14:37:59.254106+0000","last_fullsized":"2023-07-25T14:37:59.254106+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T20:37:48.433030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.353189+0000","last_change":"2023-07-25T14:37:58.272769+0000","last_active":"2023-07-25T14:37:59.353189+0000","last_peered":"2023-07-25T14:37:59.353189+0000","last_clean":"2023-07-25T14:37:59.353189+0000","last_became_active":"2023-07-25T14:37:58.272512+0000","last_became_peered":"2023-07-25T14:37:58.272512+0000","last_unstale":"2023-07-25T14:37:59.353189+0000","last_undegraded":"2023-07-25T14:37:59.353189+0000","last_fullsized":"2023-07-25T14:37:59.353189+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T01:35:59.361785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.255491+0000","last_change":"2023-07-25T14:37:45.188464+0000","last_active":"2023-07-25T14:37:59.255491+0000","last_peered":"2023-07-25T14:37:59.255491+0000","last_clean":"2023-07-25T14:37:59.255491+0000","last_became_active":"2023-07-25T14:37:45.188020+0000","last_became_peered":"2023-07-25T14:37:45.188020+0000","last_unstale":"2023-07-25T14:37:59.255491+0000","last_undegraded":"2023-07-25T14:37:59.255491+0000","last_fullsized":"2023-07-25T14:37:59.255491+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T15:54:51.725869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.355144+0000","last_change":"2023-07-25T14:37:58.273903+0000","last_active":"2023-07-25T14:37:59.355144+0000","last_peered":"2023-07-25T14:37:59.355144+0000","last_clean":"2023-07-25T14:37:59.355144+0000","last_became_active":"2023-07-25T14:37:58.273670+0000","last_became_peered":"2023-07-25T14:37:58.273670+0000","last_unstale":"2023-07-25T14:37:59.355144+0000","last_undegraded":"2023-07-25T14:37:59.355144+0000","last_fullsized":"2023-07-25T14:37:59.355144+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T15:31:42.790271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.352915+0000","last_change":"2023-07-25T14:37:45.205460+0000","last_active":"2023-07-25T14:37:59.352915+0000","last_peered":"2023-07-25T14:37:59.352915+0000","last_clean":"2023-07-25T14:37:59.352915+0000","last_became_active":"2023-07-25T14:37:45.205174+0000","last_became_peered":"2023-07-25T14:37:45.205174+0000","last_unstale":"2023-07-25T14:37:59.352915+0000","last_undegraded":"2023-07-25T14:37:59.352915+0000","last_fullsized":"2023-07-25T14:37:59.352915+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T15:08:21.539614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.355282+0000","last_change":"2023-07-25T14:37:58.274595+0000","last_active":"2023-07-25T14:37:59.355282+0000","last_peered":"2023-07-25T14:37:59.355282+0000","last_clean":"2023-07-25T14:37:59.355282+0000","last_became_active":"2023-07-25T14:37:58.274339+0000","last_became_peered":"2023-07-25T14:37:58.274339+0000","last_unstale":"2023-07-25T14:37:59.355282+0000","last_undegraded":"2023-07-25T14:37:59.355282+0000","last_fullsized":"2023-07-25T14:37:59.355282+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T02:02:19.195180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.253439+0000","last_change":"2023-07-25T14:37:45.199014+0000","last_active":"2023-07-25T14:37:59.253439+0000","last_peered":"2023-07-25T14:37:59.253439+0000","last_clean":"2023-07-25T14:37:59.253439+0000","last_became_active":"2023-07-25T14:37:45.198610+0000","last_became_peered":"2023-07-25T14:37:45.198610+0000","last_unstale":"2023-07-25T14:37:59.253439+0000","last_undegraded":"2023-07-25T14:37:59.253439+0000","last_fullsized":"2023-07-25T14:37:59.253439+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T20:16:20.476125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.253805+0000","last_change":"2023-07-25T14:37:58.262112+0000","last_active":"2023-07-25T14:37:59.253805+0000","last_peered":"2023-07-25T14:37:59.253805+0000","last_clean":"2023-07-25T14:37:59.253805+0000","last_became_active":"2023-07-25T14:37:58.261790+0000","last_became_peered":"2023-07-25T14:37:58.261790+0000","last_unstale":"2023-07-25T14:37:59.253805+0000","last_undegraded":"2023-07-25T14:37:59.253805+0000","last_fullsized":"2023-07-25T14:37:59.253805+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T18:39:54.194269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.353336+0000","last_change":"2023-07-25T14:37:45.190492+0000","last_active":"2023-07-25T14:37:59.353336+0000","last_peered":"2023-07-25T14:37:59.353336+0000","last_clean":"2023-07-25T14:37:59.353336+0000","last_became_active":"2023-07-25T14:37:45.190205+0000","last_became_peered":"2023-07-25T14:37:45.190205+0000","last_unstale":"2023-07-25T14:37:59.353336+0000","last_undegraded":"2023-07-25T14:37:59.353336+0000","last_fullsized":"2023-07-25T14:37:59.353336+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T15:19:19.734194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.353566+0000","last_change":"2023-07-25T14:37:58.265370+0000","last_active":"2023-07-25T14:37:59.353566+0000","last_peered":"2023-07-25T14:37:59.353566+0000","last_clean":"2023-07-25T14:37:59.353566+0000","last_became_active":"2023-07-25T14:37:58.264772+0000","last_became_peered":"2023-07-25T14:37:58.264772+0000","last_unstale":"2023-07-25T14:37:59.353566+0000","last_undegraded":"2023-07-25T14:37:59.353566+0000","last_fullsized":"2023-07-25T14:37:59.353566+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T23:04:07.473888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.255306+0000","last_change":"2023-07-25T14:37:45.189887+0000","last_active":"2023-07-25T14:37:59.255306+0000","last_peered":"2023-07-25T14:37:59.255306+0000","last_clean":"2023-07-25T14:37:59.255306+0000","last_became_active":"2023-07-25T14:37:45.189544+0000","last_became_peered":"2023-07-25T14:37:45.189544+0000","last_unstale":"2023-07-25T14:37:59.255306+0000","last_undegraded":"2023-07-25T14:37:59.255306+0000","last_fullsized":"2023-07-25T14:37:59.255306+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T15:25:10.256493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.355592+0000","last_change":"2023-07-25T14:37:58.273603+0000","last_active":"2023-07-25T14:37:59.355592+0000","last_peered":"2023-07-25T14:37:59.355592+0000","last_clean":"2023-07-25T14:37:59.355592+0000","last_became_active":"2023-07-25T14:37:58.272546+0000","last_became_peered":"2023-07-25T14:37:58.272546+0000","last_unstale":"2023-07-25T14:37:59.355592+0000","last_undegraded":"2023-07-25T14:37:59.355592+0000","last_fullsized":"2023-07-25T14:37:59.355592+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:11:25.174278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.255785+0000","last_change":"2023-07-25T14:37:45.197332+0000","last_active":"2023-07-25T14:37:59.255785+0000","last_peered":"2023-07-25T14:37:59.255785+0000","last_clean":"2023-07-25T14:37:59.255785+0000","last_became_active":"2023-07-25T14:37:45.196749+0000","last_became_peered":"2023-07-25T14:37:45.196749+0000","last_unstale":"2023-07-25T14:37:59.255785+0000","last_undegraded":"2023-07-25T14:37:59.255785+0000","last_fullsized":"2023-07-25T14:37:59.255785+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T14:55:58.159337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.354401+0000","last_change":"2023-07-25T14:37:58.276058+0000","last_active":"2023-07-25T14:37:59.354401+0000","last_peered":"2023-07-25T14:37:59.354401+0000","last_clean":"2023-07-25T14:37:59.354401+0000","last_became_active":"2023-07-25T14:37:58.275828+0000","last_became_peered":"2023-07-25T14:37:58.275828+0000","last_unstale":"2023-07-25T14:37:59.354401+0000","last_undegraded":"2023-07-25T14:37:59.354401+0000","last_fullsized":"2023-07-25T14:37:59.354401+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T23:50:15.511943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.353370+0000","last_change":"2023-07-25T14:37:45.191972+0000","last_active":"2023-07-25T14:37:59.353370+0000","last_peered":"2023-07-25T14:37:59.353370+0000","last_clean":"2023-07-25T14:37:59.353370+0000","last_became_active":"2023-07-25T14:37:45.191704+0000","last_became_peered":"2023-07-25T14:37:45.191704+0000","last_unstale":"2023-07-25T14:37:59.353370+0000","last_undegraded":"2023-07-25T14:37:59.353370+0000","last_fullsized":"2023-07-25T14:37:59.353370+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T02:23:43.183873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.353202+0000","last_change":"2023-07-25T14:37:58.274924+0000","last_active":"2023-07-25T14:37:59.353202+0000","last_peered":"2023-07-25T14:37:59.353202+0000","last_clean":"2023-07-25T14:37:59.353202+0000","last_became_active":"2023-07-25T14:37:58.274620+0000","last_became_peered":"2023-07-25T14:37:58.274620+0000","last_unstale":"2023-07-25T14:37:59.353202+0000","last_undegraded":"2023-07-25T14:37:59.353202+0000","last_fullsized":"2023-07-25T14:37:59.353202+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T15:22:16.316397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.352671+0000","last_change":"2023-07-25T14:37:57.258106+0000","last_active":"2023-07-25T14:37:59.352671+0000","last_peered":"2023-07-25T14:37:59.352671+0000","last_clean":"2023-07-25T14:37:59.352671+0000","last_became_active":"2023-07-25T14:37:57.257771+0000","last_became_peered":"2023-07-25T14:37:57.257771+0000","last_unstale":"2023-07-25T14:37:59.352671+0000","last_undegraded":"2023-07-25T14:37:59.352671+0000","last_fullsized":"2023-07-25T14:37:59.352671+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_clean_scrub_stamp":"2023-07-25T14:37:56.225499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T22:46:36.416127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.354496+0000","last_change":"2023-07-25T14:37:45.213847+0000","last_active":"2023-07-25T14:37:59.354496+0000","last_peered":"2023-07-25T14:37:59.354496+0000","last_clean":"2023-07-25T14:37:59.354496+0000","last_became_active":"2023-07-25T14:37:45.213456+0000","last_became_peered":"2023-07-25T14:37:45.213456+0000","last_unstale":"2023-07-25T14:37:59.354496+0000","last_undegraded":"2023-07-25T14:37:59.354496+0000","last_fullsized":"2023-07-25T14:37:59.354496+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T18:39:41.108484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"56'4","reported_seq":25,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.354975+0000","last_change":"2023-07-25T14:37:44.164114+0000","last_active":"2023-07-25T14:37:59.354975+0000","last_peered":"2023-07-25T14:37:59.354975+0000","last_clean":"2023-07-25T14:37:59.354975+0000","last_became_active":"2023-07-25T14:37:44.163807+0000","last_became_peered":"2023-07-25T14:37:44.163807+0000","last_unstale":"2023-07-25T14:37:59.354975+0000","last_undegraded":"2023-07-25T14:37:59.354975+0000","last_fullsized":"2023-07-25T14:37:59.354975+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T15:08:20.537998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.352807+0000","last_change":"2023-07-25T14:37:58.267265+0000","last_active":"2023-07-25T14:37:59.352807+0000","last_peered":"2023-07-25T14:37:59.352807+0000","last_clean":"2023-07-25T14:37:59.352807+0000","last_became_active":"2023-07-25T14:37:58.266994+0000","last_became_peered":"2023-07-25T14:37:58.266994+0000","last_unstale":"2023-07-25T14:37:59.352807+0000","last_undegraded":"2023-07-25T14:37:59.352807+0000","last_fullsized":"2023-07-25T14:37:59.352807+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T18:39:54.194269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.354729+0000","last_change":"2023-07-25T14:37:57.262903+0000","last_active":"2023-07-25T14:37:59.354729+0000","last_peered":"2023-07-25T14:37:59.354729+0000","last_clean":"2023-07-25T14:37:59.354729+0000","last_became_active":"2023-07-25T14:37:57.262633+0000","last_became_peered":"2023-07-25T14:37:57.262633+0000","last_unstale":"2023-07-25T14:37:59.354729+0000","last_undegraded":"2023-07-25T14:37:59.354729+0000","last_fullsized":"2023-07-25T14:37:59.354729+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_clean_scrub_stamp":"2023-07-25T14:37:56.225499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:52:02.073882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.255485+0000","last_change":"2023-07-25T14:37:45.191918+0000","last_active":"2023-07-25T14:37:59.255485+0000","last_peered":"2023-07-25T14:37:59.255485+0000","last_clean":"2023-07-25T14:37:59.255485+0000","last_became_active":"2023-07-25T14:37:45.191341+0000","last_became_peered":"2023-07-25T14:37:45.191341+0000","last_unstale":"2023-07-25T14:37:59.255485+0000","last_undegraded":"2023-07-25T14:37:59.255485+0000","last_fullsized":"2023-07-25T14:37:59.255485+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T18:10:50.908131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"56'1","reported_seq":22,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.353801+0000","last_change":"2023-07-25T14:37:44.174028+0000","last_active":"2023-07-25T14:37:59.353801+0000","last_peered":"2023-07-25T14:37:59.353801+0000","last_clean":"2023-07-25T14:37:59.353801+0000","last_became_active":"2023-07-25T14:37:44.173193+0000","last_became_peered":"2023-07-25T14:37:44.173193+0000","last_unstale":"2023-07-25T14:37:59.353801+0000","last_undegraded":"2023-07-25T14:37:59.353801+0000","last_fullsized":"2023-07-25T14:37:59.353801+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T21:37:45.453864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.355094+0000","last_change":"2023-07-25T14:37:58.274251+0000","last_active":"2023-07-25T14:37:59.355094+0000","last_peered":"2023-07-25T14:37:59.355094+0000","last_clean":"2023-07-25T14:37:59.355094+0000","last_became_active":"2023-07-25T14:37:58.274080+0000","last_became_peered":"2023-07-25T14:37:58.274080+0000","last_unstale":"2023-07-25T14:37:59.355094+0000","last_undegraded":"2023-07-25T14:37:59.355094+0000","last_fullsized":"2023-07-25T14:37:59.355094+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T22:14:04.754808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"60'1","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.255087+0000","last_change":"2023-07-25T14:37:57.263153+0000","last_active":"2023-07-25T14:37:59.255087+0000","last_peered":"2023-07-25T14:37:59.255087+0000","last_clean":"2023-07-25T14:37:59.255087+0000","last_became_active":"2023-07-25T14:37:57.262683+0000","last_became_peered":"2023-07-25T14:37:57.262683+0000","last_unstale":"2023-07-25T14:37:59.255087+0000","last_undegraded":"2023-07-25T14:37:59.255087+0000","last_fullsized":"2023-07-25T14:37:59.255087+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_clean_scrub_stamp":"2023-07-25T14:37:56.225499+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T01:18:45.274260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.355011+0000","last_change":"2023-07-25T14:37:45.209338+0000","last_active":"2023-07-25T14:37:59.355011+0000","last_peered":"2023-07-25T14:37:59.355011+0000","last_clean":"2023-07-25T14:37:59.355011+0000","last_became_active":"2023-07-25T14:37:45.207168+0000","last_became_peered":"2023-07-25T14:37:45.207168+0000","last_unstale":"2023-07-25T14:37:59.355011+0000","last_undegraded":"2023-07-25T14:37:59.355011+0000","last_fullsized":"2023-07-25T14:37:59.355011+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T15:01:23.982072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"56'2","reported_seq":23,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.254033+0000","last_change":"2023-07-25T14:37:44.168052+0000","last_active":"2023-07-25T14:37:59.254033+0000","last_peered":"2023-07-25T14:37:59.254033+0000","last_clean":"2023-07-25T14:37:59.254033+0000","last_became_active":"2023-07-25T14:37:44.167768+0000","last_became_peered":"2023-07-25T14:37:44.167768+0000","last_unstale":"2023-07-25T14:37:59.254033+0000","last_undegraded":"2023-07-25T14:37:59.254033+0000","last_fullsized":"2023-07-25T14:37:59.254033+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T15:08:20.537998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.255418+0000","last_change":"2023-07-25T14:37:58.252199+0000","last_active":"2023-07-25T14:37:59.255418+0000","last_peered":"2023-07-25T14:37:59.255418+0000","last_clean":"2023-07-25T14:37:59.255418+0000","last_became_active":"2023-07-25T14:37:58.251930+0000","last_became_peered":"2023-07-25T14:37:58.251930+0000","last_unstale":"2023-07-25T14:37:59.255418+0000","last_undegraded":"2023-07-25T14:37:59.255418+0000","last_fullsized":"2023-07-25T14:37:59.255418+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T20:48:38.981381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"60'1","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.253401+0000","last_change":"2023-07-25T14:37:57.261540+0000","last_active":"2023-07-25T14:37:59.253401+0000","last_peered":"2023-07-25T14:37:59.253401+0000","last_clean":"2023-07-25T14:37:59.253401+0000","last_became_active":"2023-07-25T14:37:57.261265+0000","last_became_peered":"2023-07-25T14:37:57.261265+0000","last_unstale":"2023-07-25T14:37:59.253401+0000","last_undegraded":"2023-07-25T14:37:59.253401+0000","last_fullsized":"2023-07-25T14:37:59.253401+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_clean_scrub_stamp":"2023-07-25T14:37:56.225499+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T23:25:22.309808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.354465+0000","last_change":"2023-07-25T14:37:45.204504+0000","last_active":"2023-07-25T14:37:59.354465+0000","last_peered":"2023-07-25T14:37:59.354465+0000","last_clean":"2023-07-25T14:37:59.354465+0000","last_became_active":"2023-07-25T14:37:45.203141+0000","last_became_peered":"2023-07-25T14:37:45.203141+0000","last_unstale":"2023-07-25T14:37:59.354465+0000","last_undegraded":"2023-07-25T14:37:59.354465+0000","last_fullsized":"2023-07-25T14:37:59.354465+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T20:15:25.491350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"56'2","reported_seq":23,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.354580+0000","last_change":"2023-07-25T14:37:44.167404+0000","last_active":"2023-07-25T14:37:59.354580+0000","last_peered":"2023-07-25T14:37:59.354580+0000","last_clean":"2023-07-25T14:37:59.354580+0000","last_became_active":"2023-07-25T14:37:44.167157+0000","last_became_peered":"2023-07-25T14:37:44.167157+0000","last_unstale":"2023-07-25T14:37:59.354580+0000","last_undegraded":"2023-07-25T14:37:59.354580+0000","last_fullsized":"2023-07-25T14:37:59.354580+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T14:55:57.157721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.353737+0000","last_change":"2023-07-25T14:37:58.266893+0000","last_active":"2023-07-25T14:37:59.353737+0000","last_peered":"2023-07-25T14:37:59.353737+0000","last_clean":"2023-07-25T14:37:59.353737+0000","last_became_active":"2023-07-25T14:37:58.266636+0000","last_became_peered":"2023-07-25T14:37:58.266636+0000","last_unstale":"2023-07-25T14:37:59.353737+0000","last_undegraded":"2023-07-25T14:37:59.353737+0000","last_fullsized":"2023-07-25T14:37:59.353737+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:11:45.159867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"60'2","reported_seq":15,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.353604+0000","last_change":"2023-07-25T14:37:57.248386+0000","last_active":"2023-07-25T14:37:59.353604+0000","last_peered":"2023-07-25T14:37:59.353604+0000","last_clean":"2023-07-25T14:37:59.353604+0000","last_became_active":"2023-07-25T14:37:57.248115+0000","last_became_peered":"2023-07-25T14:37:57.248115+0000","last_unstale":"2023-07-25T14:37:59.353604+0000","last_undegraded":"2023-07-25T14:37:59.353604+0000","last_fullsized":"2023-07-25T14:37:59.353604+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_clean_scrub_stamp":"2023-07-25T14:37:56.225499+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T02:03:05.515454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.255456+0000","last_change":"2023-07-25T14:37:45.192672+0000","last_active":"2023-07-25T14:37:59.255456+0000","last_peered":"2023-07-25T14:37:59.255456+0000","last_clean":"2023-07-25T14:37:59.255456+0000","last_became_active":"2023-07-25T14:37:45.192426+0000","last_became_peered":"2023-07-25T14:37:45.192426+0000","last_unstale":"2023-07-25T14:37:59.255456+0000","last_undegraded":"2023-07-25T14:37:59.255456+0000","last_fullsized":"2023-07-25T14:37:59.255456+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T17:04:57.323478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"56'1","reported_seq":22,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.353439+0000","last_change":"2023-07-25T14:37:44.165894+0000","last_active":"2023-07-25T14:37:59.353439+0000","last_peered":"2023-07-25T14:37:59.353439+0000","last_clean":"2023-07-25T14:37:59.353439+0000","last_became_active":"2023-07-25T14:37:44.165121+0000","last_became_peered":"2023-07-25T14:37:44.165121+0000","last_unstale":"2023-07-25T14:37:59.353439+0000","last_undegraded":"2023-07-25T14:37:59.353439+0000","last_fullsized":"2023-07-25T14:37:59.353439+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T23:45:30.075158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.354219+0000","last_change":"2023-07-25T14:37:58.266399+0000","last_active":"2023-07-25T14:37:59.354219+0000","last_peered":"2023-07-25T14:37:59.354219+0000","last_clean":"2023-07-25T14:37:59.354219+0000","last_became_active":"2023-07-25T14:37:58.266136+0000","last_became_peered":"2023-07-25T14:37:58.266136+0000","last_unstale":"2023-07-25T14:37:59.354219+0000","last_undegraded":"2023-07-25T14:37:59.354219+0000","last_fullsized":"2023-07-25T14:37:59.354219+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T02:13:09.943612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"60'2","reported_seq":15,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.354166+0000","last_change":"2023-07-25T14:37:57.256744+0000","last_active":"2023-07-25T14:37:59.354166+0000","last_peered":"2023-07-25T14:37:59.354166+0000","last_clean":"2023-07-25T14:37:59.354166+0000","last_became_active":"2023-07-25T14:37:57.256503+0000","last_became_peered":"2023-07-25T14:37:57.256503+0000","last_unstale":"2023-07-25T14:37:59.354166+0000","last_undegraded":"2023-07-25T14:37:59.354166+0000","last_fullsized":"2023-07-25T14:37:59.354166+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_clean_scrub_stamp":"2023-07-25T14:37:56.225499+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T15:02:48.422214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.254941+0000","last_change":"2023-07-25T14:37:45.204924+0000","last_active":"2023-07-25T14:37:59.254941+0000","last_peered":"2023-07-25T14:37:59.254941+0000","last_clean":"2023-07-25T14:37:59.254941+0000","last_became_active":"2023-07-25T14:37:45.204636+0000","last_became_peered":"2023-07-25T14:37:45.204636+0000","last_unstale":"2023-07-25T14:37:59.254941+0000","last_undegraded":"2023-07-25T14:37:59.254941+0000","last_fullsized":"2023-07-25T14:37:59.254941+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T19:58:11.434033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"56'1","reported_seq":22,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.354092+0000","last_change":"2023-07-25T14:37:44.165997+0000","last_active":"2023-07-25T14:37:59.354092+0000","last_peered":"2023-07-25T14:37:59.354092+0000","last_clean":"2023-07-25T14:37:59.354092+0000","last_became_active":"2023-07-25T14:37:44.165724+0000","last_became_peered":"2023-07-25T14:37:44.165724+0000","last_unstale":"2023-07-25T14:37:59.354092+0000","last_undegraded":"2023-07-25T14:37:59.354092+0000","last_fullsized":"2023-07-25T14:37:59.354092+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T16:59:26.609126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.254524+0000","last_change":"2023-07-25T14:37:58.257104+0000","last_active":"2023-07-25T14:37:59.254524+0000","last_peered":"2023-07-25T14:37:59.254524+0000","last_clean":"2023-07-25T14:37:59.254524+0000","last_became_active":"2023-07-25T14:37:58.256857+0000","last_became_peered":"2023-07-25T14:37:58.256857+0000","last_unstale":"2023-07-25T14:37:59.254524+0000","last_undegraded":"2023-07-25T14:37:59.254524+0000","last_fullsized":"2023-07-25T14:37:59.254524+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T23:45:44.162560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"60'4","reported_seq":17,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.355043+0000","last_change":"2023-07-25T14:37:57.254601+0000","last_active":"2023-07-25T14:37:59.355043+0000","last_peered":"2023-07-25T14:37:59.355043+0000","last_clean":"2023-07-25T14:37:59.355043+0000","last_became_active":"2023-07-25T14:37:57.254128+0000","last_became_peered":"2023-07-25T14:37:57.254128+0000","last_unstale":"2023-07-25T14:37:59.355043+0000","last_undegraded":"2023-07-25T14:37:59.355043+0000","last_fullsized":"2023-07-25T14:37:59.355043+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_clean_scrub_stamp":"2023-07-25T14:37:56.225499+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T18:04:47.417812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.254888+0000","last_change":"2023-07-25T14:37:45.200734+0000","last_active":"2023-07-25T14:37:59.254888+0000","last_peered":"2023-07-25T14:37:59.254888+0000","last_clean":"2023-07-25T14:37:59.254888+0000","last_became_active":"2023-07-25T14:37:45.200452+0000","last_became_peered":"2023-07-25T14:37:45.200452+0000","last_unstale":"2023-07-25T14:37:59.254888+0000","last_undegraded":"2023-07-25T14:37:59.254888+0000","last_fullsized":"2023-07-25T14:37:59.254888+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T23:06:28.083990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":21,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.354833+0000","last_change":"2023-07-25T14:37:44.163784+0000","last_active":"2023-07-25T14:37:59.354833+0000","last_peered":"2023-07-25T14:37:59.354833+0000","last_clean":"2023-07-25T14:37:59.354833+0000","last_became_active":"2023-07-25T14:37:44.163566+0000","last_became_peered":"2023-07-25T14:37:44.163566+0000","last_unstale":"2023-07-25T14:37:59.354833+0000","last_undegraded":"2023-07-25T14:37:59.354833+0000","last_fullsized":"2023-07-25T14:37:59.354833+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T17:43:04.617257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.354934+0000","last_change":"2023-07-25T14:37:58.272389+0000","last_active":"2023-07-25T14:37:59.354934+0000","last_peered":"2023-07-25T14:37:59.354934+0000","last_clean":"2023-07-25T14:37:59.354934+0000","last_became_active":"2023-07-25T14:37:58.272172+0000","last_became_peered":"2023-07-25T14:37:58.272172+0000","last_unstale":"2023-07-25T14:37:59.354934+0000","last_undegraded":"2023-07-25T14:37:59.354934+0000","last_fullsized":"2023-07-25T14:37:59.354934+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:01:28.750034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"60'1","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.254282+0000","last_change":"2023-07-25T14:37:57.266582+0000","last_active":"2023-07-25T14:37:59.254282+0000","last_peered":"2023-07-25T14:37:59.254282+0000","last_clean":"2023-07-25T14:37:59.254282+0000","last_became_active":"2023-07-25T14:37:57.266257+0000","last_became_peered":"2023-07-25T14:37:57.266257+0000","last_unstale":"2023-07-25T14:37:59.254282+0000","last_undegraded":"2023-07-25T14:37:59.254282+0000","last_fullsized":"2023-07-25T14:37:59.254282+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_clean_scrub_stamp":"2023-07-25T14:37:56.225499+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T15:19:31.814559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.352932+0000","last_change":"2023-07-25T14:37:45.205124+0000","last_active":"2023-07-25T14:37:59.352932+0000","last_peered":"2023-07-25T14:37:59.352932+0000","last_clean":"2023-07-25T14:37:59.352932+0000","last_became_active":"2023-07-25T14:37:45.204730+0000","last_became_peered":"2023-07-25T14:37:45.204730+0000","last_unstale":"2023-07-25T14:37:59.352932+0000","last_undegraded":"2023-07-25T14:37:59.352932+0000","last_fullsized":"2023-07-25T14:37:59.352932+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:16:02.561651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":21,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.254665+0000","last_change":"2023-07-25T14:37:44.171926+0000","last_active":"2023-07-25T14:37:59.254665+0000","last_peered":"2023-07-25T14:37:59.254665+0000","last_clean":"2023-07-25T14:37:59.254665+0000","last_became_active":"2023-07-25T14:37:44.171610+0000","last_became_peered":"2023-07-25T14:37:44.171610+0000","last_unstale":"2023-07-25T14:37:59.254665+0000","last_undegraded":"2023-07-25T14:37:59.254665+0000","last_fullsized":"2023-07-25T14:37:59.254665+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T19:35:54.989248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.354760+0000","last_change":"2023-07-25T14:37:58.273479+0000","last_active":"2023-07-25T14:37:59.354760+0000","last_peered":"2023-07-25T14:37:59.354760+0000","last_clean":"2023-07-25T14:37:59.354760+0000","last_became_active":"2023-07-25T14:37:58.272406+0000","last_became_peered":"2023-07-25T14:37:58.272406+0000","last_unstale":"2023-07-25T14:37:59.354760+0000","last_undegraded":"2023-07-25T14:37:59.354760+0000","last_fullsized":"2023-07-25T14:37:59.354760+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T19:32:56.068141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.255553+0000","last_change":"2023-07-25T14:37:57.263209+0000","last_active":"2023-07-25T14:37:59.255553+0000","last_peered":"2023-07-25T14:37:59.255553+0000","last_clean":"2023-07-25T14:37:59.255553+0000","last_became_active":"2023-07-25T14:37:57.262677+0000","last_became_peered":"2023-07-25T14:37:57.262677+0000","last_unstale":"2023-07-25T14:37:59.255553+0000","last_undegraded":"2023-07-25T14:37:59.255553+0000","last_fullsized":"2023-07-25T14:37:59.255553+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_clean_scrub_stamp":"2023-07-25T14:37:56.225499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T17:02:33.760834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.255620+0000","last_change":"2023-07-25T14:37:45.208126+0000","last_active":"2023-07-25T14:37:59.255620+0000","last_peered":"2023-07-25T14:37:59.255620+0000","last_clean":"2023-07-25T14:37:59.255620+0000","last_became_active":"2023-07-25T14:37:45.207856+0000","last_became_peered":"2023-07-25T14:37:45.207856+0000","last_unstale":"2023-07-25T14:37:59.255620+0000","last_undegraded":"2023-07-25T14:37:59.255620+0000","last_fullsized":"2023-07-25T14:37:59.255620+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T15:04:38.410166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":21,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.254265+0000","last_change":"2023-07-25T14:37:44.164773+0000","last_active":"2023-07-25T14:37:59.254265+0000","last_peered":"2023-07-25T14:37:59.254265+0000","last_clean":"2023-07-25T14:37:59.254265+0000","last_became_active":"2023-07-25T14:37:44.164480+0000","last_became_peered":"2023-07-25T14:37:44.164480+0000","last_unstale":"2023-07-25T14:37:59.254265+0000","last_undegraded":"2023-07-25T14:37:59.254265+0000","last_fullsized":"2023-07-25T14:37:59.254265+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T15:59:59.981639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.354816+0000","last_change":"2023-07-25T14:37:58.273504+0000","last_active":"2023-07-25T14:37:59.354816+0000","last_peered":"2023-07-25T14:37:59.354816+0000","last_clean":"2023-07-25T14:37:59.354816+0000","last_became_active":"2023-07-25T14:37:58.272498+0000","last_became_peered":"2023-07-25T14:37:58.272498+0000","last_unstale":"2023-07-25T14:37:59.354816+0000","last_undegraded":"2023-07-25T14:37:59.354816+0000","last_fullsized":"2023-07-25T14:37:59.354816+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T16:55:49.405044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"60'8","reported_seq":21,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.352582+0000","last_change":"2023-07-25T14:37:57.257465+0000","last_active":"2023-07-25T14:37:59.352582+0000","last_peered":"2023-07-25T14:37:59.352582+0000","last_clean":"2023-07-25T14:37:59.352582+0000","last_became_active":"2023-07-25T14:37:57.257172+0000","last_became_peered":"2023-07-25T14:37:57.257172+0000","last_unstale":"2023-07-25T14:37:59.352582+0000","last_undegraded":"2023-07-25T14:37:59.352582+0000","last_fullsized":"2023-07-25T14:37:59.352582+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_clean_scrub_stamp":"2023-07-25T14:37:56.225499+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T20:46:02.598993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.355167+0000","last_change":"2023-07-25T14:37:45.196449+0000","last_active":"2023-07-25T14:37:59.355167+0000","last_peered":"2023-07-25T14:37:59.355167+0000","last_clean":"2023-07-25T14:37:59.355167+0000","last_became_active":"2023-07-25T14:37:45.196172+0000","last_became_peered":"2023-07-25T14:37:45.196172+0000","last_unstale":"2023-07-25T14:37:59.355167+0000","last_undegraded":"2023-07-25T14:37:59.355167+0000","last_fullsized":"2023-07-25T14:37:59.355167+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T20:37:48.433030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":21,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.355084+0000","last_change":"2023-07-25T14:37:44.162751+0000","last_active":"2023-07-25T14:37:59.355084+0000","last_peered":"2023-07-25T14:37:59.355084+0000","last_clean":"2023-07-25T14:37:59.355084+0000","last_became_active":"2023-07-25T14:37:44.162037+0000","last_became_peered":"2023-07-25T14:37:44.162037+0000","last_unstale":"2023-07-25T14:37:59.355084+0000","last_undegraded":"2023-07-25T14:37:59.355084+0000","last_fullsized":"2023-07-25T14:37:59.355084+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T18:53:30.782548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.353395+0000","last_change":"2023-07-25T14:37:58.263069+0000","last_active":"2023-07-25T14:37:59.353395+0000","last_peered":"2023-07-25T14:37:59.353395+0000","last_clean":"2023-07-25T14:37:59.353395+0000","last_became_active":"2023-07-25T14:37:58.262816+0000","last_became_peered":"2023-07-25T14:37:58.262816+0000","last_unstale":"2023-07-25T14:37:59.353395+0000","last_undegraded":"2023-07-25T14:37:59.353395+0000","last_fullsized":"2023-07-25T14:37:59.353395+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T19:15:01.089481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"60'2","reported_seq":15,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.355594+0000","last_change":"2023-07-25T14:37:57.264233+0000","last_active":"2023-07-25T14:37:59.355594+0000","last_peered":"2023-07-25T14:37:59.355594+0000","last_clean":"2023-07-25T14:37:59.355594+0000","last_became_active":"2023-07-25T14:37:57.263944+0000","last_became_peered":"2023-07-25T14:37:57.263944+0000","last_unstale":"2023-07-25T14:37:59.355594+0000","last_undegraded":"2023-07-25T14:37:59.355594+0000","last_fullsized":"2023-07-25T14:37:59.355594+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_clean_scrub_stamp":"2023-07-25T14:37:56.225499+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T21:35:30.980842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.354834+0000","last_change":"2023-07-25T14:37:45.206751+0000","last_active":"2023-07-25T14:37:59.354834+0000","last_peered":"2023-07-25T14:37:59.354834+0000","last_clean":"2023-07-25T14:37:59.354834+0000","last_became_active":"2023-07-25T14:37:45.206422+0000","last_became_peered":"2023-07-25T14:37:45.206422+0000","last_unstale":"2023-07-25T14:37:59.354834+0000","last_undegraded":"2023-07-25T14:37:59.354834+0000","last_fullsized":"2023-07-25T14:37:59.354834+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T16:03:21.851226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"56'3","reported_seq":24,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.353115+0000","last_change":"2023-07-25T14:37:44.161397+0000","last_active":"2023-07-25T14:37:59.353115+0000","last_peered":"2023-07-25T14:37:59.353115+0000","last_clean":"2023-07-25T14:37:59.353115+0000","last_became_active":"2023-07-25T14:37:44.161134+0000","last_became_peered":"2023-07-25T14:37:44.161134+0000","last_unstale":"2023-07-25T14:37:59.353115+0000","last_undegraded":"2023-07-25T14:37:59.353115+0000","last_fullsized":"2023-07-25T14:37:59.353115+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T23:19:20.504472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.353506+0000","last_change":"2023-07-25T14:37:58.273268+0000","last_active":"2023-07-25T14:37:59.353506+0000","last_peered":"2023-07-25T14:37:59.353506+0000","last_clean":"2023-07-25T14:37:59.353506+0000","last_became_active":"2023-07-25T14:37:58.272950+0000","last_became_peered":"2023-07-25T14:37:58.272950+0000","last_unstale":"2023-07-25T14:37:59.353506+0000","last_undegraded":"2023-07-25T14:37:59.353506+0000","last_fullsized":"2023-07-25T14:37:59.353506+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T18:45:07.995927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.353005+0000","last_change":"2023-07-25T14:37:57.257276+0000","last_active":"2023-07-25T14:37:59.353005+0000","last_peered":"2023-07-25T14:37:59.353005+0000","last_clean":"2023-07-25T14:37:59.353005+0000","last_became_active":"2023-07-25T14:37:57.256993+0000","last_became_peered":"2023-07-25T14:37:57.256993+0000","last_unstale":"2023-07-25T14:37:59.353005+0000","last_undegraded":"2023-07-25T14:37:59.353005+0000","last_fullsized":"2023-07-25T14:37:59.353005+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_clean_scrub_stamp":"2023-07-25T14:37:56.225499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T17:40:11.976810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.255720+0000","last_change":"2023-07-25T14:37:45.199815+0000","last_active":"2023-07-25T14:37:59.255720+0000","last_peered":"2023-07-25T14:37:59.255720+0000","last_clean":"2023-07-25T14:37:59.255720+0000","last_became_active":"2023-07-25T14:37:45.199555+0000","last_became_peered":"2023-07-25T14:37:45.199555+0000","last_unstale":"2023-07-25T14:37:59.255720+0000","last_undegraded":"2023-07-25T14:37:59.255720+0000","last_fullsized":"2023-07-25T14:37:59.255720+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:27:37.618593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"57'8","reported_seq":29,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.355396+0000","last_change":"2023-07-25T14:37:44.173212+0000","last_active":"2023-07-25T14:37:59.355396+0000","last_peered":"2023-07-25T14:37:59.355396+0000","last_clean":"2023-07-25T14:37:59.355396+0000","last_became_active":"2023-07-25T14:37:44.172950+0000","last_became_peered":"2023-07-25T14:37:44.172950+0000","last_unstale":"2023-07-25T14:37:59.355396+0000","last_undegraded":"2023-07-25T14:37:59.355396+0000","last_fullsized":"2023-07-25T14:37:59.355396+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T19:06:16.675638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3071,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.353476+0000","last_change":"2023-07-25T14:37:58.267921+0000","last_active":"2023-07-25T14:37:59.353476+0000","last_peered":"2023-07-25T14:37:59.353476+0000","last_clean":"2023-07-25T14:37:59.353476+0000","last_became_active":"2023-07-25T14:37:58.263495+0000","last_became_peered":"2023-07-25T14:37:58.263495+0000","last_unstale":"2023-07-25T14:37:59.353476+0000","last_undegraded":"2023-07-25T14:37:59.353476+0000","last_fullsized":"2023-07-25T14:37:59.353476+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:52:23.301924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"60'3","reported_seq":16,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.353656+0000","last_change":"2023-07-25T14:37:57.258129+0000","last_active":"2023-07-25T14:37:59.353656+0000","last_peered":"2023-07-25T14:37:59.353656+0000","last_clean":"2023-07-25T14:37:59.353656+0000","last_became_active":"2023-07-25T14:37:57.257770+0000","last_became_peered":"2023-07-25T14:37:57.257770+0000","last_unstale":"2023-07-25T14:37:59.353656+0000","last_undegraded":"2023-07-25T14:37:59.353656+0000","last_fullsized":"2023-07-25T14:37:59.353656+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_clean_scrub_stamp":"2023-07-25T14:37:56.225499+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T21:08:31.954016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.353459+0000","last_change":"2023-07-25T14:37:45.203546+0000","last_active":"2023-07-25T14:37:59.353459+0000","last_peered":"2023-07-25T14:37:59.353459+0000","last_clean":"2023-07-25T14:37:59.353459+0000","last_became_active":"2023-07-25T14:37:45.203115+0000","last_became_peered":"2023-07-25T14:37:45.203115+0000","last_unstale":"2023-07-25T14:37:59.353459+0000","last_undegraded":"2023-07-25T14:37:59.353459+0000","last_fullsized":"2023-07-25T14:37:59.353459+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:23:42.852496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"56'2","reported_seq":23,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.355344+0000","last_change":"2023-07-25T14:37:44.164563+0000","last_active":"2023-07-25T14:37:59.355344+0000","last_peered":"2023-07-25T14:37:59.355344+0000","last_clean":"2023-07-25T14:37:59.355344+0000","last_became_active":"2023-07-25T14:37:44.164255+0000","last_became_peered":"2023-07-25T14:37:44.164255+0000","last_unstale":"2023-07-25T14:37:59.355344+0000","last_undegraded":"2023-07-25T14:37:59.355344+0000","last_fullsized":"2023-07-25T14:37:59.355344+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T16:48:43.337902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.253856+0000","last_change":"2023-07-25T14:37:58.261845+0000","last_active":"2023-07-25T14:37:59.253856+0000","last_peered":"2023-07-25T14:37:59.253856+0000","last_clean":"2023-07-25T14:37:59.253856+0000","last_became_active":"2023-07-25T14:37:58.261043+0000","last_became_peered":"2023-07-25T14:37:58.261043+0000","last_unstale":"2023-07-25T14:37:59.253856+0000","last_undegraded":"2023-07-25T14:37:59.253856+0000","last_fullsized":"2023-07-25T14:37:59.253856+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:22:35.512164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"60'6","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.255681+0000","last_change":"2023-07-25T14:37:57.252569+0000","last_active":"2023-07-25T14:37:59.255681+0000","last_peered":"2023-07-25T14:37:59.255681+0000","last_clean":"2023-07-25T14:37:59.255681+0000","last_became_active":"2023-07-25T14:37:57.252285+0000","last_became_peered":"2023-07-25T14:37:57.252285+0000","last_unstale":"2023-07-25T14:37:59.255681+0000","last_undegraded":"2023-07-25T14:37:59.255681+0000","last_fullsized":"2023-07-25T14:37:59.255681+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_clean_scrub_stamp":"2023-07-25T14:37:56.225499+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T01:12:06.057938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.255189+0000","last_change":"2023-07-25T14:37:45.201081+0000","last_active":"2023-07-25T14:37:59.255189+0000","last_peered":"2023-07-25T14:37:59.255189+0000","last_clean":"2023-07-25T14:37:59.255189+0000","last_became_active":"2023-07-25T14:37:45.200738+0000","last_became_peered":"2023-07-25T14:37:45.200738+0000","last_unstale":"2023-07-25T14:37:59.255189+0000","last_undegraded":"2023-07-25T14:37:59.255189+0000","last_fullsized":"2023-07-25T14:37:59.255189+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:11:32.074082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":21,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.354657+0000","last_change":"2023-07-25T14:37:44.173296+0000","last_active":"2023-07-25T14:37:59.354657+0000","last_peered":"2023-07-25T14:37:59.354657+0000","last_clean":"2023-07-25T14:37:59.354657+0000","last_became_active":"2023-07-25T14:37:44.172957+0000","last_became_peered":"2023-07-25T14:37:44.172957+0000","last_unstale":"2023-07-25T14:37:59.354657+0000","last_undegraded":"2023-07-25T14:37:59.354657+0000","last_fullsized":"2023-07-25T14:37:59.354657+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T18:15:12.884852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.352923+0000","last_change":"2023-07-25T14:37:58.264626+0000","last_active":"2023-07-25T14:37:59.352923+0000","last_peered":"2023-07-25T14:37:59.352923+0000","last_clean":"2023-07-25T14:37:59.352923+0000","last_became_active":"2023-07-25T14:37:58.264350+0000","last_became_peered":"2023-07-25T14:37:58.264350+0000","last_unstale":"2023-07-25T14:37:59.352923+0000","last_undegraded":"2023-07-25T14:37:59.352923+0000","last_fullsized":"2023-07-25T14:37:59.352923+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T21:50:12.129185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.355339+0000","last_change":"2023-07-25T14:37:57.254528+0000","last_active":"2023-07-25T14:37:59.355339+0000","last_peered":"2023-07-25T14:37:59.355339+0000","last_clean":"2023-07-25T14:37:59.355339+0000","last_became_active":"2023-07-25T14:37:57.254073+0000","last_became_peered":"2023-07-25T14:37:57.254073+0000","last_unstale":"2023-07-25T14:37:59.355339+0000","last_undegraded":"2023-07-25T14:37:59.355339+0000","last_fullsized":"2023-07-25T14:37:59.355339+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_clean_scrub_stamp":"2023-07-25T14:37:56.225499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T17:58:22.033923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.352715+0000","last_change":"2023-07-25T14:37:45.195068+0000","last_active":"2023-07-25T14:37:59.352715+0000","last_peered":"2023-07-25T14:37:59.352715+0000","last_clean":"2023-07-25T14:37:59.352715+0000","last_became_active":"2023-07-25T14:37:45.194820+0000","last_became_peered":"2023-07-25T14:37:45.194820+0000","last_unstale":"2023-07-25T14:37:59.352715+0000","last_undegraded":"2023-07-25T14:37:59.352715+0000","last_fullsized":"2023-07-25T14:37:59.352715+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T23:27:14.922188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":21,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.255797+0000","last_change":"2023-07-25T14:37:44.166150+0000","last_active":"2023-07-25T14:37:59.255797+0000","last_peered":"2023-07-25T14:37:59.255797+0000","last_clean":"2023-07-25T14:37:59.255797+0000","last_became_active":"2023-07-25T14:37:44.165851+0000","last_became_peered":"2023-07-25T14:37:44.165851+0000","last_unstale":"2023-07-25T14:37:59.255797+0000","last_undegraded":"2023-07-25T14:37:59.255797+0000","last_fullsized":"2023-07-25T14:37:59.255797+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T19:02:49.906914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.255552+0000","last_change":"2023-07-25T14:37:58.252027+0000","last_active":"2023-07-25T14:37:59.255552+0000","last_peered":"2023-07-25T14:37:59.255552+0000","last_clean":"2023-07-25T14:37:59.255552+0000","last_became_active":"2023-07-25T14:37:58.251719+0000","last_became_peered":"2023-07-25T14:37:58.251719+0000","last_unstale":"2023-07-25T14:37:59.255552+0000","last_undegraded":"2023-07-25T14:37:59.255552+0000","last_fullsized":"2023-07-25T14:37:59.255552+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:21:18.689386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.354073+0000","last_change":"2023-07-25T14:37:57.264390+0000","last_active":"2023-07-25T14:37:59.354073+0000","last_peered":"2023-07-25T14:37:59.354073+0000","last_clean":"2023-07-25T14:37:59.354073+0000","last_became_active":"2023-07-25T14:37:57.264110+0000","last_became_peered":"2023-07-25T14:37:57.264110+0000","last_unstale":"2023-07-25T14:37:59.354073+0000","last_undegraded":"2023-07-25T14:37:59.354073+0000","last_fullsized":"2023-07-25T14:37:59.354073+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_clean_scrub_stamp":"2023-07-25T14:37:56.225499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T17:02:33.760834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.254875+0000","last_change":"2023-07-25T14:37:45.193890+0000","last_active":"2023-07-25T14:37:59.254875+0000","last_peered":"2023-07-25T14:37:59.254875+0000","last_clean":"2023-07-25T14:37:59.254875+0000","last_became_active":"2023-07-25T14:37:45.193634+0000","last_became_peered":"2023-07-25T14:37:45.193634+0000","last_unstale":"2023-07-25T14:37:59.254875+0000","last_undegraded":"2023-07-25T14:37:59.254875+0000","last_fullsized":"2023-07-25T14:37:59.254875+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T02:11:14.139374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"56'8","reported_seq":29,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.253486+0000","last_change":"2023-07-25T14:37:44.164996+0000","last_active":"2023-07-25T14:37:59.253486+0000","last_peered":"2023-07-25T14:37:59.253486+0000","last_clean":"2023-07-25T14:37:59.253486+0000","last_became_active":"2023-07-25T14:37:44.164753+0000","last_became_peered":"2023-07-25T14:37:44.164753+0000","last_unstale":"2023-07-25T14:37:59.253486+0000","last_undegraded":"2023-07-25T14:37:59.253486+0000","last_fullsized":"2023-07-25T14:37:59.253486+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T22:19:43.486777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.353210+0000","last_change":"2023-07-25T14:37:58.276220+0000","last_active":"2023-07-25T14:37:59.353210+0000","last_peered":"2023-07-25T14:37:59.353210+0000","last_clean":"2023-07-25T14:37:59.353210+0000","last_became_active":"2023-07-25T14:37:58.275959+0000","last_became_peered":"2023-07-25T14:37:58.275959+0000","last_unstale":"2023-07-25T14:37:59.353210+0000","last_undegraded":"2023-07-25T14:37:59.353210+0000","last_fullsized":"2023-07-25T14:37:59.353210+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T02:24:24.354419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.353590+0000","last_change":"2023-07-25T14:37:57.261183+0000","last_active":"2023-07-25T14:37:59.353590+0000","last_peered":"2023-07-25T14:37:59.353590+0000","last_clean":"2023-07-25T14:37:59.353590+0000","last_became_active":"2023-07-25T14:37:57.260897+0000","last_became_peered":"2023-07-25T14:37:57.260897+0000","last_unstale":"2023-07-25T14:37:59.353590+0000","last_undegraded":"2023-07-25T14:37:59.353590+0000","last_fullsized":"2023-07-25T14:37:59.353590+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_clean_scrub_stamp":"2023-07-25T14:37:56.225499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T01:50:26.093784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.353681+0000","last_change":"2023-07-25T14:37:45.192838+0000","last_active":"2023-07-25T14:37:59.353681+0000","last_peered":"2023-07-25T14:37:59.353681+0000","last_clean":"2023-07-25T14:37:59.353681+0000","last_became_active":"2023-07-25T14:37:45.192552+0000","last_became_peered":"2023-07-25T14:37:45.192552+0000","last_unstale":"2023-07-25T14:37:59.353681+0000","last_undegraded":"2023-07-25T14:37:59.353681+0000","last_fullsized":"2023-07-25T14:37:59.353681+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T17:21:58.816449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"56'2","reported_seq":23,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.355211+0000","last_change":"2023-07-25T14:37:44.163016+0000","last_active":"2023-07-25T14:37:59.355211+0000","last_peered":"2023-07-25T14:37:59.355211+0000","last_clean":"2023-07-25T14:37:59.355211+0000","last_became_active":"2023-07-25T14:37:44.161974+0000","last_became_peered":"2023-07-25T14:37:44.161974+0000","last_unstale":"2023-07-25T14:37:59.355211+0000","last_undegraded":"2023-07-25T14:37:59.355211+0000","last_fullsized":"2023-07-25T14:37:59.355211+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T20:02:33.029907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.353945+0000","last_change":"2023-07-25T14:37:58.255940+0000","last_active":"2023-07-25T14:37:59.353945+0000","last_peered":"2023-07-25T14:37:59.353945+0000","last_clean":"2023-07-25T14:37:59.353945+0000","last_became_active":"2023-07-25T14:37:58.254944+0000","last_became_peered":"2023-07-25T14:37:58.254944+0000","last_unstale":"2023-07-25T14:37:59.353945+0000","last_undegraded":"2023-07-25T14:37:59.353945+0000","last_fullsized":"2023-07-25T14:37:59.353945+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T15:25:23.342278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.253270+0000","last_change":"2023-07-25T14:37:57.261245+0000","last_active":"2023-07-25T14:37:59.253270+0000","last_peered":"2023-07-25T14:37:59.253270+0000","last_clean":"2023-07-25T14:37:59.253270+0000","last_became_active":"2023-07-25T14:37:57.259735+0000","last_became_peered":"2023-07-25T14:37:57.259735+0000","last_unstale":"2023-07-25T14:37:59.253270+0000","last_undegraded":"2023-07-25T14:37:59.253270+0000","last_fullsized":"2023-07-25T14:37:59.253270+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_clean_scrub_stamp":"2023-07-25T14:37:56.225499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T23:37:53.349690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.255714+0000","last_change":"2023-07-25T14:37:45.198281+0000","last_active":"2023-07-25T14:37:59.255714+0000","last_peered":"2023-07-25T14:37:59.255714+0000","last_clean":"2023-07-25T14:37:59.255714+0000","last_became_active":"2023-07-25T14:37:45.197975+0000","last_became_peered":"2023-07-25T14:37:45.197975+0000","last_unstale":"2023-07-25T14:37:59.255714+0000","last_undegraded":"2023-07-25T14:37:59.255714+0000","last_fullsized":"2023-07-25T14:37:59.255714+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T01:34:38.725451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"57'1","reported_seq":22,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.255679+0000","last_change":"2023-07-25T14:37:44.166254+0000","last_active":"2023-07-25T14:37:59.255679+0000","last_peered":"2023-07-25T14:37:59.255679+0000","last_clean":"2023-07-25T14:37:59.255679+0000","last_became_active":"2023-07-25T14:37:44.165974+0000","last_became_peered":"2023-07-25T14:37:44.165974+0000","last_unstale":"2023-07-25T14:37:59.255679+0000","last_undegraded":"2023-07-25T14:37:59.255679+0000","last_fullsized":"2023-07-25T14:37:59.255679+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T23:02:46.102683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.255069+0000","last_change":"2023-07-25T14:37:58.263394+0000","last_active":"2023-07-25T14:37:59.255069+0000","last_peered":"2023-07-25T14:37:59.255069+0000","last_clean":"2023-07-25T14:37:59.255069+0000","last_became_active":"2023-07-25T14:37:58.263113+0000","last_became_peered":"2023-07-25T14:37:58.263113+0000","last_unstale":"2023-07-25T14:37:59.255069+0000","last_undegraded":"2023-07-25T14:37:59.255069+0000","last_fullsized":"2023-07-25T14:37:59.255069+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T21:08:32.959436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.352880+0000","last_change":"2023-07-25T14:37:57.257509+0000","last_active":"2023-07-25T14:37:59.352880+0000","last_peered":"2023-07-25T14:37:59.352880+0000","last_clean":"2023-07-25T14:37:59.352880+0000","last_became_active":"2023-07-25T14:37:57.257227+0000","last_became_peered":"2023-07-25T14:37:57.257227+0000","last_unstale":"2023-07-25T14:37:59.352880+0000","last_undegraded":"2023-07-25T14:37:59.352880+0000","last_fullsized":"2023-07-25T14:37:59.352880+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_clean_scrub_stamp":"2023-07-25T14:37:56.225499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T22:12:40.021720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.354153+0000","last_change":"2023-07-25T14:37:45.209704+0000","last_active":"2023-07-25T14:37:59.354153+0000","last_peered":"2023-07-25T14:37:59.354153+0000","last_clean":"2023-07-25T14:37:59.354153+0000","last_became_active":"2023-07-25T14:37:45.209391+0000","last_became_peered":"2023-07-25T14:37:45.209391+0000","last_unstale":"2023-07-25T14:37:59.354153+0000","last_undegraded":"2023-07-25T14:37:59.354153+0000","last_fullsized":"2023-07-25T14:37:59.354153+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T23:37:41.269324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":21,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.255506+0000","last_change":"2023-07-25T14:37:44.166101+0000","last_active":"2023-07-25T14:37:59.255506+0000","last_peered":"2023-07-25T14:37:59.255506+0000","last_clean":"2023-07-25T14:37:59.255506+0000","last_became_active":"2023-07-25T14:37:44.165823+0000","last_became_peered":"2023-07-25T14:37:44.165823+0000","last_unstale":"2023-07-25T14:37:59.255506+0000","last_undegraded":"2023-07-25T14:37:59.255506+0000","last_fullsized":"2023-07-25T14:37:59.255506+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:38:22.173444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.352802+0000","last_change":"2023-07-25T14:37:58.269040+0000","last_active":"2023-07-25T14:37:59.352802+0000","last_peered":"2023-07-25T14:37:59.352802+0000","last_clean":"2023-07-25T14:37:59.352802+0000","last_became_active":"2023-07-25T14:37:58.268758+0000","last_became_peered":"2023-07-25T14:37:58.268758+0000","last_unstale":"2023-07-25T14:37:59.352802+0000","last_undegraded":"2023-07-25T14:37:59.352802+0000","last_fullsized":"2023-07-25T14:37:59.352802+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T19:20:13.436831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.253749+0000","last_change":"2023-07-25T14:37:57.260967+0000","last_active":"2023-07-25T14:37:59.253749+0000","last_peered":"2023-07-25T14:37:59.253749+0000","last_clean":"2023-07-25T14:37:59.253749+0000","last_became_active":"2023-07-25T14:37:57.259766+0000","last_became_peered":"2023-07-25T14:37:57.259766+0000","last_unstale":"2023-07-25T14:37:59.253749+0000","last_undegraded":"2023-07-25T14:37:59.253749+0000","last_fullsized":"2023-07-25T14:37:59.253749+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_clean_scrub_stamp":"2023-07-25T14:37:56.225499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T21:50:11.123765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.354678+0000","last_change":"2023-07-25T14:37:45.207757+0000","last_active":"2023-07-25T14:37:59.354678+0000","last_peered":"2023-07-25T14:37:59.354678+0000","last_clean":"2023-07-25T14:37:59.354678+0000","last_became_active":"2023-07-25T14:37:45.204097+0000","last_became_peered":"2023-07-25T14:37:45.204097+0000","last_unstale":"2023-07-25T14:37:59.354678+0000","last_undegraded":"2023-07-25T14:37:59.354678+0000","last_fullsized":"2023-07-25T14:37:59.354678+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:22:22.426378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":21,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.353919+0000","last_change":"2023-07-25T14:37:44.170019+0000","last_active":"2023-07-25T14:37:59.353919+0000","last_peered":"2023-07-25T14:37:59.353919+0000","last_clean":"2023-07-25T14:37:59.353919+0000","last_became_active":"2023-07-25T14:37:44.169764+0000","last_became_peered":"2023-07-25T14:37:44.169764+0000","last_unstale":"2023-07-25T14:37:59.353919+0000","last_undegraded":"2023-07-25T14:37:59.353919+0000","last_fullsized":"2023-07-25T14:37:59.353919+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T22:44:30.774104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.354543+0000","last_change":"2023-07-25T14:37:58.255540+0000","last_active":"2023-07-25T14:37:59.354543+0000","last_peered":"2023-07-25T14:37:59.354543+0000","last_clean":"2023-07-25T14:37:59.354543+0000","last_became_active":"2023-07-25T14:37:58.255227+0000","last_became_peered":"2023-07-25T14:37:58.255227+0000","last_unstale":"2023-07-25T14:37:59.354543+0000","last_undegraded":"2023-07-25T14:37:59.354543+0000","last_fullsized":"2023-07-25T14:37:59.354543+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T01:12:07.063358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.354037+0000","last_change":"2023-07-25T14:37:57.252733+0000","last_active":"2023-07-25T14:37:59.354037+0000","last_peered":"2023-07-25T14:37:59.354037+0000","last_clean":"2023-07-25T14:37:59.354037+0000","last_became_active":"2023-07-25T14:37:57.252027+0000","last_became_peered":"2023-07-25T14:37:57.252027+0000","last_unstale":"2023-07-25T14:37:59.354037+0000","last_undegraded":"2023-07-25T14:37:59.354037+0000","last_fullsized":"2023-07-25T14:37:59.354037+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_clean_scrub_stamp":"2023-07-25T14:37:56.225499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T15:55:03.806235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.255759+0000","last_change":"2023-07-25T14:37:45.192706+0000","last_active":"2023-07-25T14:37:59.255759+0000","last_peered":"2023-07-25T14:37:59.255759+0000","last_clean":"2023-07-25T14:37:59.255759+0000","last_became_active":"2023-07-25T14:37:45.191283+0000","last_became_peered":"2023-07-25T14:37:45.191283+0000","last_unstale":"2023-07-25T14:37:59.255759+0000","last_undegraded":"2023-07-25T14:37:59.255759+0000","last_fullsized":"2023-07-25T14:37:59.255759+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T01:09:03.425047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":21,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.255260+0000","last_change":"2023-07-25T14:37:44.171694+0000","last_active":"2023-07-25T14:37:59.255260+0000","last_peered":"2023-07-25T14:37:59.255260+0000","last_clean":"2023-07-25T14:37:59.255260+0000","last_became_active":"2023-07-25T14:37:44.171465+0000","last_became_peered":"2023-07-25T14:37:44.171465+0000","last_unstale":"2023-07-25T14:37:59.255260+0000","last_undegraded":"2023-07-25T14:37:59.255260+0000","last_fullsized":"2023-07-25T14:37:59.255260+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T19:43:30.626125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.253582+0000","last_change":"2023-07-25T14:37:58.262039+0000","last_active":"2023-07-25T14:37:59.253582+0000","last_peered":"2023-07-25T14:37:59.253582+0000","last_clean":"2023-07-25T14:37:59.253582+0000","last_became_active":"2023-07-25T14:37:58.261440+0000","last_became_peered":"2023-07-25T14:37:58.261440+0000","last_unstale":"2023-07-25T14:37:59.253582+0000","last_undegraded":"2023-07-25T14:37:59.253582+0000","last_fullsized":"2023-07-25T14:37:59.253582+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T23:50:15.511943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.354786+0000","last_change":"2023-07-25T14:37:57.253502+0000","last_active":"2023-07-25T14:37:59.354786+0000","last_peered":"2023-07-25T14:37:59.354786+0000","last_clean":"2023-07-25T14:37:59.354786+0000","last_became_active":"2023-07-25T14:37:57.253160+0000","last_became_peered":"2023-07-25T14:37:57.253160+0000","last_unstale":"2023-07-25T14:37:59.354786+0000","last_undegraded":"2023-07-25T14:37:59.354786+0000","last_fullsized":"2023-07-25T14:37:59.354786+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_clean_scrub_stamp":"2023-07-25T14:37:56.225499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T21:36:41.667564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.353986+0000","last_change":"2023-07-25T14:37:45.208487+0000","last_active":"2023-07-25T14:37:59.353986+0000","last_peered":"2023-07-25T14:37:59.353986+0000","last_clean":"2023-07-25T14:37:59.353986+0000","last_became_active":"2023-07-25T14:37:45.207037+0000","last_became_peered":"2023-07-25T14:37:45.207037+0000","last_unstale":"2023-07-25T14:37:59.353986+0000","last_undegraded":"2023-07-25T14:37:59.353986+0000","last_fullsized":"2023-07-25T14:37:59.353986+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T17:19:54.370051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":21,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.355360+0000","last_change":"2023-07-25T14:37:44.165012+0000","last_active":"2023-07-25T14:37:59.355360+0000","last_peered":"2023-07-25T14:37:59.355360+0000","last_clean":"2023-07-25T14:37:59.355360+0000","last_became_active":"2023-07-25T14:37:44.164759+0000","last_became_peered":"2023-07-25T14:37:44.164759+0000","last_unstale":"2023-07-25T14:37:59.355360+0000","last_undegraded":"2023-07-25T14:37:59.355360+0000","last_fullsized":"2023-07-25T14:37:59.355360+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T01:48:31.890423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.254189+0000","last_change":"2023-07-25T14:37:58.255039+0000","last_active":"2023-07-25T14:37:59.254189+0000","last_peered":"2023-07-25T14:37:59.254189+0000","last_clean":"2023-07-25T14:37:59.254189+0000","last_became_active":"2023-07-25T14:37:58.254784+0000","last_became_peered":"2023-07-25T14:37:58.254784+0000","last_unstale":"2023-07-25T14:37:59.254189+0000","last_undegraded":"2023-07-25T14:37:59.254189+0000","last_fullsized":"2023-07-25T14:37:59.254189+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T19:28:19.281913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"60'2","reported_seq":15,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.355538+0000","last_change":"2023-07-25T14:37:57.261057+0000","last_active":"2023-07-25T14:37:59.355538+0000","last_peered":"2023-07-25T14:37:59.355538+0000","last_clean":"2023-07-25T14:37:59.355538+0000","last_became_active":"2023-07-25T14:37:57.260773+0000","last_became_peered":"2023-07-25T14:37:57.260773+0000","last_unstale":"2023-07-25T14:37:59.355538+0000","last_undegraded":"2023-07-25T14:37:59.355538+0000","last_fullsized":"2023-07-25T14:37:59.355538+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_clean_scrub_stamp":"2023-07-25T14:37:56.225499+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T22:28:26.670719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.355030+0000","last_change":"2023-07-25T14:37:45.191681+0000","last_active":"2023-07-25T14:37:59.355030+0000","last_peered":"2023-07-25T14:37:59.355030+0000","last_clean":"2023-07-25T14:37:59.355030+0000","last_became_active":"2023-07-25T14:37:45.188974+0000","last_became_peered":"2023-07-25T14:37:45.188974+0000","last_unstale":"2023-07-25T14:37:59.355030+0000","last_undegraded":"2023-07-25T14:37:59.355030+0000","last_fullsized":"2023-07-25T14:37:59.355030+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T20:19:02.577921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":21,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.253413+0000","last_change":"2023-07-25T14:37:44.164983+0000","last_active":"2023-07-25T14:37:59.253413+0000","last_peered":"2023-07-25T14:37:59.253413+0000","last_clean":"2023-07-25T14:37:59.253413+0000","last_became_active":"2023-07-25T14:37:44.164413+0000","last_became_peered":"2023-07-25T14:37:44.164413+0000","last_unstale":"2023-07-25T14:37:59.253413+0000","last_undegraded":"2023-07-25T14:37:59.253413+0000","last_fullsized":"2023-07-25T14:37:59.253413+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T20:15:24.489734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.355326+0000","last_change":"2023-07-25T14:37:58.267676+0000","last_active":"2023-07-25T14:37:59.355326+0000","last_peered":"2023-07-25T14:37:59.355326+0000","last_clean":"2023-07-25T14:37:59.355326+0000","last_became_active":"2023-07-25T14:37:58.267393+0000","last_became_peered":"2023-07-25T14:37:58.267393+0000","last_unstale":"2023-07-25T14:37:59.355326+0000","last_undegraded":"2023-07-25T14:37:59.355326+0000","last_fullsized":"2023-07-25T14:37:59.355326+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T19:28:19.281913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.355568+0000","last_change":"2023-07-25T14:37:57.264182+0000","last_active":"2023-07-25T14:37:59.355568+0000","last_peered":"2023-07-25T14:37:59.355568+0000","last_clean":"2023-07-25T14:37:59.355568+0000","last_became_active":"2023-07-25T14:37:57.263876+0000","last_became_peered":"2023-07-25T14:37:57.263876+0000","last_unstale":"2023-07-25T14:37:59.355568+0000","last_undegraded":"2023-07-25T14:37:59.355568+0000","last_fullsized":"2023-07-25T14:37:59.355568+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_clean_scrub_stamp":"2023-07-25T14:37:56.225499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T22:42:00.280992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.353985+0000","last_change":"2023-07-25T14:37:45.192970+0000","last_active":"2023-07-25T14:37:59.353985+0000","last_peered":"2023-07-25T14:37:59.353985+0000","last_clean":"2023-07-25T14:37:59.353985+0000","last_became_active":"2023-07-25T14:37:45.192666+0000","last_became_peered":"2023-07-25T14:37:45.192666+0000","last_unstale":"2023-07-25T14:37:59.353985+0000","last_undegraded":"2023-07-25T14:37:59.353985+0000","last_fullsized":"2023-07-25T14:37:59.353985+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T19:02:50.908530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":21,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.353632+0000","last_change":"2023-07-25T14:37:44.168526+0000","last_active":"2023-07-25T14:37:59.353632+0000","last_peered":"2023-07-25T14:37:59.353632+0000","last_clean":"2023-07-25T14:37:59.353632+0000","last_became_active":"2023-07-25T14:37:44.168336+0000","last_became_peered":"2023-07-25T14:37:44.168336+0000","last_unstale":"2023-07-25T14:37:59.353632+0000","last_undegraded":"2023-07-25T14:37:59.353632+0000","last_fullsized":"2023-07-25T14:37:59.353632+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T15:46:45.390857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.254942+0000","last_change":"2023-07-25T14:37:58.266220+0000","last_active":"2023-07-25T14:37:59.254942+0000","last_peered":"2023-07-25T14:37:59.254942+0000","last_clean":"2023-07-25T14:37:59.254942+0000","last_became_active":"2023-07-25T14:37:58.265981+0000","last_became_peered":"2023-07-25T14:37:58.265981+0000","last_unstale":"2023-07-25T14:37:59.254942+0000","last_undegraded":"2023-07-25T14:37:59.254942+0000","last_fullsized":"2023-07-25T14:37:59.254942+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T01:50:27.099203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.255399+0000","last_change":"2023-07-25T14:37:57.250015+0000","last_active":"2023-07-25T14:37:59.255399+0000","last_peered":"2023-07-25T14:37:59.255399+0000","last_clean":"2023-07-25T14:37:59.255399+0000","last_became_active":"2023-07-25T14:37:57.249747+0000","last_became_peered":"2023-07-25T14:37:57.249747+0000","last_unstale":"2023-07-25T14:37:59.255399+0000","last_undegraded":"2023-07-25T14:37:59.255399+0000","last_fullsized":"2023-07-25T14:37:59.255399+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_clean_scrub_stamp":"2023-07-25T14:37:56.225499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T23:57:24.618192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.255604+0000","last_change":"2023-07-25T14:37:45.202784+0000","last_active":"2023-07-25T14:37:59.255604+0000","last_peered":"2023-07-25T14:37:59.255604+0000","last_clean":"2023-07-25T14:37:59.255604+0000","last_became_active":"2023-07-25T14:37:45.202515+0000","last_became_peered":"2023-07-25T14:37:45.202515+0000","last_unstale":"2023-07-25T14:37:59.255604+0000","last_undegraded":"2023-07-25T14:37:59.255604+0000","last_fullsized":"2023-07-25T14:37:59.255604+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T02:17:20.156479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":21,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.354227+0000","last_change":"2023-07-25T14:37:44.170162+0000","last_active":"2023-07-25T14:37:59.354227+0000","last_peered":"2023-07-25T14:37:59.354227+0000","last_clean":"2023-07-25T14:37:59.354227+0000","last_became_active":"2023-07-25T14:37:44.169805+0000","last_became_peered":"2023-07-25T14:37:44.169805+0000","last_unstale":"2023-07-25T14:37:59.354227+0000","last_undegraded":"2023-07-25T14:37:59.354227+0000","last_fullsized":"2023-07-25T14:37:59.354227+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T23:25:09.227827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":92,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.355191+0000","last_change":"2023-07-25T14:35:34.370772+0000","last_active":"2023-07-25T14:37:59.355191+0000","last_peered":"2023-07-25T14:37:59.355191+0000","last_clean":"2023-07-25T14:37:59.355191+0000","last_became_active":"2023-07-25T14:35:34.370549+0000","last_became_peered":"2023-07-25T14:35:34.370549+0000","last_unstale":"2023-07-25T14:37:59.355191+0000","last_undegraded":"2023-07-25T14:37:59.355191+0000","last_fullsized":"2023-07-25T14:37:59.355191+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_clean_scrub_stamp":"2023-07-25T14:35:33.358525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T23:25:23.438453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.255659+0000","last_change":"2023-07-25T14:37:58.276530+0000","last_active":"2023-07-25T14:37:59.255659+0000","last_peered":"2023-07-25T14:37:59.255659+0000","last_clean":"2023-07-25T14:37:59.255659+0000","last_became_active":"2023-07-25T14:37:58.275948+0000","last_became_peered":"2023-07-25T14:37:58.275948+0000","last_unstale":"2023-07-25T14:37:59.255659+0000","last_undegraded":"2023-07-25T14:37:59.255659+0000","last_fullsized":"2023-07-25T14:37:59.255659+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T15:10:47.053810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"60'2","reported_seq":15,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.353203+0000","last_change":"2023-07-25T14:37:57.254095+0000","last_active":"2023-07-25T14:37:59.353203+0000","last_peered":"2023-07-25T14:37:59.353203+0000","last_clean":"2023-07-25T14:37:59.353203+0000","last_became_active":"2023-07-25T14:37:57.253803+0000","last_became_peered":"2023-07-25T14:37:57.253803+0000","last_unstale":"2023-07-25T14:37:59.353203+0000","last_undegraded":"2023-07-25T14:37:59.353203+0000","last_fullsized":"2023-07-25T14:37:59.353203+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_clean_scrub_stamp":"2023-07-25T14:37:56.225499+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T19:28:18.276493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.355313+0000","last_change":"2023-07-25T14:37:45.194744+0000","last_active":"2023-07-25T14:37:59.355313+0000","last_peered":"2023-07-25T14:37:59.355313+0000","last_clean":"2023-07-25T14:37:59.355313+0000","last_became_active":"2023-07-25T14:37:45.194393+0000","last_became_peered":"2023-07-25T14:37:45.194393+0000","last_unstale":"2023-07-25T14:37:59.355313+0000","last_undegraded":"2023-07-25T14:37:59.355313+0000","last_fullsized":"2023-07-25T14:37:59.355313+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T21:01:07.274086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"56'1","reported_seq":22,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.354423+0000","last_change":"2023-07-25T14:37:44.166450+0000","last_active":"2023-07-25T14:37:59.354423+0000","last_peered":"2023-07-25T14:37:59.354423+0000","last_clean":"2023-07-25T14:37:59.354423+0000","last_became_active":"2023-07-25T14:37:44.165513+0000","last_became_peered":"2023-07-25T14:37:44.165513+0000","last_unstale":"2023-07-25T14:37:59.354423+0000","last_undegraded":"2023-07-25T14:37:59.354423+0000","last_fullsized":"2023-07-25T14:37:59.354423+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T01:34:37.723835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":92,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.354605+0000","last_change":"2023-07-25T14:35:35.321055+0000","last_active":"2023-07-25T14:37:59.354605+0000","last_peered":"2023-07-25T14:37:59.354605+0000","last_clean":"2023-07-25T14:37:59.354605+0000","last_became_active":"2023-07-25T14:35:35.320739+0000","last_became_peered":"2023-07-25T14:35:35.320739+0000","last_unstale":"2023-07-25T14:37:59.354605+0000","last_undegraded":"2023-07-25T14:37:59.354605+0000","last_fullsized":"2023-07-25T14:37:59.354605+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_clean_scrub_stamp":"2023-07-25T14:35:33.358525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T01:20:46.377691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.253424+0000","last_change":"2023-07-25T14:37:58.268807+0000","last_active":"2023-07-25T14:37:59.253424+0000","last_peered":"2023-07-25T14:37:59.253424+0000","last_clean":"2023-07-25T14:37:59.253424+0000","last_became_active":"2023-07-25T14:37:58.268383+0000","last_became_peered":"2023-07-25T14:37:58.268383+0000","last_unstale":"2023-07-25T14:37:59.253424+0000","last_undegraded":"2023-07-25T14:37:59.253424+0000","last_fullsized":"2023-07-25T14:37:59.253424+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T02:13:09.943612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.353687+0000","last_change":"2023-07-25T14:37:57.252413+0000","last_active":"2023-07-25T14:37:59.353687+0000","last_peered":"2023-07-25T14:37:59.353687+0000","last_clean":"2023-07-25T14:37:59.353687+0000","last_became_active":"2023-07-25T14:37:57.252131+0000","last_became_peered":"2023-07-25T14:37:57.252131+0000","last_unstale":"2023-07-25T14:37:59.353687+0000","last_undegraded":"2023-07-25T14:37:59.353687+0000","last_fullsized":"2023-07-25T14:37:59.353687+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_clean_scrub_stamp":"2023-07-25T14:37:56.225499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T02:26:45.352413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.353339+0000","last_change":"2023-07-25T14:37:45.197932+0000","last_active":"2023-07-25T14:37:59.353339+0000","last_peered":"2023-07-25T14:37:59.353339+0000","last_clean":"2023-07-25T14:37:59.353339+0000","last_became_active":"2023-07-25T14:37:45.197610+0000","last_became_peered":"2023-07-25T14:37:45.197610+0000","last_unstale":"2023-07-25T14:37:59.353339+0000","last_undegraded":"2023-07-25T14:37:59.353339+0000","last_fullsized":"2023-07-25T14:37:59.353339+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T16:00:00.983255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":21,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.354806+0000","last_change":"2023-07-25T14:37:44.166137+0000","last_active":"2023-07-25T14:37:59.354806+0000","last_peered":"2023-07-25T14:37:59.354806+0000","last_clean":"2023-07-25T14:37:59.354806+0000","last_became_active":"2023-07-25T14:37:44.165836+0000","last_became_peered":"2023-07-25T14:37:44.165836+0000","last_unstale":"2023-07-25T14:37:59.354806+0000","last_undegraded":"2023-07-25T14:37:59.354806+0000","last_fullsized":"2023-07-25T14:37:59.354806+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:47:45.268358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":100,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.256021+0000","last_change":"2023-07-25T14:35:35.321057+0000","last_active":"2023-07-25T14:37:59.256021+0000","last_peered":"2023-07-25T14:37:59.256021+0000","last_clean":"2023-07-25T14:37:59.256021+0000","last_became_active":"2023-07-25T14:35:35.320751+0000","last_became_peered":"2023-07-25T14:35:35.320751+0000","last_unstale":"2023-07-25T14:37:59.256021+0000","last_undegraded":"2023-07-25T14:37:59.256021+0000","last_fullsized":"2023-07-25T14:37:59.256021+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_clean_scrub_stamp":"2023-07-25T14:35:33.358525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T19:31:35.569131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.355119+0000","last_change":"2023-07-25T14:37:58.269302+0000","last_active":"2023-07-25T14:37:59.355119+0000","last_peered":"2023-07-25T14:37:59.355119+0000","last_clean":"2023-07-25T14:37:59.355119+0000","last_became_active":"2023-07-25T14:37:58.269050+0000","last_became_peered":"2023-07-25T14:37:58.269050+0000","last_unstale":"2023-07-25T14:37:59.355119+0000","last_undegraded":"2023-07-25T14:37:59.355119+0000","last_fullsized":"2023-07-25T14:37:59.355119+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T15:57:56.554035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"60'1","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.354312+0000","last_change":"2023-07-25T14:37:57.260989+0000","last_active":"2023-07-25T14:37:59.354312+0000","last_peered":"2023-07-25T14:37:59.354312+0000","last_clean":"2023-07-25T14:37:59.354312+0000","last_became_active":"2023-07-25T14:37:57.260668+0000","last_became_peered":"2023-07-25T14:37:57.260668+0000","last_unstale":"2023-07-25T14:37:59.354312+0000","last_undegraded":"2023-07-25T14:37:59.354312+0000","last_fullsized":"2023-07-25T14:37:59.354312+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_clean_scrub_stamp":"2023-07-25T14:37:56.225499+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T20:16:32.556491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.353208+0000","last_change":"2023-07-25T14:37:45.195875+0000","last_active":"2023-07-25T14:37:59.353208+0000","last_peered":"2023-07-25T14:37:59.353208+0000","last_clean":"2023-07-25T14:37:59.353208+0000","last_became_active":"2023-07-25T14:37:45.195516+0000","last_became_peered":"2023-07-25T14:37:45.195516+0000","last_unstale":"2023-07-25T14:37:59.353208+0000","last_undegraded":"2023-07-25T14:37:59.353208+0000","last_fullsized":"2023-07-25T14:37:59.353208+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T18:09:47.450177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"56'2","reported_seq":23,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.354374+0000","last_change":"2023-07-25T14:37:44.167253+0000","last_active":"2023-07-25T14:37:59.354374+0000","last_peered":"2023-07-25T14:37:59.354374+0000","last_clean":"2023-07-25T14:37:59.354374+0000","last_became_active":"2023-07-25T14:37:44.166775+0000","last_became_peered":"2023-07-25T14:37:44.166775+0000","last_unstale":"2023-07-25T14:37:59.354374+0000","last_undegraded":"2023-07-25T14:37:59.354374+0000","last_fullsized":"2023-07-25T14:37:59.354374+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T15:04:37.408551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":92,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.353876+0000","last_change":"2023-07-25T14:35:35.321201+0000","last_active":"2023-07-25T14:37:59.353876+0000","last_peered":"2023-07-25T14:37:59.353876+0000","last_clean":"2023-07-25T14:37:59.353876+0000","last_became_active":"2023-07-25T14:35:35.320728+0000","last_became_peered":"2023-07-25T14:35:35.320728+0000","last_unstale":"2023-07-25T14:37:59.353876+0000","last_undegraded":"2023-07-25T14:37:59.353876+0000","last_fullsized":"2023-07-25T14:37:59.353876+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_clean_scrub_stamp":"2023-07-25T14:35:33.358525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T20:43:19.501209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.354369+0000","last_change":"2023-07-25T14:37:58.260726+0000","last_active":"2023-07-25T14:37:59.354369+0000","last_peered":"2023-07-25T14:37:59.354369+0000","last_clean":"2023-07-25T14:37:59.354369+0000","last_became_active":"2023-07-25T14:37:58.260402+0000","last_became_peered":"2023-07-25T14:37:58.260402+0000","last_unstale":"2023-07-25T14:37:59.354369+0000","last_undegraded":"2023-07-25T14:37:59.354369+0000","last_fullsized":"2023-07-25T14:37:59.354369+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T22:19:57.574178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"60'1","reported_seq":14,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.355524+0000","last_change":"2023-07-25T14:37:57.254343+0000","last_active":"2023-07-25T14:37:59.355524+0000","last_peered":"2023-07-25T14:37:59.355524+0000","last_clean":"2023-07-25T14:37:59.355524+0000","last_became_active":"2023-07-25T14:37:57.253567+0000","last_became_peered":"2023-07-25T14:37:57.253567+0000","last_unstale":"2023-07-25T14:37:59.355524+0000","last_undegraded":"2023-07-25T14:37:59.355524+0000","last_fullsized":"2023-07-25T14:37:59.355524+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_clean_scrub_stamp":"2023-07-25T14:37:56.225499+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:13:00.646026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.352565+0000","last_change":"2023-07-25T14:37:45.209554+0000","last_active":"2023-07-25T14:37:59.352565+0000","last_peered":"2023-07-25T14:37:59.352565+0000","last_clean":"2023-07-25T14:37:59.352565+0000","last_became_active":"2023-07-25T14:37:45.209319+0000","last_became_peered":"2023-07-25T14:37:45.209319+0000","last_unstale":"2023-07-25T14:37:59.352565+0000","last_undegraded":"2023-07-25T14:37:59.352565+0000","last_fullsized":"2023-07-25T14:37:59.352565+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T23:50:02.426158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":21,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.255956+0000","last_change":"2023-07-25T14:37:44.172803+0000","last_active":"2023-07-25T14:37:59.255956+0000","last_peered":"2023-07-25T14:37:59.255956+0000","last_clean":"2023-07-25T14:37:59.255956+0000","last_became_active":"2023-07-25T14:37:44.172512+0000","last_became_peered":"2023-07-25T14:37:44.172512+0000","last_unstale":"2023-07-25T14:37:59.255956+0000","last_undegraded":"2023-07-25T14:37:59.255956+0000","last_fullsized":"2023-07-25T14:37:59.255956+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T01:22:56.162683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":92,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.353366+0000","last_change":"2023-07-25T14:35:35.321448+0000","last_active":"2023-07-25T14:37:59.353366+0000","last_peered":"2023-07-25T14:37:59.353366+0000","last_clean":"2023-07-25T14:37:59.353366+0000","last_became_active":"2023-07-25T14:35:35.320830+0000","last_became_peered":"2023-07-25T14:35:35.320830+0000","last_unstale":"2023-07-25T14:37:59.353366+0000","last_undegraded":"2023-07-25T14:37:59.353366+0000","last_fullsized":"2023-07-25T14:37:59.353366+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_clean_scrub_stamp":"2023-07-25T14:35:33.358525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T15:24:16.390167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.355106+0000","last_change":"2023-07-25T14:37:58.264469+0000","last_active":"2023-07-25T14:37:59.355106+0000","last_peered":"2023-07-25T14:37:59.355106+0000","last_clean":"2023-07-25T14:37:59.355106+0000","last_became_active":"2023-07-25T14:37:58.263999+0000","last_became_peered":"2023-07-25T14:37:58.263999+0000","last_unstale":"2023-07-25T14:37:59.355106+0000","last_undegraded":"2023-07-25T14:37:59.355106+0000","last_fullsized":"2023-07-25T14:37:59.355106+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T17:02:45.018562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"60'2","reported_seq":15,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.353632+0000","last_change":"2023-07-25T14:37:57.264239+0000","last_active":"2023-07-25T14:37:59.353632+0000","last_peered":"2023-07-25T14:37:59.353632+0000","last_clean":"2023-07-25T14:37:59.353632+0000","last_became_active":"2023-07-25T14:37:57.263940+0000","last_became_peered":"2023-07-25T14:37:57.263940+0000","last_unstale":"2023-07-25T14:37:59.353632+0000","last_undegraded":"2023-07-25T14:37:59.353632+0000","last_fullsized":"2023-07-25T14:37:59.353632+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_clean_scrub_stamp":"2023-07-25T14:37:56.225499+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T16:38:31.603176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.353149+0000","last_change":"2023-07-25T14:37:45.207283+0000","last_active":"2023-07-25T14:37:59.353149+0000","last_peered":"2023-07-25T14:37:59.353149+0000","last_clean":"2023-07-25T14:37:59.353149+0000","last_became_active":"2023-07-25T14:37:45.206954+0000","last_became_peered":"2023-07-25T14:37:45.206954+0000","last_unstale":"2023-07-25T14:37:59.353149+0000","last_undegraded":"2023-07-25T14:37:59.353149+0000","last_fullsized":"2023-07-25T14:37:59.353149+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T20:37:48.433030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":21,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.352835+0000","last_change":"2023-07-25T14:37:44.172365+0000","last_active":"2023-07-25T14:37:59.352835+0000","last_peered":"2023-07-25T14:37:59.352835+0000","last_clean":"2023-07-25T14:37:59.352835+0000","last_became_active":"2023-07-25T14:37:44.172127+0000","last_became_peered":"2023-07-25T14:37:44.172127+0000","last_unstale":"2023-07-25T14:37:59.352835+0000","last_undegraded":"2023-07-25T14:37:59.352835+0000","last_fullsized":"2023-07-25T14:37:59.352835+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T23:04:37.348348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":242,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.353735+0000","last_change":"2023-07-25T14:35:34.372381+0000","last_active":"2023-07-25T14:37:59.353735+0000","last_peered":"2023-07-25T14:37:59.353735+0000","last_clean":"2023-07-25T14:37:59.353735+0000","last_became_active":"2023-07-25T14:35:34.371110+0000","last_became_peered":"2023-07-25T14:35:34.371110+0000","last_unstale":"2023-07-25T14:37:59.353735+0000","last_undegraded":"2023-07-25T14:37:59.353735+0000","last_fullsized":"2023-07-25T14:37:59.353735+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_clean_scrub_stamp":"2023-07-25T14:35:33.358525+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T23:46:41.355823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":90,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.355212+0000","last_change":"2023-07-25T14:35:34.370121+0000","last_active":"2023-07-25T14:37:59.355212+0000","last_peered":"2023-07-25T14:37:59.355212+0000","last_clean":"2023-07-25T14:37:59.355212+0000","last_became_active":"2023-07-25T14:35:34.369795+0000","last_became_peered":"2023-07-25T14:35:34.369795+0000","last_unstale":"2023-07-25T14:37:59.355212+0000","last_undegraded":"2023-07-25T14:37:59.355212+0000","last_fullsized":"2023-07-25T14:37:59.355212+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_clean_scrub_stamp":"2023-07-25T14:35:33.358525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T23:47:21.332532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.254963+0000","last_change":"2023-07-25T14:37:58.252372+0000","last_active":"2023-07-25T14:37:59.254963+0000","last_peered":"2023-07-25T14:37:59.254963+0000","last_clean":"2023-07-25T14:37:59.254963+0000","last_became_active":"2023-07-25T14:37:58.252088+0000","last_became_peered":"2023-07-25T14:37:58.252088+0000","last_unstale":"2023-07-25T14:37:59.254963+0000","last_undegraded":"2023-07-25T14:37:59.254963+0000","last_fullsized":"2023-07-25T14:37:59.254963+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:00:12.125505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.254923+0000","last_change":"2023-07-25T14:37:57.252650+0000","last_active":"2023-07-25T14:37:59.254923+0000","last_peered":"2023-07-25T14:37:59.254923+0000","last_clean":"2023-07-25T14:37:59.254923+0000","last_became_active":"2023-07-25T14:37:57.252334+0000","last_became_peered":"2023-07-25T14:37:57.252334+0000","last_unstale":"2023-07-25T14:37:59.254923+0000","last_undegraded":"2023-07-25T14:37:59.254923+0000","last_fullsized":"2023-07-25T14:37:59.254923+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_clean_scrub_stamp":"2023-07-25T14:37:56.225499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T22:08:17.759332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.254874+0000","last_change":"2023-07-25T14:37:45.204523+0000","last_active":"2023-07-25T14:37:59.254874+0000","last_peered":"2023-07-25T14:37:59.254874+0000","last_clean":"2023-07-25T14:37:59.254874+0000","last_became_active":"2023-07-25T14:37:45.204095+0000","last_became_peered":"2023-07-25T14:37:45.204095+0000","last_unstale":"2023-07-25T14:37:59.254874+0000","last_undegraded":"2023-07-25T14:37:59.254874+0000","last_fullsized":"2023-07-25T14:37:59.254874+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-27T00:29:50.162252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"56'1","reported_seq":22,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.355427+0000","last_change":"2023-07-25T14:37:44.164092+0000","last_active":"2023-07-25T14:37:59.355427+0000","last_peered":"2023-07-25T14:37:59.355427+0000","last_clean":"2023-07-25T14:37:59.355427+0000","last_became_active":"2023-07-25T14:37:44.163068+0000","last_became_peered":"2023-07-25T14:37:44.163068+0000","last_unstale":"2023-07-25T14:37:59.355427+0000","last_undegraded":"2023-07-25T14:37:59.355427+0000","last_fullsized":"2023-07-25T14:37:59.355427+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T14:50:52.133043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":92,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.354041+0000","last_change":"2023-07-25T14:35:34.371737+0000","last_active":"2023-07-25T14:37:59.354041+0000","last_peered":"2023-07-25T14:37:59.354041+0000","last_clean":"2023-07-25T14:37:59.354041+0000","last_became_active":"2023-07-25T14:35:34.371411+0000","last_became_peered":"2023-07-25T14:35:34.371411+0000","last_unstale":"2023-07-25T14:37:59.354041+0000","last_undegraded":"2023-07-25T14:37:59.354041+0000","last_fullsized":"2023-07-25T14:37:59.354041+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_clean_scrub_stamp":"2023-07-25T14:35:33.358525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T20:09:33.523945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":11,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.254942+0000","last_change":"2023-07-25T14:37:58.260030+0000","last_active":"2023-07-25T14:37:59.254942+0000","last_peered":"2023-07-25T14:37:59.254942+0000","last_clean":"2023-07-25T14:37:59.254942+0000","last_became_active":"2023-07-25T14:37:58.259717+0000","last_became_peered":"2023-07-25T14:37:58.259717+0000","last_unstale":"2023-07-25T14:37:59.254942+0000","last_undegraded":"2023-07-25T14:37:59.254942+0000","last_fullsized":"2023-07-25T14:37:59.254942+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:57.230919+0000","last_clean_scrub_stamp":"2023-07-25T14:37:57.230919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T15:46:59.478258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":13,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.352433+0000","last_change":"2023-07-25T14:37:57.253988+0000","last_active":"2023-07-25T14:37:59.352433+0000","last_peered":"2023-07-25T14:37:59.352433+0000","last_clean":"2023-07-25T14:37:59.352433+0000","last_became_active":"2023-07-25T14:37:57.253709+0000","last_became_peered":"2023-07-25T14:37:57.253709+0000","last_unstale":"2023-07-25T14:37:59.352433+0000","last_undegraded":"2023-07-25T14:37:59.352433+0000","last_fullsized":"2023-07-25T14:37:59.352433+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:56.225499+0000","last_clean_scrub_stamp":"2023-07-25T14:37:56.225499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T22:19:56.568758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":19,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.355003+0000","last_change":"2023-07-25T14:37:45.204043+0000","last_active":"2023-07-25T14:37:59.355003+0000","last_peered":"2023-07-25T14:37:59.355003+0000","last_clean":"2023-07-25T14:37:59.355003+0000","last_became_active":"2023-07-25T14:37:45.203102+0000","last_became_peered":"2023-07-25T14:37:45.203102+0000","last_unstale":"2023-07-25T14:37:59.355003+0000","last_undegraded":"2023-07-25T14:37:59.355003+0000","last_fullsized":"2023-07-25T14:37:59.355003+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:44.145134+0000","last_clean_scrub_stamp":"2023-07-25T14:37:44.145134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T23:19:21.506088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"56'2","reported_seq":23,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.255012+0000","last_change":"2023-07-25T14:37:44.167732+0000","last_active":"2023-07-25T14:37:59.255012+0000","last_peered":"2023-07-25T14:37:59.255012+0000","last_clean":"2023-07-25T14:37:59.255012+0000","last_became_active":"2023-07-25T14:37:44.167418+0000","last_became_peered":"2023-07-25T14:37:44.167418+0000","last_unstale":"2023-07-25T14:37:59.255012+0000","last_undegraded":"2023-07-25T14:37:59.255012+0000","last_fullsized":"2023-07-25T14:37:59.255012+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:37:43.143518+0000","last_clean_scrub_stamp":"2023-07-25T14:37:43.143518+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T16:41:14.128972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":98,"reported_epoch":61,"state":"active+clean","last_fresh":"2023-07-25T14:37:59.254088+0000","last_change":"2023-07-25T14:35:34.371347+0000","last_active":"2023-07-25T14:37:59.254088+0000","last_peered":"2023-07-25T14:37:59.254088+0000","last_clean":"2023-07-25T14:37:59.254088+0000","last_became_active":"2023-07-25T14:35:34.371044+0000","last_became_peered":"2023-07-25T14:35:34.371044+0000","last_unstale":"2023-07-25T14:37:59.254088+0000","last_undegraded":"2023-07-25T14:37:59.254088+0000","last_fullsized":"2023-07-25T14:37:59.254088+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-25T14:35:33.358525+0000","last_clean_scrub_stamp":"2023-07-25T14:35:33.358525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-26T23:17:10.719479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":3869,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64510,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574882,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":815104,"data_stored":949163,"data_compressed":32255,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jul 25 14:37:40 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.46999999999999997,"15min":0.46200000000000002},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.84299999999999997,"15min":0.90200000000000002},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.70699999999999996,"5min":9.1600000000000001,"15min":9.1600000000000001},"last":0.63100000000000001}]},{"osd":1,"last update":"Tue Jul 25 14:37:40 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.59299999999999997,"15min":0.60699999999999998},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.82699999999999996,"5min":1.5009999999999999,"15min":1.5009999999999999},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.61099999999999999,"15min":0.61799999999999999},"min":{"1min":0.45600000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.81100000000000005,"5min":1.526,"15min":1.526},"last":0.67600000000000005}]},{"osd":2,"last update":"Tue Jul 25 14:37:40 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.54500000000000004,"15min":0.55400000000000005},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.71599999999999997,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.82899999999999996,"15min":0.873},"min":{"1min":0.38300000000000001,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.95399999999999996,"5min":8.1739999999999995,"15min":8.1739999999999995},"last":0.65800000000000003}]},{"osd":3,"last update":"Tue Jul 25 14:37:40 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.82499999999999996,"15min":0.875},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.81599999999999995,"5min":7.2279999999999998,"15min":7.2279999999999998},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.89600000000000002,"15min":0.93999999999999995},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.0029999999999999,"5min":7.1870000000000003,"15min":7.1870000000000003},"last":0.70499999999999996}]},{"osd":4,"last update":"Tue Jul 25 14:37:40 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.57999999999999996,"15min":0.57799999999999996},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.76600000000000001,"5min":1.254,"15min":1.254},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.59299999999999997,"15min":0.59599999999999997},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.877,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.48199999999999998}]},{"osd":5,"last update":"Tue Jul 25 14:37:40 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.441},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.52600000000000002,"5min":0.501,"15min":0.501},"max":{"1min":0.84699999999999998,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.52900000000000003}]},{"osd":6,"last update":"Tue Jul 25 14:37:40 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.45800000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.88,"5min":1.286,"15min":1.286},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.64500000000000002,"15min":0.64400000000000002},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.59199999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574881,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27764,"kb_used_data":740,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344076,"statfs":{"total":96636764160,"available":96608333824,"internally_reserved":0,"allocated":757760,"data_stored":358895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jul 25 14:37:35 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.54200000000000004,"15min":0.54800000000000004},"min":{"1min":0.32300000000000001,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.73199999999999998,"5min":1.9370000000000001,"15min":1.9370000000000001},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.56000000000000005,"15min":0.56599999999999995},"min":{"1min":0.39700000000000002,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.77200000000000002,"5min":2.6779999999999999,"15min":2.6779999999999999},"last":0.41399999999999998}]},{"osd":1,"last update":"Tue Jul 25 14:37:35 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.53500000000000003,"15min":0.54100000000000004},"min":{"1min":0.34599999999999997,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.70799999999999996,"5min":2.5720000000000001,"15min":2.5720000000000001},"last":0.505},{"interface":"front","average":{"1min":0.503,"5min":0.54500000000000004,"15min":0.55200000000000005},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.64800000000000002,"5min":1.6259999999999999,"15min":1.6259999999999999},"last":0.437}]},{"osd":2,"last update":"Tue Jul 25 14:37:35 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.52700000000000002,"15min":0.52100000000000002},"min":{"1min":0.34399999999999997,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.79000000000000004,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.50600000000000001,"15min":0.501},"min":{"1min":0.375,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.68799999999999994,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.39700000000000002}]},{"osd":3,"last update":"Tue Jul 25 14:37:35 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.64900000000000002,"15min":0.66300000000000003},"min":{"1min":0.38600000000000001,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.73499999999999999,"5min":3.5750000000000002,"15min":3.5750000000000002},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.69899999999999995,"15min":0.71699999999999997},"min":{"1min":0.36499999999999999,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.77400000000000002,"5min":4.7190000000000003,"15min":4.7190000000000003},"last":0.60299999999999998}]},{"osd":4,"last update":"Tue Jul 25 14:37:35 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.65700000000000003,"15min":0.67200000000000004},"min":{"1min":0.39100000000000001,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.79700000000000004,"5min":4.694,"15min":4.694},"last":0.37},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.622,"15min":0.628},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.74099999999999999,"5min":2.7839999999999998,"15min":2.7839999999999998},"last":0.46200000000000002}]},{"osd":5,"last update":"Tue Jul 25 14:37:35 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.54500000000000004,"15min":0.54100000000000004},"min":{"1min":0.36199999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.752,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.624,"15min":0.627},"min":{"1min":0.376,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.82499999999999996,"5min":1.7310000000000001,"15min":1.7310000000000001},"last":0.56999999999999995}]},{"osd":7,"last update":"Tue Jul 25 14:37:35 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.68799999999999994,"15min":0.69799999999999995},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.81299999999999994,"5min":2.7290000000000001,"15min":2.7290000000000001},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.58999999999999997,"15min":0.58199999999999996},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.53600000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574881,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27844,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343996,"statfs":{"total":96636764160,"available":96608251904,"internally_reserved":0,"allocated":835584,"data_stored":952358,"data_compressed":32255,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jul 25 14:37:39 2023","interfaces":[{"interface":"back","average":{"1min":0.314,"5min":0.318,"15min":0.318},"min":{"1min":0.23999999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.44500000000000001,"5min":0.47099999999999997,"15min":0.47099999999999997},"last":0.22700000000000001},{"interface":"front","average":{"1min":0.312,"5min":0.32800000000000001,"15min":0.33000000000000002},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.44700000000000001,"5min":0.48899999999999999,"15min":0.48899999999999999},"last":0.32800000000000001}]},{"osd":2,"last update":"Tue Jul 25 14:37:39 2023","interfaces":[{"interface":"back","average":{"1min":0.29799999999999999,"5min":0.30599999999999999,"15min":0.308},"min":{"1min":0.20100000000000001,"5min":0.20100000000000001,"15min":0.20100000000000001},"max":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.35399999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"min":{"1min":0.27200000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.45800000000000002,"5min":0.56499999999999995,"15min":0.56499999999999995},"last":0.28299999999999997}]},{"osd":3,"last update":"Tue Jul 25 14:37:39 2023","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.371,"15min":0.373},"min":{"1min":0.29699999999999999,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.432,"5min":0.52900000000000003,"15min":0.52900000000000003},"last":0.311},{"interface":"front","average":{"1min":0.33000000000000002,"5min":0.34499999999999997,"15min":0.34699999999999998},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.46999999999999997,"5min":0.496,"15min":0.496},"last":0.36599999999999999}]},{"osd":4,"last update":"Tue Jul 25 14:37:39 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.55300000000000005,"15min":0.55100000000000005},"min":{"1min":0.44900000000000001,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.78400000000000003,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.55400000000000005,"15min":0.55800000000000005},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.65100000000000002,"5min":0.745,"15min":0.745},"last":0.57599999999999996}]},{"osd":5,"last update":"Tue Jul 25 14:37:39 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.56100000000000005,"15min":0.55900000000000005},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.754,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.56399999999999995,"15min":0.56499999999999995},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.67400000000000004}]},{"osd":6,"last update":"Tue Jul 25 14:37:39 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.58099999999999996,"15min":0.58199999999999996},"min":{"1min":0.46000000000000002,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.70399999999999996,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.56899999999999995,"15min":0.57099999999999995},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.56599999999999995}]},{"osd":7,"last update":"Tue Jul 25 14:37:39 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.47699999999999998,"5min":0.443,"15min":0.443},"max":{"1min":0.71799999999999997,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.59599999999999997,"15min":0.59499999999999997},"min":{"1min":0.48399999999999999,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.74199999999999999,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.66500000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574881,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27744,"kb_used_data":720,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344096,"statfs":{"total":96636764160,"available":96608354304,"internally_reserved":0,"allocated":737280,"data_stored":357082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Jul 25 14:37:36 2023","interfaces":[{"interface":"back","average":{"1min":0.29899999999999999,"5min":0.35099999999999998,"15min":0.35899999999999999},"min":{"1min":0.17199999999999999,"5min":0.17199999999999999,"15min":0.17199999999999999},"max":{"1min":0.39000000000000001,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.29899999999999999},{"interface":"front","average":{"1min":0.28899999999999998,"5min":0.58899999999999997,"15min":0.63900000000000001},"min":{"1min":0.19600000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.37,"5min":6.5369999999999999,"15min":6.5369999999999999},"last":0.22700000000000001}]},{"osd":2,"last update":"Tue Jul 25 14:37:36 2023","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":0.36399999999999999,"15min":0.37},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.47599999999999998,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.245},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.63,"15min":0.67600000000000005},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.439,"5min":6.5659999999999998,"15min":6.5659999999999998},"last":0.316}]},{"osd":3,"last update":"Tue Jul 25 14:37:36 2023","interfaces":[{"interface":"back","average":{"1min":0.33100000000000002,"5min":0.88700000000000001,"15min":0.97899999999999998},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.48799999999999999,"5min":12.449,"15min":12.449},"last":0.28899999999999998},{"interface":"front","average":{"1min":0.36199999999999999,"5min":0.40999999999999998,"15min":0.41799999999999998},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.45100000000000001,"5min":1.079,"15min":1.079},"last":0.33200000000000002}]},{"osd":4,"last update":"Tue Jul 25 14:37:36 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.79300000000000004,"15min":0.83199999999999996},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.71399999999999997,"5min":6.5099999999999998,"15min":6.5099999999999998},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.55600000000000005,"5min":1.0680000000000001,"15min":1.1539999999999999},"min":{"1min":0.35399999999999998,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.66100000000000003,"5min":12.35,"15min":12.35},"last":0.48899999999999999}]},{"osd":5,"last update":"Tue Jul 25 14:37:36 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.58699999999999997,"15min":0.58899999999999997},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.68100000000000005,"5min":1.107,"15min":1.107},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.82599999999999996,"15min":0.872},"min":{"1min":0.39000000000000001,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.76600000000000001,"5min":6.4349999999999996,"15min":6.4349999999999996},"last":0.38700000000000001}]},{"osd":6,"last update":"Tue Jul 25 14:37:36 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":1.0820000000000001,"15min":1.1679999999999999},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.74099999999999999,"5min":12.417,"15min":12.417},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.60799999999999998,"15min":0.61199999999999999},"min":{"1min":0.45000000000000001,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.68999999999999995,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.51400000000000001}]},{"osd":7,"last update":"Tue Jul 25 14:37:36 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.85799999999999998,"15min":0.90400000000000003},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.67200000000000004,"5min":6.4809999999999999,"15min":6.4809999999999999},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.57799999999999996,"5min":1.091,"15min":1.177},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.77500000000000002,"5min":12.388999999999999,"15min":12.388999999999999},"last":0.39900000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574881,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27756,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344084,"statfs":{"total":96636764160,"available":96608342016,"internally_reserved":0,"allocated":749568,"data_stored":360701,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jul 25 14:37:34 2023","interfaces":[{"interface":"back","average":{"1min":0.311,"5min":0.38200000000000001,"15min":0.39400000000000002},"min":{"1min":0.20399999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.39000000000000001,"5min":2.1030000000000002,"15min":2.1030000000000002},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.27600000000000002,"5min":0.92800000000000005,"15min":1.0369999999999999},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":0.32900000000000001,"5min":16.969000000000001,"15min":16.969000000000001},"last":0.39100000000000001}]},{"osd":1,"last update":"Tue Jul 25 14:37:34 2023","interfaces":[{"interface":"back","average":{"1min":0.33400000000000002,"5min":0.35099999999999998,"15min":0.35399999999999998},"min":{"1min":0.26200000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.41899999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"last":0.25600000000000001},{"interface":"front","average":{"1min":0.34300000000000003,"5min":0.379,"15min":0.38500000000000001},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.50800000000000001,"5min":1.111,"15min":1.111},"last":0.32300000000000001}]},{"osd":3,"last update":"Tue Jul 25 14:37:34 2023","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.79700000000000004,"15min":0.876},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.36799999999999999,"5min":13.035,"15min":13.035},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.376,"5min":0.40300000000000002,"15min":0.40699999999999997},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.61599999999999999,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.40799999999999997}]},{"osd":4,"last update":"Tue Jul 25 14:37:34 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.754,"15min":0.79200000000000004},"min":{"1min":0.39100000000000001,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.73099999999999998,"5min":6.165,"15min":6.165},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.55900000000000005,"5min":1.0069999999999999,"15min":1.0820000000000001},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.74199999999999999,"5min":13.004,"15min":13.004},"last":0.64800000000000002}]},{"osd":5,"last update":"Tue Jul 25 14:37:34 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.57199999999999995,"15min":0.57299999999999995},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.75800000000000001,"15min":0.79500000000000004},"min":{"1min":0.41299999999999998,"5min":0.378,"15min":0.378},"max":{"1min":0.69499999999999995,"5min":6.226,"15min":6.226},"last":0.51700000000000002}]},{"osd":6,"last update":"Tue Jul 25 14:37:34 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":1.006,"15min":1.0840000000000001},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.77400000000000002,"5min":12.974,"15min":12.974},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.59499999999999997,"15min":0.59699999999999998},"min":{"1min":0.42599999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.77200000000000002,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.68600000000000005}]},{"osd":7,"last update":"Tue Jul 25 14:37:34 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.77900000000000003,"15min":0.81499999999999995},"min":{"1min":0.40899999999999997,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.70499999999999996,"5min":6.1989999999999998,"15min":6.1989999999999998},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.56699999999999995,"5min":1.026,"15min":1.1020000000000001},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.74199999999999999,"5min":12.936999999999999,"15min":12.936999999999999},"last":0.53300000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574881,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27760,"kb_used_data":736,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344080,"statfs":{"total":96636764160,"available":96608337920,"internally_reserved":0,"allocated":753664,"data_stored":358724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jul 25 14:37:36 2023","interfaces":[{"interface":"back","average":{"1min":0.29999999999999999,"5min":0.312,"15min":0.314},"min":{"1min":0.20300000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.32100000000000001,"5min":0.309,"15min":0.307},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.45400000000000001,"5min":0.46300000000000002,"15min":0.46300000000000002},"last":0.25800000000000001}]},{"osd":1,"last update":"Tue Jul 25 14:37:36 2023","interfaces":[{"interface":"back","average":{"1min":0.315,"5min":0.308,"15min":0.307},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"last":0.27700000000000002},{"interface":"front","average":{"1min":0.34200000000000003,"5min":0.36899999999999999,"15min":0.373},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.496,"5min":0.59099999999999997,"15min":0.59099999999999997},"last":0.30199999999999999}]},{"osd":2,"last update":"Tue Jul 25 14:37:36 2023","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":0.37,"15min":0.374},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.441,"5min":0.502,"15min":0.502},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.35899999999999999,"5min":0.39300000000000002,"15min":0.39900000000000002},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.47299999999999998,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.38200000000000001}]},{"osd":4,"last update":"Tue Jul 25 14:37:36 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.57199999999999995,"15min":0.57399999999999995},"min":{"1min":0.42399999999999999,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.77000000000000002,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.62},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58799999999999997,"15min":0.58899999999999997},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.69399999999999995}]},{"osd":5,"last update":"Tue Jul 25 14:37:36 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.70999999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.625,"15min":0.63100000000000001},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.88100000000000001,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.68200000000000005}]},{"osd":6,"last update":"Tue Jul 25 14:37:36 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.61499999999999999,"15min":0.625},"min":{"1min":0.46300000000000002,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.68799999999999994,"5min":0.871,"15min":0.871},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.59399999999999997,"15min":0.59599999999999997},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.70599999999999996}]},{"osd":7,"last update":"Tue Jul 25 14:37:36 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.59099999999999997,"15min":0.58899999999999997},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.83599999999999997,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.60699999999999998,"15min":0.60899999999999999},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.64400000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574881,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27748,"kb_used_data":724,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344092,"statfs":{"total":96636764160,"available":96608350208,"internally_reserved":0,"allocated":741376,"data_stored":358179,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jul 25 14:37:35 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.55500000000000005,"15min":0.56100000000000005},"min":{"1min":0.39600000000000002,"5min":0.31,"15min":0.31},"max":{"1min":0.75700000000000001,"5min":0.876,"15min":0.876},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.51100000000000001,"15min":0.51000000000000001},"min":{"1min":0.371,"5min":0.309,"15min":0.309},"max":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.48299999999999998}]},{"osd":1,"last update":"Tue Jul 25 14:37:35 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.69099999999999995,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.53600000000000003,"15min":0.53200000000000003},"min":{"1min":0.38900000000000001,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.70399999999999996,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.46300000000000002}]},{"osd":2,"last update":"Tue Jul 25 14:37:35 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.55500000000000005,"15min":0.54900000000000004},"min":{"1min":0.435,"5min":0.376,"15min":0.376},"max":{"1min":0.67600000000000005,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.54600000000000004,"15min":0.54200000000000004},"min":{"1min":0.41999999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.60999999999999999}]},{"osd":3,"last update":"Tue Jul 25 14:37:35 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.53600000000000003,"15min":0.53000000000000003},"min":{"1min":0.33000000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.73299999999999998,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.63,"15min":0.63800000000000001},"min":{"1min":0.47299999999999998,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.76100000000000001,"5min":1.8720000000000001,"15min":1.8720000000000001},"last":0.57699999999999996}]},{"osd":5,"last update":"Tue Jul 25 14:37:35 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.49099999999999999,"15min":0.47599999999999998},"min":{"1min":0.36399999999999999,"5min":0.317,"15min":0.317},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.61899999999999999,"15min":0.61599999999999999},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.748,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.58899999999999997}]},{"osd":6,"last update":"Tue Jul 25 14:37:35 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.54900000000000004,"15min":0.54100000000000004},"min":{"1min":0.41299999999999998,"5min":0.372,"15min":0.372},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.59899999999999998,"15min":0.60099999999999998},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.68999999999999995}]},{"osd":7,"last update":"Tue Jul 25 14:37:35 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.623,"15min":0.61899999999999999},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.79500000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.64600000000000002,"15min":0.64000000000000001},"min":{"1min":0.54900000000000004,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.63100000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574881,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27764,"kb_used_data":740,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344076,"statfs":{"total":96636764160,"available":96608333824,"internally_reserved":0,"allocated":757760,"data_stored":359785,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Jul 25 14:37:32 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.59799999999999998,"15min":0.60599999999999998},"min":{"1min":0.35399999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.83399999999999996,"5min":2.548,"15min":2.548},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.55700000000000005,"15min":0.56000000000000005},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.76500000000000001,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.64100000000000001}]},{"osd":1,"last update":"Tue Jul 25 14:37:32 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.58099999999999996,"15min":0.58499999999999996},"min":{"1min":0.39900000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.753,"5min":1.657,"15min":1.657},"last":0.625},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.42599999999999999,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.79700000000000004,"5min":1.752,"15min":1.752},"last":0.58299999999999996}]},{"osd":2,"last update":"Tue Jul 25 14:37:32 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.56499999999999995,"15min":0.56699999999999995},"min":{"1min":0.38800000000000001,"5min":0.372,"15min":0.372},"max":{"1min":0.82899999999999996,"5min":0.872,"15min":0.872},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.54300000000000004,"15min":0.53400000000000003},"min":{"1min":0.46500000000000002,"5min":0.376,"15min":0.376},"max":{"1min":0.751,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.67400000000000004}]},{"osd":3,"last update":"Tue Jul 25 14:37:32 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.56399999999999995,"15min":0.55800000000000005},"min":{"1min":0.39900000000000002,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.60899999999999999,"15min":0.60499999999999998},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.68999999999999995}]},{"osd":4,"last update":"Tue Jul 25 14:37:32 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.52900000000000003,"15min":0.52700000000000002},"min":{"1min":0.38900000000000001,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.56100000000000005,"15min":0.55900000000000005},"min":{"1min":0.35499999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.41199999999999998}]},{"osd":6,"last update":"Tue Jul 25 14:37:32 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.56299999999999994,"15min":0.55400000000000005},"min":{"1min":0.42499999999999999,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.57099999999999995,"15min":0.56799999999999995},"min":{"1min":0.35999999999999999,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.52500000000000002}]},{"osd":7,"last update":"Tue Jul 25 14:37:32 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.58799999999999997,"15min":0.58199999999999996},"min":{"1min":0.41899999999999998,"5min":0.375,"15min":0.375},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.496},{"interface":"front","average":{"1min":0.627,"5min":0.64400000000000002,"15min":0.64700000000000002},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.81399999999999995,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.56100000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32255,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32255,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3071,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-25T14:38:07.347 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-07-25T14:38:07.348 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mon 'allow r' osd 'allow rw pool=cephfs2_data' mds allow 2023-07-25T14:38:07.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.492+0000 7f8760686700 1 Processor -- start 2023-07-25T14:38:07.503 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.492+0000 7f8760686700 1 -- start start 2023-07-25T14:38:07.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.493+0000 7f8760686700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f875814f810 0x7f87580c4370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:38:07.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.493+0000 7f8760686700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87580c5890 con 0x7f87580a9cc0 2023-07-25T14:38:07.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.493+0000 7f8760686700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8758152150 con 0x7f87580bb0b0 2023-07-25T14:38:07.506 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.493+0000 7f8760686700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f875814fbf0 con 0x7f875814f810 2023-07-25T14:38:07.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.493+0000 7f875dc21700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f87580a9cc0 0x7f87581525e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:34988/0 (socket says 172.21.15.72:34988) 2023-07-25T14:38:07.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.493+0000 7f875dc21700 1 -- 172.21.15.72:0/3322189081 learned_addr learned my addr 172.21.15.72:0/3322189081 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:38:07.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.494+0000 7f875d420700 1 -- 172.21.15.72:0/3322189081 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2845595349 0 0) 0x7f87580c5890 con 0x7f87580a9cc0 2023-07-25T14:38:07.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.494+0000 7f875d420700 1 -- 172.21.15.72:0/3322189081 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f87440035b0 con 0x7f87580a9cc0 2023-07-25T14:38:07.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.494+0000 7f875e422700 1 --2- 172.21.15.72:0/3322189081 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f875814f810 0x7f87580c4370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:38:07.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.494+0000 7f875d420700 1 -- 172.21.15.72:0/3322189081 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3731639653 0 0) 0x7f87440035b0 con 0x7f87580a9cc0 2023-07-25T14:38:07.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.494+0000 7f875d420700 1 -- 172.21.15.72:0/3322189081 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f875814f810 msgr2=0x7f87580c4370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:38:07.507 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.494+0000 7f875d420700 1 --2- 172.21.15.72:0/3322189081 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f875814f810 0x7f87580c4370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:38:07.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.494+0000 7f875d420700 1 -- 172.21.15.72:0/3322189081 >> v1:172.21.15.92:6789/0 conn(0x7f87580bb0b0 legacy=0x7f875815cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:38:07.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.494+0000 7f875d420700 1 -- 172.21.15.72:0/3322189081 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87581566a0 con 0x7f87580a9cc0 2023-07-25T14:38:07.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.494+0000 7f875d420700 1 -- 172.21.15.72:0/3322189081 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2559588315 0 0) 0x7f8754001670 con 0x7f87580a9cc0 2023-07-25T14:38:07.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.494+0000 7f875d420700 1 -- 172.21.15.72:0/3322189081 >> v1:172.21.15.72:6789/0 conn(0x7f87580a9cc0 legacy=0x7f87581525e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:38:07.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.494+0000 7f875d420700 1 --2- 172.21.15.72:0/3322189081 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8744003a30 0x7f8744003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:38:07.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.494+0000 7f875d420700 1 --2- 172.21.15.72:0/3322189081 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f875814f810 0x7f8744004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:38:07.508 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.494+0000 7f875d420700 1 --2- 172.21.15.72:0/3322189081 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8744004d90 0x7f8744005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:38:07.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.494+0000 7f875d420700 1 -- 172.21.15.72:0/3322189081 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f875814fbf0 con 0x7f8744004d90 2023-07-25T14:38:07.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.494+0000 7f875d420700 1 -- 172.21.15.72:0/3322189081 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f874400bbf0 con 0x7f8744003a30 2023-07-25T14:38:07.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.494+0000 7f875d420700 1 -- 172.21.15.72:0/3322189081 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f874400bdb0 con 0x7f875814f810 2023-07-25T14:38:07.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.494+0000 7f875ec23700 1 --2- 172.21.15.72:0/3322189081 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8744004d90 0x7f8744005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:38:07.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.494+0000 7f875dc21700 1 --2- 172.21.15.72:0/3322189081 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f875814f810 0x7f8744004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:38:07.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.494+0000 7f875e422700 1 --2- 172.21.15.72:0/3322189081 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8744003a30 0x7f8744003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:38:07.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.494+0000 7f875ec23700 1 -- 172.21.15.72:0/3322189081 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f875814f810 msgr2=0x7f8744004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:38:07.509 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.494+0000 7f875ec23700 1 --2- 172.21.15.72:0/3322189081 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f875814f810 0x7f8744004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:38:07.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.494+0000 7f875ec23700 1 -- 172.21.15.72:0/3322189081 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8744003a30 msgr2=0x7f8744003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:38:07.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.494+0000 7f875ec23700 1 --2- 172.21.15.72:0/3322189081 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8744003a30 0x7f8744003e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:38:07.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.494+0000 7f875ec23700 1 -- 172.21.15.72:0/3322189081 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87440035b0 con 0x7f8744004d90 2023-07-25T14:38:07.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.494+0000 7f875ec23700 1 --2- 172.21.15.72:0/3322189081 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8744004d90 0x7f8744005210 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f875806e370 tx=0x7f8744005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99638c53c797f52a server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:38:07.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.495+0000 7f875d420700 1 -- 172.21.15.72:0/3322189081 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8750001da0 con 0x7f8744004d90 2023-07-25T14:38:07.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.495+0000 7f875d420700 1 -- 172.21.15.72:0/3322189081 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8750003c50 con 0x7f8744004d90 2023-07-25T14:38:07.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.495+0000 7f875d420700 1 -- 172.21.15.72:0/3322189081 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f875000c9f0 con 0x7f8744004d90 2023-07-25T14:38:07.510 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.495+0000 7f8760686700 1 -- 172.21.15.72:0/3322189081 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8744004d90 msgr2=0x7f8744005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:38:07.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.495+0000 7f8760686700 1 --2- 172.21.15.72:0/3322189081 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8744004d90 0x7f8744005210 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f875806e370 tx=0x7f8744005880 comp rx=0 tx=0).stop 2023-07-25T14:38:07.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.495+0000 7f875ec23700 1 -- 172.21.15.72:0/3322189081 reap_dead start 2023-07-25T14:38:07.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.495+0000 7f8760686700 1 -- 172.21.15.72:0/3322189081 shutdown_connections 2023-07-25T14:38:07.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.495+0000 7f8760686700 1 -- 172.21.15.72:0/3322189081 >> 172.21.15.72:0/3322189081 conn(0x7f875806a8d0 msgr2=0x7f87580a94e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:38:07.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.495+0000 7f8760686700 1 -- 172.21.15.72:0/3322189081 shutdown_connections 2023-07-25T14:38:07.511 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.495+0000 7f8760686700 1 -- 172.21.15.72:0/3322189081 wait complete. 2023-07-25T14:38:07.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.496+0000 7f8760686700 1 Processor -- start 2023-07-25T14:38:07.513 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.496+0000 7f8760686700 1 -- start start 2023-07-25T14:38:07.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.497+0000 7f8760686700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8744004d90 0x7f87580a93f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:38:07.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.497+0000 7f8760686700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f87580a6da0 0x7f87580c1250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:38:07.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.497+0000 7f8760686700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8758153c50 0x7f87581540d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:38:07.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.497+0000 7f8760686700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f875814ebf0 con 0x7f8744004d90 2023-07-25T14:38:07.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.497+0000 7f8760686700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87580c0be0 con 0x7f8758153c50 2023-07-25T14:38:07.514 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.497+0000 7f8760686700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87580bf0f0 con 0x7f87580a6da0 2023-07-25T14:38:07.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.497+0000 7f875e422700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8744004d90 0x7f87580a93f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:38:07.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.497+0000 7f875e422700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8744004d90 0x7f87580a93f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:44262/0 (socket says 172.21.15.72:44262) 2023-07-25T14:38:07.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.497+0000 7f875e422700 1 -- 172.21.15.72:0/828441463 learned_addr learned my addr 172.21.15.72:0/828441463 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:38:07.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.497+0000 7f875dc21700 1 --2- 172.21.15.72:0/828441463 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f87580a6da0 0x7f87580c1250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:38:07.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.497+0000 7f875ec23700 1 --2- 172.21.15.72:0/828441463 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8758153c50 0x7f87581540d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:38:07.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.497+0000 7f875e422700 1 -- 172.21.15.72:0/828441463 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f87580a6da0 msgr2=0x7f87580c1250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:38:07.515 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.497+0000 7f875e422700 1 --2- 172.21.15.72:0/828441463 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f87580a6da0 0x7f87580c1250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:38:07.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.497+0000 7f875e422700 1 -- 172.21.15.72:0/828441463 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8758153c50 msgr2=0x7f87581540d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:38:07.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.497+0000 7f875e422700 1 --2- 172.21.15.72:0/828441463 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8758153c50 0x7f87581540d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:38:07.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.497+0000 7f875e422700 1 -- 172.21.15.72:0/828441463 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87580bf3d0 con 0x7f8744004d90 2023-07-25T14:38:07.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.497+0000 7f875dc21700 1 --2- 172.21.15.72:0/828441463 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f87580a6da0 0x7f87580c1250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-25T14:38:07.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.498+0000 7f875e422700 1 --2- 172.21.15.72:0/828441463 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8744004d90 0x7f87580a93f0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f87480116c0 tx=0x7f8748011a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:38:07.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.498+0000 7f874effd700 1 -- 172.21.15.72:0/828441463 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f874800c070 con 0x7f8744004d90 2023-07-25T14:38:07.516 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.498+0000 7f874effd700 1 -- 172.21.15.72:0/828441463 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8748015870 con 0x7f8744004d90 2023-07-25T14:38:07.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.498+0000 7f8760686700 1 -- 172.21.15.72:0/828441463 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87580bf6b0 con 0x7f8744004d90 2023-07-25T14:38:07.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.498+0000 7f874effd700 1 -- 172.21.15.72:0/828441463 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8748015c20 con 0x7f8744004d90 2023-07-25T14:38:07.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.498+0000 7f8760686700 1 -- 172.21.15.72:0/828441463 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8758153730 con 0x7f8744004d90 2023-07-25T14:38:07.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.499+0000 7f8760686700 1 -- 172.21.15.72:0/828441463 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f875804e470 con 0x7f8744004d90 2023-07-25T14:38:07.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.499+0000 7f874effd700 1 -- 172.21.15.72:0/828441463 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8748013400 con 0x7f8744004d90 2023-07-25T14:38:07.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.499+0000 7f874effd700 1 --2- 172.21.15.72:0/828441463 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f873c06ace0 0x7f873c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:38:07.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.500+0000 7f874effd700 1 -- 172.21.15.72:0/828441463 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 7238+0+0 (secure 0 0 0) 0x7f8748089b10 con 0x7f8744004d90 2023-07-25T14:38:07.517 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.500+0000 7f875dc21700 1 --2- 172.21.15.72:0/828441463 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f873c06ace0 0x7f873c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:38:07.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.500+0000 7f875dc21700 1 --2- 172.21.15.72:0/828441463 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f873c06ace0 0x7f873c06d1a0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f8754007fd0 tx=0x7f8754009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:38:07.518 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.504+0000 7f874effd700 1 -- 172.21.15.72:0/828441463 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f87480547b0 con 0x7f8744004d90 2023-07-25T14:38:07.778 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.768+0000 7f8760686700 1 -- 172.21.15.72:0/828441463 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs2_data", "mds", "allow"]} v 0) v1 -- 0x7f8758151230 con 0x7f8744004d90 2023-07-25T14:38:07.783 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.773+0000 7f874effd700 1 -- 172.21.15.72:0/828441463 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs2_data", "mds", "allow"]}]=0 updated caps for client.1 v18) v1 ==== 185+0+142 (secure 0 0 0) 0x7f8748087e60 con 0x7f8744004d90 2023-07-25T14:38:07.784 INFO:teuthology.orchestra.run.smithi072.stdout:[client.1] 2023-07-25T14:38:07.784 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQCI3b9kRPMxKxAAACbj386PGidKwcHoe2J57A== 2023-07-25T14:38:07.784 INFO:teuthology.orchestra.run.smithi072.stdout: caps mds = "allow" 2023-07-25T14:38:07.785 INFO:teuthology.orchestra.run.smithi072.stdout: caps mon = "allow r" 2023-07-25T14:38:07.785 INFO:teuthology.orchestra.run.smithi072.stdout: caps osd = "allow rw pool=cephfs2_data" 2023-07-25T14:38:07.786 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.775+0000 7f8760686700 1 -- 172.21.15.72:0/828441463 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f873c06ace0 msgr2=0x7f873c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:38:07.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.775+0000 7f8760686700 1 --2- 172.21.15.72:0/828441463 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f873c06ace0 0x7f873c06d1a0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f8754007fd0 tx=0x7f8754009040 comp rx=0 tx=0).stop 2023-07-25T14:38:07.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.775+0000 7f8760686700 1 -- 172.21.15.72:0/828441463 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8744004d90 msgr2=0x7f87580a93f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:38:07.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.775+0000 7f8760686700 1 --2- 172.21.15.72:0/828441463 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8744004d90 0x7f87580a93f0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f87480116c0 tx=0x7f8748011a80 comp rx=0 tx=0).stop 2023-07-25T14:38:07.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.775+0000 7f8760686700 1 -- 172.21.15.72:0/828441463 shutdown_connections 2023-07-25T14:38:07.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.775+0000 7f8760686700 1 --2- 172.21.15.72:0/828441463 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f873c06ace0 0x7f873c06d1a0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:38:07.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.775+0000 7f8760686700 1 --2- 172.21.15.72:0/828441463 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8758153c50 0x7f87581540d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:38:07.787 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.775+0000 7f8760686700 1 --2- 172.21.15.72:0/828441463 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f8744004d90 0x7f87580a93f0 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:38:07.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.775+0000 7f8760686700 1 --2- 172.21.15.72:0/828441463 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f87580a6da0 0x7f87580c1250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:38:07.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.775+0000 7f8760686700 1 -- 172.21.15.72:0/828441463 >> 172.21.15.72:0/828441463 conn(0x7f875806a8d0 msgr2=0x7f875806ee10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:38:07.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.775+0000 7f8760686700 1 -- 172.21.15.72:0/828441463 shutdown_connections 2023-07-25T14:38:07.788 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.775+0000 7f8760686700 1 -- 172.21.15.72:0/828441463 wait complete. 2023-07-25T14:38:07.788 INFO:teuthology.orchestra.run.smithi072.stderr:updated caps for client.1 2023-07-25T14:38:07.798 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-07-25T14:38:07.798 DEBUG:teuthology.orchestra.run.smithi092:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-25T14:38:07.819 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-07-25T14:38:07.820 DEBUG:teuthology.orchestra.run.smithi092:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-25T14:38:07.880 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-25T14:38:08.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.990+0000 7f2543a17700 1 Processor -- start 2023-07-25T14:38:08.001 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.990+0000 7f2543a17700 1 -- start start 2023-07-25T14:38:08.003 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.991+0000 7f2543a17700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f253c151950 0x7f253c06a190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:38:08.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.991+0000 7f2543a17700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f253c0724c0 0x7f253c0c34c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:38:08.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.991+0000 7f2543a17700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f253c0c2fe0 con 0x7f253c06a6d0 2023-07-25T14:38:08.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.991+0000 7f2543a17700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f253c071a60 con 0x7f253c151950 2023-07-25T14:38:08.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.991+0000 7f2543a17700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f253c0c2a70 con 0x7f253c0724c0 2023-07-25T14:38:08.004 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.991+0000 7f2541fb4700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f253c06a6d0 0x7f253c0c3a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:35006/0 (socket says 172.21.15.72:35006) 2023-07-25T14:38:08.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.991+0000 7f2541fb4700 1 -- 172.21.15.72:0/2606929010 learned_addr learned my addr 172.21.15.72:0/2606929010 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:38:08.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.991+0000 7f25417b3700 1 --2- 172.21.15.72:0/2606929010 >> v2:172.21.15.92:3300/0 conn(0x7f253c151950 0x7f253c06a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:38:08.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.991+0000 7f2540fb2700 1 --2- 172.21.15.72:0/2606929010 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f253c0724c0 0x7f253c0c34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:38:08.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.991+0000 7f2533fff700 1 -- 172.21.15.72:0/2606929010 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1218966994 0 0) 0x7f253c0c2fe0 con 0x7f253c06a6d0 2023-07-25T14:38:08.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.991+0000 7f2533fff700 1 -- 172.21.15.72:0/2606929010 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f25280035b0 con 0x7f253c06a6d0 2023-07-25T14:38:08.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.992+0000 7f2533fff700 1 -- 172.21.15.72:0/2606929010 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3091358744 0 0) 0x7f25280035b0 con 0x7f253c06a6d0 2023-07-25T14:38:08.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.992+0000 7f2533fff700 1 -- 172.21.15.72:0/2606929010 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f253c0724c0 msgr2=0x7f253c0c34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:38:08.005 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.992+0000 7f2533fff700 1 --2- 172.21.15.72:0/2606929010 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f253c0724c0 0x7f253c0c34c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:38:08.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.992+0000 7f2533fff700 1 -- 172.21.15.72:0/2606929010 >> v2:172.21.15.92:3300/0 conn(0x7f253c151950 msgr2=0x7f253c06a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:38:08.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.992+0000 7f2533fff700 1 --2- 172.21.15.72:0/2606929010 >> v2:172.21.15.92:3300/0 conn(0x7f253c151950 0x7f253c06a190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:38:08.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.992+0000 7f2533fff700 1 -- 172.21.15.72:0/2606929010 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f253c155070 con 0x7f253c06a6d0 2023-07-25T14:38:08.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.992+0000 7f2533fff700 1 -- 172.21.15.72:0/2606929010 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2559588315 0 0) 0x7f25340019f0 con 0x7f253c06a6d0 2023-07-25T14:38:08.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.992+0000 7f2533fff700 1 -- 172.21.15.72:0/2606929010 >> v1:172.21.15.72:6789/0 conn(0x7f253c06a6d0 legacy=0x7f253c0c3a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:38:08.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.992+0000 7f2533fff700 1 --2- 172.21.15.72:0/2606929010 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2528003a00 0x7f2528003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:38:08.006 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.992+0000 7f2533fff700 1 --2- 172.21.15.72:0/2606929010 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2528004850 0x7f2528004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:38:08.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.992+0000 7f2533fff700 1 --2- 172.21.15.72:0/2606929010 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f253c0724c0 0x7f2528005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:38:08.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.992+0000 7f2533fff700 1 -- 172.21.15.72:0/2606929010 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f253c071a60 con 0x7f2528004850 2023-07-25T14:38:08.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.992+0000 7f2533fff700 1 -- 172.21.15.72:0/2606929010 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f252800ba10 con 0x7f2528003a00 2023-07-25T14:38:08.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.992+0000 7f2533fff700 1 -- 172.21.15.72:0/2606929010 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f252800bb50 con 0x7f253c0724c0 2023-07-25T14:38:08.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.992+0000 7f2540fb2700 1 --2- 172.21.15.72:0/2606929010 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2528004850 0x7f2528004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:38:08.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.992+0000 7f25417b3700 1 --2- 172.21.15.72:0/2606929010 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2528003a00 0x7f2528003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:38:08.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.992+0000 7f2541fb4700 1 --2- 172.21.15.72:0/2606929010 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f253c0724c0 0x7f2528005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:38:08.007 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.992+0000 7f2540fb2700 1 -- 172.21.15.72:0/2606929010 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f253c0724c0 msgr2=0x7f2528005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:38:08.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.992+0000 7f2540fb2700 1 --2- 172.21.15.72:0/2606929010 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f253c0724c0 0x7f2528005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:38:08.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.992+0000 7f2540fb2700 1 -- 172.21.15.72:0/2606929010 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2528003a00 msgr2=0x7f2528003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:38:08.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.992+0000 7f2540fb2700 1 --2- 172.21.15.72:0/2606929010 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2528003a00 0x7f2528003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:38:08.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.992+0000 7f2540fb2700 1 -- 172.21.15.72:0/2606929010 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25280035b0 con 0x7f2528004850 2023-07-25T14:38:08.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.992+0000 7f2540fb2700 1 --2- 172.21.15.72:0/2606929010 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2528004850 0x7f2528004cd0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f2538009b60 tx=0x7f2528005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad78556e3882baec server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:38:08.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.992+0000 7f2533fff700 1 -- 172.21.15.72:0/2606929010 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f253800e6c0 con 0x7f2528004850 2023-07-25T14:38:08.008 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.992+0000 7f2533fff700 1 -- 172.21.15.72:0/2606929010 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f253800e820 con 0x7f2528004850 2023-07-25T14:38:08.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.992+0000 7f2533fff700 1 -- 172.21.15.72:0/2606929010 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f253800eb90 con 0x7f2528004850 2023-07-25T14:38:08.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.993+0000 7f2543a17700 1 -- 172.21.15.72:0/2606929010 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2528004850 msgr2=0x7f2528004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:38:08.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.993+0000 7f2543a17700 1 --2- 172.21.15.72:0/2606929010 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2528004850 0x7f2528004cd0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f2538009b60 tx=0x7f2528005880 comp rx=0 tx=0).stop 2023-07-25T14:38:08.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.993+0000 7f2541fb4700 1 -- 172.21.15.72:0/2606929010 reap_dead start 2023-07-25T14:38:08.009 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.993+0000 7f2543a17700 1 -- 172.21.15.72:0/2606929010 shutdown_connections 2023-07-25T14:38:08.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.993+0000 7f2543a17700 1 -- 172.21.15.72:0/2606929010 >> 172.21.15.72:0/2606929010 conn(0x7f253c0a87e0 msgr2=0x7f253c0a8bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:38:08.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.993+0000 7f2543a17700 1 -- 172.21.15.72:0/2606929010 shutdown_connections 2023-07-25T14:38:08.010 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.993+0000 7f2543a17700 1 -- 172.21.15.72:0/2606929010 wait complete. 2023-07-25T14:38:08.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.994+0000 7f2543a17700 1 Processor -- start 2023-07-25T14:38:08.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.994+0000 7f2543a17700 1 -- start start 2023-07-25T14:38:08.012 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.995+0000 7f2543a17700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2528004850 0x7f253c1ecaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:38:08.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.995+0000 7f2543a17700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f253c150900 0x7f253c1ecfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:38:08.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.995+0000 7f2543a17700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f253c0a7fd0 0x7f253c14b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:38:08.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.995+0000 7f2543a17700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f253c154260 con 0x7f2528004850 2023-07-25T14:38:08.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.995+0000 7f2543a17700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f253c153930 con 0x7f253c0a7fd0 2023-07-25T14:38:08.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.995+0000 7f2543a17700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f253c153c10 con 0x7f253c150900 2023-07-25T14:38:08.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.995+0000 7f25417b3700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2528004850 0x7f253c1ecaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:38:08.013 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.995+0000 7f25417b3700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2528004850 0x7f253c1ecaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:44280/0 (socket says 172.21.15.72:44280) 2023-07-25T14:38:08.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.995+0000 7f25417b3700 1 -- 172.21.15.72:0/2066211029 learned_addr learned my addr 172.21.15.72:0/2066211029 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:38:08.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.995+0000 7f2540fb2700 1 --2- 172.21.15.72:0/2066211029 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f253c150900 0x7f253c1ecfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:38:08.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.995+0000 7f2541fb4700 1 --2- 172.21.15.72:0/2066211029 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f253c0a7fd0 0x7f253c14b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:38:08.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.995+0000 7f25417b3700 1 -- 172.21.15.72:0/2066211029 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f253c150900 msgr2=0x7f253c1ecfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:38:08.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.995+0000 7f25417b3700 1 --2- 172.21.15.72:0/2066211029 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f253c150900 0x7f253c1ecfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:38:08.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.995+0000 7f25417b3700 1 -- 172.21.15.72:0/2066211029 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f253c0a7fd0 msgr2=0x7f253c14b7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:38:08.014 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.995+0000 7f25417b3700 1 --2- 172.21.15.72:0/2066211029 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f253c0a7fd0 0x7f253c14b7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:38:08.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.995+0000 7f25417b3700 1 -- 172.21.15.72:0/2066211029 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f253c153ef0 con 0x7f2528004850 2023-07-25T14:38:08.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.995+0000 7f2541fb4700 1 --2- 172.21.15.72:0/2066211029 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f253c0a7fd0 0x7f253c14b7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-25T14:38:08.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.995+0000 7f25417b3700 1 --2- 172.21.15.72:0/2066211029 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2528004850 0x7f253c1ecaa0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f252c011aa0 tx=0x7f252c011db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:38:08.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.995+0000 7f2531ffb700 1 -- 172.21.15.72:0/2066211029 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f252c00f940 con 0x7f2528004850 2023-07-25T14:38:08.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.995+0000 7f2531ffb700 1 -- 172.21.15.72:0/2066211029 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f252c00faa0 con 0x7f2528004850 2023-07-25T14:38:08.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.996+0000 7f2531ffb700 1 -- 172.21.15.72:0/2066211029 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f252c00fe50 con 0x7f2528004850 2023-07-25T14:38:08.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.996+0000 7f2543a17700 1 -- 172.21.15.72:0/2066211029 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f253c14bd10 con 0x7f2528004850 2023-07-25T14:38:08.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.996+0000 7f2543a17700 1 -- 172.21.15.72:0/2066211029 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f253c14c180 con 0x7f2528004850 2023-07-25T14:38:08.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.997+0000 7f2543a17700 1 -- 172.21.15.72:0/2066211029 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f253c154540 con 0x7f2528004850 2023-07-25T14:38:08.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.997+0000 7f2531ffb700 1 -- 172.21.15.72:0/2066211029 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f252c014440 con 0x7f2528004850 2023-07-25T14:38:08.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.997+0000 7f2531ffb700 1 --2- 172.21.15.72:0/2066211029 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f252006ace0 0x7f252006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:38:08.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.998+0000 7f2540fb2700 1 --2- 172.21.15.72:0/2066211029 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f252006ace0 0x7f252006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:38:08.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.998+0000 7f2531ffb700 1 -- 172.21.15.72:0/2066211029 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 7238+0+0 (secure 0 0 0) 0x7f252c08a130 con 0x7f2528004850 2023-07-25T14:38:08.016 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:07.998+0000 7f2540fb2700 1 --2- 172.21.15.72:0/2066211029 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f252006ace0 0x7f252006d1a0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f25380090b0 tx=0x7f253801f040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:38:08.017 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:08.002+0000 7f2531ffb700 1 -- 172.21.15.72:0/2066211029 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f252c0587d0 con 0x7f2528004850 2023-07-25T14:38:08.201 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:08.191+0000 7f2543a17700 1 -- 172.21.15.72:0/2066211029 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f253c04e470 con 0x7f2528004850 2023-07-25T14:38:08.202 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:08.192+0000 7f2531ffb700 1 -- 172.21.15.72:0/2066211029 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v61) v1 ==== 74+0+22155 (secure 0 0 0) 0x7f252c058360 con 0x7f2528004850 2023-07-25T14:38:08.203 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-07-25T14:38:08.203 INFO:teuthology.orchestra.run.smithi072.stdout:{"epoch":61,"fsid":"9170db48-9170-43e8-8ccb-9813e6240906","created":"2023-07-25T14:35:21.733262+0000","modified":"2023-07-25T14:37:59.246173+0000","last_up_change":"2023-07-25T14:35:31.355010+0000","last_in_change":"2023-07-25T14:35:24.195785+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-07-25T14:35:32.983457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-07-25T14:35:33.326342+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-07-25T14:37:42.689589+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-07-25T14:37:43.512214+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs2_metadata","create_time":"2023-07-25T14:37:56.130030+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs2_data","create_time":"2023-07-25T14:37:56.603570+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d517fdad-0bfe-49f0-89f2-9421c3761839","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6801","nonce":2475407414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6803","nonce":2475407414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6807","nonce":2475407414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":2475407414},{"type":"v1","addr":"172.21.15.72:6805","nonce":2475407414}]},"public_addr":"172.21.15.72:6801/2475407414","cluster_addr":"172.21.15.72:6803/2475407414","heartbeat_back_addr":"172.21.15.72:6807/2475407414","heartbeat_front_addr":"172.21.15.72:6805/2475407414","state":["exists","up"]},{"osd":1,"uuid":"e1564be3-f209-47e5-a8d0-32fc618a474f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6820","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6822","nonce":870954016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6824","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6825","nonce":870954016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6830","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6831","nonce":870954016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6827","nonce":870954016},{"type":"v1","addr":"172.21.15.72:6829","nonce":870954016}]},"public_addr":"172.21.15.72:6822/870954016","cluster_addr":"172.21.15.72:6825/870954016","heartbeat_back_addr":"172.21.15.72:6831/870954016","heartbeat_front_addr":"172.21.15.72:6829/870954016","state":["exists","up"]},{"osd":2,"uuid":"c4647d30-ffa6-417a-9026-ef530c75910e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6808","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6809","nonce":2143129442}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6810","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6811","nonce":2143129442}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6814","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6815","nonce":2143129442}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6812","nonce":2143129442},{"type":"v1","addr":"172.21.15.72:6813","nonce":2143129442}]},"public_addr":"172.21.15.72:6809/2143129442","cluster_addr":"172.21.15.72:6811/2143129442","heartbeat_back_addr":"172.21.15.72:6815/2143129442","heartbeat_front_addr":"172.21.15.72:6813/2143129442","state":["exists","up"]},{"osd":3,"uuid":"76c9d9a7-c2e2-4612-a58b-d6882dd76b58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6816","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6817","nonce":3404066311}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6818","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6819","nonce":3404066311}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6826","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6828","nonce":3404066311}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6821","nonce":3404066311},{"type":"v1","addr":"172.21.15.72:6823","nonce":3404066311}]},"public_addr":"172.21.15.72:6817/3404066311","cluster_addr":"172.21.15.72:6819/3404066311","heartbeat_back_addr":"172.21.15.72:6828/3404066311","heartbeat_front_addr":"172.21.15.72:6823/3404066311","state":["exists","up"]},{"osd":4,"uuid":"7f8920dc-0ad4-4a73-ab40-65408f83eadd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6817","nonce":2381008739}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6819","nonce":2381008739}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6825","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6827","nonce":2381008739}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":2381008739},{"type":"v1","addr":"172.21.15.92:6822","nonce":2381008739}]},"public_addr":"172.21.15.92:6817/2381008739","cluster_addr":"172.21.15.92:6819/2381008739","heartbeat_back_addr":"172.21.15.92:6827/2381008739","heartbeat_front_addr":"172.21.15.92:6822/2381008739","state":["exists","up"]},{"osd":5,"uuid":"56257e7c-31eb-44c5-9ec7-1318a4e0bb35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6801","nonce":2161935604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6803","nonce":2161935604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6807","nonce":2161935604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":2161935604},{"type":"v1","addr":"172.21.15.92:6805","nonce":2161935604}]},"public_addr":"172.21.15.92:6801/2161935604","cluster_addr":"172.21.15.92:6803/2161935604","heartbeat_back_addr":"172.21.15.92:6807/2161935604","heartbeat_front_addr":"172.21.15.92:6805/2161935604","state":["exists","up"]},{"osd":6,"uuid":"a150d3d8-a0c9-4955-968a-8d98eff4ffb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6809","nonce":3770163493}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6811","nonce":3770163493}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6815","nonce":3770163493}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":3770163493},{"type":"v1","addr":"172.21.15.92:6813","nonce":3770163493}]},"public_addr":"172.21.15.92:6809/3770163493","cluster_addr":"172.21.15.92:6811/3770163493","heartbeat_back_addr":"172.21.15.92:6815/3770163493","heartbeat_front_addr":"172.21.15.92:6813/3770163493","state":["exists","up"]},{"osd":7,"uuid":"07799c27-54ee-4591-a42d-a978d6b32065","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6821","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6823","nonce":2135777609}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6826","nonce":2135777609}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6831","nonce":2135777609}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":2135777609},{"type":"v1","addr":"172.21.15.92:6829","nonce":2135777609}]},"public_addr":"172.21.15.92:6823/2135777609","cluster_addr":"172.21.15.92:6826/2135777609","heartbeat_back_addr":"172.21.15.92:6831/2135777609","heartbeat_front_addr":"172.21.15.92:6829/2135777609","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.345365+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.378150+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.146566+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.372172+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:30.398421+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.385632+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.465611+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-25T14:35:29.443583+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-25T14:38:08.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:08.194+0000 7f2543a17700 1 -- 172.21.15.72:0/2066211029 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f252006ace0 msgr2=0x7f252006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:38:08.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:08.194+0000 7f2543a17700 1 --2- 172.21.15.72:0/2066211029 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f252006ace0 0x7f252006d1a0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f25380090b0 tx=0x7f253801f040 comp rx=0 tx=0).stop 2023-07-25T14:38:08.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:08.194+0000 7f2543a17700 1 -- 172.21.15.72:0/2066211029 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2528004850 msgr2=0x7f253c1ecaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:38:08.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:08.194+0000 7f2543a17700 1 --2- 172.21.15.72:0/2066211029 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2528004850 0x7f253c1ecaa0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f252c011aa0 tx=0x7f252c011db0 comp rx=0 tx=0).stop 2023-07-25T14:38:08.205 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:08.194+0000 7f2543a17700 1 -- 172.21.15.72:0/2066211029 shutdown_connections 2023-07-25T14:38:08.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:08.194+0000 7f2543a17700 1 --2- 172.21.15.72:0/2066211029 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f252006ace0 0x7f252006d1a0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:38:08.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:08.194+0000 7f2543a17700 1 --2- 172.21.15.72:0/2066211029 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f253c0a7fd0 0x7f253c14b7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:38:08.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:08.194+0000 7f2543a17700 1 --2- 172.21.15.72:0/2066211029 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f2528004850 0x7f253c1ecaa0 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:38:08.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:08.194+0000 7f2543a17700 1 --2- 172.21.15.72:0/2066211029 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f253c150900 0x7f253c1ecfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:38:08.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:08.194+0000 7f2543a17700 1 -- 172.21.15.72:0/2066211029 >> 172.21.15.72:0/2066211029 conn(0x7f253c0a87e0 msgr2=0x7f253c14f9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:38:08.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:08.194+0000 7f2543a17700 1 -- 172.21.15.72:0/2066211029 shutdown_connections 2023-07-25T14:38:08.206 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:08.194+0000 7f2543a17700 1 -- 172.21.15.72:0/2066211029 wait complete. 2023-07-25T14:38:08.217 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-07-25T14:35:32.983457+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-07-25T14:35:33.326342+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-25T14:37:42.689589+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '56', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs_data', 'create_time': '2023-07-25T14:37:43.512214+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '57', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-07-25T14:37:56.130030+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '60', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs2_data', 'create_time': '2023-07-25T14:37:56.603570+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '61', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-25T14:38:08.218 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-25T14:38:08.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:08.331+0000 7feb0528e700 1 Processor -- start 2023-07-25T14:38:08.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:08.331+0000 7feb0528e700 1 -- start start 2023-07-25T14:38:08.345 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:08.332+0000 7feb0528e700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7feb00151950 0x7feb0006a190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:38:08.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:08.332+0000 7feb0528e700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7feb0006a6d0 0x7feb000c3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:38:08.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:08.332+0000 7feb0528e700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb000c2fe0 con 0x7feb000724c0 2023-07-25T14:38:08.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:08.332+0000 7feb0528e700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb00071a60 con 0x7feb00151950 2023-07-25T14:38:08.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:08.332+0000 7feb0528e700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb000c2a70 con 0x7feb0006a6d0 2023-07-25T14:38:08.346 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:08.332+0000 7feafeffd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7feb00151950 0x7feb0006a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:38:08.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:08.332+0000 7feafe7fc700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7feb000724c0 0x7feb000c34c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:35024/0 (socket says 172.21.15.72:35024) 2023-07-25T14:38:08.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:08.332+0000 7feafe7fc700 1 -- 172.21.15.72:0/1436405027 learned_addr learned my addr 172.21.15.72:0/1436405027 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:38:08.347 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:08.332+0000 7feafeffd700 1 -- 172.21.15.72:0/1436405027 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7feb0006a6d0 msgr2=0x7feb000c3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:38:08.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:08.332+0000 7feaff7fe700 1 --2- 172.21.15.72:0/1436405027 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7feb0006a6d0 0x7feb000c3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:38:08.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:08.332+0000 7feafeffd700 1 --2- 172.21.15.72:0/1436405027 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7feb0006a6d0 0x7feb000c3bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:38:08.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:08.332+0000 7feafeffd700 1 -- 172.21.15.72:0/1436405027 >> v1:172.21.15.72:6789/0 conn(0x7feb000724c0 legacy=0x7feb000c34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:38:08.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:08.332+0000 7feafeffd700 1 -- 172.21.15.72:0/1436405027 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb00155070 con 0x7feb00151950 2023-07-25T14:38:08.348 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:08.332+0000 7feafdffb700 1 -- 172.21.15.72:0/1436405027 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3628328379 0 0) 0x7feb000c2fe0 con 0x7feb000724c0 2023-07-25T14:38:08.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:08.332+0000 7feaff7fe700 1 --2- 172.21.15.72:0/1436405027 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7feb0006a6d0 0x7feb000c3bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-25T14:38:08.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:08.333+0000 7feafeffd700 1 --2- 172.21.15.72:0/1436405027 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feb00151950 0x7feb0006a190 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7feaf4009840 tx=0x7feaf4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9053a73a870131a server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:38:08.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:08.333+0000 7feafdffb700 1 -- 172.21.15.72:0/1436405027 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaf4011830 con 0x7feb00151950 2023-07-25T14:38:08.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:08.333+0000 7feafdffb700 1 -- 172.21.15.72:0/1436405027 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feaf4011990 con 0x7feb00151950 2023-07-25T14:38:08.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:08.333+0000 7feafdffb700 1 -- 172.21.15.72:0/1436405027 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaf4011d20 con 0x7feb00151950 2023-07-25T14:38:08.349 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:08.333+0000 7feb0528e700 1 -- 172.21.15.72:0/1436405027 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feb00151950 msgr2=0x7feb0006a190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:38:08.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:08.333+0000 7feb0528e700 1 --2- 172.21.15.72:0/1436405027 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feb00151950 0x7feb0006a190 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7feaf4009840 tx=0x7feaf4009b50 comp rx=0 tx=0).stop 2023-07-25T14:38:08.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:08.333+0000 7feb0528e700 1 -- 172.21.15.72:0/1436405027 shutdown_connections 2023-07-25T14:38:08.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:08.333+0000 7feb0528e700 1 --2- 172.21.15.72:0/1436405027 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7feb0006a6d0 0x7feb000c3bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:38:08.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:08.333+0000 7feb0528e700 1 --2- 172.21.15.72:0/1436405027 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feb00151950 0x7feb0006a190 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:38:08.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:08.333+0000 7feb0528e700 1 -- 172.21.15.72:0/1436405027 >> 172.21.15.72:0/1436405027 conn(0x7feb000a87e0 msgr2=0x7feb000a8bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:38:08.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:08.333+0000 7feb0528e700 1 -- 172.21.15.72:0/1436405027 shutdown_connections 2023-07-25T14:38:08.350 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:08.333+0000 7feb0528e700 1 -- 172.21.15.72:0/1436405027 wait complete. 2023-07-25T14:38:08.352 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:08.335+0000 7feb0528e700 1 Processor -- start 2023-07-25T14:38:08.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:08.335+0000 7feb0528e700 1 -- start start 2023-07-25T14:38:08.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:08.335+0000 7feb0528e700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7feb0006a6d0 0x7feb000ac490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:38:08.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:08.335+0000 7feb0528e700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feb000724c0 0x7feb001e9450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:38:08.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:08.335+0000 7feb0528e700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feb00151950 0x7feb0014d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:38:08.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:08.335+0000 7feb0528e700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb001579a0 con 0x7feb000724c0 2023-07-25T14:38:08.354 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:08.335+0000 7feb0528e700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb00157420 con 0x7feb00151950 2023-07-25T14:38:08.354 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:08.335+0000 7feb0528e700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb001e9d90 con 0x7feb0006a6d0 2023-07-25T14:38:08.354 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:08.336+0000 7feafe7fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feb000724c0 0x7feb001e9450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:38:08.354 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:08.336+0000 7feafe7fc700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feb000724c0 0x7feb001e9450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:44292/0 (socket says 172.21.15.72:44292) 2023-07-25T14:38:08.354 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:08.336+0000 7feafe7fc700 1 -- 172.21.15.72:0/1516730773 learned_addr learned my addr 172.21.15.72:0/1516730773 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:38:08.354 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:08.336+0000 7feafeffd700 1 --2- 172.21.15.72:0/1516730773 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7feb0006a6d0 0x7feb000ac490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:38:08.355 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:08.336+0000 7feaff7fe700 1 --2- 172.21.15.72:0/1516730773 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feb00151950 0x7feb0014d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:38:08.355 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:08.336+0000 7feafe7fc700 1 -- 172.21.15.72:0/1516730773 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7feb0006a6d0 msgr2=0x7feb000ac490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:38:08.355 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:08.336+0000 7feafe7fc700 1 --2- 172.21.15.72:0/1516730773 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7feb0006a6d0 0x7feb000ac490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:38:08.355 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:08.336+0000 7feafe7fc700 1 -- 172.21.15.72:0/1516730773 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feb00151950 msgr2=0x7feb0014d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:38:08.355 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:08.336+0000 7feafe7fc700 1 --2- 172.21.15.72:0/1516730773 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feb00151950 0x7feb0014d530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:38:08.355 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:08.336+0000 7feafe7fc700 1 -- 172.21.15.72:0/1516730773 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaf40094a0 con 0x7feb000724c0 2023-07-25T14:38:08.355 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:08.336+0000 7feafeffd700 1 --2- 172.21.15.72:0/1516730773 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7feb0006a6d0 0x7feb000ac490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-25T14:38:08.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:08.336+0000 7feafe7fc700 1 --2- 172.21.15.72:0/1516730773 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feb000724c0 0x7feb001e9450 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7feaf00011e0 tx=0x7feaf000cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:38:08.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:08.336+0000 7feae77fe700 1 -- 172.21.15.72:0/1516730773 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaf0004c80 con 0x7feb000724c0 2023-07-25T14:38:08.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:08.336+0000 7feae77fe700 1 -- 172.21.15.72:0/1516730773 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feaf0004e00 con 0x7feb000724c0 2023-07-25T14:38:08.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:08.336+0000 7feb0528e700 1 -- 172.21.15.72:0/1516730773 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb001576c0 con 0x7feb000724c0 2023-07-25T14:38:08.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:08.336+0000 7feae77fe700 1 -- 172.21.15.72:0/1516730773 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaf0007310 con 0x7feb000724c0 2023-07-25T14:38:08.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:08.336+0000 7feb0528e700 1 -- 172.21.15.72:0/1516730773 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb000c3550 con 0x7feb000724c0 2023-07-25T14:38:08.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:08.337+0000 7feb0528e700 1 -- 172.21.15.72:0/1516730773 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb0004e470 con 0x7feb000724c0 2023-07-25T14:38:08.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:08.338+0000 7feae77fe700 1 -- 172.21.15.72:0/1516730773 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7feaf0007470 con 0x7feb000724c0 2023-07-25T14:38:08.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:08.338+0000 7feae77fe700 1 --2- 172.21.15.72:0/1516730773 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7feaec06ace0 0x7feaec06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:38:08.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:08.338+0000 7feafeffd700 1 --2- 172.21.15.72:0/1516730773 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7feaec06ace0 0x7feaec06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:38:08.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:08.338+0000 7feae77fe700 1 -- 172.21.15.72:0/1516730773 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 7238+0+0 (secure 0 0 0) 0x7feaf00896a0 con 0x7feb000724c0 2023-07-25T14:38:08.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:08.339+0000 7feafeffd700 1 --2- 172.21.15.72:0/1516730773 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7feaec06ace0 0x7feaec06d1a0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7feaf40090b0 tx=0x7feaf401c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:38:08.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:08.343+0000 7feae77fe700 1 -- 172.21.15.72:0/1516730773 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7feaf00542b0 con 0x7feb000724c0 2023-07-25T14:38:08.542 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:08.532+0000 7feb0528e700 1 -- 172.21.15.72:0/1516730773 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7feb000722a0 con 0x7feb000724c0 2023-07-25T14:38:08.543 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:08.532+0000 7feae77fe700 1 -- 172.21.15.72:0/1516730773 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v61) v1 ==== 92+0+10 (secure 0 0 0) 0x7feaf00578d0 con 0x7feb000724c0 2023-07-25T14:38:08.543 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 8 2023-07-25T14:38:08.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:08.534+0000 7feb0528e700 1 -- 172.21.15.72:0/1516730773 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7feaec06ace0 msgr2=0x7feaec06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:38:08.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:08.534+0000 7feb0528e700 1 --2- 172.21.15.72:0/1516730773 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7feaec06ace0 0x7feaec06d1a0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7feaf40090b0 tx=0x7feaf401c040 comp rx=0 tx=0).stop 2023-07-25T14:38:08.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:08.534+0000 7feb0528e700 1 -- 172.21.15.72:0/1516730773 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feb000724c0 msgr2=0x7feb001e9450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:38:08.545 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:08.534+0000 7feb0528e700 1 --2- 172.21.15.72:0/1516730773 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feb000724c0 0x7feb001e9450 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7feaf00011e0 tx=0x7feaf000cae0 comp rx=0 tx=0).stop 2023-07-25T14:38:08.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:08.535+0000 7feb0528e700 1 -- 172.21.15.72:0/1516730773 shutdown_connections 2023-07-25T14:38:08.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:08.535+0000 7feb0528e700 1 --2- 172.21.15.72:0/1516730773 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7feaec06ace0 0x7feaec06d1a0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:38:08.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:08.535+0000 7feb0528e700 1 --2- 172.21.15.72:0/1516730773 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7feb0006a6d0 0x7feb000ac490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:38:08.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:08.535+0000 7feb0528e700 1 --2- 172.21.15.72:0/1516730773 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feb00151950 0x7feb0014d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:38:08.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:08.535+0000 7feb0528e700 1 --2- 172.21.15.72:0/1516730773 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feb000724c0 0x7feb001e9450 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:38:08.546 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:08.535+0000 7feb0528e700 1 -- 172.21.15.72:0/1516730773 >> 172.21.15.72:0/1516730773 conn(0x7feb000a87e0 msgr2=0x7feb0014fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:38:08.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:08.535+0000 7feb0528e700 1 -- 172.21.15.72:0/1516730773 shutdown_connections 2023-07-25T14:38:08.547 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:08.535+0000 7feb0528e700 1 -- 172.21.15.72:0/1516730773 wait complete. 2023-07-25T14:38:08.557 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-25T14:38:08.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:08.670+0000 7f32c0f6f700 1 Processor -- start 2023-07-25T14:38:08.680 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:08.670+0000 7f32c0f6f700 1 -- start start 2023-07-25T14:38:08.681 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:08.670+0000 7f32c0f6f700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f32bc0bf5d0 0x7f32bc0a7490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:38:08.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:08.670+0000 7f32c0f6f700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f32bc06ed70 0x7f32bc0bf9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:38:08.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:08.670+0000 7f32c0f6f700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32bc066050 con 0x7f32bc06a190 2023-07-25T14:38:08.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:08.670+0000 7f32c0f6f700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32bc06b560 con 0x7f32bc0bf5d0 2023-07-25T14:38:08.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:08.670+0000 7f32c0f6f700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32bc151be0 con 0x7f32bc06ed70 2023-07-25T14:38:08.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:08.671+0000 7f32ba59c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f32bc0bf5d0 0x7f32bc0a7490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:38:08.682 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:08.671+0000 7f32ba59c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f32bc0bf5d0 0x7f32bc0a7490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:44300/0 (socket says 172.21.15.72:44300) 2023-07-25T14:38:08.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:08.671+0000 7f32ba59c700 1 -- 172.21.15.72:0/362013582 learned_addr learned my addr 172.21.15.72:0/362013582 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:38:08.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:08.671+0000 7f32b9d9b700 1 --2- 172.21.15.72:0/362013582 >> v2:172.21.15.92:3300/0 conn(0x7f32bc06ed70 0x7f32bc0bf9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:38:08.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:08.671+0000 7f32ba59c700 1 -- 172.21.15.72:0/362013582 >> v2:172.21.15.92:3300/0 conn(0x7f32bc06ed70 msgr2=0x7f32bc0bf9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:38:08.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:08.671+0000 7f32ba59c700 1 --2- 172.21.15.72:0/362013582 >> v2:172.21.15.92:3300/0 conn(0x7f32bc06ed70 0x7f32bc0bf9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:38:08.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:08.671+0000 7f32ba59c700 1 -- 172.21.15.72:0/362013582 >> v1:172.21.15.92:6789/0 conn(0x7f32bc06a190 legacy=0x7f32bc157830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:38:08.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:08.671+0000 7f32ba59c700 1 -- 172.21.15.72:0/362013582 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32bc154d60 con 0x7f32bc0bf5d0 2023-07-25T14:38:08.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:08.671+0000 7f32ba59c700 1 --2- 172.21.15.72:0/362013582 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f32bc0bf5d0 0x7f32bc0a7490 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f32bc0683e0 tx=0x7f32b0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdea3a4461894902 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:38:08.683 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:08.671+0000 7f32b959a700 1 -- 172.21.15.72:0/362013582 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32b0004230 con 0x7f32bc0bf5d0 2023-07-25T14:38:08.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:08.671+0000 7f32b959a700 1 -- 172.21.15.72:0/362013582 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32b0004390 con 0x7f32bc0bf5d0 2023-07-25T14:38:08.684 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:08.671+0000 7f32b959a700 1 -- 172.21.15.72:0/362013582 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32b00036a0 con 0x7f32bc0bf5d0 2023-07-25T14:38:08.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:08.672+0000 7f32c0f6f700 1 -- 172.21.15.72:0/362013582 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f32bc0bf5d0 msgr2=0x7f32bc0a7490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:38:08.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:08.672+0000 7f32c0f6f700 1 --2- 172.21.15.72:0/362013582 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f32bc0bf5d0 0x7f32bc0a7490 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f32bc0683e0 tx=0x7f32b0009bd0 comp rx=0 tx=0).stop 2023-07-25T14:38:08.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:08.672+0000 7f32c0f6f700 1 -- 172.21.15.72:0/362013582 shutdown_connections 2023-07-25T14:38:08.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:08.672+0000 7f32c0f6f700 1 --2- 172.21.15.72:0/362013582 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f32bc0bf5d0 0x7f32bc0a7490 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:38:08.686 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:08.672+0000 7f32c0f6f700 1 --2- 172.21.15.72:0/362013582 >> v2:172.21.15.92:3300/0 conn(0x7f32bc06ed70 0x7f32bc0bf9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:38:08.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:08.672+0000 7f32c0f6f700 1 -- 172.21.15.72:0/362013582 >> 172.21.15.72:0/362013582 conn(0x7f32bc06def0 msgr2=0x7f32bc06e300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:38:08.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:08.672+0000 7f32c0f6f700 1 -- 172.21.15.72:0/362013582 shutdown_connections 2023-07-25T14:38:08.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:08.672+0000 7f32c0f6f700 1 -- 172.21.15.72:0/362013582 wait complete. 2023-07-25T14:38:08.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:08.673+0000 7f32c0f6f700 1 Processor -- start 2023-07-25T14:38:08.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:08.673+0000 7f32c0f6f700 1 -- start start 2023-07-25T14:38:08.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:08.674+0000 7f32c0f6f700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f32bc06a190 0x7f32bc14b930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:38:08.687 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:08.674+0000 7f32c0f6f700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f32bc06ed70 0x7f32bc14c780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:38:08.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:08.674+0000 7f32c0f6f700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f32bc0bf5d0 0x7f32bc14e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:38:08.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:08.674+0000 7f32c0f6f700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32bc14d3a0 con 0x7f32bc0bf5d0 2023-07-25T14:38:08.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:08.674+0000 7f32c0f6f700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32bc14d0c0 con 0x7f32bc06ed70 2023-07-25T14:38:08.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:08.674+0000 7f32c0f6f700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32bc152f60 con 0x7f32bc06a190 2023-07-25T14:38:08.688 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:08.674+0000 7f32bad9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f32bc0bf5d0 0x7f32bc14e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:38:08.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:08.674+0000 7f32bad9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f32bc0bf5d0 0x7f32bc14e4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:44310/0 (socket says 172.21.15.72:44310) 2023-07-25T14:38:08.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:08.674+0000 7f32bad9d700 1 -- 172.21.15.72:0/1476638907 learned_addr learned my addr 172.21.15.72:0/1476638907 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:38:08.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:08.674+0000 7f32b9d9b700 1 --2- 172.21.15.72:0/1476638907 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f32bc06ed70 0x7f32bc14c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:38:08.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:08.674+0000 7f32ba59c700 1 --2- 172.21.15.72:0/1476638907 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f32bc06a190 0x7f32bc14b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:38:08.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:08.674+0000 7f32bad9d700 1 -- 172.21.15.72:0/1476638907 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f32bc06a190 msgr2=0x7f32bc14b930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:38:08.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:08.674+0000 7f32bad9d700 1 --2- 172.21.15.72:0/1476638907 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f32bc06a190 0x7f32bc14b930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:38:08.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:08.674+0000 7f32bad9d700 1 -- 172.21.15.72:0/1476638907 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f32bc06ed70 msgr2=0x7f32bc14c780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:38:08.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:08.674+0000 7f32bad9d700 1 --2- 172.21.15.72:0/1476638907 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f32bc06ed70 0x7f32bc14c780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:38:08.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:08.674+0000 7f32bad9d700 1 -- 172.21.15.72:0/1476638907 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32b0009550 con 0x7f32bc0bf5d0 2023-07-25T14:38:08.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:08.674+0000 7f32b9d9b700 1 --2- 172.21.15.72:0/1476638907 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f32bc06ed70 0x7f32bc14c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-25T14:38:08.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:08.674+0000 7f32bad9d700 1 --2- 172.21.15.72:0/1476638907 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f32bc0bf5d0 0x7f32bc14e4d0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f32b400b970 tx=0x7f32b400bd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:38:08.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:08.675+0000 7f32aaffd700 1 -- 172.21.15.72:0/1476638907 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32b400c9b0 con 0x7f32bc0bf5d0 2023-07-25T14:38:08.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:08.675+0000 7f32aaffd700 1 -- 172.21.15.72:0/1476638907 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32b400cb10 con 0x7f32bc0bf5d0 2023-07-25T14:38:08.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:08.675+0000 7f32c0f6f700 1 -- 172.21.15.72:0/1476638907 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32bc153240 con 0x7f32bc0bf5d0 2023-07-25T14:38:08.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:08.675+0000 7f32aaffd700 1 -- 172.21.15.72:0/1476638907 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32b4014440 con 0x7f32bc0bf5d0 2023-07-25T14:38:08.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:08.675+0000 7f32c0f6f700 1 -- 172.21.15.72:0/1476638907 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32bc0c20e0 con 0x7f32bc0bf5d0 2023-07-25T14:38:08.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:08.676+0000 7f32c0f6f700 1 -- 172.21.15.72:0/1476638907 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32bc1533d0 con 0x7f32bc0bf5d0 2023-07-25T14:38:08.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:08.676+0000 7f32aaffd700 1 -- 172.21.15.72:0/1476638907 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f32b401d3b0 con 0x7f32bc0bf5d0 2023-07-25T14:38:08.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:08.676+0000 7f32aaffd700 1 --2- 172.21.15.72:0/1476638907 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f329c06ace0 0x7f329c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:38:08.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:08.676+0000 7f32aaffd700 1 -- 172.21.15.72:0/1476638907 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 7238+0+0 (secure 0 0 0) 0x7f32b40895e0 con 0x7f32bc0bf5d0 2023-07-25T14:38:08.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:08.676+0000 7f32ba59c700 1 --2- 172.21.15.72:0/1476638907 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f329c06ace0 0x7f329c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:38:08.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:08.677+0000 7f32ba59c700 1 --2- 172.21.15.72:0/1476638907 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f329c06ace0 0x7f329c06d1a0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f32b0000c00 tx=0x7f32b0008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:38:08.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:08.681+0000 7f32aaffd700 1 -- 172.21.15.72:0/1476638907 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f32b40541e0 con 0x7f32bc0bf5d0 2023-07-25T14:38:08.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:08.868+0000 7f32c0f6f700 1 -- 172.21.15.72:0/1476638907 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f32bc04e470 con 0x7f32bc0bf5d0 2023-07-25T14:38:08.879 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:08.869+0000 7f32aaffd700 1 -- 172.21.15.72:0/1476638907 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v61) v1 ==== 93+0+10 (secure 0 0 0) 0x7f32b4057800 con 0x7f32bc0bf5d0 2023-07-25T14:38:08.879 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 1 2023-07-25T14:38:08.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:08.871+0000 7f32c0f6f700 1 -- 172.21.15.72:0/1476638907 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f329c06ace0 msgr2=0x7f329c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:38:08.881 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:08.871+0000 7f32c0f6f700 1 --2- 172.21.15.72:0/1476638907 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f329c06ace0 0x7f329c06d1a0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f32b0000c00 tx=0x7f32b0008030 comp rx=0 tx=0).stop 2023-07-25T14:38:08.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:08.871+0000 7f32c0f6f700 1 -- 172.21.15.72:0/1476638907 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f32bc0bf5d0 msgr2=0x7f32bc14e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:38:08.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:08.871+0000 7f32c0f6f700 1 --2- 172.21.15.72:0/1476638907 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f32bc0bf5d0 0x7f32bc14e4d0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f32b400b970 tx=0x7f32b400bd30 comp rx=0 tx=0).stop 2023-07-25T14:38:08.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:08.871+0000 7f32c0f6f700 1 -- 172.21.15.72:0/1476638907 shutdown_connections 2023-07-25T14:38:08.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:08.871+0000 7f32c0f6f700 1 --2- 172.21.15.72:0/1476638907 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f329c06ace0 0x7f329c06d1a0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:38:08.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:08.871+0000 7f32c0f6f700 1 --2- 172.21.15.72:0/1476638907 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f32bc06a190 0x7f32bc14b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:38:08.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:08.871+0000 7f32c0f6f700 1 --2- 172.21.15.72:0/1476638907 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f32bc0bf5d0 0x7f32bc14e4d0 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:38:08.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:08.871+0000 7f32c0f6f700 1 --2- 172.21.15.72:0/1476638907 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f32bc06ed70 0x7f32bc14c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:38:08.882 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:08.871+0000 7f32c0f6f700 1 -- 172.21.15.72:0/1476638907 >> 172.21.15.72:0/1476638907 conn(0x7f32bc06def0 msgr2=0x7f32bc06a5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:38:08.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:08.871+0000 7f32c0f6f700 1 -- 172.21.15.72:0/1476638907 shutdown_connections 2023-07-25T14:38:08.883 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:08.871+0000 7f32c0f6f700 1 -- 172.21.15.72:0/1476638907 wait complete. 2023-07-25T14:38:08.893 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-25T14:38:09.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.005+0000 7f3d18902700 1 Processor -- start 2023-07-25T14:38:09.015 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.005+0000 7f3d18902700 1 -- start start 2023-07-25T14:38:09.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.006+0000 7f3d18902700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f3d140bf5d0 0x7f3d140a7490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:38:09.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.006+0000 7f3d18902700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f3d1406a190 0x7f3d1415ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:38:09.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.006+0000 7f3d18902700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d14066050 con 0x7f3d1406ed70 2023-07-25T14:38:09.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.006+0000 7f3d18902700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d1406b560 con 0x7f3d140bf5d0 2023-07-25T14:38:09.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.006+0000 7f3d18902700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d14151be0 con 0x7f3d1406a190 2023-07-25T14:38:09.018 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.006+0000 7f3d1259c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f3d140bf5d0 0x7f3d140a7490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:38:09.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.006+0000 7f3d1259c700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f3d140bf5d0 0x7f3d140a7490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:44314/0 (socket says 172.21.15.72:44314) 2023-07-25T14:38:09.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.006+0000 7f3d1259c700 1 -- 172.21.15.72:0/2559946280 learned_addr learned my addr 172.21.15.72:0/2559946280 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:38:09.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.006+0000 7f3d12d9d700 1 --2- 172.21.15.72:0/2559946280 >> v2:172.21.15.92:3300/0 conn(0x7f3d1406a190 0x7f3d1415ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:38:09.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.006+0000 7f3d1259c700 1 -- 172.21.15.72:0/2559946280 >> v2:172.21.15.92:3300/0 conn(0x7f3d1406a190 msgr2=0x7f3d1415ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:38:09.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.006+0000 7f3d1259c700 1 --2- 172.21.15.72:0/2559946280 >> v2:172.21.15.92:3300/0 conn(0x7f3d1406a190 0x7f3d1415ebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:38:09.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.006+0000 7f3d1259c700 1 -- 172.21.15.72:0/2559946280 >> v1:172.21.15.92:6789/0 conn(0x7f3d1406ed70 legacy=0x7f3d140bf9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:38:09.019 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.006+0000 7f3d1259c700 1 -- 172.21.15.72:0/2559946280 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d14154d60 con 0x7f3d140bf5d0 2023-07-25T14:38:09.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.006+0000 7f3d1259c700 1 --2- 172.21.15.72:0/2559946280 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3d140bf5d0 0x7f3d140a7490 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f3d140665f0 tx=0x7f3d08009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4dba043aa7f07ebc server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:38:09.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.006+0000 7f3d1159a700 1 -- 172.21.15.72:0/2559946280 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d0800b870 con 0x7f3d140bf5d0 2023-07-25T14:38:09.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.006+0000 7f3d1159a700 1 -- 172.21.15.72:0/2559946280 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d0800b9d0 con 0x7f3d140bf5d0 2023-07-25T14:38:09.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.006+0000 7f3d1159a700 1 -- 172.21.15.72:0/2559946280 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d0800bd60 con 0x7f3d140bf5d0 2023-07-25T14:38:09.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.007+0000 7f3d18902700 1 -- 172.21.15.72:0/2559946280 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3d140bf5d0 msgr2=0x7f3d140a7490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:38:09.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.007+0000 7f3d18902700 1 --2- 172.21.15.72:0/2559946280 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3d140bf5d0 0x7f3d140a7490 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f3d140665f0 tx=0x7f3d08009bd0 comp rx=0 tx=0).stop 2023-07-25T14:38:09.020 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.007+0000 7f3d18902700 1 -- 172.21.15.72:0/2559946280 shutdown_connections 2023-07-25T14:38:09.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.007+0000 7f3d18902700 1 --2- 172.21.15.72:0/2559946280 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3d140bf5d0 0x7f3d140a7490 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:38:09.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.007+0000 7f3d18902700 1 --2- 172.21.15.72:0/2559946280 >> v2:172.21.15.92:3300/0 conn(0x7f3d1406a190 0x7f3d1415ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:38:09.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.007+0000 7f3d18902700 1 -- 172.21.15.72:0/2559946280 >> 172.21.15.72:0/2559946280 conn(0x7f3d1406def0 msgr2=0x7f3d1406e300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:38:09.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.007+0000 7f3d18902700 1 -- 172.21.15.72:0/2559946280 shutdown_connections 2023-07-25T14:38:09.021 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.007+0000 7f3d18902700 1 -- 172.21.15.72:0/2559946280 wait complete. 2023-07-25T14:38:09.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.008+0000 7f3d18902700 1 Processor -- start 2023-07-25T14:38:09.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.008+0000 7f3d18902700 1 -- start start 2023-07-25T14:38:09.023 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.009+0000 7f3d18902700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3d1406a190 0x7f3d141ed2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:38:09.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.009+0000 7f3d18902700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3d1406ed70 0x7f3d140710c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:38:09.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.009+0000 7f3d18902700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3d140bf5d0 0x7f3d14152a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:38:09.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.009+0000 7f3d18902700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d14154b10 con 0x7f3d140bf5d0 2023-07-25T14:38:09.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.009+0000 7f3d18902700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d1414bdf0 con 0x7f3d1406a190 2023-07-25T14:38:09.024 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.009+0000 7f3d18902700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d1414c0d0 con 0x7f3d1406ed70 2023-07-25T14:38:09.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.009+0000 7f3d12d9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3d140bf5d0 0x7f3d14152a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:38:09.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.009+0000 7f3d12d9d700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3d140bf5d0 0x7f3d14152a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:44322/0 (socket says 172.21.15.72:44322) 2023-07-25T14:38:09.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.009+0000 7f3d12d9d700 1 -- 172.21.15.72:0/2984397123 learned_addr learned my addr 172.21.15.72:0/2984397123 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:38:09.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.009+0000 7f3d1259c700 1 --2- 172.21.15.72:0/2984397123 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3d1406a190 0x7f3d141ed2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:38:09.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.009+0000 7f3d11d9b700 1 --2- 172.21.15.72:0/2984397123 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3d1406ed70 0x7f3d140710c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:38:09.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.009+0000 7f3d12d9d700 1 -- 172.21.15.72:0/2984397123 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3d1406ed70 msgr2=0x7f3d140710c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:38:09.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.009+0000 7f3d12d9d700 1 --2- 172.21.15.72:0/2984397123 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3d1406ed70 0x7f3d140710c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:38:09.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.009+0000 7f3d12d9d700 1 -- 172.21.15.72:0/2984397123 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3d1406a190 msgr2=0x7f3d141ed2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:38:09.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.009+0000 7f3d12d9d700 1 --2- 172.21.15.72:0/2984397123 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3d1406a190 0x7f3d141ed2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:38:09.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.009+0000 7f3d12d9d700 1 -- 172.21.15.72:0/2984397123 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d08009550 con 0x7f3d140bf5d0 2023-07-25T14:38:09.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.009+0000 7f3d1259c700 1 --2- 172.21.15.72:0/2984397123 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3d1406a190 0x7f3d141ed2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-25T14:38:09.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.009+0000 7f3d11d9b700 1 --2- 172.21.15.72:0/2984397123 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3d1406ed70 0x7f3d140710c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-25T14:38:09.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.010+0000 7f3d12d9d700 1 --2- 172.21.15.72:0/2984397123 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3d140bf5d0 0x7f3d14152a40 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f3d0c007e60 tx=0x7f3d0c00e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:38:09.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.010+0000 7f3d02ffd700 1 -- 172.21.15.72:0/2984397123 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d0c00ede0 con 0x7f3d140bf5d0 2023-07-25T14:38:09.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.010+0000 7f3d02ffd700 1 -- 172.21.15.72:0/2984397123 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d0c014420 con 0x7f3d140bf5d0 2023-07-25T14:38:09.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.010+0000 7f3d18902700 1 -- 172.21.15.72:0/2984397123 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d1414c3b0 con 0x7f3d140bf5d0 2023-07-25T14:38:09.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.010+0000 7f3d02ffd700 1 -- 172.21.15.72:0/2984397123 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d0c0147d0 con 0x7f3d140bf5d0 2023-07-25T14:38:09.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.010+0000 7f3d18902700 1 -- 172.21.15.72:0/2984397123 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d14152520 con 0x7f3d140bf5d0 2023-07-25T14:38:09.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.011+0000 7f3d18902700 1 -- 172.21.15.72:0/2984397123 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d1404e470 con 0x7f3d140bf5d0 2023-07-25T14:38:09.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.011+0000 7f3d02ffd700 1 -- 172.21.15.72:0/2984397123 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3d0c014930 con 0x7f3d140bf5d0 2023-07-25T14:38:09.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.011+0000 7f3d02ffd700 1 --2- 172.21.15.72:0/2984397123 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f3cf406ace0 0x7f3cf406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:38:09.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.011+0000 7f3d02ffd700 1 -- 172.21.15.72:0/2984397123 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 7238+0+0 (secure 0 0 0) 0x7f3d0c089fe0 con 0x7f3d140bf5d0 2023-07-25T14:38:09.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.012+0000 7f3d1259c700 1 --2- 172.21.15.72:0/2984397123 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f3cf406ace0 0x7f3cf406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:38:09.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.012+0000 7f3d1259c700 1 --2- 172.21.15.72:0/2984397123 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f3cf406ace0 0x7f3cf406d1a0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f3d08000c00 tx=0x7f3d08008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:38:09.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.016+0000 7f3d02ffd700 1 -- 172.21.15.72:0/2984397123 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f3d0c054c80 con 0x7f3d140bf5d0 2023-07-25T14:38:09.215 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.205+0000 7f3d18902700 1 -- 172.21.15.72:0/2984397123 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3d1414d5e0 con 0x7f3d140bf5d0 2023-07-25T14:38:09.216 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.205+0000 7f3d02ffd700 1 -- 172.21.15.72:0/2984397123 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v61) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3d0c0582a0 con 0x7f3d140bf5d0 2023-07-25T14:38:09.216 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2023-07-25T14:38:09.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.207+0000 7f3d18902700 1 -- 172.21.15.72:0/2984397123 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f3cf406ace0 msgr2=0x7f3cf406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:38:09.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.207+0000 7f3d18902700 1 --2- 172.21.15.72:0/2984397123 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f3cf406ace0 0x7f3cf406d1a0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f3d08000c00 tx=0x7f3d08008030 comp rx=0 tx=0).stop 2023-07-25T14:38:09.218 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.207+0000 7f3d18902700 1 -- 172.21.15.72:0/2984397123 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3d140bf5d0 msgr2=0x7f3d14152a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:38:09.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.207+0000 7f3d18902700 1 --2- 172.21.15.72:0/2984397123 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3d140bf5d0 0x7f3d14152a40 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f3d0c007e60 tx=0x7f3d0c00e3c0 comp rx=0 tx=0).stop 2023-07-25T14:38:09.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.207+0000 7f3d18902700 1 -- 172.21.15.72:0/2984397123 shutdown_connections 2023-07-25T14:38:09.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.207+0000 7f3d18902700 1 --2- 172.21.15.72:0/2984397123 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f3cf406ace0 0x7f3cf406d1a0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:38:09.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.207+0000 7f3d18902700 1 --2- 172.21.15.72:0/2984397123 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f3d140bf5d0 0x7f3d14152a40 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:38:09.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.208+0000 7f3d18902700 1 --2- 172.21.15.72:0/2984397123 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3d1406a190 0x7f3d141ed2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:38:09.219 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.208+0000 7f3d18902700 1 --2- 172.21.15.72:0/2984397123 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f3d1406ed70 0x7f3d140710c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:38:09.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.208+0000 7f3d18902700 1 -- 172.21.15.72:0/2984397123 >> 172.21.15.72:0/2984397123 conn(0x7f3d1406def0 msgr2=0x7f3d140c4620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:38:09.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.208+0000 7f3d18902700 1 -- 172.21.15.72:0/2984397123 shutdown_connections 2023-07-25T14:38:09.220 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.208+0000 7f3d18902700 1 -- 172.21.15.72:0/2984397123 wait complete. 2023-07-25T14:38:09.230 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-25T14:38:09.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.343+0000 7fd0a8cbf700 1 Processor -- start 2023-07-25T14:38:09.353 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.343+0000 7fd0a8cbf700 1 -- start start 2023-07-25T14:38:09.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.343+0000 7fd0a8cbf700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7fd0a4151950 0x7fd0a406a190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:38:09.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.343+0000 7fd0a8cbf700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd0a406a6d0 0x7fd0a40c3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:38:09.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.343+0000 7fd0a8cbf700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0a40c2fe0 con 0x7fd0a40724c0 2023-07-25T14:38:09.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.343+0000 7fd0a8cbf700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0a4071a60 con 0x7fd0a4151950 2023-07-25T14:38:09.356 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.343+0000 7fd0a8cbf700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0a40c2a70 con 0x7fd0a406a6d0 2023-07-25T14:38:09.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.343+0000 7fd0a1d9b700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fd0a40724c0 0x7fd0a40c34c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:35062/0 (socket says 172.21.15.72:35062) 2023-07-25T14:38:09.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.343+0000 7fd0a1d9b700 1 -- 172.21.15.72:0/3046471990 learned_addr learned my addr 172.21.15.72:0/3046471990 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:38:09.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.345+0000 7fd0a2d9d700 1 --2- 172.21.15.72:0/3046471990 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd0a406a6d0 0x7fd0a40c3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:38:09.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.345+0000 7fd0a259c700 1 --2- 172.21.15.72:0/3046471990 >> v2:172.21.15.92:3300/0 conn(0x7fd0a4151950 0x7fd0a406a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:38:09.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.345+0000 7fd0a159a700 1 -- 172.21.15.72:0/3046471990 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2807298916 0 0) 0x7fd0a40c2fe0 con 0x7fd0a40724c0 2023-07-25T14:38:09.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.345+0000 7fd0a159a700 1 -- 172.21.15.72:0/3046471990 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd08c0035b0 con 0x7fd0a40724c0 2023-07-25T14:38:09.357 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.345+0000 7fd0a159a700 1 -- 172.21.15.72:0/3046471990 <== mon.0 v1:172.21.15.72:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2104764535 0 0) 0x7fd08c0035b0 con 0x7fd0a40724c0 2023-07-25T14:38:09.358 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.345+0000 7fd0a159a700 1 -- 172.21.15.72:0/3046471990 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd0a406a6d0 msgr2=0x7fd0a40c3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:38:09.358 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.345+0000 7fd0a159a700 1 --2- 172.21.15.72:0/3046471990 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd0a406a6d0 0x7fd0a40c3bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:38:09.358 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.345+0000 7fd0a159a700 1 -- 172.21.15.72:0/3046471990 >> v2:172.21.15.92:3300/0 conn(0x7fd0a4151950 msgr2=0x7fd0a406a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:38:09.358 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.345+0000 7fd0a159a700 1 --2- 172.21.15.72:0/3046471990 >> v2:172.21.15.92:3300/0 conn(0x7fd0a4151950 0x7fd0a406a190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:38:09.358 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.345+0000 7fd0a159a700 1 -- 172.21.15.72:0/3046471990 --> v1:172.21.15.72:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0a4155070 con 0x7fd0a40724c0 2023-07-25T14:38:09.358 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.345+0000 7fd0a159a700 1 -- 172.21.15.72:0/3046471990 <== mon.0 v1:172.21.15.72:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2559588315 0 0) 0x7fd094001670 con 0x7fd0a40724c0 2023-07-25T14:38:09.358 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.345+0000 7fd0a159a700 1 -- 172.21.15.72:0/3046471990 >> v1:172.21.15.72:6789/0 conn(0x7fd0a40724c0 legacy=0x7fd0a40c34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:38:09.358 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.345+0000 7fd0a159a700 1 --2- 172.21.15.72:0/3046471990 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd08c003a00 0x7fd08c003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:38:09.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.345+0000 7fd0a159a700 1 --2- 172.21.15.72:0/3046471990 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd0a406a6d0 0x7fd08c004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:38:09.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.345+0000 7fd0a159a700 1 --2- 172.21.15.72:0/3046471990 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd08c004d90 0x7fd08c005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:38:09.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.345+0000 7fd0a159a700 1 -- 172.21.15.72:0/3046471990 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0a4071a60 con 0x7fd08c004d90 2023-07-25T14:38:09.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.345+0000 7fd0a159a700 1 -- 172.21.15.72:0/3046471990 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd08c00ba10 con 0x7fd08c003a00 2023-07-25T14:38:09.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.345+0000 7fd0a159a700 1 -- 172.21.15.72:0/3046471990 --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd08c00bb50 con 0x7fd0a406a6d0 2023-07-25T14:38:09.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.345+0000 7fd0a2d9d700 1 --2- 172.21.15.72:0/3046471990 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd08c004d90 0x7fd08c005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:38:09.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.345+0000 7fd0a259c700 1 --2- 172.21.15.72:0/3046471990 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd08c003a00 0x7fd08c003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:38:09.359 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.345+0000 7fd0a1d9b700 1 --2- 172.21.15.72:0/3046471990 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd0a406a6d0 0x7fd08c004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:38:09.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.345+0000 7fd0a2d9d700 1 -- 172.21.15.72:0/3046471990 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd0a406a6d0 msgr2=0x7fd08c004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:38:09.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.345+0000 7fd0a2d9d700 1 --2- 172.21.15.72:0/3046471990 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd0a406a6d0 0x7fd08c004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:38:09.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.345+0000 7fd0a2d9d700 1 -- 172.21.15.72:0/3046471990 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd08c003a00 msgr2=0x7fd08c003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:38:09.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.345+0000 7fd0a2d9d700 1 --2- 172.21.15.72:0/3046471990 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd08c003a00 0x7fd08c003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:38:09.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.345+0000 7fd0a2d9d700 1 -- 172.21.15.72:0/3046471990 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd08c0035b0 con 0x7fd08c004d90 2023-07-25T14:38:09.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.346+0000 7fd0a2d9d700 1 --2- 172.21.15.72:0/3046471990 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd08c004d90 0x7fd08c005210 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7fd09c009fc0 tx=0x7fd08c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e33dcb424ee3840 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:38:09.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.346+0000 7fd0a159a700 1 -- 172.21.15.72:0/3046471990 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd09c00ec30 con 0x7fd08c004d90 2023-07-25T14:38:09.360 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.346+0000 7fd0a159a700 1 -- 172.21.15.72:0/3046471990 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd09c00f040 con 0x7fd08c004d90 2023-07-25T14:38:09.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.346+0000 7fd0a159a700 1 -- 172.21.15.72:0/3046471990 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd09c014480 con 0x7fd08c004d90 2023-07-25T14:38:09.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.346+0000 7fd0a8cbf700 1 -- 172.21.15.72:0/3046471990 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd08c004d90 msgr2=0x7fd08c005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:38:09.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.346+0000 7fd0a8cbf700 1 --2- 172.21.15.72:0/3046471990 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd08c004d90 0x7fd08c005210 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7fd09c009fc0 tx=0x7fd08c005880 comp rx=0 tx=0).stop 2023-07-25T14:38:09.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.346+0000 7fd0a2d9d700 1 -- 172.21.15.72:0/3046471990 reap_dead start 2023-07-25T14:38:09.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.346+0000 7fd0a8cbf700 1 -- 172.21.15.72:0/3046471990 shutdown_connections 2023-07-25T14:38:09.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.346+0000 7fd0a8cbf700 1 -- 172.21.15.72:0/3046471990 >> 172.21.15.72:0/3046471990 conn(0x7fd0a40a87e0 msgr2=0x7fd0a40a8bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:38:09.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.346+0000 7fd0a8cbf700 1 -- 172.21.15.72:0/3046471990 shutdown_connections 2023-07-25T14:38:09.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.346+0000 7fd0a8cbf700 1 -- 172.21.15.72:0/3046471990 wait complete. 2023-07-25T14:38:09.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.348+0000 7fd0a8cbf700 1 Processor -- start 2023-07-25T14:38:09.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.348+0000 7fd0a8cbf700 1 -- start start 2023-07-25T14:38:09.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.348+0000 7fd0a8cbf700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd08c004d90 0x7fd0a4153190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:38:09.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.348+0000 7fd0a8cbf700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd0a41536d0 0x7fd0a41558e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:38:09.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.348+0000 7fd0a8cbf700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd0a41e9c30 0x7fd0a4155e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:38:09.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.348+0000 7fd0a8cbf700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0a40be6d0 con 0x7fd08c004d90 2023-07-25T14:38:09.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.348+0000 7fd0a8cbf700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0a4156360 con 0x7fd0a41e9c30 2023-07-25T14:38:09.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.348+0000 7fd0a8cbf700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0a41520f0 con 0x7fd0a41536d0 2023-07-25T14:38:09.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.348+0000 7fd0a259c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd08c004d90 0x7fd0a4153190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:38:09.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.348+0000 7fd0a259c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd08c004d90 0x7fd0a4153190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:44338/0 (socket says 172.21.15.72:44338) 2023-07-25T14:38:09.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.348+0000 7fd0a259c700 1 -- 172.21.15.72:0/3095764792 learned_addr learned my addr 172.21.15.72:0/3095764792 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:38:09.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.348+0000 7fd0a1d9b700 1 --2- 172.21.15.72:0/3095764792 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd0a41536d0 0x7fd0a41558e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:38:09.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.348+0000 7fd0a2d9d700 1 --2- 172.21.15.72:0/3095764792 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd0a41e9c30 0x7fd0a4155e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:38:09.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.348+0000 7fd0a259c700 1 -- 172.21.15.72:0/3095764792 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd0a41536d0 msgr2=0x7fd0a41558e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:38:09.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.348+0000 7fd0a259c700 1 --2- 172.21.15.72:0/3095764792 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd0a41536d0 0x7fd0a41558e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:38:09.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.348+0000 7fd0a259c700 1 -- 172.21.15.72:0/3095764792 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd0a41e9c30 msgr2=0x7fd0a4155e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:38:09.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.348+0000 7fd0a259c700 1 --2- 172.21.15.72:0/3095764792 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd0a41e9c30 0x7fd0a4155e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:38:09.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.348+0000 7fd0a259c700 1 -- 172.21.15.72:0/3095764792 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0a41523d0 con 0x7fd08c004d90 2023-07-25T14:38:09.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.348+0000 7fd0a2d9d700 1 --2- 172.21.15.72:0/3095764792 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd0a41e9c30 0x7fd0a4155e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-25T14:38:09.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.348+0000 7fd0a259c700 1 --2- 172.21.15.72:0/3095764792 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd08c004d90 0x7fd0a4153190 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7fd098011ad0 tx=0x7fd098011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:38:09.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.348+0000 7fd092ffd700 1 -- 172.21.15.72:0/3095764792 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd09800fa00 con 0x7fd08c004d90 2023-07-25T14:38:09.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.348+0000 7fd092ffd700 1 -- 172.21.15.72:0/3095764792 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd09800fb80 con 0x7fd08c004d90 2023-07-25T14:38:09.366 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.348+0000 7fd0a8cbf700 1 -- 172.21.15.72:0/3095764792 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0a41526b0 con 0x7fd08c004d90 2023-07-25T14:38:09.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.348+0000 7fd092ffd700 1 -- 172.21.15.72:0/3095764792 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd098014440 con 0x7fd08c004d90 2023-07-25T14:38:09.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.348+0000 7fd0a8cbf700 1 -- 172.21.15.72:0/3095764792 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0a4152c70 con 0x7fd08c004d90 2023-07-25T14:38:09.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.350+0000 7fd0a8cbf700 1 -- 172.21.15.72:0/3095764792 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0a40bd7c0 con 0x7fd08c004d90 2023-07-25T14:38:09.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.351+0000 7fd092ffd700 1 -- 172.21.15.72:0/3095764792 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd0980145a0 con 0x7fd08c004d90 2023-07-25T14:38:09.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.351+0000 7fd092ffd700 1 --2- 172.21.15.72:0/3095764792 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fd08406ace0 0x7fd08406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:38:09.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.351+0000 7fd092ffd700 1 -- 172.21.15.72:0/3095764792 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 7238+0+0 (secure 0 0 0) 0x7fd09808a0b0 con 0x7fd08c004d90 2023-07-25T14:38:09.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.351+0000 7fd0a1d9b700 1 --2- 172.21.15.72:0/3095764792 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fd08406ace0 0x7fd08406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:38:09.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.351+0000 7fd0a1d9b700 1 --2- 172.21.15.72:0/3095764792 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fd08406ace0 0x7fd08406d1a0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fd0a4070120 tx=0x7fd094009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:38:09.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.355+0000 7fd092ffd700 1 -- 172.21.15.72:0/3095764792 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fd098054e10 con 0x7fd08c004d90 2023-07-25T14:38:09.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.543+0000 7fd0a8cbf700 1 -- 172.21.15.72:0/3095764792 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd0a4074270 con 0x7fd08c004d90 2023-07-25T14:38:09.553 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.544+0000 7fd092ffd700 1 -- 172.21.15.72:0/3095764792 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v61) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd098058430 con 0x7fd08c004d90 2023-07-25T14:38:09.554 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 64 2023-07-25T14:38:09.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.546+0000 7fd0a8cbf700 1 -- 172.21.15.72:0/3095764792 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fd08406ace0 msgr2=0x7fd08406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:38:09.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.546+0000 7fd0a8cbf700 1 --2- 172.21.15.72:0/3095764792 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fd08406ace0 0x7fd08406d1a0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fd0a4070120 tx=0x7fd094009040 comp rx=0 tx=0).stop 2023-07-25T14:38:09.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.546+0000 7fd0a8cbf700 1 -- 172.21.15.72:0/3095764792 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd08c004d90 msgr2=0x7fd0a4153190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:38:09.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.546+0000 7fd0a8cbf700 1 --2- 172.21.15.72:0/3095764792 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd08c004d90 0x7fd0a4153190 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7fd098011ad0 tx=0x7fd098011e90 comp rx=0 tx=0).stop 2023-07-25T14:38:09.556 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.546+0000 7fd0a8cbf700 1 -- 172.21.15.72:0/3095764792 shutdown_connections 2023-07-25T14:38:09.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.546+0000 7fd0a8cbf700 1 --2- 172.21.15.72:0/3095764792 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fd08406ace0 0x7fd08406d1a0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:38:09.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.546+0000 7fd0a8cbf700 1 --2- 172.21.15.72:0/3095764792 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd0a41e9c30 0x7fd0a4155e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:38:09.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.546+0000 7fd0a8cbf700 1 --2- 172.21.15.72:0/3095764792 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fd08c004d90 0x7fd0a4153190 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:38:09.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.546+0000 7fd0a8cbf700 1 --2- 172.21.15.72:0/3095764792 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fd0a41536d0 0x7fd0a41558e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:38:09.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.546+0000 7fd0a8cbf700 1 -- 172.21.15.72:0/3095764792 >> 172.21.15.72:0/3095764792 conn(0x7fd0a40a87e0 msgr2=0x7fd0a41542b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:38:09.557 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.546+0000 7fd0a8cbf700 1 -- 172.21.15.72:0/3095764792 shutdown_connections 2023-07-25T14:38:09.558 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.546+0000 7fd0a8cbf700 1 -- 172.21.15.72:0/3095764792 wait complete. 2023-07-25T14:38:09.567 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-07-25T14:38:09.689 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.680+0000 7f053b40a700 1 Processor -- start 2023-07-25T14:38:09.690 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.680+0000 7f053b40a700 1 -- start start 2023-07-25T14:38:09.691 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.681+0000 7f053b40a700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f053406b510 0x7f0534151c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:38:09.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.681+0000 7f053b40a700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f053406ea10 0x7f053414e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:38:09.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.681+0000 7f053b40a700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f053414eb30 0x7f05340a7490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:38:09.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.681+0000 7f053b40a700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0534152190 con 0x7f053414eb30 2023-07-25T14:38:09.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.681+0000 7f053b40a700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05340ac350 con 0x7f053406ea10 2023-07-25T14:38:09.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.681+0000 7f053b40a700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05340c1670 con 0x7f053406b510 2023-07-25T14:38:09.692 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.681+0000 7f05399a7700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f053414eb30 0x7f05340a7490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:38:09.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.681+0000 7f05399a7700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f053414eb30 0x7f05340a7490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:44350/0 (socket says 172.21.15.72:44350) 2023-07-25T14:38:09.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.681+0000 7f05399a7700 1 -- 172.21.15.72:0/467711066 learned_addr learned my addr 172.21.15.72:0/467711066 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:38:09.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.681+0000 7f05399a7700 1 -- 172.21.15.72:0/467711066 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f053406b510 msgr2=0x7f0534151c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:38:09.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.681+0000 7f05389a5700 1 --2- 172.21.15.72:0/467711066 >> v2:172.21.15.92:3300/0 conn(0x7f053406ea10 0x7f053414e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:38:09.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.681+0000 7f05399a7700 1 --2- 172.21.15.72:0/467711066 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f053406b510 0x7f0534151c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:38:09.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.681+0000 7f05399a7700 1 -- 172.21.15.72:0/467711066 >> v2:172.21.15.92:3300/0 conn(0x7f053406ea10 msgr2=0x7f053414e5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:38:09.693 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.681+0000 7f05399a7700 1 --2- 172.21.15.72:0/467711066 >> v2:172.21.15.92:3300/0 conn(0x7f053406ea10 0x7f053414e5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:38:09.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.681+0000 7f05399a7700 1 -- 172.21.15.72:0/467711066 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0534066480 con 0x7f053414eb30 2023-07-25T14:38:09.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.681+0000 7f05399a7700 1 --2- 172.21.15.72:0/467711066 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f053414eb30 0x7f05340a7490 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f053406ccc0 tx=0x7f052c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ead6e659da02670a server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:38:09.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.681+0000 7f052bfff700 1 -- 172.21.15.72:0/467711066 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f052c00e070 con 0x7f053414eb30 2023-07-25T14:38:09.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.681+0000 7f052bfff700 1 -- 172.21.15.72:0/467711066 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f052c00b9c0 con 0x7f053414eb30 2023-07-25T14:38:09.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.681+0000 7f052bfff700 1 -- 172.21.15.72:0/467711066 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f052c00bd70 con 0x7f053414eb30 2023-07-25T14:38:09.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.682+0000 7f053b40a700 1 -- 172.21.15.72:0/467711066 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f053414eb30 msgr2=0x7f05340a7490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:38:09.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.682+0000 7f053b40a700 1 --2- 172.21.15.72:0/467711066 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f053414eb30 0x7f05340a7490 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f053406ccc0 tx=0x7f052c00b330 comp rx=0 tx=0).stop 2023-07-25T14:38:09.694 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.682+0000 7f053b40a700 1 -- 172.21.15.72:0/467711066 shutdown_connections 2023-07-25T14:38:09.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.682+0000 7f053b40a700 1 --2- 172.21.15.72:0/467711066 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f053414eb30 0x7f05340a7490 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:38:09.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.682+0000 7f053b40a700 1 --2- 172.21.15.72:0/467711066 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f053406b510 0x7f0534151c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:38:09.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.682+0000 7f053b40a700 1 --2- 172.21.15.72:0/467711066 >> v2:172.21.15.92:3300/0 conn(0x7f053406ea10 0x7f053414e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:38:09.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.682+0000 7f053b40a700 1 -- 172.21.15.72:0/467711066 >> 172.21.15.72:0/467711066 conn(0x7f053406def0 msgr2=0x7f053406e300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:38:09.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.682+0000 7f053b40a700 1 -- 172.21.15.72:0/467711066 shutdown_connections 2023-07-25T14:38:09.695 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.682+0000 7f053b40a700 1 -- 172.21.15.72:0/467711066 wait complete. 2023-07-25T14:38:09.697 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.684+0000 7f053b40a700 1 Processor -- start 2023-07-25T14:38:09.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.684+0000 7f053b40a700 1 -- start start 2023-07-25T14:38:09.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.684+0000 7f053b40a700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f053406b510 0x7f05341e5f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:38:09.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.684+0000 7f053b40a700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f053406ea10 0x7f05341dab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:38:09.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.684+0000 7f053b40a700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f053414eb30 0x7f053414f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:38:09.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.684+0000 7f053b40a700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05340a8ad0 con 0x7f053414eb30 2023-07-25T14:38:09.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.684+0000 7f053b40a700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05341e9ef0 con 0x7f053406ea10 2023-07-25T14:38:09.698 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.684+0000 7f053b40a700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05341ea420 con 0x7f053406b510 2023-07-25T14:38:09.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.685+0000 7f05399a7700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f053414eb30 0x7f053414f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:38:09.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.685+0000 7f05399a7700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f053414eb30 0x7f053414f040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:44356/0 (socket says 172.21.15.72:44356) 2023-07-25T14:38:09.699 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.685+0000 7f05399a7700 1 -- 172.21.15.72:0/1018736773 learned_addr learned my addr 172.21.15.72:0/1018736773 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:38:09.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.685+0000 7f05389a5700 1 --2- 172.21.15.72:0/1018736773 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f053406ea10 0x7f05341dab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:38:09.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.685+0000 7f05391a6700 1 --2- 172.21.15.72:0/1018736773 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f053406b510 0x7f05341e5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:38:09.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.685+0000 7f05399a7700 1 -- 172.21.15.72:0/1018736773 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f053406b510 msgr2=0x7f05341e5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:38:09.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.685+0000 7f05399a7700 1 --2- 172.21.15.72:0/1018736773 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f053406b510 0x7f05341e5f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:38:09.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.685+0000 7f05399a7700 1 -- 172.21.15.72:0/1018736773 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f053406ea10 msgr2=0x7f05341dab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:38:09.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.685+0000 7f05399a7700 1 --2- 172.21.15.72:0/1018736773 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f053406ea10 0x7f05341dab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:38:09.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.685+0000 7f05399a7700 1 -- 172.21.15.72:0/1018736773 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f052c009b30 con 0x7f053414eb30 2023-07-25T14:38:09.700 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.685+0000 7f05389a5700 1 --2- 172.21.15.72:0/1018736773 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f053406ea10 0x7f05341dab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-25T14:38:09.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.685+0000 7f05399a7700 1 --2- 172.21.15.72:0/1018736773 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f053414eb30 0x7f053414f040 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f052c00b370 tx=0x7f052c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:38:09.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.685+0000 7f0529ffb700 1 -- 172.21.15.72:0/1018736773 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f052c004450 con 0x7f053414eb30 2023-07-25T14:38:09.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.685+0000 7f0529ffb700 1 -- 172.21.15.72:0/1018736773 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f052c0045b0 con 0x7f053414eb30 2023-07-25T14:38:09.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.685+0000 7f0529ffb700 1 -- 172.21.15.72:0/1018736773 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f052c004940 con 0x7f053414eb30 2023-07-25T14:38:09.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.685+0000 7f053b40a700 1 -- 172.21.15.72:0/1018736773 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0534150bd0 con 0x7f053414eb30 2023-07-25T14:38:09.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.685+0000 7f053b40a700 1 -- 172.21.15.72:0/1018736773 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05341ea140 con 0x7f053414eb30 2023-07-25T14:38:09.701 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.686+0000 7f053b40a700 1 -- 172.21.15.72:0/1018736773 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f053404e470 con 0x7f053414eb30 2023-07-25T14:38:09.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.687+0000 7f0529ffb700 1 -- 172.21.15.72:0/1018736773 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f052c01a4c0 con 0x7f053414eb30 2023-07-25T14:38:09.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.687+0000 7f0529ffb700 1 --2- 172.21.15.72:0/1018736773 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f051806ace0 0x7f051806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:38:09.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.687+0000 7f0529ffb700 1 -- 172.21.15.72:0/1018736773 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 7238+0+0 (secure 0 0 0) 0x7f052c08c5f0 con 0x7f053414eb30 2023-07-25T14:38:09.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.687+0000 7f05391a6700 1 --2- 172.21.15.72:0/1018736773 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f051806ace0 0x7f051806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:38:09.702 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.688+0000 7f05391a6700 1 --2- 172.21.15.72:0/1018736773 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f051806ace0 0x7f051806d1a0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f0530006fd0 tx=0x7f0530008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:38:09.703 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.691+0000 7f0529ffb700 1 -- 172.21.15.72:0/1018736773 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f052c05ad20 con 0x7f053414eb30 2023-07-25T14:38:09.888 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.879+0000 7f053b40a700 1 -- 172.21.15.72:0/1018736773 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7f05340c4aa0 con 0x7f053414eb30 2023-07-25T14:38:09.889 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.879+0000 7f0529ffb700 1 -- 172.21.15.72:0/1018736773 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v61) v1 ==== 105+0+11 (secure 0 0 0) 0x7f052c05a8b0 con 0x7f053414eb30 2023-07-25T14:38:09.889 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 32 2023-07-25T14:38:09.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.882+0000 7f053b40a700 1 -- 172.21.15.72:0/1018736773 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f051806ace0 msgr2=0x7f051806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:38:09.891 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.882+0000 7f053b40a700 1 --2- 172.21.15.72:0/1018736773 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f051806ace0 0x7f051806d1a0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f0530006fd0 tx=0x7f0530008040 comp rx=0 tx=0).stop 2023-07-25T14:38:09.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.882+0000 7f053b40a700 1 -- 172.21.15.72:0/1018736773 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f053414eb30 msgr2=0x7f053414f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:38:09.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.882+0000 7f053b40a700 1 --2- 172.21.15.72:0/1018736773 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f053414eb30 0x7f053414f040 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f052c00b370 tx=0x7f052c004ad0 comp rx=0 tx=0).stop 2023-07-25T14:38:09.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.882+0000 7f053b40a700 1 -- 172.21.15.72:0/1018736773 shutdown_connections 2023-07-25T14:38:09.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.882+0000 7f053b40a700 1 --2- 172.21.15.72:0/1018736773 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f051806ace0 0x7f051806d1a0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:38:09.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.882+0000 7f053b40a700 1 --2- 172.21.15.72:0/1018736773 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f053406b510 0x7f05341e5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:38:09.892 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.882+0000 7f053b40a700 1 --2- 172.21.15.72:0/1018736773 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f053414eb30 0x7f053414f040 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:38:09.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.882+0000 7f053b40a700 1 --2- 172.21.15.72:0/1018736773 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f053406ea10 0x7f05341dab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:38:09.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.882+0000 7f053b40a700 1 -- 172.21.15.72:0/1018736773 >> 172.21.15.72:0/1018736773 conn(0x7f053406def0 msgr2=0x7f05341db860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:38:09.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.882+0000 7f053b40a700 1 -- 172.21.15.72:0/1018736773 shutdown_connections 2023-07-25T14:38:09.893 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:09.882+0000 7f053b40a700 1 -- 172.21.15.72:0/1018736773 wait complete. 2023-07-25T14:38:09.903 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-07-25T14:38:10.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.017+0000 7f41e88d9700 1 Processor -- start 2023-07-25T14:38:10.027 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.017+0000 7f41e88d9700 1 -- start start 2023-07-25T14:38:10.028 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.018+0000 7f41e88d9700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f41e414faf0 0x7f41e40c5e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:38:10.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.018+0000 7f41e88d9700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7f41e40ba0e0 0x7f41e41558a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:38:10.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.018+0000 7f41e88d9700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41e40c4930 con 0x7f41e4155de0 2023-07-25T14:38:10.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.018+0000 7f41e88d9700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41e40c5670 con 0x7f41e40ba0e0 2023-07-25T14:38:10.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.018+0000 7f41e88d9700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41e40726e0 con 0x7f41e414faf0 2023-07-25T14:38:10.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.018+0000 7f41e2d9d700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f41e4155de0 0x7f41e4071960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:35100/0 (socket says 172.21.15.72:35100) 2023-07-25T14:38:10.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.018+0000 7f41e2d9d700 1 -- 172.21.15.72:0/285028248 learned_addr learned my addr 172.21.15.72:0/285028248 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:38:10.029 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.018+0000 7f41e259c700 1 --2- 172.21.15.72:0/285028248 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f41e414faf0 0x7f41e40c5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:38:10.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.018+0000 7f41e1d9b700 1 --2- 172.21.15.72:0/285028248 >> v2:172.21.15.92:3300/0 conn(0x7f41e40ba0e0 0x7f41e41558a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:38:10.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.018+0000 7f41e159a700 1 -- 172.21.15.72:0/285028248 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1372847845 0 0) 0x7f41e40c4930 con 0x7f41e4155de0 2023-07-25T14:38:10.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.018+0000 7f41e159a700 1 -- 172.21.15.72:0/285028248 --> v1:172.21.15.72:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f41cc0035b0 con 0x7f41e4155de0 2023-07-25T14:38:10.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.019+0000 7f41e1d9b700 1 -- 172.21.15.72:0/285028248 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f41e414faf0 msgr2=0x7f41e40c5e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:38:10.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.019+0000 7f41e1d9b700 1 --2- 172.21.15.72:0/285028248 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f41e414faf0 0x7f41e40c5e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:38:10.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.019+0000 7f41e1d9b700 1 -- 172.21.15.72:0/285028248 >> v1:172.21.15.72:6789/0 conn(0x7f41e4155de0 legacy=0x7f41e4071960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:38:10.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.019+0000 7f41e1d9b700 1 -- 172.21.15.72:0/285028248 --> v2:172.21.15.92:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41e40c4b80 con 0x7f41e40ba0e0 2023-07-25T14:38:10.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.019+0000 7f41e259c700 1 --2- 172.21.15.72:0/285028248 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f41e414faf0 0x7f41e40c5e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-25T14:38:10.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.019+0000 7f41e1d9b700 1 --2- 172.21.15.72:0/285028248 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f41e40ba0e0 0x7f41e41558a0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f41d4009840 tx=0x7f41d4009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6498561e881c2fbf server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:38:10.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.019+0000 7f41e159a700 1 -- 172.21.15.72:0/285028248 <== mon.1 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41d4011830 con 0x7f41e40ba0e0 2023-07-25T14:38:10.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.019+0000 7f41e159a700 1 -- 172.21.15.72:0/285028248 <== mon.1 v2:172.21.15.92:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41d4011990 con 0x7f41e40ba0e0 2023-07-25T14:38:10.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.019+0000 7f41e159a700 1 -- 172.21.15.72:0/285028248 <== mon.1 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41d4011d20 con 0x7f41e40ba0e0 2023-07-25T14:38:10.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.020+0000 7f41e88d9700 1 -- 172.21.15.72:0/285028248 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f41e40ba0e0 msgr2=0x7f41e41558a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:38:10.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.020+0000 7f41e88d9700 1 --2- 172.21.15.72:0/285028248 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f41e40ba0e0 0x7f41e41558a0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f41d4009840 tx=0x7f41d4009b50 comp rx=0 tx=0).stop 2023-07-25T14:38:10.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.020+0000 7f41e88d9700 1 -- 172.21.15.72:0/285028248 shutdown_connections 2023-07-25T14:38:10.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.020+0000 7f41e88d9700 1 --2- 172.21.15.72:0/285028248 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f41e414faf0 0x7f41e40c5e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:38:10.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.020+0000 7f41e88d9700 1 --2- 172.21.15.72:0/285028248 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f41e40ba0e0 0x7f41e41558a0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:38:10.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.020+0000 7f41e88d9700 1 -- 172.21.15.72:0/285028248 >> 172.21.15.72:0/285028248 conn(0x7f41e40a87e0 msgr2=0x7f41e40a8bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:38:10.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.020+0000 7f41e88d9700 1 -- 172.21.15.72:0/285028248 shutdown_connections 2023-07-25T14:38:10.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.020+0000 7f41e88d9700 1 -- 172.21.15.72:0/285028248 wait complete. 2023-07-25T14:38:10.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.021+0000 7f41e88d9700 1 Processor -- start 2023-07-25T14:38:10.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.021+0000 7f41e88d9700 1 -- start start 2023-07-25T14:38:10.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.022+0000 7f41e88d9700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f41e40ba0e0 0x7f41e4154920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:38:10.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.022+0000 7f41e88d9700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f41e414faf0 0x7f41e40ba870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:38:10.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.022+0000 7f41e88d9700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f41e4155de0 0x7f41e40badb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:38:10.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.022+0000 7f41e88d9700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41e414e990 con 0x7f41e414faf0 2023-07-25T14:38:10.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.022+0000 7f41e88d9700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41e40c03b0 con 0x7f41e4155de0 2023-07-25T14:38:10.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.022+0000 7f41e88d9700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41e40c0690 con 0x7f41e40ba0e0 2023-07-25T14:38:10.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.022+0000 7f41e1d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f41e414faf0 0x7f41e40ba870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:38:10.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.022+0000 7f41e1d9b700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f41e414faf0 0x7f41e40ba870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:44368/0 (socket says 172.21.15.72:44368) 2023-07-25T14:38:10.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.022+0000 7f41e1d9b700 1 -- 172.21.15.72:0/3733665343 learned_addr learned my addr 172.21.15.72:0/3733665343 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:38:10.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.022+0000 7f41e1d9b700 1 -- 172.21.15.72:0/3733665343 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f41e40ba0e0 msgr2=0x7f41e4154920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:38:10.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.022+0000 7f41e1d9b700 1 --2- 172.21.15.72:0/3733665343 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f41e40ba0e0 0x7f41e4154920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:38:10.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.022+0000 7f41e1d9b700 1 -- 172.21.15.72:0/3733665343 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f41e4155de0 msgr2=0x7f41e40badb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:38:10.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.022+0000 7f41e2d9d700 1 --2- 172.21.15.72:0/3733665343 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f41e4155de0 0x7f41e40badb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:38:10.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.022+0000 7f41e1d9b700 1 --2- 172.21.15.72:0/3733665343 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f41e4155de0 0x7f41e40badb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:38:10.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.022+0000 7f41e1d9b700 1 -- 172.21.15.72:0/3733665343 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41d80094a0 con 0x7f41e414faf0 2023-07-25T14:38:10.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.022+0000 7f41e1d9b700 1 --2- 172.21.15.72:0/3733665343 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f41e414faf0 0x7f41e40ba870 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f41d4009fd0 tx=0x7f41d4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:38:10.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.022+0000 7f41d2ffd700 1 -- 172.21.15.72:0/3733665343 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41d40036a0 con 0x7f41e414faf0 2023-07-25T14:38:10.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.022+0000 7f41d2ffd700 1 -- 172.21.15.72:0/3733665343 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41d401e070 con 0x7f41e414faf0 2023-07-25T14:38:10.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.022+0000 7f41e88d9700 1 -- 172.21.15.72:0/3733665343 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41d40094a0 con 0x7f41e414faf0 2023-07-25T14:38:10.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.022+0000 7f41d2ffd700 1 -- 172.21.15.72:0/3733665343 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41d4003a60 con 0x7f41e414faf0 2023-07-25T14:38:10.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.022+0000 7f41e88d9700 1 -- 172.21.15.72:0/3733665343 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41e40720c0 con 0x7f41e414faf0 2023-07-25T14:38:10.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.023+0000 7f41e88d9700 1 -- 172.21.15.72:0/3733665343 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41e40c0850 con 0x7f41e414faf0 2023-07-25T14:38:10.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.024+0000 7f41d2ffd700 1 -- 172.21.15.72:0/3733665343 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f41d4003bc0 con 0x7f41e414faf0 2023-07-25T14:38:10.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.024+0000 7f41d2ffd700 1 --2- 172.21.15.72:0/3733665343 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f41c406ace0 0x7f41c406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:38:10.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.024+0000 7f41d2ffd700 1 -- 172.21.15.72:0/3733665343 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 7238+0+0 (secure 0 0 0) 0x7f41d408a7e0 con 0x7f41e414faf0 2023-07-25T14:38:10.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.024+0000 7f41e259c700 1 --2- 172.21.15.72:0/3733665343 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f41c406ace0 0x7f41c406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:38:10.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.025+0000 7f41e259c700 1 --2- 172.21.15.72:0/3733665343 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f41c406ace0 0x7f41c406d1a0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f41d8006f10 tx=0x7f41d8006e60 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:38:10.041 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.029+0000 7f41d2ffd700 1 -- 172.21.15.72:0/3733665343 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f41d4055530 con 0x7f41e414faf0 2023-07-25T14:38:10.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.216+0000 7f41e88d9700 1 -- 172.21.15.72:0/3733665343 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7f41e404e470 con 0x7f41e414faf0 2023-07-25T14:38:10.226 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.217+0000 7f41d2ffd700 1 -- 172.21.15.72:0/3733665343 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v61) v1 ==== 101+0+11 (secure 0 0 0) 0x7f41d40200a0 con 0x7f41e414faf0 2023-07-25T14:38:10.226 INFO:teuthology.orchestra.run.smithi072.stdout:pg_num: 64 2023-07-25T14:38:10.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.219+0000 7f41e88d9700 1 -- 172.21.15.72:0/3733665343 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f41c406ace0 msgr2=0x7f41c406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:38:10.228 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.219+0000 7f41e88d9700 1 --2- 172.21.15.72:0/3733665343 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f41c406ace0 0x7f41c406d1a0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f41d8006f10 tx=0x7f41d8006e60 comp rx=0 tx=0).stop 2023-07-25T14:38:10.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.219+0000 7f41e88d9700 1 -- 172.21.15.72:0/3733665343 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f41e414faf0 msgr2=0x7f41e40ba870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:38:10.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.219+0000 7f41e88d9700 1 --2- 172.21.15.72:0/3733665343 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f41e414faf0 0x7f41e40ba870 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f41d4009fd0 tx=0x7f41d4004750 comp rx=0 tx=0).stop 2023-07-25T14:38:10.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.219+0000 7f41e88d9700 1 -- 172.21.15.72:0/3733665343 shutdown_connections 2023-07-25T14:38:10.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.219+0000 7f41e88d9700 1 --2- 172.21.15.72:0/3733665343 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f41c406ace0 0x7f41c406d1a0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:38:10.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.219+0000 7f41e88d9700 1 --2- 172.21.15.72:0/3733665343 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f41e40ba0e0 0x7f41e4154920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:38:10.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.219+0000 7f41e88d9700 1 --2- 172.21.15.72:0/3733665343 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f41e4155de0 0x7f41e40badb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:38:10.229 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.219+0000 7f41e88d9700 1 --2- 172.21.15.72:0/3733665343 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f41e414faf0 0x7f41e40ba870 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:38:10.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.219+0000 7f41e88d9700 1 -- 172.21.15.72:0/3733665343 >> 172.21.15.72:0/3733665343 conn(0x7f41e40a87e0 msgr2=0x7f41e406fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:38:10.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.219+0000 7f41e88d9700 1 -- 172.21.15.72:0/3733665343 shutdown_connections 2023-07-25T14:38:10.230 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.219+0000 7f41e88d9700 1 -- 172.21.15.72:0/3733665343 wait complete. 2023-07-25T14:38:10.240 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-25T14:38:10.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.352+0000 7f7a0e7c0700 1 Processor -- start 2023-07-25T14:38:10.361 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.352+0000 7f7a0e7c0700 1 -- start start 2023-07-25T14:38:10.362 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.352+0000 7f7a0e7c0700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f7a080bb0a0 0x7f7a0806f120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:38:10.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.352+0000 7f7a0e7c0700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a080c4cc0 con 0x7f7a080c5910 2023-07-25T14:38:10.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.352+0000 7f7a0e7c0700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a08152f30 con 0x7f7a0814f820 2023-07-25T14:38:10.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.352+0000 7f7a0e7c0700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a080c4420 con 0x7f7a080bb0a0 2023-07-25T14:38:10.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.352+0000 7f7a077fe700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f7a080bb0a0 0x7f7a0806f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:38:10.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.352+0000 7f7a0cd5d700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f7a080c5910 0x7f7a0806f660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:35114/0 (socket says 172.21.15.72:35114) 2023-07-25T14:38:10.363 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.353+0000 7f7a0cd5d700 1 -- 172.21.15.72:0/1396908122 learned_addr learned my addr 172.21.15.72:0/1396908122 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:38:10.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.353+0000 7f7a077fe700 1 -- 172.21.15.72:0/1396908122 >> v1:172.21.15.92:6789/0 conn(0x7f7a0814f820 legacy=0x7f7a080c2390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:38:10.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.353+0000 7f7a077fe700 1 -- 172.21.15.72:0/1396908122 >> v1:172.21.15.72:6789/0 conn(0x7f7a080c5910 legacy=0x7f7a0806f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:38:10.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.353+0000 7f7a077fe700 1 -- 172.21.15.72:0/1396908122 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a080c4700 con 0x7f7a080bb0a0 2023-07-25T14:38:10.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.353+0000 7f7a06ffd700 1 -- 172.21.15.72:0/1396908122 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 195946395 0 0) 0x7f7a080c4cc0 con 0x7f7a080c5910 2023-07-25T14:38:10.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.353+0000 7f7a077fe700 1 --2- 172.21.15.72:0/1396908122 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7a080bb0a0 0x7f7a0806f120 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f79fc009840 tx=0x7f79fc009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7c1148ceb565e3 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:38:10.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.353+0000 7f7a06ffd700 1 -- 172.21.15.72:0/1396908122 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79fc004230 con 0x7f7a080bb0a0 2023-07-25T14:38:10.364 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.353+0000 7f7a06ffd700 1 -- 172.21.15.72:0/1396908122 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79fc004390 con 0x7f7a080bb0a0 2023-07-25T14:38:10.365 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.353+0000 7f7a06ffd700 1 -- 172.21.15.72:0/1396908122 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79fc0036a0 con 0x7f7a080bb0a0 2023-07-25T14:38:10.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.354+0000 7f7a0e7c0700 1 -- 172.21.15.72:0/1396908122 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7a080bb0a0 msgr2=0x7f7a0806f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:38:10.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.354+0000 7f7a0e7c0700 1 --2- 172.21.15.72:0/1396908122 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7a080bb0a0 0x7f7a0806f120 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f79fc009840 tx=0x7f79fc009b50 comp rx=0 tx=0).stop 2023-07-25T14:38:10.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.354+0000 7f7a0e7c0700 1 -- 172.21.15.72:0/1396908122 shutdown_connections 2023-07-25T14:38:10.367 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.354+0000 7f7a0e7c0700 1 --2- 172.21.15.72:0/1396908122 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7a080bb0a0 0x7f7a0806f120 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:38:10.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.354+0000 7f7a0e7c0700 1 -- 172.21.15.72:0/1396908122 >> 172.21.15.72:0/1396908122 conn(0x7f7a0806a980 msgr2=0x7f7a080a9540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:38:10.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.354+0000 7f7a0e7c0700 1 -- 172.21.15.72:0/1396908122 shutdown_connections 2023-07-25T14:38:10.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.354+0000 7f7a0e7c0700 1 -- 172.21.15.72:0/1396908122 wait complete. 2023-07-25T14:38:10.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.355+0000 7f7a0e7c0700 1 Processor -- start 2023-07-25T14:38:10.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.355+0000 7f7a0e7c0700 1 -- start start 2023-07-25T14:38:10.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.356+0000 7f7a0e7c0700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7a080bb0a0 0x7f7a081eaf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:38:10.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.356+0000 7f7a0e7c0700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7a080c5910 0x7f7a081558e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:38:10.368 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.356+0000 7f7a0e7c0700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7a0814f820 0x7f7a080bfce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:38:10.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.356+0000 7f7a0e7c0700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a080ad850 con 0x7f7a080bb0a0 2023-07-25T14:38:10.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.356+0000 7f7a0e7c0700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a081eb490 con 0x7f7a080c5910 2023-07-25T14:38:10.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.356+0000 7f7a0e7c0700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a0806f870 con 0x7f7a0814f820 2023-07-25T14:38:10.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.356+0000 7f7a07fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7a080bb0a0 0x7f7a081eaf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:38:10.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.356+0000 7f7a07fff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7a080bb0a0 0x7f7a081eaf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:44380/0 (socket says 172.21.15.72:44380) 2023-07-25T14:38:10.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.356+0000 7f7a07fff700 1 -- 172.21.15.72:0/3865944912 learned_addr learned my addr 172.21.15.72:0/3865944912 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:38:10.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.356+0000 7f7a077fe700 1 --2- 172.21.15.72:0/3865944912 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7a080c5910 0x7f7a081558e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:38:10.369 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.356+0000 7f7a0cd5d700 1 --2- 172.21.15.72:0/3865944912 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7a0814f820 0x7f7a080bfce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:38:10.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.356+0000 7f7a07fff700 1 -- 172.21.15.72:0/3865944912 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7a0814f820 msgr2=0x7f7a080bfce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:38:10.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.356+0000 7f7a07fff700 1 --2- 172.21.15.72:0/3865944912 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7a0814f820 0x7f7a080bfce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:38:10.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.356+0000 7f7a07fff700 1 -- 172.21.15.72:0/3865944912 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7a080c5910 msgr2=0x7f7a081558e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:38:10.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.356+0000 7f7a07fff700 1 --2- 172.21.15.72:0/3865944912 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7a080c5910 0x7f7a081558e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:38:10.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.356+0000 7f7a07fff700 1 -- 172.21.15.72:0/3865944912 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79fc0094a0 con 0x7f7a080bb0a0 2023-07-25T14:38:10.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.356+0000 7f7a0cd5d700 1 --2- 172.21.15.72:0/3865944912 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7a0814f820 0x7f7a080bfce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-25T14:38:10.370 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.356+0000 7f7a07fff700 1 --2- 172.21.15.72:0/3865944912 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7a080bb0a0 0x7f7a081eaf50 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f79f800b480 tx=0x7f79f800b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:38:10.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.356+0000 7f7a04ff9700 1 -- 172.21.15.72:0/3865944912 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79f8004020 con 0x7f7a080bb0a0 2023-07-25T14:38:10.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.356+0000 7f7a04ff9700 1 -- 172.21.15.72:0/3865944912 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79f8004180 con 0x7f7a080bb0a0 2023-07-25T14:38:10.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.356+0000 7f7a0e7c0700 1 -- 172.21.15.72:0/3865944912 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a080aa980 con 0x7f7a080bb0a0 2023-07-25T14:38:10.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.356+0000 7f7a04ff9700 1 -- 172.21.15.72:0/3865944912 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79f8004530 con 0x7f7a080bb0a0 2023-07-25T14:38:10.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.356+0000 7f7a0e7c0700 1 -- 172.21.15.72:0/3865944912 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a080ad470 con 0x7f7a080bb0a0 2023-07-25T14:38:10.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.357+0000 7f7a0e7c0700 1 -- 172.21.15.72:0/3865944912 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a080bfb30 con 0x7f7a080bb0a0 2023-07-25T14:38:10.371 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.358+0000 7f7a04ff9700 1 -- 172.21.15.72:0/3865944912 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f79f80036d0 con 0x7f7a080bb0a0 2023-07-25T14:38:10.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.358+0000 7f7a04ff9700 1 --2- 172.21.15.72:0/3865944912 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f79f406ace0 0x7f79f406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:38:10.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.358+0000 7f7a077fe700 1 --2- 172.21.15.72:0/3865944912 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f79f406ace0 0x7f79f406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:38:10.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.358+0000 7f7a04ff9700 1 -- 172.21.15.72:0/3865944912 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 7238+0+0 (secure 0 0 0) 0x7f79f8089060 con 0x7f7a080bb0a0 2023-07-25T14:38:10.372 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.359+0000 7f7a077fe700 1 --2- 172.21.15.72:0/3865944912 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f79f406ace0 0x7f79f406d1a0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f79fc0090b0 tx=0x7f79fc01c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:38:10.373 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.363+0000 7f7a04ff9700 1 -- 172.21.15.72:0/3865944912 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f79f8053d00 con 0x7f7a080bb0a0 2023-07-25T14:38:10.574 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.565+0000 7f7a0e7c0700 1 -- 172.21.15.72:0/3865944912 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f7a0804e470 con 0x7f7a080bb0a0 2023-07-25T14:38:10.575 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.566+0000 7f7a04ff9700 1 -- 172.21.15.72:0/3865944912 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v61) v1 ==== 80+0+0 (secure 0 0 0) 0x7f79f8057320 con 0x7f7a080bb0a0 2023-07-25T14:38:10.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.568+0000 7f7a0e7c0700 1 -- 172.21.15.72:0/3865944912 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f79f406ace0 msgr2=0x7f79f406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:38:10.577 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.568+0000 7f7a0e7c0700 1 --2- 172.21.15.72:0/3865944912 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f79f406ace0 0x7f79f406d1a0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f79fc0090b0 tx=0x7f79fc01c040 comp rx=0 tx=0).stop 2023-07-25T14:38:10.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.568+0000 7f7a0e7c0700 1 -- 172.21.15.72:0/3865944912 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7a080bb0a0 msgr2=0x7f7a081eaf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:38:10.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.568+0000 7f7a0e7c0700 1 --2- 172.21.15.72:0/3865944912 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7a080bb0a0 0x7f7a081eaf50 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f79f800b480 tx=0x7f79f800b790 comp rx=0 tx=0).stop 2023-07-25T14:38:10.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.568+0000 7f7a0e7c0700 1 -- 172.21.15.72:0/3865944912 shutdown_connections 2023-07-25T14:38:10.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.568+0000 7f7a0e7c0700 1 --2- 172.21.15.72:0/3865944912 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f79f406ace0 0x7f79f406d1a0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:38:10.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.568+0000 7f7a0e7c0700 1 --2- 172.21.15.72:0/3865944912 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f7a0814f820 0x7f7a080bfce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:38:10.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.568+0000 7f7a0e7c0700 1 --2- 172.21.15.72:0/3865944912 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f7a080bb0a0 0x7f7a081eaf50 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:38:10.578 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.568+0000 7f7a0e7c0700 1 --2- 172.21.15.72:0/3865944912 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7a080c5910 0x7f7a081558e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:38:10.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.568+0000 7f7a0e7c0700 1 -- 172.21.15.72:0/3865944912 >> 172.21.15.72:0/3865944912 conn(0x7f7a0806a980 msgr2=0x7f7a08150bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:38:10.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.568+0000 7f7a0e7c0700 1 -- 172.21.15.72:0/3865944912 shutdown_connections 2023-07-25T14:38:10.579 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.568+0000 7f7a0e7c0700 1 -- 172.21.15.72:0/3865944912 wait complete. 2023-07-25T14:38:10.579 INFO:teuthology.orchestra.run.smithi072.stderr:listed 0 entries 2023-07-25T14:38:10.589 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-07-25T14:38:10.589 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-25T14:38:10.590 DEBUG:teuthology.orchestra.run.smithi092:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-07-25T14:38:10.640 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi092.front.sepia.ceph.com 2023-07-25T14:38:10.640 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-25T14:38:10.641 DEBUG:teuthology.orchestra.run.smithi092:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-07-25T14:38:10.661 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-07-25T14:38:10.661 DEBUG:teuthology.orchestra.run.smithi092:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-25T14:38:10.721 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284264k,nr_inodes=4071066,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=45,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19843 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260552k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 2023-07-25T14:38:10.722 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-25T14:38:10.842 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.833+0000 7f85d63f5700 1 Processor -- start 2023-07-25T14:38:10.843 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.833+0000 7f85d63f5700 1 -- start start 2023-07-25T14:38:10.844 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.834+0000 7f85d63f5700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f85d006a190 0x7f85d00c0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:38:10.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.834+0000 7f85d63f5700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85d006a5c0 con 0x7f85d0072300 2023-07-25T14:38:10.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.834+0000 7f85d63f5700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85d00a8230 con 0x7f85d014dea0 2023-07-25T14:38:10.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.834+0000 7f85d63f5700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85d00c18d0 con 0x7f85d006a190 2023-07-25T14:38:10.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.834+0000 7f85d4992700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7f85d006a190 0x7f85d00c0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:38:10.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.834+0000 7f85cf7fe700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7f85d0072300 0x7f85d00a86c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:35126/0 (socket says 172.21.15.72:35126) 2023-07-25T14:38:10.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.834+0000 7f85cf7fe700 1 -- 172.21.15.72:0/2479847635 learned_addr learned my addr 172.21.15.72:0/2479847635 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:38:10.845 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.834+0000 7f85d4992700 1 -- 172.21.15.72:0/2479847635 >> v1:172.21.15.92:6789/0 conn(0x7f85d014dea0 legacy=0x7f85d0151200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:38:10.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.834+0000 7f85d4992700 1 -- 172.21.15.72:0/2479847635 >> v1:172.21.15.72:6789/0 conn(0x7f85d0072300 legacy=0x7f85d00a86c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:38:10.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.834+0000 7f85ceffd700 1 -- 172.21.15.72:0/2479847635 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 816490793 0 0) 0x7f85c0001110 con 0x7f85d0072300 2023-07-25T14:38:10.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.834+0000 7f85d4992700 1 -- 172.21.15.72:0/2479847635 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85d00a8dd0 con 0x7f85d006a190 2023-07-25T14:38:10.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.834+0000 7f85d4992700 1 --2- 172.21.15.72:0/2479847635 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f85d006a190 0x7f85d00c0bc0 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f85c800aea0 tx=0x7f85c800c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=484b631cf983ce23 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:38:10.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.835+0000 7f85ceffd700 1 -- 172.21.15.72:0/2479847635 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85c800f070 con 0x7f85d006a190 2023-07-25T14:38:10.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.835+0000 7f85ceffd700 1 -- 172.21.15.72:0/2479847635 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85c8003a20 con 0x7f85d006a190 2023-07-25T14:38:10.846 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.835+0000 7f85ceffd700 1 -- 172.21.15.72:0/2479847635 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85c8003dd0 con 0x7f85d006a190 2023-07-25T14:38:10.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.835+0000 7f85d63f5700 1 -- 172.21.15.72:0/2479847635 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f85d006a190 msgr2=0x7f85d00c0bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:38:10.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.835+0000 7f85d63f5700 1 --2- 172.21.15.72:0/2479847635 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f85d006a190 0x7f85d00c0bc0 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f85c800aea0 tx=0x7f85c800c330 comp rx=0 tx=0).stop 2023-07-25T14:38:10.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.835+0000 7f85d63f5700 1 -- 172.21.15.72:0/2479847635 shutdown_connections 2023-07-25T14:38:10.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.835+0000 7f85d63f5700 1 --2- 172.21.15.72:0/2479847635 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f85d006a190 0x7f85d00c0bc0 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:38:10.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.835+0000 7f85d63f5700 1 -- 172.21.15.72:0/2479847635 >> 172.21.15.72:0/2479847635 conn(0x7f85d006def0 msgr2=0x7f85d006e300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:38:10.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.835+0000 7f85d63f5700 1 -- 172.21.15.72:0/2479847635 shutdown_connections 2023-07-25T14:38:10.847 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.835+0000 7f85d63f5700 1 -- 172.21.15.72:0/2479847635 wait complete. 2023-07-25T14:38:10.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.836+0000 7f85d63f5700 1 Processor -- start 2023-07-25T14:38:10.849 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.836+0000 7f85d63f5700 1 -- start start 2023-07-25T14:38:10.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.837+0000 7f85d63f5700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f85d006a190 0x7f85d014c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:38:10.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.837+0000 7f85d63f5700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f85d0072300 0x7f85d01e8020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:38:10.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.837+0000 7f85d63f5700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f85d014dea0 0x7f85d01e8560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:38:10.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.837+0000 7f85d63f5700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85d01ebe20 con 0x7f85d006a190 2023-07-25T14:38:10.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.837+0000 7f85d63f5700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85d00c5e40 con 0x7f85d014dea0 2023-07-25T14:38:10.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.837+0000 7f85d63f5700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85d01e7b40 con 0x7f85d0072300 2023-07-25T14:38:10.850 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.837+0000 7f85cffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f85d006a190 0x7f85d014c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:38:10.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.837+0000 7f85cffff700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f85d006a190 0x7f85d014c2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:44396/0 (socket says 172.21.15.72:44396) 2023-07-25T14:38:10.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.837+0000 7f85cffff700 1 -- 172.21.15.72:0/3613598515 learned_addr learned my addr 172.21.15.72:0/3613598515 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:38:10.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.837+0000 7f85d4992700 1 --2- 172.21.15.72:0/3613598515 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f85d014dea0 0x7f85d01e8560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:38:10.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.837+0000 7f85cf7fe700 1 --2- 172.21.15.72:0/3613598515 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f85d0072300 0x7f85d01e8020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:38:10.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.838+0000 7f85cffff700 1 -- 172.21.15.72:0/3613598515 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f85d0072300 msgr2=0x7f85d01e8020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:38:10.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.838+0000 7f85cffff700 1 --2- 172.21.15.72:0/3613598515 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f85d0072300 0x7f85d01e8020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:38:10.851 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.838+0000 7f85cffff700 1 -- 172.21.15.72:0/3613598515 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f85d014dea0 msgr2=0x7f85d01e8560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:38:10.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.838+0000 7f85cffff700 1 --2- 172.21.15.72:0/3613598515 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f85d014dea0 0x7f85d01e8560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:38:10.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.838+0000 7f85cffff700 1 -- 172.21.15.72:0/3613598515 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85c800ab80 con 0x7f85d006a190 2023-07-25T14:38:10.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.838+0000 7f85cffff700 1 --2- 172.21.15.72:0/3613598515 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f85d006a190 0x7f85d014c2a0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f85c400b470 tx=0x7f85c400b830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:38:10.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.838+0000 7f85ccff9700 1 -- 172.21.15.72:0/3613598515 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85c4011830 con 0x7f85d006a190 2023-07-25T14:38:10.852 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.838+0000 7f85ccff9700 1 -- 172.21.15.72:0/3613598515 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85c4011990 con 0x7f85d006a190 2023-07-25T14:38:10.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.838+0000 7f85d63f5700 1 -- 172.21.15.72:0/3613598515 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85d00c5880 con 0x7f85d006a190 2023-07-25T14:38:10.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.838+0000 7f85ccff9700 1 -- 172.21.15.72:0/3613598515 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85c4011d40 con 0x7f85d006a190 2023-07-25T14:38:10.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.838+0000 7f85d63f5700 1 -- 172.21.15.72:0/3613598515 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85d014c7e0 con 0x7f85d006a190 2023-07-25T14:38:10.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.839+0000 7f85d63f5700 1 -- 172.21.15.72:0/3613598515 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85d01e79a0 con 0x7f85d006a190 2023-07-25T14:38:10.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.839+0000 7f85ccff9700 1 -- 172.21.15.72:0/3613598515 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f85c401a400 con 0x7f85d006a190 2023-07-25T14:38:10.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.840+0000 7f85ccff9700 1 --2- 172.21.15.72:0/3613598515 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f85bc06ace0 0x7f85bc06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:38:10.853 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.840+0000 7f85ccff9700 1 -- 172.21.15.72:0/3613598515 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 7238+0+0 (secure 0 0 0) 0x7f85c4089930 con 0x7f85d006a190 2023-07-25T14:38:10.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.840+0000 7f85cf7fe700 1 --2- 172.21.15.72:0/3613598515 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f85bc06ace0 0x7f85bc06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:38:10.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.840+0000 7f85cf7fe700 1 --2- 172.21.15.72:0/3613598515 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f85bc06ace0 0x7f85bc06d1a0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f85d014cbc0 tx=0x7f85c0007a40 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:38:10.854 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:10.844+0000 7f85ccff9700 1 -- 172.21.15.72:0/3613598515 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7f85d01e79a0 con 0x7f85d006a190 2023-07-25T14:38:11.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:11.072+0000 7f85d63f5700 1 -- 172.21.15.72:0/3613598515 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f85d01e79a0 con 0x7f85d006a190 2023-07-25T14:38:11.082 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:11.072+0000 7f85ccff9700 1 -- 172.21.15.72:0/3613598515 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v38) v1 ==== 53+0+149 (secure 0 0 0) 0x7f85c40150b0 con 0x7f85d006a190 2023-07-25T14:38:11.082 INFO:teuthology.orchestra.run.smithi072.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-25T14:38:11.083 INFO:teuthology.orchestra.run.smithi072.stdout:name: cephfs2, metadata pool: cephfs2_metadata, data pools: [cephfs2_data ] 2023-07-25T14:38:11.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:11.074+0000 7f85d63f5700 1 -- 172.21.15.72:0/3613598515 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f85bc06ace0 msgr2=0x7f85bc06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:38:11.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:11.074+0000 7f85d63f5700 1 --2- 172.21.15.72:0/3613598515 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f85bc06ace0 0x7f85bc06d1a0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f85d014cbc0 tx=0x7f85c0007a40 comp rx=0 tx=0).stop 2023-07-25T14:38:11.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:11.074+0000 7f85d63f5700 1 -- 172.21.15.72:0/3613598515 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f85d006a190 msgr2=0x7f85d014c2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:38:11.084 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:11.074+0000 7f85d63f5700 1 --2- 172.21.15.72:0/3613598515 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f85d006a190 0x7f85d014c2a0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f85c400b470 tx=0x7f85c400b830 comp rx=0 tx=0).stop 2023-07-25T14:38:11.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:11.074+0000 7f85d63f5700 1 -- 172.21.15.72:0/3613598515 shutdown_connections 2023-07-25T14:38:11.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:11.074+0000 7f85d63f5700 1 --2- 172.21.15.72:0/3613598515 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7f85bc06ace0 0x7f85bc06d1a0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:38:11.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:11.074+0000 7f85d63f5700 1 --2- 172.21.15.72:0/3613598515 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f85d014dea0 0x7f85d01e8560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:38:11.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:11.074+0000 7f85d63f5700 1 --2- 172.21.15.72:0/3613598515 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7f85d006a190 0x7f85d014c2a0 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:38:11.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:11.074+0000 7f85d63f5700 1 --2- 172.21.15.72:0/3613598515 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7f85d0072300 0x7f85d01e8020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:38:11.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:11.074+0000 7f85d63f5700 1 -- 172.21.15.72:0/3613598515 >> 172.21.15.72:0/3613598515 conn(0x7f85d006def0 msgr2=0x7f85d0149ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:38:11.085 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:11.075+0000 7f85d63f5700 1 -- 172.21.15.72:0/3613598515 shutdown_connections 2023-07-25T14:38:11.086 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:11.075+0000 7f85d63f5700 1 -- 172.21.15.72:0/3613598515 wait complete. 2023-07-25T14:38:11.096 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs2; just confirmed its presence on cluster 2023-07-25T14:38:11.096 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-25T14:38:11.096 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi092.front.sepia.ceph.com 2023-07-25T14:38:11.097 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-07-25T14:38:11.097 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-07-25T14:38:11.097 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs2 2023-07-25T14:38:11.097 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-07-25T14:38:11.098 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-25T14:38:11.098 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-07-25T14:38:11.098 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-25T14:38:11.099 DEBUG:teuthology.orchestra.run.smithi092:> ip addr 2023-07-25T14:38:11.120 INFO:teuthology.orchestra.run.smithi092.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-25T14:38:11.120 INFO:teuthology.orchestra.run.smithi092.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-25T14:38:11.120 INFO:teuthology.orchestra.run.smithi092.stdout: inet 127.0.0.1/8 scope host lo 2023-07-25T14:38:11.120 INFO:teuthology.orchestra.run.smithi092.stdout: valid_lft forever preferred_lft forever 2023-07-25T14:38:11.121 INFO:teuthology.orchestra.run.smithi092.stdout: inet6 ::1/128 scope host 2023-07-25T14:38:11.121 INFO:teuthology.orchestra.run.smithi092.stdout: valid_lft forever preferred_lft forever 2023-07-25T14:38:11.121 INFO:teuthology.orchestra.run.smithi092.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-25T14:38:11.121 INFO:teuthology.orchestra.run.smithi092.stdout: link/ether 0c:c4:7a:d8:a1:b2 brd ff:ff:ff:ff:ff:ff 2023-07-25T14:38:11.121 INFO:teuthology.orchestra.run.smithi092.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-25T14:38:11.121 INFO:teuthology.orchestra.run.smithi092.stdout: link/ether 0c:c4:7a:d8:a1:b3 brd ff:ff:ff:ff:ff:ff 2023-07-25T14:38:11.121 INFO:teuthology.orchestra.run.smithi092.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-25T14:38:11.121 INFO:teuthology.orchestra.run.smithi092.stdout: link/ether 0c:c4:7a:8f:cd:44 brd ff:ff:ff:ff:ff:ff 2023-07-25T14:38:11.122 INFO:teuthology.orchestra.run.smithi092.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-25T14:38:11.122 INFO:teuthology.orchestra.run.smithi092.stdout: link/ether 0c:c4:7a:8f:cd:45 brd ff:ff:ff:ff:ff:ff 2023-07-25T14:38:11.122 INFO:teuthology.orchestra.run.smithi092.stdout: inet 172.21.15.92/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-07-25T14:38:11.122 INFO:teuthology.orchestra.run.smithi092.stdout: valid_lft 42103sec preferred_lft 42103sec 2023-07-25T14:38:11.122 INFO:teuthology.orchestra.run.smithi092.stdout: inet6 fe80::c8ab:79f5:f80b:16b/64 scope link noprefixroute 2023-07-25T14:38:11.122 INFO:teuthology.orchestra.run.smithi092.stdout: valid_lft forever preferred_lft forever 2023-07-25T14:38:11.122 INFO:teuthology.orchestra.run.smithi092.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-25T14:38:11.123 INFO:teuthology.orchestra.run.smithi092.stdout: link/ether 0e:6e:1c:1c:77:0f brd ff:ff:ff:ff:ff:ff 2023-07-25T14:38:11.123 INFO:teuthology.orchestra.run.smithi092.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-25T14:38:11.123 INFO:teuthology.orchestra.run.smithi092.stdout: valid_lft forever preferred_lft forever 2023-07-25T14:38:11.123 INFO:teuthology.orchestra.run.smithi092.stdout: inet6 fe80::5099:6cff:fecf:8811/64 scope link 2023-07-25T14:38:11.123 INFO:teuthology.orchestra.run.smithi092.stdout: valid_lft forever preferred_lft forever 2023-07-25T14:38:11.123 INFO:teuthology.orchestra.run.smithi092.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-25T14:38:11.123 INFO:teuthology.orchestra.run.smithi092.stdout: link/ether 0e:6e:1c:1c:77:0f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-07-25T14:38:11.123 INFO:teuthology.orchestra.run.smithi092.stdout: inet6 fe80::c6e:1cff:fe1c:770f/64 scope link 2023-07-25T14:38:11.124 INFO:teuthology.orchestra.run.smithi092.stdout: valid_lft forever preferred_lft forever 2023-07-25T14:38:11.124 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-25T14:38:11.124 DEBUG:teuthology.orchestra.run.smithi092:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-25T14:38:11.191 INFO:teuthology.orchestra.run.smithi092.stdout:1 2023-07-25T14:38:11.192 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-25T14:38:11.193 DEBUG:teuthology.orchestra.run.smithi092:> route 2023-07-25T14:38:11.255 INFO:teuthology.orchestra.run.smithi092.stdout:Kernel IP routing table 2023-07-25T14:38:11.255 INFO:teuthology.orchestra.run.smithi092.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-25T14:38:11.256 INFO:teuthology.orchestra.run.smithi092.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-07-25T14:38:11.256 INFO:teuthology.orchestra.run.smithi092.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-07-25T14:38:11.256 INFO:teuthology.orchestra.run.smithi092.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-25T14:38:11.256 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-25T14:38:11.257 DEBUG:teuthology.orchestra.run.smithi092:> (cd / && exec bash -c ' 2023-07-25T14:38:11.257 DEBUG:teuthology.orchestra.run.smithi092:> set -e 2023-07-25T14:38:11.258 DEBUG:teuthology.orchestra.run.smithi092:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-07-25T14:38:11.258 DEBUG:teuthology.orchestra.run.smithi092:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-07-25T14:38:11.258 DEBUG:teuthology.orchestra.run.smithi092:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-07-25T14:38:11.258 DEBUG:teuthology.orchestra.run.smithi092:> ') 2023-07-25T14:38:11.375 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-25T14:38:11.376 DEBUG:teuthology.orchestra.run.smithi092:> ip netns list 2023-07-25T14:38:11.396 INFO:teuthology.orchestra.run.smithi092.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-07-25T14:38:11.397 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-07-25T14:38:11.397 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-25T14:38:11.398 DEBUG:teuthology.orchestra.run.smithi092:> sudo ip link set brx.0 up 2023-07-25T14:38:11.469 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-25T14:38:11.470 DEBUG:teuthology.orchestra.run.smithi092:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-07-25T14:38:11.530 INFO:teuthology.orchestra.run.smithi092.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-07-25T14:38:11.531 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-25T14:38:11.531 DEBUG:teuthology.orchestra.run.smithi092:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-07-25T14:38:11.592 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-07-25T14:38:11.592 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-25T14:38:11.593 DEBUG:teuthology.orchestra.run.smithi092:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs2 2023-07-25T14:38:11.685 INFO:teuthology.orchestra.run.smithi092.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs2 2023-07-25T14:38:11.686 INFO:teuthology.orchestra.run.smithi092.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs2". 2023-07-25T14:38:11.686 INFO:teuthology.orchestra.run.smithi092.stdout:invalid new device string format 2023-07-25T14:38:11.695 INFO:teuthology.orchestra.run.smithi092.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs2 2023-07-25T14:38:11.695 INFO:teuthology.orchestra.run.smithi092.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs2". 2023-07-25T14:38:11.695 INFO:teuthology.orchestra.run.smithi092.stdout:invalid new device string format 2023-07-25T14:38:11.695 INFO:teuthology.orchestra.run.smithi092.stdout:mount.ceph: resolved to: "172.21.15.72:3300,172.21.15.92:3300,172.21.15.92:3301" 2023-07-25T14:38:11.696 INFO:teuthology.orchestra.run.smithi092.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-25T14:38:11.737 INFO:teuthology.orchestra.run.smithi092.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs2 2023-07-25T14:38:11.738 INFO:teuthology.orchestra.run.smithi092.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs2". 2023-07-25T14:38:11.738 INFO:teuthology.orchestra.run.smithi092.stdout:invalid new device string format 2023-07-25T14:38:11.738 INFO:teuthology.orchestra.run.smithi092.stdout:mount.ceph: resolved to: "172.21.15.72:3300,172.21.15.92:3300,172.21.15.92:3301" 2023-07-25T14:38:11.739 INFO:teuthology.orchestra.run.smithi092.stdout:mount.ceph: switching to using v1 address with old syntax 2023-07-25T14:38:11.739 INFO:teuthology.orchestra.run.smithi092.stdout:mount.ceph: resolved to: "172.21.15.72:6789,172.21.15.92:6789,172.21.15.92:6790" 2023-07-25T14:38:11.739 INFO:teuthology.orchestra.run.smithi092.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.72:6789,172.21.15.92:6789,172.21.15.92:6790:/ 2023-07-25T14:38:11.740 INFO:teuthology.orchestra.run.smithi092.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs2,key=1,fsid=9170db48-9170-43e8-8ccb-9813e6240906" will pass to kernel 2023-07-25T14:38:11.753 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-07-25T14:38:11.753 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-25T14:38:11.754 DEBUG:teuthology.orchestra.run.smithi092:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-07-25T14:38:11.781 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-25T14:38:11.782 DEBUG:teuthology.orchestra.run.smithi092:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-07-25T14:38:11.869 INFO:teuthology.orchestra.run.smithi092.stdout:client5965 2023-07-25T14:38:11.869 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2023-07-25T14:38:11.870 DEBUG:teuthology.orchestra.run.smithi092:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-25T14:38:11.887 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth add client.testuser mon 'allow rw fsname=cephfs, allow rw fsname=cephfs2' osd 'allow rw tag cephfs data=cephfs, allow rw tag cephfs data=cephfs2' mds 'allow rw fsname=cephfs' 2023-07-25T14:38:12.025 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:12.015+0000 7fecca0eb700 1 Processor -- start 2023-07-25T14:38:12.026 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:12.015+0000 7fecca0eb700 1 -- start start 2023-07-25T14:38:12.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:12.016+0000 7fecca0eb700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fecc414f810 0x7fecc40c4370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:38:12.030 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:12.016+0000 7fecca0eb700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fecc40a9cc0 0x7fecc41525e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:38:12.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:12.016+0000 7fecca0eb700 1 -- --> v1:172.21.15.72:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecc40c5890 con 0x7fecc40bb0b0 2023-07-25T14:38:12.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:12.016+0000 7fecca0eb700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecc4152150 con 0x7fecc40a9cc0 2023-07-25T14:38:12.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:12.016+0000 7fecca0eb700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecc414fbf0 con 0x7fecc414f810 2023-07-25T14:38:12.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:12.016+0000 7fecc2ffd700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7fecc40a9cc0 0x7fecc41525e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:38:12.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:12.016+0000 7fecc3fff700 1 --1- >> v1:172.21.15.72:6789/0 conn(0x7fecc40bb0b0 0x7fecc4152b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.72:6789/0 says I am v1:172.21.15.72:35142/0 (socket says 172.21.15.72:35142) 2023-07-25T14:38:12.031 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:12.016+0000 7fecc3fff700 1 -- 172.21.15.72:0/715854712 learned_addr learned my addr 172.21.15.72:0/715854712 (peer_addr_for_me v1:172.21.15.72:0/0) 2023-07-25T14:38:12.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:12.016+0000 7fecc37fe700 1 --2- 172.21.15.72:0/715854712 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fecc414f810 0x7fecc40c4370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:38:12.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:12.017+0000 7fecc2ffd700 1 -- 172.21.15.72:0/715854712 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fecc414f810 msgr2=0x7fecc40c4370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:38:12.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:12.017+0000 7fecc2ffd700 1 --2- 172.21.15.72:0/715854712 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fecc414f810 0x7fecc40c4370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:38:12.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:12.017+0000 7fecc2ffd700 1 -- 172.21.15.72:0/715854712 >> v1:172.21.15.72:6789/0 conn(0x7fecc40bb0b0 legacy=0x7fecc4152b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:38:12.032 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:12.017+0000 7fecc2ffd700 1 -- 172.21.15.72:0/715854712 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecc41566a0 con 0x7fecc40a9cc0 2023-07-25T14:38:12.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:12.017+0000 7fecc27fc700 1 -- 172.21.15.72:0/715854712 <== mon.0 v1:172.21.15.72:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1475538524 0 0) 0x7fecc40c5890 con 0x7fecc40bb0b0 2023-07-25T14:38:12.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:12.017+0000 7fecc37fe700 1 --2- 172.21.15.72:0/715854712 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fecc414f810 0x7fecc40c4370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-25T14:38:12.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:12.017+0000 7fecc2ffd700 1 --2- 172.21.15.72:0/715854712 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fecc40a9cc0 0x7fecc41525e0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7fecb4009840 tx=0x7fecb4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1b64a7f06d43f5f server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:38:12.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:12.017+0000 7fecc27fc700 1 -- 172.21.15.72:0/715854712 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecb4011830 con 0x7fecc40a9cc0 2023-07-25T14:38:12.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:12.017+0000 7fecc27fc700 1 -- 172.21.15.72:0/715854712 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecb4011990 con 0x7fecc40a9cc0 2023-07-25T14:38:12.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:12.017+0000 7fecc27fc700 1 -- 172.21.15.72:0/715854712 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecb4011d20 con 0x7fecc40a9cc0 2023-07-25T14:38:12.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:12.017+0000 7fecca0eb700 1 -- 172.21.15.72:0/715854712 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fecc40a9cc0 msgr2=0x7fecc41525e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:38:12.033 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:12.017+0000 7fecca0eb700 1 --2- 172.21.15.72:0/715854712 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fecc40a9cc0 0x7fecc41525e0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7fecb4009840 tx=0x7fecb4009b50 comp rx=0 tx=0).stop 2023-07-25T14:38:12.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:12.018+0000 7fecca0eb700 1 -- 172.21.15.72:0/715854712 shutdown_connections 2023-07-25T14:38:12.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:12.018+0000 7fecca0eb700 1 --2- 172.21.15.72:0/715854712 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fecc414f810 0x7fecc40c4370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:38:12.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:12.018+0000 7fecca0eb700 1 --2- 172.21.15.72:0/715854712 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fecc40a9cc0 0x7fecc41525e0 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:38:12.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:12.018+0000 7fecca0eb700 1 -- 172.21.15.72:0/715854712 >> 172.21.15.72:0/715854712 conn(0x7fecc406a8d0 msgr2=0x7fecc40a94e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:38:12.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:12.018+0000 7fecca0eb700 1 -- 172.21.15.72:0/715854712 shutdown_connections 2023-07-25T14:38:12.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:12.018+0000 7fecca0eb700 1 -- 172.21.15.72:0/715854712 wait complete. 2023-07-25T14:38:12.034 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:12.019+0000 7fecca0eb700 1 Processor -- start 2023-07-25T14:38:12.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:12.019+0000 7fecca0eb700 1 -- start start 2023-07-25T14:38:12.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:12.019+0000 7fecca0eb700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fecc40a9cc0 0x7fecc40bddf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:38:12.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:12.019+0000 7fecca0eb700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fecc40bb0b0 0x7fecc40bc2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:38:12.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:12.020+0000 7fecca0eb700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fecc414f810 0x7fecc40a8f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:38:12.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:12.020+0000 7fecca0eb700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecc40c0d90 con 0x7fecc40a9cc0 2023-07-25T14:38:12.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:12.020+0000 7fecca0eb700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecc40c1070 con 0x7fecc414f810 2023-07-25T14:38:12.035 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:12.020+0000 7fecca0eb700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecc40c1350 con 0x7fecc40bb0b0 2023-07-25T14:38:12.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:12.020+0000 7fecc37fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fecc40a9cc0 0x7fecc40bddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:38:12.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:12.020+0000 7fecc37fe700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fecc40a9cc0 0x7fecc40bddf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:44410/0 (socket says 172.21.15.72:44410) 2023-07-25T14:38:12.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:12.020+0000 7fecc37fe700 1 -- 172.21.15.72:0/1132939595 learned_addr learned my addr 172.21.15.72:0/1132939595 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:38:12.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:12.020+0000 7fecc2ffd700 1 --2- 172.21.15.72:0/1132939595 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fecc40bb0b0 0x7fecc40bc2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:38:12.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:12.020+0000 7fecc3fff700 1 --2- 172.21.15.72:0/1132939595 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fecc414f810 0x7fecc40a8f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:38:12.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:12.020+0000 7fecc37fe700 1 -- 172.21.15.72:0/1132939595 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fecc40bb0b0 msgr2=0x7fecc40bc2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:38:12.036 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:12.020+0000 7fecc37fe700 1 --2- 172.21.15.72:0/1132939595 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fecc40bb0b0 0x7fecc40bc2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:38:12.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:12.020+0000 7fecc37fe700 1 -- 172.21.15.72:0/1132939595 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fecc414f810 msgr2=0x7fecc40a8f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:38:12.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:12.020+0000 7fecc37fe700 1 --2- 172.21.15.72:0/1132939595 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fecc414f810 0x7fecc40a8f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:38:12.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:12.020+0000 7fecc37fe700 1 -- 172.21.15.72:0/1132939595 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecb40094a0 con 0x7fecc40a9cc0 2023-07-25T14:38:12.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:12.020+0000 7fecc2ffd700 1 --2- 172.21.15.72:0/1132939595 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fecc40bb0b0 0x7fecc40bc2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-25T14:38:12.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:12.020+0000 7fecc37fe700 1 --2- 172.21.15.72:0/1132939595 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fecc40a9cc0 0x7fecc40bddf0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7fecb800e810 tx=0x7fecb800ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:38:12.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:12.020+0000 7fecabfff700 1 -- 172.21.15.72:0/1132939595 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecb8004230 con 0x7fecc40a9cc0 2023-07-25T14:38:12.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:12.020+0000 7fecabfff700 1 -- 172.21.15.72:0/1132939595 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecb8004390 con 0x7fecc40a9cc0 2023-07-25T14:38:12.037 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:12.020+0000 7fecca0eb700 1 -- 172.21.15.72:0/1132939595 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecc40c1630 con 0x7fecc40a9cc0 2023-07-25T14:38:12.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:12.020+0000 7fecabfff700 1 -- 172.21.15.72:0/1132939595 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecb80036a0 con 0x7fecc40a9cc0 2023-07-25T14:38:12.038 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:12.020+0000 7fecca0eb700 1 -- 172.21.15.72:0/1132939595 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecc40bc800 con 0x7fecc40a9cc0 2023-07-25T14:38:12.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:12.021+0000 7fecca0eb700 1 -- 172.21.15.72:0/1132939595 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecc404e470 con 0x7fecc40a9cc0 2023-07-25T14:38:12.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:12.022+0000 7fecabfff700 1 -- 172.21.15.72:0/1132939595 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fecb8003800 con 0x7fecc40a9cc0 2023-07-25T14:38:12.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:12.022+0000 7fecabfff700 1 --2- 172.21.15.72:0/1132939595 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fecb006ace0 0x7fecb006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:38:12.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:12.022+0000 7fecabfff700 1 -- 172.21.15.72:0/1132939595 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 7238+0+0 (secure 0 0 0) 0x7fecb8089460 con 0x7fecc40a9cc0 2023-07-25T14:38:12.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:12.022+0000 7fecc2ffd700 1 --2- 172.21.15.72:0/1132939595 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fecb006ace0 0x7fecb006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:38:12.039 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:12.022+0000 7fecc2ffd700 1 --2- 172.21.15.72:0/1132939595 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fecb006ace0 0x7fecb006d1a0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fecc40c1b30 tx=0x7fecb4008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:38:12.040 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:12.026+0000 7fecabfff700 1 -- 172.21.15.72:0/1132939595 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7fecb8054070 con 0x7fecc40a9cc0 2023-07-25T14:38:12.297 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:12.288+0000 7fecca0eb700 1 -- 172.21.15.72:0/1132939595 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "auth add", "entity": "client.testuser", "caps": ["mon", "allow rw fsname=cephfs, allow rw fsname=cephfs2", "osd", "allow rw tag cephfs data=cephfs, allow rw tag cephfs data=cephfs2", "mds", "allow rw fsname=cephfs"]} v 0) v1 -- 0x7fecc40c0ed0 con 0x7fecc40a9cc0 2023-07-25T14:38:12.301 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:12.291+0000 7fecabfff700 1 -- 172.21.15.72:0/1132939595 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "auth add", "entity": "client.testuser", "caps": ["mon", "allow rw fsname=cephfs, allow rw fsname=cephfs2", "osd", "allow rw tag cephfs data=cephfs, allow rw tag cephfs data=cephfs2", "mds", "allow rw fsname=cephfs"]}]=0 added key for client.testuser v19) v1 ==== 291+0+0 (secure 0 0 0) 0x7fecc40c0ed0 con 0x7fecc40a9cc0 2023-07-25T14:38:12.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:12.293+0000 7fecca0eb700 1 -- 172.21.15.72:0/1132939595 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fecb006ace0 msgr2=0x7fecb006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:38:12.303 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:12.293+0000 7fecca0eb700 1 --2- 172.21.15.72:0/1132939595 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fecb006ace0 0x7fecb006d1a0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fecc40c1b30 tx=0x7fecb4008030 comp rx=0 tx=0).stop 2023-07-25T14:38:12.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:12.293+0000 7fecca0eb700 1 -- 172.21.15.72:0/1132939595 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fecc40a9cc0 msgr2=0x7fecc40bddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:38:12.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:12.293+0000 7fecca0eb700 1 --2- 172.21.15.72:0/1132939595 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fecc40a9cc0 0x7fecc40bddf0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7fecb800e810 tx=0x7fecb800ebd0 comp rx=0 tx=0).stop 2023-07-25T14:38:12.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:12.293+0000 7fecca0eb700 1 -- 172.21.15.72:0/1132939595 shutdown_connections 2023-07-25T14:38:12.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:12.293+0000 7fecca0eb700 1 --2- 172.21.15.72:0/1132939595 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7fecb006ace0 0x7fecb006d1a0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:38:12.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:12.293+0000 7fecca0eb700 1 --2- 172.21.15.72:0/1132939595 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fecc414f810 0x7fecc40a8f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:38:12.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:12.293+0000 7fecca0eb700 1 --2- 172.21.15.72:0/1132939595 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7fecc40a9cc0 0x7fecc40bddf0 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:38:12.304 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:12.293+0000 7fecca0eb700 1 --2- 172.21.15.72:0/1132939595 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7fecc40bb0b0 0x7fecc40bc2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:38:12.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:12.293+0000 7fecca0eb700 1 -- 172.21.15.72:0/1132939595 >> 172.21.15.72:0/1132939595 conn(0x7fecc406a8d0 msgr2=0x7fecc41525e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:38:12.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:12.293+0000 7fecca0eb700 1 -- 172.21.15.72:0/1132939595 shutdown_connections 2023-07-25T14:38:12.305 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:12.293+0000 7fecca0eb700 1 -- 172.21.15.72:0/1132939595 wait complete. 2023-07-25T14:38:12.305 INFO:teuthology.orchestra.run.smithi072.stderr:added key for client.testuser 2023-07-25T14:38:12.317 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth get client.testuser 2023-07-25T14:38:12.438 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:12.429+0000 7febac995700 1 Processor -- start 2023-07-25T14:38:12.439 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:12.429+0000 7febac995700 1 -- start start 2023-07-25T14:38:12.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:12.430+0000 7febac995700 1 --2- >> v2:172.21.15.92:3300/0 conn(0x7feba8151870 0x7feba8154ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:38:12.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:12.430+0000 7febac995700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7feba806eb60 0x7feba806ef70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:38:12.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:12.430+0000 7febac995700 1 -- --> v1:172.21.15.92:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feba80c4cc0 con 0x7feba80c47b0 2023-07-25T14:38:12.440 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:12.430+0000 7febac995700 1 -- --> v2:172.21.15.72:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feba8151c50 con 0x7feba806eb60 2023-07-25T14:38:12.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:12.430+0000 7febac995700 1 -- --> v2:172.21.15.92:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feba80c1230 con 0x7feba8151870 2023-07-25T14:38:12.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:12.430+0000 7feba6d9d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7feba806eb60 0x7feba806ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:38:12.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:12.430+0000 7feba6d9d700 1 --2- >> v2:172.21.15.72:3300/0 conn(0x7feba806eb60 0x7feba806ef70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:44420/0 (socket says 172.21.15.72:44420) 2023-07-25T14:38:12.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:12.430+0000 7feba6d9d700 1 -- 172.21.15.72:0/3871687909 learned_addr learned my addr 172.21.15.72:0/3871687909 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:38:12.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:12.430+0000 7feba659c700 1 --2- 172.21.15.72:0/3871687909 >> v2:172.21.15.92:3300/0 conn(0x7feba8151870 0x7feba8154ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:38:12.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:12.430+0000 7feba6d9d700 1 -- 172.21.15.72:0/3871687909 >> v2:172.21.15.92:3300/0 conn(0x7feba8151870 msgr2=0x7feba8154ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:38:12.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:12.430+0000 7feba6d9d700 1 --2- 172.21.15.72:0/3871687909 >> v2:172.21.15.92:3300/0 conn(0x7feba8151870 0x7feba8154ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:38:12.441 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:12.430+0000 7feba6d9d700 1 -- 172.21.15.72:0/3871687909 >> v1:172.21.15.92:6789/0 conn(0x7feba80c47b0 legacy=0x7feba8071540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-25T14:38:12.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:12.430+0000 7feba6d9d700 1 -- 172.21.15.72:0/3871687909 --> v2:172.21.15.72:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feba806e660 con 0x7feba806eb60 2023-07-25T14:38:12.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:12.430+0000 7feba6d9d700 1 --2- 172.21.15.72:0/3871687909 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feba806eb60 0x7feba806ef70 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7feba8072860 tx=0x7feba000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e412107b2bc1c01 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:38:12.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:12.431+0000 7feba559a700 1 -- 172.21.15.72:0/3871687909 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feba000e070 con 0x7feba806eb60 2023-07-25T14:38:12.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:12.431+0000 7feba559a700 1 -- 172.21.15.72:0/3871687909 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feba0003a20 con 0x7feba806eb60 2023-07-25T14:38:12.442 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:12.431+0000 7feba559a700 1 -- 172.21.15.72:0/3871687909 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feba0003dd0 con 0x7feba806eb60 2023-07-25T14:38:12.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:12.431+0000 7febac995700 1 -- 172.21.15.72:0/3871687909 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feba806eb60 msgr2=0x7feba806ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:38:12.444 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:12.431+0000 7febac995700 1 --2- 172.21.15.72:0/3871687909 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feba806eb60 0x7feba806ef70 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7feba8072860 tx=0x7feba000b330 comp rx=0 tx=0).stop 2023-07-25T14:38:12.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:12.431+0000 7febac995700 1 -- 172.21.15.72:0/3871687909 shutdown_connections 2023-07-25T14:38:12.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:12.431+0000 7febac995700 1 --2- 172.21.15.72:0/3871687909 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feba806eb60 0x7feba806ef70 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:38:12.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:12.431+0000 7febac995700 1 --2- 172.21.15.72:0/3871687909 >> v2:172.21.15.92:3300/0 conn(0x7feba8151870 0x7feba8154ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:38:12.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:12.431+0000 7febac995700 1 -- 172.21.15.72:0/3871687909 >> 172.21.15.72:0/3871687909 conn(0x7feba80c68b0 msgr2=0x7feba80c6cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:38:12.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:12.431+0000 7febac995700 1 -- 172.21.15.72:0/3871687909 shutdown_connections 2023-07-25T14:38:12.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:12.431+0000 7febac995700 1 -- 172.21.15.72:0/3871687909 wait complete. 2023-07-25T14:38:12.445 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:12.432+0000 7febac995700 1 Processor -- start 2023-07-25T14:38:12.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:12.432+0000 7febac995700 1 -- start start 2023-07-25T14:38:12.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:12.433+0000 7febac995700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feba806eb60 0x7feba814c040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:38:12.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:12.433+0000 7febac995700 1 --2- >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7feba80c47b0 0x7feba81ed660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:38:12.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:12.433+0000 7febac995700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feba8151870 0x7feba81e9ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:38:12.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:12.433+0000 7febac995700 1 -- --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feba814df50 con 0x7feba806eb60 2023-07-25T14:38:12.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:12.433+0000 7febac995700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feba81e96e0 con 0x7feba8151870 2023-07-25T14:38:12.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:12.433+0000 7febac995700 1 -- --> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feba806bc60 con 0x7feba80c47b0 2023-07-25T14:38:12.446 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:12.433+0000 7feba659c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feba806eb60 0x7feba814c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:38:12.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:12.433+0000 7feba659c700 1 --2- >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feba806eb60 0x7feba814c040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.72:3300/0 says I am v2:172.21.15.72:44422/0 (socket says 172.21.15.72:44422) 2023-07-25T14:38:12.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:12.433+0000 7feba659c700 1 -- 172.21.15.72:0/3927477724 learned_addr learned my addr 172.21.15.72:0/3927477724 (peer_addr_for_me v2:172.21.15.72:0/0) 2023-07-25T14:38:12.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:12.433+0000 7feba6d9d700 1 --2- 172.21.15.72:0/3927477724 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feba8151870 0x7feba81e9ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:38:12.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:12.433+0000 7feba5d9b700 1 --2- 172.21.15.72:0/3927477724 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7feba80c47b0 0x7feba81ed660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:38:12.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:12.433+0000 7feba659c700 1 -- 172.21.15.72:0/3927477724 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7feba80c47b0 msgr2=0x7feba81ed660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:38:12.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:12.433+0000 7feba659c700 1 --2- 172.21.15.72:0/3927477724 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7feba80c47b0 0x7feba81ed660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:38:12.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:12.433+0000 7feba659c700 1 -- 172.21.15.72:0/3927477724 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feba8151870 msgr2=0x7feba81e9ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:38:12.447 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:12.433+0000 7feba659c700 1 --2- 172.21.15.72:0/3927477724 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feba8151870 0x7feba81e9ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:38:12.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:12.433+0000 7feba659c700 1 -- 172.21.15.72:0/3927477724 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feba0009b30 con 0x7feba806eb60 2023-07-25T14:38:12.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:12.433+0000 7feba6d9d700 1 --2- 172.21.15.72:0/3927477724 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feba8151870 0x7feba81e9ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-25T14:38:12.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:12.434+0000 7feba659c700 1 --2- 172.21.15.72:0/3927477724 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feba806eb60 0x7feba814c040 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7feb9c00d7d0 tx=0x7feb9c00db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:38:12.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:12.434+0000 7feb96ffd700 1 -- 172.21.15.72:0/3927477724 <== mon.0 v2:172.21.15.72:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb9c0125f0 con 0x7feba806eb60 2023-07-25T14:38:12.448 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:12.434+0000 7feb96ffd700 1 -- 172.21.15.72:0/3927477724 <== mon.0 v2:172.21.15.72:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb9c012750 con 0x7feba806eb60 2023-07-25T14:38:12.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:12.434+0000 7febac995700 1 -- 172.21.15.72:0/3927477724 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feba80a75b0 con 0x7feba806eb60 2023-07-25T14:38:12.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:12.434+0000 7feb96ffd700 1 -- 172.21.15.72:0/3927477724 <== mon.0 v2:172.21.15.72:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb9c012b00 con 0x7feba806eb60 2023-07-25T14:38:12.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:12.434+0000 7febac995700 1 -- 172.21.15.72:0/3927477724 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feba80a7b70 con 0x7feba806eb60 2023-07-25T14:38:12.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:12.435+0000 7febac995700 1 -- 172.21.15.72:0/3927477724 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feba804e470 con 0x7feba806eb60 2023-07-25T14:38:12.449 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:12.435+0000 7feb96ffd700 1 -- 172.21.15.72:0/3927477724 <== mon.0 v2:172.21.15.72:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7feb9c012c60 con 0x7feba806eb60 2023-07-25T14:38:12.450 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:12.435+0000 7feb96ffd700 1 --2- 172.21.15.72:0/3927477724 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7feb8806ace0 0x7feb8806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-25T14:38:12.450 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:12.436+0000 7feb96ffd700 1 -- 172.21.15.72:0/3927477724 <== mon.0 v2:172.21.15.72:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 7238+0+0 (secure 0 0 0) 0x7feb9c089a30 con 0x7feba806eb60 2023-07-25T14:38:12.450 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:12.436+0000 7feba5d9b700 1 --2- 172.21.15.72:0/3927477724 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7feb8806ace0 0x7feb8806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-25T14:38:12.450 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:12.436+0000 7feba5d9b700 1 --2- 172.21.15.72:0/3927477724 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7feb8806ace0 0x7feb8806d1a0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7feb98004f30 tx=0x7feb98009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-25T14:38:12.450 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:12.440+0000 7feb96ffd700 1 -- 172.21.15.72:0/3927477724 <== mon.0 v2:172.21.15.72:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176884 (secure 0 0 0) 0x7feb9c0546d0 con 0x7feba806eb60 2023-07-25T14:38:12.714 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:12.704+0000 7febac995700 1 -- 172.21.15.72:0/3927477724 --> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] -- mon_command({"prefix": "auth get", "entity": "client.testuser"} v 0) v1 -- 0x7feba806fb50 con 0x7feba806eb60 2023-07-25T14:38:12.714 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:12.705+0000 7feb96ffd700 1 -- 172.21.15.72:0/3927477724 <== mon.0 v2:172.21.15.72:3300/0 7 ==== mon_command_ack([{"prefix": "auth get", "entity": "client.testuser"}]=0 v19) v1 ==== 85+0+245 (secure 0 0 0) 0x7feb9c057cf0 con 0x7feba806eb60 2023-07-25T14:38:12.715 INFO:teuthology.orchestra.run.smithi072.stdout:[client.testuser] 2023-07-25T14:38:12.715 INFO:teuthology.orchestra.run.smithi072.stdout: key = AQBU3r9kSQ02ERAApLiD5qLtc29oUOlt8jO3rw== 2023-07-25T14:38:12.715 INFO:teuthology.orchestra.run.smithi072.stdout: caps mds = "allow rw fsname=cephfs" 2023-07-25T14:38:12.715 INFO:teuthology.orchestra.run.smithi072.stdout: caps mon = "allow rw fsname=cephfs, allow rw fsname=cephfs2" 2023-07-25T14:38:12.715 INFO:teuthology.orchestra.run.smithi072.stdout: caps osd = "allow rw tag cephfs data=cephfs, allow rw tag cephfs data=cephfs2" 2023-07-25T14:38:12.716 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:12.707+0000 7febac995700 1 -- 172.21.15.72:0/3927477724 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7feb8806ace0 msgr2=0x7feb8806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:38:12.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:12.707+0000 7febac995700 1 --2- 172.21.15.72:0/3927477724 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7feb8806ace0 0x7feb8806d1a0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7feb98004f30 tx=0x7feb98009040 comp rx=0 tx=0).stop 2023-07-25T14:38:12.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:12.707+0000 7febac995700 1 -- 172.21.15.72:0/3927477724 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feba806eb60 msgr2=0x7feba814c040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-25T14:38:12.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:12.707+0000 7febac995700 1 --2- 172.21.15.72:0/3927477724 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feba806eb60 0x7feba814c040 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7feb9c00d7d0 tx=0x7feb9c00db90 comp rx=0 tx=0).stop 2023-07-25T14:38:12.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:12.707+0000 7febac995700 1 -- 172.21.15.72:0/3927477724 shutdown_connections 2023-07-25T14:38:12.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:12.707+0000 7febac995700 1 --2- 172.21.15.72:0/3927477724 >> [v2:172.21.15.72:6832/1171220306,v1:172.21.15.72:6833/1171220306] conn(0x7feb8806ace0 0x7feb8806d1a0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:38:12.717 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:12.707+0000 7febac995700 1 --2- 172.21.15.72:0/3927477724 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feba8151870 0x7feba81e9ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:38:12.718 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:12.707+0000 7febac995700 1 --2- 172.21.15.72:0/3927477724 >> [v2:172.21.15.72:3300/0,v1:172.21.15.72:6789/0] conn(0x7feba806eb60 0x7feba814c040 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:38:12.718 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:12.707+0000 7febac995700 1 --2- 172.21.15.72:0/3927477724 >> [v2:172.21.15.92:3301/0,v1:172.21.15.92:6790/0] conn(0x7feba80c47b0 0x7feba81ed660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-25T14:38:12.718 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:12.707+0000 7febac995700 1 -- 172.21.15.72:0/3927477724 >> 172.21.15.72:0/3927477724 conn(0x7feba80c68b0 msgr2=0x7feba8071500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-25T14:38:12.718 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:12.707+0000 7febac995700 1 -- 172.21.15.72:0/3927477724 shutdown_connections 2023-07-25T14:38:12.718 INFO:teuthology.orchestra.run.smithi072.stderr:2023-07-25T14:38:12.707+0000 7febac995700 1 -- 172.21.15.72:0/3927477724 wait complete. 2023-07-25T14:38:12.728 DEBUG:teuthology.orchestra.run.smithi072:> mktemp 2023-07-25T14:38:12.745 INFO:teuthology.orchestra.run.smithi072.stdout:/tmp/tmp.B3hfMkMjkz 2023-07-25T14:38:12.745 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-07-25T14:38:12.746 DEBUG:teuthology.orchestra.run.smithi072:> dd of=/tmp/tmp.B3hfMkMjkz 2023-07-25T14:38:12.791 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/teuthology/orchestra/run.py", line 309, in copy_and_close shutil.copyfileobj(src, fdst) File "/usr/lib/python3.8/shutil.py", line 199, in copyfileobj fsrc_read = fsrc.read AttributeError: 'RemoteProcess' object has no attribute 'read' 2023-07-25T14:38:16.021 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T14:38:16.023 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T14:38:46.084 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T14:38:46.087 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T14:39:16.146 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T14:39:16.148 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T14:39:46.215 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T14:39:46.218 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T14:40:16.292 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T14:40:16.295 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T14:40:46.378 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T14:40:46.382 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T14:41:16.445 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T14:41:16.448 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T14:41:46.511 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T14:41:46.516 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T14:42:16.578 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T14:42:16.582 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T14:42:46.649 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T14:42:46.652 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T14:43:16.718 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T14:43:16.722 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T14:43:46.803 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T14:43:46.807 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T14:44:16.873 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T14:44:16.876 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T14:44:46.933 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T14:44:46.937 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T14:45:17.004 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T14:45:17.006 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T14:45:47.097 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T14:45:47.101 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T14:46:17.167 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T14:46:17.170 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T14:46:47.234 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T14:46:47.239 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T14:47:17.306 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T14:47:17.309 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T14:47:47.388 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T14:47:47.391 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T14:48:17.458 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T14:48:17.461 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T14:48:47.523 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T14:48:47.527 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T14:49:17.593 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T14:49:17.596 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T14:49:47.656 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T14:49:47.662 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T14:50:17.738 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T14:50:17.740 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T14:50:47.814 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T14:50:47.817 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T14:51:17.897 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T14:51:17.900 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T14:51:47.963 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T14:51:47.966 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T14:52:18.023 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T14:52:18.026 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T14:52:48.094 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T14:52:48.098 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T14:53:18.342 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T14:53:18.346 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T14:53:48.415 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T14:53:48.419 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T14:54:18.488 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T14:54:18.494 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T14:54:48.558 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T14:54:48.561 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T14:55:18.629 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T14:55:18.633 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T14:55:48.691 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T14:55:48.694 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T14:56:18.794 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T14:56:18.797 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T14:56:48.855 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T14:56:48.858 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T14:57:18.925 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T14:57:18.928 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T14:57:49.004 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T14:57:49.007 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T14:58:19.077 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T14:58:19.080 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T14:58:49.148 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T14:58:49.150 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T14:59:19.220 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T14:59:19.223 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T14:59:49.295 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T14:59:49.298 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:00:19.383 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:00:19.386 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:00:49.454 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:00:49.457 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:01:19.540 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:01:19.543 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:01:49.618 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:01:49.621 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:02:19.697 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:02:19.699 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:02:49.761 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:02:49.764 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:03:19.836 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:03:19.838 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:03:49.906 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:03:49.909 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:04:19.984 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:04:19.987 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:04:50.052 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:04:50.055 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:05:20.115 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:05:20.118 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:05:50.202 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:05:50.206 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:06:20.287 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:06:20.291 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:06:50.358 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:06:50.361 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:07:20.438 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:07:20.441 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:07:50.507 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:07:50.510 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:08:20.577 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:08:20.581 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:08:50.646 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:08:50.649 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:09:20.724 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:09:20.727 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:09:50.790 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:09:50.793 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:10:20.873 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:10:20.876 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:10:50.943 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:10:50.946 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:11:21.013 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:11:21.015 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:11:51.091 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:11:51.093 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:12:21.161 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:12:21.164 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:12:51.223 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:12:51.226 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:13:21.439 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:13:21.442 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:13:51.503 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:13:51.506 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:14:21.573 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:14:21.575 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:14:51.634 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:14:51.637 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:15:21.704 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:15:21.707 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:15:51.783 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:15:51.786 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:16:21.865 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:16:21.868 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:16:51.948 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:16:51.951 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:17:22.026 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:17:22.029 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:17:52.087 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:17:52.090 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:18:22.156 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:18:22.160 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:18:52.259 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:18:52.262 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:19:22.322 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:19:22.325 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:19:52.404 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:19:52.407 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:20:22.464 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:20:22.467 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:20:52.546 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:20:52.548 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:21:22.687 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:21:22.690 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:21:52.775 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:21:52.777 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:22:22.871 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:22:22.874 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:22:52.938 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:22:52.941 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:23:23.003 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:23:23.007 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:23:53.068 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:23:53.071 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:24:23.138 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:24:23.144 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:24:53.213 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:24:53.217 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:25:23.283 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:25:23.286 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:25:53.377 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:25:53.381 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:26:23.446 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:26:23.449 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:26:53.515 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:26:53.518 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:27:23.609 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:27:23.612 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:27:53.695 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:27:53.698 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:28:23.764 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:28:23.767 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:28:53.846 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:28:53.849 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:29:23.971 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:29:23.974 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:29:54.033 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:29:54.036 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:30:24.119 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:30:24.122 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:30:54.202 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:30:54.209 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:31:24.275 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:31:24.277 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:31:54.366 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:31:54.369 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:32:24.467 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:32:24.470 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:32:54.532 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:32:54.535 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:33:24.661 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:33:24.666 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:33:54.750 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:33:54.754 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:34:24.834 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:34:24.838 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:34:54.913 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:34:54.918 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:35:24.982 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:35:24.988 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:35:55.046 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:35:55.050 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:36:25.113 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:36:25.116 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:36:55.182 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:36:55.189 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:37:25.277 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:37:25.279 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:37:55.345 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:37:55.348 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:38:25.433 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:38:25.436 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:38:55.557 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:38:55.561 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:39:25.622 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:39:25.625 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:39:55.700 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:39:55.703 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:40:25.779 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:40:25.782 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:40:55.856 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:40:55.860 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:41:25.925 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:41:25.929 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:41:56.004 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:41:56.007 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:42:26.090 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:42:26.092 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:42:56.159 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:42:56.162 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:43:26.225 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:43:26.229 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:43:56.290 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:43:56.293 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:44:26.410 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:44:26.415 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:44:56.490 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:44:56.493 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:45:26.564 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:45:26.567 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:45:56.635 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:45:56.639 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:46:26.722 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:46:26.725 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:46:56.794 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:46:56.797 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:47:26.936 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:47:26.939 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:47:57.014 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:47:57.016 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:48:27.158 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:48:27.161 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:48:57.255 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:48:57.258 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:49:27.389 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:49:27.392 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:49:57.509 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:49:57.511 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:50:27.653 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:50:27.656 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:50:57.718 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:50:57.721 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:51:27.859 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:51:27.862 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:51:57.978 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:51:57.981 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:52:28.140 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:52:28.142 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:52:58.218 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:52:58.221 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:53:28.362 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:53:28.364 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:53:58.508 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:53:58.511 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:54:28.601 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:54:28.604 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:54:58.745 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:54:58.748 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:55:28.815 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:55:28.818 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:55:58.943 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:55:58.946 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:56:29.071 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:56:29.074 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:56:59.157 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:56:59.160 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:57:29.326 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:57:29.329 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:57:59.478 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:57:59.481 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:58:29.622 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:58:29.625 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:58:59.700 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:58:59.703 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:59:29.834 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:59:29.838 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:59:59.954 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T15:59:59.957 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:00:30.034 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:00:30.037 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:01:00.102 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:01:00.104 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:01:30.245 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:01:30.248 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:02:00.349 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:02:00.352 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:02:30.483 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:02:30.486 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:03:00.628 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:03:00.631 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:03:30.747 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:03:30.750 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:04:00.891 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:04:00.893 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:04:30.977 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:04:30.980 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:05:01.113 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:05:01.115 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:05:31.223 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:05:31.226 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:06:01.326 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:06:01.329 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:06:31.462 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:06:31.465 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:07:01.598 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:07:01.600 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:07:31.734 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:07:31.738 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:08:01.887 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:08:01.890 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:08:31.947 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:08:31.949 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:09:02.059 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:09:02.062 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:09:32.194 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:09:32.198 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:10:02.322 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:10:02.325 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:10:32.484 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:10:32.486 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:11:02.611 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:11:02.614 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:11:32.731 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:11:32.734 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:12:02.858 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:12:02.861 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:12:32.937 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:12:32.940 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:13:03.022 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:13:03.025 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:13:33.085 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:13:33.088 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:14:03.235 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:14:03.238 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:14:33.338 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:14:33.341 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:15:03.424 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:15:03.427 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:15:33.544 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:15:33.547 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:16:03.671 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:16:03.674 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:16:33.823 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:16:33.826 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:17:03.968 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:17:03.971 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:17:34.097 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:17:34.100 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:18:04.174 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:18:04.177 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:18:34.326 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:18:34.328 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:19:04.404 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:19:04.407 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:19:34.539 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:19:34.543 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:20:04.625 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:20:04.629 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:20:34.762 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:20:34.765 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:21:04.882 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:21:04.885 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:21:35.026 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:21:35.029 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:22:05.087 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:22:05.091 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:22:35.240 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:22:35.243 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:23:05.359 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:23:05.362 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:23:35.487 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:23:35.489 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:24:05.597 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:24:05.600 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:24:35.726 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:24:35.729 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:25:05.886 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:25:05.890 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:25:35.951 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:25:35.953 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:26:06.110 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:26:06.113 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:26:36.246 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:26:36.249 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:27:06.390 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:27:06.394 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:27:36.527 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:27:36.530 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:28:06.613 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:28:06.616 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:28:36.898 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:28:36.901 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:29:06.959 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:29:06.962 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:29:37.040 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:29:37.043 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:30:07.157 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:30:07.160 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:30:37.302 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:30:37.305 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:31:07.412 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:31:07.416 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:31:37.542 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:31:37.545 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:32:07.620 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:32:07.624 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:32:37.775 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:32:37.777 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:33:07.912 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:33:07.915 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:33:38.041 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:33:38.043 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:34:08.111 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:34:08.114 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:34:38.224 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:34:38.227 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:35:08.353 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:35:08.356 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:35:38.474 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:35:38.477 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:36:08.628 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:36:08.631 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:36:38.780 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:36:38.783 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:37:08.859 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:37:08.862 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:37:38.996 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:37:39.000 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:38:09.091 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:38:09.094 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:38:39.237 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:38:39.240 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:39:09.357 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:39:09.360 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:39:39.428 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:39:39.430 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:40:09.548 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:40:09.551 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:40:39.676 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:40:39.679 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:41:09.772 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:41:09.775 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:41:39.934 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:41:39.937 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:42:10.062 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:42:10.065 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:42:40.143 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:42:40.146 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:43:10.278 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:43:10.281 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:43:40.406 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:43:40.408 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:44:10.475 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:44:10.478 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:44:40.637 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:44:40.640 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:45:10.765 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:45:10.768 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:45:40.835 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:45:40.838 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:46:10.980 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:46:10.983 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:46:41.091 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:46:41.094 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:47:11.224 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:47:11.229 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:47:41.376 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:47:41.379 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:48:11.526 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:48:11.530 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:48:41.604 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:48:41.607 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:49:11.750 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:49:11.753 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:49:42.077 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:49:42.083 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:50:12.138 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:50:12.142 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:50:42.203 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:50:42.206 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:51:12.269 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:51:12.273 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:51:42.406 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:51:42.410 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:52:12.469 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:52:12.472 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:52:42.607 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:52:42.610 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:53:12.725 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:53:12.728 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:53:42.794 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:53:42.797 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:54:12.867 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:54:12.870 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:54:43.002 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:54:43.005 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:55:13.155 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:55:13.158 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:55:43.316 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:55:43.320 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:56:13.385 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:56:13.388 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:56:43.505 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:56:43.509 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:57:13.651 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:57:13.654 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:57:43.779 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:57:43.782 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:58:13.856 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:58:13.859 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:58:44.001 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:58:44.004 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:59:14.122 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:59:14.125 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:59:44.257 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T16:59:44.260 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:00:14.369 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:00:14.371 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:00:44.498 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:00:44.501 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:01:14.568 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:01:14.571 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:01:44.645 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:01:44.648 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:02:14.715 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:02:14.719 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:02:44.877 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:02:44.880 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:03:14.955 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:03:14.958 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:03:45.107 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:03:45.110 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:04:15.227 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:04:15.230 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:04:45.348 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:04:45.351 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:05:15.422 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:05:15.425 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:05:45.549 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:05:45.552 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:06:15.803 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:06:15.807 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:06:45.874 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:06:45.877 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:07:15.993 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:07:15.996 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:07:46.106 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:07:46.109 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:08:16.244 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:08:16.247 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:08:46.364 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:08:46.367 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:09:16.518 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:09:16.522 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:09:46.681 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:09:46.683 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:10:16.751 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:10:16.754 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:10:46.822 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:10:46.825 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:11:16.894 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:11:16.896 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:11:46.959 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:11:46.963 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:12:17.034 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:12:17.036 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:12:47.111 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:12:47.114 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:13:17.189 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:13:17.192 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:13:47.328 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:13:47.331 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:14:17.389 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:14:17.392 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:14:47.453 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:14:47.456 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:15:18.212 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:15:18.215 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:15:48.308 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:15:48.311 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:16:18.445 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:16:18.448 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:16:48.507 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:16:48.511 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:17:18.661 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:17:18.664 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:17:48.764 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:17:48.768 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:18:18.934 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:18:18.938 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:18:49.055 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:18:49.059 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:19:19.207 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:19:19.211 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:19:49.344 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:19:49.348 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:20:19.415 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:20:19.419 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:20:49.543 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:20:49.546 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:21:19.687 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:21:19.691 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:21:49.816 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:21:49.821 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:22:19.947 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:22:19.950 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:22:50.065 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:22:50.068 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:23:20.367 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:23:20.373 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:23:50.462 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:23:50.466 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:24:20.592 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:24:20.595 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:24:50.702 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:24:50.704 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:25:20.772 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:25:20.775 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:25:50.875 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:25:50.878 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:26:21.012 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:26:21.015 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:26:51.107 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:26:51.110 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:27:21.260 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:27:21.263 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:27:51.321 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:27:51.324 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:28:21.491 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:28:21.494 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:28:51.612 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:28:51.615 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:29:21.764 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:29:21.767 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:29:51.861 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:29:51.864 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:30:22.021 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:30:22.024 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:30:52.125 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:30:52.127 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:31:22.244 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:31:22.247 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:31:52.331 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:31:52.334 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:32:22.459 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:32:22.462 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:32:52.579 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:32:52.583 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:33:22.691 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:33:22.694 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:33:52.844 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:33:52.847 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:34:22.947 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:34:22.950 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:34:53.078 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:34:53.082 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:35:23.211 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:35:23.214 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:35:53.273 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:35:53.276 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:36:23.409 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:36:23.411 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:36:53.512 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:36:53.515 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:37:23.674 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:37:23.677 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:37:53.802 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:37:53.805 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:38:23.914 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:38:23.916 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:38:54.042 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:38:54.045 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:39:24.186 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:39:24.189 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:39:54.264 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:39:54.268 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:40:24.386 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:40:24.389 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:40:54.524 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:40:54.527 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:41:24.588 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:41:24.591 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:41:54.724 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:41:54.727 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:42:24.879 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:42:24.882 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:42:55.019 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:42:55.022 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:43:25.113 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:43:25.116 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:43:55.176 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:43:55.179 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:44:25.305 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:44:25.309 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:44:55.408 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:44:55.411 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:45:25.470 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:45:25.473 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:45:55.590 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:45:55.593 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:46:25.719 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:46:25.722 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:46:55.782 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:46:55.785 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:47:25.937 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:47:25.940 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:47:56.005 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:47:56.008 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:48:26.168 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:48:26.171 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:48:56.305 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:48:56.307 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:49:26.426 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:49:26.429 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:49:56.580 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:49:56.584 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:50:26.715 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:50:26.717 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:50:57.117 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:50:57.120 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:51:27.183 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:51:27.185 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:51:57.302 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:51:57.305 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:52:27.457 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:52:27.459 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:52:57.535 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:52:57.539 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:53:27.681 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:53:27.683 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:53:57.833 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:53:57.836 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:54:28.176 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:54:28.179 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:54:58.249 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:54:58.252 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:55:28.337 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:55:28.341 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:55:58.490 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:55:58.493 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:56:28.627 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:56:28.630 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:56:58.689 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:56:58.692 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:57:28.834 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:57:28.837 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:57:58.954 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:57:58.957 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:58:29.116 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:58:29.119 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:58:59.190 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:58:59.193 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:59:29.299 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:59:29.303 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:59:59.443 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T17:59:59.446 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:00:29.615 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:00:29.623 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:00:59.695 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:00:59.698 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:01:29.846 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:01:29.849 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:01:59.957 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:01:59.962 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:02:30.103 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:02:30.106 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:03:00.178 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:03:00.181 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:03:30.317 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:03:30.320 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:04:00.379 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:04:00.382 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:04:30.534 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:04:30.538 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:05:00.595 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:05:00.598 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:05:30.678 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:05:30.681 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:06:00.802 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:06:00.806 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:06:30.868 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:06:30.872 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:07:00.937 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:07:00.939 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:07:31.014 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:07:31.018 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:08:01.101 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:08:01.105 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:08:31.202 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:08:31.205 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:09:01.314 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:09:01.318 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:09:31.442 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:09:31.445 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:10:01.587 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:10:01.591 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:10:31.732 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:10:31.735 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:11:01.804 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:11:01.807 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:11:31.972 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:11:31.976 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:12:02.100 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:12:02.104 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:12:32.245 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:12:32.248 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:13:02.408 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:13:02.411 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:13:32.485 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:13:32.488 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:14:02.611 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:14:02.614 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:14:32.711 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:14:32.713 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:15:02.837 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:15:02.840 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:15:32.978 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:15:32.981 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:16:03.096 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:16:03.100 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:16:33.221 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:16:33.224 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:17:03.498 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:17:03.501 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:17:33.582 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:17:33.585 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:18:03.700 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:18:03.703 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:18:33.776 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:18:33.779 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:19:03.934 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:19:03.937 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:19:34.019 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:19:34.022 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:20:04.163 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:20:04.166 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:20:34.299 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:20:34.303 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:21:04.458 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:21:04.460 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:21:34.520 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:21:34.524 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:22:04.588 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:22:04.591 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:22:34.704 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:22:34.707 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:23:04.815 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:23:04.819 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:23:34.983 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:23:34.986 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:24:05.119 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:24:05.123 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:24:35.238 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:24:35.240 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:25:05.390 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:25:05.395 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:25:35.468 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:25:35.471 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:26:05.595 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:26:05.598 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:26:35.697 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:26:35.701 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:27:05.824 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:27:05.827 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:27:35.935 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:27:35.937 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:28:06.079 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:28:06.082 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:28:36.190 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:28:36.193 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:29:06.343 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:29:06.346 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:29:36.476 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:29:36.479 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:30:06.621 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:30:06.624 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:30:36.752 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:30:36.754 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:31:06.870 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:31:06.873 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:31:37.015 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:31:37.018 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:32:07.175 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:32:07.178 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:32:37.287 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:32:37.290 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:33:07.448 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:33:07.451 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:33:37.594 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:33:37.596 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:34:07.656 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:34:07.659 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:34:37.723 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:34:37.726 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:35:07.796 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:35:07.800 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:35:37.870 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:35:37.873 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:36:07.939 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:36:07.943 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:36:38.012 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:36:38.016 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:37:08.072 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:37:08.075 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:37:38.149 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:37:38.152 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:38:08.222 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:38:08.224 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:38:38.304 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:38:38.308 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:39:08.382 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:39:08.385 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:39:38.526 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:39:38.531 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:40:08.637 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:40:08.640 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:40:38.766 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:40:38.768 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:41:08.876 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:41:08.879 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:41:39.013 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:41:39.016 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:42:09.233 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:42:09.236 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:42:39.352 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:42:39.355 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:43:09.471 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:43:09.474 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:43:39.544 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:43:39.547 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:44:09.677 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:44:09.680 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:44:39.797 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:44:39.800 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:45:09.925 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:45:09.928 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:45:40.004 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:45:40.008 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:46:10.156 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:46:10.161 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:46:40.276 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:46:40.279 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:47:10.341 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:47:10.344 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:47:40.490 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:47:40.495 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:48:10.643 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:48:10.647 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:48:40.740 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:48:40.744 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:49:10.885 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:49:10.888 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:49:41.046 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:49:41.049 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:50:11.116 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:50:11.119 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:50:41.245 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:50:41.248 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:51:11.323 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:51:11.325 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:51:41.444 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:51:41.448 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:52:11.581 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:52:11.585 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:52:41.646 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:52:41.650 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:53:11.797 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:53:11.799 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:53:41.966 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:53:41.972 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:54:12.120 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:54:12.123 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:54:42.215 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:54:42.218 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:55:12.290 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:55:12.292 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:55:42.414 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:55:42.417 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:56:12.491 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:56:12.494 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:56:42.621 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:56:42.624 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:57:12.731 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:57:12.735 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:57:42.877 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:57:42.880 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:58:12.948 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:58:12.952 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:58:43.093 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:58:43.097 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:59:13.214 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:59:13.216 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:59:43.342 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T18:59:43.345 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:00:13.490 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:00:13.493 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:00:43.625 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:00:43.627 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:01:13.735 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:01:13.739 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:01:43.855 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:01:43.858 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:02:13.985 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:02:13.987 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:02:44.096 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:02:44.099 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:03:14.241 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:03:14.244 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:03:44.352 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:03:44.355 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:04:14.489 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:04:14.492 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:04:44.575 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:04:44.579 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:05:14.712 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:05:14.715 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:05:44.833 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:05:44.836 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:06:14.977 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:06:14.979 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:06:45.131 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:06:45.133 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:07:15.274 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:07:15.277 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:07:45.395 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:07:45.398 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:08:15.472 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:08:15.475 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:08:45.551 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:08:45.555 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:09:15.679 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:09:15.682 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:09:45.741 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:09:45.743 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:10:15.810 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:10:15.813 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:10:45.888 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:10:45.891 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:11:16.046 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:11:16.049 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:11:46.211 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:11:46.214 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:12:16.281 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:12:16.284 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:12:46.408 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:12:46.411 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:13:16.463 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:13:16.466 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:13:46.554 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:13:46.558 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:14:16.676 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:14:16.680 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:14:46.814 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:14:46.816 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:15:16.934 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:15:16.937 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:15:47.086 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:15:47.089 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:16:17.323 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:16:17.326 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:16:47.442 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:16:47.446 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:17:17.500 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:17:17.504 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:17:47.573 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:17:47.576 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:18:17.702 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:18:17.705 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:18:47.846 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:18:47.850 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:19:17.983 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:19:17.986 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:19:48.119 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:19:48.122 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:20:18.264 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:20:18.268 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:20:48.417 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:20:48.420 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:21:18.504 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:21:18.508 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:21:48.650 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:21:48.653 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:22:18.718 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:22:18.721 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:22:48.863 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:22:48.866 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:23:19.004 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:23:19.007 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:23:49.101 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:23:49.104 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:24:19.237 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:24:19.240 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:24:49.349 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:24:49.352 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:25:19.484 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:25:19.487 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:25:49.596 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:25:49.599 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:26:19.697 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:26:19.700 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:26:49.851 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:26:49.859 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:27:20.012 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:27:20.015 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:27:50.123 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:27:50.126 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:28:20.259 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:28:20.262 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:28:50.370 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:28:50.372 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:29:20.506 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:29:20.509 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:29:50.634 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:29:50.637 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:30:20.704 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:30:20.707 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:30:50.848 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:30:50.851 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:31:20.984 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:31:20.987 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:31:51.095 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:31:51.098 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:32:21.215 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:32:21.218 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:32:51.326 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:32:51.329 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:33:21.472 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:33:21.474 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:33:51.546 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:33:51.550 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:34:21.610 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:34:21.613 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:34:51.746 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:34:51.749 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:35:21.883 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:35:21.885 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:35:51.950 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:35:51.953 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:36:22.105 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:36:22.108 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:36:52.233 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:36:52.236 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:37:22.369 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:37:22.372 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:37:52.514 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:37:52.517 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:38:22.583 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:38:22.586 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:38:52.753 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:38:52.755 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:39:22.822 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:39:22.825 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:39:52.959 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:39:52.961 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:40:23.104 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:40:23.110 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:40:53.165 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:40:53.168 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:41:23.485 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:41:23.488 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:41:53.545 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:41:53.547 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:42:23.668 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:42:23.671 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:42:53.806 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:42:53.809 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:43:23.939 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:43:23.942 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:43:54.092 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:43:54.094 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:44:24.152 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:44:24.155 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:44:54.272 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:44:54.276 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:45:24.418 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:45:24.421 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:45:54.489 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:45:54.493 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:46:24.633 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:46:24.641 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:46:54.776 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:46:54.779 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:47:24.904 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:47:24.907 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:47:55.058 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:47:55.061 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:48:25.160 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:48:25.163 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:48:55.322 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:48:55.325 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:49:25.391 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:49:25.394 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:49:55.527 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:49:55.530 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:50:25.597 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:50:25.600 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:50:55.702 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:50:55.706 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:51:25.797 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:51:25.800 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:51:55.859 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:51:55.863 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:52:25.936 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:52:25.940 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:52:56.048 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:52:56.051 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:53:26.193 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:53:26.196 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:53:56.271 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:53:56.274 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:54:26.340 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:54:26.343 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:54:56.485 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:54:56.488 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:55:26.630 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:55:26.633 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:55:56.691 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:55:56.694 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:56:26.845 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:56:26.848 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:56:56.988 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:56:56.991 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:57:27.116 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:57:27.119 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:57:57.310 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:57:57.313 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:58:27.390 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:58:27.393 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:58:57.482 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:58:57.485 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:59:27.555 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:59:27.558 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:59:57.703 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T19:59:57.706 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:00:27.855 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:00:27.858 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:00:58.000 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:00:58.003 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:01:28.111 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:01:28.115 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:01:58.190 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:01:58.193 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:02:28.267 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:02:28.270 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:02:58.343 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:02:58.346 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:03:28.504 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:03:28.507 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:03:58.674 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:03:58.677 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:04:28.806 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:04:28.812 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:04:58.964 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:04:58.968 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:05:29.108 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:05:29.111 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:05:59.218 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:05:59.221 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:06:29.364 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:06:29.368 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:06:59.449 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:06:59.474 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:07:29.535 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:07:29.538 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:07:59.605 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:07:59.608 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:08:29.733 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:08:29.736 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:08:59.877 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:08:59.879 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:09:29.942 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:09:29.945 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:10:00.074 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:10:00.076 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:10:30.141 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:10:30.144 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:11:00.213 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:11:00.216 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:11:30.274 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:11:30.277 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:12:00.411 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:12:00.415 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:12:30.564 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:12:30.567 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:13:00.641 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:13:00.645 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:13:30.777 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:13:30.780 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:14:00.872 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:14:00.875 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:14:30.983 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:14:30.986 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:15:01.286 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:15:01.290 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:15:31.356 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:15:31.359 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:16:01.418 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:16:01.421 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:16:31.479 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:16:31.483 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:17:01.607 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:17:01.609 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:17:31.717 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:17:31.720 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:18:01.837 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:18:01.840 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:18:31.981 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:18:31.984 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:19:02.051 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:19:02.054 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:19:32.138 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:19:32.141 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:20:02.283 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:20:02.286 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:20:32.411 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:20:32.415 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:21:02.531 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:21:02.534 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:21:32.668 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:21:32.671 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:22:02.812 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:22:02.816 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:22:32.890 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:22:32.899 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:23:03.027 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:23:03.030 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:23:33.088 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:23:33.092 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:24:03.176 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:24:03.179 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:24:33.243 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:24:33.246 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:25:03.406 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:25:03.409 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:25:33.576 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:25:33.579 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:26:03.696 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:26:03.699 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:26:33.806 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:26:33.810 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:27:03.935 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:27:03.938 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:27:34.004 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:27:34.008 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:28:04.081 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:28:04.084 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:28:34.227 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:28:34.230 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:29:04.381 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:29:04.383 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:29:34.453 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:29:34.456 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:30:04.596 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:30:04.599 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:30:34.732 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:30:34.735 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:31:04.796 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:31:04.799 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:31:34.906 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:31:34.910 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:32:05.055 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:32:05.059 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:32:35.135 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:32:35.138 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:33:05.247 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:33:05.250 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:33:35.359 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:33:35.362 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:34:05.531 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:34:05.534 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:34:35.602 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:34:35.604 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:35:05.672 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:35:05.675 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:35:35.754 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:35:35.757 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:36:05.872 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:36:05.875 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:36:36.026 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:36:36.029 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:37:06.154 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:37:06.158 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:37:36.216 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:37:36.219 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:38:06.388 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:38:06.391 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:38:36.542 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:38:36.544 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:39:06.619 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:39:06.622 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:39:36.757 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:39:36.760 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:40:06.924 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:40:06.927 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:40:37.073 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:40:37.076 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:41:07.168 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:41:07.171 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:41:37.332 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:41:37.336 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:42:07.392 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:42:07.395 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:42:37.546 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:42:37.549 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:43:07.649 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:43:07.652 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:43:37.803 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:43:37.805 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:44:07.898 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:44:07.901 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:44:37.976 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:44:37.980 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:45:08.113 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:45:08.116 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:45:38.275 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:45:38.278 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:46:08.370 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:46:08.373 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:46:38.516 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:46:38.519 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:47:08.627 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:47:08.630 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:47:38.706 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:47:38.709 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:48:08.843 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:48:08.846 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:48:39.004 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:48:39.007 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:49:09.150 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:49:09.153 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:49:39.268 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:49:39.272 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:50:09.405 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:50:09.408 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:50:39.526 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:50:39.529 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:51:09.662 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:51:09.665 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:51:39.916 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:51:39.919 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:52:09.985 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:52:09.988 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:52:40.055 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:52:40.058 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:53:10.191 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:53:10.194 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:53:40.329 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:53:40.332 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:54:10.457 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:54:10.460 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:54:40.586 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:54:40.589 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:55:10.723 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:55:10.726 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:55:40.793 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:55:40.795 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:56:10.904 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:56:10.907 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:56:41.032 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:56:41.035 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:57:11.169 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:57:11.173 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:57:41.272 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:57:41.275 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:58:11.416 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:58:11.420 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:58:41.554 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:58:41.557 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:59:11.674 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:59:11.677 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:59:41.777 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T20:59:41.780 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:00:11.838 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:00:11.842 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:00:41.950 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:00:41.953 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:01:12.062 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:01:12.066 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:01:42.215 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:01:42.220 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:02:12.310 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:02:12.313 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:02:42.455 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:02:42.462 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:03:12.592 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:03:12.595 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:03:42.796 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:03:42.799 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:04:12.934 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:04:12.937 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:04:43.009 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:04:43.012 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:05:13.091 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:05:13.094 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:05:43.221 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:05:43.224 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:06:13.350 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:06:13.353 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:06:43.430 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:06:43.434 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:07:13.551 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:07:13.554 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:07:43.705 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:07:43.708 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:08:13.851 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:08:13.854 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:08:43.916 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:08:43.919 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:09:14.087 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:09:14.090 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:09:44.172 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:09:44.175 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:10:14.317 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:10:14.320 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:10:44.463 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:10:44.466 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:11:14.551 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:11:14.555 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:11:44.689 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:11:44.692 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:12:14.834 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:12:14.838 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:12:44.905 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:12:44.908 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:13:15.052 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:13:15.055 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:13:45.147 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:13:45.151 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:14:15.284 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:14:15.287 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:14:45.404 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:14:45.407 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:15:15.500 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:15:15.503 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:15:45.654 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:15:45.659 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:16:15.766 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:16:15.771 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:16:45.920 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:16:45.924 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:17:16.024 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:17:16.027 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:17:46.144 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:17:46.147 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:18:16.239 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:18:16.244 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:18:46.385 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:18:46.388 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:19:16.463 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:19:16.466 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:19:46.602 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:19:46.606 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:20:16.713 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:20:16.716 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:20:46.909 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:20:46.912 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:21:16.995 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:21:16.999 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:21:47.116 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:21:47.119 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:22:17.235 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:22:17.238 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:22:47.314 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:22:47.317 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:23:17.468 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:23:17.471 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:23:47.613 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:23:47.618 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:24:17.691 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:24:17.694 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:24:47.764 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:24:47.767 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:25:17.893 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:25:17.896 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:25:47.954 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:25:47.956 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:26:18.090 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:26:18.093 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:26:48.156 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:26:48.159 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:27:18.297 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:27:18.300 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:27:48.443 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:27:48.447 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:28:18.572 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:28:18.575 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:28:48.733 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:28:48.736 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:29:18.878 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:29:18.881 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:29:48.973 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:29:48.976 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:30:19.093 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:30:19.096 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:30:49.281 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:30:49.284 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:31:19.367 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:31:19.371 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:31:49.521 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:31:49.524 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:32:19.632 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:32:19.635 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:32:49.735 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:32:49.739 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:33:19.814 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:33:19.817 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:33:49.892 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:33:49.895 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:34:20.063 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:34:20.066 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:34:50.124 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:34:50.127 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:35:20.185 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:35:20.188 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:35:50.340 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:35:50.343 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:36:20.400 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:36:20.403 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:36:50.563 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:36:50.566 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:37:20.682 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:37:20.686 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:37:50.757 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:37:50.760 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:38:20.881 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:38:20.884 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:38:51.042 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:38:51.045 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:39:21.160 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:39:21.163 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:39:51.311 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:39:51.314 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:40:21.438 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:40:21.441 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:40:51.674 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:40:51.677 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:41:21.741 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:41:21.744 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:41:51.802 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:41:51.805 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:42:21.952 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:42:21.955 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:42:52.037 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:42:52.041 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:43:22.165 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:43:22.168 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:43:52.308 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:43:52.311 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:44:22.435 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:44:22.437 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:44:52.546 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:44:52.549 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:45:22.691 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:45:22.694 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:45:52.784 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:45:52.787 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:46:22.920 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:46:22.924 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:46:53.006 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:46:53.008 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:47:23.124 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:47:23.127 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:47:53.268 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:47:53.271 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:48:23.412 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:48:23.415 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:48:53.498 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:48:53.502 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:49:23.676 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:49:23.679 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:49:53.812 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:49:53.815 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:50:23.882 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:50:23.884 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:50:53.951 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:50:53.954 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:51:24.070 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:51:24.073 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:51:54.206 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:51:54.209 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:52:24.326 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:52:24.330 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:52:54.445 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:52:54.447 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:53:24.573 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:53:24.576 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:53:54.734 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:53:54.736 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:54:24.811 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:54:24.814 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:54:54.905 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:54:54.908 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:55:24.984 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:55:24.987 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:55:55.119 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:55:55.122 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:56:25.248 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:56:25.250 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:56:55.316 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:56:55.319 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:57:25.461 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:57:25.464 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:57:55.556 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:57:55.559 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:58:25.617 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:58:25.620 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:58:55.686 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:58:55.689 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:59:25.823 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:59:25.826 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:59:55.967 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T21:59:55.970 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:00:26.037 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:00:26.039 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:00:56.190 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:00:56.193 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:01:26.335 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:01:26.339 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:01:56.480 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:01:56.483 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:02:26.546 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:02:26.549 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:02:56.669 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:02:56.672 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:03:26.731 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:03:26.734 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:03:56.875 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:03:56.878 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:04:27.003 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:04:27.006 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:04:57.131 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:04:57.133 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:05:27.267 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:05:27.270 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:05:57.330 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:05:57.332 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:06:27.399 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:06:27.401 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:06:57.494 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:06:57.496 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:07:27.622 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:07:27.624 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:07:57.749 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:07:57.752 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:08:27.894 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:08:27.897 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:08:58.006 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:08:58.008 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:09:28.159 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:09:28.161 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:09:58.224 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:09:58.226 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:10:28.290 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:10:28.293 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:10:58.444 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:10:58.446 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:11:28.547 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:11:28.550 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:11:58.691 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:11:58.694 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:12:28.786 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:12:28.789 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:12:58.914 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:12:58.917 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:13:29.008 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:13:29.011 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:13:59.153 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:13:59.156 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:14:29.240 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:14:29.243 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:14:59.318 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:14:59.321 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:15:29.379 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:15:29.381 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:15:59.515 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:15:59.518 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:16:29.627 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:16:29.630 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:16:59.755 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:16:59.758 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:17:29.893 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:17:29.896 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:17:59.965 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:17:59.968 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:18:30.107 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:18:30.110 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:19:00.168 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:19:00.171 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:19:30.238 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:19:30.242 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:20:00.392 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:20:00.395 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:20:30.454 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:20:30.458 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:21:00.598 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:21:00.601 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:21:30.701 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:21:30.704 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:22:00.840 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:22:00.843 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:22:30.932 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:22:30.934 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:23:01.085 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:23:01.088 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:23:31.221 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:23:31.224 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:24:01.317 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:24:01.320 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:24:31.453 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:24:31.455 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:25:01.590 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:25:01.593 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:25:31.734 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:25:31.736 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:26:01.813 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:26:01.815 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:26:31.957 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:26:31.980 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:27:02.035 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:27:02.037 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:27:32.163 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:27:32.166 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:28:02.231 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:28:02.234 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:28:32.361 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:28:32.364 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:29:02.430 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:29:02.433 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:29:32.608 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:29:32.612 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:30:02.753 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:30:02.756 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:30:32.909 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:30:32.912 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:31:02.985 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:31:02.988 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:31:33.080 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:31:33.083 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:32:03.142 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:32:03.144 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:32:33.304 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:32:33.307 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:33:03.432 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:33:03.435 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:33:33.576 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:33:33.579 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:34:03.695 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:34:03.698 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:34:33.840 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:34:33.843 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:35:03.902 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:35:03.905 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:35:33.980 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:35:33.983 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:36:04.125 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:36:04.128 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:36:34.253 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:36:34.256 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:37:04.365 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:37:04.368 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:37:34.469 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:37:34.472 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:38:04.613 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:38:04.617 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:38:34.707 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:38:34.713 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:39:04.871 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:39:04.877 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:39:35.055 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:39:35.059 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:40:05.125 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:40:05.129 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:40:35.195 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:40:35.198 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:41:05.357 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:41:05.360 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:41:35.442 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:41:35.446 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:42:05.580 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:42:05.584 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:42:35.701 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:42:35.704 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:43:05.828 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:43:05.833 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:43:35.980 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:43:35.983 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:44:06.045 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:44:06.050 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:44:36.120 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:44:36.125 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:45:06.265 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:45:06.268 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:45:36.409 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:45:36.412 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:46:06.487 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:46:06.489 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:46:36.642 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:46:36.645 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:47:06.710 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:47:06.714 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:47:36.855 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:47:36.858 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:48:06.961 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:48:06.964 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:48:37.105 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:48:37.108 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:49:07.170 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:49:07.173 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:49:37.247 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:49:37.249 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:50:07.329 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:50:07.332 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:50:37.389 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:50:37.392 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:51:07.467 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:51:07.470 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:51:37.538 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:51:37.541 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:52:07.606 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:52:07.609 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:52:37.664 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:52:37.667 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:53:07.737 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:53:07.740 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:53:37.813 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:53:37.816 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:54:07.881 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:54:07.884 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:54:38.013 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:54:38.015 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:55:08.125 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:55:08.128 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:55:38.245 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:55:38.248 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:56:08.350 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:56:08.352 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:56:38.412 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:56:38.415 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:57:08.532 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:57:08.535 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:57:38.669 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:57:38.672 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:58:08.759 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:58:08.762 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:58:38.903 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:58:38.905 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:59:09.048 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:59:09.051 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:59:39.101 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T22:59:39.104 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:00:09.247 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:00:09.250 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:00:39.408 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:00:39.411 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:01:09.504 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:01:09.507 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:01:39.616 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:01:39.619 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:02:09.744 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:02:09.747 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:02:39.889 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:02:39.892 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:03:10.001 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:03:10.004 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:03:40.140 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:03:40.144 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:04:10.250 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:04:10.252 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:04:40.386 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:04:40.389 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:05:10.532 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:05:10.534 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:05:40.612 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:05:40.615 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:06:10.764 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:06:10.768 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:06:40.828 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:06:40.831 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:07:10.970 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:07:10.973 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:07:41.065 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:07:41.072 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:08:11.218 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:08:11.221 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:08:41.306 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:08:41.313 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:09:11.376 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:09:11.389 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:09:41.448 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:09:41.452 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:10:11.526 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:10:11.533 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:10:41.611 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:10:41.615 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:11:11.676 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:11:11.679 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:11:41.743 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:11:41.746 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:12:11.818 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:12:11.821 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:12:41.883 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:12:41.887 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:13:11.960 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:13:11.963 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:13:42.040 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:13:42.043 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:14:12.101 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:14:12.105 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:14:42.166 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:14:42.169 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:15:12.257 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:15:12.260 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:15:42.323 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:15:42.326 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:16:12.383 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:16:12.386 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:16:42.451 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:16:42.454 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:17:12.523 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:17:12.525 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:17:42.658 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:17:42.661 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:18:12.802 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:18:12.805 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:18:42.930 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:18:42.933 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:19:13.067 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:19:13.070 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:19:43.195 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:19:43.198 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:20:13.356 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:20:13.359 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:20:43.511 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:20:43.513 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:21:13.597 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:21:13.600 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:21:43.709 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:21:43.712 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:22:13.861 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:22:13.864 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:22:43.963 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:22:43.966 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:23:14.106 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:23:14.109 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:23:44.167 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:23:44.169 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:24:14.225 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:24:14.228 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:24:44.288 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:24:44.291 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:25:14.355 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:25:14.358 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:25:44.428 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:25:44.431 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:26:14.496 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:26:14.498 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:26:44.568 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:26:44.572 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:27:14.642 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:27:14.645 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:27:44.726 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:27:44.729 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:28:14.782 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:28:14.786 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:28:44.867 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:28:44.871 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:29:14.953 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:29:14.957 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:29:45.013 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:29:45.016 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:30:15.078 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:30:15.081 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:30:45.170 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:30:45.173 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:31:15.231 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:31:15.234 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:31:45.300 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:31:45.303 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:32:15.378 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:32:15.380 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:32:45.442 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:32:45.445 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:33:15.508 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:33:15.511 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:33:45.590 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:33:45.593 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:34:15.655 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:34:15.658 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:34:45.730 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:34:45.733 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:35:15.796 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:35:15.799 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:35:45.863 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:35:45.866 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:36:15.937 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:36:15.940 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:36:46.010 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:36:46.014 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:37:16.073 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:37:16.076 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:37:46.143 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:37:46.146 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:38:16.208 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:38:16.211 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:38:46.275 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:38:46.278 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:39:16.352 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:39:16.355 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:39:46.438 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:39:46.442 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:40:16.499 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:40:16.502 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:40:46.570 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:40:46.573 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:41:16.815 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:41:16.818 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:41:46.881 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:41:46.885 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:42:16.946 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:42:16.950 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:42:47.009 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:42:47.012 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:43:17.070 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:43:17.074 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:43:47.136 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:43:47.139 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:44:17.202 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:44:17.208 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:44:47.286 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:44:47.289 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:45:17.350 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:45:17.353 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:45:47.416 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:45:47.418 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:46:17.517 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:46:17.520 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:46:47.584 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:46:47.589 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:47:17.653 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:47:17.656 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:47:47.814 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:47:47.817 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:48:17.883 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:48:17.886 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:48:47.947 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:48:47.950 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:49:18.038 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:49:18.041 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:49:48.100 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:49:48.104 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:50:18.179 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:50:18.183 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:50:48.266 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:50:48.269 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:51:18.343 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:51:18.346 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:51:48.405 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:51:48.408 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:52:18.478 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:52:18.482 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:52:48.552 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:52:48.555 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:53:18.622 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:53:18.625 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:53:48.684 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:53:48.687 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:54:18.748 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:54:18.751 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:54:48.865 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:54:48.868 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:55:19.001 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:55:19.005 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:55:49.122 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:55:49.125 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:56:19.283 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:56:19.286 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:56:49.352 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:56:49.355 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:57:19.499 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:57:19.501 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:57:49.630 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:57:49.632 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:58:19.738 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:58:19.741 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:58:49.884 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:58:49.887 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:59:20.020 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:59:20.023 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:59:50.115 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-25T23:59:50.117 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:00:20.185 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:00:20.188 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:00:50.290 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:00:50.294 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:01:20.395 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:01:20.398 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:01:50.547 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:01:50.550 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:02:20.683 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:02:20.687 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:02:50.811 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:02:50.815 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:03:20.973 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:03:20.977 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:03:51.033 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:03:51.036 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:04:21.145 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:04:21.148 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:04:51.208 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:04:51.211 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:05:21.274 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:05:21.277 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:05:51.339 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:05:51.341 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:06:21.409 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:06:21.413 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:06:51.471 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:06:51.475 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:07:21.535 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:07:21.538 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:07:51.712 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:07:51.717 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:08:21.798 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:08:21.802 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:08:52.161 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:08:52.163 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:09:22.217 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:09:22.220 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:09:52.392 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:09:52.395 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:10:22.537 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:10:22.539 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:10:52.632 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:10:52.635 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:11:22.785 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:11:22.788 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:11:52.913 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:11:52.917 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:12:23.040 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:12:23.043 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:12:53.185 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:12:53.189 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:13:23.313 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:13:23.317 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:13:53.459 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:13:53.462 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:14:23.570 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:14:23.573 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:14:53.699 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:14:53.702 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:15:23.852 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:15:23.855 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:15:53.971 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:15:53.975 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:16:24.116 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:16:24.119 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:16:54.178 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:16:54.181 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:17:24.306 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:17:24.309 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:17:54.372 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:17:54.375 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:18:24.445 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:18:24.448 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:18:54.590 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:18:54.593 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:19:24.672 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:19:24.675 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:19:54.805 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:19:54.808 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:20:24.944 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:20:24.948 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:20:55.074 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:20:55.077 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:21:25.317 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:21:25.320 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:21:55.386 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:21:55.389 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:22:25.523 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:22:25.526 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:22:55.669 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:22:55.671 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:23:25.813 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:23:25.816 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:23:55.883 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:23:55.886 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:24:26.012 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:24:26.015 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:24:56.139 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:24:56.142 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:25:26.217 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:25:26.220 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:25:56.282 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:25:56.285 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:26:26.383 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:26:26.386 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:26:56.440 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:26:56.443 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:27:26.524 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:27:26.528 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:27:56.591 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:27:56.594 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:28:26.663 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:28:26.674 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:28:56.749 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:28:56.752 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:29:26.836 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:29:26.839 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:29:56.897 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:29:56.900 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:30:26.962 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:30:26.965 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:30:57.027 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:30:57.030 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:31:27.107 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:31:27.110 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:31:57.188 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:31:57.192 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:32:27.269 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:32:27.274 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:32:57.334 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:32:57.337 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:33:27.449 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:33:27.452 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:33:57.507 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:33:57.510 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:34:27.572 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:34:27.574 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:34:57.708 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:34:57.711 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:35:27.844 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:35:27.847 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:35:57.964 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:35:57.967 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:36:28.092 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:36:28.095 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:36:58.169 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:36:58.173 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:37:28.233 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:37:28.238 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:37:58.316 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:37:58.319 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:38:28.373 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:38:28.376 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:38:58.440 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:38:58.446 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:39:28.591 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:39:28.595 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:39:58.657 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:39:58.661 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:40:28.730 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:40:28.734 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:40:58.822 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:40:58.825 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:41:28.890 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:41:28.893 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:41:58.960 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:41:58.963 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:42:29.035 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:42:29.038 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:42:59.099 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:42:59.102 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:43:29.194 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:43:29.197 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:43:59.275 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:43:59.279 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:44:29.344 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:44:29.346 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:44:59.428 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:44:59.431 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:45:29.490 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:45:29.493 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:45:59.556 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:45:59.560 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:46:29.614 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:46:29.618 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:46:59.680 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:46:59.683 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:47:29.769 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:47:29.772 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:47:59.855 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:47:59.858 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:48:29.913 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:48:29.917 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:48:59.979 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:48:59.982 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:49:30.038 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:49:30.041 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:50:00.094 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:50:00.098 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:50:30.164 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:50:30.168 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:51:00.249 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:51:00.251 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:51:30.319 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:51:30.323 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:52:00.385 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:52:00.387 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:52:30.542 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:52:30.546 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:53:00.627 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:53:00.631 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:53:30.765 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:53:30.770 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:54:00.834 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:54:00.838 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:54:30.904 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:54:30.910 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:55:00.974 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:55:00.976 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:55:31.036 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:55:31.039 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:56:01.098 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:56:01.102 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:56:31.180 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:56:31.184 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:57:01.262 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:57:01.265 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:57:31.340 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:57:31.343 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:58:01.402 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:58:01.406 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:58:31.471 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:58:31.474 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:59:01.535 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:59:01.538 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:59:31.617 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T00:59:31.621 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:00:01.674 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:00:01.677 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:00:31.750 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:00:31.753 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:01:01.813 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:01:01.816 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:01:31.883 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:01:31.886 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:02:01.949 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:02:01.952 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:02:32.033 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:02:32.035 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:03:02.107 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:03:02.110 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:03:32.186 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:03:32.190 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:04:02.263 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:04:02.266 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:04:32.322 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:04:32.326 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:05:02.381 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:05:02.384 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:05:32.449 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:05:32.452 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:06:02.509 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:06:02.514 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:06:32.610 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:06:32.613 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:07:02.688 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:07:02.691 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:07:32.753 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:07:32.756 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:08:02.822 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:08:02.826 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:08:32.907 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:08:32.910 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:09:02.964 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:09:02.967 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:09:33.026 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:09:33.028 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:10:03.103 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:10:03.106 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:10:33.174 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:10:33.177 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:11:03.231 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:11:03.234 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:11:33.296 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:11:33.298 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:12:03.451 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:12:03.455 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:12:33.546 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:12:33.549 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:13:03.698 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:13:03.701 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:13:33.816 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:13:33.818 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:14:03.881 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:14:03.884 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:14:34.011 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:14:34.014 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:15:04.113 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:15:04.117 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:15:34.249 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:15:34.252 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:16:04.377 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:16:04.379 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:16:34.470 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:16:34.473 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:17:04.622 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:17:04.625 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:17:34.715 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:17:34.719 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:18:04.862 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:18:04.866 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:18:34.988 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:18:34.991 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:19:05.131 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:19:05.135 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:19:35.193 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:19:35.195 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:20:05.253 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:20:05.255 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:20:35.322 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:20:35.325 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:21:05.409 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:21:05.412 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:21:35.478 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:21:35.481 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:22:05.555 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:22:05.569 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:22:35.648 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:22:35.651 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:23:05.726 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:23:05.729 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:23:35.862 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:23:35.865 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:24:05.931 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:24:05.934 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:24:36.067 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:24:36.070 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:25:06.195 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:25:06.198 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:25:36.364 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:25:36.367 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:26:06.441 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:26:06.444 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:26:36.577 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:26:36.580 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:27:06.655 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:27:06.657 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:27:36.795 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:27:36.798 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:28:06.860 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:28:06.863 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:28:37.005 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:28:37.008 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:29:07.083 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:29:07.087 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:29:37.209 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:29:37.212 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:30:07.328 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:30:07.331 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:30:37.465 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:30:37.468 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:31:07.559 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:31:07.562 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:31:37.703 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:31:37.706 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:32:07.856 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:32:07.862 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:32:37.935 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:32:37.937 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:33:07.995 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:33:07.998 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:33:38.096 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:33:38.099 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:34:08.166 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:34:08.170 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:34:38.328 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:34:38.331 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:35:08.413 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:35:08.416 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:35:38.550 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:35:38.553 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:36:08.678 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:36:08.681 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:36:38.790 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:36:38.803 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:37:08.916 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:37:08.919 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:37:39.085 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:37:39.089 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:38:09.205 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:38:09.212 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:38:39.280 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:38:39.283 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:39:09.429 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:39:09.432 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:39:39.490 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:39:39.493 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:40:09.602 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:40:09.605 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:40:39.748 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:40:39.751 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:41:09.885 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:41:09.889 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:41:39.997 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:41:40.001 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:42:10.116 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:42:10.120 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:42:40.178 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:42:40.182 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:43:10.241 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:43:10.244 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:43:40.410 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:43:40.413 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:44:10.504 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:44:10.508 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:44:40.658 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:44:40.662 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:45:10.769 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:45:10.772 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:45:40.831 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:45:40.834 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:46:10.976 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:46:10.979 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:46:41.171 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:46:41.174 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:47:11.241 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:47:11.245 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:47:41.319 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:47:41.323 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:48:11.464 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:48:11.466 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:48:41.534 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:48:41.537 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:49:11.608 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:49:11.611 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:49:41.690 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:49:41.694 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:50:11.751 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:50:11.754 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:50:41.813 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:50:41.819 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:51:11.875 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:51:11.878 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:51:41.940 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:51:41.943 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:52:12.022 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:52:12.025 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:52:42.092 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:52:42.095 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:53:12.164 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:53:12.171 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:53:42.257 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:53:42.639 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:54:12.697 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:54:12.701 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:54:42.760 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:54:42.763 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:55:12.835 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:55:12.838 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:55:42.899 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:55:42.902 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:56:12.980 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:56:12.984 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:56:43.049 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:56:43.052 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:57:13.115 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:57:13.119 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:57:43.173 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:57:43.176 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:58:13.238 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:58:13.241 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:58:43.313 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:58:43.316 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:59:13.388 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:59:13.391 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:59:43.453 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T01:59:43.456 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T02:00:13.514 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T02:00:13.517 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T02:00:43.593 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T02:00:43.596 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T02:01:13.653 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T02:01:13.655 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T02:01:43.716 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T02:01:43.719 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T02:02:13.801 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T02:02:13.804 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T02:02:43.866 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T02:02:43.869 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T02:03:13.939 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T02:03:13.942 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T02:03:44.001 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T02:03:44.004 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T02:04:14.071 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T02:04:14.105 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T02:04:44.161 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T02:04:44.164 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T02:05:14.227 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T02:05:14.230 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T02:05:44.288 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T02:05:44.291 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T02:06:14.351 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T02:06:14.354 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T02:06:44.416 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T02:06:44.419 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T02:07:14.479 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T02:07:14.482 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T02:07:44.565 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T02:07:44.569 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T02:08:14.643 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T02:08:14.645 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T02:08:44.704 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T02:08:44.710 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T02:09:14.774 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T02:09:14.777 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T02:09:44.868 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T02:09:44.871 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T02:10:14.938 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T02:10:14.941 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T02:10:45.019 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T02:10:45.022 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T02:11:15.084 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T02:11:15.087 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T02:11:45.179 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T02:11:45.181 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T02:12:15.251 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T02:12:15.253 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T02:12:45.310 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T02:12:45.313 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T02:13:15.402 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T02:13:15.405 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T02:13:45.485 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T02:13:45.488 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T02:14:15.554 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T02:14:15.558 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T02:14:45.641 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T02:14:45.644 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T02:15:15.711 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T02:15:15.714 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T02:15:45.815 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T02:15:45.818 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T02:16:15.878 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T02:16:15.882 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T02:16:45.945 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T02:16:45.948 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T02:17:16.012 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T02:17:16.015 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T02:17:46.095 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T02:17:46.098 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T02:18:16.159 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T02:18:16.162 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T02:18:46.226 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T02:18:46.229 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T02:19:16.287 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T02:19:16.290 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T02:19:46.424 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T02:19:46.427 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T02:20:16.486 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T02:20:16.490 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T02:20:46.565 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T02:20:46.568 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T02:21:16.626 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T02:21:16.629 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T02:21:46.688 DEBUG:teuthology.orchestra.run.smithi072:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T02:21:46.691 DEBUG:teuthology.orchestra.run.smithi092:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-26T02:21:57.914 DEBUG:teuthology.exit:Got signal 15; running 1 handler... 2023-07-26T02:21:57.915 DEBUG:teuthology.task.console_log:Killing console logger for smithi072 2023-07-26T02:21:57.915 DEBUG:teuthology.task.console_log:Killing console logger for smithi092 2023-07-26T02:21:57.916 DEBUG:teuthology.exit:Finished running handlers